2024-09-14T10:55:42.889 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-14T10:55:42.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T10:55:43.008 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904156 branch: main description: rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} email: ceph-qa@ceph.com first_in_suite: false job_id: '7904156' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: main ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw d3n l1 datacache persistent path: /tmp/rgw_datacache/ rgw d3n l1 datacache size: 10737418240 rgw d3n l1 local datacache enabled: true rgw enable ops log: true rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 lockdep: true osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 lockdep: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 rgw: compression type: random datacache: true datacache_path: /tmp/rgw_datacache ec-data-pool: false frontend: beast storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 main: RGW11111111111111111 s3 tenant: RGW33333333333333333 force-branch: ceph-master storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 1c941a66c1b420259b8fc5ac19e792dbbf60aded owner: scheduled_teuthology@teuthology priority: 950 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 9419 sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 sleep_before_teardown: 0 subset: 0/1 suite: rgw suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 1c941a66c1b420259b8fc5ac19e792dbbf60aded targets: smithi071.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK28tlrIsjOwE5qybQwNaltt7L9KR/Tgt8XqtZlHDMFTmJn/1zy+4vppBAvj4/cmO6jVH07aniZCQgNjkEDBl5A= smithi157.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEbJBvXBRqO1DqM05afLThufI5ShmBIDdh3ramY6fNMQVTTBT5fRXV/di1/6oCrf/q9BG5ewnUlPB9eHsEzyJYU= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-datacache.sh env: RGW_DATACACHE_PATH: /tmp/rgw_datacache - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_20:40:18 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-14T10:55:43.009 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa; will attempt to use it 2024-09-14T10:55:43.009 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa/tasks 2024-09-14T10:55:43.009 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-14T10:55:43.011 INFO:teuthology.task.internal:Checking packages... 2024-09-14T10:55:43.033 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8' 2024-09-14T10:55:43.034 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-14T10:55:43.034 INFO:teuthology.packaging:ref: None 2024-09-14T10:55:43.034 INFO:teuthology.packaging:tag: None 2024-09-14T10:55:43.034 INFO:teuthology.packaging:branch: main 2024-09-14T10:55:43.034 INFO:teuthology.packaging:sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:55:43.034 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=main 2024-09-14T10:55:43.236 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4907-ga2782315-1jammy 2024-09-14T10:55:43.238 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-14T10:55:43.244 INFO:teuthology.task.internal:no buildpackages task found 2024-09-14T10:55:43.244 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-14T10:55:43.250 INFO:teuthology.task.internal:Saving configuration 2024-09-14T10:55:43.267 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-14T10:55:43.273 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-14T10:55:43.297 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904156', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 10:49:26.404211', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIBxT20BWumacxx/Cmom1m4TYQ5MdrsA9x5MfKfPJ/jm'} 2024-09-14T10:55:43.316 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904156', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 10:49:26.405906', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHL0C5dMNIevJntLekwJAVZhndPJmgcksGiA8wgCTrEF'} 2024-09-14T10:55:43.316 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-14T10:55:43.322 INFO:teuthology.task.internal:roles: ubuntu@smithi071.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-14T10:55:43.322 INFO:teuthology.task.internal:roles: ubuntu@smithi157.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-14T10:55:43.322 INFO:teuthology.run_tasks:Running task console_log... 2024-09-14T10:55:43.386 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f79fac0c940>, signals=[15]) 2024-09-14T10:55:43.387 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-14T10:55:43.392 INFO:teuthology.task.internal:Opening connections... 2024-09-14T10:55:43.392 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi071.front.sepia.ceph.com 2024-09-14T10:55:43.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:55:43.488 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi157.front.sepia.ceph.com 2024-09-14T10:55:43.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:55:43.571 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-14T10:55:43.577 DEBUG:teuthology.orchestra.run.smithi071:> uname -m 2024-09-14T10:55:43.582 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2024-09-14T10:55:43.582 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2024-09-14T10:55:43.628 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-14T10:55:43.628 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="Ubuntu" 2024-09-14T10:55:43.628 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="22.04" 2024-09-14T10:55:43.628 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-14T10:55:43.629 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_CODENAME=jammy 2024-09-14T10:55:43.629 INFO:teuthology.orchestra.run.smithi071.stdout:ID=ubuntu 2024-09-14T10:55:43.629 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE=debian 2024-09-14T10:55:43.629 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-14T10:55:43.629 INFO:teuthology.orchestra.run.smithi071.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-14T10:55:43.629 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-14T10:55:43.629 INFO:teuthology.orchestra.run.smithi071.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-14T10:55:43.629 INFO:teuthology.orchestra.run.smithi071.stdout:UBUNTU_CODENAME=jammy 2024-09-14T10:55:43.630 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2024-09-14T10:55:43.656 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2024-09-14T10:55:43.661 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2024-09-14T10:55:43.662 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2024-09-14T10:55:43.707 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-14T10:55:43.707 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Ubuntu" 2024-09-14T10:55:43.707 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="22.04" 2024-09-14T10:55:43.707 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-14T10:55:43.707 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_CODENAME=jammy 2024-09-14T10:55:43.708 INFO:teuthology.orchestra.run.smithi157.stdout:ID=ubuntu 2024-09-14T10:55:43.708 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE=debian 2024-09-14T10:55:43.708 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-14T10:55:43.708 INFO:teuthology.orchestra.run.smithi157.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-14T10:55:43.708 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-14T10:55:43.708 INFO:teuthology.orchestra.run.smithi157.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-14T10:55:43.709 INFO:teuthology.orchestra.run.smithi157.stdout:UBUNTU_CODENAME=jammy 2024-09-14T10:55:43.709 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2024-09-14T10:55:43.731 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-14T10:55:43.744 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-14T10:55:43.751 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-14T10:55:43.751 DEBUG:teuthology.orchestra.run.smithi071:> test '!' -e /home/ubuntu/cephtest 2024-09-14T10:55:43.754 DEBUG:teuthology.orchestra.run.smithi157:> test '!' -e /home/ubuntu/cephtest 2024-09-14T10:55:43.759 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-14T10:55:43.765 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-14T10:55:43.765 DEBUG:teuthology.orchestra.run.smithi071:> test -z $(ls -A /var/lib/ceph) 2024-09-14T10:55:43.801 DEBUG:teuthology.orchestra.run.smithi157:> test -z $(ls -A /var/lib/ceph) 2024-09-14T10:55:43.887 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-14T10:55:43.943 INFO:teuthology.run_tasks:Running task kernel... 2024-09-14T10:55:43.957 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-14T10:55:43.957 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-14T10:55:43.958 DEBUG:teuthology.orchestra.run.smithi071:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T10:55:43.958 DEBUG:teuthology.orchestra.run.smithi157:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T10:55:43.963 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:55:43.963 DEBUG:teuthology.orchestra.run.smithi071:> uname -r 2024-09-14T10:55:43.964 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:55:43.964 DEBUG:teuthology.orchestra.run.smithi157:> uname -r 2024-09-14T10:55:44.010 INFO:teuthology.orchestra.run.smithi157.stdout:5.15.0-56-generic 2024-09-14T10:55:44.011 INFO:teuthology.task.kernel:Running kernel on smithi157: 5.15.0-56-generic 2024-09-14T10:55:44.011 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get clean 2024-09-14T10:55:44.012 INFO:teuthology.orchestra.run.smithi071.stdout:5.15.0-56-generic 2024-09-14T10:55:44.012 INFO:teuthology.task.kernel:Running kernel on smithi071: 5.15.0-56-generic 2024-09-14T10:55:44.012 DEBUG:teuthology.orchestra.run.smithi071:> sudo apt-get clean 2024-09-14T10:55:44.141 DEBUG:teuthology.orchestra.run.smithi071:> sudo apt-get update 2024-09-14T10:55:44.142 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get update 2024-09-14T10:55:44.269 INFO:teuthology.orchestra.run.smithi071.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-14T10:55:44.271 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T10:55:44.271 INFO:teuthology.orchestra.run.smithi157.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-14T10:55:44.271 INFO:teuthology.orchestra.run.smithi157.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-14T10:55:44.342 INFO:teuthology.orchestra.run.smithi157.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-14T10:55:44.388 INFO:teuthology.orchestra.run.smithi071.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T10:55:44.470 INFO:teuthology.orchestra.run.smithi071.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-14T10:55:44.495 INFO:teuthology.orchestra.run.smithi071.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-14T10:55:44.513 INFO:teuthology.orchestra.run.smithi157.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-14T10:55:44.588 INFO:teuthology.orchestra.run.smithi071.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-14T10:55:44.596 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-14T10:55:44.614 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-14T10:55:44.618 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-14T10:55:44.620 INFO:teuthology.orchestra.run.smithi157.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-14T10:55:44.620 INFO:teuthology.orchestra.run.smithi157.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-14T10:55:44.620 INFO:teuthology.orchestra.run.smithi157.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-14T10:55:44.626 INFO:teuthology.orchestra.run.smithi071.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-14T10:55:44.628 INFO:teuthology.orchestra.run.smithi071.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-14T10:55:44.629 INFO:teuthology.orchestra.run.smithi071.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-14T10:55:44.629 INFO:teuthology.orchestra.run.smithi071.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-14T10:55:44.640 INFO:teuthology.orchestra.run.smithi157.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-14T10:55:44.643 INFO:teuthology.orchestra.run.smithi157.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-14T10:55:44.643 INFO:teuthology.orchestra.run.smithi157.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-14T10:55:44.647 INFO:teuthology.orchestra.run.smithi157.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-14T10:55:44.647 INFO:teuthology.orchestra.run.smithi071.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-14T10:55:44.650 INFO:teuthology.orchestra.run.smithi071.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-14T10:55:44.650 INFO:teuthology.orchestra.run.smithi071.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-14T10:55:44.652 INFO:teuthology.orchestra.run.smithi157.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-14T10:55:44.653 INFO:teuthology.orchestra.run.smithi157.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-14T10:55:44.654 INFO:teuthology.orchestra.run.smithi157.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-14T10:55:44.656 INFO:teuthology.orchestra.run.smithi071.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-14T10:55:44.660 INFO:teuthology.orchestra.run.smithi071.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-14T10:55:44.661 INFO:teuthology.orchestra.run.smithi071.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-14T10:55:44.663 INFO:teuthology.orchestra.run.smithi071.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-14T10:55:44.674 INFO:teuthology.orchestra.run.smithi157.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-14T10:55:44.674 INFO:teuthology.orchestra.run.smithi157.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-14T10:55:44.674 INFO:teuthology.orchestra.run.smithi157.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-14T10:55:44.684 INFO:teuthology.orchestra.run.smithi071.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-14T10:55:44.684 INFO:teuthology.orchestra.run.smithi071.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-14T10:55:44.684 INFO:teuthology.orchestra.run.smithi071.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-14T10:55:44.691 INFO:teuthology.orchestra.run.smithi157.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-14T10:55:44.696 INFO:teuthology.orchestra.run.smithi157.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-14T10:55:44.699 INFO:teuthology.orchestra.run.smithi157.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-14T10:55:44.699 INFO:teuthology.orchestra.run.smithi157.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-14T10:55:44.717 INFO:teuthology.orchestra.run.smithi157.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-14T10:55:44.717 INFO:teuthology.orchestra.run.smithi157.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-14T10:55:44.720 INFO:teuthology.orchestra.run.smithi157.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-14T10:55:44.720 INFO:teuthology.orchestra.run.smithi157.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-14T10:55:44.725 INFO:teuthology.orchestra.run.smithi157.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-14T10:55:44.731 INFO:teuthology.orchestra.run.smithi157.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-14T10:55:44.733 INFO:teuthology.orchestra.run.smithi157.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-14T10:55:44.733 INFO:teuthology.orchestra.run.smithi157.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-14T10:55:44.733 INFO:teuthology.orchestra.run.smithi157.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-14T10:55:44.749 INFO:teuthology.orchestra.run.smithi157.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-14T10:55:44.749 INFO:teuthology.orchestra.run.smithi157.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-14T10:55:44.750 INFO:teuthology.orchestra.run.smithi157.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-14T10:55:44.750 INFO:teuthology.orchestra.run.smithi157.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-14T10:55:44.750 INFO:teuthology.orchestra.run.smithi157.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-14T10:55:44.765 INFO:teuthology.orchestra.run.smithi157.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-14T10:55:44.766 INFO:teuthology.orchestra.run.smithi157.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-14T10:55:44.766 INFO:teuthology.orchestra.run.smithi157.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-14T10:55:44.766 INFO:teuthology.orchestra.run.smithi157.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-14T10:55:44.767 INFO:teuthology.orchestra.run.smithi157.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-14T10:55:44.826 INFO:teuthology.orchestra.run.smithi071.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-14T10:55:44.965 INFO:teuthology.orchestra.run.smithi071.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-14T10:55:45.160 INFO:teuthology.orchestra.run.smithi071.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-14T10:55:45.323 INFO:teuthology.orchestra.run.smithi071.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-14T10:55:45.337 INFO:teuthology.orchestra.run.smithi071.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-14T10:55:45.337 INFO:teuthology.orchestra.run.smithi071.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-14T10:55:45.338 INFO:teuthology.orchestra.run.smithi071.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-14T10:55:45.408 INFO:teuthology.orchestra.run.smithi071.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-14T10:55:45.423 INFO:teuthology.orchestra.run.smithi071.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-14T10:55:45.423 INFO:teuthology.orchestra.run.smithi071.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-14T10:55:45.445 INFO:teuthology.orchestra.run.smithi071.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-14T10:55:45.475 INFO:teuthology.orchestra.run.smithi071.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-14T10:55:45.481 INFO:teuthology.orchestra.run.smithi071.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-14T10:55:45.487 INFO:teuthology.orchestra.run.smithi071.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-14T10:55:45.488 INFO:teuthology.orchestra.run.smithi071.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-14T10:55:45.489 INFO:teuthology.orchestra.run.smithi071.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-14T10:55:45.563 INFO:teuthology.orchestra.run.smithi071.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-14T10:55:45.564 INFO:teuthology.orchestra.run.smithi071.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-14T10:55:45.565 INFO:teuthology.orchestra.run.smithi071.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-14T10:55:45.566 INFO:teuthology.orchestra.run.smithi071.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-14T10:55:45.567 INFO:teuthology.orchestra.run.smithi071.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-14T10:55:45.568 INFO:teuthology.orchestra.run.smithi071.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-14T10:55:45.569 INFO:teuthology.orchestra.run.smithi071.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-14T10:55:45.650 INFO:teuthology.orchestra.run.smithi071.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-14T10:55:45.651 INFO:teuthology.orchestra.run.smithi071.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-14T10:55:50.762 INFO:teuthology.orchestra.run.smithi071.stdout:Fetched 16.0 MB in 2s (7,488 kB/s) 2024-09-14T10:55:50.838 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 16.0 MB in 2s (7,389 kB/s) 2024-09-14T10:55:52.219 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-09-14T10:55:52.237 DEBUG:teuthology.orchestra.run.smithi157:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-14T10:55:52.290 INFO:teuthology.orchestra.run.smithi071.stdout:Reading package lists... 2024-09-14T10:55:52.299 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-09-14T10:55:52.310 DEBUG:teuthology.orchestra.run.smithi071:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-14T10:55:52.375 INFO:teuthology.orchestra.run.smithi071.stdout:Reading package lists... 2024-09-14T10:55:52.510 INFO:teuthology.orchestra.run.smithi157.stdout:Building dependency tree... 2024-09-14T10:55:52.511 INFO:teuthology.orchestra.run.smithi157.stdout:Reading state information... 2024-09-14T10:55:52.587 INFO:teuthology.orchestra.run.smithi071.stdout:Building dependency tree... 2024-09-14T10:55:52.588 INFO:teuthology.orchestra.run.smithi071.stdout:Reading state information... 2024-09-14T10:55:52.701 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T10:55:52.701 INFO:teuthology.orchestra.run.smithi157.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T10:55:52.701 INFO:teuthology.orchestra.run.smithi157.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T10:55:52.702 INFO:teuthology.orchestra.run.smithi157.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T10:55:52.702 INFO:teuthology.orchestra.run.smithi157.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-14T10:55:52.702 INFO:teuthology.orchestra.run.smithi157.stdout: python2.7-minimal 2024-09-14T10:55:52.702 INFO:teuthology.orchestra.run.smithi157.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T10:55:52.703 INFO:teuthology.orchestra.run.smithi157.stdout:The following additional packages will be installed: 2024-09-14T10:55:52.704 INFO:teuthology.orchestra.run.smithi157.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-14T10:55:52.704 INFO:teuthology.orchestra.run.smithi157.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-14T10:55:52.704 INFO:teuthology.orchestra.run.smithi157.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-14T10:55:52.705 INFO:teuthology.orchestra.run.smithi157.stdout:Suggested packages: 2024-09-14T10:55:52.705 INFO:teuthology.orchestra.run.smithi157.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-14T10:55:52.706 INFO:teuthology.orchestra.run.smithi157.stdout:Recommended packages: 2024-09-14T10:55:52.706 INFO:teuthology.orchestra.run.smithi157.stdout: thermald 2024-09-14T10:55:52.750 INFO:teuthology.orchestra.run.smithi157.stdout:The following NEW packages will be installed: 2024-09-14T10:55:52.750 INFO:teuthology.orchestra.run.smithi157.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-14T10:55:52.750 INFO:teuthology.orchestra.run.smithi157.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-14T10:55:52.751 INFO:teuthology.orchestra.run.smithi157.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-14T10:55:52.752 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages will be upgraded: 2024-09-14T10:55:52.753 INFO:teuthology.orchestra.run.smithi157.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-14T10:55:52.776 INFO:teuthology.orchestra.run.smithi071.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T10:55:52.776 INFO:teuthology.orchestra.run.smithi071.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T10:55:52.776 INFO:teuthology.orchestra.run.smithi071.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T10:55:52.777 INFO:teuthology.orchestra.run.smithi071.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T10:55:52.777 INFO:teuthology.orchestra.run.smithi071.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-14T10:55:52.777 INFO:teuthology.orchestra.run.smithi071.stdout: python2.7-minimal 2024-09-14T10:55:52.777 INFO:teuthology.orchestra.run.smithi071.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T10:55:52.778 INFO:teuthology.orchestra.run.smithi071.stdout:The following additional packages will be installed: 2024-09-14T10:55:52.778 INFO:teuthology.orchestra.run.smithi071.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-14T10:55:52.778 INFO:teuthology.orchestra.run.smithi071.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-14T10:55:52.779 INFO:teuthology.orchestra.run.smithi071.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-14T10:55:52.780 INFO:teuthology.orchestra.run.smithi071.stdout:Suggested packages: 2024-09-14T10:55:52.780 INFO:teuthology.orchestra.run.smithi071.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-14T10:55:52.780 INFO:teuthology.orchestra.run.smithi071.stdout:Recommended packages: 2024-09-14T10:55:52.780 INFO:teuthology.orchestra.run.smithi071.stdout: thermald 2024-09-14T10:55:52.830 INFO:teuthology.orchestra.run.smithi071.stdout:The following NEW packages will be installed: 2024-09-14T10:55:52.830 INFO:teuthology.orchestra.run.smithi071.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-14T10:55:52.830 INFO:teuthology.orchestra.run.smithi071.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-14T10:55:52.831 INFO:teuthology.orchestra.run.smithi071.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-14T10:55:52.832 INFO:teuthology.orchestra.run.smithi071.stdout:The following packages will be upgraded: 2024-09-14T10:55:52.832 INFO:teuthology.orchestra.run.smithi071.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-14T10:55:52.882 INFO:teuthology.orchestra.run.smithi071.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-14T10:55:52.882 INFO:teuthology.orchestra.run.smithi071.stdout:Need to get 113 MB of archives. 2024-09-14T10:55:52.882 INFO:teuthology.orchestra.run.smithi071.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-14T10:55:52.883 INFO:teuthology.orchestra.run.smithi071.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-14T10:55:52.932 INFO:teuthology.orchestra.run.smithi157.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-14T10:55:52.932 INFO:teuthology.orchestra.run.smithi157.stdout:Need to get 113 MB of archives. 2024-09-14T10:55:52.933 INFO:teuthology.orchestra.run.smithi157.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-14T10:55:52.933 INFO:teuthology.orchestra.run.smithi157.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-14T10:55:53.317 INFO:teuthology.orchestra.run.smithi071.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-14T10:55:53.426 INFO:teuthology.orchestra.run.smithi071.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-14T10:55:54.250 INFO:teuthology.orchestra.run.smithi071.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-14T10:55:54.250 INFO:teuthology.orchestra.run.smithi071.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-14T10:55:54.250 INFO:teuthology.orchestra.run.smithi071.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-14T10:55:54.349 INFO:teuthology.orchestra.run.smithi157.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-14T10:55:54.372 INFO:teuthology.orchestra.run.smithi071.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-14T10:55:54.393 INFO:teuthology.orchestra.run.smithi071.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-14T10:55:54.698 INFO:teuthology.orchestra.run.smithi157.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-14T10:55:54.878 INFO:teuthology.orchestra.run.smithi071.stdout:Fetched 113 MB in 2s (69.6 MB/s) 2024-09-14T10:55:55.077 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-14T10:55:56.905 INFO:teuthology.orchestra.run.smithi157.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-14T10:55:56.906 INFO:teuthology.orchestra.run.smithi157.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-14T10:55:56.906 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-14T10:55:57.105 INFO:teuthology.orchestra.run.smithi071.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-14T10:55:57.110 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:55:57.174 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:55:57.241 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-14T10:55:57.320 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-14T10:55:57.729 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 113 MB in 5s (24.8 MB/s) 2024-09-14T10:55:57.910 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-14T10:55:59.241 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-14T10:55:59.263 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:55:59.339 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:55:59.845 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-14T10:55:59.865 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:55:59.892 INFO:teuthology.orchestra.run.smithi157.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-14T10:55:59.896 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:55:59.903 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:55:59.983 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:56:02.610 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-14T10:56:02.631 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:56:02.707 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:56:03.188 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-14T10:56:03.208 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:56:03.246 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:56:06.543 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T10:56:06.670 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T10:56:07.003 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T10:56:07.099 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T10:56:07.385 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-14T10:56:07.407 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-14T10:56:07.476 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-14T10:56:09.582 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T10:56:09.707 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T10:56:10.039 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T10:56:10.169 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T10:56:10.455 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-14T10:56:10.477 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-14T10:56:10.522 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-14T10:56:13.174 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-14T10:56:13.211 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:56:13.249 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:56:15.883 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T10:56:16.009 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T10:56:16.051 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-14T10:56:16.088 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:56:16.126 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:56:16.316 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-14T10:56:16.438 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:56:16.564 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-14T10:56:16.700 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:56:18.022 INFO:teuthology.orchestra.run.smithi071.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-14T10:56:18.023 INFO:teuthology.orchestra.run.smithi071.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-14T10:56:18.023 INFO:teuthology.orchestra.run.smithi071.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-14T10:56:18.023 INFO:teuthology.orchestra.run.smithi071.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-14T10:56:18.195 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:56:19.258 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T10:56:19.386 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T10:56:19.587 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:56:20.478 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-14T10:56:20.682 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:56:20.808 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-14T10:56:20.953 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:56:21.055 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-14T10:56:21.181 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-14T10:56:21.307 INFO:teuthology.orchestra.run.smithi071.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:56:21.374 INFO:teuthology.orchestra.run.smithi071.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-14T10:56:21.374 INFO:teuthology.orchestra.run.smithi071.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-14T10:56:22.267 INFO:teuthology.orchestra.run.smithi157.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-14T10:56:22.268 INFO:teuthology.orchestra.run.smithi157.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-14T10:56:22.268 INFO:teuthology.orchestra.run.smithi157.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-14T10:56:22.268 INFO:teuthology.orchestra.run.smithi157.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-14T10:56:22.405 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:56:23.797 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:56:25.166 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-14T10:56:25.291 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-14T10:56:25.417 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:56:25.492 INFO:teuthology.orchestra.run.smithi157.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-14T10:56:25.493 INFO:teuthology.orchestra.run.smithi157.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-14T10:56:36.310 INFO:teuthology.orchestra.run.smithi071.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-14T10:56:36.311 INFO:teuthology.orchestra.run.smithi071.stdout:Sourcing file `/etc/default/grub' 2024-09-14T10:56:36.322 INFO:teuthology.orchestra.run.smithi071.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-14T10:56:36.340 INFO:teuthology.orchestra.run.smithi071.stdout:Generating grub configuration file ... 2024-09-14T10:56:36.588 INFO:teuthology.orchestra.run.smithi071.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-14T10:56:36.601 INFO:teuthology.orchestra.run.smithi071.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-14T10:56:36.897 INFO:teuthology.orchestra.run.smithi071.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-14T10:56:36.902 INFO:teuthology.orchestra.run.smithi071.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-14T10:56:36.972 INFO:teuthology.orchestra.run.smithi071.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-14T10:56:36.979 INFO:teuthology.orchestra.run.smithi071.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-14T10:56:37.140 INFO:teuthology.orchestra.run.smithi071.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-14T10:56:37.140 INFO:teuthology.orchestra.run.smithi071.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-14T10:56:37.140 INFO:teuthology.orchestra.run.smithi071.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-14T10:56:37.181 INFO:teuthology.orchestra.run.smithi071.stdout:done 2024-09-14T10:56:37.645 DEBUG:teuthology.orchestra.run.smithi071:> dpkg -s linux-image-generic 2024-09-14T10:56:37.668 INFO:teuthology.orchestra.run.smithi071.stdout:Package: linux-image-generic 2024-09-14T10:56:37.668 INFO:teuthology.orchestra.run.smithi071.stdout:Status: install ok installed 2024-09-14T10:56:37.669 INFO:teuthology.orchestra.run.smithi071.stdout:Priority: optional 2024-09-14T10:56:37.669 INFO:teuthology.orchestra.run.smithi071.stdout:Section: kernel 2024-09-14T10:56:37.669 INFO:teuthology.orchestra.run.smithi071.stdout:Installed-Size: 21 2024-09-14T10:56:37.669 INFO:teuthology.orchestra.run.smithi071.stdout:Maintainer: Ubuntu Kernel Team 2024-09-14T10:56:37.669 INFO:teuthology.orchestra.run.smithi071.stdout:Architecture: amd64 2024-09-14T10:56:37.669 INFO:teuthology.orchestra.run.smithi071.stdout:Source: linux-meta 2024-09-14T10:56:37.669 INFO:teuthology.orchestra.run.smithi071.stdout:Version: 5.15.0.121.121 2024-09-14T10:56:37.669 INFO:teuthology.orchestra.run.smithi071.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-14T10:56:37.669 INFO:teuthology.orchestra.run.smithi071.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-14T10:56:37.669 INFO:teuthology.orchestra.run.smithi071.stdout:Recommends: thermald 2024-09-14T10:56:37.669 INFO:teuthology.orchestra.run.smithi071.stdout:Description: Generic Linux kernel image 2024-09-14T10:56:37.669 INFO:teuthology.orchestra.run.smithi071.stdout: This package will always depend on the latest generic kernel image 2024-09-14T10:56:37.669 INFO:teuthology.orchestra.run.smithi071.stdout: available. 2024-09-14T10:56:37.670 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-14T10:56:37.670 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T10:56:37.670 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T10:56:37.670 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-14T10:56:37.670 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi071.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T10:56:37.670 DEBUG:teuthology.orchestra.run.smithi071:> sudo apt-get clean 2024-09-14T10:56:37.857 DEBUG:teuthology.orchestra.run.smithi071:> sudo apt-get update 2024-09-14T10:56:37.973 INFO:teuthology.orchestra.run.smithi071.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T10:56:37.981 INFO:teuthology.orchestra.run.smithi071.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-14T10:56:37.998 INFO:teuthology.orchestra.run.smithi071.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-14T10:56:38.093 INFO:teuthology.orchestra.run.smithi071.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-14T10:56:39.389 INFO:teuthology.orchestra.run.smithi071.stdout:Reading package lists... 2024-09-14T10:56:39.407 DEBUG:teuthology.orchestra.run.smithi071:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-14T10:56:39.469 INFO:teuthology.orchestra.run.smithi071.stdout:Reading package lists... 2024-09-14T10:56:39.618 INFO:teuthology.orchestra.run.smithi157.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-14T10:56:39.618 INFO:teuthology.orchestra.run.smithi157.stdout:Sourcing file `/etc/default/grub' 2024-09-14T10:56:39.637 INFO:teuthology.orchestra.run.smithi157.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-14T10:56:39.661 INFO:teuthology.orchestra.run.smithi157.stdout:Generating grub configuration file ... 2024-09-14T10:56:39.679 INFO:teuthology.orchestra.run.smithi071.stdout:Building dependency tree... 2024-09-14T10:56:39.680 INFO:teuthology.orchestra.run.smithi071.stdout:Reading state information... 2024-09-14T10:56:39.860 INFO:teuthology.orchestra.run.smithi071.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-14T10:56:39.861 INFO:teuthology.orchestra.run.smithi071.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T10:56:39.861 INFO:teuthology.orchestra.run.smithi071.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T10:56:39.861 INFO:teuthology.orchestra.run.smithi071.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T10:56:39.861 INFO:teuthology.orchestra.run.smithi071.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T10:56:39.861 INFO:teuthology.orchestra.run.smithi071.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T10:56:39.861 INFO:teuthology.orchestra.run.smithi071.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T10:56:39.862 INFO:teuthology.orchestra.run.smithi071.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T10:56:39.898 INFO:teuthology.orchestra.run.smithi071.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-14T10:56:39.900 DEBUG:teuthology.orchestra.run.smithi071:> dpkg -s linux-image-generic 2024-09-14T10:56:39.912 INFO:teuthology.orchestra.run.smithi071.stdout:Package: linux-image-generic 2024-09-14T10:56:39.912 INFO:teuthology.orchestra.run.smithi071.stdout:Status: install ok installed 2024-09-14T10:56:39.912 INFO:teuthology.orchestra.run.smithi071.stdout:Priority: optional 2024-09-14T10:56:39.912 INFO:teuthology.orchestra.run.smithi071.stdout:Section: kernel 2024-09-14T10:56:39.912 INFO:teuthology.orchestra.run.smithi071.stdout:Installed-Size: 21 2024-09-14T10:56:39.912 INFO:teuthology.orchestra.run.smithi071.stdout:Maintainer: Ubuntu Kernel Team 2024-09-14T10:56:39.913 INFO:teuthology.orchestra.run.smithi071.stdout:Architecture: amd64 2024-09-14T10:56:39.913 INFO:teuthology.orchestra.run.smithi071.stdout:Source: linux-meta 2024-09-14T10:56:39.913 INFO:teuthology.orchestra.run.smithi071.stdout:Version: 5.15.0.121.121 2024-09-14T10:56:39.913 INFO:teuthology.orchestra.run.smithi071.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-14T10:56:39.913 INFO:teuthology.orchestra.run.smithi071.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-14T10:56:39.913 INFO:teuthology.orchestra.run.smithi071.stdout:Recommends: thermald 2024-09-14T10:56:39.913 INFO:teuthology.orchestra.run.smithi071.stdout:Description: Generic Linux kernel image 2024-09-14T10:56:39.913 INFO:teuthology.orchestra.run.smithi071.stdout: This package will always depend on the latest generic kernel image 2024-09-14T10:56:39.913 INFO:teuthology.orchestra.run.smithi071.stdout: available. 2024-09-14T10:56:39.913 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2024-09-14T10:56:39.954 INFO:teuthology.orchestra.run.smithi157.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-14T10:56:39.959 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.3tKeQwH0hQ 2024-09-14T10:56:39.959 DEBUG:teuthology.orchestra.run.smithi071:> sudo cp /boot/grub/grub.cfg /tmp/tmp.3tKeQwH0hQ 2024-09-14T10:56:39.979 INFO:teuthology.orchestra.run.smithi157.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-14T10:56:40.030 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.3tKeQwH0hQ 2024-09-14T10:56:40.139 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.3tKeQwH0hQ is 10KB 2024-09-14T10:56:40.155 DEBUG:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.3tKeQwH0hQ 2024-09-14T10:56:40.164 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-14T10:56:40.214 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T10:56:40.214 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-14T10:56:40.214 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-14T10:56:40.278 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-14T10:56:40.279 DEBUG:teuthology.orchestra.run.smithi071:> sudo update-grub 2024-09-14T10:56:40.282 INFO:teuthology.orchestra.run.smithi157.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-14T10:56:40.287 INFO:teuthology.orchestra.run.smithi157.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-14T10:56:40.353 INFO:teuthology.orchestra.run.smithi157.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-14T10:56:40.359 INFO:teuthology.orchestra.run.smithi157.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-14T10:56:40.507 INFO:teuthology.orchestra.run.smithi157.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-14T10:56:40.507 INFO:teuthology.orchestra.run.smithi157.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-14T10:56:40.507 INFO:teuthology.orchestra.run.smithi157.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-14T10:56:40.549 INFO:teuthology.orchestra.run.smithi157.stdout:done 2024-09-14T10:56:40.991 DEBUG:teuthology.orchestra.run.smithi157:> dpkg -s linux-image-generic 2024-09-14T10:56:41.019 INFO:teuthology.orchestra.run.smithi157.stdout:Package: linux-image-generic 2024-09-14T10:56:41.019 INFO:teuthology.orchestra.run.smithi157.stdout:Status: install ok installed 2024-09-14T10:56:41.019 INFO:teuthology.orchestra.run.smithi157.stdout:Priority: optional 2024-09-14T10:56:41.019 INFO:teuthology.orchestra.run.smithi157.stdout:Section: kernel 2024-09-14T10:56:41.020 INFO:teuthology.orchestra.run.smithi157.stdout:Installed-Size: 21 2024-09-14T10:56:41.020 INFO:teuthology.orchestra.run.smithi157.stdout:Maintainer: Ubuntu Kernel Team 2024-09-14T10:56:41.020 INFO:teuthology.orchestra.run.smithi157.stdout:Architecture: amd64 2024-09-14T10:56:41.020 INFO:teuthology.orchestra.run.smithi157.stdout:Source: linux-meta 2024-09-14T10:56:41.020 INFO:teuthology.orchestra.run.smithi157.stdout:Version: 5.15.0.121.121 2024-09-14T10:56:41.020 INFO:teuthology.orchestra.run.smithi157.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-14T10:56:41.021 INFO:teuthology.orchestra.run.smithi157.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-14T10:56:41.021 INFO:teuthology.orchestra.run.smithi157.stdout:Recommends: thermald 2024-09-14T10:56:41.021 INFO:teuthology.orchestra.run.smithi157.stdout:Description: Generic Linux kernel image 2024-09-14T10:56:41.021 INFO:teuthology.orchestra.run.smithi157.stdout: This package will always depend on the latest generic kernel image 2024-09-14T10:56:41.021 INFO:teuthology.orchestra.run.smithi157.stdout: available. 2024-09-14T10:56:41.022 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-14T10:56:41.022 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T10:56:41.022 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T10:56:41.022 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-14T10:56:41.022 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi157.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T10:56:41.023 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get clean 2024-09-14T10:56:41.189 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get update 2024-09-14T10:56:41.445 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T10:56:41.445 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-14T10:56:41.447 INFO:teuthology.orchestra.run.smithi071.stderr:Sourcing file `/etc/default/grub' 2024-09-14T10:56:41.448 INFO:teuthology.orchestra.run.smithi071.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-14T10:56:41.450 INFO:teuthology.orchestra.run.smithi071.stderr:Generating grub configuration file ... 2024-09-14T10:56:41.509 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-14T10:56:41.591 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-14T10:56:41.626 INFO:teuthology.orchestra.run.smithi071.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-14T10:56:41.632 INFO:teuthology.orchestra.run.smithi071.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-14T10:56:41.869 INFO:teuthology.orchestra.run.smithi071.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-14T10:56:41.875 INFO:teuthology.orchestra.run.smithi071.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-14T10:56:41.917 INFO:teuthology.orchestra.run.smithi071.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-14T10:56:41.922 INFO:teuthology.orchestra.run.smithi071.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-14T10:56:42.058 INFO:teuthology.orchestra.run.smithi071.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-14T10:56:42.058 INFO:teuthology.orchestra.run.smithi071.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-14T10:56:42.058 INFO:teuthology.orchestra.run.smithi071.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-14T10:56:42.070 INFO:teuthology.orchestra.run.smithi071.stderr:done 2024-09-14T10:56:42.082 DEBUG:teuthology.orchestra.run.smithi071:> sudo shutdown -r now 2024-09-14T10:56:42.857 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-09-14T10:56:42.876 DEBUG:teuthology.orchestra.run.smithi157:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-14T10:56:42.938 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-09-14T10:56:43.159 INFO:teuthology.orchestra.run.smithi157.stdout:Building dependency tree... 2024-09-14T10:56:43.160 INFO:teuthology.orchestra.run.smithi157.stdout:Reading state information... 2024-09-14T10:56:43.335 INFO:teuthology.orchestra.run.smithi157.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-14T10:56:43.335 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T10:56:43.335 INFO:teuthology.orchestra.run.smithi157.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T10:56:43.335 INFO:teuthology.orchestra.run.smithi157.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T10:56:43.335 INFO:teuthology.orchestra.run.smithi157.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T10:56:43.336 INFO:teuthology.orchestra.run.smithi157.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T10:56:43.336 INFO:teuthology.orchestra.run.smithi157.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T10:56:43.337 INFO:teuthology.orchestra.run.smithi157.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T10:56:43.374 INFO:teuthology.orchestra.run.smithi157.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-14T10:56:43.376 DEBUG:teuthology.orchestra.run.smithi157:> dpkg -s linux-image-generic 2024-09-14T10:56:43.391 INFO:teuthology.orchestra.run.smithi157.stdout:Package: linux-image-generic 2024-09-14T10:56:43.391 INFO:teuthology.orchestra.run.smithi157.stdout:Status: install ok installed 2024-09-14T10:56:43.391 INFO:teuthology.orchestra.run.smithi157.stdout:Priority: optional 2024-09-14T10:56:43.391 INFO:teuthology.orchestra.run.smithi157.stdout:Section: kernel 2024-09-14T10:56:43.391 INFO:teuthology.orchestra.run.smithi157.stdout:Installed-Size: 21 2024-09-14T10:56:43.391 INFO:teuthology.orchestra.run.smithi157.stdout:Maintainer: Ubuntu Kernel Team 2024-09-14T10:56:43.391 INFO:teuthology.orchestra.run.smithi157.stdout:Architecture: amd64 2024-09-14T10:56:43.391 INFO:teuthology.orchestra.run.smithi157.stdout:Source: linux-meta 2024-09-14T10:56:43.391 INFO:teuthology.orchestra.run.smithi157.stdout:Version: 5.15.0.121.121 2024-09-14T10:56:43.392 INFO:teuthology.orchestra.run.smithi157.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-14T10:56:43.392 INFO:teuthology.orchestra.run.smithi157.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-14T10:56:43.392 INFO:teuthology.orchestra.run.smithi157.stdout:Recommends: thermald 2024-09-14T10:56:43.392 INFO:teuthology.orchestra.run.smithi157.stdout:Description: Generic Linux kernel image 2024-09-14T10:56:43.392 INFO:teuthology.orchestra.run.smithi157.stdout: This package will always depend on the latest generic kernel image 2024-09-14T10:56:43.392 INFO:teuthology.orchestra.run.smithi157.stdout: available. 2024-09-14T10:56:43.392 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2024-09-14T10:56:43.437 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.gSaXae1giU 2024-09-14T10:56:43.437 DEBUG:teuthology.orchestra.run.smithi157:> sudo cp /boot/grub/grub.cfg /tmp/tmp.gSaXae1giU 2024-09-14T10:56:43.490 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.gSaXae1giU 2024-09-14T10:56:43.608 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.gSaXae1giU is 10KB 2024-09-14T10:56:43.621 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.gSaXae1giU 2024-09-14T10:56:43.626 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-14T10:56:43.681 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-14T10:56:43.681 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-14T10:56:43.681 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-14T10:56:43.749 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-14T10:56:43.750 DEBUG:teuthology.orchestra.run.smithi157:> sudo update-grub 2024-09-14T10:56:44.950 INFO:teuthology.orchestra.run.smithi157.stderr:Sourcing file `/etc/default/grub' 2024-09-14T10:56:44.951 INFO:teuthology.orchestra.run.smithi157.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-14T10:56:44.954 INFO:teuthology.orchestra.run.smithi157.stderr:Generating grub configuration file ... 2024-09-14T10:56:45.139 INFO:teuthology.orchestra.run.smithi157.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-14T10:56:45.145 INFO:teuthology.orchestra.run.smithi157.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-14T10:56:45.379 INFO:teuthology.orchestra.run.smithi157.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-14T10:56:45.384 INFO:teuthology.orchestra.run.smithi157.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-14T10:56:45.425 INFO:teuthology.orchestra.run.smithi157.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-14T10:56:45.430 INFO:teuthology.orchestra.run.smithi157.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-14T10:56:45.550 INFO:teuthology.orchestra.run.smithi157.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-14T10:56:45.550 INFO:teuthology.orchestra.run.smithi157.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-14T10:56:45.550 INFO:teuthology.orchestra.run.smithi157.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-14T10:56:45.562 INFO:teuthology.orchestra.run.smithi157.stderr:done 2024-09-14T10:56:45.575 DEBUG:teuthology.orchestra.run.smithi157:> sudo shutdown -r now 2024-09-14T10:57:12.109 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-14T10:57:12.109 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-14T10:57:12.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:57:15.581 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-14T10:57:15.581 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-09-14T10:57:15.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:57:30.433 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-09-14T10:57:34.013 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-09-14T10:57:39.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-14T10:57:39.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:57:42.493 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-09-14T10:57:43.014 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-09-14T10:57:43.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:57:46.081 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-09-14T10:57:54.501 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-14T10:57:54.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:57:58.082 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-09-14T10:57:58.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:58:01.153 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-09-14T10:58:12.929 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-09-14T10:58:16.157 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-09-14T10:58:16.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:58:27.942 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-14T10:58:27.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:58:28.566 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-09-14T10:58:29.306 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-14T10:58:29.307 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-121-generic"... 2024-09-14T10:58:29.307 DEBUG:teuthology.orchestra.run.smithi071:> uname -r 2024-09-14T10:58:29.312 INFO:teuthology.orchestra.run.smithi071.stdout:5.15.0-121-generic 2024-09-14T10:58:29.312 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-14T10:58:29.313 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T10:58:29.313 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-14T10:58:30.314 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-14T10:58:30.314 DEBUG:teuthology.orchestra.run.smithi071:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T10:58:30.451 INFO:teuthology.orchestra.run.smithi071.stdout:ttyS1 2024-09-14T10:58:30.496 DEBUG:teuthology.parallel:result is None 2024-09-14T10:58:34.685 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-09-14T10:58:52.686 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-09-14T10:58:52.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:58:53.113 DEBUG:teuthology.orchestra.run.smithi157:> true 2024-09-14T10:58:54.012 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-09-14T10:58:54.012 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-121-generic"... 2024-09-14T10:58:54.012 DEBUG:teuthology.orchestra.run.smithi157:> uname -r 2024-09-14T10:58:54.060 INFO:teuthology.orchestra.run.smithi157.stdout:5.15.0-121-generic 2024-09-14T10:58:54.060 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-14T10:58:54.060 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T10:58:54.061 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-14T10:58:55.061 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-14T10:58:55.062 DEBUG:teuthology.orchestra.run.smithi157:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T10:58:55.132 INFO:teuthology.orchestra.run.smithi157.stdout:ttyS1 2024-09-14T10:58:55.158 DEBUG:teuthology.parallel:result is None 2024-09-14T10:58:55.158 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-14T10:58:55.166 INFO:teuthology.task.internal:Creating test directory... 2024-09-14T10:58:55.166 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T10:58:55.169 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T10:58:55.175 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-14T10:58:55.184 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-14T10:58:55.190 INFO:teuthology.task.internal:Creating archive directory... 2024-09-14T10:58:55.190 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T10:58:55.216 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T10:58:55.305 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-14T10:58:55.311 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-14T10:58:55.311 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T10:58:55.314 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T10:58:55.333 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T10:58:55.335 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T10:58:55.341 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T10:58:55.343 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T10:58:55.345 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-14T10:58:55.352 INFO:teuthology.task.internal:Configuring sudo... 2024-09-14T10:58:55.352 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T10:58:55.390 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T10:58:55.412 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-14T10:58:55.421 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-14T10:58:55.421 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T10:58:55.444 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T10:58:55.460 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T10:58:55.495 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T10:58:55.543 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T10:58:55.543 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T10:58:55.618 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T10:58:55.624 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T10:58:55.672 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-14T10:58:55.672 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T10:58:55.741 DEBUG:teuthology.orchestra.run.smithi071:> sudo service rsyslog restart 2024-09-14T10:58:55.743 DEBUG:teuthology.orchestra.run.smithi157:> sudo service rsyslog restart 2024-09-14T10:58:55.823 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-14T10:58:55.831 INFO:teuthology.task.internal:Starting timer... 2024-09-14T10:58:55.831 INFO:teuthology.run_tasks:Running task pcp... 2024-09-14T10:58:55.844 INFO:teuthology.run_tasks:Running task selinux... 2024-09-14T10:58:55.852 DEBUG:teuthology.task.selinux:Excluding smithi071: OS 'ubuntu' does not support SELinux 2024-09-14T10:58:55.852 DEBUG:teuthology.task.selinux:Excluding smithi157: OS 'ubuntu' does not support SELinux 2024-09-14T10:58:55.852 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-14T10:58:55.852 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-14T10:58:55.853 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-14T10:58:55.853 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-14T10:58:55.861 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-14T10:58:55.873 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-14T10:58:55.874 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi071.front.sepia.ceph.com,smithi157.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-14T11:06:24.995 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi071.front.sepia.ceph.com'), Remote(name='ubuntu@smithi157.front.sepia.ceph.com')] 2024-09-14T11:06:24.996 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-14T11:06:24.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:06:25.079 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-09-14T11:06:25.152 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-14T11:06:25.153 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-09-14T11:06:25.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:06:25.230 DEBUG:teuthology.orchestra.run.smithi157:> true 2024-09-14T11:06:25.305 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-09-14T11:06:25.305 INFO:teuthology.run_tasks:Running task clock... 2024-09-14T11:06:25.315 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-14T11:06:25.315 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T11:06:25.315 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T11:06:25.320 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T11:06:25.320 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T11:06:25.345 INFO:teuthology.orchestra.run.smithi071.stdout:14 Sep 11:06:25 ntpd[18463]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-14T11:06:25.345 INFO:teuthology.orchestra.run.smithi071.stdout:14 Sep 11:06:25 ntpd[18463]: Command line: ntpd -gq 2024-09-14T11:06:25.345 INFO:teuthology.orchestra.run.smithi071.stdout:14 Sep 11:06:25 ntpd[18463]: ---------------------------------------------------- 2024-09-14T11:06:25.346 INFO:teuthology.orchestra.run.smithi071.stdout:14 Sep 11:06:25 ntpd[18463]: ntp-4 is maintained by Network Time Foundation, 2024-09-14T11:06:25.346 INFO:teuthology.orchestra.run.smithi071.stdout:14 Sep 11:06:25 ntpd[18463]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-14T11:06:25.346 INFO:teuthology.orchestra.run.smithi071.stdout:14 Sep 11:06:25 ntpd[18463]: corporation. Support and training for ntp-4 are 2024-09-14T11:06:25.346 INFO:teuthology.orchestra.run.smithi071.stdout:14 Sep 11:06:25 ntpd[18463]: available at https://www.nwtime.org/support 2024-09-14T11:06:25.346 INFO:teuthology.orchestra.run.smithi071.stdout:14 Sep 11:06:25 ntpd[18463]: ---------------------------------------------------- 2024-09-14T11:06:25.346 INFO:teuthology.orchestra.run.smithi071.stdout:14 Sep 11:06:25 ntpd[18463]: proto: precision = 0.046 usec (-24) 2024-09-14T11:06:25.347 INFO:teuthology.orchestra.run.smithi071.stdout:14 Sep 11:06:25 ntpd[18463]: basedate set to 2022-02-04 2024-09-14T11:06:25.347 INFO:teuthology.orchestra.run.smithi071.stdout:14 Sep 11:06:25 ntpd[18463]: gps base set to 2022-02-06 (week 2196) 2024-09-14T11:06:25.347 INFO:teuthology.orchestra.run.smithi071.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-14T11:06:25.347 INFO:teuthology.orchestra.run.smithi071.stdout:14 Sep 11:06:25 ntpd[18463]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-14T11:06:25.347 INFO:teuthology.orchestra.run.smithi071.stdout:14 Sep 11:06:25 ntpd[18463]: restrict ::: KOD does nothing without LIMITED. 2024-09-14T11:06:25.348 INFO:teuthology.orchestra.run.smithi071.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-14T11:06:25.348 INFO:teuthology.orchestra.run.smithi071.stdout:14 Sep 11:06:25 ntpd[18463]: Listen and drop on 0 v6wildcard [::]:123 2024-09-14T11:06:25.349 INFO:teuthology.orchestra.run.smithi071.stdout:14 Sep 11:06:25 ntpd[18463]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-14T11:06:25.349 INFO:teuthology.orchestra.run.smithi071.stdout:14 Sep 11:06:25 ntpd[18463]: Listen normally on 2 lo 127.0.0.1:123 2024-09-14T11:06:25.349 INFO:teuthology.orchestra.run.smithi071.stdout:14 Sep 11:06:25 ntpd[18463]: Listen normally on 3 enp3s0f1 172.21.15.71:123 2024-09-14T11:06:25.349 INFO:teuthology.orchestra.run.smithi071.stdout:14 Sep 11:06:25 ntpd[18463]: Listen normally on 4 lo [::1]:123 2024-09-14T11:06:25.349 INFO:teuthology.orchestra.run.smithi071.stdout:14 Sep 11:06:25 ntpd[18463]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d765%5]:123 2024-09-14T11:06:25.349 INFO:teuthology.orchestra.run.smithi071.stdout:14 Sep 11:06:25 ntpd[18463]: Listening on routing socket on fd #22 for interface updates 2024-09-14T11:06:25.372 INFO:teuthology.orchestra.run.smithi157.stdout:14 Sep 11:06:25 ntpd[18486]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-14T11:06:25.372 INFO:teuthology.orchestra.run.smithi157.stdout:14 Sep 11:06:25 ntpd[18486]: Command line: ntpd -gq 2024-09-14T11:06:25.372 INFO:teuthology.orchestra.run.smithi157.stdout:14 Sep 11:06:25 ntpd[18486]: ---------------------------------------------------- 2024-09-14T11:06:25.372 INFO:teuthology.orchestra.run.smithi157.stdout:14 Sep 11:06:25 ntpd[18486]: ntp-4 is maintained by Network Time Foundation, 2024-09-14T11:06:25.372 INFO:teuthology.orchestra.run.smithi157.stdout:14 Sep 11:06:25 ntpd[18486]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-14T11:06:25.372 INFO:teuthology.orchestra.run.smithi157.stdout:14 Sep 11:06:25 ntpd[18486]: corporation. Support and training for ntp-4 are 2024-09-14T11:06:25.372 INFO:teuthology.orchestra.run.smithi157.stdout:14 Sep 11:06:25 ntpd[18486]: available at https://www.nwtime.org/support 2024-09-14T11:06:25.373 INFO:teuthology.orchestra.run.smithi157.stdout:14 Sep 11:06:25 ntpd[18486]: ---------------------------------------------------- 2024-09-14T11:06:25.373 INFO:teuthology.orchestra.run.smithi157.stdout:14 Sep 11:06:25 ntpd[18486]: proto: precision = 0.045 usec (-24) 2024-09-14T11:06:25.373 INFO:teuthology.orchestra.run.smithi157.stdout:14 Sep 11:06:25 ntpd[18486]: basedate set to 2022-02-04 2024-09-14T11:06:25.373 INFO:teuthology.orchestra.run.smithi157.stdout:14 Sep 11:06:25 ntpd[18486]: gps base set to 2022-02-06 (week 2196) 2024-09-14T11:06:25.374 INFO:teuthology.orchestra.run.smithi157.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-14T11:06:25.374 INFO:teuthology.orchestra.run.smithi157.stdout:14 Sep 11:06:25 ntpd[18486]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-14T11:06:25.374 INFO:teuthology.orchestra.run.smithi157.stdout:14 Sep 11:06:25 ntpd[18486]: restrict ::: KOD does nothing without LIMITED. 2024-09-14T11:06:25.374 INFO:teuthology.orchestra.run.smithi157.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-14T11:06:25.375 INFO:teuthology.orchestra.run.smithi157.stdout:14 Sep 11:06:25 ntpd[18486]: Listen and drop on 0 v6wildcard [::]:123 2024-09-14T11:06:25.375 INFO:teuthology.orchestra.run.smithi157.stdout:14 Sep 11:06:25 ntpd[18486]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-14T11:06:25.375 INFO:teuthology.orchestra.run.smithi157.stdout:14 Sep 11:06:25 ntpd[18486]: Listen normally on 2 lo 127.0.0.1:123 2024-09-14T11:06:25.375 INFO:teuthology.orchestra.run.smithi157.stdout:14 Sep 11:06:25 ntpd[18486]: Listen normally on 3 enp3s0f1 172.21.15.157:123 2024-09-14T11:06:25.375 INFO:teuthology.orchestra.run.smithi157.stdout:14 Sep 11:06:25 ntpd[18486]: Listen normally on 4 lo [::1]:123 2024-09-14T11:06:25.375 INFO:teuthology.orchestra.run.smithi157.stdout:14 Sep 11:06:25 ntpd[18486]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7ea1%5]:123 2024-09-14T11:06:25.375 INFO:teuthology.orchestra.run.smithi157.stdout:14 Sep 11:06:25 ntpd[18486]: Listening on routing socket on fd #22 for interface updates 2024-09-14T11:06:26.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:26 ntpd[18463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:06:26.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:26 ntpd[18463]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:06:26.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:26 ntpd[18463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:06:26.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:26 ntpd[18463]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:06:26.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:26 ntpd[18463]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:06:26.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:26 ntpd[18463]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:06:26.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:26 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:06:26.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:26 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:06:26.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:26 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:06:26.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:26 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:06:26.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:26 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:06:26.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:26 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:06:26.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:26 ntpd[18486]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:06:26.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:26 ntpd[18486]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:06:27.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:27 ntpd[18463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:06:27.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:27 ntpd[18463]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:06:27.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:27 ntpd[18463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:06:27.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:27 ntpd[18463]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:06:27.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:27 ntpd[18463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:06:27.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:27 ntpd[18463]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:06:27.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:27 ntpd[18463]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:06:27.347 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:27 ntpd[18463]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:06:27.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:27 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:06:27.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:27 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:06:27.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:27 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:06:27.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:27 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:06:27.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:27 ntpd[18486]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:06:27.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:27 ntpd[18486]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:06:28.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:28 ntpd[18463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:06:28.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:28 ntpd[18463]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:06:28.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:28 ntpd[18463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:06:28.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:28 ntpd[18463]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:06:28.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:28 ntpd[18463]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:06:28.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:28 ntpd[18463]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:06:28.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:28 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:06:28.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:28 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:06:28.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:28 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:06:28.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:28 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:06:28.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:28 ntpd[18486]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:06:28.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:28 ntpd[18486]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:06:29.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:29 ntpd[18463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:06:29.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:29 ntpd[18463]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:06:29.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:29 ntpd[18463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:06:29.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:29 ntpd[18463]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:06:29.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:29 ntpd[18463]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:06:29.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:29 ntpd[18463]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:06:29.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:29 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:06:29.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:29 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:06:29.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:29 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:06:29.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:29 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:06:29.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:29 ntpd[18486]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:06:29.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:29 ntpd[18486]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:06:30.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:30 ntpd[18463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:06:30.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:30 ntpd[18463]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:06:30.347 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:30 ntpd[18463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:06:30.347 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:30 ntpd[18463]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:06:30.347 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:30 ntpd[18463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:06:30.347 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:30 ntpd[18463]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:06:30.347 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:30 ntpd[18463]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:06:30.347 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:30 ntpd[18463]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:06:30.347 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:30 ntpd[18463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:06:30.347 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:30 ntpd[18463]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:06:30.347 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:30 ntpd[18463]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:06:30.347 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:30 ntpd[18463]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:06:30.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:30 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:06:30.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:30 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:06:30.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:30 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:06:30.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:30 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:06:30.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:30 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:06:30.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:30 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:06:30.374 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:30 ntpd[18486]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:06:30.374 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:30 ntpd[18486]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:06:30.374 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:30 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:06:30.374 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:30 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:06:30.374 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:30 ntpd[18486]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:06:30.374 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:30 ntpd[18486]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:06:31.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:31 ntpd[18463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:06:31.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:31 ntpd[18463]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:06:31.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:31 ntpd[18463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:06:31.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:31 ntpd[18463]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:06:31.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:31 ntpd[18463]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:06:31.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:31 ntpd[18463]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:06:31.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:31 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:06:31.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:31 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:06:31.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:31 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:06:31.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:31 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:06:31.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:31 ntpd[18486]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:06:31.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:31 ntpd[18486]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:06:32.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:32 ntpd[18463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:06:32.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:32 ntpd[18463]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:06:32.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:32 ntpd[18463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:06:32.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:32 ntpd[18463]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:06:32.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:32 ntpd[18463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:06:32.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:32 ntpd[18463]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:06:32.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:32 ntpd[18463]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:06:32.346 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:32 ntpd[18463]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:06:32.347 INFO:teuthology.orchestra.run.smithi071.stdout:14 Sep 11:06:32 ntpd[18463]: ntpd: time slew +0.010437 s 2024-09-14T11:06:32.347 INFO:teuthology.orchestra.run.smithi071.stdout:ntpd: time slew +0.010437s 2024-09-14T11:06:32.347 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:32 ntpd[18463]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-14T11:06:32.347 INFO:teuthology.orchestra.run.smithi071.stderr:14 Sep 11:06:32 ntpd[18463]: can't open /var/log/ntpstats/loopstats.20240914: Permission denied 2024-09-14T11:06:32.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:32 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:06:32.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:32 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:06:32.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:32 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:06:32.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:32 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:06:32.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:32 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:06:32.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:32 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:06:32.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:32 ntpd[18486]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:06:32.373 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:32 ntpd[18486]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:06:32.374 INFO:teuthology.orchestra.run.smithi157.stdout:14 Sep 11:06:32 ntpd[18486]: ntpd: time slew +0.004535 s 2024-09-14T11:06:32.374 INFO:teuthology.orchestra.run.smithi157.stdout:ntpd: time slew +0.004535s 2024-09-14T11:06:32.374 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:32 ntpd[18486]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-14T11:06:32.374 INFO:teuthology.orchestra.run.smithi157.stderr:14 Sep 11:06:32 ntpd[18486]: can't open /var/log/ntpstats/loopstats.20240914: Permission denied 2024-09-14T11:06:32.397 INFO:teuthology.orchestra.run.smithi071.stdout: remote refid st t when poll reach delay offset jitter 2024-09-14T11:06:32.397 INFO:teuthology.orchestra.run.smithi071.stdout:============================================================================== 2024-09-14T11:06:32.397 INFO:teuthology.orchestra.run.smithi071.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T11:06:32.397 INFO:teuthology.orchestra.run.smithi071.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T11:06:32.397 INFO:teuthology.orchestra.run.smithi071.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T11:06:32.397 INFO:teuthology.orchestra.run.smithi071.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T11:06:32.430 INFO:teuthology.orchestra.run.smithi157.stdout: remote refid st t when poll reach delay offset jitter 2024-09-14T11:06:32.430 INFO:teuthology.orchestra.run.smithi157.stdout:============================================================================== 2024-09-14T11:06:32.430 INFO:teuthology.orchestra.run.smithi157.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T11:06:32.430 INFO:teuthology.orchestra.run.smithi157.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T11:06:32.430 INFO:teuthology.orchestra.run.smithi157.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T11:06:32.431 INFO:teuthology.orchestra.run.smithi157.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T11:06:32.431 INFO:teuthology.run_tasks:Running task install... 2024-09-14T11:06:32.441 DEBUG:teuthology.task.install:project ceph 2024-09-14T11:06:32.441 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}} 2024-09-14T11:06:32.442 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'} 2024-09-14T11:06:32.442 INFO:teuthology.task.install:Using flavor: default 2024-09-14T11:06:32.447 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-14T11:06:32.447 INFO:teuthology.task.install:extra packages: [] 2024-09-14T11:06:32.448 DEBUG:teuthology.orchestra.run.smithi071:> sudo apt-key list | grep Ceph 2024-09-14T11:06:32.448 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-key list | grep Ceph 2024-09-14T11:06:32.504 INFO:teuthology.orchestra.run.smithi071.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-14T11:06:32.531 INFO:teuthology.orchestra.run.smithi157.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-14T11:06:32.532 INFO:teuthology.orchestra.run.smithi071.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-14T11:06:32.532 INFO:teuthology.orchestra.run.smithi071.stdout:uid [ unknown] Ceph.com (release key) 2024-09-14T11:06:32.533 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-14T11:06:32.533 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-14T11:06:32.533 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T11:06:32.559 INFO:teuthology.orchestra.run.smithi157.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-14T11:06:32.559 INFO:teuthology.orchestra.run.smithi157.stdout:uid [ unknown] Ceph.com (release key) 2024-09-14T11:06:32.559 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-14T11:06:32.559 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-14T11:06:32.560 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T11:06:32.688 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default/ 2024-09-14T11:06:32.688 INFO:teuthology.task.install.deb:Package version is 19.3.0-4907-ga2782315-1jammy 2024-09-14T11:06:32.697 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default/ 2024-09-14T11:06:32.697 INFO:teuthology.task.install.deb:Package version is 19.3.0-4907-ga2782315-1jammy 2024-09-14T11:06:32.802 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T11:06:32.802 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-14T11:06:32.809 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-14T11:06:32.809 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-14T11:06:32.817 DEBUG:teuthology.orchestra.run.smithi071:> sudo apt-get update 2024-09-14T11:06:32.823 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get update 2024-09-14T11:06:32.990 INFO:teuthology.orchestra.run.smithi157.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-14T11:06:33.040 INFO:teuthology.orchestra.run.smithi071.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy InRelease 2024-09-14T11:06:33.049 INFO:teuthology.orchestra.run.smithi157.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy InRelease 2024-09-14T11:06:33.074 INFO:teuthology.orchestra.run.smithi157.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-14T11:06:33.074 INFO:teuthology.orchestra.run.smithi071.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-14T11:06:33.096 INFO:teuthology.orchestra.run.smithi157.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-14T11:06:33.098 INFO:teuthology.orchestra.run.smithi071.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-14T11:06:33.117 INFO:teuthology.orchestra.run.smithi157.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-14T11:06:33.117 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T11:06:33.119 INFO:teuthology.orchestra.run.smithi071.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-14T11:06:33.119 INFO:teuthology.orchestra.run.smithi071.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T11:06:33.119 INFO:teuthology.orchestra.run.smithi071.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,421 B] 2024-09-14T11:06:33.148 INFO:teuthology.orchestra.run.smithi071.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-14T11:06:33.165 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,421 B] 2024-09-14T11:06:33.191 INFO:teuthology.orchestra.run.smithi071.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-14T11:06:33.199 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-14T11:06:33.273 INFO:teuthology.orchestra.run.smithi071.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-14T11:06:33.492 INFO:teuthology.orchestra.run.smithi071.stdout:Fetched 29.3 kB in 0s (59.6 kB/s) 2024-09-14T11:06:33.554 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-14T11:06:33.716 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 286 kB in 1s (409 kB/s) 2024-09-14T11:06:34.505 INFO:teuthology.orchestra.run.smithi071.stdout:Reading package lists... 2024-09-14T11:06:34.522 DEBUG:teuthology.orchestra.run.smithi071:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4907-ga2782315-1jammy cephadm=19.3.0-4907-ga2782315-1jammy ceph-mds=19.3.0-4907-ga2782315-1jammy ceph-mgr=19.3.0-4907-ga2782315-1jammy ceph-common=19.3.0-4907-ga2782315-1jammy ceph-fuse=19.3.0-4907-ga2782315-1jammy ceph-test=19.3.0-4907-ga2782315-1jammy ceph-volume=19.3.0-4907-ga2782315-1jammy radosgw=19.3.0-4907-ga2782315-1jammy python3-rados=19.3.0-4907-ga2782315-1jammy python3-rgw=19.3.0-4907-ga2782315-1jammy python3-cephfs=19.3.0-4907-ga2782315-1jammy python3-rbd=19.3.0-4907-ga2782315-1jammy libcephfs2=19.3.0-4907-ga2782315-1jammy libcephfs-dev=19.3.0-4907-ga2782315-1jammy librados2=19.3.0-4907-ga2782315-1jammy librbd1=19.3.0-4907-ga2782315-1jammy rbd-fuse=19.3.0-4907-ga2782315-1jammy 2024-09-14T11:06:34.586 INFO:teuthology.orchestra.run.smithi071.stdout:Reading package lists... 2024-09-14T11:06:34.748 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-09-14T11:06:34.765 DEBUG:teuthology.orchestra.run.smithi157:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4907-ga2782315-1jammy cephadm=19.3.0-4907-ga2782315-1jammy ceph-mds=19.3.0-4907-ga2782315-1jammy ceph-mgr=19.3.0-4907-ga2782315-1jammy ceph-common=19.3.0-4907-ga2782315-1jammy ceph-fuse=19.3.0-4907-ga2782315-1jammy ceph-test=19.3.0-4907-ga2782315-1jammy ceph-volume=19.3.0-4907-ga2782315-1jammy radosgw=19.3.0-4907-ga2782315-1jammy python3-rados=19.3.0-4907-ga2782315-1jammy python3-rgw=19.3.0-4907-ga2782315-1jammy python3-cephfs=19.3.0-4907-ga2782315-1jammy python3-rbd=19.3.0-4907-ga2782315-1jammy libcephfs2=19.3.0-4907-ga2782315-1jammy libcephfs-dev=19.3.0-4907-ga2782315-1jammy librados2=19.3.0-4907-ga2782315-1jammy librbd1=19.3.0-4907-ga2782315-1jammy rbd-fuse=19.3.0-4907-ga2782315-1jammy 2024-09-14T11:06:34.794 INFO:teuthology.orchestra.run.smithi071.stdout:Building dependency tree... 2024-09-14T11:06:34.795 INFO:teuthology.orchestra.run.smithi071.stdout:Reading state information... 2024-09-14T11:06:34.830 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-09-14T11:06:34.992 INFO:teuthology.orchestra.run.smithi071.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T11:06:34.992 INFO:teuthology.orchestra.run.smithi071.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T11:06:34.992 INFO:teuthology.orchestra.run.smithi071.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T11:06:34.992 INFO:teuthology.orchestra.run.smithi071.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T11:06:34.993 INFO:teuthology.orchestra.run.smithi071.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T11:06:34.993 INFO:teuthology.orchestra.run.smithi071.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T11:06:34.993 INFO:teuthology.orchestra.run.smithi071.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T11:06:34.993 INFO:teuthology.orchestra.run.smithi071.stdout:The following additional packages will be installed: 2024-09-14T11:06:34.993 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-14T11:06:34.995 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-14T11:06:34.995 INFO:teuthology.orchestra.run.smithi071.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-14T11:06:34.995 INFO:teuthology.orchestra.run.smithi071.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-14T11:06:34.995 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-14T11:06:34.995 INFO:teuthology.orchestra.run.smithi071.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-14T11:06:34.995 INFO:teuthology.orchestra.run.smithi071.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-14T11:06:34.995 INFO:teuthology.orchestra.run.smithi071.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-14T11:06:34.995 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-14T11:06:34.996 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-14T11:06:34.996 INFO:teuthology.orchestra.run.smithi071.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-14T11:06:34.996 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-14T11:06:34.996 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-14T11:06:34.996 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-14T11:06:34.996 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-14T11:06:34.996 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-14T11:06:34.996 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-14T11:06:34.996 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-14T11:06:34.996 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-14T11:06:34.996 INFO:teuthology.orchestra.run.smithi071.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-14T11:06:34.996 INFO:teuthology.orchestra.run.smithi071.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-14T11:06:34.997 INFO:teuthology.orchestra.run.smithi071.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-14T11:06:34.997 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-14T11:06:34.997 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet zip 2024-09-14T11:06:34.997 INFO:teuthology.orchestra.run.smithi071.stdout:Suggested packages: 2024-09-14T11:06:34.997 INFO:teuthology.orchestra.run.smithi071.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-14T11:06:34.997 INFO:teuthology.orchestra.run.smithi071.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-14T11:06:34.997 INFO:teuthology.orchestra.run.smithi071.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-14T11:06:34.997 INFO:teuthology.orchestra.run.smithi071.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-14T11:06:34.997 INFO:teuthology.orchestra.run.smithi071.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-14T11:06:34.998 INFO:teuthology.orchestra.run.smithi071.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-14T11:06:34.998 INFO:teuthology.orchestra.run.smithi071.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-14T11:06:34.998 INFO:teuthology.orchestra.run.smithi071.stdout:Recommended packages: 2024-09-14T11:06:34.998 INFO:teuthology.orchestra.run.smithi071.stdout: btrfs-tools 2024-09-14T11:06:35.039 INFO:teuthology.orchestra.run.smithi157.stdout:Building dependency tree... 2024-09-14T11:06:35.040 INFO:teuthology.orchestra.run.smithi157.stdout:Reading state information... 2024-09-14T11:06:35.099 INFO:teuthology.orchestra.run.smithi071.stdout:The following NEW packages will be installed: 2024-09-14T11:06:35.099 INFO:teuthology.orchestra.run.smithi071.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-14T11:06:35.099 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-14T11:06:35.099 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-14T11:06:35.099 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-14T11:06:35.099 INFO:teuthology.orchestra.run.smithi071.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-14T11:06:35.099 INFO:teuthology.orchestra.run.smithi071.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-14T11:06:35.100 INFO:teuthology.orchestra.run.smithi071.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-14T11:06:35.101 INFO:teuthology.orchestra.run.smithi071.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-14T11:06:35.101 INFO:teuthology.orchestra.run.smithi071.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-14T11:06:35.101 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-14T11:06:35.101 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-14T11:06:35.101 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-14T11:06:35.101 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-14T11:06:35.101 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-14T11:06:35.101 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-14T11:06:35.101 INFO:teuthology.orchestra.run.smithi071.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-14T11:06:35.101 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-14T11:06:35.101 INFO:teuthology.orchestra.run.smithi071.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-14T11:06:35.102 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-14T11:06:35.102 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-14T11:06:35.102 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-14T11:06:35.102 INFO:teuthology.orchestra.run.smithi071.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-14T11:06:35.102 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-14T11:06:35.102 INFO:teuthology.orchestra.run.smithi071.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-14T11:06:35.102 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-14T11:06:35.102 INFO:teuthology.orchestra.run.smithi071.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-14T11:06:35.158 INFO:teuthology.orchestra.run.smithi071.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-14T11:06:35.158 INFO:teuthology.orchestra.run.smithi071.stdout:Need to get 251 MB of archives. 2024-09-14T11:06:35.159 INFO:teuthology.orchestra.run.smithi071.stdout:After this operation, 934 MB of additional disk space will be used. 2024-09-14T11:06:35.159 INFO:teuthology.orchestra.run.smithi071.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-14T11:06:35.241 INFO:teuthology.orchestra.run.smithi071.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4907-ga2782315-1jammy [3,634 kB] 2024-09-14T11:06:35.247 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T11:06:35.247 INFO:teuthology.orchestra.run.smithi157.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T11:06:35.247 INFO:teuthology.orchestra.run.smithi157.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T11:06:35.247 INFO:teuthology.orchestra.run.smithi157.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T11:06:35.248 INFO:teuthology.orchestra.run.smithi071.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-14T11:06:35.248 INFO:teuthology.orchestra.run.smithi157.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T11:06:35.248 INFO:teuthology.orchestra.run.smithi157.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T11:06:35.248 INFO:teuthology.orchestra.run.smithi157.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T11:06:35.249 INFO:teuthology.orchestra.run.smithi157.stdout:The following additional packages will be installed: 2024-09-14T11:06:35.249 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-14T11:06:35.249 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-14T11:06:35.249 INFO:teuthology.orchestra.run.smithi157.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-14T11:06:35.249 INFO:teuthology.orchestra.run.smithi157.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-14T11:06:35.249 INFO:teuthology.orchestra.run.smithi157.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-14T11:06:35.250 INFO:teuthology.orchestra.run.smithi071.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-14T11:06:35.251 INFO:teuthology.orchestra.run.smithi157.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-14T11:06:35.251 INFO:teuthology.orchestra.run.smithi157.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-14T11:06:35.251 INFO:teuthology.orchestra.run.smithi157.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-14T11:06:35.251 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-14T11:06:35.251 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-14T11:06:35.251 INFO:teuthology.orchestra.run.smithi157.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-14T11:06:35.251 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-14T11:06:35.251 INFO:teuthology.orchestra.run.smithi157.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-14T11:06:35.251 INFO:teuthology.orchestra.run.smithi157.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-14T11:06:35.251 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-14T11:06:35.251 INFO:teuthology.orchestra.run.smithi157.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-14T11:06:35.251 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-14T11:06:35.252 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-14T11:06:35.252 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-14T11:06:35.252 INFO:teuthology.orchestra.run.smithi157.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-14T11:06:35.252 INFO:teuthology.orchestra.run.smithi157.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-14T11:06:35.252 INFO:teuthology.orchestra.run.smithi157.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-14T11:06:35.252 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-14T11:06:35.252 INFO:teuthology.orchestra.run.smithi157.stdout: xmlstarlet zip 2024-09-14T11:06:35.252 INFO:teuthology.orchestra.run.smithi157.stdout:Suggested packages: 2024-09-14T11:06:35.252 INFO:teuthology.orchestra.run.smithi157.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-14T11:06:35.253 INFO:teuthology.orchestra.run.smithi157.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-14T11:06:35.253 INFO:teuthology.orchestra.run.smithi157.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-14T11:06:35.253 INFO:teuthology.orchestra.run.smithi157.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-14T11:06:35.253 INFO:teuthology.orchestra.run.smithi157.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-14T11:06:35.253 INFO:teuthology.orchestra.run.smithi157.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-14T11:06:35.253 INFO:teuthology.orchestra.run.smithi157.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-14T11:06:35.253 INFO:teuthology.orchestra.run.smithi157.stdout:Recommended packages: 2024-09-14T11:06:35.253 INFO:teuthology.orchestra.run.smithi157.stdout: btrfs-tools 2024-09-14T11:06:35.267 INFO:teuthology.orchestra.run.smithi071.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-14T11:06:35.328 INFO:teuthology.orchestra.run.smithi071.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-14T11:06:35.333 INFO:teuthology.orchestra.run.smithi071.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-14T11:06:35.346 INFO:teuthology.orchestra.run.smithi071.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-14T11:06:35.349 INFO:teuthology.orchestra.run.smithi071.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-14T11:06:35.351 INFO:teuthology.orchestra.run.smithi071.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-14T11:06:35.351 INFO:teuthology.orchestra.run.smithi071.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-14T11:06:35.352 INFO:teuthology.orchestra.run.smithi071.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-14T11:06:35.355 INFO:teuthology.orchestra.run.smithi157.stdout:The following NEW packages will be installed: 2024-09-14T11:06:35.355 INFO:teuthology.orchestra.run.smithi157.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-14T11:06:35.356 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-14T11:06:35.357 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-14T11:06:35.357 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-14T11:06:35.357 INFO:teuthology.orchestra.run.smithi157.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-14T11:06:35.357 INFO:teuthology.orchestra.run.smithi157.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-14T11:06:35.357 INFO:teuthology.orchestra.run.smithi157.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-14T11:06:35.357 INFO:teuthology.orchestra.run.smithi157.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-14T11:06:35.358 INFO:teuthology.orchestra.run.smithi157.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-14T11:06:35.358 INFO:teuthology.orchestra.run.smithi157.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-14T11:06:35.358 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-14T11:06:35.358 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-14T11:06:35.358 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-14T11:06:35.358 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-14T11:06:35.358 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-14T11:06:35.358 INFO:teuthology.orchestra.run.smithi157.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-14T11:06:35.358 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-14T11:06:35.358 INFO:teuthology.orchestra.run.smithi157.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-14T11:06:35.358 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-14T11:06:35.358 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-14T11:06:35.358 INFO:teuthology.orchestra.run.smithi157.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-14T11:06:35.359 INFO:teuthology.orchestra.run.smithi157.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-14T11:06:35.359 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-14T11:06:35.359 INFO:teuthology.orchestra.run.smithi157.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-14T11:06:35.359 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-14T11:06:35.359 INFO:teuthology.orchestra.run.smithi157.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-14T11:06:35.360 INFO:teuthology.orchestra.run.smithi071.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-14T11:06:35.362 INFO:teuthology.orchestra.run.smithi071.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-14T11:06:35.364 INFO:teuthology.orchestra.run.smithi071.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-14T11:06:35.367 INFO:teuthology.orchestra.run.smithi071.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-14T11:06:35.367 INFO:teuthology.orchestra.run.smithi071.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-14T11:06:35.385 INFO:teuthology.orchestra.run.smithi071.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-14T11:06:35.387 INFO:teuthology.orchestra.run.smithi071.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-14T11:06:35.389 INFO:teuthology.orchestra.run.smithi071.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-14T11:06:35.390 INFO:teuthology.orchestra.run.smithi071.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-14T11:06:35.390 INFO:teuthology.orchestra.run.smithi071.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-14T11:06:35.391 INFO:teuthology.orchestra.run.smithi071.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-14T11:06:35.391 INFO:teuthology.orchestra.run.smithi071.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-14T11:06:35.392 INFO:teuthology.orchestra.run.smithi071.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-14T11:06:35.402 INFO:teuthology.orchestra.run.smithi071.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-14T11:06:35.403 INFO:teuthology.orchestra.run.smithi071.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-14T11:06:35.425 INFO:teuthology.orchestra.run.smithi071.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-14T11:06:35.425 INFO:teuthology.orchestra.run.smithi071.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-14T11:06:35.428 INFO:teuthology.orchestra.run.smithi071.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-14T11:06:35.428 INFO:teuthology.orchestra.run.smithi071.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-14T11:06:35.429 INFO:teuthology.orchestra.run.smithi071.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-14T11:06:35.429 INFO:teuthology.orchestra.run.smithi071.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-14T11:06:35.429 INFO:teuthology.orchestra.run.smithi071.stdout:Get:34 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4907-ga2782315-1jammy [3,334 kB] 2024-09-14T11:06:35.430 INFO:teuthology.orchestra.run.smithi071.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-14T11:06:35.430 INFO:teuthology.orchestra.run.smithi071.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-14T11:06:35.444 INFO:teuthology.orchestra.run.smithi071.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-14T11:06:35.445 INFO:teuthology.orchestra.run.smithi071.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-14T11:06:35.461 INFO:teuthology.orchestra.run.smithi071.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-14T11:06:35.462 INFO:teuthology.orchestra.run.smithi071.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-14T11:06:35.468 INFO:teuthology.orchestra.run.smithi071.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-14T11:06:35.468 INFO:teuthology.orchestra.run.smithi071.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-14T11:06:35.468 INFO:teuthology.orchestra.run.smithi071.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-14T11:06:35.469 INFO:teuthology.orchestra.run.smithi071.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-14T11:06:35.470 INFO:teuthology.orchestra.run.smithi071.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-14T11:06:35.472 INFO:teuthology.orchestra.run.smithi071.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-14T11:06:35.476 INFO:teuthology.orchestra.run.smithi071.stdout:Get:47 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4907-ga2782315-1jammy [721 kB] 2024-09-14T11:06:35.479 INFO:teuthology.orchestra.run.smithi071.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-14T11:06:35.480 INFO:teuthology.orchestra.run.smithi071.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-14T11:06:35.487 INFO:teuthology.orchestra.run.smithi071.stdout:Get:50 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4907-ga2782315-1jammy [357 kB] 2024-09-14T11:06:35.490 INFO:teuthology.orchestra.run.smithi071.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-14T11:06:35.493 INFO:teuthology.orchestra.run.smithi071.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-14T11:06:35.494 INFO:teuthology.orchestra.run.smithi071.stdout:Get:53 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4907-ga2782315-1jammy [32.8 kB] 2024-09-14T11:06:35.494 INFO:teuthology.orchestra.run.smithi071.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-14T11:06:35.494 INFO:teuthology.orchestra.run.smithi071.stdout:Get:55 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4907-ga2782315-1jammy [180 kB] 2024-09-14T11:06:35.494 INFO:teuthology.orchestra.run.smithi071.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-14T11:06:35.497 INFO:teuthology.orchestra.run.smithi071.stdout:Get:57 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4907-ga2782315-1jammy [71.3 kB] 2024-09-14T11:06:35.497 INFO:teuthology.orchestra.run.smithi071.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-14T11:06:35.498 INFO:teuthology.orchestra.run.smithi071.stdout:Get:59 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4907-ga2782315-1jammy [338 kB] 2024-09-14T11:06:35.503 INFO:teuthology.orchestra.run.smithi071.stdout:Get:60 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4907-ga2782315-1jammy [7,989 kB] 2024-09-14T11:06:35.545 INFO:teuthology.orchestra.run.smithi157.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-14T11:06:35.545 INFO:teuthology.orchestra.run.smithi157.stdout:Need to get 251 MB of archives. 2024-09-14T11:06:35.545 INFO:teuthology.orchestra.run.smithi157.stdout:After this operation, 934 MB of additional disk space will be used. 2024-09-14T11:06:35.545 INFO:teuthology.orchestra.run.smithi157.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-14T11:06:35.553 INFO:teuthology.orchestra.run.smithi071.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-14T11:06:35.554 INFO:teuthology.orchestra.run.smithi071.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-14T11:06:35.555 INFO:teuthology.orchestra.run.smithi071.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-14T11:06:35.555 INFO:teuthology.orchestra.run.smithi071.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-14T11:06:35.556 INFO:teuthology.orchestra.run.smithi071.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-14T11:06:35.574 INFO:teuthology.orchestra.run.smithi071.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-14T11:06:35.576 INFO:teuthology.orchestra.run.smithi071.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-14T11:06:35.576 INFO:teuthology.orchestra.run.smithi071.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-14T11:06:35.591 INFO:teuthology.orchestra.run.smithi071.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-14T11:06:35.592 INFO:teuthology.orchestra.run.smithi071.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-14T11:06:35.592 INFO:teuthology.orchestra.run.smithi071.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-14T11:06:35.592 INFO:teuthology.orchestra.run.smithi071.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-14T11:06:35.593 INFO:teuthology.orchestra.run.smithi071.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-14T11:06:35.593 INFO:teuthology.orchestra.run.smithi071.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-14T11:06:35.597 INFO:teuthology.orchestra.run.smithi157.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4907-ga2782315-1jammy [3,634 kB] 2024-09-14T11:06:35.606 INFO:teuthology.orchestra.run.smithi071.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-14T11:06:35.607 INFO:teuthology.orchestra.run.smithi071.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-14T11:06:35.610 INFO:teuthology.orchestra.run.smithi071.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-14T11:06:35.623 INFO:teuthology.orchestra.run.smithi071.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-14T11:06:35.625 INFO:teuthology.orchestra.run.smithi071.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-14T11:06:35.625 INFO:teuthology.orchestra.run.smithi071.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-14T11:06:35.629 INFO:teuthology.orchestra.run.smithi071.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-14T11:06:35.631 INFO:teuthology.orchestra.run.smithi071.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-14T11:06:35.632 INFO:teuthology.orchestra.run.smithi071.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-14T11:06:35.632 INFO:teuthology.orchestra.run.smithi071.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-14T11:06:35.636 INFO:teuthology.orchestra.run.smithi071.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4907-ga2782315-1jammy [112 kB] 2024-09-14T11:06:35.638 INFO:teuthology.orchestra.run.smithi071.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4907-ga2782315-1jammy [473 kB] 2024-09-14T11:06:35.640 INFO:teuthology.orchestra.run.smithi071.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-14T11:06:35.641 INFO:teuthology.orchestra.run.smithi071.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-14T11:06:35.644 INFO:teuthology.orchestra.run.smithi071.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-14T11:06:35.644 INFO:teuthology.orchestra.run.smithi071.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4907-ga2782315-1jammy [28.3 MB] 2024-09-14T11:06:35.658 INFO:teuthology.orchestra.run.smithi071.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-14T11:06:35.658 INFO:teuthology.orchestra.run.smithi071.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-14T11:06:35.659 INFO:teuthology.orchestra.run.smithi071.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-14T11:06:35.660 INFO:teuthology.orchestra.run.smithi071.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-14T11:06:35.661 INFO:teuthology.orchestra.run.smithi071.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-14T11:06:35.667 INFO:teuthology.orchestra.run.smithi071.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-14T11:06:35.667 INFO:teuthology.orchestra.run.smithi071.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-14T11:06:35.675 INFO:teuthology.orchestra.run.smithi071.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-14T11:06:35.677 INFO:teuthology.orchestra.run.smithi071.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-14T11:06:35.678 INFO:teuthology.orchestra.run.smithi071.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-14T11:06:35.967 INFO:teuthology.orchestra.run.smithi157.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-14T11:06:35.979 INFO:teuthology.orchestra.run.smithi157.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-14T11:06:36.060 INFO:teuthology.orchestra.run.smithi157.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-14T11:06:36.259 INFO:teuthology.orchestra.run.smithi071.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4907-ga2782315-1jammy [5,207 kB] 2024-09-14T11:06:36.289 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-14T11:06:36.303 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-14T11:06:36.326 INFO:teuthology.orchestra.run.smithi071.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4907-ga2782315-1jammy [251 kB] 2024-09-14T11:06:36.328 INFO:teuthology.orchestra.run.smithi071.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4907-ga2782315-1jammy [124 kB] 2024-09-14T11:06:36.329 INFO:teuthology.orchestra.run.smithi071.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4907-ga2782315-1jammy [1,562 kB] 2024-09-14T11:06:36.343 INFO:teuthology.orchestra.run.smithi071.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4907-ga2782315-1jammy [6,309 kB] 2024-09-14T11:06:36.352 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-14T11:06:36.367 INFO:teuthology.orchestra.run.smithi157.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-14T11:06:36.371 INFO:teuthology.orchestra.run.smithi157.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-14T11:06:36.372 INFO:teuthology.orchestra.run.smithi157.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-14T11:06:36.374 INFO:teuthology.orchestra.run.smithi157.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-14T11:06:36.401 INFO:teuthology.orchestra.run.smithi157.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-14T11:06:36.407 INFO:teuthology.orchestra.run.smithi157.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-14T11:06:36.412 INFO:teuthology.orchestra.run.smithi157.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-14T11:06:36.450 INFO:teuthology.orchestra.run.smithi071.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4907-ga2782315-1jammy [23.1 MB] 2024-09-14T11:06:36.453 INFO:teuthology.orchestra.run.smithi157.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-14T11:06:36.453 INFO:teuthology.orchestra.run.smithi157.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-14T11:06:36.458 INFO:teuthology.orchestra.run.smithi157.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-14T11:06:36.497 INFO:teuthology.orchestra.run.smithi157.stdout:Get:19 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4907-ga2782315-1jammy [3,334 kB] 2024-09-14T11:06:36.535 INFO:teuthology.orchestra.run.smithi157.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-14T11:06:36.538 INFO:teuthology.orchestra.run.smithi157.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-14T11:06:36.539 INFO:teuthology.orchestra.run.smithi157.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-14T11:06:36.540 INFO:teuthology.orchestra.run.smithi157.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-14T11:06:36.542 INFO:teuthology.orchestra.run.smithi157.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-14T11:06:36.542 INFO:teuthology.orchestra.run.smithi157.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-14T11:06:36.543 INFO:teuthology.orchestra.run.smithi157.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-14T11:06:36.616 INFO:teuthology.orchestra.run.smithi157.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-14T11:06:36.617 INFO:teuthology.orchestra.run.smithi157.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-14T11:06:36.617 INFO:teuthology.orchestra.run.smithi157.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-14T11:06:36.697 INFO:teuthology.orchestra.run.smithi157.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-14T11:06:36.702 INFO:teuthology.orchestra.run.smithi157.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-14T11:06:36.703 INFO:teuthology.orchestra.run.smithi157.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-14T11:06:36.704 INFO:teuthology.orchestra.run.smithi157.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-14T11:06:36.705 INFO:teuthology.orchestra.run.smithi157.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-14T11:06:36.707 INFO:teuthology.orchestra.run.smithi157.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-14T11:06:36.707 INFO:teuthology.orchestra.run.smithi157.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-14T11:06:36.779 INFO:teuthology.orchestra.run.smithi157.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-14T11:06:36.781 INFO:teuthology.orchestra.run.smithi157.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-14T11:06:36.782 INFO:teuthology.orchestra.run.smithi157.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-14T11:06:36.860 INFO:teuthology.orchestra.run.smithi157.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-14T11:06:36.871 INFO:teuthology.orchestra.run.smithi157.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-14T11:06:36.871 INFO:teuthology.orchestra.run.smithi157.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-14T11:06:36.872 INFO:teuthology.orchestra.run.smithi157.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-14T11:06:36.873 INFO:teuthology.orchestra.run.smithi157.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-14T11:06:36.876 INFO:teuthology.orchestra.run.smithi157.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-14T11:06:36.880 INFO:teuthology.orchestra.run.smithi157.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-14T11:06:36.942 INFO:teuthology.orchestra.run.smithi157.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-14T11:06:36.944 INFO:teuthology.orchestra.run.smithi157.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-14T11:06:36.945 INFO:teuthology.orchestra.run.smithi157.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-14T11:06:36.947 INFO:teuthology.orchestra.run.smithi157.stdout:Get:50 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4907-ga2782315-1jammy [721 kB] 2024-09-14T11:06:36.971 INFO:teuthology.orchestra.run.smithi071.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4907-ga2782315-1jammy [14.0 kB] 2024-09-14T11:06:36.972 INFO:teuthology.orchestra.run.smithi157.stdout:Get:51 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4907-ga2782315-1jammy [357 kB] 2024-09-14T11:06:36.972 INFO:teuthology.orchestra.run.smithi071.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4907-ga2782315-1jammy [880 kB] 2024-09-14T11:06:36.984 INFO:teuthology.orchestra.run.smithi071.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4907-ga2782315-1jammy [2,454 kB] 2024-09-14T11:06:36.990 INFO:teuthology.orchestra.run.smithi157.stdout:Get:52 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4907-ga2782315-1jammy [32.8 kB] 2024-09-14T11:06:36.991 INFO:teuthology.orchestra.run.smithi157.stdout:Get:53 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4907-ga2782315-1jammy [180 kB] 2024-09-14T11:06:36.995 INFO:teuthology.orchestra.run.smithi157.stdout:Get:54 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4907-ga2782315-1jammy [71.3 kB] 2024-09-14T11:06:37.006 INFO:teuthology.orchestra.run.smithi157.stdout:Get:55 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4907-ga2782315-1jammy [338 kB] 2024-09-14T11:06:37.013 INFO:teuthology.orchestra.run.smithi157.stdout:Get:56 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4907-ga2782315-1jammy [7,989 kB] 2024-09-14T11:06:37.019 INFO:teuthology.orchestra.run.smithi071.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4907-ga2782315-1jammy [813 kB] 2024-09-14T11:06:37.026 INFO:teuthology.orchestra.run.smithi157.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-14T11:06:37.028 INFO:teuthology.orchestra.run.smithi157.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-14T11:06:37.029 INFO:teuthology.orchestra.run.smithi071.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4907-ga2782315-1jammy [160 kB] 2024-09-14T11:06:37.029 INFO:teuthology.orchestra.run.smithi157.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-14T11:06:37.030 INFO:teuthology.orchestra.run.smithi071.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4907-ga2782315-1jammy [61.4 MB] 2024-09-14T11:06:37.034 INFO:teuthology.orchestra.run.smithi157.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-14T11:06:37.157 INFO:teuthology.orchestra.run.smithi157.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-14T11:06:37.193 INFO:teuthology.orchestra.run.smithi157.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-14T11:06:37.195 INFO:teuthology.orchestra.run.smithi157.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-14T11:06:37.195 INFO:teuthology.orchestra.run.smithi157.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-14T11:06:37.197 INFO:teuthology.orchestra.run.smithi157.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-14T11:06:37.230 INFO:teuthology.orchestra.run.smithi157.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-14T11:06:37.233 INFO:teuthology.orchestra.run.smithi157.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-14T11:06:37.233 INFO:teuthology.orchestra.run.smithi157.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-14T11:06:37.295 INFO:teuthology.orchestra.run.smithi157.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-14T11:06:37.295 INFO:teuthology.orchestra.run.smithi157.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-14T11:06:37.355 INFO:teuthology.orchestra.run.smithi157.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-14T11:06:37.356 INFO:teuthology.orchestra.run.smithi157.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-14T11:06:37.357 INFO:teuthology.orchestra.run.smithi157.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-14T11:06:37.358 INFO:teuthology.orchestra.run.smithi157.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-14T11:06:37.358 INFO:teuthology.orchestra.run.smithi157.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-14T11:06:37.359 INFO:teuthology.orchestra.run.smithi157.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-14T11:06:37.365 INFO:teuthology.orchestra.run.smithi157.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-14T11:06:37.436 INFO:teuthology.orchestra.run.smithi157.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-14T11:06:37.440 INFO:teuthology.orchestra.run.smithi157.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-14T11:06:37.441 INFO:teuthology.orchestra.run.smithi157.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-14T11:06:37.518 INFO:teuthology.orchestra.run.smithi157.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-14T11:06:37.524 INFO:teuthology.orchestra.run.smithi157.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-14T11:06:37.526 INFO:teuthology.orchestra.run.smithi157.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-14T11:06:37.527 INFO:teuthology.orchestra.run.smithi157.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-14T11:06:37.538 INFO:teuthology.orchestra.run.smithi157.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-14T11:06:37.540 INFO:teuthology.orchestra.run.smithi157.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-14T11:06:37.547 INFO:teuthology.orchestra.run.smithi157.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-14T11:06:37.599 INFO:teuthology.orchestra.run.smithi157.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-14T11:06:37.601 INFO:teuthology.orchestra.run.smithi157.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-14T11:06:37.601 INFO:teuthology.orchestra.run.smithi157.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-14T11:06:37.680 INFO:teuthology.orchestra.run.smithi157.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-14T11:06:37.682 INFO:teuthology.orchestra.run.smithi157.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-14T11:06:37.693 INFO:teuthology.orchestra.run.smithi157.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4907-ga2782315-1jammy [112 kB] 2024-09-14T11:06:37.696 INFO:teuthology.orchestra.run.smithi157.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4907-ga2782315-1jammy [473 kB] 2024-09-14T11:06:37.699 INFO:teuthology.orchestra.run.smithi157.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-14T11:06:37.700 INFO:teuthology.orchestra.run.smithi157.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-14T11:06:37.701 INFO:teuthology.orchestra.run.smithi157.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-14T11:06:37.706 INFO:teuthology.orchestra.run.smithi157.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-14T11:06:37.707 INFO:teuthology.orchestra.run.smithi157.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-14T11:06:37.709 INFO:teuthology.orchestra.run.smithi157.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4907-ga2782315-1jammy [28.3 MB] 2024-09-14T11:06:38.609 INFO:teuthology.orchestra.run.smithi071.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4907-ga2782315-1jammy [8,625 kB] 2024-09-14T11:06:38.841 INFO:teuthology.orchestra.run.smithi157.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4907-ga2782315-1jammy [5,207 kB] 2024-09-14T11:06:38.857 INFO:teuthology.orchestra.run.smithi071.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4907-ga2782315-1jammy [14.2 kB] 2024-09-14T11:06:38.858 INFO:teuthology.orchestra.run.smithi071.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4907-ga2782315-1jammy [55.8 MB] 2024-09-14T11:06:38.921 INFO:teuthology.orchestra.run.smithi157.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4907-ga2782315-1jammy [251 kB] 2024-09-14T11:06:38.925 INFO:teuthology.orchestra.run.smithi157.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4907-ga2782315-1jammy [124 kB] 2024-09-14T11:06:38.927 INFO:teuthology.orchestra.run.smithi157.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4907-ga2782315-1jammy [1,562 kB] 2024-09-14T11:06:38.976 INFO:teuthology.orchestra.run.smithi157.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4907-ga2782315-1jammy [6,309 kB] 2024-09-14T11:06:39.154 INFO:teuthology.orchestra.run.smithi157.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4907-ga2782315-1jammy [23.1 MB] 2024-09-14T11:06:39.960 INFO:teuthology.orchestra.run.smithi157.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4907-ga2782315-1jammy [14.0 kB] 2024-09-14T11:06:39.961 INFO:teuthology.orchestra.run.smithi157.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4907-ga2782315-1jammy [880 kB] 2024-09-14T11:06:39.978 INFO:teuthology.orchestra.run.smithi157.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4907-ga2782315-1jammy [2,454 kB] 2024-09-14T11:06:40.020 INFO:teuthology.orchestra.run.smithi157.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4907-ga2782315-1jammy [813 kB] 2024-09-14T11:06:40.035 INFO:teuthology.orchestra.run.smithi157.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4907-ga2782315-1jammy [160 kB] 2024-09-14T11:06:40.037 INFO:teuthology.orchestra.run.smithi157.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4907-ga2782315-1jammy [61.4 MB] 2024-09-14T11:06:40.932 INFO:teuthology.orchestra.run.smithi071.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4907-ga2782315-1jammy [130 kB] 2024-09-14T11:06:40.935 INFO:teuthology.orchestra.run.smithi071.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4907-ga2782315-1jammy [39.0 kB] 2024-09-14T11:06:41.006 INFO:teuthology.orchestra.run.smithi071.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4907-ga2782315-1jammy [15.9 MB] 2024-09-14T11:06:41.495 INFO:teuthology.orchestra.run.smithi071.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4907-ga2782315-1jammy [91.2 kB] 2024-09-14T11:06:41.877 INFO:teuthology.orchestra.run.smithi157.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4907-ga2782315-1jammy [8,625 kB] 2024-09-14T11:06:41.986 INFO:teuthology.orchestra.run.smithi157.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4907-ga2782315-1jammy [14.2 kB] 2024-09-14T11:06:41.986 INFO:teuthology.orchestra.run.smithi157.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4907-ga2782315-1jammy [55.8 MB] 2024-09-14T11:06:42.069 INFO:teuthology.orchestra.run.smithi071.stdout:Fetched 251 MB in 6s (39.3 MB/s) 2024-09-14T11:06:42.227 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-14T11:06:42.326 INFO:teuthology.orchestra.run.smithi071.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-14T11:06:42.332 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-14T11:06:42.409 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-14T11:06:42.704 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-14T11:06:42.730 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-14T11:06:42.771 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-14T11:06:43.099 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-14T11:06:43.125 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-14T11:06:43.165 INFO:teuthology.orchestra.run.smithi157.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4907-ga2782315-1jammy [130 kB] 2024-09-14T11:06:43.165 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-14T11:06:43.167 INFO:teuthology.orchestra.run.smithi157.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4907-ga2782315-1jammy [39.0 kB] 2024-09-14T11:06:43.168 INFO:teuthology.orchestra.run.smithi157.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4907-ga2782315-1jammy [15.9 MB] 2024-09-14T11:06:43.470 INFO:teuthology.orchestra.run.smithi157.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4907-ga2782315-1jammy [91.2 kB] 2024-09-14T11:06:43.619 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-14T11:06:43.645 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T11:06:43.693 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T11:06:44.037 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 251 MB in 8s (31.0 MB/s) 2024-09-14T11:06:44.063 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-14T11:06:44.089 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T11:06:44.130 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T11:06:44.202 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-14T11:06:44.303 INFO:teuthology.orchestra.run.smithi157.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-14T11:06:44.308 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-14T11:06:44.392 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-14T11:06:44.483 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-14T11:06:44.509 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T11:06:44.549 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T11:06:44.695 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-14T11:06:44.721 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-14T11:06:44.762 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-14T11:06:44.903 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-14T11:06:44.929 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-14T11:06:44.969 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-14T11:06:45.081 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-14T11:06:45.107 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-14T11:06:45.148 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-14T11:06:45.330 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package librados2. 2024-09-14T11:06:45.357 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../007-librados2_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:06:45.405 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking librados2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:45.527 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-14T11:06:45.553 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T11:06:45.593 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T11:06:45.916 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libnbd0. 2024-09-14T11:06:45.942 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-14T11:06:45.980 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-14T11:06:45.983 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-14T11:06:46.006 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T11:06:46.046 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T11:06:46.278 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package librbd1. 2024-09-14T11:06:46.304 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../009-librbd1_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:06:46.344 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking librbd1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:46.383 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-14T11:06:46.409 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T11:06:46.449 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T11:06:46.769 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-14T11:06:46.795 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-14T11:06:46.813 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libcephfs2. 2024-09-14T11:06:46.827 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-14T11:06:46.840 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:06:46.880 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libcephfs2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:47.130 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package librados2. 2024-09-14T11:06:47.157 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../007-librados2_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:06:47.197 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librados2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:47.199 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-rados. 2024-09-14T11:06:47.214 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:06:47.266 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-rados (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:47.594 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-14T11:06:47.620 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:06:47.660 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-ceph-argparse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:47.667 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libnbd0. 2024-09-14T11:06:47.693 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-14T11:06:47.733 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-14T11:06:47.913 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-cephfs. 2024-09-14T11:06:47.928 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:06:47.971 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-cephfs (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:48.019 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package librbd1. 2024-09-14T11:06:48.034 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../009-librbd1_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:06:48.069 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librbd1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:48.282 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-14T11:06:48.308 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:06:48.349 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:48.455 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libcephfs2. 2024-09-14T11:06:48.481 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:06:48.513 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libcephfs2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:48.985 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-14T11:06:49.011 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-14T11:06:49.041 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-rados. 2024-09-14T11:06:49.060 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-14T11:06:49.067 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:06:49.107 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-rados (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:49.405 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-prettytable. 2024-09-14T11:06:49.431 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-14T11:06:49.444 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-14T11:06:49.470 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:06:49.471 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-14T11:06:49.510 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-ceph-argparse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:49.724 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-rbd. 2024-09-14T11:06:49.750 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:06:49.762 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cephfs. 2024-09-14T11:06:49.778 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:06:49.790 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-rbd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:49.821 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cephfs (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:50.074 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-14T11:06:50.089 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:06:50.132 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:50.152 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-14T11:06:50.179 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-14T11:06:50.218 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-14T11:06:50.452 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-14T11:06:50.478 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-14T11:06:50.512 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-14T11:06:50.518 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-14T11:06:50.527 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-14T11:06:50.562 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-14T11:06:50.848 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-14T11:06:50.854 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-prettytable. 2024-09-14T11:06:50.863 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-14T11:06:50.881 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-14T11:06:50.906 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-14T11:06:50.921 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-14T11:06:51.182 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-rbd. 2024-09-14T11:06:51.197 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:06:51.235 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package lua5.1. 2024-09-14T11:06:51.242 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-rbd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:51.261 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-14T11:06:51.302 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-14T11:06:51.587 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-14T11:06:51.613 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package lua-any. 2024-09-14T11:06:51.613 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-14T11:06:51.628 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-14T11:06:51.653 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-14T11:06:51.662 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-14T11:06:51.865 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package zip. 2024-09-14T11:06:51.891 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-14T11:06:51.923 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-14T11:06:51.931 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking zip (3.0-12build2) ... 2024-09-14T11:06:51.949 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-14T11:06:51.989 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-14T11:06:52.268 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package unzip. 2024-09-14T11:06:52.283 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-14T11:06:52.294 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-14T11:06:52.299 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-14T11:06:52.335 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-14T11:06:52.342 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-14T11:06:52.654 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package lua5.1. 2024-09-14T11:06:52.680 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-14T11:06:52.720 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-14T11:06:52.730 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package luarocks. 2024-09-14T11:06:52.756 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-14T11:06:52.796 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-14T11:06:53.007 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package lua-any. 2024-09-14T11:06:53.033 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-14T11:06:53.073 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-14T11:06:53.179 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package librgw2. 2024-09-14T11:06:53.206 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../026-librgw2_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:06:53.237 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking librgw2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:53.325 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package zip. 2024-09-14T11:06:53.341 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-14T11:06:53.392 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking zip (3.0-12build2) ... 2024-09-14T11:06:53.713 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package unzip. 2024-09-14T11:06:53.739 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-14T11:06:53.779 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-14T11:06:53.840 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-rgw. 2024-09-14T11:06:53.866 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:06:53.906 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-rgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:54.133 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package luarocks. 2024-09-14T11:06:54.159 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-14T11:06:54.191 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-14T11:06:54.243 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-14T11:06:54.269 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-14T11:06:54.309 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-14T11:06:54.591 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package librgw2. 2024-09-14T11:06:54.612 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libradosstriper1. 2024-09-14T11:06:54.617 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../026-librgw2_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:06:54.638 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:06:54.657 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librgw2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:54.678 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libradosstriper1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:55.107 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-common. 2024-09-14T11:06:55.133 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:06:55.190 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:55.276 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-rgw. 2024-09-14T11:06:55.291 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:06:55.335 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-rgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:55.637 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-14T11:06:55.664 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-14T11:06:55.704 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-14T11:06:55.999 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libradosstriper1. 2024-09-14T11:06:56.025 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:06:56.065 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libradosstriper1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:56.435 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-common. 2024-09-14T11:06:56.462 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:06:56.493 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:56.653 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-base. 2024-09-14T11:06:56.680 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:06:56.738 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-base (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:57.307 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-14T11:06:57.334 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-14T11:06:57.374 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-14T11:06:57.685 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-cheroot. 2024-09-14T11:06:57.712 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-14T11:06:57.752 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-14T11:06:58.015 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-base. 2024-09-14T11:06:58.042 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:06:58.055 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-14T11:06:58.081 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-14T11:06:58.091 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-base (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:58.121 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-14T11:06:58.399 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-14T11:06:58.425 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-14T11:06:58.465 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-14T11:06:58.670 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-14T11:06:58.696 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-14T11:06:58.736 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-14T11:06:58.752 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-14T11:06:58.778 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-14T11:06:58.818 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-14T11:06:59.022 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cheroot. 2024-09-14T11:06:59.048 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-14T11:06:59.235 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-14T11:06:59.313 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-tempora. 2024-09-14T11:06:59.339 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-14T11:06:59.389 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-14T11:06:59.600 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-14T11:06:59.626 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-14T11:06:59.666 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-14T11:06:59.715 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-portend. 2024-09-14T11:06:59.742 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-14T11:06:59.782 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-14T11:06:59.953 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-14T11:06:59.979 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-14T11:07:00.019 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-14T11:07:00.077 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-14T11:07:00.103 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-14T11:07:00.143 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-14T11:07:00.272 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-14T11:07:00.299 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-14T11:07:00.330 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-14T11:07:00.413 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-14T11:07:00.439 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-14T11:07:00.479 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-14T11:07:00.633 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-tempora. 2024-09-14T11:07:00.660 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-14T11:07:00.700 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-14T11:07:00.849 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-natsort. 2024-09-14T11:07:00.876 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-14T11:07:00.916 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-14T11:07:01.011 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-portend. 2024-09-14T11:07:01.038 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-14T11:07:01.078 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-14T11:07:01.186 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-logutils. 2024-09-14T11:07:01.212 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-14T11:07:01.244 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-14T11:07:01.356 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-14T11:07:01.382 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-14T11:07:01.431 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-14T11:07:01.530 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-14T11:07:01.556 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-14T11:07:01.596 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-14T11:07:01.708 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-14T11:07:01.735 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-14T11:07:01.775 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-14T11:07:01.899 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-mako. 2024-09-14T11:07:01.925 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-14T11:07:01.966 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-14T11:07:02.104 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-natsort. 2024-09-14T11:07:02.131 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-14T11:07:02.170 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-14T11:07:02.294 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-14T11:07:02.321 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-14T11:07:02.360 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-14T11:07:02.482 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-logutils. 2024-09-14T11:07:02.508 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-14T11:07:02.548 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-14T11:07:02.622 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-14T11:07:02.637 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-14T11:07:02.671 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-14T11:07:02.817 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-14T11:07:02.833 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-14T11:07:02.867 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-14T11:07:02.949 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-webob. 2024-09-14T11:07:02.976 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-14T11:07:03.016 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-14T11:07:03.187 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-mako. 2024-09-14T11:07:03.214 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-14T11:07:03.254 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-14T11:07:03.377 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-waitress. 2024-09-14T11:07:03.404 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-14T11:07:03.447 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-14T11:07:03.582 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-14T11:07:03.609 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-14T11:07:03.649 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-14T11:07:03.755 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-tempita. 2024-09-14T11:07:03.782 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-14T11:07:03.821 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-14T11:07:03.951 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-14T11:07:03.978 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-14T11:07:04.018 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-14T11:07:04.124 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-paste. 2024-09-14T11:07:04.151 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-14T11:07:04.191 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-14T11:07:04.271 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-webob. 2024-09-14T11:07:04.297 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-14T11:07:04.329 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-14T11:07:04.513 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-14T11:07:04.539 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-14T11:07:04.579 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-14T11:07:04.657 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-waitress. 2024-09-14T11:07:04.683 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-14T11:07:04.726 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-14T11:07:04.924 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-14T11:07:04.950 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-14T11:07:04.991 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-14T11:07:05.060 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-tempita. 2024-09-14T11:07:05.086 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-14T11:07:05.127 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-14T11:07:05.353 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-webtest. 2024-09-14T11:07:05.379 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-14T11:07:05.419 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-14T11:07:05.455 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-paste. 2024-09-14T11:07:05.481 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-14T11:07:05.563 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-14T11:07:05.731 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pecan. 2024-09-14T11:07:05.758 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-14T11:07:05.797 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-14T11:07:05.899 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-14T11:07:05.914 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-14T11:07:05.957 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-14T11:07:06.161 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-certifi. 2024-09-14T11:07:06.188 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-14T11:07:06.210 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-14T11:07:06.236 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-14T11:07:06.237 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-14T11:07:06.268 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-14T11:07:06.572 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-webtest. 2024-09-14T11:07:06.598 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-14T11:07:06.614 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-idna. 2024-09-14T11:07:06.638 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-14T11:07:06.641 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-14T11:07:06.681 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-14T11:07:06.949 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pecan. 2024-09-14T11:07:06.975 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-14T11:07:06.984 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-urllib3. 2024-09-14T11:07:07.010 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-14T11:07:07.016 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-14T11:07:07.050 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-14T11:07:07.379 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-requests. 2024-09-14T11:07:07.379 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-certifi. 2024-09-14T11:07:07.406 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-14T11:07:07.406 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-14T11:07:07.446 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-14T11:07:07.446 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-14T11:07:07.715 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-14T11:07:07.740 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-idna. 2024-09-14T11:07:07.742 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-14T11:07:07.767 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-14T11:07:07.782 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-14T11:07:07.798 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-14T11:07:08.060 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-14T11:07:08.068 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-urllib3. 2024-09-14T11:07:08.076 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:07:08.094 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-14T11:07:08.110 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:08.134 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-14T11:07:09.289 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-requests. 2024-09-14T11:07:09.315 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-14T11:07:09.355 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-14T11:07:09.449 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-14T11:07:09.475 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:07:09.666 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-14T11:07:09.693 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-14T11:07:09.724 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:09.732 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-14T11:07:09.994 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-14T11:07:10.011 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-14T11:07:10.022 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-14T11:07:10.038 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:07:10.051 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-14T11:07:10.077 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:10.355 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-openssl. 2024-09-14T11:07:10.381 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-14T11:07:10.421 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-14T11:07:10.432 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-14T11:07:10.459 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:07:10.499 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:10.750 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-mgr. 2024-09-14T11:07:10.776 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:07:10.776 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-14T11:07:10.804 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-14T11:07:10.816 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-mgr (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:10.843 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-14T11:07:11.146 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-openssl. 2024-09-14T11:07:11.173 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-14T11:07:11.203 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-mon. 2024-09-14T11:07:11.212 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-14T11:07:11.230 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:07:11.269 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-mon (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:11.549 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr. 2024-09-14T11:07:11.576 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:07:11.615 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:11.832 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-osd. 2024-09-14T11:07:11.858 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:07:11.898 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-osd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:11.994 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mon. 2024-09-14T11:07:12.021 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:07:12.060 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mon (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:12.664 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-osd. 2024-09-14T11:07:12.691 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:07:12.730 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-osd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:12.943 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph. 2024-09-14T11:07:12.958 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../067-ceph_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:07:13.018 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:13.354 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-fuse. 2024-09-14T11:07:13.381 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:07:13.421 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:13.741 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-mds. 2024-09-14T11:07:13.767 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:07:13.775 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph. 2024-09-14T11:07:13.802 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../067-ceph_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:07:13.807 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-mds (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:13.841 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:14.144 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-fuse. 2024-09-14T11:07:14.171 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:07:14.211 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package cephadm. 2024-09-14T11:07:14.211 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:14.237 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../070-cephadm_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:07:14.277 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:14.555 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mds. 2024-09-14T11:07:14.583 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:07:14.605 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-14T11:07:14.622 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mds (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:14.632 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-14T11:07:14.672 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-14T11:07:14.991 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-14T11:07:15.007 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-14T11:07:15.049 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-14T11:07:15.191 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package cephadm. 2024-09-14T11:07:15.218 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../070-cephadm_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:07:15.258 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:15.586 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-14T11:07:15.613 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-14T11:07:15.652 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-14T11:07:15.980 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-14T11:07:16.007 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-14T11:07:16.047 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-14T11:07:16.063 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-babel. 2024-09-14T11:07:16.090 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-14T11:07:16.130 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-14T11:07:16.458 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-jinja2. 2024-09-14T11:07:16.484 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-14T11:07:16.524 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-14T11:07:16.886 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-14T11:07:16.913 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:07:16.953 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:17.010 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-babel. 2024-09-14T11:07:17.037 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-14T11:07:17.076 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-14T11:07:17.315 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-14T11:07:17.341 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-14T11:07:17.379 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jinja2. 2024-09-14T11:07:17.381 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-14T11:07:17.395 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-14T11:07:17.429 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-14T11:07:17.684 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-routes. 2024-09-14T11:07:17.711 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-14T11:07:17.740 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-14T11:07:17.750 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-14T11:07:17.768 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:07:17.798 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:18.104 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-14T11:07:18.131 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:07:18.143 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-14T11:07:18.159 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-14T11:07:18.171 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:18.193 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-14T11:07:18.446 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-routes. 2024-09-14T11:07:18.473 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-14T11:07:18.504 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-14T11:07:18.808 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-14T11:07:18.835 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:07:18.866 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:21.001 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-14T11:07:21.019 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-14T11:07:21.060 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-14T11:07:21.462 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-14T11:07:21.489 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-14T11:07:21.529 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-14T11:07:21.622 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-joblib. 2024-09-14T11:07:21.650 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-14T11:07:21.689 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-14T11:07:22.016 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-joblib. 2024-09-14T11:07:22.044 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-14T11:07:22.051 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-14T11:07:22.079 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-14T11:07:22.082 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-14T11:07:22.109 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-14T11:07:22.395 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-sklearn. 2024-09-14T11:07:22.423 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-14T11:07:22.452 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-14T11:07:22.480 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-14T11:07:22.519 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-14T11:07:22.547 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-14T11:07:22.805 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-sklearn. 2024-09-14T11:07:22.833 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-14T11:07:22.974 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-14T11:07:23.291 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-14T11:07:23.307 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:07:23.341 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:23.641 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-14T11:07:23.669 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:07:23.708 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:24.245 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-cachetools. 2024-09-14T11:07:24.272 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-14T11:07:24.311 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-14T11:07:24.614 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-14T11:07:24.642 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-14T11:07:24.653 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cachetools. 2024-09-14T11:07:24.681 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-14T11:07:24.681 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-14T11:07:24.719 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-14T11:07:24.976 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-14T11:07:25.003 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-14T11:07:25.022 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-14T11:07:25.034 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-14T11:07:25.050 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-14T11:07:25.089 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-14T11:07:25.346 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-rsa. 2024-09-14T11:07:25.374 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-14T11:07:25.412 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-14T11:07:25.617 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-14T11:07:25.645 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-14T11:07:25.683 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-14T11:07:25.733 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-google-auth. 2024-09-14T11:07:25.761 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-14T11:07:25.800 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-14T11:07:25.962 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-rsa. 2024-09-14T11:07:25.989 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-14T11:07:26.020 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-14T11:07:26.120 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-14T11:07:26.147 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-14T11:07:26.186 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-14T11:07:26.332 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-google-auth. 2024-09-14T11:07:26.360 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-14T11:07:26.398 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-14T11:07:26.464 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-websocket. 2024-09-14T11:07:26.480 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-14T11:07:26.514 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-14T11:07:26.710 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-14T11:07:26.737 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-14T11:07:26.768 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-14T11:07:26.818 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-14T11:07:26.845 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-14T11:07:26.884 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-14T11:07:27.063 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-websocket. 2024-09-14T11:07:27.091 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-14T11:07:27.129 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-14T11:07:27.441 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-14T11:07:27.469 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-14T11:07:27.508 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-14T11:07:27.549 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-14T11:07:27.569 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:07:27.607 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:27.935 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-14T11:07:27.997 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-14T11:07:28.001 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-14T11:07:28.172 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-14T11:07:28.200 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:07:28.238 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:28.289 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-14T11:07:28.316 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-14T11:07:28.355 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-14T11:07:28.516 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-14T11:07:28.544 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-14T11:07:28.574 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-14T11:07:28.624 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package jq. 2024-09-14T11:07:28.652 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-14T11:07:28.691 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-14T11:07:28.860 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-14T11:07:28.888 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-14T11:07:28.926 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-14T11:07:28.927 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package socat. 2024-09-14T11:07:28.943 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-14T11:07:28.985 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-14T11:07:29.181 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package jq. 2024-09-14T11:07:29.209 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-14T11:07:29.248 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-14T11:07:29.289 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package xmlstarlet. 2024-09-14T11:07:29.305 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-14T11:07:29.339 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-14T11:07:29.484 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package socat. 2024-09-14T11:07:29.500 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-14T11:07:29.542 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-14T11:07:29.718 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-test. 2024-09-14T11:07:29.735 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:07:29.777 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-test (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:29.837 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package xmlstarlet. 2024-09-14T11:07:29.853 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-14T11:07:29.895 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-14T11:07:30.249 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-test. 2024-09-14T11:07:30.277 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:07:30.316 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-test (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:32.398 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-volume. 2024-09-14T11:07:32.427 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:07:32.464 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-volume (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:32.769 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-14T11:07:32.797 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:07:32.844 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libcephfs-dev (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:32.878 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-volume. 2024-09-14T11:07:32.906 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:07:32.945 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-volume (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:33.172 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-14T11:07:33.200 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-14T11:07:33.238 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-14T11:07:33.258 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-14T11:07:33.285 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:07:33.324 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libcephfs-dev (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:33.593 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-14T11:07:33.610 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-14T11:07:33.621 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-14T11:07:33.638 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-14T11:07:33.659 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-14T11:07:33.676 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-14T11:07:33.956 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-14T11:07:33.984 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-14T11:07:33.989 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package nvme-cli. 2024-09-14T11:07:34.017 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-14T11:07:34.022 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-14T11:07:34.056 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-14T11:07:34.393 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package nvme-cli. 2024-09-14T11:07:34.421 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-14T11:07:34.445 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package pkg-config. 2024-09-14T11:07:34.460 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-14T11:07:34.473 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-14T11:07:34.503 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-14T11:07:34.747 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-14T11:07:34.764 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-14T11:07:34.805 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-14T11:07:34.865 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package pkg-config. 2024-09-14T11:07:34.893 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-14T11:07:34.931 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-14T11:07:35.184 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-14T11:07:35.209 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-14T11:07:35.212 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-14T11:07:35.237 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-14T11:07:35.251 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-14T11:07:35.275 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-14T11:07:35.587 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pastescript. 2024-09-14T11:07:35.615 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-14T11:07:35.653 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-14T11:07:35.662 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-14T11:07:35.690 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-14T11:07:35.729 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-14T11:07:35.974 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pluggy. 2024-09-14T11:07:36.002 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-14T11:07:36.040 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pastescript. 2024-09-14T11:07:36.040 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-14T11:07:36.068 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-14T11:07:36.106 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-14T11:07:36.318 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-psutil. 2024-09-14T11:07:36.346 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-14T11:07:36.377 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-14T11:07:36.443 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pluggy. 2024-09-14T11:07:36.471 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-14T11:07:36.509 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-14T11:07:36.738 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-py. 2024-09-14T11:07:36.766 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-14T11:07:36.779 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-psutil. 2024-09-14T11:07:36.795 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-14T11:07:36.813 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-14T11:07:36.837 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-14T11:07:37.108 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pygments. 2024-09-14T11:07:37.137 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-14T11:07:37.157 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-py. 2024-09-14T11:07:37.175 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-14T11:07:37.185 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-14T11:07:37.257 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-14T11:07:37.552 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pygments. 2024-09-14T11:07:37.568 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-14T11:07:37.602 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-14T11:07:37.659 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-14T11:07:37.687 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-14T11:07:37.721 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-14T11:07:38.024 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-toml. 2024-09-14T11:07:38.048 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-14T11:07:38.052 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-14T11:07:38.076 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-14T11:07:38.090 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-14T11:07:38.114 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-14T11:07:38.393 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pytest. 2024-09-14T11:07:38.422 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-14T11:07:38.425 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-toml. 2024-09-14T11:07:38.453 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-14T11:07:38.460 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-14T11:07:38.492 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-14T11:07:38.781 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-simplejson. 2024-09-14T11:07:38.795 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pytest. 2024-09-14T11:07:38.809 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-14T11:07:38.822 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-14T11:07:38.847 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-14T11:07:38.861 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-14T11:07:39.108 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-14T11:07:39.137 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-14T11:07:39.174 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-14T11:07:39.206 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-simplejson. 2024-09-14T11:07:39.234 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-14T11:07:39.273 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-14T11:07:39.534 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-14T11:07:39.550 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-14T11:07:39.592 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-14T11:07:39.896 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package radosgw. 2024-09-14T11:07:39.924 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../117-radosgw_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:07:39.962 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking radosgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:40.304 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package radosgw. 2024-09-14T11:07:40.332 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../117-radosgw_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:07:40.370 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking radosgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:40.841 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package rbd-fuse. 2024-09-14T11:07:40.869 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:07:40.907 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking rbd-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:41.237 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-14T11:07:41.416 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package rbd-fuse. 2024-09-14T11:07:41.444 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:07:41.473 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking rbd-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:41.496 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-14T11:07:41.614 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-14T11:07:41.778 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-14T11:07:41.886 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-14T11:07:42.045 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-14T11:07:42.180 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-14T11:07:42.207 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-14T11:07:42.439 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-14T11:07:42.613 INFO:teuthology.orchestra.run.smithi071.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-14T11:07:42.699 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:42.763 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-14T11:07:43.185 INFO:teuthology.orchestra.run.smithi157.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-14T11:07:43.256 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:43.441 INFO:teuthology.orchestra.run.smithi071.stdout:Adding system user cephadm....done 2024-09-14T11:07:43.590 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-14T11:07:43.731 INFO:teuthology.orchestra.run.smithi157.stdout:Adding system user cephadm....done 2024-09-14T11:07:43.854 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-14T11:07:43.866 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-14T11:07:44.126 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-14T11:07:44.139 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-14T11:07:44.237 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-14T11:07:44.407 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-14T11:07:44.497 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-14T11:07:44.508 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-14T11:07:44.742 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-14T11:07:44.748 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-14T11:07:44.874 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-14T11:07:44.977 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-14T11:07:45.103 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-14T11:07:45.185 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-14T11:07:45.405 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-14T11:07:45.537 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-14T11:07:45.765 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-14T11:07:45.780 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-14T11:07:45.999 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-14T11:07:46.073 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-14T11:07:46.267 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-14T11:07:46.325 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-14T11:07:46.544 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-14T11:07:46.584 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-14T11:07:46.778 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-14T11:07:46.827 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-14T11:07:47.037 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-14T11:07:47.053 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-ceph-argparse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:47.304 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-14T11:07:47.322 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-ceph-argparse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:47.430 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-14T11:07:47.556 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-14T11:07:47.598 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-14T11:07:47.682 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-14T11:07:47.707 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-14T11:07:47.808 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-14T11:07:47.809 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-14T11:07:47.918 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-14T11:07:48.060 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-14T11:07:48.068 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-14T11:07:48.311 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-14T11:07:48.460 INFO:teuthology.orchestra.run.smithi071.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-14T11:07:48.491 INFO:teuthology.orchestra.run.smithi071.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-14T11:07:48.555 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-14T11:07:48.681 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-14T11:07:48.716 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-14T11:07:48.753 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-14T11:07:48.815 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-14T11:07:48.916 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-14T11:07:49.049 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-14T11:07:49.175 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-14T11:07:49.267 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-14T11:07:49.368 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-14T11:07:49.443 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-14T11:07:49.627 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-14T11:07:49.702 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-14T11:07:49.886 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-14T11:07:50.012 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up zip (3.0-12build2) ... 2024-09-14T11:07:50.138 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-14T11:07:50.180 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up zip (3.0-12build2) ... 2024-09-14T11:07:50.306 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-14T11:07:50.790 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-14T11:07:50.957 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-14T11:07:51.041 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-14T11:07:51.159 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-14T11:07:51.217 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-14T11:07:51.318 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-14T11:07:51.419 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-14T11:07:51.575 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-14T11:07:51.728 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-14T11:07:51.911 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-14T11:07:52.113 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-14T11:07:52.321 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-14T11:07:52.372 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-14T11:07:52.572 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-14T11:07:52.757 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-14T11:07:52.949 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-14T11:07:53.042 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-14T11:07:53.242 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-14T11:07:53.376 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-14T11:07:53.585 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-14T11:07:53.627 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-14T11:07:53.753 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:53.820 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-14T11:07:53.938 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:07:54.080 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-14T11:07:54.256 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-14T11:07:54.406 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-14T11:07:54.573 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-14T11:07:55.587 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-14T11:07:55.747 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-14T11:07:55.830 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T11:07:55.956 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-14T11:07:56.007 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T11:07:56.141 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-14T11:07:56.199 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-14T11:07:56.317 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-14T11:07:56.409 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-14T11:07:56.417 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-14T11:07:56.518 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-14T11:07:56.628 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-14T11:07:56.907 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-14T11:07:56.913 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-14T11:07:57.172 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-14T11:07:57.212 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-14T11:07:57.423 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T11:07:57.481 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T11:07:57.549 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-14T11:07:57.606 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-14T11:07:57.851 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-14T11:07:57.915 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-14T11:07:58.077 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-14T11:07:58.166 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-14T11:07:58.345 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-14T11:07:58.400 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-14T11:07:58.596 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-14T11:07:58.652 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-14T11:07:58.847 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-14T11:07:58.928 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-14T11:07:59.107 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-14T11:07:59.187 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-14T11:07:59.233 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-14T11:07:59.313 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-14T11:07:59.517 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-14T11:07:59.616 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-14T11:07:59.618 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-14T11:07:59.724 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-14T11:07:59.903 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-14T11:08:00.008 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-14T11:08:00.196 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-14T11:08:00.301 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-14T11:08:00.456 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-14T11:08:00.560 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-14T11:08:00.582 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-14T11:08:00.678 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-14T11:08:00.708 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-14T11:08:00.798 INFO:teuthology.orchestra.run.smithi071.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-14T11:08:00.804 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-14T11:08:00.902 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-14T11:08:01.035 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-14T11:08:01.136 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-14T11:08:01.148 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-14T11:08:01.249 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-14T11:08:01.546 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-14T11:08:01.633 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-14T11:08:01.805 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-14T11:08:01.876 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-14T11:08:01.931 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-14T11:08:01.985 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-14T11:08:02.182 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T11:08:02.245 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T11:08:02.333 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-14T11:08:02.396 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-14T11:08:02.651 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-14T11:08:02.714 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-14T11:08:02.927 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-14T11:08:02.998 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-14T11:08:03.187 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-14T11:08:03.266 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-14T11:08:03.313 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-14T11:08:03.392 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-14T11:08:03.573 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-14T11:08:03.651 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-14T11:08:03.926 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-14T11:08:04.005 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-14T11:08:04.161 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-14T11:08:04.264 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-14T11:08:04.546 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-14T11:08:04.649 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-14T11:08:04.823 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-14T11:08:04.925 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-14T11:08:05.152 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-14T11:08:05.245 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-14T11:08:05.260 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up librados2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:05.377 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:05.379 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librados2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:05.504 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-14T11:08:05.505 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:05.606 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-14T11:08:05.840 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libcephfs2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:05.934 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libcephfs2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:05.966 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libradosstriper1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:06.060 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libradosstriper1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:06.067 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-14T11:08:06.186 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-14T11:08:06.344 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up librbd1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:06.471 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librbd1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:06.479 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-mgr-modules-core (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:06.605 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:06.622 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-modules-core (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:06.748 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:06.820 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-14T11:08:06.820 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-14T11:08:06.970 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-14T11:08:06.970 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-14T11:08:07.290 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libcephfs-dev (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:07.416 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-rados (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:07.450 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libcephfs-dev (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:07.534 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up librgw2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:07.550 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-rados (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:07.652 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librgw2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:07.652 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-14T11:08:07.769 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-14T11:08:08.797 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-rbd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:08.923 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up rbd-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:08.981 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-rbd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:09.049 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-rgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:09.091 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up rbd-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:09.167 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-cephfs (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:09.220 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-rgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:09.268 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:09.326 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cephfs (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:09.427 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:09.803 INFO:teuthology.orchestra.run.smithi071.stdout:Adding group ceph....done 2024-09-14T11:08:10.003 INFO:teuthology.orchestra.run.smithi157.stdout:Adding group ceph....done 2024-09-14T11:08:10.113 INFO:teuthology.orchestra.run.smithi071.stdout:Adding system user ceph....done 2024-09-14T11:08:10.274 INFO:teuthology.orchestra.run.smithi071.stdout:Setting system user ceph properties....done 2024-09-14T11:08:10.293 INFO:teuthology.orchestra.run.smithi071.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-14T11:08:10.371 INFO:teuthology.orchestra.run.smithi157.stdout:Adding system user ceph....done 2024-09-14T11:08:10.425 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-14T11:08:10.498 INFO:teuthology.orchestra.run.smithi157.stdout:Setting system user ceph properties....done 2024-09-14T11:08:10.513 INFO:teuthology.orchestra.run.smithi157.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-14T11:08:10.651 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-14T11:08:10.730 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-14T11:08:11.034 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-14T11:08:11.179 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-test (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:11.305 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up radosgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:11.511 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-test (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:11.638 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up radosgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:11.759 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-14T11:08:11.759 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-14T11:08:12.103 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-14T11:08:12.104 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-14T11:08:12.207 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-base (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:12.536 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-14T11:08:12.715 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-base (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:13.001 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-mds (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:13.087 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-14T11:08:13.229 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-14T11:08:13.229 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-14T11:08:13.542 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mds (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:13.694 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-mgr (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:13.744 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-14T11:08:13.744 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-14T11:08:13.913 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-14T11:08:13.913 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-14T11:08:14.219 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:14.381 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-osd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:14.440 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-14T11:08:14.440 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-14T11:08:14.676 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-14T11:08:14.676 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-14T11:08:14.920 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-osd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:15.139 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:15.193 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-14T11:08:15.193 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-14T11:08:15.265 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:15.416 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-mon (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:15.611 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-14T11:08:15.611 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-14T11:08:15.697 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:15.798 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:15.924 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mon (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:16.059 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-mgr-cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:16.142 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-14T11:08:16.142 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-14T11:08:16.185 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:16.320 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-mgr-dashboard (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:16.471 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-volume (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:16.566 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:16.743 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:16.841 INFO:teuthology.orchestra.run.smithi071.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-14T11:08:16.869 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-dashboard (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:16.941 INFO:teuthology.orchestra.run.smithi071.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-14T11:08:17.020 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-volume (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:08:17.107 INFO:teuthology.orchestra.run.smithi071.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-14T11:08:17.373 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-14T11:08:17.500 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-14T11:08:17.644 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-14T11:08:18.263 INFO:teuthology.orchestra.run.smithi071.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-14T11:08:18.745 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-14T11:08:18.934 INFO:teuthology.orchestra.run.smithi071.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-14T11:08:18.937 DEBUG:teuthology.orchestra.run.smithi071:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-14T11:08:18.991 INFO:teuthology.orchestra.run.smithi071.stdout:Reading package lists... 2024-09-14T11:08:19.195 INFO:teuthology.orchestra.run.smithi071.stdout:Building dependency tree... 2024-09-14T11:08:19.196 INFO:teuthology.orchestra.run.smithi071.stdout:Reading state information... 2024-09-14T11:08:19.373 INFO:teuthology.orchestra.run.smithi071.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T11:08:19.373 INFO:teuthology.orchestra.run.smithi071.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T11:08:19.373 INFO:teuthology.orchestra.run.smithi071.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T11:08:19.373 INFO:teuthology.orchestra.run.smithi071.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T11:08:19.374 INFO:teuthology.orchestra.run.smithi071.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T11:08:19.374 INFO:teuthology.orchestra.run.smithi071.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T11:08:19.374 INFO:teuthology.orchestra.run.smithi071.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T11:08:19.375 INFO:teuthology.orchestra.run.smithi071.stdout:The following additional packages will be installed: 2024-09-14T11:08:19.375 INFO:teuthology.orchestra.run.smithi071.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-14T11:08:19.375 INFO:teuthology.orchestra.run.smithi071.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-14T11:08:19.375 INFO:teuthology.orchestra.run.smithi071.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-14T11:08:19.375 INFO:teuthology.orchestra.run.smithi071.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-14T11:08:19.375 INFO:teuthology.orchestra.run.smithi071.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-14T11:08:19.375 INFO:teuthology.orchestra.run.smithi071.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-14T11:08:19.375 INFO:teuthology.orchestra.run.smithi071.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-14T11:08:19.376 INFO:teuthology.orchestra.run.smithi071.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-14T11:08:19.376 INFO:teuthology.orchestra.run.smithi071.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-14T11:08:19.376 INFO:teuthology.orchestra.run.smithi071.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-14T11:08:19.376 INFO:teuthology.orchestra.run.smithi071.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-14T11:08:19.376 INFO:teuthology.orchestra.run.smithi071.stdout:Suggested packages: 2024-09-14T11:08:19.376 INFO:teuthology.orchestra.run.smithi071.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-14T11:08:19.376 INFO:teuthology.orchestra.run.smithi071.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-14T11:08:19.376 INFO:teuthology.orchestra.run.smithi071.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-14T11:08:19.377 INFO:teuthology.orchestra.run.smithi071.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-14T11:08:19.377 INFO:teuthology.orchestra.run.smithi071.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-14T11:08:19.413 INFO:teuthology.orchestra.run.smithi157.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-14T11:08:19.414 INFO:teuthology.orchestra.run.smithi071.stdout:The following NEW packages will be installed: 2024-09-14T11:08:19.414 INFO:teuthology.orchestra.run.smithi071.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-14T11:08:19.414 INFO:teuthology.orchestra.run.smithi071.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-14T11:08:19.415 INFO:teuthology.orchestra.run.smithi071.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-14T11:08:19.415 INFO:teuthology.orchestra.run.smithi071.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-14T11:08:19.415 INFO:teuthology.orchestra.run.smithi071.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-14T11:08:19.415 INFO:teuthology.orchestra.run.smithi071.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-14T11:08:19.415 INFO:teuthology.orchestra.run.smithi071.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-14T11:08:19.415 INFO:teuthology.orchestra.run.smithi071.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-14T11:08:19.415 INFO:teuthology.orchestra.run.smithi071.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-14T11:08:19.415 INFO:teuthology.orchestra.run.smithi071.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-14T11:08:19.416 INFO:teuthology.orchestra.run.smithi071.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-14T11:08:19.416 INFO:teuthology.orchestra.run.smithi071.stdout: s3cmd 2024-09-14T11:08:19.417 DEBUG:teuthology.orchestra.run.smithi157:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-14T11:08:19.468 INFO:teuthology.orchestra.run.smithi071.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-14T11:08:19.468 INFO:teuthology.orchestra.run.smithi071.stdout:Need to get 10.4 MB of archives. 2024-09-14T11:08:19.468 INFO:teuthology.orchestra.run.smithi071.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-14T11:08:19.468 INFO:teuthology.orchestra.run.smithi071.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-14T11:08:19.470 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-09-14T11:08:19.485 INFO:teuthology.orchestra.run.smithi071.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-14T11:08:19.485 INFO:teuthology.orchestra.run.smithi071.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-14T11:08:19.489 INFO:teuthology.orchestra.run.smithi071.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-14T11:08:19.524 INFO:teuthology.orchestra.run.smithi071.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-14T11:08:19.539 INFO:teuthology.orchestra.run.smithi071.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-14T11:08:19.540 INFO:teuthology.orchestra.run.smithi071.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-14T11:08:19.571 INFO:teuthology.orchestra.run.smithi071.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-14T11:08:19.591 INFO:teuthology.orchestra.run.smithi071.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-14T11:08:19.592 INFO:teuthology.orchestra.run.smithi071.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-14T11:08:19.593 INFO:teuthology.orchestra.run.smithi071.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-14T11:08:19.639 INFO:teuthology.orchestra.run.smithi071.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-14T11:08:19.639 INFO:teuthology.orchestra.run.smithi071.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-14T11:08:19.656 INFO:teuthology.orchestra.run.smithi157.stdout:Building dependency tree... 2024-09-14T11:08:19.657 INFO:teuthology.orchestra.run.smithi157.stdout:Reading state information... 2024-09-14T11:08:19.657 INFO:teuthology.orchestra.run.smithi071.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-14T11:08:19.657 INFO:teuthology.orchestra.run.smithi071.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-14T11:08:19.658 INFO:teuthology.orchestra.run.smithi071.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-14T11:08:19.659 INFO:teuthology.orchestra.run.smithi071.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-14T11:08:19.659 INFO:teuthology.orchestra.run.smithi071.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-14T11:08:19.662 INFO:teuthology.orchestra.run.smithi071.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-14T11:08:19.662 INFO:teuthology.orchestra.run.smithi071.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-14T11:08:19.668 INFO:teuthology.orchestra.run.smithi071.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-14T11:08:19.675 INFO:teuthology.orchestra.run.smithi071.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-14T11:08:19.676 INFO:teuthology.orchestra.run.smithi071.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-14T11:08:19.687 INFO:teuthology.orchestra.run.smithi071.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-14T11:08:19.688 INFO:teuthology.orchestra.run.smithi071.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-14T11:08:19.688 INFO:teuthology.orchestra.run.smithi071.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-14T11:08:19.689 INFO:teuthology.orchestra.run.smithi071.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-14T11:08:19.690 INFO:teuthology.orchestra.run.smithi071.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-14T11:08:19.694 INFO:teuthology.orchestra.run.smithi071.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-14T11:08:19.695 INFO:teuthology.orchestra.run.smithi071.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-14T11:08:19.709 INFO:teuthology.orchestra.run.smithi071.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-14T11:08:19.710 INFO:teuthology.orchestra.run.smithi071.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-14T11:08:19.727 INFO:teuthology.orchestra.run.smithi071.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-14T11:08:19.727 INFO:teuthology.orchestra.run.smithi071.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-14T11:08:19.727 INFO:teuthology.orchestra.run.smithi071.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-14T11:08:19.838 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T11:08:19.838 INFO:teuthology.orchestra.run.smithi157.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T11:08:19.838 INFO:teuthology.orchestra.run.smithi157.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T11:08:19.838 INFO:teuthology.orchestra.run.smithi157.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T11:08:19.839 INFO:teuthology.orchestra.run.smithi157.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T11:08:19.839 INFO:teuthology.orchestra.run.smithi157.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T11:08:19.839 INFO:teuthology.orchestra.run.smithi157.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T11:08:19.841 INFO:teuthology.orchestra.run.smithi157.stdout:The following additional packages will be installed: 2024-09-14T11:08:19.841 INFO:teuthology.orchestra.run.smithi157.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-14T11:08:19.842 INFO:teuthology.orchestra.run.smithi157.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-14T11:08:19.842 INFO:teuthology.orchestra.run.smithi157.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-14T11:08:19.842 INFO:teuthology.orchestra.run.smithi157.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-14T11:08:19.842 INFO:teuthology.orchestra.run.smithi157.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-14T11:08:19.842 INFO:teuthology.orchestra.run.smithi157.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-14T11:08:19.842 INFO:teuthology.orchestra.run.smithi157.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-14T11:08:19.842 INFO:teuthology.orchestra.run.smithi157.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-14T11:08:19.843 INFO:teuthology.orchestra.run.smithi157.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-14T11:08:19.843 INFO:teuthology.orchestra.run.smithi157.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-14T11:08:19.843 INFO:teuthology.orchestra.run.smithi157.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-14T11:08:19.843 INFO:teuthology.orchestra.run.smithi157.stdout:Suggested packages: 2024-09-14T11:08:19.844 INFO:teuthology.orchestra.run.smithi157.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-14T11:08:19.844 INFO:teuthology.orchestra.run.smithi157.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-14T11:08:19.844 INFO:teuthology.orchestra.run.smithi157.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-14T11:08:19.844 INFO:teuthology.orchestra.run.smithi157.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-14T11:08:19.844 INFO:teuthology.orchestra.run.smithi157.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-14T11:08:19.882 INFO:teuthology.orchestra.run.smithi157.stdout:The following NEW packages will be installed: 2024-09-14T11:08:19.882 INFO:teuthology.orchestra.run.smithi157.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-14T11:08:19.882 INFO:teuthology.orchestra.run.smithi157.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-14T11:08:19.882 INFO:teuthology.orchestra.run.smithi157.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-14T11:08:19.882 INFO:teuthology.orchestra.run.smithi157.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-14T11:08:19.882 INFO:teuthology.orchestra.run.smithi157.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-14T11:08:19.882 INFO:teuthology.orchestra.run.smithi157.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-14T11:08:19.882 INFO:teuthology.orchestra.run.smithi157.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-14T11:08:19.882 INFO:teuthology.orchestra.run.smithi157.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-14T11:08:19.882 INFO:teuthology.orchestra.run.smithi157.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-14T11:08:19.883 INFO:teuthology.orchestra.run.smithi157.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-14T11:08:19.883 INFO:teuthology.orchestra.run.smithi157.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-14T11:08:19.883 INFO:teuthology.orchestra.run.smithi157.stdout: s3cmd 2024-09-14T11:08:20.063 INFO:teuthology.orchestra.run.smithi157.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-14T11:08:20.064 INFO:teuthology.orchestra.run.smithi157.stdout:Need to get 10.4 MB of archives. 2024-09-14T11:08:20.064 INFO:teuthology.orchestra.run.smithi157.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-14T11:08:20.064 INFO:teuthology.orchestra.run.smithi157.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-14T11:08:20.146 INFO:teuthology.orchestra.run.smithi157.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-14T11:08:20.146 INFO:teuthology.orchestra.run.smithi157.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-14T11:08:20.163 INFO:teuthology.orchestra.run.smithi157.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-14T11:08:20.171 INFO:teuthology.orchestra.run.smithi071.stdout:Fetched 10.4 MB in 0s (34.1 MB/s) 2024-09-14T11:08:20.251 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-14T11:08:20.310 INFO:teuthology.orchestra.run.smithi071.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176255 files and directories currently installed.) 2024-09-14T11:08:20.316 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-14T11:08:20.327 INFO:teuthology.orchestra.run.smithi157.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-14T11:08:20.359 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-14T11:08:20.397 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-14T11:08:20.405 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-14T11:08:20.540 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-14T11:08:20.621 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-14T11:08:20.633 INFO:teuthology.orchestra.run.smithi157.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-14T11:08:20.633 INFO:teuthology.orchestra.run.smithi157.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-14T11:08:20.636 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-14T11:08:20.637 INFO:teuthology.orchestra.run.smithi157.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-14T11:08:20.679 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-14T11:08:20.782 INFO:teuthology.orchestra.run.smithi157.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-14T11:08:20.782 INFO:teuthology.orchestra.run.smithi157.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-14T11:08:20.822 INFO:teuthology.orchestra.run.smithi157.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-14T11:08:20.823 INFO:teuthology.orchestra.run.smithi157.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-14T11:08:20.824 INFO:teuthology.orchestra.run.smithi157.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-14T11:08:20.826 INFO:teuthology.orchestra.run.smithi157.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-14T11:08:20.826 INFO:teuthology.orchestra.run.smithi157.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-14T11:08:20.832 INFO:teuthology.orchestra.run.smithi157.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-14T11:08:20.833 INFO:teuthology.orchestra.run.smithi157.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-14T11:08:20.865 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-14T11:08:20.881 INFO:teuthology.orchestra.run.smithi157.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-14T11:08:20.882 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-14T11:08:20.883 INFO:teuthology.orchestra.run.smithi157.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-14T11:08:20.915 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-14T11:08:20.931 INFO:teuthology.orchestra.run.smithi157.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-14T11:08:20.933 INFO:teuthology.orchestra.run.smithi157.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-14T11:08:20.933 INFO:teuthology.orchestra.run.smithi157.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-14T11:08:20.936 INFO:teuthology.orchestra.run.smithi157.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-14T11:08:20.937 INFO:teuthology.orchestra.run.smithi157.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-14T11:08:20.964 INFO:teuthology.orchestra.run.smithi157.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-14T11:08:20.972 INFO:teuthology.orchestra.run.smithi157.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-14T11:08:20.977 INFO:teuthology.orchestra.run.smithi157.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-14T11:08:21.045 INFO:teuthology.orchestra.run.smithi157.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-14T11:08:21.045 INFO:teuthology.orchestra.run.smithi157.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-14T11:08:21.078 INFO:teuthology.orchestra.run.smithi157.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-14T11:08:21.078 INFO:teuthology.orchestra.run.smithi157.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-14T11:08:21.079 INFO:teuthology.orchestra.run.smithi157.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-14T11:08:21.168 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-14T11:08:21.184 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-14T11:08:21.226 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-14T11:08:21.487 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-14T11:08:21.504 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-14T11:08:21.522 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 10.4 MB in 1s (8,706 kB/s) 2024-09-14T11:08:21.546 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-14T11:08:21.609 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-14T11:08:21.670 INFO:teuthology.orchestra.run.smithi157.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176255 files and directories currently installed.) 2024-09-14T11:08:21.675 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-14T11:08:21.725 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-14T11:08:21.748 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-14T11:08:21.765 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-14T11:08:21.798 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-14T11:08:21.987 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-14T11:08:22.000 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-14T11:08:22.014 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-14T11:08:22.017 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-14T11:08:22.053 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-14T11:08:22.059 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-14T11:08:22.273 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-14T11:08:22.301 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-14T11:08:22.329 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-14T11:08:22.331 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-14T11:08:22.357 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-14T11:08:22.395 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-14T11:08:22.659 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-14T11:08:22.688 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-14T11:08:22.726 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-14T11:08:22.765 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-14T11:08:22.793 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-14T11:08:22.832 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-14T11:08:22.995 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-14T11:08:23.023 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-14T11:08:23.062 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-14T11:08:23.085 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libjsr305-java. 2024-09-14T11:08:23.113 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-14T11:08:23.151 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-14T11:08:23.315 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-14T11:08:23.331 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-14T11:08:23.364 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-14T11:08:23.405 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libguava-java. 2024-09-14T11:08:23.421 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-14T11:08:23.463 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-14T11:08:23.583 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-14T11:08:23.600 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-14T11:08:23.642 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-14T11:08:23.883 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-14T11:08:23.899 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-14T11:08:23.927 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-14T11:08:23.941 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-14T11:08:23.955 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-14T11:08:23.994 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-14T11:08:24.285 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libguice-java. 2024-09-14T11:08:24.288 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-14T11:08:24.313 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-14T11:08:24.316 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-14T11:08:24.355 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-14T11:08:24.360 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-14T11:08:24.583 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libjsr305-java. 2024-09-14T11:08:24.599 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-14T11:08:24.633 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-14T11:08:24.756 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-14T11:08:24.772 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-14T11:08:24.814 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-14T11:08:24.869 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libguava-java. 2024-09-14T11:08:24.897 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-14T11:08:24.935 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-14T11:08:25.067 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-14T11:08:25.095 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-14T11:08:25.134 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-14T11:08:25.346 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-14T11:08:25.362 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-14T11:08:25.396 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-14T11:08:25.420 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libjansi-java. 2024-09-14T11:08:25.448 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-14T11:08:25.495 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-14T11:08:25.624 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libguice-java. 2024-09-14T11:08:25.640 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-14T11:08:25.682 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-14T11:08:25.764 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-14T11:08:25.780 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-14T11:08:25.823 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-14T11:08:26.053 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-14T11:08:26.075 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-14T11:08:26.080 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-14T11:08:26.104 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-14T11:08:26.119 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-14T11:08:26.142 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-14T11:08:26.371 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-14T11:08:26.388 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-14T11:08:26.420 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-14T11:08:26.430 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-14T11:08:26.448 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-14T11:08:26.495 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-14T11:08:26.674 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libjansi-java. 2024-09-14T11:08:26.690 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-14T11:08:26.733 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-14T11:08:26.814 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-14T11:08:26.843 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-14T11:08:26.881 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-14T11:08:26.985 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-14T11:08:27.001 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-14T11:08:27.043 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-14T11:08:27.185 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-14T11:08:27.202 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-14T11:08:27.243 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-14T11:08:27.296 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-14T11:08:27.324 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-14T11:08:27.362 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-14T11:08:27.505 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-14T11:08:27.521 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-14T11:08:27.631 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-14T11:08:27.650 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-14T11:08:27.667 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-14T11:08:27.783 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-14T11:08:27.976 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-14T11:08:28.004 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-14T11:08:28.042 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-14T11:08:28.052 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-14T11:08:28.068 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-14T11:08:28.111 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-14T11:08:28.304 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-14T11:08:28.332 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-14T11:08:28.370 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-14T11:08:28.423 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-14T11:08:28.451 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-14T11:08:28.498 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-14T11:08:28.623 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-14T11:08:28.639 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-14T11:08:28.690 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-14T11:08:28.734 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-14T11:08:28.750 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-14T11:08:28.784 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-14T11:08:28.984 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-14T11:08:29.000 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-14T11:08:29.028 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-14T11:08:29.042 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-14T11:08:29.044 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-14T11:08:29.086 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-14T11:08:29.270 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libslf4j-java. 2024-09-14T11:08:29.287 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-14T11:08:29.320 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-14T11:08:29.338 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-14T11:08:29.355 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-14T11:08:29.397 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-14T11:08:29.591 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-14T11:08:29.607 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-14T11:08:29.633 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-14T11:08:29.650 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-14T11:08:29.657 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-14T11:08:29.691 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-14T11:08:29.927 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-14T11:08:29.943 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-14T11:08:29.952 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-14T11:08:29.977 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-14T11:08:29.980 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-14T11:08:30.019 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-14T11:08:30.213 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libslf4j-java. 2024-09-14T11:08:30.229 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-14T11:08:30.271 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-14T11:08:30.272 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-14T11:08:30.300 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-14T11:08:30.330 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-14T11:08:30.541 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-14T11:08:30.558 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-14T11:08:30.600 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-14T11:08:30.685 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-14T11:08:30.706 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-14T11:08:30.743 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-14T11:08:30.886 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-14T11:08:30.914 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-14T11:08:30.952 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-14T11:08:31.031 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-14T11:08:31.047 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-14T11:08:31.089 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-14T11:08:31.239 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-14T11:08:31.267 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-14T11:08:31.305 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-14T11:08:31.509 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package maven. 2024-09-14T11:08:31.537 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-14T11:08:31.567 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking maven (3.6.3-5) ... 2024-09-14T11:08:31.693 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-14T11:08:31.709 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-14T11:08:31.751 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-14T11:08:31.878 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-magic. 2024-09-14T11:08:31.906 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-14T11:08:31.945 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-14T11:08:32.004 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-14T11:08:32.032 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-14T11:08:32.070 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-14T11:08:32.256 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package s3cmd. 2024-09-14T11:08:32.284 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-14T11:08:32.322 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-14T11:08:32.506 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package maven. 2024-09-14T11:08:32.534 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-14T11:08:32.573 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking maven (3.6.3-5) ... 2024-09-14T11:08:32.702 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-14T11:08:32.836 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-14T11:08:32.910 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-magic. 2024-09-14T11:08:32.937 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-14T11:08:32.962 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-14T11:08:32.976 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-14T11:08:33.080 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-14T11:08:33.181 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-14T11:08:33.280 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package s3cmd. 2024-09-14T11:08:33.308 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-14T11:08:33.315 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-14T11:08:33.346 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-14T11:08:33.441 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-14T11:08:33.567 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-14T11:08:33.693 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-14T11:08:33.693 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-14T11:08:33.818 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-14T11:08:33.819 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-14T11:08:33.936 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-14T11:08:33.945 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-14T11:08:34.037 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-14T11:08:34.071 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-14T11:08:34.154 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-14T11:08:34.180 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-14T11:08:34.280 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-14T11:08:34.281 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-14T11:08:34.382 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-14T11:08:34.406 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-14T11:08:34.508 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-14T11:08:34.532 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-14T11:08:34.675 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-14T11:08:34.768 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-14T11:08:34.801 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-14T11:08:34.894 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-14T11:08:34.927 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-14T11:08:35.037 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-14T11:08:35.045 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-14T11:08:35.145 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-14T11:08:35.163 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-14T11:08:35.271 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-14T11:08:35.289 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-14T11:08:35.390 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-14T11:08:35.397 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-14T11:08:35.491 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-14T11:08:35.532 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-14T11:08:35.767 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-14T11:08:35.792 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-14T11:08:35.893 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-14T11:08:35.918 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-14T11:08:36.019 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libguava-java (29.0-6) ... 2024-09-14T11:08:36.044 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-14T11:08:36.145 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-14T11:08:36.169 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-14T11:08:36.271 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-14T11:08:36.296 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-14T11:08:36.406 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-14T11:08:36.421 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-14T11:08:36.514 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-14T11:08:36.531 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-14T11:08:36.615 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-14T11:08:36.716 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-14T11:08:36.816 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-14T11:08:36.842 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-14T11:08:36.942 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-14T11:08:36.968 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-14T11:08:37.068 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libguava-java (29.0-6) ... 2024-09-14T11:08:37.094 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up maven (3.6.3-5) ... 2024-09-14T11:08:37.194 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-14T11:08:37.320 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-14T11:08:37.351 INFO:teuthology.orchestra.run.smithi071.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-14T11:08:37.421 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-14T11:08:37.423 INFO:teuthology.orchestra.run.smithi071.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-14T11:08:37.538 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-14T11:08:37.758 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-14T11:08:37.974 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-14T11:08:38.100 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-14T11:08:38.242 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-14T11:08:38.368 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up maven (3.6.3-5) ... 2024-09-14T11:08:38.719 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-14T11:08:38.774 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-14T11:08:39.472 INFO:teuthology.orchestra.run.smithi071.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-14T11:08:39.478 DEBUG:teuthology.parallel:result is None 2024-09-14T11:08:40.166 INFO:teuthology.orchestra.run.smithi157.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-14T11:08:40.170 DEBUG:teuthology.parallel:result is None 2024-09-14T11:08:40.171 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T11:08:40.314 DEBUG:teuthology.orchestra.run.smithi071:> dpkg-query -W -f '${Version}' ceph 2024-09-14T11:08:40.333 INFO:teuthology.orchestra.run.smithi071.stdout:19.3.0-4907-ga2782315-1jammy 2024-09-14T11:08:40.334 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4907-ga2782315-1jammy 2024-09-14T11:08:40.334 INFO:teuthology.task.install:The correct ceph version 19.3.0-4907-ga2782315-1jammy is installed. 2024-09-14T11:08:40.336 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T11:08:40.471 DEBUG:teuthology.orchestra.run.smithi157:> dpkg-query -W -f '${Version}' ceph 2024-09-14T11:08:40.490 INFO:teuthology.orchestra.run.smithi157.stdout:19.3.0-4907-ga2782315-1jammy 2024-09-14T11:08:40.490 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4907-ga2782315-1jammy 2024-09-14T11:08:40.490 INFO:teuthology.task.install:The correct ceph version 19.3.0-4907-ga2782315-1jammy is installed. 2024-09-14T11:08:40.492 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-14T11:08:40.492 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T11:08:40.492 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T11:08:40.506 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-14T11:08:40.506 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T11:08:40.547 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-14T11:08:40.547 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T11:08:40.547 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T11:08:40.560 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T11:08:40.612 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-14T11:08:40.612 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T11:08:40.626 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T11:08:40.684 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-14T11:08:40.685 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T11:08:40.685 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T11:08:40.698 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T11:08:40.753 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-14T11:08:40.753 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T11:08:40.765 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T11:08:40.819 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-14T11:08:40.820 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T11:08:40.820 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T11:08:40.832 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T11:08:40.893 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-14T11:08:40.893 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T11:08:40.905 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T11:08:40.960 INFO:teuthology.run_tasks:Running task ceph... 2024-09-14T11:08:41.042 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-14T11:08:41.043 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 777 /var/log/ceph 2024-09-14T11:08:41.045 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 777 /var/log/ceph 2024-09-14T11:08:41.058 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-14T11:08:41.058 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T11:08:41.098 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T11:08:41.112 INFO:tasks.ceph:Creating extra log directories... 2024-09-14T11:08:41.113 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T11:08:41.155 DEBUG:teuthology.orchestra.run.smithi157:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T11:08:41.179 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-14T11:08:41.179 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-14T11:08:41.179 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904156', 'branch': 'main', 'description': 'rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7904156', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}}, 'rgw': {'compression type': 'random', 'datacache': True, 'datacache_path': '/tmp/rgw_datacache', 'ec-data-pool': False, 'frontend': 'beast', 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '1c941a66c1b420259b8fc5ac19e792dbbf60aded'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 950, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 9419, 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'sleep_before_teardown': 0, 'subset': '0/1', 'suite': 'rgw', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '1c941a66c1b420259b8fc5ac19e792dbbf60aded', 'targets': {'smithi071.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK28tlrIsjOwE5qybQwNaltt7L9KR/Tgt8XqtZlHDMFTmJn/1zy+4vppBAvj4/cmO6jVH07aniZCQgNjkEDBl5A=', 'smithi157.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEbJBvXBRqO1DqM05afLThufI5ShmBIDdh3ramY6fNMQVTTBT5fRXV/di1/6oCrf/q9BG5ewnUlPB9eHsEzyJYU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-datacache.sh']}, 'env': {'RGW_DATACACHE_PATH': '/tmp/rgw_datacache'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_20:40:18', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-14T11:08:41.180 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T11:08:41.211 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T11:08:41.217 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T11:08:41.263 DEBUG:teuthology.orchestra.run.smithi157:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T11:08:41.275 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T11:08:41.275 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T11:08:41.321 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T11:08:41.322 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_1 2024-09-14T11:08:41.370 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T11:08:41.370 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:08:41.370 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 888 Links: 1 2024-09-14T11:08:41.370 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:08:41.370 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-14 11:02:55.722648153 +0000 2024-09-14T11:08:41.370 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-14 11:02:55.462650477 +0000 2024-09-14T11:08:41.370 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-14 11:02:55.462650477 +0000 2024-09-14T11:08:41.370 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: - 2024-09-14T11:08:41.371 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T11:08:41.424 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-14T11:08:41.424 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-14T11:08:41.424 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000428657 s, 1.2 MB/s 2024-09-14T11:08:41.425 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T11:08:41.478 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_2 2024-09-14T11:08:41.525 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T11:08:41.525 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:08:41.526 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 900 Links: 1 2024-09-14T11:08:41.526 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:08:41.526 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-14 11:02:56.278643188 +0000 2024-09-14T11:08:41.526 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-14 11:02:55.954646081 +0000 2024-09-14T11:08:41.526 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-14 11:02:55.954646081 +0000 2024-09-14T11:08:41.526 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: - 2024-09-14T11:08:41.526 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T11:08:41.580 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-14T11:08:41.580 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-14T11:08:41.580 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000414914 s, 1.2 MB/s 2024-09-14T11:08:41.581 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T11:08:41.630 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_3 2024-09-14T11:08:41.677 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T11:08:41.677 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:08:41.677 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 924 Links: 1 2024-09-14T11:08:41.677 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:08:41.678 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-14 11:02:56.794638578 +0000 2024-09-14T11:08:41.678 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-14 11:02:56.526640973 +0000 2024-09-14T11:08:41.678 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-14 11:02:56.526640973 +0000 2024-09-14T11:08:41.678 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: - 2024-09-14T11:08:41.678 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T11:08:41.731 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-14T11:08:41.731 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-14T11:08:41.732 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000444774 s, 1.2 MB/s 2024-09-14T11:08:41.733 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T11:08:41.782 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_4 2024-09-14T11:08:41.829 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T11:08:41.829 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:08:41.829 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 938 Links: 1 2024-09-14T11:08:41.829 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:08:41.829 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-14 11:02:57.050636292 +0000 2024-09-14T11:08:41.829 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-14 11:02:57.046636327 +0000 2024-09-14T11:08:41.830 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-14 11:02:57.046636327 +0000 2024-09-14T11:08:41.830 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: - 2024-09-14T11:08:41.830 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T11:08:41.887 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-14T11:08:41.888 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-14T11:08:41.888 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.00039728 s, 1.3 MB/s 2024-09-14T11:08:41.889 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T11:08:41.942 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:08:41.943 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-14T11:08:41.943 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T11:08:41.948 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T11:08:41.948 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_1 2024-09-14T11:08:41.998 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T11:08:41.998 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:08:41.998 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 887 Links: 1 2024-09-14T11:08:41.998 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:08:41.998 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-09-14 11:02:56.436773283 +0000 2024-09-14T11:08:41.998 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-09-14 11:02:56.192745451 +0000 2024-09-14T11:08:41.998 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-09-14 11:02:56.192745451 +0000 2024-09-14T11:08:41.998 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-09-14T11:08:41.998 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T11:08:42.052 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-09-14T11:08:42.052 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-09-14T11:08:42.052 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000318015 s, 1.6 MB/s 2024-09-14T11:08:42.053 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T11:08:42.103 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_2 2024-09-14T11:08:42.150 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T11:08:42.150 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:08:42.150 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 904 Links: 1 2024-09-14T11:08:42.151 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:08:42.151 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-09-14 11:02:56.904826666 +0000 2024-09-14T11:08:42.151 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-09-14 11:02:56.668799747 +0000 2024-09-14T11:08:42.151 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-09-14 11:02:56.668799747 +0000 2024-09-14T11:08:42.151 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-09-14T11:08:42.151 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T11:08:42.203 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-09-14T11:08:42.203 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-09-14T11:08:42.203 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000237913 s, 2.2 MB/s 2024-09-14T11:08:42.205 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T11:08:42.258 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_3 2024-09-14T11:08:42.305 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T11:08:42.305 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:08:42.306 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 920 Links: 1 2024-09-14T11:08:42.306 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:08:42.306 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-09-14 11:02:57.384880272 +0000 2024-09-14T11:08:42.306 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-09-14 11:02:57.136852727 +0000 2024-09-14T11:08:42.306 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-09-14 11:02:57.136852727 +0000 2024-09-14T11:08:42.306 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-09-14T11:08:42.306 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T11:08:42.360 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-09-14T11:08:42.361 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-09-14T11:08:42.361 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000292344 s, 1.8 MB/s 2024-09-14T11:08:42.362 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T11:08:42.412 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_4 2024-09-14T11:08:42.457 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T11:08:42.458 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:08:42.458 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 944 Links: 1 2024-09-14T11:08:42.458 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:08:42.458 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-09-14 11:02:57.832930031 +0000 2024-09-14T11:08:42.458 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-09-14 11:02:57.604904707 +0000 2024-09-14T11:08:42.458 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-09-14 11:02:57.604904707 +0000 2024-09-14T11:08:42.458 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-09-14T11:08:42.458 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T11:08:42.512 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-09-14T11:08:42.512 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-09-14T11:08:42.512 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000284945 s, 1.8 MB/s 2024-09-14T11:08:42.514 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T11:08:42.563 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:08:42.563 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi071.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi157.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-14T11:08:42.563 INFO:tasks.ceph:Generating config... 2024-09-14T11:08:42.565 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-14T11:08:42.565 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-14T11:08:42.565 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-14T11:08:42.565 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-14T11:08:42.565 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-14T11:08:42.565 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T11:08:42.566 INFO:tasks.ceph:[client] rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-14T11:08:42.566 INFO:tasks.ceph:[client] rgw d3n l1 datacache size = 10737418240 2024-09-14T11:08:42.566 INFO:tasks.ceph:[client] rgw d3n l1 local datacache enabled = True 2024-09-14T11:08:42.566 INFO:tasks.ceph:[client] rgw enable ops log = True 2024-09-14T11:08:42.566 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-14T11:08:42.566 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-14T11:08:42.566 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-14T11:08:42.566 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-14T11:08:42.566 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-14T11:08:42.567 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-14T11:08:42.567 INFO:tasks.ceph:[client] setuser = ceph 2024-09-14T11:08:42.567 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-14T11:08:42.567 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-14T11:08:42.567 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-14T11:08:42.567 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-14T11:08:42.567 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-14T11:08:42.567 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-14T11:08:42.567 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-14T11:08:42.567 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-14T11:08:42.567 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-14T11:08:42.567 INFO:tasks.ceph:[mon] lockdep = True 2024-09-14T11:08:42.567 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-14T11:08:42.567 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-14T11:08:42.568 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-14T11:08:42.568 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-14T11:08:42.568 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-14T11:08:42.568 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-14T11:08:42.568 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-14T11:08:42.568 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-14T11:08:42.568 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-14T11:08:42.568 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-14T11:08:42.568 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-14T11:08:42.568 INFO:tasks.ceph:[osd] lockdep = True 2024-09-14T11:08:42.568 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-14T11:08:42.568 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-14T11:08:42.568 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-14T11:08:42.569 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-14T11:08:42.569 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-14T11:08:42.569 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-14T11:08:42.569 INFO:tasks.ceph:Setting up mon.a... 2024-09-14T11:08:42.569 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-14T11:08:42.604 INFO:teuthology.orchestra.run.smithi071.stdout:creating /etc/ceph/ceph.keyring 2024-09-14T11:08:42.619 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-14T11:08:42.698 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T11:08:42.753 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.71'), ('mon.c', '[v2:172.21.15.71:3301,v1:172.21.15.71:6790]'), ('mon.b', '172.21.15.157')] 2024-09-14T11:08:42.754 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.71,[v2:172.21.15.71:3301,v1:172.21.15.71:6790],172.21.15.157', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'lockdep': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': True, 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-14T11:08:42.755 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T11:08:42.755 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T11:08:42.801 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.71 --addv c '[v2:172.21.15.71:3301,v1:172.21.15.71:6790]' --add b 172.21.15.157 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:08:42.887 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:08:42.887 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:08:42.888 INFO:teuthology.orchestra.run.smithi071.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:08:42.888 INFO:teuthology.orchestra.run.smithi071.stdout:monmaptool: generated fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:08:42.888 INFO:teuthology.orchestra.run.smithi071.stdout:setting min_mon_release = quincy 2024-09-14T11:08:42.888 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 0 2024-09-14T11:08:42.888 INFO:teuthology.orchestra.run.smithi071.stdout:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:08:42.888 INFO:teuthology.orchestra.run.smithi071.stdout:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:08:42.888 INFO:teuthology.orchestra.run.smithi071.stdout:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:08:42.888 INFO:teuthology.orchestra.run.smithi071.stdout:min_mon_release 17 (quincy) 2024-09-14T11:08:42.888 INFO:teuthology.orchestra.run.smithi071.stdout:election_strategy: 1 2024-09-14T11:08:42.889 INFO:teuthology.orchestra.run.smithi071.stdout:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:08:42.889 INFO:teuthology.orchestra.run.smithi071.stdout:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:08:42.889 INFO:teuthology.orchestra.run.smithi071.stdout:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:08:42.889 INFO:teuthology.orchestra.run.smithi071.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-14T11:08:42.890 DEBUG:teuthology.orchestra.run.smithi071:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T11:08:42.937 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 26f8926f-0d5e-4c48-adc1-d4f1601407fa... 2024-09-14T11:08:42.938 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T11:08:42.982 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T11:08:43.010 INFO:teuthology.orchestra.run.smithi071.stdout:[global] 2024-09-14T11:08:43.010 INFO:teuthology.orchestra.run.smithi071.stdout: chdir = "" 2024-09-14T11:08:43.010 INFO:teuthology.orchestra.run.smithi071.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T11:08:43.011 INFO:teuthology.orchestra.run.smithi071.stdout: auth supported = cephx 2024-09-14T11:08:43.011 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:08:43.011 INFO:teuthology.orchestra.run.smithi071.stdout: filestore xattr use omap = true 2024-09-14T11:08:43.011 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:08:43.011 INFO:teuthology.orchestra.run.smithi071.stdout: mon clock drift allowed = 1.000 2024-09-14T11:08:43.011 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:08:43.011 INFO:teuthology.orchestra.run.smithi071.stdout: osd crush chooseleaf type = 0 2024-09-14T11:08:43.011 INFO:teuthology.orchestra.run.smithi071.stdout: auth debug = true 2024-09-14T11:08:43.011 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:08:43.011 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on old message = true 2024-09-14T11:08:43.011 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on bug = true 2024-09-14T11:08:43.012 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:08:43.012 INFO:teuthology.orchestra.run.smithi071.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T11:08:43.012 INFO:teuthology.orchestra.run.smithi071.stdout: mon pg warn max object skew = 0 2024-09-14T11:08:43.012 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:08:43.012 INFO:teuthology.orchestra.run.smithi071.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T11:08:43.012 INFO:teuthology.orchestra.run.smithi071.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T11:08:43.012 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:08:43.012 INFO:teuthology.orchestra.run.smithi071.stdout: osd pool default size = 2 2024-09-14T11:08:43.012 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:08:43.012 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd allow primary affinity = true 2024-09-14T11:08:43.012 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd allow pg remap = true 2024-09-14T11:08:43.013 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on legacy crush tunables = false 2024-09-14T11:08:43.013 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on crush straw calc version zero = false 2024-09-14T11:08:43.013 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on no sortbitwise = false 2024-09-14T11:08:43.013 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on osd down out interval zero = false 2024-09-14T11:08:43.013 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on too few osds = false 2024-09-14T11:08:43.013 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T11:08:43.013 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T11:08:43.013 INFO:teuthology.orchestra.run.smithi071.stdout: mon_allow_pool_size_one = true 2024-09-14T11:08:43.013 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:08:43.013 INFO:teuthology.orchestra.run.smithi071.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T11:08:43.014 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:08:43.014 INFO:teuthology.orchestra.run.smithi071.stdout: osd default data pool replay window = 5 2024-09-14T11:08:43.014 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:08:43.014 INFO:teuthology.orchestra.run.smithi071.stdout: mon allow pool delete = true 2024-09-14T11:08:43.014 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:08:43.014 INFO:teuthology.orchestra.run.smithi071.stdout: mon cluster log file level = debug 2024-09-14T11:08:43.014 INFO:teuthology.orchestra.run.smithi071.stdout: debug asserts on shutdown = true 2024-09-14T11:08:43.014 INFO:teuthology.orchestra.run.smithi071.stdout: mon health detail to clog = false 2024-09-14T11:08:43.014 INFO:teuthology.orchestra.run.smithi071.stdout: mon host = "172.21.15.71,[v2:172.21.15.71:3301,v1:172.21.15.71:6790],172.21.15.157" 2024-09-14T11:08:43.014 INFO:teuthology.orchestra.run.smithi071.stdout: mon client directed command retry = 5 2024-09-14T11:08:43.014 INFO:teuthology.orchestra.run.smithi071.stdout: ms inject socket failures = 5000 2024-09-14T11:08:43.014 INFO:teuthology.orchestra.run.smithi071.stdout: osd_max_pg_log_entries = 10 2024-09-14T11:08:43.015 INFO:teuthology.orchestra.run.smithi071.stdout: osd_min_pg_log_entries = 10 2024-09-14T11:08:43.015 INFO:teuthology.orchestra.run.smithi071.stdout: fsid = 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:08:43.015 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:08:43.015 INFO:teuthology.orchestra.run.smithi071.stdout:[osd] 2024-09-14T11:08:43.015 INFO:teuthology.orchestra.run.smithi071.stdout: osd journal size = 100 2024-09-14T11:08:43.015 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:08:43.015 INFO:teuthology.orchestra.run.smithi071.stdout: osd scrub load threshold = 5.0 2024-09-14T11:08:43.015 INFO:teuthology.orchestra.run.smithi071.stdout: osd scrub max interval = 600 2024-09-14T11:08:43.015 INFO:teuthology.orchestra.run.smithi071.stdout: osd mclock profile = high_recovery_ops 2024-09-14T11:08:43.015 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:08:43.015 INFO:teuthology.orchestra.run.smithi071.stdout: osd recover clone overlap = true 2024-09-14T11:08:43.015 INFO:teuthology.orchestra.run.smithi071.stdout: osd recovery max chunk = 1048576 2024-09-14T11:08:43.016 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:08:43.016 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug shutdown = true 2024-09-14T11:08:43.016 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug op order = true 2024-09-14T11:08:43.016 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug verify stray on activate = true 2024-09-14T11:08:43.016 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug trim objects = true 2024-09-14T11:08:43.016 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:08:43.016 INFO:teuthology.orchestra.run.smithi071.stdout: osd open classes on start = true 2024-09-14T11:08:43.016 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug pg log writeout = true 2024-09-14T11:08:43.016 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:08:43.016 INFO:teuthology.orchestra.run.smithi071.stdout: osd deep scrub update digest min age = 30 2024-09-14T11:08:43.016 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:08:43.017 INFO:teuthology.orchestra.run.smithi071.stdout: osd map max advance = 10 2024-09-14T11:08:43.017 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:08:43.017 INFO:teuthology.orchestra.run.smithi071.stdout: journal zero on create = true 2024-09-14T11:08:43.017 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:08:43.017 INFO:teuthology.orchestra.run.smithi071.stdout: filestore ondisk finisher threads = 3 2024-09-14T11:08:43.017 INFO:teuthology.orchestra.run.smithi071.stdout: filestore apply finisher threads = 3 2024-09-14T11:08:43.017 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:08:43.017 INFO:teuthology.orchestra.run.smithi071.stdout: bdev debug aio = true 2024-09-14T11:08:43.017 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug misdirected ops = true 2024-09-14T11:08:43.018 INFO:teuthology.orchestra.run.smithi071.stdout: bdev async discard = True 2024-09-14T11:08:43.018 INFO:teuthology.orchestra.run.smithi071.stdout: bdev enable discard = True 2024-09-14T11:08:43.018 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore allocator = bitmap 2024-09-14T11:08:43.018 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore block size = 96636764160 2024-09-14T11:08:43.018 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore fsck on mount = True 2024-09-14T11:08:43.018 INFO:teuthology.orchestra.run.smithi071.stdout: debug bluefs = 1/20 2024-09-14T11:08:43.018 INFO:teuthology.orchestra.run.smithi071.stdout: debug bluestore = 1/20 2024-09-14T11:08:43.018 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2024-09-14T11:08:43.018 INFO:teuthology.orchestra.run.smithi071.stdout: debug objclass = 20 2024-09-14T11:08:43.018 INFO:teuthology.orchestra.run.smithi071.stdout: debug osd = 20 2024-09-14T11:08:43.018 INFO:teuthology.orchestra.run.smithi071.stdout: debug rocksdb = 4/10 2024-09-14T11:08:43.019 INFO:teuthology.orchestra.run.smithi071.stdout: lockdep = True 2024-09-14T11:08:43.019 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T11:08:43.019 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd full ratio = 0.9 2024-09-14T11:08:43.019 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd nearfull ratio = 0.8 2024-09-14T11:08:43.019 INFO:teuthology.orchestra.run.smithi071.stdout: osd failsafe full ratio = 0.95 2024-09-14T11:08:43.019 INFO:teuthology.orchestra.run.smithi071.stdout: osd objectstore = bluestore 2024-09-14T11:08:43.019 INFO:teuthology.orchestra.run.smithi071.stdout: osd shutdown pgref assert = True 2024-09-14T11:08:43.019 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:08:43.019 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr] 2024-09-14T11:08:43.019 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2024-09-14T11:08:43.019 INFO:teuthology.orchestra.run.smithi071.stdout: debug mgr = 20 2024-09-14T11:08:43.019 INFO:teuthology.orchestra.run.smithi071.stdout: debug mon = 20 2024-09-14T11:08:43.020 INFO:teuthology.orchestra.run.smithi071.stdout: debug auth = 20 2024-09-14T11:08:43.020 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min pgs per osd = 4 2024-09-14T11:08:43.020 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min bytes per osd = 10 2024-09-14T11:08:43.020 INFO:teuthology.orchestra.run.smithi071.stdout: mgr/telemetry/nag = false 2024-09-14T11:08:43.020 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:08:43.020 INFO:teuthology.orchestra.run.smithi071.stdout:[mon] 2024-09-14T11:08:43.020 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2024-09-14T11:08:43.020 INFO:teuthology.orchestra.run.smithi071.stdout: debug mon = 20 2024-09-14T11:08:43.020 INFO:teuthology.orchestra.run.smithi071.stdout: debug paxos = 20 2024-09-14T11:08:43.020 INFO:teuthology.orchestra.run.smithi071.stdout: debug auth = 20 2024-09-14T11:08:43.020 INFO:teuthology.orchestra.run.smithi071.stdout: mon data avail warn = 5 2024-09-14T11:08:43.021 INFO:teuthology.orchestra.run.smithi071.stdout: mon mgr mkfs grace = 240 2024-09-14T11:08:43.021 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min pgs per osd = 4 2024-09-14T11:08:43.021 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd reporter subtree level = osd 2024-09-14T11:08:43.021 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd prime pg temp = true 2024-09-14T11:08:43.021 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min bytes per osd = 10 2024-09-14T11:08:43.021 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:08:43.021 INFO:teuthology.orchestra.run.smithi071.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T11:08:43.021 INFO:teuthology.orchestra.run.smithi071.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T11:08:43.021 INFO:teuthology.orchestra.run.smithi071.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T11:08:43.021 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:08:43.021 INFO:teuthology.orchestra.run.smithi071.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T11:08:43.022 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T11:08:43.022 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T11:08:43.022 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:08:43.022 INFO:teuthology.orchestra.run.smithi071.stdout: # 1m isn't quite enough 2024-09-14T11:08:43.022 INFO:teuthology.orchestra.run.smithi071.stdout: mon_down_mkfs_grace = 2m 2024-09-14T11:08:43.022 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:08:43.022 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_filestore_osds = false 2024-09-14T11:08:43.022 INFO:teuthology.orchestra.run.smithi071.stdout: lockdep = True 2024-09-14T11:08:43.022 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:08:43.022 INFO:teuthology.orchestra.run.smithi071.stdout:[client] 2024-09-14T11:08:43.022 INFO:teuthology.orchestra.run.smithi071.stdout: rgw cache enabled = true 2024-09-14T11:08:43.023 INFO:teuthology.orchestra.run.smithi071.stdout: rgw enable ops log = True 2024-09-14T11:08:43.023 INFO:teuthology.orchestra.run.smithi071.stdout: rgw enable usage log = true 2024-09-14T11:08:43.023 INFO:teuthology.orchestra.run.smithi071.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T11:08:43.023 INFO:teuthology.orchestra.run.smithi071.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T11:08:43.023 INFO:teuthology.orchestra.run.smithi071.stdout: debug rgw = 20 2024-09-14T11:08:43.023 INFO:teuthology.orchestra.run.smithi071.stdout: debug rgw notification = 20 2024-09-14T11:08:43.023 INFO:teuthology.orchestra.run.smithi071.stdout: rgw bucket counters cache = True 2024-09-14T11:08:43.023 INFO:teuthology.orchestra.run.smithi071.stdout: rgw crypt require ssl = False 2024-09-14T11:08:43.023 INFO:teuthology.orchestra.run.smithi071.stdout: rgw crypt s3 kms backend = testing 2024-09-14T11:08:43.024 INFO:teuthology.orchestra.run.smithi071.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T11:08:43.024 INFO:teuthology.orchestra.run.smithi071.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-14T11:08:43.024 INFO:teuthology.orchestra.run.smithi071.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-14T11:08:43.024 INFO:teuthology.orchestra.run.smithi071.stdout: rgw d3n l1 local datacache enabled = True 2024-09-14T11:08:43.024 INFO:teuthology.orchestra.run.smithi071.stdout: rgw reshard progress judge interval = 10 2024-09-14T11:08:43.024 INFO:teuthology.orchestra.run.smithi071.stdout: rgw s3 auth use sts = True 2024-09-14T11:08:43.024 INFO:teuthology.orchestra.run.smithi071.stdout: rgw sts key = abcdefghijklmnop 2024-09-14T11:08:43.024 INFO:teuthology.orchestra.run.smithi071.stdout: rgw torrent flag = True 2024-09-14T11:08:43.024 INFO:teuthology.orchestra.run.smithi071.stdout: rgw user counters cache = True 2024-09-14T11:08:43.024 INFO:teuthology.orchestra.run.smithi071.stdout: setgroup = ceph 2024-09-14T11:08:43.024 INFO:teuthology.orchestra.run.smithi071.stdout: setuser = ceph 2024-09-14T11:08:43.025 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.a] 2024-09-14T11:08:43.025 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.c] 2024-09-14T11:08:43.025 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.b] 2024-09-14T11:08:43.026 INFO:teuthology.orchestra.run.smithi157.stdout:[global] 2024-09-14T11:08:43.026 INFO:teuthology.orchestra.run.smithi157.stdout: chdir = "" 2024-09-14T11:08:43.026 INFO:teuthology.orchestra.run.smithi157.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T11:08:43.027 INFO:teuthology.orchestra.run.smithi157.stdout: auth supported = cephx 2024-09-14T11:08:43.027 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-14T11:08:43.027 INFO:teuthology.orchestra.run.smithi157.stdout: filestore xattr use omap = true 2024-09-14T11:08:43.027 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-14T11:08:43.027 INFO:teuthology.orchestra.run.smithi157.stdout: mon clock drift allowed = 1.000 2024-09-14T11:08:43.027 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-14T11:08:43.027 INFO:teuthology.orchestra.run.smithi157.stdout: osd crush chooseleaf type = 0 2024-09-14T11:08:43.027 INFO:teuthology.orchestra.run.smithi157.stdout: auth debug = true 2024-09-14T11:08:43.027 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-14T11:08:43.027 INFO:teuthology.orchestra.run.smithi157.stdout: ms die on old message = true 2024-09-14T11:08:43.027 INFO:teuthology.orchestra.run.smithi157.stdout: ms die on bug = true 2024-09-14T11:08:43.027 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-14T11:08:43.028 INFO:teuthology.orchestra.run.smithi157.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T11:08:43.028 INFO:teuthology.orchestra.run.smithi157.stdout: mon pg warn max object skew = 0 2024-09-14T11:08:43.028 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-14T11:08:43.028 INFO:teuthology.orchestra.run.smithi157.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T11:08:43.028 INFO:teuthology.orchestra.run.smithi157.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T11:08:43.028 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-14T11:08:43.028 INFO:teuthology.orchestra.run.smithi157.stdout: osd pool default size = 2 2024-09-14T11:08:43.028 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-14T11:08:43.028 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd allow primary affinity = true 2024-09-14T11:08:43.028 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd allow pg remap = true 2024-09-14T11:08:43.028 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on legacy crush tunables = false 2024-09-14T11:08:43.029 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on crush straw calc version zero = false 2024-09-14T11:08:43.029 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on no sortbitwise = false 2024-09-14T11:08:43.029 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on osd down out interval zero = false 2024-09-14T11:08:43.029 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on too few osds = false 2024-09-14T11:08:43.029 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T11:08:43.029 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T11:08:43.029 INFO:teuthology.orchestra.run.smithi157.stdout: mon_allow_pool_size_one = true 2024-09-14T11:08:43.029 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-14T11:08:43.029 INFO:teuthology.orchestra.run.smithi157.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T11:08:43.029 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-14T11:08:43.029 INFO:teuthology.orchestra.run.smithi157.stdout: osd default data pool replay window = 5 2024-09-14T11:08:43.029 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-14T11:08:43.030 INFO:teuthology.orchestra.run.smithi157.stdout: mon allow pool delete = true 2024-09-14T11:08:43.030 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-14T11:08:43.030 INFO:teuthology.orchestra.run.smithi157.stdout: mon cluster log file level = debug 2024-09-14T11:08:43.030 INFO:teuthology.orchestra.run.smithi157.stdout: debug asserts on shutdown = true 2024-09-14T11:08:43.030 INFO:teuthology.orchestra.run.smithi157.stdout: mon health detail to clog = false 2024-09-14T11:08:43.030 INFO:teuthology.orchestra.run.smithi157.stdout: mon host = "172.21.15.71,[v2:172.21.15.71:3301,v1:172.21.15.71:6790],172.21.15.157" 2024-09-14T11:08:43.030 INFO:teuthology.orchestra.run.smithi157.stdout: mon client directed command retry = 5 2024-09-14T11:08:43.030 INFO:teuthology.orchestra.run.smithi157.stdout: ms inject socket failures = 5000 2024-09-14T11:08:43.030 INFO:teuthology.orchestra.run.smithi157.stdout: osd_max_pg_log_entries = 10 2024-09-14T11:08:43.030 INFO:teuthology.orchestra.run.smithi157.stdout: osd_min_pg_log_entries = 10 2024-09-14T11:08:43.030 INFO:teuthology.orchestra.run.smithi157.stdout: fsid = 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:08:43.031 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-14T11:08:43.031 INFO:teuthology.orchestra.run.smithi157.stdout:[osd] 2024-09-14T11:08:43.031 INFO:teuthology.orchestra.run.smithi157.stdout: osd journal size = 100 2024-09-14T11:08:43.031 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-14T11:08:43.031 INFO:teuthology.orchestra.run.smithi157.stdout: osd scrub load threshold = 5.0 2024-09-14T11:08:43.031 INFO:teuthology.orchestra.run.smithi157.stdout: osd scrub max interval = 600 2024-09-14T11:08:43.031 INFO:teuthology.orchestra.run.smithi157.stdout: osd mclock profile = high_recovery_ops 2024-09-14T11:08:43.031 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-14T11:08:43.031 INFO:teuthology.orchestra.run.smithi157.stdout: osd recover clone overlap = true 2024-09-14T11:08:43.031 INFO:teuthology.orchestra.run.smithi157.stdout: osd recovery max chunk = 1048576 2024-09-14T11:08:43.031 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-14T11:08:43.032 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug shutdown = true 2024-09-14T11:08:43.032 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug op order = true 2024-09-14T11:08:43.032 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug verify stray on activate = true 2024-09-14T11:08:43.032 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug trim objects = true 2024-09-14T11:08:43.032 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-14T11:08:43.032 INFO:teuthology.orchestra.run.smithi157.stdout: osd open classes on start = true 2024-09-14T11:08:43.032 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug pg log writeout = true 2024-09-14T11:08:43.032 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-14T11:08:43.032 INFO:teuthology.orchestra.run.smithi157.stdout: osd deep scrub update digest min age = 30 2024-09-14T11:08:43.032 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-14T11:08:43.032 INFO:teuthology.orchestra.run.smithi157.stdout: osd map max advance = 10 2024-09-14T11:08:43.032 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-14T11:08:43.033 INFO:teuthology.orchestra.run.smithi157.stdout: journal zero on create = true 2024-09-14T11:08:43.033 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-14T11:08:43.033 INFO:teuthology.orchestra.run.smithi157.stdout: filestore ondisk finisher threads = 3 2024-09-14T11:08:43.033 INFO:teuthology.orchestra.run.smithi157.stdout: filestore apply finisher threads = 3 2024-09-14T11:08:43.033 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-14T11:08:43.033 INFO:teuthology.orchestra.run.smithi157.stdout: bdev debug aio = true 2024-09-14T11:08:43.033 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug misdirected ops = true 2024-09-14T11:08:43.033 INFO:teuthology.orchestra.run.smithi157.stdout: bdev async discard = True 2024-09-14T11:08:43.033 INFO:teuthology.orchestra.run.smithi157.stdout: bdev enable discard = True 2024-09-14T11:08:43.033 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore allocator = bitmap 2024-09-14T11:08:43.033 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore block size = 96636764160 2024-09-14T11:08:43.034 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore fsck on mount = True 2024-09-14T11:08:43.034 INFO:teuthology.orchestra.run.smithi157.stdout: debug bluefs = 1/20 2024-09-14T11:08:43.034 INFO:teuthology.orchestra.run.smithi157.stdout: debug bluestore = 1/20 2024-09-14T11:08:43.034 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-09-14T11:08:43.034 INFO:teuthology.orchestra.run.smithi157.stdout: debug objclass = 20 2024-09-14T11:08:43.034 INFO:teuthology.orchestra.run.smithi157.stdout: debug osd = 20 2024-09-14T11:08:43.034 INFO:teuthology.orchestra.run.smithi157.stdout: debug rocksdb = 4/10 2024-09-14T11:08:43.034 INFO:teuthology.orchestra.run.smithi157.stdout: lockdep = True 2024-09-14T11:08:43.034 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T11:08:43.034 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd full ratio = 0.9 2024-09-14T11:08:43.034 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd nearfull ratio = 0.8 2024-09-14T11:08:43.034 INFO:teuthology.orchestra.run.smithi157.stdout: osd failsafe full ratio = 0.95 2024-09-14T11:08:43.035 INFO:teuthology.orchestra.run.smithi157.stdout: osd objectstore = bluestore 2024-09-14T11:08:43.035 INFO:teuthology.orchestra.run.smithi157.stdout: osd shutdown pgref assert = True 2024-09-14T11:08:43.035 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-14T11:08:43.035 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr] 2024-09-14T11:08:43.035 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-09-14T11:08:43.035 INFO:teuthology.orchestra.run.smithi157.stdout: debug mgr = 20 2024-09-14T11:08:43.035 INFO:teuthology.orchestra.run.smithi157.stdout: debug mon = 20 2024-09-14T11:08:43.035 INFO:teuthology.orchestra.run.smithi157.stdout: debug auth = 20 2024-09-14T11:08:43.035 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min pgs per osd = 4 2024-09-14T11:08:43.035 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min bytes per osd = 10 2024-09-14T11:08:43.035 INFO:teuthology.orchestra.run.smithi157.stdout: mgr/telemetry/nag = false 2024-09-14T11:08:43.036 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-14T11:08:43.036 INFO:teuthology.orchestra.run.smithi157.stdout:[mon] 2024-09-14T11:08:43.036 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-09-14T11:08:43.036 INFO:teuthology.orchestra.run.smithi157.stdout: debug mon = 20 2024-09-14T11:08:43.036 INFO:teuthology.orchestra.run.smithi157.stdout: debug paxos = 20 2024-09-14T11:08:43.036 INFO:teuthology.orchestra.run.smithi157.stdout: debug auth = 20 2024-09-14T11:08:43.036 INFO:teuthology.orchestra.run.smithi157.stdout: mon data avail warn = 5 2024-09-14T11:08:43.036 INFO:teuthology.orchestra.run.smithi157.stdout: mon mgr mkfs grace = 240 2024-09-14T11:08:43.036 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min pgs per osd = 4 2024-09-14T11:08:43.036 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd reporter subtree level = osd 2024-09-14T11:08:43.036 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd prime pg temp = true 2024-09-14T11:08:43.037 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min bytes per osd = 10 2024-09-14T11:08:43.037 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-14T11:08:43.037 INFO:teuthology.orchestra.run.smithi157.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T11:08:43.037 INFO:teuthology.orchestra.run.smithi157.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T11:08:43.037 INFO:teuthology.orchestra.run.smithi157.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T11:08:43.037 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-14T11:08:43.037 INFO:teuthology.orchestra.run.smithi157.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T11:08:43.037 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T11:08:43.037 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T11:08:43.037 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-14T11:08:43.037 INFO:teuthology.orchestra.run.smithi157.stdout: # 1m isn't quite enough 2024-09-14T11:08:43.038 INFO:teuthology.orchestra.run.smithi157.stdout: mon_down_mkfs_grace = 2m 2024-09-14T11:08:43.038 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-14T11:08:43.038 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_filestore_osds = false 2024-09-14T11:08:43.038 INFO:teuthology.orchestra.run.smithi157.stdout: lockdep = True 2024-09-14T11:08:43.038 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-09-14T11:08:43.038 INFO:teuthology.orchestra.run.smithi157.stdout:[client] 2024-09-14T11:08:43.038 INFO:teuthology.orchestra.run.smithi157.stdout: rgw cache enabled = true 2024-09-14T11:08:43.038 INFO:teuthology.orchestra.run.smithi157.stdout: rgw enable ops log = True 2024-09-14T11:08:43.038 INFO:teuthology.orchestra.run.smithi157.stdout: rgw enable usage log = true 2024-09-14T11:08:43.038 INFO:teuthology.orchestra.run.smithi157.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T11:08:43.038 INFO:teuthology.orchestra.run.smithi157.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T11:08:43.039 INFO:teuthology.orchestra.run.smithi157.stdout: debug rgw = 20 2024-09-14T11:08:43.039 INFO:teuthology.orchestra.run.smithi157.stdout: debug rgw notification = 20 2024-09-14T11:08:43.039 INFO:teuthology.orchestra.run.smithi157.stdout: rgw bucket counters cache = True 2024-09-14T11:08:43.039 INFO:teuthology.orchestra.run.smithi157.stdout: rgw crypt require ssl = False 2024-09-14T11:08:43.039 INFO:teuthology.orchestra.run.smithi157.stdout: rgw crypt s3 kms backend = testing 2024-09-14T11:08:43.039 INFO:teuthology.orchestra.run.smithi157.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T11:08:43.039 INFO:teuthology.orchestra.run.smithi157.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-14T11:08:43.039 INFO:teuthology.orchestra.run.smithi157.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-14T11:08:43.039 INFO:teuthology.orchestra.run.smithi157.stdout: rgw d3n l1 local datacache enabled = True 2024-09-14T11:08:43.039 INFO:teuthology.orchestra.run.smithi157.stdout: rgw reshard progress judge interval = 10 2024-09-14T11:08:43.039 INFO:teuthology.orchestra.run.smithi157.stdout: rgw s3 auth use sts = True 2024-09-14T11:08:43.040 INFO:teuthology.orchestra.run.smithi157.stdout: rgw sts key = abcdefghijklmnop 2024-09-14T11:08:43.040 INFO:teuthology.orchestra.run.smithi157.stdout: rgw torrent flag = True 2024-09-14T11:08:43.040 INFO:teuthology.orchestra.run.smithi157.stdout: rgw user counters cache = True 2024-09-14T11:08:43.040 INFO:teuthology.orchestra.run.smithi157.stdout: setgroup = ceph 2024-09-14T11:08:43.040 INFO:teuthology.orchestra.run.smithi157.stdout: setuser = ceph 2024-09-14T11:08:43.040 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.a] 2024-09-14T11:08:43.040 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.c] 2024-09-14T11:08:43.040 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.b] 2024-09-14T11:08:43.040 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-14T11:08:43.041 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-14T11:08:43.122 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-14T11:08:43.123 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T11:08:43.123 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-14T11:08:43.129 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T11:08:43.129 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-14T11:08:43.177 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi071.front.sepia.ceph.com 2024-09-14T11:08:43.177 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T11:08:43.178 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T11:08:43.178 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T11:08:43.242 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T11:08:43.243 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:08:43.289 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi157.front.sepia.ceph.com 2024-09-14T11:08:43.289 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-14T11:08:43.290 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T11:08:43.290 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T11:08:43.313 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-14T11:08:43.313 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:08:43.362 INFO:tasks.ceph:Setting up mon nodes... 2024-09-14T11:08:43.362 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-14T11:08:43.362 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-14T11:08:43.407 INFO:teuthology.orchestra.run.smithi071.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-14T11:08:43.410 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T11:08:43.454 INFO:teuthology.orchestra.run.smithi157.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T11:08:43.469 INFO:tasks.ceph:Setting up mds nodes... 2024-09-14T11:08:43.469 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-14T11:08:43.470 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-14T11:08:43.502 INFO:teuthology.orchestra.run.smithi071.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-14T11:08:43.513 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-14T11:08:43.549 INFO:teuthology.orchestra.run.smithi157.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-14T11:08:43.560 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-14T11:08:43.560 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi071.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi157.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-14T11:08:43.560 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-14T11:08:43.573 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:08:43.574 INFO:tasks.ceph:role: osd.0 2024-09-14T11:08:43.574 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-14T11:08:43.574 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T11:08:43.637 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:08:43.637 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:08:43.638 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:08:43.638 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T11:08:43.638 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:08:43.638 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:08:43.638 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:08:43.638 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T11:08:43.638 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:08:43.638 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:08:44.109 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2024-09-14T11:08:44.111 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2024-09-14T11:08:44.112 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-14T11:08:44.202 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-14T11:08:44.211 INFO:teuthology.orchestra.run.smithi071.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T11:08:44.212 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:08:44.212 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-14T11:08:44.269 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:08:44.269 INFO:tasks.ceph:role: osd.1 2024-09-14T11:08:44.269 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-14T11:08:44.269 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T11:08:44.334 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:08:44.334 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:08:44.334 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:08:44.334 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T11:08:44.335 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:08:44.335 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:08:44.335 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:08:44.335 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T11:08:44.335 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:08:44.335 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:08:44.801 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2024-09-14T11:08:44.803 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2024-09-14T11:08:44.803 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-14T11:08:44.954 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-14T11:08:44.966 INFO:teuthology.orchestra.run.smithi071.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T11:08:44.966 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:08:44.967 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-14T11:08:45.021 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:08:45.022 INFO:tasks.ceph:role: osd.2 2024-09-14T11:08:45.022 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-14T11:08:45.022 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T11:08:45.085 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:08:45.086 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:08:45.086 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:08:45.086 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T11:08:45.086 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:08:45.086 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:08:45.086 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:08:45.086 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T11:08:45.086 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:08:45.086 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:08:45.581 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2024-09-14T11:08:45.584 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2024-09-14T11:08:45.584 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-14T11:08:45.740 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-14T11:08:45.750 INFO:teuthology.orchestra.run.smithi071.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T11:08:45.751 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:08:45.752 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-14T11:08:45.805 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:08:45.805 INFO:tasks.ceph:role: osd.3 2024-09-14T11:08:45.805 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-14T11:08:45.805 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-14T11:08:45.869 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:08:45.869 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:08:45.870 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:08:45.870 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T11:08:45.870 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:08:45.870 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:08:45.870 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:08:45.870 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T11:08:45.870 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:08:45.870 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:08:46.302 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2024-09-14T11:08:46.304 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2024-09-14T11:08:46.304 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-14T11:08:46.400 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-14T11:08:46.411 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:08:46.411 INFO:teuthology.orchestra.run.smithi071.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T11:08:46.412 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:08:46.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:08:46.527+0000 7f448f3bd7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-14T11:08:46.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:08:46.527+0000 7f448f3bd7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-14T11:08:46.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:08:46.527+0000 7f448f3bd7c0 -1 bdev(0x562e9917b800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-14T11:08:46.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:08:46.531+0000 7f448f3bd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-14T11:08:49.673 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-14T11:08:49.687 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:08:49.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:08:49.775+0000 7f44531d67c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-14T11:08:49.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:08:49.775+0000 7f44531d67c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-14T11:08:49.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:08:49.775+0000 7f44531d67c0 -1 bdev(0x5645280ad800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-14T11:08:49.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:08:49.775+0000 7f44531d67c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-14T11:08:52.913 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-14T11:08:52.973 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:08:53.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:08:53.063+0000 7f12b158c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-14T11:08:53.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:08:53.063+0000 7f12b158c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-14T11:08:53.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:08:53.063+0000 7f12b158c7c0 -1 bdev(0x55b72c08f800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-14T11:08:53.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:08:53.063+0000 7f12b158c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-14T11:08:56.193 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-14T11:08:56.249 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:08:56.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:08:56.339+0000 7fe89cb747c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-14T11:08:56.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:08:56.339+0000 7fe89cb747c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-14T11:08:56.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:08:56.339+0000 7fe89cb747c0 -1 bdev(0x5616aaec7800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-14T11:08:56.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:08:56.343+0000 7fe89cb747c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-14T11:08:59.464 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-14T11:08:59.518 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-14T11:08:59.532 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:08:59.532 INFO:tasks.ceph:role: osd.4 2024-09-14T11:08:59.532 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi157.front.sepia.ceph.com 2024-09-14T11:08:59.533 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T11:08:59.589 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:08:59.589 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:08:59.589 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:08:59.589 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T11:08:59.589 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:08:59.589 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:08:59.589 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:08:59.589 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T11:08:59.589 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:08:59.590 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:08:59.613 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2024-09-14T11:08:59.615 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-09-14T11:08:59.615 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-14T11:08:59.673 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-14T11:08:59.726 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:08:59.726 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T11:08:59.727 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-14T11:08:59.779 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:08:59.779 INFO:tasks.ceph:role: osd.5 2024-09-14T11:08:59.779 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi157.front.sepia.ceph.com 2024-09-14T11:08:59.779 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T11:08:59.834 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:08:59.834 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:08:59.834 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:08:59.835 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T11:08:59.835 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:08:59.835 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:08:59.835 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:08:59.835 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T11:08:59.835 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:08:59.835 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:08:59.858 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2024-09-14T11:08:59.860 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-09-14T11:08:59.860 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-14T11:08:59.915 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-14T11:08:59.965 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:08:59.966 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T11:08:59.966 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-14T11:09:00.019 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:09:00.019 INFO:tasks.ceph:role: osd.6 2024-09-14T11:09:00.019 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi157.front.sepia.ceph.com 2024-09-14T11:09:00.019 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T11:09:00.076 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:09:00.076 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:09:00.076 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:09:00.076 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T11:09:00.076 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:09:00.077 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:09:00.077 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:09:00.077 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T11:09:00.077 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:09:00.077 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:09:00.100 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2024-09-14T11:09:00.142 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-09-14T11:09:00.142 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-14T11:09:00.201 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-14T11:09:00.253 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T11:09:00.254 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:09:00.254 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-14T11:09:00.309 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:09:00.309 INFO:tasks.ceph:role: osd.7 2024-09-14T11:09:00.309 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi157.front.sepia.ceph.com 2024-09-14T11:09:00.309 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-14T11:09:00.365 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:09:00.365 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:09:00.365 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:09:00.365 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T11:09:00.365 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:09:00.365 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:09:00.365 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:09:00.365 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T11:09:00.365 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:09:00.365 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:09:00.388 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2024-09-14T11:09:00.390 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-09-14T11:09:00.390 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-14T11:09:00.449 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-14T11:09:00.502 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:09:00.503 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T11:09:00.503 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:09:00.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-14T11:09:00.628+0000 7f9843ea17c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-14T11:09:00.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-14T11:09:00.628+0000 7f9843ea17c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-14T11:09:00.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-14T11:09:00.628+0000 7f9843ea17c0 -1 bdev(0x55efc55db800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-14T11:09:00.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-14T11:09:00.628+0000 7f9843ea17c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-14T11:09:03.790 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-14T11:09:03.803 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:09:03.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-14T11:09:03.892+0000 7f2a5fadb7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-14T11:09:03.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-14T11:09:03.892+0000 7f2a5fadb7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-14T11:09:03.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-14T11:09:03.892+0000 7f2a5fadb7c0 -1 bdev(0x557342965800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-14T11:09:03.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-14T11:09:03.892+0000 7f2a5fadb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-14T11:09:07.045 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-14T11:09:07.101 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:09:07.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-14T11:09:07.192+0000 7f565d58a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-14T11:09:07.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-14T11:09:07.192+0000 7f565d58a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-14T11:09:07.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-14T11:09:07.192+0000 7f565d58a7c0 -1 bdev(0x5560b8259800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-14T11:09:07.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-14T11:09:07.192+0000 7f565d58a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-14T11:09:10.367 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-14T11:09:10.421 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:09:10.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-14T11:09:10.512+0000 7f0f408767c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-14T11:09:10.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-14T11:09:10.512+0000 7f0f408767c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-14T11:09:10.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-14T11:09:10.512+0000 7f0f408767c0 -1 bdev(0x55c31b67d800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-14T11:09:10.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-09-14T11:09:10.512+0000 7f0f408767c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-14T11:09:13.673 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-14T11:09:13.729 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-14T11:09:13.729 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T11:09:13.729 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-14T11:09:13.743 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T11:09:13.743 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-14T11:09:13.797 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T11:09:13.797 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-14T11:09:13.852 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T11:09:13.853 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-14T11:09:13.908 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T11:09:13.908 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-14T11:09:13.961 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-14T11:09:13.961 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-14T11:09:13.974 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-14T11:09:13.974 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-14T11:09:14.029 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-14T11:09:14.030 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-14T11:09:14.085 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-14T11:09:14.085 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-14T11:09:14.140 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-14T11:09:14.140 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-14T11:09:14.196 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T11:09:14.196 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-14T11:09:14.202 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-14T11:09:14.203 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-14T11:09:14.245 INFO:tasks.ceph:Adding keys to all mons... 2024-09-14T11:09:14.245 DEBUG:teuthology.orchestra.run.smithi071:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T11:09:14.248 DEBUG:teuthology.orchestra.run.smithi157:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T11:09:14.291 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr.y] 2024-09-14T11:09:14.291 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQC7buVmEDAPGRAAq2Em4Or9YItF2erojw8+eA== 2024-09-14T11:09:14.291 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.0] 2024-09-14T11:09:14.291 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQC+buVm7F/IHxAAjTiIMc6FpvpZFwd5j2D2mA== 2024-09-14T11:09:14.292 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.1] 2024-09-14T11:09:14.292 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDBbuVmiOR9LhAAe7WsWTvcK8JEGys+S2N8rw== 2024-09-14T11:09:14.292 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.2] 2024-09-14T11:09:14.292 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDFbuVmtlAUBBAAOpb+ARvCUkABajG5R89Mfg== 2024-09-14T11:09:14.292 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.3] 2024-09-14T11:09:14.292 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDIbuVm8auXFBAAjopLSSexww3dOgCd+/a7CA== 2024-09-14T11:09:14.292 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr.x] 2024-09-14T11:09:14.292 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQC7buVmGODcGxAABAgA7x4mBs4sFxBFELzxHQ== 2024-09-14T11:09:14.292 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.4] 2024-09-14T11:09:14.292 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDMbuVm3q2VJRAAukMCOXxKqpm3+rSieNld8A== 2024-09-14T11:09:14.292 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.5] 2024-09-14T11:09:14.292 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDPbuVmpkd9NRAAEMzp6z/isGH6UQp7hF8cMA== 2024-09-14T11:09:14.293 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.6] 2024-09-14T11:09:14.293 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDTbuVmRomxCxAAcC6ao8U/3Hf0QkVqlvn5Ew== 2024-09-14T11:09:14.293 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.7] 2024-09-14T11:09:14.293 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDWbuVmUAbKHhAAj/YzmiCzd6lVMKSo4QbE8g== 2024-09-14T11:09:14.293 INFO:teuthology.orchestra.run.smithi071.stdout:[client.0] 2024-09-14T11:09:14.293 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQC7buVmjbG/HhAAqzNtvYM2u0NIYPWBm4fGug== 2024-09-14T11:09:14.293 INFO:teuthology.orchestra.run.smithi071.stdout:[client.1] 2024-09-14T11:09:14.293 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQC7buVmAuuGIRAAQnGdgkrmXwCaChwzuQGLkA== 2024-09-14T11:09:14.299 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr.y] 2024-09-14T11:09:14.299 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQC7buVmEDAPGRAAq2Em4Or9YItF2erojw8+eA== 2024-09-14T11:09:14.299 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.0] 2024-09-14T11:09:14.299 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQC+buVm7F/IHxAAjTiIMc6FpvpZFwd5j2D2mA== 2024-09-14T11:09:14.299 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.1] 2024-09-14T11:09:14.299 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDBbuVmiOR9LhAAe7WsWTvcK8JEGys+S2N8rw== 2024-09-14T11:09:14.300 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.2] 2024-09-14T11:09:14.300 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDFbuVmtlAUBBAAOpb+ARvCUkABajG5R89Mfg== 2024-09-14T11:09:14.300 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.3] 2024-09-14T11:09:14.300 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDIbuVm8auXFBAAjopLSSexww3dOgCd+/a7CA== 2024-09-14T11:09:14.300 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr.x] 2024-09-14T11:09:14.300 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQC7buVmGODcGxAABAgA7x4mBs4sFxBFELzxHQ== 2024-09-14T11:09:14.300 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.4] 2024-09-14T11:09:14.300 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDMbuVm3q2VJRAAukMCOXxKqpm3+rSieNld8A== 2024-09-14T11:09:14.300 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.5] 2024-09-14T11:09:14.300 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDPbuVmpkd9NRAAEMzp6z/isGH6UQp7hF8cMA== 2024-09-14T11:09:14.300 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.6] 2024-09-14T11:09:14.300 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDTbuVmRomxCxAAcC6ao8U/3Hf0QkVqlvn5Ew== 2024-09-14T11:09:14.300 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.7] 2024-09-14T11:09:14.301 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDWbuVmUAbKHhAAj/YzmiCzd6lVMKSo4QbE8g== 2024-09-14T11:09:14.301 INFO:teuthology.orchestra.run.smithi157.stdout:[client.0] 2024-09-14T11:09:14.301 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQC7buVmjbG/HhAAqzNtvYM2u0NIYPWBm4fGug== 2024-09-14T11:09:14.301 INFO:teuthology.orchestra.run.smithi157.stdout:[client.1] 2024-09-14T11:09:14.301 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQC7buVmAuuGIRAAQnGdgkrmXwCaChwzuQGLkA== 2024-09-14T11:09:14.302 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T11:09:14.338 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T11:09:14.394 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:09:14.397 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:09:14.437 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:09:14.487 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:09:14.528 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:09:14.574 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:09:14.619 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:09:14.663 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:09:14.709 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T11:09:14.712 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T11:09:14.752 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:09:14.794 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:09:14.838 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:09:14.878 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:09:14.925 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:09:14.962 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:09:15.006 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:09:15.046 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:09:15.098 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T11:09:15.131 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T11:09:15.177 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T11:09:15.217 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T11:09:15.261 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-14T11:09:15.262 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-14T11:09:15.316 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T11:09:15.408 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-14T11:09:15.419 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-14T11:09:15.476 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T11:09:15.563 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-14T11:09:15.616 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-14T11:09:15.630 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T11:09:15.724 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-14T11:09:15.735 DEBUG:teuthology.orchestra.run.smithi071:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:09:15.737 DEBUG:teuthology.orchestra.run.smithi157:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:09:15.780 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-14T11:09:15.781 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-14T11:09:15.781 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-14T11:09:15.786 INFO:tasks.ceph.mon.a:Started 2024-09-14T11:09:15.786 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-14T11:09:15.786 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-14T11:09:15.788 INFO:tasks.ceph.mon.c:Started 2024-09-14T11:09:15.788 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-14T11:09:15.788 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-14T11:09:15.826 INFO:tasks.ceph.mon.b:Started 2024-09-14T11:09:15.826 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-14T11:09:15.826 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-14T11:09:15.826 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-14T11:09:15.829 INFO:tasks.ceph.mgr.y:Started 2024-09-14T11:09:15.829 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-14T11:09:15.829 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-14T11:09:15.831 INFO:tasks.ceph.mgr.x:Started 2024-09-14T11:09:15.831 DEBUG:tasks.ceph:set 0 configs 2024-09-14T11:09:15.831 INFO:tasks.ceph:Setting crush tunables to default 2024-09-14T11:09:15.831 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd crush tunables default 2024-09-14T11:09:16.262 INFO:teuthology.orchestra.run.smithi071.stderr:adjusted tunables profile to default 2024-09-14T11:09:16.280 INFO:tasks.ceph:check_enable_crimson: False 2024-09-14T11:09:16.281 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-14T11:09:16.281 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T11:09:16.281 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-14T11:09:16.292 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T11:09:16.292 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-14T11:09:16.348 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T11:09:16.348 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-14T11:09:16.399 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T11:09:16.399 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-14T11:09:16.452 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-14T11:09:16.452 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-14T11:09:16.466 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-14T11:09:16.466 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-14T11:09:16.520 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-14T11:09:16.521 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-14T11:09:16.575 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-09-14T11:09:16.576 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-14T11:09:16.627 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 164dcbb0-6fba-429d-99e1-e9cc27927100 0 2024-09-14T11:09:16.876 INFO:teuthology.orchestra.run.smithi157.stdout:0 2024-09-14T11:09:16.893 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new c5897a6a-29f0-4adf-bc9a-4bb3c6f1fef0 1 2024-09-14T11:09:17.105 INFO:teuthology.orchestra.run.smithi157.stdout:1 2024-09-14T11:09:17.122 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 00e849be-fd02-41b9-8b44-96632fab0df7 2 2024-09-14T11:09:17.321 INFO:teuthology.orchestra.run.smithi157.stdout:2 2024-09-14T11:09:17.338 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 10ac7c16-3217-45d5-8cba-e5009b98ec67 3 2024-09-14T11:09:17.537 INFO:teuthology.orchestra.run.smithi157.stdout:3 2024-09-14T11:09:17.553 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new d6d6c280-cca0-40f4-9a37-ad61aad8553d 4 2024-09-14T11:09:17.752 INFO:teuthology.orchestra.run.smithi157.stdout:4 2024-09-14T11:09:17.769 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 4ba34dac-04b7-401f-80e4-17131ad5275f 5 2024-09-14T11:09:17.969 INFO:teuthology.orchestra.run.smithi157.stdout:5 2024-09-14T11:09:17.986 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 93d2103c-c129-4a50-b6ed-adf9e62b7cac 6 2024-09-14T11:09:18.190 INFO:teuthology.orchestra.run.smithi157.stdout:6 2024-09-14T11:09:18.206 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 87b80188-9ed1-428d-adbf-63102db355dd 7 2024-09-14T11:09:18.407 INFO:teuthology.orchestra.run.smithi157.stdout:7 2024-09-14T11:09:18.424 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-14T11:09:18.424 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-14T11:09:18.426 INFO:tasks.ceph.osd.0:Started 2024-09-14T11:09:18.427 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-14T11:09:18.427 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-14T11:09:18.429 INFO:tasks.ceph.osd.1:Started 2024-09-14T11:09:18.429 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-14T11:09:18.429 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-14T11:09:18.431 INFO:tasks.ceph.osd.2:Started 2024-09-14T11:09:18.431 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-14T11:09:18.432 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-14T11:09:18.433 INFO:tasks.ceph.osd.3:Started 2024-09-14T11:09:18.434 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-14T11:09:18.434 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-14T11:09:18.436 INFO:tasks.ceph.osd.4:Started 2024-09-14T11:09:18.436 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-14T11:09:18.436 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-14T11:09:18.438 INFO:tasks.ceph.osd.5:Started 2024-09-14T11:09:18.439 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-14T11:09:18.439 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-14T11:09:18.441 INFO:tasks.ceph.osd.6:Started 2024-09-14T11:09:18.441 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-14T11:09:18.441 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-14T11:09:18.444 INFO:tasks.ceph.osd.7:Started 2024-09-14T11:09:18.444 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T11:09:18.639 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:09:18.640 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":10,"fsid":"26f8926f-0d5e-4c48-adc1-d4f1601407fa","created":"2024-09-14T11:09:16.150194+0000","modified":"2024-09-14T11:09:18.416908+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T11:09:18.416908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"164dcbb0-6fba-429d-99e1-e9cc27927100","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c5897a6a-29f0-4adf-bc9a-4bb3c6f1fef0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00e849be-fd02-41b9-8b44-96632fab0df7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"10ac7c16-3217-45d5-8cba-e5009b98ec67","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d6d6c280-cca0-40f4-9a37-ad61aad8553d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4ba34dac-04b7-401f-80e4-17131ad5275f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"93d2103c-c129-4a50-b6ed-adf9e62b7cac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"87b80188-9ed1-428d-adbf-63102db355dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:09:18.655 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-14T11:09:18.656 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-14T11:09:19.019 INFO:tasks.ceph.mgr.y.smithi071.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-14T11:09:19.019 INFO:tasks.ceph.mgr.y.smithi071.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-14T11:09:19.019 INFO:tasks.ceph.mgr.y.smithi071.stderr: from numpy import show_config as show_numpy_config 2024-09-14T11:09:19.057 INFO:tasks.ceph.mgr.x.smithi157.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-14T11:09:19.058 INFO:tasks.ceph.mgr.x.smithi157.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-14T11:09:19.058 INFO:tasks.ceph.mgr.x.smithi157.stderr: from numpy import show_config as show_numpy_config 2024-09-14T11:09:19.462 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T11:09:19.586 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T11:09:19.595+0000 7f33a37bd7c0 -1 Falling back to public interface 2024-09-14T11:09:19.645 INFO:teuthology.misc.health.smithi071.stdout: 2024-09-14T11:09:19.645 INFO:teuthology.misc.health.smithi071.stdout:{"epoch":10,"fsid":"26f8926f-0d5e-4c48-adc1-d4f1601407fa","created":"2024-09-14T11:09:16.150194+0000","modified":"2024-09-14T11:09:18.416908+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T11:09:18.416908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"164dcbb0-6fba-429d-99e1-e9cc27927100","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c5897a6a-29f0-4adf-bc9a-4bb3c6f1fef0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00e849be-fd02-41b9-8b44-96632fab0df7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"10ac7c16-3217-45d5-8cba-e5009b98ec67","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d6d6c280-cca0-40f4-9a37-ad61aad8553d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4ba34dac-04b7-401f-80e4-17131ad5275f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"93d2103c-c129-4a50-b6ed-adf9e62b7cac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"87b80188-9ed1-428d-adbf-63102db355dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:09:19.660 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-14T11:09:19.778 INFO:tasks.ceph.osd.7.smithi157.stderr:2024-09-14T11:09:19.788+0000 7eff207127c0 -1 Falling back to public interface 2024-09-14T11:09:19.807 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T11:09:19.815+0000 7f35dce7f7c0 -1 Falling back to public interface 2024-09-14T11:09:19.817 INFO:tasks.ceph.osd.5.smithi157.stderr:2024-09-14T11:09:19.828+0000 7f14f4af87c0 -1 Falling back to public interface 2024-09-14T11:09:19.825 INFO:tasks.ceph.osd.6.smithi157.stderr:2024-09-14T11:09:19.836+0000 7f18ea12c7c0 -1 Falling back to public interface 2024-09-14T11:09:19.862 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T11:09:19.871+0000 7f35433717c0 -1 Falling back to public interface 2024-09-14T11:09:20.053 INFO:tasks.ceph.osd.4.smithi157.stderr:2024-09-14T11:09:20.064+0000 7f3021d837c0 -1 Falling back to public interface 2024-09-14T11:09:20.081 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T11:09:20.091+0000 7fec3ebee7c0 -1 Falling back to public interface 2024-09-14T11:09:21.926 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-09-14T11:09:21.935+0000 7fcb86958640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-14T11:09:21.927 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-09-14T11:09:21.935+0000 7fcb86958640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-14T11:09:23.719 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T11:09:23.727+0000 7f33a37bd7c0 -1 osd.0 0 log_to_monitors true 2024-09-14T11:09:23.806 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T11:09:23.815+0000 7f35dce7f7c0 -1 osd.1 0 log_to_monitors true 2024-09-14T11:09:23.887 INFO:tasks.ceph.osd.6.smithi157.stderr:2024-09-14T11:09:23.896+0000 7f18ea12c7c0 -1 osd.6 0 log_to_monitors true 2024-09-14T11:09:23.887 INFO:tasks.ceph.osd.5.smithi157.stderr:2024-09-14T11:09:23.896+0000 7f14f4af87c0 -1 osd.5 0 log_to_monitors true 2024-09-14T11:09:24.009 INFO:tasks.ceph.osd.7.smithi157.stderr:2024-09-14T11:09:24.020+0000 7eff207127c0 -1 osd.7 0 log_to_monitors true 2024-09-14T11:09:24.031 INFO:tasks.ceph.osd.4.smithi157.stderr:2024-09-14T11:09:24.040+0000 7f3021d837c0 -1 osd.4 0 log_to_monitors true 2024-09-14T11:09:24.155 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T11:09:24.163+0000 7fec3ebee7c0 -1 osd.2 0 log_to_monitors true 2024-09-14T11:09:24.473 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T11:09:24.483+0000 7f35433717c0 -1 osd.3 0 log_to_monitors true 2024-09-14T11:09:26.001 INFO:tasks.ceph.osd.6.smithi157.stderr:2024-09-14T11:09:26.012+0000 7f18e60d5640 -1 osd.6 0 waiting for initial osdmap 2024-09-14T11:09:26.005 INFO:tasks.ceph.osd.5.smithi157.stderr:2024-09-14T11:09:26.016+0000 7f14f0aa1640 -1 osd.5 0 waiting for initial osdmap 2024-09-14T11:09:26.038 INFO:tasks.ceph.osd.6.smithi157.stderr:2024-09-14T11:09:26.048+0000 7f18ddf07640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:09:26.047 INFO:tasks.ceph.osd.5.smithi157.stderr:2024-09-14T11:09:26.056+0000 7f14e88d3640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:09:26.418 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T11:09:26.427+0000 7f35d963a640 -1 osd.1 0 waiting for initial osdmap 2024-09-14T11:09:26.467 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T11:09:26.486 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-09-14T11:09:26.495+0000 7f35d0c5a640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:09:26.528 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T11:09:26.535+0000 7f339f766640 -1 osd.0 0 waiting for initial osdmap 2024-09-14T11:09:26.592 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-09-14T11:09:26.599+0000 7f3397598640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:09:26.851 INFO:teuthology.misc.health.smithi071.stdout: 2024-09-14T11:09:26.852 INFO:teuthology.misc.health.smithi071.stdout:{"epoch":13,"fsid":"26f8926f-0d5e-4c48-adc1-d4f1601407fa","created":"2024-09-14T11:09:16.150194+0000","modified":"2024-09-14T11:09:25.942469+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T11:09:18.416908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"164dcbb0-6fba-429d-99e1-e9cc27927100","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c5897a6a-29f0-4adf-bc9a-4bb3c6f1fef0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00e849be-fd02-41b9-8b44-96632fab0df7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"10ac7c16-3217-45d5-8cba-e5009b98ec67","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d6d6c280-cca0-40f4-9a37-ad61aad8553d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4ba34dac-04b7-401f-80e4-17131ad5275f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"93d2103c-c129-4a50-b6ed-adf9e62b7cac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"87b80188-9ed1-428d-adbf-63102db355dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:09:26.876 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-14T11:09:26.920 INFO:tasks.ceph.osd.4.smithi157.stderr:2024-09-14T11:09:26.928+0000 7f301dd2c640 -1 osd.4 0 waiting for initial osdmap 2024-09-14T11:09:26.928 INFO:tasks.ceph.osd.7.smithi157.stderr:2024-09-14T11:09:26.936+0000 7eff1cecd640 -1 osd.7 0 waiting for initial osdmap 2024-09-14T11:09:26.941 INFO:tasks.ceph.osd.4.smithi157.stderr:2024-09-14T11:09:26.952+0000 7f3015b5e640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:09:26.953 INFO:tasks.ceph.osd.7.smithi157.stderr:2024-09-14T11:09:26.964+0000 7eff144ed640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:09:27.300 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T11:09:27.307+0000 7f353f31a640 -1 osd.3 0 waiting for initial osdmap 2024-09-14T11:09:27.313 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T11:09:27.323+0000 7fec3ab97640 -1 osd.2 0 waiting for initial osdmap 2024-09-14T11:09:27.329 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-09-14T11:09:27.339+0000 7f353714c640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:09:27.353 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-09-14T11:09:27.363+0000 7fec329c9640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:09:33.683 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T11:09:33.987 INFO:teuthology.misc.health.smithi071.stdout: 2024-09-14T11:09:33.987 INFO:teuthology.misc.health.smithi071.stdout:{"epoch":18,"fsid":"26f8926f-0d5e-4c48-adc1-d4f1601407fa","created":"2024-09-14T11:09:16.150194+0000","modified":"2024-09-14T11:09:31.064968+0000","last_up_change":"2024-09-14T11:09:28.039408+0000","last_in_change":"2024-09-14T11:09:18.416908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T11:09:28.974599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"164dcbb0-6fba-429d-99e1-e9cc27927100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1986152349},{"type":"v1","addr":"172.21.15.71:6801","nonce":1986152349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1986152349},{"type":"v1","addr":"172.21.15.71:6803","nonce":1986152349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":1986152349},{"type":"v1","addr":"172.21.15.71:6807","nonce":1986152349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1986152349},{"type":"v1","addr":"172.21.15.71:6805","nonce":1986152349}]},"public_addr":"172.21.15.71:6801/1986152349","cluster_addr":"172.21.15.71:6803/1986152349","heartbeat_back_addr":"172.21.15.71:6807/1986152349","heartbeat_front_addr":"172.21.15.71:6805/1986152349","state":["exists","up"]},{"osd":1,"uuid":"c5897a6a-29f0-4adf-bc9a-4bb3c6f1fef0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":1268087573},{"type":"v1","addr":"172.21.15.71:6809","nonce":1268087573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":1268087573},{"type":"v1","addr":"172.21.15.71:6811","nonce":1268087573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1268087573},{"type":"v1","addr":"172.21.15.71:6815","nonce":1268087573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":1268087573},{"type":"v1","addr":"172.21.15.71:6813","nonce":1268087573}]},"public_addr":"172.21.15.71:6809/1268087573","cluster_addr":"172.21.15.71:6811/1268087573","heartbeat_back_addr":"172.21.15.71:6815/1268087573","heartbeat_front_addr":"172.21.15.71:6813/1268087573","state":["exists","up"]},{"osd":2,"uuid":"00e849be-fd02-41b9-8b44-96632fab0df7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2436891866},{"type":"v1","addr":"172.21.15.71:6825","nonce":2436891866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2436891866},{"type":"v1","addr":"172.21.15.71:6827","nonce":2436891866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2436891866},{"type":"v1","addr":"172.21.15.71:6831","nonce":2436891866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2436891866},{"type":"v1","addr":"172.21.15.71:6829","nonce":2436891866}]},"public_addr":"172.21.15.71:6825/2436891866","cluster_addr":"172.21.15.71:6827/2436891866","heartbeat_back_addr":"172.21.15.71:6831/2436891866","heartbeat_front_addr":"172.21.15.71:6829/2436891866","state":["exists","up"]},{"osd":3,"uuid":"10ac7c16-3217-45d5-8cba-e5009b98ec67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":60654820},{"type":"v1","addr":"172.21.15.71:6817","nonce":60654820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":60654820},{"type":"v1","addr":"172.21.15.71:6819","nonce":60654820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":60654820},{"type":"v1","addr":"172.21.15.71:6823","nonce":60654820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":60654820},{"type":"v1","addr":"172.21.15.71:6821","nonce":60654820}]},"public_addr":"172.21.15.71:6817/60654820","cluster_addr":"172.21.15.71:6819/60654820","heartbeat_back_addr":"172.21.15.71:6823/60654820","heartbeat_front_addr":"172.21.15.71:6821/60654820","state":["exists","up"]},{"osd":4,"uuid":"d6d6c280-cca0-40f4-9a37-ad61aad8553d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":2449482389},{"type":"v1","addr":"172.21.15.157:6825","nonce":2449482389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2449482389},{"type":"v1","addr":"172.21.15.157:6827","nonce":2449482389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":2449482389},{"type":"v1","addr":"172.21.15.157:6831","nonce":2449482389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":2449482389},{"type":"v1","addr":"172.21.15.157:6829","nonce":2449482389}]},"public_addr":"172.21.15.157:6825/2449482389","cluster_addr":"172.21.15.157:6827/2449482389","heartbeat_back_addr":"172.21.15.157:6831/2449482389","heartbeat_front_addr":"172.21.15.157:6829/2449482389","state":["exists","up"]},{"osd":5,"uuid":"4ba34dac-04b7-401f-80e4-17131ad5275f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":527702018},{"type":"v1","addr":"172.21.15.157:6809","nonce":527702018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":527702018},{"type":"v1","addr":"172.21.15.157:6811","nonce":527702018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":527702018},{"type":"v1","addr":"172.21.15.157:6815","nonce":527702018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":527702018},{"type":"v1","addr":"172.21.15.157:6813","nonce":527702018}]},"public_addr":"172.21.15.157:6809/527702018","cluster_addr":"172.21.15.157:6811/527702018","heartbeat_back_addr":"172.21.15.157:6815/527702018","heartbeat_front_addr":"172.21.15.157:6813/527702018","state":["exists","up"]},{"osd":6,"uuid":"93d2103c-c129-4a50-b6ed-adf9e62b7cac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1231501119},{"type":"v1","addr":"172.21.15.157:6817","nonce":1231501119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1231501119},{"type":"v1","addr":"172.21.15.157:6819","nonce":1231501119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1231501119},{"type":"v1","addr":"172.21.15.157:6823","nonce":1231501119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1231501119},{"type":"v1","addr":"172.21.15.157:6821","nonce":1231501119}]},"public_addr":"172.21.15.157:6817/1231501119","cluster_addr":"172.21.15.157:6819/1231501119","heartbeat_back_addr":"172.21.15.157:6823/1231501119","heartbeat_front_addr":"172.21.15.157:6821/1231501119","state":["exists","up"]},{"osd":7,"uuid":"87b80188-9ed1-428d-adbf-63102db355dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3420822707},{"type":"v1","addr":"172.21.15.157:6801","nonce":3420822707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3420822707},{"type":"v1","addr":"172.21.15.157:6803","nonce":3420822707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3420822707},{"type":"v1","addr":"172.21.15.157:6807","nonce":3420822707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3420822707},{"type":"v1","addr":"172.21.15.157:6805","nonce":3420822707}]},"public_addr":"172.21.15.157:6801/3420822707","cluster_addr":"172.21.15.157:6803/3420822707","heartbeat_back_addr":"172.21.15.157:6807/3420822707","heartbeat_front_addr":"172.21.15.157:6805/3420822707","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:09:24.750725+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:09:24.825357+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:09:25.213418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:09:25.473164+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:09:25.085301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:09:24.874251+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:09:24.920771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:09:25.051948+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:09:34.003 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-14T11:09:34.003 INFO:tasks.ceph:Creating RBD pool 2024-09-14T11:09:34.003 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-14T11:09:35.081 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'rbd' created 2024-09-14T11:09:35.105 DEBUG:teuthology.orchestra.run.smithi071:> rbd --cluster ceph pool init rbd 2024-09-14T11:09:35.151 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:35.151 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:38.138 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-14T11:09:38.139 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-14T11:09:38.139 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-14T11:09:38.455 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:09:38.474 INFO:teuthology.orchestra.run.smithi071.stdout:[{"version":9,"timestamp":"2024-09-14T11:09:27.327757+0000","name":"","changes":[{"name":"osd.2/osd_mclock_max_capacity_iops_ssd","new_value":"6205.671929"}]}] 2024-09-14T11:09:38.474 INFO:tasks.ceph_manager:config epoch is 9 2024-09-14T11:09:38.474 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-14T11:09:38.474 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-14T11:09:38.475 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-14T11:09:38.829 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:09:38.845 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":1492027983},{"type":"v1","addr":"172.21.15.71:6833","nonce":1492027983}]},"active_addr":"172.21.15.71:6833/1492027983","active_change":"2024-09-14T11:09:20.917724+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4111,"name":"x","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":72400147}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":1029813470}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":2651337086}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":1594188640}]}]} 2024-09-14T11:09:38.849 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-14T11:09:38.850 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-14T11:09:38.850 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T11:09:39.140 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:09:39.140 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":22,"fsid":"26f8926f-0d5e-4c48-adc1-d4f1601407fa","created":"2024-09-14T11:09:16.150194+0000","modified":"2024-09-14T11:09:38.116526+0000","last_up_change":"2024-09-14T11:09:28.039408+0000","last_in_change":"2024-09-14T11:09:18.416908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T11:09:28.974599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T11:09:34.328460+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"164dcbb0-6fba-429d-99e1-e9cc27927100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1986152349},{"type":"v1","addr":"172.21.15.71:6801","nonce":1986152349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1986152349},{"type":"v1","addr":"172.21.15.71:6803","nonce":1986152349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":1986152349},{"type":"v1","addr":"172.21.15.71:6807","nonce":1986152349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1986152349},{"type":"v1","addr":"172.21.15.71:6805","nonce":1986152349}]},"public_addr":"172.21.15.71:6801/1986152349","cluster_addr":"172.21.15.71:6803/1986152349","heartbeat_back_addr":"172.21.15.71:6807/1986152349","heartbeat_front_addr":"172.21.15.71:6805/1986152349","state":["exists","up"]},{"osd":1,"uuid":"c5897a6a-29f0-4adf-bc9a-4bb3c6f1fef0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":1268087573},{"type":"v1","addr":"172.21.15.71:6809","nonce":1268087573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":1268087573},{"type":"v1","addr":"172.21.15.71:6811","nonce":1268087573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1268087573},{"type":"v1","addr":"172.21.15.71:6815","nonce":1268087573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":1268087573},{"type":"v1","addr":"172.21.15.71:6813","nonce":1268087573}]},"public_addr":"172.21.15.71:6809/1268087573","cluster_addr":"172.21.15.71:6811/1268087573","heartbeat_back_addr":"172.21.15.71:6815/1268087573","heartbeat_front_addr":"172.21.15.71:6813/1268087573","state":["exists","up"]},{"osd":2,"uuid":"00e849be-fd02-41b9-8b44-96632fab0df7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2436891866},{"type":"v1","addr":"172.21.15.71:6825","nonce":2436891866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2436891866},{"type":"v1","addr":"172.21.15.71:6827","nonce":2436891866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2436891866},{"type":"v1","addr":"172.21.15.71:6831","nonce":2436891866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2436891866},{"type":"v1","addr":"172.21.15.71:6829","nonce":2436891866}]},"public_addr":"172.21.15.71:6825/2436891866","cluster_addr":"172.21.15.71:6827/2436891866","heartbeat_back_addr":"172.21.15.71:6831/2436891866","heartbeat_front_addr":"172.21.15.71:6829/2436891866","state":["exists","up"]},{"osd":3,"uuid":"10ac7c16-3217-45d5-8cba-e5009b98ec67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":60654820},{"type":"v1","addr":"172.21.15.71:6817","nonce":60654820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":60654820},{"type":"v1","addr":"172.21.15.71:6819","nonce":60654820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":60654820},{"type":"v1","addr":"172.21.15.71:6823","nonce":60654820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":60654820},{"type":"v1","addr":"172.21.15.71:6821","nonce":60654820}]},"public_addr":"172.21.15.71:6817/60654820","cluster_addr":"172.21.15.71:6819/60654820","heartbeat_back_addr":"172.21.15.71:6823/60654820","heartbeat_front_addr":"172.21.15.71:6821/60654820","state":["exists","up"]},{"osd":4,"uuid":"d6d6c280-cca0-40f4-9a37-ad61aad8553d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":2449482389},{"type":"v1","addr":"172.21.15.157:6825","nonce":2449482389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2449482389},{"type":"v1","addr":"172.21.15.157:6827","nonce":2449482389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":2449482389},{"type":"v1","addr":"172.21.15.157:6831","nonce":2449482389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":2449482389},{"type":"v1","addr":"172.21.15.157:6829","nonce":2449482389}]},"public_addr":"172.21.15.157:6825/2449482389","cluster_addr":"172.21.15.157:6827/2449482389","heartbeat_back_addr":"172.21.15.157:6831/2449482389","heartbeat_front_addr":"172.21.15.157:6829/2449482389","state":["exists","up"]},{"osd":5,"uuid":"4ba34dac-04b7-401f-80e4-17131ad5275f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":527702018},{"type":"v1","addr":"172.21.15.157:6809","nonce":527702018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":527702018},{"type":"v1","addr":"172.21.15.157:6811","nonce":527702018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":527702018},{"type":"v1","addr":"172.21.15.157:6815","nonce":527702018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":527702018},{"type":"v1","addr":"172.21.15.157:6813","nonce":527702018}]},"public_addr":"172.21.15.157:6809/527702018","cluster_addr":"172.21.15.157:6811/527702018","heartbeat_back_addr":"172.21.15.157:6815/527702018","heartbeat_front_addr":"172.21.15.157:6813/527702018","state":["exists","up"]},{"osd":6,"uuid":"93d2103c-c129-4a50-b6ed-adf9e62b7cac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1231501119},{"type":"v1","addr":"172.21.15.157:6817","nonce":1231501119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1231501119},{"type":"v1","addr":"172.21.15.157:6819","nonce":1231501119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1231501119},{"type":"v1","addr":"172.21.15.157:6823","nonce":1231501119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1231501119},{"type":"v1","addr":"172.21.15.157:6821","nonce":1231501119}]},"public_addr":"172.21.15.157:6817/1231501119","cluster_addr":"172.21.15.157:6819/1231501119","heartbeat_back_addr":"172.21.15.157:6823/1231501119","heartbeat_front_addr":"172.21.15.157:6821/1231501119","state":["exists","up"]},{"osd":7,"uuid":"87b80188-9ed1-428d-adbf-63102db355dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3420822707},{"type":"v1","addr":"172.21.15.157:6801","nonce":3420822707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3420822707},{"type":"v1","addr":"172.21.15.157:6803","nonce":3420822707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3420822707},{"type":"v1","addr":"172.21.15.157:6807","nonce":3420822707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3420822707},{"type":"v1","addr":"172.21.15.157:6805","nonce":3420822707}]},"public_addr":"172.21.15.157:6801/3420822707","cluster_addr":"172.21.15.157:6803/3420822707","heartbeat_back_addr":"172.21.15.157:6807/3420822707","heartbeat_front_addr":"172.21.15.157:6805/3420822707","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:09:24.750725+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:09:24.825357+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:09:25.213418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:09:25.473164+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:09:25.085301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:09:24.874251+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:09:24.920771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:09:25.051948+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:09:39.157 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-14T11:09:39.157 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T11:09:39.463 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:09:39.464 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":22,"fsid":"26f8926f-0d5e-4c48-adc1-d4f1601407fa","created":"2024-09-14T11:09:16.150194+0000","modified":"2024-09-14T11:09:38.116526+0000","last_up_change":"2024-09-14T11:09:28.039408+0000","last_in_change":"2024-09-14T11:09:18.416908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T11:09:28.974599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T11:09:34.328460+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"164dcbb0-6fba-429d-99e1-e9cc27927100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1986152349},{"type":"v1","addr":"172.21.15.71:6801","nonce":1986152349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1986152349},{"type":"v1","addr":"172.21.15.71:6803","nonce":1986152349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":1986152349},{"type":"v1","addr":"172.21.15.71:6807","nonce":1986152349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1986152349},{"type":"v1","addr":"172.21.15.71:6805","nonce":1986152349}]},"public_addr":"172.21.15.71:6801/1986152349","cluster_addr":"172.21.15.71:6803/1986152349","heartbeat_back_addr":"172.21.15.71:6807/1986152349","heartbeat_front_addr":"172.21.15.71:6805/1986152349","state":["exists","up"]},{"osd":1,"uuid":"c5897a6a-29f0-4adf-bc9a-4bb3c6f1fef0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":1268087573},{"type":"v1","addr":"172.21.15.71:6809","nonce":1268087573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":1268087573},{"type":"v1","addr":"172.21.15.71:6811","nonce":1268087573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1268087573},{"type":"v1","addr":"172.21.15.71:6815","nonce":1268087573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":1268087573},{"type":"v1","addr":"172.21.15.71:6813","nonce":1268087573}]},"public_addr":"172.21.15.71:6809/1268087573","cluster_addr":"172.21.15.71:6811/1268087573","heartbeat_back_addr":"172.21.15.71:6815/1268087573","heartbeat_front_addr":"172.21.15.71:6813/1268087573","state":["exists","up"]},{"osd":2,"uuid":"00e849be-fd02-41b9-8b44-96632fab0df7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2436891866},{"type":"v1","addr":"172.21.15.71:6825","nonce":2436891866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2436891866},{"type":"v1","addr":"172.21.15.71:6827","nonce":2436891866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2436891866},{"type":"v1","addr":"172.21.15.71:6831","nonce":2436891866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2436891866},{"type":"v1","addr":"172.21.15.71:6829","nonce":2436891866}]},"public_addr":"172.21.15.71:6825/2436891866","cluster_addr":"172.21.15.71:6827/2436891866","heartbeat_back_addr":"172.21.15.71:6831/2436891866","heartbeat_front_addr":"172.21.15.71:6829/2436891866","state":["exists","up"]},{"osd":3,"uuid":"10ac7c16-3217-45d5-8cba-e5009b98ec67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":60654820},{"type":"v1","addr":"172.21.15.71:6817","nonce":60654820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":60654820},{"type":"v1","addr":"172.21.15.71:6819","nonce":60654820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":60654820},{"type":"v1","addr":"172.21.15.71:6823","nonce":60654820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":60654820},{"type":"v1","addr":"172.21.15.71:6821","nonce":60654820}]},"public_addr":"172.21.15.71:6817/60654820","cluster_addr":"172.21.15.71:6819/60654820","heartbeat_back_addr":"172.21.15.71:6823/60654820","heartbeat_front_addr":"172.21.15.71:6821/60654820","state":["exists","up"]},{"osd":4,"uuid":"d6d6c280-cca0-40f4-9a37-ad61aad8553d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":2449482389},{"type":"v1","addr":"172.21.15.157:6825","nonce":2449482389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2449482389},{"type":"v1","addr":"172.21.15.157:6827","nonce":2449482389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":2449482389},{"type":"v1","addr":"172.21.15.157:6831","nonce":2449482389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":2449482389},{"type":"v1","addr":"172.21.15.157:6829","nonce":2449482389}]},"public_addr":"172.21.15.157:6825/2449482389","cluster_addr":"172.21.15.157:6827/2449482389","heartbeat_back_addr":"172.21.15.157:6831/2449482389","heartbeat_front_addr":"172.21.15.157:6829/2449482389","state":["exists","up"]},{"osd":5,"uuid":"4ba34dac-04b7-401f-80e4-17131ad5275f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":527702018},{"type":"v1","addr":"172.21.15.157:6809","nonce":527702018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":527702018},{"type":"v1","addr":"172.21.15.157:6811","nonce":527702018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":527702018},{"type":"v1","addr":"172.21.15.157:6815","nonce":527702018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":527702018},{"type":"v1","addr":"172.21.15.157:6813","nonce":527702018}]},"public_addr":"172.21.15.157:6809/527702018","cluster_addr":"172.21.15.157:6811/527702018","heartbeat_back_addr":"172.21.15.157:6815/527702018","heartbeat_front_addr":"172.21.15.157:6813/527702018","state":["exists","up"]},{"osd":6,"uuid":"93d2103c-c129-4a50-b6ed-adf9e62b7cac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1231501119},{"type":"v1","addr":"172.21.15.157:6817","nonce":1231501119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1231501119},{"type":"v1","addr":"172.21.15.157:6819","nonce":1231501119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1231501119},{"type":"v1","addr":"172.21.15.157:6823","nonce":1231501119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1231501119},{"type":"v1","addr":"172.21.15.157:6821","nonce":1231501119}]},"public_addr":"172.21.15.157:6817/1231501119","cluster_addr":"172.21.15.157:6819/1231501119","heartbeat_back_addr":"172.21.15.157:6823/1231501119","heartbeat_front_addr":"172.21.15.157:6821/1231501119","state":["exists","up"]},{"osd":7,"uuid":"87b80188-9ed1-428d-adbf-63102db355dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3420822707},{"type":"v1","addr":"172.21.15.157:6801","nonce":3420822707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3420822707},{"type":"v1","addr":"172.21.15.157:6803","nonce":3420822707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3420822707},{"type":"v1","addr":"172.21.15.157:6807","nonce":3420822707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3420822707},{"type":"v1","addr":"172.21.15.157:6805","nonce":3420822707}]},"public_addr":"172.21.15.157:6801/3420822707","cluster_addr":"172.21.15.157:6803/3420822707","heartbeat_back_addr":"172.21.15.157:6807/3420822707","heartbeat_front_addr":"172.21.15.157:6805/3420822707","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:09:24.750725+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:09:24.825357+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:09:25.213418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:09:25.473164+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:09:25.085301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:09:24.874251+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:09:24.920771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:09:25.051948+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:09:39.483 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-14T11:09:39.483 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-14T11:09:39.484 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-14T11:09:39.484 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-14T11:09:39.485 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-14T11:09:39.485 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-14T11:09:39.485 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-14T11:09:39.486 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-14T11:09:39.739 INFO:teuthology.orchestra.run.smithi071.stdout:60129542149 2024-09-14T11:09:39.740 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T11:09:39.741 INFO:teuthology.orchestra.run.smithi071.stdout:64424509446 2024-09-14T11:09:39.741 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T11:09:39.751 INFO:teuthology.orchestra.run.smithi071.stdout:60129542149 2024-09-14T11:09:39.751 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T11:09:39.753 INFO:teuthology.orchestra.run.smithi071.stdout:60129542148 2024-09-14T11:09:39.753 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-14T11:09:39.754 INFO:teuthology.orchestra.run.smithi071.stdout:60129542151 2024-09-14T11:09:39.755 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T11:09:39.758 INFO:teuthology.orchestra.run.smithi071.stdout:64424509446 2024-09-14T11:09:39.758 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T11:09:39.760 INFO:teuthology.orchestra.run.smithi071.stdout:60129542149 2024-09-14T11:09:39.760 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-14T11:09:39.769 INFO:teuthology.orchestra.run.smithi071.stdout:60129542150 2024-09-14T11:09:39.769 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T11:09:40.243 INFO:teuthology.orchestra.run.smithi071.stdout:64424509444 2024-09-14T11:09:40.269 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.3 2024-09-14T11:09:40.285 INFO:teuthology.orchestra.run.smithi071.stdout:60129542147 2024-09-14T11:09:40.295 INFO:teuthology.orchestra.run.smithi071.stdout:60129542148 2024-09-14T11:09:40.296 INFO:teuthology.orchestra.run.smithi071.stdout:60129542148 2024-09-14T11:09:40.301 INFO:teuthology.orchestra.run.smithi071.stdout:60129542150 2024-09-14T11:09:40.303 INFO:teuthology.orchestra.run.smithi071.stdout:64424509444 2024-09-14T11:09:40.306 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.6 2024-09-14T11:09:40.324 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.7 2024-09-14T11:09:40.324 INFO:teuthology.orchestra.run.smithi071.stdout:60129542148 2024-09-14T11:09:40.329 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.2 2024-09-14T11:09:40.331 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.5 2024-09-14T11:09:40.335 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.0 2024-09-14T11:09:40.345 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.1 2024-09-14T11:09:40.366 INFO:teuthology.orchestra.run.smithi071.stdout:60129542149 2024-09-14T11:09:40.382 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.4 2024-09-14T11:09:41.270 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T11:09:41.307 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-14T11:09:41.325 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-14T11:09:41.329 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T11:09:41.332 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T11:09:41.335 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T11:09:41.346 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T11:09:41.383 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T11:09:41.794 INFO:teuthology.orchestra.run.smithi071.stdout:64424509446 2024-09-14T11:09:41.817 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.3 2024-09-14T11:09:41.817 DEBUG:teuthology.parallel:result is None 2024-09-14T11:09:41.836 INFO:teuthology.orchestra.run.smithi071.stdout:60129542148 2024-09-14T11:09:41.859 INFO:teuthology.orchestra.run.smithi071.stdout:60129542151 2024-09-14T11:09:41.861 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.6 2024-09-14T11:09:41.861 DEBUG:teuthology.parallel:result is None 2024-09-14T11:09:41.877 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.0 2024-09-14T11:09:41.877 DEBUG:teuthology.parallel:result is None 2024-09-14T11:09:41.895 INFO:teuthology.orchestra.run.smithi071.stdout:64424509446 2024-09-14T11:09:41.912 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.2 2024-09-14T11:09:41.912 INFO:teuthology.orchestra.run.smithi071.stdout:60129542149 2024-09-14T11:09:41.913 INFO:teuthology.orchestra.run.smithi071.stdout:60129542149 2024-09-14T11:09:41.913 DEBUG:teuthology.parallel:result is None 2024-09-14T11:09:41.915 INFO:teuthology.orchestra.run.smithi071.stdout:60129542149 2024-09-14T11:09:41.941 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.1 2024-09-14T11:09:41.941 DEBUG:teuthology.parallel:result is None 2024-09-14T11:09:41.942 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.5 2024-09-14T11:09:41.943 DEBUG:teuthology.parallel:result is None 2024-09-14T11:09:41.943 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.7 2024-09-14T11:09:41.943 DEBUG:teuthology.parallel:result is None 2024-09-14T11:09:41.952 INFO:teuthology.orchestra.run.smithi071.stdout:60129542150 2024-09-14T11:09:41.968 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.4 2024-09-14T11:09:41.968 DEBUG:teuthology.parallel:result is None 2024-09-14T11:09:41.968 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T11:09:41.968 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:09:42.286 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:09:42.286 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-14T11:09:42.302 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-14T11:09:40.934912+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252432,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722288,"statfs":{"total":773094113280,"available":772835622912,"internally_reserved":0,"allocated":2965504,"data_stored":1789414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.839871"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:09:38.140326+0000","last_change":"2024-09-14T11:09:38.140326+0000","last_active":"2024-09-14T11:09:38.140326+0000","last_peered":"2024-09-14T11:09:38.140326+0000","last_clean":"2024-09-14T11:09:38.140326+0000","last_became_active":"2024-09-14T11:09:36.108781+0000","last_became_peered":"2024-09-14T11:09:36.108781+0000","last_unstale":"2024-09-14T11:09:38.140326+0000","last_undegraded":"2024-09-14T11:09:38.140326+0000","last_fullsized":"2024-09-14T11:09:38.140326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:06.040461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002510581,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:09:38.678645+0000","last_change":"2024-09-14T11:09:38.679232+0000","last_active":"2024-09-14T11:09:38.678645+0000","last_peered":"2024-09-14T11:09:38.678645+0000","last_clean":"2024-09-14T11:09:38.678645+0000","last_became_active":"2024-09-14T11:09:36.106073+0000","last_became_peered":"2024-09-14T11:09:36.106073+0000","last_unstale":"2024-09-14T11:09:38.678645+0000","last_undegraded":"2024-09-14T11:09:38.678645+0000","last_fullsized":"2024-09-14T11:09:38.678645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:12.720860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012975129999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:09:38.140706+0000","last_change":"2024-09-14T11:09:38.140706+0000","last_active":"2024-09-14T11:09:38.140706+0000","last_peered":"2024-09-14T11:09:38.140706+0000","last_clean":"2024-09-14T11:09:38.140706+0000","last_became_active":"2024-09-14T11:09:36.110624+0000","last_became_peered":"2024-09-14T11:09:36.110624+0000","last_unstale":"2024-09-14T11:09:38.140706+0000","last_undegraded":"2024-09-14T11:09:38.140706+0000","last_fullsized":"2024-09-14T11:09:38.140706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:03.769383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002569127,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:09:38.678894+0000","last_change":"2024-09-14T11:09:38.679466+0000","last_active":"2024-09-14T11:09:38.678894+0000","last_peered":"2024-09-14T11:09:38.678894+0000","last_clean":"2024-09-14T11:09:38.678894+0000","last_became_active":"2024-09-14T11:09:36.887411+0000","last_became_peered":"2024-09-14T11:09:36.887411+0000","last_unstale":"2024-09-14T11:09:38.678894+0000","last_undegraded":"2024-09-14T11:09:38.678894+0000","last_fullsized":"2024-09-14T11:09:38.678894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:17.852943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001210341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:09:38.141969+0000","last_change":"2024-09-14T11:09:38.140129+0000","last_active":"2024-09-14T11:09:38.141969+0000","last_peered":"2024-09-14T11:09:38.141969+0000","last_clean":"2024-09-14T11:09:38.141969+0000","last_became_active":"2024-09-14T11:09:36.887391+0000","last_became_peered":"2024-09-14T11:09:36.887391+0000","last_unstale":"2024-09-14T11:09:38.141969+0000","last_undegraded":"2024-09-14T11:09:38.141969+0000","last_fullsized":"2024-09-14T11:09:38.141969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:23.561067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023357849999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:09:38.678730+0000","last_change":"2024-09-14T11:09:38.679236+0000","last_active":"2024-09-14T11:09:38.678730+0000","last_peered":"2024-09-14T11:09:38.678730+0000","last_clean":"2024-09-14T11:09:38.678730+0000","last_became_active":"2024-09-14T11:09:36.110778+0000","last_became_peered":"2024-09-14T11:09:36.110778+0000","last_unstale":"2024-09-14T11:09:38.678730+0000","last_undegraded":"2024-09-14T11:09:38.678730+0000","last_fullsized":"2024-09-14T11:09:38.678730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:49.202249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001188634,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:09:38.138820+0000","last_change":"2024-09-14T11:09:38.138820+0000","last_active":"2024-09-14T11:09:38.138820+0000","last_peered":"2024-09-14T11:09:38.138820+0000","last_clean":"2024-09-14T11:09:38.138820+0000","last_became_active":"2024-09-14T11:09:36.110037+0000","last_became_peered":"2024-09-14T11:09:36.110037+0000","last_unstale":"2024-09-14T11:09:38.138820+0000","last_undegraded":"2024-09-14T11:09:38.138820+0000","last_fullsized":"2024-09-14T11:09:38.138820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:29.413375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001043441,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:09:38.138631+0000","last_change":"2024-09-14T11:09:38.138631+0000","last_active":"2024-09-14T11:09:38.138631+0000","last_peered":"2024-09-14T11:09:38.138631+0000","last_clean":"2024-09-14T11:09:38.138631+0000","last_became_active":"2024-09-14T11:09:36.264768+0000","last_became_peered":"2024-09-14T11:09:36.264768+0000","last_unstale":"2024-09-14T11:09:38.138631+0000","last_undegraded":"2024-09-14T11:09:38.138631+0000","last_fullsized":"2024-09-14T11:09:38.138631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:42.835248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092723999999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:09:38.130264+0000","last_change":"2024-09-14T11:09:30.311475+0000","last_active":"2024-09-14T11:09:38.130264+0000","last_peered":"2024-09-14T11:09:38.130264+0000","last_clean":"2024-09-14T11:09:38.130264+0000","last_became_active":"2024-09-14T11:09:30.309524+0000","last_became_peered":"2024-09-14T11:09:30.309524+0000","last_unstale":"2024-09-14T11:09:38.130264+0000","last_undegraded":"2024-09-14T11:09:38.130264+0000","last_fullsized":"2024-09-14T11:09:38.130264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:29.042524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:29.042524+0000","last_clean_scrub_stamp":"2024-09-14T11:09:29.042524+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:30.098592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":76080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35572,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336268,"statfs":{"total":96636764160,"available":96600338432,"internally_reserved":0,"allocated":221184,"data_stored":76080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35568,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336272,"statfs":{"total":96636764160,"available":96600342528,"internally_reserved":0,"allocated":225280,"data_stored":76099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36144,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335696,"statfs":{"total":96636764160,"available":96599752704,"internally_reserved":0,"allocated":815104,"data_stored":666448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35572,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336268,"statfs":{"total":96636764160,"available":96600338432,"internally_reserved":0,"allocated":221184,"data_stored":76080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":666448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":76080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:09:42.303 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:09:42.590 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:09:42.590 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-14T11:09:42.607 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-14T11:09:40.934912+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252432,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722288,"statfs":{"total":773094113280,"available":772835622912,"internally_reserved":0,"allocated":2965504,"data_stored":1789414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.839871"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:09:38.140326+0000","last_change":"2024-09-14T11:09:38.140326+0000","last_active":"2024-09-14T11:09:38.140326+0000","last_peered":"2024-09-14T11:09:38.140326+0000","last_clean":"2024-09-14T11:09:38.140326+0000","last_became_active":"2024-09-14T11:09:36.108781+0000","last_became_peered":"2024-09-14T11:09:36.108781+0000","last_unstale":"2024-09-14T11:09:38.140326+0000","last_undegraded":"2024-09-14T11:09:38.140326+0000","last_fullsized":"2024-09-14T11:09:38.140326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:06.040461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002510581,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:09:38.678645+0000","last_change":"2024-09-14T11:09:38.679232+0000","last_active":"2024-09-14T11:09:38.678645+0000","last_peered":"2024-09-14T11:09:38.678645+0000","last_clean":"2024-09-14T11:09:38.678645+0000","last_became_active":"2024-09-14T11:09:36.106073+0000","last_became_peered":"2024-09-14T11:09:36.106073+0000","last_unstale":"2024-09-14T11:09:38.678645+0000","last_undegraded":"2024-09-14T11:09:38.678645+0000","last_fullsized":"2024-09-14T11:09:38.678645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:12.720860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012975129999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:09:38.140706+0000","last_change":"2024-09-14T11:09:38.140706+0000","last_active":"2024-09-14T11:09:38.140706+0000","last_peered":"2024-09-14T11:09:38.140706+0000","last_clean":"2024-09-14T11:09:38.140706+0000","last_became_active":"2024-09-14T11:09:36.110624+0000","last_became_peered":"2024-09-14T11:09:36.110624+0000","last_unstale":"2024-09-14T11:09:38.140706+0000","last_undegraded":"2024-09-14T11:09:38.140706+0000","last_fullsized":"2024-09-14T11:09:38.140706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:03.769383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002569127,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:09:38.678894+0000","last_change":"2024-09-14T11:09:38.679466+0000","last_active":"2024-09-14T11:09:38.678894+0000","last_peered":"2024-09-14T11:09:38.678894+0000","last_clean":"2024-09-14T11:09:38.678894+0000","last_became_active":"2024-09-14T11:09:36.887411+0000","last_became_peered":"2024-09-14T11:09:36.887411+0000","last_unstale":"2024-09-14T11:09:38.678894+0000","last_undegraded":"2024-09-14T11:09:38.678894+0000","last_fullsized":"2024-09-14T11:09:38.678894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:17.852943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001210341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:09:38.141969+0000","last_change":"2024-09-14T11:09:38.140129+0000","last_active":"2024-09-14T11:09:38.141969+0000","last_peered":"2024-09-14T11:09:38.141969+0000","last_clean":"2024-09-14T11:09:38.141969+0000","last_became_active":"2024-09-14T11:09:36.887391+0000","last_became_peered":"2024-09-14T11:09:36.887391+0000","last_unstale":"2024-09-14T11:09:38.141969+0000","last_undegraded":"2024-09-14T11:09:38.141969+0000","last_fullsized":"2024-09-14T11:09:38.141969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:23.561067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023357849999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:09:38.678730+0000","last_change":"2024-09-14T11:09:38.679236+0000","last_active":"2024-09-14T11:09:38.678730+0000","last_peered":"2024-09-14T11:09:38.678730+0000","last_clean":"2024-09-14T11:09:38.678730+0000","last_became_active":"2024-09-14T11:09:36.110778+0000","last_became_peered":"2024-09-14T11:09:36.110778+0000","last_unstale":"2024-09-14T11:09:38.678730+0000","last_undegraded":"2024-09-14T11:09:38.678730+0000","last_fullsized":"2024-09-14T11:09:38.678730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:49.202249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001188634,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:09:38.138820+0000","last_change":"2024-09-14T11:09:38.138820+0000","last_active":"2024-09-14T11:09:38.138820+0000","last_peered":"2024-09-14T11:09:38.138820+0000","last_clean":"2024-09-14T11:09:38.138820+0000","last_became_active":"2024-09-14T11:09:36.110037+0000","last_became_peered":"2024-09-14T11:09:36.110037+0000","last_unstale":"2024-09-14T11:09:38.138820+0000","last_undegraded":"2024-09-14T11:09:38.138820+0000","last_fullsized":"2024-09-14T11:09:38.138820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:29.413375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001043441,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:09:38.138631+0000","last_change":"2024-09-14T11:09:38.138631+0000","last_active":"2024-09-14T11:09:38.138631+0000","last_peered":"2024-09-14T11:09:38.138631+0000","last_clean":"2024-09-14T11:09:38.138631+0000","last_became_active":"2024-09-14T11:09:36.264768+0000","last_became_peered":"2024-09-14T11:09:36.264768+0000","last_unstale":"2024-09-14T11:09:38.138631+0000","last_undegraded":"2024-09-14T11:09:38.138631+0000","last_fullsized":"2024-09-14T11:09:38.138631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:42.835248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092723999999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T11:09:38.130264+0000","last_change":"2024-09-14T11:09:30.311475+0000","last_active":"2024-09-14T11:09:38.130264+0000","last_peered":"2024-09-14T11:09:38.130264+0000","last_clean":"2024-09-14T11:09:38.130264+0000","last_became_active":"2024-09-14T11:09:30.309524+0000","last_became_peered":"2024-09-14T11:09:30.309524+0000","last_unstale":"2024-09-14T11:09:38.130264+0000","last_undegraded":"2024-09-14T11:09:38.130264+0000","last_fullsized":"2024-09-14T11:09:38.130264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:29.042524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:29.042524+0000","last_clean_scrub_stamp":"2024-09-14T11:09:29.042524+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:30.098592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":76080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35572,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336268,"statfs":{"total":96636764160,"available":96600338432,"internally_reserved":0,"allocated":221184,"data_stored":76080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35568,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336272,"statfs":{"total":96636764160,"available":96600342528,"internally_reserved":0,"allocated":225280,"data_stored":76099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36144,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335696,"statfs":{"total":96636764160,"available":96599752704,"internally_reserved":0,"allocated":815104,"data_stored":666448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35572,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336268,"statfs":{"total":96636764160,"available":96600338432,"internally_reserved":0,"allocated":221184,"data_stored":76080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":666448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":76080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:09:42.608 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T11:09:42.608 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-14T11:09:42.608 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-14T11:09:42.608 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-14T11:09:42.920 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:09:42.920 INFO:teuthology.orchestra.run.smithi071.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-14T11:09:42.938 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-14T11:09:42.938 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-14T11:09:42.952 INFO:teuthology.run_tasks:Running task rgw... 2024-09-14T11:09:43.026 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-14T11:09:43.026 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-14T11:09:43.026 INFO:tasks.rgw:Creating data pools 2024-09-14T11:09:43.027 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-14T11:09:43.027 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-09-14T11:09:44.159 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'default.rgw.buckets.data' created 2024-09-14T11:09:44.190 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-14T11:09:45.175 INFO:teuthology.orchestra.run.smithi071.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-14T11:09:45.219 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-14T11:09:45.926 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'default.rgw.buckets.index' created 2024-09-14T11:09:45.958 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-14T11:09:46.930 INFO:teuthology.orchestra.run.smithi071.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-14T11:09:46.973 DEBUG:tasks.rgw:Pools created 2024-09-14T11:09:46.973 INFO:tasks.rgw:Configuring compression type = random 2024-09-14T11:09:46.973 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-14T11:09:46.973 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-14T11:09:46.973 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-14T11:09:47.042 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:47.042 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:49.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:49.015+0000 7ff2f9f15640 0 -- 172.21.15.71:0/2146599568 >> [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] conn(0x7ff1cc0717b0 msgr2=0x7ff1cc073c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:09:49.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:49.023+0000 7ff2fbc0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:09:49.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:49.023+0000 7ff2f9f15640 0 -- 172.21.15.71:0/3151980151 >> [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] conn(0x7ff1c00718a0 msgr2=0x7ff1c0073d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:49.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:49.023+0000 7ff2fbc0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:49.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:49.023+0000 7ff2fbc0e9c0 20 realm 2024-09-14T11:09:49.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:49.023+0000 7ff2fbc0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:09:49.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:49.027+0000 7ff2fbc0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:49.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:49.027+0000 7ff2fbc0e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:49.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:49.027+0000 7ff2fbc0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:09:49.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:49.027+0000 7ff2fbc0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:49.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:49.027+0000 7ff2fbc0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:09:49.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:49.027+0000 7ff2fbc0e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:49.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:49.027+0000 7ff2fbc0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:09:49.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:49.027+0000 7ff2fbc0e9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T11:09:49.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:49.027+0000 7ff2fbc0e9c0 20 searching for the correct realm 2024-09-14T11:09:49.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:49.047+0000 7ff2fbc0e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:49.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:49.047+0000 7ff2fbc0e9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:09:49.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:49.047+0000 7ff2fbc0e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:49.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:49.047+0000 7ff2fbc0e9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:09:49.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:49.047+0000 7ff2fbc0e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:49.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:49.047+0000 7ff2fbc0e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:49.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:49.047+0000 7ff2fbc0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:09:49.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:49.051+0000 7ff2fbc0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:49.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:49.051+0000 7ff2fbc0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:09:49.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:49.051+0000 7ff2fbc0e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:49.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:49.051+0000 7ff2fbc0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:09:49.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:49.051+0000 7ff2fbc0e9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T11:09:49.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:49.051+0000 7ff2fbc0e9c0 20 zone default found 2024-09-14T11:09:49.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:49.051+0000 7ff2fbc0e9c0 4 Realm: () 2024-09-14T11:09:49.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:49.051+0000 7ff2fbc0e9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:09:49.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:49.051+0000 7ff2fbc0e9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:09:49.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:49.051+0000 7ff2fbc0e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:49.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:49.051+0000 7ff2fbc0e9c0 20 zonegroup default 2024-09-14T11:09:49.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:49.051+0000 7ff2fbc0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:09:49.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:49.051+0000 7ff2fbc0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:49.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:49.051+0000 7ff2fbc0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:09:50.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:50.979+0000 7ff2fbc0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:50.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:50.979+0000 7ff2fbc0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:09:50.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:50.983+0000 7ff2fbc0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:50.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:50.983+0000 7ff2fbc0e9c0 20 started sync module instance, tier type = 2024-09-14T11:09:50.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:50.983+0000 7ff2fbc0e9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:09:53.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.039+0000 7ff2fbc0e9c0 20 add_watcher() i=0 2024-09-14T11:09:53.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.039+0000 7ff2fbc0e9c0 20 add_watcher() i=1 2024-09-14T11:09:53.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.039+0000 7ff2fbc0e9c0 20 add_watcher() i=2 2024-09-14T11:09:53.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.039+0000 7ff2fbc0e9c0 20 add_watcher() i=3 2024-09-14T11:09:53.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.039+0000 7ff2fbc0e9c0 20 add_watcher() i=4 2024-09-14T11:09:53.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.039+0000 7ff2fbc0e9c0 20 add_watcher() i=5 2024-09-14T11:09:53.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.039+0000 7ff2fbc0e9c0 20 add_watcher() i=6 2024-09-14T11:09:53.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.039+0000 7ff2fbc0e9c0 20 add_watcher() i=7 2024-09-14T11:09:53.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.039+0000 7ff2fbc0e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:53.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.043+0000 7ff2fbc0e9c0 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-14T11:09:53.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.043+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-14T11:09:53.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.043+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.043+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-14T11:09:53.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.043+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-14T11:09:53.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.043+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.043+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-14T11:09:53.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.043+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-14T11:09:53.034 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.043+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.043+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-14T11:09:53.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.043+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-14T11:09:53.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.043+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.043+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-14T11:09:53.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.043+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-14T11:09:53.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.043+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.047+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-14T11:09:53.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.047+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-14T11:09:53.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.047+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.047+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-14T11:09:53.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.047+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-14T11:09:53.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.047+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.047+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-14T11:09:53.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.047+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-14T11:09:53.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.047+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.047+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-14T11:09:53.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.047+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-14T11:09:53.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.047+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.047+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-14T11:09:53.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.047+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-14T11:09:53.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.047+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.047+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-14T11:09:53.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.047+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-14T11:09:53.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.047+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.047+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-14T11:09:53.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.047+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-14T11:09:53.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.047+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.051+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-14T11:09:53.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.051+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-14T11:09:53.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.051+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.051+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-14T11:09:53.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.051+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-14T11:09:53.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.051+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.051+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-14T11:09:53.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.051+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-14T11:09:53.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.051+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.051+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-14T11:09:53.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.051+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-14T11:09:53.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.051+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.051+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-14T11:09:53.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.051+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-14T11:09:53.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.051+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.051+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-14T11:09:53.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.051+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-14T11:09:53.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.051+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.055+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-14T11:09:53.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.055+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-14T11:09:53.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.055+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.055+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-14T11:09:53.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.055+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-14T11:09:53.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.055+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.055+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-14T11:09:53.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.055+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-14T11:09:53.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.055+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.055+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-14T11:09:53.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.055+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-14T11:09:53.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.055+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.055+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-14T11:09:53.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.055+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-14T11:09:53.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.055+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.055+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-14T11:09:53.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.055+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-14T11:09:53.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.055+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.055+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-14T11:09:53.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.055+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-14T11:09:53.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.055+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.059+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-14T11:09:53.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.059+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-14T11:09:53.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.059+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.059+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-14T11:09:53.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.059+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-14T11:09:53.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.059+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.059+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-14T11:09:53.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.059+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-14T11:09:53.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.059+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.059+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-14T11:09:53.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.059+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-14T11:09:53.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.059+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.059+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-14T11:09:53.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.059+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-14T11:09:53.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.059+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.059+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-14T11:09:53.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.059+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-14T11:09:53.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.059+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.059+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-14T11:09:53.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.059+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-14T11:09:53.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.059+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.063+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-14T11:09:53.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.063+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-14T11:09:53.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.063+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.063+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-14T11:09:53.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.063+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-14T11:09:53.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.063+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.063+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-14T11:09:53.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.063+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-14T11:09:53.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.063+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.063+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-14T11:09:53.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.063+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-14T11:09:53.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.063+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.063+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-14T11:09:53.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.063+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-14T11:09:53.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.063+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.063+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-14T11:09:53.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.063+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-14T11:09:53.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.063+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.067+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-14T11:09:53.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.067+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-14T11:09:53.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.067+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.067+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-14T11:09:53.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.067+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-14T11:09:53.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.067+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.067+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-14T11:09:53.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.067+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-14T11:09:53.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.067+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.067+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-14T11:09:53.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.067+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-14T11:09:53.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.067+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.067+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-14T11:09:53.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.067+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-14T11:09:53.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.067+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.067+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-14T11:09:53.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.067+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-14T11:09:53.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.067+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.067+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-14T11:09:53.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.067+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-14T11:09:53.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.067+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.071+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-14T11:09:53.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.071+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-14T11:09:53.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.071+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.071+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-14T11:09:53.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.071+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-14T11:09:53.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.071+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.071+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-14T11:09:53.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.071+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-14T11:09:53.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.071+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.071+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-14T11:09:53.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.071+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-14T11:09:53.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.071+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.071+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-14T11:09:53.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.071+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-14T11:09:53.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.071+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.071+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-14T11:09:53.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.071+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-14T11:09:53.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.071+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.071+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-14T11:09:53.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.071+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-14T11:09:53.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.071+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.075+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-14T11:09:53.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.075+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-14T11:09:53.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.075+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.075+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-14T11:09:53.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.075+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-14T11:09:53.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.075+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.075+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-14T11:09:53.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.075+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-14T11:09:53.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.075+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.075+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-14T11:09:53.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.075+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-14T11:09:53.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.075+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.075+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-14T11:09:53.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.075+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-14T11:09:53.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.075+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.075+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-14T11:09:53.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.075+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-14T11:09:53.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.075+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.075+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-14T11:09:53.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.075+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-14T11:09:53.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.075+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.079+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-14T11:09:53.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.079+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-14T11:09:53.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.079+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.079+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-14T11:09:53.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.079+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-14T11:09:53.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.079+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.079+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-14T11:09:53.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.079+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-14T11:09:53.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.079+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.079+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-14T11:09:53.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.079+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-14T11:09:53.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.079+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.079+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-14T11:09:53.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.079+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-14T11:09:53.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.079+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.079+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-14T11:09:53.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.079+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-14T11:09:53.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.079+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.083+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-14T11:09:53.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.083+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-14T11:09:53.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.083+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.083+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-14T11:09:53.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.083+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-14T11:09:53.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.083+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.083+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-14T11:09:53.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.083+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-14T11:09:53.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.083+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.083+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-14T11:09:53.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.083+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-14T11:09:53.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.083+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.083+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-14T11:09:53.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.083+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-14T11:09:53.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.083+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.083+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-14T11:09:53.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.083+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-14T11:09:53.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.083+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.087+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-14T11:09:53.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.087+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-14T11:09:53.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.087+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.087+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-14T11:09:53.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.087+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-14T11:09:53.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.087+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.087+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-14T11:09:53.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.087+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-14T11:09:53.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.087+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.087+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-14T11:09:53.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.087+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-14T11:09:53.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.087+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.087+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-14T11:09:53.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.087+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-14T11:09:53.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.087+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.091+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-14T11:09:53.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.091+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-14T11:09:53.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.091+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.091+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-14T11:09:53.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.091+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-14T11:09:53.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.091+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.091+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-14T11:09:53.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.091+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-14T11:09:53.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.091+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.091+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-14T11:09:53.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.091+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-14T11:09:53.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.091+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.091+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-14T11:09:53.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.091+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-14T11:09:53.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.091+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.091+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-14T11:09:53.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.091+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-14T11:09:53.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.091+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.095+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-14T11:09:53.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.095+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-14T11:09:53.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.095+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.095+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-14T11:09:53.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.095+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-14T11:09:53.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.095+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.095+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-14T11:09:53.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.095+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-14T11:09:53.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.095+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.095+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-14T11:09:53.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.095+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-14T11:09:53.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.095+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.095+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-14T11:09:53.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.095+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-14T11:09:53.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.095+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.095+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-14T11:09:53.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.095+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-14T11:09:53.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.095+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.095+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-14T11:09:53.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.095+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-14T11:09:53.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.095+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.099+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-14T11:09:53.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.099+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-14T11:09:53.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.099+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.099+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-14T11:09:53.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.099+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-14T11:09:53.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.099+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.099+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-14T11:09:53.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.099+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-14T11:09:53.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.099+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.099+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-14T11:09:53.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.099+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-14T11:09:53.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.099+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.099+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-14T11:09:53.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.099+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-14T11:09:53.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.099+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.103+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-14T11:09:53.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.103+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-14T11:09:53.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.103+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.103+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-14T11:09:53.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.103+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-14T11:09:53.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.103+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.103+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-14T11:09:53.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.103+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-14T11:09:53.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.103+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.103+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-14T11:09:53.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.103+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-14T11:09:53.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.103+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.103+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-14T11:09:53.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.103+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-14T11:09:53.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.103+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.103+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-14T11:09:53.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.103+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-14T11:09:53.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.103+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.107+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-14T11:09:53.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.107+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-14T11:09:53.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.107+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.107+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-14T11:09:53.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.107+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-14T11:09:53.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.107+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.107+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-14T11:09:53.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.107+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-14T11:09:53.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.107+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.107+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-14T11:09:53.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.107+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-14T11:09:53.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.107+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.107+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-14T11:09:53.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.107+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-14T11:09:53.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.107+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.111+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-14T11:09:53.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.111+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-14T11:09:53.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.111+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.111+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-14T11:09:53.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.111+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-14T11:09:53.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.111+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.111+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-14T11:09:53.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.111+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-14T11:09:53.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.111+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.111+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-14T11:09:53.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.111+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-14T11:09:53.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.111+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.111+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-14T11:09:53.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.111+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-14T11:09:53.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.111+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.111+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-14T11:09:53.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.111+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-14T11:09:53.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.111+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.115+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-14T11:09:53.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.115+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-14T11:09:53.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.115+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.115+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-14T11:09:53.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.115+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-14T11:09:53.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.115+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.115+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-14T11:09:53.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.115+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-14T11:09:53.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.115+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.115+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-14T11:09:53.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.115+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-14T11:09:53.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.115+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.115+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-14T11:09:53.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.115+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-14T11:09:53.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.115+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.115+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-14T11:09:53.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.115+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-14T11:09:53.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.115+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.119+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-14T11:09:53.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.119+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-14T11:09:53.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.119+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.119+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-14T11:09:53.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.119+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-14T11:09:53.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.119+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.119+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-14T11:09:53.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.119+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-14T11:09:53.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.119+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.119+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-14T11:09:53.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.119+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-14T11:09:53.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.119+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.123+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-14T11:09:53.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.123+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-14T11:09:53.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.123+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.123+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-14T11:09:53.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.123+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-14T11:09:53.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.123+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.123+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-14T11:09:53.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.123+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-14T11:09:53.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.123+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.123+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-14T11:09:53.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.123+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-14T11:09:53.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.123+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.123+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-14T11:09:53.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.123+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-14T11:09:53.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.123+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.123+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-14T11:09:53.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.123+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-14T11:09:53.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.123+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.127+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-14T11:09:53.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.127+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-14T11:09:53.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.127+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.127+0000 7ff2fbc0e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-14T11:09:53.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.127+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-14T11:09:53.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.131+0000 7ff2fbc0e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:09:53.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.139+0000 7ff1ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:53.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.139+0000 7ff2fbc0e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:53.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:53.139+0000 7ff2fbc0e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:55.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:55.990+0000 7ff2fbc0e9c0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-14T11:09:55.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:55.990+0000 7ff2fbc0e9c0 5 note: GC not initialized 2024-09-14T11:09:55.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:55.998+0000 7ff1aa7e4640 20 reqs_thread_entry: start 2024-09-14T11:09:55.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:55.998+0000 7ff2fbc0e9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:09:55.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:55.998+0000 7ff2fbc0e9c0 20 Filter name: none 2024-09-14T11:09:55.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:55.998+0000 7ff10bfff640 20 reqs_thread_entry: start 2024-09-14T11:09:56.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.046+0000 7ff1ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:56.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.054+0000 7ff2fbc0e9c0 20 remove_watcher() i=0 2024-09-14T11:09:56.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.054+0000 7ff2fbc0e9c0 2 removed watcher, disabling cache 2024-09-14T11:09:56.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.054+0000 7ff2fbc0e9c0 20 remove_watcher() i=1 2024-09-14T11:09:56.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.058+0000 7ff2fbc0e9c0 20 remove_watcher() i=2 2024-09-14T11:09:56.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.062+0000 7ff2fbc0e9c0 20 remove_watcher() i=3 2024-09-14T11:09:56.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.062+0000 7ff2fbc0e9c0 20 remove_watcher() i=4 2024-09-14T11:09:56.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.066+0000 7ff2fbc0e9c0 20 remove_watcher() i=5 2024-09-14T11:09:56.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.070+0000 7ff2fbc0e9c0 20 remove_watcher() i=6 2024-09-14T11:09:56.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.070+0000 7ff2fbc0e9c0 20 remove_watcher() i=7 2024-09-14T11:09:56.084 INFO:teuthology.orchestra.run.smithi071.stdout:[] 2024-09-14T11:09:56.084 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T11:09:56.085 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-14T11:09:56.085 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-14T11:09:56.085 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-14T11:09:56.127 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:56.127 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:56.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.170+0000 7f7da83569c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:56.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.170+0000 7f7da83569c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:56.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.174+0000 7f7bdbfff640 20 reqs_thread_entry: start 2024-09-14T11:09:56.182 INFO:teuthology.orchestra.run.smithi071.stdout:{"id":"4444f441-0c56-48df-a905-d49e7e44d629","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-14T11:09:56.182 DEBUG:tasks.util.rgw: json result: {'id': '4444f441-0c56-48df-a905-d49e7e44d629', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-14T11:09:56.183 INFO:tasks.rgw:Preparing directory for rgw datacache at /tmp/rgw_datacache 2024-09-14T11:09:56.183 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p /tmp/rgw_datacache 2024-09-14T11:09:56.229 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a+rwx /tmp/rgw_datacache 2024-09-14T11:09:56.284 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-14T11:09:56.284 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-14T11:09:56.284 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-14T11:09:56.355 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:56.356 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:56.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.410+0000 7f3e248fe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.410+0000 7f3e248fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:56.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.410+0000 7f3e248fe9c0 20 realm 2024-09-14T11:09:56.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.410+0000 7f3e248fe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.410+0000 7f3e248fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:56.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.410+0000 7f3e248fe9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:56.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.410+0000 7f3e248fe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.414+0000 7f3e248fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:56.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.414+0000 7f3e248fe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.414+0000 7f3e248fe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:56.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.414+0000 7f3e248fe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.414+0000 7f3e248fe9c0 20 rados_obj.operate() r=0 bl.length=1009 2024-09-14T11:09:56.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.414+0000 7f3e248fe9c0 20 searching for the correct realm 2024-09-14T11:09:56.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.418+0000 7f3e22c05640 0 -- 172.21.15.71:0/1865713583 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f3e0c109640 msgr2=0x7f3e0c0e2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:09:56.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.630+0000 7f3e22c05640 0 -- 172.21.15.71:0/1865713583 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x5581f08f0230 msgr2=0x5581f08f2620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:56.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.646+0000 7f3e248fe9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:56.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.646+0000 7f3e248fe9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:09:56.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.646+0000 7f3e248fe9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:56.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.646+0000 7f3e248fe9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:09:56.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.646+0000 7f3e248fe9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:56.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.646+0000 7f3e248fe9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:56.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.646+0000 7f3e248fe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.646+0000 7f3e248fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:56.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.646+0000 7f3e248fe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.646+0000 7f3e248fe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:56.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.646+0000 7f3e248fe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.650+0000 7f3e248fe9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T11:09:56.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.650+0000 7f3e248fe9c0 20 zone default found 2024-09-14T11:09:56.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.650+0000 7f3e248fe9c0 4 Realm: () 2024-09-14T11:09:56.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.650+0000 7f3e248fe9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:09:56.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.650+0000 7f3e248fe9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:09:56.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.650+0000 7f3e248fe9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:56.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.650+0000 7f3e248fe9c0 20 zonegroup default 2024-09-14T11:09:56.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.650+0000 7f3e248fe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.650+0000 7f3e248fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:56.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.650+0000 7f3e248fe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.650+0000 7f3e248fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:56.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.650+0000 7f3e248fe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:09:56.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.650+0000 7f3e248fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:56.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.650+0000 7f3e248fe9c0 20 started sync module instance, tier type = 2024-09-14T11:09:56.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.650+0000 7f3e248fe9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:09:56.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.674+0000 7f3e248fe9c0 20 add_watcher() i=0 2024-09-14T11:09:56.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.674+0000 7f3e248fe9c0 20 add_watcher() i=1 2024-09-14T11:09:56.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.674+0000 7f3e248fe9c0 20 add_watcher() i=2 2024-09-14T11:09:56.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.674+0000 7f3e248fe9c0 20 add_watcher() i=3 2024-09-14T11:09:56.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.674+0000 7f3e248fe9c0 20 add_watcher() i=4 2024-09-14T11:09:56.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.674+0000 7f3e248fe9c0 20 add_watcher() i=5 2024-09-14T11:09:56.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.674+0000 7f3e248fe9c0 20 add_watcher() i=6 2024-09-14T11:09:56.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.678+0000 7f3e248fe9c0 20 add_watcher() i=7 2024-09-14T11:09:56.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.678+0000 7f3e248fe9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:56.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.682+0000 7f3cd8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:56.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.682+0000 7f3e248fe9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:56.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.682+0000 7f3e248fe9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:56.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.682+0000 7f3e248fe9c0 5 note: GC not initialized 2024-09-14T11:09:56.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.682+0000 7f3c537fe640 20 reqs_thread_entry: start 2024-09-14T11:09:56.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.682+0000 7f3e248fe9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:09:56.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.682+0000 7f3e248fe9c0 20 Filter name: none 2024-09-14T11:09:56.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.682+0000 7f3c517fa640 20 reqs_thread_entry: start 2024-09-14T11:09:56.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.702+0000 7f3cd8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:56.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.706+0000 7f3e248fe9c0 20 remove_watcher() i=0 2024-09-14T11:09:56.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.706+0000 7f3e248fe9c0 2 removed watcher, disabling cache 2024-09-14T11:09:56.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.710+0000 7f3e248fe9c0 20 remove_watcher() i=1 2024-09-14T11:09:56.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.714+0000 7f3e248fe9c0 20 remove_watcher() i=2 2024-09-14T11:09:56.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.714+0000 7f3e248fe9c0 20 remove_watcher() i=3 2024-09-14T11:09:56.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.718+0000 7f3e248fe9c0 20 remove_watcher() i=4 2024-09-14T11:09:56.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.718+0000 7f3e248fe9c0 20 remove_watcher() i=5 2024-09-14T11:09:56.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.722+0000 7f3e248fe9c0 20 remove_watcher() i=6 2024-09-14T11:09:56.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.726+0000 7f3e248fe9c0 20 remove_watcher() i=7 2024-09-14T11:09:56.728 INFO:teuthology.orchestra.run.smithi071.stdout:[] 2024-09-14T11:09:56.728 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T11:09:56.728 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-14T11:09:56.729 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-14T11:09:56.729 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-14T11:09:56.729 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-14T11:09:56.811 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:56.812 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:56.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.854+0000 7f66f9b999c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:56.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.854+0000 7f66f9b999c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:56.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.858+0000 7f6555ffb640 20 reqs_thread_entry: start 2024-09-14T11:09:56.866 INFO:teuthology.orchestra.run.smithi071.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-14T11:09:56.866 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-14T11:09:56.866 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-14T11:09:56.867 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-14T11:09:56.867 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-14T11:09:56.949 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:56.949 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:56.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.990+0000 7f835ce3b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:56.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.990+0000 7f835ce3b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:56.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:56.994+0000 7f8210ff9640 20 reqs_thread_entry: start 2024-09-14T11:09:57.003 INFO:teuthology.orchestra.run.smithi071.stdout:{"id":"4444f441-0c56-48df-a905-d49e7e44d629","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-14T11:09:57.004 DEBUG:tasks.util.rgw: json result: {'id': '4444f441-0c56-48df-a905-d49e7e44d629', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-14T11:09:57.004 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-14T11:09:57.004 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-14T11:09:57.004 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-14T11:09:57.004 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-14T11:09:57.081 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:57.081 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:57.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:57.122+0000 7f861a5949c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:57.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:57.122+0000 7f861a5949c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:57.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:57.126+0000 7f845e7fc640 20 reqs_thread_entry: start 2024-09-14T11:09:57.134 INFO:teuthology.orchestra.run.smithi071.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-14T11:09:57.134 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-14T11:09:57.135 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-14T11:09:57.135 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-14T11:09:57.135 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-14T11:09:57.214 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:57.214 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:57.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:57.254+0000 7fe481d0b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:57.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:57.254+0000 7fe481d0b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:57.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:09:57.258+0000 7fe32dffb640 20 reqs_thread_entry: start 2024-09-14T11:09:57.265 INFO:teuthology.orchestra.run.smithi071.stdout:{"id":"4444f441-0c56-48df-a905-d49e7e44d629","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-14T11:09:57.265 DEBUG:tasks.util.rgw: json result: {'id': '4444f441-0c56-48df-a905-d49e7e44d629', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-14T11:09:57.266 INFO:tasks.rgw:Starting rgw... 2024-09-14T11:09:57.266 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-14T11:09:57.266 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-14T11:09:57.266 DEBUG:teuthology.orchestra.run.smithi071:> sudo echo -n http://smithi071.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-14T11:09:57.327 INFO:teuthology.orchestra.run.smithi071.stdout:http://smithi071.front.sepia.ceph.com:80 2024-09-14T11:09:57.327 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-14T11:09:57.381 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-14T11:09:57.381 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-14T11:09:57.423 INFO:tasks.rgw.client.0:Started 2024-09-14T11:09:57.423 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi071.front.sepia.ceph.com:80/ 2024-09-14T11:09:57.423 DEBUG:teuthology.orchestra.run.smithi071:> curl http://smithi071.front.sepia.ceph.com:80/ 2024-09-14T11:09:57.438 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T11:09:57.438 INFO:teuthology.orchestra.run.smithi071.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T11:09:57.438 INFO:teuthology.orchestra.run.smithi071.stderr: Dload Upload Total Spent Left Speed 2024-09-14T11:09:57.438 INFO:teuthology.orchestra.run.smithi071.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T11:09:57.439 INFO:teuthology.orchestra.run.smithi071.stderr:curl: (7) Failed to connect to smithi071.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-14T11:09:58.439 DEBUG:teuthology.orchestra.run.smithi071:> curl http://smithi071.front.sepia.ceph.com:80/ 2024-09-14T11:09:58.451 INFO:teuthology.orchestra.run.smithi071.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T11:09:58.451 INFO:teuthology.orchestra.run.smithi071.stderr: Dload Upload Total Spent Left Speed 2024-09-14T11:09:58.453 INFO:teuthology.orchestra.run.smithi071.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 67876 0 --:--:-- --:--:-- --:--:-- 93500 2024-09-14T11:09:58.454 INFO:teuthology.orchestra.run.smithi071.stdout:anonymous 2024-09-14T11:09:58.455 INFO:teuthology.run_tasks:Running task tox... 2024-09-14T11:09:58.477 INFO:tasks.tox:Deploying tox from pip... 2024-09-14T11:09:58.477 DEBUG:teuthology.orchestra.run.smithi071:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-14T11:10:01.699 DEBUG:teuthology.orchestra.run.smithi071:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-14T11:10:02.343 INFO:teuthology.orchestra.run.smithi071.stdout:Collecting tox==3.15.0 2024-09-14T11:10:02.438 INFO:teuthology.orchestra.run.smithi071.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-14T11:10:02.505 INFO:teuthology.orchestra.run.smithi071.stdout: ---------------------------------------- 82.1/82.1 KB 1.2 MB/s eta 0:00:00 2024-09-14T11:10:02.643 INFO:teuthology.orchestra.run.smithi071.stdout:Collecting py<2,>=1.4.17 2024-09-14T11:10:02.658 INFO:teuthology.orchestra.run.smithi071.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-14T11:10:02.714 INFO:teuthology.orchestra.run.smithi071.stdout: ---------------------------------------- 98.7/98.7 KB 1.7 MB/s eta 0:00:00 2024-09-14T11:10:02.784 INFO:teuthology.orchestra.run.smithi071.stdout:Collecting toml>=0.9.4 2024-09-14T11:10:02.801 INFO:teuthology.orchestra.run.smithi071.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-14T11:10:03.106 INFO:teuthology.orchestra.run.smithi071.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-14T11:10:03.122 INFO:teuthology.orchestra.run.smithi071.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-14T11:10:03.727 INFO:teuthology.orchestra.run.smithi071.stdout: ---------------------------------------- 6.0/6.0 MB 10.0 MB/s eta 0:00:00 2024-09-14T11:10:03.855 INFO:teuthology.orchestra.run.smithi071.stdout:Collecting six<2,>=1.14.0 2024-09-14T11:10:03.871 INFO:teuthology.orchestra.run.smithi071.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:10:04.022 INFO:teuthology.orchestra.run.smithi071.stdout:Collecting filelock<4,>=3.0.0 2024-09-14T11:10:04.037 INFO:teuthology.orchestra.run.smithi071.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-14T11:10:04.160 INFO:teuthology.orchestra.run.smithi071.stdout:Collecting packaging>=14 2024-09-14T11:10:04.175 INFO:teuthology.orchestra.run.smithi071.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-14T11:10:04.210 INFO:teuthology.orchestra.run.smithi071.stdout: ---------------------------------------- 54.0/54.0 KB 1.4 MB/s eta 0:00:00 2024-09-14T11:10:04.303 INFO:teuthology.orchestra.run.smithi071.stdout:Collecting pluggy<1,>=0.12.0 2024-09-14T11:10:04.319 INFO:teuthology.orchestra.run.smithi071.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-14T11:10:04.492 INFO:teuthology.orchestra.run.smithi071.stdout:Collecting distlib<1,>=0.3.7 2024-09-14T11:10:04.506 INFO:teuthology.orchestra.run.smithi071.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-14T11:10:04.571 INFO:teuthology.orchestra.run.smithi071.stdout: --------------------------------------- 468.9/468.9 KB 7.7 MB/s eta 0:00:00 2024-09-14T11:10:04.669 INFO:teuthology.orchestra.run.smithi071.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-14T11:10:04.683 INFO:teuthology.orchestra.run.smithi071.stdout: Downloading platformdirs-4.3.3-py3-none-any.whl (18 kB) 2024-09-14T11:10:04.862 INFO:teuthology.orchestra.run.smithi071.stdout:Installing collected packages: distlib, toml, six, py, pluggy, platformdirs, packaging, filelock, virtualenv, tox 2024-09-14T11:10:05.881 INFO:teuthology.orchestra.run.smithi071.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.3 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-14T11:10:05.977 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:10:05.991 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:10:05.992 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:10:05.992 DEBUG:teuthology.orchestra.run.smithi071:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:10:05.999 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:10:05.999 INFO:teuthology.orchestra.run.smithi071.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:10:05.999 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:10:06.049 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:10:06.049 DEBUG:teuthology.orchestra.run.smithi071:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:10:06.095 INFO:tasks.workunit:timeout=3h 2024-09-14T11:10:06.096 INFO:tasks.workunit:cleanup=True 2024-09-14T11:10:06.096 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:10:06.145 INFO:tasks.workunit.client.0.smithi071.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:11:00.731 INFO:tasks.workunit.client.0.smithi071.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:11:00.731 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:11:00.731 INFO:tasks.workunit.client.0.smithi071.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:11:00.732 INFO:tasks.workunit.client.0.smithi071.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:11:00.732 INFO:tasks.workunit.client.0.smithi071.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:11:00.732 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:11:00.732 INFO:tasks.workunit.client.0.smithi071.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:11:00.732 INFO:tasks.workunit.client.0.smithi071.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:11:00.732 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:11:00.732 INFO:tasks.workunit.client.0.smithi071.stderr: git switch -c 2024-09-14T11:11:00.732 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:11:00.732 INFO:tasks.workunit.client.0.smithi071.stderr:Or undo this operation with: 2024-09-14T11:11:00.732 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:11:00.732 INFO:tasks.workunit.client.0.smithi071.stderr: git switch - 2024-09-14T11:11:00.732 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:11:00.733 INFO:tasks.workunit.client.0.smithi071.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:11:00.733 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:11:00.733 INFO:tasks.workunit.client.0.smithi071.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:11:00.734 DEBUG:teuthology.orchestra.run.smithi071:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:11:00.780 INFO:tasks.workunit.client.0.smithi071.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:11:00.783 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:11:00.783 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:11:01.770 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:11:01.852 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:11:01.914 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:11:01.916 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:11:01.916 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:11:01.964 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:11:01.968 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T11:11:01.968 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:11:02.016 INFO:tasks.workunit:Running workunits matching rgw/run-datacache.sh on client.0... 2024-09-14T11:11:02.017 INFO:tasks.workunit:Running workunit rgw/run-datacache.sh... 2024-09-14T11:11:02.017 DEBUG:teuthology.orchestra.run.smithi071:workunit test rgw/run-datacache.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-14T11:11:02.069 INFO:tasks.workunit.client.0.smithi071.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-14T11:11:02.070 INFO:tasks.workunit.client.0.smithi071.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:11:02.070 INFO:tasks.workunit.client.0.smithi071.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:11:05.154 INFO:tasks.workunit.client.0.smithi071.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T11:11:05.155 INFO:tasks.workunit.client.0.smithi071.stderr:++ deactivate nondestructive 2024-09-14T11:11:05.155 INFO:tasks.workunit.client.0.smithi071.stderr:++ '[' -n '' ']' 2024-09-14T11:11:05.155 INFO:tasks.workunit.client.0.smithi071.stderr:++ '[' -n '' ']' 2024-09-14T11:11:05.155 INFO:tasks.workunit.client.0.smithi071.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:11:05.155 INFO:tasks.workunit.client.0.smithi071.stderr:++ hash -r 2024-09-14T11:11:05.155 INFO:tasks.workunit.client.0.smithi071.stderr:++ '[' -n '' ']' 2024-09-14T11:11:05.155 INFO:tasks.workunit.client.0.smithi071.stderr:++ unset VIRTUAL_ENV 2024-09-14T11:11:05.155 INFO:tasks.workunit.client.0.smithi071.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-14T11:11:05.155 INFO:tasks.workunit.client.0.smithi071.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T11:11:05.155 INFO:tasks.workunit.client.0.smithi071.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:11:05.157 INFO:tasks.workunit.client.0.smithi071.stderr:++ export VIRTUAL_ENV 2024-09-14T11:11:05.157 INFO:tasks.workunit.client.0.smithi071.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T11:11:05.157 INFO:tasks.workunit.client.0.smithi071.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T11:11:05.157 INFO:tasks.workunit.client.0.smithi071.stderr:++ export PATH 2024-09-14T11:11:05.157 INFO:tasks.workunit.client.0.smithi071.stderr:++ '[' -n '' ']' 2024-09-14T11:11:05.157 INFO:tasks.workunit.client.0.smithi071.stderr:++ '[' -z '' ']' 2024-09-14T11:11:05.157 INFO:tasks.workunit.client.0.smithi071.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T11:11:05.157 INFO:tasks.workunit.client.0.smithi071.stderr:++ PS1='(rgw) ' 2024-09-14T11:11:05.157 INFO:tasks.workunit.client.0.smithi071.stderr:++ export PS1 2024-09-14T11:11:05.157 INFO:tasks.workunit.client.0.smithi071.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-14T11:11:05.157 INFO:tasks.workunit.client.0.smithi071.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-14T11:11:05.157 INFO:tasks.workunit.client.0.smithi071.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:11:05.158 INFO:tasks.workunit.client.0.smithi071.stderr:++ hash -r 2024-09-14T11:11:05.158 INFO:tasks.workunit.client.0.smithi071.stderr:+ pip install pip --upgrade 2024-09-14T11:11:05.515 INFO:tasks.workunit.client.0.smithi071.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-14T11:11:05.740 INFO:tasks.workunit.client.0.smithi071.stdout:Collecting pip 2024-09-14T11:11:05.840 INFO:tasks.workunit.client.0.smithi071.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:11:05.973 INFO:tasks.workunit.client.0.smithi071.stdout: ---------------------------------------- 1.8/1.8 MB 14.3 MB/s eta 0:00:00 2024-09-14T11:11:06.043 INFO:tasks.workunit.client.0.smithi071.stdout:Installing collected packages: pip 2024-09-14T11:11:06.043 INFO:tasks.workunit.client.0.smithi071.stdout: Attempting uninstall: pip 2024-09-14T11:11:06.043 INFO:tasks.workunit.client.0.smithi071.stdout: Found existing installation: pip 22.0.2 2024-09-14T11:11:06.312 INFO:tasks.workunit.client.0.smithi071.stdout: Uninstalling pip-22.0.2: 2024-09-14T11:11:06.318 INFO:tasks.workunit.client.0.smithi071.stdout: Successfully uninstalled pip-22.0.2 2024-09-14T11:11:07.058 INFO:tasks.workunit.client.0.smithi071.stdout:Successfully installed pip-24.2 2024-09-14T11:11:07.117 INFO:tasks.workunit.client.0.smithi071.stderr:+ pip install configobj 2024-09-14T11:11:07.713 INFO:tasks.workunit.client.0.smithi071.stdout:Collecting configobj 2024-09-14T11:11:07.761 INFO:tasks.workunit.client.0.smithi071.stdout: Downloading configobj-5.0.8-py2.py3-none-any.whl.metadata (3.4 kB) 2024-09-14T11:11:07.896 INFO:tasks.workunit.client.0.smithi071.stdout:Collecting six (from configobj) 2024-09-14T11:11:07.914 INFO:tasks.workunit.client.0.smithi071.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:11:07.985 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading configobj-5.0.8-py2.py3-none-any.whl (36 kB) 2024-09-14T11:11:08.063 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:11:08.145 INFO:tasks.workunit.client.0.smithi071.stdout:Installing collected packages: six, configobj 2024-09-14T11:11:08.301 INFO:tasks.workunit.client.0.smithi071.stdout:Successfully installed configobj-5.0.8 six-1.16.0 2024-09-14T11:11:08.711 INFO:tasks.workunit.client.0.smithi071.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_datacache.py 2024-09-14T11:11:08.749 INFO:tasks.workunit.client.0.smithi071.stderr:DEBUG:root:datacache dir from config is: /tmp/rgw_datacache 2024-09-14T11:11:08.749 INFO:tasks.workunit.client.0.smithi071.stderr:DEBUG:root:exec_cmd(pwd) 2024-09-14T11:11:08.749 INFO:tasks.workunit.client.0.smithi071.stderr:INFO:root:command succeeded 2024-09-14T11:11:08.750 INFO:tasks.workunit.client.0.smithi071.stderr:INFO:root:b'/home/ubuntu/cephtest/mnt.0/client.0/tmp\n' 2024-09-14T11:11:08.750 INFO:tasks.workunit.client.0.smithi071.stderr:DEBUG:root:pwd is: /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:11:08.750 INFO:tasks.workunit.client.0.smithi071.stderr:DEBUG:root:exec_cmd(sudo netstat -nltp | egrep "rados|valgr") 2024-09-14T11:11:08.792 INFO:tasks.workunit.client.0.smithi071.stderr:INFO:root:command succeeded 2024-09-14T11:11:08.793 INFO:tasks.workunit.client.0.smithi071.stderr:INFO:root:b'tcp 0 0 0.0.0.0:80 0.0.0.0:* LISTEN 36914/radosgw \ntcp6 0 0 :::80 :::* LISTEN 36914/radosgw \n' 2024-09-14T11:11:08.793 INFO:tasks.workunit.client.0.smithi071.stderr:INFO:root:radosgw port: 80 2024-09-14T11:11:08.793 INFO:tasks.workunit.client.0.smithi071.stderr:INFO:root:radosgw endpoint is: 127.0.0.1 2024-09-14T11:11:08.793 INFO:tasks.workunit.client.0.smithi071.stderr:DEBUG:root:exec_cmd(dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat bs=1M count=7) 2024-09-14T11:11:08.826 INFO:tasks.workunit.client.0.smithi071.stderr:INFO:root:command succeeded 2024-09-14T11:11:08.826 INFO:tasks.workunit.client.0.smithi071.stderr:INFO:root:b'' 2024-09-14T11:11:08.826 INFO:tasks.workunit.client.0.smithi071.stderr:DEBUG:root:exec_cmd(radosgw-admin user create --uid rgw_datacache_user --display-name DatacacheUser --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn) 2024-09-14T11:11:09.002 INFO:tasks.workunit.client.0.smithi071.stderr:INFO:root:command succeeded 2024-09-14T11:11:09.002 INFO:tasks.workunit.client.0.smithi071.stderr:INFO:root:b'{\n "user_id": "rgw_datacache_user",\n "display_name": "DatacacheUser",\n "email": "",\n "suspended": 0,\n "max_buckets": 1000,\n "subusers": [],\n "keys": [\n {\n "user": "rgw_datacache_user",\n "access_key": "NX5QOQKC6BH2IDN8HC7A",\n "secret_key": "LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn",\n "active": true,\n "create_date": "2024-09-14T11:11:08.969434Z"\n }\n ],\n "swift_keys": [],\n "caps": [],\n "op_mask": "read, write, delete",\n "default_placement": "",\n "default_storage_class": "",\n "placement_tags": [],\n "bucket_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "user_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "temp_url_keys": [],\n "type": "rgw",\n "mfa_ids": [],\n "account_id": "",\n "path": "/",\n "create_date": "2024-09-14T11:11:08.969421Z",\n "tags": [],\n "group_ids": []\n}\n\n' 2024-09-14T11:11:09.002 INFO:tasks.workunit.client.0.smithi071.stderr:INFO:root:Creating s3cmd config... 2024-09-14T11:11:09.002 INFO:tasks.workunit.client.0.smithi071.stderr:INFO:root:proto for s3cmd config is http 2024-09-14T11:11:09.002 INFO:tasks.workunit.client.0.smithi071.stderr:INFO:root:s3cmd config written 2024-09-14T11:11:09.002 INFO:tasks.workunit.client.0.smithi071.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 mb s3://datacachebucket) 2024-09-14T11:11:09.174 INFO:tasks.workunit.client.0.smithi071.stderr:INFO:root:command succeeded 2024-09-14T11:11:09.174 INFO:tasks.workunit.client.0.smithi071.stderr:INFO:root:b"Bucket 's3://datacachebucket/' created\n" 2024-09-14T11:11:09.175 INFO:tasks.workunit.client.0.smithi071.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 put /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat s3://datacachebucket) 2024-09-14T11:11:09.477 INFO:tasks.workunit.client.0.smithi071.stderr:INFO:root:command succeeded 2024-09-14T11:11:09.477 INFO:tasks.workunit.client.0.smithi071.stderr:INFO:root:b"upload: '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat' -> 's3://datacachebucket/7M.dat' (7340032 bytes in 0.2 seconds, 46.38 MB/s) [1 of 1]\n" 2024-09-14T11:11:09.478 INFO:tasks.workunit.client.0.smithi071.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 get s3://datacachebucket/7M.dat /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat --force) 2024-09-14T11:11:09.658 INFO:tasks.workunit.client.0.smithi071.stderr:INFO:root:command succeeded 2024-09-14T11:11:09.659 INFO:tasks.workunit.client.0.smithi071.stderr:INFO:root:b"download: 's3://datacachebucket/7M.dat' -> '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat' (7340032 bytes in 0.0 seconds, 171.82 MB/s)\n" 2024-09-14T11:11:09.659 INFO:tasks.workunit.client.0.smithi071.stderr:DEBUG:root:exec_cmd(radosgw-admin object stat --bucket=datacachebucket --object=7M.dat) 2024-09-14T11:11:10.045 INFO:tasks.workunit.client.0.smithi071.stderr:INFO:root:command succeeded 2024-09-14T11:11:10.045 INFO:tasks.workunit.client.0.smithi071.stderr:INFO:root:b'{\n "name": "7M.dat",\n "size": 7368844,\n "policy": {\n "acl": {\n "acl_user_map": [\n {\n "user": "rgw_datacache_user",\n "acl": 15\n }\n ],\n "acl_group_map": [],\n "grant_map": [\n {\n "id": "rgw_datacache_user",\n "grant": {\n "type": {\n "type": 0\n },\n "id": "rgw_datacache_user",\n "name": "DatacacheUser",\n "permission": {\n "flags": 15\n }\n }\n }\n ]\n },\n "owner": {\n "id": "rgw_datacache_user",\n "display_name": "DatacacheUser"\n }\n },\n "compression": {\n "compression_type": "lz4",\n "orig_size": 7340032,\n "blocks": [\n {\n "old_ofs": 0,\n "new_ofs": 0,\n "len": 4210766\n },\n {\n "old_ofs": 4194304,\n "new_ofs": 4210766,\n "len": 3158078\n }\n ]\n },\n "etag": "25d40cb3465b8aa518a080530b69a86a",\n "tag": "4444f441-0c56-48df-a905-d49e7e44d629.4596.3835866767536355467",\n "manifest": {\n "objs": [],\n "obj_size": 7368844,\n "explicit_objs": false,\n "head_size": 4194304,\n "max_head_size": 4194304,\n "prefix": ".HZR74kpIT-5Fs3j-YTL7DsJ7uRbNJzZ_",\n "rules": [\n {\n "key": 0,\n "val": {\n "start_part_num": 0,\n "start_ofs": 4194304,\n "part_size": 0,\n "stripe_max_size": 4194304,\n "override_prefix": ""\n }\n }\n ],\n "tail_instance": "",\n "tail_placement": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "4444f441-0c56-48df-a905-d49e7e44d629.4596.1",\n "bucket_id": "4444f441-0c56-48df-a905-d49e7e44d629.4596.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "placement_rule": "default-placement"\n },\n "tier_type": "",\n "begin_iter": {\n "part_ofs": 0,\n "stripe_ofs": 0,\n "ofs": 0,\n "stripe_size": 4194304,\n "cur_part_id": 0,\n "cur_stripe": 0,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "4444f441-0c56-48df-a905-d49e7e44d629.4596.1",\n "bucket_id": "4444f441-0c56-48df-a905-d49e7e44d629.4596.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": "7M.dat",\n "instance": "",\n "ns": ""\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n },\n "end_iter": {\n "part_ofs": 4194304,\n "stripe_ofs": 4194304,\n "ofs": 7368844,\n "stripe_size": 3174540,\n "cur_part_id": 0,\n "cur_stripe": 1,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "4444f441-0c56-48df-a905-d49e7e44d629.4596.1",\n "bucket_id": "4444f441-0c56-48df-a905-d49e7e44d629.4596.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".HZR74kpIT-5Fs3j-YTL7DsJ7uRbNJzZ_1",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n }\n },\n "pg_ver": 0,\n "source_zone": 0,\n "torrent": "",\n "mtime": "2024-09-14T11:11:09.435209Z",\n "attrs": {\n "user.rgw.content_type": "application/octet-stream",\n "user.rgw.storage_class": "STANDARD",\n "user.rgw.tail_tag": "4444f441-0c56-48df-a905-d49e7e44d629.4596.3835866767536355467",\n "user.rgw.x-amz-meta-s3cmd-attrs": "atime:1726312268/ctime:1726312268/gid:1271/gname:ubuntu/md5:25d40cb3465b8aa518a080530b69a86a/mode:33204/mtime:1726312268/uid:1000/uname:ubuntu"\n }\n}\n' 2024-09-14T11:11:10.045 INFO:tasks.workunit.client.0.smithi071.stderr:DEBUG:root:Cached object name is: .HZR74kpIT-5Fs3j-YTL7DsJ7uRbNJzZ_ 2024-09-14T11:11:10.045 INFO:tasks.workunit.client.0.smithi071.stderr:DEBUG:root:exec_cmd(find /tmp/rgw_datacache -type f | wc -l) 2024-09-14T11:11:10.047 INFO:tasks.workunit.client.0.smithi071.stderr:INFO:root:command succeeded 2024-09-14T11:11:10.047 INFO:tasks.workunit.client.0.smithi071.stderr:INFO:root:b'0\n' 2024-09-14T11:11:10.047 INFO:tasks.workunit.client.0.smithi071.stderr:DEBUG:root:Check cache dir content: 0 2024-09-14T11:11:10.047 INFO:tasks.workunit.client.0.smithi071.stderr:INFO:root:NOTICE: datacache test object not found, inspect if datacache was bypassed or disabled during this check. 2024-09-14T11:11:10.047 INFO:tasks.workunit.client.0.smithi071.stderr:INFO:root:Completed Datacache tests 2024-09-14T11:11:10.055 INFO:tasks.workunit.client.0.smithi071.stderr:+ deactivate 2024-09-14T11:11:10.055 INFO:tasks.workunit.client.0.smithi071.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-14T11:11:10.055 INFO:tasks.workunit.client.0.smithi071.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T11:11:10.055 INFO:tasks.workunit.client.0.smithi071.stderr:+ export PATH 2024-09-14T11:11:10.055 INFO:tasks.workunit.client.0.smithi071.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T11:11:10.055 INFO:tasks.workunit.client.0.smithi071.stderr:+ '[' -n '' ']' 2024-09-14T11:11:10.055 INFO:tasks.workunit.client.0.smithi071.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:11:10.055 INFO:tasks.workunit.client.0.smithi071.stderr:+ hash -r 2024-09-14T11:11:10.055 INFO:tasks.workunit.client.0.smithi071.stderr:+ '[' -n '' ']' 2024-09-14T11:11:10.056 INFO:tasks.workunit.client.0.smithi071.stderr:+ unset VIRTUAL_ENV 2024-09-14T11:11:10.056 INFO:tasks.workunit.client.0.smithi071.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-14T11:11:10.056 INFO:tasks.workunit.client.0.smithi071.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T11:11:10.056 INFO:tasks.workunit.client.0.smithi071.stderr:+ unset -f deactivate 2024-09-14T11:11:10.056 INFO:tasks.workunit.client.0.smithi071.stderr:+ echo OK. 2024-09-14T11:11:10.057 INFO:tasks.workunit.client.0.smithi071.stdout:OK. 2024-09-14T11:11:10.057 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:11:10.057 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:11:10.113 INFO:tasks.workunit:Stopping ['rgw/run-datacache.sh'] on client.0... 2024-09-14T11:11:10.113 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:11:10.462 DEBUG:teuthology.parallel:result is None 2024-09-14T11:11:10.463 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:11:10.474 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:11:10.474 DEBUG:teuthology.orchestra.run.smithi071:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:11:10.581 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:11:10.582 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:11:10.591 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:11:10.592 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:11:10.592 DEBUG:teuthology.orchestra.run.smithi071:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:11:10.597 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:11:10.598 INFO:teuthology.orchestra.run.smithi071.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:11:10.598 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:11:10.645 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:11:10.645 DEBUG:teuthology.orchestra.run.smithi071:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:11:10.693 INFO:tasks.workunit:timeout=3h 2024-09-14T11:11:10.694 INFO:tasks.workunit:cleanup=True 2024-09-14T11:11:10.694 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:11:10.743 INFO:tasks.workunit.client.0.smithi071.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:12:05.224 INFO:tasks.workunit.client.0.smithi071.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:12:05.225 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:12:05.225 INFO:tasks.workunit.client.0.smithi071.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:12:05.225 INFO:tasks.workunit.client.0.smithi071.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:12:05.225 INFO:tasks.workunit.client.0.smithi071.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:12:05.225 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:12:05.225 INFO:tasks.workunit.client.0.smithi071.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:12:05.225 INFO:tasks.workunit.client.0.smithi071.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:12:05.225 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:12:05.225 INFO:tasks.workunit.client.0.smithi071.stderr: git switch -c 2024-09-14T11:12:05.225 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:12:05.225 INFO:tasks.workunit.client.0.smithi071.stderr:Or undo this operation with: 2024-09-14T11:12:05.226 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:12:05.226 INFO:tasks.workunit.client.0.smithi071.stderr: git switch - 2024-09-14T11:12:05.226 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:12:05.226 INFO:tasks.workunit.client.0.smithi071.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:12:05.226 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:12:05.226 INFO:tasks.workunit.client.0.smithi071.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:12:05.226 DEBUG:teuthology.orchestra.run.smithi071:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:12:05.271 INFO:tasks.workunit.client.0.smithi071.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:12:05.274 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:12:05.274 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:12:05.334 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:12:05.389 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:12:05.433 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:12:05.434 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:12:05.434 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:12:05.478 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:12:05.482 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T11:12:05.482 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:12:05.530 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-14T11:12:05.531 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-14T11:12:05.532 DEBUG:teuthology.orchestra.run.smithi071:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-14T11:12:05.583 INFO:tasks.workunit.client.0.smithi071.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-14T11:12:05.583 INFO:tasks.workunit.client.0.smithi071.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:12:05.584 INFO:tasks.workunit.client.0.smithi071.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:12:08.495 INFO:tasks.workunit.client.0.smithi071.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T11:12:08.495 INFO:tasks.workunit.client.0.smithi071.stderr:++ deactivate nondestructive 2024-09-14T11:12:08.495 INFO:tasks.workunit.client.0.smithi071.stderr:++ '[' -n '' ']' 2024-09-14T11:12:08.495 INFO:tasks.workunit.client.0.smithi071.stderr:++ '[' -n '' ']' 2024-09-14T11:12:08.495 INFO:tasks.workunit.client.0.smithi071.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:12:08.496 INFO:tasks.workunit.client.0.smithi071.stderr:++ hash -r 2024-09-14T11:12:08.496 INFO:tasks.workunit.client.0.smithi071.stderr:++ '[' -n '' ']' 2024-09-14T11:12:08.496 INFO:tasks.workunit.client.0.smithi071.stderr:++ unset VIRTUAL_ENV 2024-09-14T11:12:08.496 INFO:tasks.workunit.client.0.smithi071.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-14T11:12:08.496 INFO:tasks.workunit.client.0.smithi071.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T11:12:08.496 INFO:tasks.workunit.client.0.smithi071.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:12:08.496 INFO:tasks.workunit.client.0.smithi071.stderr:++ export VIRTUAL_ENV 2024-09-14T11:12:08.496 INFO:tasks.workunit.client.0.smithi071.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T11:12:08.496 INFO:tasks.workunit.client.0.smithi071.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T11:12:08.496 INFO:tasks.workunit.client.0.smithi071.stderr:++ export PATH 2024-09-14T11:12:08.496 INFO:tasks.workunit.client.0.smithi071.stderr:++ '[' -n '' ']' 2024-09-14T11:12:08.496 INFO:tasks.workunit.client.0.smithi071.stderr:++ '[' -z '' ']' 2024-09-14T11:12:08.496 INFO:tasks.workunit.client.0.smithi071.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T11:12:08.497 INFO:tasks.workunit.client.0.smithi071.stderr:++ PS1='(rgw) ' 2024-09-14T11:12:08.497 INFO:tasks.workunit.client.0.smithi071.stderr:++ export PS1 2024-09-14T11:12:08.497 INFO:tasks.workunit.client.0.smithi071.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-14T11:12:08.497 INFO:tasks.workunit.client.0.smithi071.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-14T11:12:08.497 INFO:tasks.workunit.client.0.smithi071.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:12:08.497 INFO:tasks.workunit.client.0.smithi071.stderr:++ hash -r 2024-09-14T11:12:08.497 INFO:tasks.workunit.client.0.smithi071.stderr:+ pip install pip --upgrade 2024-09-14T11:12:08.890 INFO:tasks.workunit.client.0.smithi071.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-14T11:12:09.094 INFO:tasks.workunit.client.0.smithi071.stdout:Collecting pip 2024-09-14T11:12:09.100 INFO:tasks.workunit.client.0.smithi071.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:12:09.134 INFO:tasks.workunit.client.0.smithi071.stdout:Installing collected packages: pip 2024-09-14T11:12:09.134 INFO:tasks.workunit.client.0.smithi071.stdout: Attempting uninstall: pip 2024-09-14T11:12:09.135 INFO:tasks.workunit.client.0.smithi071.stdout: Found existing installation: pip 22.0.2 2024-09-14T11:12:09.393 INFO:tasks.workunit.client.0.smithi071.stdout: Uninstalling pip-22.0.2: 2024-09-14T11:12:09.400 INFO:tasks.workunit.client.0.smithi071.stdout: Successfully uninstalled pip-22.0.2 2024-09-14T11:12:10.427 INFO:tasks.workunit.client.0.smithi071.stdout:Successfully installed pip-24.2 2024-09-14T11:12:10.497 INFO:tasks.workunit.client.0.smithi071.stderr:+ pip install boto3 2024-09-14T11:12:11.496 INFO:tasks.workunit.client.0.smithi071.stdout:Collecting boto3 2024-09-14T11:12:11.540 INFO:tasks.workunit.client.0.smithi071.stdout: Downloading boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:12:12.165 INFO:tasks.workunit.client.0.smithi071.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:12:12.180 INFO:tasks.workunit.client.0.smithi071.stdout: Downloading botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:12:12.277 INFO:tasks.workunit.client.0.smithi071.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:12:12.291 INFO:tasks.workunit.client.0.smithi071.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:12:12.455 INFO:tasks.workunit.client.0.smithi071.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:12:12.471 INFO:tasks.workunit.client.0.smithi071.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:12:12.628 INFO:tasks.workunit.client.0.smithi071.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:12:12.644 INFO:tasks.workunit.client.0.smithi071.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:12:12.873 INFO:tasks.workunit.client.0.smithi071.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:12:12.888 INFO:tasks.workunit.client.0.smithi071.stdout: Downloading urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-14T11:12:13.141 INFO:tasks.workunit.client.0.smithi071.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:12:13.143 INFO:tasks.workunit.client.0.smithi071.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:12:13.159 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:12:13.250 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:12:13.486 INFO:tasks.workunit.client.0.smithi071.stdout: ---------------------------------------- 12.5/12.5 MB 56.1 MB/s eta 0:00:00 2024-09-14T11:12:13.503 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:12:13.567 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:12:13.636 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:12:13.691 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-14T11:12:13.740 INFO:tasks.workunit.client.0.smithi071.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:12:13.862 INFO:tasks.workunit.client.0.smithi071.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:12:14.998 INFO:tasks.workunit.client.0.smithi071.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-14T11:12:15.205 INFO:tasks.workunit.client.0.smithi071.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-14T11:12:15.356 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-14T11:12:15.395 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:15.395 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:15.439 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.438+0000 7f7a686b39c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:15.441 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.438+0000 7f7a686b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:15.441 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.438+0000 7f7a686b39c0 20 realm 2024-09-14T11:12:15.441 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.438+0000 7f7a686b39c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:15.442 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.442+0000 7f7a686b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:15.442 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.442+0000 7f7a686b39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:15.442 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.442+0000 7f7a686b39c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:15.443 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.442+0000 7f7a686b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:15.443 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.442+0000 7f7a686b39c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:15.443 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.442+0000 7f7a686b39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:15.443 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.442+0000 7f7a686b39c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:15.444 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.442+0000 7f7a686b39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:15.444 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.442+0000 7f7a686b39c0 20 searching for the correct realm 2024-09-14T11:12:15.446 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.446+0000 7f7a659b8640 0 -- 172.21.15.71:0/568214461 >> [v2:172.21.15.71:6824/2436891866,v1:172.21.15.71:6825/2436891866] conn(0x7f7a58008070 msgr2=0x7f7a5802b960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:15.453 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.450+0000 7f7a661b9640 0 -- 172.21.15.71:0/568214461 >> [v2:172.21.15.157:6816/1231501119,v1:172.21.15.157:6817/1231501119] conn(0x560452b902e0 msgr2=0x560452b927a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:15.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.462+0000 7f7a686b39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:15.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.462+0000 7f7a686b39c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:12:15.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.462+0000 7f7a686b39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:15.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.462+0000 7f7a686b39c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:12:15.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.462+0000 7f7a686b39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:15.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.462+0000 7f7a686b39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:15.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.462+0000 7f7a686b39c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:15.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.462+0000 7f7a686b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:15.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.462+0000 7f7a686b39c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:15.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.462+0000 7f7a686b39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:15.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.462+0000 7f7a686b39c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:15.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.462+0000 7f7a686b39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:15.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.466+0000 7f7a686b39c0 20 zone default found 2024-09-14T11:12:15.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.466+0000 7f7a686b39c0 4 Realm: () 2024-09-14T11:12:15.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.466+0000 7f7a686b39c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:12:15.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.466+0000 7f7a686b39c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:12:15.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.466+0000 7f7a686b39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:15.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.466+0000 7f7a686b39c0 20 zonegroup default 2024-09-14T11:12:15.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.466+0000 7f7a686b39c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:15.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.466+0000 7f7a686b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:15.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.466+0000 7f7a686b39c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:15.468 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.466+0000 7f7a686b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:15.468 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.466+0000 7f7a686b39c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:15.468 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.466+0000 7f7a686b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:15.468 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.466+0000 7f7a686b39c0 20 started sync module instance, tier type = 2024-09-14T11:12:15.468 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.466+0000 7f7a686b39c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:12:15.487 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.486+0000 7f7a686b39c0 20 add_watcher() i=0 2024-09-14T11:12:15.487 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.486+0000 7f7a686b39c0 20 add_watcher() i=1 2024-09-14T11:12:15.487 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.486+0000 7f7a686b39c0 20 add_watcher() i=2 2024-09-14T11:12:15.487 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.486+0000 7f7a686b39c0 20 add_watcher() i=3 2024-09-14T11:12:15.487 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.486+0000 7f7a686b39c0 20 add_watcher() i=4 2024-09-14T11:12:15.488 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.486+0000 7f7a686b39c0 20 add_watcher() i=5 2024-09-14T11:12:15.488 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.486+0000 7f7a686b39c0 20 add_watcher() i=6 2024-09-14T11:12:15.490 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.486+0000 7f7a686b39c0 20 add_watcher() i=7 2024-09-14T11:12:15.490 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.486+0000 7f7a686b39c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:15.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.490+0000 7f791cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:15.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.494+0000 7f7a686b39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:15.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.494+0000 7f7a686b39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:15.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.494+0000 7f7a686b39c0 5 note: GC not initialized 2024-09-14T11:12:15.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.494+0000 7f78977fe640 20 reqs_thread_entry: start 2024-09-14T11:12:15.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.494+0000 7f7a686b39c0 20 init_complete bucket index max shards: 11 2024-09-14T11:12:15.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.494+0000 7f7a686b39c0 20 Filter name: none 2024-09-14T11:12:15.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.494+0000 7f78957fa640 20 reqs_thread_entry: start 2024-09-14T11:12:15.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.494+0000 7f7a686b39c0 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-14T11:12:15.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.494+0000 7f7a686b39c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:15.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.494+0000 7f7a686b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:15.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.494+0000 7f7a686b39c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-14T11:12:15.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.494+0000 7f7a686b39c0 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T11:12:15.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.494+0000 7f7a686b39c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-14T11:12:15.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.494+0000 7f7a686b39c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:15.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.494+0000 7f7a686b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:15.497 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.494+0000 7f7a686b39c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-14T11:12:15.497 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.494+0000 7f7a686b39c0 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T11:12:15.497 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.494+0000 7f7a686b39c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-14T11:12:15.497 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.494+0000 7f7a686b39c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-14T11:12:15.497 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.494+0000 7f7a686b39c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-14T11:12:15.497 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.494+0000 7f7a686b39c0 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T11:12:15.498 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.494+0000 7f7a686b39c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-14T11:12:15.498 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.494+0000 7f7949ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789953 cookie 94576567781792 notifier 4650 bl.length()=593 2024-09-14T11:12:15.498 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.494+0000 7f7949ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-14T11:12:15.498 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.494+0000 7f7949ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T11:12:15.501 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.498+0000 7f7a686b39c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-14T11:12:15.501 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.498+0000 7f7a686b39c0 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T11:12:15.501 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.498+0000 7f7a686b39c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-14T11:12:15.501 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.498+0000 7f7949ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789952 cookie 94576567720496 notifier 4650 bl.length()=186 2024-09-14T11:12:15.501 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.498+0000 7f7949ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-14T11:12:15.501 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.498+0000 7f7949ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T11:12:15.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.502+0000 7f791cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:15.506 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.506+0000 7f7a686b39c0 20 remove_watcher() i=0 2024-09-14T11:12:15.507 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.506+0000 7f7a686b39c0 2 removed watcher, disabling cache 2024-09-14T11:12:15.509 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.506+0000 7f7a686b39c0 20 remove_watcher() i=1 2024-09-14T11:12:15.511 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.510+0000 7f7a686b39c0 20 remove_watcher() i=2 2024-09-14T11:12:15.513 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.510+0000 7f7a686b39c0 20 remove_watcher() i=3 2024-09-14T11:12:15.515 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.514+0000 7f7a686b39c0 20 remove_watcher() i=4 2024-09-14T11:12:15.518 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.518+0000 7f7a686b39c0 20 remove_watcher() i=5 2024-09-14T11:12:15.521 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.518+0000 7f7a686b39c0 20 remove_watcher() i=6 2024-09-14T11:12:15.523 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:15.522+0000 7f7a686b39c0 20 remove_watcher() i=7 2024-09-14T11:12:15.959 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: recalculated bucket check stats are correct 2024-09-14T11:12:15.959 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:12:15.960 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-14T11:12:15.992 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:15.993 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:16.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.034+0000 7f9fdf8439c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.040 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.038+0000 7f9fdf8439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:16.040 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.038+0000 7f9fdf8439c0 20 realm 2024-09-14T11:12:16.040 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.038+0000 7f9fdf8439c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.040 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.038+0000 7f9fdf8439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:16.040 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.038+0000 7f9fdf8439c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:16.041 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.038+0000 7f9fdf8439c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.041 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.038+0000 7f9fdf8439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:16.041 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.038+0000 7f9fdf8439c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.041 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.038+0000 7f9fdf8439c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:16.041 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.038+0000 7f9fdf8439c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.042 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.042+0000 7f9fdf8439c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:16.042 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.042+0000 7f9fdf8439c0 20 searching for the correct realm 2024-09-14T11:12:16.047 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.046+0000 7f9fdd349640 0 -- 172.21.15.71:0/354939313 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x5593d27d3ff0 msgr2=0x5593d27d64b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:16.053 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.050+0000 7f9fdcb48640 0 -- 172.21.15.71:0/354939313 >> [v2:172.21.15.157:6800/3420822707,v1:172.21.15.157:6801/3420822707] conn(0x7f9fd4078b30 msgr2=0x7f9fd404dfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:12:16.274 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.270+0000 7f9fdf8439c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:16.274 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.270+0000 7f9fdf8439c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:12:16.274 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.270+0000 7f9fdf8439c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:16.274 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.270+0000 7f9fdf8439c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:12:16.274 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.270+0000 7f9fdf8439c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:16.274 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.270+0000 7f9fdf8439c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:16.274 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.270+0000 7f9fdf8439c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.275 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.274+0000 7f9fdf8439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:16.275 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.274+0000 7f9fdf8439c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.275 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.274+0000 7f9fdf8439c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:16.275 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.274+0000 7f9fdf8439c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.276 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.274+0000 7f9fdf8439c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:16.276 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.274+0000 7f9fdf8439c0 20 zone default found 2024-09-14T11:12:16.276 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.274+0000 7f9fdf8439c0 4 Realm: () 2024-09-14T11:12:16.276 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.274+0000 7f9fdf8439c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:12:16.276 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.274+0000 7f9fdf8439c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:12:16.276 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.274+0000 7f9fdf8439c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:16.276 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.274+0000 7f9fdf8439c0 20 zonegroup default 2024-09-14T11:12:16.277 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.274+0000 7f9fdf8439c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.277 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.274+0000 7f9fdf8439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:16.277 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.274+0000 7f9fdf8439c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.278 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.274+0000 7f9fdf8439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:16.278 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.274+0000 7f9fdf8439c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.278 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.278+0000 7f9fdf8439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:16.278 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.278+0000 7f9fdf8439c0 20 started sync module instance, tier type = 2024-09-14T11:12:16.278 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.278+0000 7f9fdf8439c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:12:16.302 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.298+0000 7f9fdf8439c0 20 add_watcher() i=0 2024-09-14T11:12:16.302 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.298+0000 7f9fdf8439c0 20 add_watcher() i=1 2024-09-14T11:12:16.302 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.298+0000 7f9fdf8439c0 20 add_watcher() i=2 2024-09-14T11:12:16.302 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.298+0000 7f9fdf8439c0 20 add_watcher() i=3 2024-09-14T11:12:16.302 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.298+0000 7f9fdf8439c0 20 add_watcher() i=4 2024-09-14T11:12:16.302 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.298+0000 7f9fdf8439c0 20 add_watcher() i=5 2024-09-14T11:12:16.302 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.298+0000 7f9fdf8439c0 20 add_watcher() i=6 2024-09-14T11:12:16.304 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.302+0000 7f9fdf8439c0 20 add_watcher() i=7 2024-09-14T11:12:16.305 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.302+0000 7f9fdf8439c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:16.309 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.306+0000 7f9e937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:16.310 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.310+0000 7f9fdf8439c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:16.310 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.310+0000 7f9fdf8439c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:16.310 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.310+0000 7f9fdf8439c0 5 note: GC not initialized 2024-09-14T11:12:16.311 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.310+0000 7f9e927e4640 20 reqs_thread_entry: start 2024-09-14T11:12:16.311 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.310+0000 7f9fdf8439c0 20 init_complete bucket index max shards: 11 2024-09-14T11:12:16.311 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.310+0000 7f9fdf8439c0 20 Filter name: none 2024-09-14T11:12:16.311 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.310+0000 7f9e03fff640 20 reqs_thread_entry: start 2024-09-14T11:12:16.311 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.310+0000 7f9fdf8439c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:12:16.311 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.310+0000 7f9fdf8439c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.312 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.310+0000 7f9fdf8439c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:12:16.313 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.310+0000 7f9fdf8439c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:12:16.313 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.310+0000 7f9fdf8439c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:12:16.313 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.310+0000 7f9fdf8439c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 : miss 2024-09-14T11:12:16.313 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.310+0000 7f9fdf8439c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.314 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.310+0000 7f9fdf8439c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:12:16.314 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.310+0000 7f9fdf8439c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 info.flags=0x17 2024-09-14T11:12:16.314 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.310+0000 7f9fdf8439c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 to cache LRU end 2024-09-14T11:12:16.314 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.310+0000 7f9fdf8439c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:12:16.314 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.310+0000 7f9fdf8439c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:12:16.314 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.310+0000 7f9fdf8439c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 2024-09-14T11:12:16.314 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.314+0000 7f9fdf8439c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.0 2024-09-14T11:12:16.315 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.314+0000 7f9fdf8439c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.1 2024-09-14T11:12:16.315 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.314+0000 7f9fdf8439c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.2 2024-09-14T11:12:16.316 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.314+0000 7f9fdf8439c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.3 2024-09-14T11:12:16.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.318+0000 7f9fdf8439c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.4 2024-09-14T11:12:16.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.318+0000 7f9fdf8439c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:16.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.318+0000 7f9fdf8439c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.6 2024-09-14T11:12:16.321 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.318+0000 7f9fdf8439c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.7 2024-09-14T11:12:16.322 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.322+0000 7f9fdf8439c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:16.322 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.322+0000 7f9fdf8439c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.9 2024-09-14T11:12:16.324 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.322+0000 7f9fdf8439c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.10 2024-09-14T11:12:16.334 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.334+0000 7f9e937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:16.339 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.338+0000 7f9fdf8439c0 20 remove_watcher() i=0 2024-09-14T11:12:16.339 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.338+0000 7f9fdf8439c0 2 removed watcher, disabling cache 2024-09-14T11:12:16.341 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.338+0000 7f9fdf8439c0 20 remove_watcher() i=1 2024-09-14T11:12:16.343 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.342+0000 7f9fdf8439c0 20 remove_watcher() i=2 2024-09-14T11:12:16.348 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.342+0000 7f9fdf8439c0 20 remove_watcher() i=3 2024-09-14T11:12:16.348 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.346+0000 7f9fdf8439c0 20 remove_watcher() i=4 2024-09-14T11:12:16.350 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.350+0000 7f9fdf8439c0 20 remove_watcher() i=5 2024-09-14T11:12:16.353 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.350+0000 7f9fdf8439c0 20 remove_watcher() i=6 2024-09-14T11:12:16.355 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.354+0000 7f9fdf8439c0 20 remove_watcher() i=7 2024-09-14T11:12:16.372 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-14T11:12:16.401 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:16.401 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:16.447 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.446+0000 7f06b0c619c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.449 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.446+0000 7f06b0c619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:16.450 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.446+0000 7f06b0c619c0 20 realm 2024-09-14T11:12:16.450 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.446+0000 7f06b0c619c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.450 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.450+0000 7f06b0c619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:16.450 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.450+0000 7f06b0c619c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:16.451 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.450+0000 7f06b0c619c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.451 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.450+0000 7f06b0c619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:16.451 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.450+0000 7f06b0c619c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.451 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.450+0000 7f06b0c619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:16.451 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.450+0000 7f06b0c619c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.452 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.450+0000 7f06b0c619c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:16.452 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.450+0000 7f06b0c619c0 20 searching for the correct realm 2024-09-14T11:12:16.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.454+0000 7f06ae767640 0 -- 172.21.15.71:0/3676735041 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x56270de752f0 msgr2=0x56270de77790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:12:16.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.462+0000 7f06aef68640 0 -- 172.21.15.71:0/3676735041 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x56270de70590 msgr2=0x56270de72980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:12:16.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.470+0000 7f06b0c619c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:16.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.470+0000 7f06b0c619c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:12:16.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.470+0000 7f06b0c619c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:16.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.470+0000 7f06b0c619c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:12:16.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.470+0000 7f06b0c619c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:16.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.470+0000 7f06b0c619c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:16.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.470+0000 7f06b0c619c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.470+0000 7f06b0c619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:16.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.470+0000 7f06b0c619c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.470+0000 7f06b0c619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:16.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.470+0000 7f06b0c619c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.474+0000 7f06b0c619c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:16.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.474+0000 7f06b0c619c0 20 zone default found 2024-09-14T11:12:16.475 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.474+0000 7f06b0c619c0 4 Realm: () 2024-09-14T11:12:16.475 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.474+0000 7f06b0c619c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:12:16.475 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.474+0000 7f06b0c619c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:12:16.475 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.474+0000 7f06b0c619c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:16.475 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.474+0000 7f06b0c619c0 20 zonegroup default 2024-09-14T11:12:16.475 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.474+0000 7f06b0c619c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.474+0000 7f06b0c619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:16.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.474+0000 7f06b0c619c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.474+0000 7f06b0c619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:16.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.474+0000 7f06b0c619c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.474+0000 7f06b0c619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:16.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.474+0000 7f06b0c619c0 20 started sync module instance, tier type = 2024-09-14T11:12:16.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.474+0000 7f06b0c619c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:12:16.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.494+0000 7f06b0c619c0 20 add_watcher() i=0 2024-09-14T11:12:16.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.494+0000 7f06b0c619c0 20 add_watcher() i=1 2024-09-14T11:12:16.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.494+0000 7f06b0c619c0 20 add_watcher() i=2 2024-09-14T11:12:16.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.494+0000 7f06b0c619c0 20 add_watcher() i=3 2024-09-14T11:12:16.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.494+0000 7f06b0c619c0 20 add_watcher() i=4 2024-09-14T11:12:16.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.494+0000 7f06b0c619c0 20 add_watcher() i=5 2024-09-14T11:12:16.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.494+0000 7f06b0c619c0 20 add_watcher() i=6 2024-09-14T11:12:16.499 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.498+0000 7f06b0c619c0 20 add_watcher() i=7 2024-09-14T11:12:16.499 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.498+0000 7f06b0c619c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:16.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.502+0000 7f0564fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:16.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.502+0000 7f06b0c619c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:16.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.502+0000 7f06b0c619c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:16.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.502+0000 7f06b0c619c0 5 note: GC not initialized 2024-09-14T11:12:16.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.502+0000 7f04df7fe640 20 reqs_thread_entry: start 2024-09-14T11:12:16.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.502+0000 7f06b0c619c0 20 init_complete bucket index max shards: 11 2024-09-14T11:12:16.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.502+0000 7f06b0c619c0 20 Filter name: none 2024-09-14T11:12:16.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.502+0000 7f04dd7fa640 20 reqs_thread_entry: start 2024-09-14T11:12:16.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.502+0000 7f06b0c619c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.504 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.502+0000 7f06b0c619c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:12:16.504 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.502+0000 7f06b0c619c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.504 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.502+0000 7f06b0c619c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:12:16.504 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.502+0000 7f06b0c619c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:12:16.505 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.502+0000 7f06b0c619c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.505 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.502+0000 7f06b0c619c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:12:16.505 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.502+0000 7f06b0c619c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.506 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.506+0000 7f06b0c619c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:12:16.506 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.506+0000 7f06b0c619c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:12:16.508 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.506+0000 7f0564fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:16.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.510+0000 7f06b0c619c0 20 remove_watcher() i=0 2024-09-14T11:12:16.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.510+0000 7f06b0c619c0 2 removed watcher, disabling cache 2024-09-14T11:12:16.514 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.514+0000 7f06b0c619c0 20 remove_watcher() i=1 2024-09-14T11:12:16.516 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.514+0000 7f06b0c619c0 20 remove_watcher() i=2 2024-09-14T11:12:16.518 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.518+0000 7f06b0c619c0 20 remove_watcher() i=3 2024-09-14T11:12:16.521 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.518+0000 7f06b0c619c0 20 remove_watcher() i=4 2024-09-14T11:12:16.523 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.522+0000 7f06b0c619c0 20 remove_watcher() i=5 2024-09-14T11:12:16.525 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.522+0000 7f06b0c619c0 20 remove_watcher() i=6 2024-09-14T11:12:16.528 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.526+0000 7f06b0c619c0 20 remove_watcher() i=7 2024-09-14T11:12:16.542 INFO:tasks.workunit.client.0.smithi071.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 79, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-14T11:12:16.542 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-14T11:12:16.543 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:12:16.543 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T11:12:16.575 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:16.575 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:16.619 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.618+0000 7ffb18e559c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.621 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.618+0000 7ffb18e559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:16.621 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.618+0000 7ffb18e559c0 20 realm 2024-09-14T11:12:16.621 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.618+0000 7ffb18e559c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.622 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.622+0000 7ffb18e559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:16.622 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.622+0000 7ffb18e559c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:16.622 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.622+0000 7ffb18e559c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.622 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.622+0000 7ffb18e559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:16.622 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.622+0000 7ffb18e559c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.623 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.622+0000 7ffb18e559c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:16.623 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.622+0000 7ffb18e559c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.624 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.622+0000 7ffb18e559c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:16.624 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.622+0000 7ffb18e559c0 20 searching for the correct realm 2024-09-14T11:12:16.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.626+0000 7ffb1695b640 0 -- 172.21.15.71:0/606805769 >> [v2:172.21.15.157:6808/527702018,v1:172.21.15.157:6809/527702018] conn(0x7ffb10004040 msgr2=0x7ffb1006d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:16.844 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.842+0000 7ffb1695b640 0 -- 172.21.15.71:0/606805769 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x55c61ea12110 msgr2=0x55c61ea145d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:16.853 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.850+0000 7ffb18e559c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:16.853 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.850+0000 7ffb18e559c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:12:16.853 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.850+0000 7ffb18e559c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:16.854 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.850+0000 7ffb18e559c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:12:16.854 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.850+0000 7ffb18e559c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:16.854 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.850+0000 7ffb18e559c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:16.854 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.850+0000 7ffb18e559c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.856 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.850+0000 7ffb18e559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:16.856 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.850+0000 7ffb18e559c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.856 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.854+0000 7ffb18e559c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:16.857 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.854+0000 7ffb18e559c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.857 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.854+0000 7ffb18e559c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:16.857 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.854+0000 7ffb18e559c0 20 zone default found 2024-09-14T11:12:16.857 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.854+0000 7ffb18e559c0 4 Realm: () 2024-09-14T11:12:16.857 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.854+0000 7ffb18e559c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:12:16.857 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.854+0000 7ffb18e559c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:12:16.858 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.854+0000 7ffb18e559c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:16.858 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.854+0000 7ffb18e559c0 20 zonegroup default 2024-09-14T11:12:16.858 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.854+0000 7ffb18e559c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.858 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.854+0000 7ffb18e559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:16.858 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.854+0000 7ffb18e559c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.859 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.854+0000 7ffb18e559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:16.859 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.854+0000 7ffb18e559c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.859 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.854+0000 7ffb18e559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:16.860 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.854+0000 7ffb18e559c0 20 started sync module instance, tier type = 2024-09-14T11:12:16.860 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.854+0000 7ffb18e559c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:12:16.880 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.878+0000 7ffb18e559c0 20 add_watcher() i=0 2024-09-14T11:12:16.881 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.878+0000 7ffb18e559c0 20 add_watcher() i=1 2024-09-14T11:12:16.881 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.878+0000 7ffb18e559c0 20 add_watcher() i=2 2024-09-14T11:12:16.881 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.878+0000 7ffb18e559c0 20 add_watcher() i=3 2024-09-14T11:12:16.881 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.878+0000 7ffb18e559c0 20 add_watcher() i=4 2024-09-14T11:12:16.881 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.878+0000 7ffb18e559c0 20 add_watcher() i=5 2024-09-14T11:12:16.882 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.878+0000 7ffb18e559c0 20 add_watcher() i=6 2024-09-14T11:12:16.883 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.882+0000 7ffb18e559c0 20 add_watcher() i=7 2024-09-14T11:12:16.883 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.882+0000 7ffb18e559c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:16.887 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.886+0000 7ff9cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:16.888 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.886+0000 7ffb18e559c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:16.888 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.886+0000 7ffb18e559c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:16.888 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.886+0000 7ffb18e559c0 5 note: GC not initialized 2024-09-14T11:12:16.890 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.886+0000 7ff947fff640 20 reqs_thread_entry: start 2024-09-14T11:12:16.890 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.886+0000 7ffb18e559c0 20 init_complete bucket index max shards: 11 2024-09-14T11:12:16.890 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.886+0000 7ffb18e559c0 20 Filter name: none 2024-09-14T11:12:16.890 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.886+0000 7ff945ffb640 20 reqs_thread_entry: start 2024-09-14T11:12:16.890 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.886+0000 7ffb18e559c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:12:16.891 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.886+0000 7ffb18e559c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.893 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.890+0000 7ffb18e559c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:12:16.893 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.890+0000 7ffb18e559c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:12:16.893 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.890+0000 7ffb18e559c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:12:16.893 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.890+0000 7ffb18e559c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 : miss 2024-09-14T11:12:16.893 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.890+0000 7ffb18e559c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:16.894 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.890+0000 7ffb18e559c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:12:16.894 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.890+0000 7ffb18e559c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 info.flags=0x17 2024-09-14T11:12:16.894 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.890+0000 7ffb18e559c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 to cache LRU end 2024-09-14T11:12:16.894 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.890+0000 7ffb18e559c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:12:16.894 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.890+0000 7ffb18e559c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:12:16.894 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.890+0000 7ffb18e559c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 2024-09-14T11:12:16.895 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.890+0000 7ffb18e559c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.0 2024-09-14T11:12:16.895 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.890+0000 7ffb18e559c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:12:16.895 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.890+0000 7ffb18e559c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.1 2024-09-14T11:12:16.896 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.890+0000 7ffb18e559c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:12:16.896 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.890+0000 7ffb18e559c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.2 2024-09-14T11:12:16.897 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.894+0000 7ffb18e559c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:12:16.897 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.894+0000 7ffb18e559c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.3 2024-09-14T11:12:16.897 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.894+0000 7ffb18e559c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:12:16.897 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.894+0000 7ffb18e559c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.4 2024-09-14T11:12:16.897 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.894+0000 7ffb18e559c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:12:16.898 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.894+0000 7ffb18e559c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:16.899 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.894+0000 7ffb18e559c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T11:12:16.899 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.894+0000 7ffb18e559c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.6 2024-09-14T11:12:16.899 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.898+0000 7ffb18e559c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:12:16.899 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.898+0000 7ffb18e559c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.7 2024-09-14T11:12:16.899 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.898+0000 7ffb18e559c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:12:16.900 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.898+0000 7ffb18e559c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:16.901 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.898+0000 7ffb18e559c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T11:12:16.901 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.898+0000 7ffb18e559c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.9 2024-09-14T11:12:16.901 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.898+0000 7ffb18e559c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:12:16.901 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.898+0000 7ffb18e559c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.10 2024-09-14T11:12:16.902 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.898+0000 7ffb18e559c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:12:16.902 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.898+0000 7ffb18e559c0 1 NOTICE: finished all shards (0 entries found) 2024-09-14T11:12:16.903 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.902+0000 7ff9cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:16.908 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.906+0000 7ffb18e559c0 20 remove_watcher() i=0 2024-09-14T11:12:16.908 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.906+0000 7ffb18e559c0 2 removed watcher, disabling cache 2024-09-14T11:12:16.910 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.910+0000 7ffb18e559c0 20 remove_watcher() i=1 2024-09-14T11:12:16.912 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.910+0000 7ffb18e559c0 20 remove_watcher() i=2 2024-09-14T11:12:16.915 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.914+0000 7ffb18e559c0 20 remove_watcher() i=3 2024-09-14T11:12:16.917 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.914+0000 7ffb18e559c0 20 remove_watcher() i=4 2024-09-14T11:12:16.919 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.918+0000 7ffb18e559c0 20 remove_watcher() i=5 2024-09-14T11:12:16.922 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.922+0000 7ffb18e559c0 20 remove_watcher() i=6 2024-09-14T11:12:16.925 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:16.922+0000 7ffb18e559c0 20 remove_watcher() i=7 2024-09-14T11:12:16.947 INFO:tasks.workunit.client.0.smithi071.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:12:17.391 INFO:tasks.workunit.client.0.smithi071.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T11:12:18.883 INFO:tasks.workunit.client.0.smithi071.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:12:18.883 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T11:12:18.919 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:18.920 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:18.965 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.962+0000 7f2f090819c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:18.968 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.966+0000 7f2f090819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:18.968 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.966+0000 7f2f090819c0 20 realm 2024-09-14T11:12:18.968 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.966+0000 7f2f090819c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:18.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.966+0000 7f2f090819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:18.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.966+0000 7f2f090819c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:18.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.966+0000 7f2f090819c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:18.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.966+0000 7f2f090819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:18.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.966+0000 7f2f090819c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:18.971 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.970+0000 7f2f090819c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:18.971 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.970+0000 7f2f090819c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:18.972 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.970+0000 7f2f090819c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:18.972 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.970+0000 7f2f090819c0 20 searching for the correct realm 2024-09-14T11:12:18.975 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.974+0000 7f2f07388640 0 -- 172.21.15.71:0/3139641134 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f2efc08f040 msgr2=0x7f2efc05db00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:18.981 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.978+0000 7f2f07388640 0 -- 172.21.15.71:0/3139641134 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55f75253e3b0 msgr2=0x55f7525407a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:12:18.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.990+0000 7f2f090819c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:18.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.990+0000 7f2f090819c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:12:18.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.990+0000 7f2f090819c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:18.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.990+0000 7f2f090819c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:12:18.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.990+0000 7f2f090819c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:18.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.990+0000 7f2f090819c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:18.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.990+0000 7f2f090819c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:18.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.990+0000 7f2f090819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:18.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.990+0000 7f2f090819c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:18.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.990+0000 7f2f090819c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:18.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.990+0000 7f2f090819c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:18.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.990+0000 7f2f090819c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:18.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.990+0000 7f2f090819c0 20 zone default found 2024-09-14T11:12:18.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.990+0000 7f2f090819c0 4 Realm: () 2024-09-14T11:12:18.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.990+0000 7f2f090819c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:12:18.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.990+0000 7f2f090819c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:12:18.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.990+0000 7f2f090819c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:18.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.990+0000 7f2f090819c0 20 zonegroup default 2024-09-14T11:12:18.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.990+0000 7f2f090819c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:18.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.990+0000 7f2f090819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:18.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.990+0000 7f2f090819c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:18.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.990+0000 7f2f090819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:18.995 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.990+0000 7f2f090819c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:18.995 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.994+0000 7f2f090819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:18.995 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.994+0000 7f2f090819c0 20 started sync module instance, tier type = 2024-09-14T11:12:18.995 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:18.994+0000 7f2f090819c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:12:19.014 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.010+0000 7f2f090819c0 20 add_watcher() i=0 2024-09-14T11:12:19.014 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.010+0000 7f2f090819c0 20 add_watcher() i=1 2024-09-14T11:12:19.014 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.010+0000 7f2f090819c0 20 add_watcher() i=2 2024-09-14T11:12:19.014 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.010+0000 7f2f090819c0 20 add_watcher() i=3 2024-09-14T11:12:19.014 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.010+0000 7f2f090819c0 20 add_watcher() i=4 2024-09-14T11:12:19.014 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.010+0000 7f2f090819c0 20 add_watcher() i=5 2024-09-14T11:12:19.014 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.010+0000 7f2f090819c0 20 add_watcher() i=6 2024-09-14T11:12:19.016 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.014+0000 7f2f090819c0 20 add_watcher() i=7 2024-09-14T11:12:19.016 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.014+0000 7f2f090819c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:19.019 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.018+0000 7f2dbd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:19.020 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.018+0000 7f2f090819c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:19.021 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.018+0000 7f2f090819c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:19.021 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.018+0000 7f2f090819c0 5 note: GC not initialized 2024-09-14T11:12:19.021 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.018+0000 7f2d37fff640 20 reqs_thread_entry: start 2024-09-14T11:12:19.021 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.018+0000 7f2f090819c0 20 init_complete bucket index max shards: 11 2024-09-14T11:12:19.021 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.018+0000 7f2f090819c0 20 Filter name: none 2024-09-14T11:12:19.021 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.018+0000 7f2d35ffb640 20 reqs_thread_entry: start 2024-09-14T11:12:19.021 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.018+0000 7f2f090819c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.022 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.018+0000 7f2f090819c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:12:19.022 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.018+0000 7f2f090819c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.023 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.022+0000 7f2f090819c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:12:19.023 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.022+0000 7f2f090819c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:12:19.023 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.022+0000 7f2f090819c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:12:19.023 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.022+0000 7f2f090819c0 20 INFO: main: starting shard=0 2024-09-14T11:12:19.023 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.022+0000 7f2f090819c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.0 2024-09-14T11:12:19.023 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.022+0000 7f2f090819c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.024 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.022+0000 7f2f090819c0 20 INFO: main: starting shard=1 2024-09-14T11:12:19.024 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.022+0000 7f2f090819c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.1 2024-09-14T11:12:19.024 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.022+0000 7f2f090819c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.024 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.022+0000 7f2f090819c0 20 INFO: main: starting shard=2 2024-09-14T11:12:19.024 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.022+0000 7f2f090819c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.2 2024-09-14T11:12:19.025 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.022+0000 7f2f090819c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.025 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.022+0000 7f2f090819c0 20 INFO: main: starting shard=3 2024-09-14T11:12:19.025 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.022+0000 7f2f090819c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.3 2024-09-14T11:12:19.026 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.026+0000 7f2f090819c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.026 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.026+0000 7f2f090819c0 20 INFO: main: starting shard=4 2024-09-14T11:12:19.026 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.026+0000 7f2f090819c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.4 2024-09-14T11:12:19.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.026+0000 7f2f090819c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.026+0000 7f2f090819c0 20 INFO: main: starting shard=5 2024-09-14T11:12:19.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.026+0000 7f2f090819c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:19.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.026+0000 7f2f090819c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.026+0000 7f2f090819c0 20 INFO: main: starting shard=6 2024-09-14T11:12:19.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.026+0000 7f2f090819c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.6 2024-09-14T11:12:19.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.026+0000 7f2f090819c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.029 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.026+0000 7f2f090819c0 20 INFO: main: starting shard=7 2024-09-14T11:12:19.029 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.026+0000 7f2f090819c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.7 2024-09-14T11:12:19.029 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.026+0000 7f2f090819c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.030 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.026+0000 7f2f090819c0 20 INFO: main: starting shard=8 2024-09-14T11:12:19.030 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.026+0000 7f2f090819c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:19.030 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.030+0000 7f2f090819c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T11:12:19.030 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.030+0000 7f2f090819c0 20 INFO: main: starting shard=9 2024-09-14T11:12:19.030 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.030+0000 7f2f090819c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.9 2024-09-14T11:12:19.031 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.030+0000 7f2f090819c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.031 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.030+0000 7f2f090819c0 20 INFO: main: starting shard=10 2024-09-14T11:12:19.032 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.030+0000 7f2f090819c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.10 2024-09-14T11:12:19.032 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.030+0000 7f2f090819c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.032 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.030+0000 7f2f090819c0 20 INFO: main: done 2024-09-14T11:12:19.033 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.030+0000 7f2dbd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:19.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.034+0000 7f2f090819c0 20 remove_watcher() i=0 2024-09-14T11:12:19.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.034+0000 7f2f090819c0 2 removed watcher, disabling cache 2024-09-14T11:12:19.039 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.038+0000 7f2f090819c0 20 remove_watcher() i=1 2024-09-14T11:12:19.041 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.038+0000 7f2f090819c0 20 remove_watcher() i=2 2024-09-14T11:12:19.043 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.042+0000 7f2f090819c0 20 remove_watcher() i=3 2024-09-14T11:12:19.045 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.042+0000 7f2f090819c0 20 remove_watcher() i=4 2024-09-14T11:12:19.047 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.046+0000 7f2f090819c0 20 remove_watcher() i=5 2024-09-14T11:12:19.050 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.050+0000 7f2f090819c0 20 remove_watcher() i=6 2024-09-14T11:12:19.053 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.050+0000 7f2f090819c0 20 remove_watcher() i=7 2024-09-14T11:12:19.134 INFO:tasks.workunit.client.0.smithi071.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:12:19.135 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T11:12:19.170 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:19.170 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:19.216 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.214+0000 7f7c2b34a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.218 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.218+0000 7f7c2b34a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:19.218 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.218+0000 7f7c2b34a9c0 20 realm 2024-09-14T11:12:19.219 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.218+0000 7f7c2b34a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.219 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.218+0000 7f7c2b34a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:19.219 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.218+0000 7f7c2b34a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:19.219 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.218+0000 7f7c2b34a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.218+0000 7f7c2b34a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:19.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.218+0000 7f7c2b34a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.218+0000 7f7c2b34a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:19.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.218+0000 7f7c2b34a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.221 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.218+0000 7f7c2b34a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:19.221 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.218+0000 7f7c2b34a9c0 20 searching for the correct realm 2024-09-14T11:12:19.225 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.222+0000 7f7c29651640 0 -- 172.21.15.71:0/143042713 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f7c1c008050 msgr2=0x7f7c1c0681e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:19.438 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.438+0000 7f7c29651640 0 -- 172.21.15.71:0/143042713 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x562fc20442c0 msgr2=0x562fc20466b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:19.453 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.450+0000 7f7c2b34a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:19.453 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.450+0000 7f7c2b34a9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:12:19.453 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.450+0000 7f7c2b34a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:19.453 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.450+0000 7f7c2b34a9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:12:19.453 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.450+0000 7f7c2b34a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:19.453 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.450+0000 7f7c2b34a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:19.454 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.450+0000 7f7c2b34a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.454 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.450+0000 7f7c2b34a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:19.454 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.450+0000 7f7c2b34a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.454 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.454+0000 7f7c2b34a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:19.454 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.454+0000 7f7c2b34a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.455 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.454+0000 7f7c2b34a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:19.455 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.454+0000 7f7c2b34a9c0 20 zone default found 2024-09-14T11:12:19.455 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.454+0000 7f7c2b34a9c0 4 Realm: () 2024-09-14T11:12:19.455 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.454+0000 7f7c2b34a9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:12:19.455 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.454+0000 7f7c2b34a9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:12:19.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.454+0000 7f7c2b34a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:19.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.454+0000 7f7c2b34a9c0 20 zonegroup default 2024-09-14T11:12:19.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.454+0000 7f7c2b34a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.454+0000 7f7c2b34a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:19.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.454+0000 7f7c2b34a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.454+0000 7f7c2b34a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:19.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.454+0000 7f7c2b34a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.454+0000 7f7c2b34a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:19.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.454+0000 7f7c2b34a9c0 20 started sync module instance, tier type = 2024-09-14T11:12:19.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.454+0000 7f7c2b34a9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:12:19.481 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.478+0000 7f7c2b34a9c0 20 add_watcher() i=0 2024-09-14T11:12:19.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.478+0000 7f7c2b34a9c0 20 add_watcher() i=1 2024-09-14T11:12:19.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.478+0000 7f7c2b34a9c0 20 add_watcher() i=2 2024-09-14T11:12:19.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.478+0000 7f7c2b34a9c0 20 add_watcher() i=3 2024-09-14T11:12:19.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.478+0000 7f7c2b34a9c0 20 add_watcher() i=4 2024-09-14T11:12:19.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.478+0000 7f7c2b34a9c0 20 add_watcher() i=5 2024-09-14T11:12:19.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.478+0000 7f7c2b34a9c0 20 add_watcher() i=6 2024-09-14T11:12:19.484 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.482+0000 7f7c2b34a9c0 20 add_watcher() i=7 2024-09-14T11:12:19.485 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.482+0000 7f7c2b34a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:19.488 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.486+0000 7f7adefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:19.489 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.486+0000 7f7c2b34a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:19.489 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.486+0000 7f7c2b34a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:19.490 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.486+0000 7f7c2b34a9c0 5 note: GC not initialized 2024-09-14T11:12:19.490 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.490+0000 7f7addfe3640 20 reqs_thread_entry: start 2024-09-14T11:12:19.490 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.490+0000 7f7c2b34a9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:12:19.490 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.490+0000 7f7c2b34a9c0 20 Filter name: none 2024-09-14T11:12:19.491 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.490+0000 7f7a4f7fe640 20 reqs_thread_entry: start 2024-09-14T11:12:19.491 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.490+0000 7f7c2b34a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.492 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.490+0000 7f7c2b34a9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:12:19.492 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.490+0000 7f7c2b34a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.493 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.490+0000 7f7c2b34a9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:12:19.493 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.490+0000 7f7c2b34a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:12:19.493 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.490+0000 7f7c2b34a9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:12:19.493 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.490+0000 7f7c2b34a9c0 20 INFO: main: starting shard=0 2024-09-14T11:12:19.493 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.490+0000 7f7c2b34a9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.0 2024-09-14T11:12:19.493 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.490+0000 7f7c2b34a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.493 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.490+0000 7f7c2b34a9c0 20 INFO: main: starting shard=1 2024-09-14T11:12:19.493 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.490+0000 7f7c2b34a9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.1 2024-09-14T11:12:19.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.494+0000 7f7c2b34a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.494+0000 7f7c2b34a9c0 20 INFO: main: starting shard=2 2024-09-14T11:12:19.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.494+0000 7f7c2b34a9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.2 2024-09-14T11:12:19.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.494+0000 7f7c2b34a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.494+0000 7f7c2b34a9c0 20 INFO: main: starting shard=3 2024-09-14T11:12:19.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.494+0000 7f7c2b34a9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.3 2024-09-14T11:12:19.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.494+0000 7f7c2b34a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.494+0000 7f7c2b34a9c0 20 INFO: main: starting shard=4 2024-09-14T11:12:19.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.494+0000 7f7c2b34a9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.4 2024-09-14T11:12:19.497 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.494+0000 7f7c2b34a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.497 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.494+0000 7f7c2b34a9c0 20 INFO: main: starting shard=5 2024-09-14T11:12:19.497 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.494+0000 7f7c2b34a9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:19.497 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.494+0000 7f7c2b34a9c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T11:12:19.498 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.494+0000 7f7c2b34a9c0 20 INFO: main: starting shard=6 2024-09-14T11:12:19.498 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.494+0000 7f7c2b34a9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.6 2024-09-14T11:12:19.499 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.498+0000 7f7c2b34a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.499 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.498+0000 7f7c2b34a9c0 20 INFO: main: starting shard=7 2024-09-14T11:12:19.499 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.498+0000 7f7c2b34a9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.7 2024-09-14T11:12:19.500 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.498+0000 7f7c2b34a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.500 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.498+0000 7f7c2b34a9c0 20 INFO: main: starting shard=8 2024-09-14T11:12:19.500 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.498+0000 7f7c2b34a9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:19.501 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.498+0000 7f7c2b34a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.501 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.498+0000 7f7c2b34a9c0 20 INFO: main: starting shard=9 2024-09-14T11:12:19.501 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.498+0000 7f7c2b34a9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.9 2024-09-14T11:12:19.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.502+0000 7f7c2b34a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.502+0000 7f7c2b34a9c0 20 INFO: main: starting shard=10 2024-09-14T11:12:19.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.502+0000 7f7c2b34a9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.10 2024-09-14T11:12:19.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.502+0000 7f7c2b34a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.502+0000 7f7c2b34a9c0 20 INFO: main: done 2024-09-14T11:12:19.504 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.502+0000 7f7adefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:19.508 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.506+0000 7f7c2b34a9c0 20 remove_watcher() i=0 2024-09-14T11:12:19.509 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.506+0000 7f7c2b34a9c0 2 removed watcher, disabling cache 2024-09-14T11:12:19.510 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.510+0000 7f7c2b34a9c0 20 remove_watcher() i=1 2024-09-14T11:12:19.513 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.510+0000 7f7c2b34a9c0 20 remove_watcher() i=2 2024-09-14T11:12:19.515 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.514+0000 7f7c2b34a9c0 20 remove_watcher() i=3 2024-09-14T11:12:19.517 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.514+0000 7f7c2b34a9c0 20 remove_watcher() i=4 2024-09-14T11:12:19.519 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.518+0000 7f7c2b34a9c0 20 remove_watcher() i=5 2024-09-14T11:12:19.523 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.522+0000 7f7c2b34a9c0 20 remove_watcher() i=6 2024-09-14T11:12:19.526 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.526+0000 7f7c2b34a9c0 20 remove_watcher() i=7 2024-09-14T11:12:19.607 INFO:tasks.workunit.client.0.smithi071.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:12:19.607 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-14T11:12:19.644 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:19.644 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:19.690 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.686+0000 7f9a7c7199c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.693 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.690+0000 7f9a7c7199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:19.693 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.690+0000 7f9a7c7199c0 20 realm 2024-09-14T11:12:19.693 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.690+0000 7f9a7c7199c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.693 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.690+0000 7f9a7c7199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:19.693 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.690+0000 7f9a7c7199c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:19.693 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.690+0000 7f9a7c7199c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.694 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.690+0000 7f9a7c7199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:19.694 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.690+0000 7f9a7c7199c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.694 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.694+0000 7f9a7c7199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:19.694 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.694+0000 7f9a7c7199c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.694+0000 7f9a7c7199c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:19.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.694+0000 7f9a7c7199c0 20 searching for the correct realm 2024-09-14T11:12:19.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.698+0000 7f9a7aa20640 0 -- 172.21.15.71:0/3111458170 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f9a700da060 msgr2=0x7f9a70103440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:19.706 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.706+0000 7f9a7aa20640 0 -- 172.21.15.71:0/3111458170 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x556a04a3c810 msgr2=0x556a04a3ec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:19.714 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.714+0000 7f9a7c7199c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:19.714 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.714+0000 7f9a7c7199c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:12:19.714 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.714+0000 7f9a7c7199c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:19.714 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.714+0000 7f9a7c7199c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:12:19.715 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.714+0000 7f9a7c7199c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:19.715 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.714+0000 7f9a7c7199c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:19.715 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.714+0000 7f9a7c7199c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.715 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.714+0000 7f9a7c7199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:19.715 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.714+0000 7f9a7c7199c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.715 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.714+0000 7f9a7c7199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:19.715 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.714+0000 7f9a7c7199c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.716 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.714+0000 7f9a7c7199c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:19.716 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.714+0000 7f9a7c7199c0 20 zone default found 2024-09-14T11:12:19.716 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.714+0000 7f9a7c7199c0 4 Realm: () 2024-09-14T11:12:19.716 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.714+0000 7f9a7c7199c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:12:19.716 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.714+0000 7f9a7c7199c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:12:19.717 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.714+0000 7f9a7c7199c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:19.717 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.714+0000 7f9a7c7199c0 20 zonegroup default 2024-09-14T11:12:19.717 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.714+0000 7f9a7c7199c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.717 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.714+0000 7f9a7c7199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:19.717 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.714+0000 7f9a7c7199c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.717 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.714+0000 7f9a7c7199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:19.718 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.714+0000 7f9a7c7199c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.718 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.718+0000 7f9a7c7199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:19.718 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.718+0000 7f9a7c7199c0 20 started sync module instance, tier type = 2024-09-14T11:12:19.718 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.718+0000 7f9a7c7199c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:12:19.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.734+0000 7f9a7c7199c0 20 add_watcher() i=0 2024-09-14T11:12:19.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.734+0000 7f9a7c7199c0 20 add_watcher() i=1 2024-09-14T11:12:19.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.734+0000 7f9a7c7199c0 20 add_watcher() i=2 2024-09-14T11:12:19.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.734+0000 7f9a7c7199c0 20 add_watcher() i=3 2024-09-14T11:12:19.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.734+0000 7f9a7c7199c0 20 add_watcher() i=4 2024-09-14T11:12:19.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.734+0000 7f9a7c7199c0 20 add_watcher() i=5 2024-09-14T11:12:19.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.734+0000 7f9a7c7199c0 20 add_watcher() i=6 2024-09-14T11:12:19.739 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.738+0000 7f9a7c7199c0 20 add_watcher() i=7 2024-09-14T11:12:19.739 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.738+0000 7f9a7c7199c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:19.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.742+0000 7f9930fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:19.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.742+0000 7f9a7c7199c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:19.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.742+0000 7f9a7c7199c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:19.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.742+0000 7f9a7c7199c0 5 note: GC not initialized 2024-09-14T11:12:19.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.742+0000 7f98ab7fe640 20 reqs_thread_entry: start 2024-09-14T11:12:19.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.742+0000 7f9a7c7199c0 20 init_complete bucket index max shards: 11 2024-09-14T11:12:19.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.742+0000 7f9a7c7199c0 20 Filter name: none 2024-09-14T11:12:19.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.742+0000 7f98a97fa640 20 reqs_thread_entry: start 2024-09-14T11:12:19.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.742+0000 7f9a7c7199c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.742+0000 7f9a7c7199c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:12:19.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.742+0000 7f9a7c7199c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.745 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.742+0000 7f9a7c7199c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:12:19.745 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.742+0000 7f9a7c7199c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:12:19.745 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.742+0000 7f9a7c7199c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:12:19.745 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.742+0000 7f9a7c7199c0 20 INFO: main: starting shard=0 2024-09-14T11:12:19.745 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.742+0000 7f9a7c7199c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.0 2024-09-14T11:12:19.746 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.742+0000 7f9a7c7199c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.746 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.742+0000 7f9a7c7199c0 20 INFO: main: starting shard=1 2024-09-14T11:12:19.746 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.742+0000 7f9a7c7199c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.1 2024-09-14T11:12:19.746 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.746+0000 7f9a7c7199c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:12:19.746 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.746+0000 7f9a7c7199c0 20 INFO: main: starting shard=2 2024-09-14T11:12:19.746 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.746+0000 7f9a7c7199c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.2 2024-09-14T11:12:19.747 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.746+0000 7f9a7c7199c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.747 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.746+0000 7f9a7c7199c0 20 INFO: main: starting shard=3 2024-09-14T11:12:19.748 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.746+0000 7f9a7c7199c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.3 2024-09-14T11:12:19.748 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.746+0000 7f9a7c7199c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.749 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.746+0000 7f9a7c7199c0 20 INFO: main: starting shard=4 2024-09-14T11:12:19.749 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.746+0000 7f9a7c7199c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.4 2024-09-14T11:12:19.749 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.746+0000 7f9a7c7199c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.749 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.746+0000 7f9a7c7199c0 20 INFO: main: starting shard=5 2024-09-14T11:12:19.749 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.746+0000 7f9a7c7199c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:19.750 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.746+0000 7f9a7c7199c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.750 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.746+0000 7f9a7c7199c0 20 INFO: main: starting shard=6 2024-09-14T11:12:19.750 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.746+0000 7f9a7c7199c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.6 2024-09-14T11:12:19.751 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.750+0000 7f9a7c7199c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.751 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.750+0000 7f9a7c7199c0 20 INFO: main: starting shard=7 2024-09-14T11:12:19.751 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.750+0000 7f9a7c7199c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.7 2024-09-14T11:12:19.752 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.750+0000 7f9a7c7199c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.753 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.750+0000 7f9a7c7199c0 20 INFO: main: starting shard=8 2024-09-14T11:12:19.753 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.750+0000 7f9a7c7199c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:19.753 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.750+0000 7f9a7c7199c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.753 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.750+0000 7f9a7c7199c0 20 INFO: main: starting shard=9 2024-09-14T11:12:19.753 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.750+0000 7f9a7c7199c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.9 2024-09-14T11:12:19.754 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.754+0000 7f9a7c7199c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.754 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.754+0000 7f9a7c7199c0 20 INFO: main: starting shard=10 2024-09-14T11:12:19.754 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.754+0000 7f9a7c7199c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.10 2024-09-14T11:12:19.755 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.754+0000 7f9a7c7199c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.755 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.754+0000 7f9a7c7199c0 20 INFO: main: done 2024-09-14T11:12:19.756 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.754+0000 7f9930fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:19.760 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.758+0000 7f9a7c7199c0 20 remove_watcher() i=0 2024-09-14T11:12:19.760 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.758+0000 7f9a7c7199c0 2 removed watcher, disabling cache 2024-09-14T11:12:19.762 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.762+0000 7f9a7c7199c0 20 remove_watcher() i=1 2024-09-14T11:12:19.764 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.762+0000 7f9a7c7199c0 20 remove_watcher() i=2 2024-09-14T11:12:19.766 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.766+0000 7f9a7c7199c0 20 remove_watcher() i=3 2024-09-14T11:12:19.768 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.766+0000 7f9a7c7199c0 20 remove_watcher() i=4 2024-09-14T11:12:19.770 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.770+0000 7f9a7c7199c0 20 remove_watcher() i=5 2024-09-14T11:12:19.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.770+0000 7f9a7c7199c0 20 remove_watcher() i=6 2024-09-14T11:12:19.776 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.774+0000 7f9a7c7199c0 20 remove_watcher() i=7 2024-09-14T11:12:19.847 INFO:tasks.workunit.client.0.smithi071.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:12:19.847 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-14T11:12:19.878 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:19.878 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:19.925 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.922+0000 7ff90dc169c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.928 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.926+0000 7ff90dc169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:19.928 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.926+0000 7ff90dc169c0 20 realm 2024-09-14T11:12:19.928 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.926+0000 7ff90dc169c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.929 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.926+0000 7ff90dc169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:19.929 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.926+0000 7ff90dc169c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:19.929 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.926+0000 7ff90dc169c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.929 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.926+0000 7ff90dc169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:19.929 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.926+0000 7ff90dc169c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.929 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.926+0000 7ff90dc169c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:19.929 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.926+0000 7ff90dc169c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.930 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.930+0000 7ff90dc169c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:19.930 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.930+0000 7ff90dc169c0 20 searching for the correct realm 2024-09-14T11:12:19.934 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.934+0000 7ff90bf1d640 0 -- 172.21.15.71:0/1457234824 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7ff8f40f7cd0 msgr2=0x7ff8f4101e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:19.941 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.938+0000 7ff90bf1d640 0 -- 172.21.15.71:0/1457234824 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55c624771110 msgr2=0x55c624773500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:19.949 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.946+0000 7ff90dc169c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:19.949 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.946+0000 7ff90dc169c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:12:19.949 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.946+0000 7ff90dc169c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:19.949 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.946+0000 7ff90dc169c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:12:19.950 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.946+0000 7ff90dc169c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:19.950 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.946+0000 7ff90dc169c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:19.950 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.946+0000 7ff90dc169c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.950 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.950+0000 7ff90dc169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:19.950 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.950+0000 7ff90dc169c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.950 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.950+0000 7ff90dc169c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:19.950 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.950+0000 7ff90dc169c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.951 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.950+0000 7ff90dc169c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:19.951 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.950+0000 7ff90dc169c0 20 zone default found 2024-09-14T11:12:19.951 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.950+0000 7ff90dc169c0 4 Realm: () 2024-09-14T11:12:19.951 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.950+0000 7ff90dc169c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:12:19.951 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.950+0000 7ff90dc169c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:12:19.952 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.950+0000 7ff90dc169c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:19.952 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.950+0000 7ff90dc169c0 20 zonegroup default 2024-09-14T11:12:19.952 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.950+0000 7ff90dc169c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.952 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.950+0000 7ff90dc169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:19.952 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.950+0000 7ff90dc169c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.953 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.950+0000 7ff90dc169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:19.953 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.950+0000 7ff90dc169c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.953 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.950+0000 7ff90dc169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:19.953 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.950+0000 7ff90dc169c0 20 started sync module instance, tier type = 2024-09-14T11:12:19.953 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.950+0000 7ff90dc169c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:12:19.973 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.970+0000 7ff90dc169c0 20 add_watcher() i=0 2024-09-14T11:12:19.973 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.970+0000 7ff90dc169c0 20 add_watcher() i=1 2024-09-14T11:12:19.973 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.970+0000 7ff90dc169c0 20 add_watcher() i=2 2024-09-14T11:12:19.973 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.970+0000 7ff90dc169c0 20 add_watcher() i=3 2024-09-14T11:12:19.974 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.970+0000 7ff90dc169c0 20 add_watcher() i=4 2024-09-14T11:12:19.974 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.970+0000 7ff90dc169c0 20 add_watcher() i=5 2024-09-14T11:12:19.974 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.970+0000 7ff90dc169c0 20 add_watcher() i=6 2024-09-14T11:12:19.976 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.974+0000 7ff90dc169c0 20 add_watcher() i=7 2024-09-14T11:12:19.976 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.974+0000 7ff90dc169c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:19.980 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.978+0000 7ff7c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:19.981 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.978+0000 7ff90dc169c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:19.981 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.978+0000 7ff90dc169c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:19.981 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.978+0000 7ff90dc169c0 5 note: GC not initialized 2024-09-14T11:12:19.981 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.978+0000 7ff7c0fe1640 20 reqs_thread_entry: start 2024-09-14T11:12:19.981 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.978+0000 7ff90dc169c0 20 init_complete bucket index max shards: 11 2024-09-14T11:12:19.981 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.978+0000 7ff90dc169c0 20 Filter name: none 2024-09-14T11:12:19.982 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.978+0000 7ff73a7fc640 20 reqs_thread_entry: start 2024-09-14T11:12:19.982 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.978+0000 7ff90dc169c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.982 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.982+0000 7ff90dc169c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:12:19.982 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.982+0000 7ff90dc169c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:19.983 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.982+0000 7ff90dc169c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:12:19.983 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.982+0000 7ff90dc169c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:12:19.983 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.982+0000 7ff90dc169c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:12:19.984 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.982+0000 7ff90dc169c0 20 INFO: main: starting shard=0 2024-09-14T11:12:19.984 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.982+0000 7ff90dc169c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.0 2024-09-14T11:12:19.984 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.982+0000 7ff90dc169c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.984 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.982+0000 7ff90dc169c0 20 INFO: main: starting shard=1 2024-09-14T11:12:19.984 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.982+0000 7ff90dc169c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.1 2024-09-14T11:12:19.985 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.982+0000 7ff90dc169c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.985 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.982+0000 7ff90dc169c0 20 INFO: main: starting shard=2 2024-09-14T11:12:19.985 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.982+0000 7ff90dc169c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.2 2024-09-14T11:12:19.986 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.986+0000 7ff90dc169c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.986 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.986+0000 7ff90dc169c0 20 INFO: main: starting shard=3 2024-09-14T11:12:19.986 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.986+0000 7ff90dc169c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.3 2024-09-14T11:12:19.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.986+0000 7ff90dc169c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.986+0000 7ff90dc169c0 20 INFO: main: starting shard=4 2024-09-14T11:12:19.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.986+0000 7ff90dc169c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.4 2024-09-14T11:12:19.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.986+0000 7ff90dc169c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.986+0000 7ff90dc169c0 20 INFO: main: starting shard=5 2024-09-14T11:12:19.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.986+0000 7ff90dc169c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:19.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.986+0000 7ff90dc169c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.989 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.986+0000 7ff90dc169c0 20 INFO: main: starting shard=6 2024-09-14T11:12:19.989 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.986+0000 7ff90dc169c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.6 2024-09-14T11:12:19.990 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.990+0000 7ff90dc169c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.990 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.990+0000 7ff90dc169c0 20 INFO: main: starting shard=7 2024-09-14T11:12:19.990 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.990+0000 7ff90dc169c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.7 2024-09-14T11:12:19.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.990+0000 7ff90dc169c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.990+0000 7ff90dc169c0 20 INFO: main: starting shard=8 2024-09-14T11:12:19.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.990+0000 7ff90dc169c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:19.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.990+0000 7ff90dc169c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.990+0000 7ff90dc169c0 20 INFO: main: starting shard=9 2024-09-14T11:12:19.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.990+0000 7ff90dc169c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.9 2024-09-14T11:12:19.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.990+0000 7ff90dc169c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:19.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.990+0000 7ff90dc169c0 20 INFO: main: starting shard=10 2024-09-14T11:12:19.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.990+0000 7ff90dc169c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.10 2024-09-14T11:12:19.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.994+0000 7ff90dc169c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:12:19.995 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.994+0000 7ff90dc169c0 20 INFO: main: done 2024-09-14T11:12:19.995 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.994+0000 7ff7c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:20.000 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.998+0000 7ff90dc169c0 20 remove_watcher() i=0 2024-09-14T11:12:20.000 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:19.998+0000 7ff90dc169c0 2 removed watcher, disabling cache 2024-09-14T11:12:20.002 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:20.002+0000 7ff90dc169c0 20 remove_watcher() i=1 2024-09-14T11:12:20.004 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:20.002+0000 7ff90dc169c0 20 remove_watcher() i=2 2024-09-14T11:12:20.006 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:20.006+0000 7ff90dc169c0 20 remove_watcher() i=3 2024-09-14T11:12:20.007 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:20.006+0000 7ff90dc169c0 20 remove_watcher() i=4 2024-09-14T11:12:20.009 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:20.006+0000 7ff90dc169c0 20 remove_watcher() i=5 2024-09-14T11:12:20.011 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:20.010+0000 7ff90dc169c0 20 remove_watcher() i=6 2024-09-14T11:12:20.013 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:20.010+0000 7ff90dc169c0 20 remove_watcher() i=7 2024-09-14T11:12:20.032 INFO:tasks.workunit.client.0.smithi071.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:12:20.449 INFO:tasks.workunit.client.0.smithi071.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T11:12:20.869 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-14T11:12:20.869 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:12:20.869 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T11:12:20.902 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:20.902 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:20.941 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:20.938+0000 7f4efd6119c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:20.944 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:20.942+0000 7f4efd6119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:20.944 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:20.942+0000 7f4efd6119c0 20 realm 2024-09-14T11:12:20.944 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:20.942+0000 7f4efd6119c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:20.944 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:20.942+0000 7f4efd6119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:20.944 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:20.942+0000 7f4efd6119c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:20.944 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:20.942+0000 7f4efd6119c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:20.944 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:20.942+0000 7f4efd6119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:20.945 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:20.942+0000 7f4efd6119c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:20.946 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:20.942+0000 7f4efd6119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:20.946 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:20.942+0000 7f4efd6119c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:20.946 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:20.942+0000 7f4efd6119c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:20.946 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:20.942+0000 7f4efd6119c0 20 searching for the correct realm 2024-09-14T11:12:20.950 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:20.950+0000 7f4efb117640 0 -- 172.21.15.71:0/297310316 >> [v2:172.21.15.157:6808/527702018,v1:172.21.15.157:6809/527702018] conn(0x7f4eec047400 msgr2=0x7f4eec047840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:12:21.167 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.166+0000 7f4efb117640 0 -- 172.21.15.71:0/297310316 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x556e136fd550 msgr2=0x556e136ff9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:21.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.174+0000 7f4efd6119c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:21.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.174+0000 7f4efd6119c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:12:21.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.174+0000 7f4efd6119c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:21.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.174+0000 7f4efd6119c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:12:21.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.174+0000 7f4efd6119c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:21.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.174+0000 7f4efd6119c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:21.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.174+0000 7f4efd6119c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:21.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.174+0000 7f4efd6119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:21.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.174+0000 7f4efd6119c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:21.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.174+0000 7f4efd6119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:21.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.174+0000 7f4efd6119c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:21.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.174+0000 7f4efd6119c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:21.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.174+0000 7f4efd6119c0 20 zone default found 2024-09-14T11:12:21.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.174+0000 7f4efd6119c0 4 Realm: () 2024-09-14T11:12:21.178 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.174+0000 7f4efd6119c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:12:21.178 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.174+0000 7f4efd6119c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:12:21.178 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.174+0000 7f4efd6119c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:21.178 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.174+0000 7f4efd6119c0 20 zonegroup default 2024-09-14T11:12:21.178 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.174+0000 7f4efd6119c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:21.178 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.178+0000 7f4efd6119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:21.178 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.178+0000 7f4efd6119c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:21.179 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.178+0000 7f4efd6119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:21.179 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.178+0000 7f4efd6119c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:21.179 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.178+0000 7f4efd6119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:21.180 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.178+0000 7f4efd6119c0 20 started sync module instance, tier type = 2024-09-14T11:12:21.180 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.178+0000 7f4efd6119c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:12:21.205 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.202+0000 7f4efd6119c0 20 add_watcher() i=0 2024-09-14T11:12:21.206 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.202+0000 7f4efd6119c0 20 add_watcher() i=1 2024-09-14T11:12:21.206 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.202+0000 7f4efd6119c0 20 add_watcher() i=2 2024-09-14T11:12:21.206 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.202+0000 7f4efd6119c0 20 add_watcher() i=3 2024-09-14T11:12:21.206 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.202+0000 7f4efd6119c0 20 add_watcher() i=4 2024-09-14T11:12:21.206 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.202+0000 7f4efd6119c0 20 add_watcher() i=5 2024-09-14T11:12:21.206 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.206+0000 7f4efd6119c0 20 add_watcher() i=6 2024-09-14T11:12:21.208 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.206+0000 7f4efd6119c0 20 add_watcher() i=7 2024-09-14T11:12:21.208 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.206+0000 7f4efd6119c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:21.213 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.210+0000 7f4db27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:21.213 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.210+0000 7f4efd6119c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:21.213 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.210+0000 7f4efd6119c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:21.213 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.210+0000 7f4efd6119c0 5 note: GC not initialized 2024-09-14T11:12:21.214 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.214+0000 7f4db17e2640 20 reqs_thread_entry: start 2024-09-14T11:12:21.214 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.214+0000 7f4efd6119c0 20 init_complete bucket index max shards: 11 2024-09-14T11:12:21.214 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.214+0000 7f4efd6119c0 20 Filter name: none 2024-09-14T11:12:21.215 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.214+0000 7f4daa7fc640 20 reqs_thread_entry: start 2024-09-14T11:12:21.215 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.214+0000 7f4efd6119c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:12:21.215 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.214+0000 7f4efd6119c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:21.215 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.214+0000 7f4efd6119c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:12:21.216 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.214+0000 7f4efd6119c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:12:21.216 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.214+0000 7f4efd6119c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:12:21.216 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.214+0000 7f4efd6119c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 : miss 2024-09-14T11:12:21.216 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.214+0000 7f4efd6119c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:21.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.214+0000 7f4efd6119c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:12:21.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.214+0000 7f4efd6119c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 info.flags=0x17 2024-09-14T11:12:21.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.214+0000 7f4efd6119c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 to cache LRU end 2024-09-14T11:12:21.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.214+0000 7f4efd6119c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:12:21.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.214+0000 7f4efd6119c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:12:21.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.214+0000 7f4efd6119c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 2024-09-14T11:12:21.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.214+0000 7f4efd6119c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.0 2024-09-14T11:12:21.218 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.218+0000 7f4efd6119c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:12:21.218 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.218+0000 7f4efd6119c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.1 2024-09-14T11:12:21.218 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.218+0000 7f4efd6119c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.2 2024-09-14T11:12:21.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.218+0000 7f4efd6119c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:12:21.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.218+0000 7f4efd6119c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.3 2024-09-14T11:12:21.221 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.218+0000 7f4efd6119c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:12:21.221 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.218+0000 7f4efd6119c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.4 2024-09-14T11:12:21.221 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.218+0000 7f4efd6119c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:12:21.221 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.218+0000 7f4efd6119c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:21.222 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.222+0000 7f4efd6119c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.6 2024-09-14T11:12:21.223 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.222+0000 7f4efd6119c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:12:21.223 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.222+0000 7f4efd6119c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.7 2024-09-14T11:12:21.224 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.222+0000 7f4efd6119c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:12:21.224 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.222+0000 7f4efd6119c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:21.225 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.222+0000 7f4efd6119c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.9 2024-09-14T11:12:21.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.226+0000 7f4efd6119c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:12:21.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.226+0000 7f4efd6119c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.10 2024-09-14T11:12:21.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.226+0000 7f4efd6119c0 1 NOTICE: finished shard 1 (1 entries found) 2024-09-14T11:12:21.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.226+0000 7f4efd6119c0 1 NOTICE: finished shard 5 (1 entries found) 2024-09-14T11:12:21.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.226+0000 7f4efd6119c0 1 NOTICE: finished shard 8 (1 entries found) 2024-09-14T11:12:21.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.226+0000 7f4efd6119c0 1 NOTICE: finished shard 10 (1 entries found) 2024-09-14T11:12:21.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.226+0000 7f4efd6119c0 1 NOTICE: finished all shards (4 entries found) 2024-09-14T11:12:21.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.226+0000 7f4db27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:21.233 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.230+0000 7f4efd6119c0 20 remove_watcher() i=0 2024-09-14T11:12:21.233 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.230+0000 7f4efd6119c0 2 removed watcher, disabling cache 2024-09-14T11:12:21.236 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.234+0000 7f4efd6119c0 20 remove_watcher() i=1 2024-09-14T11:12:21.238 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.238+0000 7f4efd6119c0 20 remove_watcher() i=2 2024-09-14T11:12:21.240 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.238+0000 7f4efd6119c0 20 remove_watcher() i=3 2024-09-14T11:12:21.242 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.242+0000 7f4efd6119c0 20 remove_watcher() i=4 2024-09-14T11:12:21.244 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.242+0000 7f4efd6119c0 20 remove_watcher() i=5 2024-09-14T11:12:21.249 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.246+0000 7f4efd6119c0 20 remove_watcher() i=6 2024-09-14T11:12:21.250 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.246+0000 7f4efd6119c0 20 remove_watcher() i=7 2024-09-14T11:12:21.264 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: unlinked entries are not listable 2024-09-14T11:12:21.264 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:12:21.271 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-14T11:12:21.271 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:12:21.367 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-14T11:12:21.367 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:12:21.367 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:12:21.408 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:21.408 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:21.662 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.662+0000 7fbc0defc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:21.663 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.662+0000 7fbc0defc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:21.664 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.662+0000 7fbc0defc9c0 20 realm 2024-09-14T11:12:21.664 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.662+0000 7fbc0defc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:21.664 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.662+0000 7fbc0defc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:21.664 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.662+0000 7fbc0defc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:21.664 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.662+0000 7fbc0defc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:21.665 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.662+0000 7fbc0defc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:21.665 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.662+0000 7fbc0defc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:21.666 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.662+0000 7fbc0defc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:21.666 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.666+0000 7fbc0defc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:21.666 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.666+0000 7fbc0defc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:21.667 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.666+0000 7fbc0defc9c0 20 searching for the correct realm 2024-09-14T11:12:21.670 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.670+0000 7fbc0c203640 0 -- 172.21.15.71:0/3604585548 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fbc00026070 msgr2=0x7fbc00065c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:21.885 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.882+0000 7fbc0c203640 0 -- 172.21.15.71:0/3604585548 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55b9b8c95300 msgr2=0x55b9b8c976f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:21.900 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.898+0000 7fbc0defc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:21.900 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.898+0000 7fbc0defc9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:12:21.901 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.898+0000 7fbc0defc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:21.901 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.898+0000 7fbc0defc9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:12:21.901 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.898+0000 7fbc0defc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:21.901 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.898+0000 7fbc0defc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:21.901 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.898+0000 7fbc0defc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:21.901 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.898+0000 7fbc0defc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:21.901 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.898+0000 7fbc0defc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:21.902 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.902+0000 7fbc0defc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:21.902 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.902+0000 7fbc0defc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:21.903 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.902+0000 7fbc0defc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:21.903 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.902+0000 7fbc0defc9c0 20 zone default found 2024-09-14T11:12:21.903 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.902+0000 7fbc0defc9c0 4 Realm: () 2024-09-14T11:12:21.903 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.902+0000 7fbc0defc9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:12:21.903 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.902+0000 7fbc0defc9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:12:21.903 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.902+0000 7fbc0defc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:21.903 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.902+0000 7fbc0defc9c0 20 zonegroup default 2024-09-14T11:12:21.903 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.902+0000 7fbc0defc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:21.904 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.902+0000 7fbc0defc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:21.904 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.902+0000 7fbc0defc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:21.904 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.902+0000 7fbc0defc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:21.904 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.902+0000 7fbc0defc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:21.905 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.902+0000 7fbc0defc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:21.905 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.902+0000 7fbc0defc9c0 20 started sync module instance, tier type = 2024-09-14T11:12:21.905 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.902+0000 7fbc0defc9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:12:21.931 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.930+0000 7fbc0defc9c0 20 add_watcher() i=0 2024-09-14T11:12:21.931 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.930+0000 7fbc0defc9c0 20 add_watcher() i=1 2024-09-14T11:12:21.931 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.930+0000 7fbc0defc9c0 20 add_watcher() i=2 2024-09-14T11:12:21.931 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.930+0000 7fbc0defc9c0 20 add_watcher() i=3 2024-09-14T11:12:21.931 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.930+0000 7fbc0defc9c0 20 add_watcher() i=4 2024-09-14T11:12:21.931 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.930+0000 7fbc0defc9c0 20 add_watcher() i=5 2024-09-14T11:12:21.931 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.930+0000 7fbc0defc9c0 20 add_watcher() i=6 2024-09-14T11:12:21.933 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.930+0000 7fbc0defc9c0 20 add_watcher() i=7 2024-09-14T11:12:21.933 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.930+0000 7fbc0defc9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:21.938 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.934+0000 7fbac1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:21.939 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.938+0000 7fbc0defc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:21.939 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.938+0000 7fbc0defc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:21.939 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.938+0000 7fbc0defc9c0 5 note: GC not initialized 2024-09-14T11:12:21.939 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.938+0000 7fbac0fe1640 20 reqs_thread_entry: start 2024-09-14T11:12:21.939 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.938+0000 7fbc0defc9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:12:21.940 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.938+0000 7fbc0defc9c0 20 Filter name: none 2024-09-14T11:12:21.940 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.938+0000 7fba3a7fc640 20 reqs_thread_entry: start 2024-09-14T11:12:21.940 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.938+0000 7fbc0defc9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:12:21.940 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.938+0000 7fbc0defc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:21.941 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.938+0000 7fbc0defc9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:12:21.941 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.938+0000 7fbc0defc9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:12:21.941 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.938+0000 7fbc0defc9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:12:21.941 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.938+0000 7fbc0defc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 : miss 2024-09-14T11:12:21.941 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.938+0000 7fbc0defc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:21.942 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.942+0000 7fbc0defc9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:12:21.942 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.942+0000 7fbc0defc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 info.flags=0x17 2024-09-14T11:12:21.942 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.942+0000 7fbc0defc9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 to cache LRU end 2024-09-14T11:12:21.942 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.942+0000 7fbc0defc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:12:21.943 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.942+0000 7fbc0defc9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:12:21.943 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.942+0000 7fbc0defc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 2024-09-14T11:12:21.943 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.942+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.0 2024-09-14T11:12:21.943 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.942+0000 7fbc0defc9c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:12:21.943 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.942+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.1 2024-09-14T11:12:21.943 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.942+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.2 2024-09-14T11:12:21.945 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.942+0000 7fbc0defc9c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:12:21.945 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.942+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.3 2024-09-14T11:12:21.946 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.946+0000 7fbc0defc9c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:12:21.946 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.946+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.4 2024-09-14T11:12:21.947 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.946+0000 7fbc0defc9c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:12:21.947 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.946+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:21.947 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.946+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.6 2024-09-14T11:12:21.948 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.946+0000 7fbc0defc9c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:12:21.949 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.946+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.7 2024-09-14T11:12:21.949 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.946+0000 7fbc0defc9c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:12:21.949 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.946+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:21.950 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.950+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.9 2024-09-14T11:12:21.951 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.950+0000 7fbc0defc9c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-14T11:12:21.951 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.950+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.10 2024-09-14T11:12:21.952 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.950+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.1 2024-09-14T11:12:21.953 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.950+0000 7fbc0defc9c0 20 get_obj_state: octx=0x55b9b898d290 obj=check-bucket:e state=0x55b9b8cd0bf8 s->prefetch_data=0 2024-09-14T11:12:21.953 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.950+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:21.953 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.950+0000 7fbc0defc9c0 20 get_obj_state: octx=0x55b9b8a2f460 obj=check-bucket:d state=0x55b9b8cc66b8 s->prefetch_data=0 2024-09-14T11:12:21.953 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.950+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:21.954 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.954+0000 7fbc0defc9c0 20 get_obj_state: octx=0x55b9b8cc9410 obj=check-bucket:c state=0x55b9b8cc7708 s->prefetch_data=0 2024-09-14T11:12:21.954 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.954+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.10 2024-09-14T11:12:21.955 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.954+0000 7fbc0defc9c0 20 get_obj_state: octx=0x55b9b8cc8b40 obj=check-bucket:f state=0x55b9b8ccbff8 s->prefetch_data=0 2024-09-14T11:12:21.955 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.954+0000 7fbc0defc9c0 20 get_obj_state: setting s->obj_tag to fgcf6df73zmq771bymate1igty9gbxpi 2024-09-14T11:12:21.955 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.954+0000 7fbc0defc9c0 20 get_obj_state_impl: setting s->olh_tag to zjuct0ksva76x23y3t3eoqbr2zbaovh2 2024-09-14T11:12:21.955 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.954+0000 7fbc0defc9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=zjuct0ksva76x23y3t3eoqbr2zbaovh2 2024-09-14T11:12:21.955 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.954+0000 7fbc0defc9c0 20 get_obj_state: setting s->obj_tag to oc062nenu9h9k9e9yscliuzzf5nr998l 2024-09-14T11:12:21.955 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.954+0000 7fbc0defc9c0 20 get_obj_state_impl: setting s->olh_tag to 1uwfkl6or70l3k1b3k9jpilz4kkc807h 2024-09-14T11:12:21.955 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.954+0000 7fbc0defc9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=1uwfkl6or70l3k1b3k9jpilz4kkc807h 2024-09-14T11:12:21.955 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.954+0000 7fbc0defc9c0 20 get_obj_state: setting s->obj_tag to xi7rb3mtk6wlnyn7g0gnsqkst197hwft 2024-09-14T11:12:21.955 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.954+0000 7fbc0defc9c0 20 get_obj_state_impl: setting s->olh_tag to 32x0rwovytdsuw77qq86rm01wy7x0p6l 2024-09-14T11:12:21.956 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.954+0000 7fbc0defc9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=32x0rwovytdsuw77qq86rm01wy7x0p6l 2024-09-14T11:12:21.956 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.954+0000 7fbc0defc9c0 20 get_obj_state: setting s->obj_tag to 2xp5t44blqxq08h3jz9vy392f5xm5gvv 2024-09-14T11:12:21.956 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.954+0000 7fbc0defc9c0 20 get_obj_state_impl: setting s->olh_tag to c0wlmn54gtpd1s2i7o8zclps7fueyeu1 2024-09-14T11:12:21.956 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.954+0000 7fbc0defc9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=c0wlmn54gtpd1s2i7o8zclps7fueyeu1 2024-09-14T11:12:21.957 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.954+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:21.958 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.958+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.1 2024-09-14T11:12:21.958 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.958+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:21.958 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.958+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.10 2024-09-14T11:12:21.960 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.958+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:21.960 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.958+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.1 2024-09-14T11:12:21.962 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.958+0000 7fbc0defc9c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-14T11:12:21.962 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.958+0000 7fbc0defc9c0 20 olh_log_entry: epoch=2 op=3 key=e[VwTNZImu4uoki9A.Lqp59kZJODzaxVh] 2024-09-14T11:12:21.962 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.958+0000 7fbc0defc9c0 20 get_obj_state: octx=0x55b9b898d290 obj=check-bucket:_:VwTNZImu4uoki9A.Lqp59kZJODzaxVh_e state=0x55b9b8d71de8 s->prefetch_data=0 2024-09-14T11:12:21.962 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.958+0000 7fbc0defc9c0 20 olh_log_entry: epoch=3 op=3 key=d[004.QP5FUNll-yBEJuQ0eZYoYyEe-MV] 2024-09-14T11:12:21.962 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.958+0000 7fbc0defc9c0 20 get_obj_state: octx=0x55b9b8a2f460 obj=check-bucket:_:004.QP5FUNll-yBEJuQ0eZYoYyEe-MV_d state=0x55b9b8d74e68 s->prefetch_data=0 2024-09-14T11:12:21.962 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.958+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.10 2024-09-14T11:12:21.962 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.958+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:21.962 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.962+0000 7fbc0defc9c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-14T11:12:21.962 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.962+0000 7fbc0defc9c0 20 olh_log_entry: epoch=2 op=3 key=f[sDamiqfM4vAF3g8-Z2sxiN47UVtH3ym] 2024-09-14T11:12:21.962 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.962+0000 7fbc0defc9c0 20 get_obj_state: octx=0x55b9b8cc8b40 obj=check-bucket:_:sDamiqfM4vAF3g8-Z2sxiN47UVtH3ym_f state=0x55b9b8d7cf58 s->prefetch_data=0 2024-09-14T11:12:21.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.962+0000 7fbc0defc9c0 10 manifest: total_size = 22 2024-09-14T11:12:21.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.962+0000 7fbc0defc9c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.12446709865800116485 2024-09-14T11:12:21.964 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.962+0000 7fbc0defc9c0 20 get_obj_state: octx=0x55b9b898d290 obj=check-bucket:_:VwTNZImu4uoki9A.Lqp59kZJODzaxVh_e state=0x55b9b8d71de8 s->prefetch_data=0 2024-09-14T11:12:21.964 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.962+0000 7fbc0defc9c0 20 prepare_atomic_modification: state is not atomic. state=0x55b9b8d71de8 2024-09-14T11:12:21.964 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.962+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.1 2024-09-14T11:12:21.964 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.962+0000 7fbc0defc9c0 20 olh_log_entry: epoch=3 op=3 key=c[ID.s8vKpDysCfIGTD5tuPom614AVZOH] 2024-09-14T11:12:21.964 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.962+0000 7fbc0defc9c0 20 get_obj_state: octx=0x55b9b8cc9410 obj=check-bucket:_:ID.s8vKpDysCfIGTD5tuPom614AVZOH_c state=0x55b9b8d87798 s->prefetch_data=0 2024-09-14T11:12:21.964 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.962+0000 7fbc0defc9c0 10 manifest: total_size = 22 2024-09-14T11:12:21.964 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.962+0000 7fbc0defc9c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.10344746131124513732 2024-09-14T11:12:21.964 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.962+0000 7fbc0defc9c0 20 get_obj_state: octx=0x55b9b8a2f460 obj=check-bucket:_:004.QP5FUNll-yBEJuQ0eZYoYyEe-MV_d state=0x55b9b8d74e68 s->prefetch_data=0 2024-09-14T11:12:21.964 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.962+0000 7fbc0defc9c0 20 prepare_atomic_modification: state is not atomic. state=0x55b9b8d74e68 2024-09-14T11:12:21.964 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.962+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:21.964 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.962+0000 7fbc0defc9c0 10 manifest: total_size = 9 2024-09-14T11:12:21.964 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.962+0000 7fbc0defc9c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.11509274985739946582 2024-09-14T11:12:21.964 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.962+0000 7fbc0defc9c0 20 get_obj_state: octx=0x55b9b8cc8b40 obj=check-bucket:_:sDamiqfM4vAF3g8-Z2sxiN47UVtH3ym_f state=0x55b9b8d7cf58 s->prefetch_data=0 2024-09-14T11:12:21.964 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.962+0000 7fbc0defc9c0 20 prepare_atomic_modification: state is not atomic. state=0x55b9b8d7cf58 2024-09-14T11:12:21.965 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.962+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.10 2024-09-14T11:12:21.965 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.962+0000 7fbc0defc9c0 10 manifest: total_size = 11 2024-09-14T11:12:21.965 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.962+0000 7fbc0defc9c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.7240466515433587557 2024-09-14T11:12:21.965 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.962+0000 7fbc0defc9c0 20 get_obj_state: octx=0x55b9b8cc9410 obj=check-bucket:_:ID.s8vKpDysCfIGTD5tuPom614AVZOH_c state=0x55b9b8d87798 s->prefetch_data=0 2024-09-14T11:12:21.965 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.962+0000 7fbc0defc9c0 20 prepare_atomic_modification: state is not atomic. state=0x55b9b8d87798 2024-09-14T11:12:21.965 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.962+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:21.968 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.966+0000 7fbaeaffd640 20 handle_completion(): completion ok for obj=e[VwTNZImu4uoki9A.Lqp59kZJODzaxVh] 2024-09-14T11:12:21.971 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.970+0000 7fbaeaffd640 20 handle_completion(): completion ok for obj=f[sDamiqfM4vAF3g8-Z2sxiN47UVtH3ym] 2024-09-14T11:12:21.971 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.970+0000 7fbc0defc9c0 20 get_obj_state: octx=0x55b9b898d290 obj=check-bucket:e state=0x55b9b8cd0bf8 s->prefetch_data=0 2024-09-14T11:12:21.971 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.970+0000 7fbc0defc9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=zjuct0ksva76x23y3t3eoqbr2zbaovh2 2024-09-14T11:12:21.972 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.970+0000 7fbaea7fc640 20 handle_completion(): completion ok for obj=d[004.QP5FUNll-yBEJuQ0eZYoYyEe-MV] 2024-09-14T11:12:21.973 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.970+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:21.973 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.970+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:21.974 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.974+0000 7fbc0defc9c0 20 get_obj_state: octx=0x55b9b8cc8b40 obj=check-bucket:f state=0x55b9b8ccbff8 s->prefetch_data=0 2024-09-14T11:12:21.974 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.974+0000 7fbc0defc9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=c0wlmn54gtpd1s2i7o8zclps7fueyeu1 2024-09-14T11:12:21.974 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.974+0000 7fbaeaffd640 20 handle_completion(): completion ok for obj=c[ID.s8vKpDysCfIGTD5tuPom614AVZOH] 2024-09-14T11:12:21.974 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.974+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:21.974 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.974+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:21.976 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.974+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:21.977 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.974+0000 7fbc0defc9c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-14T11:12:21.977 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.974+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:21.977 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.974+0000 7fbc0defc9c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-14T11:12:21.977 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.974+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.1 2024-09-14T11:12:21.979 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.978+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.10 2024-09-14T11:12:21.982 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.982+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.10 2024-09-14T11:12:21.982 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.982+0000 7fbc0defc9c0 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-14T11:12:21.982 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.982+0000 7fbc0defc9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.1 2024-09-14T11:12:21.982 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.982+0000 7fbc0defc9c0 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-14T11:12:21.982 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.982+0000 7fbc0defc9c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-14T11:12:21.983 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.982+0000 7fbac1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:21.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.986+0000 7fbc0defc9c0 20 remove_watcher() i=0 2024-09-14T11:12:21.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.986+0000 7fbc0defc9c0 2 removed watcher, disabling cache 2024-09-14T11:12:21.990 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.990+0000 7fbc0defc9c0 20 remove_watcher() i=1 2024-09-14T11:12:21.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.990+0000 7fbc0defc9c0 20 remove_watcher() i=2 2024-09-14T11:12:21.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.994+0000 7fbc0defc9c0 20 remove_watcher() i=3 2024-09-14T11:12:21.996 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.994+0000 7fbc0defc9c0 20 remove_watcher() i=4 2024-09-14T11:12:21.998 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.998+0000 7fbc0defc9c0 20 remove_watcher() i=5 2024-09-14T11:12:22.001 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:21.998+0000 7fbc0defc9c0 20 remove_watcher() i=6 2024-09-14T11:12:22.004 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.002+0000 7fbc0defc9c0 20 remove_watcher() i=7 2024-09-14T11:12:22.034 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-14T11:12:22.034 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:12:22.106 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-14T11:12:22.106 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:12:22.106 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T11:12:22.144 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:22.144 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:22.192 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.190+0000 7f8e79f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:22.194 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.194+0000 7f8e79f269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:22.194 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.194+0000 7f8e79f269c0 20 realm 2024-09-14T11:12:22.194 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.194+0000 7f8e79f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:22.194 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.194+0000 7f8e79f269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:22.194 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.194+0000 7f8e79f269c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:22.195 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.194+0000 7f8e79f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:22.195 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.194+0000 7f8e79f269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:22.195 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.194+0000 7f8e79f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:22.195 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.194+0000 7f8e79f269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:22.196 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.194+0000 7f8e79f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:22.196 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.194+0000 7f8e79f269c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:22.197 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.194+0000 7f8e79f269c0 20 searching for the correct realm 2024-09-14T11:12:22.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.198+0000 7f8e7822d640 0 -- 172.21.15.71:0/1845580911 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f8e60070070 msgr2=0x7f8e60066330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:12:22.414 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.410+0000 7f8e7822d640 0 -- 172.21.15.71:0/1845580911 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x558bff030f00 msgr2=0x558bff0332f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:22.427 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.426+0000 7f8e79f269c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:22.427 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.426+0000 7f8e79f269c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:12:22.428 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.426+0000 7f8e79f269c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:22.428 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.426+0000 7f8e79f269c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:12:22.428 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.426+0000 7f8e79f269c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:22.428 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.426+0000 7f8e79f269c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:22.428 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.426+0000 7f8e79f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:22.428 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.426+0000 7f8e79f269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:22.428 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.426+0000 7f8e79f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:22.429 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.426+0000 7f8e79f269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:22.429 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.426+0000 7f8e79f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:22.430 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.430+0000 7f8e79f269c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:22.430 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.430+0000 7f8e79f269c0 20 zone default found 2024-09-14T11:12:22.430 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.430+0000 7f8e79f269c0 4 Realm: () 2024-09-14T11:12:22.430 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.430+0000 7f8e79f269c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:12:22.430 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.430+0000 7f8e79f269c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:12:22.430 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.430+0000 7f8e79f269c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:22.430 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.430+0000 7f8e79f269c0 20 zonegroup default 2024-09-14T11:12:22.431 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.430+0000 7f8e79f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:22.431 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.430+0000 7f8e79f269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:22.431 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.430+0000 7f8e79f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:22.431 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.430+0000 7f8e79f269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:22.431 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.430+0000 7f8e79f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:22.432 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.430+0000 7f8e79f269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:22.432 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.430+0000 7f8e79f269c0 20 started sync module instance, tier type = 2024-09-14T11:12:22.432 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.430+0000 7f8e79f269c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:12:22.455 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.454+0000 7f8e79f269c0 20 add_watcher() i=0 2024-09-14T11:12:22.455 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.454+0000 7f8e79f269c0 20 add_watcher() i=1 2024-09-14T11:12:22.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.454+0000 7f8e79f269c0 20 add_watcher() i=2 2024-09-14T11:12:22.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.454+0000 7f8e79f269c0 20 add_watcher() i=3 2024-09-14T11:12:22.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.454+0000 7f8e79f269c0 20 add_watcher() i=4 2024-09-14T11:12:22.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.454+0000 7f8e79f269c0 20 add_watcher() i=5 2024-09-14T11:12:22.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.454+0000 7f8e79f269c0 20 add_watcher() i=6 2024-09-14T11:12:22.458 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.458+0000 7f8e79f269c0 20 add_watcher() i=7 2024-09-14T11:12:22.458 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.458+0000 7f8e79f269c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:22.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.462+0000 7f8d2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:22.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.462+0000 7f8e79f269c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:22.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.462+0000 7f8e79f269c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:22.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.462+0000 7f8e79f269c0 5 note: GC not initialized 2024-09-14T11:12:22.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.462+0000 7f8d2cfe1640 20 reqs_thread_entry: start 2024-09-14T11:12:22.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.462+0000 7f8e79f269c0 20 init_complete bucket index max shards: 11 2024-09-14T11:12:22.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.462+0000 7f8e79f269c0 20 Filter name: none 2024-09-14T11:12:22.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.462+0000 7f8ca67fc640 20 reqs_thread_entry: start 2024-09-14T11:12:22.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.462+0000 7f8e79f269c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:12:22.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.462+0000 7f8e79f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:22.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.462+0000 7f8e79f269c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:12:22.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.462+0000 7f8e79f269c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:12:22.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.466+0000 7f8e79f269c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:12:22.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.466+0000 7f8e79f269c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 : miss 2024-09-14T11:12:22.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.466+0000 7f8e79f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:22.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.466+0000 7f8e79f269c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:12:22.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.466+0000 7f8e79f269c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 info.flags=0x17 2024-09-14T11:12:22.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.466+0000 7f8e79f269c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 to cache LRU end 2024-09-14T11:12:22.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.466+0000 7f8e79f269c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:12:22.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.466+0000 7f8e79f269c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:12:22.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.466+0000 7f8e79f269c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 2024-09-14T11:12:22.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.466+0000 7f8e79f269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.0 2024-09-14T11:12:22.468 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.466+0000 7f8e79f269c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:12:22.468 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.466+0000 7f8e79f269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.1 2024-09-14T11:12:22.468 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.466+0000 7f8e79f269c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:12:22.469 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.466+0000 7f8e79f269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.2 2024-09-14T11:12:22.469 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.466+0000 7f8e79f269c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:12:22.470 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.470+0000 7f8e79f269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.3 2024-09-14T11:12:22.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.470+0000 7f8e79f269c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:12:22.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.470+0000 7f8e79f269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.4 2024-09-14T11:12:22.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.470+0000 7f8e79f269c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:12:22.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.470+0000 7f8e79f269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:22.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.470+0000 7f8e79f269c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T11:12:22.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.470+0000 7f8e79f269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.6 2024-09-14T11:12:22.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.470+0000 7f8e79f269c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:12:22.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.470+0000 7f8e79f269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.7 2024-09-14T11:12:22.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.474+0000 7f8e79f269c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:12:22.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.474+0000 7f8e79f269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:22.475 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.474+0000 7f8e79f269c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T11:12:22.475 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.474+0000 7f8e79f269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.9 2024-09-14T11:12:22.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.474+0000 7f8e79f269c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:12:22.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.474+0000 7f8e79f269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.10 2024-09-14T11:12:22.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.474+0000 7f8e79f269c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:12:22.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.474+0000 7f8e79f269c0 1 NOTICE: finished all shards (0 entries found) 2024-09-14T11:12:22.478 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.478+0000 7f8d2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:22.483 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.482+0000 7f8e79f269c0 20 remove_watcher() i=0 2024-09-14T11:12:22.483 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.482+0000 7f8e79f269c0 2 removed watcher, disabling cache 2024-09-14T11:12:22.485 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.482+0000 7f8e79f269c0 20 remove_watcher() i=1 2024-09-14T11:12:22.488 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.486+0000 7f8e79f269c0 20 remove_watcher() i=2 2024-09-14T11:12:22.490 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.490+0000 7f8e79f269c0 20 remove_watcher() i=3 2024-09-14T11:12:22.492 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.490+0000 7f8e79f269c0 20 remove_watcher() i=4 2024-09-14T11:12:22.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.494+0000 7f8e79f269c0 20 remove_watcher() i=5 2024-09-14T11:12:22.497 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.494+0000 7f8e79f269c0 20 remove_watcher() i=6 2024-09-14T11:12:22.499 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.498+0000 7f8e79f269c0 20 remove_watcher() i=7 2024-09-14T11:12:22.558 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T11:12:22.590 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:22.590 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:22.634 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.634+0000 7f00674ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:22.637 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.634+0000 7f00674ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:22.637 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.634+0000 7f00674ea9c0 20 realm 2024-09-14T11:12:22.637 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.634+0000 7f00674ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:22.638 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.634+0000 7f00674ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:22.638 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.634+0000 7f00674ea9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:22.638 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.634+0000 7f00674ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:22.638 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.634+0000 7f00674ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:22.638 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.634+0000 7f00674ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:22.638 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.638+0000 7f00674ea9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:22.638 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.638+0000 7f00674ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:22.639 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.638+0000 7f00674ea9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:22.639 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.638+0000 7f00674ea9c0 20 searching for the correct realm 2024-09-14T11:12:22.643 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.642+0000 7f00657f1640 0 -- 172.21.15.71:0/3347540679 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f0058058e20 msgr2=0x7f005803b500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:12:22.857 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.854+0000 7f00657f1640 0 -- 172.21.15.71:0/3347540679 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55e2cbb5d8c0 msgr2=0x55e2cbb5fcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:22.873 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.870+0000 7f00674ea9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:22.873 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.870+0000 7f00674ea9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:12:22.873 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.870+0000 7f00674ea9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:22.873 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.870+0000 7f00674ea9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:12:22.874 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.870+0000 7f00674ea9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:22.874 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.870+0000 7f00674ea9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:22.874 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.870+0000 7f00674ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:22.874 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.874+0000 7f00674ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:22.874 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.874+0000 7f00674ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:22.874 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.874+0000 7f00674ea9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:22.874 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.874+0000 7f00674ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:22.876 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.874+0000 7f00674ea9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:22.876 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.874+0000 7f00674ea9c0 20 zone default found 2024-09-14T11:12:22.876 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.874+0000 7f00674ea9c0 4 Realm: () 2024-09-14T11:12:22.876 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.874+0000 7f00674ea9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:12:22.876 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.874+0000 7f00674ea9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:12:22.876 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.874+0000 7f00674ea9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:22.876 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.874+0000 7f00674ea9c0 20 zonegroup default 2024-09-14T11:12:22.876 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.874+0000 7f00674ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:22.877 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.874+0000 7f00674ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:22.877 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.874+0000 7f00674ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:22.877 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.874+0000 7f00674ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:22.877 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.874+0000 7f00674ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:22.878 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.878+0000 7f00674ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:22.878 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.878+0000 7f00674ea9c0 20 started sync module instance, tier type = 2024-09-14T11:12:22.878 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.878+0000 7f00674ea9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:12:22.903 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.902+0000 7f00674ea9c0 20 add_watcher() i=0 2024-09-14T11:12:22.903 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.902+0000 7f00674ea9c0 20 add_watcher() i=1 2024-09-14T11:12:22.903 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.902+0000 7f00674ea9c0 20 add_watcher() i=2 2024-09-14T11:12:22.903 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.902+0000 7f00674ea9c0 20 add_watcher() i=3 2024-09-14T11:12:22.903 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.902+0000 7f00674ea9c0 20 add_watcher() i=4 2024-09-14T11:12:22.903 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.902+0000 7f00674ea9c0 20 add_watcher() i=5 2024-09-14T11:12:22.903 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.902+0000 7f00674ea9c0 20 add_watcher() i=6 2024-09-14T11:12:22.905 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.902+0000 7f00674ea9c0 20 add_watcher() i=7 2024-09-14T11:12:22.906 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.902+0000 7f00674ea9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:22.910 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.910+0000 7eff1afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:22.911 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.910+0000 7f00674ea9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:22.911 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.910+0000 7f00674ea9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:22.911 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.910+0000 7f00674ea9c0 5 note: GC not initialized 2024-09-14T11:12:22.912 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.910+0000 7eff19fe3640 20 reqs_thread_entry: start 2024-09-14T11:12:22.912 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.910+0000 7f00674ea9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:12:22.912 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.910+0000 7f00674ea9c0 20 Filter name: none 2024-09-14T11:12:22.912 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.910+0000 7efe8b7fe640 20 reqs_thread_entry: start 2024-09-14T11:12:22.912 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.910+0000 7f00674ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:22.917 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.910+0000 7f00674ea9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:12:22.917 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.910+0000 7f00674ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:22.917 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.914+0000 7f00674ea9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:12:22.917 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.914+0000 7f00674ea9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:12:22.917 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.914+0000 7f00674ea9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:12:22.917 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.914+0000 7f00674ea9c0 20 INFO: main: starting shard=0 2024-09-14T11:12:22.917 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.914+0000 7f00674ea9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.0 2024-09-14T11:12:22.918 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.914+0000 7f00674ea9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:22.918 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.914+0000 7f00674ea9c0 20 INFO: main: starting shard=1 2024-09-14T11:12:22.918 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.914+0000 7f00674ea9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.1 2024-09-14T11:12:22.918 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.914+0000 7f00674ea9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:22.918 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.914+0000 7f00674ea9c0 20 INFO: main: starting shard=2 2024-09-14T11:12:22.918 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.914+0000 7f00674ea9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.2 2024-09-14T11:12:22.918 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.918+0000 7f00674ea9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:22.918 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.918+0000 7f00674ea9c0 20 INFO: main: starting shard=3 2024-09-14T11:12:22.918 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.918+0000 7f00674ea9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.3 2024-09-14T11:12:22.920 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.918+0000 7f00674ea9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:22.920 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.918+0000 7f00674ea9c0 20 INFO: main: starting shard=4 2024-09-14T11:12:22.920 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.918+0000 7f00674ea9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.4 2024-09-14T11:12:22.920 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.918+0000 7f00674ea9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:22.920 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.918+0000 7f00674ea9c0 20 INFO: main: starting shard=5 2024-09-14T11:12:22.921 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.918+0000 7f00674ea9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:22.921 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.918+0000 7f00674ea9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:22.921 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.918+0000 7f00674ea9c0 20 INFO: main: starting shard=6 2024-09-14T11:12:22.921 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.918+0000 7f00674ea9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.6 2024-09-14T11:12:22.923 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.922+0000 7f00674ea9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:22.923 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.922+0000 7f00674ea9c0 20 INFO: main: starting shard=7 2024-09-14T11:12:22.923 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.922+0000 7f00674ea9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.7 2024-09-14T11:12:22.924 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.922+0000 7f00674ea9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:22.924 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.922+0000 7f00674ea9c0 20 INFO: main: starting shard=8 2024-09-14T11:12:22.924 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.922+0000 7f00674ea9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:22.925 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.922+0000 7f00674ea9c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-14T11:12:22.925 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.922+0000 7f00674ea9c0 20 INFO: main: starting shard=9 2024-09-14T11:12:22.925 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.922+0000 7f00674ea9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.9 2024-09-14T11:12:22.926 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.926+0000 7f00674ea9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:22.926 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.926+0000 7f00674ea9c0 20 INFO: main: starting shard=10 2024-09-14T11:12:22.926 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.926+0000 7f00674ea9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.10 2024-09-14T11:12:22.926 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.926+0000 7f00674ea9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:22.926 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.926+0000 7f00674ea9c0 20 INFO: main: done 2024-09-14T11:12:22.928 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.926+0000 7eff1afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:22.933 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.930+0000 7f00674ea9c0 20 remove_watcher() i=0 2024-09-14T11:12:22.933 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.930+0000 7f00674ea9c0 2 removed watcher, disabling cache 2024-09-14T11:12:22.935 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.934+0000 7f00674ea9c0 20 remove_watcher() i=1 2024-09-14T11:12:22.938 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.938+0000 7f00674ea9c0 20 remove_watcher() i=2 2024-09-14T11:12:22.940 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.938+0000 7f00674ea9c0 20 remove_watcher() i=3 2024-09-14T11:12:22.943 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.942+0000 7f00674ea9c0 20 remove_watcher() i=4 2024-09-14T11:12:22.946 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.946+0000 7f00674ea9c0 20 remove_watcher() i=5 2024-09-14T11:12:22.949 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.946+0000 7f00674ea9c0 20 remove_watcher() i=6 2024-09-14T11:12:22.952 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:22.950+0000 7f00674ea9c0 20 remove_watcher() i=7 2024-09-14T11:12:22.971 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T11:12:23.003 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:23.003 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:23.048 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.046+0000 7f6f924da9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:23.050 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.050+0000 7f6f924da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:23.050 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.050+0000 7f6f924da9c0 20 realm 2024-09-14T11:12:23.050 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.050+0000 7f6f924da9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:23.051 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.050+0000 7f6f924da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:23.051 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.050+0000 7f6f924da9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:23.051 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.050+0000 7f6f924da9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:23.051 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.050+0000 7f6f924da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:23.051 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.050+0000 7f6f924da9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:23.052 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.050+0000 7f6f924da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:23.052 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.050+0000 7f6f924da9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:23.053 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.050+0000 7f6f924da9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:23.053 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.050+0000 7f6f924da9c0 20 searching for the correct realm 2024-09-14T11:12:23.057 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.054+0000 7f6f907e1640 0 -- 172.21.15.71:0/2261229883 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f6f78048040 msgr2=0x7f6f7801c940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:12:23.270 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.270+0000 7f6f907e1640 0 -- 172.21.15.71:0/2261229883 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55d4fc2beb10 msgr2=0x55d4fc2c0f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:23.285 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.282+0000 7f6f924da9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:23.286 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.282+0000 7f6f924da9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:12:23.286 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.282+0000 7f6f924da9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:23.286 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.282+0000 7f6f924da9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:12:23.286 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.282+0000 7f6f924da9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:23.286 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.282+0000 7f6f924da9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:23.286 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.282+0000 7f6f924da9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:23.286 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.286+0000 7f6f924da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:23.287 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.286+0000 7f6f924da9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:23.287 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.286+0000 7f6f924da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:23.287 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.286+0000 7f6f924da9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:23.288 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.286+0000 7f6f924da9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:23.288 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.286+0000 7f6f924da9c0 20 zone default found 2024-09-14T11:12:23.288 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.286+0000 7f6f924da9c0 4 Realm: () 2024-09-14T11:12:23.288 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.286+0000 7f6f924da9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:12:23.288 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.286+0000 7f6f924da9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:12:23.289 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.286+0000 7f6f924da9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:23.289 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.286+0000 7f6f924da9c0 20 zonegroup default 2024-09-14T11:12:23.289 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.286+0000 7f6f924da9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:23.289 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.286+0000 7f6f924da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:23.289 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.286+0000 7f6f924da9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:23.290 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.286+0000 7f6f924da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:23.290 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.286+0000 7f6f924da9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:23.290 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.290+0000 7f6f924da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:23.290 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.290+0000 7f6f924da9c0 20 started sync module instance, tier type = 2024-09-14T11:12:23.290 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.290+0000 7f6f924da9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:12:23.316 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.314+0000 7f6f924da9c0 20 add_watcher() i=0 2024-09-14T11:12:23.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.314+0000 7f6f924da9c0 20 add_watcher() i=1 2024-09-14T11:12:23.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.314+0000 7f6f924da9c0 20 add_watcher() i=2 2024-09-14T11:12:23.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.314+0000 7f6f924da9c0 20 add_watcher() i=3 2024-09-14T11:12:23.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.314+0000 7f6f924da9c0 20 add_watcher() i=4 2024-09-14T11:12:23.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.314+0000 7f6f924da9c0 20 add_watcher() i=5 2024-09-14T11:12:23.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.314+0000 7f6f924da9c0 20 add_watcher() i=6 2024-09-14T11:12:23.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.318+0000 7f6f924da9c0 20 add_watcher() i=7 2024-09-14T11:12:23.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.318+0000 7f6f924da9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:23.323 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.322+0000 7f6e45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:23.325 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.322+0000 7f6f924da9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:23.325 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.322+0000 7f6f924da9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:23.325 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.322+0000 7f6f924da9c0 5 note: GC not initialized 2024-09-14T11:12:23.325 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.322+0000 7f6e44fe1640 20 reqs_thread_entry: start 2024-09-14T11:12:23.326 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.322+0000 7f6f924da9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:12:23.326 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.322+0000 7f6f924da9c0 20 Filter name: none 2024-09-14T11:12:23.326 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.322+0000 7f6dbe7fc640 20 reqs_thread_entry: start 2024-09-14T11:12:23.326 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.326+0000 7f6f924da9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:23.327 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.326+0000 7f6f924da9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:12:23.327 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.326+0000 7f6f924da9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:23.328 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.326+0000 7f6f924da9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:12:23.328 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.326+0000 7f6f924da9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:12:23.329 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.326+0000 7f6f924da9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:12:23.329 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.326+0000 7f6f924da9c0 20 INFO: main: starting shard=0 2024-09-14T11:12:23.329 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.326+0000 7f6f924da9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.0 2024-09-14T11:12:23.329 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.326+0000 7f6f924da9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:23.329 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.326+0000 7f6f924da9c0 20 INFO: main: starting shard=1 2024-09-14T11:12:23.329 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.326+0000 7f6f924da9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.1 2024-09-14T11:12:23.330 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.330+0000 7f6f924da9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:23.330 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.330+0000 7f6f924da9c0 20 INFO: main: starting shard=2 2024-09-14T11:12:23.330 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.330+0000 7f6f924da9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.2 2024-09-14T11:12:23.331 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.330+0000 7f6f924da9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:23.332 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.330+0000 7f6f924da9c0 20 INFO: main: starting shard=3 2024-09-14T11:12:23.332 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.330+0000 7f6f924da9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.3 2024-09-14T11:12:23.333 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.330+0000 7f6f924da9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:23.333 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.330+0000 7f6f924da9c0 20 INFO: main: starting shard=4 2024-09-14T11:12:23.333 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.330+0000 7f6f924da9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.4 2024-09-14T11:12:23.333 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.330+0000 7f6f924da9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:23.334 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.330+0000 7f6f924da9c0 20 INFO: main: starting shard=5 2024-09-14T11:12:23.334 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.330+0000 7f6f924da9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:23.334 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.334+0000 7f6f924da9c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-14T11:12:23.334 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.334+0000 7f6f924da9c0 20 INFO: main: starting shard=6 2024-09-14T11:12:23.334 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.334+0000 7f6f924da9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.6 2024-09-14T11:12:23.335 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.334+0000 7f6f924da9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:23.335 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.334+0000 7f6f924da9c0 20 INFO: main: starting shard=7 2024-09-14T11:12:23.335 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.334+0000 7f6f924da9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.7 2024-09-14T11:12:23.337 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.334+0000 7f6f924da9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:23.337 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.334+0000 7f6f924da9c0 20 INFO: main: starting shard=8 2024-09-14T11:12:23.337 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.334+0000 7f6f924da9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:23.338 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.334+0000 7f6f924da9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:23.338 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.334+0000 7f6f924da9c0 20 INFO: main: starting shard=9 2024-09-14T11:12:23.338 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.334+0000 7f6f924da9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.9 2024-09-14T11:12:23.339 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.338+0000 7f6f924da9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:23.339 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.338+0000 7f6f924da9c0 20 INFO: main: starting shard=10 2024-09-14T11:12:23.339 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.338+0000 7f6f924da9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.10 2024-09-14T11:12:23.340 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.338+0000 7f6f924da9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:23.340 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.338+0000 7f6f924da9c0 20 INFO: main: done 2024-09-14T11:12:23.341 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.338+0000 7f6e45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:23.345 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.342+0000 7f6f924da9c0 20 remove_watcher() i=0 2024-09-14T11:12:23.346 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.342+0000 7f6f924da9c0 2 removed watcher, disabling cache 2024-09-14T11:12:23.348 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.346+0000 7f6f924da9c0 20 remove_watcher() i=1 2024-09-14T11:12:23.350 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.350+0000 7f6f924da9c0 20 remove_watcher() i=2 2024-09-14T11:12:23.352 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.350+0000 7f6f924da9c0 20 remove_watcher() i=3 2024-09-14T11:12:23.354 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.354+0000 7f6f924da9c0 20 remove_watcher() i=4 2024-09-14T11:12:23.357 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.354+0000 7f6f924da9c0 20 remove_watcher() i=5 2024-09-14T11:12:23.359 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.358+0000 7f6f924da9c0 20 remove_watcher() i=6 2024-09-14T11:12:23.362 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.362+0000 7f6f924da9c0 20 remove_watcher() i=7 2024-09-14T11:12:23.379 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-14T11:12:23.379 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:12:23.380 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-14T11:12:23.413 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:23.413 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:23.458 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.458+0000 7f9b012cb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:23.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.458+0000 7f9b012cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:23.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.458+0000 7f9b012cb9c0 20 realm 2024-09-14T11:12:23.461 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.458+0000 7f9b012cb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:23.461 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.458+0000 7f9b012cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:23.461 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.458+0000 7f9b012cb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:23.461 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.458+0000 7f9b012cb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:23.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.458+0000 7f9b012cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:23.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.458+0000 7f9b012cb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:23.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.462+0000 7f9b012cb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:23.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.462+0000 7f9b012cb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:23.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.462+0000 7f9b012cb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:23.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.462+0000 7f9b012cb9c0 20 searching for the correct realm 2024-09-14T11:12:23.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.466+0000 7f9afe5d0640 0 -- 172.21.15.71:0/3207706030 >> [v2:172.21.15.71:6808/1268087573,v1:172.21.15.71:6809/1268087573] conn(0x55a3e718e190 msgr2=0x55a3e7190650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:23.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.470+0000 7f9afe5d0640 0 -- 172.21.15.71:0/3207706030 >> [v2:172.21.15.157:6800/3420822707,v1:172.21.15.157:6801/3420822707] conn(0x7f9ae8003100 msgr2=0x7f9af4080800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:23.692 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.690+0000 7f9b012cb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:23.692 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.690+0000 7f9b012cb9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:12:23.692 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.690+0000 7f9b012cb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:23.692 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.690+0000 7f9b012cb9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:12:23.693 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.690+0000 7f9b012cb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:23.693 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.690+0000 7f9b012cb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:23.693 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.690+0000 7f9b012cb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:23.693 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.690+0000 7f9b012cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:23.693 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.690+0000 7f9b012cb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:23.693 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.690+0000 7f9b012cb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:23.694 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.690+0000 7f9b012cb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:23.694 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.694+0000 7f9b012cb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:23.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.694+0000 7f9b012cb9c0 20 zone default found 2024-09-14T11:12:23.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.694+0000 7f9b012cb9c0 4 Realm: () 2024-09-14T11:12:23.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.694+0000 7f9b012cb9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:12:23.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.694+0000 7f9b012cb9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:12:23.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.694+0000 7f9b012cb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:23.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.694+0000 7f9b012cb9c0 20 zonegroup default 2024-09-14T11:12:23.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.694+0000 7f9b012cb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:23.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.694+0000 7f9b012cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:23.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.694+0000 7f9b012cb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:23.697 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.694+0000 7f9b012cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:23.697 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.694+0000 7f9b012cb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:23.697 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.694+0000 7f9b012cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:23.697 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.694+0000 7f9b012cb9c0 20 started sync module instance, tier type = 2024-09-14T11:12:23.697 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.694+0000 7f9b012cb9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:12:23.724 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.722+0000 7f9b012cb9c0 20 add_watcher() i=0 2024-09-14T11:12:23.724 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.722+0000 7f9b012cb9c0 20 add_watcher() i=1 2024-09-14T11:12:23.724 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.722+0000 7f9b012cb9c0 20 add_watcher() i=2 2024-09-14T11:12:23.724 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.722+0000 7f9b012cb9c0 20 add_watcher() i=3 2024-09-14T11:12:23.725 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.722+0000 7f9b012cb9c0 20 add_watcher() i=4 2024-09-14T11:12:23.725 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.722+0000 7f9b012cb9c0 20 add_watcher() i=5 2024-09-14T11:12:23.725 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.722+0000 7f9b012cb9c0 20 add_watcher() i=6 2024-09-14T11:12:23.726 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.726+0000 7f9b012cb9c0 20 add_watcher() i=7 2024-09-14T11:12:23.726 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.726+0000 7f9b012cb9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:23.731 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.730+0000 7f99b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:23.732 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.730+0000 7f9b012cb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:23.732 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.730+0000 7f9b012cb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:23.732 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.730+0000 7f9b012cb9c0 5 note: GC not initialized 2024-09-14T11:12:23.732 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.730+0000 7f992ffff640 20 reqs_thread_entry: start 2024-09-14T11:12:23.732 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.730+0000 7f9b012cb9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:12:23.733 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.730+0000 7f9b012cb9c0 20 Filter name: none 2024-09-14T11:12:23.733 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.730+0000 7f992dffb640 20 reqs_thread_entry: start 2024-09-14T11:12:23.733 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.730+0000 7f9b012cb9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:12:23.733 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.730+0000 7f9b012cb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:23.734 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.734+0000 7f9b012cb9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:12:23.734 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.734+0000 7f9b012cb9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:12:23.734 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.734+0000 7f9b012cb9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:12:23.734 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.734+0000 7f9b012cb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 : miss 2024-09-14T11:12:23.734 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.734+0000 7f9b012cb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:23.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.734+0000 7f9b012cb9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:12:23.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.734+0000 7f9b012cb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 info.flags=0x17 2024-09-14T11:12:23.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.734+0000 7f9b012cb9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 to cache LRU end 2024-09-14T11:12:23.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.734+0000 7f9b012cb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:12:23.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.734+0000 7f9b012cb9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:12:23.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.734+0000 7f9b012cb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 2024-09-14T11:12:23.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.734+0000 7f9b012cb9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.0 2024-09-14T11:12:23.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.734+0000 7f9b012cb9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:12:23.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.734+0000 7f9b012cb9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.1 2024-09-14T11:12:23.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.734+0000 7f9b012cb9c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:12:23.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.734+0000 7f9b012cb9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.2 2024-09-14T11:12:23.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.738+0000 7f9b012cb9c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:12:23.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.738+0000 7f9b012cb9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.3 2024-09-14T11:12:23.740 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.738+0000 7f9b012cb9c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:12:23.740 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.738+0000 7f9b012cb9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.4 2024-09-14T11:12:23.741 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.738+0000 7f9b012cb9c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:12:23.741 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.738+0000 7f9b012cb9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:23.741 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.738+0000 7f9b012cb9c0 1 NOTICE: finished shard 5 (1 entries found) 2024-09-14T11:12:23.741 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.738+0000 7f9b012cb9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.6 2024-09-14T11:12:23.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.742+0000 7f9b012cb9c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:12:23.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.742+0000 7f9b012cb9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.7 2024-09-14T11:12:23.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.742+0000 7f9b012cb9c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:12:23.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.742+0000 7f9b012cb9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:23.745 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.742+0000 7f9b012cb9c0 1 NOTICE: finished shard 8 (1 entries found) 2024-09-14T11:12:23.745 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.742+0000 7f9b012cb9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.9 2024-09-14T11:12:23.746 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.746+0000 7f9b012cb9c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:12:23.747 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.746+0000 7f9b012cb9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.10 2024-09-14T11:12:23.747 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.746+0000 7f9b012cb9c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:12:23.747 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.746+0000 7f9b012cb9c0 1 NOTICE: finished all shards (2 entries found) 2024-09-14T11:12:23.749 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.746+0000 7f99b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:23.754 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.754+0000 7f9b012cb9c0 20 remove_watcher() i=0 2024-09-14T11:12:23.754 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.754+0000 7f9b012cb9c0 2 removed watcher, disabling cache 2024-09-14T11:12:23.756 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.754+0000 7f9b012cb9c0 20 remove_watcher() i=1 2024-09-14T11:12:23.758 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.758+0000 7f9b012cb9c0 20 remove_watcher() i=2 2024-09-14T11:12:23.761 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.758+0000 7f9b012cb9c0 20 remove_watcher() i=3 2024-09-14T11:12:23.763 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.762+0000 7f9b012cb9c0 20 remove_watcher() i=4 2024-09-14T11:12:23.765 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.762+0000 7f9b012cb9c0 20 remove_watcher() i=5 2024-09-14T11:12:23.767 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.766+0000 7f9b012cb9c0 20 remove_watcher() i=6 2024-09-14T11:12:23.771 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.770+0000 7f9b012cb9c0 20 remove_watcher() i=7 2024-09-14T11:12:23.788 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-14T11:12:23.788 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:12:23.788 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:12:23.821 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:23.822 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:23.866 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.866+0000 7f61a72e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:23.869 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.866+0000 7f61a72e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:23.869 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.866+0000 7f61a72e09c0 20 realm 2024-09-14T11:12:23.869 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.866+0000 7f61a72e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:23.870 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.866+0000 7f61a72e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:23.870 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.866+0000 7f61a72e09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:23.870 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.866+0000 7f61a72e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:23.870 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.870+0000 7f61a72e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:23.870 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.870+0000 7f61a72e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:23.871 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.870+0000 7f61a72e09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:23.871 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.870+0000 7f61a72e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:23.872 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.870+0000 7f61a72e09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:23.872 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.870+0000 7f61a72e09c0 20 searching for the correct realm 2024-09-14T11:12:23.876 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:23.874+0000 7f61a55e7640 0 -- 172.21.15.71:0/1781344621 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x55b60504d5d0 msgr2=0x7f6198071fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:24.090 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.086+0000 7f61a55e7640 0 -- 172.21.15.71:0/1781344621 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55b60506fb00 msgr2=0x55b605071f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:24.105 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.102+0000 7f61a72e09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:24.105 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.102+0000 7f61a72e09c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:12:24.105 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.102+0000 7f61a72e09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:24.106 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.102+0000 7f61a72e09c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:12:24.106 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.102+0000 7f61a72e09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:24.106 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.102+0000 7f61a72e09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:24.106 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.102+0000 7f61a72e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.107 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.102+0000 7f61a72e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:24.107 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.102+0000 7f61a72e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.107 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.106+0000 7f61a72e09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:24.107 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.106+0000 7f61a72e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.108 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.106+0000 7f61a72e09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:24.109 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.106+0000 7f61a72e09c0 20 zone default found 2024-09-14T11:12:24.109 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.106+0000 7f61a72e09c0 4 Realm: () 2024-09-14T11:12:24.109 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.106+0000 7f61a72e09c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:12:24.109 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.106+0000 7f61a72e09c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:12:24.109 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.106+0000 7f61a72e09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:24.109 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.106+0000 7f61a72e09c0 20 zonegroup default 2024-09-14T11:12:24.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.106+0000 7f61a72e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.106+0000 7f61a72e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:24.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.106+0000 7f61a72e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.111 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.106+0000 7f61a72e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:24.111 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.106+0000 7f61a72e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.111 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.106+0000 7f61a72e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:24.111 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.106+0000 7f61a72e09c0 20 started sync module instance, tier type = 2024-09-14T11:12:24.111 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.106+0000 7f61a72e09c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:12:24.136 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.134+0000 7f61a72e09c0 20 add_watcher() i=0 2024-09-14T11:12:24.136 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.134+0000 7f61a72e09c0 20 add_watcher() i=1 2024-09-14T11:12:24.137 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.134+0000 7f61a72e09c0 20 add_watcher() i=2 2024-09-14T11:12:24.137 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.134+0000 7f61a72e09c0 20 add_watcher() i=3 2024-09-14T11:12:24.137 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.134+0000 7f61a72e09c0 20 add_watcher() i=4 2024-09-14T11:12:24.137 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.134+0000 7f61a72e09c0 20 add_watcher() i=5 2024-09-14T11:12:24.137 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.134+0000 7f61a72e09c0 20 add_watcher() i=6 2024-09-14T11:12:24.139 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.138+0000 7f61a72e09c0 20 add_watcher() i=7 2024-09-14T11:12:24.139 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.138+0000 7f61a72e09c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:24.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.142+0000 7f605afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:24.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.142+0000 7f61a72e09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:24.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.142+0000 7f61a72e09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:24.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.142+0000 7f61a72e09c0 5 note: GC not initialized 2024-09-14T11:12:24.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.142+0000 7f6059fe3640 20 reqs_thread_entry: start 2024-09-14T11:12:24.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.142+0000 7f61a72e09c0 20 init_complete bucket index max shards: 11 2024-09-14T11:12:24.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.142+0000 7f61a72e09c0 20 Filter name: none 2024-09-14T11:12:24.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.142+0000 7f5fcb7fe640 20 reqs_thread_entry: start 2024-09-14T11:12:24.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.146+0000 7f61a72e09c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:12:24.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.146+0000 7f61a72e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.147 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.146+0000 7f61a72e09c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:12:24.147 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.146+0000 7f61a72e09c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:12:24.147 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.146+0000 7f61a72e09c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:12:24.147 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.146+0000 7f61a72e09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 : miss 2024-09-14T11:12:24.147 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.146+0000 7f61a72e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.148 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.146+0000 7f61a72e09c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:12:24.148 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.146+0000 7f61a72e09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 info.flags=0x17 2024-09-14T11:12:24.148 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.146+0000 7f61a72e09c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 to cache LRU end 2024-09-14T11:12:24.148 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.146+0000 7f61a72e09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:12:24.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.146+0000 7f61a72e09c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:12:24.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.146+0000 7f61a72e09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 2024-09-14T11:12:24.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.146+0000 7f61a72e09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.0 2024-09-14T11:12:24.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.146+0000 7f61a72e09c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:12:24.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.146+0000 7f61a72e09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.1 2024-09-14T11:12:24.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.150+0000 7f61a72e09c0 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-14T11:12:24.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.150+0000 7f61a72e09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.2 2024-09-14T11:12:24.152 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.150+0000 7f61a72e09c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:12:24.152 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.150+0000 7f61a72e09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.3 2024-09-14T11:12:24.157 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.150+0000 7f61a72e09c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:12:24.157 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.150+0000 7f61a72e09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.4 2024-09-14T11:12:24.158 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.154+0000 7f61a72e09c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:12:24.158 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.154+0000 7f61a72e09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:24.159 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.154+0000 7f61a72e09c0 20 get_obj_state: octx=0x55b604d65290 obj=check-bucket:d state=0x55b6050ab198 s->prefetch_data=0 2024-09-14T11:12:24.159 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.154+0000 7f61a72e09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.6 2024-09-14T11:12:24.159 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.154+0000 7f61a72e09c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:12:24.159 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.154+0000 7f61a72e09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.7 2024-09-14T11:12:24.159 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.154+0000 7f61a72e09c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:12:24.159 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.154+0000 7f61a72e09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:24.159 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.158+0000 7f61a72e09c0 20 get_obj_state: octx=0x55b604e07450 obj=check-bucket:c state=0x55b6050a6608 s->prefetch_data=0 2024-09-14T11:12:24.159 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.158+0000 7f61a72e09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.9 2024-09-14T11:12:24.159 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.158+0000 7f61a72e09c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-14T11:12:24.159 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.158+0000 7f61a72e09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.10 2024-09-14T11:12:24.160 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.158+0000 7f61a72e09c0 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-14T11:12:24.161 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.158+0000 7f61a72e09c0 20 get_obj_state: setting s->obj_tag to oc062nenu9h9k9e9yscliuzzf5nr998l 2024-09-14T11:12:24.161 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.158+0000 7f61a72e09c0 20 get_obj_state_impl: setting s->olh_tag to 1uwfkl6or70l3k1b3k9jpilz4kkc807h 2024-09-14T11:12:24.161 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.158+0000 7f61a72e09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:24.161 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.158+0000 7f61a72e09c0 20 get_obj_state: setting s->obj_tag to xi7rb3mtk6wlnyn7g0gnsqkst197hwft 2024-09-14T11:12:24.161 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.158+0000 7f61a72e09c0 20 get_obj_state_impl: setting s->olh_tag to 32x0rwovytdsuw77qq86rm01wy7x0p6l 2024-09-14T11:12:24.161 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.158+0000 7f61a72e09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:24.162 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.158+0000 7f61a72e09c0 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-14T11:12:24.162 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.158+0000 7f61a72e09c0 20 olh_log_entry: epoch=4 op=3 key=d[ccL4zOPzOBjSmVpYAREqMBg0N6L6.3H] 2024-09-14T11:12:24.162 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.158+0000 7f61a72e09c0 20 get_obj_state: octx=0x55b6050d2fa0 obj=check-bucket:_:ccL4zOPzOBjSmVpYAREqMBg0N6L6.3H_d state=0x55b6050f79f8 s->prefetch_data=0 2024-09-14T11:12:24.162 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.158+0000 7f61a72e09c0 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-14T11:12:24.162 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.158+0000 7f61a72e09c0 20 olh_log_entry: epoch=4 op=3 key=c[Emfhg..-dtJqdKGWImj31LcQp7gZVTr] 2024-09-14T11:12:24.162 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.158+0000 7f61a72e09c0 20 get_obj_state: octx=0x55b6050f2fa0 obj=check-bucket:_:Emfhg..-dtJqdKGWImj31LcQp7gZVTr_c state=0x55b6050fe9b8 s->prefetch_data=0 2024-09-14T11:12:24.164 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.162+0000 7f61a72e09c0 20 get_obj_state: octx=0x55b6050d2fa0 obj=check-bucket:d state=0x55b6050fe9b8 s->prefetch_data=0 2024-09-14T11:12:24.164 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.162+0000 7f61a72e09c0 20 get_obj_state: octx=0x55b6050f2fa0 obj=check-bucket:c state=0x55b6050fff28 s->prefetch_data=0 2024-09-14T11:12:24.165 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.162+0000 7f61a72e09c0 20 get_obj_state: setting s->obj_tag to xi7rb3mtk6wlnyn7g0gnsqkst197hwft 2024-09-14T11:12:24.165 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.162+0000 7f61a72e09c0 20 get_obj_state_impl: setting s->olh_tag to 32x0rwovytdsuw77qq86rm01wy7x0p6l 2024-09-14T11:12:24.165 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.162+0000 7f61a72e09c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=32x0rwovytdsuw77qq86rm01wy7x0p6l 2024-09-14T11:12:24.165 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.162+0000 7f61a72e09c0 20 get_obj_state: setting s->obj_tag to oc062nenu9h9k9e9yscliuzzf5nr998l 2024-09-14T11:12:24.165 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.162+0000 7f61a72e09c0 20 get_obj_state_impl: setting s->olh_tag to 1uwfkl6or70l3k1b3k9jpilz4kkc807h 2024-09-14T11:12:24.165 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.162+0000 7f61a72e09c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=1uwfkl6or70l3k1b3k9jpilz4kkc807h 2024-09-14T11:12:24.169 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.166+0000 7f61a72e09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:24.169 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.166+0000 7f61a72e09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:24.171 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.170+0000 7f61a72e09c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-14T11:12:24.172 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.170+0000 7f61a72e09c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-14T11:12:24.172 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.170+0000 7f61a72e09c0 1 NOTICE: finished all shards (2 entries removed) 2024-09-14T11:12:24.173 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.170+0000 7f605afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:24.178 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.178+0000 7f61a72e09c0 20 remove_watcher() i=0 2024-09-14T11:12:24.178 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.178+0000 7f61a72e09c0 2 removed watcher, disabling cache 2024-09-14T11:12:24.180 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.178+0000 7f61a72e09c0 20 remove_watcher() i=1 2024-09-14T11:12:24.182 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.182+0000 7f61a72e09c0 20 remove_watcher() i=2 2024-09-14T11:12:24.185 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.182+0000 7f61a72e09c0 20 remove_watcher() i=3 2024-09-14T11:12:24.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.186+0000 7f61a72e09c0 20 remove_watcher() i=4 2024-09-14T11:12:24.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.190+0000 7f61a72e09c0 20 remove_watcher() i=5 2024-09-14T11:12:24.193 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.190+0000 7f61a72e09c0 20 remove_watcher() i=6 2024-09-14T11:12:24.196 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.194+0000 7f61a72e09c0 20 remove_watcher() i=7 2024-09-14T11:12:24.215 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T11:12:24.248 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:24.248 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:24.293 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.290+0000 7fa0d75349c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.296 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.294+0000 7fa0d75349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:24.296 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.294+0000 7fa0d75349c0 20 realm 2024-09-14T11:12:24.297 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.294+0000 7fa0d75349c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.297 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.294+0000 7fa0d75349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:24.297 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.294+0000 7fa0d75349c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:24.297 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.294+0000 7fa0d75349c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.297 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.294+0000 7fa0d75349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:24.298 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.294+0000 7fa0d75349c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.298 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.294+0000 7fa0d75349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:24.299 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.294+0000 7fa0d75349c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.299 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.298+0000 7fa0d75349c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:24.299 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.298+0000 7fa0d75349c0 20 searching for the correct realm 2024-09-14T11:12:24.303 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.302+0000 7fa0d503a640 0 -- 172.21.15.71:0/9706858 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x55ec52bce830 msgr2=0x55ec52bd0cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:24.308 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.306+0000 7fa0d583b640 0 -- 172.21.15.71:0/9706858 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55ec52bc9ac0 msgr2=0x55ec52bcbeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:24.316 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.314+0000 7fa0d75349c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:24.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.314+0000 7fa0d75349c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:12:24.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.314+0000 7fa0d75349c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:24.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.314+0000 7fa0d75349c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:12:24.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.314+0000 7fa0d75349c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:24.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.314+0000 7fa0d75349c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:24.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.314+0000 7fa0d75349c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.314+0000 7fa0d75349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:24.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.314+0000 7fa0d75349c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.314+0000 7fa0d75349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:24.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.314+0000 7fa0d75349c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.318+0000 7fa0d75349c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:24.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.318+0000 7fa0d75349c0 20 zone default found 2024-09-14T11:12:24.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.318+0000 7fa0d75349c0 4 Realm: () 2024-09-14T11:12:24.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.318+0000 7fa0d75349c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:12:24.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.318+0000 7fa0d75349c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:12:24.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.318+0000 7fa0d75349c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:24.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.318+0000 7fa0d75349c0 20 zonegroup default 2024-09-14T11:12:24.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.318+0000 7fa0d75349c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.318+0000 7fa0d75349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:24.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.318+0000 7fa0d75349c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.318+0000 7fa0d75349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:24.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.318+0000 7fa0d75349c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.320 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.318+0000 7fa0d75349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:24.320 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.318+0000 7fa0d75349c0 20 started sync module instance, tier type = 2024-09-14T11:12:24.320 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.318+0000 7fa0d75349c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:12:24.339 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.338+0000 7fa0d75349c0 20 add_watcher() i=0 2024-09-14T11:12:24.340 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.338+0000 7fa0d75349c0 20 add_watcher() i=1 2024-09-14T11:12:24.340 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.338+0000 7fa0d75349c0 20 add_watcher() i=2 2024-09-14T11:12:24.340 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.338+0000 7fa0d75349c0 20 add_watcher() i=3 2024-09-14T11:12:24.340 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.338+0000 7fa0d75349c0 20 add_watcher() i=4 2024-09-14T11:12:24.340 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.338+0000 7fa0d75349c0 20 add_watcher() i=5 2024-09-14T11:12:24.340 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.338+0000 7fa0d75349c0 20 add_watcher() i=6 2024-09-14T11:12:24.342 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.342+0000 7fa0d75349c0 20 add_watcher() i=7 2024-09-14T11:12:24.342 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.342+0000 7fa0d75349c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:24.345 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.342+0000 7f9f8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:24.346 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.346+0000 7fa0d75349c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:24.346 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.346+0000 7fa0d75349c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:24.346 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.346+0000 7fa0d75349c0 5 note: GC not initialized 2024-09-14T11:12:24.346 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.346+0000 7f9f8a7e4640 20 reqs_thread_entry: start 2024-09-14T11:12:24.347 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.346+0000 7fa0d75349c0 20 init_complete bucket index max shards: 11 2024-09-14T11:12:24.347 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.346+0000 7fa0d75349c0 20 Filter name: none 2024-09-14T11:12:24.347 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.346+0000 7f9efbfff640 20 reqs_thread_entry: start 2024-09-14T11:12:24.347 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.346+0000 7fa0d75349c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.347 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.346+0000 7fa0d75349c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:12:24.347 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.346+0000 7fa0d75349c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.348 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.346+0000 7fa0d75349c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:12:24.348 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.346+0000 7fa0d75349c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:12:24.349 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.346+0000 7fa0d75349c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:12:24.349 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.346+0000 7fa0d75349c0 20 INFO: main: starting shard=0 2024-09-14T11:12:24.349 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.346+0000 7fa0d75349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.0 2024-09-14T11:12:24.349 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.346+0000 7fa0d75349c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:24.349 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.346+0000 7fa0d75349c0 20 INFO: main: starting shard=1 2024-09-14T11:12:24.349 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.346+0000 7fa0d75349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.1 2024-09-14T11:12:24.350 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.346+0000 7fa0d75349c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:24.350 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.346+0000 7fa0d75349c0 20 INFO: main: starting shard=2 2024-09-14T11:12:24.350 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.346+0000 7fa0d75349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.2 2024-09-14T11:12:24.351 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.350+0000 7fa0d75349c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:24.351 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.350+0000 7fa0d75349c0 20 INFO: main: starting shard=3 2024-09-14T11:12:24.351 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.350+0000 7fa0d75349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.3 2024-09-14T11:12:24.352 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.350+0000 7fa0d75349c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:24.352 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.350+0000 7fa0d75349c0 20 INFO: main: starting shard=4 2024-09-14T11:12:24.352 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.350+0000 7fa0d75349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.4 2024-09-14T11:12:24.352 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.350+0000 7fa0d75349c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:24.352 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.350+0000 7fa0d75349c0 20 INFO: main: starting shard=5 2024-09-14T11:12:24.352 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.350+0000 7fa0d75349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:24.353 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.350+0000 7fa0d75349c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:24.353 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.350+0000 7fa0d75349c0 20 INFO: main: starting shard=6 2024-09-14T11:12:24.353 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.350+0000 7fa0d75349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.6 2024-09-14T11:12:24.354 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.354+0000 7fa0d75349c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:24.354 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.354+0000 7fa0d75349c0 20 INFO: main: starting shard=7 2024-09-14T11:12:24.354 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.354+0000 7fa0d75349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.7 2024-09-14T11:12:24.355 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.354+0000 7fa0d75349c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:24.355 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.354+0000 7fa0d75349c0 20 INFO: main: starting shard=8 2024-09-14T11:12:24.355 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.354+0000 7fa0d75349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:24.355 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.354+0000 7fa0d75349c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:24.355 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.354+0000 7fa0d75349c0 20 INFO: main: starting shard=9 2024-09-14T11:12:24.355 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.354+0000 7fa0d75349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.9 2024-09-14T11:12:24.356 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.354+0000 7fa0d75349c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:24.356 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.354+0000 7fa0d75349c0 20 INFO: main: starting shard=10 2024-09-14T11:12:24.357 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.354+0000 7fa0d75349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.10 2024-09-14T11:12:24.357 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.354+0000 7fa0d75349c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:24.357 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.354+0000 7fa0d75349c0 20 INFO: main: done 2024-09-14T11:12:24.358 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.358+0000 7f9f8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:24.362 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.362+0000 7fa0d75349c0 20 remove_watcher() i=0 2024-09-14T11:12:24.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.362+0000 7fa0d75349c0 2 removed watcher, disabling cache 2024-09-14T11:12:24.364 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.362+0000 7fa0d75349c0 20 remove_watcher() i=1 2024-09-14T11:12:24.367 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.366+0000 7fa0d75349c0 20 remove_watcher() i=2 2024-09-14T11:12:24.369 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.366+0000 7fa0d75349c0 20 remove_watcher() i=3 2024-09-14T11:12:24.371 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.370+0000 7fa0d75349c0 20 remove_watcher() i=4 2024-09-14T11:12:24.373 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.370+0000 7fa0d75349c0 20 remove_watcher() i=5 2024-09-14T11:12:24.376 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.374+0000 7fa0d75349c0 20 remove_watcher() i=6 2024-09-14T11:12:24.379 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.378+0000 7fa0d75349c0 20 remove_watcher() i=7 2024-09-14T11:12:24.393 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T11:12:24.422 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:24.422 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:24.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.462+0000 7fed607e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.466+0000 7fed607e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:24.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.466+0000 7fed607e39c0 20 realm 2024-09-14T11:12:24.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.466+0000 7fed607e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.468 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.466+0000 7fed607e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:24.468 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.466+0000 7fed607e39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:24.468 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.466+0000 7fed607e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.469 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.466+0000 7fed607e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:24.469 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.466+0000 7fed607e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.469 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.466+0000 7fed607e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:24.469 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.466+0000 7fed607e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.470 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.470+0000 7fed607e39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:24.470 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.470+0000 7fed607e39c0 20 searching for the correct realm 2024-09-14T11:12:24.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.474+0000 7fed5eaea640 0 -- 172.21.15.71:0/2129457609 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fed54008040 msgr2=0x7fed54073280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:24.480 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.478+0000 7fed5eaea640 0 -- 172.21.15.71:0/2129457609 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x56270fe5dc70 msgr2=0x56270fe60060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:24.489 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.486+0000 7fed607e39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:24.489 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.486+0000 7fed607e39c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:12:24.489 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.486+0000 7fed607e39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:24.489 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.486+0000 7fed607e39c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:12:24.489 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.486+0000 7fed607e39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:24.490 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.486+0000 7fed607e39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:24.490 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.486+0000 7fed607e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.491 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.486+0000 7fed607e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:24.491 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.486+0000 7fed607e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.491 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.490+0000 7fed607e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:24.491 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.490+0000 7fed607e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.491 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.490+0000 7fed607e39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:24.491 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.490+0000 7fed607e39c0 20 zone default found 2024-09-14T11:12:24.491 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.490+0000 7fed607e39c0 4 Realm: () 2024-09-14T11:12:24.491 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.490+0000 7fed607e39c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:12:24.492 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.490+0000 7fed607e39c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:12:24.492 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.490+0000 7fed607e39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:24.492 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.490+0000 7fed607e39c0 20 zonegroup default 2024-09-14T11:12:24.492 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.490+0000 7fed607e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.493 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.490+0000 7fed607e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:24.493 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.490+0000 7fed607e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.493 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.490+0000 7fed607e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:24.493 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.490+0000 7fed607e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.493 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.490+0000 7fed607e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:24.493 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.490+0000 7fed607e39c0 20 started sync module instance, tier type = 2024-09-14T11:12:24.493 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.490+0000 7fed607e39c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:12:24.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.510+0000 7fed607e39c0 20 add_watcher() i=0 2024-09-14T11:12:24.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.510+0000 7fed607e39c0 20 add_watcher() i=1 2024-09-14T11:12:24.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.510+0000 7fed607e39c0 20 add_watcher() i=2 2024-09-14T11:12:24.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.510+0000 7fed607e39c0 20 add_watcher() i=3 2024-09-14T11:12:24.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.510+0000 7fed607e39c0 20 add_watcher() i=4 2024-09-14T11:12:24.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.510+0000 7fed607e39c0 20 add_watcher() i=5 2024-09-14T11:12:24.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.510+0000 7fed607e39c0 20 add_watcher() i=6 2024-09-14T11:12:24.514 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.514+0000 7fed607e39c0 20 add_watcher() i=7 2024-09-14T11:12:24.514 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.514+0000 7fed607e39c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:24.518 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.518+0000 7fec14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:24.519 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.518+0000 7fed607e39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:24.519 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.518+0000 7fed607e39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:24.519 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.518+0000 7fed607e39c0 5 note: GC not initialized 2024-09-14T11:12:24.519 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.518+0000 7feb8f7fe640 20 reqs_thread_entry: start 2024-09-14T11:12:24.519 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.518+0000 7fed607e39c0 20 init_complete bucket index max shards: 11 2024-09-14T11:12:24.519 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.518+0000 7fed607e39c0 20 Filter name: none 2024-09-14T11:12:24.520 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.518+0000 7feb8d7fa640 20 reqs_thread_entry: start 2024-09-14T11:12:24.520 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.518+0000 7fed607e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.520 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.518+0000 7fed607e39c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:12:24.521 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.518+0000 7fed607e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.522+0000 7fed607e39c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:12:24.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.522+0000 7fed607e39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:12:24.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.522+0000 7fed607e39c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:12:24.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.522+0000 7fed607e39c0 20 INFO: main: starting shard=0 2024-09-14T11:12:24.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.522+0000 7fed607e39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.0 2024-09-14T11:12:24.523 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.522+0000 7fed607e39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:24.523 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.522+0000 7fed607e39c0 20 INFO: main: starting shard=1 2024-09-14T11:12:24.523 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.522+0000 7fed607e39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.1 2024-09-14T11:12:24.523 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.522+0000 7fed607e39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:24.523 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.522+0000 7fed607e39c0 20 INFO: main: starting shard=2 2024-09-14T11:12:24.523 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.522+0000 7fed607e39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.2 2024-09-14T11:12:24.525 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.522+0000 7fed607e39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:24.525 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.522+0000 7fed607e39c0 20 INFO: main: starting shard=3 2024-09-14T11:12:24.525 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.522+0000 7fed607e39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.3 2024-09-14T11:12:24.526 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.526+0000 7fed607e39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:24.526 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.526+0000 7fed607e39c0 20 INFO: main: starting shard=4 2024-09-14T11:12:24.526 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.526+0000 7fed607e39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.4 2024-09-14T11:12:24.526 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.526+0000 7fed607e39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:24.527 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.526+0000 7fed607e39c0 20 INFO: main: starting shard=5 2024-09-14T11:12:24.527 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.526+0000 7fed607e39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:24.527 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.526+0000 7fed607e39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:24.527 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.526+0000 7fed607e39c0 20 INFO: main: starting shard=6 2024-09-14T11:12:24.527 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.526+0000 7fed607e39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.6 2024-09-14T11:12:24.528 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.526+0000 7fed607e39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:24.528 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.526+0000 7fed607e39c0 20 INFO: main: starting shard=7 2024-09-14T11:12:24.528 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.526+0000 7fed607e39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.7 2024-09-14T11:12:24.529 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.526+0000 7fed607e39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:24.529 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.526+0000 7fed607e39c0 20 INFO: main: starting shard=8 2024-09-14T11:12:24.529 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.526+0000 7fed607e39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:24.529 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.526+0000 7fed607e39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:24.529 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.526+0000 7fed607e39c0 20 INFO: main: starting shard=9 2024-09-14T11:12:24.530 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.526+0000 7fed607e39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.9 2024-09-14T11:12:24.530 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.530+0000 7fed607e39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:24.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.530+0000 7fed607e39c0 20 INFO: main: starting shard=10 2024-09-14T11:12:24.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.530+0000 7fed607e39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.10 2024-09-14T11:12:24.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.530+0000 7fed607e39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:24.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.530+0000 7fed607e39c0 20 INFO: main: done 2024-09-14T11:12:24.532 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.530+0000 7fec14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:24.536 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.534+0000 7fed607e39c0 20 remove_watcher() i=0 2024-09-14T11:12:24.536 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.534+0000 7fed607e39c0 2 removed watcher, disabling cache 2024-09-14T11:12:24.538 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.538+0000 7fed607e39c0 20 remove_watcher() i=1 2024-09-14T11:12:24.541 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.538+0000 7fed607e39c0 20 remove_watcher() i=2 2024-09-14T11:12:24.543 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.542+0000 7fed607e39c0 20 remove_watcher() i=3 2024-09-14T11:12:24.545 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.542+0000 7fed607e39c0 20 remove_watcher() i=4 2024-09-14T11:12:24.547 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.546+0000 7fed607e39c0 20 remove_watcher() i=5 2024-09-14T11:12:24.550 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.550+0000 7fed607e39c0 20 remove_watcher() i=6 2024-09-14T11:12:24.553 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.550+0000 7fed607e39c0 20 remove_watcher() i=7 2024-09-14T11:12:24.567 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-14T11:12:24.567 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:12:24.567 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-14T11:12:24.597 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:24.597 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:24.641 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.638+0000 7f6c83e329c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.644 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.642+0000 7f6c83e329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:24.644 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.642+0000 7f6c83e329c0 20 realm 2024-09-14T11:12:24.644 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.642+0000 7f6c83e329c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.645 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.642+0000 7f6c83e329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:24.645 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.642+0000 7f6c83e329c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:24.645 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.642+0000 7f6c83e329c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.645 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.642+0000 7f6c83e329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:24.645 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.642+0000 7f6c83e329c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.646 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.646+0000 7f6c83e329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:24.646 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.646+0000 7f6c83e329c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.647 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.646+0000 7f6c83e329c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:24.647 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.646+0000 7f6c83e329c0 20 searching for the correct realm 2024-09-14T11:12:24.651 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.650+0000 7f6c81938640 0 -- 172.21.15.71:0/3083345333 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x55c4866b5f40 msgr2=0x55c4866b8400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:24.657 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.654+0000 7f6c81938640 0 -- 172.21.15.71:0/3083345333 >> [v2:172.21.15.157:6816/1231501119,v1:172.21.15.157:6817/1231501119] conn(0x55c4866a96c0 msgr2=0x55c4866abaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:12:24.666 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.666+0000 7f6c83e329c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:24.666 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.666+0000 7f6c83e329c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:12:24.666 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.666+0000 7f6c83e329c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:24.666 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.666+0000 7f6c83e329c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:12:24.666 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.666+0000 7f6c83e329c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:24.666 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.666+0000 7f6c83e329c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:24.666 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.666+0000 7f6c83e329c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.667 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.666+0000 7f6c83e329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:24.667 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.666+0000 7f6c83e329c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.667 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.666+0000 7f6c83e329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:24.667 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.666+0000 7f6c83e329c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.668 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.666+0000 7f6c83e329c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:24.668 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.666+0000 7f6c83e329c0 20 zone default found 2024-09-14T11:12:24.668 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.666+0000 7f6c83e329c0 4 Realm: () 2024-09-14T11:12:24.668 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.666+0000 7f6c83e329c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:12:24.668 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.666+0000 7f6c83e329c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:12:24.668 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.666+0000 7f6c83e329c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:24.668 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.666+0000 7f6c83e329c0 20 zonegroup default 2024-09-14T11:12:24.668 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.666+0000 7f6c83e329c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.668 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.666+0000 7f6c83e329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:24.668 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.666+0000 7f6c83e329c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.669 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.666+0000 7f6c83e329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:24.669 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.666+0000 7f6c83e329c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.669 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.666+0000 7f6c83e329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:24.669 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.666+0000 7f6c83e329c0 20 started sync module instance, tier type = 2024-09-14T11:12:24.669 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.666+0000 7f6c83e329c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:12:24.688 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.686+0000 7f6c83e329c0 20 add_watcher() i=0 2024-09-14T11:12:24.688 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.686+0000 7f6c83e329c0 20 add_watcher() i=1 2024-09-14T11:12:24.688 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.686+0000 7f6c83e329c0 20 add_watcher() i=2 2024-09-14T11:12:24.689 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.686+0000 7f6c83e329c0 20 add_watcher() i=3 2024-09-14T11:12:24.689 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.686+0000 7f6c83e329c0 20 add_watcher() i=4 2024-09-14T11:12:24.689 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.686+0000 7f6c83e329c0 20 add_watcher() i=5 2024-09-14T11:12:24.689 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.686+0000 7f6c83e329c0 20 add_watcher() i=6 2024-09-14T11:12:24.691 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.690+0000 7f6c83e329c0 20 add_watcher() i=7 2024-09-14T11:12:24.691 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.690+0000 7f6c83e329c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:24.694 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.694+0000 7f6b337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:24.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.694+0000 7f6c83e329c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:24.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.694+0000 7f6c83e329c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:24.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.694+0000 7f6c83e329c0 5 note: GC not initialized 2024-09-14T11:12:24.696 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.694+0000 7f6b327fc640 20 reqs_thread_entry: start 2024-09-14T11:12:24.696 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.694+0000 7f6c83e329c0 20 init_complete bucket index max shards: 11 2024-09-14T11:12:24.696 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.694+0000 7f6c83e329c0 20 Filter name: none 2024-09-14T11:12:24.696 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.694+0000 7f6aa3fff640 20 reqs_thread_entry: start 2024-09-14T11:12:24.696 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.694+0000 7f6c83e329c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:12:24.696 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.694+0000 7f6c83e329c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.697 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.694+0000 7f6c83e329c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:12:24.697 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.694+0000 7f6c83e329c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:12:24.697 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.694+0000 7f6c83e329c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:12:24.697 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.694+0000 7f6c83e329c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 : miss 2024-09-14T11:12:24.697 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.694+0000 7f6c83e329c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.697 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.694+0000 7f6c83e329c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:12:24.697 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.694+0000 7f6c83e329c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 info.flags=0x17 2024-09-14T11:12:24.697 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.694+0000 7f6c83e329c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 to cache LRU end 2024-09-14T11:12:24.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.694+0000 7f6c83e329c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:12:24.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.694+0000 7f6c83e329c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:12:24.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.694+0000 7f6c83e329c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 2024-09-14T11:12:24.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.694+0000 7f6c83e329c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.0 2024-09-14T11:12:24.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.694+0000 7f6c83e329c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:12:24.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.694+0000 7f6c83e329c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.1 2024-09-14T11:12:24.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.698+0000 7f6c83e329c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:12:24.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.698+0000 7f6c83e329c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.2 2024-09-14T11:12:24.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.698+0000 7f6c83e329c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:12:24.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.698+0000 7f6c83e329c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.3 2024-09-14T11:12:24.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.698+0000 7f6c83e329c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:12:24.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.698+0000 7f6c83e329c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.4 2024-09-14T11:12:24.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.698+0000 7f6c83e329c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:12:24.701 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.698+0000 7f6c83e329c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:24.701 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.698+0000 7f6c83e329c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T11:12:24.701 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.698+0000 7f6c83e329c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.6 2024-09-14T11:12:24.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.702+0000 7f6c83e329c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:12:24.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.702+0000 7f6c83e329c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.7 2024-09-14T11:12:24.703 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.702+0000 7f6c83e329c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:12:24.703 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.702+0000 7f6c83e329c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:24.704 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.702+0000 7f6c83e329c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T11:12:24.704 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.702+0000 7f6c83e329c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.9 2024-09-14T11:12:24.705 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.702+0000 7f6c83e329c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:12:24.705 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.702+0000 7f6c83e329c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.10 2024-09-14T11:12:24.706 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.702+0000 7f6c83e329c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:12:24.706 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.702+0000 7f6c83e329c0 1 NOTICE: finished all shards (0 entries found) 2024-09-14T11:12:24.707 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.706+0000 7f6b337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:24.711 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.710+0000 7f6c83e329c0 20 remove_watcher() i=0 2024-09-14T11:12:24.711 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.710+0000 7f6c83e329c0 2 removed watcher, disabling cache 2024-09-14T11:12:24.713 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.710+0000 7f6c83e329c0 20 remove_watcher() i=1 2024-09-14T11:12:24.715 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.714+0000 7f6c83e329c0 20 remove_watcher() i=2 2024-09-14T11:12:24.720 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.718+0000 7f6c83e329c0 20 remove_watcher() i=3 2024-09-14T11:12:24.722 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.722+0000 7f6c83e329c0 20 remove_watcher() i=4 2024-09-14T11:12:24.724 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.722+0000 7f6c83e329c0 20 remove_watcher() i=5 2024-09-14T11:12:24.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.726+0000 7f6c83e329c0 20 remove_watcher() i=6 2024-09-14T11:12:24.730 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:24.730+0000 7f6c83e329c0 20 remove_watcher() i=7 2024-09-14T11:12:24.745 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-14T11:12:24.745 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:12:24.801 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-14T11:12:24.802 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:12:25.145 INFO:tasks.workunit.client.0.smithi071.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:12:25.594 INFO:tasks.workunit.client.0.smithi071.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T11:12:27.087 INFO:tasks.workunit.client.0.smithi071.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:12:27.087 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T11:12:27.124 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:27.124 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:27.168 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.166+0000 7f1d3c65f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.170 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.170+0000 7f1d3c65f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:27.170 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.170+0000 7f1d3c65f9c0 20 realm 2024-09-14T11:12:27.171 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.170+0000 7f1d3c65f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.171 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.170+0000 7f1d3c65f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:27.171 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.170+0000 7f1d3c65f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:27.172 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.170+0000 7f1d3c65f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.172 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.170+0000 7f1d3c65f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:27.172 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.170+0000 7f1d3c65f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.172 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.170+0000 7f1d3c65f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:27.172 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.170+0000 7f1d3c65f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.173 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.170+0000 7f1d3c65f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:27.173 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.170+0000 7f1d3c65f9c0 20 searching for the correct realm 2024-09-14T11:12:27.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.174+0000 7f1d3a966640 0 -- 172.21.15.71:0/1158659599 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f1d300e7070 msgr2=0x7f1d300dd400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:27.184 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.182+0000 7f1d3a966640 0 -- 172.21.15.71:0/1158659599 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x5584f3bf4f00 msgr2=0x5584f3bf72f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:27.193 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.190+0000 7f1d3c65f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:27.193 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.190+0000 7f1d3c65f9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:12:27.193 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.190+0000 7f1d3c65f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:27.193 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.190+0000 7f1d3c65f9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:12:27.194 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.190+0000 7f1d3c65f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:27.194 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.190+0000 7f1d3c65f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:27.194 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.190+0000 7f1d3c65f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.194 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.190+0000 7f1d3c65f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:27.194 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.190+0000 7f1d3c65f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.194 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.194+0000 7f1d3c65f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:27.194 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.194+0000 7f1d3c65f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.195 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.194+0000 7f1d3c65f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:27.195 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.194+0000 7f1d3c65f9c0 20 zone default found 2024-09-14T11:12:27.195 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.194+0000 7f1d3c65f9c0 4 Realm: () 2024-09-14T11:12:27.195 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.194+0000 7f1d3c65f9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:12:27.195 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.194+0000 7f1d3c65f9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:12:27.195 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.194+0000 7f1d3c65f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:27.195 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.194+0000 7f1d3c65f9c0 20 zonegroup default 2024-09-14T11:12:27.195 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.194+0000 7f1d3c65f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.196 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.194+0000 7f1d3c65f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:27.196 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.194+0000 7f1d3c65f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.196 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.194+0000 7f1d3c65f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:27.196 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.194+0000 7f1d3c65f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.197 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.194+0000 7f1d3c65f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:27.197 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.194+0000 7f1d3c65f9c0 20 started sync module instance, tier type = 2024-09-14T11:12:27.197 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.194+0000 7f1d3c65f9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:12:27.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.214+0000 7f1d3c65f9c0 20 add_watcher() i=0 2024-09-14T11:12:27.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.214+0000 7f1d3c65f9c0 20 add_watcher() i=1 2024-09-14T11:12:27.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.214+0000 7f1d3c65f9c0 20 add_watcher() i=2 2024-09-14T11:12:27.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.214+0000 7f1d3c65f9c0 20 add_watcher() i=3 2024-09-14T11:12:27.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.214+0000 7f1d3c65f9c0 20 add_watcher() i=4 2024-09-14T11:12:27.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.214+0000 7f1d3c65f9c0 20 add_watcher() i=5 2024-09-14T11:12:27.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.214+0000 7f1d3c65f9c0 20 add_watcher() i=6 2024-09-14T11:12:27.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.218+0000 7f1d3c65f9c0 20 add_watcher() i=7 2024-09-14T11:12:27.221 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.218+0000 7f1d3c65f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:27.223 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.222+0000 7f1bf0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:27.224 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.222+0000 7f1d3c65f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:27.224 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.222+0000 7f1d3c65f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:27.224 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.222+0000 7f1d3c65f9c0 5 note: GC not initialized 2024-09-14T11:12:27.224 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.222+0000 7f1b6b7fe640 20 reqs_thread_entry: start 2024-09-14T11:12:27.224 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.222+0000 7f1d3c65f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:12:27.225 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.222+0000 7f1d3c65f9c0 20 Filter name: none 2024-09-14T11:12:27.225 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.222+0000 7f1b697fa640 20 reqs_thread_entry: start 2024-09-14T11:12:27.225 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.222+0000 7f1d3c65f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.225 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.222+0000 7f1d3c65f9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:12:27.225 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.222+0000 7f1d3c65f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.226+0000 7f1d3c65f9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:12:27.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.226+0000 7f1d3c65f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:12:27.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.226+0000 7f1d3c65f9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:12:27.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.226+0000 7f1d3c65f9c0 20 INFO: main: starting shard=0 2024-09-14T11:12:27.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.226+0000 7f1d3c65f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.0 2024-09-14T11:12:27.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.226+0000 7f1d3c65f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:27.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.226+0000 7f1d3c65f9c0 20 INFO: main: starting shard=1 2024-09-14T11:12:27.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.226+0000 7f1d3c65f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.1 2024-09-14T11:12:27.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.226+0000 7f1d3c65f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:27.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.226+0000 7f1d3c65f9c0 20 INFO: main: starting shard=2 2024-09-14T11:12:27.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.226+0000 7f1d3c65f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.2 2024-09-14T11:12:27.229 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.226+0000 7f1d3c65f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:27.229 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.226+0000 7f1d3c65f9c0 20 INFO: main: starting shard=3 2024-09-14T11:12:27.229 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.226+0000 7f1d3c65f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.3 2024-09-14T11:12:27.230 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.230+0000 7f1d3c65f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:27.230 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.230+0000 7f1d3c65f9c0 20 INFO: main: starting shard=4 2024-09-14T11:12:27.230 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.230+0000 7f1d3c65f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.4 2024-09-14T11:12:27.231 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.230+0000 7f1d3c65f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:27.231 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.230+0000 7f1d3c65f9c0 20 INFO: main: starting shard=5 2024-09-14T11:12:27.231 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.230+0000 7f1d3c65f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:27.232 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.230+0000 7f1d3c65f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:27.232 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.230+0000 7f1d3c65f9c0 20 INFO: main: starting shard=6 2024-09-14T11:12:27.232 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.230+0000 7f1d3c65f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.6 2024-09-14T11:12:27.233 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.230+0000 7f1d3c65f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:27.233 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.230+0000 7f1d3c65f9c0 20 INFO: main: starting shard=7 2024-09-14T11:12:27.233 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.230+0000 7f1d3c65f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.7 2024-09-14T11:12:27.234 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.234+0000 7f1d3c65f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:27.234 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.234+0000 7f1d3c65f9c0 20 INFO: main: starting shard=8 2024-09-14T11:12:27.234 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.234+0000 7f1d3c65f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:27.235 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.234+0000 7f1d3c65f9c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T11:12:27.235 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.234+0000 7f1d3c65f9c0 20 INFO: main: starting shard=9 2024-09-14T11:12:27.235 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.234+0000 7f1d3c65f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.9 2024-09-14T11:12:27.236 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.234+0000 7f1d3c65f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:27.236 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.234+0000 7f1d3c65f9c0 20 INFO: main: starting shard=10 2024-09-14T11:12:27.236 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.234+0000 7f1d3c65f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.10 2024-09-14T11:12:27.236 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.234+0000 7f1d3c65f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:27.236 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.234+0000 7f1d3c65f9c0 20 INFO: main: done 2024-09-14T11:12:27.237 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.234+0000 7f1bf0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:27.241 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.238+0000 7f1d3c65f9c0 20 remove_watcher() i=0 2024-09-14T11:12:27.241 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.238+0000 7f1d3c65f9c0 2 removed watcher, disabling cache 2024-09-14T11:12:27.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.242+0000 7f1d3c65f9c0 20 remove_watcher() i=1 2024-09-14T11:12:27.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.242+0000 7f1d3c65f9c0 20 remove_watcher() i=2 2024-09-14T11:12:27.247 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.246+0000 7f1d3c65f9c0 20 remove_watcher() i=3 2024-09-14T11:12:27.250 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.250+0000 7f1d3c65f9c0 20 remove_watcher() i=4 2024-09-14T11:12:27.252 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.250+0000 7f1d3c65f9c0 20 remove_watcher() i=5 2024-09-14T11:12:27.254 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.254+0000 7f1d3c65f9c0 20 remove_watcher() i=6 2024-09-14T11:12:27.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.258+0000 7f1d3c65f9c0 20 remove_watcher() i=7 2024-09-14T11:12:27.334 INFO:tasks.workunit.client.0.smithi071.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:12:27.335 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T11:12:27.367 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:27.367 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:27.409 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.406+0000 7efea3e429c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.412 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.410+0000 7efea3e429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:27.412 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.410+0000 7efea3e429c0 20 realm 2024-09-14T11:12:27.412 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.410+0000 7efea3e429c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.413 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.410+0000 7efea3e429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:27.413 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.410+0000 7efea3e429c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:27.413 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.410+0000 7efea3e429c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.413 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.410+0000 7efea3e429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:27.413 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.410+0000 7efea3e429c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.414 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.414+0000 7efea3e429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:27.414 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.414+0000 7efea3e429c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.414 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.414+0000 7efea3e429c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:27.415 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.414+0000 7efea3e429c0 20 searching for the correct realm 2024-09-14T11:12:27.419 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.418+0000 7efea1948640 0 -- 172.21.15.71:0/361061317 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x5619a6c71070 msgr2=0x5619a6c73530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:27.425 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.422+0000 7efea2149640 0 -- 172.21.15.71:0/361061317 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x5619a6c6c310 msgr2=0x5619a6c6e700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:27.432 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.430+0000 7efea3e429c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:27.433 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.430+0000 7efea3e429c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:12:27.433 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.430+0000 7efea3e429c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:27.433 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.430+0000 7efea3e429c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:12:27.433 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.430+0000 7efea3e429c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:27.433 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.430+0000 7efea3e429c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:27.433 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.430+0000 7efea3e429c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.433 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.430+0000 7efea3e429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:27.434 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.430+0000 7efea3e429c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.434 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.430+0000 7efea3e429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:27.434 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.430+0000 7efea3e429c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.435 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.434+0000 7efea3e429c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:27.435 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.434+0000 7efea3e429c0 20 zone default found 2024-09-14T11:12:27.435 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.434+0000 7efea3e429c0 4 Realm: () 2024-09-14T11:12:27.435 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.434+0000 7efea3e429c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:12:27.435 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.434+0000 7efea3e429c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:12:27.435 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.434+0000 7efea3e429c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:27.435 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.434+0000 7efea3e429c0 20 zonegroup default 2024-09-14T11:12:27.435 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.434+0000 7efea3e429c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.435 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.434+0000 7efea3e429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:27.435 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.434+0000 7efea3e429c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.436 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.434+0000 7efea3e429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:27.436 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.434+0000 7efea3e429c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.436 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.434+0000 7efea3e429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:27.436 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.434+0000 7efea3e429c0 20 started sync module instance, tier type = 2024-09-14T11:12:27.436 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.434+0000 7efea3e429c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:12:27.454 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.454+0000 7efea3e429c0 20 add_watcher() i=0 2024-09-14T11:12:27.454 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.454+0000 7efea3e429c0 20 add_watcher() i=1 2024-09-14T11:12:27.454 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.454+0000 7efea3e429c0 20 add_watcher() i=2 2024-09-14T11:12:27.454 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.454+0000 7efea3e429c0 20 add_watcher() i=3 2024-09-14T11:12:27.454 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.454+0000 7efea3e429c0 20 add_watcher() i=4 2024-09-14T11:12:27.454 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.454+0000 7efea3e429c0 20 add_watcher() i=5 2024-09-14T11:12:27.454 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.454+0000 7efea3e429c0 20 add_watcher() i=6 2024-09-14T11:12:27.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.454+0000 7efea3e429c0 20 add_watcher() i=7 2024-09-14T11:12:27.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.454+0000 7efea3e429c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:27.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.458+0000 7efd537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:27.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.458+0000 7efea3e429c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:27.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.458+0000 7efea3e429c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:27.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.458+0000 7efea3e429c0 5 note: GC not initialized 2024-09-14T11:12:27.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.458+0000 7efd527fc640 20 reqs_thread_entry: start 2024-09-14T11:12:27.461 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.458+0000 7efea3e429c0 20 init_complete bucket index max shards: 11 2024-09-14T11:12:27.461 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.458+0000 7efea3e429c0 20 Filter name: none 2024-09-14T11:12:27.461 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.458+0000 7efcc3fff640 20 reqs_thread_entry: start 2024-09-14T11:12:27.461 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.458+0000 7efea3e429c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.461 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.458+0000 7efea3e429c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:12:27.461 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.458+0000 7efea3e429c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.462+0000 7efea3e429c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:12:27.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.462+0000 7efea3e429c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:12:27.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.462+0000 7efea3e429c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:12:27.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.462+0000 7efea3e429c0 20 INFO: main: starting shard=0 2024-09-14T11:12:27.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.462+0000 7efea3e429c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.0 2024-09-14T11:12:27.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.462+0000 7efea3e429c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:27.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.462+0000 7efea3e429c0 20 INFO: main: starting shard=1 2024-09-14T11:12:27.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.462+0000 7efea3e429c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.1 2024-09-14T11:12:27.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.462+0000 7efea3e429c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:27.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.462+0000 7efea3e429c0 20 INFO: main: starting shard=2 2024-09-14T11:12:27.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.462+0000 7efea3e429c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.2 2024-09-14T11:12:27.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.462+0000 7efea3e429c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:27.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.462+0000 7efea3e429c0 20 INFO: main: starting shard=3 2024-09-14T11:12:27.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.462+0000 7efea3e429c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.3 2024-09-14T11:12:27.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.462+0000 7efea3e429c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:27.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.462+0000 7efea3e429c0 20 INFO: main: starting shard=4 2024-09-14T11:12:27.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.462+0000 7efea3e429c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.4 2024-09-14T11:12:27.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.466+0000 7efea3e429c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:27.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.466+0000 7efea3e429c0 20 INFO: main: starting shard=5 2024-09-14T11:12:27.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.466+0000 7efea3e429c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:27.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.466+0000 7efea3e429c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T11:12:27.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.466+0000 7efea3e429c0 20 INFO: main: starting shard=6 2024-09-14T11:12:27.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.466+0000 7efea3e429c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.6 2024-09-14T11:12:27.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.466+0000 7efea3e429c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:27.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.466+0000 7efea3e429c0 20 INFO: main: starting shard=7 2024-09-14T11:12:27.468 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.466+0000 7efea3e429c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.7 2024-09-14T11:12:27.469 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.466+0000 7efea3e429c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:27.469 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.466+0000 7efea3e429c0 20 INFO: main: starting shard=8 2024-09-14T11:12:27.469 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.466+0000 7efea3e429c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:27.469 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.466+0000 7efea3e429c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:27.470 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.466+0000 7efea3e429c0 20 INFO: main: starting shard=9 2024-09-14T11:12:27.470 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.466+0000 7efea3e429c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.9 2024-09-14T11:12:27.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.470+0000 7efea3e429c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:27.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.470+0000 7efea3e429c0 20 INFO: main: starting shard=10 2024-09-14T11:12:27.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.470+0000 7efea3e429c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.10 2024-09-14T11:12:27.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.470+0000 7efea3e429c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:27.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.470+0000 7efea3e429c0 20 INFO: main: done 2024-09-14T11:12:27.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.470+0000 7efd537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:27.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.474+0000 7efea3e429c0 20 remove_watcher() i=0 2024-09-14T11:12:27.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.474+0000 7efea3e429c0 2 removed watcher, disabling cache 2024-09-14T11:12:27.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.474+0000 7efea3e429c0 20 remove_watcher() i=1 2024-09-14T11:12:27.479 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.478+0000 7efea3e429c0 20 remove_watcher() i=2 2024-09-14T11:12:27.481 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.478+0000 7efea3e429c0 20 remove_watcher() i=3 2024-09-14T11:12:27.483 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.482+0000 7efea3e429c0 20 remove_watcher() i=4 2024-09-14T11:12:27.485 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.482+0000 7efea3e429c0 20 remove_watcher() i=5 2024-09-14T11:12:27.488 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.486+0000 7efea3e429c0 20 remove_watcher() i=6 2024-09-14T11:12:27.491 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.490+0000 7efea3e429c0 20 remove_watcher() i=7 2024-09-14T11:12:27.558 INFO:tasks.workunit.client.0.smithi071.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:12:27.559 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-14T11:12:27.584 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:27.585 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:27.625 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.622+0000 7f3f56ee19c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.626+0000 7f3f56ee19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:27.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.626+0000 7f3f56ee19c0 20 realm 2024-09-14T11:12:27.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.626+0000 7f3f56ee19c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.626+0000 7f3f56ee19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:27.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.626+0000 7f3f56ee19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:27.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.626+0000 7f3f56ee19c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.626+0000 7f3f56ee19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:27.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.626+0000 7f3f56ee19c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.626+0000 7f3f56ee19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:27.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.626+0000 7f3f56ee19c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:27.630 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.626+0000 7f3f56ee19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:27.630 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.626+0000 7f3f56ee19c0 20 searching for the correct realm 2024-09-14T11:12:27.845 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:27.842+0000 7f3f549e7640 0 -- 172.21.15.71:0/960911326 >> [v2:172.21.15.157:6808/527702018,v1:172.21.15.157:6809/527702018] conn(0x7f3f440cc400 msgr2=0x7f3f440cc880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:28.059 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.058+0000 7f3f549e7640 0 -- 172.21.15.71:0/960911326 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x55c8741ca750 msgr2=0x55c8741ccc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:28.069 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.066+0000 7f3f56ee19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:28.069 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.066+0000 7f3f56ee19c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:12:28.069 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.066+0000 7f3f56ee19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:28.069 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.066+0000 7f3f56ee19c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:12:28.069 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.066+0000 7f3f56ee19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:28.069 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.066+0000 7f3f56ee19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:28.069 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.066+0000 7f3f56ee19c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:28.069 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.066+0000 7f3f56ee19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:28.069 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.066+0000 7f3f56ee19c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:28.070 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.070+0000 7f3f56ee19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:28.070 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.070+0000 7f3f56ee19c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:28.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.070+0000 7f3f56ee19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:28.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.070+0000 7f3f56ee19c0 20 zone default found 2024-09-14T11:12:28.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.070+0000 7f3f56ee19c0 4 Realm: () 2024-09-14T11:12:28.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.070+0000 7f3f56ee19c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:12:28.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.070+0000 7f3f56ee19c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:12:28.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.070+0000 7f3f56ee19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:28.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.070+0000 7f3f56ee19c0 20 zonegroup default 2024-09-14T11:12:28.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.070+0000 7f3f56ee19c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:28.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.070+0000 7f3f56ee19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:28.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.070+0000 7f3f56ee19c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:28.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.070+0000 7f3f56ee19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:28.073 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.070+0000 7f3f56ee19c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:28.073 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.070+0000 7f3f56ee19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:28.074 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.070+0000 7f3f56ee19c0 20 started sync module instance, tier type = 2024-09-14T11:12:28.074 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.070+0000 7f3f56ee19c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:12:28.098 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.098+0000 7f3f56ee19c0 20 add_watcher() i=0 2024-09-14T11:12:28.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.098+0000 7f3f56ee19c0 20 add_watcher() i=1 2024-09-14T11:12:28.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.098+0000 7f3f56ee19c0 20 add_watcher() i=2 2024-09-14T11:12:28.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.098+0000 7f3f56ee19c0 20 add_watcher() i=3 2024-09-14T11:12:28.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.098+0000 7f3f56ee19c0 20 add_watcher() i=4 2024-09-14T11:12:28.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.098+0000 7f3f56ee19c0 20 add_watcher() i=5 2024-09-14T11:12:28.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.098+0000 7f3f56ee19c0 20 add_watcher() i=6 2024-09-14T11:12:28.101 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.098+0000 7f3f56ee19c0 20 add_watcher() i=7 2024-09-14T11:12:28.101 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.098+0000 7f3f56ee19c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:28.105 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.102+0000 7f3e0afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:28.106 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.106+0000 7f3f56ee19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:28.106 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.106+0000 7f3f56ee19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:28.106 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.106+0000 7f3f56ee19c0 5 note: GC not initialized 2024-09-14T11:12:28.107 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.106+0000 7f3e09fe3640 20 reqs_thread_entry: start 2024-09-14T11:12:28.107 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.106+0000 7f3f56ee19c0 20 init_complete bucket index max shards: 11 2024-09-14T11:12:28.107 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.106+0000 7f3f56ee19c0 20 Filter name: none 2024-09-14T11:12:28.107 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.106+0000 7f3d7b7fe640 20 reqs_thread_entry: start 2024-09-14T11:12:28.107 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.106+0000 7f3f56ee19c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:28.108 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.106+0000 7f3f56ee19c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:12:28.108 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.106+0000 7f3f56ee19c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:28.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.106+0000 7f3f56ee19c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:12:28.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.106+0000 7f3f56ee19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:12:28.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.106+0000 7f3f56ee19c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:12:28.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.110+0000 7f3f56ee19c0 20 INFO: main: starting shard=0 2024-09-14T11:12:28.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.110+0000 7f3f56ee19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.0 2024-09-14T11:12:28.111 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.110+0000 7f3f56ee19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:28.111 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.110+0000 7f3f56ee19c0 20 INFO: main: starting shard=1 2024-09-14T11:12:28.111 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.110+0000 7f3f56ee19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.1 2024-09-14T11:12:28.112 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.110+0000 7f3f56ee19c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:12:28.112 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.110+0000 7f3f56ee19c0 20 INFO: main: starting shard=2 2024-09-14T11:12:28.112 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.110+0000 7f3f56ee19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.2 2024-09-14T11:12:28.113 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.110+0000 7f3f56ee19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:28.113 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.110+0000 7f3f56ee19c0 20 INFO: main: starting shard=3 2024-09-14T11:12:28.113 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.110+0000 7f3f56ee19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.3 2024-09-14T11:12:28.114 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.114+0000 7f3f56ee19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:28.115 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.114+0000 7f3f56ee19c0 20 INFO: main: starting shard=4 2024-09-14T11:12:28.115 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.114+0000 7f3f56ee19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.4 2024-09-14T11:12:28.116 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.114+0000 7f3f56ee19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:28.116 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.114+0000 7f3f56ee19c0 20 INFO: main: starting shard=5 2024-09-14T11:12:28.116 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.114+0000 7f3f56ee19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:28.117 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.114+0000 7f3f56ee19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:28.117 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.114+0000 7f3f56ee19c0 20 INFO: main: starting shard=6 2024-09-14T11:12:28.117 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.114+0000 7f3f56ee19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.6 2024-09-14T11:12:28.118 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.118+0000 7f3f56ee19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:28.118 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.118+0000 7f3f56ee19c0 20 INFO: main: starting shard=7 2024-09-14T11:12:28.119 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.118+0000 7f3f56ee19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.7 2024-09-14T11:12:28.120 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.118+0000 7f3f56ee19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:28.120 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.118+0000 7f3f56ee19c0 20 INFO: main: starting shard=8 2024-09-14T11:12:28.120 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.118+0000 7f3f56ee19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:28.120 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.118+0000 7f3f56ee19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:28.120 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.118+0000 7f3f56ee19c0 20 INFO: main: starting shard=9 2024-09-14T11:12:28.120 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.118+0000 7f3f56ee19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.9 2024-09-14T11:12:28.122 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.122+0000 7f3f56ee19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:28.122 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.122+0000 7f3f56ee19c0 20 INFO: main: starting shard=10 2024-09-14T11:12:28.122 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.122+0000 7f3f56ee19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.10 2024-09-14T11:12:28.122 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.122+0000 7f3f56ee19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:28.122 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.122+0000 7f3f56ee19c0 20 INFO: main: done 2024-09-14T11:12:28.123 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.122+0000 7f3e0afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:28.128 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.126+0000 7f3f56ee19c0 20 remove_watcher() i=0 2024-09-14T11:12:28.128 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.126+0000 7f3f56ee19c0 2 removed watcher, disabling cache 2024-09-14T11:12:28.130 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.130+0000 7f3f56ee19c0 20 remove_watcher() i=1 2024-09-14T11:12:28.133 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.130+0000 7f3f56ee19c0 20 remove_watcher() i=2 2024-09-14T11:12:28.135 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.134+0000 7f3f56ee19c0 20 remove_watcher() i=3 2024-09-14T11:12:28.137 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.134+0000 7f3f56ee19c0 20 remove_watcher() i=4 2024-09-14T11:12:28.139 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.138+0000 7f3f56ee19c0 20 remove_watcher() i=5 2024-09-14T11:12:28.141 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.138+0000 7f3f56ee19c0 20 remove_watcher() i=6 2024-09-14T11:12:28.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.142+0000 7f3f56ee19c0 20 remove_watcher() i=7 2024-09-14T11:12:28.223 INFO:tasks.workunit.client.0.smithi071.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:12:28.224 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-14T11:12:28.258 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:28.258 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:28.307 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.306+0000 7f2fe65519c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:28.309 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.306+0000 7f2fe65519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:28.309 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.306+0000 7f2fe65519c0 20 realm 2024-09-14T11:12:28.309 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.306+0000 7f2fe65519c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:28.310 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.306+0000 7f2fe65519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:28.310 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.306+0000 7f2fe65519c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:28.310 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.306+0000 7f2fe65519c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:28.310 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.310+0000 7f2fe65519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:28.310 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.310+0000 7f2fe65519c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:28.311 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.310+0000 7f2fe65519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:28.311 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.310+0000 7f2fe65519c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:28.312 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.310+0000 7f2fe65519c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:28.312 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.310+0000 7f2fe65519c0 20 searching for the correct realm 2024-09-14T11:12:28.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.314+0000 7f2fe4057640 0 -- 172.21.15.71:0/990378871 >> [v2:172.21.15.157:6808/527702018,v1:172.21.15.157:6809/527702018] conn(0x7f2fd401b880 msgr2=0x7f2fd4092a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:12:28.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.530+0000 7f2fe4057640 0 -- 172.21.15.71:0/990378871 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x5605b9e0ad90 msgr2=0x5605b9e0d230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:28.540 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.538+0000 7f2fe65519c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:28.540 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.538+0000 7f2fe65519c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:12:28.540 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.538+0000 7f2fe65519c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:28.540 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.538+0000 7f2fe65519c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:12:28.540 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.538+0000 7f2fe65519c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:28.540 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.538+0000 7f2fe65519c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:28.541 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.538+0000 7f2fe65519c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:28.541 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.538+0000 7f2fe65519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:28.541 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.538+0000 7f2fe65519c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:28.541 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.538+0000 7f2fe65519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:28.542 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.538+0000 7f2fe65519c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:28.543 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.542+0000 7f2fe65519c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:28.543 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.542+0000 7f2fe65519c0 20 zone default found 2024-09-14T11:12:28.543 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.542+0000 7f2fe65519c0 4 Realm: () 2024-09-14T11:12:28.543 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.542+0000 7f2fe65519c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:12:28.543 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.542+0000 7f2fe65519c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:12:28.543 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.542+0000 7f2fe65519c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:28.543 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.542+0000 7f2fe65519c0 20 zonegroup default 2024-09-14T11:12:28.543 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.542+0000 7f2fe65519c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:28.544 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.542+0000 7f2fe65519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:28.544 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.542+0000 7f2fe65519c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:28.544 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.542+0000 7f2fe65519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:28.544 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.542+0000 7f2fe65519c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:28.545 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.542+0000 7f2fe65519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:28.545 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.542+0000 7f2fe65519c0 20 started sync module instance, tier type = 2024-09-14T11:12:28.545 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.542+0000 7f2fe65519c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:12:28.569 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.566+0000 7f2fe65519c0 20 add_watcher() i=0 2024-09-14T11:12:28.569 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.566+0000 7f2fe65519c0 20 add_watcher() i=1 2024-09-14T11:12:28.569 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.566+0000 7f2fe65519c0 20 add_watcher() i=2 2024-09-14T11:12:28.569 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.566+0000 7f2fe65519c0 20 add_watcher() i=3 2024-09-14T11:12:28.569 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.566+0000 7f2fe65519c0 20 add_watcher() i=4 2024-09-14T11:12:28.569 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.566+0000 7f2fe65519c0 20 add_watcher() i=5 2024-09-14T11:12:28.569 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.566+0000 7f2fe65519c0 20 add_watcher() i=6 2024-09-14T11:12:28.572 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.570+0000 7f2fe65519c0 20 add_watcher() i=7 2024-09-14T11:12:28.572 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.570+0000 7f2fe65519c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:28.576 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.574+0000 7f2e9a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:28.577 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.574+0000 7f2fe65519c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:28.577 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.574+0000 7f2fe65519c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:28.577 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.574+0000 7f2fe65519c0 5 note: GC not initialized 2024-09-14T11:12:28.578 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.574+0000 7f2e997e2640 20 reqs_thread_entry: start 2024-09-14T11:12:28.578 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.574+0000 7f2fe65519c0 20 init_complete bucket index max shards: 11 2024-09-14T11:12:28.578 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.574+0000 7f2fe65519c0 20 Filter name: none 2024-09-14T11:12:28.578 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.578+0000 7f2e0affd640 20 reqs_thread_entry: start 2024-09-14T11:12:28.578 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.578+0000 7f2fe65519c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:28.579 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.578+0000 7f2fe65519c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:12:28.579 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.578+0000 7f2fe65519c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:28.580 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.578+0000 7f2fe65519c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:12:28.580 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.578+0000 7f2fe65519c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:12:28.580 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.578+0000 7f2fe65519c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:12:28.581 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.578+0000 7f2fe65519c0 20 INFO: main: starting shard=0 2024-09-14T11:12:28.581 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.578+0000 7f2fe65519c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.0 2024-09-14T11:12:28.581 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.578+0000 7f2fe65519c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:28.581 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.578+0000 7f2fe65519c0 20 INFO: main: starting shard=1 2024-09-14T11:12:28.581 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.578+0000 7f2fe65519c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.1 2024-09-14T11:12:28.581 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.578+0000 7f2fe65519c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:28.582 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.578+0000 7f2fe65519c0 20 INFO: main: starting shard=2 2024-09-14T11:12:28.582 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.578+0000 7f2fe65519c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.2 2024-09-14T11:12:28.582 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.582+0000 7f2fe65519c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:28.583 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.582+0000 7f2fe65519c0 20 INFO: main: starting shard=3 2024-09-14T11:12:28.583 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.582+0000 7f2fe65519c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.3 2024-09-14T11:12:28.584 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.582+0000 7f2fe65519c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:28.584 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.582+0000 7f2fe65519c0 20 INFO: main: starting shard=4 2024-09-14T11:12:28.584 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.582+0000 7f2fe65519c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.4 2024-09-14T11:12:28.584 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.582+0000 7f2fe65519c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:28.584 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.582+0000 7f2fe65519c0 20 INFO: main: starting shard=5 2024-09-14T11:12:28.585 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.582+0000 7f2fe65519c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:28.585 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.582+0000 7f2fe65519c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:28.585 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.582+0000 7f2fe65519c0 20 INFO: main: starting shard=6 2024-09-14T11:12:28.585 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.582+0000 7f2fe65519c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.6 2024-09-14T11:12:28.586 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.586+0000 7f2fe65519c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:28.586 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.586+0000 7f2fe65519c0 20 INFO: main: starting shard=7 2024-09-14T11:12:28.586 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.586+0000 7f2fe65519c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.7 2024-09-14T11:12:28.588 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.586+0000 7f2fe65519c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:28.588 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.586+0000 7f2fe65519c0 20 INFO: main: starting shard=8 2024-09-14T11:12:28.588 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.586+0000 7f2fe65519c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:28.588 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.586+0000 7f2fe65519c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:28.588 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.586+0000 7f2fe65519c0 20 INFO: main: starting shard=9 2024-09-14T11:12:28.588 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.586+0000 7f2fe65519c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.9 2024-09-14T11:12:28.589 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.586+0000 7f2fe65519c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:12:28.589 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.586+0000 7f2fe65519c0 20 INFO: main: starting shard=10 2024-09-14T11:12:28.590 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.586+0000 7f2fe65519c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.10 2024-09-14T11:12:28.591 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.590+0000 7f2fe65519c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:12:28.591 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.590+0000 7f2fe65519c0 20 INFO: main: done 2024-09-14T11:12:28.592 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.590+0000 7f2e9a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:28.597 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.594+0000 7f2fe65519c0 20 remove_watcher() i=0 2024-09-14T11:12:28.597 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.594+0000 7f2fe65519c0 2 removed watcher, disabling cache 2024-09-14T11:12:28.599 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.598+0000 7f2fe65519c0 20 remove_watcher() i=1 2024-09-14T11:12:28.602 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.602+0000 7f2fe65519c0 20 remove_watcher() i=2 2024-09-14T11:12:28.604 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.602+0000 7f2fe65519c0 20 remove_watcher() i=3 2024-09-14T11:12:28.606 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.606+0000 7f2fe65519c0 20 remove_watcher() i=4 2024-09-14T11:12:28.609 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.606+0000 7f2fe65519c0 20 remove_watcher() i=5 2024-09-14T11:12:28.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.610+0000 7f2fe65519c0 20 remove_watcher() i=6 2024-09-14T11:12:28.615 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:28.614+0000 7f2fe65519c0 20 remove_watcher() i=7 2024-09-14T11:12:28.636 INFO:tasks.workunit.client.0.smithi071.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:12:29.068 INFO:tasks.workunit.client.0.smithi071.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T11:12:29.498 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-14T11:12:29.529 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:29.529 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:29.570 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.570+0000 7f81a70a19c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.570+0000 7f81a70a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:29.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.570+0000 7f81a70a19c0 20 realm 2024-09-14T11:12:29.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.570+0000 7f81a70a19c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.570+0000 7f81a70a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:29.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.570+0000 7f81a70a19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:29.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.570+0000 7f81a70a19c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.570+0000 7f81a70a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:29.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.570+0000 7f81a70a19c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.574+0000 7f81a70a19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:29.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.574+0000 7f81a70a19c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.575 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.574+0000 7f81a70a19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:29.575 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.574+0000 7f81a70a19c0 20 searching for the correct realm 2024-09-14T11:12:29.579 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.578+0000 7f81a53a8640 0 -- 172.21.15.71:0/110086405 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f81980ca070 msgr2=0x7f8198003840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:29.585 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.582+0000 7f81a53a8640 0 -- 172.21.15.71:0/110086405 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x56412f7ca230 msgr2=0x56412f7cc660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:12:29.594 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.594+0000 7f81a70a19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:29.594 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.594+0000 7f81a70a19c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:12:29.594 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.594+0000 7f81a70a19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:29.594 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.594+0000 7f81a70a19c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:12:29.594 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.594+0000 7f81a70a19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:29.594 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.594+0000 7f81a70a19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:29.594 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.594+0000 7f81a70a19c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.595 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.594+0000 7f81a70a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:29.595 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.594+0000 7f81a70a19c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.595 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.594+0000 7f81a70a19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:29.595 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.594+0000 7f81a70a19c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.596 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.594+0000 7f81a70a19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:29.596 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.594+0000 7f81a70a19c0 20 zone default found 2024-09-14T11:12:29.596 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.594+0000 7f81a70a19c0 4 Realm: () 2024-09-14T11:12:29.596 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.594+0000 7f81a70a19c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:12:29.597 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.594+0000 7f81a70a19c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:12:29.597 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.594+0000 7f81a70a19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:29.597 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.594+0000 7f81a70a19c0 20 zonegroup default 2024-09-14T11:12:29.597 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.594+0000 7f81a70a19c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.597 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.594+0000 7f81a70a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:29.597 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.594+0000 7f81a70a19c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.598 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.594+0000 7f81a70a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:29.598 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.594+0000 7f81a70a19c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.598 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.594+0000 7f81a70a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:29.598 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.594+0000 7f81a70a19c0 20 started sync module instance, tier type = 2024-09-14T11:12:29.598 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.594+0000 7f81a70a19c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:12:29.618 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.618+0000 7f81a70a19c0 20 add_watcher() i=0 2024-09-14T11:12:29.618 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.618+0000 7f81a70a19c0 20 add_watcher() i=1 2024-09-14T11:12:29.619 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.618+0000 7f81a70a19c0 20 add_watcher() i=2 2024-09-14T11:12:29.619 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.618+0000 7f81a70a19c0 20 add_watcher() i=3 2024-09-14T11:12:29.619 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.618+0000 7f81a70a19c0 20 add_watcher() i=4 2024-09-14T11:12:29.619 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.618+0000 7f81a70a19c0 20 add_watcher() i=5 2024-09-14T11:12:29.619 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.618+0000 7f81a70a19c0 20 add_watcher() i=6 2024-09-14T11:12:29.621 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.618+0000 7f81a70a19c0 20 add_watcher() i=7 2024-09-14T11:12:29.621 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.618+0000 7f81a70a19c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:29.624 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.622+0000 7f805b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:29.625 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.622+0000 7f81a70a19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:29.625 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.622+0000 7f81a70a19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:29.625 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.622+0000 7f81a70a19c0 5 note: GC not initialized 2024-09-14T11:12:29.626 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.622+0000 7f805a7e4640 20 reqs_thread_entry: start 2024-09-14T11:12:29.626 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.622+0000 7f81a70a19c0 20 init_complete bucket index max shards: 11 2024-09-14T11:12:29.626 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.622+0000 7f81a70a19c0 20 Filter name: none 2024-09-14T11:12:29.626 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.626+0000 7f8053fff640 20 reqs_thread_entry: start 2024-09-14T11:12:29.626 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.626+0000 7f81a70a19c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:12:29.626 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.626+0000 7f81a70a19c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.627 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.626+0000 7f81a70a19c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:12:29.627 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.626+0000 7f81a70a19c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:12:29.627 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.626+0000 7f81a70a19c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:12:29.627 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.626+0000 7f81a70a19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 : miss 2024-09-14T11:12:29.627 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.626+0000 7f81a70a19c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.626+0000 7f81a70a19c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:12:29.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.626+0000 7f81a70a19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 info.flags=0x17 2024-09-14T11:12:29.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.626+0000 7f81a70a19c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 to cache LRU end 2024-09-14T11:12:29.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.626+0000 7f81a70a19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:12:29.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.626+0000 7f81a70a19c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:12:29.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.626+0000 7f81a70a19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 2024-09-14T11:12:29.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.626+0000 7f81a70a19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.0 2024-09-14T11:12:29.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.626+0000 7f81a70a19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.1 2024-09-14T11:12:29.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.626+0000 7f81a70a19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.2 2024-09-14T11:12:29.630 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.630+0000 7f81a70a19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.3 2024-09-14T11:12:29.631 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.630+0000 7f81a70a19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.4 2024-09-14T11:12:29.632 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.630+0000 7f81a70a19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:29.633 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.630+0000 7f81a70a19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.6 2024-09-14T11:12:29.633 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.630+0000 7f81a70a19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.7 2024-09-14T11:12:29.635 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.634+0000 7f81a70a19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:29.635 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.634+0000 7f81a70a19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.9 2024-09-14T11:12:29.637 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.634+0000 7f81a70a19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.10 2024-09-14T11:12:29.647 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.646+0000 7f805b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:29.652 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.650+0000 7f81a70a19c0 20 remove_watcher() i=0 2024-09-14T11:12:29.652 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.650+0000 7f81a70a19c0 2 removed watcher, disabling cache 2024-09-14T11:12:29.654 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.654+0000 7f81a70a19c0 20 remove_watcher() i=1 2024-09-14T11:12:29.656 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.654+0000 7f81a70a19c0 20 remove_watcher() i=2 2024-09-14T11:12:29.658 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.658+0000 7f81a70a19c0 20 remove_watcher() i=3 2024-09-14T11:12:29.660 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.658+0000 7f81a70a19c0 20 remove_watcher() i=4 2024-09-14T11:12:29.662 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.662+0000 7f81a70a19c0 20 remove_watcher() i=5 2024-09-14T11:12:29.665 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.662+0000 7f81a70a19c0 20 remove_watcher() i=6 2024-09-14T11:12:29.668 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.666+0000 7f81a70a19c0 20 remove_watcher() i=7 2024-09-14T11:12:29.683 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:12:29.719 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:29.719 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:29.759 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.758+0000 7ffb31c5c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.761 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.758+0000 7ffb31c5c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:29.761 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.758+0000 7ffb31c5c9c0 20 realm 2024-09-14T11:12:29.761 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.758+0000 7ffb31c5c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.762 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.762+0000 7ffb31c5c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:29.762 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.762+0000 7ffb31c5c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:29.762 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.762+0000 7ffb31c5c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.762 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.762+0000 7ffb31c5c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:29.762 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.762+0000 7ffb31c5c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.763 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.762+0000 7ffb31c5c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:29.763 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.762+0000 7ffb31c5c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.764 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.762+0000 7ffb31c5c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:29.764 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.762+0000 7ffb31c5c9c0 20 searching for the correct realm 2024-09-14T11:12:29.769 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.766+0000 7ffb2f762640 0 -- 172.21.15.71:0/489933466 >> [v2:172.21.15.157:6808/527702018,v1:172.21.15.157:6809/527702018] conn(0x7ffb20017070 msgr2=0x7ffb2005bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:29.983 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.982+0000 7ffb2f762640 0 -- 172.21.15.71:0/489933466 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x5567039a9cf0 msgr2=0x5567039ac1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:29.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.990+0000 7ffb31c5c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:29.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.990+0000 7ffb31c5c9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:12:29.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.990+0000 7ffb31c5c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:29.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.990+0000 7ffb31c5c9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:12:29.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.990+0000 7ffb31c5c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:29.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.990+0000 7ffb31c5c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:29.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.990+0000 7ffb31c5c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.990+0000 7ffb31c5c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:29.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.990+0000 7ffb31c5c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.990+0000 7ffb31c5c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:29.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.990+0000 7ffb31c5c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.990+0000 7ffb31c5c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:29.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.990+0000 7ffb31c5c9c0 20 zone default found 2024-09-14T11:12:29.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.990+0000 7ffb31c5c9c0 4 Realm: () 2024-09-14T11:12:29.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.990+0000 7ffb31c5c9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:12:29.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.990+0000 7ffb31c5c9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:12:29.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.990+0000 7ffb31c5c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:29.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.990+0000 7ffb31c5c9c0 20 zonegroup default 2024-09-14T11:12:29.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.990+0000 7ffb31c5c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.994+0000 7ffb31c5c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:29.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.994+0000 7ffb31c5c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.995 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.994+0000 7ffb31c5c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:29.995 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.994+0000 7ffb31c5c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:29.996 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.994+0000 7ffb31c5c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:29.996 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.994+0000 7ffb31c5c9c0 20 started sync module instance, tier type = 2024-09-14T11:12:29.996 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:29.994+0000 7ffb31c5c9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:12:30.020 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.018+0000 7ffb31c5c9c0 20 add_watcher() i=0 2024-09-14T11:12:30.020 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.018+0000 7ffb31c5c9c0 20 add_watcher() i=1 2024-09-14T11:12:30.020 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.018+0000 7ffb31c5c9c0 20 add_watcher() i=2 2024-09-14T11:12:30.020 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.018+0000 7ffb31c5c9c0 20 add_watcher() i=3 2024-09-14T11:12:30.020 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.018+0000 7ffb31c5c9c0 20 add_watcher() i=4 2024-09-14T11:12:30.020 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.018+0000 7ffb31c5c9c0 20 add_watcher() i=5 2024-09-14T11:12:30.020 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.018+0000 7ffb31c5c9c0 20 add_watcher() i=6 2024-09-14T11:12:30.022 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.022+0000 7ffb31c5c9c0 20 add_watcher() i=7 2024-09-14T11:12:30.022 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.022+0000 7ffb31c5c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:30.026 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.026+0000 7ff9e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:30.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.026+0000 7ffb31c5c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:30.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.026+0000 7ffb31c5c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:30.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.026+0000 7ffb31c5c9c0 5 note: GC not initialized 2024-09-14T11:12:30.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.026+0000 7ff9e4fe1640 20 reqs_thread_entry: start 2024-09-14T11:12:30.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.026+0000 7ffb31c5c9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:12:30.029 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.026+0000 7ffb31c5c9c0 20 Filter name: none 2024-09-14T11:12:30.029 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.026+0000 7ff95e7fc640 20 reqs_thread_entry: start 2024-09-14T11:12:30.029 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.026+0000 7ffb31c5c9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:12:30.029 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.026+0000 7ffb31c5c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.030 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.030+0000 7ffb31c5c9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:12:30.030 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.030+0000 7ffb31c5c9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:12:30.030 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.030+0000 7ffb31c5c9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:12:30.030 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.030+0000 7ffb31c5c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 : miss 2024-09-14T11:12:30.030 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.030+0000 7ffb31c5c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.031 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.030+0000 7ffb31c5c9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:12:30.031 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.030+0000 7ffb31c5c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 info.flags=0x17 2024-09-14T11:12:30.031 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.030+0000 7ffb31c5c9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 to cache LRU end 2024-09-14T11:12:30.031 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.030+0000 7ffb31c5c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:12:30.031 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.030+0000 7ffb31c5c9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:12:30.031 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.030+0000 7ffb31c5c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.2 2024-09-14T11:12:30.032 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.030+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.0 2024-09-14T11:12:30.032 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.030+0000 7ffb31c5c9c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:12:30.032 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.030+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.1 2024-09-14T11:12:30.033 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.030+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.2 2024-09-14T11:12:30.034 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.034+0000 7ffb31c5c9c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:12:30.034 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.034+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.3 2024-09-14T11:12:30.036 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.034+0000 7ffb31c5c9c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:12:30.036 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.034+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.4 2024-09-14T11:12:30.036 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.034+0000 7ffb31c5c9c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:12:30.036 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.034+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:30.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.034+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.6 2024-09-14T11:12:30.038 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.038+0000 7ffb31c5c9c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:12:30.038 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.038+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.7 2024-09-14T11:12:30.039 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.038+0000 7ffb31c5c9c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:12:30.039 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.038+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:30.041 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.038+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.9 2024-09-14T11:12:30.042 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.042+0000 7ffb31c5c9c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-14T11:12:30.042 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.042+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.10 2024-09-14T11:12:30.042 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.042+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.1 2024-09-14T11:12:30.043 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.042+0000 7ffb31c5c9c0 20 get_obj_state: octx=0x55670369a290 obj=check-bucket:e state=0x5567039e0e38 s->prefetch_data=0 2024-09-14T11:12:30.043 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.042+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:30.044 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.042+0000 7ffb31c5c9c0 20 get_obj_state: octx=0x55670373c460 obj=check-bucket:d state=0x5567039d6e18 s->prefetch_data=0 2024-09-14T11:12:30.044 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.042+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:30.044 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.042+0000 7ffb31c5c9c0 20 get_obj_state: octx=0x5567039d9b90 obj=check-bucket:c state=0x5567039d8168 s->prefetch_data=0 2024-09-14T11:12:30.044 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.042+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.10 2024-09-14T11:12:30.045 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.042+0000 7ffb31c5c9c0 20 get_obj_state: octx=0x5567039d7bb0 obj=check-bucket:f state=0x5567039de498 s->prefetch_data=0 2024-09-14T11:12:30.045 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.042+0000 7ffb31c5c9c0 20 get_obj_state: setting s->obj_tag to krzfghfv7q2r9d6ufwnssmq8jjyah2tr 2024-09-14T11:12:30.046 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.042+0000 7ffb31c5c9c0 20 get_obj_state_impl: setting s->olh_tag to 2zaa9xkwfasbsxzvbbf169shg2fx2qdc 2024-09-14T11:12:30.046 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.042+0000 7ffb31c5c9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2zaa9xkwfasbsxzvbbf169shg2fx2qdc 2024-09-14T11:12:30.046 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.042+0000 7ffb31c5c9c0 20 get_obj_state: setting s->obj_tag to 2kpcnj78vyp95trkb9b31zzmpadd92hf 2024-09-14T11:12:30.046 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.042+0000 7ffb31c5c9c0 20 get_obj_state_impl: setting s->olh_tag to g79zvfod3hoeqbd0kxj43uckvq2s2wre 2024-09-14T11:12:30.046 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.042+0000 7ffb31c5c9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=g79zvfod3hoeqbd0kxj43uckvq2s2wre 2024-09-14T11:12:30.046 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.042+0000 7ffb31c5c9c0 20 get_obj_state: setting s->obj_tag to wxd2zgu6dv6dvwgbdso3e56d6mz8wfbv 2024-09-14T11:12:30.046 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.042+0000 7ffb31c5c9c0 20 get_obj_state_impl: setting s->olh_tag to dgekfai7uld21cwlvwnz01bfwz230mqc 2024-09-14T11:12:30.046 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.042+0000 7ffb31c5c9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=dgekfai7uld21cwlvwnz01bfwz230mqc 2024-09-14T11:12:30.046 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.042+0000 7ffb31c5c9c0 20 get_obj_state: setting s->obj_tag to k22q44xf7qnkw0zufkhce7fsp0nb4kj1 2024-09-14T11:12:30.046 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.042+0000 7ffb31c5c9c0 20 get_obj_state_impl: setting s->olh_tag to jpk5pdbefbz6cfqfl76dxpf4j440xnxt 2024-09-14T11:12:30.046 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.042+0000 7ffb31c5c9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=jpk5pdbefbz6cfqfl76dxpf4j440xnxt 2024-09-14T11:12:30.047 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.046+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:30.048 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.046+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:30.048 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.046+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.10 2024-09-14T11:12:30.048 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.046+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.1 2024-09-14T11:12:30.050 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.050+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:30.050 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.050+0000 7ffb31c5c9c0 20 olh_log_entry: epoch=3 op=3 key=d[OVVNkWJX0suMmghM2W41JvGsvb-MNxQ] 2024-09-14T11:12:30.051 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.050+0000 7ffb31c5c9c0 20 get_obj_state: octx=0x55670373c460 obj=check-bucket:_:OVVNkWJX0suMmghM2W41JvGsvb-MNxQ_d state=0x556703a82e68 s->prefetch_data=0 2024-09-14T11:12:30.051 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.050+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:30.051 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.050+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.1 2024-09-14T11:12:30.052 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.050+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.10 2024-09-14T11:12:30.052 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.050+0000 7ffb31c5c9c0 10 manifest: total_size = 11 2024-09-14T11:12:30.052 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.050+0000 7ffb31c5c9c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.14774078548744610032 2024-09-14T11:12:30.052 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.050+0000 7ffb31c5c9c0 20 get_obj_state: octx=0x55670373c460 obj=check-bucket:_:OVVNkWJX0suMmghM2W41JvGsvb-MNxQ_d state=0x556703a82e68 s->prefetch_data=0 2024-09-14T11:12:30.052 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.050+0000 7ffb31c5c9c0 20 prepare_atomic_modification: state is not atomic. state=0x556703a82e68 2024-09-14T11:12:30.052 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.050+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:30.053 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.050+0000 7ffb31c5c9c0 20 olh_log_entry: epoch=3 op=3 key=c[YEJgRbp7xtjXcaENVq5geTmXafY8lqq] 2024-09-14T11:12:30.053 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.050+0000 7ffb31c5c9c0 20 get_obj_state: octx=0x5567039d9b90 obj=check-bucket:_:YEJgRbp7xtjXcaENVq5geTmXafY8lqq_c state=0x556703a801e8 s->prefetch_data=0 2024-09-14T11:12:30.053 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.050+0000 7ffb31c5c9c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-14T11:12:30.053 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.050+0000 7ffb31c5c9c0 20 olh_log_entry: epoch=2 op=3 key=e[lsDY.PH7poGUfHWVYX2N32zDLsqAqGg] 2024-09-14T11:12:30.053 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.050+0000 7ffb31c5c9c0 20 get_obj_state: octx=0x55670369a290 obj=check-bucket:_:lsDY.PH7poGUfHWVYX2N32zDLsqAqGg_e state=0x556703a8f588 s->prefetch_data=0 2024-09-14T11:12:30.053 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.050+0000 7ffb31c5c9c0 10 manifest: total_size = 22 2024-09-14T11:12:30.054 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.050+0000 7ffb31c5c9c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.13646715808008857490 2024-09-14T11:12:30.054 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.050+0000 7ffb31c5c9c0 20 get_obj_state: octx=0x55670369a290 obj=check-bucket:_:lsDY.PH7poGUfHWVYX2N32zDLsqAqGg_e state=0x556703a8f588 s->prefetch_data=0 2024-09-14T11:12:30.054 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.050+0000 7ffb31c5c9c0 20 prepare_atomic_modification: state is not atomic. state=0x556703a8f588 2024-09-14T11:12:30.054 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.050+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.1 2024-09-14T11:12:30.054 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.050+0000 7ffb31c5c9c0 10 manifest: total_size = 22 2024-09-14T11:12:30.054 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.050+0000 7ffb31c5c9c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.7005320977559400214 2024-09-14T11:12:30.054 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.050+0000 7ffb31c5c9c0 20 get_obj_state: octx=0x5567039d9b90 obj=check-bucket:_:YEJgRbp7xtjXcaENVq5geTmXafY8lqq_c state=0x556703a801e8 s->prefetch_data=0 2024-09-14T11:12:30.054 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.050+0000 7ffb31c5c9c0 20 prepare_atomic_modification: state is not atomic. state=0x556703a801e8 2024-09-14T11:12:30.054 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.050+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:30.054 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.050+0000 7ffb31c5c9c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-14T11:12:30.055 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.050+0000 7ffb31c5c9c0 20 olh_log_entry: epoch=2 op=3 key=f[zKs-5JXUDQPUOhl70VyiR2yjPDoYb9a] 2024-09-14T11:12:30.055 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.050+0000 7ffb31c5c9c0 20 get_obj_state: octx=0x5567039d7bb0 obj=check-bucket:_:zKs-5JXUDQPUOhl70VyiR2yjPDoYb9a_f state=0x556703a9ef38 s->prefetch_data=0 2024-09-14T11:12:30.055 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.054+0000 7ffb31c5c9c0 10 manifest: total_size = 22 2024-09-14T11:12:30.055 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.054+0000 7ffb31c5c9c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.14406410927560211178 2024-09-14T11:12:30.055 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.054+0000 7ffb31c5c9c0 20 get_obj_state: octx=0x5567039d7bb0 obj=check-bucket:_:zKs-5JXUDQPUOhl70VyiR2yjPDoYb9a_f state=0x556703a9ef38 s->prefetch_data=0 2024-09-14T11:12:30.055 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.054+0000 7ffb31c5c9c0 20 prepare_atomic_modification: state is not atomic. state=0x556703a9ef38 2024-09-14T11:12:30.055 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.054+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.10 2024-09-14T11:12:30.058 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.058+0000 7ffa12ffd640 20 handle_completion(): completion ok for obj=e[lsDY.PH7poGUfHWVYX2N32zDLsqAqGg] 2024-09-14T11:12:30.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.058+0000 7ffb31c5c9c0 20 get_obj_state: octx=0x55670369a290 obj=check-bucket:e state=0x5567039e0e38 s->prefetch_data=0 2024-09-14T11:12:30.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.058+0000 7ffb31c5c9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2zaa9xkwfasbsxzvbbf169shg2fx2qdc 2024-09-14T11:12:30.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.058+0000 7ffa12ffd640 20 handle_completion(): completion ok for obj=c[YEJgRbp7xtjXcaENVq5geTmXafY8lqq] 2024-09-14T11:12:30.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.058+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:30.062 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.058+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:30.062 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.062+0000 7ffa127fc640 20 handle_completion(): completion ok for obj=d[OVVNkWJX0suMmghM2W41JvGsvb-MNxQ] 2024-09-14T11:12:30.062 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.062+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:30.063 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.062+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:30.063 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.062+0000 7ffa12ffd640 20 handle_completion(): completion ok for obj=f[zKs-5JXUDQPUOhl70VyiR2yjPDoYb9a] 2024-09-14T11:12:30.064 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.062+0000 7ffb31c5c9c0 20 get_obj_state: octx=0x5567039d7bb0 obj=check-bucket:f state=0x5567039de498 s->prefetch_data=0 2024-09-14T11:12:30.064 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.062+0000 7ffb31c5c9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=jpk5pdbefbz6cfqfl76dxpf4j440xnxt 2024-09-14T11:12:30.065 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.062+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.8 2024-09-14T11:12:30.065 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.062+0000 7ffb31c5c9c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-14T11:12:30.065 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.062+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.5 2024-09-14T11:12:30.065 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.062+0000 7ffb31c5c9c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-14T11:12:30.066 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.066+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.1 2024-09-14T11:12:30.068 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.066+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.1 2024-09-14T11:12:30.068 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.066+0000 7ffb31c5c9c0 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-14T11:12:30.068 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.066+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.10 2024-09-14T11:12:30.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.070+0000 7ffb31c5c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.2.10 2024-09-14T11:12:30.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.070+0000 7ffb31c5c9c0 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-14T11:12:30.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.070+0000 7ffb31c5c9c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-14T11:12:30.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.070+0000 7ff9e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:30.076 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.074+0000 7ffb31c5c9c0 20 remove_watcher() i=0 2024-09-14T11:12:30.076 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.074+0000 7ffb31c5c9c0 2 removed watcher, disabling cache 2024-09-14T11:12:30.081 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.078+0000 7ffb31c5c9c0 20 remove_watcher() i=1 2024-09-14T11:12:30.081 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.078+0000 7ffb31c5c9c0 20 remove_watcher() i=2 2024-09-14T11:12:30.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.082+0000 7ffb31c5c9c0 20 remove_watcher() i=3 2024-09-14T11:12:30.085 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.082+0000 7ffb31c5c9c0 20 remove_watcher() i=4 2024-09-14T11:12:30.088 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.086+0000 7ffb31c5c9c0 20 remove_watcher() i=5 2024-09-14T11:12:30.090 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.090+0000 7ffb31c5c9c0 20 remove_watcher() i=6 2024-09-14T11:12:30.093 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.090+0000 7ffb31c5c9c0 20 remove_watcher() i=7 2024-09-14T11:12:30.163 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-14T11:12:30.191 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:30.191 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:30.236 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.234+0000 7f94e37ef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.238 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.238+0000 7f94e37ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:30.238 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.238+0000 7f94e37ef9c0 20 realm 2024-09-14T11:12:30.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.238+0000 7f94e37ef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.238+0000 7f94e37ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:30.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.238+0000 7f94e37ef9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:30.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.238+0000 7f94e37ef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.238+0000 7f94e37ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:30.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.238+0000 7f94e37ef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.240 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.238+0000 7f94e37ef9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:30.240 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.238+0000 7f94e37ef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.241 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.238+0000 7f94e37ef9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:30.241 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.238+0000 7f94e37ef9c0 20 searching for the correct realm 2024-09-14T11:12:30.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.242+0000 7f94e1af6640 0 -- 172.21.15.71:0/3630387700 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f94d80e5070 msgr2=0x7f94d80e8960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:30.252 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.250+0000 7f94e1af6640 0 -- 172.21.15.71:0/3630387700 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55ec69830690 msgr2=0x55ec69832a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:12:30.261 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.258+0000 7f94e37ef9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:30.261 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.258+0000 7f94e37ef9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:12:30.261 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.258+0000 7f94e37ef9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:30.261 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.258+0000 7f94e37ef9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:12:30.261 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.258+0000 7f94e37ef9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:30.261 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.258+0000 7f94e37ef9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:30.261 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.258+0000 7f94e37ef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.262 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.258+0000 7f94e37ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:30.262 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.258+0000 7f94e37ef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.262 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.258+0000 7f94e37ef9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:30.262 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.258+0000 7f94e37ef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.263 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.262+0000 7f94e37ef9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:30.263 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.262+0000 7f94e37ef9c0 20 zone default found 2024-09-14T11:12:30.263 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.262+0000 7f94e37ef9c0 4 Realm: () 2024-09-14T11:12:30.263 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.262+0000 7f94e37ef9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:12:30.263 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.262+0000 7f94e37ef9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:12:30.263 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.262+0000 7f94e37ef9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:30.264 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.262+0000 7f94e37ef9c0 20 zonegroup default 2024-09-14T11:12:30.264 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.262+0000 7f94e37ef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.264 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.262+0000 7f94e37ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:30.264 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.262+0000 7f94e37ef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.264 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.262+0000 7f94e37ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:30.264 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.262+0000 7f94e37ef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.264 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.262+0000 7f94e37ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:30.264 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.262+0000 7f94e37ef9c0 20 started sync module instance, tier type = 2024-09-14T11:12:30.264 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.262+0000 7f94e37ef9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:12:30.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.282+0000 7f94e37ef9c0 20 add_watcher() i=0 2024-09-14T11:12:30.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.282+0000 7f94e37ef9c0 20 add_watcher() i=1 2024-09-14T11:12:30.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.282+0000 7f94e37ef9c0 20 add_watcher() i=2 2024-09-14T11:12:30.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.282+0000 7f94e37ef9c0 20 add_watcher() i=3 2024-09-14T11:12:30.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.282+0000 7f94e37ef9c0 20 add_watcher() i=4 2024-09-14T11:12:30.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.282+0000 7f94e37ef9c0 20 add_watcher() i=5 2024-09-14T11:12:30.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.282+0000 7f94e37ef9c0 20 add_watcher() i=6 2024-09-14T11:12:30.286 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.286+0000 7f94e37ef9c0 20 add_watcher() i=7 2024-09-14T11:12:30.286 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.286+0000 7f94e37ef9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:30.289 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.286+0000 7f93977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:30.290 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.286+0000 7f94e37ef9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:30.290 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.286+0000 7f94e37ef9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:30.290 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.286+0000 7f94e37ef9c0 5 note: GC not initialized 2024-09-14T11:12:30.290 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.290+0000 7f93967e4640 20 reqs_thread_entry: start 2024-09-14T11:12:30.290 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.290+0000 7f94e37ef9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:12:30.290 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.290+0000 7f94e37ef9c0 20 Filter name: none 2024-09-14T11:12:30.290 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.290+0000 7f9307fff640 20 reqs_thread_entry: start 2024-09-14T11:12:30.290 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.290+0000 7f94e37ef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.291 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.290+0000 7f94e37ef9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:12:30.291 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.290+0000 7f94e37ef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.292 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.290+0000 7f94e37ef9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:12:30.292 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.290+0000 7f94e37ef9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:12:30.292 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.290+0000 7f94e37ef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.292 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.290+0000 7f94e37ef9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:12:30.292 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.290+0000 7f94e37ef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:12:30.293 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.290+0000 7f94e37ef9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:12:30.293 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.290+0000 7f94e37ef9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:12:30.295 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.294+0000 7f93977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:30.300 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.298+0000 7f94e37ef9c0 20 remove_watcher() i=0 2024-09-14T11:12:30.300 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.298+0000 7f94e37ef9c0 2 removed watcher, disabling cache 2024-09-14T11:12:30.302 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.302+0000 7f94e37ef9c0 20 remove_watcher() i=1 2024-09-14T11:12:30.304 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.302+0000 7f94e37ef9c0 20 remove_watcher() i=2 2024-09-14T11:12:30.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.306+0000 7f94e37ef9c0 20 remove_watcher() i=3 2024-09-14T11:12:30.309 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.306+0000 7f94e37ef9c0 20 remove_watcher() i=4 2024-09-14T11:12:30.311 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.310+0000 7f94e37ef9c0 20 remove_watcher() i=5 2024-09-14T11:12:30.313 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.310+0000 7f94e37ef9c0 20 remove_watcher() i=6 2024-09-14T11:12:30.316 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:12:30.314+0000 7f94e37ef9c0 20 remove_watcher() i=7 2024-09-14T11:12:30.331 INFO:tasks.workunit.client.0.smithi071.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-14T11:12:30.331 INFO:tasks.workunit.client.0.smithi071.stderr:Deleting bucket check-bucket 2024-09-14T11:12:30.391 INFO:tasks.workunit.client.0.smithi071.stderr:Completed bucket check tests 2024-09-14T11:12:30.391 INFO:tasks.workunit.client.0.smithi071.stdout:connected to http://localhost:80 2024-09-14T11:12:30.484 INFO:tasks.workunit.client.0.smithi071.stderr:+ deactivate 2024-09-14T11:12:30.484 INFO:tasks.workunit.client.0.smithi071.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-14T11:12:30.484 INFO:tasks.workunit.client.0.smithi071.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T11:12:30.484 INFO:tasks.workunit.client.0.smithi071.stderr:+ export PATH 2024-09-14T11:12:30.484 INFO:tasks.workunit.client.0.smithi071.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T11:12:30.484 INFO:tasks.workunit.client.0.smithi071.stderr:+ '[' -n '' ']' 2024-09-14T11:12:30.484 INFO:tasks.workunit.client.0.smithi071.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:12:30.484 INFO:tasks.workunit.client.0.smithi071.stderr:+ hash -r 2024-09-14T11:12:30.484 INFO:tasks.workunit.client.0.smithi071.stderr:+ '[' -n '' ']' 2024-09-14T11:12:30.484 INFO:tasks.workunit.client.0.smithi071.stderr:+ unset VIRTUAL_ENV 2024-09-14T11:12:30.485 INFO:tasks.workunit.client.0.smithi071.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-14T11:12:30.485 INFO:tasks.workunit.client.0.smithi071.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T11:12:30.485 INFO:tasks.workunit.client.0.smithi071.stderr:+ unset -f deactivate 2024-09-14T11:12:30.485 INFO:tasks.workunit.client.0.smithi071.stdout:OK. 2024-09-14T11:12:30.486 INFO:tasks.workunit.client.0.smithi071.stderr:+ echo OK. 2024-09-14T11:12:30.486 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:12:30.486 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:12:30.542 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-14T11:12:30.543 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:12:30.946 DEBUG:teuthology.parallel:result is None 2024-09-14T11:12:30.946 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:12:30.960 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:12:30.961 DEBUG:teuthology.orchestra.run.smithi071:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:12:31.006 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:12:31.006 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:12:31.017 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:12:31.018 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:12:31.018 DEBUG:teuthology.orchestra.run.smithi071:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:12:31.058 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:12:31.059 INFO:teuthology.orchestra.run.smithi071.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:12:31.059 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:12:31.107 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:12:31.107 DEBUG:teuthology.orchestra.run.smithi071:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:12:31.158 INFO:tasks.workunit:timeout=3h 2024-09-14T11:12:31.159 INFO:tasks.workunit:cleanup=True 2024-09-14T11:12:31.159 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:12:31.213 INFO:tasks.workunit.client.0.smithi071.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:13:25.079 INFO:tasks.workunit.client.0.smithi071.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:13:25.079 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:13:25.079 INFO:tasks.workunit.client.0.smithi071.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:13:25.079 INFO:tasks.workunit.client.0.smithi071.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:13:25.079 INFO:tasks.workunit.client.0.smithi071.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:13:25.079 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:13:25.079 INFO:tasks.workunit.client.0.smithi071.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:13:25.080 INFO:tasks.workunit.client.0.smithi071.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:13:25.080 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:13:25.080 INFO:tasks.workunit.client.0.smithi071.stderr: git switch -c 2024-09-14T11:13:25.080 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:13:25.080 INFO:tasks.workunit.client.0.smithi071.stderr:Or undo this operation with: 2024-09-14T11:13:25.080 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:13:25.080 INFO:tasks.workunit.client.0.smithi071.stderr: git switch - 2024-09-14T11:13:25.080 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:13:25.080 INFO:tasks.workunit.client.0.smithi071.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:13:25.080 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:13:25.080 INFO:tasks.workunit.client.0.smithi071.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:13:25.082 DEBUG:teuthology.orchestra.run.smithi071:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:13:25.130 INFO:tasks.workunit.client.0.smithi071.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:13:25.132 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:13:25.132 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:13:25.182 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:13:25.234 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:13:25.273 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:13:25.274 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:13:25.274 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:13:25.317 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:13:25.321 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T11:13:25.321 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:13:25.365 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-14T11:13:25.367 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-14T11:13:25.367 DEBUG:teuthology.orchestra.run.smithi071:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-14T11:13:25.428 INFO:tasks.workunit.client.0.smithi071.stdout:Running main() from gmock_main.cc 2024-09-14T11:13:25.429 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T11:13:25.429 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-14T11:13:25.429 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 11 tests from ClsLock 2024-09-14T11:13:25.429 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-14T11:13:27.223 INFO:tasks.workunit.client.0.smithi071.stdout:lock: mylock 2024-09-14T11:13:27.223 INFO:tasks.workunit.client.0.smithi071.stdout: lock_type: exclusive 2024-09-14T11:13:27.223 INFO:tasks.workunit.client.0.smithi071.stdout: tag: 2024-09-14T11:13:27.223 INFO:tasks.workunit.client.0.smithi071.stdout: lockers: 2024-09-14T11:13:27.223 INFO:tasks.workunit.client.0.smithi071.stdout: client.4994 expiration=2024-09-14T11:15:27.219361+0000 addr=v1:172.21.15.71:0/3028685137 cookie= 2024-09-14T11:13:27.231 INFO:tasks.workunit.client.0.smithi071.stdout:lock: mylock 2024-09-14T11:13:27.231 INFO:tasks.workunit.client.0.smithi071.stdout: lock_type: shared 2024-09-14T11:13:27.231 INFO:tasks.workunit.client.0.smithi071.stdout: tag: 2024-09-14T11:13:27.231 INFO:tasks.workunit.client.0.smithi071.stdout: lockers: 2024-09-14T11:13:27.231 INFO:tasks.workunit.client.0.smithi071.stdout: client.4994 expiration=2024-09-14T11:15:27.232788+0000 addr=v1:172.21.15.71:0/3028685137 cookie= 2024-09-14T11:13:27.231 INFO:tasks.workunit.client.0.smithi071.stdout: client.4997 expiration=0.000000 addr=v1:172.21.15.71:0/1788746065 cookie= 2024-09-14T11:13:27.233 INFO:tasks.workunit.client.0.smithi071.stdout:lock: mylock 2024-09-14T11:13:27.233 INFO:tasks.workunit.client.0.smithi071.stdout: lock_type: shared 2024-09-14T11:13:27.233 INFO:tasks.workunit.client.0.smithi071.stdout: tag: 2024-09-14T11:13:27.233 INFO:tasks.workunit.client.0.smithi071.stdout: lockers: 2024-09-14T11:13:27.233 INFO:tasks.workunit.client.0.smithi071.stdout: client.4997 expiration=0.000000 addr=v1:172.21.15.71:0/1788746065 cookie= 2024-09-14T11:13:28.167 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] ClsLock.TestMultiLocking (2738 ms) 2024-09-14T11:13:28.167 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] ClsLock.TestMeta 2024-09-14T11:13:30.509 INFO:tasks.workunit.client.0.smithi071.stdout:lock: mylock 2024-09-14T11:13:30.510 INFO:tasks.workunit.client.0.smithi071.stdout: lock_type: shared 2024-09-14T11:13:30.510 INFO:tasks.workunit.client.0.smithi071.stdout: tag: 2024-09-14T11:13:30.510 INFO:tasks.workunit.client.0.smithi071.stdout: lockers: 2024-09-14T11:13:30.510 INFO:tasks.workunit.client.0.smithi071.stdout: client.5009 expiration=0.000000 addr=v1:172.21.15.71:0/2308288354 cookie= 2024-09-14T11:13:30.514 INFO:tasks.workunit.client.0.smithi071.stdout:lock: mylock 2024-09-14T11:13:30.514 INFO:tasks.workunit.client.0.smithi071.stdout: lock_type: exclusive 2024-09-14T11:13:30.514 INFO:tasks.workunit.client.0.smithi071.stdout: tag: new_tag 2024-09-14T11:13:30.514 INFO:tasks.workunit.client.0.smithi071.stdout: lockers: 2024-09-14T11:13:30.514 INFO:tasks.workunit.client.0.smithi071.stdout: client.5003 expiration=0.000000 addr=v1:172.21.15.71:0/607943716 cookie= 2024-09-14T11:13:31.238 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] ClsLock.TestMeta (3072 ms) 2024-09-14T11:13:31.238 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] ClsLock.TestCookie 2024-09-14T11:13:33.276 INFO:tasks.workunit.client.0.smithi071.stdout:lock: mylock 2024-09-14T11:13:33.276 INFO:tasks.workunit.client.0.smithi071.stdout: lock_type: exclusive 2024-09-14T11:13:33.276 INFO:tasks.workunit.client.0.smithi071.stdout: tag: 2024-09-14T11:13:33.276 INFO:tasks.workunit.client.0.smithi071.stdout: lockers: 2024-09-14T11:13:33.281 INFO:tasks.workunit.client.0.smithi071.stdout:lock: mylock 2024-09-14T11:13:33.281 INFO:tasks.workunit.client.0.smithi071.stdout: lock_type: shared 2024-09-14T11:13:33.281 INFO:tasks.workunit.client.0.smithi071.stdout: tag: 2024-09-14T11:13:33.281 INFO:tasks.workunit.client.0.smithi071.stdout: lockers: 2024-09-14T11:13:33.281 INFO:tasks.workunit.client.0.smithi071.stdout: client.5178 expiration=0.000000 addr=v1:172.21.15.71:0/1554554841 cookie= 2024-09-14T11:13:33.281 INFO:tasks.workunit.client.0.smithi071.stdout: client.5178 expiration=0.000000 addr=v1:172.21.15.71:0/1554554841 cookie=new cookie 2024-09-14T11:13:34.249 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] ClsLock.TestCookie (3010 ms) 2024-09-14T11:13:34.249 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-14T11:13:37.335 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] ClsLock.TestMultipleLocks (3087 ms) 2024-09-14T11:13:37.336 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-14T11:13:44.474 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] ClsLock.TestLockDuration (7138 ms) 2024-09-14T11:13:44.474 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-14T11:13:47.501 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] ClsLock.TestAssertLocked (3025 ms) 2024-09-14T11:13:47.501 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-14T11:13:50.505 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] ClsLock.TestSetCookie (3007 ms) 2024-09-14T11:13:50.505 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] ClsLock.TestRenew 2024-09-14T11:14:11.155 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] ClsLock.TestRenew (20650 ms) 2024-09-14T11:14:11.155 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-14T11:14:18.137 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (6982 ms) 2024-09-14T11:14:18.138 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-14T11:14:26.197 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8056 ms) 2024-09-14T11:14:26.197 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-14T11:14:34.315 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8122 ms) 2024-09-14T11:14:34.315 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 11 tests from ClsLock (68887 ms total) 2024-09-14T11:14:34.315 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-14T11:14:34.315 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-14T11:14:34.315 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 11 tests from 1 test suite ran. (68887 ms total) 2024-09-14T11:14:34.316 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 11 tests. 2024-09-14T11:14:34.321 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:14:34.322 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:14:34.378 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-14T11:14:34.379 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-14T11:14:34.379 DEBUG:teuthology.orchestra.run.smithi071:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-14T11:14:34.445 INFO:tasks.workunit.client.0.smithi071.stdout:Running main() from gmock_main.cc 2024-09-14T11:14:34.445 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T11:14:34.445 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-14T11:14:34.448 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 4 tests from cls_log 2024-09-14T11:14:34.448 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-14T11:14:37.330 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_log.test_log_add_same_time (2885 ms) 2024-09-14T11:14:37.331 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-14T11:14:40.379 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_log.test_log_add_different_time (3049 ms) 2024-09-14T11:14:40.379 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_log.trim_by_time 2024-09-14T11:14:43.437 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_log.trim_by_time (3057 ms) 2024-09-14T11:14:43.437 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-14T11:14:46.449 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_log.trim_by_marker (3009 ms) 2024-09-14T11:14:46.449 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 4 tests from cls_log (12001 ms total) 2024-09-14T11:14:46.449 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-14T11:14:46.449 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-14T11:14:46.449 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 4 tests from 1 test suite ran. (12001 ms total) 2024-09-14T11:14:46.449 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 4 tests. 2024-09-14T11:14:46.451 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:14:46.451 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:14:46.505 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-14T11:14:46.506 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-14T11:14:46.507 DEBUG:teuthology.orchestra.run.smithi071:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-14T11:14:46.571 INFO:tasks.workunit.client.0.smithi071.stdout:Running main() from gmock_main.cc 2024-09-14T11:14:46.571 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-14T11:14:46.571 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-14T11:14:46.572 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 10 tests from cls_refcount 2024-09-14T11:14:46.572 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-14T11:14:49.507 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_refcount.test_implicit (2936 ms) 2024-09-14T11:14:49.507 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-14T11:14:52.579 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3072 ms) 2024-09-14T11:14:52.579 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-14T11:15:01.664 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_refcount.test_put_snap (9085 ms) 2024-09-14T11:15:01.664 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-14T11:15:04.676 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_refcount.test_explicit (3012 ms) 2024-09-14T11:15:04.676 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_refcount.set 2024-09-14T11:15:07.739 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_refcount.set (3064 ms) 2024-09-14T11:15:07.740 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-14T11:15:14.819 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_refcount.test_implicit_ec (7079 ms) 2024-09-14T11:15:14.819 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-14T11:15:21.883 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7064 ms) 2024-09-14T11:15:21.883 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-14T11:15:34.036 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_refcount.test_put_snap_ec (12154 ms) 2024-09-14T11:15:34.036 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-14T11:15:41.060 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_refcount.test_explicit_ec (7024 ms) 2024-09-14T11:15:41.060 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_refcount.set_ec 2024-09-14T11:15:48.157 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_refcount.set_ec (7096 ms) 2024-09-14T11:15:48.157 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 10 tests from cls_refcount (61586 ms total) 2024-09-14T11:15:48.157 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-14T11:15:48.157 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-14T11:15:48.157 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 10 tests from 1 test suite ran. (61586 ms total) 2024-09-14T11:15:48.157 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 10 tests. 2024-09-14T11:15:48.160 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:15:48.161 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:15:48.217 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-14T11:15:48.219 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-14T11:15:48.219 DEBUG:teuthology.orchestra.run.smithi071:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-14T11:15:48.284 INFO:tasks.workunit.client.0.smithi071.stdout:Running main() from gmock_main.cc 2024-09-14T11:15:48.284 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 18 tests from 1 test suite. 2024-09-14T11:15:48.284 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-14T11:15:48.284 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 18 tests from cls_rgw 2024-09-14T11:15:50.193 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_rgw.index_basic 2024-09-14T11:15:50.290 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_rgw.index_basic (97 ms) 2024-09-14T11:15:50.290 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-14T11:15:50.360 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (71 ms) 2024-09-14T11:15:50.360 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-14T11:15:50.461 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_rgw.index_remove_object (101 ms) 2024-09-14T11:15:50.462 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-14T11:15:52.807 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_rgw.index_suggest (2346 ms) 2024-09-14T11:15:52.808 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-14T11:15:52.822 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_rgw.index_suggest_complete (14 ms) 2024-09-14T11:15:52.822 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_rgw.index_list 2024-09-14T11:15:52.877 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_rgw.index_list (55 ms) 2024-09-14T11:15:52.877 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-14T11:16:50.007 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_rgw.index_list_delimited (57129 ms) 2024-09-14T11:16:50.007 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_rgw.bi_list 2024-09-14T11:16:50.225 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_rgw.bi_list (219 ms) 2024-09-14T11:16:50.225 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_rgw.gc_set 2024-09-14T11:16:50.256 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_rgw.gc_set (30 ms) 2024-09-14T11:16:50.256 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_rgw.gc_list 2024-09-14T11:16:50.288 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_rgw.gc_list (31 ms) 2024-09-14T11:16:50.288 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-14T11:16:58.215 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_rgw.gc_defer (7928 ms) 2024-09-14T11:16:58.216 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-14T11:16:58.673 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_rgw.usage_basic (457 ms) 2024-09-14T11:16:58.673 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-14T11:16:58.676 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_rgw.usage_clear_no_obj (2 ms) 2024-09-14T11:16:58.676 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-14T11:16:58.888 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_rgw.usage_clear (212 ms) 2024-09-14T11:16:58.888 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-14T11:16:59.019 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_rgw.bi_log_trim (132 ms) 2024-09-14T11:16:59.019 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-14T11:16:59.051 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_rgw.index_racing_removes (32 ms) 2024-09-14T11:16:59.051 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-14T11:16:59.082 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_rgw.reshardlog_list (31 ms) 2024-09-14T11:16:59.083 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-14T11:16:59.114 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_rgw.reshardlog_num (32 ms) 2024-09-14T11:16:59.235 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 18 tests from cls_rgw (68922 ms total) 2024-09-14T11:16:59.236 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-14T11:16:59.236 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-14T11:16:59.236 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 18 tests from 1 test suite ran. (70952 ms total) 2024-09-14T11:16:59.236 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 18 tests. 2024-09-14T11:16:59.242 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:16:59.242 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:16:59.298 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-14T11:16:59.299 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-14T11:16:59.299 DEBUG:teuthology.orchestra.run.smithi071:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-14T11:16:59.364 INFO:tasks.workunit.client.0.smithi071.stdout:Running main() from gmock_main.cc 2024-09-14T11:16:59.364 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T11:16:59.365 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-14T11:16:59.365 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-14T11:16:59.365 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_rgw_gc.init 2024-09-14T11:17:01.244 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_rgw_gc.init (1879 ms) 2024-09-14T11:17:01.244 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-14T11:17:01.275 INFO:tasks.workunit.client.0.smithi071.stderr:[ ] list info tag = chain-0 2024-09-14T11:17:01.275 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (30 ms) 2024-09-14T11:17:01.275 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-14T11:17:01.283 INFO:tasks.workunit.client.0.smithi071.stderr:[ ] next_marker is: = 0/4263 2024-09-14T11:17:01.284 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (9 ms) 2024-09-14T11:17:01.284 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-14T11:17:01.301 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (17 ms) 2024-09-14T11:17:01.301 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-14T11:17:01.314 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (13 ms) 2024-09-14T11:17:01.314 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-14T11:17:01.327 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (14 ms) 2024-09-14T11:17:01.327 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-14T11:17:01.342 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (15 ms) 2024-09-14T11:17:01.342 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-14T11:17:01.359 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (17 ms) 2024-09-14T11:17:01.360 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-14T11:17:02.281 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_rgw_gc.finalize (921 ms) 2024-09-14T11:17:02.281 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 9 tests from cls_rgw_gc (2916 ms total) 2024-09-14T11:17:02.281 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-14T11:17:02.281 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-14T11:17:02.281 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 9 tests from 1 test suite ran. (2916 ms total) 2024-09-14T11:17:02.281 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 9 tests. 2024-09-14T11:17:02.287 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:17:02.287 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:17:02.341 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-14T11:17:02.342 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-14T11:17:02.342 DEBUG:teuthology.orchestra.run.smithi071:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-14T11:17:02.421 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:02.421 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:02.421 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 1 test from 1 test suite. 2024-09-14T11:17:02.421 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-14T11:17:04.306 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 1 test from cls_rgw_stats 2024-09-14T11:17:04.307 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-14T11:17:04.328 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.327+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=U90HY4Q3CWLO type=del size=1496989 2024-09-14T11:17:04.334 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.335+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~8L20JM2UWZUQ.0 size=1003231 2024-09-14T11:17:04.334 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.335+0000 7fe125ff88c0 1 > prepared multipart upload key=K05LARTJ2QZ3 upload=8L20JM2UWZUQ tag=ALH0IAURP4EH type=write size=2051807 2024-09-14T11:17:04.340 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.339+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~NFB3ULSF1IAP.0 size=591809 2024-09-14T11:17:04.340 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.339+0000 7fe125ff88c0 1 > prepared multipart upload key=YN2HI39GPEDF upload=NFB3ULSF1IAP tag=06FTPDKWP4EZ type=write size=1640385 2024-09-14T11:17:04.344 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.343+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=JL8PT844NAQE type=del size=608049 2024-09-14T11:17:04.350 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.351+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~GISJ19XHOQ6T.0 size=1048576 2024-09-14T11:17:04.353 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.355+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~GISJ19XHOQ6T.1 size=842189 2024-09-14T11:17:04.353 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.355+0000 7fe125ff88c0 1 > prepared multipart upload key=FQ5WT12KB664 upload=GISJ19XHOQ6T tag=OWQWZXNTMX4T type=write size=2939341 2024-09-14T11:17:04.359 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.359+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~2UEVEAJ1WH17.0 size=1048576 2024-09-14T11:17:04.362 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.363+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~2UEVEAJ1WH17.1 size=1048576 2024-09-14T11:17:04.365 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.367+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~2UEVEAJ1WH17.2 size=65539 2024-09-14T11:17:04.366 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.367+0000 7fe125ff88c0 1 > prepared multipart upload key=35EB6U5O4A51 upload=2UEVEAJ1WH17 tag=OA463Z876YL6 type=write size=3211267 2024-09-14T11:17:04.372 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.371+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~0F35W7B4X6UG.0 size=432266 2024-09-14T11:17:04.372 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.371+0000 7fe125ff88c0 1 > prepared multipart upload key=YN2HI39GPEDF upload=0F35W7B4X6UG tag=WKFDYHRIWQVN type=write size=1480842 2024-09-14T11:17:04.379 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.379+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~DSZ1GDQUXB48.0 size=343731 2024-09-14T11:17:04.379 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.379+0000 7fe125ff88c0 1 > prepared multipart upload key=3YGN50MBAF41 upload=DSZ1GDQUXB48 tag=AK82ASJD1QSG type=write size=1392307 2024-09-14T11:17:04.386 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.387+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~113GSDNVE0Z8.0 size=229685 2024-09-14T11:17:04.386 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.387+0000 7fe125ff88c0 1 > prepared multipart upload key=6C3JZKTB8BP3 upload=113GSDNVE0Z8 tag=PAQ768BD2P4Z type=write size=1278261 2024-09-14T11:17:04.393 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.395+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~9U84GTL39LA2.0 size=660841 2024-09-14T11:17:04.393 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.395+0000 7fe125ff88c0 1 > prepared multipart upload key=N80X3YUF4OEL upload=9U84GTL39LA2 tag=G2NHGGM8GQVN type=write size=1709417 2024-09-14T11:17:04.397 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.399+0000 7fe125ff88c0 1 > prepared operation key=SUCH37O8V1LY tag=5UB59FP5YK6A type=write size=346300 2024-09-14T11:17:04.401 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.403+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=ZQELEC1YKT93 type=del size=3484509 2024-09-14T11:17:04.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.407+0000 7fe125ff88c0 1 > prepared part key=_multipart_6PLUU2QIO9LJ.2~JTFG6VB5OKGY.0 size=1048576 2024-09-14T11:17:04.410 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.411+0000 7fe125ff88c0 1 > prepared part key=_multipart_6PLUU2QIO9LJ.2~JTFG6VB5OKGY.1 size=1048576 2024-09-14T11:17:04.413 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.415+0000 7fe125ff88c0 1 > prepared part key=_multipart_6PLUU2QIO9LJ.2~JTFG6VB5OKGY.2 size=65865 2024-09-14T11:17:04.413 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.415+0000 7fe125ff88c0 1 > prepared multipart upload key=6PLUU2QIO9LJ upload=JTFG6VB5OKGY tag=HU08P0BX2PWN type=write size=3211593 2024-09-14T11:17:04.419 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.419+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~GCWKQQDNHX4C.0 size=1003450 2024-09-14T11:17:04.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.419+0000 7fe125ff88c0 1 > prepared multipart upload key=YGEVGH840L18 upload=GCWKQQDNHX4C tag=L6L74V1QGGGZ type=write size=2052026 2024-09-14T11:17:04.427 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.427+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~3L93AW2V6AVH.0 size=903323 2024-09-14T11:17:04.427 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.427+0000 7fe125ff88c0 1 > prepared multipart upload key=21HC4VMHXS6L upload=3L93AW2V6AVH tag=5MZY8GQ6Q822 type=write size=1951899 2024-09-14T11:17:04.431 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.431+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=OCH9XL7MMHOL type=del size=3532014 2024-09-14T11:17:04.441 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.443+0000 7fe125ff88c0 1 < completed delete operation key=2UXA6SXDTUFT tag=U90HY4Q3CWLO type=del 2024-09-14T11:17:04.447 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.447+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=DVF3YJ4S80AE type=del size=292795 2024-09-14T11:17:04.450 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.451+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~8L20JM2UWZUQ.0 size=1003231 2024-09-14T11:17:04.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.455+0000 7fe125ff88c0 1 < completed multipart upload key=K05LARTJ2QZ3 upload=8L20JM2UWZUQ tag=ALH0IAURP4EH type=write size=2051807 2024-09-14T11:17:04.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.459+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=CCY0QDL4EM8T type=del size=2911879 2024-09-14T11:17:04.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.463+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~NFB3ULSF1IAP.0 size=591809 2024-09-14T11:17:04.469 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.471+0000 7fe125ff88c0 1 < completed multipart upload key=YN2HI39GPEDF upload=NFB3ULSF1IAP tag=06FTPDKWP4EZ type=write size=1640385 2024-09-14T11:17:04.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.475+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=RF21POH1TIY7 type=del size=3571944 2024-09-14T11:17:04.480 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.479+0000 7fe125ff88c0 1 < suggested update operation key=F9I82N7RQC81 tag=JL8PT844NAQE type=del size=608049 2024-09-14T11:17:04.483 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.483+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=CC1DL51W5C3L type=del size=3953736 2024-09-14T11:17:04.484 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.483+0000 7fe125ff88c0 1 < canceled part key=_multipart_FQ5WT12KB664.2~GISJ19XHOQ6T.0 size=1048576 2024-09-14T11:17:04.487 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.487+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~GISJ19XHOQ6T.1 size=842189 2024-09-14T11:17:04.493 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.495+0000 7fe125ff88c0 1 < canceled multipart upload key=FQ5WT12KB664 upload=GISJ19XHOQ6T tag=OWQWZXNTMX4T type=write size=2939341 2024-09-14T11:17:04.497 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.499+0000 7fe125ff88c0 1 > prepared operation key=3OU4U9JF3ZD5 tag=OZSWFDMXJ32C type=write size=427907 2024-09-14T11:17:04.500 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.503+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~2UEVEAJ1WH17.0 size=1048576 2024-09-14T11:17:04.504 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.503+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~2UEVEAJ1WH17.1 size=1048576 2024-09-14T11:17:04.508 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.511+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~2UEVEAJ1WH17.2 size=65539 2024-09-14T11:17:04.514 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.515+0000 7fe125ff88c0 1 < completed multipart upload key=35EB6U5O4A51 upload=2UEVEAJ1WH17 tag=OA463Z876YL6 type=write size=3211267 2024-09-14T11:17:04.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.523+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~J0ZJBLLJ80WK.0 size=148071 2024-09-14T11:17:04.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.523+0000 7fe125ff88c0 1 > prepared multipart upload key=YFRH8WECBTJK upload=J0ZJBLLJ80WK tag=IFC0PUYEW2JX type=write size=1196647 2024-09-14T11:17:04.525 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.527+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~0F35W7B4X6UG.0 size=432266 2024-09-14T11:17:04.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.531+0000 7fe125ff88c0 1 < completed multipart upload key=YN2HI39GPEDF upload=0F35W7B4X6UG tag=WKFDYHRIWQVN type=write size=1480842 2024-09-14T11:17:04.535 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.535+0000 7fe125ff88c0 1 > prepared operation key=YFRH8WECBTJK tag=RBYL1BW1ZXGL type=write size=916449 2024-09-14T11:17:04.539 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.539+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~DSZ1GDQUXB48.0 size=343731 2024-09-14T11:17:04.545 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.547+0000 7fe125ff88c0 1 < completed multipart upload key=3YGN50MBAF41 upload=DSZ1GDQUXB48 tag=AK82ASJD1QSG type=write size=1392307 2024-09-14T11:17:04.552 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.551+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~YRVCFTPHM5BO.0 size=29939 2024-09-14T11:17:04.552 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.551+0000 7fe125ff88c0 1 > prepared multipart upload key=21HC4VMHXS6L upload=YRVCFTPHM5BO tag=9M07PPH1SCM8 type=write size=1078515 2024-09-14T11:17:04.557 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.559+0000 7fe125ff88c0 1 < completed part key=_multipart_6C3JZKTB8BP3.2~113GSDNVE0Z8.0 size=229685 2024-09-14T11:17:04.563 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.563+0000 7fe125ff88c0 1 < completed multipart upload key=6C3JZKTB8BP3 upload=113GSDNVE0Z8 tag=PAQ768BD2P4Z type=write size=1278261 2024-09-14T11:17:04.567 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.567+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=A5CK58215RGF type=del size=3612416 2024-09-14T11:17:04.568 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.567+0000 7fe125ff88c0 1 < canceled part key=_multipart_N80X3YUF4OEL.2~9U84GTL39LA2.0 size=660841 2024-09-14T11:17:04.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.575+0000 7fe125ff88c0 1 < canceled multipart upload key=N80X3YUF4OEL upload=9U84GTL39LA2 tag=G2NHGGM8GQVN type=write size=1709417 2024-09-14T11:17:04.581 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.583+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~X8FU0KK8L3EX.0 size=1048576 2024-09-14T11:17:04.584 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.583+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~X8FU0KK8L3EX.1 size=1048576 2024-09-14T11:17:04.586 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.587+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~X8FU0KK8L3EX.2 size=96769 2024-09-14T11:17:04.587 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.587+0000 7fe125ff88c0 1 > prepared multipart upload key=F9I82N7RQC81 upload=X8FU0KK8L3EX tag=BNFVE0HU2M09 type=write size=3242497 2024-09-14T11:17:04.590 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.591+0000 7fe125ff88c0 1 < completed write operation key=SUCH37O8V1LY tag=5UB59FP5YK6A type=write size=346300 2024-09-14T11:17:04.597 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.599+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~308TA911ERRL.0 size=1048576 2024-09-14T11:17:04.600 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.599+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~308TA911ERRL.1 size=522945 2024-09-14T11:17:04.600 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.599+0000 7fe125ff88c0 1 > prepared multipart upload key=YN2HI39GPEDF upload=308TA911ERRL tag=ZACSF8TR6GJW type=write size=2620097 2024-09-14T11:17:04.604 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.603+0000 7fe125ff88c0 1 < completed delete operation key=L4XO0WTYKNXY tag=ZQELEC1YKT93 type=del 2024-09-14T11:17:04.611 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.611+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~P863CMD28GAB.0 size=1048576 2024-09-14T11:17:04.613 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.615+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~P863CMD28GAB.1 size=455750 2024-09-14T11:17:04.613 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.615+0000 7fe125ff88c0 1 > prepared multipart upload key=2UXA6SXDTUFT upload=P863CMD28GAB tag=TL7CXMNNOOAZ type=write size=2552902 2024-09-14T11:17:04.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.619+0000 7fe125ff88c0 1 < completed part key=_multipart_6PLUU2QIO9LJ.2~JTFG6VB5OKGY.0 size=1048576 2024-09-14T11:17:04.620 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.619+0000 7fe125ff88c0 1 < completed part key=_multipart_6PLUU2QIO9LJ.2~JTFG6VB5OKGY.1 size=1048576 2024-09-14T11:17:04.623 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.623+0000 7fe125ff88c0 1 < completed part key=_multipart_6PLUU2QIO9LJ.2~JTFG6VB5OKGY.2 size=65865 2024-09-14T11:17:04.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.631+0000 7fe125ff88c0 1 < completed multipart upload key=6PLUU2QIO9LJ upload=JTFG6VB5OKGY tag=HU08P0BX2PWN type=write size=3211593 2024-09-14T11:17:04.632 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.631+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=RSFJJGSI2ZKM type=del size=1051055 2024-09-14T11:17:04.636 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.635+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~GCWKQQDNHX4C.0 size=1003450 2024-09-14T11:17:04.642 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.643+0000 7fe125ff88c0 1 < completed multipart upload key=YGEVGH840L18 upload=GCWKQQDNHX4C tag=L6L74V1QGGGZ type=write size=2052026 2024-09-14T11:17:04.646 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.647+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=GTL4C9YT5IWU type=write size=652284 2024-09-14T11:17:04.650 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.651+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~3L93AW2V6AVH.0 size=903323 2024-09-14T11:17:04.657 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.659+0000 7fe125ff88c0 1 < completed multipart upload key=21HC4VMHXS6L upload=3L93AW2V6AVH tag=5MZY8GQ6Q822 type=write size=1951899 2024-09-14T11:17:04.661 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.663+0000 7fe125ff88c0 1 > prepared operation key=1ML6RIXI4C5P tag=NFF8W11BL69T type=del size=63848 2024-09-14T11:17:04.666 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.667+0000 7fe125ff88c0 1 < completed delete operation key=V6B470G93KFT tag=OCH9XL7MMHOL type=del 2024-09-14T11:17:04.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.675+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~CPRHKYLWYTZK.0 size=1048576 2024-09-14T11:17:04.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.679+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~CPRHKYLWYTZK.1 size=1048576 2024-09-14T11:17:04.680 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.679+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~CPRHKYLWYTZK.2 size=336691 2024-09-14T11:17:04.680 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.679+0000 7fe125ff88c0 1 > prepared multipart upload key=YFRH8WECBTJK upload=CPRHKYLWYTZK tag=H6SPI1QVBE0S type=write size=3482419 2024-09-14T11:17:04.689 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.691+0000 7fe125ff88c0 1 < suggested update operation key=35EB6U5O4A51 tag=DVF3YJ4S80AE type=del size=292795 2024-09-14T11:17:04.693 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.695+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=TM0WMVD0WUIU type=del size=2122097 2024-09-14T11:17:04.696 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.699+0000 7fe125ff88c0 1 < completed delete operation key=V6B470G93KFT tag=CCY0QDL4EM8T type=del 2024-09-14T11:17:04.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.699+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=ZLG997HSR17T type=del size=332913 2024-09-14T11:17:04.704 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.703+0000 7fe125ff88c0 -1 < failed to complete operation key=35EB6U5O4A51 tag=RF21POH1TIY7 type=del size=3571944: (22) Invalid argument 2024-09-14T11:17:04.714 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.715+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~1TKXYJ4NRLWC.0 size=501219 2024-09-14T11:17:04.714 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.715+0000 7fe125ff88c0 1 > prepared multipart upload key=V6B470G93KFT upload=1TKXYJ4NRLWC tag=937NGY7RQ7SV type=write size=1549795 2024-09-14T11:17:04.718 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.719+0000 7fe125ff88c0 1 < canceled operation key=2LH5U05C2F8C tag=CC1DL51W5C3L type=del size=3953736 2024-09-14T11:17:04.722 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.723+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=SA8Q22N7EJDN type=del size=2230574 2024-09-14T11:17:04.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.727+0000 7fe125ff88c0 1 < completed write operation key=3OU4U9JF3ZD5 tag=OZSWFDMXJ32C type=write size=427907 2024-09-14T11:17:04.731 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.731+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=M7B8BWNJ7E1B type=del size=141769 2024-09-14T11:17:04.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.735+0000 7fe125ff88c0 1 < completed part key=_multipart_YFRH8WECBTJK.2~J0ZJBLLJ80WK.0 size=148071 2024-09-14T11:17:04.741 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.743+0000 7fe125ff88c0 1 < completed multipart upload key=YFRH8WECBTJK upload=J0ZJBLLJ80WK tag=IFC0PUYEW2JX type=write size=1196647 2024-09-14T11:17:04.745 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.747+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=CVQ7IMPFRE33 type=write size=308581 2024-09-14T11:17:04.749 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.751+0000 7fe125ff88c0 1 < canceled operation key=YFRH8WECBTJK tag=RBYL1BW1ZXGL type=write size=916449 2024-09-14T11:17:04.752 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.751+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=388YNN1ZRFGP type=del size=1380623 2024-09-14T11:17:04.756 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.759+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~YRVCFTPHM5BO.0 size=29939 2024-09-14T11:17:04.763 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.763+0000 7fe125ff88c0 1 < completed multipart upload key=21HC4VMHXS6L upload=YRVCFTPHM5BO tag=9M07PPH1SCM8 type=write size=1078515 2024-09-14T11:17:04.771 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.771+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~P2H2SU7IE44E.0 size=1048576 2024-09-14T11:17:04.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.775+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~P2H2SU7IE44E.1 size=139294 2024-09-14T11:17:04.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.775+0000 7fe125ff88c0 1 > prepared multipart upload key=0FITHLGQKQEC upload=P2H2SU7IE44E tag=2HDAA31IH9FV type=write size=2236446 2024-09-14T11:17:04.781 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.783+0000 7fe125ff88c0 1 < suggested update operation key=K3P6U6NU8I01 tag=A5CK58215RGF type=del size=3612416 2024-09-14T11:17:04.786 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.787+0000 7fe125ff88c0 1 > prepared operation key=K05LARTJ2QZ3 tag=NO2ER3KUA0QD type=del size=4055935 2024-09-14T11:17:04.790 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.791+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~X8FU0KK8L3EX.0 size=1048576 2024-09-14T11:17:04.793 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.795+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~X8FU0KK8L3EX.1 size=1048576 2024-09-14T11:17:04.796 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.795+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~X8FU0KK8L3EX.2 size=96769 2024-09-14T11:17:04.803 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.803+0000 7fe125ff88c0 1 < completed multipart upload key=F9I82N7RQC81 upload=X8FU0KK8L3EX tag=BNFVE0HU2M09 type=write size=3242497 2024-09-14T11:17:04.808 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.807+0000 7fe125ff88c0 1 > prepared operation key=SUCH37O8V1LY tag=VOFQEDAL11P4 type=del size=278407 2024-09-14T11:17:04.812 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.811+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~308TA911ERRL.0 size=1048576 2024-09-14T11:17:04.815 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.815+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~308TA911ERRL.1 size=522945 2024-09-14T11:17:04.822 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.823+0000 7fe125ff88c0 1 < completed multipart upload key=YN2HI39GPEDF upload=308TA911ERRL tag=ZACSF8TR6GJW type=write size=2620097 2024-09-14T11:17:04.830 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.831+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~FB6XHCBL4HE1.0 size=74796 2024-09-14T11:17:04.830 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.831+0000 7fe125ff88c0 1 > prepared multipart upload key=0VBX2FWYCFEZ upload=FB6XHCBL4HE1 tag=2YCAZZJNIV9I type=write size=1123372 2024-09-14T11:17:04.834 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.835+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~P863CMD28GAB.0 size=1048576 2024-09-14T11:17:04.837 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.839+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~P863CMD28GAB.1 size=455750 2024-09-14T11:17:04.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.843+0000 7fe125ff88c0 1 < completed multipart upload key=2UXA6SXDTUFT upload=P863CMD28GAB tag=TL7CXMNNOOAZ type=write size=2552902 2024-09-14T11:17:04.847 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.847+0000 7fe125ff88c0 1 > prepared operation key=3YGN50MBAF41 tag=8JE9N1LDL3D1 type=del size=2381529 2024-09-14T11:17:04.851 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.851+0000 7fe125ff88c0 1 < completed delete operation key=2KEKSWK0UT6C tag=RSFJJGSI2ZKM type=del 2024-09-14T11:17:04.855 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.855+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=5OB7T3MVMRNL type=del size=2622075 2024-09-14T11:17:04.859 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.859+0000 7fe125ff88c0 1 < completed write operation key=2KEKSWK0UT6C tag=GTL4C9YT5IWU type=write size=652284 2024-09-14T11:17:04.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.863+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=VKLEG3ARTNCB type=del size=893615 2024-09-14T11:17:04.867 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.867+0000 7fe125ff88c0 1 < completed delete operation key=1ML6RIXI4C5P tag=NFF8W11BL69T type=del 2024-09-14T11:17:04.871 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.871+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=78B3TC7VRTLE type=write size=939828 2024-09-14T11:17:04.875 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.875+0000 7fe125ff88c0 1 < completed part key=_multipart_YFRH8WECBTJK.2~CPRHKYLWYTZK.0 size=1048576 2024-09-14T11:17:04.878 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.879+0000 7fe125ff88c0 1 < completed part key=_multipart_YFRH8WECBTJK.2~CPRHKYLWYTZK.1 size=1048576 2024-09-14T11:17:04.882 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.883+0000 7fe125ff88c0 1 < completed part key=_multipart_YFRH8WECBTJK.2~CPRHKYLWYTZK.2 size=336691 2024-09-14T11:17:04.888 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.887+0000 7fe125ff88c0 1 < completed multipart upload key=YFRH8WECBTJK upload=CPRHKYLWYTZK tag=H6SPI1QVBE0S type=write size=3482419 2024-09-14T11:17:04.892 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.891+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=NF2XKGE2WX67 type=del size=2766836 2024-09-14T11:17:04.896 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.899+0000 7fe125ff88c0 1 < completed delete operation key=2LH5U05C2F8C tag=TM0WMVD0WUIU type=del 2024-09-14T11:17:04.904 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.903+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~RG7IJ7NXSK2F.0 size=1048576 2024-09-14T11:17:04.907 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.907+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~RG7IJ7NXSK2F.1 size=271107 2024-09-14T11:17:04.907 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.907+0000 7fe125ff88c0 1 > prepared multipart upload key=K05LARTJ2QZ3 upload=RG7IJ7NXSK2F tag=9GCM6DXDS7LP type=write size=2368259 2024-09-14T11:17:04.911 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.911+0000 7fe125ff88c0 -1 < failed to complete operation key=K3P6U6NU8I01 tag=ZLG997HSR17T type=del size=332913: (22) Invalid argument 2024-09-14T11:17:04.914 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.915+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=O1OSCU7HC1TX type=del size=175703 2024-09-14T11:17:04.918 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.919+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~1TKXYJ4NRLWC.0 size=501219 2024-09-14T11:17:04.926 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.927+0000 7fe125ff88c0 1 < completed multipart upload key=V6B470G93KFT upload=1TKXYJ4NRLWC tag=937NGY7RQ7SV type=write size=1549795 2024-09-14T11:17:04.929 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.931+0000 7fe125ff88c0 1 > prepared operation key=46ZTDBWFVSUH tag=4NX8K6FB69CD type=del size=1650728 2024-09-14T11:17:04.933 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.935+0000 7fe125ff88c0 1 < completed delete operation key=W0B19NBHNLMZ tag=SA8Q22N7EJDN type=del 2024-09-14T11:17:04.937 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.939+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=65ZS730L800U type=del size=2341030 2024-09-14T11:17:04.941 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.943+0000 7fe125ff88c0 1 < completed delete operation key=N94D3R7IOBNL tag=M7B8BWNJ7E1B type=del 2024-09-14T11:17:04.949 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.951+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~XZDR9ZR79H0B.0 size=1048576 2024-09-14T11:17:04.952 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.951+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~XZDR9ZR79H0B.1 size=150903 2024-09-14T11:17:04.952 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.951+0000 7fe125ff88c0 1 > prepared multipart upload key=2LH5U05C2F8C upload=XZDR9ZR79H0B tag=9A4KDZ2PJ8H1 type=write size=2248055 2024-09-14T11:17:04.956 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.955+0000 7fe125ff88c0 1 < completed write operation key=N94D3R7IOBNL tag=CVQ7IMPFRE33 type=write size=308581 2024-09-14T11:17:04.960 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.959+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=X73MYV8GNN8V type=del size=2181730 2024-09-14T11:17:04.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.963+0000 7fe125ff88c0 1 < completed delete operation key=WEA3MQ0DI42N tag=388YNN1ZRFGP type=del 2024-09-14T11:17:04.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.971+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~DFHKJ51ON4F5.0 size=1048576 2024-09-14T11:17:04.973 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.975+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~DFHKJ51ON4F5.1 size=1048576 2024-09-14T11:17:04.976 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.979+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~DFHKJ51ON4F5.2 size=610996 2024-09-14T11:17:04.976 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.979+0000 7fe125ff88c0 1 > prepared multipart upload key=YN2HI39GPEDF upload=DFHKJ51ON4F5 tag=1DFDDY874JAY type=write size=3756724 2024-09-14T11:17:04.980 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.983+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~P2H2SU7IE44E.0 size=1048576 2024-09-14T11:17:04.983 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.983+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~P2H2SU7IE44E.1 size=139294 2024-09-14T11:17:04.989 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.991+0000 7fe125ff88c0 1 < completed multipart upload key=0FITHLGQKQEC upload=P2H2SU7IE44E tag=2HDAA31IH9FV type=write size=2236446 2024-09-14T11:17:04.996 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.995+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~ZJTUZNC052KP.0 size=1048576 2024-09-14T11:17:04.999 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.999+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~ZJTUZNC052KP.1 size=264549 2024-09-14T11:17:05.000 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:04.999+0000 7fe125ff88c0 1 > prepared multipart upload key=L4XO0WTYKNXY upload=ZJTUZNC052KP tag=W3JXK3EPD1J9 type=write size=2361701 2024-09-14T11:17:05.003 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.003+0000 7fe125ff88c0 1 < canceled operation key=K05LARTJ2QZ3 tag=NO2ER3KUA0QD type=del size=4055935 2024-09-14T11:17:05.010 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.011+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~M9119HMAVK87.0 size=428019 2024-09-14T11:17:05.010 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.011+0000 7fe125ff88c0 1 > prepared multipart upload key=YFRH8WECBTJK upload=M9119HMAVK87 tag=BT28NL0L6199 type=write size=1476595 2024-09-14T11:17:05.014 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.015+0000 7fe125ff88c0 1 < completed delete operation key=SUCH37O8V1LY tag=VOFQEDAL11P4 type=del 2024-09-14T11:17:05.018 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.019+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=UPZJDA8NY9BC type=del size=881626 2024-09-14T11:17:05.021 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.023+0000 7fe125ff88c0 1 < completed part key=_multipart_0VBX2FWYCFEZ.2~FB6XHCBL4HE1.0 size=74796 2024-09-14T11:17:05.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.027+0000 7fe125ff88c0 1 < completed multipart upload key=0VBX2FWYCFEZ upload=FB6XHCBL4HE1 tag=2YCAZZJNIV9I type=write size=1123372 2024-09-14T11:17:05.031 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.031+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=Z7H3673RTABV type=del size=1339444 2024-09-14T11:17:05.035 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.035+0000 7fe125ff88c0 1 < completed delete operation key=3YGN50MBAF41 tag=8JE9N1LDL3D1 type=del 2024-09-14T11:17:05.039 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.039+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=HTJYK3VERNRY type=del size=1558000 2024-09-14T11:17:05.043 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.043+0000 7fe125ff88c0 1 < completed delete operation key=4D2X7151977X tag=5OB7T3MVMRNL type=del 2024-09-14T11:17:05.047 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.047+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=G8EPBOBEGXZT type=write size=909692 2024-09-14T11:17:05.055 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.055+0000 7fe125ff88c0 1 < suggested update operation key=2UXA6SXDTUFT tag=VKLEG3ARTNCB type=del size=893615 2024-09-14T11:17:05.062 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.063+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~Z0HM3GQQX0W1.0 size=1048576 2024-09-14T11:17:05.064 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.067+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~Z0HM3GQQX0W1.1 size=642709 2024-09-14T11:17:05.064 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.067+0000 7fe125ff88c0 1 > prepared multipart upload key=SSNV25PDLDIS upload=Z0HM3GQQX0W1 tag=G1NGHY47VZ6G type=write size=2739861 2024-09-14T11:17:05.068 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.067+0000 7fe125ff88c0 -1 < failed to complete operation key=2UXA6SXDTUFT tag=78B3TC7VRTLE type=write size=939828: (22) Invalid argument 2024-09-14T11:17:05.075 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.075+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~U6CWT3PM6DMI.0 size=1048576 2024-09-14T11:17:05.081 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.083+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~U6CWT3PM6DMI.1 size=757679 2024-09-14T11:17:05.081 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.083+0000 7fe125ff88c0 1 > prepared multipart upload key=6C3JZKTB8BP3 upload=U6CWT3PM6DMI tag=CECSPLO3D1PS type=write size=2854831 2024-09-14T11:17:05.088 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.087+0000 7fe125ff88c0 1 < suggested remove operation key=ESVFZQQXE3GT tag=NF2XKGE2WX67 type=del 2024-09-14T11:17:05.092 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.091+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=DSB7K0B3WC6N type=del size=428176 2024-09-14T11:17:05.095 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.095+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~RG7IJ7NXSK2F.0 size=1048576 2024-09-14T11:17:05.098 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.099+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~RG7IJ7NXSK2F.1 size=271107 2024-09-14T11:17:05.103 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.103+0000 7fe125ff88c0 1 < completed multipart upload key=K05LARTJ2QZ3 upload=RG7IJ7NXSK2F tag=9GCM6DXDS7LP type=write size=2368259 2024-09-14T11:17:05.107 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.107+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=1RLUS1J26D1Z type=write size=531579 2024-09-14T11:17:05.111 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.111+0000 7fe125ff88c0 -1 < failed to complete operation key=ESVFZQQXE3GT tag=O1OSCU7HC1TX type=del size=175703: (22) Invalid argument 2024-09-14T11:17:05.119 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.119+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~Q2Q7FZPQG6PG.0 size=1048576 2024-09-14T11:17:05.122 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.123+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~Q2Q7FZPQG6PG.1 size=1048576 2024-09-14T11:17:05.125 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.127+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~Q2Q7FZPQG6PG.2 size=187356 2024-09-14T11:17:05.125 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.127+0000 7fe125ff88c0 1 > prepared multipart upload key=3YGN50MBAF41 upload=Q2Q7FZPQG6PG tag=JAAS35I1MOOD type=write size=3333084 2024-09-14T11:17:05.129 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.131+0000 7fe125ff88c0 1 < completed delete operation key=46ZTDBWFVSUH tag=4NX8K6FB69CD type=del 2024-09-14T11:17:05.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.135+0000 7fe125ff88c0 1 > prepared operation key=6C3JZKTB8BP3 tag=B7AM2FLU0QGJ type=write size=20620 2024-09-14T11:17:05.138 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.139+0000 7fe125ff88c0 1 < completed delete operation key=V6B470G93KFT tag=65ZS730L800U type=del 2024-09-14T11:17:05.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.147+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~AWJ2H7LYXZFQ.0 size=223747 2024-09-14T11:17:05.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.147+0000 7fe125ff88c0 1 > prepared multipart upload key=F9I82N7RQC81 upload=AWJ2H7LYXZFQ tag=NJRE63EY9DX0 type=write size=1272323 2024-09-14T11:17:05.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.151+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~XZDR9ZR79H0B.0 size=1048576 2024-09-14T11:17:05.152 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.151+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~XZDR9ZR79H0B.1 size=150903 2024-09-14T11:17:05.158 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.159+0000 7fe125ff88c0 1 < completed multipart upload key=2LH5U05C2F8C upload=XZDR9ZR79H0B tag=9A4KDZ2PJ8H1 type=write size=2248055 2024-09-14T11:17:05.162 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.163+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=XYWP54WQOIC5 type=del size=1789561 2024-09-14T11:17:05.166 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.167+0000 7fe125ff88c0 1 < completed delete operation key=F9I82N7RQC81 tag=X73MYV8GNN8V type=del 2024-09-14T11:17:05.170 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.171+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=089OST1RHVNP type=del size=1498471 2024-09-14T11:17:05.173 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.175+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~DFHKJ51ON4F5.0 size=1048576 2024-09-14T11:17:05.174 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.175+0000 7fe125ff88c0 1 < canceled part key=_multipart_YN2HI39GPEDF.2~DFHKJ51ON4F5.1 size=1048576 2024-09-14T11:17:05.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.179+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~DFHKJ51ON4F5.2 size=610996 2024-09-14T11:17:05.183 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.183+0000 7fe125ff88c0 1 < canceled multipart upload key=YN2HI39GPEDF upload=DFHKJ51ON4F5 tag=1DFDDY874JAY type=write size=3756724 2024-09-14T11:17:05.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.187+0000 7fe125ff88c0 1 > prepared operation key=K05LARTJ2QZ3 tag=QQVRVITKCZH2 type=write size=345286 2024-09-14T11:17:05.191 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.191+0000 7fe125ff88c0 1 < completed part key=_multipart_L4XO0WTYKNXY.2~ZJTUZNC052KP.0 size=1048576 2024-09-14T11:17:05.194 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.195+0000 7fe125ff88c0 1 < completed part key=_multipart_L4XO0WTYKNXY.2~ZJTUZNC052KP.1 size=264549 2024-09-14T11:17:05.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.199+0000 7fe125ff88c0 1 < completed multipart upload key=L4XO0WTYKNXY upload=ZJTUZNC052KP tag=W3JXK3EPD1J9 type=write size=2361701 2024-09-14T11:17:05.206 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.207+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~71FXTIX05CGT.0 size=1048576 2024-09-14T11:17:05.209 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.211+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~71FXTIX05CGT.1 size=627453 2024-09-14T11:17:05.209 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.211+0000 7fe125ff88c0 1 > prepared multipart upload key=YGEVGH840L18 upload=71FXTIX05CGT tag=WCJ0H2YHR01X type=write size=2724605 2024-09-14T11:17:05.212 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.215+0000 7fe125ff88c0 1 < completed part key=_multipart_YFRH8WECBTJK.2~M9119HMAVK87.0 size=428019 2024-09-14T11:17:05.219 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.219+0000 7fe125ff88c0 1 < completed multipart upload key=YFRH8WECBTJK upload=M9119HMAVK87 tag=BT28NL0L6199 type=write size=1476595 2024-09-14T11:17:05.225 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.227+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~1STHT0EIE9PM.0 size=1048576 2024-09-14T11:17:05.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.231+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~1STHT0EIE9PM.1 size=598883 2024-09-14T11:17:05.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.231+0000 7fe125ff88c0 1 > prepared multipart upload key=0VBX2FWYCFEZ upload=1STHT0EIE9PM tag=DYJ2L9T2ES0G type=write size=2696035 2024-09-14T11:17:05.236 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.235+0000 7fe125ff88c0 1 < suggested update operation key=YN2HI39GPEDF tag=UPZJDA8NY9BC type=del size=881626 2024-09-14T11:17:05.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.239+0000 7fe125ff88c0 1 > prepared operation key=N80X3YUF4OEL tag=97D9FHTBE7WJ type=write size=429806 2024-09-14T11:17:05.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.243+0000 7fe125ff88c0 1 < completed delete operation key=L4XO0WTYKNXY tag=Z7H3673RTABV type=del 2024-09-14T11:17:05.246 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.247+0000 7fe125ff88c0 1 > prepared operation key=FQ5WT12KB664 tag=TFQGN5Q4BXAL type=del size=2472736 2024-09-14T11:17:05.253 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.255+0000 7fe125ff88c0 1 < suggested update operation key=2UXA6SXDTUFT tag=HTJYK3VERNRY type=del size=1558000 2024-09-14T11:17:05.257 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.259+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=BC4FQYZYUAYO type=del size=660160 2024-09-14T11:17:05.264 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.263+0000 7fe125ff88c0 1 < suggested update operation key=F9I82N7RQC81 tag=G8EPBOBEGXZT type=write size=909692 2024-09-14T11:17:05.270 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.271+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~8M1DKGX7XP83.0 size=1048576 2024-09-14T11:17:05.273 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.275+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~8M1DKGX7XP83.1 size=1048576 2024-09-14T11:17:05.276 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.275+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~8M1DKGX7XP83.2 size=162401 2024-09-14T11:17:05.276 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.275+0000 7fe125ff88c0 1 > prepared multipart upload key=35EB6U5O4A51 upload=8M1DKGX7XP83 tag=A3R91DNMV5ZQ type=write size=3308129 2024-09-14T11:17:05.279 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.279+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~Z0HM3GQQX0W1.0 size=1048576 2024-09-14T11:17:05.279 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.279+0000 7fe125ff88c0 1 < canceled part key=_multipart_SSNV25PDLDIS.2~Z0HM3GQQX0W1.1 size=642709 2024-09-14T11:17:05.284 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.287+0000 7fe125ff88c0 1 < canceled multipart upload key=SSNV25PDLDIS upload=Z0HM3GQQX0W1 tag=G1NGHY47VZ6G type=write size=2739861 2024-09-14T11:17:05.307 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.307+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~7AF94406LC19.0 size=1048576 2024-09-14T11:17:05.309 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.311+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~7AF94406LC19.1 size=1048576 2024-09-14T11:17:05.312 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.311+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~7AF94406LC19.2 size=378764 2024-09-14T11:17:05.312 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.311+0000 7fe125ff88c0 1 > prepared multipart upload key=46ZTDBWFVSUH upload=7AF94406LC19 tag=JYQTL9DV9XZR type=write size=3524492 2024-09-14T11:17:05.315 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.315+0000 7fe125ff88c0 1 < completed part key=_multipart_6C3JZKTB8BP3.2~U6CWT3PM6DMI.0 size=1048576 2024-09-14T11:17:05.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.319+0000 7fe125ff88c0 1 < completed part key=_multipart_6C3JZKTB8BP3.2~U6CWT3PM6DMI.1 size=757679 2024-09-14T11:17:05.322 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.323+0000 7fe125ff88c0 1 < completed multipart upload key=6C3JZKTB8BP3 upload=U6CWT3PM6DMI tag=CECSPLO3D1PS type=write size=2854831 2024-09-14T11:17:05.325 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.327+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=H0B7WNKYQW9N type=del size=226567 2024-09-14T11:17:05.330 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.331+0000 7fe125ff88c0 1 < suggested update operation key=2LH5U05C2F8C tag=DSB7K0B3WC6N type=del size=428176 2024-09-14T11:17:05.333 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.335+0000 7fe125ff88c0 1 > prepared operation key=3YGN50MBAF41 tag=4Y1MCIQD866D type=del size=485855 2024-09-14T11:17:05.337 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.339+0000 7fe125ff88c0 1 < canceled operation key=2KEKSWK0UT6C tag=1RLUS1J26D1Z type=write size=531579 2024-09-14T11:17:05.340 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.339+0000 7fe125ff88c0 1 > prepared operation key=N80X3YUF4OEL tag=LFTS876F2WVF type=del size=2884953 2024-09-14T11:17:05.344 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.343+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~Q2Q7FZPQG6PG.0 size=1048576 2024-09-14T11:17:05.346 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.347+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~Q2Q7FZPQG6PG.1 size=1048576 2024-09-14T11:17:05.348 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.351+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~Q2Q7FZPQG6PG.2 size=187356 2024-09-14T11:17:05.354 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.355+0000 7fe125ff88c0 1 < completed multipart upload key=3YGN50MBAF41 upload=Q2Q7FZPQG6PG tag=JAAS35I1MOOD type=write size=3333084 2024-09-14T11:17:05.357 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.359+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=KSU8OPOQ29GB type=write size=1047544 2024-09-14T11:17:05.360 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.363+0000 7fe125ff88c0 1 < completed write operation key=6C3JZKTB8BP3 tag=B7AM2FLU0QGJ type=write size=20620 2024-09-14T11:17:05.364 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.363+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=9JERLQF5E35S type=del size=3250184 2024-09-14T11:17:05.368 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.367+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~AWJ2H7LYXZFQ.0 size=223747 2024-09-14T11:17:05.374 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.375+0000 7fe125ff88c0 1 < completed multipart upload key=F9I82N7RQC81 upload=AWJ2H7LYXZFQ tag=NJRE63EY9DX0 type=write size=1272323 2024-09-14T11:17:05.377 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.379+0000 7fe125ff88c0 1 > prepared operation key=LYBGDNKUROWH tag=UH8JWG5Z2Z20 type=del size=1032218 2024-09-14T11:17:05.385 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.387+0000 7fe125ff88c0 1 < suggested update operation key=2UXA6SXDTUFT tag=XYWP54WQOIC5 type=del size=1789561 2024-09-14T11:17:05.388 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.391+0000 7fe125ff88c0 1 > prepared operation key=3OU4U9JF3ZD5 tag=AAAKYOEI4FC7 type=del size=603404 2024-09-14T11:17:05.395 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.395+0000 7fe125ff88c0 1 < suggested update operation key=4D2X7151977X tag=089OST1RHVNP type=del size=1498471 2024-09-14T11:17:05.402 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.403+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~V0FNQA49YTOD.0 size=1048576 2024-09-14T11:17:05.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.407+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~V0FNQA49YTOD.1 size=136120 2024-09-14T11:17:05.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.407+0000 7fe125ff88c0 1 > prepared multipart upload key=46ZTDBWFVSUH upload=V0FNQA49YTOD tag=09Z3YUR7ZDBR type=write size=2233272 2024-09-14T11:17:05.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.407+0000 7fe125ff88c0 1 < completed write operation key=K05LARTJ2QZ3 tag=QQVRVITKCZH2 type=write size=345286 2024-09-14T11:17:05.412 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.411+0000 7fe125ff88c0 1 > prepared operation key=3YGN50MBAF41 tag=GL8UR1L8H7F5 type=del size=1554277 2024-09-14T11:17:05.416 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.415+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~71FXTIX05CGT.0 size=1048576 2024-09-14T11:17:05.419 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.419+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~71FXTIX05CGT.1 size=627453 2024-09-14T11:17:05.427 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.427+0000 7fe125ff88c0 1 < completed multipart upload key=YGEVGH840L18 upload=71FXTIX05CGT tag=WCJ0H2YHR01X type=write size=2724605 2024-09-14T11:17:05.433 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.435+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~T7KK5QL72S8E.0 size=400938 2024-09-14T11:17:05.433 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.435+0000 7fe125ff88c0 1 > prepared multipart upload key=ESVFZQQXE3GT upload=T7KK5QL72S8E tag=YZSAGYCUX706 type=write size=1449514 2024-09-14T11:17:05.434 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.435+0000 7fe125ff88c0 1 < canceled part key=_multipart_0VBX2FWYCFEZ.2~1STHT0EIE9PM.0 size=1048576 2024-09-14T11:17:05.437 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.439+0000 7fe125ff88c0 1 < completed part key=_multipart_0VBX2FWYCFEZ.2~1STHT0EIE9PM.1 size=598883 2024-09-14T11:17:05.443 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.443+0000 7fe125ff88c0 1 < canceled multipart upload key=0VBX2FWYCFEZ upload=1STHT0EIE9PM tag=DYJ2L9T2ES0G type=write size=2696035 2024-09-14T11:17:05.446 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.447+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=D2R8II0Y4U20 type=write size=648851 2024-09-14T11:17:05.449 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.451+0000 7fe125ff88c0 1 < completed write operation key=N80X3YUF4OEL tag=97D9FHTBE7WJ type=write size=429806 2024-09-14T11:17:05.455 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.455+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~G5ITAADFC33K.0 size=1048576 2024-09-14T11:17:05.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.459+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~G5ITAADFC33K.1 size=1048576 2024-09-14T11:17:05.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.459+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~G5ITAADFC33K.2 size=798609 2024-09-14T11:17:05.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.459+0000 7fe125ff88c0 1 > prepared multipart upload key=F9I82N7RQC81 upload=G5ITAADFC33K tag=3VS8AOD3TA8M type=write size=3944337 2024-09-14T11:17:05.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.463+0000 7fe125ff88c0 1 < completed delete operation key=FQ5WT12KB664 tag=TFQGN5Q4BXAL type=del 2024-09-14T11:17:05.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.467+0000 7fe125ff88c0 1 > prepared operation key=1ML6RIXI4C5P tag=WJ0DGQJNJG31 type=del size=3180524 2024-09-14T11:17:05.470 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.471+0000 7fe125ff88c0 1 < completed delete operation key=K3P6U6NU8I01 tag=BC4FQYZYUAYO type=del 2024-09-14T11:17:05.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.475+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~XSX5WV10ZR6U.0 size=519346 2024-09-14T11:17:05.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.475+0000 7fe125ff88c0 1 > prepared multipart upload key=YN2HI39GPEDF upload=XSX5WV10ZR6U tag=SE9POVICM8TR type=write size=1567922 2024-09-14T11:17:05.479 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.479+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~8M1DKGX7XP83.0 size=1048576 2024-09-14T11:17:05.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.483+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~8M1DKGX7XP83.1 size=1048576 2024-09-14T11:17:05.484 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.487+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~8M1DKGX7XP83.2 size=162401 2024-09-14T11:17:05.489 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.491+0000 7fe125ff88c0 1 < completed multipart upload key=35EB6U5O4A51 upload=8M1DKGX7XP83 tag=A3R91DNMV5ZQ type=write size=3308129 2024-09-14T11:17:05.493 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.495+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=SOM3HOPDCVXI type=del size=2709271 2024-09-14T11:17:05.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.499+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~7AF94406LC19.0 size=1048576 2024-09-14T11:17:05.499 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.499+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~7AF94406LC19.1 size=1048576 2024-09-14T11:17:05.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.503+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~7AF94406LC19.2 size=378764 2024-09-14T11:17:05.508 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.507+0000 7fe125ff88c0 1 < completed multipart upload key=46ZTDBWFVSUH upload=7AF94406LC19 tag=JYQTL9DV9XZR type=write size=3524492 2024-09-14T11:17:05.511 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.511+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=3QRNXEUS8QVI type=del size=717656 2024-09-14T11:17:05.518 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.519+0000 7fe125ff88c0 1 < suggested update operation key=4D2X7151977X tag=H0B7WNKYQW9N type=del size=226567 2024-09-14T11:17:05.521 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.523+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=Y0PIJAF5BK21 type=write size=8235 2024-09-14T11:17:05.524 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.527+0000 7fe125ff88c0 1 < completed delete operation key=3YGN50MBAF41 tag=4Y1MCIQD866D type=del 2024-09-14T11:17:05.528 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.527+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=NSKM3RAYHWMJ type=del size=2885888 2024-09-14T11:17:05.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.531+0000 7fe125ff88c0 1 < completed delete operation key=N80X3YUF4OEL tag=LFTS876F2WVF type=del 2024-09-14T11:17:05.535 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.535+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=WNFY8K7QD7XG type=del size=394209 2024-09-14T11:17:05.539 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.539+0000 7fe125ff88c0 1 < completed write operation key=35EB6U5O4A51 tag=KSU8OPOQ29GB type=write size=1047544 2024-09-14T11:17:05.543 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.543+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=4Q75NL3ET0WZ type=del size=3781108 2024-09-14T11:17:05.547 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.547+0000 7fe125ff88c0 1 < completed delete operation key=YCF2PCJ9TZMR tag=9JERLQF5E35S type=del 2024-09-14T11:17:05.554 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.555+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~54K4K7XYVJ2N.0 size=1048576 2024-09-14T11:17:05.556 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.559+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~54K4K7XYVJ2N.1 size=592162 2024-09-14T11:17:05.556 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.559+0000 7fe125ff88c0 1 > prepared multipart upload key=YFRH8WECBTJK upload=54K4K7XYVJ2N tag=NMJQGUXFR75R type=write size=2689314 2024-09-14T11:17:05.560 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.563+0000 7fe125ff88c0 1 < completed delete operation key=LYBGDNKUROWH tag=UH8JWG5Z2Z20 type=del 2024-09-14T11:17:05.564 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.563+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=BOYM47CXZEPD type=del size=3376921 2024-09-14T11:17:05.571 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.571+0000 7fe125ff88c0 1 < suggested remove operation key=3OU4U9JF3ZD5 tag=AAAKYOEI4FC7 type=del 2024-09-14T11:17:05.575 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.575+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=M2OISH5T71R9 type=del size=2114754 2024-09-14T11:17:05.579 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.579+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~V0FNQA49YTOD.0 size=1048576 2024-09-14T11:17:05.581 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.583+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~V0FNQA49YTOD.1 size=136120 2024-09-14T11:17:05.587 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.587+0000 7fe125ff88c0 1 < completed multipart upload key=46ZTDBWFVSUH upload=V0FNQA49YTOD tag=09Z3YUR7ZDBR type=write size=2233272 2024-09-14T11:17:05.594 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.595+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~FH6UWMLEEEE5.0 size=1048576 2024-09-14T11:17:05.596 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.599+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~FH6UWMLEEEE5.1 size=274135 2024-09-14T11:17:05.596 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.599+0000 7fe125ff88c0 1 > prepared multipart upload key=YN2HI39GPEDF upload=FH6UWMLEEEE5 tag=P38HX9TDSQ3O type=write size=2371287 2024-09-14T11:17:05.600 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.599+0000 7fe125ff88c0 1 < completed delete operation key=3YGN50MBAF41 tag=GL8UR1L8H7F5 type=del 2024-09-14T11:17:05.604 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.603+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=M89SBG23Y73H type=del size=1770716 2024-09-14T11:17:05.607 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.607+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~T7KK5QL72S8E.0 size=400938 2024-09-14T11:17:05.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.611+0000 7fe125ff88c0 1 < completed multipart upload key=ESVFZQQXE3GT upload=T7KK5QL72S8E tag=YZSAGYCUX706 type=write size=1449514 2024-09-14T11:17:05.619 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.619+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~RFMHSM6K33JR.0 size=1048576 2024-09-14T11:17:05.621 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.623+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~RFMHSM6K33JR.1 size=1048576 2024-09-14T11:17:05.624 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.623+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~RFMHSM6K33JR.2 size=805553 2024-09-14T11:17:05.624 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.623+0000 7fe125ff88c0 1 > prepared multipart upload key=YN2HI39GPEDF upload=RFMHSM6K33JR tag=P6XE5FENON49 type=write size=3951281 2024-09-14T11:17:05.630 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.631+0000 7fe125ff88c0 1 < suggested remove operation key=YN2HI39GPEDF tag=D2R8II0Y4U20 type=write 2024-09-14T11:17:05.637 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.639+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~YN0P4PJRH88D.0 size=521177 2024-09-14T11:17:05.638 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.639+0000 7fe125ff88c0 1 > prepared multipart upload key=6C3JZKTB8BP3 upload=YN0P4PJRH88D tag=8RHPS7TIC4QJ type=write size=1569753 2024-09-14T11:17:05.641 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.643+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~G5ITAADFC33K.0 size=1048576 2024-09-14T11:17:05.644 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.643+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~G5ITAADFC33K.1 size=1048576 2024-09-14T11:17:05.647 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.647+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~G5ITAADFC33K.2 size=798609 2024-09-14T11:17:05.652 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.655+0000 7fe125ff88c0 1 < completed multipart upload key=F9I82N7RQC81 upload=G5ITAADFC33K tag=3VS8AOD3TA8M type=write size=3944337 2024-09-14T11:17:05.660 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.659+0000 7fe125ff88c0 1 > prepared part key=_multipart_WEA3MQ0DI42N.2~SKY4RS4G508D.0 size=1048576 2024-09-14T11:17:05.663 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.663+0000 7fe125ff88c0 1 > prepared part key=_multipart_WEA3MQ0DI42N.2~SKY4RS4G508D.1 size=5388 2024-09-14T11:17:05.663 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.663+0000 7fe125ff88c0 1 > prepared multipart upload key=WEA3MQ0DI42N upload=SKY4RS4G508D tag=MVSRRMY80HA2 type=write size=2102540 2024-09-14T11:17:05.667 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.667+0000 7fe125ff88c0 1 < completed delete operation key=1ML6RIXI4C5P tag=WJ0DGQJNJG31 type=del 2024-09-14T11:17:05.671 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.671+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=9SF35LV056U0 type=write size=323924 2024-09-14T11:17:05.676 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.675+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~XSX5WV10ZR6U.0 size=519346 2024-09-14T11:17:05.681 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.683+0000 7fe125ff88c0 1 < completed multipart upload key=YN2HI39GPEDF upload=XSX5WV10ZR6U tag=SE9POVICM8TR type=write size=1567922 2024-09-14T11:17:05.688 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.687+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~PVBV5ECD04AL.0 size=354194 2024-09-14T11:17:05.688 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.687+0000 7fe125ff88c0 1 > prepared multipart upload key=21HC4VMHXS6L upload=PVBV5ECD04AL tag=7CCG1JXXEGOT type=write size=1402770 2024-09-14T11:17:05.692 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.691+0000 7fe125ff88c0 1 < canceled operation key=2KEKSWK0UT6C tag=SOM3HOPDCVXI type=del size=2709271 2024-09-14T11:17:05.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.699+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~QNU9T3NMDOK1.0 size=1048576 2024-09-14T11:17:05.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.703+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~QNU9T3NMDOK1.1 size=459764 2024-09-14T11:17:05.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.703+0000 7fe125ff88c0 1 > prepared multipart upload key=FQ5WT12KB664 upload=QNU9T3NMDOK1 tag=6V36B895BO5Z type=write size=2556916 2024-09-14T11:17:05.706 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.707+0000 7fe125ff88c0 1 < completed delete operation key=F9I82N7RQC81 tag=3QRNXEUS8QVI type=del 2024-09-14T11:17:05.712 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.715+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~8OXMEYPF3HBG.0 size=1048576 2024-09-14T11:17:05.715 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.715+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~8OXMEYPF3HBG.1 size=866859 2024-09-14T11:17:05.715 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.715+0000 7fe125ff88c0 1 > prepared multipart upload key=F9I82N7RQC81 upload=8OXMEYPF3HBG tag=EB0J99GB71KN type=write size=2964011 2024-09-14T11:17:05.719 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.719+0000 7fe125ff88c0 1 < completed write operation key=YGEVGH840L18 tag=Y0PIJAF5BK21 type=write size=8235 2024-09-14T11:17:05.723 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.723+0000 7fe125ff88c0 1 > prepared operation key=6C3JZKTB8BP3 tag=UPH57MATQ6B7 type=del size=1779135 2024-09-14T11:17:05.731 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.731+0000 7fe125ff88c0 1 < suggested remove operation key=21HC4VMHXS6L tag=NSKM3RAYHWMJ type=del 2024-09-14T11:17:05.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.735+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=H9GEA9GMG8VW type=write size=773982 2024-09-14T11:17:05.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.739+0000 7fe125ff88c0 1 < completed delete operation key=L4XO0WTYKNXY tag=WNFY8K7QD7XG type=del 2024-09-14T11:17:05.742 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.743+0000 7fe125ff88c0 1 > prepared operation key=SUCH37O8V1LY tag=B18LEFL2TN1P type=del size=2988391 2024-09-14T11:17:05.747 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.747+0000 7fe125ff88c0 1 < completed delete operation key=N94D3R7IOBNL tag=4Q75NL3ET0WZ type=del 2024-09-14T11:17:05.750 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.751+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=33IMLB110GSS type=del size=1548879 2024-09-14T11:17:05.754 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.755+0000 7fe125ff88c0 1 < completed part key=_multipart_YFRH8WECBTJK.2~54K4K7XYVJ2N.0 size=1048576 2024-09-14T11:17:05.760 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.759+0000 7fe125ff88c0 1 < completed part key=_multipart_YFRH8WECBTJK.2~54K4K7XYVJ2N.1 size=592162 2024-09-14T11:17:05.766 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.767+0000 7fe125ff88c0 1 < completed multipart upload key=YFRH8WECBTJK upload=54K4K7XYVJ2N tag=NMJQGUXFR75R type=write size=2689314 2024-09-14T11:17:05.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.775+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~BDUO2UQBADPN.0 size=586401 2024-09-14T11:17:05.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.775+0000 7fe125ff88c0 1 > prepared multipart upload key=K05LARTJ2QZ3 upload=BDUO2UQBADPN tag=P8RHG61MALRZ type=write size=1634977 2024-09-14T11:17:05.780 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.779+0000 7fe125ff88c0 1 < completed delete operation key=35EB6U5O4A51 tag=BOYM47CXZEPD type=del 2024-09-14T11:17:05.786 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.787+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~ZB0QMBXPU2PL.0 size=1048576 2024-09-14T11:17:05.788 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.791+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~ZB0QMBXPU2PL.1 size=1048576 2024-09-14T11:17:05.791 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.791+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~ZB0QMBXPU2PL.2 size=518423 2024-09-14T11:17:05.791 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.791+0000 7fe125ff88c0 1 > prepared multipart upload key=YN2HI39GPEDF upload=ZB0QMBXPU2PL tag=0ZWCK0TJVC5W type=write size=3664151 2024-09-14T11:17:05.795 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.795+0000 7fe125ff88c0 1 < completed delete operation key=WEA3MQ0DI42N tag=M2OISH5T71R9 type=del 2024-09-14T11:17:05.802 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.803+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~MXJABV5FP7AD.0 size=398905 2024-09-14T11:17:05.802 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.803+0000 7fe125ff88c0 1 > prepared multipart upload key=ESVFZQQXE3GT upload=MXJABV5FP7AD tag=1D5C3WWWPD86 type=write size=1447481 2024-09-14T11:17:05.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.807+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~FH6UWMLEEEE5.0 size=1048576 2024-09-14T11:17:05.809 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.811+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~FH6UWMLEEEE5.1 size=274135 2024-09-14T11:17:05.814 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.815+0000 7fe125ff88c0 1 < completed multipart upload key=YN2HI39GPEDF upload=FH6UWMLEEEE5 tag=P38HX9TDSQ3O type=write size=2371287 2024-09-14T11:17:05.818 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.819+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=M8RUQKLUJJ3R type=del size=18981 2024-09-14T11:17:05.821 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.823+0000 7fe125ff88c0 1 < completed delete operation key=4D2X7151977X tag=M89SBG23Y73H type=del 2024-09-14T11:17:05.824 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.827+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=0C4IAKECNYY7 type=write size=909821 2024-09-14T11:17:05.828 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.831+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~RFMHSM6K33JR.0 size=1048576 2024-09-14T11:17:05.831 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.831+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~RFMHSM6K33JR.1 size=1048576 2024-09-14T11:17:05.834 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.835+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~RFMHSM6K33JR.2 size=805553 2024-09-14T11:17:05.839 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.839+0000 7fe125ff88c0 1 < completed multipart upload key=YN2HI39GPEDF upload=RFMHSM6K33JR tag=P6XE5FENON49 type=write size=3951281 2024-09-14T11:17:05.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.843+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=G3RICJ73G0A0 type=del size=247168 2024-09-14T11:17:05.847 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.847+0000 7fe125ff88c0 1 < completed part key=_multipart_6C3JZKTB8BP3.2~YN0P4PJRH88D.0 size=521177 2024-09-14T11:17:05.853 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.855+0000 7fe125ff88c0 1 < completed multipart upload key=6C3JZKTB8BP3 upload=YN0P4PJRH88D tag=8RHPS7TIC4QJ type=write size=1569753 2024-09-14T11:17:05.857 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.859+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=7006JW6G3FDT type=del size=3546154 2024-09-14T11:17:05.858 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.859+0000 7fe125ff88c0 1 < canceled part key=_multipart_WEA3MQ0DI42N.2~SKY4RS4G508D.0 size=1048576 2024-09-14T11:17:05.861 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.863+0000 7fe125ff88c0 1 < completed part key=_multipart_WEA3MQ0DI42N.2~SKY4RS4G508D.1 size=5388 2024-09-14T11:17:05.866 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.867+0000 7fe125ff88c0 1 < canceled multipart upload key=WEA3MQ0DI42N upload=SKY4RS4G508D tag=MVSRRMY80HA2 type=write size=2102540 2024-09-14T11:17:05.870 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.871+0000 7fe125ff88c0 1 > prepared operation key=K05LARTJ2QZ3 tag=EVXVGC1QNKEW type=del size=946027 2024-09-14T11:17:05.874 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.875+0000 7fe125ff88c0 1 < completed write operation key=K3P6U6NU8I01 tag=9SF35LV056U0 type=write size=323924 2024-09-14T11:17:05.878 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.879+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=BMZM5SAWNZVY type=del size=2869174 2024-09-14T11:17:05.882 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.883+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~PVBV5ECD04AL.0 size=354194 2024-09-14T11:17:05.888 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.887+0000 7fe125ff88c0 1 < completed multipart upload key=21HC4VMHXS6L upload=PVBV5ECD04AL tag=7CCG1JXXEGOT type=write size=1402770 2024-09-14T11:17:05.891 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.891+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=ZQBDI0KJ4LZP type=del size=2632609 2024-09-14T11:17:05.895 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.895+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~QNU9T3NMDOK1.0 size=1048576 2024-09-14T11:17:05.898 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.899+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~QNU9T3NMDOK1.1 size=459764 2024-09-14T11:17:05.904 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.903+0000 7fe125ff88c0 1 < completed multipart upload key=FQ5WT12KB664 upload=QNU9T3NMDOK1 tag=6V36B895BO5Z type=write size=2556916 2024-09-14T11:17:05.908 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.907+0000 7fe125ff88c0 1 > prepared operation key=K05LARTJ2QZ3 tag=63OP9SML83FP type=del size=3283125 2024-09-14T11:17:05.912 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.911+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~8OXMEYPF3HBG.0 size=1048576 2024-09-14T11:17:05.915 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.915+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~8OXMEYPF3HBG.1 size=866859 2024-09-14T11:17:05.920 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.919+0000 7fe125ff88c0 1 < completed multipart upload key=F9I82N7RQC81 upload=8OXMEYPF3HBG tag=EB0J99GB71KN type=write size=2964011 2024-09-14T11:17:05.924 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.923+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=90O3F98LGCDF type=del size=3938832 2024-09-14T11:17:05.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.927+0000 7fe125ff88c0 1 < completed delete operation key=6C3JZKTB8BP3 tag=UPH57MATQ6B7 type=del 2024-09-14T11:17:05.934 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.935+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~IFXQOH2S2AHQ.0 size=960221 2024-09-14T11:17:05.934 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.935+0000 7fe125ff88c0 1 > prepared multipart upload key=YCF2PCJ9TZMR upload=IFXQOH2S2AHQ tag=VZ84ORZSJXXH type=write size=2008797 2024-09-14T11:17:05.938 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.939+0000 7fe125ff88c0 1 < completed write operation key=V6B470G93KFT tag=H9GEA9GMG8VW type=write size=773982 2024-09-14T11:17:05.942 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.943+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=76RWNMEV7LL0 type=del size=3461571 2024-09-14T11:17:05.946 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.947+0000 7fe125ff88c0 1 < completed delete operation key=SUCH37O8V1LY tag=B18LEFL2TN1P type=del 2024-09-14T11:17:05.950 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.951+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=L3K521OAPJOJ type=del size=4056144 2024-09-14T11:17:05.954 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.955+0000 7fe125ff88c0 1 < completed delete operation key=2KEKSWK0UT6C tag=33IMLB110GSS type=del 2024-09-14T11:17:05.958 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.959+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=XJJMVVS1E6OA type=del size=983368 2024-09-14T11:17:05.962 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.963+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~BDUO2UQBADPN.0 size=586401 2024-09-14T11:17:05.968 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.967+0000 7fe125ff88c0 1 < completed multipart upload key=K05LARTJ2QZ3 upload=BDUO2UQBADPN tag=P8RHG61MALRZ type=write size=1634977 2024-09-14T11:17:05.974 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.975+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~NJ4CFETM3RCO.0 size=1048576 2024-09-14T11:17:05.977 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.979+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~NJ4CFETM3RCO.1 size=717781 2024-09-14T11:17:05.977 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.979+0000 7fe125ff88c0 1 > prepared multipart upload key=SUCH37O8V1LY upload=NJ4CFETM3RCO tag=QPQ1XJFJK2BM type=write size=2814933 2024-09-14T11:17:05.981 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.983+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~ZB0QMBXPU2PL.0 size=1048576 2024-09-14T11:17:05.984 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.983+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~ZB0QMBXPU2PL.1 size=1048576 2024-09-14T11:17:05.984 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.983+0000 7fe125ff88c0 1 < canceled part key=_multipart_YN2HI39GPEDF.2~ZB0QMBXPU2PL.2 size=518423 2024-09-14T11:17:05.989 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.991+0000 7fe125ff88c0 1 < canceled multipart upload key=YN2HI39GPEDF upload=ZB0QMBXPU2PL tag=0ZWCK0TJVC5W type=write size=3664151 2024-09-14T11:17:05.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.995+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=PY8TKEFPMJ12 type=del size=2458976 2024-09-14T11:17:05.998 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:05.999+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~MXJABV5FP7AD.0 size=398905 2024-09-14T11:17:06.004 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.003+0000 7fe125ff88c0 1 < completed multipart upload key=ESVFZQQXE3GT upload=MXJABV5FP7AD tag=1D5C3WWWPD86 type=write size=1447481 2024-09-14T11:17:06.008 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.007+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=TB8NGIWAPKKZ type=del size=2665314 2024-09-14T11:17:06.011 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.011+0000 7fe125ff88c0 1 < completed delete operation key=ESVFZQQXE3GT tag=M8RUQKLUJJ3R type=del 2024-09-14T11:17:06.015 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.015+0000 7fe125ff88c0 1 > prepared operation key=YFRH8WECBTJK tag=K71E7CIXIW5T type=del size=2998451 2024-09-14T11:17:06.018 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.019+0000 7fe125ff88c0 1 < completed write operation key=0VBX2FWYCFEZ tag=0C4IAKECNYY7 type=write size=909821 2024-09-14T11:17:06.024 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.027+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~2269APTON56K.0 size=1048576 2024-09-14T11:17:06.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.027+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~2269APTON56K.1 size=951019 2024-09-14T11:17:06.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.027+0000 7fe125ff88c0 1 > prepared multipart upload key=W0B19NBHNLMZ upload=2269APTON56K tag=G9LZPOUXK2M9 type=write size=3048171 2024-09-14T11:17:06.031 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.031+0000 7fe125ff88c0 1 < completed delete operation key=L4XO0WTYKNXY tag=G3RICJ73G0A0 type=del 2024-09-14T11:17:06.035 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.035+0000 7fe125ff88c0 1 > prepared operation key=46ZTDBWFVSUH tag=AHS6X8U73WTQ type=del size=3048813 2024-09-14T11:17:06.039 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.039+0000 7fe125ff88c0 1 < canceled operation key=ESVFZQQXE3GT tag=7006JW6G3FDT type=del size=3546154 2024-09-14T11:17:06.043 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.043+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=4O9ZUEN81CNZ type=del size=435933 2024-09-14T11:17:06.046 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.047+0000 7fe125ff88c0 1 < completed delete operation key=K05LARTJ2QZ3 tag=EVXVGC1QNKEW type=del 2024-09-14T11:17:06.050 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.051+0000 7fe125ff88c0 1 > prepared operation key=LYBGDNKUROWH tag=ZJ5QAJ0AYF3U type=del size=3548571 2024-09-14T11:17:06.054 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.055+0000 7fe125ff88c0 1 < completed delete operation key=V6B470G93KFT tag=BMZM5SAWNZVY type=del 2024-09-14T11:17:06.058 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.059+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=LN2LL5AX03GS type=del size=1986922 2024-09-14T11:17:06.065 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.067+0000 7fe125ff88c0 1 < suggested remove operation key=ESVFZQQXE3GT tag=ZQBDI0KJ4LZP type=del 2024-09-14T11:17:06.069 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.071+0000 7fe125ff88c0 1 > prepared operation key=LYBGDNKUROWH tag=8I1BJSWQ01MY type=write size=698409 2024-09-14T11:17:06.077 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.079+0000 7fe125ff88c0 1 < suggested update operation key=K05LARTJ2QZ3 tag=63OP9SML83FP type=del size=3283125 2024-09-14T11:17:06.084 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.083+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~7LAY4UVAGEIF.0 size=1048576 2024-09-14T11:17:06.087 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.087+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~7LAY4UVAGEIF.1 size=995354 2024-09-14T11:17:06.087 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.087+0000 7fe125ff88c0 1 > prepared multipart upload key=YCF2PCJ9TZMR upload=7LAY4UVAGEIF tag=4TUX7KU9BNKW type=write size=3092506 2024-09-14T11:17:06.091 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.091+0000 7fe125ff88c0 1 < completed delete operation key=SSNV25PDLDIS tag=90O3F98LGCDF type=del 2024-09-14T11:17:06.098 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.099+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~NLAVW6GLU0SM.0 size=1048576 2024-09-14T11:17:06.100 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.103+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~NLAVW6GLU0SM.1 size=1048576 2024-09-14T11:17:06.107 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.107+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~NLAVW6GLU0SM.2 size=478905 2024-09-14T11:17:06.107 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.107+0000 7fe125ff88c0 1 > prepared multipart upload key=LYBGDNKUROWH upload=NLAVW6GLU0SM tag=9E79BO19J1TM type=write size=3624633 2024-09-14T11:17:06.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.115+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~IFXQOH2S2AHQ.0 size=960221 2024-09-14T11:17:06.116 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.119+0000 7fe125ff88c0 1 < completed multipart upload key=YCF2PCJ9TZMR upload=IFXQOH2S2AHQ tag=VZ84ORZSJXXH type=write size=2008797 2024-09-14T11:17:06.120 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.119+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=WJJN4GL0EUAZ type=del size=3741201 2024-09-14T11:17:06.125 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.127+0000 7fe125ff88c0 1 < canceled operation key=2KEKSWK0UT6C tag=76RWNMEV7LL0 type=del size=3461571 2024-09-14T11:17:06.129 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.131+0000 7fe125ff88c0 1 > prepared operation key=SUCH37O8V1LY tag=D43802S0BB6Y type=del size=2636835 2024-09-14T11:17:06.133 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.135+0000 7fe125ff88c0 1 < completed delete operation key=SSNV25PDLDIS tag=L3K521OAPJOJ type=del 2024-09-14T11:17:06.139 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.139+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~BF2S19XCA3KQ.0 size=1048576 2024-09-14T11:17:06.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.143+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~BF2S19XCA3KQ.1 size=551232 2024-09-14T11:17:06.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.143+0000 7fe125ff88c0 1 > prepared multipart upload key=YGEVGH840L18 upload=BF2S19XCA3KQ tag=OY1VF1SOL34V type=write size=2648384 2024-09-14T11:17:06.147 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.147+0000 7fe125ff88c0 1 < completed delete operation key=SSNV25PDLDIS tag=XJJMVVS1E6OA type=del 2024-09-14T11:17:06.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.151+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=KD90Q8D0N1IW type=write size=757804 2024-09-14T11:17:06.155 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.155+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~NJ4CFETM3RCO.0 size=1048576 2024-09-14T11:17:06.158 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.159+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~NJ4CFETM3RCO.1 size=717781 2024-09-14T11:17:06.164 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.163+0000 7fe125ff88c0 1 < completed multipart upload key=SUCH37O8V1LY upload=NJ4CFETM3RCO tag=QPQ1XJFJK2BM type=write size=2814933 2024-09-14T11:17:06.167 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.167+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=BE2X55MK29RG type=del size=2541208 2024-09-14T11:17:06.171 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.171+0000 7fe125ff88c0 1 < completed delete operation key=4D2X7151977X tag=PY8TKEFPMJ12 type=del 2024-09-14T11:17:06.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.175+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=EE30FO8B38DS type=write size=852227 2024-09-14T11:17:06.183 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.183+0000 7fe125ff88c0 1 < suggested remove operation key=K3P6U6NU8I01 tag=TB8NGIWAPKKZ type=del 2024-09-14T11:17:06.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.191+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~SXPVJRABQ98F.0 size=798820 2024-09-14T11:17:06.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.191+0000 7fe125ff88c0 1 > prepared multipart upload key=F9I82N7RQC81 upload=SXPVJRABQ98F tag=72Q6HVLQ6DDA type=write size=1847396 2024-09-14T11:17:06.198 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.199+0000 7fe125ff88c0 1 < suggested remove operation key=YFRH8WECBTJK tag=K71E7CIXIW5T type=del 2024-09-14T11:17:06.202 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.203+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=3LVGP15KRPTJ type=del size=2057058 2024-09-14T11:17:06.205 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.207+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~2269APTON56K.0 size=1048576 2024-09-14T11:17:06.208 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.211+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~2269APTON56K.1 size=951019 2024-09-14T11:17:06.215 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.215+0000 7fe125ff88c0 1 < completed multipart upload key=W0B19NBHNLMZ upload=2269APTON56K tag=G9LZPOUXK2M9 type=write size=3048171 2024-09-14T11:17:06.222 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.223+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~HTITM9GJR7TS.0 size=1048576 2024-09-14T11:17:06.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.227+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~HTITM9GJR7TS.1 size=1048576 2024-09-14T11:17:06.229 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.231+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~HTITM9GJR7TS.2 size=192086 2024-09-14T11:17:06.229 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.231+0000 7fe125ff88c0 1 > prepared multipart upload key=W0B19NBHNLMZ upload=HTITM9GJR7TS tag=00WK68PPJES3 type=write size=3337814 2024-09-14T11:17:06.233 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.235+0000 7fe125ff88c0 1 < completed delete operation key=46ZTDBWFVSUH tag=AHS6X8U73WTQ type=del 2024-09-14T11:17:06.241 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.243+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~4IUTIBGAN71D.0 size=1048576 2024-09-14T11:17:06.244 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.243+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~4IUTIBGAN71D.1 size=1048576 2024-09-14T11:17:06.247 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.247+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~4IUTIBGAN71D.2 size=2997 2024-09-14T11:17:06.247 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.247+0000 7fe125ff88c0 1 > prepared multipart upload key=K3P6U6NU8I01 upload=4IUTIBGAN71D tag=FPIJOTTCJZ3F type=write size=3148725 2024-09-14T11:17:06.250 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.251+0000 7fe125ff88c0 1 < completed delete operation key=F9I82N7RQC81 tag=4O9ZUEN81CNZ type=del 2024-09-14T11:17:06.254 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.255+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=CQRZ469PIFMJ type=write size=298422 2024-09-14T11:17:06.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.259+0000 7fe125ff88c0 1 < completed delete operation key=LYBGDNKUROWH tag=ZJ5QAJ0AYF3U type=del 2024-09-14T11:17:06.264 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.267+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~WL9TA475OABL.0 size=1048576 2024-09-14T11:17:06.267 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.267+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~WL9TA475OABL.1 size=1048576 2024-09-14T11:17:06.270 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.271+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~WL9TA475OABL.2 size=259300 2024-09-14T11:17:06.270 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.271+0000 7fe125ff88c0 1 > prepared multipart upload key=SSNV25PDLDIS upload=WL9TA475OABL tag=SGM5LZV0DUTC type=write size=3405028 2024-09-14T11:17:06.274 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.275+0000 7fe125ff88c0 1 < completed delete operation key=2LH5U05C2F8C tag=LN2LL5AX03GS type=del 2024-09-14T11:17:06.278 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.279+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=MGUABKFJ0VAV type=del size=1464558 2024-09-14T11:17:06.284 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.283+0000 7fe125ff88c0 1 < suggested update operation key=LYBGDNKUROWH tag=8I1BJSWQ01MY type=write size=698409 2024-09-14T11:17:06.287 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.287+0000 7fe125ff88c0 1 > prepared operation key=3YGN50MBAF41 tag=3JVA92B1DENQ type=del size=2753297 2024-09-14T11:17:06.291 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.291+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~7LAY4UVAGEIF.0 size=1048576 2024-09-14T11:17:06.294 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.295+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~7LAY4UVAGEIF.1 size=995354 2024-09-14T11:17:06.299 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.299+0000 7fe125ff88c0 1 < completed multipart upload key=YCF2PCJ9TZMR upload=7LAY4UVAGEIF tag=4TUX7KU9BNKW type=write size=3092506 2024-09-14T11:17:06.302 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.303+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=RFNX8C71NT2Q type=del size=865507 2024-09-14T11:17:06.304 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.303+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~NLAVW6GLU0SM.0 size=1048576 2024-09-14T11:17:06.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.307+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~NLAVW6GLU0SM.1 size=1048576 2024-09-14T11:17:06.308 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.311+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~NLAVW6GLU0SM.2 size=478905 2024-09-14T11:17:06.312 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.311+0000 7fe125ff88c0 1 < completed multipart upload key=LYBGDNKUROWH upload=NLAVW6GLU0SM tag=9E79BO19J1TM type=write size=3624633 2024-09-14T11:17:06.314 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.315+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=Q7M02SI7GAPC type=write size=837707 2024-09-14T11:17:06.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.319+0000 7fe125ff88c0 1 < suggested remove operation key=YGEVGH840L18 tag=WJJN4GL0EUAZ type=del 2024-09-14T11:17:06.322 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.323+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=FTOI2VGVVBRV type=del size=2034008 2024-09-14T11:17:06.325 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.327+0000 7fe125ff88c0 1 < completed delete operation key=SUCH37O8V1LY tag=D43802S0BB6Y type=del 2024-09-14T11:17:06.327 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.327+0000 7fe125ff88c0 1 > prepared operation key=LYBGDNKUROWH tag=A5FOP8F6JVVN type=del size=1923015 2024-09-14T11:17:06.330 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.331+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~BF2S19XCA3KQ.0 size=1048576 2024-09-14T11:17:06.330 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.331+0000 7fe125ff88c0 1 < canceled part key=_multipart_YGEVGH840L18.2~BF2S19XCA3KQ.1 size=551232 2024-09-14T11:17:06.334 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.335+0000 7fe125ff88c0 1 < canceled multipart upload key=YGEVGH840L18 upload=BF2S19XCA3KQ tag=OY1VF1SOL34V type=write size=2648384 2024-09-14T11:17:06.340 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.339+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~8PMFKZPW3IC1.0 size=102848 2024-09-14T11:17:06.340 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.339+0000 7fe125ff88c0 1 > prepared multipart upload key=35EB6U5O4A51 upload=8PMFKZPW3IC1 tag=53Y94UNXXMIM type=write size=1151424 2024-09-14T11:17:06.344 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.343+0000 7fe125ff88c0 -1 < failed to complete operation key=YGEVGH840L18 tag=KD90Q8D0N1IW type=write size=757804: (22) Invalid argument 2024-09-14T11:17:06.350 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.351+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~UZIG12TCVLCK.0 size=1048576 2024-09-14T11:17:06.352 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.355+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~UZIG12TCVLCK.1 size=1048576 2024-09-14T11:17:06.355 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.355+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~UZIG12TCVLCK.2 size=657625 2024-09-14T11:17:06.355 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.355+0000 7fe125ff88c0 1 > prepared multipart upload key=2UXA6SXDTUFT upload=UZIG12TCVLCK tag=5IXSDWCSP5CW type=write size=3803353 2024-09-14T11:17:06.358 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.359+0000 7fe125ff88c0 1 < completed delete operation key=4D2X7151977X tag=BE2X55MK29RG type=del 2024-09-14T11:17:06.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.363+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~H35NKFM0CVDS.0 size=1048576 2024-09-14T11:17:06.365 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.367+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~H35NKFM0CVDS.1 size=950335 2024-09-14T11:17:06.365 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.367+0000 7fe125ff88c0 1 > prepared multipart upload key=4D2X7151977X upload=H35NKFM0CVDS tag=XXOELH4CE0YD type=write size=3047487 2024-09-14T11:17:06.368 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.371+0000 7fe125ff88c0 1 < completed write operation key=YN2HI39GPEDF tag=EE30FO8B38DS type=write size=852227 2024-09-14T11:17:06.375 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.375+0000 7fe125ff88c0 1 > prepared part key=_multipart_6PLUU2QIO9LJ.2~083JMUR72369.0 size=1048576 2024-09-14T11:17:06.378 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.379+0000 7fe125ff88c0 1 > prepared part key=_multipart_6PLUU2QIO9LJ.2~083JMUR72369.1 size=1048576 2024-09-14T11:17:06.380 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.383+0000 7fe125ff88c0 1 > prepared part key=_multipart_6PLUU2QIO9LJ.2~083JMUR72369.2 size=833527 2024-09-14T11:17:06.380 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.383+0000 7fe125ff88c0 1 > prepared multipart upload key=6PLUU2QIO9LJ upload=083JMUR72369 tag=9VV2XW6AJICX type=write size=3979255 2024-09-14T11:17:06.384 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.383+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~SXPVJRABQ98F.0 size=798820 2024-09-14T11:17:06.389 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.391+0000 7fe125ff88c0 1 < completed multipart upload key=F9I82N7RQC81 upload=SXPVJRABQ98F tag=72Q6HVLQ6DDA type=write size=1847396 2024-09-14T11:17:06.393 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.395+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=G5CB85YQEYJO type=del size=1683231 2024-09-14T11:17:06.397 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.399+0000 7fe125ff88c0 1 < completed delete operation key=F9I82N7RQC81 tag=3LVGP15KRPTJ type=del 2024-09-14T11:17:06.400 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.403+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=64KUOS5KU3VM type=del size=1029744 2024-09-14T11:17:06.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.407+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~HTITM9GJR7TS.0 size=1048576 2024-09-14T11:17:06.409 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.411+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~HTITM9GJR7TS.1 size=1048576 2024-09-14T11:17:06.411 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.411+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~HTITM9GJR7TS.2 size=192086 2024-09-14T11:17:06.415 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.415+0000 7fe125ff88c0 1 < completed multipart upload key=W0B19NBHNLMZ upload=HTITM9GJR7TS tag=00WK68PPJES3 type=write size=3337814 2024-09-14T11:17:06.418 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.419+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=99SVN2KXP674 type=write size=673437 2024-09-14T11:17:06.422 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.423+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~4IUTIBGAN71D.0 size=1048576 2024-09-14T11:17:06.426 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.427+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~4IUTIBGAN71D.1 size=1048576 2024-09-14T11:17:06.429 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.431+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~4IUTIBGAN71D.2 size=2997 2024-09-14T11:17:06.434 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.435+0000 7fe125ff88c0 1 < completed multipart upload key=K3P6U6NU8I01 upload=4IUTIBGAN71D tag=FPIJOTTCJZ3F type=write size=3148725 2024-09-14T11:17:06.440 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.439+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~Y0V17VUREI8C.0 size=1048576 2024-09-14T11:17:06.442 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.443+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~Y0V17VUREI8C.1 size=1048576 2024-09-14T11:17:06.445 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.447+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~Y0V17VUREI8C.2 size=864900 2024-09-14T11:17:06.445 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.447+0000 7fe125ff88c0 1 > prepared multipart upload key=3YGN50MBAF41 upload=Y0V17VUREI8C tag=0CO6AD5KIIRT type=write size=4010628 2024-09-14T11:17:06.448 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.447+0000 7fe125ff88c0 1 < completed write operation key=35EB6U5O4A51 tag=CQRZ469PIFMJ type=write size=298422 2024-09-14T11:17:06.451 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.451+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=YGDK103X4YDF type=del size=2137118 2024-09-14T11:17:06.455 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.455+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~WL9TA475OABL.0 size=1048576 2024-09-14T11:17:06.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.459+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~WL9TA475OABL.1 size=1048576 2024-09-14T11:17:06.461 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.463+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~WL9TA475OABL.2 size=259300 2024-09-14T11:17:06.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.467+0000 7fe125ff88c0 1 < completed multipart upload key=SSNV25PDLDIS upload=WL9TA475OABL tag=SGM5LZV0DUTC type=write size=3405028 2024-09-14T11:17:06.470 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.471+0000 7fe125ff88c0 1 > prepared operation key=N80X3YUF4OEL tag=OATIQOM5OJZU type=del size=3074794 2024-09-14T11:17:06.475 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.475+0000 7fe125ff88c0 1 < completed delete operation key=35EB6U5O4A51 tag=MGUABKFJ0VAV type=del 2024-09-14T11:17:06.483 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.483+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~P7AZT5QS1EWP.0 size=1048576 2024-09-14T11:17:06.485 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.487+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~P7AZT5QS1EWP.1 size=1048576 2024-09-14T11:17:06.488 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.487+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~P7AZT5QS1EWP.2 size=335265 2024-09-14T11:17:06.488 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.487+0000 7fe125ff88c0 1 > prepared multipart upload key=W0B19NBHNLMZ upload=P7AZT5QS1EWP tag=89HEVDR1WNBX type=write size=3480993 2024-09-14T11:17:06.492 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.491+0000 7fe125ff88c0 1 < completed delete operation key=3YGN50MBAF41 tag=3JVA92B1DENQ type=del 2024-09-14T11:17:06.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.495+0000 7fe125ff88c0 1 > prepared operation key=SUCH37O8V1LY tag=SAG7C84G383O type=write size=776232 2024-09-14T11:17:06.501 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.499+0000 7fe125ff88c0 -1 < failed to complete operation key=YGEVGH840L18 tag=RFNX8C71NT2Q type=del size=865507: (22) Invalid argument 2024-09-14T11:17:06.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.503+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=KFN9NYHJLXT2 type=del size=3446294 2024-09-14T11:17:06.506 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.507+0000 7fe125ff88c0 1 < completed write operation key=N94D3R7IOBNL tag=Q7M02SI7GAPC type=write size=837707 2024-09-14T11:17:06.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.515+0000 7fe125ff88c0 1 > prepared part key=_multipart_6PLUU2QIO9LJ.2~B1K073NDQI1W.0 size=1048576 2024-09-14T11:17:06.515 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.515+0000 7fe125ff88c0 1 > prepared part key=_multipart_6PLUU2QIO9LJ.2~B1K073NDQI1W.1 size=444534 2024-09-14T11:17:06.515 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.515+0000 7fe125ff88c0 1 > prepared multipart upload key=6PLUU2QIO9LJ upload=B1K073NDQI1W tag=31NV8CDAIXX1 type=write size=2541686 2024-09-14T11:17:06.519 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.519+0000 7fe125ff88c0 1 < completed delete operation key=L4XO0WTYKNXY tag=FTOI2VGVVBRV type=del 2024-09-14T11:17:06.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.523+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=16QDOMP5JS1T type=del size=1265933 2024-09-14T11:17:06.526 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.527+0000 7fe125ff88c0 1 < completed delete operation key=LYBGDNKUROWH tag=A5FOP8F6JVVN type=del 2024-09-14T11:17:06.532 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.535+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~JLZTQHYMS6HK.0 size=641367 2024-09-14T11:17:06.532 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.535+0000 7fe125ff88c0 1 > prepared multipart upload key=2LH5U05C2F8C upload=JLZTQHYMS6HK tag=2Z65K3EISPC2 type=write size=1689943 2024-09-14T11:17:06.536 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.535+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~8PMFKZPW3IC1.0 size=102848 2024-09-14T11:17:06.542 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.543+0000 7fe125ff88c0 1 < completed multipart upload key=35EB6U5O4A51 upload=8PMFKZPW3IC1 tag=53Y94UNXXMIM type=write size=1151424 2024-09-14T11:17:06.545 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.547+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=YNEJ0M5SVEH6 type=write size=292818 2024-09-14T11:17:06.546 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.547+0000 7fe125ff88c0 1 < canceled part key=_multipart_2UXA6SXDTUFT.2~UZIG12TCVLCK.0 size=1048576 2024-09-14T11:17:06.548 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.551+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~UZIG12TCVLCK.1 size=1048576 2024-09-14T11:17:06.549 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.551+0000 7fe125ff88c0 1 < canceled part key=_multipart_2UXA6SXDTUFT.2~UZIG12TCVLCK.2 size=657625 2024-09-14T11:17:06.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.555+0000 7fe125ff88c0 1 < canceled multipart upload key=2UXA6SXDTUFT upload=UZIG12TCVLCK tag=5IXSDWCSP5CW type=write size=3803353 2024-09-14T11:17:06.561 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.563+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~KL6CUL85OX4C.0 size=552948 2024-09-14T11:17:06.562 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.563+0000 7fe125ff88c0 1 > prepared multipart upload key=YCF2PCJ9TZMR upload=KL6CUL85OX4C tag=FUBWYFWFM8XF type=write size=1601524 2024-09-14T11:17:06.565 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.567+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~H35NKFM0CVDS.0 size=1048576 2024-09-14T11:17:06.568 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.567+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~H35NKFM0CVDS.1 size=950335 2024-09-14T11:17:06.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.575+0000 7fe125ff88c0 1 < completed multipart upload key=4D2X7151977X upload=H35NKFM0CVDS tag=XXOELH4CE0YD type=write size=3047487 2024-09-14T11:17:06.581 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.583+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~GSNUB75GN3LO.0 size=80842 2024-09-14T11:17:06.581 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.583+0000 7fe125ff88c0 1 > prepared multipart upload key=FQ5WT12KB664 upload=GSNUB75GN3LO tag=7A2YPZFM71UV type=write size=1129418 2024-09-14T11:17:06.585 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.587+0000 7fe125ff88c0 1 < completed part key=_multipart_6PLUU2QIO9LJ.2~083JMUR72369.0 size=1048576 2024-09-14T11:17:06.587 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.587+0000 7fe125ff88c0 1 < completed part key=_multipart_6PLUU2QIO9LJ.2~083JMUR72369.1 size=1048576 2024-09-14T11:17:06.590 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.591+0000 7fe125ff88c0 1 < completed part key=_multipart_6PLUU2QIO9LJ.2~083JMUR72369.2 size=833527 2024-09-14T11:17:06.596 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.595+0000 7fe125ff88c0 1 < completed multipart upload key=6PLUU2QIO9LJ upload=083JMUR72369 tag=9VV2XW6AJICX type=write size=3979255 2024-09-14T11:17:06.599 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.599+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=T39TPNUZ2H7A type=del size=223960 2024-09-14T11:17:06.603 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.603+0000 7fe125ff88c0 1 < completed delete operation key=21HC4VMHXS6L tag=G5CB85YQEYJO type=del 2024-09-14T11:17:06.607 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.607+0000 7fe125ff88c0 1 > prepared operation key=1ML6RIXI4C5P tag=PAG7OC0XMEA6 type=del size=1850260 2024-09-14T11:17:06.610 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.611+0000 7fe125ff88c0 1 < completed delete operation key=F9I82N7RQC81 tag=64KUOS5KU3VM type=del 2024-09-14T11:17:06.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.619+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~4Y8V71DAQ08L.0 size=135203 2024-09-14T11:17:06.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.619+0000 7fe125ff88c0 1 > prepared multipart upload key=4D2X7151977X upload=4Y8V71DAQ08L tag=UPQGA3273J8K type=write size=1183779 2024-09-14T11:17:06.625 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.627+0000 7fe125ff88c0 1 < suggested remove operation key=SSNV25PDLDIS tag=99SVN2KXP674 type=write 2024-09-14T11:17:06.630 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.631+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=2D7G7TM6XXLL type=del size=2546472 2024-09-14T11:17:06.631 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.631+0000 7fe125ff88c0 1 < canceled part key=_multipart_3YGN50MBAF41.2~Y0V17VUREI8C.0 size=1048576 2024-09-14T11:17:06.634 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.635+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~Y0V17VUREI8C.1 size=1048576 2024-09-14T11:17:06.637 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.639+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~Y0V17VUREI8C.2 size=864900 2024-09-14T11:17:06.643 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.643+0000 7fe125ff88c0 1 < canceled multipart upload key=3YGN50MBAF41 upload=Y0V17VUREI8C tag=0CO6AD5KIIRT type=write size=4010628 2024-09-14T11:17:06.647 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.647+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=HQ17S69D8GHS type=del size=4155218 2024-09-14T11:17:06.651 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.651+0000 7fe125ff88c0 1 < completed delete operation key=2UXA6SXDTUFT tag=YGDK103X4YDF type=del 2024-09-14T11:17:06.658 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.659+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~K6ESQMKA6BK0.0 size=1048576 2024-09-14T11:17:06.661 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.663+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~K6ESQMKA6BK0.1 size=291526 2024-09-14T11:17:06.661 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.663+0000 7fe125ff88c0 1 > prepared multipart upload key=1ML6RIXI4C5P upload=K6ESQMKA6BK0 tag=TSJMFACR5IX1 type=write size=2388678 2024-09-14T11:17:06.665 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.667+0000 7fe125ff88c0 1 < completed delete operation key=N80X3YUF4OEL tag=OATIQOM5OJZU type=del 2024-09-14T11:17:06.669 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.671+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=OZH39JBZZT4J type=write size=887756 2024-09-14T11:17:06.673 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.675+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~P7AZT5QS1EWP.0 size=1048576 2024-09-14T11:17:06.673 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.675+0000 7fe125ff88c0 1 < canceled part key=_multipart_W0B19NBHNLMZ.2~P7AZT5QS1EWP.1 size=1048576 2024-09-14T11:17:06.676 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.675+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~P7AZT5QS1EWP.2 size=335265 2024-09-14T11:17:06.682 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.683+0000 7fe125ff88c0 1 < canceled multipart upload key=W0B19NBHNLMZ upload=P7AZT5QS1EWP tag=89HEVDR1WNBX type=write size=3480993 2024-09-14T11:17:06.685 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.687+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=ZXK6DIJCXK18 type=write size=1028952 2024-09-14T11:17:06.689 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.691+0000 7fe125ff88c0 1 < canceled operation key=SUCH37O8V1LY tag=SAG7C84G383O type=write size=776232 2024-09-14T11:17:06.693 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.695+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=UAEL04E91JSN type=write size=1035516 2024-09-14T11:17:06.697 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.699+0000 7fe125ff88c0 1 < completed delete operation key=6PLUU2QIO9LJ tag=KFN9NYHJLXT2 type=del 2024-09-14T11:17:06.705 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.707+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~ATI5J8XDN259.0 size=1048576 2024-09-14T11:17:06.708 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.707+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~ATI5J8XDN259.1 size=1048576 2024-09-14T11:17:06.711 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.711+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~ATI5J8XDN259.2 size=620794 2024-09-14T11:17:06.711 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.711+0000 7fe125ff88c0 1 > prepared multipart upload key=3OU4U9JF3ZD5 upload=ATI5J8XDN259 tag=OXBM44LOXQCR type=write size=3766522 2024-09-14T11:17:06.715 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.715+0000 7fe125ff88c0 1 < completed part key=_multipart_6PLUU2QIO9LJ.2~B1K073NDQI1W.0 size=1048576 2024-09-14T11:17:06.718 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.719+0000 7fe125ff88c0 1 < completed part key=_multipart_6PLUU2QIO9LJ.2~B1K073NDQI1W.1 size=444534 2024-09-14T11:17:06.724 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.727+0000 7fe125ff88c0 1 < completed multipart upload key=6PLUU2QIO9LJ upload=B1K073NDQI1W tag=31NV8CDAIXX1 type=write size=2541686 2024-09-14T11:17:06.728 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.731+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=NKB7GA42AOKP type=del size=1823384 2024-09-14T11:17:06.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.739+0000 7fe125ff88c0 1 < suggested remove operation key=35EB6U5O4A51 tag=16QDOMP5JS1T type=del 2024-09-14T11:17:06.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.743+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~3BIYWMUEGJCZ.0 size=825235 2024-09-14T11:17:06.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.743+0000 7fe125ff88c0 1 > prepared multipart upload key=1ML6RIXI4C5P upload=3BIYWMUEGJCZ tag=TXKQHD0JH6DI type=write size=1873811 2024-09-14T11:17:06.747 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.747+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~JLZTQHYMS6HK.0 size=641367 2024-09-14T11:17:06.753 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.755+0000 7fe125ff88c0 1 < completed multipart upload key=2LH5U05C2F8C upload=JLZTQHYMS6HK tag=2Z65K3EISPC2 type=write size=1689943 2024-09-14T11:17:06.759 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.759+0000 7fe125ff88c0 1 > prepared part key=_multipart_N94D3R7IOBNL.2~8BYCWJMRQZIK.0 size=1048576 2024-09-14T11:17:06.766 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.767+0000 7fe125ff88c0 1 > prepared part key=_multipart_N94D3R7IOBNL.2~8BYCWJMRQZIK.1 size=54547 2024-09-14T11:17:06.766 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.767+0000 7fe125ff88c0 1 > prepared multipart upload key=N94D3R7IOBNL upload=8BYCWJMRQZIK tag=4H40446RJNEJ type=write size=2151699 2024-09-14T11:17:06.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.775+0000 7fe125ff88c0 1 < suggested remove operation key=N94D3R7IOBNL tag=YNEJ0M5SVEH6 type=write 2024-09-14T11:17:06.780 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.779+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~6Y4JCNOZX7WZ.0 size=1048576 2024-09-14T11:17:06.782 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.783+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~6Y4JCNOZX7WZ.1 size=1048576 2024-09-14T11:17:06.785 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.787+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~6Y4JCNOZX7WZ.2 size=203217 2024-09-14T11:17:06.785 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.787+0000 7fe125ff88c0 1 > prepared multipart upload key=4D2X7151977X upload=6Y4JCNOZX7WZ tag=JEEGKVY98F41 type=write size=3348945 2024-09-14T11:17:06.789 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.791+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~KL6CUL85OX4C.0 size=552948 2024-09-14T11:17:06.794 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.799+0000 7fe125ff88c0 1 < completed multipart upload key=YCF2PCJ9TZMR upload=KL6CUL85OX4C tag=FUBWYFWFM8XF type=write size=1601524 2024-09-14T11:17:06.797 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.799+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=TML7TE2RQJEU type=del size=3950887 2024-09-14T11:17:06.801 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.803+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~GSNUB75GN3LO.0 size=80842 2024-09-14T11:17:06.808 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.807+0000 7fe125ff88c0 1 < completed multipart upload key=FQ5WT12KB664 upload=GSNUB75GN3LO tag=7A2YPZFM71UV type=write size=1129418 2024-09-14T11:17:06.812 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.811+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=R7M62MV1Z47Z type=write size=901926 2024-09-14T11:17:06.816 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.815+0000 7fe125ff88c0 1 < canceled operation key=V6B470G93KFT tag=T39TPNUZ2H7A type=del size=223960 2024-09-14T11:17:06.819 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.819+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=MEWN3URVGQ4M type=del size=2320072 2024-09-14T11:17:06.823 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.823+0000 7fe125ff88c0 1 < completed delete operation key=1ML6RIXI4C5P tag=PAG7OC0XMEA6 type=del 2024-09-14T11:17:06.827 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.827+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=H7V0OM67Y87J type=del size=660553 2024-09-14T11:17:06.831 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.831+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~4Y8V71DAQ08L.0 size=135203 2024-09-14T11:17:06.837 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.839+0000 7fe125ff88c0 1 < completed multipart upload key=4D2X7151977X upload=4Y8V71DAQ08L tag=UPQGA3273J8K type=write size=1183779 2024-09-14T11:17:06.842 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.843+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=2T3FWIZISLI7 type=del size=1247698 2024-09-14T11:17:06.845 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.847+0000 7fe125ff88c0 1 < completed delete operation key=4D2X7151977X tag=2D7G7TM6XXLL type=del 2024-09-14T11:17:06.849 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.851+0000 7fe125ff88c0 1 > prepared operation key=0FITHLGQKQEC tag=XDPO2JAWAJ7W type=del size=3407392 2024-09-14T11:17:06.853 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.855+0000 7fe125ff88c0 1 < canceled operation key=2KEKSWK0UT6C tag=HQ17S69D8GHS type=del size=4155218 2024-09-14T11:17:06.856 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.859+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=BJS7W6T6IIUA type=del size=885578 2024-09-14T11:17:06.860 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.863+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~K6ESQMKA6BK0.0 size=1048576 2024-09-14T11:17:06.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.863+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~K6ESQMKA6BK0.1 size=291526 2024-09-14T11:17:06.869 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.871+0000 7fe125ff88c0 1 < completed multipart upload key=1ML6RIXI4C5P upload=K6ESQMKA6BK0 tag=TSJMFACR5IX1 type=write size=2388678 2024-09-14T11:17:06.873 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.875+0000 7fe125ff88c0 1 > prepared operation key=FQ5WT12KB664 tag=6OMYO6HZ43ZP type=del size=2961390 2024-09-14T11:17:06.876 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.879+0000 7fe125ff88c0 1 < completed write operation key=SSNV25PDLDIS tag=OZH39JBZZT4J type=write size=887756 2024-09-14T11:17:06.880 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.883+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=244FDB1U5E1I type=del size=1171895 2024-09-14T11:17:06.884 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.883+0000 7fe125ff88c0 1 < completed write operation key=YN2HI39GPEDF tag=ZXK6DIJCXK18 type=write size=1028952 2024-09-14T11:17:06.891 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.891+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~45JP0MORYXO4.0 size=1048576 2024-09-14T11:17:06.894 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.895+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~45JP0MORYXO4.1 size=1048576 2024-09-14T11:17:06.897 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.899+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~45JP0MORYXO4.2 size=176820 2024-09-14T11:17:06.897 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.899+0000 7fe125ff88c0 1 > prepared multipart upload key=0FITHLGQKQEC upload=45JP0MORYXO4 tag=JA5QGZ43FWKI type=write size=3322548 2024-09-14T11:17:06.900 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.903+0000 7fe125ff88c0 1 < completed write operation key=4D2X7151977X tag=UAEL04E91JSN type=write size=1035516 2024-09-14T11:17:06.904 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.907+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=P3X5YP8XTXZ4 type=del size=4059656 2024-09-14T11:17:06.908 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.907+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~ATI5J8XDN259.0 size=1048576 2024-09-14T11:17:06.911 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.911+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~ATI5J8XDN259.1 size=1048576 2024-09-14T11:17:06.914 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.915+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~ATI5J8XDN259.2 size=620794 2024-09-14T11:17:06.920 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.923+0000 7fe125ff88c0 1 < completed multipart upload key=3OU4U9JF3ZD5 upload=ATI5J8XDN259 tag=OXBM44LOXQCR type=write size=3766522 2024-09-14T11:17:06.924 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.923+0000 7fe125ff88c0 1 > prepared operation key=FQ5WT12KB664 tag=325FNJ4FTP3T type=del size=2885192 2024-09-14T11:17:06.928 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.931+0000 7fe125ff88c0 1 < completed delete operation key=SSNV25PDLDIS tag=NKB7GA42AOKP type=del 2024-09-14T11:17:06.935 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.935+0000 7fe125ff88c0 1 > prepared part key=_multipart_2KEKSWK0UT6C.2~3A1YABTFTMA0.0 size=1048576 2024-09-14T11:17:06.938 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.939+0000 7fe125ff88c0 1 > prepared part key=_multipart_2KEKSWK0UT6C.2~3A1YABTFTMA0.1 size=339517 2024-09-14T11:17:06.938 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.939+0000 7fe125ff88c0 1 > prepared multipart upload key=2KEKSWK0UT6C upload=3A1YABTFTMA0 tag=NVBBCVI4090U type=write size=2436669 2024-09-14T11:17:06.942 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.943+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~3BIYWMUEGJCZ.0 size=825235 2024-09-14T11:17:06.948 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.947+0000 7fe125ff88c0 1 < completed multipart upload key=1ML6RIXI4C5P upload=3BIYWMUEGJCZ tag=TXKQHD0JH6DI type=write size=1873811 2024-09-14T11:17:06.952 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.951+0000 7fe125ff88c0 1 > prepared operation key=SUCH37O8V1LY tag=IGSNSOPMNPJL type=del size=1230343 2024-09-14T11:17:06.956 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.955+0000 7fe125ff88c0 1 < completed part key=_multipart_N94D3R7IOBNL.2~8BYCWJMRQZIK.0 size=1048576 2024-09-14T11:17:06.959 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.959+0000 7fe125ff88c0 1 < completed part key=_multipart_N94D3R7IOBNL.2~8BYCWJMRQZIK.1 size=54547 2024-09-14T11:17:06.965 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.967+0000 7fe125ff88c0 1 < completed multipart upload key=N94D3R7IOBNL upload=8BYCWJMRQZIK tag=4H40446RJNEJ type=write size=2151699 2024-09-14T11:17:06.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.971+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=KKCFO78T398D type=del size=182274 2024-09-14T11:17:06.972 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.975+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~6Y4JCNOZX7WZ.0 size=1048576 2024-09-14T11:17:06.975 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.975+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~6Y4JCNOZX7WZ.1 size=1048576 2024-09-14T11:17:06.978 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.979+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~6Y4JCNOZX7WZ.2 size=203217 2024-09-14T11:17:06.984 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.983+0000 7fe125ff88c0 1 < completed multipart upload key=4D2X7151977X upload=6Y4JCNOZX7WZ tag=JEEGKVY98F41 type=write size=3348945 2024-09-14T11:17:06.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.991+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~YS2IDUD9X463.0 size=1048576 2024-09-14T11:17:06.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.995+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~YS2IDUD9X463.1 size=792420 2024-09-14T11:17:06.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:06.995+0000 7fe125ff88c0 1 > prepared multipart upload key=SSNV25PDLDIS upload=YS2IDUD9X463 tag=5TA96LJOO0YU type=write size=2889572 2024-09-14T11:17:07.002 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.003+0000 7fe125ff88c0 1 < suggested update operation key=K3P6U6NU8I01 tag=TML7TE2RQJEU type=del size=3950887 2024-09-14T11:17:07.008 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.011+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~48E6FFRY4XA6.0 size=1026457 2024-09-14T11:17:07.008 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.011+0000 7fe125ff88c0 1 > prepared multipart upload key=2LH5U05C2F8C upload=48E6FFRY4XA6 tag=ZPBUPB4QQCVQ type=write size=2075033 2024-09-14T11:17:07.011 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.011+0000 7fe125ff88c0 1 < completed write operation key=6PLUU2QIO9LJ tag=R7M62MV1Z47Z type=write size=901926 2024-09-14T11:17:07.018 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.019+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~R17ZDSJ3Q6BL.0 size=1048576 2024-09-14T11:17:07.020 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.019+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~R17ZDSJ3Q6BL.1 size=1048576 2024-09-14T11:17:07.022 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.023+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~R17ZDSJ3Q6BL.2 size=22405 2024-09-14T11:17:07.022 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.023+0000 7fe125ff88c0 1 > prepared multipart upload key=K05LARTJ2QZ3 upload=R17ZDSJ3Q6BL tag=R1M3CZFXCOJH type=write size=3168133 2024-09-14T11:17:07.030 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.031+0000 7fe125ff88c0 1 < suggested remove operation key=21HC4VMHXS6L tag=MEWN3URVGQ4M type=del 2024-09-14T11:17:07.033 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.035+0000 7fe125ff88c0 1 > prepared operation key=K05LARTJ2QZ3 tag=6A0CJ599DMZD type=del size=3991150 2024-09-14T11:17:07.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.039+0000 7fe125ff88c0 1 < completed delete operation key=F9I82N7RQC81 tag=H7V0OM67Y87J type=del 2024-09-14T11:17:07.042 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.043+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~5AB7P5ZWNAYR.0 size=1048576 2024-09-14T11:17:07.044 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.047+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~5AB7P5ZWNAYR.1 size=1048576 2024-09-14T11:17:07.047 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.047+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~5AB7P5ZWNAYR.2 size=242861 2024-09-14T11:17:07.047 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.047+0000 7fe125ff88c0 1 > prepared multipart upload key=6C3JZKTB8BP3 upload=5AB7P5ZWNAYR tag=HGKI0V5BBTXH type=write size=3388589 2024-09-14T11:17:07.050 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.051+0000 7fe125ff88c0 1 < completed delete operation key=F9I82N7RQC81 tag=2T3FWIZISLI7 type=del 2024-09-14T11:17:07.053 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.055+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=Y8JUT654UBRG type=del size=3876433 2024-09-14T11:17:07.057 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.059+0000 7fe125ff88c0 1 < completed delete operation key=0FITHLGQKQEC tag=XDPO2JAWAJ7W type=del 2024-09-14T11:17:07.062 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.063+0000 7fe125ff88c0 1 > prepared part key=_multipart_N94D3R7IOBNL.2~DE0M4BCB920W.0 size=1048576 2024-09-14T11:17:07.065 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.067+0000 7fe125ff88c0 1 > prepared part key=_multipart_N94D3R7IOBNL.2~DE0M4BCB920W.1 size=444731 2024-09-14T11:17:07.065 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.067+0000 7fe125ff88c0 1 > prepared multipart upload key=N94D3R7IOBNL upload=DE0M4BCB920W tag=HU3MVHZV9097 type=write size=2541883 2024-09-14T11:17:07.068 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.067+0000 7fe125ff88c0 1 < completed delete operation key=WEA3MQ0DI42N tag=BJS7W6T6IIUA type=del 2024-09-14T11:17:07.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.071+0000 7fe125ff88c0 1 > prepared operation key=1ML6RIXI4C5P tag=MVQW5GFYH707 type=write size=386381 2024-09-14T11:17:07.078 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.079+0000 7fe125ff88c0 1 < suggested remove operation key=FQ5WT12KB664 tag=6OMYO6HZ43ZP type=del 2024-09-14T11:17:07.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.083+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~VH6TR6RJ8L27.0 size=1048576 2024-09-14T11:17:07.086 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.087+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~VH6TR6RJ8L27.1 size=253337 2024-09-14T11:17:07.086 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.087+0000 7fe125ff88c0 1 > prepared multipart upload key=21HC4VMHXS6L upload=VH6TR6RJ8L27 tag=JFQ9FO5CCXB3 type=write size=2350489 2024-09-14T11:17:07.092 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.091+0000 7fe125ff88c0 1 < suggested remove operation key=V6B470G93KFT tag=244FDB1U5E1I type=del 2024-09-14T11:17:07.100 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.099+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~0DQ7150SD1D6.0 size=1048576 2024-09-14T11:17:07.102 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.103+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~0DQ7150SD1D6.1 size=910273 2024-09-14T11:17:07.103 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.103+0000 7fe125ff88c0 1 > prepared multipart upload key=K05LARTJ2QZ3 upload=0DQ7150SD1D6 tag=TME5YVRDTGCE type=write size=3007425 2024-09-14T11:17:07.106 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.107+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~45JP0MORYXO4.0 size=1048576 2024-09-14T11:17:07.109 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.111+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~45JP0MORYXO4.1 size=1048576 2024-09-14T11:17:07.112 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.111+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~45JP0MORYXO4.2 size=176820 2024-09-14T11:17:07.118 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.119+0000 7fe125ff88c0 1 < completed multipart upload key=0FITHLGQKQEC upload=45JP0MORYXO4 tag=JA5QGZ43FWKI type=write size=3322548 2024-09-14T11:17:07.122 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.123+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=C8E6WN7LIK99 type=del size=3964311 2024-09-14T11:17:07.126 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.127+0000 7fe125ff88c0 -1 < failed to complete operation key=K3P6U6NU8I01 tag=P3X5YP8XTXZ4 type=del size=4059656: (22) Invalid argument 2024-09-14T11:17:07.130 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.131+0000 7fe125ff88c0 1 > prepared operation key=46ZTDBWFVSUH tag=3XZPJ9UL0OEX type=write size=884130 2024-09-14T11:17:07.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.135+0000 7fe125ff88c0 -1 < failed to complete operation key=FQ5WT12KB664 tag=325FNJ4FTP3T type=del size=2885192: (22) Invalid argument 2024-09-14T11:17:07.137 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.139+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=EEGYIV6J0DRM type=del size=3083869 2024-09-14T11:17:07.141 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.143+0000 7fe125ff88c0 1 < completed part key=_multipart_2KEKSWK0UT6C.2~3A1YABTFTMA0.0 size=1048576 2024-09-14T11:17:07.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.143+0000 7fe125ff88c0 1 < completed part key=_multipart_2KEKSWK0UT6C.2~3A1YABTFTMA0.1 size=339517 2024-09-14T11:17:07.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.151+0000 7fe125ff88c0 1 < completed multipart upload key=2KEKSWK0UT6C upload=3A1YABTFTMA0 tag=NVBBCVI4090U type=write size=2436669 2024-09-14T11:17:07.152 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.151+0000 7fe125ff88c0 1 > prepared operation key=0FITHLGQKQEC tag=WIJJALC7V8K9 type=del size=3381214 2024-09-14T11:17:07.155 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.155+0000 7fe125ff88c0 1 < completed delete operation key=SUCH37O8V1LY tag=IGSNSOPMNPJL type=del 2024-09-14T11:17:07.158 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.159+0000 7fe125ff88c0 1 > prepared operation key=3OU4U9JF3ZD5 tag=1XWR5MP753I0 type=del size=2894560 2024-09-14T11:17:07.167 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.167+0000 7fe125ff88c0 1 < suggested update operation key=SSNV25PDLDIS tag=KKCFO78T398D type=del size=182274 2024-09-14T11:17:07.171 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.171+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=DSEOAHXDM177 type=del size=2476383 2024-09-14T11:17:07.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.175+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~YS2IDUD9X463.0 size=1048576 2024-09-14T11:17:07.179 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.179+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~YS2IDUD9X463.1 size=792420 2024-09-14T11:17:07.184 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.183+0000 7fe125ff88c0 1 < completed multipart upload key=SSNV25PDLDIS upload=YS2IDUD9X463 tag=5TA96LJOO0YU type=write size=2889572 2024-09-14T11:17:07.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.187+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=G287J667L55L type=del size=2018661 2024-09-14T11:17:07.191 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.191+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~48E6FFRY4XA6.0 size=1026457 2024-09-14T11:17:07.195 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.195+0000 7fe125ff88c0 1 < completed multipart upload key=2LH5U05C2F8C upload=48E6FFRY4XA6 tag=ZPBUPB4QQCVQ type=write size=2075033 2024-09-14T11:17:07.198 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.199+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=ZH2J2GLMUO9D type=del size=2406726 2024-09-14T11:17:07.202 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.203+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~R17ZDSJ3Q6BL.0 size=1048576 2024-09-14T11:17:07.205 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.207+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~R17ZDSJ3Q6BL.1 size=1048576 2024-09-14T11:17:07.208 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.207+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~R17ZDSJ3Q6BL.2 size=22405 2024-09-14T11:17:07.214 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.215+0000 7fe125ff88c0 1 < completed multipart upload key=K05LARTJ2QZ3 upload=R17ZDSJ3Q6BL tag=R1M3CZFXCOJH type=write size=3168133 2024-09-14T11:17:07.221 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.223+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~D2A1ZTI4CT78.0 size=1048576 2024-09-14T11:17:07.223 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.223+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~D2A1ZTI4CT78.1 size=962260 2024-09-14T11:17:07.223 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.223+0000 7fe125ff88c0 1 > prepared multipart upload key=3OU4U9JF3ZD5 upload=D2A1ZTI4CT78 tag=EIXNYQ0MI32J type=write size=3059412 2024-09-14T11:17:07.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.227+0000 7fe125ff88c0 1 < completed delete operation key=K05LARTJ2QZ3 tag=6A0CJ599DMZD type=del 2024-09-14T11:17:07.230 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.231+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=VFM1XFTSA7XI type=del size=2401189 2024-09-14T11:17:07.231 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.231+0000 7fe125ff88c0 1 < canceled part key=_multipart_6C3JZKTB8BP3.2~5AB7P5ZWNAYR.0 size=1048576 2024-09-14T11:17:07.235 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.235+0000 7fe125ff88c0 1 < completed part key=_multipart_6C3JZKTB8BP3.2~5AB7P5ZWNAYR.1 size=1048576 2024-09-14T11:17:07.235 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.235+0000 7fe125ff88c0 1 < canceled part key=_multipart_6C3JZKTB8BP3.2~5AB7P5ZWNAYR.2 size=242861 2024-09-14T11:17:07.240 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.239+0000 7fe125ff88c0 1 < canceled multipart upload key=6C3JZKTB8BP3 upload=5AB7P5ZWNAYR tag=HGKI0V5BBTXH type=write size=3388589 2024-09-14T11:17:07.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.243+0000 7fe125ff88c0 1 > prepared operation key=3YGN50MBAF41 tag=XLB9TS15V102 type=write size=510282 2024-09-14T11:17:07.247 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.247+0000 7fe125ff88c0 1 < completed delete operation key=4D2X7151977X tag=Y8JUT654UBRG type=del 2024-09-14T11:17:07.253 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.255+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~Z9WO3UPN6851.0 size=6256 2024-09-14T11:17:07.253 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.255+0000 7fe125ff88c0 1 > prepared multipart upload key=4D2X7151977X upload=Z9WO3UPN6851 tag=MNT85MTXENK5 type=write size=1054832 2024-09-14T11:17:07.257 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.259+0000 7fe125ff88c0 1 < completed part key=_multipart_N94D3R7IOBNL.2~DE0M4BCB920W.0 size=1048576 2024-09-14T11:17:07.259 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.259+0000 7fe125ff88c0 1 < completed part key=_multipart_N94D3R7IOBNL.2~DE0M4BCB920W.1 size=444731 2024-09-14T11:17:07.265 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.267+0000 7fe125ff88c0 1 < completed multipart upload key=N94D3R7IOBNL upload=DE0M4BCB920W tag=HU3MVHZV9097 type=write size=2541883 2024-09-14T11:17:07.272 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.271+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~M3O0L4FZNH8K.0 size=1048576 2024-09-14T11:17:07.274 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.275+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~M3O0L4FZNH8K.1 size=999581 2024-09-14T11:17:07.275 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.275+0000 7fe125ff88c0 1 > prepared multipart upload key=2LH5U05C2F8C upload=M3O0L4FZNH8K tag=IRH451QP2H3H type=write size=3096733 2024-09-14T11:17:07.279 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.279+0000 7fe125ff88c0 1 < completed write operation key=1ML6RIXI4C5P tag=MVQW5GFYH707 type=write size=386381 2024-09-14T11:17:07.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.283+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=U0DK2BZJTGEL type=del size=1376680 2024-09-14T11:17:07.287 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.287+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~VH6TR6RJ8L27.0 size=1048576 2024-09-14T11:17:07.290 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.291+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~VH6TR6RJ8L27.1 size=253337 2024-09-14T11:17:07.296 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.295+0000 7fe125ff88c0 1 < completed multipart upload key=21HC4VMHXS6L upload=VH6TR6RJ8L27 tag=JFQ9FO5CCXB3 type=write size=2350489 2024-09-14T11:17:07.302 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.303+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~QE35P23Z1Z3H.0 size=1048576 2024-09-14T11:17:07.305 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.307+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~QE35P23Z1Z3H.1 size=1048576 2024-09-14T11:17:07.307 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.307+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~QE35P23Z1Z3H.2 size=508911 2024-09-14T11:17:07.307 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.307+0000 7fe125ff88c0 1 > prepared multipart upload key=L4XO0WTYKNXY upload=QE35P23Z1Z3H tag=JTX6YOZR7E1Z type=write size=3654639 2024-09-14T11:17:07.312 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.311+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~0DQ7150SD1D6.0 size=1048576 2024-09-14T11:17:07.314 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.315+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~0DQ7150SD1D6.1 size=910273 2024-09-14T11:17:07.320 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.319+0000 7fe125ff88c0 1 < completed multipart upload key=K05LARTJ2QZ3 upload=0DQ7150SD1D6 tag=TME5YVRDTGCE type=write size=3007425 2024-09-14T11:17:07.323 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.323+0000 7fe125ff88c0 1 > prepared operation key=FQ5WT12KB664 tag=056UHWE685XX type=del size=3073953 2024-09-14T11:17:07.327 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.327+0000 7fe125ff88c0 1 < completed delete operation key=F9I82N7RQC81 tag=C8E6WN7LIK99 type=del 2024-09-14T11:17:07.330 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.331+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=11KOJOKP3TE6 type=del size=1870352 2024-09-14T11:17:07.334 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.335+0000 7fe125ff88c0 1 < canceled operation key=46ZTDBWFVSUH tag=3XZPJ9UL0OEX type=write size=884130 2024-09-14T11:17:07.338 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.339+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=6NEPQ75QHP6C type=write size=936130 2024-09-14T11:17:07.341 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.343+0000 7fe125ff88c0 1 < completed delete operation key=2UXA6SXDTUFT tag=EEGYIV6J0DRM type=del 2024-09-14T11:17:07.345 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.347+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=N27V6K5OH58U type=del size=1053870 2024-09-14T11:17:07.348 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.351+0000 7fe125ff88c0 1 < completed delete operation key=0FITHLGQKQEC tag=WIJJALC7V8K9 type=del 2024-09-14T11:17:07.352 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.351+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=8HDRVC8HYTCZ type=del size=2377769 2024-09-14T11:17:07.356 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.355+0000 7fe125ff88c0 1 < completed delete operation key=3OU4U9JF3ZD5 tag=1XWR5MP753I0 type=del 2024-09-14T11:17:07.359 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.359+0000 7fe125ff88c0 1 > prepared operation key=6C3JZKTB8BP3 tag=7J5DMI4YHCQV type=del size=1537959 2024-09-14T11:17:07.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.363+0000 7fe125ff88c0 1 < completed delete operation key=YCF2PCJ9TZMR tag=DSEOAHXDM177 type=del 2024-09-14T11:17:07.366 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.367+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=9535WK9KAKB8 type=write size=278113 2024-09-14T11:17:07.373 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.375+0000 7fe125ff88c0 1 < suggested remove operation key=N94D3R7IOBNL tag=G287J667L55L type=del 2024-09-14T11:17:07.380 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.379+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~3C8T8RA1TLJD.0 size=1048576 2024-09-14T11:17:07.382 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.383+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~3C8T8RA1TLJD.1 size=1048576 2024-09-14T11:17:07.385 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.387+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~3C8T8RA1TLJD.2 size=911753 2024-09-14T11:17:07.385 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.387+0000 7fe125ff88c0 1 > prepared multipart upload key=YGEVGH840L18 upload=3C8T8RA1TLJD tag=7PLJZPQM8ZJY type=write size=4057481 2024-09-14T11:17:07.388 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.391+0000 7fe125ff88c0 1 < completed delete operation key=35EB6U5O4A51 tag=ZH2J2GLMUO9D type=del 2024-09-14T11:17:07.395 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.395+0000 7fe125ff88c0 1 > prepared part key=_multipart_WEA3MQ0DI42N.2~AONNS2AKBH52.0 size=1048576 2024-09-14T11:17:07.398 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.399+0000 7fe125ff88c0 1 > prepared part key=_multipart_WEA3MQ0DI42N.2~AONNS2AKBH52.1 size=1048576 2024-09-14T11:17:07.400 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.403+0000 7fe125ff88c0 1 > prepared part key=_multipart_WEA3MQ0DI42N.2~AONNS2AKBH52.2 size=163220 2024-09-14T11:17:07.400 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.403+0000 7fe125ff88c0 1 > prepared multipart upload key=WEA3MQ0DI42N upload=AONNS2AKBH52 tag=OBO75JQD4XDP type=write size=3308948 2024-09-14T11:17:07.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.407+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~D2A1ZTI4CT78.0 size=1048576 2024-09-14T11:17:07.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.407+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~D2A1ZTI4CT78.1 size=962260 2024-09-14T11:17:07.413 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.415+0000 7fe125ff88c0 1 < completed multipart upload key=3OU4U9JF3ZD5 upload=D2A1ZTI4CT78 tag=EIXNYQ0MI32J type=write size=3059412 2024-09-14T11:17:07.416 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.419+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=ZWJPA0682HMH type=del size=4091879 2024-09-14T11:17:07.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.423+0000 7fe125ff88c0 1 < completed delete operation key=L4XO0WTYKNXY tag=VFM1XFTSA7XI type=del 2024-09-14T11:17:07.428 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.427+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=W9ILVALI85HH type=write size=95011 2024-09-14T11:17:07.433 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.435+0000 7fe125ff88c0 1 < completed write operation key=3YGN50MBAF41 tag=XLB9TS15V102 type=write size=510282 2024-09-14T11:17:07.440 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.439+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~EF29JT63IJWM.0 size=1048576 2024-09-14T11:17:07.443 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.443+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~EF29JT63IJWM.1 size=1048386 2024-09-14T11:17:07.443 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.443+0000 7fe125ff88c0 1 > prepared multipart upload key=FQ5WT12KB664 upload=EF29JT63IJWM tag=1D84B1M1UNB5 type=write size=3145538 2024-09-14T11:17:07.447 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.447+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~Z9WO3UPN6851.0 size=6256 2024-09-14T11:17:07.453 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.455+0000 7fe125ff88c0 1 < completed multipart upload key=4D2X7151977X upload=Z9WO3UPN6851 tag=MNT85MTXENK5 type=write size=1054832 2024-09-14T11:17:07.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.459+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~6GLTJCNK3MGB.0 size=1048576 2024-09-14T11:17:07.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.463+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~6GLTJCNK3MGB.1 size=1048576 2024-09-14T11:17:07.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.467+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~6GLTJCNK3MGB.2 size=549083 2024-09-14T11:17:07.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.467+0000 7fe125ff88c0 1 > prepared multipart upload key=YFRH8WECBTJK upload=6GLTJCNK3MGB tag=BORXK14C6N75 type=write size=3694811 2024-09-14T11:17:07.469 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.471+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~M3O0L4FZNH8K.0 size=1048576 2024-09-14T11:17:07.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.471+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~M3O0L4FZNH8K.1 size=999581 2024-09-14T11:17:07.478 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.479+0000 7fe125ff88c0 1 < completed multipart upload key=2LH5U05C2F8C upload=M3O0L4FZNH8K tag=IRH451QP2H3H type=write size=3096733 2024-09-14T11:17:07.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.483+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=HJ3443I8PLG9 type=del size=1579969 2024-09-14T11:17:07.486 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.487+0000 7fe125ff88c0 1 < completed delete operation key=W0B19NBHNLMZ tag=U0DK2BZJTGEL type=del 2024-09-14T11:17:07.490 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.491+0000 7fe125ff88c0 1 > prepared operation key=6C3JZKTB8BP3 tag=QTTGZJGTUOGU type=del size=746943 2024-09-14T11:17:07.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.495+0000 7fe125ff88c0 1 < completed part key=_multipart_L4XO0WTYKNXY.2~QE35P23Z1Z3H.0 size=1048576 2024-09-14T11:17:07.497 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.499+0000 7fe125ff88c0 1 < completed part key=_multipart_L4XO0WTYKNXY.2~QE35P23Z1Z3H.1 size=1048576 2024-09-14T11:17:07.500 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.499+0000 7fe125ff88c0 1 < completed part key=_multipart_L4XO0WTYKNXY.2~QE35P23Z1Z3H.2 size=508911 2024-09-14T11:17:07.506 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.507+0000 7fe125ff88c0 1 < completed multipart upload key=L4XO0WTYKNXY upload=QE35P23Z1Z3H tag=JTX6YOZR7E1Z type=write size=3654639 2024-09-14T11:17:07.513 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.515+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~IX49NAO8ED5B.0 size=1048576 2024-09-14T11:17:07.516 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.515+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~IX49NAO8ED5B.1 size=19761 2024-09-14T11:17:07.516 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.515+0000 7fe125ff88c0 1 > prepared multipart upload key=YCF2PCJ9TZMR upload=IX49NAO8ED5B tag=1OFLG5E18QBM type=write size=2116913 2024-09-14T11:17:07.523 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.523+0000 7fe125ff88c0 1 < suggested update operation key=FQ5WT12KB664 tag=056UHWE685XX type=del size=3073953 2024-09-14T11:17:07.529 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.531+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~2P8MJL0S2MSZ.0 size=1048576 2024-09-14T11:17:07.532 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.531+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~2P8MJL0S2MSZ.1 size=908854 2024-09-14T11:17:07.532 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.531+0000 7fe125ff88c0 1 > prepared multipart upload key=K05LARTJ2QZ3 upload=2P8MJL0S2MSZ tag=SQJAS0GEC15E type=write size=3006006 2024-09-14T11:17:07.537 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.539+0000 7fe125ff88c0 1 < completed delete operation key=2LH5U05C2F8C tag=11KOJOKP3TE6 type=del 2024-09-14T11:17:07.540 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.543+0000 7fe125ff88c0 1 > prepared operation key=SUCH37O8V1LY tag=7ZRZ87Q5276R type=del size=114593 2024-09-14T11:17:07.548 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.551+0000 7fe125ff88c0 1 < suggested remove operation key=SSNV25PDLDIS tag=6NEPQ75QHP6C type=write 2024-09-14T11:17:07.556 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.555+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~F0XV8FBMFEUO.0 size=1048576 2024-09-14T11:17:07.559 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.559+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~F0XV8FBMFEUO.1 size=1048576 2024-09-14T11:17:07.561 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.563+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~F0XV8FBMFEUO.2 size=231344 2024-09-14T11:17:07.562 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.563+0000 7fe125ff88c0 1 > prepared multipart upload key=K3P6U6NU8I01 upload=F0XV8FBMFEUO tag=723GV9LU0TV3 type=write size=3377072 2024-09-14T11:17:07.565 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.567+0000 7fe125ff88c0 1 < completed delete operation key=2KEKSWK0UT6C tag=N27V6K5OH58U type=del 2024-09-14T11:17:07.569 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.571+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=AL16L4EFVEQT type=write size=1011300 2024-09-14T11:17:07.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.575+0000 7fe125ff88c0 -1 < failed to complete operation key=N94D3R7IOBNL tag=8HDRVC8HYTCZ type=del size=2377769: (22) Invalid argument 2024-09-14T11:17:07.576 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.579+0000 7fe125ff88c0 1 > prepared operation key=0FITHLGQKQEC tag=SBB4DTJXQWEM type=del size=141394 2024-09-14T11:17:07.580 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.579+0000 7fe125ff88c0 1 < completed delete operation key=6C3JZKTB8BP3 tag=7J5DMI4YHCQV type=del 2024-09-14T11:17:07.584 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.583+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=ON0HUBX2QW4R type=del size=1142423 2024-09-14T11:17:07.588 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.587+0000 7fe125ff88c0 1 < completed write operation key=4D2X7151977X tag=9535WK9KAKB8 type=write size=278113 2024-09-14T11:17:07.594 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.595+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~OYCZT8UMSG4W.0 size=1048576 2024-09-14T11:17:07.597 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.599+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~OYCZT8UMSG4W.1 size=1048576 2024-09-14T11:17:07.600 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.603+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~OYCZT8UMSG4W.2 size=44647 2024-09-14T11:17:07.600 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.603+0000 7fe125ff88c0 1 > prepared multipart upload key=YCF2PCJ9TZMR upload=OYCZT8UMSG4W tag=XLC5GNC9BQBO type=write size=3190375 2024-09-14T11:17:07.604 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.607+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~3C8T8RA1TLJD.0 size=1048576 2024-09-14T11:17:07.607 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.607+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~3C8T8RA1TLJD.1 size=1048576 2024-09-14T11:17:07.610 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.611+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~3C8T8RA1TLJD.2 size=911753 2024-09-14T11:17:07.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.619+0000 7fe125ff88c0 1 < completed multipart upload key=YGEVGH840L18 upload=3C8T8RA1TLJD tag=7PLJZPQM8ZJY type=write size=4057481 2024-09-14T11:17:07.622 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.623+0000 7fe125ff88c0 1 > prepared operation key=46ZTDBWFVSUH tag=0V5DKWMG2ZEL type=del size=2892028 2024-09-14T11:17:07.623 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.623+0000 7fe125ff88c0 1 < canceled part key=_multipart_WEA3MQ0DI42N.2~AONNS2AKBH52.0 size=1048576 2024-09-14T11:17:07.627 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.627+0000 7fe125ff88c0 1 < completed part key=_multipart_WEA3MQ0DI42N.2~AONNS2AKBH52.1 size=1048576 2024-09-14T11:17:07.630 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.631+0000 7fe125ff88c0 1 < completed part key=_multipart_WEA3MQ0DI42N.2~AONNS2AKBH52.2 size=163220 2024-09-14T11:17:07.637 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.639+0000 7fe125ff88c0 1 < canceled multipart upload key=WEA3MQ0DI42N upload=AONNS2AKBH52 tag=OBO75JQD4XDP type=write size=3308948 2024-09-14T11:17:07.641 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.643+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=D2DFCQ1ROL14 type=del size=1225103 2024-09-14T11:17:07.646 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.647+0000 7fe125ff88c0 1 < completed delete operation key=YCF2PCJ9TZMR tag=ZWJPA0682HMH type=del 2024-09-14T11:17:07.650 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.651+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=VBOYC9AII3HQ type=del size=1972556 2024-09-14T11:17:07.654 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.655+0000 7fe125ff88c0 1 < completed write operation key=0VBX2FWYCFEZ tag=W9ILVALI85HH type=write size=95011 2024-09-14T11:17:07.662 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.663+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~I6ZK4ANQONNK.0 size=18947 2024-09-14T11:17:07.662 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.663+0000 7fe125ff88c0 1 > prepared multipart upload key=W0B19NBHNLMZ upload=I6ZK4ANQONNK tag=NFGVRVO16OOT type=write size=1067523 2024-09-14T11:17:07.666 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.667+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~EF29JT63IJWM.0 size=1048576 2024-09-14T11:17:07.670 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.671+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~EF29JT63IJWM.1 size=1048386 2024-09-14T11:17:07.676 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.679+0000 7fe125ff88c0 1 < completed multipart upload key=FQ5WT12KB664 upload=EF29JT63IJWM tag=1D84B1M1UNB5 type=write size=3145538 2024-09-14T11:17:07.681 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.683+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=C3GVRXBZUY80 type=write size=503231 2024-09-14T11:17:07.685 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.687+0000 7fe125ff88c0 1 < completed part key=_multipart_YFRH8WECBTJK.2~6GLTJCNK3MGB.0 size=1048576 2024-09-14T11:17:07.688 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.687+0000 7fe125ff88c0 1 < completed part key=_multipart_YFRH8WECBTJK.2~6GLTJCNK3MGB.1 size=1048576 2024-09-14T11:17:07.691 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.691+0000 7fe125ff88c0 1 < completed part key=_multipart_YFRH8WECBTJK.2~6GLTJCNK3MGB.2 size=549083 2024-09-14T11:17:07.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.699+0000 7fe125ff88c0 1 < completed multipart upload key=YFRH8WECBTJK upload=6GLTJCNK3MGB tag=BORXK14C6N75 type=write size=3694811 2024-09-14T11:17:07.705 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.707+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~ZK577NZLYUR9.0 size=1048576 2024-09-14T11:17:07.708 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.711+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~ZK577NZLYUR9.1 size=72910 2024-09-14T11:17:07.708 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.711+0000 7fe125ff88c0 1 > prepared multipart upload key=21HC4VMHXS6L upload=ZK577NZLYUR9 tag=SSW9HA2GFH5H type=write size=2170062 2024-09-14T11:17:07.713 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.715+0000 7fe125ff88c0 1 < completed delete operation key=21HC4VMHXS6L tag=HJ3443I8PLG9 type=del 2024-09-14T11:17:07.717 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.719+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=WG4N8B23KDV0 type=del size=3167459 2024-09-14T11:17:07.720 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.723+0000 7fe125ff88c0 1 < completed delete operation key=6C3JZKTB8BP3 tag=QTTGZJGTUOGU type=del 2024-09-14T11:17:07.724 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.723+0000 7fe125ff88c0 1 > prepared operation key=1ML6RIXI4C5P tag=5V5Q4YHORHPR type=del size=1652531 2024-09-14T11:17:07.728 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.727+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~IX49NAO8ED5B.0 size=1048576 2024-09-14T11:17:07.731 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.731+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~IX49NAO8ED5B.1 size=19761 2024-09-14T11:17:07.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.739+0000 7fe125ff88c0 1 < completed multipart upload key=YCF2PCJ9TZMR upload=IX49NAO8ED5B tag=1OFLG5E18QBM type=write size=2116913 2024-09-14T11:17:07.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.743+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~1QAE8HYSLE31.0 size=1048576 2024-09-14T11:17:07.747 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.747+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~1QAE8HYSLE31.1 size=1048576 2024-09-14T11:17:07.750 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.751+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~1QAE8HYSLE31.2 size=372905 2024-09-14T11:17:07.750 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.751+0000 7fe125ff88c0 1 > prepared multipart upload key=V6B470G93KFT upload=1QAE8HYSLE31 tag=A6TUTEWBS3Z5 type=write size=3518633 2024-09-14T11:17:07.753 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.755+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~2P8MJL0S2MSZ.0 size=1048576 2024-09-14T11:17:07.756 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.755+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~2P8MJL0S2MSZ.1 size=908854 2024-09-14T11:17:07.762 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.763+0000 7fe125ff88c0 1 < completed multipart upload key=K05LARTJ2QZ3 upload=2P8MJL0S2MSZ tag=SQJAS0GEC15E type=write size=3006006 2024-09-14T11:17:07.766 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.767+0000 7fe125ff88c0 1 > prepared operation key=K05LARTJ2QZ3 tag=X0VY3WO5GD5P type=del size=4033092 2024-09-14T11:17:07.769 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.771+0000 7fe125ff88c0 1 < completed delete operation key=SUCH37O8V1LY tag=7ZRZ87Q5276R type=del 2024-09-14T11:17:07.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.775+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=DY61LYOKCVXO type=write size=722013 2024-09-14T11:17:07.777 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.779+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~F0XV8FBMFEUO.0 size=1048576 2024-09-14T11:17:07.782 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.783+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~F0XV8FBMFEUO.1 size=1048576 2024-09-14T11:17:07.785 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.787+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~F0XV8FBMFEUO.2 size=231344 2024-09-14T11:17:07.791 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.791+0000 7fe125ff88c0 1 < completed multipart upload key=K3P6U6NU8I01 upload=F0XV8FBMFEUO tag=723GV9LU0TV3 type=write size=3377072 2024-09-14T11:17:07.795 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.795+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=3RN1KS0R8USR type=del size=2649940 2024-09-14T11:17:07.799 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.799+0000 7fe125ff88c0 1 < completed write operation key=21HC4VMHXS6L tag=AL16L4EFVEQT type=write size=1011300 2024-09-14T11:17:07.803 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.803+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=WX9TEM7AZSHZ type=del size=273776 2024-09-14T11:17:07.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.807+0000 7fe125ff88c0 1 < completed delete operation key=0FITHLGQKQEC tag=SBB4DTJXQWEM type=del 2024-09-14T11:17:07.813 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.815+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~ZC4M44X3I1N6.0 size=1048576 2024-09-14T11:17:07.816 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.815+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~ZC4M44X3I1N6.1 size=1048576 2024-09-14T11:17:07.819 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.819+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~ZC4M44X3I1N6.2 size=596729 2024-09-14T11:17:07.819 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.819+0000 7fe125ff88c0 1 > prepared multipart upload key=YN2HI39GPEDF upload=ZC4M44X3I1N6 tag=KAGM800E4ZSS type=write size=3742457 2024-09-14T11:17:07.827 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.827+0000 7fe125ff88c0 1 < suggested update operation key=W0B19NBHNLMZ tag=ON0HUBX2QW4R type=del size=1142423 2024-09-14T11:17:07.831 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.831+0000 7fe125ff88c0 1 > prepared operation key=1ML6RIXI4C5P tag=NMKZDD682G09 type=del size=3460605 2024-09-14T11:17:07.835 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.835+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~OYCZT8UMSG4W.0 size=1048576 2024-09-14T11:17:07.838 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.839+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~OYCZT8UMSG4W.1 size=1048576 2024-09-14T11:17:07.842 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.843+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~OYCZT8UMSG4W.2 size=44647 2024-09-14T11:17:07.848 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.847+0000 7fe125ff88c0 1 < completed multipart upload key=YCF2PCJ9TZMR upload=OYCZT8UMSG4W tag=XLC5GNC9BQBO type=write size=3190375 2024-09-14T11:17:07.852 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.851+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=2PO52GXQ3NA1 type=write size=58415 2024-09-14T11:17:07.856 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.855+0000 7fe125ff88c0 1 < completed delete operation key=46ZTDBWFVSUH tag=0V5DKWMG2ZEL type=del 2024-09-14T11:17:07.864 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.867+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~MXAU18VFN2RH.0 size=1048576 2024-09-14T11:17:07.867 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.867+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~MXAU18VFN2RH.1 size=562165 2024-09-14T11:17:07.867 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.867+0000 7fe125ff88c0 1 > prepared multipart upload key=LYBGDNKUROWH upload=MXAU18VFN2RH tag=UCWPMDQVZ92I type=write size=2659317 2024-09-14T11:17:07.872 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.871+0000 7fe125ff88c0 1 < completed delete operation key=K3P6U6NU8I01 tag=D2DFCQ1ROL14 type=del 2024-09-14T11:17:07.875 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.875+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=NO06KZ322RKZ type=del size=2841145 2024-09-14T11:17:07.879 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.879+0000 7fe125ff88c0 1 < completed delete operation key=0VBX2FWYCFEZ tag=VBOYC9AII3HQ type=del 2024-09-14T11:17:07.886 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.887+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~PAW2NW00T58T.0 size=328923 2024-09-14T11:17:07.886 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.887+0000 7fe125ff88c0 1 > prepared multipart upload key=3YGN50MBAF41 upload=PAW2NW00T58T tag=HKNYAPII2RN7 type=write size=1377499 2024-09-14T11:17:07.890 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.891+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~I6ZK4ANQONNK.0 size=18947 2024-09-14T11:17:07.895 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.895+0000 7fe125ff88c0 1 < completed multipart upload key=W0B19NBHNLMZ upload=I6ZK4ANQONNK tag=NFGVRVO16OOT type=write size=1067523 2024-09-14T11:17:07.899 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.899+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=2CL97YAGHO4K type=del size=2535044 2024-09-14T11:17:07.903 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.903+0000 7fe125ff88c0 -1 < failed to complete operation key=W0B19NBHNLMZ tag=C3GVRXBZUY80 type=write size=503231: (22) Invalid argument 2024-09-14T11:17:07.907 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.907+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=WWG7S2LGFYYF type=write size=669796 2024-09-14T11:17:07.911 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.911+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~ZK577NZLYUR9.0 size=1048576 2024-09-14T11:17:07.914 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.915+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~ZK577NZLYUR9.1 size=72910 2024-09-14T11:17:07.920 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.919+0000 7fe125ff88c0 1 < completed multipart upload key=21HC4VMHXS6L upload=ZK577NZLYUR9 tag=SSW9HA2GFH5H type=write size=2170062 2024-09-14T11:17:07.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.927+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~8WHWT2X0OBVK.0 size=836848 2024-09-14T11:17:07.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.927+0000 7fe125ff88c0 1 > prepared multipart upload key=3YGN50MBAF41 upload=8WHWT2X0OBVK tag=071GEGXLF09T type=write size=1885424 2024-09-14T11:17:07.930 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.931+0000 7fe125ff88c0 1 < completed delete operation key=0VBX2FWYCFEZ tag=WG4N8B23KDV0 type=del 2024-09-14T11:17:07.937 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.939+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~H3JXVCXJRTHR.0 size=708552 2024-09-14T11:17:07.937 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.939+0000 7fe125ff88c0 1 > prepared multipart upload key=YFRH8WECBTJK upload=H3JXVCXJRTHR tag=CCVBAQBPV1OU type=write size=1757128 2024-09-14T11:17:07.944 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.947+0000 7fe125ff88c0 1 < suggested remove operation key=1ML6RIXI4C5P tag=5V5Q4YHORHPR type=del 2024-09-14T11:17:07.948 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.947+0000 7fe125ff88c0 1 > prepared operation key=0FITHLGQKQEC tag=L2AP3GSMWRJJ type=del size=815517 2024-09-14T11:17:07.952 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.951+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~1QAE8HYSLE31.0 size=1048576 2024-09-14T11:17:07.955 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.955+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~1QAE8HYSLE31.1 size=1048576 2024-09-14T11:17:07.958 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.959+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~1QAE8HYSLE31.2 size=372905 2024-09-14T11:17:07.964 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.963+0000 7fe125ff88c0 1 < completed multipart upload key=V6B470G93KFT upload=1QAE8HYSLE31 tag=A6TUTEWBS3Z5 type=write size=3518633 2024-09-14T11:17:07.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.971+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~797JCCTZ3OI7.0 size=1048576 2024-09-14T11:17:07.973 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.975+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~797JCCTZ3OI7.1 size=78431 2024-09-14T11:17:07.973 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.975+0000 7fe125ff88c0 1 > prepared multipart upload key=V6B470G93KFT upload=797JCCTZ3OI7 tag=SP8N0CHKIOZH type=write size=2175583 2024-09-14T11:17:07.976 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.975+0000 7fe125ff88c0 1 < completed delete operation key=K05LARTJ2QZ3 tag=X0VY3WO5GD5P type=del 2024-09-14T11:17:07.980 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.979+0000 7fe125ff88c0 1 > prepared operation key=FQ5WT12KB664 tag=PC5KCDGVESNE type=write size=925566 2024-09-14T11:17:07.984 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.983+0000 7fe125ff88c0 1 < completed write operation key=YGEVGH840L18 tag=DY61LYOKCVXO type=write size=722013 2024-09-14T11:17:07.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.987+0000 7fe125ff88c0 1 > prepared operation key=LYBGDNKUROWH tag=70S3JU26Y1PO type=del size=1810791 2024-09-14T11:17:07.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.991+0000 7fe125ff88c0 1 < completed delete operation key=2LH5U05C2F8C tag=3RN1KS0R8USR type=del 2024-09-14T11:17:07.995 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.995+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=CV3IGPN40KG3 type=del size=3149837 2024-09-14T11:17:07.999 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:07.999+0000 7fe125ff88c0 1 < canceled operation key=YN2HI39GPEDF tag=WX9TEM7AZSHZ type=del size=273776 2024-09-14T11:17:08.003 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.003+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=KWGNEJ7MNSVG type=write size=505082 2024-09-14T11:17:08.007 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.007+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~ZC4M44X3I1N6.0 size=1048576 2024-09-14T11:17:08.010 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.011+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~ZC4M44X3I1N6.1 size=1048576 2024-09-14T11:17:08.013 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.015+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~ZC4M44X3I1N6.2 size=596729 2024-09-14T11:17:08.019 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.019+0000 7fe125ff88c0 1 < completed multipart upload key=YN2HI39GPEDF upload=ZC4M44X3I1N6 tag=KAGM800E4ZSS type=write size=3742457 2024-09-14T11:17:08.023 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.023+0000 7fe125ff88c0 1 > prepared operation key=3OU4U9JF3ZD5 tag=MUA2K8S2NLLP type=del size=1666708 2024-09-14T11:17:08.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.027+0000 7fe125ff88c0 -1 < failed to complete operation key=1ML6RIXI4C5P tag=NMKZDD682G09 type=del size=3460605: (22) Invalid argument 2024-09-14T11:17:08.031 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.031+0000 7fe125ff88c0 1 > prepared operation key=1ML6RIXI4C5P tag=J43WIBDH6VMP type=del size=1546555 2024-09-14T11:17:08.035 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.035+0000 7fe125ff88c0 1 < canceled operation key=YCF2PCJ9TZMR tag=2PO52GXQ3NA1 type=write size=58415 2024-09-14T11:17:08.041 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.043+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~D5GCKED3XI86.0 size=1048576 2024-09-14T11:17:08.044 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.043+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~D5GCKED3XI86.1 size=1048576 2024-09-14T11:17:08.047 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.047+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~D5GCKED3XI86.2 size=848012 2024-09-14T11:17:08.047 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.047+0000 7fe125ff88c0 1 > prepared multipart upload key=35EB6U5O4A51 upload=D5GCKED3XI86 tag=9XVPO5HWBSPJ type=write size=3993740 2024-09-14T11:17:08.048 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.047+0000 7fe125ff88c0 1 < canceled part key=_multipart_LYBGDNKUROWH.2~MXAU18VFN2RH.0 size=1048576 2024-09-14T11:17:08.051 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.051+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~MXAU18VFN2RH.1 size=562165 2024-09-14T11:17:08.058 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.059+0000 7fe125ff88c0 1 < canceled multipart upload key=LYBGDNKUROWH upload=MXAU18VFN2RH tag=UCWPMDQVZ92I type=write size=2659317 2024-09-14T11:17:08.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.063+0000 7fe125ff88c0 1 > prepared operation key=1ML6RIXI4C5P tag=3VU0RZWW92IC type=del size=2685119 2024-09-14T11:17:08.065 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.067+0000 7fe125ff88c0 1 < completed delete operation key=21HC4VMHXS6L tag=NO06KZ322RKZ type=del 2024-09-14T11:17:08.069 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.071+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=2HPOAMIA0LU5 type=del size=837208 2024-09-14T11:17:08.073 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.075+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~PAW2NW00T58T.0 size=328923 2024-09-14T11:17:08.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.079+0000 7fe125ff88c0 1 < completed multipart upload key=3YGN50MBAF41 upload=PAW2NW00T58T tag=HKNYAPII2RN7 type=write size=1377499 2024-09-14T11:17:08.086 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.087+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~7D62Y1ZJMLPD.0 size=1048576 2024-09-14T11:17:08.088 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.091+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~7D62Y1ZJMLPD.1 size=626373 2024-09-14T11:17:08.088 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.091+0000 7fe125ff88c0 1 > prepared multipart upload key=4D2X7151977X upload=7D62Y1ZJMLPD tag=P9G5WYGCXYYB type=write size=2723525 2024-09-14T11:17:08.096 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.095+0000 7fe125ff88c0 1 < suggested update operation key=WEA3MQ0DI42N tag=2CL97YAGHO4K type=del size=2535044 2024-09-14T11:17:08.100 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.099+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=0PGBSIMV0U9K type=del size=2032031 2024-09-14T11:17:08.104 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.107+0000 7fe125ff88c0 1 < completed write operation key=6PLUU2QIO9LJ tag=WWG7S2LGFYYF type=write size=669796 2024-09-14T11:17:08.108 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.111+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=J654NV6FLWJZ type=del size=4059623 2024-09-14T11:17:08.112 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.111+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~8WHWT2X0OBVK.0 size=836848 2024-09-14T11:17:08.119 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.119+0000 7fe125ff88c0 1 < completed multipart upload key=3YGN50MBAF41 upload=8WHWT2X0OBVK tag=071GEGXLF09T type=write size=1885424 2024-09-14T11:17:08.126 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.127+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~U8CHCLHIE7RJ.0 size=1048576 2024-09-14T11:17:08.129 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.131+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~U8CHCLHIE7RJ.1 size=854280 2024-09-14T11:17:08.129 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.131+0000 7fe125ff88c0 1 > prepared multipart upload key=F9I82N7RQC81 upload=U8CHCLHIE7RJ tag=IVFR76LNZ632 type=write size=2951432 2024-09-14T11:17:08.135 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.135+0000 7fe125ff88c0 1 < completed part key=_multipart_YFRH8WECBTJK.2~H3JXVCXJRTHR.0 size=708552 2024-09-14T11:17:08.141 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.143+0000 7fe125ff88c0 1 < completed multipart upload key=YFRH8WECBTJK upload=H3JXVCXJRTHR tag=CCVBAQBPV1OU type=write size=1757128 2024-09-14T11:17:08.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.147+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=PDNGXMIL118P type=write size=692555 2024-09-14T11:17:08.148 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.151+0000 7fe125ff88c0 1 < completed delete operation key=0FITHLGQKQEC tag=L2AP3GSMWRJJ type=del 2024-09-14T11:17:08.152 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.151+0000 7fe125ff88c0 1 > prepared operation key=YFRH8WECBTJK tag=0RC9ERA9H8Z9 type=write size=134853 2024-09-14T11:17:08.156 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.155+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~797JCCTZ3OI7.0 size=1048576 2024-09-14T11:17:08.159 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.159+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~797JCCTZ3OI7.1 size=78431 2024-09-14T11:17:08.165 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.167+0000 7fe125ff88c0 1 < completed multipart upload key=V6B470G93KFT upload=797JCCTZ3OI7 tag=SP8N0CHKIOZH type=write size=2175583 2024-09-14T11:17:08.168 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.171+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=13Q1OEY2PZWH type=del size=1397208 2024-09-14T11:17:08.172 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.171+0000 7fe125ff88c0 1 < completed write operation key=FQ5WT12KB664 tag=PC5KCDGVESNE type=write size=925566 2024-09-14T11:17:08.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.179+0000 7fe125ff88c0 1 > prepared operation key=FQ5WT12KB664 tag=QSV1RQBCIA32 type=del size=1899702 2024-09-14T11:17:08.180 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.179+0000 7fe125ff88c0 1 < completed delete operation key=LYBGDNKUROWH tag=70S3JU26Y1PO type=del 2024-09-14T11:17:08.184 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.183+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=RQXW943R1GED type=del size=2617455 2024-09-14T11:17:08.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.187+0000 7fe125ff88c0 1 < completed delete operation key=YGEVGH840L18 tag=CV3IGPN40KG3 type=del 2024-09-14T11:17:08.191 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.191+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=P9ZJ6ZXGW2LM type=del size=741903 2024-09-14T11:17:08.195 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.195+0000 7fe125ff88c0 -1 < failed to complete operation key=WEA3MQ0DI42N tag=KWGNEJ7MNSVG type=write size=505082: (22) Invalid argument 2024-09-14T11:17:08.201 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.203+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~M0JNLFAJEBO5.0 size=1048576 2024-09-14T11:17:08.204 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.203+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~M0JNLFAJEBO5.1 size=283986 2024-09-14T11:17:08.204 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.203+0000 7fe125ff88c0 1 > prepared multipart upload key=4D2X7151977X upload=M0JNLFAJEBO5 tag=GGF3WE2MJL4M type=write size=2381138 2024-09-14T11:17:08.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.207+0000 7fe125ff88c0 1 < completed delete operation key=3OU4U9JF3ZD5 tag=MUA2K8S2NLLP type=del 2024-09-14T11:17:08.211 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.211+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=GYU3G8VV0QE6 type=write size=809342 2024-09-14T11:17:08.215 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.215+0000 7fe125ff88c0 1 < completed delete operation key=1ML6RIXI4C5P tag=J43WIBDH6VMP type=del 2024-09-14T11:17:08.219 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.219+0000 7fe125ff88c0 1 > prepared operation key=0FITHLGQKQEC tag=CFZI58TWJE95 type=del size=3902788 2024-09-14T11:17:08.223 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.223+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~D5GCKED3XI86.0 size=1048576 2024-09-14T11:17:08.225 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.227+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~D5GCKED3XI86.1 size=1048576 2024-09-14T11:17:08.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.231+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~D5GCKED3XI86.2 size=848012 2024-09-14T11:17:08.234 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.235+0000 7fe125ff88c0 1 < completed multipart upload key=35EB6U5O4A51 upload=D5GCKED3XI86 tag=9XVPO5HWBSPJ type=write size=3993740 2024-09-14T11:17:08.238 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.239+0000 7fe125ff88c0 1 > prepared operation key=FQ5WT12KB664 tag=M5R0VZV4TP1H type=del size=3634279 2024-09-14T11:17:08.242 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.243+0000 7fe125ff88c0 1 < completed delete operation key=1ML6RIXI4C5P tag=3VU0RZWW92IC type=del 2024-09-14T11:17:08.248 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.251+0000 7fe125ff88c0 1 > prepared part key=_multipart_6PLUU2QIO9LJ.2~L7MA5WEE18S3.0 size=340734 2024-09-14T11:17:08.249 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.251+0000 7fe125ff88c0 1 > prepared multipart upload key=6PLUU2QIO9LJ upload=L7MA5WEE18S3 tag=0TFTXZZ6JSSW type=write size=1389310 2024-09-14T11:17:08.256 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.255+0000 7fe125ff88c0 1 < suggested remove operation key=YGEVGH840L18 tag=2HPOAMIA0LU5 type=del 2024-09-14T11:17:08.259 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.259+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=084Z3X46C1UU type=write size=222211 2024-09-14T11:17:08.263 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.263+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~7D62Y1ZJMLPD.0 size=1048576 2024-09-14T11:17:08.266 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.267+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~7D62Y1ZJMLPD.1 size=626373 2024-09-14T11:17:08.272 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.271+0000 7fe125ff88c0 1 < completed multipart upload key=4D2X7151977X upload=7D62Y1ZJMLPD tag=P9G5WYGCXYYB type=write size=2723525 2024-09-14T11:17:08.278 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.279+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~8AEMZ10GY5F7.0 size=194785 2024-09-14T11:17:08.278 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.279+0000 7fe125ff88c0 1 > prepared multipart upload key=YCF2PCJ9TZMR upload=8AEMZ10GY5F7 tag=ZGJRJ7BFJNH1 type=write size=1243361 2024-09-14T11:17:08.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.283+0000 7fe125ff88c0 1 < completed delete operation key=L4XO0WTYKNXY tag=0PGBSIMV0U9K type=del 2024-09-14T11:17:08.285 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.287+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=65KSLFTXBC3S type=del size=2703045 2024-09-14T11:17:08.293 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.295+0000 7fe125ff88c0 1 < suggested remove operation key=K3P6U6NU8I01 tag=J654NV6FLWJZ type=del 2024-09-14T11:17:08.296 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.295+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=EVM3VKCNZSRC type=del size=3642538 2024-09-14T11:17:08.299 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.299+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~U8CHCLHIE7RJ.0 size=1048576 2024-09-14T11:17:08.302 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.303+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~U8CHCLHIE7RJ.1 size=854280 2024-09-14T11:17:08.308 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.311+0000 7fe125ff88c0 1 < completed multipart upload key=F9I82N7RQC81 upload=U8CHCLHIE7RJ tag=IVFR76LNZ632 type=write size=2951432 2024-09-14T11:17:08.312 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.315+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=8690IMU61L9Q type=write size=946453 2024-09-14T11:17:08.320 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.319+0000 7fe125ff88c0 1 < suggested update operation key=F9I82N7RQC81 tag=PDNGXMIL118P type=write size=692555 2024-09-14T11:17:08.327 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.327+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~3JAUHTFUT403.0 size=1048576 2024-09-14T11:17:08.331 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.331+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~3JAUHTFUT403.1 size=293306 2024-09-14T11:17:08.331 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.331+0000 7fe125ff88c0 1 > prepared multipart upload key=35EB6U5O4A51 upload=3JAUHTFUT403 tag=B6EBXQED2MY2 type=write size=2390458 2024-09-14T11:17:08.335 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.335+0000 7fe125ff88c0 1 < canceled operation key=YFRH8WECBTJK tag=0RC9ERA9H8Z9 type=write size=134853 2024-09-14T11:17:08.339 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.339+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=IHNS1G5MLIFM type=del size=3519583 2024-09-14T11:17:08.343 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.343+0000 7fe125ff88c0 1 < completed delete operation key=2KEKSWK0UT6C tag=13Q1OEY2PZWH type=del 2024-09-14T11:17:08.347 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.347+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=GPNZ1VYUX5CH type=del size=226402 2024-09-14T11:17:08.351 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.351+0000 7fe125ff88c0 1 < completed delete operation key=FQ5WT12KB664 tag=QSV1RQBCIA32 type=del 2024-09-14T11:17:08.358 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.359+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~369GZ80NS474.0 size=1048576 2024-09-14T11:17:08.361 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.363+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~369GZ80NS474.1 size=1048576 2024-09-14T11:17:08.364 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.363+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~369GZ80NS474.2 size=294948 2024-09-14T11:17:08.364 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.363+0000 7fe125ff88c0 1 > prepared multipart upload key=1ML6RIXI4C5P upload=369GZ80NS474 tag=451MNC73U4N8 type=write size=3440676 2024-09-14T11:17:08.371 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.371+0000 7fe125ff88c0 1 < suggested remove operation key=F9I82N7RQC81 tag=RQXW943R1GED type=del 2024-09-14T11:17:08.375 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.375+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=4QE662M2DNPB type=write size=701062 2024-09-14T11:17:08.379 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.379+0000 7fe125ff88c0 1 < completed delete operation key=YN2HI39GPEDF tag=P9ZJ6ZXGW2LM type=del 2024-09-14T11:17:08.383 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.383+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=1LSTTHTWYPYB type=del size=3879485 2024-09-14T11:17:08.387 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.387+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~M0JNLFAJEBO5.0 size=1048576 2024-09-14T11:17:08.390 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.391+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~M0JNLFAJEBO5.1 size=283986 2024-09-14T11:17:08.396 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.395+0000 7fe125ff88c0 1 < completed multipart upload key=4D2X7151977X upload=M0JNLFAJEBO5 tag=GGF3WE2MJL4M type=write size=2381138 2024-09-14T11:17:08.400 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.399+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=JQ3KVP758VRE type=del size=3517794 2024-09-14T11:17:08.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.403+0000 7fe125ff88c0 1 < completed write operation key=21HC4VMHXS6L tag=GYU3G8VV0QE6 type=write size=809342 2024-09-14T11:17:08.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.407+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=H7KBXSX4W1NE type=del size=849369 2024-09-14T11:17:08.413 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.415+0000 7fe125ff88c0 1 < completed delete operation key=0FITHLGQKQEC tag=CFZI58TWJE95 type=del 2024-09-14T11:17:08.416 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.419+0000 7fe125ff88c0 1 > prepared operation key=N80X3YUF4OEL tag=4PSR0J24YFQJ type=del size=2102725 2024-09-14T11:17:08.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.423+0000 7fe125ff88c0 1 < completed delete operation key=FQ5WT12KB664 tag=M5R0VZV4TP1H type=del 2024-09-14T11:17:08.427 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.427+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~BAOEKIUF08II.0 size=1048576 2024-09-14T11:17:08.430 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.431+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~BAOEKIUF08II.1 size=1048576 2024-09-14T11:17:08.432 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.435+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~BAOEKIUF08II.2 size=121235 2024-09-14T11:17:08.432 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.435+0000 7fe125ff88c0 1 > prepared multipart upload key=1ML6RIXI4C5P upload=BAOEKIUF08II tag=XCEB8TP340SO type=write size=3266963 2024-09-14T11:17:08.436 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.439+0000 7fe125ff88c0 1 < completed part key=_multipart_6PLUU2QIO9LJ.2~L7MA5WEE18S3.0 size=340734 2024-09-14T11:17:08.442 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.443+0000 7fe125ff88c0 1 < completed multipart upload key=6PLUU2QIO9LJ upload=L7MA5WEE18S3 tag=0TFTXZZ6JSSW type=write size=1389310 2024-09-14T11:17:08.446 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.447+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=112WMYIBX78A type=del size=1146647 2024-09-14T11:17:08.450 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.451+0000 7fe125ff88c0 1 < completed write operation key=SSNV25PDLDIS tag=084Z3X46C1UU type=write size=222211 2024-09-14T11:17:08.454 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.455+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=3KBYKXW5MCE0 type=write size=792998 2024-09-14T11:17:08.458 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.459+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~8AEMZ10GY5F7.0 size=194785 2024-09-14T11:17:08.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.463+0000 7fe125ff88c0 1 < completed multipart upload key=YCF2PCJ9TZMR upload=8AEMZ10GY5F7 tag=ZGJRJ7BFJNH1 type=write size=1243361 2024-09-14T11:17:08.468 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.467+0000 7fe125ff88c0 1 > prepared operation key=3YGN50MBAF41 tag=8SV0R2231VZU type=write size=717989 2024-09-14T11:17:08.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.471+0000 7fe125ff88c0 1 < completed delete operation key=YN2HI39GPEDF tag=65KSLFTXBC3S type=del 2024-09-14T11:17:08.478 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.479+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~24YTPTXP0ULW.0 size=1048576 2024-09-14T11:17:08.481 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.483+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~24YTPTXP0ULW.1 size=1048576 2024-09-14T11:17:08.487 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.487+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~24YTPTXP0ULW.2 size=771653 2024-09-14T11:17:08.487 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.487+0000 7fe125ff88c0 1 > prepared multipart upload key=YFRH8WECBTJK upload=24YTPTXP0ULW tag=7WX0W2E03P5I type=write size=3917381 2024-09-14T11:17:08.491 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.491+0000 7fe125ff88c0 1 < completed delete operation key=0VBX2FWYCFEZ tag=EVM3VKCNZSRC type=del 2024-09-14T11:17:08.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.495+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=MMN0X975UOSH type=del size=3207366 2024-09-14T11:17:08.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.503+0000 7fe125ff88c0 1 < suggested update operation key=F9I82N7RQC81 tag=8690IMU61L9Q type=write size=946453 2024-09-14T11:17:08.506 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.507+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=KGOHBQCFPIMW type=del size=2296286 2024-09-14T11:17:08.510 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.511+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~3JAUHTFUT403.0 size=1048576 2024-09-14T11:17:08.513 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.515+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~3JAUHTFUT403.1 size=293306 2024-09-14T11:17:08.518 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.519+0000 7fe125ff88c0 1 < completed multipart upload key=35EB6U5O4A51 upload=3JAUHTFUT403 tag=B6EBXQED2MY2 type=write size=2390458 2024-09-14T11:17:08.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.523+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=TRQOL9JKAX56 type=del size=1326366 2024-09-14T11:17:08.526 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.527+0000 7fe125ff88c0 1 < completed delete operation key=6PLUU2QIO9LJ tag=IHNS1G5MLIFM type=del 2024-09-14T11:17:08.529 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.531+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=HSNGC0UDHWWY type=write size=687545 2024-09-14T11:17:08.533 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.535+0000 7fe125ff88c0 1 < completed delete operation key=0VBX2FWYCFEZ tag=GPNZ1VYUX5CH type=del 2024-09-14T11:17:08.539 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.539+0000 7fe125ff88c0 1 > prepared part key=_multipart_2KEKSWK0UT6C.2~TP17FLRBVFQE.0 size=1048576 2024-09-14T11:17:08.542 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.543+0000 7fe125ff88c0 1 > prepared part key=_multipart_2KEKSWK0UT6C.2~TP17FLRBVFQE.1 size=281663 2024-09-14T11:17:08.542 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.543+0000 7fe125ff88c0 1 > prepared multipart upload key=2KEKSWK0UT6C upload=TP17FLRBVFQE tag=2C7IHEOJJACP type=write size=2378815 2024-09-14T11:17:08.546 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.547+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~369GZ80NS474.0 size=1048576 2024-09-14T11:17:08.549 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.551+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~369GZ80NS474.1 size=1048576 2024-09-14T11:17:08.552 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.551+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~369GZ80NS474.2 size=294948 2024-09-14T11:17:08.558 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.559+0000 7fe125ff88c0 1 < completed multipart upload key=1ML6RIXI4C5P upload=369GZ80NS474 tag=451MNC73U4N8 type=write size=3440676 2024-09-14T11:17:08.565 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.567+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~BQ3H0MBWI2O4.0 size=114883 2024-09-14T11:17:08.565 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.567+0000 7fe125ff88c0 1 > prepared multipart upload key=2UXA6SXDTUFT upload=BQ3H0MBWI2O4 tag=NEOX8GORINS6 type=write size=1163459 2024-09-14T11:17:08.569 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.571+0000 7fe125ff88c0 1 < completed write operation key=2LH5U05C2F8C tag=4QE662M2DNPB type=write size=701062 2024-09-14T11:17:08.576 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.575+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~HW2XTIIIZ3RA.0 size=1048576 2024-09-14T11:17:08.579 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.579+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~HW2XTIIIZ3RA.1 size=1048576 2024-09-14T11:17:08.583 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.583+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~HW2XTIIIZ3RA.2 size=697718 2024-09-14T11:17:08.583 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.583+0000 7fe125ff88c0 1 > prepared multipart upload key=46ZTDBWFVSUH upload=HW2XTIIIZ3RA tag=S9EIYXFVYOMV type=write size=3843446 2024-09-14T11:17:08.587 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.587+0000 7fe125ff88c0 -1 < failed to complete operation key=F9I82N7RQC81 tag=1LSTTHTWYPYB type=del size=3879485: (22) Invalid argument 2024-09-14T11:17:08.592 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.595+0000 7fe125ff88c0 1 > prepared operation key=N80X3YUF4OEL tag=LL282V5VORYR type=del size=1970167 2024-09-14T11:17:08.600 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.599+0000 7fe125ff88c0 1 < suggested remove operation key=YCF2PCJ9TZMR tag=JQ3KVP758VRE type=del 2024-09-14T11:17:08.604 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.603+0000 7fe125ff88c0 1 > prepared operation key=LYBGDNKUROWH tag=10C7FWBTHZGY type=del size=1711530 2024-09-14T11:17:08.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.607+0000 7fe125ff88c0 1 < completed delete operation key=W0B19NBHNLMZ tag=H7KBXSX4W1NE type=del 2024-09-14T11:17:08.614 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.615+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~EG1XOGR4KZOQ.0 size=329781 2024-09-14T11:17:08.615 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.615+0000 7fe125ff88c0 1 > prepared multipart upload key=2LH5U05C2F8C upload=EG1XOGR4KZOQ tag=Q9KMTUSTUND6 type=write size=1378357 2024-09-14T11:17:08.618 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.619+0000 7fe125ff88c0 1 < completed delete operation key=N80X3YUF4OEL tag=4PSR0J24YFQJ type=del 2024-09-14T11:17:08.622 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.623+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=QHG1F5TJ3UC6 type=del size=1207422 2024-09-14T11:17:08.626 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.627+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~BAOEKIUF08II.0 size=1048576 2024-09-14T11:17:08.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.631+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~BAOEKIUF08II.1 size=1048576 2024-09-14T11:17:08.632 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.631+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~BAOEKIUF08II.2 size=121235 2024-09-14T11:17:08.638 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.639+0000 7fe125ff88c0 1 < completed multipart upload key=1ML6RIXI4C5P upload=BAOEKIUF08II tag=XCEB8TP340SO type=write size=3266963 2024-09-14T11:17:08.645 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.647+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~PPAC0PAM8UYY.0 size=1048576 2024-09-14T11:17:08.648 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.651+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~PPAC0PAM8UYY.1 size=837932 2024-09-14T11:17:08.648 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.651+0000 7fe125ff88c0 1 > prepared multipart upload key=SUCH37O8V1LY upload=PPAC0PAM8UYY tag=8QZ32OAY22H1 type=write size=2935084 2024-09-14T11:17:08.651 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.651+0000 7fe125ff88c0 -1 < no bi entry to suggest for operation key=YCF2PCJ9TZMR tag=112WMYIBX78A type=del size=1146647: (2) No such file or directory 2024-09-14T11:17:08.657 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.659+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~20AJ67E1DZU8.0 size=1048576 2024-09-14T11:17:08.661 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.663+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~20AJ67E1DZU8.1 size=436534 2024-09-14T11:17:08.661 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.663+0000 7fe125ff88c0 1 > prepared multipart upload key=21HC4VMHXS6L upload=20AJ67E1DZU8 tag=F8W5V9TF2O16 type=write size=2533686 2024-09-14T11:17:08.664 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.667+0000 7fe125ff88c0 1 < completed write operation key=V6B470G93KFT tag=3KBYKXW5MCE0 type=write size=792998 2024-09-14T11:17:08.671 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.671+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~DZAUA4UY944L.0 size=272264 2024-09-14T11:17:08.671 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.671+0000 7fe125ff88c0 1 > prepared multipart upload key=YGEVGH840L18 upload=DZAUA4UY944L tag=C1LZSZ3LTKTE type=write size=1320840 2024-09-14T11:17:08.675 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.675+0000 7fe125ff88c0 1 < completed write operation key=3YGN50MBAF41 tag=8SV0R2231VZU type=write size=717989 2024-09-14T11:17:08.682 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.683+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~MAAVTREW5AET.0 size=1048576 2024-09-14T11:17:08.685 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.687+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~MAAVTREW5AET.1 size=1048576 2024-09-14T11:17:08.687 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.687+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~MAAVTREW5AET.2 size=223699 2024-09-14T11:17:08.688 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.687+0000 7fe125ff88c0 1 > prepared multipart upload key=V6B470G93KFT upload=MAAVTREW5AET tag=9R4XFSKL0YM8 type=write size=3369427 2024-09-14T11:17:08.691 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.691+0000 7fe125ff88c0 1 < completed part key=_multipart_YFRH8WECBTJK.2~24YTPTXP0ULW.0 size=1048576 2024-09-14T11:17:08.694 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.695+0000 7fe125ff88c0 1 < completed part key=_multipart_YFRH8WECBTJK.2~24YTPTXP0ULW.1 size=1048576 2024-09-14T11:17:08.697 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.699+0000 7fe125ff88c0 1 < completed part key=_multipart_YFRH8WECBTJK.2~24YTPTXP0ULW.2 size=771653 2024-09-14T11:17:08.704 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.703+0000 7fe125ff88c0 1 < completed multipart upload key=YFRH8WECBTJK upload=24YTPTXP0ULW tag=7WX0W2E03P5I type=write size=3917381 2024-09-14T11:17:08.708 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.711+0000 7fe125ff88c0 1 > prepared operation key=46ZTDBWFVSUH tag=LEBPICGB045N type=write size=728200 2024-09-14T11:17:08.716 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.715+0000 7fe125ff88c0 1 < suggested remove operation key=4D2X7151977X tag=MMN0X975UOSH type=del 2024-09-14T11:17:08.720 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.719+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=RMF5AUP1W3KK type=del size=1117465 2024-09-14T11:17:08.724 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.723+0000 7fe125ff88c0 1 < canceled operation key=35EB6U5O4A51 tag=KGOHBQCFPIMW type=del size=2296286 2024-09-14T11:17:08.730 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.731+0000 7fe125ff88c0 1 > prepared part key=_multipart_2KEKSWK0UT6C.2~0YZVEMWL8YD7.0 size=1048576 2024-09-14T11:17:08.733 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.735+0000 7fe125ff88c0 1 > prepared part key=_multipart_2KEKSWK0UT6C.2~0YZVEMWL8YD7.1 size=1048576 2024-09-14T11:17:08.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.735+0000 7fe125ff88c0 1 > prepared part key=_multipart_2KEKSWK0UT6C.2~0YZVEMWL8YD7.2 size=802644 2024-09-14T11:17:08.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.735+0000 7fe125ff88c0 1 > prepared multipart upload key=2KEKSWK0UT6C upload=0YZVEMWL8YD7 tag=R2SH3BPSRAEI type=write size=3948372 2024-09-14T11:17:08.740 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.739+0000 7fe125ff88c0 1 < completed delete operation key=W0B19NBHNLMZ tag=TRQOL9JKAX56 type=del 2024-09-14T11:17:08.747 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.747+0000 7fe125ff88c0 1 > prepared part key=_multipart_N94D3R7IOBNL.2~1MQKD92Q07WT.0 size=1048576 2024-09-14T11:17:08.750 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.751+0000 7fe125ff88c0 1 > prepared part key=_multipart_N94D3R7IOBNL.2~1MQKD92Q07WT.1 size=704981 2024-09-14T11:17:08.750 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.751+0000 7fe125ff88c0 1 > prepared multipart upload key=N94D3R7IOBNL upload=1MQKD92Q07WT tag=RZYS6TJ71XS0 type=write size=2802133 2024-09-14T11:17:08.755 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.755+0000 7fe125ff88c0 1 < completed write operation key=21HC4VMHXS6L tag=HSNGC0UDHWWY type=write size=687545 2024-09-14T11:17:08.759 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.759+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=I3N0R02K261Z type=del size=4169322 2024-09-14T11:17:08.762 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.763+0000 7fe125ff88c0 1 < completed part key=_multipart_2KEKSWK0UT6C.2~TP17FLRBVFQE.0 size=1048576 2024-09-14T11:17:08.766 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.767+0000 7fe125ff88c0 1 < completed part key=_multipart_2KEKSWK0UT6C.2~TP17FLRBVFQE.1 size=281663 2024-09-14T11:17:08.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.775+0000 7fe125ff88c0 1 < completed multipart upload key=2KEKSWK0UT6C upload=TP17FLRBVFQE tag=2C7IHEOJJACP type=write size=2378815 2024-09-14T11:17:08.779 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.779+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~VZDKN84FZTP7.0 size=59948 2024-09-14T11:17:08.779 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.779+0000 7fe125ff88c0 1 > prepared multipart upload key=LYBGDNKUROWH upload=VZDKN84FZTP7 tag=SJYRVFGOBKP4 type=write size=1108524 2024-09-14T11:17:08.783 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.783+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~BQ3H0MBWI2O4.0 size=114883 2024-09-14T11:17:08.789 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.791+0000 7fe125ff88c0 1 < completed multipart upload key=2UXA6SXDTUFT upload=BQ3H0MBWI2O4 tag=NEOX8GORINS6 type=write size=1163459 2024-09-14T11:17:08.796 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.795+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~3D7FYJHJAQ84.0 size=1048576 2024-09-14T11:17:08.799 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.799+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~3D7FYJHJAQ84.1 size=525606 2024-09-14T11:17:08.799 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.799+0000 7fe125ff88c0 1 > prepared multipart upload key=FQ5WT12KB664 upload=3D7FYJHJAQ84 tag=5CV5NJH3ZY40 type=write size=2622758 2024-09-14T11:17:08.803 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.803+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~HW2XTIIIZ3RA.0 size=1048576 2024-09-14T11:17:08.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.807+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~HW2XTIIIZ3RA.1 size=1048576 2024-09-14T11:17:08.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.807+0000 7fe125ff88c0 1 < canceled part key=_multipart_46ZTDBWFVSUH.2~HW2XTIIIZ3RA.2 size=697718 2024-09-14T11:17:08.812 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.811+0000 7fe125ff88c0 1 < canceled multipart upload key=46ZTDBWFVSUH upload=HW2XTIIIZ3RA tag=S9EIYXFVYOMV type=write size=3843446 2024-09-14T11:17:08.816 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.815+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=2DXP3O3LANV3 type=write size=917965 2024-09-14T11:17:08.824 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.827+0000 7fe125ff88c0 1 < suggested update operation key=N80X3YUF4OEL tag=LL282V5VORYR type=del size=1970167 2024-09-14T11:17:08.833 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.835+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~XB4QRU26TARB.0 size=1048576 2024-09-14T11:17:08.836 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.835+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~XB4QRU26TARB.1 size=1048576 2024-09-14T11:17:08.842 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.843+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~XB4QRU26TARB.2 size=341925 2024-09-14T11:17:08.842 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.843+0000 7fe125ff88c0 1 > prepared multipart upload key=YGEVGH840L18 upload=XB4QRU26TARB tag=19Y6JACDS9AJ type=write size=3487653 2024-09-14T11:17:08.846 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.847+0000 7fe125ff88c0 1 < canceled operation key=LYBGDNKUROWH tag=10C7FWBTHZGY type=del size=1711530 2024-09-14T11:17:08.850 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.851+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=8508C4WJCRZ3 type=del size=2640548 2024-09-14T11:17:08.854 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.855+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~EG1XOGR4KZOQ.0 size=329781 2024-09-14T11:17:08.860 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.863+0000 7fe125ff88c0 1 < completed multipart upload key=2LH5U05C2F8C upload=EG1XOGR4KZOQ tag=Q9KMTUSTUND6 type=write size=1378357 2024-09-14T11:17:08.868 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.867+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~WIO58OJ89SVG.0 size=1048576 2024-09-14T11:17:08.871 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.871+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~WIO58OJ89SVG.1 size=550696 2024-09-14T11:17:08.872 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.871+0000 7fe125ff88c0 1 > prepared multipart upload key=K3P6U6NU8I01 upload=WIO58OJ89SVG tag=05O77CVF9B1O type=write size=2647848 2024-09-14T11:17:08.875 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.875+0000 7fe125ff88c0 1 < completed delete operation key=L4XO0WTYKNXY tag=QHG1F5TJ3UC6 type=del 2024-09-14T11:17:08.879 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.879+0000 7fe125ff88c0 1 > prepared operation key=0FITHLGQKQEC tag=8JV784VOLCLJ type=del size=631013 2024-09-14T11:17:08.883 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.883+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~PPAC0PAM8UYY.0 size=1048576 2024-09-14T11:17:08.886 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.887+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~PPAC0PAM8UYY.1 size=837932 2024-09-14T11:17:08.893 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.895+0000 7fe125ff88c0 1 < completed multipart upload key=SUCH37O8V1LY upload=PPAC0PAM8UYY tag=8QZ32OAY22H1 type=write size=2935084 2024-09-14T11:17:08.900 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.899+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~82YDIHUBYNH4.0 size=156112 2024-09-14T11:17:08.900 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.899+0000 7fe125ff88c0 1 > prepared multipart upload key=YGEVGH840L18 upload=82YDIHUBYNH4 tag=P3KW5XKPY2KX type=write size=1204688 2024-09-14T11:17:08.903 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.903+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~20AJ67E1DZU8.0 size=1048576 2024-09-14T11:17:08.903 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.903+0000 7fe125ff88c0 1 < canceled part key=_multipart_21HC4VMHXS6L.2~20AJ67E1DZU8.1 size=436534 2024-09-14T11:17:08.909 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.911+0000 7fe125ff88c0 1 < canceled multipart upload key=21HC4VMHXS6L upload=20AJ67E1DZU8 tag=F8W5V9TF2O16 type=write size=2533686 2024-09-14T11:17:08.916 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.915+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~KVTKNEM0UXKY.0 size=1048576 2024-09-14T11:17:08.919 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.919+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~KVTKNEM0UXKY.1 size=204200 2024-09-14T11:17:08.919 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.919+0000 7fe125ff88c0 1 > prepared multipart upload key=0FITHLGQKQEC upload=KVTKNEM0UXKY tag=7R845DLXE1CB type=write size=2301352 2024-09-14T11:17:08.923 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.923+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~DZAUA4UY944L.0 size=272264 2024-09-14T11:17:08.929 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.931+0000 7fe125ff88c0 1 < completed multipart upload key=YGEVGH840L18 upload=DZAUA4UY944L tag=C1LZSZ3LTKTE type=write size=1320840 2024-09-14T11:17:08.933 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.935+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=7622XRCSWY5C type=del size=2102958 2024-09-14T11:17:08.936 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.939+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~MAAVTREW5AET.0 size=1048576 2024-09-14T11:17:08.939 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.939+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~MAAVTREW5AET.1 size=1048576 2024-09-14T11:17:08.940 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.939+0000 7fe125ff88c0 1 < canceled part key=_multipart_V6B470G93KFT.2~MAAVTREW5AET.2 size=223699 2024-09-14T11:17:08.945 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.947+0000 7fe125ff88c0 1 < canceled multipart upload key=V6B470G93KFT upload=MAAVTREW5AET tag=9R4XFSKL0YM8 type=write size=3369427 2024-09-14T11:17:08.949 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.951+0000 7fe125ff88c0 1 > prepared operation key=SUCH37O8V1LY tag=ZX51T7SVSEA8 type=del size=1281303 2024-09-14T11:17:08.957 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.959+0000 7fe125ff88c0 1 < suggested remove operation key=46ZTDBWFVSUH tag=LEBPICGB045N type=write 2024-09-14T11:17:08.964 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.963+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~4REC2DO117X0.0 size=1048576 2024-09-14T11:17:08.967 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.967+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~4REC2DO117X0.1 size=1048576 2024-09-14T11:17:08.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.971+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~4REC2DO117X0.2 size=540394 2024-09-14T11:17:08.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.971+0000 7fe125ff88c0 1 > prepared multipart upload key=1ML6RIXI4C5P upload=4REC2DO117X0 tag=EYALEKTYXYR2 type=write size=3686122 2024-09-14T11:17:08.974 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.975+0000 7fe125ff88c0 1 < completed delete operation key=2KEKSWK0UT6C tag=RMF5AUP1W3KK type=del 2024-09-14T11:17:08.978 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.979+0000 7fe125ff88c0 1 > prepared operation key=K05LARTJ2QZ3 tag=MSN21BD13C7T type=del size=2970350 2024-09-14T11:17:08.982 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.983+0000 7fe125ff88c0 1 < completed part key=_multipart_2KEKSWK0UT6C.2~0YZVEMWL8YD7.0 size=1048576 2024-09-14T11:17:08.985 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.987+0000 7fe125ff88c0 1 < completed part key=_multipart_2KEKSWK0UT6C.2~0YZVEMWL8YD7.1 size=1048576 2024-09-14T11:17:08.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.987+0000 7fe125ff88c0 1 < completed part key=_multipart_2KEKSWK0UT6C.2~0YZVEMWL8YD7.2 size=802644 2024-09-14T11:17:08.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.995+0000 7fe125ff88c0 1 < completed multipart upload key=2KEKSWK0UT6C upload=0YZVEMWL8YD7 tag=R2SH3BPSRAEI type=write size=3948372 2024-09-14T11:17:08.997 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:08.999+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=T271N0YTQD8V type=del size=3733572 2024-09-14T11:17:09.001 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.003+0000 7fe125ff88c0 1 < completed part key=_multipart_N94D3R7IOBNL.2~1MQKD92Q07WT.0 size=1048576 2024-09-14T11:17:09.004 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.003+0000 7fe125ff88c0 1 < completed part key=_multipart_N94D3R7IOBNL.2~1MQKD92Q07WT.1 size=704981 2024-09-14T11:17:09.009 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.011+0000 7fe125ff88c0 1 < completed multipart upload key=N94D3R7IOBNL upload=1MQKD92Q07WT tag=RZYS6TJ71XS0 type=write size=2802133 2024-09-14T11:17:09.016 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.015+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~5QIKWGFFBGZ8.0 size=1048576 2024-09-14T11:17:09.018 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.019+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~5QIKWGFFBGZ8.1 size=1048576 2024-09-14T11:17:09.021 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.023+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~5QIKWGFFBGZ8.2 size=715158 2024-09-14T11:17:09.021 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.023+0000 7fe125ff88c0 1 > prepared multipart upload key=W0B19NBHNLMZ upload=5QIKWGFFBGZ8 tag=LFGZWZVHNX5L type=write size=3860886 2024-09-14T11:17:09.025 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.027+0000 7fe125ff88c0 1 < completed delete operation key=L4XO0WTYKNXY tag=I3N0R02K261Z type=del 2024-09-14T11:17:09.032 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.031+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~87OVLFU24J1D.0 size=1039215 2024-09-14T11:17:09.032 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.031+0000 7fe125ff88c0 1 > prepared multipart upload key=YFRH8WECBTJK upload=87OVLFU24J1D tag=JWY9RKLA4QDQ type=write size=2087791 2024-09-14T11:17:09.035 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.035+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~VZDKN84FZTP7.0 size=59948 2024-09-14T11:17:09.041 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.043+0000 7fe125ff88c0 1 < completed multipart upload key=LYBGDNKUROWH upload=VZDKN84FZTP7 tag=SJYRVFGOBKP4 type=write size=1108524 2024-09-14T11:17:09.045 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.047+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=B55QQ28RCUD6 type=del size=988648 2024-09-14T11:17:09.050 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.051+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~3D7FYJHJAQ84.0 size=1048576 2024-09-14T11:17:09.053 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.055+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~3D7FYJHJAQ84.1 size=525606 2024-09-14T11:17:09.059 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.059+0000 7fe125ff88c0 1 < completed multipart upload key=FQ5WT12KB664 upload=3D7FYJHJAQ84 tag=5CV5NJH3ZY40 type=write size=2622758 2024-09-14T11:17:09.063 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.063+0000 7fe125ff88c0 1 > prepared operation key=N80X3YUF4OEL tag=8XKF2QN23ZTI type=write size=650168 2024-09-14T11:17:09.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.071+0000 7fe125ff88c0 1 < suggested update operation key=YCF2PCJ9TZMR tag=2DXP3O3LANV3 type=write size=917965 2024-09-14T11:17:09.078 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.079+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~4GR5NVCEYVDC.0 size=418236 2024-09-14T11:17:09.078 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.079+0000 7fe125ff88c0 1 > prepared multipart upload key=21HC4VMHXS6L upload=4GR5NVCEYVDC tag=VCMUN9CJHCNN type=write size=1466812 2024-09-14T11:17:09.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.083+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~XB4QRU26TARB.0 size=1048576 2024-09-14T11:17:09.086 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.087+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~XB4QRU26TARB.1 size=1048576 2024-09-14T11:17:09.089 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.091+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~XB4QRU26TARB.2 size=341925 2024-09-14T11:17:09.095 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.095+0000 7fe125ff88c0 1 < completed multipart upload key=YGEVGH840L18 upload=XB4QRU26TARB tag=19Y6JACDS9AJ type=write size=3487653 2024-09-14T11:17:09.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.099+0000 7fe125ff88c0 1 > prepared operation key=3YGN50MBAF41 tag=IDBZB6J0K31G type=del size=1374613 2024-09-14T11:17:09.102 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.103+0000 7fe125ff88c0 1 < completed delete operation key=SSNV25PDLDIS tag=8508C4WJCRZ3 type=del 2024-09-14T11:17:09.109 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.111+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~50J4EQC1X2TE.0 size=1048576 2024-09-14T11:17:09.112 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.111+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~50J4EQC1X2TE.1 size=1048576 2024-09-14T11:17:09.115 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.115+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~50J4EQC1X2TE.2 size=39497 2024-09-14T11:17:09.115 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.115+0000 7fe125ff88c0 1 > prepared multipart upload key=0VBX2FWYCFEZ upload=50J4EQC1X2TE tag=A0GHUZ70K1HN type=write size=3185225 2024-09-14T11:17:09.119 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.119+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~WIO58OJ89SVG.0 size=1048576 2024-09-14T11:17:09.122 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.123+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~WIO58OJ89SVG.1 size=550696 2024-09-14T11:17:09.128 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.127+0000 7fe125ff88c0 1 < completed multipart upload key=K3P6U6NU8I01 upload=WIO58OJ89SVG tag=05O77CVF9B1O type=write size=2647848 2024-09-14T11:17:09.136 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.135+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~3990ZSY3IRYD.0 size=1048576 2024-09-14T11:17:09.138 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.139+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~3990ZSY3IRYD.1 size=1048576 2024-09-14T11:17:09.141 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.143+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~3990ZSY3IRYD.2 size=390888 2024-09-14T11:17:09.141 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.143+0000 7fe125ff88c0 1 > prepared multipart upload key=SUCH37O8V1LY upload=3990ZSY3IRYD tag=PAX87Y2YT9QT type=write size=3536616 2024-09-14T11:17:09.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.147+0000 7fe125ff88c0 1 < completed delete operation key=0FITHLGQKQEC tag=8JV784VOLCLJ type=del 2024-09-14T11:17:09.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.151+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~ODEQ0UK6FWQ2.0 size=1048576 2024-09-14T11:17:09.154 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.155+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~ODEQ0UK6FWQ2.1 size=1048576 2024-09-14T11:17:09.157 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.159+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~ODEQ0UK6FWQ2.2 size=257205 2024-09-14T11:17:09.157 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.159+0000 7fe125ff88c0 1 > prepared multipart upload key=2LH5U05C2F8C upload=ODEQ0UK6FWQ2 tag=I5O1BGVQBBH9 type=write size=3402933 2024-09-14T11:17:09.162 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.163+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~82YDIHUBYNH4.0 size=156112 2024-09-14T11:17:09.168 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.167+0000 7fe125ff88c0 1 < completed multipart upload key=YGEVGH840L18 upload=82YDIHUBYNH4 tag=P3KW5XKPY2KX type=write size=1204688 2024-09-14T11:17:09.172 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.171+0000 7fe125ff88c0 1 > prepared operation key=3YGN50MBAF41 tag=RHSJ2V6H7SHL type=del size=2551320 2024-09-14T11:17:09.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.175+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~KVTKNEM0UXKY.0 size=1048576 2024-09-14T11:17:09.178 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.179+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~KVTKNEM0UXKY.1 size=204200 2024-09-14T11:17:09.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.187+0000 7fe125ff88c0 1 < completed multipart upload key=0FITHLGQKQEC upload=KVTKNEM0UXKY tag=7R845DLXE1CB type=write size=2301352 2024-09-14T11:17:09.192 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.191+0000 7fe125ff88c0 1 > prepared operation key=3OU4U9JF3ZD5 tag=ZIX0B4WU7ZX0 type=del size=225751 2024-09-14T11:17:09.196 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.195+0000 7fe125ff88c0 1 < completed delete operation key=L4XO0WTYKNXY tag=7622XRCSWY5C type=del 2024-09-14T11:17:09.203 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.203+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~2MYLI717UAFL.0 size=923447 2024-09-14T11:17:09.203 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.203+0000 7fe125ff88c0 1 > prepared multipart upload key=V6B470G93KFT upload=2MYLI717UAFL tag=D41O1C7C97IA type=write size=1972023 2024-09-14T11:17:09.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.207+0000 7fe125ff88c0 1 < completed delete operation key=SUCH37O8V1LY tag=ZX51T7SVSEA8 type=del 2024-09-14T11:17:09.210 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.211+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=4ESW9EGZIG9C type=del size=3271292 2024-09-14T11:17:09.214 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.215+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~4REC2DO117X0.0 size=1048576 2024-09-14T11:17:09.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.219+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~4REC2DO117X0.1 size=1048576 2024-09-14T11:17:09.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.223+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~4REC2DO117X0.2 size=540394 2024-09-14T11:17:09.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.227+0000 7fe125ff88c0 1 < completed multipart upload key=1ML6RIXI4C5P upload=4REC2DO117X0 tag=EYALEKTYXYR2 type=write size=3686122 2024-09-14T11:17:09.230 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.231+0000 7fe125ff88c0 1 > prepared operation key=46ZTDBWFVSUH tag=PARLDTL9LEKW type=del size=2999536 2024-09-14T11:17:09.234 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.235+0000 7fe125ff88c0 1 < completed delete operation key=K05LARTJ2QZ3 tag=MSN21BD13C7T type=del 2024-09-14T11:17:09.241 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.243+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~0W6XH041U1OQ.0 size=1048576 2024-09-14T11:17:09.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.247+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~0W6XH041U1OQ.1 size=581693 2024-09-14T11:17:09.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.247+0000 7fe125ff88c0 1 > prepared multipart upload key=2LH5U05C2F8C upload=0W6XH041U1OQ tag=69BNTL3VY4CG type=write size=2678845 2024-09-14T11:17:09.249 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.251+0000 7fe125ff88c0 1 < completed delete operation key=K3P6U6NU8I01 tag=T271N0YTQD8V type=del 2024-09-14T11:17:09.253 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.255+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=E4GDE9WS2A0C type=del size=2989405 2024-09-14T11:17:09.257 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.259+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~5QIKWGFFBGZ8.0 size=1048576 2024-09-14T11:17:09.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.259+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~5QIKWGFFBGZ8.1 size=1048576 2024-09-14T11:17:09.262 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.263+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~5QIKWGFFBGZ8.2 size=715158 2024-09-14T11:17:09.267 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.267+0000 7fe125ff88c0 1 < completed multipart upload key=W0B19NBHNLMZ upload=5QIKWGFFBGZ8 tag=LFGZWZVHNX5L type=write size=3860886 2024-09-14T11:17:09.271 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.271+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=N6JNG94DMZ3N type=del size=2428613 2024-09-14T11:17:09.274 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.275+0000 7fe125ff88c0 1 < completed part key=_multipart_YFRH8WECBTJK.2~87OVLFU24J1D.0 size=1039215 2024-09-14T11:17:09.280 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.279+0000 7fe125ff88c0 1 < completed multipart upload key=YFRH8WECBTJK upload=87OVLFU24J1D tag=JWY9RKLA4QDQ type=write size=2087791 2024-09-14T11:17:09.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.283+0000 7fe125ff88c0 1 > prepared operation key=FQ5WT12KB664 tag=LTGJ3M1CHQXU type=del size=2025394 2024-09-14T11:17:09.290 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.291+0000 7fe125ff88c0 1 < suggested update operation key=2LH5U05C2F8C tag=B55QQ28RCUD6 type=del size=988648 2024-09-14T11:17:09.293 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.295+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=137JB5G8U3OM type=del size=117279 2024-09-14T11:17:09.297 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.299+0000 7fe125ff88c0 1 < canceled operation key=N80X3YUF4OEL tag=8XKF2QN23ZTI type=write size=650168 2024-09-14T11:17:09.301 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.303+0000 7fe125ff88c0 1 > prepared operation key=3OU4U9JF3ZD5 tag=64MGIEC7W03L type=del size=590576 2024-09-14T11:17:09.304 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.307+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~4GR5NVCEYVDC.0 size=418236 2024-09-14T11:17:09.310 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.311+0000 7fe125ff88c0 1 < completed multipart upload key=21HC4VMHXS6L upload=4GR5NVCEYVDC tag=VCMUN9CJHCNN type=write size=1466812 2024-09-14T11:17:09.314 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.315+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=SSJMM47ACGHY type=del size=2204485 2024-09-14T11:17:09.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.319+0000 7fe125ff88c0 1 < completed delete operation key=3YGN50MBAF41 tag=IDBZB6J0K31G type=del 2024-09-14T11:17:09.325 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.327+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~D8XDUB93PFBT.0 size=1048576 2024-09-14T11:17:09.328 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.327+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~D8XDUB93PFBT.1 size=1048576 2024-09-14T11:17:09.331 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.331+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~D8XDUB93PFBT.2 size=849422 2024-09-14T11:17:09.331 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.331+0000 7fe125ff88c0 1 > prepared multipart upload key=SUCH37O8V1LY upload=D8XDUB93PFBT tag=LCURB0BEF82X type=write size=3995150 2024-09-14T11:17:09.335 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.335+0000 7fe125ff88c0 1 < completed part key=_multipart_0VBX2FWYCFEZ.2~50J4EQC1X2TE.0 size=1048576 2024-09-14T11:17:09.338 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.339+0000 7fe125ff88c0 1 < completed part key=_multipart_0VBX2FWYCFEZ.2~50J4EQC1X2TE.1 size=1048576 2024-09-14T11:17:09.341 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.343+0000 7fe125ff88c0 1 < completed part key=_multipart_0VBX2FWYCFEZ.2~50J4EQC1X2TE.2 size=39497 2024-09-14T11:17:09.348 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.347+0000 7fe125ff88c0 1 < completed multipart upload key=0VBX2FWYCFEZ upload=50J4EQC1X2TE tag=A0GHUZ70K1HN type=write size=3185225 2024-09-14T11:17:09.356 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.355+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~PI2Q0LS5BENS.0 size=1048576 2024-09-14T11:17:09.360 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.359+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~PI2Q0LS5BENS.1 size=1048576 2024-09-14T11:17:09.361 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.363+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~PI2Q0LS5BENS.2 size=455894 2024-09-14T11:17:09.362 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.363+0000 7fe125ff88c0 1 > prepared multipart upload key=LYBGDNKUROWH upload=PI2Q0LS5BENS tag=T1LHSSOOCYT7 type=write size=3601622 2024-09-14T11:17:09.365 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.367+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~3990ZSY3IRYD.0 size=1048576 2024-09-14T11:17:09.365 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.367+0000 7fe125ff88c0 1 < canceled part key=_multipart_SUCH37O8V1LY.2~3990ZSY3IRYD.1 size=1048576 2024-09-14T11:17:09.367 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.367+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~3990ZSY3IRYD.2 size=390888 2024-09-14T11:17:09.373 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.375+0000 7fe125ff88c0 1 < canceled multipart upload key=SUCH37O8V1LY upload=3990ZSY3IRYD tag=PAX87Y2YT9QT type=write size=3536616 2024-09-14T11:17:09.377 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.379+0000 7fe125ff88c0 1 > prepared operation key=N80X3YUF4OEL tag=R0LEGLIHN134 type=del size=1304614 2024-09-14T11:17:09.381 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.383+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~ODEQ0UK6FWQ2.0 size=1048576 2024-09-14T11:17:09.384 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.383+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~ODEQ0UK6FWQ2.1 size=1048576 2024-09-14T11:17:09.387 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.387+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~ODEQ0UK6FWQ2.2 size=257205 2024-09-14T11:17:09.394 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.395+0000 7fe125ff88c0 1 < completed multipart upload key=2LH5U05C2F8C upload=ODEQ0UK6FWQ2 tag=I5O1BGVQBBH9 type=write size=3402933 2024-09-14T11:17:09.401 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.403+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~6TILB6CYOD7S.0 size=1048576 2024-09-14T11:17:09.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.403+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~6TILB6CYOD7S.1 size=354237 2024-09-14T11:17:09.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.403+0000 7fe125ff88c0 1 > prepared multipart upload key=LYBGDNKUROWH upload=6TILB6CYOD7S tag=J15MW5T7QFH4 type=write size=2451389 2024-09-14T11:17:09.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.407+0000 7fe125ff88c0 1 < completed delete operation key=3YGN50MBAF41 tag=RHSJ2V6H7SHL type=del 2024-09-14T11:17:09.415 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.415+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~J2WNW2JE5LFE.0 size=1048576 2024-09-14T11:17:09.418 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.419+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~J2WNW2JE5LFE.1 size=1048576 2024-09-14T11:17:09.421 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.423+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~J2WNW2JE5LFE.2 size=2327 2024-09-14T11:17:09.421 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.423+0000 7fe125ff88c0 1 > prepared multipart upload key=3OU4U9JF3ZD5 upload=J2WNW2JE5LFE tag=E0WJMIG6NDUW type=write size=3148055 2024-09-14T11:17:09.425 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.427+0000 7fe125ff88c0 1 < completed delete operation key=3OU4U9JF3ZD5 tag=ZIX0B4WU7ZX0 type=del 2024-09-14T11:17:09.431 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.431+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~K3HZ9DJQ6H8N.0 size=1048576 2024-09-14T11:17:09.434 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.435+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~K3HZ9DJQ6H8N.1 size=596050 2024-09-14T11:17:09.434 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.435+0000 7fe125ff88c0 1 > prepared multipart upload key=N80X3YUF4OEL upload=K3HZ9DJQ6H8N tag=J8JUMLU2WCY2 type=write size=2693202 2024-09-14T11:17:09.438 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.439+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~2MYLI717UAFL.0 size=923447 2024-09-14T11:17:09.444 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.443+0000 7fe125ff88c0 1 < completed multipart upload key=V6B470G93KFT upload=2MYLI717UAFL tag=D41O1C7C97IA type=write size=1972023 2024-09-14T11:17:09.448 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.447+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=SQS2D3VGX3W4 type=del size=4159479 2024-09-14T11:17:09.451 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.451+0000 7fe125ff88c0 1 < completed delete operation key=YCF2PCJ9TZMR tag=4ESW9EGZIG9C type=del 2024-09-14T11:17:09.455 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.455+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=63248VEIUGX6 type=del size=2421462 2024-09-14T11:17:09.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.459+0000 7fe125ff88c0 1 < canceled operation key=46ZTDBWFVSUH tag=PARLDTL9LEKW type=del size=2999536 2024-09-14T11:17:09.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.463+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=4A74FW52TKSQ type=del size=4193292 2024-09-14T11:17:09.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.467+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~0W6XH041U1OQ.0 size=1048576 2024-09-14T11:17:09.470 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.471+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~0W6XH041U1OQ.1 size=581693 2024-09-14T11:17:09.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.475+0000 7fe125ff88c0 1 < completed multipart upload key=2LH5U05C2F8C upload=0W6XH041U1OQ tag=69BNTL3VY4CG type=write size=2678845 2024-09-14T11:17:09.480 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.479+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=5LIQTBV1NE4G type=del size=880360 2024-09-14T11:17:09.484 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.483+0000 7fe125ff88c0 1 < completed delete operation key=K3P6U6NU8I01 tag=E4GDE9WS2A0C type=del 2024-09-14T11:17:09.488 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.487+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=OS72TSNG4F43 type=del size=3031633 2024-09-14T11:17:09.492 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.491+0000 7fe125ff88c0 1 < completed delete operation key=F9I82N7RQC81 tag=N6JNG94DMZ3N type=del 2024-09-14T11:17:09.498 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.499+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~ZDH85V5IFUDU.0 size=475603 2024-09-14T11:17:09.498 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.499+0000 7fe125ff88c0 1 > prepared multipart upload key=35EB6U5O4A51 upload=ZDH85V5IFUDU tag=X17CKDOPE6AK type=write size=1524179 2024-09-14T11:17:09.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.503+0000 7fe125ff88c0 1 < completed delete operation key=FQ5WT12KB664 tag=LTGJ3M1CHQXU type=del 2024-09-14T11:17:09.506 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.507+0000 7fe125ff88c0 1 > prepared operation key=6C3JZKTB8BP3 tag=QPE9I5GQPT2U type=write size=645928 2024-09-14T11:17:09.514 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.515+0000 7fe125ff88c0 1 < suggested remove operation key=4D2X7151977X tag=137JB5G8U3OM type=del 2024-09-14T11:17:09.518 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.519+0000 7fe125ff88c0 1 > prepared operation key=SUCH37O8V1LY tag=HR1AQP1BNWMP type=del size=802232 2024-09-14T11:17:09.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.523+0000 7fe125ff88c0 1 < completed delete operation key=3OU4U9JF3ZD5 tag=64MGIEC7W03L type=del 2024-09-14T11:17:09.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.531+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~90P1OFAGPVJQ.0 size=1048576 2024-09-14T11:17:09.534 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.535+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~90P1OFAGPVJQ.1 size=1048576 2024-09-14T11:17:09.537 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.539+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~90P1OFAGPVJQ.2 size=101593 2024-09-14T11:17:09.537 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.539+0000 7fe125ff88c0 1 > prepared multipart upload key=0FITHLGQKQEC upload=90P1OFAGPVJQ tag=4PA0WOTL7LSK type=write size=3247321 2024-09-14T11:17:09.540 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.543+0000 7fe125ff88c0 1 < completed delete operation key=35EB6U5O4A51 tag=SSJMM47ACGHY type=del 2024-09-14T11:17:09.544 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.547+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=9EHN9TUS5GXQ type=del size=1437999 2024-09-14T11:17:09.548 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.551+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~D8XDUB93PFBT.0 size=1048576 2024-09-14T11:17:09.551 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.551+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~D8XDUB93PFBT.1 size=1048576 2024-09-14T11:17:09.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.555+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~D8XDUB93PFBT.2 size=849422 2024-09-14T11:17:09.560 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.563+0000 7fe125ff88c0 1 < completed multipart upload key=SUCH37O8V1LY upload=D8XDUB93PFBT tag=LCURB0BEF82X type=write size=3995150 2024-09-14T11:17:09.567 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.567+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~Z5LTSJ3XJ1O6.0 size=1048576 2024-09-14T11:17:09.570 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.571+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~Z5LTSJ3XJ1O6.1 size=1048576 2024-09-14T11:17:09.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.575+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~Z5LTSJ3XJ1O6.2 size=28835 2024-09-14T11:17:09.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.575+0000 7fe125ff88c0 1 > prepared multipart upload key=N80X3YUF4OEL upload=Z5LTSJ3XJ1O6 tag=CHYZ70Q41O4K type=write size=3174563 2024-09-14T11:17:09.578 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.579+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~PI2Q0LS5BENS.0 size=1048576 2024-09-14T11:17:09.581 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.583+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~PI2Q0LS5BENS.1 size=1048576 2024-09-14T11:17:09.584 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.583+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~PI2Q0LS5BENS.2 size=455894 2024-09-14T11:17:09.591 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.591+0000 7fe125ff88c0 1 < completed multipart upload key=LYBGDNKUROWH upload=PI2Q0LS5BENS tag=T1LHSSOOCYT7 type=write size=3601622 2024-09-14T11:17:09.596 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.595+0000 7fe125ff88c0 1 > prepared operation key=LYBGDNKUROWH tag=TWJJLR8FR4JR type=del size=822592 2024-09-14T11:17:09.600 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.599+0000 7fe125ff88c0 1 < completed delete operation key=N80X3YUF4OEL tag=R0LEGLIHN134 type=del 2024-09-14T11:17:09.604 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.603+0000 7fe125ff88c0 1 > prepared operation key=3OU4U9JF3ZD5 tag=BJP1BO9Z1OOA type=write size=351511 2024-09-14T11:17:09.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.607+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~6TILB6CYOD7S.0 size=1048576 2024-09-14T11:17:09.611 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.611+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~6TILB6CYOD7S.1 size=354237 2024-09-14T11:17:09.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.619+0000 7fe125ff88c0 1 < completed multipart upload key=LYBGDNKUROWH upload=6TILB6CYOD7S tag=J15MW5T7QFH4 type=write size=2451389 2024-09-14T11:17:09.621 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.623+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=75P47P25F3X5 type=del size=2636824 2024-09-14T11:17:09.625 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.627+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~J2WNW2JE5LFE.0 size=1048576 2024-09-14T11:17:09.625 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.627+0000 7fe125ff88c0 1 < canceled part key=_multipart_3OU4U9JF3ZD5.2~J2WNW2JE5LFE.1 size=1048576 2024-09-14T11:17:09.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.631+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~J2WNW2JE5LFE.2 size=2327 2024-09-14T11:17:09.635 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.635+0000 7fe125ff88c0 1 < canceled multipart upload key=3OU4U9JF3ZD5 upload=J2WNW2JE5LFE tag=E0WJMIG6NDUW type=write size=3148055 2024-09-14T11:17:09.639 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.639+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=7EAADVEA6I0O type=del size=2746228 2024-09-14T11:17:09.643 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.643+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~K3HZ9DJQ6H8N.0 size=1048576 2024-09-14T11:17:09.646 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.647+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~K3HZ9DJQ6H8N.1 size=596050 2024-09-14T11:17:09.652 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.651+0000 7fe125ff88c0 1 < completed multipart upload key=N80X3YUF4OEL upload=K3HZ9DJQ6H8N tag=J8JUMLU2WCY2 type=write size=2693202 2024-09-14T11:17:09.659 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.659+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~SFD49UH1YON9.0 size=1048576 2024-09-14T11:17:09.662 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.663+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~SFD49UH1YON9.1 size=1048576 2024-09-14T11:17:09.665 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.667+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~SFD49UH1YON9.2 size=654843 2024-09-14T11:17:09.665 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.667+0000 7fe125ff88c0 1 > prepared multipart upload key=N80X3YUF4OEL upload=SFD49UH1YON9 tag=HSAMH2ULDF1U type=write size=3800571 2024-09-14T11:17:09.668 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.671+0000 7fe125ff88c0 1 < completed delete operation key=35EB6U5O4A51 tag=SQS2D3VGX3W4 type=del 2024-09-14T11:17:09.672 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.675+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=QFXTC11MCRSH type=del size=1100114 2024-09-14T11:17:09.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.679+0000 7fe125ff88c0 1 < completed delete operation key=2KEKSWK0UT6C tag=63248VEIUGX6 type=del 2024-09-14T11:17:09.680 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.683+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=2BAEH3USFK64 type=del size=272198 2024-09-14T11:17:09.684 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.683+0000 7fe125ff88c0 1 < completed delete operation key=YN2HI39GPEDF tag=4A74FW52TKSQ type=del 2024-09-14T11:17:09.688 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.691+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=8KK1RGA3YBD0 type=del size=4053577 2024-09-14T11:17:09.692 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.695+0000 7fe125ff88c0 -1 < failed to complete operation key=4D2X7151977X tag=5LIQTBV1NE4G type=del size=880360: (22) Invalid argument 2024-09-14T11:17:09.696 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.699+0000 7fe125ff88c0 1 > prepared operation key=N80X3YUF4OEL tag=7U5E6T32Y2WL type=write size=247524 2024-09-14T11:17:09.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.699+0000 7fe125ff88c0 1 < completed delete operation key=N94D3R7IOBNL tag=OS72TSNG4F43 type=del 2024-09-14T11:17:09.704 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.703+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=L1Z8NO21FUAV type=del size=1176725 2024-09-14T11:17:09.705 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.707+0000 7fe125ff88c0 1 < canceled part key=_multipart_35EB6U5O4A51.2~ZDH85V5IFUDU.0 size=475603 2024-09-14T11:17:09.711 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.711+0000 7fe125ff88c0 1 < canceled multipart upload key=35EB6U5O4A51 upload=ZDH85V5IFUDU tag=X17CKDOPE6AK type=write size=1524179 2024-09-14T11:17:09.715 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.715+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=TLAUFI7EHAKH type=del size=1776156 2024-09-14T11:17:09.719 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.719+0000 7fe125ff88c0 1 < completed write operation key=6C3JZKTB8BP3 tag=QPE9I5GQPT2U type=write size=645928 2024-09-14T11:17:09.722 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.723+0000 7fe125ff88c0 1 > prepared operation key=FQ5WT12KB664 tag=IHP43FQ4DV27 type=del size=780754 2024-09-14T11:17:09.726 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.727+0000 7fe125ff88c0 1 < completed delete operation key=SUCH37O8V1LY tag=HR1AQP1BNWMP type=del 2024-09-14T11:17:09.734 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.735+0000 7fe125ff88c0 1 > prepared part key=_multipart_N94D3R7IOBNL.2~99JGCS2DMH6E.0 size=1048576 2024-09-14T11:17:09.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.739+0000 7fe125ff88c0 1 > prepared part key=_multipart_N94D3R7IOBNL.2~99JGCS2DMH6E.1 size=1048576 2024-09-14T11:17:09.740 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.739+0000 7fe125ff88c0 1 > prepared part key=_multipart_N94D3R7IOBNL.2~99JGCS2DMH6E.2 size=600296 2024-09-14T11:17:09.740 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.739+0000 7fe125ff88c0 1 > prepared multipart upload key=N94D3R7IOBNL upload=99JGCS2DMH6E tag=2TB3RUDNK0QN type=write size=3746024 2024-09-14T11:17:09.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.743+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~90P1OFAGPVJQ.0 size=1048576 2024-09-14T11:17:09.747 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.747+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~90P1OFAGPVJQ.1 size=1048576 2024-09-14T11:17:09.750 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.751+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~90P1OFAGPVJQ.2 size=101593 2024-09-14T11:17:09.756 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.755+0000 7fe125ff88c0 1 < completed multipart upload key=0FITHLGQKQEC upload=90P1OFAGPVJQ tag=4PA0WOTL7LSK type=write size=3247321 2024-09-14T11:17:09.760 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.759+0000 7fe125ff88c0 1 > prepared operation key=3OU4U9JF3ZD5 tag=V167FDM3ZQA5 type=del size=1218612 2024-09-14T11:17:09.764 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.763+0000 7fe125ff88c0 1 < completed delete operation key=F9I82N7RQC81 tag=9EHN9TUS5GXQ type=del 2024-09-14T11:17:09.768 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.767+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=T13V7APIDR31 type=write size=430761 2024-09-14T11:17:09.771 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.771+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~Z5LTSJ3XJ1O6.0 size=1048576 2024-09-14T11:17:09.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.775+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~Z5LTSJ3XJ1O6.1 size=1048576 2024-09-14T11:17:09.777 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.779+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~Z5LTSJ3XJ1O6.2 size=28835 2024-09-14T11:17:09.783 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.783+0000 7fe125ff88c0 1 < completed multipart upload key=N80X3YUF4OEL upload=Z5LTSJ3XJ1O6 tag=CHYZ70Q41O4K type=write size=3174563 2024-09-14T11:17:09.790 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.791+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~AME94RI2OETK.0 size=1048576 2024-09-14T11:17:09.793 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.795+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~AME94RI2OETK.1 size=743081 2024-09-14T11:17:09.793 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.795+0000 7fe125ff88c0 1 > prepared multipart upload key=N80X3YUF4OEL upload=AME94RI2OETK tag=WNNW2RJ9GGC3 type=write size=2840233 2024-09-14T11:17:09.797 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.799+0000 7fe125ff88c0 1 < completed delete operation key=LYBGDNKUROWH tag=TWJJLR8FR4JR type=del 2024-09-14T11:17:09.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.803+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~GEDIV3140QYY.0 size=1048576 2024-09-14T11:17:09.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.807+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~GEDIV3140QYY.1 size=1048576 2024-09-14T11:17:09.810 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.811+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~GEDIV3140QYY.2 size=828458 2024-09-14T11:17:09.810 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.811+0000 7fe125ff88c0 1 > prepared multipart upload key=F9I82N7RQC81 upload=GEDIV3140QYY tag=0VX5MHVV4309 type=write size=3974186 2024-09-14T11:17:09.814 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.815+0000 7fe125ff88c0 1 < completed write operation key=3OU4U9JF3ZD5 tag=BJP1BO9Z1OOA type=write size=351511 2024-09-14T11:17:09.820 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.823+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~AJ4FCV7VV6F9.0 size=758764 2024-09-14T11:17:09.820 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.823+0000 7fe125ff88c0 1 > prepared multipart upload key=2UXA6SXDTUFT upload=AJ4FCV7VV6F9 tag=17YW8WQEOOXU type=write size=1807340 2024-09-14T11:17:09.825 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.827+0000 7fe125ff88c0 1 < canceled operation key=ESVFZQQXE3GT tag=75P47P25F3X5 type=del size=2636824 2024-09-14T11:17:09.832 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.831+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~CAHF3SRM7HMS.0 size=1048576 2024-09-14T11:17:09.836 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.835+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~CAHF3SRM7HMS.1 size=1048576 2024-09-14T11:17:09.838 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.839+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~CAHF3SRM7HMS.2 size=806921 2024-09-14T11:17:09.838 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.839+0000 7fe125ff88c0 1 > prepared multipart upload key=K05LARTJ2QZ3 upload=CAHF3SRM7HMS tag=O91M6HZ7F9XR type=write size=3952649 2024-09-14T11:17:09.842 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.843+0000 7fe125ff88c0 1 < completed delete operation key=35EB6U5O4A51 tag=7EAADVEA6I0O type=del 2024-09-14T11:17:09.846 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.847+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=5YAZL51C8IZF type=del size=907341 2024-09-14T11:17:09.850 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.851+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~SFD49UH1YON9.0 size=1048576 2024-09-14T11:17:09.854 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.855+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~SFD49UH1YON9.1 size=1048576 2024-09-14T11:17:09.856 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.859+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~SFD49UH1YON9.2 size=654843 2024-09-14T11:17:09.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.863+0000 7fe125ff88c0 1 < completed multipart upload key=N80X3YUF4OEL upload=SFD49UH1YON9 tag=HSAMH2ULDF1U type=write size=3800571 2024-09-14T11:17:09.867 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.867+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=EBGQ1D19MPT1 type=del size=3694012 2024-09-14T11:17:09.871 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.871+0000 7fe125ff88c0 1 < completed delete operation key=K3P6U6NU8I01 tag=QFXTC11MCRSH type=del 2024-09-14T11:17:09.879 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.879+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~T4OLR0ON3XZC.0 size=504326 2024-09-14T11:17:09.879 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.879+0000 7fe125ff88c0 1 > prepared multipart upload key=V6B470G93KFT upload=T4OLR0ON3XZC tag=UQ83Y4QCBYOJ type=write size=1552902 2024-09-14T11:17:09.886 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.887+0000 7fe125ff88c0 1 < completed delete operation key=ESVFZQQXE3GT tag=2BAEH3USFK64 type=del 2024-09-14T11:17:09.890 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.891+0000 7fe125ff88c0 1 > prepared operation key=N80X3YUF4OEL tag=GMRHDO1DJA6I type=del size=62597 2024-09-14T11:17:09.895 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.895+0000 7fe125ff88c0 1 < completed delete operation key=2UXA6SXDTUFT tag=8KK1RGA3YBD0 type=del 2024-09-14T11:17:09.900 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.899+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=CVMYSMF55AZ9 type=del size=1112116 2024-09-14T11:17:09.905 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.907+0000 7fe125ff88c0 1 < completed write operation key=N80X3YUF4OEL tag=7U5E6T32Y2WL type=write size=247524 2024-09-14T11:17:09.909 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.911+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=TB8E6D0WUNP7 type=del size=2879008 2024-09-14T11:17:09.913 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.915+0000 7fe125ff88c0 1 < completed delete operation key=K3P6U6NU8I01 tag=L1Z8NO21FUAV type=del 2024-09-14T11:17:09.916 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.919+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=TY04XZO5VTDK type=write size=55510 2024-09-14T11:17:09.920 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.919+0000 7fe125ff88c0 1 < completed delete operation key=0VBX2FWYCFEZ tag=TLAUFI7EHAKH type=del 2024-09-14T11:17:09.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.927+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~VFZEII5GVBUB.0 size=537589 2024-09-14T11:17:09.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.927+0000 7fe125ff88c0 1 > prepared multipart upload key=2LH5U05C2F8C upload=VFZEII5GVBUB tag=JPV8CTG53FP2 type=write size=1586165 2024-09-14T11:17:09.930 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.931+0000 7fe125ff88c0 1 < completed delete operation key=FQ5WT12KB664 tag=IHP43FQ4DV27 type=del 2024-09-14T11:17:09.934 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.935+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=4MA8MJRGKVJU type=del size=753707 2024-09-14T11:17:09.938 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.939+0000 7fe125ff88c0 1 < completed part key=_multipart_N94D3R7IOBNL.2~99JGCS2DMH6E.0 size=1048576 2024-09-14T11:17:09.940 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.943+0000 7fe125ff88c0 1 < completed part key=_multipart_N94D3R7IOBNL.2~99JGCS2DMH6E.1 size=1048576 2024-09-14T11:17:09.943 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.943+0000 7fe125ff88c0 1 < completed part key=_multipart_N94D3R7IOBNL.2~99JGCS2DMH6E.2 size=600296 2024-09-14T11:17:09.949 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.951+0000 7fe125ff88c0 1 < completed multipart upload key=N94D3R7IOBNL upload=99JGCS2DMH6E tag=2TB3RUDNK0QN type=write size=3746024 2024-09-14T11:17:09.953 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.955+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=RI7MPHNDWDD9 type=del size=1012475 2024-09-14T11:17:09.961 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.963+0000 7fe125ff88c0 1 < suggested update operation key=3OU4U9JF3ZD5 tag=V167FDM3ZQA5 type=del size=1218612 2024-09-14T11:17:09.967 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.967+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~KWJA3635TSBX.0 size=444011 2024-09-14T11:17:09.967 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.967+0000 7fe125ff88c0 1 > prepared multipart upload key=LYBGDNKUROWH upload=KWJA3635TSBX tag=87HX83WQ1AQE type=write size=1492587 2024-09-14T11:17:09.974 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.975+0000 7fe125ff88c0 1 < suggested remove operation key=6PLUU2QIO9LJ tag=T13V7APIDR31 type=write 2024-09-14T11:17:09.981 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.983+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~LVUUL51KLXHM.0 size=1048576 2024-09-14T11:17:09.984 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.983+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~LVUUL51KLXHM.1 size=1048576 2024-09-14T11:17:09.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.987+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~LVUUL51KLXHM.2 size=603130 2024-09-14T11:17:09.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.987+0000 7fe125ff88c0 1 > prepared multipart upload key=SUCH37O8V1LY upload=LVUUL51KLXHM tag=XTRY0BD11XHS type=write size=3748858 2024-09-14T11:17:09.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.991+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~AME94RI2OETK.0 size=1048576 2024-09-14T11:17:09.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.995+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~AME94RI2OETK.1 size=743081 2024-09-14T11:17:10.000 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:09.999+0000 7fe125ff88c0 1 < completed multipart upload key=N80X3YUF4OEL upload=AME94RI2OETK tag=WNNW2RJ9GGC3 type=write size=2840233 2024-09-14T11:17:10.005 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.007+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~9SS3HO4X5JF6.0 size=1048576 2024-09-14T11:17:10.008 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.007+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~9SS3HO4X5JF6.1 size=149983 2024-09-14T11:17:10.008 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.007+0000 7fe125ff88c0 1 > prepared multipart upload key=K05LARTJ2QZ3 upload=9SS3HO4X5JF6 tag=RERE7KLJFY0T type=write size=2247135 2024-09-14T11:17:10.011 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.011+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~GEDIV3140QYY.0 size=1048576 2024-09-14T11:17:10.013 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.015+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~GEDIV3140QYY.1 size=1048576 2024-09-14T11:17:10.015 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.015+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~GEDIV3140QYY.2 size=828458 2024-09-14T11:17:10.020 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.019+0000 7fe125ff88c0 1 < completed multipart upload key=F9I82N7RQC81 upload=GEDIV3140QYY tag=0VX5MHVV4309 type=write size=3974186 2024-09-14T11:17:10.025 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.027+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~Q44J9JX2SJH4.0 size=1048576 2024-09-14T11:17:10.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.027+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~Q44J9JX2SJH4.1 size=1048576 2024-09-14T11:17:10.030 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.031+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~Q44J9JX2SJH4.2 size=537806 2024-09-14T11:17:10.030 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.031+0000 7fe125ff88c0 1 > prepared multipart upload key=35EB6U5O4A51 upload=Q44J9JX2SJH4 tag=CWSIJGP39C3U type=write size=3683534 2024-09-14T11:17:10.033 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.035+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~AJ4FCV7VV6F9.0 size=758764 2024-09-14T11:17:10.038 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.039+0000 7fe125ff88c0 1 < completed multipart upload key=2UXA6SXDTUFT upload=AJ4FCV7VV6F9 tag=17YW8WQEOOXU type=write size=1807340 2024-09-14T11:17:10.043 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.043+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~O283YSZZ332D.0 size=1048576 2024-09-14T11:17:10.046 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.047+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~O283YSZZ332D.1 size=521390 2024-09-14T11:17:10.046 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.047+0000 7fe125ff88c0 1 > prepared multipart upload key=46ZTDBWFVSUH upload=O283YSZZ332D tag=P7LO14P64LHS type=write size=2618542 2024-09-14T11:17:10.048 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.051+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~CAHF3SRM7HMS.0 size=1048576 2024-09-14T11:17:10.051 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.051+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~CAHF3SRM7HMS.1 size=1048576 2024-09-14T11:17:10.054 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.055+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~CAHF3SRM7HMS.2 size=806921 2024-09-14T11:17:10.059 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.059+0000 7fe125ff88c0 1 < completed multipart upload key=K05LARTJ2QZ3 upload=CAHF3SRM7HMS tag=O91M6HZ7F9XR type=write size=3952649 2024-09-14T11:17:10.063 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.063+0000 7fe125ff88c0 1 > prepared operation key=LYBGDNKUROWH tag=M736WB2LJZAB type=write size=988276 2024-09-14T11:17:10.067 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.067+0000 7fe125ff88c0 1 < completed delete operation key=WEA3MQ0DI42N tag=5YAZL51C8IZF type=del 2024-09-14T11:17:10.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.071+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=AZX2V9JL8ZZX type=del size=3625721 2024-09-14T11:17:10.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.079+0000 7fe125ff88c0 1 < suggested remove operation key=4D2X7151977X tag=EBGQ1D19MPT1 type=del 2024-09-14T11:17:10.086 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.087+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~2QMCW1IP9WAA.0 size=1048576 2024-09-14T11:17:10.089 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.091+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~2QMCW1IP9WAA.1 size=1048576 2024-09-14T11:17:10.092 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.091+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~2QMCW1IP9WAA.2 size=405558 2024-09-14T11:17:10.092 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.091+0000 7fe125ff88c0 1 > prepared multipart upload key=3OU4U9JF3ZD5 upload=2QMCW1IP9WAA tag=RJ6CP46F5UZU type=write size=3551286 2024-09-14T11:17:10.096 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.095+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~T4OLR0ON3XZC.0 size=504326 2024-09-14T11:17:10.102 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.103+0000 7fe125ff88c0 1 < completed multipart upload key=V6B470G93KFT upload=T4OLR0ON3XZC tag=UQ83Y4QCBYOJ type=write size=1552902 2024-09-14T11:17:10.108 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.111+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~W2983H5HONS8.0 size=1048576 2024-09-14T11:17:10.111 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.111+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~W2983H5HONS8.1 size=1048576 2024-09-14T11:17:10.114 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.115+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~W2983H5HONS8.2 size=918714 2024-09-14T11:17:10.115 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.115+0000 7fe125ff88c0 1 > prepared multipart upload key=YN2HI39GPEDF upload=W2983H5HONS8 tag=Y4EFK3IY9UN2 type=write size=4064442 2024-09-14T11:17:10.118 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.119+0000 7fe125ff88c0 1 < completed delete operation key=N80X3YUF4OEL tag=GMRHDO1DJA6I type=del 2024-09-14T11:17:10.122 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.123+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=00K4NWAEK1HS type=write size=212041 2024-09-14T11:17:10.126 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.127+0000 7fe125ff88c0 1 < canceled operation key=V6B470G93KFT tag=CVMYSMF55AZ9 type=del size=1112116 2024-09-14T11:17:10.130 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.131+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=WT10XNFV6LYT type=del size=655298 2024-09-14T11:17:10.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.135+0000 7fe125ff88c0 -1 < failed to complete operation key=6PLUU2QIO9LJ tag=TB8E6D0WUNP7 type=del size=2879008: (22) Invalid argument 2024-09-14T11:17:10.138 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.139+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=YTG87L4Q60UQ type=del size=3034872 2024-09-14T11:17:10.140 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.139+0000 7fe125ff88c0 -1 < no bi entry to suggest for operation key=6PLUU2QIO9LJ tag=TY04XZO5VTDK type=write size=55510: (2) No such file or directory 2024-09-14T11:17:10.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.143+0000 7fe125ff88c0 1 > prepared operation key=FQ5WT12KB664 tag=3XQAT35IXL1A type=del size=2685428 2024-09-14T11:17:10.148 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.147+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~VFZEII5GVBUB.0 size=537589 2024-09-14T11:17:10.154 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.155+0000 7fe125ff88c0 1 < completed multipart upload key=2LH5U05C2F8C upload=VFZEII5GVBUB tag=JPV8CTG53FP2 type=write size=1586165 2024-09-14T11:17:10.158 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.159+0000 7fe125ff88c0 1 > prepared operation key=46ZTDBWFVSUH tag=40FPOU8PQ6K5 type=del size=3996338 2024-09-14T11:17:10.162 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.163+0000 7fe125ff88c0 -1 < failed to complete operation key=4D2X7151977X tag=4MA8MJRGKVJU type=del size=753707: (22) Invalid argument 2024-09-14T11:17:10.169 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.171+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~D8N2HEMOHYBQ.0 size=1048576 2024-09-14T11:17:10.171 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.171+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~D8N2HEMOHYBQ.1 size=984786 2024-09-14T11:17:10.172 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.171+0000 7fe125ff88c0 1 > prepared multipart upload key=0FITHLGQKQEC upload=D8N2HEMOHYBQ tag=F97Z2KR2MIIG type=write size=3081938 2024-09-14T11:17:10.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.175+0000 7fe125ff88c0 1 < completed delete operation key=YN2HI39GPEDF tag=RI7MPHNDWDD9 type=del 2024-09-14T11:17:10.179 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.179+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=BAK7GOIPTU29 type=del size=910532 2024-09-14T11:17:10.183 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.183+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~KWJA3635TSBX.0 size=444011 2024-09-14T11:17:10.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.191+0000 7fe125ff88c0 1 < completed multipart upload key=LYBGDNKUROWH upload=KWJA3635TSBX tag=87HX83WQ1AQE type=write size=1492587 2024-09-14T11:17:10.193 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.195+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=W47YKZB55XI6 type=del size=3773395 2024-09-14T11:17:10.197 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.199+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~LVUUL51KLXHM.0 size=1048576 2024-09-14T11:17:10.201 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.203+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~LVUUL51KLXHM.1 size=1048576 2024-09-14T11:17:10.203 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.203+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~LVUUL51KLXHM.2 size=603130 2024-09-14T11:17:10.209 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.211+0000 7fe125ff88c0 1 < completed multipart upload key=SUCH37O8V1LY upload=LVUUL51KLXHM tag=XTRY0BD11XHS type=write size=3748858 2024-09-14T11:17:10.212 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.215+0000 7fe125ff88c0 1 > prepared operation key=LYBGDNKUROWH tag=9J50SFES0BN5 type=del size=3059426 2024-09-14T11:17:10.216 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.215+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~9SS3HO4X5JF6.0 size=1048576 2024-09-14T11:17:10.223 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.223+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~9SS3HO4X5JF6.1 size=149983 2024-09-14T11:17:10.229 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.231+0000 7fe125ff88c0 1 < completed multipart upload key=K05LARTJ2QZ3 upload=9SS3HO4X5JF6 tag=RERE7KLJFY0T type=write size=2247135 2024-09-14T11:17:10.235 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.235+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~S73GY3C0HBBE.0 size=1048576 2024-09-14T11:17:10.238 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.239+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~S73GY3C0HBBE.1 size=813120 2024-09-14T11:17:10.238 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.239+0000 7fe125ff88c0 1 > prepared multipart upload key=K05LARTJ2QZ3 upload=S73GY3C0HBBE tag=XIW2MZFZQX0R type=write size=2910272 2024-09-14T11:17:10.242 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.243+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~Q44J9JX2SJH4.0 size=1048576 2024-09-14T11:17:10.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.247+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~Q44J9JX2SJH4.1 size=1048576 2024-09-14T11:17:10.248 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.247+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~Q44J9JX2SJH4.2 size=537806 2024-09-14T11:17:10.254 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.255+0000 7fe125ff88c0 1 < completed multipart upload key=35EB6U5O4A51 upload=Q44J9JX2SJH4 tag=CWSIJGP39C3U type=write size=3683534 2024-09-14T11:17:10.257 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.259+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=BKVO5GOAEUKW type=write size=30276 2024-09-14T11:17:10.259 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.259+0000 7fe125ff88c0 1 < canceled part key=_multipart_46ZTDBWFVSUH.2~O283YSZZ332D.0 size=1048576 2024-09-14T11:17:10.262 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.263+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~O283YSZZ332D.1 size=521390 2024-09-14T11:17:10.268 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.267+0000 7fe125ff88c0 1 < canceled multipart upload key=46ZTDBWFVSUH upload=O283YSZZ332D tag=P7LO14P64LHS type=write size=2618542 2024-09-14T11:17:10.274 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.275+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~IKMP4G0EVM4H.0 size=1048576 2024-09-14T11:17:10.277 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.279+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~IKMP4G0EVM4H.1 size=10537 2024-09-14T11:17:10.277 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.279+0000 7fe125ff88c0 1 > prepared multipart upload key=YFRH8WECBTJK upload=IKMP4G0EVM4H tag=P2M2IQH0TLQN type=write size=2107689 2024-09-14T11:17:10.285 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.287+0000 7fe125ff88c0 1 < suggested remove operation key=LYBGDNKUROWH tag=M736WB2LJZAB type=write 2024-09-14T11:17:10.291 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.291+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~J9HQ4SSIGV1K.0 size=1048576 2024-09-14T11:17:10.294 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.295+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~J9HQ4SSIGV1K.1 size=1048576 2024-09-14T11:17:10.296 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.299+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~J9HQ4SSIGV1K.2 size=501579 2024-09-14T11:17:10.297 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.299+0000 7fe125ff88c0 1 > prepared multipart upload key=W0B19NBHNLMZ upload=J9HQ4SSIGV1K tag=T892ZCN58PZK type=write size=3647307 2024-09-14T11:17:10.300 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.299+0000 7fe125ff88c0 1 < completed delete operation key=2KEKSWK0UT6C tag=AZX2V9JL8ZZX type=del 2024-09-14T11:17:10.303 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.303+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=FIOYMOS3FLN7 type=write size=366479 2024-09-14T11:17:10.307 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.307+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~2QMCW1IP9WAA.0 size=1048576 2024-09-14T11:17:10.310 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.311+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~2QMCW1IP9WAA.1 size=1048576 2024-09-14T11:17:10.313 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.315+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~2QMCW1IP9WAA.2 size=405558 2024-09-14T11:17:10.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.319+0000 7fe125ff88c0 1 < completed multipart upload key=3OU4U9JF3ZD5 upload=2QMCW1IP9WAA tag=RJ6CP46F5UZU type=write size=3551286 2024-09-14T11:17:10.326 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.327+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~5KFDKRVRO5PJ.0 size=455448 2024-09-14T11:17:10.326 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.327+0000 7fe125ff88c0 1 > prepared multipart upload key=FQ5WT12KB664 upload=5KFDKRVRO5PJ tag=FKK8BD22HG7R type=write size=1504024 2024-09-14T11:17:10.327 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.327+0000 7fe125ff88c0 1 < canceled part key=_multipart_YN2HI39GPEDF.2~W2983H5HONS8.0 size=1048576 2024-09-14T11:17:10.327 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.327+0000 7fe125ff88c0 1 < canceled part key=_multipart_YN2HI39GPEDF.2~W2983H5HONS8.1 size=1048576 2024-09-14T11:17:10.330 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.331+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~W2983H5HONS8.2 size=918714 2024-09-14T11:17:10.336 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.335+0000 7fe125ff88c0 1 < canceled multipart upload key=YN2HI39GPEDF upload=W2983H5HONS8 tag=Y4EFK3IY9UN2 type=write size=4064442 2024-09-14T11:17:10.342 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.343+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~LZGBVD6AWUFS.0 size=1048576 2024-09-14T11:17:10.345 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.347+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~LZGBVD6AWUFS.1 size=317151 2024-09-14T11:17:10.345 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.347+0000 7fe125ff88c0 1 > prepared multipart upload key=V6B470G93KFT upload=LZGBVD6AWUFS tag=JW5F8FWOU1JW type=write size=2414303 2024-09-14T11:17:10.348 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.351+0000 7fe125ff88c0 1 < completed write operation key=2UXA6SXDTUFT tag=00K4NWAEK1HS type=write size=212041 2024-09-14T11:17:10.352 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.351+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=FXQWSI7BZ2B1 type=write size=8559 2024-09-14T11:17:10.360 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.359+0000 7fe125ff88c0 1 < suggested remove operation key=ESVFZQQXE3GT tag=WT10XNFV6LYT type=del 2024-09-14T11:17:10.364 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.363+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=4AVP18YDTLMA type=del size=3117093 2024-09-14T11:17:10.372 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.371+0000 7fe125ff88c0 1 < suggested update operation key=YGEVGH840L18 tag=YTG87L4Q60UQ type=del size=3034872 2024-09-14T11:17:10.380 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.379+0000 7fe125ff88c0 1 > prepared part key=_multipart_N94D3R7IOBNL.2~9WMQ0IBG8EQD.0 size=1048576 2024-09-14T11:17:10.383 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.383+0000 7fe125ff88c0 1 > prepared part key=_multipart_N94D3R7IOBNL.2~9WMQ0IBG8EQD.1 size=400410 2024-09-14T11:17:10.383 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.383+0000 7fe125ff88c0 1 > prepared multipart upload key=N94D3R7IOBNL upload=9WMQ0IBG8EQD tag=F97MKZW99KG2 type=write size=2497562 2024-09-14T11:17:10.387 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.387+0000 7fe125ff88c0 1 < completed delete operation key=FQ5WT12KB664 tag=3XQAT35IXL1A type=del 2024-09-14T11:17:10.390 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.391+0000 7fe125ff88c0 1 > prepared operation key=N80X3YUF4OEL tag=AW23DC60XKY5 type=del size=3136511 2024-09-14T11:17:10.394 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.395+0000 7fe125ff88c0 1 < completed delete operation key=46ZTDBWFVSUH tag=40FPOU8PQ6K5 type=del 2024-09-14T11:17:10.398 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.399+0000 7fe125ff88c0 1 > prepared operation key=N80X3YUF4OEL tag=53XK87MG84I5 type=del size=1932669 2024-09-14T11:17:10.402 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.403+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~D8N2HEMOHYBQ.0 size=1048576 2024-09-14T11:17:10.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.407+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~D8N2HEMOHYBQ.1 size=984786 2024-09-14T11:17:10.411 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.411+0000 7fe125ff88c0 1 < completed multipart upload key=0FITHLGQKQEC upload=D8N2HEMOHYBQ tag=F97Z2KR2MIIG type=write size=3081938 2024-09-14T11:17:10.419 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.419+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~N1UZAN131G29.0 size=1048576 2024-09-14T11:17:10.421 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.423+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~N1UZAN131G29.1 size=525939 2024-09-14T11:17:10.422 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.423+0000 7fe125ff88c0 1 > prepared multipart upload key=K3P6U6NU8I01 upload=N1UZAN131G29 tag=0B701NHT7ADL type=write size=2623091 2024-09-14T11:17:10.425 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.427+0000 7fe125ff88c0 1 < completed delete operation key=WEA3MQ0DI42N tag=BAK7GOIPTU29 type=del 2024-09-14T11:17:10.432 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.431+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~C6V0S005F3UE.0 size=756661 2024-09-14T11:17:10.432 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.431+0000 7fe125ff88c0 1 > prepared multipart upload key=0FITHLGQKQEC upload=C6V0S005F3UE tag=X1OM1UDZ3NNU type=write size=1805237 2024-09-14T11:17:10.435 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.435+0000 7fe125ff88c0 1 < completed delete operation key=35EB6U5O4A51 tag=W47YKZB55XI6 type=del 2024-09-14T11:17:10.443 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.443+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~RIQJ7YAEH8CW.0 size=714007 2024-09-14T11:17:10.443 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.443+0000 7fe125ff88c0 1 > prepared multipart upload key=SSNV25PDLDIS upload=RIQJ7YAEH8CW tag=5OX0B551PSZJ type=write size=1762583 2024-09-14T11:17:10.447 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.447+0000 7fe125ff88c0 -1 < failed to complete operation key=LYBGDNKUROWH tag=9J50SFES0BN5 type=del size=3059426: (22) Invalid argument 2024-09-14T11:17:10.452 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.451+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=H8SKLYBLVMYB type=del size=3505519 2024-09-14T11:17:10.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.455+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~S73GY3C0HBBE.0 size=1048576 2024-09-14T11:17:10.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.459+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~S73GY3C0HBBE.1 size=813120 2024-09-14T11:17:10.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.467+0000 7fe125ff88c0 1 < completed multipart upload key=K05LARTJ2QZ3 upload=S73GY3C0HBBE tag=XIW2MZFZQX0R type=write size=2910272 2024-09-14T11:17:10.469 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.471+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=QQ54I9T0QTK9 type=del size=123804 2024-09-14T11:17:10.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.479+0000 7fe125ff88c0 1 < suggested update operation key=YN2HI39GPEDF tag=BKVO5GOAEUKW type=write size=30276 2024-09-14T11:17:10.481 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.483+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=Y00ZF98DTTS2 type=del size=3148766 2024-09-14T11:17:10.485 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.487+0000 7fe125ff88c0 1 < completed part key=_multipart_YFRH8WECBTJK.2~IKMP4G0EVM4H.0 size=1048576 2024-09-14T11:17:10.488 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.487+0000 7fe125ff88c0 1 < completed part key=_multipart_YFRH8WECBTJK.2~IKMP4G0EVM4H.1 size=10537 2024-09-14T11:17:10.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.495+0000 7fe125ff88c0 1 < completed multipart upload key=YFRH8WECBTJK upload=IKMP4G0EVM4H tag=P2M2IQH0TLQN type=write size=2107689 2024-09-14T11:17:10.501 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.503+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~0HYADHIBS463.0 size=1048576 2024-09-14T11:17:10.504 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.503+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~0HYADHIBS463.1 size=553516 2024-09-14T11:17:10.504 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.503+0000 7fe125ff88c0 1 > prepared multipart upload key=FQ5WT12KB664 upload=0HYADHIBS463 tag=G01PA935BH25 type=write size=2650668 2024-09-14T11:17:10.508 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.507+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~J9HQ4SSIGV1K.0 size=1048576 2024-09-14T11:17:10.511 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.511+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~J9HQ4SSIGV1K.1 size=1048576 2024-09-14T11:17:10.514 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.515+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~J9HQ4SSIGV1K.2 size=501579 2024-09-14T11:17:10.520 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.523+0000 7fe125ff88c0 1 < completed multipart upload key=W0B19NBHNLMZ upload=J9HQ4SSIGV1K tag=T892ZCN58PZK type=write size=3647307 2024-09-14T11:17:10.524 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.527+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=FQDHD7NZG7DE type=del size=3110664 2024-09-14T11:17:10.528 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.531+0000 7fe125ff88c0 1 < completed write operation key=SSNV25PDLDIS tag=FIOYMOS3FLN7 type=write size=366479 2024-09-14T11:17:10.535 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.535+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~M3U0F5EFUR80.0 size=912126 2024-09-14T11:17:10.535 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.535+0000 7fe125ff88c0 1 > prepared multipart upload key=F9I82N7RQC81 upload=M3U0F5EFUR80 tag=IT1CILD0ZZ7J type=write size=1960702 2024-09-14T11:17:10.539 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.539+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~5KFDKRVRO5PJ.0 size=455448 2024-09-14T11:17:10.544 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.543+0000 7fe125ff88c0 1 < completed multipart upload key=FQ5WT12KB664 upload=5KFDKRVRO5PJ tag=FKK8BD22HG7R type=write size=1504024 2024-09-14T11:17:10.551 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.551+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~ZWQMY1YRZ1BB.0 size=968867 2024-09-14T11:17:10.551 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.551+0000 7fe125ff88c0 1 > prepared multipart upload key=35EB6U5O4A51 upload=ZWQMY1YRZ1BB tag=K1ZBSFSJ4IWE type=write size=2017443 2024-09-14T11:17:10.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.555+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~LZGBVD6AWUFS.0 size=1048576 2024-09-14T11:17:10.558 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.559+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~LZGBVD6AWUFS.1 size=317151 2024-09-14T11:17:10.567 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.567+0000 7fe125ff88c0 1 < completed multipart upload key=V6B470G93KFT upload=LZGBVD6AWUFS tag=JW5F8FWOU1JW type=write size=2414303 2024-09-14T11:17:10.571 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.571+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=CLS4HT61LA6U type=del size=537444 2024-09-14T11:17:10.575 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.575+0000 7fe125ff88c0 1 < completed write operation key=L4XO0WTYKNXY tag=FXQWSI7BZ2B1 type=write size=8559 2024-09-14T11:17:10.581 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.583+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~JUP2T6SX6H9Q.0 size=1048576 2024-09-14T11:17:10.584 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.587+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~JUP2T6SX6H9Q.1 size=1048576 2024-09-14T11:17:10.587 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.587+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~JUP2T6SX6H9Q.2 size=702779 2024-09-14T11:17:10.587 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.587+0000 7fe125ff88c0 1 > prepared multipart upload key=YN2HI39GPEDF upload=JUP2T6SX6H9Q tag=NIGEI0IPT5NH type=write size=3848507 2024-09-14T11:17:10.594 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.595+0000 7fe125ff88c0 1 < suggested remove operation key=YN2HI39GPEDF tag=4AVP18YDTLMA type=del 2024-09-14T11:17:10.598 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.599+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=UM5INS5UWGRH type=del size=2412406 2024-09-14T11:17:10.602 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.603+0000 7fe125ff88c0 1 < completed part key=_multipart_N94D3R7IOBNL.2~9WMQ0IBG8EQD.0 size=1048576 2024-09-14T11:17:10.605 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.607+0000 7fe125ff88c0 1 < completed part key=_multipart_N94D3R7IOBNL.2~9WMQ0IBG8EQD.1 size=400410 2024-09-14T11:17:10.611 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.611+0000 7fe125ff88c0 1 < completed multipart upload key=N94D3R7IOBNL upload=9WMQ0IBG8EQD tag=F97MKZW99KG2 type=write size=2497562 2024-09-14T11:17:10.614 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.615+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=1N0YQWD4KIQV type=del size=2600110 2024-09-14T11:17:10.618 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.619+0000 7fe125ff88c0 1 < completed delete operation key=N80X3YUF4OEL tag=AW23DC60XKY5 type=del 2024-09-14T11:17:10.622 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.623+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=3WOQPBB6KBJH type=del size=3654332 2024-09-14T11:17:10.626 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.627+0000 7fe125ff88c0 1 < completed delete operation key=N80X3YUF4OEL tag=53XK87MG84I5 type=del 2024-09-14T11:17:10.633 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.635+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~3OSUCSVYRLP2.0 size=1048576 2024-09-14T11:17:10.636 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.635+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~3OSUCSVYRLP2.1 size=874870 2024-09-14T11:17:10.636 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.635+0000 7fe125ff88c0 1 > prepared multipart upload key=ESVFZQQXE3GT upload=3OSUCSVYRLP2 tag=NCN5BR9GNVA2 type=write size=2972022 2024-09-14T11:17:10.639 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.639+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~N1UZAN131G29.0 size=1048576 2024-09-14T11:17:10.642 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.643+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~N1UZAN131G29.1 size=525939 2024-09-14T11:17:10.648 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.647+0000 7fe125ff88c0 1 < completed multipart upload key=K3P6U6NU8I01 upload=N1UZAN131G29 tag=0B701NHT7ADL type=write size=2623091 2024-09-14T11:17:10.652 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.651+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=HL18HHVKUM8G type=del size=3901216 2024-09-14T11:17:10.653 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.655+0000 7fe125ff88c0 1 < canceled part key=_multipart_0FITHLGQKQEC.2~C6V0S005F3UE.0 size=756661 2024-09-14T11:17:10.659 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.659+0000 7fe125ff88c0 1 < canceled multipart upload key=0FITHLGQKQEC upload=C6V0S005F3UE tag=X1OM1UDZ3NNU type=write size=1805237 2024-09-14T11:17:10.662 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.663+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=80F2SU1IZLH8 type=del size=3998937 2024-09-14T11:17:10.666 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.667+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~RIQJ7YAEH8CW.0 size=714007 2024-09-14T11:17:10.672 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.671+0000 7fe125ff88c0 1 < completed multipart upload key=SSNV25PDLDIS upload=RIQJ7YAEH8CW tag=5OX0B551PSZJ type=write size=1762583 2024-09-14T11:17:10.680 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.679+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~EUJPHB23Y3UB.0 size=1048576 2024-09-14T11:17:10.683 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.683+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~EUJPHB23Y3UB.1 size=1048576 2024-09-14T11:17:10.686 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.687+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~EUJPHB23Y3UB.2 size=190616 2024-09-14T11:17:10.686 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.687+0000 7fe125ff88c0 1 > prepared multipart upload key=K3P6U6NU8I01 upload=EUJPHB23Y3UB tag=EQ7ABE8XG887 type=write size=3336344 2024-09-14T11:17:10.690 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.691+0000 7fe125ff88c0 1 < completed delete operation key=F9I82N7RQC81 tag=H8SKLYBLVMYB type=del 2024-09-14T11:17:10.694 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.695+0000 7fe125ff88c0 1 > prepared operation key=FQ5WT12KB664 tag=M2BA3WDEU8EI type=write size=651825 2024-09-14T11:17:10.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.699+0000 7fe125ff88c0 1 < completed delete operation key=V6B470G93KFT tag=QQ54I9T0QTK9 type=del 2024-09-14T11:17:10.703 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.703+0000 7fe125ff88c0 1 > prepared operation key=0FITHLGQKQEC tag=UY69YY16JK3V type=write size=386919 2024-09-14T11:17:10.708 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.707+0000 7fe125ff88c0 1 < completed delete operation key=2UXA6SXDTUFT tag=Y00ZF98DTTS2 type=del 2024-09-14T11:17:10.712 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.711+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=H18IU855VH5W type=del size=2113500 2024-09-14T11:17:10.715 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.715+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~0HYADHIBS463.0 size=1048576 2024-09-14T11:17:10.719 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.719+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~0HYADHIBS463.1 size=553516 2024-09-14T11:17:10.726 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.727+0000 7fe125ff88c0 1 < completed multipart upload key=FQ5WT12KB664 upload=0HYADHIBS463 tag=G01PA935BH25 type=write size=2650668 2024-09-14T11:17:10.734 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.735+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~11M1HKZ2EYR0.0 size=1048576 2024-09-14T11:17:10.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.739+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~11M1HKZ2EYR0.1 size=679780 2024-09-14T11:17:10.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.739+0000 7fe125ff88c0 1 > prepared multipart upload key=K3P6U6NU8I01 upload=11M1HKZ2EYR0 tag=Q3S9NLEBG4JQ type=write size=2776932 2024-09-14T11:17:10.741 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.743+0000 7fe125ff88c0 1 < completed delete operation key=V6B470G93KFT tag=FQDHD7NZG7DE type=del 2024-09-14T11:17:10.747 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.747+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~CG2VGKZBWJKN.0 size=1048576 2024-09-14T11:17:10.750 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.751+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~CG2VGKZBWJKN.1 size=309712 2024-09-14T11:17:10.750 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.751+0000 7fe125ff88c0 1 > prepared multipart upload key=YCF2PCJ9TZMR upload=CG2VGKZBWJKN tag=P7L18MRT8SNG type=write size=2406864 2024-09-14T11:17:10.754 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.755+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~M3U0F5EFUR80.0 size=912126 2024-09-14T11:17:10.760 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.759+0000 7fe125ff88c0 1 < completed multipart upload key=F9I82N7RQC81 upload=M3U0F5EFUR80 tag=IT1CILD0ZZ7J type=write size=1960702 2024-09-14T11:17:10.764 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.767+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=AJI74JRM9DA0 type=write size=440823 2024-09-14T11:17:10.768 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.767+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~ZWQMY1YRZ1BB.0 size=968867 2024-09-14T11:17:10.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.775+0000 7fe125ff88c0 1 < completed multipart upload key=35EB6U5O4A51 upload=ZWQMY1YRZ1BB tag=K1ZBSFSJ4IWE type=write size=2017443 2024-09-14T11:17:10.781 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.783+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~XP4K3161R1IH.0 size=235072 2024-09-14T11:17:10.781 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.783+0000 7fe125ff88c0 1 > prepared multipart upload key=SSNV25PDLDIS upload=XP4K3161R1IH tag=68L815I51H7W type=write size=1283648 2024-09-14T11:17:10.784 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.787+0000 7fe125ff88c0 1 < completed delete operation key=2UXA6SXDTUFT tag=CLS4HT61LA6U type=del 2024-09-14T11:17:10.788 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.787+0000 7fe125ff88c0 1 > prepared operation key=YFRH8WECBTJK tag=5DO2CFTSIFE1 type=del size=279190 2024-09-14T11:17:10.792 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.791+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~JUP2T6SX6H9Q.0 size=1048576 2024-09-14T11:17:10.796 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.795+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~JUP2T6SX6H9Q.1 size=1048576 2024-09-14T11:17:10.799 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.799+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~JUP2T6SX6H9Q.2 size=702779 2024-09-14T11:17:10.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.807+0000 7fe125ff88c0 1 < completed multipart upload key=YN2HI39GPEDF upload=JUP2T6SX6H9Q tag=NIGEI0IPT5NH type=write size=3848507 2024-09-14T11:17:10.811 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.811+0000 7fe125ff88c0 1 > prepared part key=_multipart_WEA3MQ0DI42N.2~96966DAHD1FY.0 size=445417 2024-09-14T11:17:10.811 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.811+0000 7fe125ff88c0 1 > prepared multipart upload key=WEA3MQ0DI42N upload=96966DAHD1FY tag=1J7JF9GWINAW type=write size=1493993 2024-09-14T11:17:10.815 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.815+0000 7fe125ff88c0 1 < completed delete operation key=W0B19NBHNLMZ tag=UM5INS5UWGRH type=del 2024-09-14T11:17:10.822 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.823+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~JDVY5FYPBDL5.0 size=1048576 2024-09-14T11:17:10.825 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.827+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~JDVY5FYPBDL5.1 size=417380 2024-09-14T11:17:10.825 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.827+0000 7fe125ff88c0 1 > prepared multipart upload key=3OU4U9JF3ZD5 upload=JDVY5FYPBDL5 tag=56OABJ4QAT00 type=write size=2514532 2024-09-14T11:17:10.829 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.831+0000 7fe125ff88c0 1 < completed delete operation key=F9I82N7RQC81 tag=1N0YQWD4KIQV type=del 2024-09-14T11:17:10.832 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.835+0000 7fe125ff88c0 1 > prepared operation key=3OU4U9JF3ZD5 tag=X1X0KAF9SSCI type=del size=1753017 2024-09-14T11:17:10.837 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.839+0000 7fe125ff88c0 1 < completed delete operation key=2LH5U05C2F8C tag=3WOQPBB6KBJH type=del 2024-09-14T11:17:10.841 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.843+0000 7fe125ff88c0 1 > prepared operation key=N80X3YUF4OEL tag=X7CCQUEPM21R type=write size=144811 2024-09-14T11:17:10.846 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.847+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~3OSUCSVYRLP2.0 size=1048576 2024-09-14T11:17:10.849 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.851+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~3OSUCSVYRLP2.1 size=874870 2024-09-14T11:17:10.855 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.855+0000 7fe125ff88c0 1 < completed multipart upload key=ESVFZQQXE3GT upload=3OSUCSVYRLP2 tag=NCN5BR9GNVA2 type=write size=2972022 2024-09-14T11:17:10.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.863+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~LQO7F0JK2RFF.0 size=1048576 2024-09-14T11:17:10.866 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.867+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~LQO7F0JK2RFF.1 size=718492 2024-09-14T11:17:10.866 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.867+0000 7fe125ff88c0 1 > prepared multipart upload key=21HC4VMHXS6L upload=LQO7F0JK2RFF tag=EDVHF2NEB8H3 type=write size=2815644 2024-09-14T11:17:10.870 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.871+0000 7fe125ff88c0 1 < completed delete operation key=F9I82N7RQC81 tag=HL18HHVKUM8G type=del 2024-09-14T11:17:10.878 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.879+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~W5D9BHXJKQ2B.0 size=120057 2024-09-14T11:17:10.878 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.879+0000 7fe125ff88c0 1 > prepared multipart upload key=21HC4VMHXS6L upload=W5D9BHXJKQ2B tag=3YY6MEPIP5WK type=write size=1168633 2024-09-14T11:17:10.881 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.883+0000 7fe125ff88c0 1 < completed delete operation key=K3P6U6NU8I01 tag=80F2SU1IZLH8 type=del 2024-09-14T11:17:10.888 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.891+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~VLMF46VFZ7HX.0 size=1048576 2024-09-14T11:17:10.892 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.891+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~VLMF46VFZ7HX.1 size=456557 2024-09-14T11:17:10.892 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.891+0000 7fe125ff88c0 1 > prepared multipart upload key=4D2X7151977X upload=VLMF46VFZ7HX tag=O2XW6305FAE4 type=write size=2553709 2024-09-14T11:17:10.897 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.899+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~EUJPHB23Y3UB.0 size=1048576 2024-09-14T11:17:10.900 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.899+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~EUJPHB23Y3UB.1 size=1048576 2024-09-14T11:17:10.900 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.899+0000 7fe125ff88c0 1 < canceled part key=_multipart_K3P6U6NU8I01.2~EUJPHB23Y3UB.2 size=190616 2024-09-14T11:17:10.906 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.907+0000 7fe125ff88c0 1 < canceled multipart upload key=K3P6U6NU8I01 upload=EUJPHB23Y3UB tag=EQ7ABE8XG887 type=write size=3336344 2024-09-14T11:17:10.910 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.911+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=BFY7BT0ZRSAF type=del size=1143305 2024-09-14T11:17:10.914 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.915+0000 7fe125ff88c0 1 < completed write operation key=FQ5WT12KB664 tag=M2BA3WDEU8EI type=write size=651825 2024-09-14T11:17:10.925 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.927+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~UP4AO25ZQT3S.0 size=1048576 2024-09-14T11:17:10.928 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.931+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~UP4AO25ZQT3S.1 size=1048576 2024-09-14T11:17:10.931 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.931+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~UP4AO25ZQT3S.2 size=729418 2024-09-14T11:17:10.932 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.931+0000 7fe125ff88c0 1 > prepared multipart upload key=L4XO0WTYKNXY upload=UP4AO25ZQT3S tag=WTIPFBZIRLP4 type=write size=3875146 2024-09-14T11:17:10.936 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.939+0000 7fe125ff88c0 1 < completed write operation key=0FITHLGQKQEC tag=UY69YY16JK3V type=write size=386919 2024-09-14T11:17:10.944 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.943+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~0YBETPB88LGI.0 size=1048576 2024-09-14T11:17:10.947 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.947+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~0YBETPB88LGI.1 size=1048576 2024-09-14T11:17:10.950 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.951+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~0YBETPB88LGI.2 size=234097 2024-09-14T11:17:10.951 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.951+0000 7fe125ff88c0 1 > prepared multipart upload key=N80X3YUF4OEL upload=0YBETPB88LGI tag=WG5VODV60LJL type=write size=3379825 2024-09-14T11:17:10.954 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.955+0000 7fe125ff88c0 1 < completed delete operation key=YCF2PCJ9TZMR tag=H18IU855VH5W type=del 2024-09-14T11:17:10.962 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.963+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~VDBU541JHM1B.0 size=589381 2024-09-14T11:17:10.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.963+0000 7fe125ff88c0 1 > prepared multipart upload key=L4XO0WTYKNXY upload=VDBU541JHM1B tag=A305SW6YE0D2 type=write size=1637957 2024-09-14T11:17:10.967 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.967+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~11M1HKZ2EYR0.0 size=1048576 2024-09-14T11:17:10.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.971+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~11M1HKZ2EYR0.1 size=679780 2024-09-14T11:17:10.976 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.975+0000 7fe125ff88c0 1 < completed multipart upload key=K3P6U6NU8I01 upload=11M1HKZ2EYR0 tag=Q3S9NLEBG4JQ type=write size=2776932 2024-09-14T11:17:10.981 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.983+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=CCFC8VS20WJR type=del size=3031940 2024-09-14T11:17:10.985 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.987+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~CG2VGKZBWJKN.0 size=1048576 2024-09-14T11:17:10.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.991+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~CG2VGKZBWJKN.1 size=309712 2024-09-14T11:17:10.995 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.995+0000 7fe125ff88c0 1 < completed multipart upload key=YCF2PCJ9TZMR upload=CG2VGKZBWJKN tag=P7L18MRT8SNG type=write size=2406864 2024-09-14T11:17:10.999 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:10.999+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=BYP7XCY41262 type=del size=3981242 2024-09-14T11:17:11.003 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.003+0000 7fe125ff88c0 1 < canceled operation key=4D2X7151977X tag=AJI74JRM9DA0 type=write size=440823 2024-09-14T11:17:11.007 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.007+0000 7fe125ff88c0 1 > prepared operation key=3OU4U9JF3ZD5 tag=Z518II0QIMGS type=del size=2335791 2024-09-14T11:17:11.011 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.011+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~XP4K3161R1IH.0 size=235072 2024-09-14T11:17:11.016 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.015+0000 7fe125ff88c0 1 < completed multipart upload key=SSNV25PDLDIS upload=XP4K3161R1IH tag=68L815I51H7W type=write size=1283648 2024-09-14T11:17:11.020 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.019+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=V3KK6I3FGPKZ type=write size=112335 2024-09-14T11:17:11.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.027+0000 7fe125ff88c0 1 < suggested remove operation key=YFRH8WECBTJK tag=5DO2CFTSIFE1 type=del 2024-09-14T11:17:11.033 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.035+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~1P8GZ27QF10S.0 size=802923 2024-09-14T11:17:11.033 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.035+0000 7fe125ff88c0 1 > prepared multipart upload key=SUCH37O8V1LY upload=1P8GZ27QF10S tag=2VE84I4UD7B4 type=write size=1851499 2024-09-14T11:17:11.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.039+0000 7fe125ff88c0 1 < completed part key=_multipart_WEA3MQ0DI42N.2~96966DAHD1FY.0 size=445417 2024-09-14T11:17:11.043 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.043+0000 7fe125ff88c0 1 < completed multipart upload key=WEA3MQ0DI42N upload=96966DAHD1FY tag=1J7JF9GWINAW type=write size=1493993 2024-09-14T11:17:11.049 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.051+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~5YJ3TU157TC5.0 size=1048576 2024-09-14T11:17:11.052 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.051+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~5YJ3TU157TC5.1 size=1048576 2024-09-14T11:17:11.055 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.055+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~5YJ3TU157TC5.2 size=1011099 2024-09-14T11:17:11.055 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.055+0000 7fe125ff88c0 1 > prepared multipart upload key=YN2HI39GPEDF upload=5YJ3TU157TC5 tag=CBDDMSQIPOX4 type=write size=4156827 2024-09-14T11:17:11.059 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.059+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~JDVY5FYPBDL5.0 size=1048576 2024-09-14T11:17:11.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.063+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~JDVY5FYPBDL5.1 size=417380 2024-09-14T11:17:11.067 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.067+0000 7fe125ff88c0 1 < completed multipart upload key=3OU4U9JF3ZD5 upload=JDVY5FYPBDL5 tag=56OABJ4QAT00 type=write size=2514532 2024-09-14T11:17:11.074 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.075+0000 7fe125ff88c0 1 > prepared part key=_multipart_6PLUU2QIO9LJ.2~GB2U2RTXIUJW.0 size=1048576 2024-09-14T11:17:11.077 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.079+0000 7fe125ff88c0 1 > prepared part key=_multipart_6PLUU2QIO9LJ.2~GB2U2RTXIUJW.1 size=1048576 2024-09-14T11:17:11.080 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.079+0000 7fe125ff88c0 1 > prepared part key=_multipart_6PLUU2QIO9LJ.2~GB2U2RTXIUJW.2 size=818123 2024-09-14T11:17:11.080 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.079+0000 7fe125ff88c0 1 > prepared multipart upload key=6PLUU2QIO9LJ upload=GB2U2RTXIUJW tag=HVEH3TWG9CO1 type=write size=3963851 2024-09-14T11:17:11.084 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.083+0000 7fe125ff88c0 1 < completed delete operation key=3OU4U9JF3ZD5 tag=X1X0KAF9SSCI type=del 2024-09-14T11:17:11.087 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.087+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=43WUKWQC605L type=del size=2939039 2024-09-14T11:17:11.091 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.091+0000 7fe125ff88c0 1 < canceled operation key=N80X3YUF4OEL tag=X7CCQUEPM21R type=write size=144811 2024-09-14T11:17:11.095 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.095+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=5CHMXVVW5OYS type=del size=3162004 2024-09-14T11:17:11.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.099+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~LQO7F0JK2RFF.0 size=1048576 2024-09-14T11:17:11.102 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.103+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~LQO7F0JK2RFF.1 size=718492 2024-09-14T11:17:11.108 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.111+0000 7fe125ff88c0 1 < completed multipart upload key=21HC4VMHXS6L upload=LQO7F0JK2RFF tag=EDVHF2NEB8H3 type=write size=2815644 2024-09-14T11:17:11.114 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.115+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~K1NPMFHCJI9E.0 size=1048576 2024-09-14T11:17:11.117 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.119+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~K1NPMFHCJI9E.1 size=1048576 2024-09-14T11:17:11.119 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.119+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~K1NPMFHCJI9E.2 size=27858 2024-09-14T11:17:11.120 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.119+0000 7fe125ff88c0 1 > prepared multipart upload key=4D2X7151977X upload=K1NPMFHCJI9E tag=RT6AE7LEXSUK type=write size=3173586 2024-09-14T11:17:11.121 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.123+0000 7fe125ff88c0 1 < canceled part key=_multipart_21HC4VMHXS6L.2~W5D9BHXJKQ2B.0 size=120057 2024-09-14T11:17:11.127 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.127+0000 7fe125ff88c0 1 < canceled multipart upload key=21HC4VMHXS6L upload=W5D9BHXJKQ2B tag=3YY6MEPIP5WK type=write size=1168633 2024-09-14T11:17:11.133 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.135+0000 7fe125ff88c0 1 > prepared part key=_multipart_WEA3MQ0DI42N.2~RG1ICI4NHR5H.0 size=437575 2024-09-14T11:17:11.133 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.135+0000 7fe125ff88c0 1 > prepared multipart upload key=WEA3MQ0DI42N upload=RG1ICI4NHR5H tag=Z3R9HLKY5XCG type=write size=1486151 2024-09-14T11:17:11.137 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.139+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~VLMF46VFZ7HX.0 size=1048576 2024-09-14T11:17:11.140 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.139+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~VLMF46VFZ7HX.1 size=456557 2024-09-14T11:17:11.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.147+0000 7fe125ff88c0 1 < completed multipart upload key=4D2X7151977X upload=VLMF46VFZ7HX tag=O2XW6305FAE4 type=write size=2553709 2024-09-14T11:17:11.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.151+0000 7fe125ff88c0 1 > prepared operation key=3OU4U9JF3ZD5 tag=U29J6JPH9JSA type=del size=3328002 2024-09-14T11:17:11.153 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.155+0000 7fe125ff88c0 1 < completed delete operation key=2UXA6SXDTUFT tag=BFY7BT0ZRSAF type=del 2024-09-14T11:17:11.159 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.159+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~8OANOB60X0NS.0 size=1048576 2024-09-14T11:17:11.162 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.163+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~8OANOB60X0NS.1 size=1048576 2024-09-14T11:17:11.165 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.167+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~8OANOB60X0NS.2 size=350165 2024-09-14T11:17:11.165 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.167+0000 7fe125ff88c0 1 > prepared multipart upload key=N80X3YUF4OEL upload=8OANOB60X0NS tag=L48BXAWXH5N9 type=write size=3495893 2024-09-14T11:17:11.166 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.167+0000 7fe125ff88c0 1 < canceled part key=_multipart_L4XO0WTYKNXY.2~UP4AO25ZQT3S.0 size=1048576 2024-09-14T11:17:11.168 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.171+0000 7fe125ff88c0 1 < completed part key=_multipart_L4XO0WTYKNXY.2~UP4AO25ZQT3S.1 size=1048576 2024-09-14T11:17:11.171 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.171+0000 7fe125ff88c0 1 < completed part key=_multipart_L4XO0WTYKNXY.2~UP4AO25ZQT3S.2 size=729418 2024-09-14T11:17:11.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.179+0000 7fe125ff88c0 1 < canceled multipart upload key=L4XO0WTYKNXY upload=UP4AO25ZQT3S tag=WTIPFBZIRLP4 type=write size=3875146 2024-09-14T11:17:11.181 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.183+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=Q67LMBFEQAKC type=del size=2948423 2024-09-14T11:17:11.186 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.187+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~0YBETPB88LGI.0 size=1048576 2024-09-14T11:17:11.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.191+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~0YBETPB88LGI.1 size=1048576 2024-09-14T11:17:11.192 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.195+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~0YBETPB88LGI.2 size=234097 2024-09-14T11:17:11.199 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.199+0000 7fe125ff88c0 1 < completed multipart upload key=N80X3YUF4OEL upload=0YBETPB88LGI tag=WG5VODV60LJL type=write size=3379825 2024-09-14T11:17:11.203 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.203+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=LHWUVSZ0EZRG type=del size=887662 2024-09-14T11:17:11.204 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.203+0000 7fe125ff88c0 1 < canceled part key=_multipart_L4XO0WTYKNXY.2~VDBU541JHM1B.0 size=589381 2024-09-14T11:17:11.210 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.211+0000 7fe125ff88c0 1 < canceled multipart upload key=L4XO0WTYKNXY upload=VDBU541JHM1B tag=A305SW6YE0D2 type=write size=1637957 2024-09-14T11:17:11.213 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.215+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=4OSH0LLQEDVV type=write size=453409 2024-09-14T11:17:11.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.219+0000 7fe125ff88c0 1 < completed delete operation key=35EB6U5O4A51 tag=CCFC8VS20WJR type=del 2024-09-14T11:17:11.224 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.223+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~85YXVFSL58X9.0 size=639798 2024-09-14T11:17:11.224 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.223+0000 7fe125ff88c0 1 > prepared multipart upload key=W0B19NBHNLMZ upload=85YXVFSL58X9 tag=25TDHWQ5KIFR type=write size=1688374 2024-09-14T11:17:11.231 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.231+0000 7fe125ff88c0 1 < suggested remove operation key=K3P6U6NU8I01 tag=BYP7XCY41262 type=del 2024-09-14T11:17:11.235 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.235+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=8B7HXP2KP311 type=del size=1211968 2024-09-14T11:17:11.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.239+0000 7fe125ff88c0 1 < completed delete operation key=3OU4U9JF3ZD5 tag=Z518II0QIMGS type=del 2024-09-14T11:17:11.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.243+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=DWAUG4DE15P5 type=write size=326213 2024-09-14T11:17:11.246 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.247+0000 7fe125ff88c0 1 < completed write operation key=6PLUU2QIO9LJ tag=V3KK6I3FGPKZ type=write size=112335 2024-09-14T11:17:11.253 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.255+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~CB3P88X9AXCC.0 size=1048576 2024-09-14T11:17:11.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.255+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~CB3P88X9AXCC.1 size=1048576 2024-09-14T11:17:11.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.259+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~CB3P88X9AXCC.2 size=879148 2024-09-14T11:17:11.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.259+0000 7fe125ff88c0 1 > prepared multipart upload key=6C3JZKTB8BP3 upload=CB3P88X9AXCC tag=7QQLWFD29R12 type=write size=4024876 2024-09-14T11:17:11.262 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.263+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~1P8GZ27QF10S.0 size=802923 2024-09-14T11:17:11.270 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.271+0000 7fe125ff88c0 1 < completed multipart upload key=SUCH37O8V1LY upload=1P8GZ27QF10S tag=2VE84I4UD7B4 type=write size=1851499 2024-09-14T11:17:11.274 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.275+0000 7fe125ff88c0 1 > prepared operation key=YFRH8WECBTJK tag=2XM8XGX8GVY9 type=del size=656217 2024-09-14T11:17:11.278 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.279+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~5YJ3TU157TC5.0 size=1048576 2024-09-14T11:17:11.281 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.283+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~5YJ3TU157TC5.1 size=1048576 2024-09-14T11:17:11.284 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.283+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~5YJ3TU157TC5.2 size=1011099 2024-09-14T11:17:11.290 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.291+0000 7fe125ff88c0 1 < completed multipart upload key=YN2HI39GPEDF upload=5YJ3TU157TC5 tag=CBDDMSQIPOX4 type=write size=4156827 2024-09-14T11:17:11.294 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.295+0000 7fe125ff88c0 1 > prepared operation key=YFRH8WECBTJK tag=6GA7T09NEE59 type=del size=1016330 2024-09-14T11:17:11.297 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.299+0000 7fe125ff88c0 1 < completed part key=_multipart_6PLUU2QIO9LJ.2~GB2U2RTXIUJW.0 size=1048576 2024-09-14T11:17:11.300 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.303+0000 7fe125ff88c0 1 < completed part key=_multipart_6PLUU2QIO9LJ.2~GB2U2RTXIUJW.1 size=1048576 2024-09-14T11:17:11.303 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.303+0000 7fe125ff88c0 1 < completed part key=_multipart_6PLUU2QIO9LJ.2~GB2U2RTXIUJW.2 size=818123 2024-09-14T11:17:11.310 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.311+0000 7fe125ff88c0 1 < completed multipart upload key=6PLUU2QIO9LJ upload=GB2U2RTXIUJW tag=HVEH3TWG9CO1 type=write size=3963851 2024-09-14T11:17:11.313 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.315+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=I56K3GC8NHZ0 type=del size=778361 2024-09-14T11:17:11.316 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.319+0000 7fe125ff88c0 1 < completed delete operation key=SSNV25PDLDIS tag=43WUKWQC605L type=del 2024-09-14T11:17:11.320 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.319+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=6RIR8B8RXYPR type=del size=369924 2024-09-14T11:17:11.324 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.323+0000 7fe125ff88c0 1 < completed delete operation key=F9I82N7RQC81 tag=5CHMXVVW5OYS type=del 2024-09-14T11:17:11.328 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.331+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=7FXQZTPEWAMJ type=del size=3270519 2024-09-14T11:17:11.332 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.331+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~K1NPMFHCJI9E.0 size=1048576 2024-09-14T11:17:11.335 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.335+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~K1NPMFHCJI9E.1 size=1048576 2024-09-14T11:17:11.338 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.339+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~K1NPMFHCJI9E.2 size=27858 2024-09-14T11:17:11.344 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.343+0000 7fe125ff88c0 1 < completed multipart upload key=4D2X7151977X upload=K1NPMFHCJI9E tag=RT6AE7LEXSUK type=write size=3173586 2024-09-14T11:17:11.557 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.559+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~EUO3E6YLMVT6.0 size=1048576 2024-09-14T11:17:11.560 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.559+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~EUO3E6YLMVT6.1 size=615809 2024-09-14T11:17:11.560 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.559+0000 7fe125ff88c0 1 > prepared multipart upload key=YN2HI39GPEDF upload=EUO3E6YLMVT6 tag=WHHZ23U5YRKQ type=write size=2712961 2024-09-14T11:17:11.563 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.563+0000 7fe125ff88c0 1 < completed part key=_multipart_WEA3MQ0DI42N.2~RG1ICI4NHR5H.0 size=437575 2024-09-14T11:17:11.569 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.571+0000 7fe125ff88c0 1 < completed multipart upload key=WEA3MQ0DI42N upload=RG1ICI4NHR5H tag=Z3R9HLKY5XCG type=write size=1486151 2024-09-14T11:17:11.576 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.575+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~I73H0L9RKZMY.0 size=1048576 2024-09-14T11:17:11.579 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.579+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~I73H0L9RKZMY.1 size=410123 2024-09-14T11:17:11.579 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.579+0000 7fe125ff88c0 1 > prepared multipart upload key=2UXA6SXDTUFT upload=I73H0L9RKZMY tag=0ZSP443N5HK5 type=write size=2507275 2024-09-14T11:17:11.586 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.587+0000 7fe125ff88c0 1 < suggested remove operation key=3OU4U9JF3ZD5 tag=U29J6JPH9JSA type=del 2024-09-14T11:17:11.593 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.595+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~QET2L3XL9EVN.0 size=556608 2024-09-14T11:17:11.593 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.595+0000 7fe125ff88c0 1 > prepared multipart upload key=1ML6RIXI4C5P upload=QET2L3XL9EVN tag=28EJMG0Z14ND type=write size=1605184 2024-09-14T11:17:11.597 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.599+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~8OANOB60X0NS.0 size=1048576 2024-09-14T11:17:11.600 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.603+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~8OANOB60X0NS.1 size=1048576 2024-09-14T11:17:11.601 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.603+0000 7fe125ff88c0 1 < canceled part key=_multipart_N80X3YUF4OEL.2~8OANOB60X0NS.2 size=350165 2024-09-14T11:17:11.607 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.607+0000 7fe125ff88c0 1 < canceled multipart upload key=N80X3YUF4OEL upload=8OANOB60X0NS tag=L48BXAWXH5N9 type=write size=3495893 2024-09-14T11:17:11.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.611+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=GSDALC4AICIN type=del size=948311 2024-09-14T11:17:11.615 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.615+0000 7fe125ff88c0 1 < completed delete operation key=2UXA6SXDTUFT tag=Q67LMBFEQAKC type=del 2024-09-14T11:17:11.619 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.619+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=EMU7CHRQX9IT type=del size=3203012 2024-09-14T11:17:11.623 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.623+0000 7fe125ff88c0 1 < completed delete operation key=YGEVGH840L18 tag=LHWUVSZ0EZRG type=del 2024-09-14T11:17:11.627 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.627+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=A9I1T88F8FLG type=del size=2095411 2024-09-14T11:17:11.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.631+0000 7fe125ff88c0 -1 < no bi entry to suggest for operation key=K3P6U6NU8I01 tag=4OSH0LLQEDVV type=write size=453409: (2) No such file or directory 2024-09-14T11:17:11.634 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.635+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=S4H7NHOV91WH type=del size=1230802 2024-09-14T11:17:11.639 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.639+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~85YXVFSL58X9.0 size=639798 2024-09-14T11:17:11.645 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.647+0000 7fe125ff88c0 1 < completed multipart upload key=W0B19NBHNLMZ upload=85YXVFSL58X9 tag=25TDHWQ5KIFR type=write size=1688374 2024-09-14T11:17:11.650 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.651+0000 7fe125ff88c0 1 > prepared operation key=1ML6RIXI4C5P tag=KMY0U5VX3L3R type=del size=3037996 2024-09-14T11:17:11.655 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.655+0000 7fe125ff88c0 1 < completed delete operation key=2KEKSWK0UT6C tag=8B7HXP2KP311 type=del 2024-09-14T11:17:11.659 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.659+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=I1EC4MVMA2AI type=del size=2195116 2024-09-14T11:17:11.663 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.663+0000 7fe125ff88c0 1 < completed write operation key=F9I82N7RQC81 tag=DWAUG4DE15P5 type=write size=326213 2024-09-14T11:17:11.667 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.667+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=FMWSJI8NB9E1 type=del size=684 2024-09-14T11:17:11.672 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.671+0000 7fe125ff88c0 1 < completed part key=_multipart_6C3JZKTB8BP3.2~CB3P88X9AXCC.0 size=1048576 2024-09-14T11:17:11.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.675+0000 7fe125ff88c0 1 < completed part key=_multipart_6C3JZKTB8BP3.2~CB3P88X9AXCC.1 size=1048576 2024-09-14T11:17:11.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.679+0000 7fe125ff88c0 1 < completed part key=_multipart_6C3JZKTB8BP3.2~CB3P88X9AXCC.2 size=879148 2024-09-14T11:17:11.683 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.683+0000 7fe125ff88c0 1 < completed multipart upload key=6C3JZKTB8BP3 upload=CB3P88X9AXCC tag=7QQLWFD29R12 type=write size=4024876 2024-09-14T11:17:11.687 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.687+0000 7fe125ff88c0 1 > prepared operation key=K05LARTJ2QZ3 tag=KZXLKLU5DO6B type=write size=983853 2024-09-14T11:17:11.691 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.691+0000 7fe125ff88c0 1 < completed delete operation key=YFRH8WECBTJK tag=2XM8XGX8GVY9 type=del 2024-09-14T11:17:11.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.695+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=AE10ZX9T5PX0 type=write size=635022 2024-09-14T11:17:11.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.699+0000 7fe125ff88c0 1 < completed delete operation key=YFRH8WECBTJK tag=6GA7T09NEE59 type=del 2024-09-14T11:17:11.706 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.707+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~T66RIXUCMAUQ.0 size=521330 2024-09-14T11:17:11.706 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.707+0000 7fe125ff88c0 1 > prepared multipart upload key=LYBGDNKUROWH upload=T66RIXUCMAUQ tag=JYZVSFH7953R type=write size=1569906 2024-09-14T11:17:11.710 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.711+0000 7fe125ff88c0 1 < completed delete operation key=YCF2PCJ9TZMR tag=I56K3GC8NHZ0 type=del 2024-09-14T11:17:11.714 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.715+0000 7fe125ff88c0 1 > prepared operation key=46ZTDBWFVSUH tag=OG9PLX7YBTPK type=write size=674234 2024-09-14T11:17:11.718 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.719+0000 7fe125ff88c0 1 < completed delete operation key=2UXA6SXDTUFT tag=6RIR8B8RXYPR type=del 2024-09-14T11:17:11.722 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.723+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=LKU1H5RI3LOX type=del size=3826472 2024-09-14T11:17:11.730 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.731+0000 7fe125ff88c0 1 < suggested update operation key=ESVFZQQXE3GT tag=7FXQZTPEWAMJ type=del size=3270519 2024-09-14T11:17:11.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.739+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~Y4JE46Y4WXYO.0 size=496102 2024-09-14T11:17:11.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.739+0000 7fe125ff88c0 1 > prepared multipart upload key=0VBX2FWYCFEZ upload=Y4JE46Y4WXYO tag=BRNXLGK9CE9J type=write size=1544678 2024-09-14T11:17:11.741 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.743+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~EUO3E6YLMVT6.0 size=1048576 2024-09-14T11:17:11.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.747+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~EUO3E6YLMVT6.1 size=615809 2024-09-14T11:17:11.750 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.751+0000 7fe125ff88c0 1 < completed multipart upload key=YN2HI39GPEDF upload=EUO3E6YLMVT6 tag=WHHZ23U5YRKQ type=write size=2712961 2024-09-14T11:17:11.755 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.755+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=PWV8JC2CVPOX type=del size=2404182 2024-09-14T11:17:11.759 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.759+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~I73H0L9RKZMY.0 size=1048576 2024-09-14T11:17:11.759 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.759+0000 7fe125ff88c0 1 < canceled part key=_multipart_2UXA6SXDTUFT.2~I73H0L9RKZMY.1 size=410123 2024-09-14T11:17:11.765 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.767+0000 7fe125ff88c0 1 < canceled multipart upload key=2UXA6SXDTUFT upload=I73H0L9RKZMY tag=0ZSP443N5HK5 type=write size=2507275 2024-09-14T11:17:11.771 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.771+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~R2529X2C27EU.0 size=726394 2024-09-14T11:17:11.771 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.771+0000 7fe125ff88c0 1 > prepared multipart upload key=YCF2PCJ9TZMR upload=R2529X2C27EU tag=ARL4YJLRU9IE type=write size=1774970 2024-09-14T11:17:11.775 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.775+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~QET2L3XL9EVN.0 size=556608 2024-09-14T11:17:11.782 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.783+0000 7fe125ff88c0 1 < completed multipart upload key=1ML6RIXI4C5P upload=QET2L3XL9EVN tag=28EJMG0Z14ND type=write size=1605184 2024-09-14T11:17:11.786 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.787+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=CK9UGIQZ7KIC type=write size=301679 2024-09-14T11:17:11.789 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.791+0000 7fe125ff88c0 1 < completed delete operation key=6PLUU2QIO9LJ tag=GSDALC4AICIN type=del 2024-09-14T11:17:11.794 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.795+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=UZA63SRPLZNA type=del size=1418102 2024-09-14T11:17:11.797 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.799+0000 7fe125ff88c0 -1 < failed to complete operation key=ESVFZQQXE3GT tag=EMU7CHRQX9IT type=del size=3203012: (22) Invalid argument 2024-09-14T11:17:11.805 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.807+0000 7fe125ff88c0 1 > prepared part key=_multipart_WEA3MQ0DI42N.2~FFAKQ76AFYUF.0 size=720916 2024-09-14T11:17:11.805 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.807+0000 7fe125ff88c0 1 > prepared multipart upload key=WEA3MQ0DI42N upload=FFAKQ76AFYUF tag=ZVRQUPPPWNVY type=write size=1769492 2024-09-14T11:17:11.809 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.811+0000 7fe125ff88c0 1 < completed delete operation key=2KEKSWK0UT6C tag=A9I1T88F8FLG type=del 2024-09-14T11:17:11.812 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.815+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=K5H5WKB0XNVX type=write size=277152 2024-09-14T11:17:11.816 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.815+0000 7fe125ff88c0 1 < completed delete operation key=F9I82N7RQC81 tag=S4H7NHOV91WH type=del 2024-09-14T11:17:11.823 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.823+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~KXDZRCMOY2LK.0 size=276653 2024-09-14T11:17:11.823 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.823+0000 7fe125ff88c0 1 > prepared multipart upload key=0VBX2FWYCFEZ upload=KXDZRCMOY2LK tag=EBRHSNRTJ5J7 type=write size=1325229 2024-09-14T11:17:11.828 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.827+0000 7fe125ff88c0 1 < completed delete operation key=1ML6RIXI4C5P tag=KMY0U5VX3L3R type=del 2024-09-14T11:17:11.836 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.839+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~5J3QUTDJX43G.0 size=1048576 2024-09-14T11:17:11.839 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.839+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~5J3QUTDJX43G.1 size=843740 2024-09-14T11:17:11.840 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.839+0000 7fe125ff88c0 1 > prepared multipart upload key=6C3JZKTB8BP3 upload=5J3QUTDJX43G tag=J2OA2YXHWABG type=write size=2940892 2024-09-14T11:17:11.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.843+0000 7fe125ff88c0 1 < completed delete operation key=YN2HI39GPEDF tag=I1EC4MVMA2AI type=del 2024-09-14T11:17:11.850 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.855+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~MP8PF1A7O05O.0 size=585597 2024-09-14T11:17:11.850 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.855+0000 7fe125ff88c0 1 > prepared multipart upload key=F9I82N7RQC81 upload=MP8PF1A7O05O tag=CA390DWIL5T9 type=write size=1634173 2024-09-14T11:17:11.854 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.855+0000 7fe125ff88c0 1 < completed delete operation key=L4XO0WTYKNXY tag=FMWSJI8NB9E1 type=del 2024-09-14T11:17:11.861 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.863+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~56R4GGVOCUTK.0 size=558863 2024-09-14T11:17:11.861 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.863+0000 7fe125ff88c0 1 > prepared multipart upload key=4D2X7151977X upload=56R4GGVOCUTK tag=5K9UFHT7HHTW type=write size=1607439 2024-09-14T11:17:11.865 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.867+0000 7fe125ff88c0 1 < completed write operation key=K05LARTJ2QZ3 tag=KZXLKLU5DO6B type=write size=983853 2024-09-14T11:17:11.869 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.871+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=3WK56MKW4932 type=del size=559928 2024-09-14T11:17:11.873 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.875+0000 7fe125ff88c0 1 < completed write operation key=WEA3MQ0DI42N tag=AE10ZX9T5PX0 type=write size=635022 2024-09-14T11:17:11.877 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.879+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=VNFVAGTDTH9W type=del size=2922419 2024-09-14T11:17:11.881 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.883+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~T66RIXUCMAUQ.0 size=521330 2024-09-14T11:17:11.887 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.887+0000 7fe125ff88c0 1 < completed multipart upload key=LYBGDNKUROWH upload=T66RIXUCMAUQ tag=JYZVSFH7953R type=write size=1569906 2024-09-14T11:17:11.894 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.895+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~YQB8R0U4CYMG.0 size=1048576 2024-09-14T11:17:11.896 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.899+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~YQB8R0U4CYMG.1 size=1048576 2024-09-14T11:17:11.899 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.899+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~YQB8R0U4CYMG.2 size=243596 2024-09-14T11:17:11.899 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.899+0000 7fe125ff88c0 1 > prepared multipart upload key=W0B19NBHNLMZ upload=YQB8R0U4CYMG tag=M8P836HDWCGQ type=write size=3389324 2024-09-14T11:17:11.903 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.903+0000 7fe125ff88c0 1 < completed write operation key=46ZTDBWFVSUH tag=OG9PLX7YBTPK type=write size=674234 2024-09-14T11:17:11.906 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.907+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=QWGY4KD2T9IS type=del size=1935024 2024-09-14T11:17:11.910 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.911+0000 7fe125ff88c0 1 < completed delete operation key=K3P6U6NU8I01 tag=LKU1H5RI3LOX type=del 2024-09-14T11:17:11.917 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.919+0000 7fe125ff88c0 1 > prepared part key=_multipart_N94D3R7IOBNL.2~V6UJ02X9RXN8.0 size=1048576 2024-09-14T11:17:11.920 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.919+0000 7fe125ff88c0 1 > prepared part key=_multipart_N94D3R7IOBNL.2~V6UJ02X9RXN8.1 size=77166 2024-09-14T11:17:11.920 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.919+0000 7fe125ff88c0 1 > prepared multipart upload key=N94D3R7IOBNL upload=V6UJ02X9RXN8 tag=AYNN1BEWIRII type=write size=2174318 2024-09-14T11:17:11.923 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.923+0000 7fe125ff88c0 1 < completed part key=_multipart_0VBX2FWYCFEZ.2~Y4JE46Y4WXYO.0 size=496102 2024-09-14T11:17:11.929 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.931+0000 7fe125ff88c0 1 < completed multipart upload key=0VBX2FWYCFEZ upload=Y4JE46Y4WXYO tag=BRNXLGK9CE9J type=write size=1544678 2024-09-14T11:17:11.935 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.935+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~TKQ73PQC6RMZ.0 size=1048576 2024-09-14T11:17:11.938 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.939+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~TKQ73PQC6RMZ.1 size=1035771 2024-09-14T11:17:11.938 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.939+0000 7fe125ff88c0 1 > prepared multipart upload key=LYBGDNKUROWH upload=TKQ73PQC6RMZ tag=CBV1AW671KFA type=write size=3132923 2024-09-14T11:17:11.942 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.943+0000 7fe125ff88c0 1 < completed delete operation key=WEA3MQ0DI42N tag=PWV8JC2CVPOX type=del 2024-09-14T11:17:11.948 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.951+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~MWVRGJC5OY5Z.0 size=1048576 2024-09-14T11:17:11.951 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.951+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~MWVRGJC5OY5Z.1 size=781154 2024-09-14T11:17:11.951 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.951+0000 7fe125ff88c0 1 > prepared multipart upload key=N80X3YUF4OEL upload=MWVRGJC5OY5Z tag=GNJ86O9GK3SS type=write size=2878306 2024-09-14T11:17:11.955 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.955+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~R2529X2C27EU.0 size=726394 2024-09-14T11:17:11.961 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.963+0000 7fe125ff88c0 1 < completed multipart upload key=YCF2PCJ9TZMR upload=R2529X2C27EU tag=ARL4YJLRU9IE type=write size=1774970 2024-09-14T11:17:11.964 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.967+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=32R6LT4F42WP type=del size=1291816 2024-09-14T11:17:11.968 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.967+0000 7fe125ff88c0 1 < completed write operation key=W0B19NBHNLMZ tag=CK9UGIQZ7KIC type=write size=301679 2024-09-14T11:17:11.972 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.971+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=AX5P9BJ05YER type=del size=4052259 2024-09-14T11:17:11.976 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.975+0000 7fe125ff88c0 1 < canceled operation key=ESVFZQQXE3GT tag=UZA63SRPLZNA type=del size=1418102 2024-09-14T11:17:11.980 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.979+0000 7fe125ff88c0 1 > prepared operation key=SUCH37O8V1LY tag=IDGACCF89FCE type=write size=725802 2024-09-14T11:17:11.983 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.983+0000 7fe125ff88c0 1 < completed part key=_multipart_WEA3MQ0DI42N.2~FFAKQ76AFYUF.0 size=720916 2024-09-14T11:17:11.989 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.991+0000 7fe125ff88c0 1 < completed multipart upload key=WEA3MQ0DI42N upload=FFAKQ76AFYUF tag=ZVRQUPPPWNVY type=write size=1769492 2024-09-14T11:17:11.996 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.995+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~FN52HMEWN5SY.0 size=228744 2024-09-14T11:17:11.996 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.995+0000 7fe125ff88c0 1 > prepared multipart upload key=1ML6RIXI4C5P upload=FN52HMEWN5SY tag=3OIRNRULRC1Z type=write size=1277320 2024-09-14T11:17:11.999 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:11.999+0000 7fe125ff88c0 1 < completed write operation key=35EB6U5O4A51 tag=K5H5WKB0XNVX type=write size=277152 2024-09-14T11:17:12.003 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.003+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=SG57SQS01QE6 type=del size=758353 2024-09-14T11:17:12.007 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.007+0000 7fe125ff88c0 1 < completed part key=_multipart_0VBX2FWYCFEZ.2~KXDZRCMOY2LK.0 size=276653 2024-09-14T11:17:12.013 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.015+0000 7fe125ff88c0 1 < completed multipart upload key=0VBX2FWYCFEZ upload=KXDZRCMOY2LK tag=EBRHSNRTJ5J7 type=write size=1325229 2024-09-14T11:17:12.020 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.019+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~6X789NUXHFG9.0 size=705062 2024-09-14T11:17:12.020 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.019+0000 7fe125ff88c0 1 > prepared multipart upload key=2UXA6SXDTUFT upload=6X789NUXHFG9 tag=A27YLS10WPTT type=write size=1753638 2024-09-14T11:17:12.024 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.023+0000 7fe125ff88c0 1 < completed part key=_multipart_6C3JZKTB8BP3.2~5J3QUTDJX43G.0 size=1048576 2024-09-14T11:17:12.026 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.027+0000 7fe125ff88c0 1 < completed part key=_multipart_6C3JZKTB8BP3.2~5J3QUTDJX43G.1 size=843740 2024-09-14T11:17:12.033 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.035+0000 7fe125ff88c0 1 < completed multipart upload key=6C3JZKTB8BP3 upload=5J3QUTDJX43G tag=J2OA2YXHWABG type=write size=2940892 2024-09-14T11:17:12.036 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.039+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=RBYVC026034H type=del size=165966 2024-09-14T11:17:12.040 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.043+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~MP8PF1A7O05O.0 size=585597 2024-09-14T11:17:12.047 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.047+0000 7fe125ff88c0 1 < completed multipart upload key=F9I82N7RQC81 upload=MP8PF1A7O05O tag=CA390DWIL5T9 type=write size=1634173 2024-09-14T11:17:12.053 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.055+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~RFU4G80KF48M.0 size=1048576 2024-09-14T11:17:12.057 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.059+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~RFU4G80KF48M.1 size=1048576 2024-09-14T11:17:12.060 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.059+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~RFU4G80KF48M.2 size=73331 2024-09-14T11:17:12.060 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.059+0000 7fe125ff88c0 1 > prepared multipart upload key=N80X3YUF4OEL upload=RFU4G80KF48M tag=VQSVQK18DGVQ type=write size=3219059 2024-09-14T11:17:12.064 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.063+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~56R4GGVOCUTK.0 size=558863 2024-09-14T11:17:12.070 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.071+0000 7fe125ff88c0 1 < completed multipart upload key=4D2X7151977X upload=56R4GGVOCUTK tag=5K9UFHT7HHTW type=write size=1607439 2024-09-14T11:17:12.074 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.075+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=EGHQL9LSAJU9 type=del size=423580 2024-09-14T11:17:12.078 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.079+0000 7fe125ff88c0 1 < canceled operation key=YN2HI39GPEDF tag=3WK56MKW4932 type=del size=559928 2024-09-14T11:17:12.085 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.087+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~QQR0F6QMZT7F.0 size=1048576 2024-09-14T11:17:12.087 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.087+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~QQR0F6QMZT7F.1 size=298693 2024-09-14T11:17:12.087 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.087+0000 7fe125ff88c0 1 > prepared multipart upload key=V6B470G93KFT upload=QQR0F6QMZT7F tag=659MVR8NI7DP type=write size=2395845 2024-09-14T11:17:12.091 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.091+0000 7fe125ff88c0 1 < completed delete operation key=2KEKSWK0UT6C tag=VNFVAGTDTH9W type=del 2024-09-14T11:17:12.095 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.095+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=MUKRTE4HPRR6 type=del size=1622052 2024-09-14T11:17:12.096 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.095+0000 7fe125ff88c0 1 < canceled part key=_multipart_W0B19NBHNLMZ.2~YQB8R0U4CYMG.0 size=1048576 2024-09-14T11:17:12.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.099+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~YQB8R0U4CYMG.1 size=1048576 2024-09-14T11:17:12.102 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.103+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~YQB8R0U4CYMG.2 size=243596 2024-09-14T11:17:12.108 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.107+0000 7fe125ff88c0 1 < canceled multipart upload key=W0B19NBHNLMZ upload=YQB8R0U4CYMG tag=M8P836HDWCGQ type=write size=3389324 2024-09-14T11:17:12.112 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.111+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=LB9P75U1S2BV type=del size=2577275 2024-09-14T11:17:12.120 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.119+0000 7fe125ff88c0 1 < suggested remove operation key=0VBX2FWYCFEZ tag=QWGY4KD2T9IS type=del 2024-09-14T11:17:12.126 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.127+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~18IX5L1Q4UTX.0 size=1048576 2024-09-14T11:17:12.129 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.131+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~18IX5L1Q4UTX.1 size=745528 2024-09-14T11:17:12.129 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.131+0000 7fe125ff88c0 1 > prepared multipart upload key=W0B19NBHNLMZ upload=18IX5L1Q4UTX tag=X5IJL2L7NWVS type=write size=2842680 2024-09-14T11:17:12.133 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.135+0000 7fe125ff88c0 1 < completed part key=_multipart_N94D3R7IOBNL.2~V6UJ02X9RXN8.0 size=1048576 2024-09-14T11:17:12.135 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.135+0000 7fe125ff88c0 1 < completed part key=_multipart_N94D3R7IOBNL.2~V6UJ02X9RXN8.1 size=77166 2024-09-14T11:17:12.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.143+0000 7fe125ff88c0 1 < completed multipart upload key=N94D3R7IOBNL upload=V6UJ02X9RXN8 tag=AYNN1BEWIRII type=write size=2174318 2024-09-14T11:17:12.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.147+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=RSV1V0KG5PZO type=write size=58042 2024-09-14T11:17:12.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.151+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~TKQ73PQC6RMZ.0 size=1048576 2024-09-14T11:17:12.152 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.151+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~TKQ73PQC6RMZ.1 size=1035771 2024-09-14T11:17:12.158 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.159+0000 7fe125ff88c0 1 < completed multipart upload key=LYBGDNKUROWH upload=TKQ73PQC6RMZ tag=CBV1AW671KFA type=write size=3132923 2024-09-14T11:17:12.164 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.163+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~B3UTJ9KSTENF.0 size=1048576 2024-09-14T11:17:12.167 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.167+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~B3UTJ9KSTENF.1 size=1048576 2024-09-14T11:17:12.170 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.171+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~B3UTJ9KSTENF.2 size=447206 2024-09-14T11:17:12.170 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.171+0000 7fe125ff88c0 1 > prepared multipart upload key=K05LARTJ2QZ3 upload=B3UTJ9KSTENF tag=9JDG8XV1J39E type=write size=3592934 2024-09-14T11:17:12.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.179+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~MWVRGJC5OY5Z.0 size=1048576 2024-09-14T11:17:12.179 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.179+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~MWVRGJC5OY5Z.1 size=781154 2024-09-14T11:17:12.185 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.187+0000 7fe125ff88c0 1 < completed multipart upload key=N80X3YUF4OEL upload=MWVRGJC5OY5Z tag=GNJ86O9GK3SS type=write size=2878306 2024-09-14T11:17:12.192 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.191+0000 7fe125ff88c0 1 > prepared part key=_multipart_N94D3R7IOBNL.2~YKBJWHHUXC7H.0 size=1048576 2024-09-14T11:17:12.195 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.195+0000 7fe125ff88c0 1 > prepared part key=_multipart_N94D3R7IOBNL.2~YKBJWHHUXC7H.1 size=1048576 2024-09-14T11:17:12.198 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.199+0000 7fe125ff88c0 1 > prepared part key=_multipart_N94D3R7IOBNL.2~YKBJWHHUXC7H.2 size=955101 2024-09-14T11:17:12.198 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.199+0000 7fe125ff88c0 1 > prepared multipart upload key=N94D3R7IOBNL upload=YKBJWHHUXC7H tag=ZWQKUQWETK2Z type=write size=4100829 2024-09-14T11:17:12.202 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.203+0000 7fe125ff88c0 1 < completed delete operation key=SSNV25PDLDIS tag=32R6LT4F42WP type=del 2024-09-14T11:17:12.206 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.207+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=BO61YYMB6KFW type=del size=3572710 2024-09-14T11:17:12.214 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.215+0000 7fe125ff88c0 1 < suggested remove operation key=L4XO0WTYKNXY tag=AX5P9BJ05YER type=del 2024-09-14T11:17:12.221 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.223+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~1LXN88WY0U1H.0 size=1048576 2024-09-14T11:17:12.225 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.227+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~1LXN88WY0U1H.1 size=1048576 2024-09-14T11:17:12.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.231+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~1LXN88WY0U1H.2 size=53095 2024-09-14T11:17:12.229 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.231+0000 7fe125ff88c0 1 > prepared multipart upload key=N80X3YUF4OEL upload=1LXN88WY0U1H tag=UQLSQJ02XINI type=write size=3198823 2024-09-14T11:17:12.233 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.235+0000 7fe125ff88c0 1 < completed write operation key=SUCH37O8V1LY tag=IDGACCF89FCE type=write size=725802 2024-09-14T11:17:12.240 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.239+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~P50BL369W0IS.0 size=551562 2024-09-14T11:17:12.240 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.239+0000 7fe125ff88c0 1 > prepared multipart upload key=6C3JZKTB8BP3 upload=P50BL369W0IS tag=PSYXI1DLNTX7 type=write size=1600138 2024-09-14T11:17:12.244 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.247+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~FN52HMEWN5SY.0 size=228744 2024-09-14T11:17:12.250 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.251+0000 7fe125ff88c0 1 < completed multipart upload key=1ML6RIXI4C5P upload=FN52HMEWN5SY tag=3OIRNRULRC1Z type=write size=1277320 2024-09-14T11:17:12.254 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.255+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=SUV4TEL8JXN7 type=del size=2123535 2024-09-14T11:17:12.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.259+0000 7fe125ff88c0 1 < completed delete operation key=V6B470G93KFT tag=SG57SQS01QE6 type=del 2024-09-14T11:17:12.261 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.263+0000 7fe125ff88c0 1 > prepared operation key=N80X3YUF4OEL tag=75TZW6F20G72 type=del size=1866983 2024-09-14T11:17:12.265 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.267+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~6X789NUXHFG9.0 size=705062 2024-09-14T11:17:12.272 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.271+0000 7fe125ff88c0 1 < completed multipart upload key=2UXA6SXDTUFT upload=6X789NUXHFG9 tag=A27YLS10WPTT type=write size=1753638 2024-09-14T11:17:12.276 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.279+0000 7fe125ff88c0 1 > prepared operation key=LYBGDNKUROWH tag=AMXNJ91SH5UX type=write size=376313 2024-09-14T11:17:12.280 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.283+0000 7fe125ff88c0 1 < completed delete operation key=SSNV25PDLDIS tag=RBYVC026034H type=del 2024-09-14T11:17:12.284 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.283+0000 7fe125ff88c0 1 > prepared operation key=FQ5WT12KB664 tag=HR086B87WWWS type=del size=2372187 2024-09-14T11:17:12.285 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.287+0000 7fe125ff88c0 1 < canceled part key=_multipart_N80X3YUF4OEL.2~RFU4G80KF48M.0 size=1048576 2024-09-14T11:17:12.288 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.287+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~RFU4G80KF48M.1 size=1048576 2024-09-14T11:17:12.291 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.291+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~RFU4G80KF48M.2 size=73331 2024-09-14T11:17:12.296 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.299+0000 7fe125ff88c0 1 < canceled multipart upload key=N80X3YUF4OEL upload=RFU4G80KF48M tag=VQSVQK18DGVQ type=write size=3219059 2024-09-14T11:17:12.300 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.299+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=WHA7D8ZB2CGX type=del size=1594040 2024-09-14T11:17:12.304 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.303+0000 7fe125ff88c0 -1 < failed to complete operation key=0VBX2FWYCFEZ tag=EGHQL9LSAJU9 type=del size=423580: (22) Invalid argument 2024-09-14T11:17:12.311 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.311+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~WM6HRS30XWSB.0 size=1048576 2024-09-14T11:17:12.314 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.315+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~WM6HRS30XWSB.1 size=1048576 2024-09-14T11:17:12.316 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.319+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~WM6HRS30XWSB.2 size=878317 2024-09-14T11:17:12.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.319+0000 7fe125ff88c0 1 > prepared multipart upload key=F9I82N7RQC81 upload=WM6HRS30XWSB tag=N91KMUR54A0B type=write size=4024045 2024-09-14T11:17:12.320 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.323+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~QQR0F6QMZT7F.0 size=1048576 2024-09-14T11:17:12.323 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.323+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~QQR0F6QMZT7F.1 size=298693 2024-09-14T11:17:12.329 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.331+0000 7fe125ff88c0 1 < completed multipart upload key=V6B470G93KFT upload=QQR0F6QMZT7F tag=659MVR8NI7DP type=write size=2395845 2024-09-14T11:17:12.335 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.335+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~21DBLXLHJZV9.0 size=1048576 2024-09-14T11:17:12.338 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.339+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~21DBLXLHJZV9.1 size=33800 2024-09-14T11:17:12.338 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.339+0000 7fe125ff88c0 1 > prepared multipart upload key=K05LARTJ2QZ3 upload=21DBLXLHJZV9 tag=S0DMT5ZGJ0MC type=write size=2130952 2024-09-14T11:17:12.345 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.347+0000 7fe125ff88c0 1 < suggested remove operation key=YGEVGH840L18 tag=MUKRTE4HPRR6 type=del 2024-09-14T11:17:12.353 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.355+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~U1XZZPSV0ZDF.0 size=1048576 2024-09-14T11:17:12.356 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.359+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~U1XZZPSV0ZDF.1 size=1048576 2024-09-14T11:17:12.359 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.359+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~U1XZZPSV0ZDF.2 size=466805 2024-09-14T11:17:12.360 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.359+0000 7fe125ff88c0 1 > prepared multipart upload key=YFRH8WECBTJK upload=U1XZZPSV0ZDF tag=3C3YMH4P33VL type=write size=3612533 2024-09-14T11:17:12.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.363+0000 7fe125ff88c0 1 < completed delete operation key=35EB6U5O4A51 tag=LB9P75U1S2BV type=del 2024-09-14T11:17:12.371 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.371+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~Q2U6ESDDM9K3.0 size=1048576 2024-09-14T11:17:12.374 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.375+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~Q2U6ESDDM9K3.1 size=986895 2024-09-14T11:17:12.374 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.375+0000 7fe125ff88c0 1 > prepared multipart upload key=ESVFZQQXE3GT upload=Q2U6ESDDM9K3 tag=14J11U83BKD9 type=write size=3084047 2024-09-14T11:17:12.378 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.379+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~18IX5L1Q4UTX.0 size=1048576 2024-09-14T11:17:12.382 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.383+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~18IX5L1Q4UTX.1 size=745528 2024-09-14T11:17:12.388 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.391+0000 7fe125ff88c0 1 < completed multipart upload key=W0B19NBHNLMZ upload=18IX5L1Q4UTX tag=X5IJL2L7NWVS type=write size=2842680 2024-09-14T11:17:12.393 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.395+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=GZ80DT5KK1L5 type=del size=1899725 2024-09-14T11:17:12.398 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.399+0000 7fe125ff88c0 1 < completed write operation key=W0B19NBHNLMZ tag=RSV1V0KG5PZO type=write size=58042 2024-09-14T11:17:12.402 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.403+0000 7fe125ff88c0 1 > prepared operation key=3YGN50MBAF41 tag=RZSSKFT9IBUN type=del size=73895 2024-09-14T11:17:12.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.407+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~B3UTJ9KSTENF.0 size=1048576 2024-09-14T11:17:12.410 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.411+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~B3UTJ9KSTENF.1 size=1048576 2024-09-14T11:17:12.413 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.415+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~B3UTJ9KSTENF.2 size=447206 2024-09-14T11:17:12.419 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.419+0000 7fe125ff88c0 1 < completed multipart upload key=K05LARTJ2QZ3 upload=B3UTJ9KSTENF tag=9JDG8XV1J39E type=write size=3592934 2024-09-14T11:17:12.423 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.423+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=BDF8EZR6MHMV type=write size=768261 2024-09-14T11:17:12.427 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.427+0000 7fe125ff88c0 1 < completed part key=_multipart_N94D3R7IOBNL.2~YKBJWHHUXC7H.0 size=1048576 2024-09-14T11:17:12.427 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.427+0000 7fe125ff88c0 1 < canceled part key=_multipart_N94D3R7IOBNL.2~YKBJWHHUXC7H.1 size=1048576 2024-09-14T11:17:12.430 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.431+0000 7fe125ff88c0 1 < completed part key=_multipart_N94D3R7IOBNL.2~YKBJWHHUXC7H.2 size=955101 2024-09-14T11:17:12.436 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.435+0000 7fe125ff88c0 1 < canceled multipart upload key=N94D3R7IOBNL upload=YKBJWHHUXC7H tag=ZWQKUQWETK2Z type=write size=4100829 2024-09-14T11:17:12.443 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.443+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~7E9PZDNST3TM.0 size=1048576 2024-09-14T11:17:12.446 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.447+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~7E9PZDNST3TM.1 size=863351 2024-09-14T11:17:12.446 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.447+0000 7fe125ff88c0 1 > prepared multipart upload key=SSNV25PDLDIS upload=7E9PZDNST3TM tag=JOH7KUR9MLV2 type=write size=2960503 2024-09-14T11:17:12.449 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.451+0000 7fe125ff88c0 1 < completed delete operation key=2LH5U05C2F8C tag=BO61YYMB6KFW type=del 2024-09-14T11:17:12.453 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.455+0000 7fe125ff88c0 1 > prepared operation key=YFRH8WECBTJK tag=MWE5R0KTKD72 type=del size=2219476 2024-09-14T11:17:12.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.455+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~1LXN88WY0U1H.0 size=1048576 2024-09-14T11:17:12.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.459+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~1LXN88WY0U1H.1 size=1048576 2024-09-14T11:17:12.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.459+0000 7fe125ff88c0 1 < canceled part key=_multipart_N80X3YUF4OEL.2~1LXN88WY0U1H.2 size=53095 2024-09-14T11:17:12.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.467+0000 7fe125ff88c0 1 < canceled multipart upload key=N80X3YUF4OEL upload=1LXN88WY0U1H tag=UQLSQJ02XINI type=write size=3198823 2024-09-14T11:17:12.468 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.467+0000 7fe125ff88c0 1 > prepared operation key=46ZTDBWFVSUH tag=M3EZM9R5MR2V type=del size=3205012 2024-09-14T11:17:12.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.471+0000 7fe125ff88c0 1 < completed part key=_multipart_6C3JZKTB8BP3.2~P50BL369W0IS.0 size=551562 2024-09-14T11:17:12.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.479+0000 7fe125ff88c0 1 < completed multipart upload key=6C3JZKTB8BP3 upload=P50BL369W0IS tag=PSYXI1DLNTX7 type=write size=1600138 2024-09-14T11:17:12.481 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.483+0000 7fe125ff88c0 1 > prepared operation key=K05LARTJ2QZ3 tag=Z77XBU19GJ1F type=del size=3956689 2024-09-14T11:17:12.485 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.487+0000 7fe125ff88c0 1 < completed delete operation key=2KEKSWK0UT6C tag=SUV4TEL8JXN7 type=del 2024-09-14T11:17:12.489 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.491+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=H19QCQJQVXDM type=del size=2585692 2024-09-14T11:17:12.492 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.495+0000 7fe125ff88c0 1 < completed delete operation key=N80X3YUF4OEL tag=75TZW6F20G72 type=del 2024-09-14T11:17:12.499 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.499+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~W3EA7J3WTWZN.0 size=1048576 2024-09-14T11:17:12.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.503+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~W3EA7J3WTWZN.1 size=1048576 2024-09-14T11:17:12.505 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.507+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~W3EA7J3WTWZN.2 size=231091 2024-09-14T11:17:12.505 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.507+0000 7fe125ff88c0 1 > prepared multipart upload key=V6B470G93KFT upload=W3EA7J3WTWZN tag=F70685PQ2BZ9 type=write size=3376819 2024-09-14T11:17:12.508 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.511+0000 7fe125ff88c0 1 < completed write operation key=LYBGDNKUROWH tag=AMXNJ91SH5UX type=write size=376313 2024-09-14T11:17:12.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.515+0000 7fe125ff88c0 1 > prepared operation key=K05LARTJ2QZ3 tag=FROGWN239LB1 type=del size=1188694 2024-09-14T11:17:12.516 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.515+0000 7fe125ff88c0 1 < completed delete operation key=FQ5WT12KB664 tag=HR086B87WWWS type=del 2024-09-14T11:17:12.520 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.519+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=HMXHJMJTAP2O type=del size=1097436 2024-09-14T11:17:12.526 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.527+0000 7fe125ff88c0 1 < completed delete operation key=2UXA6SXDTUFT tag=WHA7D8ZB2CGX type=del 2024-09-14T11:17:12.530 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.531+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=J6PYAKLGYNDS type=write size=211422 2024-09-14T11:17:12.534 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.535+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~WM6HRS30XWSB.0 size=1048576 2024-09-14T11:17:12.537 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.539+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~WM6HRS30XWSB.1 size=1048576 2024-09-14T11:17:12.540 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.539+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~WM6HRS30XWSB.2 size=878317 2024-09-14T11:17:12.546 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.547+0000 7fe125ff88c0 1 < completed multipart upload key=F9I82N7RQC81 upload=WM6HRS30XWSB tag=N91KMUR54A0B type=write size=4024045 2024-09-14T11:17:12.549 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.551+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=N0BBZOHMSSSU type=del size=107378 2024-09-14T11:17:12.553 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.555+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~21DBLXLHJZV9.0 size=1048576 2024-09-14T11:17:12.556 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.555+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~21DBLXLHJZV9.1 size=33800 2024-09-14T11:17:12.562 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.563+0000 7fe125ff88c0 1 < completed multipart upload key=K05LARTJ2QZ3 upload=21DBLXLHJZV9 tag=S0DMT5ZGJ0MC type=write size=2130952 2024-09-14T11:17:12.566 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.567+0000 7fe125ff88c0 1 > prepared operation key=1ML6RIXI4C5P tag=XHQQ69F9R3HU type=del size=3080819 2024-09-14T11:17:12.567 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.567+0000 7fe125ff88c0 1 < canceled part key=_multipart_YFRH8WECBTJK.2~U1XZZPSV0ZDF.0 size=1048576 2024-09-14T11:17:12.570 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.571+0000 7fe125ff88c0 1 < completed part key=_multipart_YFRH8WECBTJK.2~U1XZZPSV0ZDF.1 size=1048576 2024-09-14T11:17:12.572 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.575+0000 7fe125ff88c0 1 < completed part key=_multipart_YFRH8WECBTJK.2~U1XZZPSV0ZDF.2 size=466805 2024-09-14T11:17:12.578 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.579+0000 7fe125ff88c0 1 < canceled multipart upload key=YFRH8WECBTJK upload=U1XZZPSV0ZDF tag=3C3YMH4P33VL type=write size=3612533 2024-09-14T11:17:12.582 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.583+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=4YIH6F933I5D type=write size=519236 2024-09-14T11:17:12.585 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.587+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~Q2U6ESDDM9K3.0 size=1048576 2024-09-14T11:17:12.588 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.587+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~Q2U6ESDDM9K3.1 size=986895 2024-09-14T11:17:12.593 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.595+0000 7fe125ff88c0 1 < completed multipart upload key=ESVFZQQXE3GT upload=Q2U6ESDDM9K3 tag=14J11U83BKD9 type=write size=3084047 2024-09-14T11:17:12.596 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.599+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=1RCDS3YLGZ7R type=del size=3158682 2024-09-14T11:17:12.600 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.599+0000 7fe125ff88c0 1 < completed delete operation key=L4XO0WTYKNXY tag=GZ80DT5KK1L5 type=del 2024-09-14T11:17:12.604 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.603+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=Q9HNA4E5MOR7 type=del size=2192042 2024-09-14T11:17:12.609 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.611+0000 7fe125ff88c0 1 < completed delete operation key=3YGN50MBAF41 tag=RZSSKFT9IBUN type=del 2024-09-14T11:17:12.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.611+0000 7fe125ff88c0 1 > prepared operation key=K05LARTJ2QZ3 tag=I2J8Q91VEVBH type=del size=1153857 2024-09-14T11:17:12.615 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.615+0000 7fe125ff88c0 1 < completed write operation key=YGEVGH840L18 tag=BDF8EZR6MHMV type=write size=768261 2024-09-14T11:17:12.619 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.619+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=K6M4R21NLL1F type=del size=2774187 2024-09-14T11:17:12.623 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.623+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~7E9PZDNST3TM.0 size=1048576 2024-09-14T11:17:12.626 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.627+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~7E9PZDNST3TM.1 size=863351 2024-09-14T11:17:12.632 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.631+0000 7fe125ff88c0 1 < completed multipart upload key=SSNV25PDLDIS upload=7E9PZDNST3TM tag=JOH7KUR9MLV2 type=write size=2960503 2024-09-14T11:17:12.635 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.635+0000 7fe125ff88c0 1 > prepared operation key=YFRH8WECBTJK tag=HM8O8LE3CQV2 type=write size=507115 2024-09-14T11:17:12.639 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.639+0000 7fe125ff88c0 1 < canceled operation key=YFRH8WECBTJK tag=MWE5R0KTKD72 type=del size=2219476 2024-09-14T11:17:12.646 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.647+0000 7fe125ff88c0 1 > prepared part key=_multipart_6PLUU2QIO9LJ.2~RWOO4UZ0G8AH.0 size=1048576 2024-09-14T11:17:12.648 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.651+0000 7fe125ff88c0 1 > prepared part key=_multipart_6PLUU2QIO9LJ.2~RWOO4UZ0G8AH.1 size=108420 2024-09-14T11:17:12.648 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.651+0000 7fe125ff88c0 1 > prepared multipart upload key=6PLUU2QIO9LJ upload=RWOO4UZ0G8AH tag=ALNPINZN5E86 type=write size=2205572 2024-09-14T11:17:12.651 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.651+0000 7fe125ff88c0 1 < completed delete operation key=46ZTDBWFVSUH tag=M3EZM9R5MR2V type=del 2024-09-14T11:17:12.658 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.659+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~LSB46DN5B8Y4.0 size=1048576 2024-09-14T11:17:12.660 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.663+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~LSB46DN5B8Y4.1 size=589749 2024-09-14T11:17:12.661 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.663+0000 7fe125ff88c0 1 > prepared multipart upload key=2UXA6SXDTUFT upload=LSB46DN5B8Y4 tag=L6LZ3YPAW93S type=write size=2686901 2024-09-14T11:17:12.665 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.667+0000 7fe125ff88c0 1 < completed delete operation key=K05LARTJ2QZ3 tag=Z77XBU19GJ1F type=del 2024-09-14T11:17:12.668 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.671+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=15QWVY7K078Q type=del size=764356 2024-09-14T11:17:12.672 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.671+0000 7fe125ff88c0 1 < completed delete operation key=W0B19NBHNLMZ tag=H19QCQJQVXDM type=del 2024-09-14T11:17:12.675 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.675+0000 7fe125ff88c0 1 > prepared operation key=6C3JZKTB8BP3 tag=6NWOK63VA42Q type=del size=620030 2024-09-14T11:17:12.679 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.679+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~W3EA7J3WTWZN.0 size=1048576 2024-09-14T11:17:12.682 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.683+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~W3EA7J3WTWZN.1 size=1048576 2024-09-14T11:17:12.685 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.687+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~W3EA7J3WTWZN.2 size=231091 2024-09-14T11:17:12.690 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.691+0000 7fe125ff88c0 1 < completed multipart upload key=V6B470G93KFT upload=W3EA7J3WTWZN tag=F70685PQ2BZ9 type=write size=3376819 2024-09-14T11:17:12.693 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.695+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=HN6HE17QHXEY type=del size=1635274 2024-09-14T11:17:12.697 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.699+0000 7fe125ff88c0 1 < completed delete operation key=K05LARTJ2QZ3 tag=FROGWN239LB1 type=del 2024-09-14T11:17:12.703 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.703+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~2ZHKS8413MU0.0 size=870783 2024-09-14T11:17:12.703 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.703+0000 7fe125ff88c0 1 > prepared multipart upload key=N80X3YUF4OEL upload=2ZHKS8413MU0 tag=4OWTDXKPRNNI type=write size=1919359 2024-09-14T11:17:12.707 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.707+0000 7fe125ff88c0 1 < canceled operation key=4D2X7151977X tag=HMXHJMJTAP2O type=del size=1097436 2024-09-14T11:17:12.714 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.715+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~WJKF1VSG8DK2.0 size=1048576 2024-09-14T11:17:12.716 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.719+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~WJKF1VSG8DK2.1 size=1048576 2024-09-14T11:17:12.719 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.719+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~WJKF1VSG8DK2.2 size=1036000 2024-09-14T11:17:12.719 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.719+0000 7fe125ff88c0 1 > prepared multipart upload key=4D2X7151977X upload=WJKF1VSG8DK2 tag=LFOW3GQA9G52 type=write size=4181728 2024-09-14T11:17:12.723 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.723+0000 7fe125ff88c0 1 < completed write operation key=YN2HI39GPEDF tag=J6PYAKLGYNDS type=write size=211422 2024-09-14T11:17:12.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.727+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=Z0D7LZCQ7VXB type=del size=3354363 2024-09-14T11:17:12.731 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.731+0000 7fe125ff88c0 1 < canceled operation key=YCF2PCJ9TZMR tag=N0BBZOHMSSSU type=del size=107378 2024-09-14T11:17:12.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.739+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~XHO9VWZOMUM4.0 size=1048576 2024-09-14T11:17:12.740 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.739+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~XHO9VWZOMUM4.1 size=1048576 2024-09-14T11:17:12.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.743+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~XHO9VWZOMUM4.2 size=443636 2024-09-14T11:17:12.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.743+0000 7fe125ff88c0 1 > prepared multipart upload key=YN2HI39GPEDF upload=XHO9VWZOMUM4 tag=175259Y2LGGF type=write size=3589364 2024-09-14T11:17:12.746 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.747+0000 7fe125ff88c0 1 < completed delete operation key=1ML6RIXI4C5P tag=XHQQ69F9R3HU type=del 2024-09-14T11:17:12.752 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.755+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~GJZM1ODOXUNK.0 size=1048576 2024-09-14T11:17:12.755 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.755+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~GJZM1ODOXUNK.1 size=590524 2024-09-14T11:17:12.755 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.755+0000 7fe125ff88c0 1 > prepared multipart upload key=YGEVGH840L18 upload=GJZM1ODOXUNK tag=YP4V9PJ4TM45 type=write size=2687676 2024-09-14T11:17:12.759 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.759+0000 7fe125ff88c0 1 < completed write operation key=35EB6U5O4A51 tag=4YIH6F933I5D type=write size=519236 2024-09-14T11:17:12.763 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.763+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=B9IROG9OWKKG type=del size=1432517 2024-09-14T11:17:12.767 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.767+0000 7fe125ff88c0 1 < canceled operation key=N94D3R7IOBNL tag=1RCDS3YLGZ7R type=del size=3158682 2024-09-14T11:17:12.770 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.771+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=JR10EPNTCEWW type=write size=761051 2024-09-14T11:17:12.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.775+0000 7fe125ff88c0 1 < completed delete operation key=V6B470G93KFT tag=Q9HNA4E5MOR7 type=del 2024-09-14T11:17:12.780 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.783+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~10QFVFVSBFO0.0 size=1048576 2024-09-14T11:17:12.783 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.783+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~10QFVFVSBFO0.1 size=525803 2024-09-14T11:17:12.783 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.783+0000 7fe125ff88c0 1 > prepared multipart upload key=0FITHLGQKQEC upload=10QFVFVSBFO0 tag=CG18R05UNADK type=write size=2622955 2024-09-14T11:17:12.787 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.787+0000 7fe125ff88c0 1 < completed delete operation key=K05LARTJ2QZ3 tag=I2J8Q91VEVBH type=del 2024-09-14T11:17:12.794 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.795+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~FAF0E8VBFPQW.0 size=1048576 2024-09-14T11:17:12.797 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.799+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~FAF0E8VBFPQW.1 size=987442 2024-09-14T11:17:12.797 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.799+0000 7fe125ff88c0 1 > prepared multipart upload key=FQ5WT12KB664 upload=FAF0E8VBFPQW tag=AOE8RM4PBJ2T type=write size=3084594 2024-09-14T11:17:12.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.803+0000 7fe125ff88c0 1 < suggested update operation key=K3P6U6NU8I01 tag=K6M4R21NLL1F type=del size=2774187 2024-09-14T11:17:12.808 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.807+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=RZB2LFNCRSS0 type=del size=3708547 2024-09-14T11:17:12.811 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.811+0000 7fe125ff88c0 1 < completed write operation key=YFRH8WECBTJK tag=HM8O8LE3CQV2 type=write size=507115 2024-09-14T11:17:12.815 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.815+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=RFFCN0L6XMG3 type=del size=2930414 2024-09-14T11:17:12.819 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.819+0000 7fe125ff88c0 1 < completed part key=_multipart_6PLUU2QIO9LJ.2~RWOO4UZ0G8AH.0 size=1048576 2024-09-14T11:17:12.821 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.823+0000 7fe125ff88c0 1 < completed part key=_multipart_6PLUU2QIO9LJ.2~RWOO4UZ0G8AH.1 size=108420 2024-09-14T11:17:12.827 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.827+0000 7fe125ff88c0 1 < completed multipart upload key=6PLUU2QIO9LJ upload=RWOO4UZ0G8AH tag=ALNPINZN5E86 type=write size=2205572 2024-09-14T11:17:12.834 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.835+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~E3N8JW6PPJXL.0 size=1048576 2024-09-14T11:17:12.836 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.835+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~E3N8JW6PPJXL.1 size=1048576 2024-09-14T11:17:12.839 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.839+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~E3N8JW6PPJXL.2 size=997480 2024-09-14T11:17:12.839 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.839+0000 7fe125ff88c0 1 > prepared multipart upload key=3OU4U9JF3ZD5 upload=E3N8JW6PPJXL tag=5LYQ1ELVO43S type=write size=4143208 2024-09-14T11:17:12.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.843+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~LSB46DN5B8Y4.0 size=1048576 2024-09-14T11:17:12.846 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.847+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~LSB46DN5B8Y4.1 size=589749 2024-09-14T11:17:12.852 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.851+0000 7fe125ff88c0 1 < completed multipart upload key=2UXA6SXDTUFT upload=LSB46DN5B8Y4 tag=L6LZ3YPAW93S type=write size=2686901 2024-09-14T11:17:12.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.863+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~9N6CP2DBX2QR.0 size=420815 2024-09-14T11:17:12.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.863+0000 7fe125ff88c0 1 > prepared multipart upload key=3OU4U9JF3ZD5 upload=9N6CP2DBX2QR tag=WUYHZN742BB9 type=write size=1469391 2024-09-14T11:17:12.866 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.867+0000 7fe125ff88c0 1 < completed delete operation key=6PLUU2QIO9LJ tag=15QWVY7K078Q type=del 2024-09-14T11:17:12.870 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.871+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=U3C7AYBSPAQ4 type=write size=467555 2024-09-14T11:17:12.874 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.875+0000 7fe125ff88c0 1 < completed delete operation key=6C3JZKTB8BP3 tag=6NWOK63VA42Q type=del 2024-09-14T11:17:12.878 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.879+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=0IMYXFDPBLZZ type=write size=763528 2024-09-14T11:17:12.882 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.883+0000 7fe125ff88c0 1 < completed delete operation key=YCF2PCJ9TZMR tag=HN6HE17QHXEY type=del 2024-09-14T11:17:12.889 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.891+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~UB3MSNW3RCGZ.0 size=1048576 2024-09-14T11:17:12.892 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.891+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~UB3MSNW3RCGZ.1 size=1048576 2024-09-14T11:17:12.895 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.895+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~UB3MSNW3RCGZ.2 size=511962 2024-09-14T11:17:12.895 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.895+0000 7fe125ff88c0 1 > prepared multipart upload key=2UXA6SXDTUFT upload=UB3MSNW3RCGZ tag=4VOL4SI2IW63 type=write size=3657690 2024-09-14T11:17:12.899 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.899+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~2ZHKS8413MU0.0 size=870783 2024-09-14T11:17:12.904 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.907+0000 7fe125ff88c0 1 < completed multipart upload key=N80X3YUF4OEL upload=2ZHKS8413MU0 tag=4OWTDXKPRNNI type=write size=1919359 2024-09-14T11:17:12.911 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.911+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~XIA1T3A2YQS3.0 size=920590 2024-09-14T11:17:12.911 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.911+0000 7fe125ff88c0 1 > prepared multipart upload key=F9I82N7RQC81 upload=XIA1T3A2YQS3 tag=1117RIB99O4F type=write size=1969166 2024-09-14T11:17:12.915 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.915+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~WJKF1VSG8DK2.0 size=1048576 2024-09-14T11:17:12.918 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.919+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~WJKF1VSG8DK2.1 size=1048576 2024-09-14T11:17:12.921 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.923+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~WJKF1VSG8DK2.2 size=1036000 2024-09-14T11:17:12.926 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.927+0000 7fe125ff88c0 1 < completed multipart upload key=4D2X7151977X upload=WJKF1VSG8DK2 tag=LFOW3GQA9G52 type=write size=4181728 2024-09-14T11:17:12.930 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.931+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=3A1J11YCN79W type=del size=2412721 2024-09-14T11:17:12.937 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.939+0000 7fe125ff88c0 1 < suggested update operation key=WEA3MQ0DI42N tag=Z0D7LZCQ7VXB type=del size=3354363 2024-09-14T11:17:12.941 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.943+0000 7fe125ff88c0 1 > prepared operation key=N80X3YUF4OEL tag=KDU4FVN97ZWM type=write size=547789 2024-09-14T11:17:12.945 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.947+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~XHO9VWZOMUM4.0 size=1048576 2024-09-14T11:17:12.949 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.951+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~XHO9VWZOMUM4.1 size=1048576 2024-09-14T11:17:12.949 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.951+0000 7fe125ff88c0 1 < canceled part key=_multipart_YN2HI39GPEDF.2~XHO9VWZOMUM4.2 size=443636 2024-09-14T11:17:12.955 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.955+0000 7fe125ff88c0 1 < canceled multipart upload key=YN2HI39GPEDF upload=XHO9VWZOMUM4 tag=175259Y2LGGF type=write size=3589364 2024-09-14T11:17:12.959 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.959+0000 7fe125ff88c0 1 > prepared operation key=1ML6RIXI4C5P tag=52HWMJG5AJ9T type=del size=4001561 2024-09-14T11:17:12.962 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.963+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~GJZM1ODOXUNK.0 size=1048576 2024-09-14T11:17:12.966 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.967+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~GJZM1ODOXUNK.1 size=590524 2024-09-14T11:17:12.971 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.971+0000 7fe125ff88c0 1 < completed multipart upload key=YGEVGH840L18 upload=GJZM1ODOXUNK tag=YP4V9PJ4TM45 type=write size=2687676 2024-09-14T11:17:12.978 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.979+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~DTUUSBSUSGYU.0 size=1048576 2024-09-14T11:17:12.981 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.983+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~DTUUSBSUSGYU.1 size=1048576 2024-09-14T11:17:12.984 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.983+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~DTUUSBSUSGYU.2 size=466298 2024-09-14T11:17:12.984 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.983+0000 7fe125ff88c0 1 > prepared multipart upload key=0FITHLGQKQEC upload=DTUUSBSUSGYU tag=ZIX4P7DKZ53P type=write size=3612026 2024-09-14T11:17:12.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.987+0000 7fe125ff88c0 1 < completed delete operation key=0VBX2FWYCFEZ tag=B9IROG9OWKKG type=del 2024-09-14T11:17:12.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.995+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~UL43N31EA2WU.0 size=1048576 2024-09-14T11:17:12.997 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.999+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~UL43N31EA2WU.1 size=1048576 2024-09-14T11:17:13.000 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.999+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~UL43N31EA2WU.2 size=213483 2024-09-14T11:17:13.000 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:12.999+0000 7fe125ff88c0 1 > prepared multipart upload key=2LH5U05C2F8C upload=UL43N31EA2WU tag=75EPVI0HF3AE type=write size=3359211 2024-09-14T11:17:13.004 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.003+0000 7fe125ff88c0 1 < completed write operation key=L4XO0WTYKNXY tag=JR10EPNTCEWW type=write size=761051 2024-09-14T11:17:13.008 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.007+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=N8JQ1IO855PS type=del size=1291740 2024-09-14T11:17:13.009 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.011+0000 7fe125ff88c0 1 < canceled part key=_multipart_0FITHLGQKQEC.2~10QFVFVSBFO0.0 size=1048576 2024-09-14T11:17:13.012 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.011+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~10QFVFVSBFO0.1 size=525803 2024-09-14T11:17:13.018 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.019+0000 7fe125ff88c0 1 < canceled multipart upload key=0FITHLGQKQEC upload=10QFVFVSBFO0 tag=CG18R05UNADK type=write size=2622955 2024-09-14T11:17:13.022 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.023+0000 7fe125ff88c0 1 > prepared operation key=SUCH37O8V1LY tag=8LRY11N09DGX type=del size=1368188 2024-09-14T11:17:13.026 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.027+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~FAF0E8VBFPQW.0 size=1048576 2024-09-14T11:17:13.029 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.031+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~FAF0E8VBFPQW.1 size=987442 2024-09-14T11:17:13.035 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.035+0000 7fe125ff88c0 1 < completed multipart upload key=FQ5WT12KB664 upload=FAF0E8VBFPQW tag=AOE8RM4PBJ2T type=write size=3084594 2024-09-14T11:17:13.041 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.043+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~7H5GGNEHKBBB.0 size=1048576 2024-09-14T11:17:13.043 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.043+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~7H5GGNEHKBBB.1 size=1048576 2024-09-14T11:17:13.046 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.047+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~7H5GGNEHKBBB.2 size=862931 2024-09-14T11:17:13.046 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.047+0000 7fe125ff88c0 1 > prepared multipart upload key=SUCH37O8V1LY upload=7H5GGNEHKBBB tag=L9S8RFS631DZ type=write size=4008659 2024-09-14T11:17:13.050 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.051+0000 7fe125ff88c0 1 < completed delete operation key=2LH5U05C2F8C tag=RZB2LFNCRSS0 type=del 2024-09-14T11:17:13.056 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.059+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~7Z15C2H08JKR.0 size=1048576 2024-09-14T11:17:13.059 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.059+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~7Z15C2H08JKR.1 size=727348 2024-09-14T11:17:13.059 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.059+0000 7fe125ff88c0 1 > prepared multipart upload key=46ZTDBWFVSUH upload=7Z15C2H08JKR tag=ZH9CP2OVWAX0 type=write size=2824500 2024-09-14T11:17:13.062 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.063+0000 7fe125ff88c0 1 < completed delete operation key=2UXA6SXDTUFT tag=RFFCN0L6XMG3 type=del 2024-09-14T11:17:13.068 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.067+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~RIHN7T6T9VYY.0 size=1048576 2024-09-14T11:17:13.070 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.071+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~RIHN7T6T9VYY.1 size=1048576 2024-09-14T11:17:13.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.075+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~RIHN7T6T9VYY.2 size=833064 2024-09-14T11:17:13.073 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.075+0000 7fe125ff88c0 1 > prepared multipart upload key=FQ5WT12KB664 upload=RIHN7T6T9VYY tag=UTPYG1BVMZO3 type=write size=3978792 2024-09-14T11:17:13.076 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.075+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~E3N8JW6PPJXL.0 size=1048576 2024-09-14T11:17:13.078 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.079+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~E3N8JW6PPJXL.1 size=1048576 2024-09-14T11:17:13.081 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.083+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~E3N8JW6PPJXL.2 size=997480 2024-09-14T11:17:13.086 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.087+0000 7fe125ff88c0 1 < completed multipart upload key=3OU4U9JF3ZD5 upload=E3N8JW6PPJXL tag=5LYQ1ELVO43S type=write size=4143208 2024-09-14T11:17:13.090 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.091+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=LCKZ0ELA9DY3 type=write size=268317 2024-09-14T11:17:13.090 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.091+0000 7fe125ff88c0 1 < canceled part key=_multipart_3OU4U9JF3ZD5.2~9N6CP2DBX2QR.0 size=420815 2024-09-14T11:17:13.096 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.095+0000 7fe125ff88c0 1 < canceled multipart upload key=3OU4U9JF3ZD5 upload=9N6CP2DBX2QR tag=WUYHZN742BB9 type=write size=1469391 2024-09-14T11:17:13.100 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.099+0000 7fe125ff88c0 1 > prepared operation key=6C3JZKTB8BP3 tag=Q7YCMAL896CB type=del size=2275535 2024-09-14T11:17:13.103 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.103+0000 7fe125ff88c0 1 < completed write operation key=K3P6U6NU8I01 tag=U3C7AYBSPAQ4 type=write size=467555 2024-09-14T11:17:13.109 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.111+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~LQW9SXVT5VCN.0 size=1048576 2024-09-14T11:17:13.112 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.111+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~LQW9SXVT5VCN.1 size=1048576 2024-09-14T11:17:13.114 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.115+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~LQW9SXVT5VCN.2 size=1036954 2024-09-14T11:17:13.115 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.115+0000 7fe125ff88c0 1 > prepared multipart upload key=1ML6RIXI4C5P upload=LQW9SXVT5VCN tag=HPBES4V3QY0S type=write size=4182682 2024-09-14T11:17:13.118 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.119+0000 7fe125ff88c0 1 < completed write operation key=35EB6U5O4A51 tag=0IMYXFDPBLZZ type=write size=763528 2024-09-14T11:17:13.122 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.123+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=RUVLDVDS1PBV type=del size=3418848 2024-09-14T11:17:13.126 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.127+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~UB3MSNW3RCGZ.0 size=1048576 2024-09-14T11:17:13.128 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.131+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~UB3MSNW3RCGZ.1 size=1048576 2024-09-14T11:17:13.131 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.131+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~UB3MSNW3RCGZ.2 size=511962 2024-09-14T11:17:13.136 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.139+0000 7fe125ff88c0 1 < completed multipart upload key=2UXA6SXDTUFT upload=UB3MSNW3RCGZ tag=4VOL4SI2IW63 type=write size=3657690 2024-09-14T11:17:13.140 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.139+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=ILALT3BHH8QT type=del size=652037 2024-09-14T11:17:13.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.143+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~XIA1T3A2YQS3.0 size=920590 2024-09-14T11:17:13.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.151+0000 7fe125ff88c0 1 < completed multipart upload key=F9I82N7RQC81 upload=XIA1T3A2YQS3 tag=1117RIB99O4F type=write size=1969166 2024-09-14T11:17:13.154 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.155+0000 7fe125ff88c0 1 > prepared operation key=FQ5WT12KB664 tag=0LENE1V97GCE type=del size=62767 2024-09-14T11:17:13.158 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.159+0000 7fe125ff88c0 1 < canceled operation key=21HC4VMHXS6L tag=3A1J11YCN79W type=del size=2412721 2024-09-14T11:17:13.164 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.163+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~SW0AQMK2FL8J.0 size=1048576 2024-09-14T11:17:13.166 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.167+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~SW0AQMK2FL8J.1 size=651463 2024-09-14T11:17:13.167 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.167+0000 7fe125ff88c0 1 > prepared multipart upload key=YCF2PCJ9TZMR upload=SW0AQMK2FL8J tag=0U9IAOORN6QU type=write size=2748615 2024-09-14T11:17:13.170 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.171+0000 7fe125ff88c0 1 < completed write operation key=N80X3YUF4OEL tag=KDU4FVN97ZWM type=write size=547789 2024-09-14T11:17:13.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.179+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~25Y6V9W006IY.0 size=1048576 2024-09-14T11:17:13.179 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.179+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~25Y6V9W006IY.1 size=1048576 2024-09-14T11:17:13.184 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.183+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~25Y6V9W006IY.2 size=704430 2024-09-14T11:17:13.184 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.183+0000 7fe125ff88c0 1 > prepared multipart upload key=0VBX2FWYCFEZ upload=25Y6V9W006IY tag=L8PECR34HOTB type=write size=3850158 2024-09-14T11:17:13.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.187+0000 7fe125ff88c0 1 < completed delete operation key=1ML6RIXI4C5P tag=52HWMJG5AJ9T type=del 2024-09-14T11:17:13.191 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.191+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=W6SS5XBQLWZX type=write size=58862 2024-09-14T11:17:13.195 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.195+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~DTUUSBSUSGYU.0 size=1048576 2024-09-14T11:17:13.198 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.199+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~DTUUSBSUSGYU.1 size=1048576 2024-09-14T11:17:13.201 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.203+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~DTUUSBSUSGYU.2 size=466298 2024-09-14T11:17:13.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.207+0000 7fe125ff88c0 1 < completed multipart upload key=0FITHLGQKQEC upload=DTUUSBSUSGYU tag=ZIX4P7DKZ53P type=write size=3612026 2024-09-14T11:17:13.210 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.211+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=BW31IPOC2ZKD type=del size=1489100 2024-09-14T11:17:13.214 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.215+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~UL43N31EA2WU.0 size=1048576 2024-09-14T11:17:13.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.219+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~UL43N31EA2WU.1 size=1048576 2024-09-14T11:17:13.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.219+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~UL43N31EA2WU.2 size=213483 2024-09-14T11:17:13.225 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.227+0000 7fe125ff88c0 1 < completed multipart upload key=2LH5U05C2F8C upload=UL43N31EA2WU tag=75EPVI0HF3AE type=write size=3359211 2024-09-14T11:17:13.229 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.231+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=K9SNHCNC1NXP type=del size=2563022 2024-09-14T11:17:13.236 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.239+0000 7fe125ff88c0 1 < suggested remove operation key=K3P6U6NU8I01 tag=N8JQ1IO855PS type=del 2024-09-14T11:17:13.240 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.239+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=ZR1X0OO0ZFQ3 type=del size=3782869 2024-09-14T11:17:13.244 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.243+0000 7fe125ff88c0 1 < completed delete operation key=SUCH37O8V1LY tag=8LRY11N09DGX type=del 2024-09-14T11:17:13.248 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.247+0000 7fe125ff88c0 1 > prepared operation key=SUCH37O8V1LY tag=E7EMAHO8H3Q1 type=write size=681628 2024-09-14T11:17:13.249 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.251+0000 7fe125ff88c0 1 < canceled part key=_multipart_SUCH37O8V1LY.2~7H5GGNEHKBBB.0 size=1048576 2024-09-14T11:17:13.252 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.255+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~7H5GGNEHKBBB.1 size=1048576 2024-09-14T11:17:13.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.255+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~7H5GGNEHKBBB.2 size=862931 2024-09-14T11:17:13.262 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.263+0000 7fe125ff88c0 1 < canceled multipart upload key=SUCH37O8V1LY upload=7H5GGNEHKBBB tag=L9S8RFS631DZ type=write size=4008659 2024-09-14T11:17:13.266 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.267+0000 7fe125ff88c0 1 > prepared operation key=SUCH37O8V1LY tag=HHH84SXMGXCY type=write size=498737 2024-09-14T11:17:13.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.271+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~7Z15C2H08JKR.0 size=1048576 2024-09-14T11:17:13.272 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.271+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~7Z15C2H08JKR.1 size=727348 2024-09-14T11:17:13.279 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.279+0000 7fe125ff88c0 1 < completed multipart upload key=46ZTDBWFVSUH upload=7Z15C2H08JKR tag=ZH9CP2OVWAX0 type=write size=2824500 2024-09-14T11:17:13.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.283+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=VYEJ9YFVSBWV type=del size=1914285 2024-09-14T11:17:13.287 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.287+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~RIHN7T6T9VYY.0 size=1048576 2024-09-14T11:17:13.290 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.291+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~RIHN7T6T9VYY.1 size=1048576 2024-09-14T11:17:13.290 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.291+0000 7fe125ff88c0 1 < canceled part key=_multipart_FQ5WT12KB664.2~RIHN7T6T9VYY.2 size=833064 2024-09-14T11:17:13.297 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.299+0000 7fe125ff88c0 1 < canceled multipart upload key=FQ5WT12KB664 upload=RIHN7T6T9VYY tag=UTPYG1BVMZO3 type=write size=3978792 2024-09-14T11:17:13.304 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.303+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~Z3JWSERDPQR1.0 size=955392 2024-09-14T11:17:13.304 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.303+0000 7fe125ff88c0 1 > prepared multipart upload key=YN2HI39GPEDF upload=Z3JWSERDPQR1 tag=2S077S4N5IUC type=write size=2003968 2024-09-14T11:17:13.308 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.307+0000 7fe125ff88c0 1 < completed write operation key=W0B19NBHNLMZ tag=LCKZ0ELA9DY3 type=write size=268317 2024-09-14T11:17:13.311 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.311+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=76O5AREJQLTI type=del size=4005136 2024-09-14T11:17:13.315 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.315+0000 7fe125ff88c0 1 < completed delete operation key=6C3JZKTB8BP3 tag=Q7YCMAL896CB type=del 2024-09-14T11:17:13.321 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.323+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~R0GX98F9RHFX.0 size=75034 2024-09-14T11:17:13.321 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.323+0000 7fe125ff88c0 1 > prepared multipart upload key=ESVFZQQXE3GT upload=R0GX98F9RHFX tag=5KRMY990FQ7R type=write size=1123610 2024-09-14T11:17:13.325 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.327+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~LQW9SXVT5VCN.0 size=1048576 2024-09-14T11:17:13.328 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.331+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~LQW9SXVT5VCN.1 size=1048576 2024-09-14T11:17:13.331 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.331+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~LQW9SXVT5VCN.2 size=1036954 2024-09-14T11:17:13.338 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.339+0000 7fe125ff88c0 1 < completed multipart upload key=1ML6RIXI4C5P upload=LQW9SXVT5VCN tag=HPBES4V3QY0S type=write size=4182682 2024-09-14T11:17:13.344 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.343+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~8JOKIK65B03E.0 size=17596 2024-09-14T11:17:13.344 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.343+0000 7fe125ff88c0 1 > prepared multipart upload key=W0B19NBHNLMZ upload=8JOKIK65B03E tag=32NO78MGM1RB type=write size=1066172 2024-09-14T11:17:13.347 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.347+0000 7fe125ff88c0 1 < completed delete operation key=YN2HI39GPEDF tag=RUVLDVDS1PBV type=del 2024-09-14T11:17:13.351 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.351+0000 7fe125ff88c0 1 > prepared operation key=3YGN50MBAF41 tag=SY8OKRITG1QN type=del size=45484 2024-09-14T11:17:13.355 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.355+0000 7fe125ff88c0 1 < completed delete operation key=YCF2PCJ9TZMR tag=ILALT3BHH8QT type=del 2024-09-14T11:17:13.359 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.359+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=OZEWX4A21LHP type=del size=3116784 2024-09-14T11:17:13.362 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.363+0000 7fe125ff88c0 1 < completed delete operation key=FQ5WT12KB664 tag=0LENE1V97GCE type=del 2024-09-14T11:17:13.366 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.367+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=BF2KVTLTTM85 type=del size=2088818 2024-09-14T11:17:13.370 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.371+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~SW0AQMK2FL8J.0 size=1048576 2024-09-14T11:17:13.372 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.371+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~SW0AQMK2FL8J.1 size=651463 2024-09-14T11:17:13.378 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.379+0000 7fe125ff88c0 1 < completed multipart upload key=YCF2PCJ9TZMR upload=SW0AQMK2FL8J tag=0U9IAOORN6QU type=write size=2748615 2024-09-14T11:17:13.382 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.383+0000 7fe125ff88c0 1 > prepared operation key=SUCH37O8V1LY tag=C9NFP7NWP28G type=del size=2306543 2024-09-14T11:17:13.385 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.387+0000 7fe125ff88c0 1 < completed part key=_multipart_0VBX2FWYCFEZ.2~25Y6V9W006IY.0 size=1048576 2024-09-14T11:17:13.388 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.387+0000 7fe125ff88c0 1 < completed part key=_multipart_0VBX2FWYCFEZ.2~25Y6V9W006IY.1 size=1048576 2024-09-14T11:17:13.388 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.387+0000 7fe125ff88c0 1 < canceled part key=_multipart_0VBX2FWYCFEZ.2~25Y6V9W006IY.2 size=704430 2024-09-14T11:17:13.394 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.395+0000 7fe125ff88c0 1 < canceled multipart upload key=0VBX2FWYCFEZ upload=25Y6V9W006IY tag=L8PECR34HOTB type=write size=3850158 2024-09-14T11:17:13.401 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.403+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~LOQ55GTDJY2L.0 size=1048576 2024-09-14T11:17:13.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.407+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~LOQ55GTDJY2L.1 size=890039 2024-09-14T11:17:13.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.407+0000 7fe125ff88c0 1 > prepared multipart upload key=YN2HI39GPEDF upload=LOQ55GTDJY2L tag=KJZF5FEV250V type=write size=2987191 2024-09-14T11:17:13.409 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.411+0000 7fe125ff88c0 1 < completed write operation key=YN2HI39GPEDF tag=W6SS5XBQLWZX type=write size=58862 2024-09-14T11:17:13.416 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.415+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~01F3ZQIBD8TY.0 size=1048576 2024-09-14T11:17:13.419 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.419+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~01F3ZQIBD8TY.1 size=282793 2024-09-14T11:17:13.419 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.419+0000 7fe125ff88c0 1 > prepared multipart upload key=YN2HI39GPEDF upload=01F3ZQIBD8TY tag=0SYW5HTP9R8F type=write size=2379945 2024-09-14T11:17:13.423 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.423+0000 7fe125ff88c0 1 < canceled operation key=21HC4VMHXS6L tag=BW31IPOC2ZKD type=del size=1489100 2024-09-14T11:17:13.427 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.427+0000 7fe125ff88c0 1 > prepared operation key=K05LARTJ2QZ3 tag=DEU7QNJFEZ6A type=write size=149406 2024-09-14T11:17:13.431 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.431+0000 7fe125ff88c0 1 < completed delete operation key=ESVFZQQXE3GT tag=K9SNHCNC1NXP type=del 2024-09-14T11:17:13.435 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.435+0000 7fe125ff88c0 1 > prepared operation key=YFRH8WECBTJK tag=YZTPKL53INZV type=del size=1683244 2024-09-14T11:17:13.438 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.439+0000 7fe125ff88c0 1 < completed delete operation key=ESVFZQQXE3GT tag=ZR1X0OO0ZFQ3 type=del 2024-09-14T11:17:13.445 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.447+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~PUAQ9DG7I955.0 size=930337 2024-09-14T11:17:13.445 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.447+0000 7fe125ff88c0 1 > prepared multipart upload key=F9I82N7RQC81 upload=PUAQ9DG7I955 tag=Z4PURG7DADVP type=write size=1978913 2024-09-14T11:17:13.452 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.451+0000 7fe125ff88c0 1 < suggested remove operation key=SUCH37O8V1LY tag=E7EMAHO8H3Q1 type=write 2024-09-14T11:17:13.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.459+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=QD7258OWFZA1 type=write size=335034 2024-09-14T11:17:13.461 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.463+0000 7fe125ff88c0 -1 < failed to complete operation key=SUCH37O8V1LY tag=HHH84SXMGXCY type=write size=498737: (22) Invalid argument 2024-09-14T11:17:13.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.467+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=AYCK60V8IJ23 type=write size=373913 2024-09-14T11:17:13.469 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.471+0000 7fe125ff88c0 1 < completed delete operation key=SSNV25PDLDIS tag=VYEJ9YFVSBWV type=del 2024-09-14T11:17:13.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.475+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=DR6REP781R71 type=del size=23522 2024-09-14T11:17:13.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.475+0000 7fe125ff88c0 1 < canceled part key=_multipart_YN2HI39GPEDF.2~Z3JWSERDPQR1.0 size=955392 2024-09-14T11:17:13.480 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.479+0000 7fe125ff88c0 1 < canceled multipart upload key=YN2HI39GPEDF upload=Z3JWSERDPQR1 tag=2S077S4N5IUC type=write size=2003968 2024-09-14T11:17:13.486 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.487+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~E0HZ1VTK8AJK.0 size=1048576 2024-09-14T11:17:13.489 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.491+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~E0HZ1VTK8AJK.1 size=1048576 2024-09-14T11:17:13.492 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.491+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~E0HZ1VTK8AJK.2 size=985666 2024-09-14T11:17:13.492 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.491+0000 7fe125ff88c0 1 > prepared multipart upload key=21HC4VMHXS6L upload=E0HZ1VTK8AJK tag=6E5DVEIBONV7 type=write size=4131394 2024-09-14T11:17:13.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.495+0000 7fe125ff88c0 1 < completed delete operation key=YGEVGH840L18 tag=76O5AREJQLTI type=del 2024-09-14T11:17:13.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.503+0000 7fe125ff88c0 1 > prepared part key=_multipart_WEA3MQ0DI42N.2~A060UXN038FS.0 size=1048576 2024-09-14T11:17:13.505 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.507+0000 7fe125ff88c0 1 > prepared part key=_multipart_WEA3MQ0DI42N.2~A060UXN038FS.1 size=1048576 2024-09-14T11:17:13.508 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.507+0000 7fe125ff88c0 1 > prepared part key=_multipart_WEA3MQ0DI42N.2~A060UXN038FS.2 size=823919 2024-09-14T11:17:13.508 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.507+0000 7fe125ff88c0 1 > prepared multipart upload key=WEA3MQ0DI42N upload=A060UXN038FS tag=NI4SP6UBS1SK type=write size=3969647 2024-09-14T11:17:13.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.511+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~R0GX98F9RHFX.0 size=75034 2024-09-14T11:17:13.518 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.519+0000 7fe125ff88c0 1 < completed multipart upload key=ESVFZQQXE3GT upload=R0GX98F9RHFX tag=5KRMY990FQ7R type=write size=1123610 2024-09-14T11:17:13.520 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.523+0000 7fe125ff88c0 1 > prepared operation key=FQ5WT12KB664 tag=IM3BK0WCZ2CS type=del size=2106939 2024-09-14T11:17:13.524 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.523+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~8JOKIK65B03E.0 size=17596 2024-09-14T11:17:13.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.531+0000 7fe125ff88c0 1 < completed multipart upload key=W0B19NBHNLMZ upload=8JOKIK65B03E tag=32NO78MGM1RB type=write size=1066172 2024-09-14T11:17:13.534 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.535+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=FGQI3C1FXTUF type=del size=2946071 2024-09-14T11:17:13.540 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.539+0000 7fe125ff88c0 1 < suggested update operation key=3YGN50MBAF41 tag=SY8OKRITG1QN type=del size=45484 2024-09-14T11:17:13.544 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.543+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=UI6IGHD5RMY2 type=del size=160066 2024-09-14T11:17:13.551 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.551+0000 7fe125ff88c0 1 < suggested update operation key=V6B470G93KFT tag=OZEWX4A21LHP type=del size=3116784 2024-09-14T11:17:13.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.555+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=K6QJR5KRW0EY type=write size=862373 2024-09-14T11:17:13.558 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.559+0000 7fe125ff88c0 1 < completed delete operation key=L4XO0WTYKNXY tag=BF2KVTLTTM85 type=del 2024-09-14T11:17:13.562 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.563+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=UQWLRLK5HM73 type=write size=239915 2024-09-14T11:17:13.565 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.567+0000 7fe125ff88c0 -1 < failed to complete operation key=SUCH37O8V1LY tag=C9NFP7NWP28G type=del size=2306543: (22) Invalid argument 2024-09-14T11:17:13.572 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.571+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~FSW6I4Y3BIRC.0 size=989031 2024-09-14T11:17:13.572 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.571+0000 7fe125ff88c0 1 > prepared multipart upload key=FQ5WT12KB664 upload=FSW6I4Y3BIRC tag=D8UC6I66J1FV type=write size=2037607 2024-09-14T11:17:13.576 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.575+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~LOQ55GTDJY2L.0 size=1048576 2024-09-14T11:17:13.576 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.575+0000 7fe125ff88c0 1 < canceled part key=_multipart_YN2HI39GPEDF.2~LOQ55GTDJY2L.1 size=890039 2024-09-14T11:17:13.582 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.583+0000 7fe125ff88c0 1 < canceled multipart upload key=YN2HI39GPEDF upload=LOQ55GTDJY2L tag=KJZF5FEV250V type=write size=2987191 2024-09-14T11:17:13.588 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.587+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~MP13Z1AO7710.0 size=1048576 2024-09-14T11:17:13.591 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.591+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~MP13Z1AO7710.1 size=471055 2024-09-14T11:17:13.591 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.591+0000 7fe125ff88c0 1 > prepared multipart upload key=FQ5WT12KB664 upload=MP13Z1AO7710 tag=JS0XZKIATTY0 type=write size=2568207 2024-09-14T11:17:13.595 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.595+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~01F3ZQIBD8TY.0 size=1048576 2024-09-14T11:17:13.598 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.599+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~01F3ZQIBD8TY.1 size=282793 2024-09-14T11:17:13.604 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.603+0000 7fe125ff88c0 1 < completed multipart upload key=YN2HI39GPEDF upload=01F3ZQIBD8TY tag=0SYW5HTP9R8F type=write size=2379945 2024-09-14T11:17:13.607 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.607+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=HGX4803G327O type=write size=395041 2024-09-14T11:17:13.611 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.611+0000 7fe125ff88c0 1 < completed write operation key=K05LARTJ2QZ3 tag=DEU7QNJFEZ6A type=write size=149406 2024-09-14T11:17:13.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.619+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~5Z0508XUS0Q7.0 size=1048576 2024-09-14T11:17:13.620 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.619+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~5Z0508XUS0Q7.1 size=1048576 2024-09-14T11:17:13.623 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.623+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~5Z0508XUS0Q7.2 size=60019 2024-09-14T11:17:13.623 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.623+0000 7fe125ff88c0 1 > prepared multipart upload key=YGEVGH840L18 upload=5Z0508XUS0Q7 tag=35KASE3T5KPG type=write size=3205747 2024-09-14T11:17:13.627 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.627+0000 7fe125ff88c0 1 < completed delete operation key=YFRH8WECBTJK tag=YZTPKL53INZV type=del 2024-09-14T11:17:13.635 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.635+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~DLNG9DH86PN6.0 size=1048576 2024-09-14T11:17:13.638 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.639+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~DLNG9DH86PN6.1 size=838852 2024-09-14T11:17:13.638 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.639+0000 7fe125ff88c0 1 > prepared multipart upload key=YGEVGH840L18 upload=DLNG9DH86PN6 tag=1GEMZ9GA8WWV type=write size=2936004 2024-09-14T11:17:13.641 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.643+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~PUAQ9DG7I955.0 size=930337 2024-09-14T11:17:13.647 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.647+0000 7fe125ff88c0 1 < completed multipart upload key=F9I82N7RQC81 upload=PUAQ9DG7I955 tag=Z4PURG7DADVP type=write size=1978913 2024-09-14T11:17:13.651 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.651+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=1I97GNB36O5S type=del size=633028 2024-09-14T11:17:13.654 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.655+0000 7fe125ff88c0 1 < completed write operation key=F9I82N7RQC81 tag=QD7258OWFZA1 type=write size=335034 2024-09-14T11:17:13.661 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.663+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~ZSX05XHYYLJB.0 size=1048576 2024-09-14T11:17:13.664 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.667+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~ZSX05XHYYLJB.1 size=944350 2024-09-14T11:17:13.664 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.667+0000 7fe125ff88c0 1 > prepared multipart upload key=21HC4VMHXS6L upload=ZSX05XHYYLJB tag=YPWF1QOJHWH7 type=write size=3041502 2024-09-14T11:17:13.668 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.667+0000 7fe125ff88c0 1 < completed write operation key=ESVFZQQXE3GT tag=AYCK60V8IJ23 type=write size=373913 2024-09-14T11:17:13.675 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.675+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~BJY5DKXOQ46Z.0 size=1048576 2024-09-14T11:17:13.678 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.679+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~BJY5DKXOQ46Z.1 size=968185 2024-09-14T11:17:13.678 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.679+0000 7fe125ff88c0 1 > prepared multipart upload key=21HC4VMHXS6L upload=BJY5DKXOQ46Z tag=NNSBB6NBOSJR type=write size=3065337 2024-09-14T11:17:13.686 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.687+0000 7fe125ff88c0 1 < suggested update operation key=W0B19NBHNLMZ tag=DR6REP781R71 type=del size=23522 2024-09-14T11:17:13.690 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.691+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=0DPHQO2OJ3MW type=del size=2962974 2024-09-14T11:17:13.694 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.695+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~E0HZ1VTK8AJK.0 size=1048576 2024-09-14T11:17:13.697 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.699+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~E0HZ1VTK8AJK.1 size=1048576 2024-09-14T11:17:13.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.699+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~E0HZ1VTK8AJK.2 size=985666 2024-09-14T11:17:13.707 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.707+0000 7fe125ff88c0 1 < completed multipart upload key=21HC4VMHXS6L upload=E0HZ1VTK8AJK tag=6E5DVEIBONV7 type=write size=4131394 2024-09-14T11:17:13.711 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.711+0000 7fe125ff88c0 1 > prepared operation key=YFRH8WECBTJK tag=XP5L1OQ1ZKKF type=write size=660487 2024-09-14T11:17:13.714 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.715+0000 7fe125ff88c0 1 < completed part key=_multipart_WEA3MQ0DI42N.2~A060UXN038FS.0 size=1048576 2024-09-14T11:17:13.718 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.719+0000 7fe125ff88c0 1 < completed part key=_multipart_WEA3MQ0DI42N.2~A060UXN038FS.1 size=1048576 2024-09-14T11:17:13.718 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.719+0000 7fe125ff88c0 1 < canceled part key=_multipart_WEA3MQ0DI42N.2~A060UXN038FS.2 size=823919 2024-09-14T11:17:13.724 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.723+0000 7fe125ff88c0 1 < canceled multipart upload key=WEA3MQ0DI42N upload=A060UXN038FS tag=NI4SP6UBS1SK type=write size=3969647 2024-09-14T11:17:13.730 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.731+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~C7L25WV1STH5.0 size=31546 2024-09-14T11:17:13.730 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.731+0000 7fe125ff88c0 1 > prepared multipart upload key=YCF2PCJ9TZMR upload=C7L25WV1STH5 tag=U527M0Q0CM4X type=write size=1080122 2024-09-14T11:17:13.734 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.735+0000 7fe125ff88c0 1 < completed delete operation key=FQ5WT12KB664 tag=IM3BK0WCZ2CS type=del 2024-09-14T11:17:13.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.739+0000 7fe125ff88c0 1 > prepared operation key=N80X3YUF4OEL tag=B6I0GBB3CHMU type=del size=825057 2024-09-14T11:17:13.742 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.743+0000 7fe125ff88c0 1 < completed delete operation key=2KEKSWK0UT6C tag=FGQI3C1FXTUF type=del 2024-09-14T11:17:13.748 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.751+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~4IH012GWI3HE.0 size=1048576 2024-09-14T11:17:13.751 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.751+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~4IH012GWI3HE.1 size=1048576 2024-09-14T11:17:13.754 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.755+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~4IH012GWI3HE.2 size=682748 2024-09-14T11:17:13.754 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.755+0000 7fe125ff88c0 1 > prepared multipart upload key=ESVFZQQXE3GT upload=4IH012GWI3HE tag=IO4WDV9RJEKE type=write size=3828476 2024-09-14T11:17:13.762 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.763+0000 7fe125ff88c0 1 < suggested update operation key=4D2X7151977X tag=UI6IGHD5RMY2 type=del size=160066 2024-09-14T11:17:13.766 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.767+0000 7fe125ff88c0 1 > prepared operation key=6C3JZKTB8BP3 tag=XEK4QMZ25P0K type=del size=465306 2024-09-14T11:17:13.770 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.771+0000 7fe125ff88c0 1 < completed write operation key=WEA3MQ0DI42N tag=K6QJR5KRW0EY type=write size=862373 2024-09-14T11:17:13.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.775+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=FQIOP97AM112 type=del size=2522643 2024-09-14T11:17:13.777 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.779+0000 7fe125ff88c0 1 < completed write operation key=V6B470G93KFT tag=UQWLRLK5HM73 type=write size=239915 2024-09-14T11:17:13.781 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.783+0000 7fe125ff88c0 1 > prepared operation key=1ML6RIXI4C5P tag=UM5YTLN7NZ74 type=write size=995019 2024-09-14T11:17:13.785 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.787+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~FSW6I4Y3BIRC.0 size=989031 2024-09-14T11:17:13.791 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.791+0000 7fe125ff88c0 1 < completed multipart upload key=FQ5WT12KB664 upload=FSW6I4Y3BIRC tag=D8UC6I66J1FV type=write size=2037607 2024-09-14T11:17:13.795 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.795+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=CEMGRWWK96VQ type=del size=689788 2024-09-14T11:17:13.799 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.799+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~MP13Z1AO7710.0 size=1048576 2024-09-14T11:17:13.802 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.803+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~MP13Z1AO7710.1 size=471055 2024-09-14T11:17:13.808 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.807+0000 7fe125ff88c0 1 < completed multipart upload key=FQ5WT12KB664 upload=MP13Z1AO7710 tag=JS0XZKIATTY0 type=write size=2568207 2024-09-14T11:17:13.811 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.811+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=QCKUKXWUPZNC type=del size=3610510 2024-09-14T11:17:13.816 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.815+0000 7fe125ff88c0 1 < completed write operation key=SSNV25PDLDIS tag=HGX4803G327O type=write size=395041 2024-09-14T11:17:13.820 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.819+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=1V7P8U7KCF1M type=del size=3352913 2024-09-14T11:17:13.824 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.823+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~5Z0508XUS0Q7.0 size=1048576 2024-09-14T11:17:13.827 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.827+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~5Z0508XUS0Q7.1 size=1048576 2024-09-14T11:17:13.830 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.831+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~5Z0508XUS0Q7.2 size=60019 2024-09-14T11:17:13.836 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.835+0000 7fe125ff88c0 1 < completed multipart upload key=YGEVGH840L18 upload=5Z0508XUS0Q7 tag=35KASE3T5KPG type=write size=3205747 2024-09-14T11:17:13.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.843+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~9IYSL6XRB0L8.0 size=1048576 2024-09-14T11:17:13.846 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.847+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~9IYSL6XRB0L8.1 size=1048576 2024-09-14T11:17:13.849 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.851+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~9IYSL6XRB0L8.2 size=453244 2024-09-14T11:17:13.849 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.851+0000 7fe125ff88c0 1 > prepared multipart upload key=W0B19NBHNLMZ upload=9IYSL6XRB0L8 tag=YBEY2S1EOXSR type=write size=3598972 2024-09-14T11:17:13.853 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.855+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~DLNG9DH86PN6.0 size=1048576 2024-09-14T11:17:13.855 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.855+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~DLNG9DH86PN6.1 size=838852 2024-09-14T11:17:13.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.863+0000 7fe125ff88c0 1 < completed multipart upload key=YGEVGH840L18 upload=DLNG9DH86PN6 tag=1GEMZ9GA8WWV type=write size=2936004 2024-09-14T11:17:13.872 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.875+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~K9PX32UJMFKS.0 size=1048576 2024-09-14T11:17:13.875 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.875+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~K9PX32UJMFKS.1 size=296840 2024-09-14T11:17:13.875 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.875+0000 7fe125ff88c0 1 > prepared multipart upload key=SUCH37O8V1LY upload=K9PX32UJMFKS tag=3B8P8PJIES6N type=write size=2393992 2024-09-14T11:17:13.882 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.883+0000 7fe125ff88c0 1 < suggested remove operation key=W0B19NBHNLMZ tag=1I97GNB36O5S type=del 2024-09-14T11:17:13.889 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.891+0000 7fe125ff88c0 1 > prepared part key=_multipart_N94D3R7IOBNL.2~C6HS05SF1K70.0 size=1048576 2024-09-14T11:17:13.892 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.891+0000 7fe125ff88c0 1 > prepared part key=_multipart_N94D3R7IOBNL.2~C6HS05SF1K70.1 size=107913 2024-09-14T11:17:13.892 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.891+0000 7fe125ff88c0 1 > prepared multipart upload key=N94D3R7IOBNL upload=C6HS05SF1K70 tag=5BN5641SID2N type=write size=2205065 2024-09-14T11:17:13.896 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.899+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~ZSX05XHYYLJB.0 size=1048576 2024-09-14T11:17:13.899 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.899+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~ZSX05XHYYLJB.1 size=944350 2024-09-14T11:17:13.905 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.907+0000 7fe125ff88c0 1 < completed multipart upload key=21HC4VMHXS6L upload=ZSX05XHYYLJB tag=YPWF1QOJHWH7 type=write size=3041502 2024-09-14T11:17:13.912 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.915+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~BKNAU4D4XU0B.0 size=523244 2024-09-14T11:17:13.912 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.915+0000 7fe125ff88c0 1 > prepared multipart upload key=6C3JZKTB8BP3 upload=BKNAU4D4XU0B tag=TDN76XIWY03Q type=write size=1571820 2024-09-14T11:17:13.916 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.919+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~BJY5DKXOQ46Z.0 size=1048576 2024-09-14T11:17:13.919 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.919+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~BJY5DKXOQ46Z.1 size=968185 2024-09-14T11:17:13.925 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.927+0000 7fe125ff88c0 1 < completed multipart upload key=21HC4VMHXS6L upload=BJY5DKXOQ46Z tag=NNSBB6NBOSJR type=write size=3065337 2024-09-14T11:17:13.929 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.931+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=W556UIM9LFFJ type=del size=3905032 2024-09-14T11:17:13.936 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.935+0000 7fe125ff88c0 1 < suggested remove operation key=2KEKSWK0UT6C tag=0DPHQO2OJ3MW type=del 2024-09-14T11:17:13.940 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.939+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=LAJ020CB55CM type=del size=1934176 2024-09-14T11:17:13.948 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.947+0000 7fe125ff88c0 1 < suggested remove operation key=YFRH8WECBTJK tag=XP5L1OQ1ZKKF type=write 2024-09-14T11:17:13.954 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.955+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~C9PWKMGH6434.0 size=1048576 2024-09-14T11:17:13.957 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.959+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~C9PWKMGH6434.1 size=1048576 2024-09-14T11:17:13.960 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.959+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~C9PWKMGH6434.2 size=115283 2024-09-14T11:17:13.960 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.959+0000 7fe125ff88c0 1 > prepared multipart upload key=2UXA6SXDTUFT upload=C9PWKMGH6434 tag=NXSPS010INR7 type=write size=3261011 2024-09-14T11:17:13.964 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.963+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~C7L25WV1STH5.0 size=31546 2024-09-14T11:17:13.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.971+0000 7fe125ff88c0 1 < completed multipart upload key=YCF2PCJ9TZMR upload=C7L25WV1STH5 tag=U527M0Q0CM4X type=write size=1080122 2024-09-14T11:17:13.973 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.975+0000 7fe125ff88c0 1 > prepared operation key=6C3JZKTB8BP3 tag=OCZB256J0WUE type=del size=482267 2024-09-14T11:17:13.977 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.979+0000 7fe125ff88c0 1 < completed delete operation key=N80X3YUF4OEL tag=B6I0GBB3CHMU type=del 2024-09-14T11:17:13.981 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.983+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=9EZE1Q1NKRO0 type=del size=828514 2024-09-14T11:17:13.985 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.987+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~4IH012GWI3HE.0 size=1048576 2024-09-14T11:17:13.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.987+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~4IH012GWI3HE.1 size=1048576 2024-09-14T11:17:13.990 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.991+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~4IH012GWI3HE.2 size=682748 2024-09-14T11:17:13.996 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:13.995+0000 7fe125ff88c0 1 < completed multipart upload key=ESVFZQQXE3GT upload=4IH012GWI3HE tag=IO4WDV9RJEKE type=write size=3828476 2024-09-14T11:17:14.003 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.003+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~IPWF8I35MGON.0 size=1048576 2024-09-14T11:17:14.006 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.007+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~IPWF8I35MGON.1 size=1048576 2024-09-14T11:17:14.009 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.011+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~IPWF8I35MGON.2 size=918405 2024-09-14T11:17:14.009 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.011+0000 7fe125ff88c0 1 > prepared multipart upload key=0FITHLGQKQEC upload=IPWF8I35MGON tag=ZZMEMC3NGG44 type=write size=4064133 2024-09-14T11:17:14.013 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.015+0000 7fe125ff88c0 1 < completed delete operation key=6C3JZKTB8BP3 tag=XEK4QMZ25P0K type=del 2024-09-14T11:17:14.017 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.019+0000 7fe125ff88c0 1 > prepared operation key=6C3JZKTB8BP3 tag=QG0CCSAT5M1Y type=del size=3819989 2024-09-14T11:17:14.025 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.027+0000 7fe125ff88c0 1 < suggested update operation key=V6B470G93KFT tag=FQIOP97AM112 type=del size=2522643 2024-09-14T11:17:14.032 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.031+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~ZSIOUG39C3YR.0 size=277595 2024-09-14T11:17:14.032 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.031+0000 7fe125ff88c0 1 > prepared multipart upload key=V6B470G93KFT upload=ZSIOUG39C3YR tag=BFEI6941Y26O type=write size=1326171 2024-09-14T11:17:14.036 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.035+0000 7fe125ff88c0 1 < completed write operation key=1ML6RIXI4C5P tag=UM5YTLN7NZ74 type=write size=995019 2024-09-14T11:17:14.043 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.043+0000 7fe125ff88c0 1 > prepared part key=_multipart_N94D3R7IOBNL.2~ZJ6JF0YMX7IB.0 size=1048576 2024-09-14T11:17:14.046 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.047+0000 7fe125ff88c0 1 > prepared part key=_multipart_N94D3R7IOBNL.2~ZJ6JF0YMX7IB.1 size=1037578 2024-09-14T11:17:14.046 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.047+0000 7fe125ff88c0 1 > prepared multipart upload key=N94D3R7IOBNL upload=ZJ6JF0YMX7IB tag=915LYX9XR4KA type=write size=3134730 2024-09-14T11:17:14.051 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.051+0000 7fe125ff88c0 1 < completed delete operation key=4D2X7151977X tag=CEMGRWWK96VQ type=del 2024-09-14T11:17:14.055 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.055+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=CHZKCR6TYLFQ type=write size=179790 2024-09-14T11:17:14.059 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.059+0000 7fe125ff88c0 1 < canceled operation key=YCF2PCJ9TZMR tag=QCKUKXWUPZNC type=del size=3610510 2024-09-14T11:17:14.063 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.063+0000 7fe125ff88c0 1 > prepared operation key=FQ5WT12KB664 tag=C42IG3OMMGUP type=del size=3494971 2024-09-14T11:17:14.067 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.067+0000 7fe125ff88c0 1 < completed delete operation key=K3P6U6NU8I01 tag=1V7P8U7KCF1M type=del 2024-09-14T11:17:14.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.071+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=F0WWHADXF1KJ type=del size=2055583 2024-09-14T11:17:14.075 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.075+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~9IYSL6XRB0L8.0 size=1048576 2024-09-14T11:17:14.077 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.079+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~9IYSL6XRB0L8.1 size=1048576 2024-09-14T11:17:14.080 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.083+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~9IYSL6XRB0L8.2 size=453244 2024-09-14T11:17:14.086 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.087+0000 7fe125ff88c0 1 < completed multipart upload key=W0B19NBHNLMZ upload=9IYSL6XRB0L8 tag=YBEY2S1EOXSR type=write size=3598972 2024-09-14T11:17:14.093 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.095+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~4KCZKZUOIMJQ.0 size=1048576 2024-09-14T11:17:14.096 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.095+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~4KCZKZUOIMJQ.1 size=298933 2024-09-14T11:17:14.096 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.095+0000 7fe125ff88c0 1 > prepared multipart upload key=0VBX2FWYCFEZ upload=4KCZKZUOIMJQ tag=S7HAC6MU65X1 type=write size=2396085 2024-09-14T11:17:14.100 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.099+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~K9PX32UJMFKS.0 size=1048576 2024-09-14T11:17:14.102 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.103+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~K9PX32UJMFKS.1 size=296840 2024-09-14T11:17:14.108 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.111+0000 7fe125ff88c0 1 < completed multipart upload key=SUCH37O8V1LY upload=K9PX32UJMFKS tag=3B8P8PJIES6N type=write size=2393992 2024-09-14T11:17:14.113 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.115+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=0MJL5J4KYZFY type=del size=874693 2024-09-14T11:17:14.116 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.119+0000 7fe125ff88c0 1 < completed part key=_multipart_N94D3R7IOBNL.2~C6HS05SF1K70.0 size=1048576 2024-09-14T11:17:14.119 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.119+0000 7fe125ff88c0 1 < completed part key=_multipart_N94D3R7IOBNL.2~C6HS05SF1K70.1 size=107913 2024-09-14T11:17:14.125 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.127+0000 7fe125ff88c0 1 < completed multipart upload key=N94D3R7IOBNL upload=C6HS05SF1K70 tag=5BN5641SID2N type=write size=2205065 2024-09-14T11:17:14.129 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.131+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=NN1AD0FTX20E type=del size=698655 2024-09-14T11:17:14.133 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.135+0000 7fe125ff88c0 1 < completed part key=_multipart_6C3JZKTB8BP3.2~BKNAU4D4XU0B.0 size=523244 2024-09-14T11:17:14.139 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.139+0000 7fe125ff88c0 1 < completed multipart upload key=6C3JZKTB8BP3 upload=BKNAU4D4XU0B tag=TDN76XIWY03Q type=write size=1571820 2024-09-14T11:17:14.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.147+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~7IY7B8BQ25X6.0 size=645000 2024-09-14T11:17:14.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.147+0000 7fe125ff88c0 1 > prepared multipart upload key=0FITHLGQKQEC upload=7IY7B8BQ25X6 tag=CFBUFFC5OZXJ type=write size=1693576 2024-09-14T11:17:14.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.151+0000 7fe125ff88c0 1 < canceled operation key=YN2HI39GPEDF tag=W556UIM9LFFJ type=del size=3905032 2024-09-14T11:17:14.155 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.155+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=04B1RS352P2S type=del size=96589 2024-09-14T11:17:14.162 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.163+0000 7fe125ff88c0 1 < suggested remove operation key=2LH5U05C2F8C tag=LAJ020CB55CM type=del 2024-09-14T11:17:14.166 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.167+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=7KANPZYBL9JK type=write size=934959 2024-09-14T11:17:14.170 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.171+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~C9PWKMGH6434.0 size=1048576 2024-09-14T11:17:14.173 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.175+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~C9PWKMGH6434.1 size=1048576 2024-09-14T11:17:14.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.175+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~C9PWKMGH6434.2 size=115283 2024-09-14T11:17:14.182 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.183+0000 7fe125ff88c0 1 < completed multipart upload key=2UXA6SXDTUFT upload=C9PWKMGH6434 tag=NXSPS010INR7 type=write size=3261011 2024-09-14T11:17:14.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.191+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~JEVEJIORM6G6.0 size=1048576 2024-09-14T11:17:14.192 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.191+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~JEVEJIORM6G6.1 size=1048576 2024-09-14T11:17:14.195 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.195+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~JEVEJIORM6G6.2 size=1038755 2024-09-14T11:17:14.195 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.195+0000 7fe125ff88c0 1 > prepared multipart upload key=ESVFZQQXE3GT upload=JEVEJIORM6G6 tag=KZHD0DI3JPT8 type=write size=4184483 2024-09-14T11:17:14.199 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.199+0000 7fe125ff88c0 1 < completed delete operation key=6C3JZKTB8BP3 tag=OCZB256J0WUE type=del 2024-09-14T11:17:14.203 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.203+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=DG7XUFMI88U7 type=del size=2135126 2024-09-14T11:17:14.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.207+0000 7fe125ff88c0 1 < completed delete operation key=21HC4VMHXS6L tag=9EZE1Q1NKRO0 type=del 2024-09-14T11:17:14.211 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.211+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=HSMN41VQFNUD type=write size=965712 2024-09-14T11:17:14.214 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.215+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~IPWF8I35MGON.0 size=1048576 2024-09-14T11:17:14.219 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.219+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~IPWF8I35MGON.1 size=1048576 2024-09-14T11:17:14.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.219+0000 7fe125ff88c0 1 < canceled part key=_multipart_0FITHLGQKQEC.2~IPWF8I35MGON.2 size=918405 2024-09-14T11:17:14.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.227+0000 7fe125ff88c0 1 < canceled multipart upload key=0FITHLGQKQEC upload=IPWF8I35MGON tag=ZZMEMC3NGG44 type=write size=4064133 2024-09-14T11:17:14.233 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.235+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~GVM0M8SSSSH4.0 size=780540 2024-09-14T11:17:14.234 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.235+0000 7fe125ff88c0 1 > prepared multipart upload key=SUCH37O8V1LY upload=GVM0M8SSSSH4 tag=N69EQLJSGRY0 type=write size=1829116 2024-09-14T11:17:14.241 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.243+0000 7fe125ff88c0 1 < suggested update operation key=6C3JZKTB8BP3 tag=QG0CCSAT5M1Y type=del size=3819989 2024-09-14T11:17:14.247 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.247+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~V6AVXMMJKV42.0 size=1048576 2024-09-14T11:17:14.250 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.251+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~V6AVXMMJKV42.1 size=1048576 2024-09-14T11:17:14.253 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.255+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~V6AVXMMJKV42.2 size=166941 2024-09-14T11:17:14.253 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.255+0000 7fe125ff88c0 1 > prepared multipart upload key=V6B470G93KFT upload=V6AVXMMJKV42 tag=56U1PLSM6VAS type=write size=3312669 2024-09-14T11:17:14.257 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.259+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~ZSIOUG39C3YR.0 size=277595 2024-09-14T11:17:14.263 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.263+0000 7fe125ff88c0 1 < completed multipart upload key=V6B470G93KFT upload=ZSIOUG39C3YR tag=BFEI6941Y26O type=write size=1326171 2024-09-14T11:17:14.267 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.267+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=138GXF4HTIJI type=del size=324635 2024-09-14T11:17:14.271 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.271+0000 7fe125ff88c0 1 < completed part key=_multipart_N94D3R7IOBNL.2~ZJ6JF0YMX7IB.0 size=1048576 2024-09-14T11:17:14.275 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.275+0000 7fe125ff88c0 1 < completed part key=_multipart_N94D3R7IOBNL.2~ZJ6JF0YMX7IB.1 size=1037578 2024-09-14T11:17:14.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.287+0000 7fe125ff88c0 1 < completed multipart upload key=N94D3R7IOBNL upload=ZJ6JF0YMX7IB tag=915LYX9XR4KA type=write size=3134730 2024-09-14T11:17:14.286 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.287+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=EZ2K65TOKH9M type=del size=2236068 2024-09-14T11:17:14.290 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.291+0000 7fe125ff88c0 1 < completed write operation key=WEA3MQ0DI42N tag=CHZKCR6TYLFQ type=write size=179790 2024-09-14T11:17:14.297 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.299+0000 7fe125ff88c0 1 > prepared part key=_multipart_2KEKSWK0UT6C.2~FZ90HRGI78E3.0 size=917300 2024-09-14T11:17:14.298 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.299+0000 7fe125ff88c0 1 > prepared multipart upload key=2KEKSWK0UT6C upload=FZ90HRGI78E3 tag=E1PWN4NFO6FL type=write size=1965876 2024-09-14T11:17:14.301 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.303+0000 7fe125ff88c0 1 < canceled operation key=FQ5WT12KB664 tag=C42IG3OMMGUP type=del size=3494971 2024-09-14T11:17:14.305 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.307+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=BEIH3SVD04QA type=del size=915490 2024-09-14T11:17:14.314 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.315+0000 7fe125ff88c0 1 < suggested remove operation key=YGEVGH840L18 tag=F0WWHADXF1KJ type=del 2024-09-14T11:17:14.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.319+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=CFSY14ZKXISR type=del size=822831 2024-09-14T11:17:14.321 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.323+0000 7fe125ff88c0 1 < completed part key=_multipart_0VBX2FWYCFEZ.2~4KCZKZUOIMJQ.0 size=1048576 2024-09-14T11:17:14.325 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.327+0000 7fe125ff88c0 1 < completed part key=_multipart_0VBX2FWYCFEZ.2~4KCZKZUOIMJQ.1 size=298933 2024-09-14T11:17:14.331 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.331+0000 7fe125ff88c0 1 < completed multipart upload key=0VBX2FWYCFEZ upload=4KCZKZUOIMJQ tag=S7HAC6MU65X1 type=write size=2396085 2024-09-14T11:17:14.338 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.339+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~O5V49PM1A03Q.0 size=1048576 2024-09-14T11:17:14.341 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.343+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~O5V49PM1A03Q.1 size=1048576 2024-09-14T11:17:14.344 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.343+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~O5V49PM1A03Q.2 size=870764 2024-09-14T11:17:14.344 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.343+0000 7fe125ff88c0 1 > prepared multipart upload key=2UXA6SXDTUFT upload=O5V49PM1A03Q tag=3HRJHHA7NMNV type=write size=4016492 2024-09-14T11:17:14.347 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.347+0000 7fe125ff88c0 1 < canceled operation key=6PLUU2QIO9LJ tag=0MJL5J4KYZFY type=del size=874693 2024-09-14T11:17:14.351 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.351+0000 7fe125ff88c0 1 > prepared operation key=LYBGDNKUROWH tag=HL0EFR99BKTA type=del size=2456896 2024-09-14T11:17:14.356 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.355+0000 7fe125ff88c0 -1 < failed to complete operation key=2LH5U05C2F8C tag=NN1AD0FTX20E type=del size=698655: (22) Invalid argument 2024-09-14T11:17:14.360 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.359+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=EHH20P1XRBZP type=del size=1437142 2024-09-14T11:17:14.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.363+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~7IY7B8BQ25X6.0 size=645000 2024-09-14T11:17:14.369 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.371+0000 7fe125ff88c0 1 < completed multipart upload key=0FITHLGQKQEC upload=7IY7B8BQ25X6 tag=CFBUFFC5OZXJ type=write size=1693576 2024-09-14T11:17:14.374 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.375+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=56RML26KAWML type=del size=2681934 2024-09-14T11:17:14.378 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.379+0000 7fe125ff88c0 -1 < failed to complete operation key=2LH5U05C2F8C tag=04B1RS352P2S type=del size=96589: (22) Invalid argument 2024-09-14T11:17:14.383 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.383+0000 7fe125ff88c0 1 > prepared operation key=YFRH8WECBTJK tag=9MUHPGZEMWHN type=del size=490207 2024-09-14T11:17:14.388 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.387+0000 7fe125ff88c0 1 < completed write operation key=W0B19NBHNLMZ tag=7KANPZYBL9JK type=write size=934959 2024-09-14T11:17:14.394 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.395+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~7AGG19XSFJKA.0 size=317717 2024-09-14T11:17:14.394 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.395+0000 7fe125ff88c0 1 > prepared multipart upload key=FQ5WT12KB664 upload=7AGG19XSFJKA tag=9M3O74C4NA95 type=write size=1366293 2024-09-14T11:17:14.398 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.399+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~JEVEJIORM6G6.0 size=1048576 2024-09-14T11:17:14.401 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.403+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~JEVEJIORM6G6.1 size=1048576 2024-09-14T11:17:14.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.407+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~JEVEJIORM6G6.2 size=1038755 2024-09-14T11:17:14.411 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.411+0000 7fe125ff88c0 1 < completed multipart upload key=ESVFZQQXE3GT upload=JEVEJIORM6G6 tag=KZHD0DI3JPT8 type=write size=4184483 2024-09-14T11:17:14.415 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.415+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=6CIOLMSW2A43 type=del size=225577 2024-09-14T11:17:14.423 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.423+0000 7fe125ff88c0 1 < suggested update operation key=WEA3MQ0DI42N tag=DG7XUFMI88U7 type=del size=2135126 2024-09-14T11:17:14.427 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.427+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=QMV4HZWDQOX2 type=del size=3030378 2024-09-14T11:17:14.431 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.431+0000 7fe125ff88c0 1 < completed write operation key=6PLUU2QIO9LJ tag=HSMN41VQFNUD type=write size=965712 2024-09-14T11:17:14.434 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.435+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=P0P9NCBG4U0K type=del size=3870106 2024-09-14T11:17:14.438 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.439+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~GVM0M8SSSSH4.0 size=780540 2024-09-14T11:17:14.444 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.447+0000 7fe125ff88c0 1 < completed multipart upload key=SUCH37O8V1LY upload=GVM0M8SSSSH4 tag=N69EQLJSGRY0 type=write size=1829116 2024-09-14T11:17:14.448 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.451+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=WOTWYGUDL3Y7 type=del size=4099568 2024-09-14T11:17:14.453 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.455+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~V6AVXMMJKV42.0 size=1048576 2024-09-14T11:17:14.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.455+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~V6AVXMMJKV42.1 size=1048576 2024-09-14T11:17:14.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.455+0000 7fe125ff88c0 1 < canceled part key=_multipart_V6B470G93KFT.2~V6AVXMMJKV42.2 size=166941 2024-09-14T11:17:14.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.463+0000 7fe125ff88c0 1 < canceled multipart upload key=V6B470G93KFT upload=V6AVXMMJKV42 tag=56U1PLSM6VAS type=write size=3312669 2024-09-14T11:17:14.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.467+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=T8KVWC1JFY1I type=write size=1035308 2024-09-14T11:17:14.469 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.471+0000 7fe125ff88c0 1 < completed delete operation key=4D2X7151977X tag=138GXF4HTIJI type=del 2024-09-14T11:17:14.475 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.475+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~PXZ2827JZFO7.0 size=1048576 2024-09-14T11:17:14.478 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.479+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~PXZ2827JZFO7.1 size=1048576 2024-09-14T11:17:14.481 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.483+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~PXZ2827JZFO7.2 size=373217 2024-09-14T11:17:14.481 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.483+0000 7fe125ff88c0 1 > prepared multipart upload key=46ZTDBWFVSUH upload=PXZ2827JZFO7 tag=L0E11FJT4KB4 type=write size=3518945 2024-09-14T11:17:14.488 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.491+0000 7fe125ff88c0 1 < suggested remove operation key=2LH5U05C2F8C tag=EZ2K65TOKH9M type=del 2024-09-14T11:17:14.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.495+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~3KD0AWU0SHM4.0 size=304147 2024-09-14T11:17:14.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.495+0000 7fe125ff88c0 1 > prepared multipart upload key=K3P6U6NU8I01 upload=3KD0AWU0SHM4 tag=VYI7MYQFY35J type=write size=1352723 2024-09-14T11:17:14.499 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.499+0000 7fe125ff88c0 1 < completed part key=_multipart_2KEKSWK0UT6C.2~FZ90HRGI78E3.0 size=917300 2024-09-14T11:17:14.505 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.507+0000 7fe125ff88c0 1 < completed multipart upload key=2KEKSWK0UT6C upload=FZ90HRGI78E3 tag=E1PWN4NFO6FL type=write size=1965876 2024-09-14T11:17:14.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.511+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~1LU17SQH1MFR.0 size=1048576 2024-09-14T11:17:14.515 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.515+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~1LU17SQH1MFR.1 size=1048576 2024-09-14T11:17:14.518 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.519+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~1LU17SQH1MFR.2 size=897426 2024-09-14T11:17:14.518 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.519+0000 7fe125ff88c0 1 > prepared multipart upload key=35EB6U5O4A51 upload=1LU17SQH1MFR tag=DA8ZZU2QOBJJ type=write size=4043154 2024-09-14T11:17:14.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.523+0000 7fe125ff88c0 1 < completed delete operation key=YN2HI39GPEDF tag=BEIH3SVD04QA type=del 2024-09-14T11:17:14.526 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.527+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=3M5HFV6H33AF type=write size=621206 2024-09-14T11:17:14.530 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.531+0000 7fe125ff88c0 1 < completed delete operation key=ESVFZQQXE3GT tag=CFSY14ZKXISR type=del 2024-09-14T11:17:14.534 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.535+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=97GGI1NC512P type=del size=3438220 2024-09-14T11:17:14.538 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.539+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~O5V49PM1A03Q.0 size=1048576 2024-09-14T11:17:14.541 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.543+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~O5V49PM1A03Q.1 size=1048576 2024-09-14T11:17:14.544 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.543+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~O5V49PM1A03Q.2 size=870764 2024-09-14T11:17:14.550 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.551+0000 7fe125ff88c0 1 < completed multipart upload key=2UXA6SXDTUFT upload=O5V49PM1A03Q tag=3HRJHHA7NMNV type=write size=4016492 2024-09-14T11:17:14.553 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.555+0000 7fe125ff88c0 1 > prepared operation key=3YGN50MBAF41 tag=X7JHU338XR4J type=del size=3643681 2024-09-14T11:17:14.557 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.559+0000 7fe125ff88c0 1 < canceled operation key=LYBGDNKUROWH tag=HL0EFR99BKTA type=del size=2456896 2024-09-14T11:17:14.564 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.567+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~RLOWLRZ7EUSB.0 size=1048576 2024-09-14T11:17:14.567 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.567+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~RLOWLRZ7EUSB.1 size=1048576 2024-09-14T11:17:14.571 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.571+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~RLOWLRZ7EUSB.2 size=404271 2024-09-14T11:17:14.571 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.571+0000 7fe125ff88c0 1 > prepared multipart upload key=2LH5U05C2F8C upload=RLOWLRZ7EUSB tag=P1538XZG2EDR type=write size=3549999 2024-09-14T11:17:14.578 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.579+0000 7fe125ff88c0 -1 < failed to complete operation key=WEA3MQ0DI42N tag=EHH20P1XRBZP type=del size=1437142: (22) Invalid argument 2024-09-14T11:17:14.582 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.583+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=EV7HMEP69KV7 type=del size=1708594 2024-09-14T11:17:14.590 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.591+0000 7fe125ff88c0 1 < suggested update operation key=YCF2PCJ9TZMR tag=56RML26KAWML type=del size=2681934 2024-09-14T11:17:14.594 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.595+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=22BALYL0PTUL type=del size=2913699 2024-09-14T11:17:14.598 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.599+0000 7fe125ff88c0 1 < completed delete operation key=YFRH8WECBTJK tag=9MUHPGZEMWHN type=del 2024-09-14T11:17:14.602 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.603+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=6V1UYHMAJXZJ type=del size=3502320 2024-09-14T11:17:14.606 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.607+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~7AGG19XSFJKA.0 size=317717 2024-09-14T11:17:14.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.611+0000 7fe125ff88c0 1 < completed multipart upload key=FQ5WT12KB664 upload=7AGG19XSFJKA tag=9M3O74C4NA95 type=write size=1366293 2024-09-14T11:17:14.618 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.619+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~45Y6812TYWIN.0 size=1048576 2024-09-14T11:17:14.621 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.623+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~45Y6812TYWIN.1 size=334330 2024-09-14T11:17:14.621 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.623+0000 7fe125ff88c0 1 > prepared multipart upload key=LYBGDNKUROWH upload=45Y6812TYWIN tag=30B6WDA2TU47 type=write size=2431482 2024-09-14T11:17:14.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.631+0000 7fe125ff88c0 1 < suggested update operation key=YN2HI39GPEDF tag=6CIOLMSW2A43 type=del size=225577 2024-09-14T11:17:14.632 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.635+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=G1VB51XRQD0K type=write size=54881 2024-09-14T11:17:14.636 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.635+0000 7fe125ff88c0 1 < completed delete operation key=V6B470G93KFT tag=QMV4HZWDQOX2 type=del 2024-09-14T11:17:14.640 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.643+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=H0G3PP4BO4SA type=del size=2771432 2024-09-14T11:17:14.644 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.643+0000 7fe125ff88c0 1 < completed delete operation key=ESVFZQQXE3GT tag=P0P9NCBG4U0K type=del 2024-09-14T11:17:14.648 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.647+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=YV163WQX39E9 type=del size=4172793 2024-09-14T11:17:14.656 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.655+0000 7fe125ff88c0 1 < suggested update operation key=F9I82N7RQC81 tag=WOTWYGUDL3Y7 type=del size=4099568 2024-09-14T11:17:14.660 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.659+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=WH11S36TNQYH type=del size=839587 2024-09-14T11:17:14.664 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.663+0000 7fe125ff88c0 1 < completed write operation key=N94D3R7IOBNL tag=T8KVWC1JFY1I type=write size=1035308 2024-09-14T11:17:14.670 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.671+0000 7fe125ff88c0 1 > prepared part key=_multipart_6PLUU2QIO9LJ.2~P7R010NYW3AA.0 size=990194 2024-09-14T11:17:14.670 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.671+0000 7fe125ff88c0 1 > prepared multipart upload key=6PLUU2QIO9LJ upload=P7R010NYW3AA tag=91PSOBBK5JQE type=write size=2038770 2024-09-14T11:17:14.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.675+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~PXZ2827JZFO7.0 size=1048576 2024-09-14T11:17:14.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.679+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~PXZ2827JZFO7.1 size=1048576 2024-09-14T11:17:14.680 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.679+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~PXZ2827JZFO7.2 size=373217 2024-09-14T11:17:14.686 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.687+0000 7fe125ff88c0 1 < completed multipart upload key=46ZTDBWFVSUH upload=PXZ2827JZFO7 tag=L0E11FJT4KB4 type=write size=3518945 2024-09-14T11:17:14.690 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.691+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=E6QM56SHG2AC type=del size=1509224 2024-09-14T11:17:14.693 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.695+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~3KD0AWU0SHM4.0 size=304147 2024-09-14T11:17:14.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.699+0000 7fe125ff88c0 1 < completed multipart upload key=K3P6U6NU8I01 upload=3KD0AWU0SHM4 tag=VYI7MYQFY35J type=write size=1352723 2024-09-14T11:17:14.706 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.707+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~ZJZQG82OLV2L.0 size=1048576 2024-09-14T11:17:14.708 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.711+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~ZJZQG82OLV2L.1 size=1048576 2024-09-14T11:17:14.711 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.711+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~ZJZQG82OLV2L.2 size=64053 2024-09-14T11:17:14.711 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.711+0000 7fe125ff88c0 1 > prepared multipart upload key=4D2X7151977X upload=ZJZQG82OLV2L tag=QXQX0I2XE2Z5 type=write size=3209781 2024-09-14T11:17:14.715 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.715+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~1LU17SQH1MFR.0 size=1048576 2024-09-14T11:17:14.715 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.715+0000 7fe125ff88c0 1 < canceled part key=_multipart_35EB6U5O4A51.2~1LU17SQH1MFR.1 size=1048576 2024-09-14T11:17:14.718 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.719+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~1LU17SQH1MFR.2 size=897426 2024-09-14T11:17:14.724 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.723+0000 7fe125ff88c0 1 < canceled multipart upload key=35EB6U5O4A51 upload=1LU17SQH1MFR tag=DA8ZZU2QOBJJ type=write size=4043154 2024-09-14T11:17:14.731 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.731+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~U84CTU2PW32L.0 size=1048576 2024-09-14T11:17:14.734 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.735+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~U84CTU2PW32L.1 size=1048576 2024-09-14T11:17:14.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.739+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~U84CTU2PW32L.2 size=137901 2024-09-14T11:17:14.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.739+0000 7fe125ff88c0 1 > prepared multipart upload key=L4XO0WTYKNXY upload=U84CTU2PW32L tag=L1ROWAS1DUGL type=write size=3283629 2024-09-14T11:17:14.745 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.747+0000 7fe125ff88c0 1 < suggested update operation key=2LH5U05C2F8C tag=3M5HFV6H33AF type=write size=621206 2024-09-14T11:17:14.751 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.751+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~FWQ31C97LKCK.0 size=1048576 2024-09-14T11:17:14.754 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.755+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~FWQ31C97LKCK.1 size=242585 2024-09-14T11:17:14.754 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.755+0000 7fe125ff88c0 1 > prepared multipart upload key=YGEVGH840L18 upload=FWQ31C97LKCK tag=UZ9J6I1LM3ZE type=write size=2339737 2024-09-14T11:17:14.762 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.763+0000 7fe125ff88c0 1 < suggested remove operation key=4D2X7151977X tag=97GGI1NC512P type=del 2024-09-14T11:17:14.766 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.767+0000 7fe125ff88c0 1 > prepared operation key=SUCH37O8V1LY tag=JQ6B6807ALLJ type=write size=258467 2024-09-14T11:17:14.769 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.771+0000 7fe125ff88c0 1 < completed delete operation key=3YGN50MBAF41 tag=X7JHU338XR4J type=del 2024-09-14T11:17:14.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.775+0000 7fe125ff88c0 1 > prepared operation key=3OU4U9JF3ZD5 tag=XSH3DSXOBEW1 type=del size=3120888 2024-09-14T11:17:14.776 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.779+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~RLOWLRZ7EUSB.0 size=1048576 2024-09-14T11:17:14.779 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.779+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~RLOWLRZ7EUSB.1 size=1048576 2024-09-14T11:17:14.782 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.783+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~RLOWLRZ7EUSB.2 size=404271 2024-09-14T11:17:14.789 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.791+0000 7fe125ff88c0 1 < completed multipart upload key=2LH5U05C2F8C upload=RLOWLRZ7EUSB tag=P1538XZG2EDR type=write size=3549999 2024-09-14T11:17:14.796 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.795+0000 7fe125ff88c0 1 > prepared part key=_multipart_2KEKSWK0UT6C.2~ZH0XV05KAQ35.0 size=1048576 2024-09-14T11:17:14.799 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.799+0000 7fe125ff88c0 1 > prepared part key=_multipart_2KEKSWK0UT6C.2~ZH0XV05KAQ35.1 size=996452 2024-09-14T11:17:14.799 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.799+0000 7fe125ff88c0 1 > prepared multipart upload key=2KEKSWK0UT6C upload=ZH0XV05KAQ35 tag=DJS8VHOYMSQ5 type=write size=3093604 2024-09-14T11:17:14.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.807+0000 7fe125ff88c0 1 < suggested update operation key=2KEKSWK0UT6C tag=EV7HMEP69KV7 type=del size=1708594 2024-09-14T11:17:14.814 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.815+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~2S3TOVVFO3NC.0 size=1048576 2024-09-14T11:17:14.816 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.819+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~2S3TOVVFO3NC.1 size=1048576 2024-09-14T11:17:14.819 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.819+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~2S3TOVVFO3NC.2 size=777071 2024-09-14T11:17:14.819 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.819+0000 7fe125ff88c0 1 > prepared multipart upload key=YGEVGH840L18 upload=2S3TOVVFO3NC tag=QLEAKJ754D1A type=write size=3922799 2024-09-14T11:17:14.823 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.823+0000 7fe125ff88c0 1 < completed delete operation key=2UXA6SXDTUFT tag=22BALYL0PTUL type=del 2024-09-14T11:17:14.830 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.831+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~7ZZTR4A42WZE.0 size=1048576 2024-09-14T11:17:14.832 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.835+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~7ZZTR4A42WZE.1 size=966464 2024-09-14T11:17:14.833 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.835+0000 7fe125ff88c0 1 > prepared multipart upload key=46ZTDBWFVSUH upload=7ZZTR4A42WZE tag=BNTQ9V7BNCVR type=write size=3063616 2024-09-14T11:17:14.840 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.843+0000 7fe125ff88c0 1 < suggested remove operation key=SSNV25PDLDIS tag=6V1UYHMAJXZJ type=del 2024-09-14T11:17:14.844 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.847+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=FEQQYCAY2THE type=del size=645433 2024-09-14T11:17:14.848 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.847+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~45Y6812TYWIN.0 size=1048576 2024-09-14T11:17:14.851 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.851+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~45Y6812TYWIN.1 size=334330 2024-09-14T11:17:14.857 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.859+0000 7fe125ff88c0 1 < completed multipart upload key=LYBGDNKUROWH upload=45Y6812TYWIN tag=30B6WDA2TU47 type=write size=2431482 2024-09-14T11:17:14.861 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.863+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=3DUFZAB4X6RC type=del size=3318374 2024-09-14T11:17:14.865 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.867+0000 7fe125ff88c0 1 < canceled operation key=N94D3R7IOBNL tag=G1VB51XRQD0K type=write size=54881 2024-09-14T11:17:14.869 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.871+0000 7fe125ff88c0 1 > prepared operation key=K05LARTJ2QZ3 tag=F78WL9KSV56I type=write size=195019 2024-09-14T11:17:14.873 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.875+0000 7fe125ff88c0 1 < completed delete operation key=0VBX2FWYCFEZ tag=H0G3PP4BO4SA type=del 2024-09-14T11:17:14.876 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.879+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=O2X6WN8AQO3U type=write size=661188 2024-09-14T11:17:14.886 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.887+0000 7fe125ff88c0 1 < suggested remove operation key=YCF2PCJ9TZMR tag=YV163WQX39E9 type=del 2024-09-14T11:17:14.890 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.891+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=4AMKWKN7EYYP type=del size=579049 2024-09-14T11:17:14.894 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.895+0000 7fe125ff88c0 -1 < failed to complete operation key=2LH5U05C2F8C tag=WH11S36TNQYH type=del size=839587: (22) Invalid argument 2024-09-14T11:17:14.897 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.899+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=QAB4I7K1U3N3 type=del size=3696760 2024-09-14T11:17:14.902 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.903+0000 7fe125ff88c0 1 < completed part key=_multipart_6PLUU2QIO9LJ.2~P7R010NYW3AA.0 size=990194 2024-09-14T11:17:14.908 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.911+0000 7fe125ff88c0 1 < completed multipart upload key=6PLUU2QIO9LJ upload=P7R010NYW3AA tag=91PSOBBK5JQE type=write size=2038770 2024-09-14T11:17:14.912 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.915+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=DJFPEL9DL21F type=del size=1317360 2024-09-14T11:17:14.916 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.919+0000 7fe125ff88c0 1 < completed delete operation key=K3P6U6NU8I01 tag=E6QM56SHG2AC type=del 2024-09-14T11:17:14.921 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.923+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=4S65WSCQY4AV type=del size=2719785 2024-09-14T11:17:14.924 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.927+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~ZJZQG82OLV2L.0 size=1048576 2024-09-14T11:17:14.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.927+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~ZJZQG82OLV2L.1 size=1048576 2024-09-14T11:17:14.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.927+0000 7fe125ff88c0 1 < canceled part key=_multipart_4D2X7151977X.2~ZJZQG82OLV2L.2 size=64053 2024-09-14T11:17:14.936 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.939+0000 7fe125ff88c0 1 < canceled multipart upload key=4D2X7151977X upload=ZJZQG82OLV2L tag=QXQX0I2XE2Z5 type=write size=3209781 2024-09-14T11:17:14.940 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.939+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=ODSTF74HWOAV type=del size=4085657 2024-09-14T11:17:14.944 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.943+0000 7fe125ff88c0 1 < completed part key=_multipart_L4XO0WTYKNXY.2~U84CTU2PW32L.0 size=1048576 2024-09-14T11:17:14.947 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.947+0000 7fe125ff88c0 1 < completed part key=_multipart_L4XO0WTYKNXY.2~U84CTU2PW32L.1 size=1048576 2024-09-14T11:17:14.950 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.951+0000 7fe125ff88c0 1 < completed part key=_multipart_L4XO0WTYKNXY.2~U84CTU2PW32L.2 size=137901 2024-09-14T11:17:14.957 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.959+0000 7fe125ff88c0 1 < completed multipart upload key=L4XO0WTYKNXY upload=U84CTU2PW32L tag=L1ROWAS1DUGL type=write size=3283629 2024-09-14T11:17:14.964 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.963+0000 7fe125ff88c0 1 > prepared part key=_multipart_2KEKSWK0UT6C.2~LE4PRB7FELY4.0 size=729664 2024-09-14T11:17:14.964 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.963+0000 7fe125ff88c0 1 > prepared multipart upload key=2KEKSWK0UT6C upload=LE4PRB7FELY4 tag=60QOLMWC9VY7 type=write size=1778240 2024-09-14T11:17:14.968 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.967+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~FWQ31C97LKCK.0 size=1048576 2024-09-14T11:17:14.971 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.971+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~FWQ31C97LKCK.1 size=242585 2024-09-14T11:17:14.977 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.979+0000 7fe125ff88c0 1 < completed multipart upload key=YGEVGH840L18 upload=FWQ31C97LKCK tag=UZ9J6I1LM3ZE type=write size=2339737 2024-09-14T11:17:14.981 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.983+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=01Y77HT52HFH type=del size=874442 2024-09-14T11:17:14.989 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.991+0000 7fe125ff88c0 1 < suggested update operation key=SUCH37O8V1LY tag=JQ6B6807ALLJ type=write size=258467 2024-09-14T11:17:14.996 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.995+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~9RWOGJCLK6KQ.0 size=561458 2024-09-14T11:17:14.996 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.995+0000 7fe125ff88c0 1 > prepared multipart upload key=SUCH37O8V1LY upload=9RWOGJCLK6KQ tag=7OYCDHMLEMC3 type=write size=1610034 2024-09-14T11:17:15.000 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:14.999+0000 7fe125ff88c0 1 < completed delete operation key=3OU4U9JF3ZD5 tag=XSH3DSXOBEW1 type=del 2024-09-14T11:17:15.003 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.003+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=UR926GBD92QV type=write size=79944 2024-09-14T11:17:15.007 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.007+0000 7fe125ff88c0 1 < completed part key=_multipart_2KEKSWK0UT6C.2~ZH0XV05KAQ35.0 size=1048576 2024-09-14T11:17:15.009 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.011+0000 7fe125ff88c0 1 < completed part key=_multipart_2KEKSWK0UT6C.2~ZH0XV05KAQ35.1 size=996452 2024-09-14T11:17:15.014 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.015+0000 7fe125ff88c0 1 < completed multipart upload key=2KEKSWK0UT6C upload=ZH0XV05KAQ35 tag=DJS8VHOYMSQ5 type=write size=3093604 2024-09-14T11:17:15.018 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.019+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=X3JK37FRMF55 type=del size=2954941 2024-09-14T11:17:15.021 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.023+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~2S3TOVVFO3NC.0 size=1048576 2024-09-14T11:17:15.024 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.023+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~2S3TOVVFO3NC.1 size=1048576 2024-09-14T11:17:15.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.027+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~2S3TOVVFO3NC.2 size=777071 2024-09-14T11:17:15.032 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.035+0000 7fe125ff88c0 1 < completed multipart upload key=YGEVGH840L18 upload=2S3TOVVFO3NC tag=QLEAKJ754D1A type=write size=3922799 2024-09-14T11:17:15.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.039+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=VHRPVL2OFD7J type=del size=747885 2024-09-14T11:17:15.040 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.039+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~7ZZTR4A42WZE.0 size=1048576 2024-09-14T11:17:15.042 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.043+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~7ZZTR4A42WZE.1 size=966464 2024-09-14T11:17:15.048 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.051+0000 7fe125ff88c0 1 < completed multipart upload key=46ZTDBWFVSUH upload=7ZZTR4A42WZE tag=BNTQ9V7BNCVR type=write size=3063616 2024-09-14T11:17:15.055 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.055+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~WSTSOSV29BDJ.0 size=1048576 2024-09-14T11:17:15.058 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.059+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~WSTSOSV29BDJ.1 size=661429 2024-09-14T11:17:15.058 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.059+0000 7fe125ff88c0 1 > prepared multipart upload key=W0B19NBHNLMZ upload=WSTSOSV29BDJ tag=0NUG55ANO6R1 type=write size=2758581 2024-09-14T11:17:15.062 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.063+0000 7fe125ff88c0 1 < completed delete operation key=V6B470G93KFT tag=FEQQYCAY2THE type=del 2024-09-14T11:17:15.065 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.067+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=SNPKVYZD80VI type=del size=401739 2024-09-14T11:17:15.069 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.071+0000 7fe125ff88c0 1 < completed delete operation key=2UXA6SXDTUFT tag=3DUFZAB4X6RC type=del 2024-09-14T11:17:15.073 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.075+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=67P8L17YK5CC type=del size=1412006 2024-09-14T11:17:15.076 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.079+0000 7fe125ff88c0 1 < completed write operation key=K05LARTJ2QZ3 tag=F78WL9KSV56I type=write size=195019 2024-09-14T11:17:15.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.083+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~ML3PPICOJ3AH.0 size=358187 2024-09-14T11:17:15.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.083+0000 7fe125ff88c0 1 > prepared multipart upload key=F9I82N7RQC81 upload=ML3PPICOJ3AH tag=19LZI70YC97G type=write size=1406763 2024-09-14T11:17:15.087 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.087+0000 7fe125ff88c0 1 < canceled operation key=0VBX2FWYCFEZ tag=O2X6WN8AQO3U type=write size=661188 2024-09-14T11:17:15.091 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.091+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=X7X04X8EZ2EP type=del size=2241680 2024-09-14T11:17:15.095 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.095+0000 7fe125ff88c0 1 < canceled operation key=V6B470G93KFT tag=4AMKWKN7EYYP type=del size=579049 2024-09-14T11:17:15.102 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.103+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~U3JFPSLT61IE.0 size=1048576 2024-09-14T11:17:15.105 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.107+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~U3JFPSLT61IE.1 size=967098 2024-09-14T11:17:15.105 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.107+0000 7fe125ff88c0 1 > prepared multipart upload key=0VBX2FWYCFEZ upload=U3JFPSLT61IE tag=904FDGSW2PUF type=write size=3064250 2024-09-14T11:17:15.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.111+0000 7fe125ff88c0 1 < completed delete operation key=K3P6U6NU8I01 tag=QAB4I7K1U3N3 type=del 2024-09-14T11:17:15.114 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.115+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=511JJ57CX87C type=del size=1576883 2024-09-14T11:17:15.118 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.119+0000 7fe125ff88c0 1 < completed delete operation key=2UXA6SXDTUFT tag=DJFPEL9DL21F type=del 2024-09-14T11:17:15.122 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.123+0000 7fe125ff88c0 1 > prepared operation key=3YGN50MBAF41 tag=TOZL4C2JZXJS type=write size=802975 2024-09-14T11:17:15.126 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.127+0000 7fe125ff88c0 1 < completed delete operation key=K3P6U6NU8I01 tag=4S65WSCQY4AV type=del 2024-09-14T11:17:15.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.135+0000 7fe125ff88c0 1 > prepared part key=_multipart_WEA3MQ0DI42N.2~3WJ8GDQ9WSL2.0 size=1048576 2024-09-14T11:17:15.137 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.139+0000 7fe125ff88c0 1 > prepared part key=_multipart_WEA3MQ0DI42N.2~3WJ8GDQ9WSL2.1 size=1048576 2024-09-14T11:17:15.141 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.143+0000 7fe125ff88c0 1 > prepared part key=_multipart_WEA3MQ0DI42N.2~3WJ8GDQ9WSL2.2 size=56649 2024-09-14T11:17:15.141 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.143+0000 7fe125ff88c0 1 > prepared multipart upload key=WEA3MQ0DI42N upload=3WJ8GDQ9WSL2 tag=WPVH6JCYLGHF type=write size=3202377 2024-09-14T11:17:15.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.151+0000 7fe125ff88c0 1 < suggested update operation key=WEA3MQ0DI42N tag=ODSTF74HWOAV type=del size=4085657 2024-09-14T11:17:15.154 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.155+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=5F8JMXAFZU90 type=del size=2490242 2024-09-14T11:17:15.159 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.159+0000 7fe125ff88c0 1 < completed part key=_multipart_2KEKSWK0UT6C.2~LE4PRB7FELY4.0 size=729664 2024-09-14T11:17:15.166 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.167+0000 7fe125ff88c0 1 < completed multipart upload key=2KEKSWK0UT6C upload=LE4PRB7FELY4 tag=60QOLMWC9VY7 type=write size=1778240 2024-09-14T11:17:15.174 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.175+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~U8GVRK2JNUL0.0 size=1048576 2024-09-14T11:17:15.178 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.179+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~U8GVRK2JNUL0.1 size=476002 2024-09-14T11:17:15.178 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.179+0000 7fe125ff88c0 1 > prepared multipart upload key=0FITHLGQKQEC upload=U8GVRK2JNUL0 tag=4EXKOL6Z28L9 type=write size=2573154 2024-09-14T11:17:15.182 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.183+0000 7fe125ff88c0 1 < completed delete operation key=YN2HI39GPEDF tag=01Y77HT52HFH type=del 2024-09-14T11:17:15.186 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.187+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=XEKM7QJALJIQ type=write size=12029 2024-09-14T11:17:15.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.191+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~9RWOGJCLK6KQ.0 size=561458 2024-09-14T11:17:15.197 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.199+0000 7fe125ff88c0 1 < completed multipart upload key=SUCH37O8V1LY upload=9RWOGJCLK6KQ tag=7OYCDHMLEMC3 type=write size=1610034 2024-09-14T11:17:15.201 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.203+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=LV8LMOVAH6TT type=del size=1732635 2024-09-14T11:17:15.210 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.211+0000 7fe125ff88c0 1 < suggested remove operation key=K3P6U6NU8I01 tag=UR926GBD92QV type=write 2024-09-14T11:17:15.218 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.219+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~M59YO682N3J5.0 size=245095 2024-09-14T11:17:15.218 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.219+0000 7fe125ff88c0 1 > prepared multipart upload key=SUCH37O8V1LY upload=M59YO682N3J5 tag=UHNF1ONFH9Q9 type=write size=1293671 2024-09-14T11:17:15.222 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.223+0000 7fe125ff88c0 1 < completed delete operation key=YGEVGH840L18 tag=X3JK37FRMF55 type=del 2024-09-14T11:17:15.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.227+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=ADWF6GKW15D0 type=del size=1561411 2024-09-14T11:17:15.232 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.231+0000 7fe125ff88c0 1 < completed delete operation key=YCF2PCJ9TZMR tag=VHRPVL2OFD7J type=del 2024-09-14T11:17:15.240 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.243+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~BCNZR4GRSRR0.0 size=117877 2024-09-14T11:17:15.240 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.243+0000 7fe125ff88c0 1 > prepared multipart upload key=V6B470G93KFT upload=BCNZR4GRSRR0 tag=2AGD83CCJXN1 type=write size=1166453 2024-09-14T11:17:15.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.247+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~WSTSOSV29BDJ.0 size=1048576 2024-09-14T11:17:15.248 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.247+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~WSTSOSV29BDJ.1 size=661429 2024-09-14T11:17:15.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.255+0000 7fe125ff88c0 1 < completed multipart upload key=W0B19NBHNLMZ upload=WSTSOSV29BDJ tag=0NUG55ANO6R1 type=write size=2758581 2024-09-14T11:17:15.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.259+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=5ILW68UAZ57I type=del size=1345214 2024-09-14T11:17:15.262 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.263+0000 7fe125ff88c0 1 < completed delete operation key=2KEKSWK0UT6C tag=SNPKVYZD80VI type=del 2024-09-14T11:17:15.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.271+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~SS0UZG6TL99R.0 size=1048576 2024-09-14T11:17:15.272 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.271+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~SS0UZG6TL99R.1 size=1048576 2024-09-14T11:17:15.275 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.275+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~SS0UZG6TL99R.2 size=515535 2024-09-14T11:17:15.275 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.275+0000 7fe125ff88c0 1 > prepared multipart upload key=YGEVGH840L18 upload=SS0UZG6TL99R tag=3H7EEUI5EG6Q type=write size=3661263 2024-09-14T11:17:15.279 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.279+0000 7fe125ff88c0 1 < completed delete operation key=YGEVGH840L18 tag=67P8L17YK5CC type=del 2024-09-14T11:17:15.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.283+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=F46S6ZZUJ7L1 type=del size=2617313 2024-09-14T11:17:15.286 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.287+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~ML3PPICOJ3AH.0 size=358187 2024-09-14T11:17:15.291 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.291+0000 7fe125ff88c0 1 < completed multipart upload key=F9I82N7RQC81 upload=ML3PPICOJ3AH tag=19LZI70YC97G type=write size=1406763 2024-09-14T11:17:15.298 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.299+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=7CXHUGKOB043 type=del size=80537 2024-09-14T11:17:15.302 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.303+0000 7fe125ff88c0 1 < canceled operation key=2KEKSWK0UT6C tag=X7X04X8EZ2EP type=del size=2241680 2024-09-14T11:17:15.309 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.311+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~8ZCE0Q3XN87S.0 size=1048576 2024-09-14T11:17:15.314 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.315+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~8ZCE0Q3XN87S.1 size=1048576 2024-09-14T11:17:15.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.319+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~8ZCE0Q3XN87S.2 size=1041513 2024-09-14T11:17:15.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.319+0000 7fe125ff88c0 1 > prepared multipart upload key=SUCH37O8V1LY upload=8ZCE0Q3XN87S tag=URY8HWHZ1E1W type=write size=4187241 2024-09-14T11:17:15.321 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.323+0000 7fe125ff88c0 1 < completed part key=_multipart_0VBX2FWYCFEZ.2~U3JFPSLT61IE.0 size=1048576 2024-09-14T11:17:15.321 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.323+0000 7fe125ff88c0 1 < canceled part key=_multipart_0VBX2FWYCFEZ.2~U3JFPSLT61IE.1 size=967098 2024-09-14T11:17:15.327 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.327+0000 7fe125ff88c0 1 < canceled multipart upload key=0VBX2FWYCFEZ upload=U3JFPSLT61IE tag=904FDGSW2PUF type=write size=3064250 2024-09-14T11:17:15.334 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.335+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~09UU2J16J4E4.0 size=1048576 2024-09-14T11:17:15.337 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.339+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~09UU2J16J4E4.1 size=1048576 2024-09-14T11:17:15.340 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.339+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~09UU2J16J4E4.2 size=893114 2024-09-14T11:17:15.340 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.339+0000 7fe125ff88c0 1 > prepared multipart upload key=0VBX2FWYCFEZ upload=09UU2J16J4E4 tag=X5KUG61YI70T type=write size=4038842 2024-09-14T11:17:15.344 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.343+0000 7fe125ff88c0 1 < completed delete operation key=2KEKSWK0UT6C tag=511JJ57CX87C type=del 2024-09-14T11:17:15.348 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.347+0000 7fe125ff88c0 1 > prepared operation key=N80X3YUF4OEL tag=90JY5QZCVA7W type=del size=2793931 2024-09-14T11:17:15.352 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.351+0000 7fe125ff88c0 1 < completed write operation key=3YGN50MBAF41 tag=TOZL4C2JZXJS type=write size=802975 2024-09-14T11:17:15.356 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.355+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=3I3OHQ80QOQU type=del size=238643 2024-09-14T11:17:15.360 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.359+0000 7fe125ff88c0 1 < completed part key=_multipart_WEA3MQ0DI42N.2~3WJ8GDQ9WSL2.0 size=1048576 2024-09-14T11:17:15.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.363+0000 7fe125ff88c0 1 < completed part key=_multipart_WEA3MQ0DI42N.2~3WJ8GDQ9WSL2.1 size=1048576 2024-09-14T11:17:15.366 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.367+0000 7fe125ff88c0 1 < completed part key=_multipart_WEA3MQ0DI42N.2~3WJ8GDQ9WSL2.2 size=56649 2024-09-14T11:17:15.372 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.371+0000 7fe125ff88c0 1 < completed multipart upload key=WEA3MQ0DI42N upload=3WJ8GDQ9WSL2 tag=WPVH6JCYLGHF type=write size=3202377 2024-09-14T11:17:15.376 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.375+0000 7fe125ff88c0 1 > prepared operation key=3YGN50MBAF41 tag=4W60KA2N84ON type=write size=640182 2024-09-14T11:17:15.384 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.383+0000 7fe125ff88c0 1 < suggested remove operation key=N94D3R7IOBNL tag=5F8JMXAFZU90 type=del 2024-09-14T11:17:15.390 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.391+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~JYU3OYX9J3AH.0 size=1048576 2024-09-14T11:17:15.393 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.395+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~JYU3OYX9J3AH.1 size=1048576 2024-09-14T11:17:15.396 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.399+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~JYU3OYX9J3AH.2 size=535756 2024-09-14T11:17:15.396 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.399+0000 7fe125ff88c0 1 > prepared multipart upload key=SSNV25PDLDIS upload=JYU3OYX9J3AH tag=1XBBEECZXW6Q type=write size=3681484 2024-09-14T11:17:15.400 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.399+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~U8GVRK2JNUL0.0 size=1048576 2024-09-14T11:17:15.403 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.403+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~U8GVRK2JNUL0.1 size=476002 2024-09-14T11:17:15.409 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.411+0000 7fe125ff88c0 1 < completed multipart upload key=0FITHLGQKQEC upload=U8GVRK2JNUL0 tag=4EXKOL6Z28L9 type=write size=2573154 2024-09-14T11:17:15.416 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.415+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~SW7J4QEGNHNL.0 size=1048576 2024-09-14T11:17:15.419 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.419+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~SW7J4QEGNHNL.1 size=1048576 2024-09-14T11:17:15.422 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.423+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~SW7J4QEGNHNL.2 size=740946 2024-09-14T11:17:15.422 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.423+0000 7fe125ff88c0 1 > prepared multipart upload key=FQ5WT12KB664 upload=SW7J4QEGNHNL tag=DA5W4QJY4PGI type=write size=3886674 2024-09-14T11:17:15.425 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.427+0000 7fe125ff88c0 1 < completed write operation key=6PLUU2QIO9LJ tag=XEKM7QJALJIQ type=write size=12029 2024-09-14T11:17:15.432 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.435+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~DYFJ7CHPXMSC.0 size=1048576 2024-09-14T11:17:15.435 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.435+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~DYFJ7CHPXMSC.1 size=1048576 2024-09-14T11:17:15.438 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.439+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~DYFJ7CHPXMSC.2 size=461357 2024-09-14T11:17:15.438 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.439+0000 7fe125ff88c0 1 > prepared multipart upload key=SUCH37O8V1LY upload=DYFJ7CHPXMSC tag=0LD63YWNEJFZ type=write size=3607085 2024-09-14T11:17:15.442 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.443+0000 7fe125ff88c0 1 < completed delete operation key=2LH5U05C2F8C tag=LV8LMOVAH6TT type=del 2024-09-14T11:17:15.445 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.447+0000 7fe125ff88c0 1 > prepared operation key=1ML6RIXI4C5P tag=PCZK9SKB3XLP type=del size=4070535 2024-09-14T11:17:15.449 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.451+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~M59YO682N3J5.0 size=245095 2024-09-14T11:17:15.455 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.455+0000 7fe125ff88c0 1 < completed multipart upload key=SUCH37O8V1LY upload=M59YO682N3J5 tag=UHNF1ONFH9Q9 type=write size=1293671 2024-09-14T11:17:15.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.463+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~Z7Y705IQZMUK.0 size=41877 2024-09-14T11:17:15.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.463+0000 7fe125ff88c0 1 > prepared multipart upload key=0FITHLGQKQEC upload=Z7Y705IQZMUK tag=H493F2J8TOIP type=write size=1090453 2024-09-14T11:17:15.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.467+0000 7fe125ff88c0 1 < canceled operation key=W0B19NBHNLMZ tag=ADWF6GKW15D0 type=del size=1561411 2024-09-14T11:17:15.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.471+0000 7fe125ff88c0 1 > prepared operation key=YFRH8WECBTJK tag=2PD1A6NYM8ZI type=del size=2602055 2024-09-14T11:17:15.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.475+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~BCNZR4GRSRR0.0 size=117877 2024-09-14T11:17:15.483 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.483+0000 7fe125ff88c0 1 < completed multipart upload key=V6B470G93KFT upload=BCNZR4GRSRR0 tag=2AGD83CCJXN1 type=write size=1166453 2024-09-14T11:17:15.488 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.487+0000 7fe125ff88c0 1 > prepared operation key=YFRH8WECBTJK tag=BWZOLM9X0KNX type=write size=323368 2024-09-14T11:17:15.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.495+0000 7fe125ff88c0 1 < suggested remove operation key=SSNV25PDLDIS tag=5ILW68UAZ57I type=del 2024-09-14T11:17:15.499 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.499+0000 7fe125ff88c0 1 > prepared operation key=N80X3YUF4OEL tag=FR2MKZFCZ5TA type=del size=3275834 2024-09-14T11:17:15.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.503+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~SS0UZG6TL99R.0 size=1048576 2024-09-14T11:17:15.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.503+0000 7fe125ff88c0 1 < canceled part key=_multipart_YGEVGH840L18.2~SS0UZG6TL99R.1 size=1048576 2024-09-14T11:17:15.506 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.507+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~SS0UZG6TL99R.2 size=515535 2024-09-14T11:17:15.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.515+0000 7fe125ff88c0 1 < canceled multipart upload key=YGEVGH840L18 upload=SS0UZG6TL99R tag=3H7EEUI5EG6Q type=write size=3661263 2024-09-14T11:17:15.516 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.519+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=E4HCX2Z52SZY type=del size=111199 2024-09-14T11:17:15.520 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.523+0000 7fe125ff88c0 1 < completed delete operation key=4D2X7151977X tag=F46S6ZZUJ7L1 type=del 2024-09-14T11:17:15.524 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.527+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=MG7IX4N7PEY2 type=del size=1012809 2024-09-14T11:17:15.528 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.531+0000 7fe125ff88c0 -1 < failed to complete operation key=N94D3R7IOBNL tag=7CXHUGKOB043 type=del size=80537: (22) Invalid argument 2024-09-14T11:17:15.532 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.535+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=CDFPLEZ1XV1N type=del size=3791809 2024-09-14T11:17:15.537 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.539+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~8ZCE0Q3XN87S.0 size=1048576 2024-09-14T11:17:15.540 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.539+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~8ZCE0Q3XN87S.1 size=1048576 2024-09-14T11:17:15.540 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.539+0000 7fe125ff88c0 1 < canceled part key=_multipart_SUCH37O8V1LY.2~8ZCE0Q3XN87S.2 size=1041513 2024-09-14T11:17:15.545 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.547+0000 7fe125ff88c0 1 < canceled multipart upload key=SUCH37O8V1LY upload=8ZCE0Q3XN87S tag=URY8HWHZ1E1W type=write size=4187241 2024-09-14T11:17:15.552 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.551+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~1AAO637U98I1.0 size=1048576 2024-09-14T11:17:15.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.555+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~1AAO637U98I1.1 size=566293 2024-09-14T11:17:15.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.555+0000 7fe125ff88c0 1 > prepared multipart upload key=K3P6U6NU8I01 upload=1AAO637U98I1 tag=9JZJ7YC9WN7G type=write size=2663445 2024-09-14T11:17:15.559 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.559+0000 7fe125ff88c0 1 < completed part key=_multipart_0VBX2FWYCFEZ.2~09UU2J16J4E4.0 size=1048576 2024-09-14T11:17:15.562 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.563+0000 7fe125ff88c0 1 < completed part key=_multipart_0VBX2FWYCFEZ.2~09UU2J16J4E4.1 size=1048576 2024-09-14T11:17:15.565 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.567+0000 7fe125ff88c0 1 < completed part key=_multipart_0VBX2FWYCFEZ.2~09UU2J16J4E4.2 size=893114 2024-09-14T11:17:15.571 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.571+0000 7fe125ff88c0 1 < completed multipart upload key=0VBX2FWYCFEZ upload=09UU2J16J4E4 tag=X5KUG61YI70T type=write size=4038842 2024-09-14T11:17:15.575 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.575+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=5N57T791AH2X type=write size=625113 2024-09-14T11:17:15.579 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.579+0000 7fe125ff88c0 1 < completed delete operation key=N80X3YUF4OEL tag=90JY5QZCVA7W type=del 2024-09-14T11:17:15.584 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.583+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=FD98PIS9EL6P type=write size=71739 2024-09-14T11:17:15.587 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.587+0000 7fe125ff88c0 1 < completed delete operation key=ESVFZQQXE3GT tag=3I3OHQ80QOQU type=del 2024-09-14T11:17:15.595 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.595+0000 7fe125ff88c0 1 > prepared part key=_multipart_WEA3MQ0DI42N.2~BBUQ9QY501K6.0 size=864493 2024-09-14T11:17:15.595 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.595+0000 7fe125ff88c0 1 > prepared multipart upload key=WEA3MQ0DI42N upload=BBUQ9QY501K6 tag=19YN7Y8JQLJP type=write size=1913069 2024-09-14T11:17:15.598 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.599+0000 7fe125ff88c0 1 < completed write operation key=3YGN50MBAF41 tag=4W60KA2N84ON type=write size=640182 2024-09-14T11:17:15.602 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.603+0000 7fe125ff88c0 1 > prepared operation key=FQ5WT12KB664 tag=5TA3QNWSTNDY type=del size=1280580 2024-09-14T11:17:15.606 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.607+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~JYU3OYX9J3AH.0 size=1048576 2024-09-14T11:17:15.609 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.611+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~JYU3OYX9J3AH.1 size=1048576 2024-09-14T11:17:15.611 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.611+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~JYU3OYX9J3AH.2 size=535756 2024-09-14T11:17:15.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.619+0000 7fe125ff88c0 1 < completed multipart upload key=SSNV25PDLDIS upload=JYU3OYX9J3AH tag=1XBBEECZXW6Q type=write size=3681484 2024-09-14T11:17:15.623 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.623+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~AU3Z0SMAK0NI.0 size=1048576 2024-09-14T11:17:15.626 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.627+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~AU3Z0SMAK0NI.1 size=1048576 2024-09-14T11:17:15.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.631+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~AU3Z0SMAK0NI.2 size=591242 2024-09-14T11:17:15.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.631+0000 7fe125ff88c0 1 > prepared multipart upload key=YN2HI39GPEDF upload=AU3Z0SMAK0NI tag=FOEZG1MDLR0B type=write size=3736970 2024-09-14T11:17:15.632 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.635+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~SW7J4QEGNHNL.0 size=1048576 2024-09-14T11:17:15.635 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.635+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~SW7J4QEGNHNL.1 size=1048576 2024-09-14T11:17:15.638 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.639+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~SW7J4QEGNHNL.2 size=740946 2024-09-14T11:17:15.647 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.647+0000 7fe125ff88c0 1 < completed multipart upload key=FQ5WT12KB664 upload=SW7J4QEGNHNL tag=DA5W4QJY4PGI type=write size=3886674 2024-09-14T11:17:15.651 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.651+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=JLT3CN9J2TGW type=del size=1835281 2024-09-14T11:17:15.654 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.655+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~DYFJ7CHPXMSC.0 size=1048576 2024-09-14T11:17:15.657 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.659+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~DYFJ7CHPXMSC.1 size=1048576 2024-09-14T11:17:15.660 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.659+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~DYFJ7CHPXMSC.2 size=461357 2024-09-14T11:17:15.666 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.667+0000 7fe125ff88c0 1 < completed multipart upload key=SUCH37O8V1LY upload=DYFJ7CHPXMSC tag=0LD63YWNEJFZ type=write size=3607085 2024-09-14T11:17:15.669 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.671+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=IWBD1WQW10ED type=del size=2137907 2024-09-14T11:17:15.673 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.675+0000 7fe125ff88c0 1 < canceled operation key=1ML6RIXI4C5P tag=PCZK9SKB3XLP type=del size=4070535 2024-09-14T11:17:15.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.679+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=R2243AECQS0K type=del size=1037718 2024-09-14T11:17:15.682 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.683+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~Z7Y705IQZMUK.0 size=41877 2024-09-14T11:17:15.687 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.687+0000 7fe125ff88c0 1 < completed multipart upload key=0FITHLGQKQEC upload=Z7Y705IQZMUK tag=H493F2J8TOIP type=write size=1090453 2024-09-14T11:17:15.691 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.691+0000 7fe125ff88c0 1 > prepared operation key=FQ5WT12KB664 tag=84OZLCSJ8RIC type=del size=2057322 2024-09-14T11:17:15.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.695+0000 7fe125ff88c0 1 < completed delete operation key=YFRH8WECBTJK tag=2PD1A6NYM8ZI type=del 2024-09-14T11:17:15.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.703+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~SFGPBX2S8V5I.0 size=1048576 2024-09-14T11:17:15.705 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.707+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~SFGPBX2S8V5I.1 size=76416 2024-09-14T11:17:15.705 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.707+0000 7fe125ff88c0 1 > prepared multipart upload key=2UXA6SXDTUFT upload=SFGPBX2S8V5I tag=Q3LMOWPQRT2D type=write size=2173568 2024-09-14T11:17:15.708 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.711+0000 7fe125ff88c0 1 < completed write operation key=YFRH8WECBTJK tag=BWZOLM9X0KNX type=write size=323368 2024-09-14T11:17:15.712 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.715+0000 7fe125ff88c0 1 > prepared operation key=LYBGDNKUROWH tag=6IXO9IOA139N type=write size=310525 2024-09-14T11:17:15.716 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.715+0000 7fe125ff88c0 1 < completed delete operation key=N80X3YUF4OEL tag=FR2MKZFCZ5TA type=del 2024-09-14T11:17:15.720 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.719+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=TWUUZSGTX371 type=del size=3830142 2024-09-14T11:17:15.723 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.723+0000 7fe125ff88c0 1 < completed delete operation key=L4XO0WTYKNXY tag=E4HCX2Z52SZY type=del 2024-09-14T11:17:15.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.727+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=Q2ECC1QG0P8Q type=del size=1479488 2024-09-14T11:17:15.731 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.731+0000 7fe125ff88c0 1 < completed delete operation key=WEA3MQ0DI42N tag=MG7IX4N7PEY2 type=del 2024-09-14T11:17:15.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.739+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~H8SSASHW0XEZ.0 size=1048576 2024-09-14T11:17:15.740 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.743+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~H8SSASHW0XEZ.1 size=1048576 2024-09-14T11:17:15.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.743+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~H8SSASHW0XEZ.2 size=14960 2024-09-14T11:17:15.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.743+0000 7fe125ff88c0 1 > prepared multipart upload key=46ZTDBWFVSUH upload=H8SSASHW0XEZ tag=IVE5E80B3SGE type=write size=3160688 2024-09-14T11:17:15.747 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.747+0000 7fe125ff88c0 1 < completed delete operation key=L4XO0WTYKNXY tag=CDFPLEZ1XV1N type=del 2024-09-14T11:17:15.754 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.755+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~W6LHCDQCNC60.0 size=1048576 2024-09-14T11:17:15.756 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.759+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~W6LHCDQCNC60.1 size=8007 2024-09-14T11:17:15.756 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.759+0000 7fe125ff88c0 1 > prepared multipart upload key=K05LARTJ2QZ3 upload=W6LHCDQCNC60 tag=ZTW56T15XPKC type=write size=2105159 2024-09-14T11:17:15.760 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.759+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~1AAO637U98I1.0 size=1048576 2024-09-14T11:17:15.763 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.763+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~1AAO637U98I1.1 size=566293 2024-09-14T11:17:15.768 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.771+0000 7fe125ff88c0 1 < completed multipart upload key=K3P6U6NU8I01 upload=1AAO637U98I1 tag=9JZJ7YC9WN7G type=write size=2663445 2024-09-14T11:17:15.772 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.775+0000 7fe125ff88c0 1 > prepared operation key=46ZTDBWFVSUH tag=38FBKX6ZJU22 type=del size=2114364 2024-09-14T11:17:15.776 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.775+0000 7fe125ff88c0 1 < completed write operation key=YGEVGH840L18 tag=5N57T791AH2X type=write size=625113 2024-09-14T11:17:15.783 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.783+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~HWQJ2YC6QDXT.0 size=913758 2024-09-14T11:17:15.783 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.783+0000 7fe125ff88c0 1 > prepared multipart upload key=SUCH37O8V1LY upload=HWQJ2YC6QDXT tag=53AOYQB89K7E type=write size=1962334 2024-09-14T11:17:15.787 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.787+0000 7fe125ff88c0 1 < completed write operation key=N94D3R7IOBNL tag=FD98PIS9EL6P type=write size=71739 2024-09-14T11:17:15.790 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.791+0000 7fe125ff88c0 1 > prepared operation key=YFRH8WECBTJK tag=RUCU1J0DJPC2 type=del size=245544 2024-09-14T11:17:15.794 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.795+0000 7fe125ff88c0 1 < completed part key=_multipart_WEA3MQ0DI42N.2~BBUQ9QY501K6.0 size=864493 2024-09-14T11:17:15.800 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.799+0000 7fe125ff88c0 1 < completed multipart upload key=WEA3MQ0DI42N upload=BBUQ9QY501K6 tag=19YN7Y8JQLJP type=write size=1913069 2024-09-14T11:17:15.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.803+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=BDWUGI80P96L type=del size=3543409 2024-09-14T11:17:15.808 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.807+0000 7fe125ff88c0 1 < canceled operation key=FQ5WT12KB664 tag=5TA3QNWSTNDY type=del size=1280580 2024-09-14T11:17:15.814 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.815+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~C3PD0PTC4TZD.0 size=934175 2024-09-14T11:17:15.815 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.815+0000 7fe125ff88c0 1 > prepared multipart upload key=3OU4U9JF3ZD5 upload=C3PD0PTC4TZD tag=RU9P24DOL0ZK type=write size=1982751 2024-09-14T11:17:15.818 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.819+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~AU3Z0SMAK0NI.0 size=1048576 2024-09-14T11:17:15.821 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.823+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~AU3Z0SMAK0NI.1 size=1048576 2024-09-14T11:17:15.824 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.823+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~AU3Z0SMAK0NI.2 size=591242 2024-09-14T11:17:15.830 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.831+0000 7fe125ff88c0 1 < completed multipart upload key=YN2HI39GPEDF upload=AU3Z0SMAK0NI tag=FOEZG1MDLR0B type=write size=3736970 2024-09-14T11:17:15.837 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.839+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~YYB819H4W1FT.0 size=1048576 2024-09-14T11:17:15.839 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.839+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~YYB819H4W1FT.1 size=1048576 2024-09-14T11:17:15.842 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.843+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~YYB819H4W1FT.2 size=171221 2024-09-14T11:17:15.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.843+0000 7fe125ff88c0 1 > prepared multipart upload key=ESVFZQQXE3GT upload=YYB819H4W1FT tag=4JZRKLZV4Y8H type=write size=3316949 2024-09-14T11:17:15.846 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.847+0000 7fe125ff88c0 1 < completed delete operation key=35EB6U5O4A51 tag=JLT3CN9J2TGW type=del 2024-09-14T11:17:15.850 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.851+0000 7fe125ff88c0 1 > prepared operation key=SUCH37O8V1LY tag=MKFDR8OO3TAQ type=del size=2965633 2024-09-14T11:17:15.854 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.855+0000 7fe125ff88c0 1 < completed delete operation key=2LH5U05C2F8C tag=IWBD1WQW10ED type=del 2024-09-14T11:17:15.861 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.863+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~1AQ6GLJZIGD6.0 size=905370 2024-09-14T11:17:15.861 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.863+0000 7fe125ff88c0 1 > prepared multipart upload key=1ML6RIXI4C5P upload=1AQ6GLJZIGD6 tag=8V5OAKPGGBTA type=write size=1953946 2024-09-14T11:17:15.865 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.867+0000 7fe125ff88c0 1 < completed delete operation key=6PLUU2QIO9LJ tag=R2243AECQS0K type=del 2024-09-14T11:17:15.870 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.871+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=9H4S2YUBN2RV type=del size=1629391 2024-09-14T11:17:15.874 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.875+0000 7fe125ff88c0 1 < completed delete operation key=FQ5WT12KB664 tag=84OZLCSJ8RIC type=del 2024-09-14T11:17:15.881 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.883+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~3SEOYZ7P1LIN.0 size=1048576 2024-09-14T11:17:15.884 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.883+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~3SEOYZ7P1LIN.1 size=1048576 2024-09-14T11:17:15.886 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.887+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~3SEOYZ7P1LIN.2 size=57975 2024-09-14T11:17:15.886 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.887+0000 7fe125ff88c0 1 > prepared multipart upload key=3OU4U9JF3ZD5 upload=3SEOYZ7P1LIN tag=TFA6XPYCIP2Z type=write size=3203703 2024-09-14T11:17:15.890 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.891+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~SFGPBX2S8V5I.0 size=1048576 2024-09-14T11:17:15.893 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.895+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~SFGPBX2S8V5I.1 size=76416 2024-09-14T11:17:15.899 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.899+0000 7fe125ff88c0 1 < completed multipart upload key=2UXA6SXDTUFT upload=SFGPBX2S8V5I tag=Q3LMOWPQRT2D type=write size=2173568 2024-09-14T11:17:15.906 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.907+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~9OOVVDQNH5EH.0 size=1048576 2024-09-14T11:17:15.909 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.911+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~9OOVVDQNH5EH.1 size=530120 2024-09-14T11:17:15.909 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.911+0000 7fe125ff88c0 1 > prepared multipart upload key=W0B19NBHNLMZ upload=9OOVVDQNH5EH tag=LT5KXWSX1766 type=write size=2627272 2024-09-14T11:17:15.915 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.915+0000 7fe125ff88c0 1 < suggested update operation key=LYBGDNKUROWH tag=6IXO9IOA139N type=write size=310525 2024-09-14T11:17:15.922 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.923+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~A3YXOW3KK6GK.0 size=1048576 2024-09-14T11:17:15.925 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.927+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~A3YXOW3KK6GK.1 size=1048576 2024-09-14T11:17:15.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.927+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~A3YXOW3KK6GK.2 size=641856 2024-09-14T11:17:15.928 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.927+0000 7fe125ff88c0 1 > prepared multipart upload key=ESVFZQQXE3GT upload=A3YXOW3KK6GK tag=ZV54IOFKCE53 type=write size=3787584 2024-09-14T11:17:15.932 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.931+0000 7fe125ff88c0 1 < completed delete operation key=WEA3MQ0DI42N tag=TWUUZSGTX371 type=del 2024-09-14T11:17:15.940 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.939+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~0EKK10GQFB2V.0 size=1048576 2024-09-14T11:17:15.943 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.943+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~0EKK10GQFB2V.1 size=1048576 2024-09-14T11:17:15.946 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.947+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~0EKK10GQFB2V.2 size=1021469 2024-09-14T11:17:15.946 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.947+0000 7fe125ff88c0 1 > prepared multipart upload key=K05LARTJ2QZ3 upload=0EKK10GQFB2V tag=6K0HT05WBYU4 type=write size=4167197 2024-09-14T11:17:15.951 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.951+0000 7fe125ff88c0 1 < completed delete operation key=F9I82N7RQC81 tag=Q2ECC1QG0P8Q type=del 2024-09-14T11:17:15.955 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.955+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=4DJL609W9F8H type=del size=2737300 2024-09-14T11:17:15.960 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.959+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~H8SSASHW0XEZ.0 size=1048576 2024-09-14T11:17:15.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.963+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~H8SSASHW0XEZ.1 size=1048576 2024-09-14T11:17:15.966 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.967+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~H8SSASHW0XEZ.2 size=14960 2024-09-14T11:17:15.973 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.975+0000 7fe125ff88c0 1 < completed multipart upload key=46ZTDBWFVSUH upload=H8SSASHW0XEZ tag=IVE5E80B3SGE type=write size=3160688 2024-09-14T11:17:15.977 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.979+0000 7fe125ff88c0 1 > prepared operation key=YFRH8WECBTJK tag=638BYDLTZ1HW type=del size=1766491 2024-09-14T11:17:15.981 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.983+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~W6LHCDQCNC60.0 size=1048576 2024-09-14T11:17:15.981 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.983+0000 7fe125ff88c0 1 < canceled part key=_multipart_K05LARTJ2QZ3.2~W6LHCDQCNC60.1 size=8007 2024-09-14T11:17:15.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.987+0000 7fe125ff88c0 1 < canceled multipart upload key=K05LARTJ2QZ3 upload=W6LHCDQCNC60 tag=ZTW56T15XPKC type=write size=2105159 2024-09-14T11:17:15.995 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.995+0000 7fe125ff88c0 1 > prepared operation key=0FITHLGQKQEC tag=VBGKSXDL0CQR type=del size=3768270 2024-09-14T11:17:15.999 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:15.999+0000 7fe125ff88c0 1 < completed delete operation key=46ZTDBWFVSUH tag=38FBKX6ZJU22 type=del 2024-09-14T11:17:16.004 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.003+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=RGS6FIOGIUSZ type=del size=1441370 2024-09-14T11:17:16.008 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.007+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~HWQJ2YC6QDXT.0 size=913758 2024-09-14T11:17:16.014 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.015+0000 7fe125ff88c0 1 < completed multipart upload key=SUCH37O8V1LY upload=HWQJ2YC6QDXT tag=53AOYQB89K7E type=write size=1962334 2024-09-14T11:17:16.018 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.019+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=PELMI0P8MM0G type=del size=2596919 2024-09-14T11:17:16.023 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.023+0000 7fe125ff88c0 1 < completed delete operation key=YFRH8WECBTJK tag=RUCU1J0DJPC2 type=del 2024-09-14T11:17:16.026 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.027+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=270TBDBYOSLE type=del size=3985256 2024-09-14T11:17:16.033 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.035+0000 7fe125ff88c0 1 < suggested update operation key=21HC4VMHXS6L tag=BDWUGI80P96L type=del size=3543409 2024-09-14T11:17:16.040 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.039+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~8XWKDE20YY19.0 size=1048576 2024-09-14T11:17:16.043 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.043+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~8XWKDE20YY19.1 size=997388 2024-09-14T11:17:16.043 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.043+0000 7fe125ff88c0 1 > prepared multipart upload key=LYBGDNKUROWH upload=8XWKDE20YY19 tag=V6ZAYJFXAVPN type=write size=3094540 2024-09-14T11:17:16.047 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.047+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~C3PD0PTC4TZD.0 size=934175 2024-09-14T11:17:16.052 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.055+0000 7fe125ff88c0 1 < completed multipart upload key=3OU4U9JF3ZD5 upload=C3PD0PTC4TZD tag=RU9P24DOL0ZK type=write size=1982751 2024-09-14T11:17:16.056 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.055+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=J5A9YBHM3XS0 type=write size=907643 2024-09-14T11:17:16.059 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.059+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~YYB819H4W1FT.0 size=1048576 2024-09-14T11:17:16.062 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.063+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~YYB819H4W1FT.1 size=1048576 2024-09-14T11:17:16.065 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.067+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~YYB819H4W1FT.2 size=171221 2024-09-14T11:17:16.070 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.071+0000 7fe125ff88c0 1 < completed multipart upload key=ESVFZQQXE3GT upload=YYB819H4W1FT tag=4JZRKLZV4Y8H type=write size=3316949 2024-09-14T11:17:16.077 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.079+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~9KZ3BL1NX4HN.0 size=1048576 2024-09-14T11:17:16.080 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.079+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~9KZ3BL1NX4HN.1 size=1048576 2024-09-14T11:17:16.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.083+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~9KZ3BL1NX4HN.2 size=74352 2024-09-14T11:17:16.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.083+0000 7fe125ff88c0 1 > prepared multipart upload key=LYBGDNKUROWH upload=9KZ3BL1NX4HN tag=X0F6YT9PCXM3 type=write size=3220080 2024-09-14T11:17:16.086 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.087+0000 7fe125ff88c0 1 < completed delete operation key=SUCH37O8V1LY tag=MKFDR8OO3TAQ type=del 2024-09-14T11:17:16.094 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.095+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~JO2MI2003INW.0 size=1048576 2024-09-14T11:17:16.097 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.099+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~JO2MI2003INW.1 size=945281 2024-09-14T11:17:16.097 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.099+0000 7fe125ff88c0 1 > prepared multipart upload key=SUCH37O8V1LY upload=JO2MI2003INW tag=8GKMI2BHIA3N type=write size=3042433 2024-09-14T11:17:16.101 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.103+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~1AQ6GLJZIGD6.0 size=905370 2024-09-14T11:17:16.107 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.107+0000 7fe125ff88c0 1 < completed multipart upload key=1ML6RIXI4C5P upload=1AQ6GLJZIGD6 tag=8V5OAKPGGBTA type=write size=1953946 2024-09-14T11:17:16.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.111+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=HNA04EWOQ8J4 type=del size=1281121 2024-09-14T11:17:16.114 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.115+0000 7fe125ff88c0 1 < completed delete operation key=N94D3R7IOBNL tag=9H4S2YUBN2RV type=del 2024-09-14T11:17:16.117 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.119+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=J9DCF0HQEN1S type=del size=3507222 2024-09-14T11:17:16.121 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.123+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~3SEOYZ7P1LIN.0 size=1048576 2024-09-14T11:17:16.124 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.123+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~3SEOYZ7P1LIN.1 size=1048576 2024-09-14T11:17:16.127 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.127+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~3SEOYZ7P1LIN.2 size=57975 2024-09-14T11:17:16.132 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.135+0000 7fe125ff88c0 1 < completed multipart upload key=3OU4U9JF3ZD5 upload=3SEOYZ7P1LIN tag=TFA6XPYCIP2Z type=write size=3203703 2024-09-14T11:17:16.136 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.139+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=I2CBA5USZPQV type=write size=560882 2024-09-14T11:17:16.140 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.143+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~9OOVVDQNH5EH.0 size=1048576 2024-09-14T11:17:16.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.143+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~9OOVVDQNH5EH.1 size=530120 2024-09-14T11:17:16.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.151+0000 7fe125ff88c0 1 < completed multipart upload key=W0B19NBHNLMZ upload=9OOVVDQNH5EH tag=LT5KXWSX1766 type=write size=2627272 2024-09-14T11:17:16.154 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.155+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=GSISP9MB2S8Z type=write size=269188 2024-09-14T11:17:16.158 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.159+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~A3YXOW3KK6GK.0 size=1048576 2024-09-14T11:17:16.161 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.163+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~A3YXOW3KK6GK.1 size=1048576 2024-09-14T11:17:16.164 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.167+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~A3YXOW3KK6GK.2 size=641856 2024-09-14T11:17:16.171 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.171+0000 7fe125ff88c0 1 < completed multipart upload key=ESVFZQQXE3GT upload=A3YXOW3KK6GK tag=ZV54IOFKCE53 type=write size=3787584 2024-09-14T11:17:16.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.175+0000 7fe125ff88c0 1 > prepared operation key=3OU4U9JF3ZD5 tag=CHBMVS4I7W4W type=del size=283854 2024-09-14T11:17:16.180 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.179+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~0EKK10GQFB2V.0 size=1048576 2024-09-14T11:17:16.183 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.183+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~0EKK10GQFB2V.1 size=1048576 2024-09-14T11:17:16.186 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.187+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~0EKK10GQFB2V.2 size=1021469 2024-09-14T11:17:16.192 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.195+0000 7fe125ff88c0 1 < completed multipart upload key=K05LARTJ2QZ3 upload=0EKK10GQFB2V tag=6K0HT05WBYU4 type=write size=4167197 2024-09-14T11:17:16.196 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.199+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=ANGVHGSVLCKY type=del size=394735 2024-09-14T11:17:16.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.199+0000 7fe125ff88c0 1 < completed delete operation key=V6B470G93KFT tag=4DJL609W9F8H type=del 2024-09-14T11:17:16.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.207+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~ARGV33U2YI5X.0 size=1048576 2024-09-14T11:17:16.209 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.211+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~ARGV33U2YI5X.1 size=1048576 2024-09-14T11:17:16.212 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.215+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~ARGV33U2YI5X.2 size=309972 2024-09-14T11:17:16.212 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.215+0000 7fe125ff88c0 1 > prepared multipart upload key=1ML6RIXI4C5P upload=ARGV33U2YI5X tag=NRTY8W78TCOI type=write size=3455700 2024-09-14T11:17:16.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.219+0000 7fe125ff88c0 1 < suggested remove operation key=YFRH8WECBTJK tag=638BYDLTZ1HW type=del 2024-09-14T11:17:16.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.227+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~TQSHC2YG6EDB.0 size=1022849 2024-09-14T11:17:16.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.227+0000 7fe125ff88c0 1 > prepared multipart upload key=W0B19NBHNLMZ upload=TQSHC2YG6EDB tag=BHNNFEZMFIPR type=write size=2071425 2024-09-14T11:17:16.233 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.235+0000 7fe125ff88c0 1 < suggested update operation key=0FITHLGQKQEC tag=VBGKSXDL0CQR type=del size=3768270 2024-09-14T11:17:16.240 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.239+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~J3N3NVH5QQER.0 size=1048576 2024-09-14T11:17:16.242 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.243+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~J3N3NVH5QQER.1 size=1048576 2024-09-14T11:17:16.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.247+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~J3N3NVH5QQER.2 size=497223 2024-09-14T11:17:16.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.247+0000 7fe125ff88c0 1 > prepared multipart upload key=35EB6U5O4A51 upload=J3N3NVH5QQER tag=1W5NL3D11HFK type=write size=3642951 2024-09-14T11:17:16.251 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.251+0000 7fe125ff88c0 1 < suggested update operation key=6PLUU2QIO9LJ tag=RGS6FIOGIUSZ type=del size=1441370 2024-09-14T11:17:16.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.255+0000 7fe125ff88c0 1 > prepared operation key=LYBGDNKUROWH tag=6CPBTF0VFGBK type=del size=3409544 2024-09-14T11:17:16.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.259+0000 7fe125ff88c0 1 < completed delete operation key=SSNV25PDLDIS tag=PELMI0P8MM0G type=del 2024-09-14T11:17:16.264 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.267+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~IT4M4JXZ4T7A.0 size=1048576 2024-09-14T11:17:16.267 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.267+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~IT4M4JXZ4T7A.1 size=213320 2024-09-14T11:17:16.267 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.267+0000 7fe125ff88c0 1 > prepared multipart upload key=V6B470G93KFT upload=IT4M4JXZ4T7A tag=RZT3BVW61UBB type=write size=2310472 2024-09-14T11:17:16.274 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.275+0000 7fe125ff88c0 1 < suggested remove operation key=YGEVGH840L18 tag=270TBDBYOSLE type=del 2024-09-14T11:17:16.281 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.283+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~KQDZ6RN7U1D6.0 size=168360 2024-09-14T11:17:16.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.283+0000 7fe125ff88c0 1 > prepared multipart upload key=46ZTDBWFVSUH upload=KQDZ6RN7U1D6 tag=3ILAJYKKC380 type=write size=1216936 2024-09-14T11:17:16.285 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.287+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~8XWKDE20YY19.0 size=1048576 2024-09-14T11:17:16.288 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.287+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~8XWKDE20YY19.1 size=997388 2024-09-14T11:17:16.294 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.295+0000 7fe125ff88c0 1 < completed multipart upload key=LYBGDNKUROWH upload=8XWKDE20YY19 tag=V6ZAYJFXAVPN type=write size=3094540 2024-09-14T11:17:16.300 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.299+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~40RC4Y4UUCLT.0 size=1048576 2024-09-14T11:17:16.303 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.303+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~40RC4Y4UUCLT.1 size=150465 2024-09-14T11:17:16.303 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.303+0000 7fe125ff88c0 1 > prepared multipart upload key=4D2X7151977X upload=40RC4Y4UUCLT tag=PEE0Z3O47YWB type=write size=2247617 2024-09-14T11:17:16.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.307+0000 7fe125ff88c0 1 < completed write operation key=WEA3MQ0DI42N tag=J5A9YBHM3XS0 type=write size=907643 2024-09-14T11:17:16.313 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.315+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~FK7ACQXHD2OI.0 size=1048576 2024-09-14T11:17:16.316 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.315+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~FK7ACQXHD2OI.1 size=1048576 2024-09-14T11:17:16.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.319+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~FK7ACQXHD2OI.2 size=247237 2024-09-14T11:17:16.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.319+0000 7fe125ff88c0 1 > prepared multipart upload key=3OU4U9JF3ZD5 upload=FK7ACQXHD2OI tag=8EJ2EQ3BR70U type=write size=3392965 2024-09-14T11:17:16.322 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.323+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~9KZ3BL1NX4HN.0 size=1048576 2024-09-14T11:17:16.325 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.327+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~9KZ3BL1NX4HN.1 size=1048576 2024-09-14T11:17:16.332 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.331+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~9KZ3BL1NX4HN.2 size=74352 2024-09-14T11:17:16.338 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.339+0000 7fe125ff88c0 1 < completed multipart upload key=LYBGDNKUROWH upload=9KZ3BL1NX4HN tag=X0F6YT9PCXM3 type=write size=3220080 2024-09-14T11:17:16.344 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.347+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~EH8DYPIR1NLQ.0 size=1048576 2024-09-14T11:17:16.347 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.347+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~EH8DYPIR1NLQ.1 size=1048576 2024-09-14T11:17:16.350 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.351+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~EH8DYPIR1NLQ.2 size=325218 2024-09-14T11:17:16.350 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.351+0000 7fe125ff88c0 1 > prepared multipart upload key=K05LARTJ2QZ3 upload=EH8DYPIR1NLQ tag=2SEJA7NIYGXS type=write size=3470946 2024-09-14T11:17:16.353 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.355+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~JO2MI2003INW.0 size=1048576 2024-09-14T11:17:16.353 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.355+0000 7fe125ff88c0 1 < canceled part key=_multipart_SUCH37O8V1LY.2~JO2MI2003INW.1 size=945281 2024-09-14T11:17:16.359 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.359+0000 7fe125ff88c0 1 < canceled multipart upload key=SUCH37O8V1LY upload=JO2MI2003INW tag=8GKMI2BHIA3N type=write size=3042433 2024-09-14T11:17:16.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.363+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=UU2LU9EKY2B2 type=del size=3390323 2024-09-14T11:17:16.367 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.367+0000 7fe125ff88c0 1 < completed delete operation key=SSNV25PDLDIS tag=HNA04EWOQ8J4 type=del 2024-09-14T11:17:16.371 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.371+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=SC0V675MLNUF type=del size=1614350 2024-09-14T11:17:16.378 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.379+0000 7fe125ff88c0 1 < suggested remove operation key=21HC4VMHXS6L tag=J9DCF0HQEN1S type=del 2024-09-14T11:17:16.384 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.383+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~UG8V8N32LTJR.0 size=1048576 2024-09-14T11:17:16.387 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.387+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~UG8V8N32LTJR.1 size=862989 2024-09-14T11:17:16.387 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.387+0000 7fe125ff88c0 1 > prepared multipart upload key=4D2X7151977X upload=UG8V8N32LTJR tag=CT2ZWL70PCTM type=write size=2960141 2024-09-14T11:17:16.390 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.391+0000 7fe125ff88c0 1 < completed write operation key=K3P6U6NU8I01 tag=I2CBA5USZPQV type=write size=560882 2024-09-14T11:17:16.394 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.395+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=LCX32FZVZ95S type=del size=3497144 2024-09-14T11:17:16.397 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.399+0000 7fe125ff88c0 1 < canceled operation key=L4XO0WTYKNXY tag=GSISP9MB2S8Z type=write size=269188 2024-09-14T11:17:16.401 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.403+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=EAKZC048N6WZ type=del size=1618256 2024-09-14T11:17:16.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.407+0000 7fe125ff88c0 1 < completed delete operation key=3OU4U9JF3ZD5 tag=CHBMVS4I7W4W type=del 2024-09-14T11:17:16.412 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.411+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~QD980CEICW43.0 size=912041 2024-09-14T11:17:16.412 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.411+0000 7fe125ff88c0 1 > prepared multipart upload key=V6B470G93KFT upload=QD980CEICW43 tag=YE1Q4KEN54KA type=write size=1960617 2024-09-14T11:17:16.415 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.415+0000 7fe125ff88c0 -1 < failed to complete operation key=21HC4VMHXS6L tag=ANGVHGSVLCKY type=del size=394735: (22) Invalid argument 2024-09-14T11:17:16.418 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.419+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=C48B5PD8290V type=del size=2575368 2024-09-14T11:17:16.422 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.423+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~ARGV33U2YI5X.0 size=1048576 2024-09-14T11:17:16.424 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.427+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~ARGV33U2YI5X.1 size=1048576 2024-09-14T11:17:16.427 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.427+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~ARGV33U2YI5X.2 size=309972 2024-09-14T11:17:16.432 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.435+0000 7fe125ff88c0 1 < completed multipart upload key=1ML6RIXI4C5P upload=ARGV33U2YI5X tag=NRTY8W78TCOI type=write size=3455700 2024-09-14T11:17:16.436 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.435+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=NS4162T9DGK1 type=del size=3766075 2024-09-14T11:17:16.440 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.439+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~TQSHC2YG6EDB.0 size=1022849 2024-09-14T11:17:16.445 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.447+0000 7fe125ff88c0 1 < completed multipart upload key=W0B19NBHNLMZ upload=TQSHC2YG6EDB tag=BHNNFEZMFIPR type=write size=2071425 2024-09-14T11:17:16.449 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.451+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=VV4LMEDTTDKY type=del size=1973 2024-09-14T11:17:16.453 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.455+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~J3N3NVH5QQER.0 size=1048576 2024-09-14T11:17:16.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.455+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~J3N3NVH5QQER.1 size=1048576 2024-09-14T11:17:16.458 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.459+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~J3N3NVH5QQER.2 size=497223 2024-09-14T11:17:16.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.467+0000 7fe125ff88c0 1 < completed multipart upload key=35EB6U5O4A51 upload=J3N3NVH5QQER tag=1W5NL3D11HFK type=write size=3642951 2024-09-14T11:17:16.468 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.467+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=TRACDDCS3HKZ type=del size=257562 2024-09-14T11:17:16.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.471+0000 7fe125ff88c0 1 < canceled operation key=LYBGDNKUROWH tag=6CPBTF0VFGBK type=del size=3409544 2024-09-14T11:17:16.478 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.479+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~8S0LIKI7K056.0 size=1048576 2024-09-14T11:17:16.480 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.479+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~8S0LIKI7K056.1 size=383829 2024-09-14T11:17:16.480 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.479+0000 7fe125ff88c0 1 > prepared multipart upload key=46ZTDBWFVSUH upload=8S0LIKI7K056 tag=8CT0L26MWSWD type=write size=2480981 2024-09-14T11:17:16.484 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.483+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~IT4M4JXZ4T7A.0 size=1048576 2024-09-14T11:17:16.486 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.487+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~IT4M4JXZ4T7A.1 size=213320 2024-09-14T11:17:16.492 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.491+0000 7fe125ff88c0 1 < completed multipart upload key=V6B470G93KFT upload=IT4M4JXZ4T7A tag=RZT3BVW61UBB type=write size=2310472 2024-09-14T11:17:16.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.495+0000 7fe125ff88c0 1 > prepared operation key=3YGN50MBAF41 tag=YIRCE7NPVIT8 type=del size=3887432 2024-09-14T11:17:16.499 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.499+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~KQDZ6RN7U1D6.0 size=168360 2024-09-14T11:17:16.505 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.507+0000 7fe125ff88c0 1 < completed multipart upload key=46ZTDBWFVSUH upload=KQDZ6RN7U1D6 tag=3ILAJYKKC380 type=write size=1216936 2024-09-14T11:17:16.509 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.511+0000 7fe125ff88c0 1 > prepared operation key=K05LARTJ2QZ3 tag=HVIQO2CJCWXH type=del size=98885 2024-09-14T11:17:16.513 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.515+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~40RC4Y4UUCLT.0 size=1048576 2024-09-14T11:17:16.513 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.515+0000 7fe125ff88c0 1 < canceled part key=_multipart_4D2X7151977X.2~40RC4Y4UUCLT.1 size=150465 2024-09-14T11:17:16.519 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.519+0000 7fe125ff88c0 1 < canceled multipart upload key=4D2X7151977X upload=40RC4Y4UUCLT tag=PEE0Z3O47YWB type=write size=2247617 2024-09-14T11:17:16.523 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.523+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=F6QOTO15CKBZ type=del size=527075 2024-09-14T11:17:16.527 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.527+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~FK7ACQXHD2OI.0 size=1048576 2024-09-14T11:17:16.530 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.531+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~FK7ACQXHD2OI.1 size=1048576 2024-09-14T11:17:16.533 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.535+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~FK7ACQXHD2OI.2 size=247237 2024-09-14T11:17:16.539 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.539+0000 7fe125ff88c0 1 < completed multipart upload key=3OU4U9JF3ZD5 upload=FK7ACQXHD2OI tag=8EJ2EQ3BR70U type=write size=3392965 2024-09-14T11:17:16.542 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.543+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=BPM6N2FA54ZC type=del size=1861639 2024-09-14T11:17:16.545 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.547+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~EH8DYPIR1NLQ.0 size=1048576 2024-09-14T11:17:16.548 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.551+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~EH8DYPIR1NLQ.1 size=1048576 2024-09-14T11:17:16.552 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.551+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~EH8DYPIR1NLQ.2 size=325218 2024-09-14T11:17:16.559 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.559+0000 7fe125ff88c0 1 < completed multipart upload key=K05LARTJ2QZ3 upload=EH8DYPIR1NLQ tag=2SEJA7NIYGXS type=write size=3470946 2024-09-14T11:17:16.563 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.563+0000 7fe125ff88c0 1 > prepared operation key=6C3JZKTB8BP3 tag=91WURF580ZTN type=del size=3990700 2024-09-14T11:17:16.568 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.567+0000 7fe125ff88c0 1 < completed delete operation key=6PLUU2QIO9LJ tag=UU2LU9EKY2B2 type=del 2024-09-14T11:17:16.572 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.571+0000 7fe125ff88c0 1 > prepared operation key=3YGN50MBAF41 tag=XCGKYBNYFK8A type=del size=2611945 2024-09-14T11:17:16.576 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.575+0000 7fe125ff88c0 1 < completed delete operation key=WEA3MQ0DI42N tag=SC0V675MLNUF type=del 2024-09-14T11:17:16.582 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.583+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~MOA8VCGYSN5K.0 size=1048576 2024-09-14T11:17:16.586 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.587+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~MOA8VCGYSN5K.1 size=1048576 2024-09-14T11:17:16.588 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.591+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~MOA8VCGYSN5K.2 size=649603 2024-09-14T11:17:16.589 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.591+0000 7fe125ff88c0 1 > prepared multipart upload key=YN2HI39GPEDF upload=MOA8VCGYSN5K tag=VGWHHQ7Z9PVM type=write size=3795331 2024-09-14T11:17:16.592 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.595+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~UG8V8N32LTJR.0 size=1048576 2024-09-14T11:17:16.595 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.595+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~UG8V8N32LTJR.1 size=862989 2024-09-14T11:17:16.601 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.603+0000 7fe125ff88c0 1 < completed multipart upload key=4D2X7151977X upload=UG8V8N32LTJR tag=CT2ZWL70PCTM type=write size=2960141 2024-09-14T11:17:16.605 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.607+0000 7fe125ff88c0 1 > prepared operation key=1ML6RIXI4C5P tag=ROZ7IAYBEEPT type=del size=1587651 2024-09-14T11:17:16.609 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.615+0000 7fe125ff88c0 1 < completed delete operation key=V6B470G93KFT tag=LCX32FZVZ95S type=del 2024-09-14T11:17:16.613 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.615+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=4OA4HOLQBR30 type=del size=1956184 2024-09-14T11:17:16.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.619+0000 7fe125ff88c0 1 < completed delete operation key=ESVFZQQXE3GT tag=EAKZC048N6WZ type=del 2024-09-14T11:17:16.621 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.623+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=8YSUFQN5LXKF type=del size=2731816 2024-09-14T11:17:16.625 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.627+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~QD980CEICW43.0 size=912041 2024-09-14T11:17:16.631 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.631+0000 7fe125ff88c0 1 < completed multipart upload key=V6B470G93KFT upload=QD980CEICW43 tag=YE1Q4KEN54KA type=write size=1960617 2024-09-14T11:17:16.635 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.635+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=1V08NLVTR7S0 type=del size=1838841 2024-09-14T11:17:16.639 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.639+0000 7fe125ff88c0 1 < canceled operation key=W0B19NBHNLMZ tag=C48B5PD8290V type=del size=2575368 2024-09-14T11:17:16.647 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.647+0000 7fe125ff88c0 1 > prepared part key=_multipart_6PLUU2QIO9LJ.2~MNJTH5QTQ6CE.0 size=413664 2024-09-14T11:17:16.647 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.647+0000 7fe125ff88c0 1 > prepared multipart upload key=6PLUU2QIO9LJ upload=MNJTH5QTQ6CE tag=IMLTPDGCRFD4 type=write size=1462240 2024-09-14T11:17:16.651 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.651+0000 7fe125ff88c0 1 < completed delete operation key=6PLUU2QIO9LJ tag=NS4162T9DGK1 type=del 2024-09-14T11:17:16.655 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.655+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=VKXBT2P940NQ type=del size=2028358 2024-09-14T11:17:16.659 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.659+0000 7fe125ff88c0 1 < completed delete operation key=YCF2PCJ9TZMR tag=VV4LMEDTTDKY type=del 2024-09-14T11:17:16.663 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.663+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=KITFF7QDMIBJ type=write size=721625 2024-09-14T11:17:16.667 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.667+0000 7fe125ff88c0 1 < completed delete operation key=K3P6U6NU8I01 tag=TRACDDCS3HKZ type=del 2024-09-14T11:17:16.676 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.675+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=5RTDJLTYM56Z type=del size=2042880 2024-09-14T11:17:16.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.679+0000 7fe125ff88c0 1 < canceled part key=_multipart_46ZTDBWFVSUH.2~8S0LIKI7K056.0 size=1048576 2024-09-14T11:17:16.680 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.683+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~8S0LIKI7K056.1 size=383829 2024-09-14T11:17:16.687 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.687+0000 7fe125ff88c0 1 < canceled multipart upload key=46ZTDBWFVSUH upload=8S0LIKI7K056 tag=8CT0L26MWSWD type=write size=2480981 2024-09-14T11:17:16.692 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.691+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=F64YU77MQTVM type=del size=898654 2024-09-14T11:17:16.696 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.695+0000 7fe125ff88c0 1 < completed delete operation key=3YGN50MBAF41 tag=YIRCE7NPVIT8 type=del 2024-09-14T11:17:16.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.699+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=PZOKTXS3HGV8 type=del size=2988669 2024-09-14T11:17:16.704 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.703+0000 7fe125ff88c0 1 < completed delete operation key=K05LARTJ2QZ3 tag=HVIQO2CJCWXH type=del 2024-09-14T11:17:16.708 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.707+0000 7fe125ff88c0 1 > prepared operation key=YFRH8WECBTJK tag=1RLD4GH9SFCS type=del size=2700574 2024-09-14T11:17:16.712 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.711+0000 7fe125ff88c0 1 < completed delete operation key=2KEKSWK0UT6C tag=F6QOTO15CKBZ type=del 2024-09-14T11:17:16.716 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.715+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=TBQH02ESXF7F type=del size=3413958 2024-09-14T11:17:16.720 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.719+0000 7fe125ff88c0 1 < completed delete operation key=21HC4VMHXS6L tag=BPM6N2FA54ZC type=del 2024-09-14T11:17:16.724 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.727+0000 7fe125ff88c0 1 > prepared operation key=46ZTDBWFVSUH tag=Y76PMB3KTEKY type=del size=2076459 2024-09-14T11:17:16.728 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.727+0000 7fe125ff88c0 1 < completed delete operation key=6C3JZKTB8BP3 tag=91WURF580ZTN type=del 2024-09-14T11:17:16.732 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.731+0000 7fe125ff88c0 1 > prepared operation key=0FITHLGQKQEC tag=OCJLZ22QNRU5 type=del size=632975 2024-09-14T11:17:16.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.739+0000 7fe125ff88c0 1 < completed delete operation key=3YGN50MBAF41 tag=XCGKYBNYFK8A type=del 2024-09-14T11:17:16.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.743+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~6IFFFJCS8B3B.0 size=739202 2024-09-14T11:17:16.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.743+0000 7fe125ff88c0 1 > prepared multipart upload key=L4XO0WTYKNXY upload=6IFFFJCS8B3B tag=ZUYSTFC5RERW type=write size=1787778 2024-09-14T11:17:16.748 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.747+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~MOA8VCGYSN5K.0 size=1048576 2024-09-14T11:17:16.751 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.751+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~MOA8VCGYSN5K.1 size=1048576 2024-09-14T11:17:16.754 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.755+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~MOA8VCGYSN5K.2 size=649603 2024-09-14T11:17:16.760 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.763+0000 7fe125ff88c0 1 < completed multipart upload key=YN2HI39GPEDF upload=MOA8VCGYSN5K tag=VGWHHQ7Z9PVM type=write size=3795331 2024-09-14T11:17:16.767 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.767+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~AGTWLF7KW3XY.0 size=582934 2024-09-14T11:17:16.767 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.767+0000 7fe125ff88c0 1 > prepared multipart upload key=YCF2PCJ9TZMR upload=AGTWLF7KW3XY tag=K29U6CDZKW7S type=write size=1631510 2024-09-14T11:17:16.771 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.771+0000 7fe125ff88c0 1 < completed delete operation key=1ML6RIXI4C5P tag=ROZ7IAYBEEPT type=del 2024-09-14T11:17:16.778 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.779+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~FPM7RSZEC0PW.0 size=1048576 2024-09-14T11:17:16.781 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.783+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~FPM7RSZEC0PW.1 size=324437 2024-09-14T11:17:16.781 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.783+0000 7fe125ff88c0 1 > prepared multipart upload key=YN2HI39GPEDF upload=FPM7RSZEC0PW tag=XEUAKMSWXRQI type=write size=2421589 2024-09-14T11:17:16.785 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.787+0000 7fe125ff88c0 1 < completed delete operation key=K3P6U6NU8I01 tag=4OA4HOLQBR30 type=del 2024-09-14T11:17:16.788 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.791+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=P3W518PFIBZ1 type=del size=1768609 2024-09-14T11:17:16.796 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.795+0000 7fe125ff88c0 1 < suggested update operation key=YN2HI39GPEDF tag=8YSUFQN5LXKF type=del size=2731816 2024-09-14T11:17:16.800 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.799+0000 7fe125ff88c0 1 > prepared operation key=46ZTDBWFVSUH tag=34MOJXGSSDSS type=del size=2073393 2024-09-14T11:17:16.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.803+0000 7fe125ff88c0 1 < canceled operation key=0VBX2FWYCFEZ tag=1V08NLVTR7S0 type=del size=1838841 2024-09-14T11:17:16.808 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.807+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=2V30CCM909MJ type=del size=1815107 2024-09-14T11:17:16.812 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.811+0000 7fe125ff88c0 1 < completed part key=_multipart_6PLUU2QIO9LJ.2~MNJTH5QTQ6CE.0 size=413664 2024-09-14T11:17:16.818 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.823+0000 7fe125ff88c0 1 < completed multipart upload key=6PLUU2QIO9LJ upload=MNJTH5QTQ6CE tag=IMLTPDGCRFD4 type=write size=1462240 2024-09-14T11:17:16.822 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.823+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=1V27I750NREO type=del size=3689135 2024-09-14T11:17:16.827 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.827+0000 7fe125ff88c0 1 < completed delete operation key=K3P6U6NU8I01 tag=VKXBT2P940NQ type=del 2024-09-14T11:17:16.830 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.831+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=9VMS5O5M90UV type=del size=788149 2024-09-14T11:17:16.834 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.835+0000 7fe125ff88c0 1 < canceled operation key=2KEKSWK0UT6C tag=KITFF7QDMIBJ type=write size=721625 2024-09-14T11:17:16.838 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.839+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=55KKFF2K1SHM type=del size=383213 2024-09-14T11:17:16.842 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.843+0000 7fe125ff88c0 1 < completed delete operation key=WEA3MQ0DI42N tag=5RTDJLTYM56Z type=del 2024-09-14T11:17:16.849 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.851+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~XFXB9NR0T92D.0 size=647085 2024-09-14T11:17:16.849 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.851+0000 7fe125ff88c0 1 > prepared multipart upload key=SSNV25PDLDIS upload=XFXB9NR0T92D tag=SSKVPVDDW1CR type=write size=1695661 2024-09-14T11:17:16.852 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.855+0000 7fe125ff88c0 1 < completed delete operation key=WEA3MQ0DI42N tag=F64YU77MQTVM type=del 2024-09-14T11:17:16.859 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.859+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~WZDLQYF8WK8P.0 size=1048576 2024-09-14T11:17:16.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.863+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~WZDLQYF8WK8P.1 size=1048576 2024-09-14T11:17:16.866 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.867+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~WZDLQYF8WK8P.2 size=273624 2024-09-14T11:17:16.866 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.867+0000 7fe125ff88c0 1 > prepared multipart upload key=YFRH8WECBTJK upload=WZDLQYF8WK8P tag=5D349F0BVCP3 type=write size=3419352 2024-09-14T11:17:16.869 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.871+0000 7fe125ff88c0 1 < completed delete operation key=35EB6U5O4A51 tag=PZOKTXS3HGV8 type=del 2024-09-14T11:17:16.876 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.875+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~OCQ8KC4ZNKJP.0 size=1048576 2024-09-14T11:17:16.879 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.879+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~OCQ8KC4ZNKJP.1 size=1048576 2024-09-14T11:17:16.882 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.883+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~OCQ8KC4ZNKJP.2 size=753433 2024-09-14T11:17:16.882 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.883+0000 7fe125ff88c0 1 > prepared multipart upload key=YCF2PCJ9TZMR upload=OCQ8KC4ZNKJP tag=66Q7VKUAHBB2 type=write size=3899161 2024-09-14T11:17:16.886 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.887+0000 7fe125ff88c0 1 < completed delete operation key=YFRH8WECBTJK tag=1RLD4GH9SFCS type=del 2024-09-14T11:17:16.890 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.891+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=I3Q4ADOX8U19 type=del size=1341608 2024-09-14T11:17:16.893 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.895+0000 7fe125ff88c0 1 < completed delete operation key=YCF2PCJ9TZMR tag=TBQH02ESXF7F type=del 2024-09-14T11:17:16.897 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.899+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=2WU36I325L14 type=del size=1121702 2024-09-14T11:17:16.901 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.903+0000 7fe125ff88c0 1 < completed delete operation key=46ZTDBWFVSUH tag=Y76PMB3KTEKY type=del 2024-09-14T11:17:16.905 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.907+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=P66K044LZBQU type=write size=770290 2024-09-14T11:17:16.909 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.911+0000 7fe125ff88c0 1 < completed delete operation key=0FITHLGQKQEC tag=OCJLZ22QNRU5 type=del 2024-09-14T11:17:16.915 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.915+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~DYT826V9R3EI.0 size=8330 2024-09-14T11:17:16.916 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.915+0000 7fe125ff88c0 1 > prepared multipart upload key=4D2X7151977X upload=DYT826V9R3EI tag=6121HSWIH150 type=write size=1056906 2024-09-14T11:17:16.919 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.919+0000 7fe125ff88c0 1 < completed part key=_multipart_L4XO0WTYKNXY.2~6IFFFJCS8B3B.0 size=739202 2024-09-14T11:17:16.925 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.927+0000 7fe125ff88c0 1 < completed multipart upload key=L4XO0WTYKNXY upload=6IFFFJCS8B3B tag=ZUYSTFC5RERW type=write size=1787778 2024-09-14T11:17:16.929 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.931+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=66HK3UUHQYXX type=del size=368476 2024-09-14T11:17:16.933 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.935+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~AGTWLF7KW3XY.0 size=582934 2024-09-14T11:17:16.939 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.939+0000 7fe125ff88c0 1 < completed multipart upload key=YCF2PCJ9TZMR upload=AGTWLF7KW3XY tag=K29U6CDZKW7S type=write size=1631510 2024-09-14T11:17:16.943 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.943+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=QGLIMD1LYAR6 type=del size=4128527 2024-09-14T11:17:16.947 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.947+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~FPM7RSZEC0PW.0 size=1048576 2024-09-14T11:17:16.950 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.951+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~FPM7RSZEC0PW.1 size=324437 2024-09-14T11:17:16.956 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.955+0000 7fe125ff88c0 1 < completed multipart upload key=YN2HI39GPEDF upload=FPM7RSZEC0PW tag=XEUAKMSWXRQI type=write size=2421589 2024-09-14T11:17:16.959 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.959+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=J95H47063D8Y type=write size=1043349 2024-09-14T11:17:16.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.963+0000 7fe125ff88c0 1 < completed delete operation key=V6B470G93KFT tag=P3W518PFIBZ1 type=del 2024-09-14T11:17:16.967 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.967+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=A4DMFA64UKLI type=del size=175141 2024-09-14T11:17:16.971 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.971+0000 7fe125ff88c0 1 < completed delete operation key=46ZTDBWFVSUH tag=34MOJXGSSDSS type=del 2024-09-14T11:17:16.977 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.979+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~9XKXA0S4F2V2.0 size=1048576 2024-09-14T11:17:16.980 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.979+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~9XKXA0S4F2V2.1 size=297031 2024-09-14T11:17:16.980 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.979+0000 7fe125ff88c0 1 > prepared multipart upload key=SSNV25PDLDIS upload=9XKXA0S4F2V2 tag=8TQ45EDMCDLC type=write size=2394183 2024-09-14T11:17:16.984 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.983+0000 7fe125ff88c0 1 < completed delete operation key=WEA3MQ0DI42N tag=2V30CCM909MJ type=del 2024-09-14T11:17:16.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.991+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~W5ZCPSSSDRLJ.0 size=1048576 2024-09-14T11:17:16.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.995+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~W5ZCPSSSDRLJ.1 size=411629 2024-09-14T11:17:16.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.995+0000 7fe125ff88c0 1 > prepared multipart upload key=N80X3YUF4OEL upload=W5ZCPSSSDRLJ tag=RGA4SJUZJ80G type=write size=2508781 2024-09-14T11:17:16.997 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:16.999+0000 7fe125ff88c0 1 < completed delete operation key=V6B470G93KFT tag=1V27I750NREO type=del 2024-09-14T11:17:17.001 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.003+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=D9EDQXNBNLBT type=del size=2827217 2024-09-14T11:17:17.005 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.007+0000 7fe125ff88c0 1 < completed delete operation key=K3P6U6NU8I01 tag=9VMS5O5M90UV type=del 2024-09-14T11:17:17.009 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.011+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=9BK0NVXZDSGD type=del size=3853047 2024-09-14T11:17:17.012 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.015+0000 7fe125ff88c0 1 < completed delete operation key=YGEVGH840L18 tag=55KKFF2K1SHM type=del 2024-09-14T11:17:17.016 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.015+0000 7fe125ff88c0 1 > prepared operation key=3OU4U9JF3ZD5 tag=1T5VMKO9E1J9 type=del size=1391656 2024-09-14T11:17:17.019 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.019+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~XFXB9NR0T92D.0 size=647085 2024-09-14T11:17:17.025 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.027+0000 7fe125ff88c0 1 < completed multipart upload key=SSNV25PDLDIS upload=XFXB9NR0T92D tag=SSKVPVDDW1CR type=write size=1695661 2024-09-14T11:17:17.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.027+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=ALWJXRXYV8S1 type=del size=1692722 2024-09-14T11:17:17.032 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.031+0000 7fe125ff88c0 1 < completed part key=_multipart_YFRH8WECBTJK.2~WZDLQYF8WK8P.0 size=1048576 2024-09-14T11:17:17.039 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.039+0000 7fe125ff88c0 1 < completed part key=_multipart_YFRH8WECBTJK.2~WZDLQYF8WK8P.1 size=1048576 2024-09-14T11:17:17.042 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.043+0000 7fe125ff88c0 1 < completed part key=_multipart_YFRH8WECBTJK.2~WZDLQYF8WK8P.2 size=273624 2024-09-14T11:17:17.048 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.047+0000 7fe125ff88c0 1 < completed multipart upload key=YFRH8WECBTJK upload=WZDLQYF8WK8P tag=5D349F0BVCP3 type=write size=3419352 2024-09-14T11:17:17.051 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.051+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=D99CEJ4CTBL8 type=write size=750498 2024-09-14T11:17:17.055 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.055+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~OCQ8KC4ZNKJP.0 size=1048576 2024-09-14T11:17:17.058 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.059+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~OCQ8KC4ZNKJP.1 size=1048576 2024-09-14T11:17:17.060 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.063+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~OCQ8KC4ZNKJP.2 size=753433 2024-09-14T11:17:17.066 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.067+0000 7fe125ff88c0 1 < completed multipart upload key=YCF2PCJ9TZMR upload=OCQ8KC4ZNKJP tag=66Q7VKUAHBB2 type=write size=3899161 2024-09-14T11:17:17.070 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.071+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=ECHKETBO5DS9 type=del size=3391242 2024-09-14T11:17:17.074 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.075+0000 7fe125ff88c0 1 < completed delete operation key=K3P6U6NU8I01 tag=I3Q4ADOX8U19 type=del 2024-09-14T11:17:17.078 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.079+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=UCSCG3S7KOV7 type=write size=778459 2024-09-14T11:17:17.085 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.087+0000 7fe125ff88c0 1 < suggested remove operation key=ESVFZQQXE3GT tag=2WU36I325L14 type=del 2024-09-14T11:17:17.091 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.091+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~AOZU9HU8LVUB.0 size=1048576 2024-09-14T11:17:17.094 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.095+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~AOZU9HU8LVUB.1 size=1048576 2024-09-14T11:17:17.097 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.099+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~AOZU9HU8LVUB.2 size=587526 2024-09-14T11:17:17.097 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.099+0000 7fe125ff88c0 1 > prepared multipart upload key=21HC4VMHXS6L upload=AOZU9HU8LVUB tag=3VYPVN6N35N1 type=write size=3733254 2024-09-14T11:17:17.101 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.103+0000 7fe125ff88c0 1 < completed write operation key=YN2HI39GPEDF tag=P66K044LZBQU type=write size=770290 2024-09-14T11:17:17.107 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.107+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~KCSBB27HBD6F.0 size=1048576 2024-09-14T11:17:17.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.111+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~KCSBB27HBD6F.1 size=833696 2024-09-14T11:17:17.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.111+0000 7fe125ff88c0 1 > prepared multipart upload key=K05LARTJ2QZ3 upload=KCSBB27HBD6F tag=6TFSNSSC5E04 type=write size=2930848 2024-09-14T11:17:17.114 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.115+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~DYT826V9R3EI.0 size=8330 2024-09-14T11:17:17.120 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.119+0000 7fe125ff88c0 1 < completed multipart upload key=4D2X7151977X upload=DYT826V9R3EI tag=6121HSWIH150 type=write size=1056906 2024-09-14T11:17:17.124 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.123+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=380EQK7FEEF6 type=del size=985713 2024-09-14T11:17:17.132 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.131+0000 7fe125ff88c0 1 < suggested update operation key=F9I82N7RQC81 tag=66HK3UUHQYXX type=del size=368476 2024-09-14T11:17:17.139 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.139+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~1X9NLLXZOSAI.0 size=1048576 2024-09-14T11:17:17.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.143+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~1X9NLLXZOSAI.1 size=604426 2024-09-14T11:17:17.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.143+0000 7fe125ff88c0 1 > prepared multipart upload key=W0B19NBHNLMZ upload=1X9NLLXZOSAI tag=C1GXC8INAQH1 type=write size=2701578 2024-09-14T11:17:17.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.147+0000 7fe125ff88c0 1 < completed delete operation key=6PLUU2QIO9LJ tag=QGLIMD1LYAR6 type=del 2024-09-14T11:17:17.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.151+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=UUBTI8DJ8LQI type=del size=2555473 2024-09-14T11:17:17.154 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.155+0000 7fe125ff88c0 1 < canceled operation key=4D2X7151977X tag=J95H47063D8Y type=write size=1043349 2024-09-14T11:17:17.157 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.159+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=TWVIJ15R0SEI type=del size=3793482 2024-09-14T11:17:17.165 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.167+0000 7fe125ff88c0 1 < suggested update operation key=SSNV25PDLDIS tag=A4DMFA64UKLI type=del size=175141 2024-09-14T11:17:17.169 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.171+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=SX65TTSVTDFX type=del size=1742298 2024-09-14T11:17:17.173 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.175+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~9XKXA0S4F2V2.0 size=1048576 2024-09-14T11:17:17.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.175+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~9XKXA0S4F2V2.1 size=297031 2024-09-14T11:17:17.182 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.183+0000 7fe125ff88c0 1 < completed multipart upload key=SSNV25PDLDIS upload=9XKXA0S4F2V2 tag=8TQ45EDMCDLC type=write size=2394183 2024-09-14T11:17:17.185 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.187+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=WJOOS0AQ47K5 type=del size=2476538 2024-09-14T11:17:17.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.191+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~W5ZCPSSSDRLJ.0 size=1048576 2024-09-14T11:17:17.192 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.191+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~W5ZCPSSSDRLJ.1 size=411629 2024-09-14T11:17:17.198 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.199+0000 7fe125ff88c0 1 < completed multipart upload key=N80X3YUF4OEL upload=W5ZCPSSSDRLJ tag=RGA4SJUZJ80G type=write size=2508781 2024-09-14T11:17:17.204 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.207+0000 7fe125ff88c0 1 > prepared part key=_multipart_6PLUU2QIO9LJ.2~WCBOFQR4J3E5.0 size=37508 2024-09-14T11:17:17.204 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.207+0000 7fe125ff88c0 1 > prepared multipart upload key=6PLUU2QIO9LJ upload=WCBOFQR4J3E5 tag=AYPFDJOX7TE3 type=write size=1086084 2024-09-14T11:17:17.208 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.211+0000 7fe125ff88c0 1 < completed delete operation key=K3P6U6NU8I01 tag=D9EDQXNBNLBT type=del 2024-09-14T11:17:17.215 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.215+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~JQH4SRGGFEV0.0 size=553373 2024-09-14T11:17:17.215 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.215+0000 7fe125ff88c0 1 > prepared multipart upload key=3OU4U9JF3ZD5 upload=JQH4SRGGFEV0 tag=U3F4ZC6TK5PE type=write size=1601949 2024-09-14T11:17:17.219 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.219+0000 7fe125ff88c0 1 < completed delete operation key=YGEVGH840L18 tag=9BK0NVXZDSGD type=del 2024-09-14T11:17:17.223 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.223+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=76NDOAR98UOF type=del size=187432 2024-09-14T11:17:17.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.227+0000 7fe125ff88c0 1 < completed delete operation key=3OU4U9JF3ZD5 tag=1T5VMKO9E1J9 type=del 2024-09-14T11:17:17.235 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.235+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~YVW2ZQ3XKF0C.0 size=1048576 2024-09-14T11:17:17.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.239+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~YVW2ZQ3XKF0C.1 size=1046024 2024-09-14T11:17:17.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.239+0000 7fe125ff88c0 1 > prepared multipart upload key=L4XO0WTYKNXY upload=YVW2ZQ3XKF0C tag=R043Z2N7BZRB type=write size=3143176 2024-09-14T11:17:17.242 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.243+0000 7fe125ff88c0 -1 < failed to complete operation key=SSNV25PDLDIS tag=ALWJXRXYV8S1 type=del size=1692722: (22) Invalid argument 2024-09-14T11:17:17.250 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.251+0000 7fe125ff88c0 1 > prepared part key=_multipart_6PLUU2QIO9LJ.2~TMJHTKJIH2BK.0 size=991963 2024-09-14T11:17:17.250 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.251+0000 7fe125ff88c0 1 > prepared multipart upload key=6PLUU2QIO9LJ upload=TMJHTKJIH2BK tag=T5BWVJBD00GF type=write size=2040539 2024-09-14T11:17:17.254 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.255+0000 7fe125ff88c0 1 < completed write operation key=2LH5U05C2F8C tag=D99CEJ4CTBL8 type=write size=750498 2024-09-14T11:17:17.261 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.263+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~4I6MUW8HA6Q2.0 size=1048576 2024-09-14T11:17:17.264 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.263+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~4I6MUW8HA6Q2.1 size=1048576 2024-09-14T11:17:17.267 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.267+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~4I6MUW8HA6Q2.2 size=741621 2024-09-14T11:17:17.267 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.267+0000 7fe125ff88c0 1 > prepared multipart upload key=6C3JZKTB8BP3 upload=4I6MUW8HA6Q2 tag=XF7AUNQQJV7R type=write size=3887349 2024-09-14T11:17:17.271 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.271+0000 7fe125ff88c0 1 < completed delete operation key=2UXA6SXDTUFT tag=ECHKETBO5DS9 type=del 2024-09-14T11:17:17.275 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.275+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=4E108LE12JH6 type=del size=3866319 2024-09-14T11:17:17.280 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.279+0000 7fe125ff88c0 1 < completed write operation key=0VBX2FWYCFEZ tag=UCSCG3S7KOV7 type=write size=778459 2024-09-14T11:17:17.287 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.287+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~C7XX8RLZ06TT.0 size=534070 2024-09-14T11:17:17.287 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.287+0000 7fe125ff88c0 1 > prepared multipart upload key=FQ5WT12KB664 upload=C7XX8RLZ06TT tag=4CJ9E1R9S62P type=write size=1582646 2024-09-14T11:17:17.292 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.291+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~AOZU9HU8LVUB.0 size=1048576 2024-09-14T11:17:17.295 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.295+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~AOZU9HU8LVUB.1 size=1048576 2024-09-14T11:17:17.298 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.299+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~AOZU9HU8LVUB.2 size=587526 2024-09-14T11:17:17.304 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.303+0000 7fe125ff88c0 1 < completed multipart upload key=21HC4VMHXS6L upload=AOZU9HU8LVUB tag=3VYPVN6N35N1 type=write size=3733254 2024-09-14T11:17:17.307 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.307+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=Z86QR5KGQDM4 type=del size=114752 2024-09-14T11:17:17.311 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.311+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~KCSBB27HBD6F.0 size=1048576 2024-09-14T11:17:17.314 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.315+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~KCSBB27HBD6F.1 size=833696 2024-09-14T11:17:17.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.319+0000 7fe125ff88c0 1 < completed multipart upload key=K05LARTJ2QZ3 upload=KCSBB27HBD6F tag=6TFSNSSC5E04 type=write size=2930848 2024-09-14T11:17:17.326 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.327+0000 7fe125ff88c0 1 > prepared part key=_multipart_2KEKSWK0UT6C.2~4ZVMGX9I4FEB.0 size=19238 2024-09-14T11:17:17.326 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.327+0000 7fe125ff88c0 1 > prepared multipart upload key=2KEKSWK0UT6C upload=4ZVMGX9I4FEB tag=16ZYX4REE9BZ type=write size=1067814 2024-09-14T11:17:17.329 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.331+0000 7fe125ff88c0 1 < completed delete operation key=YN2HI39GPEDF tag=380EQK7FEEF6 type=del 2024-09-14T11:17:17.336 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.339+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~KEZROS0CO8ZO.0 size=1048576 2024-09-14T11:17:17.339 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.339+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~KEZROS0CO8ZO.1 size=353822 2024-09-14T11:17:17.339 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.339+0000 7fe125ff88c0 1 > prepared multipart upload key=0FITHLGQKQEC upload=KEZROS0CO8ZO tag=PKQSKBP122IL type=write size=2450974 2024-09-14T11:17:17.343 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.343+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~1X9NLLXZOSAI.0 size=1048576 2024-09-14T11:17:17.346 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.347+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~1X9NLLXZOSAI.1 size=604426 2024-09-14T11:17:17.352 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.351+0000 7fe125ff88c0 1 < completed multipart upload key=W0B19NBHNLMZ upload=1X9NLLXZOSAI tag=C1GXC8INAQH1 type=write size=2701578 2024-09-14T11:17:17.359 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.359+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~3NIPMRJSIVD6.0 size=511758 2024-09-14T11:17:17.359 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.359+0000 7fe125ff88c0 1 > prepared multipart upload key=FQ5WT12KB664 upload=3NIPMRJSIVD6 tag=3NEHJ3QID330 type=write size=1560334 2024-09-14T11:17:17.366 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.367+0000 7fe125ff88c0 1 < suggested remove operation key=2KEKSWK0UT6C tag=UUBTI8DJ8LQI type=del 2024-09-14T11:17:17.370 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.371+0000 7fe125ff88c0 1 > prepared operation key=46ZTDBWFVSUH tag=G6M3D875S35B type=write size=995489 2024-09-14T11:17:17.377 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.379+0000 7fe125ff88c0 1 < suggested remove operation key=N94D3R7IOBNL tag=TWVIJ15R0SEI type=del 2024-09-14T11:17:17.381 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.383+0000 7fe125ff88c0 1 > prepared operation key=SUCH37O8V1LY tag=0YQBPBSHH8B7 type=del size=762871 2024-09-14T11:17:17.389 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.391+0000 7fe125ff88c0 1 < completed delete operation key=ESVFZQQXE3GT tag=SX65TTSVTDFX type=del 2024-09-14T11:17:17.393 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.395+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=83ZKVO9I4F3O type=write size=565874 2024-09-14T11:17:17.396 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.399+0000 7fe125ff88c0 1 < canceled operation key=21HC4VMHXS6L tag=WJOOS0AQ47K5 type=del size=2476538 2024-09-14T11:17:17.403 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.403+0000 7fe125ff88c0 1 > prepared part key=_multipart_WEA3MQ0DI42N.2~ZY3MNGQKJI90.0 size=1048576 2024-09-14T11:17:17.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.407+0000 7fe125ff88c0 1 > prepared part key=_multipart_WEA3MQ0DI42N.2~ZY3MNGQKJI90.1 size=783279 2024-09-14T11:17:17.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.407+0000 7fe125ff88c0 1 > prepared multipart upload key=WEA3MQ0DI42N upload=ZY3MNGQKJI90 tag=DVVN3VSNB62O type=write size=2880431 2024-09-14T11:17:17.410 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.411+0000 7fe125ff88c0 1 < completed part key=_multipart_6PLUU2QIO9LJ.2~WCBOFQR4J3E5.0 size=37508 2024-09-14T11:17:17.417 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.419+0000 7fe125ff88c0 1 < completed multipart upload key=6PLUU2QIO9LJ upload=WCBOFQR4J3E5 tag=AYPFDJOX7TE3 type=write size=1086084 2024-09-14T11:17:17.421 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.423+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=99IN2X0TC5I9 type=del size=1883140 2024-09-14T11:17:17.425 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.427+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~JQH4SRGGFEV0.0 size=553373 2024-09-14T11:17:17.430 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.435+0000 7fe125ff88c0 1 < completed multipart upload key=3OU4U9JF3ZD5 upload=JQH4SRGGFEV0 tag=U3F4ZC6TK5PE type=write size=1601949 2024-09-14T11:17:17.436 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.435+0000 7fe125ff88c0 1 > prepared part key=_multipart_2KEKSWK0UT6C.2~CCGEOP6WCRU3.0 size=1048576 2024-09-14T11:17:17.439 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.439+0000 7fe125ff88c0 1 > prepared part key=_multipart_2KEKSWK0UT6C.2~CCGEOP6WCRU3.1 size=1048576 2024-09-14T11:17:17.442 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.443+0000 7fe125ff88c0 1 > prepared part key=_multipart_2KEKSWK0UT6C.2~CCGEOP6WCRU3.2 size=995996 2024-09-14T11:17:17.442 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.443+0000 7fe125ff88c0 1 > prepared multipart upload key=2KEKSWK0UT6C upload=CCGEOP6WCRU3 tag=1CVUYUCKWONS type=write size=4141724 2024-09-14T11:17:17.445 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.447+0000 7fe125ff88c0 1 < completed delete operation key=WEA3MQ0DI42N tag=76NDOAR98UOF type=del 2024-09-14T11:17:17.449 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.451+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=8EI7ZTLEZXXT type=write size=687313 2024-09-14T11:17:17.453 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.455+0000 7fe125ff88c0 1 < completed part key=_multipart_L4XO0WTYKNXY.2~YVW2ZQ3XKF0C.0 size=1048576 2024-09-14T11:17:17.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.455+0000 7fe125ff88c0 1 < completed part key=_multipart_L4XO0WTYKNXY.2~YVW2ZQ3XKF0C.1 size=1046024 2024-09-14T11:17:17.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.463+0000 7fe125ff88c0 1 < completed multipart upload key=L4XO0WTYKNXY upload=YVW2ZQ3XKF0C tag=R043Z2N7BZRB type=write size=3143176 2024-09-14T11:17:17.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.467+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=E2XHBZLKZKR2 type=del size=812834 2024-09-14T11:17:17.469 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.471+0000 7fe125ff88c0 1 < completed part key=_multipart_6PLUU2QIO9LJ.2~TMJHTKJIH2BK.0 size=991963 2024-09-14T11:17:17.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.475+0000 7fe125ff88c0 1 < completed multipart upload key=6PLUU2QIO9LJ upload=TMJHTKJIH2BK tag=T5BWVJBD00GF type=write size=2040539 2024-09-14T11:17:17.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.483+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~5053EEATQCI2.0 size=242651 2024-09-14T11:17:17.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.483+0000 7fe125ff88c0 1 > prepared multipart upload key=ESVFZQQXE3GT upload=5053EEATQCI2 tag=J71MZ1E275K6 type=write size=1291227 2024-09-14T11:17:17.486 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.487+0000 7fe125ff88c0 1 < completed part key=_multipart_6C3JZKTB8BP3.2~4I6MUW8HA6Q2.0 size=1048576 2024-09-14T11:17:17.489 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.491+0000 7fe125ff88c0 1 < completed part key=_multipart_6C3JZKTB8BP3.2~4I6MUW8HA6Q2.1 size=1048576 2024-09-14T11:17:17.492 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.491+0000 7fe125ff88c0 1 < completed part key=_multipart_6C3JZKTB8BP3.2~4I6MUW8HA6Q2.2 size=741621 2024-09-14T11:17:17.498 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.499+0000 7fe125ff88c0 1 < completed multipart upload key=6C3JZKTB8BP3 upload=4I6MUW8HA6Q2 tag=XF7AUNQQJV7R type=write size=3887349 2024-09-14T11:17:17.504 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.503+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~L6X1D9IVT83C.0 size=267119 2024-09-14T11:17:17.504 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.503+0000 7fe125ff88c0 1 > prepared multipart upload key=2LH5U05C2F8C upload=L6X1D9IVT83C tag=F1B1D63SMJLC type=write size=1315695 2024-09-14T11:17:17.508 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.507+0000 7fe125ff88c0 1 < completed delete operation key=YGEVGH840L18 tag=4E108LE12JH6 type=del 2024-09-14T11:17:17.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.511+0000 7fe125ff88c0 1 > prepared operation key=46ZTDBWFVSUH tag=62LVK208Z5GF type=del size=1401798 2024-09-14T11:17:17.515 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.515+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~C7XX8RLZ06TT.0 size=534070 2024-09-14T11:17:17.521 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.523+0000 7fe125ff88c0 1 < completed multipart upload key=FQ5WT12KB664 upload=C7XX8RLZ06TT tag=4CJ9E1R9S62P type=write size=1582646 2024-09-14T11:17:17.527 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.527+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~01R7O4GGMQFS.0 size=1048576 2024-09-14T11:17:17.530 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.531+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~01R7O4GGMQFS.1 size=864834 2024-09-14T11:17:17.530 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.531+0000 7fe125ff88c0 1 > prepared multipart upload key=2LH5U05C2F8C upload=01R7O4GGMQFS tag=RPYLQ2V1SGZ2 type=write size=2961986 2024-09-14T11:17:17.533 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.535+0000 7fe125ff88c0 -1 < failed to complete operation key=N94D3R7IOBNL tag=Z86QR5KGQDM4 type=del size=114752: (22) Invalid argument 2024-09-14T11:17:17.537 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.539+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=LJ5NHBD0EP16 type=del size=2353771 2024-09-14T11:17:17.540 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.539+0000 7fe125ff88c0 1 < completed part key=_multipart_2KEKSWK0UT6C.2~4ZVMGX9I4FEB.0 size=19238 2024-09-14T11:17:17.546 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.547+0000 7fe125ff88c0 1 < completed multipart upload key=2KEKSWK0UT6C upload=4ZVMGX9I4FEB tag=16ZYX4REE9BZ type=write size=1067814 2024-09-14T11:17:17.549 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.551+0000 7fe125ff88c0 1 > prepared operation key=3YGN50MBAF41 tag=FI56CJU99BWS type=del size=1552742 2024-09-14T11:17:17.553 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.555+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~KEZROS0CO8ZO.0 size=1048576 2024-09-14T11:17:17.556 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.555+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~KEZROS0CO8ZO.1 size=353822 2024-09-14T11:17:17.561 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.563+0000 7fe125ff88c0 1 < completed multipart upload key=0FITHLGQKQEC upload=KEZROS0CO8ZO tag=PKQSKBP122IL type=write size=2450974 2024-09-14T11:17:17.567 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.567+0000 7fe125ff88c0 1 > prepared part key=_multipart_2KEKSWK0UT6C.2~1QCMVJRYH3CT.0 size=1048576 2024-09-14T11:17:17.570 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.571+0000 7fe125ff88c0 1 > prepared part key=_multipart_2KEKSWK0UT6C.2~1QCMVJRYH3CT.1 size=460947 2024-09-14T11:17:17.570 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.571+0000 7fe125ff88c0 1 > prepared multipart upload key=2KEKSWK0UT6C upload=1QCMVJRYH3CT tag=2LP1F5PJZS8X type=write size=2558099 2024-09-14T11:17:17.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.575+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~3NIPMRJSIVD6.0 size=511758 2024-09-14T11:17:17.579 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.579+0000 7fe125ff88c0 1 < completed multipart upload key=FQ5WT12KB664 upload=3NIPMRJSIVD6 tag=3NEHJ3QID330 type=write size=1560334 2024-09-14T11:17:17.586 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.587+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~MBJRG1JW8HP9.0 size=481296 2024-09-14T11:17:17.586 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.587+0000 7fe125ff88c0 1 > prepared multipart upload key=4D2X7151977X upload=MBJRG1JW8HP9 tag=EV9LKN7PEQM0 type=write size=1529872 2024-09-14T11:17:17.590 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.591+0000 7fe125ff88c0 1 < completed write operation key=46ZTDBWFVSUH tag=G6M3D875S35B type=write size=995489 2024-09-14T11:17:17.596 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.599+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~0T5SEIUAR0YA.0 size=1048576 2024-09-14T11:17:17.599 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.599+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~0T5SEIUAR0YA.1 size=1048576 2024-09-14T11:17:17.601 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.603+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~0T5SEIUAR0YA.2 size=1015215 2024-09-14T11:17:17.601 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.603+0000 7fe125ff88c0 1 > prepared multipart upload key=1ML6RIXI4C5P upload=0T5SEIUAR0YA tag=5KI5WU12EIND type=write size=4160943 2024-09-14T11:17:17.605 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.607+0000 7fe125ff88c0 1 < completed delete operation key=SUCH37O8V1LY tag=0YQBPBSHH8B7 type=del 2024-09-14T11:17:17.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.607+0000 7fe125ff88c0 1 > prepared operation key=3OU4U9JF3ZD5 tag=L27OMTZFA1A6 type=del size=2540131 2024-09-14T11:17:17.611 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.611+0000 7fe125ff88c0 1 < completed write operation key=V6B470G93KFT tag=83ZKVO9I4F3O type=write size=565874 2024-09-14T11:17:17.618 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.619+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~N0GN6OK8S9YI.0 size=169983 2024-09-14T11:17:17.618 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.619+0000 7fe125ff88c0 1 > prepared multipart upload key=K05LARTJ2QZ3 upload=N0GN6OK8S9YI tag=R102E7TRU07T type=write size=1218559 2024-09-14T11:17:17.621 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.623+0000 7fe125ff88c0 1 < completed part key=_multipart_WEA3MQ0DI42N.2~ZY3MNGQKJI90.0 size=1048576 2024-09-14T11:17:17.623 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.623+0000 7fe125ff88c0 1 < completed part key=_multipart_WEA3MQ0DI42N.2~ZY3MNGQKJI90.1 size=783279 2024-09-14T11:17:17.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.631+0000 7fe125ff88c0 1 < completed multipart upload key=WEA3MQ0DI42N upload=ZY3MNGQKJI90 tag=DVVN3VSNB62O type=write size=2880431 2024-09-14T11:17:17.633 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.635+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=VB3F8OUPLRFB type=del size=4047248 2024-09-14T11:17:17.637 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.639+0000 7fe125ff88c0 1 < canceled operation key=YGEVGH840L18 tag=99IN2X0TC5I9 type=del size=1883140 2024-09-14T11:17:17.641 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.643+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=BTH2P65LQSFE type=del size=1797349 2024-09-14T11:17:17.642 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.643+0000 7fe125ff88c0 1 < canceled part key=_multipart_2KEKSWK0UT6C.2~CCGEOP6WCRU3.0 size=1048576 2024-09-14T11:17:17.645 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.647+0000 7fe125ff88c0 1 < completed part key=_multipart_2KEKSWK0UT6C.2~CCGEOP6WCRU3.1 size=1048576 2024-09-14T11:17:17.647 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.647+0000 7fe125ff88c0 1 < completed part key=_multipart_2KEKSWK0UT6C.2~CCGEOP6WCRU3.2 size=995996 2024-09-14T11:17:17.653 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.655+0000 7fe125ff88c0 1 < canceled multipart upload key=2KEKSWK0UT6C upload=CCGEOP6WCRU3 tag=1CVUYUCKWONS type=write size=4141724 2024-09-14T11:17:17.657 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.659+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=05IV58FRVLX6 type=del size=872240 2024-09-14T11:17:17.661 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.663+0000 7fe125ff88c0 1 < completed write operation key=21HC4VMHXS6L tag=8EI7ZTLEZXXT type=write size=687313 2024-09-14T11:17:17.668 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.671+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~DMXIIESWD3EU.0 size=341210 2024-09-14T11:17:17.668 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.671+0000 7fe125ff88c0 1 > prepared multipart upload key=ESVFZQQXE3GT upload=DMXIIESWD3EU tag=BCD3TZ6ABDL7 type=write size=1389786 2024-09-14T11:17:17.676 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.679+0000 7fe125ff88c0 1 < suggested update operation key=K3P6U6NU8I01 tag=E2XHBZLKZKR2 type=del size=812834 2024-09-14T11:17:17.680 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.679+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=PKC2I4B4R71T type=del size=1542888 2024-09-14T11:17:17.684 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.687+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~5053EEATQCI2.0 size=242651 2024-09-14T11:17:17.690 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.691+0000 7fe125ff88c0 1 < completed multipart upload key=ESVFZQQXE3GT upload=5053EEATQCI2 tag=J71MZ1E275K6 type=write size=1291227 2024-09-14T11:17:17.694 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.695+0000 7fe125ff88c0 1 > prepared operation key=6C3JZKTB8BP3 tag=5514ORVUKT4B type=del size=3896689 2024-09-14T11:17:17.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.699+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~L6X1D9IVT83C.0 size=267119 2024-09-14T11:17:17.704 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.707+0000 7fe125ff88c0 1 < completed multipart upload key=2LH5U05C2F8C upload=L6X1D9IVT83C tag=F1B1D63SMJLC type=write size=1315695 2024-09-14T11:17:17.708 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.707+0000 7fe125ff88c0 1 > prepared operation key=0FITHLGQKQEC tag=GDUI6WWZOZ1S type=del size=3787720 2024-09-14T11:17:17.716 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.715+0000 7fe125ff88c0 1 < suggested update operation key=46ZTDBWFVSUH tag=62LVK208Z5GF type=del size=1401798 2024-09-14T11:17:17.723 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.723+0000 7fe125ff88c0 1 > prepared operation key=FQ5WT12KB664 tag=6E7JMBS6ZHYO type=del size=644764 2024-09-14T11:17:17.728 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.727+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~01R7O4GGMQFS.0 size=1048576 2024-09-14T11:17:17.731 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.731+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~01R7O4GGMQFS.1 size=864834 2024-09-14T11:17:17.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.739+0000 7fe125ff88c0 1 < completed multipart upload key=2LH5U05C2F8C upload=01R7O4GGMQFS tag=RPYLQ2V1SGZ2 type=write size=2961986 2024-09-14T11:17:17.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.743+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~12YVBAIM7NAO.0 size=1048576 2024-09-14T11:17:17.747 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.747+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~12YVBAIM7NAO.1 size=1048576 2024-09-14T11:17:17.750 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.751+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~12YVBAIM7NAO.2 size=11476 2024-09-14T11:17:17.750 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.751+0000 7fe125ff88c0 1 > prepared multipart upload key=N80X3YUF4OEL upload=12YVBAIM7NAO tag=UIGMCVKPQIP0 type=write size=3157204 2024-09-14T11:17:17.754 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.755+0000 7fe125ff88c0 1 < completed delete operation key=2UXA6SXDTUFT tag=LJ5NHBD0EP16 type=del 2024-09-14T11:17:17.761 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.763+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~8O685R56HEJE.0 size=880847 2024-09-14T11:17:17.761 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.763+0000 7fe125ff88c0 1 > prepared multipart upload key=YN2HI39GPEDF upload=8O685R56HEJE tag=LX2RO5GQ4QJP type=write size=1929423 2024-09-14T11:17:17.768 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.771+0000 7fe125ff88c0 1 < suggested remove operation key=3YGN50MBAF41 tag=FI56CJU99BWS type=del 2024-09-14T11:17:17.772 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.771+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=3W7NXVIBRHRZ type=del size=908745 2024-09-14T11:17:17.776 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.775+0000 7fe125ff88c0 1 < completed part key=_multipart_2KEKSWK0UT6C.2~1QCMVJRYH3CT.0 size=1048576 2024-09-14T11:17:17.779 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.779+0000 7fe125ff88c0 1 < completed part key=_multipart_2KEKSWK0UT6C.2~1QCMVJRYH3CT.1 size=460947 2024-09-14T11:17:17.785 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.787+0000 7fe125ff88c0 1 < completed multipart upload key=2KEKSWK0UT6C upload=1QCMVJRYH3CT tag=2LP1F5PJZS8X type=write size=2558099 2024-09-14T11:17:17.791 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.791+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~FD33H9MEXLEO.0 size=1007834 2024-09-14T11:17:17.791 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.791+0000 7fe125ff88c0 1 > prepared multipart upload key=L4XO0WTYKNXY upload=FD33H9MEXLEO tag=W2JV4XRC5BBX type=write size=2056410 2024-09-14T11:17:17.795 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.795+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~MBJRG1JW8HP9.0 size=481296 2024-09-14T11:17:17.801 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.803+0000 7fe125ff88c0 1 < completed multipart upload key=4D2X7151977X upload=MBJRG1JW8HP9 tag=EV9LKN7PEQM0 type=write size=1529872 2024-09-14T11:17:17.805 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.807+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=915N4JPQFMT3 type=del size=1358694 2024-09-14T11:17:17.809 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.811+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~0T5SEIUAR0YA.0 size=1048576 2024-09-14T11:17:17.809 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.811+0000 7fe125ff88c0 1 < canceled part key=_multipart_1ML6RIXI4C5P.2~0T5SEIUAR0YA.1 size=1048576 2024-09-14T11:17:17.812 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.815+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~0T5SEIUAR0YA.2 size=1015215 2024-09-14T11:17:17.819 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.819+0000 7fe125ff88c0 1 < canceled multipart upload key=1ML6RIXI4C5P upload=0T5SEIUAR0YA tag=5KI5WU12EIND type=write size=4160943 2024-09-14T11:17:17.823 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.823+0000 7fe125ff88c0 1 > prepared operation key=LYBGDNKUROWH tag=WD31PUIJEQRL type=del size=1634440 2024-09-14T11:17:17.827 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.827+0000 7fe125ff88c0 1 < completed delete operation key=3OU4U9JF3ZD5 tag=L27OMTZFA1A6 type=del 2024-09-14T11:17:17.831 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.831+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=H69ZZVB2VO45 type=write size=901030 2024-09-14T11:17:17.835 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.835+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~N0GN6OK8S9YI.0 size=169983 2024-09-14T11:17:17.841 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.843+0000 7fe125ff88c0 1 < completed multipart upload key=K05LARTJ2QZ3 upload=N0GN6OK8S9YI tag=R102E7TRU07T type=write size=1218559 2024-09-14T11:17:17.845 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.847+0000 7fe125ff88c0 1 > prepared operation key=N80X3YUF4OEL tag=S47K25VY9DLI type=del size=987971 2024-09-14T11:17:17.852 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.855+0000 7fe125ff88c0 1 < suggested update operation key=L4XO0WTYKNXY tag=VB3F8OUPLRFB type=del size=4047248 2024-09-14T11:17:17.856 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.855+0000 7fe125ff88c0 1 > prepared operation key=FQ5WT12KB664 tag=RQZ030F88EE3 type=write size=883423 2024-09-14T11:17:17.860 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.859+0000 7fe125ff88c0 1 < canceled operation key=ESVFZQQXE3GT tag=BTH2P65LQSFE type=del size=1797349 2024-09-14T11:17:17.864 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.863+0000 7fe125ff88c0 1 > prepared operation key=LYBGDNKUROWH tag=PE4SCNF69S1V type=del size=781318 2024-09-14T11:17:17.868 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.867+0000 7fe125ff88c0 1 < completed delete operation key=0VBX2FWYCFEZ tag=05IV58FRVLX6 type=del 2024-09-14T11:17:17.871 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.871+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=TY7K95FAVA8V type=del size=951206 2024-09-14T11:17:17.875 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.875+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~DMXIIESWD3EU.0 size=341210 2024-09-14T11:17:17.882 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.883+0000 7fe125ff88c0 1 < completed multipart upload key=ESVFZQQXE3GT upload=DMXIIESWD3EU tag=BCD3TZ6ABDL7 type=write size=1389786 2024-09-14T11:17:17.889 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.891+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~VIK3E5CPIFCF.0 size=314539 2024-09-14T11:17:17.889 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.891+0000 7fe125ff88c0 1 > prepared multipart upload key=F9I82N7RQC81 upload=VIK3E5CPIFCF tag=VK1EAKX68XP3 type=write size=1363115 2024-09-14T11:17:17.892 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.895+0000 7fe125ff88c0 1 < completed delete operation key=2KEKSWK0UT6C tag=PKC2I4B4R71T type=del 2024-09-14T11:17:17.896 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.895+0000 7fe125ff88c0 1 > prepared operation key=6C3JZKTB8BP3 tag=3EZ61X7RH6O0 type=del size=657244 2024-09-14T11:17:17.901 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.903+0000 7fe125ff88c0 1 < completed delete operation key=6C3JZKTB8BP3 tag=5514ORVUKT4B type=del 2024-09-14T11:17:17.904 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.903+0000 7fe125ff88c0 1 > prepared operation key=1ML6RIXI4C5P tag=75RHXK3P3EJR type=del size=1549287 2024-09-14T11:17:17.909 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.911+0000 7fe125ff88c0 1 < canceled operation key=0FITHLGQKQEC tag=GDUI6WWZOZ1S type=del size=3787720 2024-09-14T11:17:17.912 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.915+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=C7ZHHGATCVTE type=del size=2248154 2024-09-14T11:17:17.916 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.915+0000 7fe125ff88c0 1 < completed delete operation key=FQ5WT12KB664 tag=6E7JMBS6ZHYO type=del 2024-09-14T11:17:17.920 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.919+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=VTNCV1Q6PQ13 type=del size=4034924 2024-09-14T11:17:17.923 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.923+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~12YVBAIM7NAO.0 size=1048576 2024-09-14T11:17:17.926 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.927+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~12YVBAIM7NAO.1 size=1048576 2024-09-14T11:17:17.929 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.931+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~12YVBAIM7NAO.2 size=11476 2024-09-14T11:17:17.935 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.935+0000 7fe125ff88c0 1 < completed multipart upload key=N80X3YUF4OEL upload=12YVBAIM7NAO tag=UIGMCVKPQIP0 type=write size=3157204 2024-09-14T11:17:17.942 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.943+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~NS7VBHSQ6H17.0 size=998610 2024-09-14T11:17:17.942 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.943+0000 7fe125ff88c0 1 > prepared multipart upload key=35EB6U5O4A51 upload=NS7VBHSQ6H17 tag=T73I0YI41ZMF type=write size=2047186 2024-09-14T11:17:17.946 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.947+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~8O685R56HEJE.0 size=880847 2024-09-14T11:17:17.952 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.951+0000 7fe125ff88c0 1 < completed multipart upload key=YN2HI39GPEDF upload=8O685R56HEJE tag=LX2RO5GQ4QJP type=write size=1929423 2024-09-14T11:17:17.959 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.959+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~PD93V9GK6GLD.0 size=1048576 2024-09-14T11:17:17.962 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.963+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~PD93V9GK6GLD.1 size=1048576 2024-09-14T11:17:17.965 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.967+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~PD93V9GK6GLD.2 size=274441 2024-09-14T11:17:17.965 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.967+0000 7fe125ff88c0 1 > prepared multipart upload key=3YGN50MBAF41 upload=PD93V9GK6GLD tag=NCI07EQ2M8ZI type=write size=3420169 2024-09-14T11:17:17.973 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.975+0000 7fe125ff88c0 1 < suggested update operation key=6PLUU2QIO9LJ tag=3W7NXVIBRHRZ type=del size=908745 2024-09-14T11:17:17.979 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.979+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~9YI81YHTU85K.0 size=1048576 2024-09-14T11:17:17.983 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.983+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~9YI81YHTU85K.1 size=829044 2024-09-14T11:17:17.983 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.983+0000 7fe125ff88c0 1 > prepared multipart upload key=SSNV25PDLDIS upload=9YI81YHTU85K tag=64ELESZDCFB5 type=write size=2926196 2024-09-14T11:17:17.986 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.987+0000 7fe125ff88c0 1 < completed part key=_multipart_L4XO0WTYKNXY.2~FD33H9MEXLEO.0 size=1007834 2024-09-14T11:17:17.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.995+0000 7fe125ff88c0 1 < completed multipart upload key=L4XO0WTYKNXY upload=FD33H9MEXLEO tag=W2JV4XRC5BBX type=write size=2056410 2024-09-14T11:17:17.996 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.999+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=LHXMTJY6G27N type=write size=842047 2024-09-14T11:17:18.000 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:17.999+0000 7fe125ff88c0 -1 < failed to complete operation key=6PLUU2QIO9LJ tag=915N4JPQFMT3 type=del size=1358694: (22) Invalid argument 2024-09-14T11:17:18.007 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.007+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~VIEARYAMIO5F.0 size=1048576 2024-09-14T11:17:18.010 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.011+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~VIEARYAMIO5F.1 size=1048576 2024-09-14T11:17:18.013 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.015+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~VIEARYAMIO5F.2 size=690798 2024-09-14T11:17:18.013 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.015+0000 7fe125ff88c0 1 > prepared multipart upload key=K3P6U6NU8I01 upload=VIEARYAMIO5F tag=KM1AMNVEAUUA type=write size=3836526 2024-09-14T11:17:18.016 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.019+0000 7fe125ff88c0 1 < completed delete operation key=LYBGDNKUROWH tag=WD31PUIJEQRL type=del 2024-09-14T11:17:18.023 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.023+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~66HRYH3WHKBD.0 size=1007349 2024-09-14T11:17:18.024 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.023+0000 7fe125ff88c0 1 > prepared multipart upload key=46ZTDBWFVSUH upload=66HRYH3WHKBD tag=BMPL0WW6I2TF type=write size=2055925 2024-09-14T11:17:18.031 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.031+0000 7fe125ff88c0 1 < suggested remove operation key=W0B19NBHNLMZ tag=H69ZZVB2VO45 type=write 2024-09-14T11:17:18.035 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.035+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=GKL3N6G7VFTT type=del size=4013961 2024-09-14T11:17:18.040 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.039+0000 7fe125ff88c0 1 < completed delete operation key=N80X3YUF4OEL tag=S47K25VY9DLI type=del 2024-09-14T11:17:18.044 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.043+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=G331KR1S1F16 type=del size=887624 2024-09-14T11:17:18.048 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.047+0000 7fe125ff88c0 1 < completed write operation key=FQ5WT12KB664 tag=RQZ030F88EE3 type=write size=883423 2024-09-14T11:17:18.054 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.055+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~3WT0Z4HI37ZR.0 size=1048576 2024-09-14T11:17:18.057 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.059+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~3WT0Z4HI37ZR.1 size=474190 2024-09-14T11:17:18.057 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.059+0000 7fe125ff88c0 1 > prepared multipart upload key=4D2X7151977X upload=3WT0Z4HI37ZR tag=2WUHWB93ZOWH type=write size=2571342 2024-09-14T11:17:18.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.063+0000 7fe125ff88c0 1 < completed delete operation key=LYBGDNKUROWH tag=PE4SCNF69S1V type=del 2024-09-14T11:17:18.068 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.067+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~HZAUNPI9S36R.0 size=1048576 2024-09-14T11:17:18.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.071+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~HZAUNPI9S36R.1 size=1048576 2024-09-14T11:17:18.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.079+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~HZAUNPI9S36R.2 size=1005668 2024-09-14T11:17:18.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.079+0000 7fe125ff88c0 1 > prepared multipart upload key=6C3JZKTB8BP3 upload=HZAUNPI9S36R tag=8A3POKBWN47M type=write size=4151396 2024-09-14T11:17:18.082 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.083+0000 7fe125ff88c0 1 < completed delete operation key=YN2HI39GPEDF tag=TY7K95FAVA8V type=del 2024-09-14T11:17:18.089 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.091+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~3D8D50LESLX7.0 size=1048576 2024-09-14T11:17:18.091 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.091+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~3D8D50LESLX7.1 size=795064 2024-09-14T11:17:18.092 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.091+0000 7fe125ff88c0 1 > prepared multipart upload key=0VBX2FWYCFEZ upload=3D8D50LESLX7 tag=LNOPJ08OSQ6Y type=write size=2892216 2024-09-14T11:17:18.095 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.095+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~VIK3E5CPIFCF.0 size=314539 2024-09-14T11:17:18.101 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.103+0000 7fe125ff88c0 1 < completed multipart upload key=F9I82N7RQC81 upload=VIK3E5CPIFCF tag=VK1EAKX68XP3 type=write size=1363115 2024-09-14T11:17:18.105 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.107+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=J6X02UH8G6LT type=write size=550165 2024-09-14T11:17:18.112 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.111+0000 7fe125ff88c0 1 < suggested remove operation key=6C3JZKTB8BP3 tag=3EZ61X7RH6O0 type=del 2024-09-14T11:17:18.118 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.119+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~D9ABA9FUTIQR.0 size=23876 2024-09-14T11:17:18.119 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.119+0000 7fe125ff88c0 1 > prepared multipart upload key=SSNV25PDLDIS upload=D9ABA9FUTIQR tag=UN97541PRN41 type=write size=1072452 2024-09-14T11:17:18.123 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.123+0000 7fe125ff88c0 1 < canceled operation key=1ML6RIXI4C5P tag=75RHXK3P3EJR type=del size=1549287 2024-09-14T11:17:18.127 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.127+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=5IWRXCFV2KQW type=del size=335423 2024-09-14T11:17:18.131 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.131+0000 7fe125ff88c0 1 < completed delete operation key=WEA3MQ0DI42N tag=C7ZHHGATCVTE type=del 2024-09-14T11:17:18.135 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.135+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=2QDHL0R7LRJO type=del size=1226110 2024-09-14T11:17:18.139 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.139+0000 7fe125ff88c0 1 < completed delete operation key=N94D3R7IOBNL tag=VTNCV1Q6PQ13 type=del 2024-09-14T11:17:18.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.143+0000 7fe125ff88c0 1 > prepared operation key=0FITHLGQKQEC tag=PDU06K205U7A type=del size=915947 2024-09-14T11:17:18.147 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.147+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~NS7VBHSQ6H17.0 size=998610 2024-09-14T11:17:18.154 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.155+0000 7fe125ff88c0 1 < completed multipart upload key=35EB6U5O4A51 upload=NS7VBHSQ6H17 tag=T73I0YI41ZMF type=write size=2047186 2024-09-14T11:17:18.159 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.159+0000 7fe125ff88c0 1 > prepared part key=_multipart_WEA3MQ0DI42N.2~SHLJLJION22E.0 size=508093 2024-09-14T11:17:18.159 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.159+0000 7fe125ff88c0 1 > prepared multipart upload key=WEA3MQ0DI42N upload=SHLJLJION22E tag=WBZEZFL3OSDH type=write size=1556669 2024-09-14T11:17:18.163 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.163+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~PD93V9GK6GLD.0 size=1048576 2024-09-14T11:17:18.163 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.163+0000 7fe125ff88c0 1 < canceled part key=_multipart_3YGN50MBAF41.2~PD93V9GK6GLD.1 size=1048576 2024-09-14T11:17:18.166 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.167+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~PD93V9GK6GLD.2 size=274441 2024-09-14T11:17:18.171 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.171+0000 7fe125ff88c0 1 < canceled multipart upload key=3YGN50MBAF41 upload=PD93V9GK6GLD tag=NCI07EQ2M8ZI type=write size=3420169 2024-09-14T11:17:18.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.175+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=K8Q939DXHGLG type=del size=2227096 2024-09-14T11:17:18.179 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.179+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~9YI81YHTU85K.0 size=1048576 2024-09-14T11:17:18.182 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.183+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~9YI81YHTU85K.1 size=829044 2024-09-14T11:17:18.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.187+0000 7fe125ff88c0 1 < completed multipart upload key=SSNV25PDLDIS upload=9YI81YHTU85K tag=64ELESZDCFB5 type=write size=2926196 2024-09-14T11:17:18.194 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.195+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~XPSW2W53EP71.0 size=1048576 2024-09-14T11:17:18.197 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.199+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~XPSW2W53EP71.1 size=1048576 2024-09-14T11:17:18.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.199+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~XPSW2W53EP71.2 size=90911 2024-09-14T11:17:18.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.199+0000 7fe125ff88c0 1 > prepared multipart upload key=YGEVGH840L18 upload=XPSW2W53EP71 tag=KD12GBF25S26 type=write size=3236639 2024-09-14T11:17:18.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.207+0000 7fe125ff88c0 1 < suggested remove operation key=2LH5U05C2F8C tag=LHXMTJY6G27N type=write 2024-09-14T11:17:18.211 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.211+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=NOJKE754K1FH type=del size=3521855 2024-09-14T11:17:18.215 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.215+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~VIEARYAMIO5F.0 size=1048576 2024-09-14T11:17:18.218 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.219+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~VIEARYAMIO5F.1 size=1048576 2024-09-14T11:17:18.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.219+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~VIEARYAMIO5F.2 size=690798 2024-09-14T11:17:18.225 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.227+0000 7fe125ff88c0 1 < completed multipart upload key=K3P6U6NU8I01 upload=VIEARYAMIO5F tag=KM1AMNVEAUUA type=write size=3836526 2024-09-14T11:17:18.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.227+0000 7fe125ff88c0 1 > prepared operation key=YFRH8WECBTJK tag=HFZ3LL4WEZV7 type=del size=3598492 2024-09-14T11:17:18.232 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.231+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~66HRYH3WHKBD.0 size=1007349 2024-09-14T11:17:18.238 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.239+0000 7fe125ff88c0 1 < completed multipart upload key=46ZTDBWFVSUH upload=66HRYH3WHKBD tag=BMPL0WW6I2TF type=write size=2055925 2024-09-14T11:17:18.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.246+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~0C8W949Y0OTL.0 size=1048576 2024-09-14T11:17:18.248 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.246+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~0C8W949Y0OTL.1 size=1048576 2024-09-14T11:17:18.251 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.250+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~0C8W949Y0OTL.2 size=77036 2024-09-14T11:17:18.251 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.250+0000 7fe125ff88c0 1 > prepared multipart upload key=K05LARTJ2QZ3 upload=0C8W949Y0OTL tag=TKH2JRUR5VHJ type=write size=3222764 2024-09-14T11:17:18.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.254+0000 7fe125ff88c0 1 < completed delete operation key=0VBX2FWYCFEZ tag=GKL3N6G7VFTT type=del 2024-09-14T11:17:18.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.258+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=R5F1W7DJ6P6J type=del size=3741742 2024-09-14T11:17:18.268 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.266+0000 7fe125ff88c0 1 < suggested remove operation key=L4XO0WTYKNXY tag=G331KR1S1F16 type=del 2024-09-14T11:17:18.272 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.270+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=EW515Y8JRHCJ type=del size=525929 2024-09-14T11:17:18.275 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.274+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~3WT0Z4HI37ZR.0 size=1048576 2024-09-14T11:17:18.278 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.278+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~3WT0Z4HI37ZR.1 size=474190 2024-09-14T11:17:18.284 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.282+0000 7fe125ff88c0 1 < completed multipart upload key=4D2X7151977X upload=3WT0Z4HI37ZR tag=2WUHWB93ZOWH type=write size=2571342 2024-09-14T11:17:18.287 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.286+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=2SQ5774JGLXJ type=del size=810163 2024-09-14T11:17:18.288 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.290+0000 7fe125ff88c0 1 < canceled part key=_multipart_6C3JZKTB8BP3.2~HZAUNPI9S36R.0 size=1048576 2024-09-14T11:17:18.291 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.290+0000 7fe125ff88c0 1 < completed part key=_multipart_6C3JZKTB8BP3.2~HZAUNPI9S36R.1 size=1048576 2024-09-14T11:17:18.294 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.294+0000 7fe125ff88c0 1 < completed part key=_multipart_6C3JZKTB8BP3.2~HZAUNPI9S36R.2 size=1005668 2024-09-14T11:17:18.301 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.302+0000 7fe125ff88c0 1 < canceled multipart upload key=6C3JZKTB8BP3 upload=HZAUNPI9S36R tag=8A3POKBWN47M type=write size=4151396 2024-09-14T11:17:18.308 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.306+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~VOJYJDJEQCE5.0 size=1042795 2024-09-14T11:17:18.308 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.306+0000 7fe125ff88c0 1 > prepared multipart upload key=V6B470G93KFT upload=VOJYJDJEQCE5 tag=1ACG604HLFCD type=write size=2091371 2024-09-14T11:17:18.311 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.310+0000 7fe125ff88c0 1 < completed part key=_multipart_0VBX2FWYCFEZ.2~3D8D50LESLX7.0 size=1048576 2024-09-14T11:17:18.314 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.314+0000 7fe125ff88c0 1 < completed part key=_multipart_0VBX2FWYCFEZ.2~3D8D50LESLX7.1 size=795064 2024-09-14T11:17:18.323 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.322+0000 7fe125ff88c0 1 < completed multipart upload key=0VBX2FWYCFEZ upload=3D8D50LESLX7 tag=LNOPJ08OSQ6Y type=write size=2892216 2024-09-14T11:17:18.328 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.326+0000 7fe125ff88c0 1 > prepared operation key=6C3JZKTB8BP3 tag=WLHCYDKAJ56Z type=write size=871412 2024-09-14T11:17:18.332 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.330+0000 7fe125ff88c0 1 < canceled operation key=K3P6U6NU8I01 tag=J6X02UH8G6LT type=write size=550165 2024-09-14T11:17:18.335 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.334+0000 7fe125ff88c0 1 > prepared operation key=FQ5WT12KB664 tag=2C8OS8HX0GH8 type=write size=572481 2024-09-14T11:17:18.338 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.338+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~D9ABA9FUTIQR.0 size=23876 2024-09-14T11:17:18.343 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.342+0000 7fe125ff88c0 1 < completed multipart upload key=SSNV25PDLDIS upload=D9ABA9FUTIQR tag=UN97541PRN41 type=write size=1072452 2024-09-14T11:17:18.347 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.346+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=9GIL00PYI23F type=del size=588735 2024-09-14T11:17:18.351 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.350+0000 7fe125ff88c0 1 < completed delete operation key=0VBX2FWYCFEZ tag=5IWRXCFV2KQW type=del 2024-09-14T11:17:18.358 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.358+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~FO0OJQ98KI4Q.0 size=628869 2024-09-14T11:17:18.358 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.358+0000 7fe125ff88c0 1 > prepared multipart upload key=35EB6U5O4A51 upload=FO0OJQ98KI4Q tag=AHUPP6TF7256 type=write size=1677445 2024-09-14T11:17:18.362 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.362+0000 7fe125ff88c0 1 < completed delete operation key=2UXA6SXDTUFT tag=2QDHL0R7LRJO type=del 2024-09-14T11:17:18.365 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.366+0000 7fe125ff88c0 1 > prepared operation key=SUCH37O8V1LY tag=GFAT0QHD3VKV type=del size=1049701 2024-09-14T11:17:18.368 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.370+0000 7fe125ff88c0 1 < canceled operation key=0FITHLGQKQEC tag=PDU06K205U7A type=del size=915947 2024-09-14T11:17:18.375 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.374+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~IADGVU3WMDHD.0 size=849545 2024-09-14T11:17:18.375 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.374+0000 7fe125ff88c0 1 > prepared multipart upload key=2LH5U05C2F8C upload=IADGVU3WMDHD tag=S31DUBNY7TV6 type=write size=1898121 2024-09-14T11:17:18.379 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.378+0000 7fe125ff88c0 1 < completed part key=_multipart_WEA3MQ0DI42N.2~SHLJLJION22E.0 size=508093 2024-09-14T11:17:18.384 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.382+0000 7fe125ff88c0 1 < completed multipart upload key=WEA3MQ0DI42N upload=SHLJLJION22E tag=WBZEZFL3OSDH type=write size=1556669 2024-09-14T11:17:18.387 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.386+0000 7fe125ff88c0 1 > prepared operation key=1ML6RIXI4C5P tag=V41HDQYQRH7Y type=del size=2121905 2024-09-14T11:17:18.390 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.390+0000 7fe125ff88c0 1 < canceled operation key=35EB6U5O4A51 tag=K8Q939DXHGLG type=del size=2227096 2024-09-14T11:17:18.396 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.394+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~U3QWG3EO3VIU.0 size=1048576 2024-09-14T11:17:18.398 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.398+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~U3QWG3EO3VIU.1 size=1048576 2024-09-14T11:17:18.401 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.402+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~U3QWG3EO3VIU.2 size=792515 2024-09-14T11:17:18.401 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.402+0000 7fe125ff88c0 1 > prepared multipart upload key=YN2HI39GPEDF upload=U3QWG3EO3VIU tag=7447K240U6P3 type=write size=3938243 2024-09-14T11:17:18.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.402+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~XPSW2W53EP71.0 size=1048576 2024-09-14T11:17:18.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.406+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~XPSW2W53EP71.1 size=1048576 2024-09-14T11:17:18.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.410+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~XPSW2W53EP71.2 size=90911 2024-09-14T11:17:18.416 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.418+0000 7fe125ff88c0 1 < completed multipart upload key=YGEVGH840L18 upload=XPSW2W53EP71 tag=KD12GBF25S26 type=write size=3236639 2024-09-14T11:17:18.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.418+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=WM5SSQ2ONCNC type=del size=1209491 2024-09-14T11:17:18.422 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.422+0000 7fe125ff88c0 1 < canceled operation key=2LH5U05C2F8C tag=NOJKE754K1FH type=del size=3521855 2024-09-14T11:17:18.426 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.426+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=M5AF9Y4E8RIG type=del size=3426155 2024-09-14T11:17:18.432 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.430+0000 7fe125ff88c0 1 < suggested update operation key=YFRH8WECBTJK tag=HFZ3LL4WEZV7 type=del size=3598492 2024-09-14T11:17:18.435 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.434+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=DZO7TYV9W9XM type=del size=250592 2024-09-14T11:17:18.438 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.438+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~0C8W949Y0OTL.0 size=1048576 2024-09-14T11:17:18.440 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.442+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~0C8W949Y0OTL.1 size=1048576 2024-09-14T11:17:18.440 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.442+0000 7fe125ff88c0 1 < canceled part key=_multipart_K05LARTJ2QZ3.2~0C8W949Y0OTL.2 size=77036 2024-09-14T11:17:18.446 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.446+0000 7fe125ff88c0 1 < canceled multipart upload key=K05LARTJ2QZ3 upload=0C8W949Y0OTL tag=TKH2JRUR5VHJ type=write size=3222764 2024-09-14T11:17:18.452 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.450+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~N1HD928JC5QP.0 size=831626 2024-09-14T11:17:18.452 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.450+0000 7fe125ff88c0 1 > prepared multipart upload key=YCF2PCJ9TZMR upload=N1HD928JC5QP tag=VREX8H8T4ZSO type=write size=1880202 2024-09-14T11:17:18.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.454+0000 7fe125ff88c0 1 < completed delete operation key=35EB6U5O4A51 tag=R5F1W7DJ6P6J type=del 2024-09-14T11:17:18.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.458+0000 7fe125ff88c0 1 > prepared operation key=1ML6RIXI4C5P tag=956956GE09D3 type=del size=2747270 2024-09-14T11:17:18.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.462+0000 7fe125ff88c0 1 < canceled operation key=21HC4VMHXS6L tag=EW515Y8JRHCJ type=del size=525929 2024-09-14T11:17:18.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.466+0000 7fe125ff88c0 1 > prepared operation key=1ML6RIXI4C5P tag=R23F40IPEGM6 type=write size=930300 2024-09-14T11:17:18.470 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.470+0000 7fe125ff88c0 1 < completed delete operation key=N94D3R7IOBNL tag=2SQ5774JGLXJ type=del 2024-09-14T11:17:18.475 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.474+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~EJC4WLFAKX4N.0 size=322412 2024-09-14T11:17:18.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.474+0000 7fe125ff88c0 1 > prepared multipart upload key=YN2HI39GPEDF upload=EJC4WLFAKX4N tag=H25E37RPDOX1 type=write size=1370988 2024-09-14T11:17:18.479 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.478+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~VOJYJDJEQCE5.0 size=1042795 2024-09-14T11:17:18.484 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.486+0000 7fe125ff88c0 1 < completed multipart upload key=V6B470G93KFT upload=VOJYJDJEQCE5 tag=1ACG604HLFCD type=write size=2091371 2024-09-14T11:17:18.488 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.486+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=T2WJLD6NAREP type=write size=530290 2024-09-14T11:17:18.491 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.490+0000 7fe125ff88c0 1 < completed write operation key=6C3JZKTB8BP3 tag=WLHCYDKAJ56Z type=write size=871412 2024-09-14T11:17:18.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.494+0000 7fe125ff88c0 1 > prepared operation key=3YGN50MBAF41 tag=KPMX8V6D153A type=del size=4095332 2024-09-14T11:17:18.497 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.498+0000 7fe125ff88c0 1 < completed write operation key=FQ5WT12KB664 tag=2C8OS8HX0GH8 type=write size=572481 2024-09-14T11:17:18.500 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.498+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=O62SASJX3ISS type=del size=4131794 2024-09-14T11:17:18.507 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.506+0000 7fe125ff88c0 1 < suggested update operation key=0VBX2FWYCFEZ tag=9GIL00PYI23F type=del size=588735 2024-09-14T11:17:18.511 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.510+0000 7fe125ff88c0 1 > prepared operation key=FQ5WT12KB664 tag=UCJKLYCFGUIE type=write size=919628 2024-09-14T11:17:18.515 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.514+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~FO0OJQ98KI4Q.0 size=628869 2024-09-14T11:17:18.521 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.522+0000 7fe125ff88c0 1 < completed multipart upload key=35EB6U5O4A51 upload=FO0OJQ98KI4Q tag=AHUPP6TF7256 type=write size=1677445 2024-09-14T11:17:18.524 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.526+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=HKPAB6OJWWY3 type=write size=144005 2024-09-14T11:17:18.528 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.526+0000 7fe125ff88c0 1 < completed delete operation key=SUCH37O8V1LY tag=GFAT0QHD3VKV type=del 2024-09-14T11:17:18.535 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.534+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~A45VC2Q0HBNW.0 size=1048576 2024-09-14T11:17:18.538 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.538+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~A45VC2Q0HBNW.1 size=269010 2024-09-14T11:17:18.538 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.538+0000 7fe125ff88c0 1 > prepared multipart upload key=YN2HI39GPEDF upload=A45VC2Q0HBNW tag=X9ENHLJJQOIT type=write size=2366162 2024-09-14T11:17:18.542 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.542+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~IADGVU3WMDHD.0 size=849545 2024-09-14T11:17:18.548 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.546+0000 7fe125ff88c0 1 < completed multipart upload key=2LH5U05C2F8C upload=IADGVU3WMDHD tag=S31DUBNY7TV6 type=write size=1898121 2024-09-14T11:17:18.552 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.550+0000 7fe125ff88c0 1 > prepared operation key=0FITHLGQKQEC tag=X2PTMRS4KSGW type=del size=3685467 2024-09-14T11:17:18.561 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.562+0000 7fe125ff88c0 1 < suggested update operation key=1ML6RIXI4C5P tag=V41HDQYQRH7Y type=del size=2121905 2024-09-14T11:17:18.565 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.566+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=QDY8CUF45TLO type=del size=2201234 2024-09-14T11:17:18.569 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.570+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~U3QWG3EO3VIU.0 size=1048576 2024-09-14T11:17:18.572 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.574+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~U3QWG3EO3VIU.1 size=1048576 2024-09-14T11:17:18.575 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.574+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~U3QWG3EO3VIU.2 size=792515 2024-09-14T11:17:18.581 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.582+0000 7fe125ff88c0 1 < completed multipart upload key=YN2HI39GPEDF upload=U3QWG3EO3VIU tag=7447K240U6P3 type=write size=3938243 2024-09-14T11:17:18.588 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.586+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~SKP2I870GN73.0 size=1048576 2024-09-14T11:17:18.592 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.590+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~SKP2I870GN73.1 size=717322 2024-09-14T11:17:18.592 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.590+0000 7fe125ff88c0 1 > prepared multipart upload key=YGEVGH840L18 upload=SKP2I870GN73 tag=AHZQ1RUJXAH2 type=write size=2814474 2024-09-14T11:17:18.595 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.594+0000 7fe125ff88c0 1 < completed delete operation key=2UXA6SXDTUFT tag=WM5SSQ2ONCNC type=del 2024-09-14T11:17:18.599 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.598+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=QKPHFUVOQGDK type=del size=2513230 2024-09-14T11:17:18.603 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.602+0000 7fe125ff88c0 1 < canceled operation key=2LH5U05C2F8C tag=M5AF9Y4E8RIG type=del size=3426155 2024-09-14T11:17:18.610 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.610+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~1V0RL5H96YBF.0 size=265831 2024-09-14T11:17:18.610 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.610+0000 7fe125ff88c0 1 > prepared multipart upload key=SUCH37O8V1LY upload=1V0RL5H96YBF tag=ZHEILTRC9UXJ type=write size=1314407 2024-09-14T11:17:18.613 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.614+0000 7fe125ff88c0 -1 < failed to complete operation key=0VBX2FWYCFEZ tag=DZO7TYV9W9XM type=del size=250592: (22) Invalid argument 2024-09-14T11:17:18.620 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.618+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~B1CK5DTA5AJ2.0 size=1048576 2024-09-14T11:17:18.623 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.622+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~B1CK5DTA5AJ2.1 size=542250 2024-09-14T11:17:18.623 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.622+0000 7fe125ff88c0 1 > prepared multipart upload key=2UXA6SXDTUFT upload=B1CK5DTA5AJ2 tag=Q88EKQ9JDGNZ type=write size=2639402 2024-09-14T11:17:18.626 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.626+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~N1HD928JC5QP.0 size=831626 2024-09-14T11:17:18.632 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.630+0000 7fe125ff88c0 1 < completed multipart upload key=YCF2PCJ9TZMR upload=N1HD928JC5QP tag=VREX8H8T4ZSO type=write size=1880202 2024-09-14T11:17:18.640 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.642+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~DD83JXMT39TD.0 size=1037393 2024-09-14T11:17:18.640 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.642+0000 7fe125ff88c0 1 > prepared multipart upload key=K3P6U6NU8I01 upload=DD83JXMT39TD tag=24UKVVDP6AW2 type=write size=2085969 2024-09-14T11:17:18.644 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.646+0000 7fe125ff88c0 -1 < failed to complete operation key=1ML6RIXI4C5P tag=956956GE09D3 type=del size=2747270: (22) Invalid argument 2024-09-14T11:17:18.649 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.650+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=6LI8YT7NOO9O type=del size=1266220 2024-09-14T11:17:18.653 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.654+0000 7fe125ff88c0 -1 < failed to complete operation key=1ML6RIXI4C5P tag=R23F40IPEGM6 type=write size=930300: (22) Invalid argument 2024-09-14T11:17:18.657 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.658+0000 7fe125ff88c0 1 > prepared operation key=YFRH8WECBTJK tag=LCXQATTNW3TJ type=del size=977032 2024-09-14T11:17:18.661 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.662+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~EJC4WLFAKX4N.0 size=322412 2024-09-14T11:17:18.667 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.666+0000 7fe125ff88c0 1 < completed multipart upload key=YN2HI39GPEDF upload=EJC4WLFAKX4N tag=H25E37RPDOX1 type=write size=1370988 2024-09-14T11:17:18.673 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.674+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~UPKG1MT3OHGX.0 size=3472 2024-09-14T11:17:18.673 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.674+0000 7fe125ff88c0 1 > prepared multipart upload key=0FITHLGQKQEC upload=UPKG1MT3OHGX tag=O9FP5JZSUXK7 type=write size=1052048 2024-09-14T11:17:18.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.678+0000 7fe125ff88c0 1 < completed write operation key=WEA3MQ0DI42N tag=T2WJLD6NAREP type=write size=530290 2024-09-14T11:17:18.681 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.682+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=AHVVECZZ3Y84 type=del size=3943775 2024-09-14T11:17:18.688 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.686+0000 7fe125ff88c0 1 < suggested remove operation key=3YGN50MBAF41 tag=KPMX8V6D153A type=del 2024-09-14T11:17:18.694 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.694+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~QR9NIHH6ENKG.0 size=166794 2024-09-14T11:17:18.694 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.694+0000 7fe125ff88c0 1 > prepared multipart upload key=L4XO0WTYKNXY upload=QR9NIHH6ENKG tag=8HIJH1J83WYB type=write size=1215370 2024-09-14T11:17:18.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.698+0000 7fe125ff88c0 1 < completed delete operation key=ESVFZQQXE3GT tag=O62SASJX3ISS type=del 2024-09-14T11:17:18.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.702+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=FLFKD1P7OPQI type=del size=68836 2024-09-14T11:17:18.710 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.710+0000 7fe125ff88c0 1 < suggested remove operation key=FQ5WT12KB664 tag=UCJKLYCFGUIE type=write 2024-09-14T11:17:18.713 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.714+0000 7fe125ff88c0 1 > prepared operation key=YFRH8WECBTJK tag=U5SNV93K4F3N type=del size=1195323 2024-09-14T11:17:18.717 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.718+0000 7fe125ff88c0 1 < completed write operation key=ESVFZQQXE3GT tag=HKPAB6OJWWY3 type=write size=144005 2024-09-14T11:17:18.721 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.722+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=X6M6QA2N330L type=del size=2548007 2024-09-14T11:17:18.725 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.726+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~A45VC2Q0HBNW.0 size=1048576 2024-09-14T11:17:18.728 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.726+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~A45VC2Q0HBNW.1 size=269010 2024-09-14T11:17:18.734 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.734+0000 7fe125ff88c0 1 < completed multipart upload key=YN2HI39GPEDF upload=A45VC2Q0HBNW tag=X9ENHLJJQOIT type=write size=2366162 2024-09-14T11:17:18.741 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.742+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~YXQVU886CXOE.0 size=479194 2024-09-14T11:17:18.741 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.742+0000 7fe125ff88c0 1 > prepared multipart upload key=YN2HI39GPEDF upload=YXQVU886CXOE tag=1EGQ3577GQ3Q type=write size=1527770 2024-09-14T11:17:18.745 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.746+0000 7fe125ff88c0 1 < completed delete operation key=0FITHLGQKQEC tag=X2PTMRS4KSGW type=del 2024-09-14T11:17:18.749 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.750+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=GPIFUED4TGBO type=del size=1435545 2024-09-14T11:17:18.761 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.762+0000 7fe125ff88c0 1 < suggested update operation key=WEA3MQ0DI42N tag=QDY8CUF45TLO type=del size=2201234 2024-09-14T11:17:18.768 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.766+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~V7WMYBGE6CK1.0 size=640416 2024-09-14T11:17:18.768 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.766+0000 7fe125ff88c0 1 > prepared multipart upload key=ESVFZQQXE3GT upload=V7WMYBGE6CK1 tag=V384JI5UZQ05 type=write size=1688992 2024-09-14T11:17:18.772 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.770+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~SKP2I870GN73.0 size=1048576 2024-09-14T11:17:18.775 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.774+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~SKP2I870GN73.1 size=717322 2024-09-14T11:17:18.782 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.782+0000 7fe125ff88c0 1 < completed multipart upload key=YGEVGH840L18 upload=SKP2I870GN73 tag=AHZQ1RUJXAH2 type=write size=2814474 2024-09-14T11:17:18.785 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.786+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=MSBHTC12O0RP type=del size=3299190 2024-09-14T11:17:18.789 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.790+0000 7fe125ff88c0 1 < completed delete operation key=YGEVGH840L18 tag=QKPHFUVOQGDK type=del 2024-09-14T11:17:18.793 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.794+0000 7fe125ff88c0 1 > prepared operation key=FQ5WT12KB664 tag=EAT4Y7OMO0WA type=del size=3437228 2024-09-14T11:17:18.797 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.798+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~1V0RL5H96YBF.0 size=265831 2024-09-14T11:17:18.803 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.802+0000 7fe125ff88c0 1 < completed multipart upload key=SUCH37O8V1LY upload=1V0RL5H96YBF tag=ZHEILTRC9UXJ type=write size=1314407 2024-09-14T11:17:18.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.806+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=I0BCD1EU29JV type=del size=2665950 2024-09-14T11:17:18.811 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.810+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~B1CK5DTA5AJ2.0 size=1048576 2024-09-14T11:17:18.814 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.814+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~B1CK5DTA5AJ2.1 size=542250 2024-09-14T11:17:18.820 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.818+0000 7fe125ff88c0 1 < completed multipart upload key=2UXA6SXDTUFT upload=B1CK5DTA5AJ2 tag=Q88EKQ9JDGNZ type=write size=2639402 2024-09-14T11:17:18.827 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.826+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~M27147SLT35Z.0 size=1048576 2024-09-14T11:17:18.830 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.830+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~M27147SLT35Z.1 size=1048576 2024-09-14T11:17:18.833 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.834+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~M27147SLT35Z.2 size=449819 2024-09-14T11:17:18.833 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.834+0000 7fe125ff88c0 1 > prepared multipart upload key=6C3JZKTB8BP3 upload=M27147SLT35Z tag=MROSKXPFZ3X4 type=write size=3595547 2024-09-14T11:17:18.836 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.838+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~DD83JXMT39TD.0 size=1037393 2024-09-14T11:17:18.842 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.842+0000 7fe125ff88c0 1 < completed multipart upload key=K3P6U6NU8I01 upload=DD83JXMT39TD tag=24UKVVDP6AW2 type=write size=2085969 2024-09-14T11:17:18.846 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.846+0000 7fe125ff88c0 1 > prepared operation key=3OU4U9JF3ZD5 tag=33ZJOWFEU2QD type=del size=3770575 2024-09-14T11:17:18.850 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.850+0000 7fe125ff88c0 1 < completed delete operation key=N94D3R7IOBNL tag=6LI8YT7NOO9O type=del 2024-09-14T11:17:18.856 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.858+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~YGLH25MF0H34.0 size=1048576 2024-09-14T11:17:18.859 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.858+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~YGLH25MF0H34.1 size=1048576 2024-09-14T11:17:18.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.862+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~YGLH25MF0H34.2 size=1003688 2024-09-14T11:17:18.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.862+0000 7fe125ff88c0 1 > prepared multipart upload key=21HC4VMHXS6L upload=YGLH25MF0H34 tag=4RTVZKAXDUXG type=write size=4149416 2024-09-14T11:17:18.866 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.866+0000 7fe125ff88c0 1 < completed delete operation key=YFRH8WECBTJK tag=LCXQATTNW3TJ type=del 2024-09-14T11:17:18.869 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.870+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=O1829YH5345G type=del size=896627 2024-09-14T11:17:18.873 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.874+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~UPKG1MT3OHGX.0 size=3472 2024-09-14T11:17:18.879 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.878+0000 7fe125ff88c0 1 < completed multipart upload key=0FITHLGQKQEC upload=UPKG1MT3OHGX tag=O9FP5JZSUXK7 type=write size=1052048 2024-09-14T11:17:18.886 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.886+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~3EOCFW2TP6NF.0 size=1048576 2024-09-14T11:17:18.889 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.890+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~3EOCFW2TP6NF.1 size=913138 2024-09-14T11:17:18.889 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.890+0000 7fe125ff88c0 1 > prepared multipart upload key=SUCH37O8V1LY upload=3EOCFW2TP6NF tag=YHP2756CHDU1 type=write size=3010290 2024-09-14T11:17:18.893 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.894+0000 7fe125ff88c0 1 < completed delete operation key=4D2X7151977X tag=AHVVECZZ3Y84 type=del 2024-09-14T11:17:18.896 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.898+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=4I274Y1QBN6N type=del size=1706542 2024-09-14T11:17:18.900 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.898+0000 7fe125ff88c0 1 < completed part key=_multipart_L4XO0WTYKNXY.2~QR9NIHH6ENKG.0 size=166794 2024-09-14T11:17:18.906 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.906+0000 7fe125ff88c0 1 < completed multipart upload key=L4XO0WTYKNXY upload=QR9NIHH6ENKG tag=8HIJH1J83WYB type=write size=1215370 2024-09-14T11:17:18.911 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.910+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=GJP2REXZ20VR type=write size=58246 2024-09-14T11:17:18.916 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.914+0000 7fe125ff88c0 1 < completed delete operation key=V6B470G93KFT tag=FLFKD1P7OPQI type=del 2024-09-14T11:17:18.919 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.918+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=1GCR032KO3L5 type=del size=59801 2024-09-14T11:17:18.928 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.926+0000 7fe125ff88c0 1 < suggested update operation key=YFRH8WECBTJK tag=U5SNV93K4F3N type=del size=1195323 2024-09-14T11:17:18.932 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.930+0000 7fe125ff88c0 1 > prepared operation key=N80X3YUF4OEL tag=IX5KZV4ZGHJ7 type=del size=1747086 2024-09-14T11:17:18.936 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.934+0000 7fe125ff88c0 1 < canceled operation key=K3P6U6NU8I01 tag=X6M6QA2N330L type=del size=2548007 2024-09-14T11:17:18.940 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.938+0000 7fe125ff88c0 1 > prepared operation key=LYBGDNKUROWH tag=Q7KIK03NGMX8 type=write size=144929 2024-09-14T11:17:18.943 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.942+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~YXQVU886CXOE.0 size=479194 2024-09-14T11:17:18.949 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.950+0000 7fe125ff88c0 1 < completed multipart upload key=YN2HI39GPEDF upload=YXQVU886CXOE tag=1EGQ3577GQ3Q type=write size=1527770 2024-09-14T11:17:18.953 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.954+0000 7fe125ff88c0 1 > prepared operation key=K05LARTJ2QZ3 tag=KGOVO2FH4CPC type=del size=2458341 2024-09-14T11:17:18.957 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.958+0000 7fe125ff88c0 1 < completed delete operation key=V6B470G93KFT tag=GPIFUED4TGBO type=del 2024-09-14T11:17:18.960 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.958+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=8CWFUPP225AZ type=del size=719247 2024-09-14T11:17:18.965 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.966+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~V7WMYBGE6CK1.0 size=640416 2024-09-14T11:17:18.971 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.970+0000 7fe125ff88c0 1 < completed multipart upload key=ESVFZQQXE3GT upload=V7WMYBGE6CK1 tag=V384JI5UZQ05 type=write size=1688992 2024-09-14T11:17:18.975 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.974+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=1G22KD5UGN4Q type=del size=3518585 2024-09-14T11:17:18.979 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.978+0000 7fe125ff88c0 1 < completed delete operation key=0VBX2FWYCFEZ tag=MSBHTC12O0RP type=del 2024-09-14T11:17:18.986 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.986+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~JQPCMV2KDM6J.0 size=1048576 2024-09-14T11:17:18.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.990+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~JQPCMV2KDM6J.1 size=47544 2024-09-14T11:17:18.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.990+0000 7fe125ff88c0 1 > prepared multipart upload key=W0B19NBHNLMZ upload=JQPCMV2KDM6J tag=FKIXQGTO0R6Y type=write size=2144696 2024-09-14T11:17:18.996 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:18.994+0000 7fe125ff88c0 1 < suggested remove operation key=FQ5WT12KB664 tag=EAT4Y7OMO0WA type=del 2024-09-14T11:17:19.002 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.002+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~BDCV7YVRKX90.0 size=83540 2024-09-14T11:17:19.002 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.002+0000 7fe125ff88c0 1 > prepared multipart upload key=LYBGDNKUROWH upload=BDCV7YVRKX90 tag=XKREFUGMKCEX type=write size=1132116 2024-09-14T11:17:19.005 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.006+0000 7fe125ff88c0 1 < completed delete operation key=YCF2PCJ9TZMR tag=I0BCD1EU29JV type=del 2024-09-14T11:17:19.009 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.010+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=NNAG4EZW0QGD type=del size=1596109 2024-09-14T11:17:19.012 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.010+0000 7fe125ff88c0 1 < completed part key=_multipart_6C3JZKTB8BP3.2~M27147SLT35Z.0 size=1048576 2024-09-14T11:17:19.014 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.014+0000 7fe125ff88c0 1 < completed part key=_multipart_6C3JZKTB8BP3.2~M27147SLT35Z.1 size=1048576 2024-09-14T11:17:19.017 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.018+0000 7fe125ff88c0 1 < completed part key=_multipart_6C3JZKTB8BP3.2~M27147SLT35Z.2 size=449819 2024-09-14T11:17:19.022 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.022+0000 7fe125ff88c0 1 < completed multipart upload key=6C3JZKTB8BP3 upload=M27147SLT35Z tag=MROSKXPFZ3X4 type=write size=3595547 2024-09-14T11:17:19.025 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.026+0000 7fe125ff88c0 1 > prepared operation key=K05LARTJ2QZ3 tag=CWXLSO9EZ1L4 type=del size=4154985 2024-09-14T11:17:19.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.026+0000 7fe125ff88c0 1 < completed delete operation key=3OU4U9JF3ZD5 tag=33ZJOWFEU2QD type=del 2024-09-14T11:17:19.034 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.034+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~BQ8BXM1O783Y.0 size=1048576 2024-09-14T11:17:19.036 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.034+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~BQ8BXM1O783Y.1 size=714107 2024-09-14T11:17:19.036 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.034+0000 7fe125ff88c0 1 > prepared multipart upload key=2UXA6SXDTUFT upload=BQ8BXM1O783Y tag=MYVYTYZMT7P1 type=write size=2811259 2024-09-14T11:17:19.040 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.038+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~YGLH25MF0H34.0 size=1048576 2024-09-14T11:17:19.042 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.042+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~YGLH25MF0H34.1 size=1048576 2024-09-14T11:17:19.042 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.042+0000 7fe125ff88c0 1 < canceled part key=_multipart_21HC4VMHXS6L.2~YGLH25MF0H34.2 size=1003688 2024-09-14T11:17:19.047 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.046+0000 7fe125ff88c0 1 < canceled multipart upload key=21HC4VMHXS6L upload=YGLH25MF0H34 tag=4RTVZKAXDUXG type=write size=4149416 2024-09-14T11:17:19.054 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.054+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~ENV4MJ0PT6D1.0 size=1048576 2024-09-14T11:17:19.057 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.058+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~ENV4MJ0PT6D1.1 size=1048576 2024-09-14T11:17:19.060 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.058+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~ENV4MJ0PT6D1.2 size=966877 2024-09-14T11:17:19.060 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.058+0000 7fe125ff88c0 1 > prepared multipart upload key=3YGN50MBAF41 upload=ENV4MJ0PT6D1 tag=BNG3H79ZNX0S type=write size=4112605 2024-09-14T11:17:19.063 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.062+0000 7fe125ff88c0 1 < completed delete operation key=YN2HI39GPEDF tag=O1829YH5345G type=del 2024-09-14T11:17:19.067 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.066+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=P8V7UYYLEVR4 type=write size=117637 2024-09-14T11:17:19.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.070+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~3EOCFW2TP6NF.0 size=1048576 2024-09-14T11:17:19.073 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.074+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~3EOCFW2TP6NF.1 size=913138 2024-09-14T11:17:19.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.078+0000 7fe125ff88c0 1 < completed multipart upload key=SUCH37O8V1LY upload=3EOCFW2TP6NF tag=YHP2756CHDU1 type=write size=3010290 2024-09-14T11:17:19.085 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.086+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~5Z4KFQYPITLZ.0 size=779774 2024-09-14T11:17:19.085 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.086+0000 7fe125ff88c0 1 > prepared multipart upload key=F9I82N7RQC81 upload=5Z4KFQYPITLZ tag=E47FBP8FUYPL type=write size=1828350 2024-09-14T11:17:19.088 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.090+0000 7fe125ff88c0 1 < canceled operation key=V6B470G93KFT tag=4I274Y1QBN6N type=del size=1706542 2024-09-14T11:17:19.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.098+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~4IYWOT050BHU.0 size=1048576 2024-09-14T11:17:19.102 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.102+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~4IYWOT050BHU.1 size=1048576 2024-09-14T11:17:19.105 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.106+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~4IYWOT050BHU.2 size=452393 2024-09-14T11:17:19.105 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.106+0000 7fe125ff88c0 1 > prepared multipart upload key=LYBGDNKUROWH upload=4IYWOT050BHU tag=1ECDAEGWCI5J type=write size=3598121 2024-09-14T11:17:19.108 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.110+0000 7fe125ff88c0 1 < completed write operation key=2LH5U05C2F8C tag=GJP2REXZ20VR type=write size=58246 2024-09-14T11:17:19.115 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.114+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~BYNQ83PUV14O.0 size=1048576 2024-09-14T11:17:19.118 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.118+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~BYNQ83PUV14O.1 size=1048576 2024-09-14T11:17:19.121 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.122+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~BYNQ83PUV14O.2 size=682767 2024-09-14T11:17:19.121 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.122+0000 7fe125ff88c0 1 > prepared multipart upload key=YN2HI39GPEDF upload=BYNQ83PUV14O tag=OW4FW3XNZL2P type=write size=3828495 2024-09-14T11:17:19.128 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.126+0000 7fe125ff88c0 1 < suggested remove operation key=W0B19NBHNLMZ tag=1GCR032KO3L5 type=del 2024-09-14T11:17:19.132 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.130+0000 7fe125ff88c0 1 > prepared operation key=FQ5WT12KB664 tag=8TXES1PJ3QDX type=del size=105362 2024-09-14T11:17:19.136 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.134+0000 7fe125ff88c0 1 < completed delete operation key=N80X3YUF4OEL tag=IX5KZV4ZGHJ7 type=del 2024-09-14T11:17:19.140 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.138+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=JVL2ZFVMZ41H type=write size=713521 2024-09-14T11:17:19.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.142+0000 7fe125ff88c0 1 < completed write operation key=LYBGDNKUROWH tag=Q7KIK03NGMX8 type=write size=144929 2024-09-14T11:17:19.148 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.146+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=MZ3IG7NI1JH9 type=del size=520890 2024-09-14T11:17:19.155 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.154+0000 7fe125ff88c0 1 < suggested update operation key=K05LARTJ2QZ3 tag=KGOVO2FH4CPC type=del size=2458341 2024-09-14T11:17:19.159 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.158+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=CH50KTV0X5J4 type=del size=1760612 2024-09-14T11:17:19.167 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.166+0000 7fe125ff88c0 1 < suggested update operation key=WEA3MQ0DI42N tag=8CWFUPP225AZ type=del size=719247 2024-09-14T11:17:19.171 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.170+0000 7fe125ff88c0 1 > prepared operation key=N80X3YUF4OEL tag=ZBYDF1FWUFNV type=del size=1992116 2024-09-14T11:17:19.174 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.174+0000 7fe125ff88c0 1 < canceled operation key=21HC4VMHXS6L tag=1G22KD5UGN4Q type=del size=3518585 2024-09-14T11:17:19.181 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.182+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~3MG01E0Y9V88.0 size=1048576 2024-09-14T11:17:19.184 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.182+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~3MG01E0Y9V88.1 size=1048576 2024-09-14T11:17:19.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.186+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~3MG01E0Y9V88.2 size=367026 2024-09-14T11:17:19.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.186+0000 7fe125ff88c0 1 > prepared multipart upload key=K3P6U6NU8I01 upload=3MG01E0Y9V88 tag=MLC3JPDJQMSJ type=write size=3512754 2024-09-14T11:17:19.191 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.190+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~JQPCMV2KDM6J.0 size=1048576 2024-09-14T11:17:19.194 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.194+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~JQPCMV2KDM6J.1 size=47544 2024-09-14T11:17:19.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.198+0000 7fe125ff88c0 1 < completed multipart upload key=W0B19NBHNLMZ upload=JQPCMV2KDM6J tag=FKIXQGTO0R6Y type=write size=2144696 2024-09-14T11:17:19.204 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.202+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=70KYO2FNO9ME type=del size=2254399 2024-09-14T11:17:19.208 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.210+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~BDCV7YVRKX90.0 size=83540 2024-09-14T11:17:19.215 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.214+0000 7fe125ff88c0 1 < completed multipart upload key=LYBGDNKUROWH upload=BDCV7YVRKX90 tag=XKREFUGMKCEX type=write size=1132116 2024-09-14T11:17:19.219 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.218+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=LM8RBO0KSR2R type=write size=1029509 2024-09-14T11:17:19.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.226+0000 7fe125ff88c0 1 < suggested remove operation key=SSNV25PDLDIS tag=NNAG4EZW0QGD type=del 2024-09-14T11:17:19.230 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.230+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=A7148WEYVB1P type=del size=630298 2024-09-14T11:17:19.234 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.234+0000 7fe125ff88c0 -1 < failed to complete operation key=K05LARTJ2QZ3 tag=CWXLSO9EZ1L4 type=del size=4154985: (22) Invalid argument 2024-09-14T11:17:19.238 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.238+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=RZJ31LINICCM type=del size=3035086 2024-09-14T11:17:19.241 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.242+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~BQ8BXM1O783Y.0 size=1048576 2024-09-14T11:17:19.244 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.242+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~BQ8BXM1O783Y.1 size=714107 2024-09-14T11:17:19.250 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.250+0000 7fe125ff88c0 1 < completed multipart upload key=2UXA6SXDTUFT upload=BQ8BXM1O783Y tag=MYVYTYZMT7P1 type=write size=2811259 2024-09-14T11:17:19.257 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.258+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~VQ7K3PZ8POF2.0 size=1048576 2024-09-14T11:17:19.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.258+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~VQ7K3PZ8POF2.1 size=437241 2024-09-14T11:17:19.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.258+0000 7fe125ff88c0 1 > prepared multipart upload key=V6B470G93KFT upload=VQ7K3PZ8POF2 tag=OQKQXPXHM007 type=write size=2534393 2024-09-14T11:17:19.264 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.266+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~ENV4MJ0PT6D1.0 size=1048576 2024-09-14T11:17:19.268 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.266+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~ENV4MJ0PT6D1.1 size=1048576 2024-09-14T11:17:19.271 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.270+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~ENV4MJ0PT6D1.2 size=966877 2024-09-14T11:17:19.277 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.278+0000 7fe125ff88c0 1 < completed multipart upload key=3YGN50MBAF41 upload=ENV4MJ0PT6D1 tag=BNG3H79ZNX0S type=write size=4112605 2024-09-14T11:17:19.281 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.282+0000 7fe125ff88c0 1 > prepared operation key=3OU4U9JF3ZD5 tag=TSQZAZCEKDCH type=del size=3786863 2024-09-14T11:17:19.286 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.286+0000 7fe125ff88c0 1 < completed write operation key=V6B470G93KFT tag=P8V7UYYLEVR4 type=write size=117637 2024-09-14T11:17:19.289 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.290+0000 7fe125ff88c0 1 > prepared operation key=6C3JZKTB8BP3 tag=VN3118ME2NU0 type=del size=3374361 2024-09-14T11:17:19.293 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.294+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~5Z4KFQYPITLZ.0 size=779774 2024-09-14T11:17:19.300 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.298+0000 7fe125ff88c0 1 < completed multipart upload key=F9I82N7RQC81 upload=5Z4KFQYPITLZ tag=E47FBP8FUYPL type=write size=1828350 2024-09-14T11:17:19.303 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.302+0000 7fe125ff88c0 1 > prepared operation key=YFRH8WECBTJK tag=99DVA53I2QMY type=del size=838620 2024-09-14T11:17:19.307 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.306+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~4IYWOT050BHU.0 size=1048576 2024-09-14T11:17:19.310 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.310+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~4IYWOT050BHU.1 size=1048576 2024-09-14T11:17:19.313 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.314+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~4IYWOT050BHU.2 size=452393 2024-09-14T11:17:19.320 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.318+0000 7fe125ff88c0 1 < completed multipart upload key=LYBGDNKUROWH upload=4IYWOT050BHU tag=1ECDAEGWCI5J type=write size=3598121 2024-09-14T11:17:19.324 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.326+0000 7fe125ff88c0 1 > prepared operation key=3YGN50MBAF41 tag=FNWIDJR3CHTP type=del size=1367209 2024-09-14T11:17:19.329 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.330+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~BYNQ83PUV14O.0 size=1048576 2024-09-14T11:17:19.332 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.330+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~BYNQ83PUV14O.1 size=1048576 2024-09-14T11:17:19.335 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.334+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~BYNQ83PUV14O.2 size=682767 2024-09-14T11:17:19.341 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.342+0000 7fe125ff88c0 1 < completed multipart upload key=YN2HI39GPEDF upload=BYNQ83PUV14O tag=OW4FW3XNZL2P type=write size=3828495 2024-09-14T11:17:19.345 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.346+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=P7P625LV8I0G type=del size=1917292 2024-09-14T11:17:19.349 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.350+0000 7fe125ff88c0 1 < completed delete operation key=FQ5WT12KB664 tag=8TXES1PJ3QDX type=del 2024-09-14T11:17:19.355 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.354+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~CRW488XANFTW.0 size=1048576 2024-09-14T11:17:19.358 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.358+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~CRW488XANFTW.1 size=1048576 2024-09-14T11:17:19.361 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.362+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~CRW488XANFTW.2 size=852853 2024-09-14T11:17:19.361 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.362+0000 7fe125ff88c0 1 > prepared multipart upload key=4D2X7151977X upload=CRW488XANFTW tag=0W23U4QOCS8G type=write size=3998581 2024-09-14T11:17:19.365 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.366+0000 7fe125ff88c0 -1 < failed to complete operation key=SSNV25PDLDIS tag=JVL2ZFVMZ41H type=write size=713521: (22) Invalid argument 2024-09-14T11:17:19.369 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.370+0000 7fe125ff88c0 1 > prepared operation key=K05LARTJ2QZ3 tag=RSD3LQ2GMUKJ type=del size=932048 2024-09-14T11:17:19.372 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.374+0000 7fe125ff88c0 1 < completed delete operation key=6PLUU2QIO9LJ tag=MZ3IG7NI1JH9 type=del 2024-09-14T11:17:19.376 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.374+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=EHU0ZKZ13F1J type=del size=3571387 2024-09-14T11:17:19.380 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.378+0000 7fe125ff88c0 -1 < failed to complete operation key=SSNV25PDLDIS tag=CH50KTV0X5J4 type=del size=1760612: (22) Invalid argument 2024-09-14T11:17:19.386 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.386+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~BFJ1DKMDW4AJ.0 size=753672 2024-09-14T11:17:19.386 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.386+0000 7fe125ff88c0 1 > prepared multipart upload key=2LH5U05C2F8C upload=BFJ1DKMDW4AJ tag=KY0P7UQGF5RO type=write size=1802248 2024-09-14T11:17:19.390 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.390+0000 7fe125ff88c0 1 < completed delete operation key=N80X3YUF4OEL tag=ZBYDF1FWUFNV type=del 2024-09-14T11:17:19.394 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.394+0000 7fe125ff88c0 1 > prepared operation key=SUCH37O8V1LY tag=H02O3TNKABR9 type=write size=1033514 2024-09-14T11:17:19.398 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.398+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~3MG01E0Y9V88.0 size=1048576 2024-09-14T11:17:19.401 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.402+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~3MG01E0Y9V88.1 size=1048576 2024-09-14T11:17:19.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.402+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~3MG01E0Y9V88.2 size=367026 2024-09-14T11:17:19.410 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.410+0000 7fe125ff88c0 1 < completed multipart upload key=K3P6U6NU8I01 upload=3MG01E0Y9V88 tag=MLC3JPDJQMSJ type=write size=3512754 2024-09-14T11:17:19.414 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.414+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=KTJRPDGDI05N type=del size=838930 2024-09-14T11:17:19.422 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.422+0000 7fe125ff88c0 1 < suggested update operation key=ESVFZQQXE3GT tag=70KYO2FNO9ME type=del size=2254399 2024-09-14T11:17:19.429 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.430+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~KW157MQ1CEGL.0 size=1048576 2024-09-14T11:17:19.432 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.430+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~KW157MQ1CEGL.1 size=1048576 2024-09-14T11:17:19.435 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.434+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~KW157MQ1CEGL.2 size=349319 2024-09-14T11:17:19.435 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.434+0000 7fe125ff88c0 1 > prepared multipart upload key=0FITHLGQKQEC upload=KW157MQ1CEGL tag=KFT4S0O3KAOK type=write size=3495047 2024-09-14T11:17:19.439 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.438+0000 7fe125ff88c0 1 < completed write operation key=2LH5U05C2F8C tag=LM8RBO0KSR2R type=write size=1029509 2024-09-14T11:17:19.442 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.442+0000 7fe125ff88c0 1 > prepared operation key=LYBGDNKUROWH tag=XA7SR8Q4NOYZ type=del size=2064005 2024-09-14T11:17:19.447 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.446+0000 7fe125ff88c0 1 < completed delete operation key=K3P6U6NU8I01 tag=A7148WEYVB1P type=del 2024-09-14T11:17:19.458 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.458+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~KVEPMTJTJW85.0 size=643357 2024-09-14T11:17:19.458 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.458+0000 7fe125ff88c0 1 > prepared multipart upload key=L4XO0WTYKNXY upload=KVEPMTJTJW85 tag=1SHUWZY892MM type=write size=1691933 2024-09-14T11:17:19.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.462+0000 7fe125ff88c0 1 < completed delete operation key=L4XO0WTYKNXY tag=RZJ31LINICCM type=del 2024-09-14T11:17:19.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.466+0000 7fe125ff88c0 1 > prepared operation key=LYBGDNKUROWH tag=QP304B0MGJHY type=del size=1628167 2024-09-14T11:17:19.470 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.470+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~VQ7K3PZ8POF2.0 size=1048576 2024-09-14T11:17:19.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.474+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~VQ7K3PZ8POF2.1 size=437241 2024-09-14T11:17:19.480 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.478+0000 7fe125ff88c0 1 < completed multipart upload key=V6B470G93KFT upload=VQ7K3PZ8POF2 tag=OQKQXPXHM007 type=write size=2534393 2024-09-14T11:17:19.484 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.486+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=1I2TBRAEXI0X type=del size=2095042 2024-09-14T11:17:19.488 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.490+0000 7fe125ff88c0 1 < completed delete operation key=3OU4U9JF3ZD5 tag=TSQZAZCEKDCH type=del 2024-09-14T11:17:19.492 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.490+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=737DOX19OM0F type=del size=3653891 2024-09-14T11:17:19.497 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.498+0000 7fe125ff88c0 1 < completed delete operation key=6C3JZKTB8BP3 tag=VN3118ME2NU0 type=del 2024-09-14T11:17:19.500 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.502+0000 7fe125ff88c0 1 > prepared operation key=LYBGDNKUROWH tag=T7OSDVSYFOOI type=del size=4061857 2024-09-14T11:17:19.504 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.502+0000 7fe125ff88c0 1 < completed delete operation key=YFRH8WECBTJK tag=99DVA53I2QMY type=del 2024-09-14T11:17:19.508 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.506+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=WFV1K5WMK2LG type=del size=4050441 2024-09-14T11:17:19.513 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.514+0000 7fe125ff88c0 1 < completed delete operation key=3YGN50MBAF41 tag=FNWIDJR3CHTP type=del 2024-09-14T11:17:19.516 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.518+0000 7fe125ff88c0 1 > prepared operation key=3OU4U9JF3ZD5 tag=M9IACG75Y87L type=del size=3911041 2024-09-14T11:17:19.520 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.518+0000 7fe125ff88c0 1 < completed delete operation key=YCF2PCJ9TZMR tag=P7P625LV8I0G type=del 2024-09-14T11:17:19.524 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.522+0000 7fe125ff88c0 1 > prepared operation key=N80X3YUF4OEL tag=IP1I13NIT5K9 type=write size=184583 2024-09-14T11:17:19.527 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.526+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~CRW488XANFTW.0 size=1048576 2024-09-14T11:17:19.530 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.530+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~CRW488XANFTW.1 size=1048576 2024-09-14T11:17:19.533 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.534+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~CRW488XANFTW.2 size=852853 2024-09-14T11:17:19.539 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.538+0000 7fe125ff88c0 1 < completed multipart upload key=4D2X7151977X upload=CRW488XANFTW tag=0W23U4QOCS8G type=write size=3998581 2024-09-14T11:17:19.543 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.542+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=U778EMFFEM16 type=del size=2413532 2024-09-14T11:17:19.546 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.546+0000 7fe125ff88c0 1 < completed delete operation key=K05LARTJ2QZ3 tag=RSD3LQ2GMUKJ type=del 2024-09-14T11:17:19.550 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.550+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=TU8H7VHUGM73 type=del size=2026363 2024-09-14T11:17:19.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.554+0000 7fe125ff88c0 1 < completed delete operation key=6PLUU2QIO9LJ tag=EHU0ZKZ13F1J type=del 2024-09-14T11:17:19.560 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.558+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=5ZHXDZN37H00 type=del size=2472933 2024-09-14T11:17:19.562 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.562+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~BFJ1DKMDW4AJ.0 size=753672 2024-09-14T11:17:19.568 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.566+0000 7fe125ff88c0 1 < completed multipart upload key=2LH5U05C2F8C upload=BFJ1DKMDW4AJ tag=KY0P7UQGF5RO type=write size=1802248 2024-09-14T11:17:19.575 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.574+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~IOH8UJ8DIDZ2.0 size=1048576 2024-09-14T11:17:19.578 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.578+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~IOH8UJ8DIDZ2.1 size=146270 2024-09-14T11:17:19.578 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.578+0000 7fe125ff88c0 1 > prepared multipart upload key=YN2HI39GPEDF upload=IOH8UJ8DIDZ2 tag=CUZWN27T34O2 type=write size=2243422 2024-09-14T11:17:19.581 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.582+0000 7fe125ff88c0 1 < canceled operation key=SUCH37O8V1LY tag=H02O3TNKABR9 type=write size=1033514 2024-09-14T11:17:19.588 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.586+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~Y8X4JJUKU35Q.0 size=817329 2024-09-14T11:17:19.588 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.586+0000 7fe125ff88c0 1 > prepared multipart upload key=W0B19NBHNLMZ upload=Y8X4JJUKU35Q tag=DMV6I0MOJI98 type=write size=1865905 2024-09-14T11:17:19.595 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.594+0000 7fe125ff88c0 1 < suggested remove operation key=YCF2PCJ9TZMR tag=KTJRPDGDI05N type=del 2024-09-14T11:17:19.602 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.602+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~N0LEZUMGST4D.0 size=1048576 2024-09-14T11:17:19.604 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.606+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~N0LEZUMGST4D.1 size=1048576 2024-09-14T11:17:19.607 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.606+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~N0LEZUMGST4D.2 size=686990 2024-09-14T11:17:19.607 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.606+0000 7fe125ff88c0 1 > prepared multipart upload key=6C3JZKTB8BP3 upload=N0LEZUMGST4D tag=RKIINIHTFZ36 type=write size=3832718 2024-09-14T11:17:19.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.606+0000 7fe125ff88c0 1 < canceled part key=_multipart_0FITHLGQKQEC.2~KW157MQ1CEGL.0 size=1048576 2024-09-14T11:17:19.611 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.610+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~KW157MQ1CEGL.1 size=1048576 2024-09-14T11:17:19.614 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.614+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~KW157MQ1CEGL.2 size=349319 2024-09-14T11:17:19.619 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.618+0000 7fe125ff88c0 1 < canceled multipart upload key=0FITHLGQKQEC upload=KW157MQ1CEGL tag=KFT4S0O3KAOK type=write size=3495047 2024-09-14T11:17:19.626 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.626+0000 7fe125ff88c0 1 > prepared part key=_multipart_2KEKSWK0UT6C.2~IASMMIBXEBV0.0 size=1048576 2024-09-14T11:17:19.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.630+0000 7fe125ff88c0 1 > prepared part key=_multipart_2KEKSWK0UT6C.2~IASMMIBXEBV0.1 size=715453 2024-09-14T11:17:19.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.630+0000 7fe125ff88c0 1 > prepared multipart upload key=2KEKSWK0UT6C upload=IASMMIBXEBV0 tag=E7L5ME61IO0F type=write size=2812605 2024-09-14T11:17:19.633 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.634+0000 7fe125ff88c0 1 < completed delete operation key=LYBGDNKUROWH tag=XA7SR8Q4NOYZ type=del 2024-09-14T11:17:19.637 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.638+0000 7fe125ff88c0 1 > prepared operation key=K05LARTJ2QZ3 tag=RDYV5QLT00JH type=del size=2213459 2024-09-14T11:17:19.640 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.642+0000 7fe125ff88c0 1 < completed part key=_multipart_L4XO0WTYKNXY.2~KVEPMTJTJW85.0 size=643357 2024-09-14T11:17:19.646 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.646+0000 7fe125ff88c0 1 < completed multipart upload key=L4XO0WTYKNXY upload=KVEPMTJTJW85 tag=1SHUWZY892MM type=write size=1691933 2024-09-14T11:17:19.653 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.654+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~GHXOF77DYMH2.0 size=387048 2024-09-14T11:17:19.653 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.654+0000 7fe125ff88c0 1 > prepared multipart upload key=F9I82N7RQC81 upload=GHXOF77DYMH2 tag=G5PGW1YFFK2Q type=write size=1435624 2024-09-14T11:17:19.657 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.658+0000 7fe125ff88c0 1 < completed delete operation key=LYBGDNKUROWH tag=QP304B0MGJHY type=del 2024-09-14T11:17:19.661 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.662+0000 7fe125ff88c0 1 > prepared operation key=46ZTDBWFVSUH tag=3QLUAGTDFFVF type=del size=1213684 2024-09-14T11:17:19.665 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.666+0000 7fe125ff88c0 1 < completed delete operation key=2LH5U05C2F8C tag=1I2TBRAEXI0X type=del 2024-09-14T11:17:19.671 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.670+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~Z6Q09K4ZS1YI.0 size=1048576 2024-09-14T11:17:19.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.674+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~Z6Q09K4ZS1YI.1 size=127806 2024-09-14T11:17:19.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.674+0000 7fe125ff88c0 1 > prepared multipart upload key=YFRH8WECBTJK upload=Z6Q09K4ZS1YI tag=T3PAJ1EUG0F9 type=write size=2224958 2024-09-14T11:17:19.683 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.682+0000 7fe125ff88c0 1 < suggested remove operation key=V6B470G93KFT tag=737DOX19OM0F type=del 2024-09-14T11:17:19.686 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.686+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=YHFIVF4OCB7P type=del size=2962780 2024-09-14T11:17:19.690 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.690+0000 7fe125ff88c0 1 < completed delete operation key=LYBGDNKUROWH tag=T7OSDVSYFOOI type=del 2024-09-14T11:17:19.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.698+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~0LUN0V2CTD3L.0 size=1048576 2024-09-14T11:17:19.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.702+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~0LUN0V2CTD3L.1 size=121433 2024-09-14T11:17:19.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.702+0000 7fe125ff88c0 1 > prepared multipart upload key=6C3JZKTB8BP3 upload=0LUN0V2CTD3L tag=8C4GXCEJDHE4 type=write size=2218585 2024-09-14T11:17:19.704 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.702+0000 7fe125ff88c0 1 < completed delete operation key=2KEKSWK0UT6C tag=WFV1K5WMK2LG type=del 2024-09-14T11:17:19.708 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.710+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=KT9U82KGDH3W type=del size=1899619 2024-09-14T11:17:19.712 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.714+0000 7fe125ff88c0 1 < canceled operation key=3OU4U9JF3ZD5 tag=M9IACG75Y87L type=del size=3911041 2024-09-14T11:17:19.716 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.718+0000 7fe125ff88c0 1 > prepared operation key=SUCH37O8V1LY tag=T0QXR4HCQ3CC type=del size=254894 2024-09-14T11:17:19.720 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.722+0000 7fe125ff88c0 1 < completed write operation key=N80X3YUF4OEL tag=IP1I13NIT5K9 type=write size=184583 2024-09-14T11:17:19.724 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.726+0000 7fe125ff88c0 1 > prepared operation key=1ML6RIXI4C5P tag=S8S3AEU4YU57 type=write size=255723 2024-09-14T11:17:19.728 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.726+0000 7fe125ff88c0 -1 < failed to complete operation key=YCF2PCJ9TZMR tag=U778EMFFEM16 type=del size=2413532: (22) Invalid argument 2024-09-14T11:17:19.734 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.734+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~BOM783UFOA8P.0 size=1048576 2024-09-14T11:17:19.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.738+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~BOM783UFOA8P.1 size=276100 2024-09-14T11:17:19.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.738+0000 7fe125ff88c0 1 > prepared multipart upload key=V6B470G93KFT upload=BOM783UFOA8P tag=QLEBHNQ86A1E type=write size=2373252 2024-09-14T11:17:19.739 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.738+0000 7fe125ff88c0 -1 < no bi entry to suggest for operation key=YCF2PCJ9TZMR tag=TU8H7VHUGM73 type=del size=2026363: (2) No such file or directory 2024-09-14T11:17:19.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.742+0000 7fe125ff88c0 1 > prepared operation key=FQ5WT12KB664 tag=YIACHAV7ZRMN type=del size=1469241 2024-09-14T11:17:19.748 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.746+0000 7fe125ff88c0 1 < completed delete operation key=2UXA6SXDTUFT tag=5ZHXDZN37H00 type=del 2024-09-14T11:17:19.753 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.754+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=J6HYQXGTSSXH type=del size=2401771 2024-09-14T11:17:19.757 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.758+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~IOH8UJ8DIDZ2.0 size=1048576 2024-09-14T11:17:19.760 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.758+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~IOH8UJ8DIDZ2.1 size=146270 2024-09-14T11:17:19.766 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.766+0000 7fe125ff88c0 1 < completed multipart upload key=YN2HI39GPEDF upload=IOH8UJ8DIDZ2 tag=CUZWN27T34O2 type=write size=2243422 2024-09-14T11:17:19.772 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.774+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~TG9ESTNSF4PP.0 size=1048576 2024-09-14T11:17:19.775 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.774+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~TG9ESTNSF4PP.1 size=122303 2024-09-14T11:17:19.775 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.774+0000 7fe125ff88c0 1 > prepared multipart upload key=3OU4U9JF3ZD5 upload=TG9ESTNSF4PP tag=RLBSU17PKS9R type=write size=2219455 2024-09-14T11:17:19.780 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.778+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~Y8X4JJUKU35Q.0 size=817329 2024-09-14T11:17:19.786 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.786+0000 7fe125ff88c0 1 < completed multipart upload key=W0B19NBHNLMZ upload=Y8X4JJUKU35Q tag=DMV6I0MOJI98 type=write size=1865905 2024-09-14T11:17:19.790 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.790+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=5XAJ33XCGHBH type=write size=790191 2024-09-14T11:17:19.795 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.794+0000 7fe125ff88c0 1 < completed part key=_multipart_6C3JZKTB8BP3.2~N0LEZUMGST4D.0 size=1048576 2024-09-14T11:17:19.799 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.798+0000 7fe125ff88c0 1 < completed part key=_multipart_6C3JZKTB8BP3.2~N0LEZUMGST4D.1 size=1048576 2024-09-14T11:17:19.802 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.802+0000 7fe125ff88c0 1 < completed part key=_multipart_6C3JZKTB8BP3.2~N0LEZUMGST4D.2 size=686990 2024-09-14T11:17:19.808 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.806+0000 7fe125ff88c0 1 < completed multipart upload key=6C3JZKTB8BP3 upload=N0LEZUMGST4D tag=RKIINIHTFZ36 type=write size=3832718 2024-09-14T11:17:19.817 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.818+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=1BJAZVVWC4LK type=write size=810759 2024-09-14T11:17:19.821 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.822+0000 7fe125ff88c0 1 < completed part key=_multipart_2KEKSWK0UT6C.2~IASMMIBXEBV0.0 size=1048576 2024-09-14T11:17:19.824 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.822+0000 7fe125ff88c0 1 < completed part key=_multipart_2KEKSWK0UT6C.2~IASMMIBXEBV0.1 size=715453 2024-09-14T11:17:19.830 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.830+0000 7fe125ff88c0 1 < completed multipart upload key=2KEKSWK0UT6C upload=IASMMIBXEBV0 tag=E7L5ME61IO0F type=write size=2812605 2024-09-14T11:17:19.837 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.838+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~HX91KT2M84M4.0 size=1048576 2024-09-14T11:17:19.839 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.838+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~HX91KT2M84M4.1 size=251007 2024-09-14T11:17:19.839 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.838+0000 7fe125ff88c0 1 > prepared multipart upload key=3YGN50MBAF41 upload=HX91KT2M84M4 tag=KB0BZGWMRSK6 type=write size=2348159 2024-09-14T11:17:19.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.842+0000 7fe125ff88c0 1 < completed delete operation key=K05LARTJ2QZ3 tag=RDYV5QLT00JH type=del 2024-09-14T11:17:19.847 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.846+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=M1L1UOEVWHUT type=del size=1337247 2024-09-14T11:17:19.848 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.850+0000 7fe125ff88c0 1 < canceled part key=_multipart_F9I82N7RQC81.2~GHXOF77DYMH2.0 size=387048 2024-09-14T11:17:19.854 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.854+0000 7fe125ff88c0 1 < canceled multipart upload key=F9I82N7RQC81 upload=GHXOF77DYMH2 tag=G5PGW1YFFK2Q type=write size=1435624 2024-09-14T11:17:19.858 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.858+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=JLYAE13A69D8 type=del size=2319902 2024-09-14T11:17:19.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.862+0000 7fe125ff88c0 1 < completed delete operation key=46ZTDBWFVSUH tag=3QLUAGTDFFVF type=del 2024-09-14T11:17:19.866 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.866+0000 7fe125ff88c0 1 > prepared operation key=46ZTDBWFVSUH tag=UHU7JQSVI5JW type=del size=3426139 2024-09-14T11:17:19.867 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.866+0000 7fe125ff88c0 1 < canceled part key=_multipart_YFRH8WECBTJK.2~Z6Q09K4ZS1YI.0 size=1048576 2024-09-14T11:17:19.867 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.866+0000 7fe125ff88c0 1 < canceled part key=_multipart_YFRH8WECBTJK.2~Z6Q09K4ZS1YI.1 size=127806 2024-09-14T11:17:19.873 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.874+0000 7fe125ff88c0 1 < canceled multipart upload key=YFRH8WECBTJK upload=Z6Q09K4ZS1YI tag=T3PAJ1EUG0F9 type=write size=2224958 2024-09-14T11:17:19.877 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.878+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=BP0AML3T2G1Q type=del size=823656 2024-09-14T11:17:19.881 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.882+0000 7fe125ff88c0 1 < canceled operation key=F9I82N7RQC81 tag=YHFIVF4OCB7P type=del size=2962780 2024-09-14T11:17:19.885 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.886+0000 7fe125ff88c0 1 > prepared operation key=FQ5WT12KB664 tag=RU8U7RC6IEO3 type=del size=1782466 2024-09-14T11:17:19.889 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.890+0000 7fe125ff88c0 1 < completed part key=_multipart_6C3JZKTB8BP3.2~0LUN0V2CTD3L.0 size=1048576 2024-09-14T11:17:19.892 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.894+0000 7fe125ff88c0 1 < completed part key=_multipart_6C3JZKTB8BP3.2~0LUN0V2CTD3L.1 size=121433 2024-09-14T11:17:19.898 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.898+0000 7fe125ff88c0 1 < completed multipart upload key=6C3JZKTB8BP3 upload=0LUN0V2CTD3L tag=8C4GXCEJDHE4 type=write size=2218585 2024-09-14T11:17:19.905 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.906+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~TK8B6GH21N12.0 size=1048576 2024-09-14T11:17:19.908 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.910+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~TK8B6GH21N12.1 size=1048576 2024-09-14T11:17:19.911 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.910+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~TK8B6GH21N12.2 size=889374 2024-09-14T11:17:19.911 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.910+0000 7fe125ff88c0 1 > prepared multipart upload key=LYBGDNKUROWH upload=TK8B6GH21N12 tag=UCMAMKNG9381 type=write size=4035102 2024-09-14T11:17:19.915 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.914+0000 7fe125ff88c0 1 < completed delete operation key=W0B19NBHNLMZ tag=KT9U82KGDH3W type=del 2024-09-14T11:17:19.919 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.918+0000 7fe125ff88c0 1 > prepared operation key=1ML6RIXI4C5P tag=YT0KGNV2YQHU type=del size=2086742 2024-09-14T11:17:19.923 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.922+0000 7fe125ff88c0 1 < completed delete operation key=SUCH37O8V1LY tag=T0QXR4HCQ3CC type=del 2024-09-14T11:17:19.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.926+0000 7fe125ff88c0 1 > prepared operation key=N80X3YUF4OEL tag=TIFKTWJPKULX type=del size=2110377 2024-09-14T11:17:19.931 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.930+0000 7fe125ff88c0 1 < completed write operation key=1ML6RIXI4C5P tag=S8S3AEU4YU57 type=write size=255723 2024-09-14T11:17:19.934 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.934+0000 7fe125ff88c0 1 > prepared operation key=3YGN50MBAF41 tag=5JW8VQJVPP3M type=del size=2985903 2024-09-14T11:17:19.938 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.938+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~BOM783UFOA8P.0 size=1048576 2024-09-14T11:17:19.941 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.942+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~BOM783UFOA8P.1 size=276100 2024-09-14T11:17:19.947 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.946+0000 7fe125ff88c0 1 < completed multipart upload key=V6B470G93KFT upload=BOM783UFOA8P tag=QLEBHNQ86A1E type=write size=2373252 2024-09-14T11:17:19.951 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.950+0000 7fe125ff88c0 1 > prepared operation key=SUCH37O8V1LY tag=T5MQ1NMOREB5 type=del size=251115 2024-09-14T11:17:19.958 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.958+0000 7fe125ff88c0 1 < suggested remove operation key=FQ5WT12KB664 tag=YIACHAV7ZRMN type=del 2024-09-14T11:17:19.965 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.966+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~3MZ5RIITZ5GV.0 size=1048576 2024-09-14T11:17:19.967 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.966+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~3MZ5RIITZ5GV.1 size=340616 2024-09-14T11:17:19.967 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.966+0000 7fe125ff88c0 1 > prepared multipart upload key=35EB6U5O4A51 upload=3MZ5RIITZ5GV tag=PQ235LD6RD3A type=write size=2437768 2024-09-14T11:17:19.971 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.970+0000 7fe125ff88c0 1 < completed delete operation key=2LH5U05C2F8C tag=J6HYQXGTSSXH type=del 2024-09-14T11:17:19.975 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.974+0000 7fe125ff88c0 1 > prepared operation key=SUCH37O8V1LY tag=UZV5ZOZ2B0I9 type=del size=3651636 2024-09-14T11:17:19.978 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.978+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~TG9ESTNSF4PP.0 size=1048576 2024-09-14T11:17:19.981 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.982+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~TG9ESTNSF4PP.1 size=122303 2024-09-14T11:17:19.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.986+0000 7fe125ff88c0 1 < completed multipart upload key=3OU4U9JF3ZD5 upload=TG9ESTNSF4PP tag=RLBSU17PKS9R type=write size=2219455 2024-09-14T11:17:19.990 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.990+0000 7fe125ff88c0 1 > prepared operation key=6C3JZKTB8BP3 tag=PA9X8MGEOPNQ type=del size=1607754 2024-09-14T11:17:19.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:19.994+0000 7fe125ff88c0 1 < completed write operation key=0VBX2FWYCFEZ tag=5XAJ33XCGHBH type=write size=790191 2024-09-14T11:17:20.002 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.002+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~PE3JUTS21YMI.0 size=1048576 2024-09-14T11:17:20.004 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.006+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~PE3JUTS21YMI.1 size=1048576 2024-09-14T11:17:20.007 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.006+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~PE3JUTS21YMI.2 size=235092 2024-09-14T11:17:20.007 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.006+0000 7fe125ff88c0 1 > prepared multipart upload key=YCF2PCJ9TZMR upload=PE3JUTS21YMI tag=F971U07TUWO4 type=write size=3380820 2024-09-14T11:17:20.010 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.010+0000 7fe125ff88c0 1 < completed write operation key=N94D3R7IOBNL tag=1BJAZVVWC4LK type=write size=810759 2024-09-14T11:17:20.014 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.014+0000 7fe125ff88c0 1 > prepared operation key=YFRH8WECBTJK tag=N2O5R98W3MMC type=del size=3844516 2024-09-14T11:17:20.018 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.018+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~HX91KT2M84M4.0 size=1048576 2024-09-14T11:17:20.020 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.022+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~HX91KT2M84M4.1 size=251007 2024-09-14T11:17:20.025 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.026+0000 7fe125ff88c0 1 < completed multipart upload key=3YGN50MBAF41 upload=HX91KT2M84M4 tag=KB0BZGWMRSK6 type=write size=2348159 2024-09-14T11:17:20.029 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.030+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=UJ4AHRXV2AO4 type=del size=1071932 2024-09-14T11:17:20.033 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.034+0000 7fe125ff88c0 1 < completed delete operation key=WEA3MQ0DI42N tag=M1L1UOEVWHUT type=del 2024-09-14T11:17:20.040 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.038+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~73WF5QQGHPYO.0 size=1048576 2024-09-14T11:17:20.042 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.042+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~73WF5QQGHPYO.1 size=1011710 2024-09-14T11:17:20.043 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.042+0000 7fe125ff88c0 1 > prepared multipart upload key=35EB6U5O4A51 upload=73WF5QQGHPYO tag=NZZQTCJZV4E8 type=write size=3108862 2024-09-14T11:17:20.050 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.050+0000 7fe125ff88c0 1 < suggested update operation key=SSNV25PDLDIS tag=JLYAE13A69D8 type=del size=2319902 2024-09-14T11:17:20.056 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.054+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~7SX9R6LQV98K.0 size=1048576 2024-09-14T11:17:20.058 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.058+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~7SX9R6LQV98K.1 size=1048576 2024-09-14T11:17:20.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.062+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~7SX9R6LQV98K.2 size=789859 2024-09-14T11:17:20.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.062+0000 7fe125ff88c0 1 > prepared multipart upload key=N80X3YUF4OEL upload=7SX9R6LQV98K tag=L9ITWCBXLHU6 type=write size=3935587 2024-09-14T11:17:20.064 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.062+0000 7fe125ff88c0 1 < completed delete operation key=46ZTDBWFVSUH tag=UHU7JQSVI5JW type=del 2024-09-14T11:17:20.069 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.070+0000 7fe125ff88c0 1 > prepared part key=_multipart_WEA3MQ0DI42N.2~SRQV7B4WQ5PX.0 size=161301 2024-09-14T11:17:20.070 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.070+0000 7fe125ff88c0 1 > prepared multipart upload key=WEA3MQ0DI42N upload=SRQV7B4WQ5PX tag=UMAB3XCPLAY7 type=write size=1209877 2024-09-14T11:17:20.073 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.074+0000 7fe125ff88c0 1 < completed delete operation key=2LH5U05C2F8C tag=BP0AML3T2G1Q type=del 2024-09-14T11:17:20.076 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.078+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=9GEKHSFM3UG1 type=del size=122061 2024-09-14T11:17:20.078 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.078+0000 7fe125ff88c0 -1 < no bi entry to suggest for operation key=FQ5WT12KB664 tag=RU8U7RC6IEO3 type=del size=1782466: (2) No such file or directory 2024-09-14T11:17:20.084 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.082+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~ZWE4Q6GBSEFI.0 size=29051 2024-09-14T11:17:20.084 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.082+0000 7fe125ff88c0 1 > prepared multipart upload key=3OU4U9JF3ZD5 upload=ZWE4Q6GBSEFI tag=NPZ9UZ172SKV type=write size=1077627 2024-09-14T11:17:20.089 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.090+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~TK8B6GH21N12.0 size=1048576 2024-09-14T11:17:20.089 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.090+0000 7fe125ff88c0 1 < canceled part key=_multipart_LYBGDNKUROWH.2~TK8B6GH21N12.1 size=1048576 2024-09-14T11:17:20.092 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.094+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~TK8B6GH21N12.2 size=889374 2024-09-14T11:17:20.098 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.098+0000 7fe125ff88c0 1 < canceled multipart upload key=LYBGDNKUROWH upload=TK8B6GH21N12 tag=UCMAMKNG9381 type=write size=4035102 2024-09-14T11:17:20.102 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.102+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=QA8RLK5F82D5 type=del size=1195642 2024-09-14T11:17:20.106 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.106+0000 7fe125ff88c0 1 < completed delete operation key=1ML6RIXI4C5P tag=YT0KGNV2YQHU type=del 2024-09-14T11:17:20.111 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.110+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=XW39R5NVB0BX type=del size=2394333 2024-09-14T11:17:20.114 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.114+0000 7fe125ff88c0 1 < completed delete operation key=N80X3YUF4OEL tag=TIFKTWJPKULX type=del 2024-09-14T11:17:20.118 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.118+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=SAN5IF4M25JG type=del size=3416877 2024-09-14T11:17:20.123 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.122+0000 7fe125ff88c0 1 < canceled operation key=3YGN50MBAF41 tag=5JW8VQJVPP3M type=del size=2985903 2024-09-14T11:17:20.127 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.126+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=L32Y6658JXOI type=del size=385378 2024-09-14T11:17:20.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.134+0000 7fe125ff88c0 1 < suggested remove operation key=SUCH37O8V1LY tag=T5MQ1NMOREB5 type=del 2024-09-14T11:17:20.138 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.138+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=FYK4K4NZUIBD type=del size=438425 2024-09-14T11:17:20.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.142+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~3MZ5RIITZ5GV.0 size=1048576 2024-09-14T11:17:20.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.146+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~3MZ5RIITZ5GV.1 size=340616 2024-09-14T11:17:20.152 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.150+0000 7fe125ff88c0 1 < completed multipart upload key=35EB6U5O4A51 upload=3MZ5RIITZ5GV tag=PQ235LD6RD3A type=write size=2437768 2024-09-14T11:17:20.155 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.154+0000 7fe125ff88c0 1 > prepared operation key=0FITHLGQKQEC tag=XT41GR359EE7 type=del size=1135935 2024-09-14T11:17:20.159 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.158+0000 7fe125ff88c0 -1 < failed to complete operation key=SUCH37O8V1LY tag=UZV5ZOZ2B0I9 type=del size=3651636: (22) Invalid argument 2024-09-14T11:17:20.167 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.166+0000 7fe125ff88c0 1 > prepared operation key=LYBGDNKUROWH tag=X9GVNFT058S1 type=del size=1194837 2024-09-14T11:17:20.172 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.170+0000 7fe125ff88c0 1 < completed delete operation key=6C3JZKTB8BP3 tag=PA9X8MGEOPNQ type=del 2024-09-14T11:17:20.178 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.178+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~Y5YP2XJ9XE78.0 size=453600 2024-09-14T11:17:20.179 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.178+0000 7fe125ff88c0 1 > prepared multipart upload key=1ML6RIXI4C5P upload=Y5YP2XJ9XE78 tag=31Y01AJ392OP type=write size=1502176 2024-09-14T11:17:20.183 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.182+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~PE3JUTS21YMI.0 size=1048576 2024-09-14T11:17:20.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.186+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~PE3JUTS21YMI.1 size=1048576 2024-09-14T11:17:20.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.190+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~PE3JUTS21YMI.2 size=235092 2024-09-14T11:17:20.197 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.198+0000 7fe125ff88c0 1 < completed multipart upload key=YCF2PCJ9TZMR upload=PE3JUTS21YMI tag=F971U07TUWO4 type=write size=3380820 2024-09-14T11:17:20.201 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.202+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=W7FCTAER15KF type=del size=2680793 2024-09-14T11:17:20.209 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.210+0000 7fe125ff88c0 1 < suggested remove operation key=YFRH8WECBTJK tag=N2O5R98W3MMC type=del 2024-09-14T11:17:20.216 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.214+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~L8L0NHQCGV8R.0 size=624830 2024-09-14T11:17:20.216 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.214+0000 7fe125ff88c0 1 > prepared multipart upload key=SUCH37O8V1LY upload=L8L0NHQCGV8R tag=RAF5GFJ3V3FM type=write size=1673406 2024-09-14T11:17:20.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.218+0000 7fe125ff88c0 1 < completed delete operation key=YGEVGH840L18 tag=UJ4AHRXV2AO4 type=del 2024-09-14T11:17:20.224 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.222+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=X0675TF1OBDP type=del size=735478 2024-09-14T11:17:20.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.226+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~73WF5QQGHPYO.0 size=1048576 2024-09-14T11:17:20.230 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.230+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~73WF5QQGHPYO.1 size=1011710 2024-09-14T11:17:20.237 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.238+0000 7fe125ff88c0 1 < completed multipart upload key=35EB6U5O4A51 upload=73WF5QQGHPYO tag=NZZQTCJZV4E8 type=write size=3108862 2024-09-14T11:17:20.240 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.242+0000 7fe125ff88c0 1 > prepared operation key=YFRH8WECBTJK tag=6IUC4OFI4F8K type=del size=913753 2024-09-14T11:17:20.244 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.242+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~7SX9R6LQV98K.0 size=1048576 2024-09-14T11:17:20.247 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.246+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~7SX9R6LQV98K.1 size=1048576 2024-09-14T11:17:20.247 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.246+0000 7fe125ff88c0 1 < canceled part key=_multipart_N80X3YUF4OEL.2~7SX9R6LQV98K.2 size=789859 2024-09-14T11:17:20.252 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.250+0000 7fe125ff88c0 1 < canceled multipart upload key=N80X3YUF4OEL upload=7SX9R6LQV98K tag=L9ITWCBXLHU6 type=write size=3935587 2024-09-14T11:17:20.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.258+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~3GJB4H2J1TT4.0 size=253709 2024-09-14T11:17:20.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.258+0000 7fe125ff88c0 1 > prepared multipart upload key=35EB6U5O4A51 upload=3GJB4H2J1TT4 tag=84XF6UQZEGWH type=write size=1302285 2024-09-14T11:17:20.264 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.266+0000 7fe125ff88c0 1 < completed part key=_multipart_WEA3MQ0DI42N.2~SRQV7B4WQ5PX.0 size=161301 2024-09-14T11:17:20.271 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.270+0000 7fe125ff88c0 1 < completed multipart upload key=WEA3MQ0DI42N upload=SRQV7B4WQ5PX tag=UMAB3XCPLAY7 type=write size=1209877 2024-09-14T11:17:20.274 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.274+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=D1ZKPDOKRNJK type=del size=1879138 2024-09-14T11:17:20.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.282+0000 7fe125ff88c0 1 < suggested update operation key=ESVFZQQXE3GT tag=9GEKHSFM3UG1 type=del size=122061 2024-09-14T11:17:20.288 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.290+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~ABL77U0V9ZPX.0 size=1048576 2024-09-14T11:17:20.291 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.290+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~ABL77U0V9ZPX.1 size=587222 2024-09-14T11:17:20.291 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.290+0000 7fe125ff88c0 1 > prepared multipart upload key=SUCH37O8V1LY upload=ABL77U0V9ZPX tag=SPBJPT36H275 type=write size=2684374 2024-09-14T11:17:20.295 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.294+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~ZWE4Q6GBSEFI.0 size=29051 2024-09-14T11:17:20.300 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.302+0000 7fe125ff88c0 1 < completed multipart upload key=3OU4U9JF3ZD5 upload=ZWE4Q6GBSEFI tag=NPZ9UZ172SKV type=write size=1077627 2024-09-14T11:17:20.304 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.302+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=QLCQ9N4Z6QD6 type=del size=1659348 2024-09-14T11:17:20.310 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.310+0000 7fe125ff88c0 1 < suggested update operation key=2LH5U05C2F8C tag=QA8RLK5F82D5 type=del size=1195642 2024-09-14T11:17:20.314 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.314+0000 7fe125ff88c0 1 > prepared operation key=3YGN50MBAF41 tag=31S41BXXCH9H type=del size=2258580 2024-09-14T11:17:20.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.318+0000 7fe125ff88c0 1 < completed delete operation key=L4XO0WTYKNXY tag=XW39R5NVB0BX type=del 2024-09-14T11:17:20.321 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.322+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=W1OUZL6UQY66 type=del size=3083620 2024-09-14T11:17:20.328 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.326+0000 7fe125ff88c0 1 < suggested remove operation key=0VBX2FWYCFEZ tag=SAN5IF4M25JG type=del 2024-09-14T11:17:20.333 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.334+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~11489C9LNM30.0 size=900137 2024-09-14T11:17:20.333 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.334+0000 7fe125ff88c0 1 > prepared multipart upload key=YCF2PCJ9TZMR upload=11489C9LNM30 tag=ABBXIWK7YU5C type=write size=1948713 2024-09-14T11:17:20.336 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.338+0000 7fe125ff88c0 1 < completed delete operation key=V6B470G93KFT tag=L32Y6658JXOI type=del 2024-09-14T11:17:20.340 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.338+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=O4LYKVTF4CWU type=del size=3365806 2024-09-14T11:17:20.344 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.342+0000 7fe125ff88c0 1 < completed delete operation key=L4XO0WTYKNXY tag=FYK4K4NZUIBD type=del 2024-09-14T11:17:20.347 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.346+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=P072CXSDXQ7B type=del size=4092872 2024-09-14T11:17:20.351 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.350+0000 7fe125ff88c0 1 < completed delete operation key=0FITHLGQKQEC tag=XT41GR359EE7 type=del 2024-09-14T11:17:20.354 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.354+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=D338K3R2EKXY type=del size=196642 2024-09-14T11:17:20.358 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.358+0000 7fe125ff88c0 1 < completed delete operation key=LYBGDNKUROWH tag=X9GVNFT058S1 type=del 2024-09-14T11:17:20.361 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.362+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=H8YIFULZGVRW type=del size=3973743 2024-09-14T11:17:20.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.362+0000 7fe125ff88c0 1 < canceled part key=_multipart_1ML6RIXI4C5P.2~Y5YP2XJ9XE78.0 size=453600 2024-09-14T11:17:20.368 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.370+0000 7fe125ff88c0 1 < canceled multipart upload key=1ML6RIXI4C5P upload=Y5YP2XJ9XE78 tag=31Y01AJ392OP type=write size=1502176 2024-09-14T11:17:20.372 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.374+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=TOO37EN5UOF8 type=del size=2382006 2024-09-14T11:17:20.374 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.374+0000 7fe125ff88c0 -1 < no bi entry to suggest for operation key=0VBX2FWYCFEZ tag=W7FCTAER15KF type=del size=2680793: (2) No such file or directory 2024-09-14T11:17:20.381 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.382+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~L6GEVPX6RZS0.0 size=1048576 2024-09-14T11:17:20.383 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.382+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~L6GEVPX6RZS0.1 size=1048576 2024-09-14T11:17:20.386 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.386+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~L6GEVPX6RZS0.2 size=1028550 2024-09-14T11:17:20.386 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.386+0000 7fe125ff88c0 1 > prepared multipart upload key=2LH5U05C2F8C upload=L6GEVPX6RZS0 tag=YVJHXY4SUGFZ type=write size=4174278 2024-09-14T11:17:20.387 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.386+0000 7fe125ff88c0 1 < canceled part key=_multipart_SUCH37O8V1LY.2~L8L0NHQCGV8R.0 size=624830 2024-09-14T11:17:20.393 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.394+0000 7fe125ff88c0 1 < canceled multipart upload key=SUCH37O8V1LY upload=L8L0NHQCGV8R tag=RAF5GFJ3V3FM type=write size=1673406 2024-09-14T11:17:20.397 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.398+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=I37B44VS6SCF type=del size=4119485 2024-09-14T11:17:20.401 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.402+0000 7fe125ff88c0 1 < completed delete operation key=V6B470G93KFT tag=X0675TF1OBDP type=del 2024-09-14T11:17:20.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.406+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=GV98I19950ED type=del size=358513 2024-09-14T11:17:20.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.410+0000 7fe125ff88c0 1 < completed delete operation key=YFRH8WECBTJK tag=6IUC4OFI4F8K type=del 2024-09-14T11:17:20.414 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.414+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~O7B0TH9TRGR3.0 size=1048576 2024-09-14T11:17:20.417 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.418+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~O7B0TH9TRGR3.1 size=885480 2024-09-14T11:17:20.418 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.418+0000 7fe125ff88c0 1 > prepared multipart upload key=ESVFZQQXE3GT upload=O7B0TH9TRGR3 tag=JV53SZ5S8TRI type=write size=2982632 2024-09-14T11:17:20.421 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.422+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~3GJB4H2J1TT4.0 size=253709 2024-09-14T11:17:20.428 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.426+0000 7fe125ff88c0 1 < completed multipart upload key=35EB6U5O4A51 upload=3GJB4H2J1TT4 tag=84XF6UQZEGWH type=write size=1302285 2024-09-14T11:17:20.432 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.434+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=W4L901QUR1GL type=del size=1897062 2024-09-14T11:17:20.437 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.438+0000 7fe125ff88c0 1 < completed delete operation key=SSNV25PDLDIS tag=D1ZKPDOKRNJK type=del 2024-09-14T11:17:20.445 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.446+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~VY07IMEA72J9.0 size=1048576 2024-09-14T11:17:20.448 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.446+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~VY07IMEA72J9.1 size=1048576 2024-09-14T11:17:20.450 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.450+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~VY07IMEA72J9.2 size=398809 2024-09-14T11:17:20.450 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.450+0000 7fe125ff88c0 1 > prepared multipart upload key=21HC4VMHXS6L upload=VY07IMEA72J9 tag=G20KS6NLHG8K type=write size=3544537 2024-09-14T11:17:20.455 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.454+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~ABL77U0V9ZPX.0 size=1048576 2024-09-14T11:17:20.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.458+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~ABL77U0V9ZPX.1 size=587222 2024-09-14T11:17:20.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.462+0000 7fe125ff88c0 1 < completed multipart upload key=SUCH37O8V1LY upload=ABL77U0V9ZPX tag=SPBJPT36H275 type=write size=2684374 2024-09-14T11:17:20.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.466+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=EXN6YGJF5MI0 type=del size=2066802 2024-09-14T11:17:20.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.470+0000 7fe125ff88c0 1 < completed delete operation key=SSNV25PDLDIS tag=QLCQ9N4Z6QD6 type=del 2024-09-14T11:17:20.475 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.474+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=HIVKQG5KEDPP type=del size=433634 2024-09-14T11:17:20.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.482+0000 7fe125ff88c0 1 < suggested remove operation key=3YGN50MBAF41 tag=31S41BXXCH9H type=del 2024-09-14T11:17:20.486 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.486+0000 7fe125ff88c0 1 > prepared operation key=0FITHLGQKQEC tag=G9RDVO0X98BP type=del size=2080259 2024-09-14T11:17:20.490 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.490+0000 7fe125ff88c0 1 < completed delete operation key=WEA3MQ0DI42N tag=W1OUZL6UQY66 type=del 2024-09-14T11:17:20.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.498+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~5HXEAM2266X4.0 size=1048576 2024-09-14T11:17:20.499 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.498+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~5HXEAM2266X4.1 size=1048576 2024-09-14T11:17:20.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.502+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~5HXEAM2266X4.2 size=44401 2024-09-14T11:17:20.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.502+0000 7fe125ff88c0 1 > prepared multipart upload key=2LH5U05C2F8C upload=5HXEAM2266X4 tag=UE4YMGYXQ2E4 type=write size=3190129 2024-09-14T11:17:20.505 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.506+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~11489C9LNM30.0 size=900137 2024-09-14T11:17:20.511 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.510+0000 7fe125ff88c0 1 < completed multipart upload key=YCF2PCJ9TZMR upload=11489C9LNM30 tag=ABBXIWK7YU5C type=write size=1948713 2024-09-14T11:17:20.517 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.518+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=WIJNEXVROMYD type=write size=743101 2024-09-14T11:17:20.521 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.522+0000 7fe125ff88c0 1 < completed delete operation key=2LH5U05C2F8C tag=O4LYKVTF4CWU type=del 2024-09-14T11:17:20.524 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.526+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=SP8TUMWND0F3 type=del size=18321 2024-09-14T11:17:20.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.530+0000 7fe125ff88c0 1 < suggested remove operation key=K3P6U6NU8I01 tag=P072CXSDXQ7B type=del 2024-09-14T11:17:20.538 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.538+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~9KFLJM29YRAC.0 size=1048576 2024-09-14T11:17:20.540 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.542+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~9KFLJM29YRAC.1 size=403165 2024-09-14T11:17:20.540 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.542+0000 7fe125ff88c0 1 > prepared multipart upload key=YGEVGH840L18 upload=9KFLJM29YRAC tag=XP0Y3FMAH797 type=write size=2500317 2024-09-14T11:17:20.544 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.542+0000 7fe125ff88c0 1 < completed delete operation key=WEA3MQ0DI42N tag=D338K3R2EKXY type=del 2024-09-14T11:17:20.548 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.546+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=GD8Q1FKJYIWJ type=write size=1022607 2024-09-14T11:17:20.552 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.550+0000 7fe125ff88c0 1 < completed delete operation key=W0B19NBHNLMZ tag=H8YIFULZGVRW type=del 2024-09-14T11:17:20.558 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.558+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~S3VX3YXDFADI.0 size=1048576 2024-09-14T11:17:20.561 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.562+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~S3VX3YXDFADI.1 size=586105 2024-09-14T11:17:20.561 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.562+0000 7fe125ff88c0 1 > prepared multipart upload key=YN2HI39GPEDF upload=S3VX3YXDFADI tag=0Q1NAOFFJD8K type=write size=2683257 2024-09-14T11:17:20.565 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.566+0000 7fe125ff88c0 1 < canceled operation key=SSNV25PDLDIS tag=TOO37EN5UOF8 type=del size=2382006 2024-09-14T11:17:20.568 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.570+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=KV07WHKA86DQ type=del size=51227 2024-09-14T11:17:20.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.574+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~L6GEVPX6RZS0.0 size=1048576 2024-09-14T11:17:20.575 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.574+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~L6GEVPX6RZS0.1 size=1048576 2024-09-14T11:17:20.578 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.578+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~L6GEVPX6RZS0.2 size=1028550 2024-09-14T11:17:20.584 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.582+0000 7fe125ff88c0 1 < completed multipart upload key=2LH5U05C2F8C upload=L6GEVPX6RZS0 tag=YVJHXY4SUGFZ type=write size=4174278 2024-09-14T11:17:20.588 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.586+0000 7fe125ff88c0 1 > prepared operation key=LYBGDNKUROWH tag=16S1OQAQ1DZG type=del size=1310925 2024-09-14T11:17:20.592 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.590+0000 7fe125ff88c0 1 < completed delete operation key=6PLUU2QIO9LJ tag=I37B44VS6SCF type=del 2024-09-14T11:17:20.595 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.594+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=VJXAU7PPFXZI type=del size=937296 2024-09-14T11:17:20.599 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.598+0000 7fe125ff88c0 1 < completed delete operation key=ESVFZQQXE3GT tag=GV98I19950ED type=del 2024-09-14T11:17:20.607 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.606+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~D3P33VZNMKKZ.0 size=872336 2024-09-14T11:17:20.607 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.606+0000 7fe125ff88c0 1 > prepared multipart upload key=K3P6U6NU8I01 upload=D3P33VZNMKKZ tag=LMGGEXCPSEDV type=write size=1920912 2024-09-14T11:17:20.611 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.610+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~O7B0TH9TRGR3.0 size=1048576 2024-09-14T11:17:20.614 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.614+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~O7B0TH9TRGR3.1 size=885480 2024-09-14T11:17:20.620 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.618+0000 7fe125ff88c0 1 < completed multipart upload key=ESVFZQQXE3GT upload=O7B0TH9TRGR3 tag=JV53SZ5S8TRI type=write size=2982632 2024-09-14T11:17:20.623 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.622+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=P8GZPPY2XN5Y type=write size=560736 2024-09-14T11:17:20.627 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.626+0000 7fe125ff88c0 1 < completed delete operation key=4D2X7151977X tag=W4L901QUR1GL type=del 2024-09-14T11:17:20.631 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.630+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=CWL7G6VUGWZ1 type=del size=2801409 2024-09-14T11:17:20.636 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.634+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~VY07IMEA72J9.0 size=1048576 2024-09-14T11:17:20.639 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.638+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~VY07IMEA72J9.1 size=1048576 2024-09-14T11:17:20.640 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.638+0000 7fe125ff88c0 1 < canceled part key=_multipart_21HC4VMHXS6L.2~VY07IMEA72J9.2 size=398809 2024-09-14T11:17:20.646 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.650+0000 7fe125ff88c0 1 < canceled multipart upload key=21HC4VMHXS6L upload=VY07IMEA72J9 tag=G20KS6NLHG8K type=write size=3544537 2024-09-14T11:17:20.650 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.650+0000 7fe125ff88c0 1 > prepared operation key=6C3JZKTB8BP3 tag=OS11CBWKO3OI type=del size=2876486 2024-09-14T11:17:20.654 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.654+0000 7fe125ff88c0 1 < completed delete operation key=WEA3MQ0DI42N tag=EXN6YGJF5MI0 type=del 2024-09-14T11:17:20.658 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.658+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=M54H1C5JLEO4 type=del size=2220224 2024-09-14T11:17:20.666 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.666+0000 7fe125ff88c0 1 < suggested remove operation key=0VBX2FWYCFEZ tag=HIVKQG5KEDPP type=del 2024-09-14T11:17:20.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.674+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~SBT7C1I6ZCSU.0 size=1048576 2024-09-14T11:17:20.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.678+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~SBT7C1I6ZCSU.1 size=646220 2024-09-14T11:17:20.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.678+0000 7fe125ff88c0 1 > prepared multipart upload key=0FITHLGQKQEC upload=SBT7C1I6ZCSU tag=7E42PUEC4I9L type=write size=2743372 2024-09-14T11:17:20.681 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.682+0000 7fe125ff88c0 1 < completed delete operation key=0FITHLGQKQEC tag=G9RDVO0X98BP type=del 2024-09-14T11:17:20.688 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.686+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~UP4VAZF5IYLR.0 size=1048576 2024-09-14T11:17:20.691 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.690+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~UP4VAZF5IYLR.1 size=1002093 2024-09-14T11:17:20.691 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.690+0000 7fe125ff88c0 1 > prepared multipart upload key=46ZTDBWFVSUH upload=UP4VAZF5IYLR tag=CH1PTC275M2P type=write size=3099245 2024-09-14T11:17:20.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.694+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~5HXEAM2266X4.0 size=1048576 2024-09-14T11:17:20.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.698+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~5HXEAM2266X4.1 size=1048576 2024-09-14T11:17:20.703 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.702+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~5HXEAM2266X4.2 size=44401 2024-09-14T11:17:20.709 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.710+0000 7fe125ff88c0 1 < completed multipart upload key=2LH5U05C2F8C upload=5HXEAM2266X4 tag=UE4YMGYXQ2E4 type=write size=3190129 2024-09-14T11:17:20.713 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.714+0000 7fe125ff88c0 1 > prepared operation key=3YGN50MBAF41 tag=VIFWGOXYOAEI type=write size=664068 2024-09-14T11:17:20.716 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.718+0000 7fe125ff88c0 1 < completed write operation key=35EB6U5O4A51 tag=WIJNEXVROMYD type=write size=743101 2024-09-14T11:17:20.720 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.718+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=ZBW45UGIFNEB type=write size=764551 2024-09-14T11:17:20.724 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.722+0000 7fe125ff88c0 1 < completed delete operation key=6PLUU2QIO9LJ tag=SP8TUMWND0F3 type=del 2024-09-14T11:17:20.731 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.730+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~2895UQSKCMJR.0 size=1048576 2024-09-14T11:17:20.733 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.734+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~2895UQSKCMJR.1 size=1048576 2024-09-14T11:17:20.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.734+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~2895UQSKCMJR.2 size=86449 2024-09-14T11:17:20.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.734+0000 7fe125ff88c0 1 > prepared multipart upload key=FQ5WT12KB664 upload=2895UQSKCMJR tag=BVQS44CWVAKO type=write size=3232177 2024-09-14T11:17:20.740 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.738+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~9KFLJM29YRAC.0 size=1048576 2024-09-14T11:17:20.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.742+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~9KFLJM29YRAC.1 size=403165 2024-09-14T11:17:20.748 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.750+0000 7fe125ff88c0 1 < completed multipart upload key=YGEVGH840L18 upload=9KFLJM29YRAC tag=XP0Y3FMAH797 type=write size=2500317 2024-09-14T11:17:20.752 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.754+0000 7fe125ff88c0 1 > prepared operation key=1ML6RIXI4C5P tag=3M9LQQNH9215 type=del size=1866763 2024-09-14T11:17:20.756 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.754+0000 7fe125ff88c0 1 < completed write operation key=4D2X7151977X tag=GD8Q1FKJYIWJ type=write size=1022607 2024-09-14T11:17:20.763 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.762+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~K35VOK8RT9F5.0 size=1048576 2024-09-14T11:17:20.766 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.766+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~K35VOK8RT9F5.1 size=1048576 2024-09-14T11:17:20.769 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.770+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~K35VOK8RT9F5.2 size=937339 2024-09-14T11:17:20.770 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.770+0000 7fe125ff88c0 1 > prepared multipart upload key=2UXA6SXDTUFT upload=K35VOK8RT9F5 tag=ZBGBZKUKYMFH type=write size=4083067 2024-09-14T11:17:20.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.774+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~S3VX3YXDFADI.0 size=1048576 2024-09-14T11:17:20.776 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.778+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~S3VX3YXDFADI.1 size=586105 2024-09-14T11:17:20.782 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.782+0000 7fe125ff88c0 1 < completed multipart upload key=YN2HI39GPEDF upload=S3VX3YXDFADI tag=0Q1NAOFFJD8K type=write size=2683257 2024-09-14T11:17:20.786 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.786+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=Z8CNXU0MVWGT type=del size=1669276 2024-09-14T11:17:20.790 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.790+0000 7fe125ff88c0 1 < completed delete operation key=2UXA6SXDTUFT tag=KV07WHKA86DQ type=del 2024-09-14T11:17:20.797 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.798+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~MUV2NISVICZ5.0 size=1048576 2024-09-14T11:17:20.800 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.798+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~MUV2NISVICZ5.1 size=858212 2024-09-14T11:17:20.800 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.798+0000 7fe125ff88c0 1 > prepared multipart upload key=SUCH37O8V1LY upload=MUV2NISVICZ5 tag=LP08DYQYFMBJ type=write size=2955364 2024-09-14T11:17:20.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.802+0000 7fe125ff88c0 1 < completed delete operation key=LYBGDNKUROWH tag=16S1OQAQ1DZG type=del 2024-09-14T11:17:20.811 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.810+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~XPAFTZHTE2MF.0 size=1048576 2024-09-14T11:17:20.814 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.814+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~XPAFTZHTE2MF.1 size=1048576 2024-09-14T11:17:20.817 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.818+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~XPAFTZHTE2MF.2 size=119469 2024-09-14T11:17:20.817 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.818+0000 7fe125ff88c0 1 > prepared multipart upload key=6C3JZKTB8BP3 upload=XPAFTZHTE2MF tag=R44YDNFFBK1J type=write size=3265197 2024-09-14T11:17:20.821 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.822+0000 7fe125ff88c0 1 < completed delete operation key=21HC4VMHXS6L tag=VJXAU7PPFXZI type=del 2024-09-14T11:17:20.825 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.826+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=TOW9INUJXKGK type=del size=2857352 2024-09-14T11:17:20.828 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.830+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~D3P33VZNMKKZ.0 size=872336 2024-09-14T11:17:20.834 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.834+0000 7fe125ff88c0 1 < completed multipart upload key=K3P6U6NU8I01 upload=D3P33VZNMKKZ tag=LMGGEXCPSEDV type=write size=1920912 2024-09-14T11:17:20.838 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.838+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=8BJI4583U4WV type=del size=246990 2024-09-14T11:17:20.842 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.842+0000 7fe125ff88c0 1 < completed write operation key=6PLUU2QIO9LJ tag=P8GZPPY2XN5Y type=write size=560736 2024-09-14T11:17:20.845 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.846+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=3WJSKBR645CH type=del size=210798 2024-09-14T11:17:20.849 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.850+0000 7fe125ff88c0 1 < canceled operation key=SSNV25PDLDIS tag=CWL7G6VUGWZ1 type=del size=2801409 2024-09-14T11:17:20.853 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.854+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=TK5SUSNRJ8YR type=del size=3628905 2024-09-14T11:17:20.857 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.858+0000 7fe125ff88c0 1 < completed delete operation key=6C3JZKTB8BP3 tag=OS11CBWKO3OI type=del 2024-09-14T11:17:20.864 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.862+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~B64RNBYAZYVM.0 size=1048576 2024-09-14T11:17:20.870 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.870+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~B64RNBYAZYVM.1 size=1048576 2024-09-14T11:17:20.873 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.874+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~B64RNBYAZYVM.2 size=838591 2024-09-14T11:17:20.873 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.874+0000 7fe125ff88c0 1 > prepared multipart upload key=YN2HI39GPEDF upload=B64RNBYAZYVM tag=BWSM9OLJQMO1 type=write size=3984319 2024-09-14T11:17:20.877 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.878+0000 7fe125ff88c0 1 < completed delete operation key=WEA3MQ0DI42N tag=M54H1C5JLEO4 type=del 2024-09-14T11:17:20.881 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.882+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=IKBKCU4VB3I1 type=del size=3039786 2024-09-14T11:17:20.884 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.886+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~SBT7C1I6ZCSU.0 size=1048576 2024-09-14T11:17:20.887 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.886+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~SBT7C1I6ZCSU.1 size=646220 2024-09-14T11:17:20.893 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.894+0000 7fe125ff88c0 1 < completed multipart upload key=0FITHLGQKQEC upload=SBT7C1I6ZCSU tag=7E42PUEC4I9L type=write size=2743372 2024-09-14T11:17:20.897 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.898+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=CJ3T49HGMZZA type=del size=3865962 2024-09-14T11:17:20.897 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.898+0000 7fe125ff88c0 1 < canceled part key=_multipart_46ZTDBWFVSUH.2~UP4VAZF5IYLR.0 size=1048576 2024-09-14T11:17:20.900 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.898+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~UP4VAZF5IYLR.1 size=1002093 2024-09-14T11:17:20.906 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.906+0000 7fe125ff88c0 1 < canceled multipart upload key=46ZTDBWFVSUH upload=UP4VAZF5IYLR tag=CH1PTC275M2P type=write size=3099245 2024-09-14T11:17:20.910 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.910+0000 7fe125ff88c0 1 > prepared operation key=K05LARTJ2QZ3 tag=MQVKIY8I5QWA type=del size=472636 2024-09-14T11:17:20.917 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.918+0000 7fe125ff88c0 1 < suggested remove operation key=3YGN50MBAF41 tag=VIFWGOXYOAEI type=write 2024-09-14T11:17:20.921 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.922+0000 7fe125ff88c0 1 > prepared operation key=N80X3YUF4OEL tag=KPUGKNF1MKY4 type=del size=3957510 2024-09-14T11:17:20.930 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.930+0000 7fe125ff88c0 1 < suggested update operation key=SSNV25PDLDIS tag=ZBW45UGIFNEB type=write size=764551 2024-09-14T11:17:20.934 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.934+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=GI9M9TYTDVHX type=del size=2966517 2024-09-14T11:17:20.938 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.938+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~2895UQSKCMJR.0 size=1048576 2024-09-14T11:17:20.941 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.942+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~2895UQSKCMJR.1 size=1048576 2024-09-14T11:17:20.941 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.942+0000 7fe125ff88c0 1 < canceled part key=_multipart_FQ5WT12KB664.2~2895UQSKCMJR.2 size=86449 2024-09-14T11:17:20.948 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.946+0000 7fe125ff88c0 1 < canceled multipart upload key=FQ5WT12KB664 upload=2895UQSKCMJR tag=BVQS44CWVAKO type=write size=3232177 2024-09-14T11:17:20.952 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.950+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=3ZGDJ8DH1AZI type=del size=584540 2024-09-14T11:17:20.956 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.958+0000 7fe125ff88c0 1 < completed delete operation key=1ML6RIXI4C5P tag=3M9LQQNH9215 type=del 2024-09-14T11:17:20.960 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.958+0000 7fe125ff88c0 1 > prepared operation key=YFRH8WECBTJK tag=869VQTV2LKH9 type=del size=2329557 2024-09-14T11:17:20.964 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.962+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~K35VOK8RT9F5.0 size=1048576 2024-09-14T11:17:20.967 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.966+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~K35VOK8RT9F5.1 size=1048576 2024-09-14T11:17:20.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.970+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~K35VOK8RT9F5.2 size=937339 2024-09-14T11:17:20.977 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.978+0000 7fe125ff88c0 1 < completed multipart upload key=2UXA6SXDTUFT upload=K35VOK8RT9F5 tag=ZBGBZKUKYMFH type=write size=4083067 2024-09-14T11:17:20.985 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.986+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~ZJY3KLCIZ1E6.0 size=930930 2024-09-14T11:17:20.985 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.986+0000 7fe125ff88c0 1 > prepared multipart upload key=FQ5WT12KB664 upload=ZJY3KLCIZ1E6 tag=K7FB7JP00UZ1 type=write size=1979506 2024-09-14T11:17:20.989 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.990+0000 7fe125ff88c0 1 < completed delete operation key=35EB6U5O4A51 tag=Z8CNXU0MVWGT type=del 2024-09-14T11:17:20.996 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.994+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~3SW4U6TI6GUT.0 size=1048576 2024-09-14T11:17:20.999 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:20.998+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~3SW4U6TI6GUT.1 size=1048576 2024-09-14T11:17:21.002 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.002+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~3SW4U6TI6GUT.2 size=310968 2024-09-14T11:17:21.002 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.002+0000 7fe125ff88c0 1 > prepared multipart upload key=LYBGDNKUROWH upload=3SW4U6TI6GUT tag=UDKH8HA8K8KD type=write size=3456696 2024-09-14T11:17:21.005 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.006+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~MUV2NISVICZ5.0 size=1048576 2024-09-14T11:17:21.008 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.006+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~MUV2NISVICZ5.1 size=858212 2024-09-14T11:17:21.014 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.014+0000 7fe125ff88c0 1 < completed multipart upload key=SUCH37O8V1LY upload=MUV2NISVICZ5 tag=LP08DYQYFMBJ type=write size=2955364 2024-09-14T11:17:21.019 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.018+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=EWPKXEGHLK1A type=del size=4034532 2024-09-14T11:17:21.023 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.022+0000 7fe125ff88c0 1 < completed part key=_multipart_6C3JZKTB8BP3.2~XPAFTZHTE2MF.0 size=1048576 2024-09-14T11:17:21.026 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.026+0000 7fe125ff88c0 1 < completed part key=_multipart_6C3JZKTB8BP3.2~XPAFTZHTE2MF.1 size=1048576 2024-09-14T11:17:21.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.030+0000 7fe125ff88c0 1 < completed part key=_multipart_6C3JZKTB8BP3.2~XPAFTZHTE2MF.2 size=119469 2024-09-14T11:17:21.034 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.034+0000 7fe125ff88c0 1 < completed multipart upload key=6C3JZKTB8BP3 upload=XPAFTZHTE2MF tag=R44YDNFFBK1J type=write size=3265197 2024-09-14T11:17:21.039 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.038+0000 7fe125ff88c0 1 > prepared part key=_multipart_2KEKSWK0UT6C.2~T3T8ZWEWVYC1.0 size=1048576 2024-09-14T11:17:21.042 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.042+0000 7fe125ff88c0 1 > prepared part key=_multipart_2KEKSWK0UT6C.2~T3T8ZWEWVYC1.1 size=313591 2024-09-14T11:17:21.042 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.042+0000 7fe125ff88c0 1 > prepared multipart upload key=2KEKSWK0UT6C upload=T3T8ZWEWVYC1 tag=NDVZ7XJ9441I type=write size=2410743 2024-09-14T11:17:21.048 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.050+0000 7fe125ff88c0 1 < suggested remove operation key=21HC4VMHXS6L tag=TOW9INUJXKGK type=del 2024-09-14T11:17:21.054 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.054+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~8LDQRSF1WO65.0 size=109965 2024-09-14T11:17:21.054 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.054+0000 7fe125ff88c0 1 > prepared multipart upload key=0FITHLGQKQEC upload=8LDQRSF1WO65 tag=0H1N93T9PMA7 type=write size=1158541 2024-09-14T11:17:21.058 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.058+0000 7fe125ff88c0 1 < completed delete operation key=F9I82N7RQC81 tag=8BJI4583U4WV type=del 2024-09-14T11:17:21.062 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.062+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=4OF0PC573PFY type=del size=3535101 2024-09-14T11:17:21.066 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.066+0000 7fe125ff88c0 1 < completed delete operation key=L4XO0WTYKNXY tag=3WJSKBR645CH type=del 2024-09-14T11:17:21.073 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.074+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~EPGDOH30ELV4.0 size=1048576 2024-09-14T11:17:21.075 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.074+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~EPGDOH30ELV4.1 size=1048576 2024-09-14T11:17:21.078 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.078+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~EPGDOH30ELV4.2 size=670218 2024-09-14T11:17:21.078 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.078+0000 7fe125ff88c0 1 > prepared multipart upload key=L4XO0WTYKNXY upload=EPGDOH30ELV4 tag=6CY6CSXEOT4Q type=write size=3815946 2024-09-14T11:17:21.081 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.082+0000 7fe125ff88c0 1 < canceled operation key=YGEVGH840L18 tag=TK5SUSNRJ8YR type=del size=3628905 2024-09-14T11:17:21.087 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.086+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~0KO3P393UQPC.0 size=1048576 2024-09-14T11:17:21.090 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.090+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~0KO3P393UQPC.1 size=904733 2024-09-14T11:17:21.090 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.090+0000 7fe125ff88c0 1 > prepared multipart upload key=N80X3YUF4OEL upload=0KO3P393UQPC tag=TQ3Z0217RSJG type=write size=3001885 2024-09-14T11:17:21.094 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.094+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~B64RNBYAZYVM.0 size=1048576 2024-09-14T11:17:21.097 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.098+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~B64RNBYAZYVM.1 size=1048576 2024-09-14T11:17:21.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.098+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~B64RNBYAZYVM.2 size=838591 2024-09-14T11:17:21.105 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.106+0000 7fe125ff88c0 1 < completed multipart upload key=YN2HI39GPEDF upload=B64RNBYAZYVM tag=BWSM9OLJQMO1 type=write size=3984319 2024-09-14T11:17:21.111 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.110+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~SSCNJ0JROIYG.0 size=756828 2024-09-14T11:17:21.111 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.110+0000 7fe125ff88c0 1 > prepared multipart upload key=SSNV25PDLDIS upload=SSCNJ0JROIYG tag=T75AS9TR5RDF type=write size=1805404 2024-09-14T11:17:21.115 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.114+0000 7fe125ff88c0 1 < completed delete operation key=0VBX2FWYCFEZ tag=IKBKCU4VB3I1 type=del 2024-09-14T11:17:21.121 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.122+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~KNJ9DXW51NPR.0 size=894964 2024-09-14T11:17:21.121 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.122+0000 7fe125ff88c0 1 > prepared multipart upload key=LYBGDNKUROWH upload=KNJ9DXW51NPR tag=97ED62GNJ5VQ type=write size=1943540 2024-09-14T11:17:21.124 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.122+0000 7fe125ff88c0 1 < completed delete operation key=F9I82N7RQC81 tag=CJ3T49HGMZZA type=del 2024-09-14T11:17:21.130 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.130+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~MY98FK9UBTGN.0 size=171313 2024-09-14T11:17:21.130 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.130+0000 7fe125ff88c0 1 > prepared multipart upload key=N80X3YUF4OEL upload=MY98FK9UBTGN tag=12DN6IL35I69 type=write size=1219889 2024-09-14T11:17:21.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.134+0000 7fe125ff88c0 1 < completed delete operation key=K05LARTJ2QZ3 tag=MQVKIY8I5QWA type=del 2024-09-14T11:17:21.137 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.138+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=Q3H6TKXL2PJS type=del size=3816524 2024-09-14T11:17:21.141 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.142+0000 7fe125ff88c0 1 < completed delete operation key=N80X3YUF4OEL tag=KPUGKNF1MKY4 type=del 2024-09-14T11:17:21.147 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.146+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~1WFWBVK10ZZQ.0 size=1048576 2024-09-14T11:17:21.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.150+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~1WFWBVK10ZZQ.1 size=812536 2024-09-14T11:17:21.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.150+0000 7fe125ff88c0 1 > prepared multipart upload key=ESVFZQQXE3GT upload=1WFWBVK10ZZQ tag=YXJEOX4AS5CS type=write size=2909688 2024-09-14T11:17:21.153 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.154+0000 7fe125ff88c0 1 < completed delete operation key=4D2X7151977X tag=GI9M9TYTDVHX type=del 2024-09-14T11:17:21.159 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.158+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~W4MEP3W3SAWJ.0 size=112580 2024-09-14T11:17:21.159 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.158+0000 7fe125ff88c0 1 > prepared multipart upload key=2LH5U05C2F8C upload=W4MEP3W3SAWJ tag=U88PSNX9YY6D type=write size=1161156 2024-09-14T11:17:21.163 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.162+0000 7fe125ff88c0 1 < completed delete operation key=4D2X7151977X tag=3ZGDJ8DH1AZI type=del 2024-09-14T11:17:21.166 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.166+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=ND07IRGWCTRP type=del size=1660393 2024-09-14T11:17:21.170 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.170+0000 7fe125ff88c0 1 < completed delete operation key=YFRH8WECBTJK tag=869VQTV2LKH9 type=del 2024-09-14T11:17:21.173 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.174+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=CIKZWRHD676J type=del size=2439555 2024-09-14T11:17:21.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.178+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~ZJY3KLCIZ1E6.0 size=930930 2024-09-14T11:17:21.182 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.182+0000 7fe125ff88c0 1 < completed multipart upload key=FQ5WT12KB664 upload=ZJY3KLCIZ1E6 tag=K7FB7JP00UZ1 type=write size=1979506 2024-09-14T11:17:21.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.186+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~DVO1WVZ2KVWA.0 size=1048576 2024-09-14T11:17:21.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.190+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~DVO1WVZ2KVWA.1 size=726049 2024-09-14T11:17:21.191 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.190+0000 7fe125ff88c0 1 > prepared multipart upload key=0VBX2FWYCFEZ upload=DVO1WVZ2KVWA tag=7JDHKLLWFAK1 type=write size=2823201 2024-09-14T11:17:21.194 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.194+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~3SW4U6TI6GUT.0 size=1048576 2024-09-14T11:17:21.196 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.194+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~3SW4U6TI6GUT.1 size=1048576 2024-09-14T11:17:21.201 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.202+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~3SW4U6TI6GUT.2 size=310968 2024-09-14T11:17:21.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.206+0000 7fe125ff88c0 1 < completed multipart upload key=LYBGDNKUROWH upload=3SW4U6TI6GUT tag=UDKH8HA8K8KD type=write size=3456696 2024-09-14T11:17:21.210 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.210+0000 7fe125ff88c0 1 > prepared operation key=6C3JZKTB8BP3 tag=BNT9MSOJAP8W type=del size=2840766 2024-09-14T11:17:21.214 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.214+0000 7fe125ff88c0 1 < canceled operation key=YCF2PCJ9TZMR tag=EWPKXEGHLK1A type=del size=4034532 2024-09-14T11:17:21.218 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.218+0000 7fe125ff88c0 1 > prepared operation key=0FITHLGQKQEC tag=AEQ81WU5ZZHZ type=del size=2938901 2024-09-14T11:17:21.222 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.222+0000 7fe125ff88c0 1 < completed part key=_multipart_2KEKSWK0UT6C.2~T3T8ZWEWVYC1.0 size=1048576 2024-09-14T11:17:21.222 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.222+0000 7fe125ff88c0 1 < canceled part key=_multipart_2KEKSWK0UT6C.2~T3T8ZWEWVYC1.1 size=313591 2024-09-14T11:17:21.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.226+0000 7fe125ff88c0 1 < canceled multipart upload key=2KEKSWK0UT6C upload=T3T8ZWEWVYC1 tag=NDVZ7XJ9441I type=write size=2410743 2024-09-14T11:17:21.234 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.234+0000 7fe125ff88c0 1 > prepared part key=_multipart_N94D3R7IOBNL.2~CQ24VTB0DIKN.0 size=520086 2024-09-14T11:17:21.234 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.234+0000 7fe125ff88c0 1 > prepared multipart upload key=N94D3R7IOBNL upload=CQ24VTB0DIKN tag=UY2NKVT7WK33 type=write size=1568662 2024-09-14T11:17:21.238 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.238+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~8LDQRSF1WO65.0 size=109965 2024-09-14T11:17:21.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.242+0000 7fe125ff88c0 1 < completed multipart upload key=0FITHLGQKQEC upload=8LDQRSF1WO65 tag=0H1N93T9PMA7 type=write size=1158541 2024-09-14T11:17:21.248 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.250+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~P7MG76Q8Z0VQ.0 size=981482 2024-09-14T11:17:21.249 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.250+0000 7fe125ff88c0 1 > prepared multipart upload key=SSNV25PDLDIS upload=P7MG76Q8Z0VQ tag=5U7SWQ0M7MQR type=write size=2030058 2024-09-14T11:17:21.252 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.250+0000 7fe125ff88c0 1 < completed delete operation key=6PLUU2QIO9LJ tag=4OF0PC573PFY type=del 2024-09-14T11:17:21.257 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.258+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~PEQPDR5YMK3W.0 size=1048576 2024-09-14T11:17:21.259 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.258+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~PEQPDR5YMK3W.1 size=1048576 2024-09-14T11:17:21.262 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.262+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~PEQPDR5YMK3W.2 size=804947 2024-09-14T11:17:21.262 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.262+0000 7fe125ff88c0 1 > prepared multipart upload key=YCF2PCJ9TZMR upload=PEQPDR5YMK3W tag=5DWNA07RGLI9 type=write size=3950675 2024-09-14T11:17:21.265 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.266+0000 7fe125ff88c0 1 < completed part key=_multipart_L4XO0WTYKNXY.2~EPGDOH30ELV4.0 size=1048576 2024-09-14T11:17:21.267 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.266+0000 7fe125ff88c0 1 < completed part key=_multipart_L4XO0WTYKNXY.2~EPGDOH30ELV4.1 size=1048576 2024-09-14T11:17:21.270 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.270+0000 7fe125ff88c0 1 < completed part key=_multipart_L4XO0WTYKNXY.2~EPGDOH30ELV4.2 size=670218 2024-09-14T11:17:21.275 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.274+0000 7fe125ff88c0 1 < completed multipart upload key=L4XO0WTYKNXY upload=EPGDOH30ELV4 tag=6CY6CSXEOT4Q type=write size=3815946 2024-09-14T11:17:21.278 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.278+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=EGU598FNLBND type=del size=2209029 2024-09-14T11:17:21.281 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.282+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~0KO3P393UQPC.0 size=1048576 2024-09-14T11:17:21.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.282+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~0KO3P393UQPC.1 size=904733 2024-09-14T11:17:21.289 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.290+0000 7fe125ff88c0 1 < completed multipart upload key=N80X3YUF4OEL upload=0KO3P393UQPC tag=TQ3Z0217RSJG type=write size=3001885 2024-09-14T11:17:21.295 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.294+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~UMMEFJ7HPVXS.0 size=438934 2024-09-14T11:17:21.295 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.294+0000 7fe125ff88c0 1 > prepared multipart upload key=46ZTDBWFVSUH upload=UMMEFJ7HPVXS tag=I0Z26ACTZHXT type=write size=1487510 2024-09-14T11:17:21.298 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.298+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~SSCNJ0JROIYG.0 size=756828 2024-09-14T11:17:21.303 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.302+0000 7fe125ff88c0 1 < completed multipart upload key=SSNV25PDLDIS upload=SSCNJ0JROIYG tag=T75AS9TR5RDF type=write size=1805404 2024-09-14T11:17:21.309 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.310+0000 7fe125ff88c0 1 > prepared part key=_multipart_6PLUU2QIO9LJ.2~1SR116V4ZF47.0 size=1048576 2024-09-14T11:17:21.312 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.310+0000 7fe125ff88c0 1 > prepared part key=_multipart_6PLUU2QIO9LJ.2~1SR116V4ZF47.1 size=1048576 2024-09-14T11:17:21.314 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.314+0000 7fe125ff88c0 1 > prepared part key=_multipart_6PLUU2QIO9LJ.2~1SR116V4ZF47.2 size=766115 2024-09-14T11:17:21.314 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.314+0000 7fe125ff88c0 1 > prepared multipart upload key=6PLUU2QIO9LJ upload=1SR116V4ZF47 tag=87EF7174YQNL type=write size=3911843 2024-09-14T11:17:21.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.318+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~KNJ9DXW51NPR.0 size=894964 2024-09-14T11:17:21.323 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.322+0000 7fe125ff88c0 1 < completed multipart upload key=LYBGDNKUROWH upload=KNJ9DXW51NPR tag=97ED62GNJ5VQ type=write size=1943540 2024-09-14T11:17:21.329 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.330+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~J4OJ47IJ4VY1.0 size=1048576 2024-09-14T11:17:21.332 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.330+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~J4OJ47IJ4VY1.1 size=96471 2024-09-14T11:17:21.332 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.330+0000 7fe125ff88c0 1 > prepared multipart upload key=W0B19NBHNLMZ upload=J4OJ47IJ4VY1 tag=9T5W8P6IJEBZ type=write size=2193623 2024-09-14T11:17:21.336 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.334+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~MY98FK9UBTGN.0 size=171313 2024-09-14T11:17:21.341 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.342+0000 7fe125ff88c0 1 < completed multipart upload key=N80X3YUF4OEL upload=MY98FK9UBTGN tag=12DN6IL35I69 type=write size=1219889 2024-09-14T11:17:21.345 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.346+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=4KSYHH58GOZO type=del size=3962284 2024-09-14T11:17:21.351 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.350+0000 7fe125ff88c0 1 < suggested remove operation key=2LH5U05C2F8C tag=Q3H6TKXL2PJS type=del 2024-09-14T11:17:21.356 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.354+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~BATNPQXIHNZB.0 size=550303 2024-09-14T11:17:21.356 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.354+0000 7fe125ff88c0 1 > prepared multipart upload key=YCF2PCJ9TZMR upload=BATNPQXIHNZB tag=D8G0DKHE0Z5N type=write size=1598879 2024-09-14T11:17:21.360 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.358+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~1WFWBVK10ZZQ.0 size=1048576 2024-09-14T11:17:21.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.362+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~1WFWBVK10ZZQ.1 size=812536 2024-09-14T11:17:21.369 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.370+0000 7fe125ff88c0 1 < completed multipart upload key=ESVFZQQXE3GT upload=1WFWBVK10ZZQ tag=YXJEOX4AS5CS type=write size=2909688 2024-09-14T11:17:21.375 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.374+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~7MITAURNGXRO.0 size=1048576 2024-09-14T11:17:21.378 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.378+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~7MITAURNGXRO.1 size=1048576 2024-09-14T11:17:21.381 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.382+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~7MITAURNGXRO.2 size=63604 2024-09-14T11:17:21.381 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.382+0000 7fe125ff88c0 1 > prepared multipart upload key=SUCH37O8V1LY upload=7MITAURNGXRO tag=U71GN8437EG9 type=write size=3209332 2024-09-14T11:17:21.385 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.386+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~W4MEP3W3SAWJ.0 size=112580 2024-09-14T11:17:21.391 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.390+0000 7fe125ff88c0 1 < completed multipart upload key=2LH5U05C2F8C upload=W4MEP3W3SAWJ tag=U88PSNX9YY6D type=write size=1161156 2024-09-14T11:17:21.398 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.398+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~GHHP2Y4KHJKK.0 size=1048576 2024-09-14T11:17:21.401 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.402+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~GHHP2Y4KHJKK.1 size=219149 2024-09-14T11:17:21.401 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.402+0000 7fe125ff88c0 1 > prepared multipart upload key=YCF2PCJ9TZMR upload=GHHP2Y4KHJKK tag=DHDWFZE12ZMN type=write size=2316301 2024-09-14T11:17:21.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.406+0000 7fe125ff88c0 1 < completed delete operation key=W0B19NBHNLMZ tag=ND07IRGWCTRP type=del 2024-09-14T11:17:21.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.406+0000 7fe125ff88c0 1 > prepared operation key=46ZTDBWFVSUH tag=KCH4G4KOQ42X type=del size=2400131 2024-09-14T11:17:21.411 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.410+0000 7fe125ff88c0 1 < completed delete operation key=N94D3R7IOBNL tag=CIKZWRHD676J type=del 2024-09-14T11:17:21.416 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.414+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=OB3UYEVORTP4 type=write size=135718 2024-09-14T11:17:21.419 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.418+0000 7fe125ff88c0 1 < completed part key=_multipart_0VBX2FWYCFEZ.2~DVO1WVZ2KVWA.0 size=1048576 2024-09-14T11:17:21.422 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.422+0000 7fe125ff88c0 1 < completed part key=_multipart_0VBX2FWYCFEZ.2~DVO1WVZ2KVWA.1 size=726049 2024-09-14T11:17:21.428 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.426+0000 7fe125ff88c0 1 < completed multipart upload key=0VBX2FWYCFEZ upload=DVO1WVZ2KVWA tag=7JDHKLLWFAK1 type=write size=2823201 2024-09-14T11:17:21.431 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.430+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=Q4LPWGEL9JG4 type=del size=2656505 2024-09-14T11:17:21.435 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.434+0000 7fe125ff88c0 1 < canceled operation key=6C3JZKTB8BP3 tag=BNT9MSOJAP8W type=del size=2840766 2024-09-14T11:17:21.442 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.442+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~F3XE209IP1N5.0 size=1048576 2024-09-14T11:17:21.445 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.446+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~F3XE209IP1N5.1 size=470121 2024-09-14T11:17:21.445 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.446+0000 7fe125ff88c0 1 > prepared multipart upload key=K3P6U6NU8I01 upload=F3XE209IP1N5 tag=SBLN5J1C4YB6 type=write size=2567273 2024-09-14T11:17:21.452 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.450+0000 7fe125ff88c0 1 < suggested remove operation key=0FITHLGQKQEC tag=AEQ81WU5ZZHZ type=del 2024-09-14T11:17:21.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.458+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=2RWU4RR1DY9J type=del size=731054 2024-09-14T11:17:21.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.462+0000 7fe125ff88c0 1 < completed part key=_multipart_N94D3R7IOBNL.2~CQ24VTB0DIKN.0 size=520086 2024-09-14T11:17:21.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.466+0000 7fe125ff88c0 1 < completed multipart upload key=N94D3R7IOBNL upload=CQ24VTB0DIKN tag=UY2NKVT7WK33 type=write size=1568662 2024-09-14T11:17:21.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.470+0000 7fe125ff88c0 1 > prepared operation key=SUCH37O8V1LY tag=2O9KXZNA71N6 type=del size=3832772 2024-09-14T11:17:21.475 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.474+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~P7MG76Q8Z0VQ.0 size=981482 2024-09-14T11:17:21.481 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.482+0000 7fe125ff88c0 1 < completed multipart upload key=SSNV25PDLDIS upload=P7MG76Q8Z0VQ tag=5U7SWQ0M7MQR type=write size=2030058 2024-09-14T11:17:21.488 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.486+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~3TVIG61HM7HB.0 size=1048576 2024-09-14T11:17:21.491 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.490+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~3TVIG61HM7HB.1 size=1048576 2024-09-14T11:17:21.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.494+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~3TVIG61HM7HB.2 size=745539 2024-09-14T11:17:21.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.494+0000 7fe125ff88c0 1 > prepared multipart upload key=2LH5U05C2F8C upload=3TVIG61HM7HB tag=5A7W22Y205QS type=write size=3891267 2024-09-14T11:17:21.498 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.498+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~PEQPDR5YMK3W.0 size=1048576 2024-09-14T11:17:21.500 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.502+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~PEQPDR5YMK3W.1 size=1048576 2024-09-14T11:17:21.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.502+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~PEQPDR5YMK3W.2 size=804947 2024-09-14T11:17:21.510 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.510+0000 7fe125ff88c0 1 < completed multipart upload key=YCF2PCJ9TZMR upload=PEQPDR5YMK3W tag=5DWNA07RGLI9 type=write size=3950675 2024-09-14T11:17:21.521 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.522+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~5ZS17IZHZTXO.0 size=1048576 2024-09-14T11:17:21.524 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.522+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~5ZS17IZHZTXO.1 size=825462 2024-09-14T11:17:21.524 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.522+0000 7fe125ff88c0 1 > prepared multipart upload key=V6B470G93KFT upload=5ZS17IZHZTXO tag=XJPA8IVVA6CG type=write size=2922614 2024-09-14T11:17:21.528 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.526+0000 7fe125ff88c0 1 < completed delete operation key=V6B470G93KFT tag=EGU598FNLBND type=del 2024-09-14T11:17:21.535 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.534+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~JUJZPM9RVQ21.0 size=492799 2024-09-14T11:17:21.535 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.534+0000 7fe125ff88c0 1 > prepared multipart upload key=K05LARTJ2QZ3 upload=JUJZPM9RVQ21 tag=TJHH2WFBRRXJ type=write size=1541375 2024-09-14T11:17:21.539 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.538+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~UMMEFJ7HPVXS.0 size=438934 2024-09-14T11:17:21.545 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.546+0000 7fe125ff88c0 1 < completed multipart upload key=46ZTDBWFVSUH upload=UMMEFJ7HPVXS tag=I0Z26ACTZHXT type=write size=1487510 2024-09-14T11:17:21.553 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.554+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~KWCZSMMLXHN9.0 size=590364 2024-09-14T11:17:21.553 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.554+0000 7fe125ff88c0 1 > prepared multipart upload key=3YGN50MBAF41 upload=KWCZSMMLXHN9 tag=26OOMT3IR8B5 type=write size=1638940 2024-09-14T11:17:21.557 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.558+0000 7fe125ff88c0 1 < completed part key=_multipart_6PLUU2QIO9LJ.2~1SR116V4ZF47.0 size=1048576 2024-09-14T11:17:21.560 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.558+0000 7fe125ff88c0 1 < completed part key=_multipart_6PLUU2QIO9LJ.2~1SR116V4ZF47.1 size=1048576 2024-09-14T11:17:21.563 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.562+0000 7fe125ff88c0 1 < completed part key=_multipart_6PLUU2QIO9LJ.2~1SR116V4ZF47.2 size=766115 2024-09-14T11:17:21.569 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.570+0000 7fe125ff88c0 1 < completed multipart upload key=6PLUU2QIO9LJ upload=1SR116V4ZF47 tag=87EF7174YQNL type=write size=3911843 2024-09-14T11:17:21.575 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.574+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~AEQ8WMRJEWYT.0 size=1048576 2024-09-14T11:17:21.578 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.578+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~AEQ8WMRJEWYT.1 size=842182 2024-09-14T11:17:21.578 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.578+0000 7fe125ff88c0 1 > prepared multipart upload key=FQ5WT12KB664 upload=AEQ8WMRJEWYT tag=GGWZWP4ZAA9O type=write size=2939334 2024-09-14T11:17:21.582 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.582+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~J4OJ47IJ4VY1.0 size=1048576 2024-09-14T11:17:21.585 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.590+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~J4OJ47IJ4VY1.1 size=96471 2024-09-14T11:17:21.591 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.590+0000 7fe125ff88c0 1 < completed multipart upload key=W0B19NBHNLMZ upload=J4OJ47IJ4VY1 tag=9T5W8P6IJEBZ type=write size=2193623 2024-09-14T11:17:21.595 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.594+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=RJCQV1YANFQO type=del size=3037773 2024-09-14T11:17:21.599 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.598+0000 7fe125ff88c0 1 < completed delete operation key=SSNV25PDLDIS tag=4KSYHH58GOZO type=del 2024-09-14T11:17:21.607 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.606+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~3LWYXHB28U63.0 size=1048576 2024-09-14T11:17:21.610 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.610+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~3LWYXHB28U63.1 size=1048576 2024-09-14T11:17:21.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.614+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~3LWYXHB28U63.2 size=429512 2024-09-14T11:17:21.613 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.614+0000 7fe125ff88c0 1 > prepared multipart upload key=35EB6U5O4A51 upload=3LWYXHB28U63 tag=5VNW86XWBW21 type=write size=3575240 2024-09-14T11:17:21.616 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.614+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~BATNPQXIHNZB.0 size=550303 2024-09-14T11:17:21.623 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.622+0000 7fe125ff88c0 1 < completed multipart upload key=YCF2PCJ9TZMR upload=BATNPQXIHNZB tag=D8G0DKHE0Z5N type=write size=1598879 2024-09-14T11:17:21.626 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.626+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=15PDH9MANF5W type=del size=2167647 2024-09-14T11:17:21.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.626+0000 7fe125ff88c0 1 < canceled part key=_multipart_SUCH37O8V1LY.2~7MITAURNGXRO.0 size=1048576 2024-09-14T11:17:21.632 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.630+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~7MITAURNGXRO.1 size=1048576 2024-09-14T11:17:21.634 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.634+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~7MITAURNGXRO.2 size=63604 2024-09-14T11:17:21.640 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.638+0000 7fe125ff88c0 1 < canceled multipart upload key=SUCH37O8V1LY upload=7MITAURNGXRO tag=U71GN8437EG9 type=write size=3209332 2024-09-14T11:17:21.647 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.646+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~VSMTAJ8JSI6G.0 size=584610 2024-09-14T11:17:21.647 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.646+0000 7fe125ff88c0 1 > prepared multipart upload key=YFRH8WECBTJK upload=VSMTAJ8JSI6G tag=VDGT7Q3BWJR7 type=write size=1633186 2024-09-14T11:17:21.651 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.650+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~GHHP2Y4KHJKK.0 size=1048576 2024-09-14T11:17:21.654 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.658+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~GHHP2Y4KHJKK.1 size=219149 2024-09-14T11:17:21.659 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.658+0000 7fe125ff88c0 1 < completed multipart upload key=YCF2PCJ9TZMR upload=GHHP2Y4KHJKK tag=DHDWFZE12ZMN type=write size=2316301 2024-09-14T11:17:21.663 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.662+0000 7fe125ff88c0 1 > prepared operation key=3OU4U9JF3ZD5 tag=GIC7V228Z9UP type=write size=923399 2024-09-14T11:17:21.667 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.666+0000 7fe125ff88c0 1 < completed delete operation key=46ZTDBWFVSUH tag=KCH4G4KOQ42X type=del 2024-09-14T11:17:21.673 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.674+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~0HK0QJ9IEPDF.0 size=897187 2024-09-14T11:17:21.673 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.674+0000 7fe125ff88c0 1 > prepared multipart upload key=LYBGDNKUROWH upload=0HK0QJ9IEPDF tag=7KY9V5LU0QZ1 type=write size=1945763 2024-09-14T11:17:21.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.678+0000 7fe125ff88c0 1 < completed write operation key=N94D3R7IOBNL tag=OB3UYEVORTP4 type=write size=135718 2024-09-14T11:17:21.681 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.682+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=3JYPP6HUL7LF type=del size=524699 2024-09-14T11:17:21.685 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.686+0000 7fe125ff88c0 1 < completed delete operation key=K3P6U6NU8I01 tag=Q4LPWGEL9JG4 type=del 2024-09-14T11:17:21.692 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.690+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~TFCX93E4ITVV.0 size=1048576 2024-09-14T11:17:21.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.694+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~TFCX93E4ITVV.1 size=1048576 2024-09-14T11:17:21.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.698+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~TFCX93E4ITVV.2 size=6454 2024-09-14T11:17:21.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.698+0000 7fe125ff88c0 1 > prepared multipart upload key=N80X3YUF4OEL upload=TFCX93E4ITVV tag=FW51GW0NNJ0S type=write size=3152182 2024-09-14T11:17:21.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.702+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~F3XE209IP1N5.0 size=1048576 2024-09-14T11:17:21.705 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.706+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~F3XE209IP1N5.1 size=470121 2024-09-14T11:17:21.711 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.710+0000 7fe125ff88c0 1 < completed multipart upload key=K3P6U6NU8I01 upload=F3XE209IP1N5 tag=SBLN5J1C4YB6 type=write size=2567273 2024-09-14T11:17:21.715 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.714+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=LN2RX5R4LOX2 type=del size=1888330 2024-09-14T11:17:21.719 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.718+0000 7fe125ff88c0 1 < completed delete operation key=4D2X7151977X tag=2RWU4RR1DY9J type=del 2024-09-14T11:17:21.723 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.722+0000 7fe125ff88c0 1 > prepared operation key=6C3JZKTB8BP3 tag=CIR44TSYLQER type=del size=852647 2024-09-14T11:17:21.726 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.726+0000 7fe125ff88c0 1 < completed delete operation key=SUCH37O8V1LY tag=2O9KXZNA71N6 type=del 2024-09-14T11:17:21.733 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.734+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~OC9NXOXBFRIM.0 size=840230 2024-09-14T11:17:21.733 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.734+0000 7fe125ff88c0 1 > prepared multipart upload key=SUCH37O8V1LY upload=OC9NXOXBFRIM tag=HTMG0X77NQUU type=write size=1888806 2024-09-14T11:17:21.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.738+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~3TVIG61HM7HB.0 size=1048576 2024-09-14T11:17:21.740 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.738+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~3TVIG61HM7HB.1 size=1048576 2024-09-14T11:17:21.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.742+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~3TVIG61HM7HB.2 size=745539 2024-09-14T11:17:21.750 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.750+0000 7fe125ff88c0 1 < completed multipart upload key=2LH5U05C2F8C upload=3TVIG61HM7HB tag=5A7W22Y205QS type=write size=3891267 2024-09-14T11:17:21.754 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.754+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=B94JPEHPJJU8 type=del size=1063505 2024-09-14T11:17:21.758 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.758+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~5ZS17IZHZTXO.0 size=1048576 2024-09-14T11:17:21.761 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.762+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~5ZS17IZHZTXO.1 size=825462 2024-09-14T11:17:21.767 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.766+0000 7fe125ff88c0 1 < completed multipart upload key=V6B470G93KFT upload=5ZS17IZHZTXO tag=XJPA8IVVA6CG type=write size=2922614 2024-09-14T11:17:21.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.774+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~NRTYSPF0KB6R.0 size=1048576 2024-09-14T11:17:21.778 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.778+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~NRTYSPF0KB6R.1 size=1048576 2024-09-14T11:17:21.780 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.782+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~NRTYSPF0KB6R.2 size=891448 2024-09-14T11:17:21.781 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.782+0000 7fe125ff88c0 1 > prepared multipart upload key=K3P6U6NU8I01 upload=NRTYSPF0KB6R tag=CR726GJ5N9ON type=write size=4037176 2024-09-14T11:17:21.784 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.786+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~JUJZPM9RVQ21.0 size=492799 2024-09-14T11:17:21.790 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.790+0000 7fe125ff88c0 1 < completed multipart upload key=K05LARTJ2QZ3 upload=JUJZPM9RVQ21 tag=TJHH2WFBRRXJ type=write size=1541375 2024-09-14T11:17:21.797 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.798+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~AU1I30R0R9AL.0 size=1048576 2024-09-14T11:17:21.801 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.802+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~AU1I30R0R9AL.1 size=1048576 2024-09-14T11:17:21.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.802+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~AU1I30R0R9AL.2 size=725196 2024-09-14T11:17:21.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.802+0000 7fe125ff88c0 1 > prepared multipart upload key=0VBX2FWYCFEZ upload=AU1I30R0R9AL tag=073NXK3SK0FE type=write size=3870924 2024-09-14T11:17:21.808 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.810+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~KWCZSMMLXHN9.0 size=590364 2024-09-14T11:17:21.815 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.814+0000 7fe125ff88c0 1 < completed multipart upload key=3YGN50MBAF41 upload=KWCZSMMLXHN9 tag=26OOMT3IR8B5 type=write size=1638940 2024-09-14T11:17:21.821 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.822+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~3HIXZV6CJ2F8.0 size=1048576 2024-09-14T11:17:21.825 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.826+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~3HIXZV6CJ2F8.1 size=531967 2024-09-14T11:17:21.825 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.826+0000 7fe125ff88c0 1 > prepared multipart upload key=SUCH37O8V1LY upload=3HIXZV6CJ2F8 tag=6PHM9RE96IPQ type=write size=2629119 2024-09-14T11:17:21.828 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.830+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~AEQ8WMRJEWYT.0 size=1048576 2024-09-14T11:17:21.831 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.830+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~AEQ8WMRJEWYT.1 size=842182 2024-09-14T11:17:21.837 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.838+0000 7fe125ff88c0 1 < completed multipart upload key=FQ5WT12KB664 upload=AEQ8WMRJEWYT tag=GGWZWP4ZAA9O type=write size=2939334 2024-09-14T11:17:21.844 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.846+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~MJ0WBZY1IGGP.0 size=1048576 2024-09-14T11:17:21.847 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.846+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~MJ0WBZY1IGGP.1 size=1048576 2024-09-14T11:17:21.851 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.850+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~MJ0WBZY1IGGP.2 size=574888 2024-09-14T11:17:21.851 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.850+0000 7fe125ff88c0 1 > prepared multipart upload key=3OU4U9JF3ZD5 upload=MJ0WBZY1IGGP tag=7IG1WXC15JKV type=write size=3720616 2024-09-14T11:17:21.856 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.854+0000 7fe125ff88c0 1 < completed delete operation key=YN2HI39GPEDF tag=RJCQV1YANFQO type=del 2024-09-14T11:17:21.865 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.866+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=L2GFVSQSQYDS type=del size=543388 2024-09-14T11:17:21.898 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.870+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~3LWYXHB28U63.0 size=1048576 2024-09-14T11:17:21.898 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.874+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~3LWYXHB28U63.1 size=1048576 2024-09-14T11:17:21.898 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.874+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~3LWYXHB28U63.2 size=429512 2024-09-14T11:17:21.898 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.882+0000 7fe125ff88c0 1 < completed multipart upload key=35EB6U5O4A51 upload=3LWYXHB28U63 tag=5VNW86XWBW21 type=write size=3575240 2024-09-14T11:17:21.898 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.886+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=TFK5YSIIAXS5 type=del size=3389239 2024-09-14T11:17:21.898 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.894+0000 7fe125ff88c0 1 < completed delete operation key=YCF2PCJ9TZMR tag=15PDH9MANF5W type=del 2024-09-14T11:17:21.898 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.898+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=FNB72LKZO1JJ type=write size=96005 2024-09-14T11:17:21.902 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.902+0000 7fe125ff88c0 1 < completed part key=_multipart_YFRH8WECBTJK.2~VSMTAJ8JSI6G.0 size=584610 2024-09-14T11:17:21.908 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.910+0000 7fe125ff88c0 1 < completed multipart upload key=YFRH8WECBTJK upload=VSMTAJ8JSI6G tag=VDGT7Q3BWJR7 type=write size=1633186 2024-09-14T11:17:21.912 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.910+0000 7fe125ff88c0 1 > prepared operation key=SUCH37O8V1LY tag=JAVDHRZ6SLYO type=del size=2052626 2024-09-14T11:17:21.917 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.918+0000 7fe125ff88c0 1 < canceled operation key=3OU4U9JF3ZD5 tag=GIC7V228Z9UP type=write size=923399 2024-09-14T11:17:21.921 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.922+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=FYO84TO19S38 type=del size=3537324 2024-09-14T11:17:21.925 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.926+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~0HK0QJ9IEPDF.0 size=897187 2024-09-14T11:17:21.932 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.930+0000 7fe125ff88c0 1 < completed multipart upload key=LYBGDNKUROWH upload=0HK0QJ9IEPDF tag=7KY9V5LU0QZ1 type=write size=1945763 2024-09-14T11:17:21.939 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.938+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~H1U2OZ6N3EHD.0 size=877637 2024-09-14T11:17:21.939 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.938+0000 7fe125ff88c0 1 > prepared multipart upload key=F9I82N7RQC81 upload=H1U2OZ6N3EHD tag=ZSK3FID116AQ type=write size=1926213 2024-09-14T11:17:21.943 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.942+0000 7fe125ff88c0 1 < completed delete operation key=2UXA6SXDTUFT tag=3JYPP6HUL7LF type=del 2024-09-14T11:17:21.950 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.950+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~Q24Z5HHWCXJM.0 size=303276 2024-09-14T11:17:21.950 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.950+0000 7fe125ff88c0 1 > prepared multipart upload key=K05LARTJ2QZ3 upload=Q24Z5HHWCXJM tag=LW0PFP7L37QH type=write size=1351852 2024-09-14T11:17:21.954 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.954+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~TFCX93E4ITVV.0 size=1048576 2024-09-14T11:17:21.957 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.958+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~TFCX93E4ITVV.1 size=1048576 2024-09-14T11:17:21.959 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.958+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~TFCX93E4ITVV.2 size=6454 2024-09-14T11:17:21.965 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.966+0000 7fe125ff88c0 1 < completed multipart upload key=N80X3YUF4OEL upload=TFCX93E4ITVV tag=FW51GW0NNJ0S type=write size=3152182 2024-09-14T11:17:21.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.970+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=FOTGY6UKPFR7 type=del size=3972428 2024-09-14T11:17:21.973 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.974+0000 7fe125ff88c0 1 < completed delete operation key=V6B470G93KFT tag=LN2RX5R4LOX2 type=del 2024-09-14T11:17:21.979 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.978+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~304ACBZWQ6UM.0 size=1048576 2024-09-14T11:17:21.982 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.982+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~304ACBZWQ6UM.1 size=533056 2024-09-14T11:17:21.982 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.982+0000 7fe125ff88c0 1 > prepared multipart upload key=L4XO0WTYKNXY upload=304ACBZWQ6UM tag=78TJ340WD6WU type=write size=2630208 2024-09-14T11:17:21.986 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.986+0000 7fe125ff88c0 1 < completed delete operation key=6C3JZKTB8BP3 tag=CIR44TSYLQER type=del 2024-09-14T11:17:21.990 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.990+0000 7fe125ff88c0 1 > prepared operation key=FQ5WT12KB664 tag=GWC3CF30YTDA type=del size=1816697 2024-09-14T11:17:21.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:21.994+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~OC9NXOXBFRIM.0 size=840230 2024-09-14T11:17:22.001 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.002+0000 7fe125ff88c0 1 < completed multipart upload key=SUCH37O8V1LY upload=OC9NXOXBFRIM tag=HTMG0X77NQUU type=write size=1888806 2024-09-14T11:17:22.005 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.006+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=45VY1G2YDSQX type=write size=340480 2024-09-14T11:17:22.009 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.010+0000 7fe125ff88c0 1 < completed delete operation key=2LH5U05C2F8C tag=B94JPEHPJJU8 type=del 2024-09-14T11:17:22.013 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.014+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=70X3SNMEQHXQ type=del size=1958400 2024-09-14T11:17:22.017 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.018+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~NRTYSPF0KB6R.0 size=1048576 2024-09-14T11:17:22.020 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.018+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~NRTYSPF0KB6R.1 size=1048576 2024-09-14T11:17:22.022 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.022+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~NRTYSPF0KB6R.2 size=891448 2024-09-14T11:17:22.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.030+0000 7fe125ff88c0 1 < completed multipart upload key=K3P6U6NU8I01 upload=NRTYSPF0KB6R tag=CR726GJ5N9ON type=write size=4037176 2024-09-14T11:17:22.032 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.034+0000 7fe125ff88c0 1 > prepared operation key=1ML6RIXI4C5P tag=7FSS3IJYDS6X type=del size=3182842 2024-09-14T11:17:22.033 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.034+0000 7fe125ff88c0 1 < canceled part key=_multipart_0VBX2FWYCFEZ.2~AU1I30R0R9AL.0 size=1048576 2024-09-14T11:17:22.036 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.034+0000 7fe125ff88c0 1 < completed part key=_multipart_0VBX2FWYCFEZ.2~AU1I30R0R9AL.1 size=1048576 2024-09-14T11:17:22.039 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.038+0000 7fe125ff88c0 1 < completed part key=_multipart_0VBX2FWYCFEZ.2~AU1I30R0R9AL.2 size=725196 2024-09-14T11:17:22.044 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.046+0000 7fe125ff88c0 1 < canceled multipart upload key=0VBX2FWYCFEZ upload=AU1I30R0R9AL tag=073NXK3SK0FE type=write size=3870924 2024-09-14T11:17:22.048 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.046+0000 7fe125ff88c0 1 > prepared operation key=N80X3YUF4OEL tag=DPR2LXLDLQB7 type=del size=1617238 2024-09-14T11:17:22.052 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.050+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~3HIXZV6CJ2F8.0 size=1048576 2024-09-14T11:17:22.054 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.054+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~3HIXZV6CJ2F8.1 size=531967 2024-09-14T11:17:22.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.062+0000 7fe125ff88c0 1 < completed multipart upload key=SUCH37O8V1LY upload=3HIXZV6CJ2F8 tag=6PHM9RE96IPQ type=write size=2629119 2024-09-14T11:17:22.065 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.066+0000 7fe125ff88c0 1 > prepared operation key=N80X3YUF4OEL tag=TGB04YQ4AH40 type=del size=3363912 2024-09-14T11:17:22.069 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.070+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~MJ0WBZY1IGGP.0 size=1048576 2024-09-14T11:17:22.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.074+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~MJ0WBZY1IGGP.1 size=1048576 2024-09-14T11:17:22.075 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.074+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~MJ0WBZY1IGGP.2 size=574888 2024-09-14T11:17:22.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.082+0000 7fe125ff88c0 1 < completed multipart upload key=3OU4U9JF3ZD5 upload=MJ0WBZY1IGGP tag=7IG1WXC15JKV type=write size=3720616 2024-09-14T11:17:22.090 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.090+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~F8VRG6AONZ8D.0 size=552495 2024-09-14T11:17:22.090 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.090+0000 7fe125ff88c0 1 > prepared multipart upload key=YFRH8WECBTJK upload=F8VRG6AONZ8D tag=6P4D44J04WRD type=write size=1601071 2024-09-14T11:17:22.098 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.098+0000 7fe125ff88c0 1 < suggested update operation key=6PLUU2QIO9LJ tag=L2GFVSQSQYDS type=del size=543388 2024-09-14T11:17:22.105 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.106+0000 7fe125ff88c0 1 > prepared part key=_multipart_2KEKSWK0UT6C.2~3Q75C3U9A6EU.0 size=1048576 2024-09-14T11:17:22.107 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.106+0000 7fe125ff88c0 1 > prepared part key=_multipart_2KEKSWK0UT6C.2~3Q75C3U9A6EU.1 size=1048576 2024-09-14T11:17:22.111 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.110+0000 7fe125ff88c0 1 > prepared part key=_multipart_2KEKSWK0UT6C.2~3Q75C3U9A6EU.2 size=746715 2024-09-14T11:17:22.111 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.110+0000 7fe125ff88c0 1 > prepared multipart upload key=2KEKSWK0UT6C upload=3Q75C3U9A6EU tag=I53WCYKGV5PT type=write size=3892443 2024-09-14T11:17:22.115 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.114+0000 7fe125ff88c0 1 < completed delete operation key=YN2HI39GPEDF tag=TFK5YSIIAXS5 type=del 2024-09-14T11:17:22.122 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.122+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~4W6IE4EFY9EY.0 size=1048576 2024-09-14T11:17:22.124 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.126+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~4W6IE4EFY9EY.1 size=445464 2024-09-14T11:17:22.124 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.126+0000 7fe125ff88c0 1 > prepared multipart upload key=46ZTDBWFVSUH upload=4W6IE4EFY9EY tag=MOQRMSM2MJJW type=write size=2542616 2024-09-14T11:17:22.128 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.130+0000 7fe125ff88c0 1 < completed write operation key=21HC4VMHXS6L tag=FNB72LKZO1JJ type=write size=96005 2024-09-14T11:17:22.132 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.130+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=586EXM0LUCMF type=write size=612354 2024-09-14T11:17:22.136 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.134+0000 7fe125ff88c0 1 < completed delete operation key=SUCH37O8V1LY tag=JAVDHRZ6SLYO type=del 2024-09-14T11:17:22.140 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.138+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=KKY3X0Q7HWNA type=del size=759286 2024-09-14T11:17:22.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.142+0000 7fe125ff88c0 1 < completed delete operation key=YN2HI39GPEDF tag=FYO84TO19S38 type=del 2024-09-14T11:17:22.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.150+0000 7fe125ff88c0 1 > prepared part key=_multipart_2KEKSWK0UT6C.2~VFHCLW1TFLWX.0 size=1048576 2024-09-14T11:17:22.153 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.154+0000 7fe125ff88c0 1 > prepared part key=_multipart_2KEKSWK0UT6C.2~VFHCLW1TFLWX.1 size=1048576 2024-09-14T11:17:22.156 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.154+0000 7fe125ff88c0 1 > prepared part key=_multipart_2KEKSWK0UT6C.2~VFHCLW1TFLWX.2 size=878233 2024-09-14T11:17:22.156 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.154+0000 7fe125ff88c0 1 > prepared multipart upload key=2KEKSWK0UT6C upload=VFHCLW1TFLWX tag=0WVF5BJNQKS3 type=write size=4023961 2024-09-14T11:17:22.159 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.158+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~H1U2OZ6N3EHD.0 size=877637 2024-09-14T11:17:22.165 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.166+0000 7fe125ff88c0 1 < completed multipart upload key=F9I82N7RQC81 upload=H1U2OZ6N3EHD tag=ZSK3FID116AQ type=write size=1926213 2024-09-14T11:17:22.169 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.170+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=62X0KSACG1GG type=del size=510893 2024-09-14T11:17:22.172 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.174+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~Q24Z5HHWCXJM.0 size=303276 2024-09-14T11:17:22.178 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.178+0000 7fe125ff88c0 1 < completed multipart upload key=K05LARTJ2QZ3 upload=Q24Z5HHWCXJM tag=LW0PFP7L37QH type=write size=1351852 2024-09-14T11:17:22.184 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.186+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~DQQGAAHZ6BA4.0 size=1048576 2024-09-14T11:17:22.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.186+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~DQQGAAHZ6BA4.1 size=61804 2024-09-14T11:17:22.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.186+0000 7fe125ff88c0 1 > prepared multipart upload key=0VBX2FWYCFEZ upload=DQQGAAHZ6BA4 tag=ZEJHYKJISHVC type=write size=2158956 2024-09-14T11:17:22.195 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.194+0000 7fe125ff88c0 1 < suggested remove operation key=6PLUU2QIO9LJ tag=FOTGY6UKPFR7 type=del 2024-09-14T11:17:22.199 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.198+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=OKHPS5PKS88V type=del size=3157091 2024-09-14T11:17:22.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.198+0000 7fe125ff88c0 1 < canceled part key=_multipart_L4XO0WTYKNXY.2~304ACBZWQ6UM.0 size=1048576 2024-09-14T11:17:22.203 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.202+0000 7fe125ff88c0 1 < completed part key=_multipart_L4XO0WTYKNXY.2~304ACBZWQ6UM.1 size=533056 2024-09-14T11:17:22.209 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.210+0000 7fe125ff88c0 1 < canceled multipart upload key=L4XO0WTYKNXY upload=304ACBZWQ6UM tag=78TJ340WD6WU type=write size=2630208 2024-09-14T11:17:22.213 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.214+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=ZQNL5NL26O7I type=del size=2805084 2024-09-14T11:17:22.223 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.222+0000 7fe125ff88c0 1 < suggested remove operation key=FQ5WT12KB664 tag=GWC3CF30YTDA type=del 2024-09-14T11:17:22.229 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.230+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~5FIFEH8W82BZ.0 size=1048576 2024-09-14T11:17:22.232 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.230+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~5FIFEH8W82BZ.1 size=115459 2024-09-14T11:17:22.232 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.230+0000 7fe125ff88c0 1 > prepared multipart upload key=3YGN50MBAF41 upload=5FIFEH8W82BZ tag=4WVVF1C89IWP type=write size=2212611 2024-09-14T11:17:22.236 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.234+0000 7fe125ff88c0 1 < completed write operation key=WEA3MQ0DI42N tag=45VY1G2YDSQX type=write size=340480 2024-09-14T11:17:22.240 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.238+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=8XO4BMM3H70S type=del size=3183493 2024-09-14T11:17:22.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.242+0000 7fe125ff88c0 1 < completed delete operation key=21HC4VMHXS6L tag=70X3SNMEQHXQ type=del 2024-09-14T11:17:22.247 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.246+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=JW7XV2SIQXJ8 type=del size=1516472 2024-09-14T11:17:22.251 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.250+0000 7fe125ff88c0 1 < completed delete operation key=1ML6RIXI4C5P tag=7FSS3IJYDS6X type=del 2024-09-14T11:17:22.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.254+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=IY51PUAAIPBP type=del size=1746756 2024-09-14T11:17:22.259 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.258+0000 7fe125ff88c0 1 < completed delete operation key=N80X3YUF4OEL tag=DPR2LXLDLQB7 type=del 2024-09-14T11:17:22.263 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.262+0000 7fe125ff88c0 1 > prepared operation key=46ZTDBWFVSUH tag=IP2RH93UZVTM type=del size=2071797 2024-09-14T11:17:22.266 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.266+0000 7fe125ff88c0 1 < completed delete operation key=N80X3YUF4OEL tag=TGB04YQ4AH40 type=del 2024-09-14T11:17:22.270 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.270+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=LDVI8Y3ZMY2X type=write size=71027 2024-09-14T11:17:22.271 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.270+0000 7fe125ff88c0 1 < canceled part key=_multipart_YFRH8WECBTJK.2~F8VRG6AONZ8D.0 size=552495 2024-09-14T11:17:22.276 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.274+0000 7fe125ff88c0 1 < canceled multipart upload key=YFRH8WECBTJK upload=F8VRG6AONZ8D tag=6P4D44J04WRD type=write size=1601071 2024-09-14T11:17:22.280 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.278+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=2POCMOOOTQPJ type=del size=2727163 2024-09-14T11:17:22.284 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.282+0000 7fe125ff88c0 1 < completed part key=_multipart_2KEKSWK0UT6C.2~3Q75C3U9A6EU.0 size=1048576 2024-09-14T11:17:22.287 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.286+0000 7fe125ff88c0 1 < completed part key=_multipart_2KEKSWK0UT6C.2~3Q75C3U9A6EU.1 size=1048576 2024-09-14T11:17:22.290 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.290+0000 7fe125ff88c0 1 < completed part key=_multipart_2KEKSWK0UT6C.2~3Q75C3U9A6EU.2 size=746715 2024-09-14T11:17:22.296 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.298+0000 7fe125ff88c0 1 < completed multipart upload key=2KEKSWK0UT6C upload=3Q75C3U9A6EU tag=I53WCYKGV5PT type=write size=3892443 2024-09-14T11:17:22.302 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.302+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~CNIEUQOWVWB7.0 size=1048576 2024-09-14T11:17:22.305 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.306+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~CNIEUQOWVWB7.1 size=1048576 2024-09-14T11:17:22.308 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.306+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~CNIEUQOWVWB7.2 size=840476 2024-09-14T11:17:22.308 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.306+0000 7fe125ff88c0 1 > prepared multipart upload key=1ML6RIXI4C5P upload=CNIEUQOWVWB7 tag=4MKFCVRTD5KB type=write size=3986204 2024-09-14T11:17:22.312 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.310+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~4W6IE4EFY9EY.0 size=1048576 2024-09-14T11:17:22.315 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.314+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~4W6IE4EFY9EY.1 size=445464 2024-09-14T11:17:22.321 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.322+0000 7fe125ff88c0 1 < completed multipart upload key=46ZTDBWFVSUH upload=4W6IE4EFY9EY tag=MOQRMSM2MJJW type=write size=2542616 2024-09-14T11:17:22.328 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.326+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~IND0OHWRKTBV.0 size=1048576 2024-09-14T11:17:22.331 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.330+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~IND0OHWRKTBV.1 size=77007 2024-09-14T11:17:22.331 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.330+0000 7fe125ff88c0 1 > prepared multipart upload key=FQ5WT12KB664 upload=IND0OHWRKTBV tag=ZKNF475NWYZC type=write size=2174159 2024-09-14T11:17:22.335 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.334+0000 7fe125ff88c0 1 < canceled operation key=N94D3R7IOBNL tag=586EXM0LUCMF type=write size=612354 2024-09-14T11:17:22.340 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.338+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=FB3H7ZTVD70V type=write size=478298 2024-09-14T11:17:22.344 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.342+0000 7fe125ff88c0 1 < completed delete operation key=2LH5U05C2F8C tag=KKY3X0Q7HWNA type=del 2024-09-14T11:17:22.351 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.350+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~NY3HIU7F8RWA.0 size=1048576 2024-09-14T11:17:22.353 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.354+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~NY3HIU7F8RWA.1 size=1048576 2024-09-14T11:17:22.356 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.354+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~NY3HIU7F8RWA.2 size=833318 2024-09-14T11:17:22.356 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.354+0000 7fe125ff88c0 1 > prepared multipart upload key=YGEVGH840L18 upload=NY3HIU7F8RWA tag=T1DC3SR72MYI type=write size=3979046 2024-09-14T11:17:22.360 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.358+0000 7fe125ff88c0 1 < completed part key=_multipart_2KEKSWK0UT6C.2~VFHCLW1TFLWX.0 size=1048576 2024-09-14T11:17:22.362 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.362+0000 7fe125ff88c0 1 < completed part key=_multipart_2KEKSWK0UT6C.2~VFHCLW1TFLWX.1 size=1048576 2024-09-14T11:17:22.365 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.366+0000 7fe125ff88c0 1 < completed part key=_multipart_2KEKSWK0UT6C.2~VFHCLW1TFLWX.2 size=878233 2024-09-14T11:17:22.371 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.370+0000 7fe125ff88c0 1 < completed multipart upload key=2KEKSWK0UT6C upload=VFHCLW1TFLWX tag=0WVF5BJNQKS3 type=write size=4023961 2024-09-14T11:17:22.375 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.374+0000 7fe125ff88c0 1 > prepared operation key=6C3JZKTB8BP3 tag=VCEHY6MOL9SJ type=write size=509654 2024-09-14T11:17:22.383 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.382+0000 7fe125ff88c0 1 < suggested remove operation key=W0B19NBHNLMZ tag=62X0KSACG1GG type=del 2024-09-14T11:17:22.387 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.386+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=1UVHVPT7B8TC type=del size=2287771 2024-09-14T11:17:22.391 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.390+0000 7fe125ff88c0 1 < completed part key=_multipart_0VBX2FWYCFEZ.2~DQQGAAHZ6BA4.0 size=1048576 2024-09-14T11:17:22.394 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.394+0000 7fe125ff88c0 1 < completed part key=_multipart_0VBX2FWYCFEZ.2~DQQGAAHZ6BA4.1 size=61804 2024-09-14T11:17:22.399 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.398+0000 7fe125ff88c0 1 < completed multipart upload key=0VBX2FWYCFEZ upload=DQQGAAHZ6BA4 tag=ZEJHYKJISHVC type=write size=2158956 2024-09-14T11:17:22.403 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.402+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=MNOL88NF3O3C type=del size=2846023 2024-09-14T11:17:22.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.406+0000 7fe125ff88c0 1 < canceled operation key=YCF2PCJ9TZMR tag=OKHPS5PKS88V type=del size=3157091 2024-09-14T11:17:22.414 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.414+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~ZCMUKXA36IND.0 size=1048576 2024-09-14T11:17:22.417 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.418+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~ZCMUKXA36IND.1 size=432459 2024-09-14T11:17:22.417 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.418+0000 7fe125ff88c0 1 > prepared multipart upload key=SSNV25PDLDIS upload=ZCMUKXA36IND tag=K9E4C1GJGEDV type=write size=2529611 2024-09-14T11:17:22.421 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.422+0000 7fe125ff88c0 1 < completed delete operation key=YGEVGH840L18 tag=ZQNL5NL26O7I type=del 2024-09-14T11:17:22.424 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.426+0000 7fe125ff88c0 1 > prepared operation key=K05LARTJ2QZ3 tag=PE4C41JN0I6F type=del size=2597079 2024-09-14T11:17:22.428 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.430+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~5FIFEH8W82BZ.0 size=1048576 2024-09-14T11:17:22.428 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.430+0000 7fe125ff88c0 1 < canceled part key=_multipart_3YGN50MBAF41.2~5FIFEH8W82BZ.1 size=115459 2024-09-14T11:17:22.435 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.434+0000 7fe125ff88c0 1 < canceled multipart upload key=3YGN50MBAF41 upload=5FIFEH8W82BZ tag=4WVVF1C89IWP type=write size=2212611 2024-09-14T11:17:22.439 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.438+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=AU2VZBRT9K3L type=del size=1237631 2024-09-14T11:17:22.443 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.442+0000 7fe125ff88c0 1 < completed delete operation key=L4XO0WTYKNXY tag=8XO4BMM3H70S type=del 2024-09-14T11:17:22.447 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.446+0000 7fe125ff88c0 1 > prepared operation key=3YGN50MBAF41 tag=XE9QRHUJUZFP type=del size=1191907 2024-09-14T11:17:22.451 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.450+0000 7fe125ff88c0 -1 < failed to complete operation key=W0B19NBHNLMZ tag=JW7XV2SIQXJ8 type=del size=1516472: (22) Invalid argument 2024-09-14T11:17:22.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.458+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~BHKUJAA5743D.0 size=1048576 2024-09-14T11:17:22.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.466+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~BHKUJAA5743D.1 size=1048576 2024-09-14T11:17:22.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.466+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~BHKUJAA5743D.2 size=600123 2024-09-14T11:17:22.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.466+0000 7fe125ff88c0 1 > prepared multipart upload key=21HC4VMHXS6L upload=BHKUJAA5743D tag=LW266CVT0CFU type=write size=3745851 2024-09-14T11:17:22.470 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.470+0000 7fe125ff88c0 -1 < failed to complete operation key=W0B19NBHNLMZ tag=IY51PUAAIPBP type=del size=1746756: (22) Invalid argument 2024-09-14T11:17:22.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.474+0000 7fe125ff88c0 1 > prepared operation key=SUCH37O8V1LY tag=EMKM1NRAQIEP type=write size=74372 2024-09-14T11:17:22.479 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.478+0000 7fe125ff88c0 1 < completed delete operation key=46ZTDBWFVSUH tag=IP2RH93UZVTM type=del 2024-09-14T11:17:22.483 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.482+0000 7fe125ff88c0 1 > prepared operation key=LYBGDNKUROWH tag=NG846KYQVM2L type=del size=3871105 2024-09-14T11:17:22.488 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.486+0000 7fe125ff88c0 -1 < failed to complete operation key=W0B19NBHNLMZ tag=LDVI8Y3ZMY2X type=write size=71027: (22) Invalid argument 2024-09-14T11:17:22.492 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.494+0000 7fe125ff88c0 1 > prepared operation key=1ML6RIXI4C5P tag=41JPPKNXQRE3 type=del size=427307 2024-09-14T11:17:22.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.494+0000 7fe125ff88c0 1 < completed delete operation key=K3P6U6NU8I01 tag=2POCMOOOTQPJ type=del 2024-09-14T11:17:22.500 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.502+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=ZHD3W00Q53BI type=write size=707633 2024-09-14T11:17:22.501 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.502+0000 7fe125ff88c0 1 < canceled part key=_multipart_1ML6RIXI4C5P.2~CNIEUQOWVWB7.0 size=1048576 2024-09-14T11:17:22.504 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.506+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~CNIEUQOWVWB7.1 size=1048576 2024-09-14T11:17:22.508 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.506+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~CNIEUQOWVWB7.2 size=840476 2024-09-14T11:17:22.514 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.514+0000 7fe125ff88c0 1 < canceled multipart upload key=1ML6RIXI4C5P upload=CNIEUQOWVWB7 tag=4MKFCVRTD5KB type=write size=3986204 2024-09-14T11:17:22.518 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.518+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=RU4SECXPQM9S type=write size=962606 2024-09-14T11:17:22.523 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.522+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~IND0OHWRKTBV.0 size=1048576 2024-09-14T11:17:22.525 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.526+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~IND0OHWRKTBV.1 size=77007 2024-09-14T11:17:22.532 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.530+0000 7fe125ff88c0 1 < completed multipart upload key=FQ5WT12KB664 upload=IND0OHWRKTBV tag=ZKNF475NWYZC type=write size=2174159 2024-09-14T11:17:22.535 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.534+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=Z2OTODN2R2GL type=del size=3711264 2024-09-14T11:17:22.539 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.538+0000 7fe125ff88c0 1 < completed write operation key=ESVFZQQXE3GT tag=FB3H7ZTVD70V type=write size=478298 2024-09-14T11:17:22.543 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.542+0000 7fe125ff88c0 1 > prepared operation key=1ML6RIXI4C5P tag=WZXDUD3AYF4I type=write size=503581 2024-09-14T11:17:22.547 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.546+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~NY3HIU7F8RWA.0 size=1048576 2024-09-14T11:17:22.551 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.550+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~NY3HIU7F8RWA.1 size=1048576 2024-09-14T11:17:22.554 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.554+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~NY3HIU7F8RWA.2 size=833318 2024-09-14T11:17:22.561 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.562+0000 7fe125ff88c0 1 < completed multipart upload key=YGEVGH840L18 upload=NY3HIU7F8RWA tag=T1DC3SR72MYI type=write size=3979046 2024-09-14T11:17:22.565 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.566+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=Q7LFVQF2CX14 type=del size=2810327 2024-09-14T11:17:22.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.574+0000 7fe125ff88c0 1 < suggested remove operation key=6C3JZKTB8BP3 tag=VCEHY6MOL9SJ type=write 2024-09-14T11:17:22.582 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.582+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=B93714O4CI4M type=del size=1605290 2024-09-14T11:17:22.587 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.586+0000 7fe125ff88c0 1 < completed delete operation key=YN2HI39GPEDF tag=1UVHVPT7B8TC type=del 2024-09-14T11:17:22.591 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.590+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=YNHBOYCVFL2B type=write size=794593 2024-09-14T11:17:22.594 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.594+0000 7fe125ff88c0 1 < completed delete operation key=0VBX2FWYCFEZ tag=MNOL88NF3O3C type=del 2024-09-14T11:17:22.599 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.598+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=UYINBVPCFDYV type=del size=594562 2024-09-14T11:17:22.603 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.602+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~ZCMUKXA36IND.0 size=1048576 2024-09-14T11:17:22.606 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.606+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~ZCMUKXA36IND.1 size=432459 2024-09-14T11:17:22.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.614+0000 7fe125ff88c0 1 < completed multipart upload key=SSNV25PDLDIS upload=ZCMUKXA36IND tag=K9E4C1GJGEDV type=write size=2529611 2024-09-14T11:17:22.616 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.618+0000 7fe125ff88c0 1 > prepared operation key=1ML6RIXI4C5P tag=XH1ZNM8L89S8 type=write size=440149 2024-09-14T11:17:22.624 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.626+0000 7fe125ff88c0 1 < suggested remove operation key=K05LARTJ2QZ3 tag=PE4C41JN0I6F type=del 2024-09-14T11:17:22.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.626+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=2FZJYETAQBTB type=del size=15691 2024-09-14T11:17:22.633 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.634+0000 7fe125ff88c0 1 < completed delete operation key=6PLUU2QIO9LJ tag=AU2VZBRT9K3L type=del 2024-09-14T11:17:22.637 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.638+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=7R5QDUMKMZF1 type=del size=1316998 2024-09-14T11:17:22.641 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.642+0000 7fe125ff88c0 1 < canceled operation key=3YGN50MBAF41 tag=XE9QRHUJUZFP type=del size=1191907 2024-09-14T11:17:22.647 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.646+0000 7fe125ff88c0 1 > prepared part key=_multipart_N94D3R7IOBNL.2~LX0IAILVS1AE.0 size=1048576 2024-09-14T11:17:22.650 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.650+0000 7fe125ff88c0 1 > prepared part key=_multipart_N94D3R7IOBNL.2~LX0IAILVS1AE.1 size=544031 2024-09-14T11:17:22.650 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.650+0000 7fe125ff88c0 1 > prepared multipart upload key=N94D3R7IOBNL upload=LX0IAILVS1AE tag=P2JYNFA0ZMMR type=write size=2641183 2024-09-14T11:17:22.654 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.654+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~BHKUJAA5743D.0 size=1048576 2024-09-14T11:17:22.657 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.658+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~BHKUJAA5743D.1 size=1048576 2024-09-14T11:17:22.659 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.658+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~BHKUJAA5743D.2 size=600123 2024-09-14T11:17:22.666 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.666+0000 7fe125ff88c0 1 < completed multipart upload key=21HC4VMHXS6L upload=BHKUJAA5743D tag=LW266CVT0CFU type=write size=3745851 2024-09-14T11:17:22.672 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.674+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~BMOBCNP1BBNX.0 size=1048576 2024-09-14T11:17:22.675 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.674+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~BMOBCNP1BBNX.1 size=470234 2024-09-14T11:17:22.675 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.674+0000 7fe125ff88c0 1 > prepared multipart upload key=YN2HI39GPEDF upload=BMOBCNP1BBNX tag=UYM92X7E1MDO type=write size=2567386 2024-09-14T11:17:22.679 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.678+0000 7fe125ff88c0 1 < completed write operation key=SUCH37O8V1LY tag=EMKM1NRAQIEP type=write size=74372 2024-09-14T11:17:22.683 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.682+0000 7fe125ff88c0 1 > prepared operation key=46ZTDBWFVSUH tag=KL077X2FI9IN type=del size=1559713 2024-09-14T11:17:22.687 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.686+0000 7fe125ff88c0 1 < completed delete operation key=LYBGDNKUROWH tag=NG846KYQVM2L type=del 2024-09-14T11:17:22.691 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.690+0000 7fe125ff88c0 1 > prepared operation key=SUCH37O8V1LY tag=6G5TB0JJBWUT type=write size=859340 2024-09-14T11:17:22.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.694+0000 7fe125ff88c0 1 < completed delete operation key=1ML6RIXI4C5P tag=41JPPKNXQRE3 type=del 2024-09-14T11:17:22.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.698+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=8T3ACZWXZAFO type=del size=2274751 2024-09-14T11:17:22.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.702+0000 7fe125ff88c0 1 < completed write operation key=YN2HI39GPEDF tag=ZHD3W00Q53BI type=write size=707633 2024-09-14T11:17:22.706 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.706+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=OVWT4F1HHN6R type=del size=2628742 2024-09-14T11:17:22.710 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.710+0000 7fe125ff88c0 1 < canceled operation key=YCF2PCJ9TZMR tag=RU4SECXPQM9S type=write size=962606 2024-09-14T11:17:22.714 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.714+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=GAX7B6C7ROVP type=del size=320146 2024-09-14T11:17:22.718 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.718+0000 7fe125ff88c0 1 < completed delete operation key=YGEVGH840L18 tag=Z2OTODN2R2GL type=del 2024-09-14T11:17:22.726 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.726+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~I4H7P2MFWTXA.0 size=1048576 2024-09-14T11:17:22.729 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.730+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~I4H7P2MFWTXA.1 size=518753 2024-09-14T11:17:22.729 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.730+0000 7fe125ff88c0 1 > prepared multipart upload key=46ZTDBWFVSUH upload=I4H7P2MFWTXA tag=28QPZLBCM621 type=write size=2615905 2024-09-14T11:17:22.734 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.734+0000 7fe125ff88c0 1 < completed write operation key=1ML6RIXI4C5P tag=WZXDUD3AYF4I type=write size=503581 2024-09-14T11:17:22.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.738+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=KMAEJU72JYX2 type=del size=68721 2024-09-14T11:17:22.742 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.742+0000 7fe125ff88c0 1 < completed delete operation key=L4XO0WTYKNXY tag=Q7LFVQF2CX14 type=del 2024-09-14T11:17:22.749 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.750+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~OZRH3GBHK47H.0 size=1016009 2024-09-14T11:17:22.749 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.750+0000 7fe125ff88c0 1 > prepared multipart upload key=N80X3YUF4OEL upload=OZRH3GBHK47H tag=UGW1VI9J3HMY type=write size=2064585 2024-09-14T11:17:22.753 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.754+0000 7fe125ff88c0 1 < completed delete operation key=V6B470G93KFT tag=B93714O4CI4M type=del 2024-09-14T11:17:22.757 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.758+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=9F6MIDGJUQIK type=del size=321125 2024-09-14T11:17:22.764 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.762+0000 7fe125ff88c0 1 < suggested remove operation key=4D2X7151977X tag=YNHBOYCVFL2B type=write 2024-09-14T11:17:22.771 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.770+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~XOE37WJ0MA9A.0 size=1048576 2024-09-14T11:17:22.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.774+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~XOE37WJ0MA9A.1 size=1048576 2024-09-14T11:17:22.776 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.778+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~XOE37WJ0MA9A.2 size=388395 2024-09-14T11:17:22.776 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.778+0000 7fe125ff88c0 1 > prepared multipart upload key=ESVFZQQXE3GT upload=XOE37WJ0MA9A tag=FZ15NKYP7DU1 type=write size=3534123 2024-09-14T11:17:22.781 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.782+0000 7fe125ff88c0 1 < completed delete operation key=L4XO0WTYKNXY tag=UYINBVPCFDYV type=del 2024-09-14T11:17:22.784 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.782+0000 7fe125ff88c0 1 > prepared operation key=1ML6RIXI4C5P tag=2OAXF6AEN21I type=del size=2180506 2024-09-14T11:17:22.788 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.786+0000 7fe125ff88c0 1 < completed write operation key=1ML6RIXI4C5P tag=XH1ZNM8L89S8 type=write size=440149 2024-09-14T11:17:22.792 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.790+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=4B20399A6EIP type=write size=334285 2024-09-14T11:17:22.795 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.794+0000 7fe125ff88c0 1 < completed delete operation key=35EB6U5O4A51 tag=2FZJYETAQBTB type=del 2024-09-14T11:17:22.802 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.802+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~74W2MPOGEIWD.0 size=1048576 2024-09-14T11:17:22.805 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.806+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~74W2MPOGEIWD.1 size=1048576 2024-09-14T11:17:22.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.806+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~74W2MPOGEIWD.2 size=549536 2024-09-14T11:17:22.808 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.806+0000 7fe125ff88c0 1 > prepared multipart upload key=1ML6RIXI4C5P upload=74W2MPOGEIWD tag=W9ABV1HJ6CNL type=write size=3695264 2024-09-14T11:17:22.812 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.810+0000 7fe125ff88c0 1 < completed delete operation key=V6B470G93KFT tag=7R5QDUMKMZF1 type=del 2024-09-14T11:17:22.820 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.818+0000 7fe125ff88c0 1 > prepared part key=_multipart_WEA3MQ0DI42N.2~TFXDDBM8124W.0 size=1048576 2024-09-14T11:17:22.824 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.822+0000 7fe125ff88c0 1 > prepared part key=_multipart_WEA3MQ0DI42N.2~TFXDDBM8124W.1 size=1048576 2024-09-14T11:17:22.826 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.826+0000 7fe125ff88c0 1 > prepared part key=_multipart_WEA3MQ0DI42N.2~TFXDDBM8124W.2 size=779442 2024-09-14T11:17:22.826 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.826+0000 7fe125ff88c0 1 > prepared multipart upload key=WEA3MQ0DI42N upload=TFXDDBM8124W tag=JNSPHRZYTUCK type=write size=3925170 2024-09-14T11:17:22.829 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.830+0000 7fe125ff88c0 1 < completed part key=_multipart_N94D3R7IOBNL.2~LX0IAILVS1AE.0 size=1048576 2024-09-14T11:17:22.832 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.830+0000 7fe125ff88c0 1 < completed part key=_multipart_N94D3R7IOBNL.2~LX0IAILVS1AE.1 size=544031 2024-09-14T11:17:22.839 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.838+0000 7fe125ff88c0 1 < completed multipart upload key=N94D3R7IOBNL upload=LX0IAILVS1AE tag=P2JYNFA0ZMMR type=write size=2641183 2024-09-14T11:17:22.847 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.846+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~9F1OJ10L4W6Y.0 size=1048576 2024-09-14T11:17:22.850 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.850+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~9F1OJ10L4W6Y.1 size=373774 2024-09-14T11:17:22.850 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.850+0000 7fe125ff88c0 1 > prepared multipart upload key=6C3JZKTB8BP3 upload=9F1OJ10L4W6Y tag=JOE4AUQ3DTX7 type=write size=2470926 2024-09-14T11:17:22.854 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.854+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~BMOBCNP1BBNX.0 size=1048576 2024-09-14T11:17:22.857 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.858+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~BMOBCNP1BBNX.1 size=470234 2024-09-14T11:17:22.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.862+0000 7fe125ff88c0 1 < completed multipart upload key=YN2HI39GPEDF upload=BMOBCNP1BBNX tag=UYM92X7E1MDO type=write size=2567386 2024-09-14T11:17:22.867 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.866+0000 7fe125ff88c0 1 > prepared operation key=SUCH37O8V1LY tag=TI353VQXFELY type=del size=1601496 2024-09-14T11:17:22.870 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.870+0000 7fe125ff88c0 1 < completed delete operation key=46ZTDBWFVSUH tag=KL077X2FI9IN type=del 2024-09-14T11:17:22.874 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.874+0000 7fe125ff88c0 1 > prepared operation key=46ZTDBWFVSUH tag=32W4QL9AETNO type=del size=3501725 2024-09-14T11:17:22.878 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.878+0000 7fe125ff88c0 1 < completed write operation key=SUCH37O8V1LY tag=6G5TB0JJBWUT type=write size=859340 2024-09-14T11:17:22.883 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.882+0000 7fe125ff88c0 1 > prepared operation key=1ML6RIXI4C5P tag=0J1INKCOPAUN type=del size=2262259 2024-09-14T11:17:22.887 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.886+0000 7fe125ff88c0 1 < completed delete operation key=YGEVGH840L18 tag=8T3ACZWXZAFO type=del 2024-09-14T11:17:22.895 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.894+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~4XDUN6ZG9XJI.0 size=452793 2024-09-14T11:17:22.895 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.894+0000 7fe125ff88c0 1 > prepared multipart upload key=SUCH37O8V1LY upload=4XDUN6ZG9XJI tag=N1M7FE0V7GI2 type=write size=1501369 2024-09-14T11:17:22.898 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.898+0000 7fe125ff88c0 1 < completed delete operation key=YGEVGH840L18 tag=OVWT4F1HHN6R type=del 2024-09-14T11:17:22.904 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.906+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~AV7VSP3MLSD3.0 size=1048576 2024-09-14T11:17:22.908 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.906+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~AV7VSP3MLSD3.1 size=1048576 2024-09-14T11:17:22.911 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.910+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~AV7VSP3MLSD3.2 size=548285 2024-09-14T11:17:22.911 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.910+0000 7fe125ff88c0 1 > prepared multipart upload key=46ZTDBWFVSUH upload=AV7VSP3MLSD3 tag=AEMQ7F1JXLV9 type=write size=3694013 2024-09-14T11:17:22.914 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.914+0000 7fe125ff88c0 1 < completed delete operation key=L4XO0WTYKNXY tag=GAX7B6C7ROVP type=del 2024-09-14T11:17:22.918 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.918+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=EGZAT8YXXLGW type=del size=236445 2024-09-14T11:17:22.922 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.922+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~I4H7P2MFWTXA.0 size=1048576 2024-09-14T11:17:22.925 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.926+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~I4H7P2MFWTXA.1 size=518753 2024-09-14T11:17:22.931 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.930+0000 7fe125ff88c0 1 < completed multipart upload key=46ZTDBWFVSUH upload=I4H7P2MFWTXA tag=28QPZLBCM621 type=write size=2615905 2024-09-14T11:17:22.936 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.934+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=3GFIW30DUA9Q type=write size=468856 2024-09-14T11:17:22.939 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.938+0000 7fe125ff88c0 1 < canceled operation key=SSNV25PDLDIS tag=KMAEJU72JYX2 type=del size=68721 2024-09-14T11:17:22.948 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.946+0000 7fe125ff88c0 1 > prepared operation key=0FITHLGQKQEC tag=931X5ITVKGS3 type=del size=3285453 2024-09-14T11:17:22.952 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.950+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~OZRH3GBHK47H.0 size=1016009 2024-09-14T11:17:22.958 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.958+0000 7fe125ff88c0 1 < completed multipart upload key=N80X3YUF4OEL upload=OZRH3GBHK47H tag=UGW1VI9J3HMY type=write size=2064585 2024-09-14T11:17:22.962 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.962+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=10NZG113C6DK type=del size=3535905 2024-09-14T11:17:22.966 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.966+0000 7fe125ff88c0 1 < canceled operation key=W0B19NBHNLMZ tag=9F6MIDGJUQIK type=del size=321125 2024-09-14T11:17:22.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.970+0000 7fe125ff88c0 1 > prepared operation key=FQ5WT12KB664 tag=MEKR509BB4NH type=write size=28269 2024-09-14T11:17:22.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.970+0000 7fe125ff88c0 1 < canceled part key=_multipart_ESVFZQQXE3GT.2~XOE37WJ0MA9A.0 size=1048576 2024-09-14T11:17:22.973 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.974+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~XOE37WJ0MA9A.1 size=1048576 2024-09-14T11:17:22.976 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.974+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~XOE37WJ0MA9A.2 size=388395 2024-09-14T11:17:22.982 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.982+0000 7fe125ff88c0 1 < canceled multipart upload key=ESVFZQQXE3GT upload=XOE37WJ0MA9A tag=FZ15NKYP7DU1 type=write size=3534123 2024-09-14T11:17:22.986 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.986+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=91WXHETX9J3I type=del size=603274 2024-09-14T11:17:22.989 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.990+0000 7fe125ff88c0 1 < completed delete operation key=1ML6RIXI4C5P tag=2OAXF6AEN21I type=del 2024-09-14T11:17:22.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:22.994+0000 7fe125ff88c0 1 > prepared operation key=6C3JZKTB8BP3 tag=OP6S5LP4PWWT type=write size=617686 2024-09-14T11:17:23.000 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.002+0000 7fe125ff88c0 1 < suggested remove operation key=6PLUU2QIO9LJ tag=4B20399A6EIP type=write 2024-09-14T11:17:23.006 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.006+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~V9HZ3101HCJN.0 size=1048576 2024-09-14T11:17:23.009 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.010+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~V9HZ3101HCJN.1 size=1048576 2024-09-14T11:17:23.011 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.010+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~V9HZ3101HCJN.2 size=544627 2024-09-14T11:17:23.011 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.010+0000 7fe125ff88c0 1 > prepared multipart upload key=FQ5WT12KB664 upload=V9HZ3101HCJN tag=RRSOX1FJRBG2 type=write size=3690355 2024-09-14T11:17:23.015 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.014+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~74W2MPOGEIWD.0 size=1048576 2024-09-14T11:17:23.017 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.018+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~74W2MPOGEIWD.1 size=1048576 2024-09-14T11:17:23.019 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.018+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~74W2MPOGEIWD.2 size=549536 2024-09-14T11:17:23.025 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.026+0000 7fe125ff88c0 1 < completed multipart upload key=1ML6RIXI4C5P upload=74W2MPOGEIWD tag=W9ABV1HJ6CNL type=write size=3695264 2024-09-14T11:17:23.029 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.030+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=4C7EL9HMLZJ4 type=del size=652196 2024-09-14T11:17:23.032 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.030+0000 7fe125ff88c0 1 < completed part key=_multipart_WEA3MQ0DI42N.2~TFXDDBM8124W.0 size=1048576 2024-09-14T11:17:23.034 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.034+0000 7fe125ff88c0 1 < completed part key=_multipart_WEA3MQ0DI42N.2~TFXDDBM8124W.1 size=1048576 2024-09-14T11:17:23.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.038+0000 7fe125ff88c0 1 < completed part key=_multipart_WEA3MQ0DI42N.2~TFXDDBM8124W.2 size=779442 2024-09-14T11:17:23.042 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.042+0000 7fe125ff88c0 1 < completed multipart upload key=WEA3MQ0DI42N upload=TFXDDBM8124W tag=JNSPHRZYTUCK type=write size=3925170 2024-09-14T11:17:23.045 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.046+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=Z0PU9MQXXEIO type=del size=3964414 2024-09-14T11:17:23.049 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.050+0000 7fe125ff88c0 1 < completed part key=_multipart_6C3JZKTB8BP3.2~9F1OJ10L4W6Y.0 size=1048576 2024-09-14T11:17:23.051 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.050+0000 7fe125ff88c0 1 < completed part key=_multipart_6C3JZKTB8BP3.2~9F1OJ10L4W6Y.1 size=373774 2024-09-14T11:17:23.056 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.058+0000 7fe125ff88c0 1 < completed multipart upload key=6C3JZKTB8BP3 upload=9F1OJ10L4W6Y tag=JOE4AUQ3DTX7 type=write size=2470926 2024-09-14T11:17:23.059 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.058+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=OTYYX4SPQO4R type=del size=3820021 2024-09-14T11:17:23.063 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.062+0000 7fe125ff88c0 1 < completed delete operation key=SUCH37O8V1LY tag=TI353VQXFELY type=del 2024-09-14T11:17:23.069 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.070+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~41GCRYR84TLR.0 size=459298 2024-09-14T11:17:23.069 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.070+0000 7fe125ff88c0 1 > prepared multipart upload key=ESVFZQQXE3GT upload=41GCRYR84TLR tag=TCR8PFBG5L3M type=write size=1507874 2024-09-14T11:17:23.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.074+0000 7fe125ff88c0 1 < completed delete operation key=46ZTDBWFVSUH tag=32W4QL9AETNO type=del 2024-09-14T11:17:23.075 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.074+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=J5RLKS71AXHD type=del size=1203304 2024-09-14T11:17:23.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.078+0000 7fe125ff88c0 1 < completed delete operation key=1ML6RIXI4C5P tag=0J1INKCOPAUN type=del 2024-09-14T11:17:23.084 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.086+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~M0FWBP9EN00Q.0 size=665971 2024-09-14T11:17:23.085 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.086+0000 7fe125ff88c0 1 > prepared multipart upload key=2LH5U05C2F8C upload=M0FWBP9EN00Q tag=EFM03KY2MEGT type=write size=1714547 2024-09-14T11:17:23.087 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.086+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~4XDUN6ZG9XJI.0 size=452793 2024-09-14T11:17:23.093 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.094+0000 7fe125ff88c0 1 < completed multipart upload key=SUCH37O8V1LY upload=4XDUN6ZG9XJI tag=N1M7FE0V7GI2 type=write size=1501369 2024-09-14T11:17:23.096 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.094+0000 7fe125ff88c0 1 > prepared operation key=K05LARTJ2QZ3 tag=68C9XU8GG1NF type=del size=2823010 2024-09-14T11:17:23.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.098+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~AV7VSP3MLSD3.0 size=1048576 2024-09-14T11:17:23.102 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.102+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~AV7VSP3MLSD3.1 size=1048576 2024-09-14T11:17:23.105 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.106+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~AV7VSP3MLSD3.2 size=548285 2024-09-14T11:17:23.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.110+0000 7fe125ff88c0 1 < completed multipart upload key=46ZTDBWFVSUH upload=AV7VSP3MLSD3 tag=AEMQ7F1JXLV9 type=write size=3694013 2024-09-14T11:17:23.114 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.114+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=GIJVXQCC9AYC type=del size=254275 2024-09-14T11:17:23.117 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.118+0000 7fe125ff88c0 1 < completed delete operation key=W0B19NBHNLMZ tag=EGZAT8YXXLGW type=del 2024-09-14T11:17:23.120 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.118+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=E3T0RZGKBAET type=del size=1968883 2024-09-14T11:17:23.126 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.126+0000 7fe125ff88c0 1 < suggested update operation key=2LH5U05C2F8C tag=3GFIW30DUA9Q type=write size=468856 2024-09-14T11:17:23.129 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.130+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=GI66IQH066D7 type=del size=1370648 2024-09-14T11:17:23.132 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.134+0000 7fe125ff88c0 1 < completed delete operation key=0FITHLGQKQEC tag=931X5ITVKGS3 type=del 2024-09-14T11:17:23.138 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.138+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~P4FWXWZLGJDQ.0 size=1048576 2024-09-14T11:17:23.141 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.142+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~P4FWXWZLGJDQ.1 size=858519 2024-09-14T11:17:23.141 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.142+0000 7fe125ff88c0 1 > prepared multipart upload key=LYBGDNKUROWH upload=P4FWXWZLGJDQ tag=KZQRWGQUS6BZ type=write size=2955671 2024-09-14T11:17:23.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.142+0000 7fe125ff88c0 1 < completed delete operation key=F9I82N7RQC81 tag=10NZG113C6DK type=del 2024-09-14T11:17:23.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.150+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~ESK17WG35E8X.0 size=652176 2024-09-14T11:17:23.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.150+0000 7fe125ff88c0 1 > prepared multipart upload key=3YGN50MBAF41 upload=ESK17WG35E8X tag=O28JU25G6WT3 type=write size=1700752 2024-09-14T11:17:23.155 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.154+0000 7fe125ff88c0 1 < completed write operation key=FQ5WT12KB664 tag=MEKR509BB4NH type=write size=28269 2024-09-14T11:17:23.164 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.162+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~E3Z80FNC8FK0.0 size=1048576 2024-09-14T11:17:23.167 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.166+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~E3Z80FNC8FK0.1 size=576119 2024-09-14T11:17:23.167 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.166+0000 7fe125ff88c0 1 > prepared multipart upload key=21HC4VMHXS6L upload=E3Z80FNC8FK0 tag=6OMQJ0IQ2V9F type=write size=2673271 2024-09-14T11:17:23.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.174+0000 7fe125ff88c0 1 < suggested update operation key=2KEKSWK0UT6C tag=91WXHETX9J3I type=del size=603274 2024-09-14T11:17:23.179 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.178+0000 7fe125ff88c0 1 > prepared operation key=0FITHLGQKQEC tag=M6ABQLSXHFG1 type=del size=3883682 2024-09-14T11:17:23.184 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.182+0000 7fe125ff88c0 1 < completed write operation key=6C3JZKTB8BP3 tag=OP6S5LP4PWWT type=write size=617686 2024-09-14T11:17:23.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.190+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=MDHOYHZ26PRT type=del size=1372324 2024-09-14T11:17:23.193 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.194+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~V9HZ3101HCJN.0 size=1048576 2024-09-14T11:17:23.193 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.194+0000 7fe125ff88c0 1 < canceled part key=_multipart_FQ5WT12KB664.2~V9HZ3101HCJN.1 size=1048576 2024-09-14T11:17:23.194 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.194+0000 7fe125ff88c0 1 < canceled part key=_multipart_FQ5WT12KB664.2~V9HZ3101HCJN.2 size=544627 2024-09-14T11:17:23.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.202+0000 7fe125ff88c0 1 < canceled multipart upload key=FQ5WT12KB664 upload=V9HZ3101HCJN tag=RRSOX1FJRBG2 type=write size=3690355 2024-09-14T11:17:23.208 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.206+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~R8CD5R3IV8E3.0 size=1048576 2024-09-14T11:17:23.211 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.210+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~R8CD5R3IV8E3.1 size=731055 2024-09-14T11:17:23.211 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.210+0000 7fe125ff88c0 1 > prepared multipart upload key=46ZTDBWFVSUH upload=R8CD5R3IV8E3 tag=NE4UK3JNKCX9 type=write size=2828207 2024-09-14T11:17:23.214 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.214+0000 7fe125ff88c0 1 < completed delete operation key=N94D3R7IOBNL tag=4C7EL9HMLZJ4 type=del 2024-09-14T11:17:23.218 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.218+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=PL7V292T0M2H type=del size=2067521 2024-09-14T11:17:23.223 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.222+0000 7fe125ff88c0 1 < completed delete operation key=21HC4VMHXS6L tag=Z0PU9MQXXEIO type=del 2024-09-14T11:17:23.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.226+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=FJZX458LAKY5 type=del size=4062888 2024-09-14T11:17:23.230 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.230+0000 7fe125ff88c0 1 < completed delete operation key=0VBX2FWYCFEZ tag=OTYYX4SPQO4R type=del 2024-09-14T11:17:23.238 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.238+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~ULQLLTPW92KW.0 size=1048576 2024-09-14T11:17:23.240 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.242+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~ULQLLTPW92KW.1 size=64797 2024-09-14T11:17:23.241 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.242+0000 7fe125ff88c0 1 > prepared multipart upload key=LYBGDNKUROWH upload=ULQLLTPW92KW tag=BVPS8K0Z6EN5 type=write size=2161949 2024-09-14T11:17:23.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.246+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~41GCRYR84TLR.0 size=459298 2024-09-14T11:17:23.251 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.250+0000 7fe125ff88c0 1 < completed multipart upload key=ESVFZQQXE3GT upload=41GCRYR84TLR tag=TCR8PFBG5L3M type=write size=1507874 2024-09-14T11:17:23.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.254+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=NLGZWKWM68SI type=del size=2994908 2024-09-14T11:17:23.259 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.258+0000 7fe125ff88c0 1 < completed delete operation key=WEA3MQ0DI42N tag=J5RLKS71AXHD type=del 2024-09-14T11:17:23.263 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.262+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=RZO2AUNU23B9 type=write size=822381 2024-09-14T11:17:23.267 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.266+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~M0FWBP9EN00Q.0 size=665971 2024-09-14T11:17:23.273 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.274+0000 7fe125ff88c0 1 < completed multipart upload key=2LH5U05C2F8C upload=M0FWBP9EN00Q tag=EFM03KY2MEGT type=write size=1714547 2024-09-14T11:17:23.276 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.278+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=C0X85QGKU7O5 type=del size=1987676 2024-09-14T11:17:23.288 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.290+0000 7fe125ff88c0 1 < suggested remove operation key=K05LARTJ2QZ3 tag=68C9XU8GG1NF type=del 2024-09-14T11:17:23.292 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.290+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=D0OAHP1IS50D type=del size=3610255 2024-09-14T11:17:23.296 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.294+0000 7fe125ff88c0 1 < completed delete operation key=2UXA6SXDTUFT tag=GIJVXQCC9AYC type=del 2024-09-14T11:17:23.302 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.302+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~FF37FD205OL3.0 size=1048576 2024-09-14T11:17:23.305 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.306+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~FF37FD205OL3.1 size=1048576 2024-09-14T11:17:23.308 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.310+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~FF37FD205OL3.2 size=434730 2024-09-14T11:17:23.308 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.310+0000 7fe125ff88c0 1 > prepared multipart upload key=W0B19NBHNLMZ upload=FF37FD205OL3 tag=KF30O779E0DA type=write size=3580458 2024-09-14T11:17:23.316 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.314+0000 7fe125ff88c0 1 < suggested remove operation key=ESVFZQQXE3GT tag=E3T0RZGKBAET type=del 2024-09-14T11:17:23.322 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.322+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~H6FWYGLBHYFM.0 size=1048576 2024-09-14T11:17:23.325 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.326+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~H6FWYGLBHYFM.1 size=1048576 2024-09-14T11:17:23.328 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.326+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~H6FWYGLBHYFM.2 size=303392 2024-09-14T11:17:23.328 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.326+0000 7fe125ff88c0 1 > prepared multipart upload key=46ZTDBWFVSUH upload=H6FWYGLBHYFM tag=PL88P9CPO5S2 type=write size=3449120 2024-09-14T11:17:23.332 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.330+0000 7fe125ff88c0 1 < completed delete operation key=YCF2PCJ9TZMR tag=GI66IQH066D7 type=del 2024-09-14T11:17:23.338 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.338+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~0VWC8GZWJSX0.0 size=546803 2024-09-14T11:17:23.338 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.338+0000 7fe125ff88c0 1 > prepared multipart upload key=1ML6RIXI4C5P upload=0VWC8GZWJSX0 tag=3F23RZVEAULZ type=write size=1595379 2024-09-14T11:17:23.342 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.342+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~P4FWXWZLGJDQ.0 size=1048576 2024-09-14T11:17:23.345 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.346+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~P4FWXWZLGJDQ.1 size=858519 2024-09-14T11:17:23.351 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.350+0000 7fe125ff88c0 1 < completed multipart upload key=LYBGDNKUROWH upload=P4FWXWZLGJDQ tag=KZQRWGQUS6BZ type=write size=2955671 2024-09-14T11:17:23.358 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.358+0000 7fe125ff88c0 1 > prepared part key=_multipart_6PLUU2QIO9LJ.2~CQ9DSKB65421.0 size=1048576 2024-09-14T11:17:23.361 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.362+0000 7fe125ff88c0 1 > prepared part key=_multipart_6PLUU2QIO9LJ.2~CQ9DSKB65421.1 size=1048576 2024-09-14T11:17:23.364 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.362+0000 7fe125ff88c0 1 > prepared part key=_multipart_6PLUU2QIO9LJ.2~CQ9DSKB65421.2 size=511498 2024-09-14T11:17:23.364 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.362+0000 7fe125ff88c0 1 > prepared multipart upload key=6PLUU2QIO9LJ upload=CQ9DSKB65421 tag=5SDULOISWRDO type=write size=3657226 2024-09-14T11:17:23.368 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.366+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~ESK17WG35E8X.0 size=652176 2024-09-14T11:17:23.374 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.374+0000 7fe125ff88c0 1 < completed multipart upload key=3YGN50MBAF41 upload=ESK17WG35E8X tag=O28JU25G6WT3 type=write size=1700752 2024-09-14T11:17:23.378 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.378+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=U1F95JSCVQHL type=del size=425244 2024-09-14T11:17:23.382 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.382+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~E3Z80FNC8FK0.0 size=1048576 2024-09-14T11:17:23.382 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.382+0000 7fe125ff88c0 1 < canceled part key=_multipart_21HC4VMHXS6L.2~E3Z80FNC8FK0.1 size=576119 2024-09-14T11:17:23.388 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.386+0000 7fe125ff88c0 1 < canceled multipart upload key=21HC4VMHXS6L upload=E3Z80FNC8FK0 tag=6OMQJ0IQ2V9F type=write size=2673271 2024-09-14T11:17:23.395 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.394+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~A6OWD13LEFFM.0 size=1048576 2024-09-14T11:17:23.398 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.398+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~A6OWD13LEFFM.1 size=1048576 2024-09-14T11:17:23.400 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.402+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~A6OWD13LEFFM.2 size=817692 2024-09-14T11:17:23.400 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.402+0000 7fe125ff88c0 1 > prepared multipart upload key=1ML6RIXI4C5P upload=A6OWD13LEFFM tag=A00ZGE29PFDD type=write size=3963420 2024-09-14T11:17:23.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.406+0000 7fe125ff88c0 1 < completed delete operation key=0FITHLGQKQEC tag=M6ABQLSXHFG1 type=del 2024-09-14T11:17:23.411 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.410+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~VIWSO60ZE01Y.0 size=1048576 2024-09-14T11:17:23.414 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.414+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~VIWSO60ZE01Y.1 size=1048576 2024-09-14T11:17:23.417 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.418+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~VIWSO60ZE01Y.2 size=518337 2024-09-14T11:17:23.418 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.418+0000 7fe125ff88c0 1 > prepared multipart upload key=SUCH37O8V1LY upload=VIWSO60ZE01Y tag=0IW9XHPBFC6S type=write size=3664065 2024-09-14T11:17:23.422 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.422+0000 7fe125ff88c0 1 < completed delete operation key=W0B19NBHNLMZ tag=MDHOYHZ26PRT type=del 2024-09-14T11:17:23.425 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.426+0000 7fe125ff88c0 1 > prepared operation key=1ML6RIXI4C5P tag=UC2R6MX0923U type=del size=449563 2024-09-14T11:17:23.430 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.430+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~R8CD5R3IV8E3.0 size=1048576 2024-09-14T11:17:23.433 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.434+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~R8CD5R3IV8E3.1 size=731055 2024-09-14T11:17:23.440 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.438+0000 7fe125ff88c0 1 < completed multipart upload key=46ZTDBWFVSUH upload=R8CD5R3IV8E3 tag=NE4UK3JNKCX9 type=write size=2828207 2024-09-14T11:17:23.444 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.446+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=B047SYXXIAQ4 type=del size=2930980 2024-09-14T11:17:23.449 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.450+0000 7fe125ff88c0 1 < completed delete operation key=L4XO0WTYKNXY tag=PL7V292T0M2H type=del 2024-09-14T11:17:23.453 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.454+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=T70GUPNWJYVM type=del size=1222903 2024-09-14T11:17:23.458 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.458+0000 7fe125ff88c0 1 < completed delete operation key=4D2X7151977X tag=FJZX458LAKY5 type=del 2024-09-14T11:17:23.461 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.462+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=ANO33K6T376X type=del size=1258753 2024-09-14T11:17:23.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.462+0000 7fe125ff88c0 1 < canceled part key=_multipart_LYBGDNKUROWH.2~ULQLLTPW92KW.0 size=1048576 2024-09-14T11:17:23.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.466+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~ULQLLTPW92KW.1 size=64797 2024-09-14T11:17:23.486 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.486+0000 7fe125ff88c0 1 < canceled multipart upload key=LYBGDNKUROWH upload=ULQLLTPW92KW tag=BVPS8K0Z6EN5 type=write size=2161949 2024-09-14T11:17:23.491 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.490+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=CJVA1M7HW64V type=del size=1254104 2024-09-14T11:17:23.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.494+0000 7fe125ff88c0 1 < completed delete operation key=4D2X7151977X tag=NLGZWKWM68SI type=del 2024-09-14T11:17:23.499 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.498+0000 7fe125ff88c0 1 > prepared operation key=3YGN50MBAF41 tag=7G6WYUYH30OJ type=del size=3861306 2024-09-14T11:17:23.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.502+0000 7fe125ff88c0 1 < completed write operation key=YGEVGH840L18 tag=RZO2AUNU23B9 type=write size=822381 2024-09-14T11:17:23.507 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.506+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=6D1FBML0226F type=del size=233671 2024-09-14T11:17:23.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.510+0000 7fe125ff88c0 1 < completed delete operation key=V6B470G93KFT tag=C0X85QGKU7O5 type=del 2024-09-14T11:17:23.515 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.514+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=2K60AP64ACPH type=write size=998308 2024-09-14T11:17:23.519 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.518+0000 7fe125ff88c0 1 < completed delete operation key=0VBX2FWYCFEZ tag=D0OAHP1IS50D type=del 2024-09-14T11:17:23.526 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.526+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~GCU5IVC30N2W.0 size=229003 2024-09-14T11:17:23.526 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.526+0000 7fe125ff88c0 1 > prepared multipart upload key=SUCH37O8V1LY upload=GCU5IVC30N2W tag=3AOKYD0OX6NN type=write size=1277579 2024-09-14T11:17:23.529 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.530+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~FF37FD205OL3.0 size=1048576 2024-09-14T11:17:23.532 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.534+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~FF37FD205OL3.1 size=1048576 2024-09-14T11:17:23.535 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.534+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~FF37FD205OL3.2 size=434730 2024-09-14T11:17:23.542 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.542+0000 7fe125ff88c0 1 < completed multipart upload key=W0B19NBHNLMZ upload=FF37FD205OL3 tag=KF30O779E0DA type=write size=3580458 2024-09-14T11:17:23.545 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.546+0000 7fe125ff88c0 1 > prepared operation key=1ML6RIXI4C5P tag=ZSON8QGCAOHU type=del size=4123048 2024-09-14T11:17:23.549 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.550+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~H6FWYGLBHYFM.0 size=1048576 2024-09-14T11:17:23.552 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.550+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~H6FWYGLBHYFM.1 size=1048576 2024-09-14T11:17:23.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.554+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~H6FWYGLBHYFM.2 size=303392 2024-09-14T11:17:23.561 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.562+0000 7fe125ff88c0 1 < completed multipart upload key=46ZTDBWFVSUH upload=H6FWYGLBHYFM tag=PL88P9CPO5S2 type=write size=3449120 2024-09-14T11:17:23.565 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.566+0000 7fe125ff88c0 1 > prepared operation key=3OU4U9JF3ZD5 tag=1DMJAVY78A87 type=write size=888878 2024-09-14T11:17:23.569 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.570+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~0VWC8GZWJSX0.0 size=546803 2024-09-14T11:17:23.575 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.574+0000 7fe125ff88c0 1 < completed multipart upload key=1ML6RIXI4C5P upload=0VWC8GZWJSX0 tag=3F23RZVEAULZ type=write size=1595379 2024-09-14T11:17:23.579 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.578+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=H1JICA3OVRIG type=del size=629007 2024-09-14T11:17:23.583 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.582+0000 7fe125ff88c0 1 < completed part key=_multipart_6PLUU2QIO9LJ.2~CQ9DSKB65421.0 size=1048576 2024-09-14T11:17:23.586 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.586+0000 7fe125ff88c0 1 < completed part key=_multipart_6PLUU2QIO9LJ.2~CQ9DSKB65421.1 size=1048576 2024-09-14T11:17:23.589 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.590+0000 7fe125ff88c0 1 < completed part key=_multipart_6PLUU2QIO9LJ.2~CQ9DSKB65421.2 size=511498 2024-09-14T11:17:23.595 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.594+0000 7fe125ff88c0 1 < completed multipart upload key=6PLUU2QIO9LJ upload=CQ9DSKB65421 tag=5SDULOISWRDO type=write size=3657226 2024-09-14T11:17:23.602 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.606+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~XVW7KIFFZ6SR.0 size=452189 2024-09-14T11:17:23.602 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.606+0000 7fe125ff88c0 1 > prepared multipart upload key=35EB6U5O4A51 upload=XVW7KIFFZ6SR tag=WBUFG8RZXTXN type=write size=1500765 2024-09-14T11:17:23.606 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.606+0000 7fe125ff88c0 1 < completed delete operation key=K3P6U6NU8I01 tag=U1F95JSCVQHL type=del 2024-09-14T11:17:23.613 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.614+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~F18L0MTI7V0S.0 size=44416 2024-09-14T11:17:23.613 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.614+0000 7fe125ff88c0 1 > prepared multipart upload key=3OU4U9JF3ZD5 upload=F18L0MTI7V0S tag=L2HTFSPJY7GS type=write size=1092992 2024-09-14T11:17:23.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.618+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~A6OWD13LEFFM.0 size=1048576 2024-09-14T11:17:23.620 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.618+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~A6OWD13LEFFM.1 size=1048576 2024-09-14T11:17:23.623 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.622+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~A6OWD13LEFFM.2 size=817692 2024-09-14T11:17:23.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.630+0000 7fe125ff88c0 1 < completed multipart upload key=1ML6RIXI4C5P upload=A6OWD13LEFFM tag=A00ZGE29PFDD type=write size=3963420 2024-09-14T11:17:23.633 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.634+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=EOWUZIGLJLBZ type=del size=840172 2024-09-14T11:17:23.634 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.634+0000 7fe125ff88c0 1 < canceled part key=_multipart_SUCH37O8V1LY.2~VIWSO60ZE01Y.0 size=1048576 2024-09-14T11:17:23.637 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.638+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~VIWSO60ZE01Y.1 size=1048576 2024-09-14T11:17:23.640 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.638+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~VIWSO60ZE01Y.2 size=518337 2024-09-14T11:17:23.650 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.650+0000 7fe125ff88c0 1 < canceled multipart upload key=SUCH37O8V1LY upload=VIWSO60ZE01Y tag=0IW9XHPBFC6S type=write size=3664065 2024-09-14T11:17:23.656 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.658+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~VEZSUNJ61FRS.0 size=63237 2024-09-14T11:17:23.656 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.658+0000 7fe125ff88c0 1 > prepared multipart upload key=FQ5WT12KB664 upload=VEZSUNJ61FRS tag=HREJFRUA1JUA type=write size=1111813 2024-09-14T11:17:23.660 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.658+0000 7fe125ff88c0 1 < completed delete operation key=1ML6RIXI4C5P tag=UC2R6MX0923U type=del 2024-09-14T11:17:23.666 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.666+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~VYH1T3EH9LAN.0 size=1048576 2024-09-14T11:17:23.669 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.670+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~VYH1T3EH9LAN.1 size=168579 2024-09-14T11:17:23.669 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.670+0000 7fe125ff88c0 1 > prepared multipart upload key=35EB6U5O4A51 upload=VYH1T3EH9LAN tag=4UX1AIAXIRGI type=write size=2265731 2024-09-14T11:17:23.676 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.678+0000 7fe125ff88c0 1 < suggested remove operation key=YN2HI39GPEDF tag=B047SYXXIAQ4 type=del 2024-09-14T11:17:23.680 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.678+0000 7fe125ff88c0 1 > prepared operation key=3YGN50MBAF41 tag=931T9N2I83SQ type=del size=985520 2024-09-14T11:17:23.683 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.682+0000 7fe125ff88c0 1 < completed delete operation key=ESVFZQQXE3GT tag=T70GUPNWJYVM type=del 2024-09-14T11:17:23.691 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.690+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~BM1KCS72OXZX.0 size=480678 2024-09-14T11:17:23.691 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.690+0000 7fe125ff88c0 1 > prepared multipart upload key=W0B19NBHNLMZ upload=BM1KCS72OXZX tag=4IM1PLK2HTT9 type=write size=1529254 2024-09-14T11:17:23.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.694+0000 7fe125ff88c0 1 < completed delete operation key=W0B19NBHNLMZ tag=ANO33K6T376X type=del 2024-09-14T11:17:23.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.702+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~H95MFO96AXCB.0 size=1048576 2024-09-14T11:17:23.705 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.706+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~H95MFO96AXCB.1 size=47831 2024-09-14T11:17:23.705 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.706+0000 7fe125ff88c0 1 > prepared multipart upload key=2UXA6SXDTUFT upload=H95MFO96AXCB tag=DMWMGEQ0C02S type=write size=2144983 2024-09-14T11:17:23.709 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.710+0000 7fe125ff88c0 1 < completed delete operation key=W0B19NBHNLMZ tag=CJVA1M7HW64V type=del 2024-09-14T11:17:23.716 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.714+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~P032USII4A2U.0 size=1048576 2024-09-14T11:17:23.719 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.718+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~P032USII4A2U.1 size=1048576 2024-09-14T11:17:23.722 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.722+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~P032USII4A2U.2 size=595076 2024-09-14T11:17:23.722 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.722+0000 7fe125ff88c0 1 > prepared multipart upload key=1ML6RIXI4C5P upload=P032USII4A2U tag=AWUB0PHQ63B6 type=write size=3740804 2024-09-14T11:17:23.726 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.726+0000 7fe125ff88c0 1 < completed delete operation key=3YGN50MBAF41 tag=7G6WYUYH30OJ type=del 2024-09-14T11:17:23.732 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.734+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~810AOV5KZ5OA.0 size=575365 2024-09-14T11:17:23.732 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.734+0000 7fe125ff88c0 1 > prepared multipart upload key=FQ5WT12KB664 upload=810AOV5KZ5OA tag=M0XQC5IXG511 type=write size=1623941 2024-09-14T11:17:23.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.738+0000 7fe125ff88c0 1 < completed delete operation key=YGEVGH840L18 tag=6D1FBML0226F type=del 2024-09-14T11:17:23.740 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.742+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=U480QKRKUPBD type=del size=9807 2024-09-14T11:17:23.747 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.746+0000 7fe125ff88c0 1 < suggested remove operation key=L4XO0WTYKNXY tag=2K60AP64ACPH type=write 2024-09-14T11:17:23.755 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.754+0000 7fe125ff88c0 1 > prepared part key=_multipart_6PLUU2QIO9LJ.2~88ACRV3J1IL5.0 size=1048576 2024-09-14T11:17:23.757 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.758+0000 7fe125ff88c0 1 > prepared part key=_multipart_6PLUU2QIO9LJ.2~88ACRV3J1IL5.1 size=746054 2024-09-14T11:17:23.757 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.758+0000 7fe125ff88c0 1 > prepared multipart upload key=6PLUU2QIO9LJ upload=88ACRV3J1IL5 tag=6XC27Z7LENG1 type=write size=2843206 2024-09-14T11:17:23.761 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.762+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~GCU5IVC30N2W.0 size=229003 2024-09-14T11:17:23.768 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.770+0000 7fe125ff88c0 1 < completed multipart upload key=SUCH37O8V1LY upload=GCU5IVC30N2W tag=3AOKYD0OX6NN type=write size=1277579 2024-09-14T11:17:23.772 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.774+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=P1QCHEJJ8FZ8 type=del size=1141849 2024-09-14T11:17:23.777 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.778+0000 7fe125ff88c0 1 < completed delete operation key=1ML6RIXI4C5P tag=ZSON8QGCAOHU type=del 2024-09-14T11:17:23.784 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.786+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~KRSLP6L2K3QZ.0 size=903269 2024-09-14T11:17:23.784 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.786+0000 7fe125ff88c0 1 > prepared multipart upload key=2LH5U05C2F8C upload=KRSLP6L2K3QZ tag=NT09TLX5EHPD type=write size=1951845 2024-09-14T11:17:23.789 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.790+0000 7fe125ff88c0 1 < completed write operation key=3OU4U9JF3ZD5 tag=1DMJAVY78A87 type=write size=888878 2024-09-14T11:17:23.793 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.794+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=6UXCZQZ4EQSC type=del size=373804 2024-09-14T11:17:23.797 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.798+0000 7fe125ff88c0 1 < completed delete operation key=YCF2PCJ9TZMR tag=H1JICA3OVRIG type=del 2024-09-14T11:17:23.801 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.802+0000 7fe125ff88c0 1 > prepared operation key=0FITHLGQKQEC tag=UIFQ5076FKTT type=write size=111144 2024-09-14T11:17:23.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.806+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~XVW7KIFFZ6SR.0 size=452189 2024-09-14T11:17:23.812 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.810+0000 7fe125ff88c0 1 < completed multipart upload key=35EB6U5O4A51 upload=XVW7KIFFZ6SR tag=WBUFG8RZXTXN type=write size=1500765 2024-09-14T11:17:23.816 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.814+0000 7fe125ff88c0 1 > prepared operation key=LYBGDNKUROWH tag=Q0LWTL5MV8UI type=write size=280663 2024-09-14T11:17:23.821 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.822+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~F18L0MTI7V0S.0 size=44416 2024-09-14T11:17:23.826 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.826+0000 7fe125ff88c0 1 < completed multipart upload key=3OU4U9JF3ZD5 upload=F18L0MTI7V0S tag=L2HTFSPJY7GS type=write size=1092992 2024-09-14T11:17:23.833 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.834+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~EJABHJRDNTRO.0 size=141567 2024-09-14T11:17:23.833 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.834+0000 7fe125ff88c0 1 > prepared multipart upload key=2LH5U05C2F8C upload=EJABHJRDNTRO tag=35SUXNIHFCEM type=write size=1190143 2024-09-14T11:17:23.836 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.838+0000 7fe125ff88c0 1 < completed delete operation key=35EB6U5O4A51 tag=EOWUZIGLJLBZ type=del 2024-09-14T11:17:23.840 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.838+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=K5X61GZ3Q1V2 type=del size=4072265 2024-09-14T11:17:23.844 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.846+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~VEZSUNJ61FRS.0 size=63237 2024-09-14T11:17:23.851 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.850+0000 7fe125ff88c0 1 < completed multipart upload key=FQ5WT12KB664 upload=VEZSUNJ61FRS tag=HREJFRUA1JUA type=write size=1111813 2024-09-14T11:17:23.855 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.854+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=R6RGSJWBXT0L type=del size=780459 2024-09-14T11:17:23.859 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.858+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~VYH1T3EH9LAN.0 size=1048576 2024-09-14T11:17:23.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.862+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~VYH1T3EH9LAN.1 size=168579 2024-09-14T11:17:23.868 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.870+0000 7fe125ff88c0 1 < completed multipart upload key=35EB6U5O4A51 upload=VYH1T3EH9LAN tag=4UX1AIAXIRGI type=write size=2265731 2024-09-14T11:17:23.875 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.874+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~6XU8VCJ4PTDW.0 size=698846 2024-09-14T11:17:23.875 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.874+0000 7fe125ff88c0 1 > prepared multipart upload key=1ML6RIXI4C5P upload=6XU8VCJ4PTDW tag=D6IY8DCM26BJ type=write size=1747422 2024-09-14T11:17:23.879 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.878+0000 7fe125ff88c0 1 < completed delete operation key=3YGN50MBAF41 tag=931T9N2I83SQ type=del 2024-09-14T11:17:23.883 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.882+0000 7fe125ff88c0 1 > prepared operation key=3OU4U9JF3ZD5 tag=1V7NV640WOY7 type=del size=1605015 2024-09-14T11:17:23.887 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.886+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~BM1KCS72OXZX.0 size=480678 2024-09-14T11:17:23.894 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.894+0000 7fe125ff88c0 1 < completed multipart upload key=W0B19NBHNLMZ upload=BM1KCS72OXZX tag=4IM1PLK2HTT9 type=write size=1529254 2024-09-14T11:17:23.898 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.898+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=EK2RFWTP14QN type=del size=776951 2024-09-14T11:17:23.902 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.902+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~H95MFO96AXCB.0 size=1048576 2024-09-14T11:17:23.905 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.906+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~H95MFO96AXCB.1 size=47831 2024-09-14T11:17:23.910 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.910+0000 7fe125ff88c0 1 < completed multipart upload key=2UXA6SXDTUFT upload=H95MFO96AXCB tag=DMWMGEQ0C02S type=write size=2144983 2024-09-14T11:17:23.915 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.914+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=X75FGHVAJU1A type=write size=966806 2024-09-14T11:17:23.919 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.918+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~P032USII4A2U.0 size=1048576 2024-09-14T11:17:23.922 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.922+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~P032USII4A2U.1 size=1048576 2024-09-14T11:17:23.925 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.926+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~P032USII4A2U.2 size=595076 2024-09-14T11:17:23.931 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.930+0000 7fe125ff88c0 1 < completed multipart upload key=1ML6RIXI4C5P upload=P032USII4A2U tag=AWUB0PHQ63B6 type=write size=3740804 2024-09-14T11:17:23.935 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.934+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=462QM53DCITJ type=del size=4021087 2024-09-14T11:17:23.939 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.938+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~810AOV5KZ5OA.0 size=575365 2024-09-14T11:17:23.945 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.946+0000 7fe125ff88c0 1 < completed multipart upload key=FQ5WT12KB664 upload=810AOV5KZ5OA tag=M0XQC5IXG511 type=write size=1623941 2024-09-14T11:17:23.952 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.954+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~EFO9NHV8WZBZ.0 size=644359 2024-09-14T11:17:23.952 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.954+0000 7fe125ff88c0 1 > prepared multipart upload key=FQ5WT12KB664 upload=EFO9NHV8WZBZ tag=9E6TU534LH7O type=write size=1692935 2024-09-14T11:17:23.956 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.954+0000 7fe125ff88c0 1 < completed delete operation key=2LH5U05C2F8C tag=U480QKRKUPBD type=del 2024-09-14T11:17:23.962 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.962+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~CF28NOG5WXD8.0 size=1048576 2024-09-14T11:17:23.965 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.966+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~CF28NOG5WXD8.1 size=747986 2024-09-14T11:17:23.965 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.966+0000 7fe125ff88c0 1 > prepared multipart upload key=1ML6RIXI4C5P upload=CF28NOG5WXD8 tag=IVNTN34P7DQZ type=write size=2845138 2024-09-14T11:17:23.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.970+0000 7fe125ff88c0 1 < completed part key=_multipart_6PLUU2QIO9LJ.2~88ACRV3J1IL5.0 size=1048576 2024-09-14T11:17:23.972 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.970+0000 7fe125ff88c0 1 < completed part key=_multipart_6PLUU2QIO9LJ.2~88ACRV3J1IL5.1 size=746054 2024-09-14T11:17:23.978 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.978+0000 7fe125ff88c0 1 < completed multipart upload key=6PLUU2QIO9LJ upload=88ACRV3J1IL5 tag=6XC27Z7LENG1 type=write size=2843206 2024-09-14T11:17:23.982 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.982+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=D8WB98VC8REM type=del size=1938632 2024-09-14T11:17:23.990 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.990+0000 7fe125ff88c0 1 < suggested update operation key=6PLUU2QIO9LJ tag=P1QCHEJJ8FZ8 type=del size=1141849 2024-09-14T11:17:23.998 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:23.998+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~6GX3VVXEUCUE.0 size=1048576 2024-09-14T11:17:24.001 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.002+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~6GX3VVXEUCUE.1 size=1048576 2024-09-14T11:17:24.008 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.010+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~6GX3VVXEUCUE.2 size=203508 2024-09-14T11:17:24.008 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.010+0000 7fe125ff88c0 1 > prepared multipart upload key=21HC4VMHXS6L upload=6GX3VVXEUCUE tag=P69JUC4147HX type=write size=3349236 2024-09-14T11:17:24.013 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.014+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~KRSLP6L2K3QZ.0 size=903269 2024-09-14T11:17:24.019 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.018+0000 7fe125ff88c0 1 < completed multipart upload key=2LH5U05C2F8C upload=KRSLP6L2K3QZ tag=NT09TLX5EHPD type=write size=1951845 2024-09-14T11:17:24.026 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.026+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~PX7ILJCX70T4.0 size=518986 2024-09-14T11:17:24.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.026+0000 7fe125ff88c0 1 > prepared multipart upload key=0FITHLGQKQEC upload=PX7ILJCX70T4 tag=6WUZPOJMEG4K type=write size=1567562 2024-09-14T11:17:24.034 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.034+0000 7fe125ff88c0 1 < suggested update operation key=2LH5U05C2F8C tag=6UXCZQZ4EQSC type=del size=373804 2024-09-14T11:17:24.039 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.038+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=IFX35LU304U2 type=del size=2852705 2024-09-14T11:17:24.043 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.042+0000 7fe125ff88c0 1 < completed write operation key=0FITHLGQKQEC tag=UIFQ5076FKTT type=write size=111144 2024-09-14T11:17:24.048 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.046+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=RN5GLSXN2TXA type=del size=1283083 2024-09-14T11:17:24.052 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.054+0000 7fe125ff88c0 1 < completed write operation key=LYBGDNKUROWH tag=Q0LWTL5MV8UI type=write size=280663 2024-09-14T11:17:24.056 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.058+0000 7fe125ff88c0 1 > prepared operation key=K05LARTJ2QZ3 tag=LIFVFU5BWO88 type=write size=817177 2024-09-14T11:17:24.060 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.058+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~EJABHJRDNTRO.0 size=141567 2024-09-14T11:17:24.066 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.066+0000 7fe125ff88c0 1 < completed multipart upload key=2LH5U05C2F8C upload=EJABHJRDNTRO tag=35SUXNIHFCEM type=write size=1190143 2024-09-14T11:17:24.070 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.070+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=JZMFHWWG4OKN type=del size=3177298 2024-09-14T11:17:24.075 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.074+0000 7fe125ff88c0 1 < completed delete operation key=SSNV25PDLDIS tag=K5X61GZ3Q1V2 type=del 2024-09-14T11:17:24.082 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.082+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~Q5YWYNW7U2J6.0 size=688729 2024-09-14T11:17:24.082 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.082+0000 7fe125ff88c0 1 > prepared multipart upload key=21HC4VMHXS6L upload=Q5YWYNW7U2J6 tag=A0ZLPP4041I7 type=write size=1737305 2024-09-14T11:17:24.086 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.086+0000 7fe125ff88c0 1 < completed delete operation key=YN2HI39GPEDF tag=R6RGSJWBXT0L type=del 2024-09-14T11:17:24.090 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.090+0000 7fe125ff88c0 1 > prepared operation key=N80X3YUF4OEL tag=9GMRPHR6VC02 type=del size=2613588 2024-09-14T11:17:24.095 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.094+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~6XU8VCJ4PTDW.0 size=698846 2024-09-14T11:17:24.101 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.102+0000 7fe125ff88c0 1 < completed multipart upload key=1ML6RIXI4C5P upload=6XU8VCJ4PTDW tag=D6IY8DCM26BJ type=write size=1747422 2024-09-14T11:17:24.108 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.106+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~GP2ZBPS52T5E.0 size=1048576 2024-09-14T11:17:24.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.110+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~GP2ZBPS52T5E.1 size=763873 2024-09-14T11:17:24.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.110+0000 7fe125ff88c0 1 > prepared multipart upload key=YGEVGH840L18 upload=GP2ZBPS52T5E tag=71O2SL1FN552 type=write size=2861025 2024-09-14T11:17:24.114 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.114+0000 7fe125ff88c0 1 < canceled operation key=3OU4U9JF3ZD5 tag=1V7NV640WOY7 type=del size=1605015 2024-09-14T11:17:24.118 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.118+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=2OYYCZQTPAK5 type=del size=3704938 2024-09-14T11:17:24.122 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.122+0000 7fe125ff88c0 1 < canceled operation key=YN2HI39GPEDF tag=EK2RFWTP14QN type=del size=776951 2024-09-14T11:17:24.126 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.126+0000 7fe125ff88c0 1 > prepared operation key=0FITHLGQKQEC tag=5QRU0F5PMHMJ type=del size=1182318 2024-09-14T11:17:24.130 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.130+0000 7fe125ff88c0 1 < completed write operation key=V6B470G93KFT tag=X75FGHVAJU1A type=write size=966806 2024-09-14T11:17:24.137 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.138+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~10P3NFO65OYC.0 size=1048576 2024-09-14T11:17:24.140 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.138+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~10P3NFO65OYC.1 size=1048576 2024-09-14T11:17:24.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.142+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~10P3NFO65OYC.2 size=122662 2024-09-14T11:17:24.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.142+0000 7fe125ff88c0 1 > prepared multipart upload key=V6B470G93KFT upload=10P3NFO65OYC tag=770D1UAPCVO6 type=write size=3268390 2024-09-14T11:17:24.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.150+0000 7fe125ff88c0 1 < suggested update operation key=N94D3R7IOBNL tag=462QM53DCITJ type=del size=4021087 2024-09-14T11:17:24.157 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.158+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~PCSJAV0TH0ZT.0 size=445037 2024-09-14T11:17:24.157 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.158+0000 7fe125ff88c0 1 > prepared multipart upload key=4D2X7151977X upload=PCSJAV0TH0ZT tag=0LJNX1IDH0MN type=write size=1493613 2024-09-14T11:17:24.161 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.162+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~EFO9NHV8WZBZ.0 size=644359 2024-09-14T11:17:24.167 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.166+0000 7fe125ff88c0 1 < completed multipart upload key=FQ5WT12KB664 upload=EFO9NHV8WZBZ tag=9E6TU534LH7O type=write size=1692935 2024-09-14T11:17:24.170 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.170+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=86IPGDS831U6 type=del size=2302319 2024-09-14T11:17:24.174 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.174+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~CF28NOG5WXD8.0 size=1048576 2024-09-14T11:17:24.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.178+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~CF28NOG5WXD8.1 size=747986 2024-09-14T11:17:24.183 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.182+0000 7fe125ff88c0 1 < completed multipart upload key=1ML6RIXI4C5P upload=CF28NOG5WXD8 tag=IVNTN34P7DQZ type=write size=2845138 2024-09-14T11:17:24.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.190+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~E72T484RY07A.0 size=1048576 2024-09-14T11:17:24.192 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.194+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~E72T484RY07A.1 size=553923 2024-09-14T11:17:24.192 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.194+0000 7fe125ff88c0 1 > prepared multipart upload key=W0B19NBHNLMZ upload=E72T484RY07A tag=R2WN2X35EM7D type=write size=2651075 2024-09-14T11:17:24.197 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.198+0000 7fe125ff88c0 1 < completed delete operation key=K3P6U6NU8I01 tag=D8WB98VC8REM type=del 2024-09-14T11:17:24.201 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.202+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=53Q8VYUSBEI6 type=del size=1070690 2024-09-14T11:17:24.205 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.206+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~6GX3VVXEUCUE.0 size=1048576 2024-09-14T11:17:24.208 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.206+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~6GX3VVXEUCUE.1 size=1048576 2024-09-14T11:17:24.210 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.210+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~6GX3VVXEUCUE.2 size=203508 2024-09-14T11:17:24.216 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.214+0000 7fe125ff88c0 1 < completed multipart upload key=21HC4VMHXS6L upload=6GX3VVXEUCUE tag=P69JUC4147HX type=write size=3349236 2024-09-14T11:17:24.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.218+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=NB23XQ689VO4 type=del size=4190998 2024-09-14T11:17:24.223 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.222+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~PX7ILJCX70T4.0 size=518986 2024-09-14T11:17:24.229 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.230+0000 7fe125ff88c0 1 < completed multipart upload key=0FITHLGQKQEC upload=PX7ILJCX70T4 tag=6WUZPOJMEG4K type=write size=1567562 2024-09-14T11:17:24.234 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.234+0000 7fe125ff88c0 1 > prepared operation key=46ZTDBWFVSUH tag=TU3G1WJZ0ZO7 type=del size=3825736 2024-09-14T11:17:24.242 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.242+0000 7fe125ff88c0 1 < suggested update operation key=YN2HI39GPEDF tag=IFX35LU304U2 type=del size=2852705 2024-09-14T11:17:24.249 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.250+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~ODMD0SYNHHOH.0 size=1048576 2024-09-14T11:17:24.252 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.250+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~ODMD0SYNHHOH.1 size=783804 2024-09-14T11:17:24.252 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.250+0000 7fe125ff88c0 1 > prepared multipart upload key=35EB6U5O4A51 upload=ODMD0SYNHHOH tag=ROCEEEGSPQE0 type=write size=2880956 2024-09-14T11:17:24.257 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.258+0000 7fe125ff88c0 1 < completed delete operation key=2KEKSWK0UT6C tag=RN5GLSXN2TXA type=del 2024-09-14T11:17:24.261 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.262+0000 7fe125ff88c0 1 > prepared operation key=K05LARTJ2QZ3 tag=T82L20EP5UZK type=del size=1523815 2024-09-14T11:17:24.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.270+0000 7fe125ff88c0 1 < suggested update operation key=K05LARTJ2QZ3 tag=LIFVFU5BWO88 type=write size=817177 2024-09-14T11:17:24.273 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.274+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=ZA532QB9DA02 type=del size=3775385 2024-09-14T11:17:24.277 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.278+0000 7fe125ff88c0 1 < completed delete operation key=2LH5U05C2F8C tag=JZMFHWWG4OKN type=del 2024-09-14T11:17:24.284 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.286+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~SM7LCE0XBS2A.0 size=1048576 2024-09-14T11:17:24.287 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.286+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~SM7LCE0XBS2A.1 size=1048576 2024-09-14T11:17:24.290 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.290+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~SM7LCE0XBS2A.2 size=151032 2024-09-14T11:17:24.290 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.290+0000 7fe125ff88c0 1 > prepared multipart upload key=FQ5WT12KB664 upload=SM7LCE0XBS2A tag=IU3AHMTE1HFZ type=write size=3296760 2024-09-14T11:17:24.294 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.294+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~Q5YWYNW7U2J6.0 size=688729 2024-09-14T11:17:24.300 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.298+0000 7fe125ff88c0 1 < completed multipart upload key=21HC4VMHXS6L upload=Q5YWYNW7U2J6 tag=A0ZLPP4041I7 type=write size=1737305 2024-09-14T11:17:24.304 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.302+0000 7fe125ff88c0 1 > prepared operation key=YFRH8WECBTJK tag=2R6BZDCVNB3O type=del size=2029123 2024-09-14T11:17:24.309 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.310+0000 7fe125ff88c0 1 < canceled operation key=N80X3YUF4OEL tag=9GMRPHR6VC02 type=del size=2613588 2024-09-14T11:17:24.315 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.314+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~XRI2GBSN1DV3.0 size=396321 2024-09-14T11:17:24.315 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.314+0000 7fe125ff88c0 1 > prepared multipart upload key=35EB6U5O4A51 upload=XRI2GBSN1DV3 tag=8Q29FG6OIYXZ type=write size=1444897 2024-09-14T11:17:24.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.318+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~GP2ZBPS52T5E.0 size=1048576 2024-09-14T11:17:24.322 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.322+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~GP2ZBPS52T5E.1 size=763873 2024-09-14T11:17:24.327 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.326+0000 7fe125ff88c0 1 < completed multipart upload key=YGEVGH840L18 upload=GP2ZBPS52T5E tag=71O2SL1FN552 type=write size=2861025 2024-09-14T11:17:24.331 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.330+0000 7fe125ff88c0 1 > prepared operation key=LYBGDNKUROWH tag=1HRV56O7T7D6 type=del size=1727945 2024-09-14T11:17:24.335 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.334+0000 7fe125ff88c0 1 < completed delete operation key=F9I82N7RQC81 tag=2OYYCZQTPAK5 type=del 2024-09-14T11:17:24.340 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.338+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=M3A7UIQ39HOK type=del size=3901091 2024-09-14T11:17:24.344 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.342+0000 7fe125ff88c0 1 < completed delete operation key=0FITHLGQKQEC tag=5QRU0F5PMHMJ type=del 2024-09-14T11:17:24.348 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.346+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=C4PGRBOD5547 type=del size=906616 2024-09-14T11:17:24.352 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.350+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~10P3NFO65OYC.0 size=1048576 2024-09-14T11:17:24.355 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.354+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~10P3NFO65OYC.1 size=1048576 2024-09-14T11:17:24.358 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.358+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~10P3NFO65OYC.2 size=122662 2024-09-14T11:17:24.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.362+0000 7fe125ff88c0 1 < completed multipart upload key=V6B470G93KFT upload=10P3NFO65OYC tag=770D1UAPCVO6 type=write size=3268390 2024-09-14T11:17:24.374 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.374+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~UP8NRK4ME0V9.0 size=348622 2024-09-14T11:17:24.374 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.374+0000 7fe125ff88c0 1 > prepared multipart upload key=3OU4U9JF3ZD5 upload=UP8NRK4ME0V9 tag=0DE3HQ9YWXS9 type=write size=1397198 2024-09-14T11:17:24.377 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.378+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~PCSJAV0TH0ZT.0 size=445037 2024-09-14T11:17:24.383 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.382+0000 7fe125ff88c0 1 < completed multipart upload key=4D2X7151977X upload=PCSJAV0TH0ZT tag=0LJNX1IDH0MN type=write size=1493613 2024-09-14T11:17:24.386 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.386+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=LRPRIC2TR896 type=write size=215113 2024-09-14T11:17:24.393 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.394+0000 7fe125ff88c0 1 < suggested remove operation key=2LH5U05C2F8C tag=86IPGDS831U6 type=del 2024-09-14T11:17:24.399 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.398+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~E5KO775Z5OYG.0 size=1048576 2024-09-14T11:17:24.402 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.402+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~E5KO775Z5OYG.1 size=425246 2024-09-14T11:17:24.402 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.402+0000 7fe125ff88c0 1 > prepared multipart upload key=L4XO0WTYKNXY upload=E5KO775Z5OYG tag=HFRHW25IWU6K type=write size=2522398 2024-09-14T11:17:24.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.406+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~E72T484RY07A.0 size=1048576 2024-09-14T11:17:24.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.406+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~E72T484RY07A.1 size=553923 2024-09-14T11:17:24.413 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.414+0000 7fe125ff88c0 1 < completed multipart upload key=W0B19NBHNLMZ upload=E72T484RY07A tag=R2WN2X35EM7D type=write size=2651075 2024-09-14T11:17:24.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.418+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~VN5T67LQUYG1.0 size=868186 2024-09-14T11:17:24.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.418+0000 7fe125ff88c0 1 > prepared multipart upload key=46ZTDBWFVSUH upload=VN5T67LQUYG1 tag=9JQBZIAE9RRG type=write size=1916762 2024-09-14T11:17:24.424 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.422+0000 7fe125ff88c0 1 < completed delete operation key=W0B19NBHNLMZ tag=53Q8VYUSBEI6 type=del 2024-09-14T11:17:24.428 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.426+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=FXWSJMOAAN83 type=del size=4098872 2024-09-14T11:17:24.432 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.434+0000 7fe125ff88c0 1 < completed delete operation key=35EB6U5O4A51 tag=NB23XQ689VO4 type=del 2024-09-14T11:17:24.436 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.438+0000 7fe125ff88c0 1 > prepared operation key=6C3JZKTB8BP3 tag=PFNSIFBEZEX2 type=write size=241857 2024-09-14T11:17:24.444 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.442+0000 7fe125ff88c0 1 < suggested remove operation key=46ZTDBWFVSUH tag=TU3G1WJZ0ZO7 type=del 2024-09-14T11:17:24.450 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.450+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~PZ0ZIRURHLVO.0 size=986075 2024-09-14T11:17:24.450 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.450+0000 7fe125ff88c0 1 > prepared multipart upload key=ESVFZQQXE3GT upload=PZ0ZIRURHLVO tag=U09SKU9UGLIG type=write size=2034651 2024-09-14T11:17:24.454 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.454+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~ODMD0SYNHHOH.0 size=1048576 2024-09-14T11:17:24.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.454+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~ODMD0SYNHHOH.1 size=783804 2024-09-14T11:17:24.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.462+0000 7fe125ff88c0 1 < completed multipart upload key=35EB6U5O4A51 upload=ODMD0SYNHHOH tag=ROCEEEGSPQE0 type=write size=2880956 2024-09-14T11:17:24.468 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.470+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~N65YGNYDJCEH.0 size=522012 2024-09-14T11:17:24.468 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.470+0000 7fe125ff88c0 1 > prepared multipart upload key=V6B470G93KFT upload=N65YGNYDJCEH tag=YL2KKC4DHZ73 type=write size=1570588 2024-09-14T11:17:24.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.474+0000 7fe125ff88c0 1 < suggested remove operation key=K05LARTJ2QZ3 tag=T82L20EP5UZK type=del 2024-09-14T11:17:24.479 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.478+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=QYW435SYIIPT type=del size=2001137 2024-09-14T11:17:24.483 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.482+0000 7fe125ff88c0 1 < canceled operation key=35EB6U5O4A51 tag=ZA532QB9DA02 type=del size=3775385 2024-09-14T11:17:24.489 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.490+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~CH4HOWQAFK90.0 size=354185 2024-09-14T11:17:24.489 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.490+0000 7fe125ff88c0 1 > prepared multipart upload key=F9I82N7RQC81 upload=CH4HOWQAFK90 tag=R5IAG1YNT7EM type=write size=1402761 2024-09-14T11:17:24.490 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.490+0000 7fe125ff88c0 1 < canceled part key=_multipart_FQ5WT12KB664.2~SM7LCE0XBS2A.0 size=1048576 2024-09-14T11:17:24.492 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.494+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~SM7LCE0XBS2A.1 size=1048576 2024-09-14T11:17:24.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.494+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~SM7LCE0XBS2A.2 size=151032 2024-09-14T11:17:24.501 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.502+0000 7fe125ff88c0 1 < canceled multipart upload key=FQ5WT12KB664 upload=SM7LCE0XBS2A tag=IU3AHMTE1HFZ type=write size=3296760 2024-09-14T11:17:24.505 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.506+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=IB2GJY52WIG3 type=del size=3926964 2024-09-14T11:17:24.508 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.510+0000 7fe125ff88c0 1 < canceled operation key=YFRH8WECBTJK tag=2R6BZDCVNB3O type=del size=2029123 2024-09-14T11:17:24.514 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.514+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~X83NJXBLLB4D.0 size=1048576 2024-09-14T11:17:24.517 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.518+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~X83NJXBLLB4D.1 size=783485 2024-09-14T11:17:24.517 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.518+0000 7fe125ff88c0 1 > prepared multipart upload key=YFRH8WECBTJK upload=X83NJXBLLB4D tag=5RBBQFNSEHCK type=write size=2880637 2024-09-14T11:17:24.521 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.522+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~XRI2GBSN1DV3.0 size=396321 2024-09-14T11:17:24.526 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.526+0000 7fe125ff88c0 1 < completed multipart upload key=35EB6U5O4A51 upload=XRI2GBSN1DV3 tag=8Q29FG6OIYXZ type=write size=1444897 2024-09-14T11:17:24.533 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.534+0000 7fe125ff88c0 1 > prepared part key=_multipart_6PLUU2QIO9LJ.2~8E6KOSKQ30SZ.0 size=1048576 2024-09-14T11:17:24.535 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.534+0000 7fe125ff88c0 1 > prepared part key=_multipart_6PLUU2QIO9LJ.2~8E6KOSKQ30SZ.1 size=808797 2024-09-14T11:17:24.535 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.534+0000 7fe125ff88c0 1 > prepared multipart upload key=6PLUU2QIO9LJ upload=8E6KOSKQ30SZ tag=DTK1B68XY3EI type=write size=2905949 2024-09-14T11:17:24.538 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.538+0000 7fe125ff88c0 1 < completed delete operation key=LYBGDNKUROWH tag=1HRV56O7T7D6 type=del 2024-09-14T11:17:24.542 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.542+0000 7fe125ff88c0 1 > prepared operation key=N80X3YUF4OEL tag=J8FOFIPEPD3M type=del size=1460725 2024-09-14T11:17:24.546 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.546+0000 7fe125ff88c0 1 < completed delete operation key=W0B19NBHNLMZ tag=M3A7UIQ39HOK type=del 2024-09-14T11:17:24.552 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.550+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~K44B815J9JMS.0 size=1048576 2024-09-14T11:17:24.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.554+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~K44B815J9JMS.1 size=1048576 2024-09-14T11:17:24.558 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.558+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~K44B815J9JMS.2 size=621924 2024-09-14T11:17:24.558 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.558+0000 7fe125ff88c0 1 > prepared multipart upload key=21HC4VMHXS6L upload=K44B815J9JMS tag=ASG5UID9C6VC type=write size=3767652 2024-09-14T11:17:24.561 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.562+0000 7fe125ff88c0 1 < completed delete operation key=N94D3R7IOBNL tag=C4PGRBOD5547 type=del 2024-09-14T11:17:24.567 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.566+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~Z5KDUCM7HZKR.0 size=54592 2024-09-14T11:17:24.567 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.566+0000 7fe125ff88c0 1 > prepared multipart upload key=46ZTDBWFVSUH upload=Z5KDUCM7HZKR tag=4IYRO7MB1YAU type=write size=1103168 2024-09-14T11:17:24.571 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.570+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~UP8NRK4ME0V9.0 size=348622 2024-09-14T11:17:24.578 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.578+0000 7fe125ff88c0 1 < completed multipart upload key=3OU4U9JF3ZD5 upload=UP8NRK4ME0V9 tag=0DE3HQ9YWXS9 type=write size=1397198 2024-09-14T11:17:24.582 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.582+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=G0WEU6I6RF33 type=del size=451808 2024-09-14T11:17:24.586 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.586+0000 7fe125ff88c0 1 < completed write operation key=K3P6U6NU8I01 tag=LRPRIC2TR896 type=write size=215113 2024-09-14T11:17:24.590 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.590+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=G9TE7G4RE9BE type=del size=350366 2024-09-14T11:17:24.594 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.594+0000 7fe125ff88c0 1 < completed part key=_multipart_L4XO0WTYKNXY.2~E5KO775Z5OYG.0 size=1048576 2024-09-14T11:17:24.597 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.598+0000 7fe125ff88c0 1 < completed part key=_multipart_L4XO0WTYKNXY.2~E5KO775Z5OYG.1 size=425246 2024-09-14T11:17:24.602 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.602+0000 7fe125ff88c0 1 < completed multipart upload key=L4XO0WTYKNXY upload=E5KO775Z5OYG tag=HFRHW25IWU6K type=write size=2522398 2024-09-14T11:17:24.609 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.610+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~6IGR4PK1IHWX.0 size=1048576 2024-09-14T11:17:24.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.610+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~6IGR4PK1IHWX.1 size=1048576 2024-09-14T11:17:24.615 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.614+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~6IGR4PK1IHWX.2 size=86744 2024-09-14T11:17:24.615 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.614+0000 7fe125ff88c0 1 > prepared multipart upload key=V6B470G93KFT upload=6IGR4PK1IHWX tag=CKZ2VVDON1VQ type=write size=3232472 2024-09-14T11:17:24.619 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.618+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~VN5T67LQUYG1.0 size=868186 2024-09-14T11:17:24.624 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.626+0000 7fe125ff88c0 1 < completed multipart upload key=46ZTDBWFVSUH upload=VN5T67LQUYG1 tag=9JQBZIAE9RRG type=write size=1916762 2024-09-14T11:17:24.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.626+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=WZLMTUITBZQE type=del size=347352 2024-09-14T11:17:24.635 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.634+0000 7fe125ff88c0 1 < suggested update operation key=2LH5U05C2F8C tag=FXWSJMOAAN83 type=del size=4098872 2024-09-14T11:17:24.642 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.642+0000 7fe125ff88c0 1 > prepared part key=_multipart_N94D3R7IOBNL.2~VDM6IO7TQ0C9.0 size=1048576 2024-09-14T11:17:24.645 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.646+0000 7fe125ff88c0 1 > prepared part key=_multipart_N94D3R7IOBNL.2~VDM6IO7TQ0C9.1 size=1048576 2024-09-14T11:17:24.647 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.646+0000 7fe125ff88c0 1 > prepared part key=_multipart_N94D3R7IOBNL.2~VDM6IO7TQ0C9.2 size=7255 2024-09-14T11:17:24.648 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.646+0000 7fe125ff88c0 1 > prepared multipart upload key=N94D3R7IOBNL upload=VDM6IO7TQ0C9 tag=9Y761VCA7DDW type=write size=3152983 2024-09-14T11:17:24.651 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.650+0000 7fe125ff88c0 1 < completed write operation key=6C3JZKTB8BP3 tag=PFNSIFBEZEX2 type=write size=241857 2024-09-14T11:17:24.655 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.654+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=OBVZHNTP8XJI type=del size=3717225 2024-09-14T11:17:24.659 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.658+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~PZ0ZIRURHLVO.0 size=986075 2024-09-14T11:17:24.666 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.666+0000 7fe125ff88c0 1 < completed multipart upload key=ESVFZQQXE3GT upload=PZ0ZIRURHLVO tag=U09SKU9UGLIG type=write size=2034651 2024-09-14T11:17:24.669 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.670+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=NMICZL0X2FDP type=del size=2844690 2024-09-14T11:17:24.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.674+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~N65YGNYDJCEH.0 size=522012 2024-09-14T11:17:24.680 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.682+0000 7fe125ff88c0 1 < completed multipart upload key=V6B470G93KFT upload=N65YGNYDJCEH tag=YL2KKC4DHZ73 type=write size=1570588 2024-09-14T11:17:24.687 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.686+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~4ONTWISJZWWW.0 size=1048576 2024-09-14T11:17:24.690 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.690+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~4ONTWISJZWWW.1 size=1048576 2024-09-14T11:17:24.693 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.694+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~4ONTWISJZWWW.2 size=223555 2024-09-14T11:17:24.693 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.694+0000 7fe125ff88c0 1 > prepared multipart upload key=SSNV25PDLDIS upload=4ONTWISJZWWW tag=3UN0A2NKW3J2 type=write size=3369283 2024-09-14T11:17:24.697 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.698+0000 7fe125ff88c0 1 < completed delete operation key=V6B470G93KFT tag=QYW435SYIIPT type=del 2024-09-14T11:17:24.707 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.706+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~LG8B110GTHPB.0 size=1048576 2024-09-14T11:17:24.710 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.710+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~LG8B110GTHPB.1 size=814251 2024-09-14T11:17:24.710 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.710+0000 7fe125ff88c0 1 > prepared multipart upload key=YN2HI39GPEDF upload=LG8B110GTHPB tag=3MD3FHTG1SFT type=write size=2911403 2024-09-14T11:17:24.714 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.714+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~CH4HOWQAFK90.0 size=354185 2024-09-14T11:17:24.719 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.718+0000 7fe125ff88c0 1 < completed multipart upload key=F9I82N7RQC81 upload=CH4HOWQAFK90 tag=R5IAG1YNT7EM type=write size=1402761 2024-09-14T11:17:24.723 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.722+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=BUPSMVOWBHX2 type=del size=2446911 2024-09-14T11:17:24.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.726+0000 7fe125ff88c0 1 < completed delete operation key=4D2X7151977X tag=IB2GJY52WIG3 type=del 2024-09-14T11:17:24.731 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.730+0000 7fe125ff88c0 1 > prepared operation key=YFRH8WECBTJK tag=4GUI60UVH42H type=del size=2996533 2024-09-14T11:17:24.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.734+0000 7fe125ff88c0 1 < completed part key=_multipart_YFRH8WECBTJK.2~X83NJXBLLB4D.0 size=1048576 2024-09-14T11:17:24.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.738+0000 7fe125ff88c0 1 < completed part key=_multipart_YFRH8WECBTJK.2~X83NJXBLLB4D.1 size=783485 2024-09-14T11:17:24.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.742+0000 7fe125ff88c0 1 < completed multipart upload key=YFRH8WECBTJK upload=X83NJXBLLB4D tag=5RBBQFNSEHCK type=write size=2880637 2024-09-14T11:17:24.747 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.746+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=DGGYSDSTEK09 type=del size=1307225 2024-09-14T11:17:24.751 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.750+0000 7fe125ff88c0 1 < completed part key=_multipart_6PLUU2QIO9LJ.2~8E6KOSKQ30SZ.0 size=1048576 2024-09-14T11:17:24.754 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.754+0000 7fe125ff88c0 1 < completed part key=_multipart_6PLUU2QIO9LJ.2~8E6KOSKQ30SZ.1 size=808797 2024-09-14T11:17:24.760 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.758+0000 7fe125ff88c0 1 < completed multipart upload key=6PLUU2QIO9LJ upload=8E6KOSKQ30SZ tag=DTK1B68XY3EI type=write size=2905949 2024-09-14T11:17:24.767 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.766+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~CNDWKJKP2NGP.0 size=1048576 2024-09-14T11:17:24.770 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.770+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~CNDWKJKP2NGP.1 size=1048576 2024-09-14T11:17:24.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.774+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~CNDWKJKP2NGP.2 size=406808 2024-09-14T11:17:24.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.774+0000 7fe125ff88c0 1 > prepared multipart upload key=35EB6U5O4A51 upload=CNDWKJKP2NGP tag=LOR2NOYEOY54 type=write size=3552536 2024-09-14T11:17:24.777 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.778+0000 7fe125ff88c0 1 < completed delete operation key=N80X3YUF4OEL tag=J8FOFIPEPD3M type=del 2024-09-14T11:17:24.782 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.782+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=P2C2IE0P8NWY type=del size=1874862 2024-09-14T11:17:24.783 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.782+0000 7fe125ff88c0 1 < canceled part key=_multipart_21HC4VMHXS6L.2~K44B815J9JMS.0 size=1048576 2024-09-14T11:17:24.786 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.786+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~K44B815J9JMS.1 size=1048576 2024-09-14T11:17:24.789 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.790+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~K44B815J9JMS.2 size=621924 2024-09-14T11:17:24.795 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.794+0000 7fe125ff88c0 1 < canceled multipart upload key=21HC4VMHXS6L upload=K44B815J9JMS tag=ASG5UID9C6VC type=write size=3767652 2024-09-14T11:17:24.799 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.798+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=8DVZTQP2CJDE type=del size=1652295 2024-09-14T11:17:24.802 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.802+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~Z5KDUCM7HZKR.0 size=54592 2024-09-14T11:17:24.808 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.806+0000 7fe125ff88c0 1 < completed multipart upload key=46ZTDBWFVSUH upload=Z5KDUCM7HZKR tag=4IYRO7MB1YAU type=write size=1103168 2024-09-14T11:17:24.815 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.814+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~EM57B3VU0Y0Y.0 size=637296 2024-09-14T11:17:24.815 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.814+0000 7fe125ff88c0 1 > prepared multipart upload key=K05LARTJ2QZ3 upload=EM57B3VU0Y0Y tag=1B5YBGLA4U5W type=write size=1685872 2024-09-14T11:17:24.822 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.822+0000 7fe125ff88c0 1 < suggested remove operation key=21HC4VMHXS6L tag=G0WEU6I6RF33 type=del 2024-09-14T11:17:24.826 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.826+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=3EJ951C3IMYT type=del size=4001368 2024-09-14T11:17:24.829 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.830+0000 7fe125ff88c0 1 < completed delete operation key=F9I82N7RQC81 tag=G9TE7G4RE9BE type=del 2024-09-14T11:17:24.833 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.834+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=2YHQOQHXMXG9 type=write size=549797 2024-09-14T11:17:24.836 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.838+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~6IGR4PK1IHWX.0 size=1048576 2024-09-14T11:17:24.839 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.838+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~6IGR4PK1IHWX.1 size=1048576 2024-09-14T11:17:24.842 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.842+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~6IGR4PK1IHWX.2 size=86744 2024-09-14T11:17:24.848 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.846+0000 7fe125ff88c0 1 < completed multipart upload key=V6B470G93KFT upload=6IGR4PK1IHWX tag=CKZ2VVDON1VQ type=write size=3232472 2024-09-14T11:17:24.851 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.850+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=0TKEHYV9EBOY type=del size=723469 2024-09-14T11:17:24.855 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.854+0000 7fe125ff88c0 1 < completed delete operation key=0VBX2FWYCFEZ tag=WZLMTUITBZQE type=del 2024-09-14T11:17:24.859 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.858+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=UF5MMT80Q8BK type=del size=3260569 2024-09-14T11:17:24.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.862+0000 7fe125ff88c0 1 < completed part key=_multipart_N94D3R7IOBNL.2~VDM6IO7TQ0C9.0 size=1048576 2024-09-14T11:17:24.865 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.866+0000 7fe125ff88c0 1 < completed part key=_multipart_N94D3R7IOBNL.2~VDM6IO7TQ0C9.1 size=1048576 2024-09-14T11:17:24.868 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.866+0000 7fe125ff88c0 1 < completed part key=_multipart_N94D3R7IOBNL.2~VDM6IO7TQ0C9.2 size=7255 2024-09-14T11:17:24.874 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.874+0000 7fe125ff88c0 1 < completed multipart upload key=N94D3R7IOBNL upload=VDM6IO7TQ0C9 tag=9Y761VCA7DDW type=write size=3152983 2024-09-14T11:17:24.878 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.878+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=JD83UFGOEKFI type=del size=1903729 2024-09-14T11:17:24.882 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.882+0000 7fe125ff88c0 1 < completed delete operation key=V6B470G93KFT tag=OBVZHNTP8XJI type=del 2024-09-14T11:17:24.886 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.886+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=DNOA28B4ZNNT type=del size=2058203 2024-09-14T11:17:24.890 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.890+0000 7fe125ff88c0 1 < completed delete operation key=35EB6U5O4A51 tag=NMICZL0X2FDP type=del 2024-09-14T11:17:24.894 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.894+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=H641XW41MPBU type=del size=3451681 2024-09-14T11:17:24.898 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.898+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~4ONTWISJZWWW.0 size=1048576 2024-09-14T11:17:24.900 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.902+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~4ONTWISJZWWW.1 size=1048576 2024-09-14T11:17:24.903 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.902+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~4ONTWISJZWWW.2 size=223555 2024-09-14T11:17:24.910 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.910+0000 7fe125ff88c0 1 < completed multipart upload key=SSNV25PDLDIS upload=4ONTWISJZWWW tag=3UN0A2NKW3J2 type=write size=3369283 2024-09-14T11:17:24.917 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.918+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~8UMTKCWSCB4T.0 size=1048576 2024-09-14T11:17:24.920 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.918+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~8UMTKCWSCB4T.1 size=1048576 2024-09-14T11:17:24.923 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.922+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~8UMTKCWSCB4T.2 size=147835 2024-09-14T11:17:24.923 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.922+0000 7fe125ff88c0 1 > prepared multipart upload key=1ML6RIXI4C5P upload=8UMTKCWSCB4T tag=FKZV4YCZ4J0F type=write size=3293563 2024-09-14T11:17:24.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.926+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~LG8B110GTHPB.0 size=1048576 2024-09-14T11:17:24.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.926+0000 7fe125ff88c0 1 < canceled part key=_multipart_YN2HI39GPEDF.2~LG8B110GTHPB.1 size=814251 2024-09-14T11:17:24.934 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.934+0000 7fe125ff88c0 1 < canceled multipart upload key=YN2HI39GPEDF upload=LG8B110GTHPB tag=3MD3FHTG1SFT type=write size=2911403 2024-09-14T11:17:24.938 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.938+0000 7fe125ff88c0 1 > prepared operation key=FQ5WT12KB664 tag=SMHTSFME16SZ type=del size=1986199 2024-09-14T11:17:24.942 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.942+0000 7fe125ff88c0 1 < completed delete operation key=YGEVGH840L18 tag=BUPSMVOWBHX2 type=del 2024-09-14T11:17:24.950 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.950+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~MLI2AYYN48PM.0 size=199512 2024-09-14T11:17:24.950 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.950+0000 7fe125ff88c0 1 > prepared multipart upload key=1ML6RIXI4C5P upload=MLI2AYYN48PM tag=ZGQ64N592VT1 type=write size=1248088 2024-09-14T11:17:24.955 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.954+0000 7fe125ff88c0 1 < completed delete operation key=YFRH8WECBTJK tag=4GUI60UVH42H type=del 2024-09-14T11:17:24.959 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.958+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=BWVEISDJ2ZIN type=del size=1043671 2024-09-14T11:17:24.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.962+0000 7fe125ff88c0 1 < completed delete operation key=K3P6U6NU8I01 tag=DGGYSDSTEK09 type=del 2024-09-14T11:17:24.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.970+0000 7fe125ff88c0 1 > prepared part key=_multipart_6PLUU2QIO9LJ.2~EIK9E1NG1I4R.0 size=1048576 2024-09-14T11:17:24.973 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.974+0000 7fe125ff88c0 1 > prepared part key=_multipart_6PLUU2QIO9LJ.2~EIK9E1NG1I4R.1 size=1048576 2024-09-14T11:17:24.975 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.974+0000 7fe125ff88c0 1 > prepared part key=_multipart_6PLUU2QIO9LJ.2~EIK9E1NG1I4R.2 size=722330 2024-09-14T11:17:24.976 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.974+0000 7fe125ff88c0 1 > prepared multipart upload key=6PLUU2QIO9LJ upload=EIK9E1NG1I4R tag=3RA7WSRLD5PE type=write size=3868058 2024-09-14T11:17:24.980 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.978+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~CNDWKJKP2NGP.0 size=1048576 2024-09-14T11:17:24.980 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.978+0000 7fe125ff88c0 1 < canceled part key=_multipart_35EB6U5O4A51.2~CNDWKJKP2NGP.1 size=1048576 2024-09-14T11:17:24.982 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.982+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~CNDWKJKP2NGP.2 size=406808 2024-09-14T11:17:24.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.990+0000 7fe125ff88c0 1 < canceled multipart upload key=35EB6U5O4A51 upload=CNDWKJKP2NGP tag=LOR2NOYEOY54 type=write size=3552536 2024-09-14T11:17:24.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.990+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=1ORJCLAM1J0U type=del size=2085229 2024-09-14T11:17:24.995 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.994+0000 7fe125ff88c0 1 < completed delete operation key=YCF2PCJ9TZMR tag=P2C2IE0P8NWY type=del 2024-09-14T11:17:24.999 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:24.998+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=M14VV7EMWM3Q type=write size=703553 2024-09-14T11:17:25.002 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.002+0000 7fe125ff88c0 1 < completed delete operation key=N94D3R7IOBNL tag=8DVZTQP2CJDE type=del 2024-09-14T11:17:25.009 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.010+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~1T4Q2H3X3TW1.0 size=1048576 2024-09-14T11:17:25.012 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.010+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~1T4Q2H3X3TW1.1 size=1048576 2024-09-14T11:17:25.015 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.014+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~1T4Q2H3X3TW1.2 size=11017 2024-09-14T11:17:25.015 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.014+0000 7fe125ff88c0 1 > prepared multipart upload key=0FITHLGQKQEC upload=1T4Q2H3X3TW1 tag=A2KZMV3ZBBKP type=write size=3156745 2024-09-14T11:17:25.019 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.018+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~EM57B3VU0Y0Y.0 size=637296 2024-09-14T11:17:25.024 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.026+0000 7fe125ff88c0 1 < completed multipart upload key=K05LARTJ2QZ3 upload=EM57B3VU0Y0Y tag=1B5YBGLA4U5W type=write size=1685872 2024-09-14T11:17:25.030 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.030+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~E2UDJK10I5VU.0 size=1048576 2024-09-14T11:17:25.033 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.034+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~E2UDJK10I5VU.1 size=1048576 2024-09-14T11:17:25.035 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.034+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~E2UDJK10I5VU.2 size=27490 2024-09-14T11:17:25.035 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.034+0000 7fe125ff88c0 1 > prepared multipart upload key=K3P6U6NU8I01 upload=E2UDJK10I5VU tag=B2QDFYN12TMQ type=write size=3173218 2024-09-14T11:17:25.039 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.038+0000 7fe125ff88c0 1 < completed delete operation key=6PLUU2QIO9LJ tag=3EJ951C3IMYT type=del 2024-09-14T11:17:25.047 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.046+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=ZB41QI07BEBV type=del size=2157238 2024-09-14T11:17:25.051 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.050+0000 7fe125ff88c0 1 < completed write operation key=ESVFZQQXE3GT tag=2YHQOQHXMXG9 type=write size=549797 2024-09-14T11:17:25.055 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.054+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=LA4SD1YQ5IY9 type=write size=960950 2024-09-14T11:17:25.063 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.062+0000 7fe125ff88c0 1 < suggested update operation key=21HC4VMHXS6L tag=0TKEHYV9EBOY type=del size=723469 2024-09-14T11:17:25.066 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.066+0000 7fe125ff88c0 1 > prepared operation key=6C3JZKTB8BP3 tag=ERG1KYTR31BY type=write size=636821 2024-09-14T11:17:25.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.070+0000 7fe125ff88c0 1 < completed delete operation key=4D2X7151977X tag=UF5MMT80Q8BK type=del 2024-09-14T11:17:25.078 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.078+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~KYT0NQPDCNWH.0 size=168672 2024-09-14T11:17:25.078 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.078+0000 7fe125ff88c0 1 > prepared multipart upload key=21HC4VMHXS6L upload=KYT0NQPDCNWH tag=B6MV695RQCCD type=write size=1217248 2024-09-14T11:17:25.085 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.086+0000 7fe125ff88c0 1 < suggested update operation key=6PLUU2QIO9LJ tag=JD83UFGOEKFI type=del size=1903729 2024-09-14T11:17:25.088 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.090+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=1A0PBK6CDEIX type=del size=3343595 2024-09-14T11:17:25.092 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.090+0000 7fe125ff88c0 1 < completed delete operation key=K3P6U6NU8I01 tag=DNOA28B4ZNNT type=del 2024-09-14T11:17:25.096 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.094+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=OYP5ISHOER56 type=del size=1643239 2024-09-14T11:17:25.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.098+0000 7fe125ff88c0 1 < completed delete operation key=ESVFZQQXE3GT tag=H641XW41MPBU type=del 2024-09-14T11:17:25.105 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.106+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~RJZ1DP2F0RBL.0 size=210932 2024-09-14T11:17:25.105 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.106+0000 7fe125ff88c0 1 > prepared multipart upload key=FQ5WT12KB664 upload=RJZ1DP2F0RBL tag=98YJTWZPL676 type=write size=1259508 2024-09-14T11:17:25.108 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.110+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~8UMTKCWSCB4T.0 size=1048576 2024-09-14T11:17:25.111 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.110+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~8UMTKCWSCB4T.1 size=1048576 2024-09-14T11:17:25.114 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.114+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~8UMTKCWSCB4T.2 size=147835 2024-09-14T11:17:25.120 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.118+0000 7fe125ff88c0 1 < completed multipart upload key=1ML6RIXI4C5P upload=8UMTKCWSCB4T tag=FKZV4YCZ4J0F type=write size=3293563 2024-09-14T11:17:25.126 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.126+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~PBL84YHKMAMK.0 size=1048576 2024-09-14T11:17:25.129 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.130+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~PBL84YHKMAMK.1 size=1048576 2024-09-14T11:17:25.132 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.130+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~PBL84YHKMAMK.2 size=421886 2024-09-14T11:17:25.132 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.130+0000 7fe125ff88c0 1 > prepared multipart upload key=LYBGDNKUROWH upload=PBL84YHKMAMK tag=7UZ96GV47BQT type=write size=3567614 2024-09-14T11:17:25.135 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.134+0000 7fe125ff88c0 1 < completed delete operation key=FQ5WT12KB664 tag=SMHTSFME16SZ type=del 2024-09-14T11:17:25.140 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.138+0000 7fe125ff88c0 1 > prepared operation key=YFRH8WECBTJK tag=5PGKTGXM18OG type=del size=1882266 2024-09-14T11:17:25.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.142+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~MLI2AYYN48PM.0 size=199512 2024-09-14T11:17:25.148 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.150+0000 7fe125ff88c0 1 < completed multipart upload key=1ML6RIXI4C5P upload=MLI2AYYN48PM tag=ZGQ64N592VT1 type=write size=1248088 2024-09-14T11:17:25.152 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.150+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=LKQVAB4U3O04 type=write size=198230 2024-09-14T11:17:25.155 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.154+0000 7fe125ff88c0 1 < completed delete operation key=V6B470G93KFT tag=BWVEISDJ2ZIN type=del 2024-09-14T11:17:25.163 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.162+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~EL61UZJ1V365.0 size=1048576 2024-09-14T11:17:25.166 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.166+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~EL61UZJ1V365.1 size=1048576 2024-09-14T11:17:25.168 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.166+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~EL61UZJ1V365.2 size=775416 2024-09-14T11:17:25.168 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.166+0000 7fe125ff88c0 1 > prepared multipart upload key=L4XO0WTYKNXY upload=EL61UZJ1V365 tag=D6DWQSVAF1ON type=write size=3921144 2024-09-14T11:17:25.172 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.170+0000 7fe125ff88c0 1 < completed part key=_multipart_6PLUU2QIO9LJ.2~EIK9E1NG1I4R.0 size=1048576 2024-09-14T11:17:25.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.174+0000 7fe125ff88c0 1 < completed part key=_multipart_6PLUU2QIO9LJ.2~EIK9E1NG1I4R.1 size=1048576 2024-09-14T11:17:25.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.178+0000 7fe125ff88c0 1 < completed part key=_multipart_6PLUU2QIO9LJ.2~EIK9E1NG1I4R.2 size=722330 2024-09-14T11:17:25.183 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.182+0000 7fe125ff88c0 1 < completed multipart upload key=6PLUU2QIO9LJ upload=EIK9E1NG1I4R tag=3RA7WSRLD5PE type=write size=3868058 2024-09-14T11:17:25.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.186+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=1BY3EMA658AI type=del size=344581 2024-09-14T11:17:25.191 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.190+0000 7fe125ff88c0 1 < canceled operation key=WEA3MQ0DI42N tag=1ORJCLAM1J0U type=del size=2085229 2024-09-14T11:17:25.194 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.194+0000 7fe125ff88c0 1 > prepared operation key=3OU4U9JF3ZD5 tag=XCNEL9LOQRDU type=del size=53780 2024-09-14T11:17:25.198 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.198+0000 7fe125ff88c0 1 < canceled operation key=WEA3MQ0DI42N tag=M14VV7EMWM3Q type=write size=703553 2024-09-14T11:17:25.202 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.202+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=RTQZEF9ZN6AK type=del size=1922216 2024-09-14T11:17:25.206 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.206+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~1T4Q2H3X3TW1.0 size=1048576 2024-09-14T11:17:25.209 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.210+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~1T4Q2H3X3TW1.1 size=1048576 2024-09-14T11:17:25.212 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.210+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~1T4Q2H3X3TW1.2 size=11017 2024-09-14T11:17:25.218 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.218+0000 7fe125ff88c0 1 < completed multipart upload key=0FITHLGQKQEC upload=1T4Q2H3X3TW1 tag=A2KZMV3ZBBKP type=write size=3156745 2024-09-14T11:17:25.225 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.226+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~X44HJGBDNA6E.0 size=1048576 2024-09-14T11:17:25.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.226+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~X44HJGBDNA6E.1 size=181882 2024-09-14T11:17:25.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.226+0000 7fe125ff88c0 1 > prepared multipart upload key=W0B19NBHNLMZ upload=X44HJGBDNA6E tag=MAW1BS9Z73BL type=write size=2279034 2024-09-14T11:17:25.232 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.230+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~E2UDJK10I5VU.0 size=1048576 2024-09-14T11:17:25.235 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.234+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~E2UDJK10I5VU.1 size=1048576 2024-09-14T11:17:25.238 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.238+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~E2UDJK10I5VU.2 size=27490 2024-09-14T11:17:25.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.246+0000 7fe125ff88c0 1 < completed multipart upload key=K3P6U6NU8I01 upload=E2UDJK10I5VU tag=B2QDFYN12TMQ type=write size=3173218 2024-09-14T11:17:25.249 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.250+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=XU602WTHL2C3 type=del size=2816647 2024-09-14T11:17:25.254 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.254+0000 7fe125ff88c0 1 < completed delete operation key=K3P6U6NU8I01 tag=ZB41QI07BEBV type=del 2024-09-14T11:17:25.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.258+0000 7fe125ff88c0 1 > prepared operation key=1ML6RIXI4C5P tag=JUJQGPGFGOG8 type=write size=589860 2024-09-14T11:17:25.262 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.262+0000 7fe125ff88c0 1 < canceled operation key=N94D3R7IOBNL tag=LA4SD1YQ5IY9 type=write size=960950 2024-09-14T11:17:25.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.270+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~O6UYOUFSRPZ0.0 size=1031594 2024-09-14T11:17:25.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.270+0000 7fe125ff88c0 1 > prepared multipart upload key=46ZTDBWFVSUH upload=O6UYOUFSRPZ0 tag=Y5HM4OYPU63P type=write size=2080170 2024-09-14T11:17:25.276 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.278+0000 7fe125ff88c0 1 < suggested update operation key=6C3JZKTB8BP3 tag=ERG1KYTR31BY type=write size=636821 2024-09-14T11:17:25.281 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.282+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=2SBG7RLJMX6K type=del size=2895679 2024-09-14T11:17:25.285 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.286+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~KYT0NQPDCNWH.0 size=168672 2024-09-14T11:17:25.292 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.294+0000 7fe125ff88c0 1 < completed multipart upload key=21HC4VMHXS6L upload=KYT0NQPDCNWH tag=B6MV695RQCCD type=write size=1217248 2024-09-14T11:17:25.299 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.298+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~EDNN0SUF8A1V.0 size=1048576 2024-09-14T11:17:25.301 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.302+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~EDNN0SUF8A1V.1 size=1048576 2024-09-14T11:17:25.304 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.302+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~EDNN0SUF8A1V.2 size=982517 2024-09-14T11:17:25.304 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.302+0000 7fe125ff88c0 1 > prepared multipart upload key=F9I82N7RQC81 upload=EDNN0SUF8A1V tag=6WLR6VTTUHR6 type=write size=4128245 2024-09-14T11:17:25.307 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.306+0000 7fe125ff88c0 1 < completed delete operation key=4D2X7151977X tag=1A0PBK6CDEIX type=del 2024-09-14T11:17:25.311 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.310+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=1MQNMT80QE13 type=write size=739820 2024-09-14T11:17:25.315 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.314+0000 7fe125ff88c0 1 < completed delete operation key=4D2X7151977X tag=OYP5ISHOER56 type=del 2024-09-14T11:17:25.322 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.322+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~CUOKW9ZKTOXG.0 size=1048576 2024-09-14T11:17:25.325 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.326+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~CUOKW9ZKTOXG.1 size=1048576 2024-09-14T11:17:25.327 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.326+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~CUOKW9ZKTOXG.2 size=448438 2024-09-14T11:17:25.328 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.326+0000 7fe125ff88c0 1 > prepared multipart upload key=3OU4U9JF3ZD5 upload=CUOKW9ZKTOXG tag=78Y9VSZ771Z0 type=write size=3594166 2024-09-14T11:17:25.328 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.330+0000 7fe125ff88c0 1 < canceled part key=_multipart_FQ5WT12KB664.2~RJZ1DP2F0RBL.0 size=210932 2024-09-14T11:17:25.334 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.334+0000 7fe125ff88c0 1 < canceled multipart upload key=FQ5WT12KB664 upload=RJZ1DP2F0RBL tag=98YJTWZPL676 type=write size=1259508 2024-09-14T11:17:25.338 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.338+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=CDNL1N0T6WVL type=del size=1839978 2024-09-14T11:17:25.342 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.342+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~PBL84YHKMAMK.0 size=1048576 2024-09-14T11:17:25.345 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.346+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~PBL84YHKMAMK.1 size=1048576 2024-09-14T11:17:25.348 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.350+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~PBL84YHKMAMK.2 size=421886 2024-09-14T11:17:25.355 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.354+0000 7fe125ff88c0 1 < completed multipart upload key=LYBGDNKUROWH upload=PBL84YHKMAMK tag=7UZ96GV47BQT type=write size=3567614 2024-09-14T11:17:25.358 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.358+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=A5PWCY189GU3 type=write size=710016 2024-09-14T11:17:25.362 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.362+0000 7fe125ff88c0 1 < completed delete operation key=YFRH8WECBTJK tag=5PGKTGXM18OG type=del 2024-09-14T11:17:25.366 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.366+0000 7fe125ff88c0 1 > prepared operation key=1ML6RIXI4C5P tag=OOSZ4SYCTKK4 type=del size=2782518 2024-09-14T11:17:25.370 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.370+0000 7fe125ff88c0 1 < canceled operation key=4D2X7151977X tag=LKQVAB4U3O04 type=write size=198230 2024-09-14T11:17:25.373 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.374+0000 7fe125ff88c0 1 > prepared operation key=46ZTDBWFVSUH tag=RYNN8ZJTLRL4 type=del size=304711 2024-09-14T11:17:25.377 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.378+0000 7fe125ff88c0 1 < completed part key=_multipart_L4XO0WTYKNXY.2~EL61UZJ1V365.0 size=1048576 2024-09-14T11:17:25.380 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.378+0000 7fe125ff88c0 1 < completed part key=_multipart_L4XO0WTYKNXY.2~EL61UZJ1V365.1 size=1048576 2024-09-14T11:17:25.383 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.382+0000 7fe125ff88c0 1 < completed part key=_multipart_L4XO0WTYKNXY.2~EL61UZJ1V365.2 size=775416 2024-09-14T11:17:25.392 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.390+0000 7fe125ff88c0 1 < completed multipart upload key=L4XO0WTYKNXY upload=EL61UZJ1V365 tag=D6DWQSVAF1ON type=write size=3921144 2024-09-14T11:17:25.399 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.398+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~FHKLEOD5VH6B.0 size=1048576 2024-09-14T11:17:25.402 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.402+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~FHKLEOD5VH6B.1 size=372537 2024-09-14T11:17:25.402 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.402+0000 7fe125ff88c0 1 > prepared multipart upload key=V6B470G93KFT upload=FHKLEOD5VH6B tag=1LTSH3F2ISHG type=write size=2469689 2024-09-14T11:17:25.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.406+0000 7fe125ff88c0 1 < completed delete operation key=K3P6U6NU8I01 tag=1BY3EMA658AI type=del 2024-09-14T11:17:25.413 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.414+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~4UPKR8MQU92X.0 size=1048576 2024-09-14T11:17:25.416 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.414+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~4UPKR8MQU92X.1 size=1048576 2024-09-14T11:17:25.419 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.418+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~4UPKR8MQU92X.2 size=547745 2024-09-14T11:17:25.419 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.418+0000 7fe125ff88c0 1 > prepared multipart upload key=N80X3YUF4OEL upload=4UPKR8MQU92X tag=8M3PD22VGBD1 type=write size=3693473 2024-09-14T11:17:25.426 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.426+0000 7fe125ff88c0 1 < suggested remove operation key=3OU4U9JF3ZD5 tag=XCNEL9LOQRDU type=del 2024-09-14T11:17:25.433 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.434+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~W81QIM649WOC.0 size=1048576 2024-09-14T11:17:25.436 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.434+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~W81QIM649WOC.1 size=192189 2024-09-14T11:17:25.436 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.434+0000 7fe125ff88c0 1 > prepared multipart upload key=W0B19NBHNLMZ upload=W81QIM649WOC tag=XDM2089AU26U type=write size=2289341 2024-09-14T11:17:25.440 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.442+0000 7fe125ff88c0 1 < completed delete operation key=35EB6U5O4A51 tag=RTQZEF9ZN6AK type=del 2024-09-14T11:17:25.445 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.446+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=AR62PYCF0HRW type=del size=1954096 2024-09-14T11:17:25.448 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.450+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~X44HJGBDNA6E.0 size=1048576 2024-09-14T11:17:25.452 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.450+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~X44HJGBDNA6E.1 size=181882 2024-09-14T11:17:25.458 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.458+0000 7fe125ff88c0 1 < completed multipart upload key=W0B19NBHNLMZ upload=X44HJGBDNA6E tag=MAW1BS9Z73BL type=write size=2279034 2024-09-14T11:17:25.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.466+0000 7fe125ff88c0 1 > prepared part key=_multipart_N94D3R7IOBNL.2~GK6H0M4J23JN.0 size=1048576 2024-09-14T11:17:25.468 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.470+0000 7fe125ff88c0 1 > prepared part key=_multipart_N94D3R7IOBNL.2~GK6H0M4J23JN.1 size=1048576 2024-09-14T11:17:25.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.470+0000 7fe125ff88c0 1 > prepared part key=_multipart_N94D3R7IOBNL.2~GK6H0M4J23JN.2 size=852353 2024-09-14T11:17:25.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.470+0000 7fe125ff88c0 1 > prepared multipart upload key=N94D3R7IOBNL upload=GK6H0M4J23JN tag=31DFGZ5FMFGI type=write size=3998081 2024-09-14T11:17:25.475 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.474+0000 7fe125ff88c0 1 < completed delete operation key=WEA3MQ0DI42N tag=XU602WTHL2C3 type=del 2024-09-14T11:17:25.479 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.478+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=CD90TL45471F type=write size=257436 2024-09-14T11:17:25.484 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.482+0000 7fe125ff88c0 1 < completed write operation key=1ML6RIXI4C5P tag=JUJQGPGFGOG8 type=write size=589860 2024-09-14T11:17:25.491 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.490+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~PSI1WUKEITGP.0 size=1048576 2024-09-14T11:17:25.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.494+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~PSI1WUKEITGP.1 size=980817 2024-09-14T11:17:25.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.494+0000 7fe125ff88c0 1 > prepared multipart upload key=W0B19NBHNLMZ upload=PSI1WUKEITGP tag=3X941A98BTHV type=write size=3077969 2024-09-14T11:17:25.498 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.498+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~O6UYOUFSRPZ0.0 size=1031594 2024-09-14T11:17:25.504 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.506+0000 7fe125ff88c0 1 < completed multipart upload key=46ZTDBWFVSUH upload=O6UYOUFSRPZ0 tag=Y5HM4OYPU63P type=write size=2080170 2024-09-14T11:17:25.508 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.510+0000 7fe125ff88c0 1 > prepared operation key=FQ5WT12KB664 tag=1YRL63I98F2M type=del size=2231403 2024-09-14T11:17:25.513 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.514+0000 7fe125ff88c0 1 < completed delete operation key=V6B470G93KFT tag=2SBG7RLJMX6K type=del 2024-09-14T11:17:25.517 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.518+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=05YQSCKTU4T0 type=write size=871076 2024-09-14T11:17:25.521 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.522+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~EDNN0SUF8A1V.0 size=1048576 2024-09-14T11:17:25.523 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.522+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~EDNN0SUF8A1V.1 size=1048576 2024-09-14T11:17:25.526 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.526+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~EDNN0SUF8A1V.2 size=982517 2024-09-14T11:17:25.532 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.530+0000 7fe125ff88c0 1 < completed multipart upload key=F9I82N7RQC81 upload=EDNN0SUF8A1V tag=6WLR6VTTUHR6 type=write size=4128245 2024-09-14T11:17:25.538 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.538+0000 7fe125ff88c0 1 > prepared part key=_multipart_2KEKSWK0UT6C.2~Y4D32BWKQV23.0 size=700149 2024-09-14T11:17:25.538 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.538+0000 7fe125ff88c0 1 > prepared multipart upload key=2KEKSWK0UT6C upload=Y4D32BWKQV23 tag=7J8RBE4F6B2Q type=write size=1748725 2024-09-14T11:17:25.542 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.542+0000 7fe125ff88c0 1 < completed write operation key=YCF2PCJ9TZMR tag=1MQNMT80QE13 type=write size=739820 2024-09-14T11:17:25.549 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.550+0000 7fe125ff88c0 1 > prepared part key=_multipart_N94D3R7IOBNL.2~ZVNFYKZZAJ6H.0 size=81 2024-09-14T11:17:25.549 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.550+0000 7fe125ff88c0 1 > prepared multipart upload key=N94D3R7IOBNL upload=ZVNFYKZZAJ6H tag=CIH8L8AZIEFM type=write size=1048657 2024-09-14T11:17:25.553 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.554+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~CUOKW9ZKTOXG.0 size=1048576 2024-09-14T11:17:25.556 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.554+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~CUOKW9ZKTOXG.1 size=1048576 2024-09-14T11:17:25.559 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.558+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~CUOKW9ZKTOXG.2 size=448438 2024-09-14T11:17:25.565 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.566+0000 7fe125ff88c0 1 < completed multipart upload key=3OU4U9JF3ZD5 upload=CUOKW9ZKTOXG tag=78Y9VSZ771Z0 type=write size=3594166 2024-09-14T11:17:25.569 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.570+0000 7fe125ff88c0 1 > prepared operation key=1ML6RIXI4C5P tag=QORQTCS3XK8M type=del size=1741147 2024-09-14T11:17:25.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.574+0000 7fe125ff88c0 1 < completed delete operation key=ESVFZQQXE3GT tag=CDNL1N0T6WVL type=del 2024-09-14T11:17:25.577 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.578+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=LN6EFDFVUEKK type=del size=269957 2024-09-14T11:17:25.581 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.582+0000 7fe125ff88c0 1 < completed write operation key=6PLUU2QIO9LJ tag=A5PWCY189GU3 type=write size=710016 2024-09-14T11:17:25.588 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.586+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~GXQR9NG42SIH.0 size=1048576 2024-09-14T11:17:25.591 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.590+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~GXQR9NG42SIH.1 size=1048576 2024-09-14T11:17:25.594 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.594+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~GXQR9NG42SIH.2 size=7477 2024-09-14T11:17:25.594 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.594+0000 7fe125ff88c0 1 > prepared multipart upload key=35EB6U5O4A51 upload=GXQR9NG42SIH tag=86VL6QRLLLD9 type=write size=3153205 2024-09-14T11:17:25.598 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.598+0000 7fe125ff88c0 1 < completed delete operation key=1ML6RIXI4C5P tag=OOSZ4SYCTKK4 type=del 2024-09-14T11:17:25.602 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.602+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=D5NBZITLWRYK type=del size=1066864 2024-09-14T11:17:25.605 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.606+0000 7fe125ff88c0 1 < completed delete operation key=46ZTDBWFVSUH tag=RYNN8ZJTLRL4 type=del 2024-09-14T11:17:25.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.614+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~V94GAMIRUCI9.0 size=1048576 2024-09-14T11:17:25.615 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.614+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~V94GAMIRUCI9.1 size=454480 2024-09-14T11:17:25.615 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.614+0000 7fe125ff88c0 1 > prepared multipart upload key=V6B470G93KFT upload=V94GAMIRUCI9 tag=50K6PTGUZT81 type=write size=2551632 2024-09-14T11:17:25.619 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.618+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~FHKLEOD5VH6B.0 size=1048576 2024-09-14T11:17:25.622 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.622+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~FHKLEOD5VH6B.1 size=372537 2024-09-14T11:17:25.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.626+0000 7fe125ff88c0 1 < completed multipart upload key=V6B470G93KFT upload=FHKLEOD5VH6B tag=1LTSH3F2ISHG type=write size=2469689 2024-09-14T11:17:25.631 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.630+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=4HPM39323TEA type=write size=574802 2024-09-14T11:17:25.636 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.634+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~4UPKR8MQU92X.0 size=1048576 2024-09-14T11:17:25.639 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.638+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~4UPKR8MQU92X.1 size=1048576 2024-09-14T11:17:25.642 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.642+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~4UPKR8MQU92X.2 size=547745 2024-09-14T11:17:25.648 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.650+0000 7fe125ff88c0 1 < completed multipart upload key=N80X3YUF4OEL upload=4UPKR8MQU92X tag=8M3PD22VGBD1 type=write size=3693473 2024-09-14T11:17:25.652 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.654+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=3CBL9DFE1113 type=del size=1209252 2024-09-14T11:17:25.657 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.658+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~W81QIM649WOC.0 size=1048576 2024-09-14T11:17:25.661 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.662+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~W81QIM649WOC.1 size=192189 2024-09-14T11:17:25.667 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.666+0000 7fe125ff88c0 1 < completed multipart upload key=W0B19NBHNLMZ upload=W81QIM649WOC tag=XDM2089AU26U type=write size=2289341 2024-09-14T11:17:25.671 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.670+0000 7fe125ff88c0 1 > prepared operation key=SUCH37O8V1LY tag=GCLYAF5D1A6O type=del size=4106393 2024-09-14T11:17:25.675 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.674+0000 7fe125ff88c0 1 < completed delete operation key=L4XO0WTYKNXY tag=AR62PYCF0HRW type=del 2024-09-14T11:17:25.679 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.678+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=466I1XGG70SC type=del size=1974544 2024-09-14T11:17:25.683 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.682+0000 7fe125ff88c0 1 < completed part key=_multipart_N94D3R7IOBNL.2~GK6H0M4J23JN.0 size=1048576 2024-09-14T11:17:25.686 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.686+0000 7fe125ff88c0 1 < completed part key=_multipart_N94D3R7IOBNL.2~GK6H0M4J23JN.1 size=1048576 2024-09-14T11:17:25.689 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.690+0000 7fe125ff88c0 1 < completed part key=_multipart_N94D3R7IOBNL.2~GK6H0M4J23JN.2 size=852353 2024-09-14T11:17:25.696 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.694+0000 7fe125ff88c0 1 < completed multipart upload key=N94D3R7IOBNL upload=GK6H0M4J23JN tag=31DFGZ5FMFGI type=write size=3998081 2024-09-14T11:17:25.703 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.702+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~NOQ4PB4OXSSP.0 size=1048576 2024-09-14T11:17:25.706 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.706+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~NOQ4PB4OXSSP.1 size=911508 2024-09-14T11:17:25.706 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.706+0000 7fe125ff88c0 1 > prepared multipart upload key=SUCH37O8V1LY upload=NOQ4PB4OXSSP tag=MXNU6M3UZBSQ type=write size=3008660 2024-09-14T11:17:25.710 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.710+0000 7fe125ff88c0 1 < completed write operation key=YCF2PCJ9TZMR tag=CD90TL45471F type=write size=257436 2024-09-14T11:17:25.714 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.714+0000 7fe125ff88c0 1 > prepared operation key=YFRH8WECBTJK tag=YDLSW5OI7D3V type=del size=206478 2024-09-14T11:17:25.718 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.718+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~PSI1WUKEITGP.0 size=1048576 2024-09-14T11:17:25.720 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.722+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~PSI1WUKEITGP.1 size=980817 2024-09-14T11:17:25.726 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.726+0000 7fe125ff88c0 1 < completed multipart upload key=W0B19NBHNLMZ upload=PSI1WUKEITGP tag=3X941A98BTHV type=write size=3077969 2024-09-14T11:17:25.733 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.734+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~31W8UYJ3LG6G.0 size=1000529 2024-09-14T11:17:25.733 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.734+0000 7fe125ff88c0 1 > prepared multipart upload key=SSNV25PDLDIS upload=31W8UYJ3LG6G tag=GYP1CUE4ECLH type=write size=2049105 2024-09-14T11:17:25.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.734+0000 7fe125ff88c0 1 < completed delete operation key=FQ5WT12KB664 tag=1YRL63I98F2M type=del 2024-09-14T11:17:25.747 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.746+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~1GQAR3LF4QKW.0 size=1048576 2024-09-14T11:17:25.750 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.750+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~1GQAR3LF4QKW.1 size=1048576 2024-09-14T11:17:25.753 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.754+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~1GQAR3LF4QKW.2 size=631943 2024-09-14T11:17:25.754 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.754+0000 7fe125ff88c0 1 > prepared multipart upload key=K05LARTJ2QZ3 upload=1GQAR3LF4QKW tag=NL0SMZ38JZIG type=write size=3777671 2024-09-14T11:17:25.757 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.758+0000 7fe125ff88c0 1 < completed write operation key=35EB6U5O4A51 tag=05YQSCKTU4T0 type=write size=871076 2024-09-14T11:17:25.761 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.762+0000 7fe125ff88c0 1 > prepared operation key=3YGN50MBAF41 tag=40T04XEVUPDZ type=write size=963765 2024-09-14T11:17:25.765 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.766+0000 7fe125ff88c0 1 < completed part key=_multipart_2KEKSWK0UT6C.2~Y4D32BWKQV23.0 size=700149 2024-09-14T11:17:25.770 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.770+0000 7fe125ff88c0 1 < completed multipart upload key=2KEKSWK0UT6C upload=Y4D32BWKQV23 tag=7J8RBE4F6B2Q type=write size=1748725 2024-09-14T11:17:25.777 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.778+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~752AST3XTWLQ.0 size=1048576 2024-09-14T11:17:25.780 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.778+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~752AST3XTWLQ.1 size=828507 2024-09-14T11:17:25.780 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.778+0000 7fe125ff88c0 1 > prepared multipart upload key=1ML6RIXI4C5P upload=752AST3XTWLQ tag=F0IFIV3PVGP6 type=write size=2925659 2024-09-14T11:17:25.784 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.782+0000 7fe125ff88c0 1 < completed part key=_multipart_N94D3R7IOBNL.2~ZVNFYKZZAJ6H.0 size=81 2024-09-14T11:17:25.790 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.790+0000 7fe125ff88c0 1 < completed multipart upload key=N94D3R7IOBNL upload=ZVNFYKZZAJ6H tag=CIH8L8AZIEFM type=write size=1048657 2024-09-14T11:17:25.794 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.794+0000 7fe125ff88c0 1 > prepared operation key=0FITHLGQKQEC tag=AJWXO8PM43K1 type=write size=739350 2024-09-14T11:17:25.798 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.798+0000 7fe125ff88c0 1 < completed delete operation key=1ML6RIXI4C5P tag=QORQTCS3XK8M type=del 2024-09-14T11:17:25.801 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.802+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=N4QF6VBM7HCO type=del size=3894687 2024-09-14T11:17:25.805 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.806+0000 7fe125ff88c0 1 < completed delete operation key=V6B470G93KFT tag=LN6EFDFVUEKK type=del 2024-09-14T11:17:25.809 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.810+0000 7fe125ff88c0 1 > prepared operation key=6C3JZKTB8BP3 tag=HFU9WZQNN2GD type=del size=4123812 2024-09-14T11:17:25.812 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.814+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~GXQR9NG42SIH.0 size=1048576 2024-09-14T11:17:25.816 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.818+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~GXQR9NG42SIH.1 size=1048576 2024-09-14T11:17:25.819 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.818+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~GXQR9NG42SIH.2 size=7477 2024-09-14T11:17:25.825 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.826+0000 7fe125ff88c0 1 < completed multipart upload key=35EB6U5O4A51 upload=GXQR9NG42SIH tag=86VL6QRLLLD9 type=write size=3153205 2024-09-14T11:17:25.832 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.830+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~KVVT6E72BFCJ.0 size=178634 2024-09-14T11:17:25.832 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.830+0000 7fe125ff88c0 1 > prepared multipart upload key=2UXA6SXDTUFT upload=KVVT6E72BFCJ tag=3BSH2HYTFADA type=write size=1227210 2024-09-14T11:17:25.835 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.834+0000 7fe125ff88c0 1 < completed delete operation key=F9I82N7RQC81 tag=D5NBZITLWRYK type=del 2024-09-14T11:17:25.842 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.842+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~BU9T6MCEZ28G.0 size=1048576 2024-09-14T11:17:25.844 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.846+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~BU9T6MCEZ28G.1 size=75533 2024-09-14T11:17:25.845 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.846+0000 7fe125ff88c0 1 > prepared multipart upload key=YGEVGH840L18 upload=BU9T6MCEZ28G tag=T00ATM4Z65PE type=write size=2172685 2024-09-14T11:17:25.848 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.850+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~V94GAMIRUCI9.0 size=1048576 2024-09-14T11:17:25.852 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.850+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~V94GAMIRUCI9.1 size=454480 2024-09-14T11:17:25.858 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.858+0000 7fe125ff88c0 1 < completed multipart upload key=V6B470G93KFT upload=V94GAMIRUCI9 tag=50K6PTGUZT81 type=write size=2551632 2024-09-14T11:17:25.861 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.862+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=66F43IECP6OF type=del size=3299285 2024-09-14T11:17:25.865 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.866+0000 7fe125ff88c0 1 < completed write operation key=21HC4VMHXS6L tag=4HPM39323TEA type=write size=574802 2024-09-14T11:17:25.869 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.870+0000 7fe125ff88c0 1 > prepared operation key=K05LARTJ2QZ3 tag=I0V8USI2K26F type=del size=3686908 2024-09-14T11:17:25.875 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.874+0000 7fe125ff88c0 1 < completed delete operation key=0VBX2FWYCFEZ tag=3CBL9DFE1113 type=del 2024-09-14T11:17:25.882 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.882+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~W277TINYW551.0 size=904739 2024-09-14T11:17:25.882 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.882+0000 7fe125ff88c0 1 > prepared multipart upload key=21HC4VMHXS6L upload=W277TINYW551 tag=HSRW1D5Z7N7J type=write size=1953315 2024-09-14T11:17:25.886 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.886+0000 7fe125ff88c0 1 < completed delete operation key=SUCH37O8V1LY tag=GCLYAF5D1A6O type=del 2024-09-14T11:17:25.892 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.890+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~XXUPZMO1RATR.0 size=1048576 2024-09-14T11:17:25.895 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.894+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~XXUPZMO1RATR.1 size=1048576 2024-09-14T11:17:25.898 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.898+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~XXUPZMO1RATR.2 size=485939 2024-09-14T11:17:25.898 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.898+0000 7fe125ff88c0 1 > prepared multipart upload key=YCF2PCJ9TZMR upload=XXUPZMO1RATR tag=BFP11MRXZIRP type=write size=3631667 2024-09-14T11:17:25.902 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.902+0000 7fe125ff88c0 1 < canceled operation key=L4XO0WTYKNXY tag=466I1XGG70SC type=del size=1974544 2024-09-14T11:17:25.906 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.906+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=32G23VJGMO9I type=write size=691078 2024-09-14T11:17:25.910 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.910+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~NOQ4PB4OXSSP.0 size=1048576 2024-09-14T11:17:25.914 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.914+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~NOQ4PB4OXSSP.1 size=911508 2024-09-14T11:17:25.920 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.918+0000 7fe125ff88c0 1 < completed multipart upload key=SUCH37O8V1LY upload=NOQ4PB4OXSSP tag=MXNU6M3UZBSQ type=write size=3008660 2024-09-14T11:17:25.928 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.926+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~QLQ7EU13S2ID.0 size=1048576 2024-09-14T11:17:25.930 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.930+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~QLQ7EU13S2ID.1 size=856594 2024-09-14T11:17:25.931 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.930+0000 7fe125ff88c0 1 > prepared multipart upload key=SSNV25PDLDIS upload=QLQ7EU13S2ID tag=FPCOKQU4MLFU type=write size=2953746 2024-09-14T11:17:25.934 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.934+0000 7fe125ff88c0 1 < completed delete operation key=YFRH8WECBTJK tag=YDLSW5OI7D3V type=del 2024-09-14T11:17:25.938 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.938+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=VWD2XX3VBY0G type=write size=25857 2024-09-14T11:17:25.942 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.942+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~31W8UYJ3LG6G.0 size=1000529 2024-09-14T11:17:25.948 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.946+0000 7fe125ff88c0 1 < completed multipart upload key=SSNV25PDLDIS upload=31W8UYJ3LG6G tag=GYP1CUE4ECLH type=write size=2049105 2024-09-14T11:17:25.954 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.954+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~C3T0HPB52997.0 size=1048576 2024-09-14T11:17:25.957 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.958+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~C3T0HPB52997.1 size=478164 2024-09-14T11:17:25.957 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.958+0000 7fe125ff88c0 1 > prepared multipart upload key=46ZTDBWFVSUH upload=C3T0HPB52997 tag=MBZ8ZSPSBHTJ type=write size=2575316 2024-09-14T11:17:25.960 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.958+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~1GQAR3LF4QKW.0 size=1048576 2024-09-14T11:17:25.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.962+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~1GQAR3LF4QKW.1 size=1048576 2024-09-14T11:17:25.966 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.966+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~1GQAR3LF4QKW.2 size=631943 2024-09-14T11:17:25.971 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.970+0000 7fe125ff88c0 1 < completed multipart upload key=K05LARTJ2QZ3 upload=1GQAR3LF4QKW tag=NL0SMZ38JZIG type=write size=3777671 2024-09-14T11:17:25.975 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.974+0000 7fe125ff88c0 1 > prepared operation key=46ZTDBWFVSUH tag=BHC0AIDASD33 type=del size=1585613 2024-09-14T11:17:25.978 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.978+0000 7fe125ff88c0 1 < completed write operation key=3YGN50MBAF41 tag=40T04XEVUPDZ type=write size=963765 2024-09-14T11:17:25.984 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.986+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~SDCFKAYBK53C.0 size=1048576 2024-09-14T11:17:25.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.986+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~SDCFKAYBK53C.1 size=1048576 2024-09-14T11:17:25.990 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.994+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~SDCFKAYBK53C.2 size=998524 2024-09-14T11:17:25.990 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.994+0000 7fe125ff88c0 1 > prepared multipart upload key=2UXA6SXDTUFT upload=SDCFKAYBK53C tag=6U8H2L31CYHX type=write size=4144252 2024-09-14T11:17:25.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.994+0000 7fe125ff88c0 1 < canceled part key=_multipart_1ML6RIXI4C5P.2~752AST3XTWLQ.0 size=1048576 2024-09-14T11:17:25.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.994+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~752AST3XTWLQ.1 size=828507 2024-09-14T11:17:25.999 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:25.998+0000 7fe125ff88c0 1 < canceled multipart upload key=1ML6RIXI4C5P upload=752AST3XTWLQ tag=F0IFIV3PVGP6 type=write size=2925659 2024-09-14T11:17:26.004 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.006+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~PHU69IAAX16N.0 size=541650 2024-09-14T11:17:26.004 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.006+0000 7fe125ff88c0 1 > prepared multipart upload key=SUCH37O8V1LY upload=PHU69IAAX16N tag=XKHS3APBI572 type=write size=1590226 2024-09-14T11:17:26.008 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.006+0000 7fe125ff88c0 1 < completed write operation key=0FITHLGQKQEC tag=AJWXO8PM43K1 type=write size=739350 2024-09-14T11:17:26.014 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.014+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~21BMQVVVT7PL.0 size=1048576 2024-09-14T11:17:26.017 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.018+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~21BMQVVVT7PL.1 size=533872 2024-09-14T11:17:26.017 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.018+0000 7fe125ff88c0 1 > prepared multipart upload key=SSNV25PDLDIS upload=21BMQVVVT7PL tag=8KSRJXBWVN5C type=write size=2631024 2024-09-14T11:17:26.023 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.022+0000 7fe125ff88c0 1 < suggested update operation key=YCF2PCJ9TZMR tag=N4QF6VBM7HCO type=del size=3894687 2024-09-14T11:17:26.029 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.030+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~LE2LB2F83NPE.0 size=1048576 2024-09-14T11:17:26.031 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.030+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~LE2LB2F83NPE.1 size=824001 2024-09-14T11:17:26.031 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.030+0000 7fe125ff88c0 1 > prepared multipart upload key=F9I82N7RQC81 upload=LE2LB2F83NPE tag=WXRVF2CP7P5V type=write size=2921153 2024-09-14T11:17:26.035 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.034+0000 7fe125ff88c0 1 < completed delete operation key=6C3JZKTB8BP3 tag=HFU9WZQNN2GD type=del 2024-09-14T11:17:26.040 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.042+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~QB0938U9ZMEG.0 size=1048576 2024-09-14T11:17:26.043 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.042+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~QB0938U9ZMEG.1 size=675414 2024-09-14T11:17:26.044 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.042+0000 7fe125ff88c0 1 > prepared multipart upload key=YCF2PCJ9TZMR upload=QB0938U9ZMEG tag=W28OHRJGB9AV type=write size=2772566 2024-09-14T11:17:26.046 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.046+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~KVVT6E72BFCJ.0 size=178634 2024-09-14T11:17:26.052 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.050+0000 7fe125ff88c0 1 < completed multipart upload key=2UXA6SXDTUFT upload=KVVT6E72BFCJ tag=3BSH2HYTFADA type=write size=1227210 2024-09-14T11:17:26.058 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.058+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~CCZH4JWBE1I8.0 size=1048576 2024-09-14T11:17:26.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.062+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~CCZH4JWBE1I8.1 size=212132 2024-09-14T11:17:26.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.062+0000 7fe125ff88c0 1 > prepared multipart upload key=F9I82N7RQC81 upload=CCZH4JWBE1I8 tag=L2Q9JPPX1GM2 type=write size=2309284 2024-09-14T11:17:26.064 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.062+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~BU9T6MCEZ28G.0 size=1048576 2024-09-14T11:17:26.066 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.066+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~BU9T6MCEZ28G.1 size=75533 2024-09-14T11:17:26.076 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.074+0000 7fe125ff88c0 1 < completed multipart upload key=YGEVGH840L18 upload=BU9T6MCEZ28G tag=T00ATM4Z65PE type=write size=2172685 2024-09-14T11:17:26.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.078+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=JOFIQ52JADWQ type=write size=844325 2024-09-14T11:17:26.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.082+0000 7fe125ff88c0 1 < completed delete operation key=4D2X7151977X tag=66F43IECP6OF type=del 2024-09-14T11:17:26.086 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.086+0000 7fe125ff88c0 1 > prepared operation key=3OU4U9JF3ZD5 tag=KDQH212465K5 type=del size=2545235 2024-09-14T11:17:26.090 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.090+0000 7fe125ff88c0 1 < canceled operation key=K05LARTJ2QZ3 tag=I0V8USI2K26F type=del size=3686908 2024-09-14T11:17:26.097 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.098+0000 7fe125ff88c0 1 > prepared part key=_multipart_2KEKSWK0UT6C.2~D7N02DR2SCEP.0 size=1048576 2024-09-14T11:17:26.100 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.098+0000 7fe125ff88c0 1 > prepared part key=_multipart_2KEKSWK0UT6C.2~D7N02DR2SCEP.1 size=750564 2024-09-14T11:17:26.100 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.098+0000 7fe125ff88c0 1 > prepared multipart upload key=2KEKSWK0UT6C upload=D7N02DR2SCEP tag=WIIVGEFVZGAO type=write size=2847716 2024-09-14T11:17:26.103 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.102+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~W277TINYW551.0 size=904739 2024-09-14T11:17:26.109 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.110+0000 7fe125ff88c0 1 < completed multipart upload key=21HC4VMHXS6L upload=W277TINYW551 tag=HSRW1D5Z7N7J type=write size=1953315 2024-09-14T11:17:26.116 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.114+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~UFKNMDCKK3ZY.0 size=1048576 2024-09-14T11:17:26.119 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.118+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~UFKNMDCKK3ZY.1 size=1048576 2024-09-14T11:17:26.122 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.122+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~UFKNMDCKK3ZY.2 size=570459 2024-09-14T11:17:26.122 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.122+0000 7fe125ff88c0 1 > prepared multipart upload key=2LH5U05C2F8C upload=UFKNMDCKK3ZY tag=3XIVA7MU7LUY type=write size=3716187 2024-09-14T11:17:26.123 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.122+0000 7fe125ff88c0 1 < canceled part key=_multipart_YCF2PCJ9TZMR.2~XXUPZMO1RATR.0 size=1048576 2024-09-14T11:17:26.126 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.126+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~XXUPZMO1RATR.1 size=1048576 2024-09-14T11:17:26.129 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.130+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~XXUPZMO1RATR.2 size=485939 2024-09-14T11:17:26.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.134+0000 7fe125ff88c0 1 < canceled multipart upload key=YCF2PCJ9TZMR upload=XXUPZMO1RATR tag=BFP11MRXZIRP type=write size=3631667 2024-09-14T11:17:26.137 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.138+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=W1XRS2ZBB7NU type=del size=3851849 2024-09-14T11:17:26.141 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.142+0000 7fe125ff88c0 1 < completed write operation key=W0B19NBHNLMZ tag=32G23VJGMO9I type=write size=691078 2024-09-14T11:17:26.148 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.146+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~JFGL1SKGJX7P.0 size=1048576 2024-09-14T11:17:26.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.150+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~JFGL1SKGJX7P.1 size=1048576 2024-09-14T11:17:26.153 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.154+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~JFGL1SKGJX7P.2 size=77343 2024-09-14T11:17:26.153 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.154+0000 7fe125ff88c0 1 > prepared multipart upload key=46ZTDBWFVSUH upload=JFGL1SKGJX7P tag=J72YMIJ5FQU0 type=write size=3223071 2024-09-14T11:17:26.157 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.158+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~QLQ7EU13S2ID.0 size=1048576 2024-09-14T11:17:26.159 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.158+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~QLQ7EU13S2ID.1 size=856594 2024-09-14T11:17:26.165 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.166+0000 7fe125ff88c0 1 < completed multipart upload key=SSNV25PDLDIS upload=QLQ7EU13S2ID tag=FPCOKQU4MLFU type=write size=2953746 2024-09-14T11:17:26.168 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.170+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=KT4MVP3UXS3P type=del size=3817145 2024-09-14T11:17:26.171 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.170+0000 7fe125ff88c0 1 < completed write operation key=2KEKSWK0UT6C tag=VWD2XX3VBY0G type=write size=25857 2024-09-14T11:17:26.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.174+0000 7fe125ff88c0 1 > prepared operation key=46ZTDBWFVSUH tag=P2G8KNG8DPQU type=write size=299382 2024-09-14T11:17:26.179 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.178+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~C3T0HPB52997.0 size=1048576 2024-09-14T11:17:26.182 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.182+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~C3T0HPB52997.1 size=478164 2024-09-14T11:17:26.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.186+0000 7fe125ff88c0 1 < completed multipart upload key=46ZTDBWFVSUH upload=C3T0HPB52997 tag=MBZ8ZSPSBHTJ type=write size=2575316 2024-09-14T11:17:26.194 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.194+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~JU1XN4924SM3.0 size=1048576 2024-09-14T11:17:26.197 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.198+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~JU1XN4924SM3.1 size=1048576 2024-09-14T11:17:26.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.198+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~JU1XN4924SM3.2 size=524901 2024-09-14T11:17:26.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.198+0000 7fe125ff88c0 1 > prepared multipart upload key=YGEVGH840L18 upload=JU1XN4924SM3 tag=PGUT58L7V10M type=write size=3670629 2024-09-14T11:17:26.203 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.202+0000 7fe125ff88c0 1 < completed delete operation key=46ZTDBWFVSUH tag=BHC0AIDASD33 type=del 2024-09-14T11:17:26.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.206+0000 7fe125ff88c0 1 > prepared operation key=0FITHLGQKQEC tag=QA0AUWI3LLH9 type=del size=619933 2024-09-14T11:17:26.211 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.210+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~SDCFKAYBK53C.0 size=1048576 2024-09-14T11:17:26.215 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.214+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~SDCFKAYBK53C.1 size=1048576 2024-09-14T11:17:26.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.218+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~SDCFKAYBK53C.2 size=998524 2024-09-14T11:17:26.223 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.222+0000 7fe125ff88c0 1 < completed multipart upload key=2UXA6SXDTUFT upload=SDCFKAYBK53C tag=6U8H2L31CYHX type=write size=4144252 2024-09-14T11:17:26.230 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.230+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~PDKJEP3NW0G7.0 size=1048576 2024-09-14T11:17:26.232 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.234+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~PDKJEP3NW0G7.1 size=1048576 2024-09-14T11:17:26.236 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.234+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~PDKJEP3NW0G7.2 size=243152 2024-09-14T11:17:26.236 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.234+0000 7fe125ff88c0 1 > prepared multipart upload key=0VBX2FWYCFEZ upload=PDKJEP3NW0G7 tag=85LI305CB78L type=write size=3388880 2024-09-14T11:17:26.236 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.238+0000 7fe125ff88c0 1 < canceled part key=_multipart_SUCH37O8V1LY.2~PHU69IAAX16N.0 size=541650 2024-09-14T11:17:26.242 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.242+0000 7fe125ff88c0 1 < canceled multipart upload key=SUCH37O8V1LY upload=PHU69IAAX16N tag=XKHS3APBI572 type=write size=1590226 2024-09-14T11:17:26.249 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.250+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~NRXHST342WBD.0 size=1048576 2024-09-14T11:17:26.252 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.250+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~NRXHST342WBD.1 size=250811 2024-09-14T11:17:26.252 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.250+0000 7fe125ff88c0 1 > prepared multipart upload key=SSNV25PDLDIS upload=NRXHST342WBD tag=PFCK9JXAWXU4 type=write size=2347963 2024-09-14T11:17:26.256 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.254+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~21BMQVVVT7PL.0 size=1048576 2024-09-14T11:17:26.259 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.258+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~21BMQVVVT7PL.1 size=533872 2024-09-14T11:17:26.265 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.270+0000 7fe125ff88c0 1 < completed multipart upload key=SSNV25PDLDIS upload=21BMQVVVT7PL tag=8KSRJXBWVN5C type=write size=2631024 2024-09-14T11:17:26.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.270+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=CF9NO8RPS2D3 type=del size=786806 2024-09-14T11:17:26.273 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.274+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~LE2LB2F83NPE.0 size=1048576 2024-09-14T11:17:26.276 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.274+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~LE2LB2F83NPE.1 size=824001 2024-09-14T11:17:26.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.282+0000 7fe125ff88c0 1 < completed multipart upload key=F9I82N7RQC81 upload=LE2LB2F83NPE tag=WXRVF2CP7P5V type=write size=2921153 2024-09-14T11:17:26.286 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.286+0000 7fe125ff88c0 1 > prepared operation key=N80X3YUF4OEL tag=OVXWZ893WU45 type=write size=540740 2024-09-14T11:17:26.290 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.290+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~QB0938U9ZMEG.0 size=1048576 2024-09-14T11:17:26.290 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.290+0000 7fe125ff88c0 1 < canceled part key=_multipart_YCF2PCJ9TZMR.2~QB0938U9ZMEG.1 size=675414 2024-09-14T11:17:26.296 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.294+0000 7fe125ff88c0 1 < canceled multipart upload key=YCF2PCJ9TZMR upload=QB0938U9ZMEG tag=W28OHRJGB9AV type=write size=2772566 2024-09-14T11:17:26.303 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.302+0000 7fe125ff88c0 1 > prepared part key=_multipart_WEA3MQ0DI42N.2~OUBG5SYOYNDZ.0 size=1048576 2024-09-14T11:17:26.305 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.306+0000 7fe125ff88c0 1 > prepared part key=_multipart_WEA3MQ0DI42N.2~OUBG5SYOYNDZ.1 size=1048576 2024-09-14T11:17:26.308 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.310+0000 7fe125ff88c0 1 > prepared part key=_multipart_WEA3MQ0DI42N.2~OUBG5SYOYNDZ.2 size=531421 2024-09-14T11:17:26.308 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.310+0000 7fe125ff88c0 1 > prepared multipart upload key=WEA3MQ0DI42N upload=OUBG5SYOYNDZ tag=D0PBTEQIIPD8 type=write size=3677149 2024-09-14T11:17:26.312 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.310+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~CCZH4JWBE1I8.0 size=1048576 2024-09-14T11:17:26.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.318+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~CCZH4JWBE1I8.1 size=212132 2024-09-14T11:17:26.323 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.322+0000 7fe125ff88c0 1 < completed multipart upload key=F9I82N7RQC81 upload=CCZH4JWBE1I8 tag=L2Q9JPPX1GM2 type=write size=2309284 2024-09-14T11:17:26.327 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.326+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=YC50WVNDC3VG type=del size=3774162 2024-09-14T11:17:26.331 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.330+0000 7fe125ff88c0 1 < completed write operation key=2UXA6SXDTUFT tag=JOFIQ52JADWQ type=write size=844325 2024-09-14T11:17:26.335 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.334+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=05NDEC4AD59N type=del size=1711841 2024-09-14T11:17:26.342 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.342+0000 7fe125ff88c0 1 < suggested update operation key=3OU4U9JF3ZD5 tag=KDQH212465K5 type=del size=2545235 2024-09-14T11:17:26.345 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.346+0000 7fe125ff88c0 1 > prepared operation key=6C3JZKTB8BP3 tag=9X2P56KCTMH3 type=del size=3598563 2024-09-14T11:17:26.350 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.350+0000 7fe125ff88c0 1 < completed part key=_multipart_2KEKSWK0UT6C.2~D7N02DR2SCEP.0 size=1048576 2024-09-14T11:17:26.352 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.354+0000 7fe125ff88c0 1 < completed part key=_multipart_2KEKSWK0UT6C.2~D7N02DR2SCEP.1 size=750564 2024-09-14T11:17:26.358 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.358+0000 7fe125ff88c0 1 < completed multipart upload key=2KEKSWK0UT6C upload=D7N02DR2SCEP tag=WIIVGEFVZGAO type=write size=2847716 2024-09-14T11:17:26.365 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.366+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~XSFCALQQN0RE.0 size=1048576 2024-09-14T11:17:26.367 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.366+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~XSFCALQQN0RE.1 size=309131 2024-09-14T11:17:26.368 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.366+0000 7fe125ff88c0 1 > prepared multipart upload key=3YGN50MBAF41 upload=XSFCALQQN0RE tag=X010H7OXYI9K type=write size=2406283 2024-09-14T11:17:26.371 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.370+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~UFKNMDCKK3ZY.0 size=1048576 2024-09-14T11:17:26.371 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.370+0000 7fe125ff88c0 1 < canceled part key=_multipart_2LH5U05C2F8C.2~UFKNMDCKK3ZY.1 size=1048576 2024-09-14T11:17:26.374 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.374+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~UFKNMDCKK3ZY.2 size=570459 2024-09-14T11:17:26.380 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.382+0000 7fe125ff88c0 1 < canceled multipart upload key=2LH5U05C2F8C upload=UFKNMDCKK3ZY tag=3XIVA7MU7LUY type=write size=3716187 2024-09-14T11:17:26.387 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.386+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~OC8ZAV3XPRO3.0 size=1048576 2024-09-14T11:17:26.390 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.390+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~OC8ZAV3XPRO3.1 size=607621 2024-09-14T11:17:26.390 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.390+0000 7fe125ff88c0 1 > prepared multipart upload key=K3P6U6NU8I01 upload=OC8ZAV3XPRO3 tag=YGZ822LWRA84 type=write size=2704773 2024-09-14T11:17:26.398 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.398+0000 7fe125ff88c0 1 < suggested update operation key=2UXA6SXDTUFT tag=W1XRS2ZBB7NU type=del size=3851849 2024-09-14T11:17:26.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.406+0000 7fe125ff88c0 1 > prepared operation key=0FITHLGQKQEC tag=66AV2M1Q4ZY1 type=write size=857941 2024-09-14T11:17:26.410 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.410+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~JFGL1SKGJX7P.0 size=1048576 2024-09-14T11:17:26.413 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.414+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~JFGL1SKGJX7P.1 size=1048576 2024-09-14T11:17:26.416 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.414+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~JFGL1SKGJX7P.2 size=77343 2024-09-14T11:17:26.422 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.422+0000 7fe125ff88c0 1 < completed multipart upload key=46ZTDBWFVSUH upload=JFGL1SKGJX7P tag=J72YMIJ5FQU0 type=write size=3223071 2024-09-14T11:17:26.426 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.426+0000 7fe125ff88c0 1 > prepared operation key=FQ5WT12KB664 tag=3ITHO92RXK8Y type=del size=2697458 2024-09-14T11:17:26.430 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.430+0000 7fe125ff88c0 1 < completed delete operation key=F9I82N7RQC81 tag=KT4MVP3UXS3P type=del 2024-09-14T11:17:26.434 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.434+0000 7fe125ff88c0 1 > prepared operation key=YFRH8WECBTJK tag=I72TZEH9I6HQ type=del size=2321340 2024-09-14T11:17:26.438 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.438+0000 7fe125ff88c0 1 < completed write operation key=46ZTDBWFVSUH tag=P2G8KNG8DPQU type=write size=299382 2024-09-14T11:17:26.444 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.446+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~637R80NWDOJV.0 size=1048576 2024-09-14T11:17:26.447 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.446+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~637R80NWDOJV.1 size=1048576 2024-09-14T11:17:26.450 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.450+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~637R80NWDOJV.2 size=140654 2024-09-14T11:17:26.450 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.450+0000 7fe125ff88c0 1 > prepared multipart upload key=L4XO0WTYKNXY upload=637R80NWDOJV tag=HY0KNWZJJIFF type=write size=3286382 2024-09-14T11:17:26.454 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.454+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~JU1XN4924SM3.0 size=1048576 2024-09-14T11:17:26.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.458+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~JU1XN4924SM3.1 size=1048576 2024-09-14T11:17:26.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.458+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~JU1XN4924SM3.2 size=524901 2024-09-14T11:17:26.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.466+0000 7fe125ff88c0 1 < completed multipart upload key=YGEVGH840L18 upload=JU1XN4924SM3 tag=PGUT58L7V10M type=write size=3670629 2024-09-14T11:17:26.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.470+0000 7fe125ff88c0 1 > prepared operation key=LYBGDNKUROWH tag=67ME6DIBGRHT type=del size=4070746 2024-09-14T11:17:26.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.474+0000 7fe125ff88c0 1 < canceled operation key=0FITHLGQKQEC tag=QA0AUWI3LLH9 type=del size=619933 2024-09-14T11:17:26.478 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.478+0000 7fe125ff88c0 1 > prepared operation key=N80X3YUF4OEL tag=1KCQRMFDWOXH type=del size=4010241 2024-09-14T11:17:26.479 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.478+0000 7fe125ff88c0 1 < canceled part key=_multipart_0VBX2FWYCFEZ.2~PDKJEP3NW0G7.0 size=1048576 2024-09-14T11:17:26.481 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.482+0000 7fe125ff88c0 1 < completed part key=_multipart_0VBX2FWYCFEZ.2~PDKJEP3NW0G7.1 size=1048576 2024-09-14T11:17:26.484 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.486+0000 7fe125ff88c0 1 < completed part key=_multipart_0VBX2FWYCFEZ.2~PDKJEP3NW0G7.2 size=243152 2024-09-14T11:17:26.490 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.490+0000 7fe125ff88c0 1 < canceled multipart upload key=0VBX2FWYCFEZ upload=PDKJEP3NW0G7 tag=85LI305CB78L type=write size=3388880 2024-09-14T11:17:26.497 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.498+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~GU219WOD6ET7.0 size=720332 2024-09-14T11:17:26.497 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.498+0000 7fe125ff88c0 1 > prepared multipart upload key=YFRH8WECBTJK upload=GU219WOD6ET7 tag=7NBCUMWNBZOV type=write size=1768908 2024-09-14T11:17:26.500 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.498+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~NRXHST342WBD.0 size=1048576 2024-09-14T11:17:26.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.502+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~NRXHST342WBD.1 size=250811 2024-09-14T11:17:26.508 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.510+0000 7fe125ff88c0 1 < completed multipart upload key=SSNV25PDLDIS upload=NRXHST342WBD tag=PFCK9JXAWXU4 type=write size=2347963 2024-09-14T11:17:26.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.514+0000 7fe125ff88c0 1 > prepared operation key=N80X3YUF4OEL tag=2PWKKND9W705 type=write size=180575 2024-09-14T11:17:26.520 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.522+0000 7fe125ff88c0 1 < suggested update operation key=YCF2PCJ9TZMR tag=CF9NO8RPS2D3 type=del size=786806 2024-09-14T11:17:26.524 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.526+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=IWX6YCBF0PU1 type=del size=2881528 2024-09-14T11:17:26.528 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.530+0000 7fe125ff88c0 1 < canceled operation key=N80X3YUF4OEL tag=OVXWZ893WU45 type=write size=540740 2024-09-14T11:17:26.532 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.534+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=YD9FVDF69CZW type=del size=2175412 2024-09-14T11:17:26.533 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.534+0000 7fe125ff88c0 1 < canceled part key=_multipart_WEA3MQ0DI42N.2~OUBG5SYOYNDZ.0 size=1048576 2024-09-14T11:17:26.536 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.534+0000 7fe125ff88c0 1 < completed part key=_multipart_WEA3MQ0DI42N.2~OUBG5SYOYNDZ.1 size=1048576 2024-09-14T11:17:26.539 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.538+0000 7fe125ff88c0 1 < completed part key=_multipart_WEA3MQ0DI42N.2~OUBG5SYOYNDZ.2 size=531421 2024-09-14T11:17:26.546 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.546+0000 7fe125ff88c0 1 < canceled multipart upload key=WEA3MQ0DI42N upload=OUBG5SYOYNDZ tag=D0PBTEQIIPD8 type=write size=3677149 2024-09-14T11:17:26.552 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.550+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~ZEULP5V3CKU8.0 size=569007 2024-09-14T11:17:26.552 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.550+0000 7fe125ff88c0 1 > prepared multipart upload key=L4XO0WTYKNXY upload=ZEULP5V3CKU8 tag=6KR8JEHLJKE3 type=write size=1617583 2024-09-14T11:17:26.560 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.558+0000 7fe125ff88c0 1 < suggested update operation key=6PLUU2QIO9LJ tag=YC50WVNDC3VG type=del size=3774162 2024-09-14T11:17:26.566 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.566+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~XBBF05617HSZ.0 size=253144 2024-09-14T11:17:26.566 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.566+0000 7fe125ff88c0 1 > prepared multipart upload key=SSNV25PDLDIS upload=XBBF05617HSZ tag=08DF1O1QEWDB type=write size=1301720 2024-09-14T11:17:26.571 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.570+0000 7fe125ff88c0 1 < completed delete operation key=4D2X7151977X tag=05NDEC4AD59N type=del 2024-09-14T11:17:26.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.574+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=QZ0NOH811SA4 type=del size=2988339 2024-09-14T11:17:26.582 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.582+0000 7fe125ff88c0 1 < suggested update operation key=6C3JZKTB8BP3 tag=9X2P56KCTMH3 type=del size=3598563 2024-09-14T11:17:26.589 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.590+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~2K6COPE95FPV.0 size=1048576 2024-09-14T11:17:26.592 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.590+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~2K6COPE95FPV.1 size=385035 2024-09-14T11:17:26.592 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.590+0000 7fe125ff88c0 1 > prepared multipart upload key=YCF2PCJ9TZMR upload=2K6COPE95FPV tag=OBWUQNFFN34W type=write size=2482187 2024-09-14T11:17:26.595 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.594+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~XSFCALQQN0RE.0 size=1048576 2024-09-14T11:17:26.598 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.598+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~XSFCALQQN0RE.1 size=309131 2024-09-14T11:17:26.604 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.602+0000 7fe125ff88c0 1 < completed multipart upload key=3YGN50MBAF41 upload=XSFCALQQN0RE tag=X010H7OXYI9K type=write size=2406283 2024-09-14T11:17:26.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.606+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=NCSMFM478T43 type=write size=269186 2024-09-14T11:17:26.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.614+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~OC8ZAV3XPRO3.0 size=1048576 2024-09-14T11:17:26.615 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.614+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~OC8ZAV3XPRO3.1 size=607621 2024-09-14T11:17:26.621 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.622+0000 7fe125ff88c0 1 < completed multipart upload key=K3P6U6NU8I01 upload=OC8ZAV3XPRO3 tag=YGZ822LWRA84 type=write size=2704773 2024-09-14T11:17:26.625 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.626+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=LNMXO3AKKRFD type=del size=1635948 2024-09-14T11:17:26.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.630+0000 7fe125ff88c0 1 < completed write operation key=0FITHLGQKQEC tag=66AV2M1Q4ZY1 type=write size=857941 2024-09-14T11:17:26.636 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.634+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~PGERTE9FNL7J.0 size=1048576 2024-09-14T11:17:26.639 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.638+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~PGERTE9FNL7J.1 size=714595 2024-09-14T11:17:26.639 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.638+0000 7fe125ff88c0 1 > prepared multipart upload key=SUCH37O8V1LY upload=PGERTE9FNL7J tag=I2789X3YKQUM type=write size=2811747 2024-09-14T11:17:26.643 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.642+0000 7fe125ff88c0 1 < completed delete operation key=FQ5WT12KB664 tag=3ITHO92RXK8Y type=del 2024-09-14T11:17:26.650 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.650+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~INBVBC66ECJV.0 size=595009 2024-09-14T11:17:26.650 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.650+0000 7fe125ff88c0 1 > prepared multipart upload key=K3P6U6NU8I01 upload=INBVBC66ECJV tag=OK7IZVPBIX6Z type=write size=1643585 2024-09-14T11:17:26.657 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.658+0000 7fe125ff88c0 1 < suggested update operation key=YFRH8WECBTJK tag=I72TZEH9I6HQ type=del size=2321340 2024-09-14T11:17:26.661 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.662+0000 7fe125ff88c0 1 > prepared operation key=N80X3YUF4OEL tag=LUT319ZPN3D1 type=del size=1693609 2024-09-14T11:17:26.665 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.666+0000 7fe125ff88c0 1 < completed part key=_multipart_L4XO0WTYKNXY.2~637R80NWDOJV.0 size=1048576 2024-09-14T11:17:26.668 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.666+0000 7fe125ff88c0 1 < completed part key=_multipart_L4XO0WTYKNXY.2~637R80NWDOJV.1 size=1048576 2024-09-14T11:17:26.671 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.670+0000 7fe125ff88c0 1 < completed part key=_multipart_L4XO0WTYKNXY.2~637R80NWDOJV.2 size=140654 2024-09-14T11:17:26.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.678+0000 7fe125ff88c0 1 < completed multipart upload key=L4XO0WTYKNXY upload=637R80NWDOJV tag=HY0KNWZJJIFF type=write size=3286382 2024-09-14T11:17:26.684 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.686+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~M2BIVFTKLE9K.0 size=1048576 2024-09-14T11:17:26.687 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.686+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~M2BIVFTKLE9K.1 size=1048576 2024-09-14T11:17:26.690 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.690+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~M2BIVFTKLE9K.2 size=669600 2024-09-14T11:17:26.690 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.690+0000 7fe125ff88c0 1 > prepared multipart upload key=W0B19NBHNLMZ upload=M2BIVFTKLE9K tag=RL9UBL0XQFLS type=write size=3815328 2024-09-14T11:17:26.694 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.694+0000 7fe125ff88c0 1 < completed delete operation key=LYBGDNKUROWH tag=67ME6DIBGRHT type=del 2024-09-14T11:17:26.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.698+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=QEEHK01JZHRV type=del size=1816687 2024-09-14T11:17:26.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.702+0000 7fe125ff88c0 1 < completed delete operation key=N80X3YUF4OEL tag=1KCQRMFDWOXH type=del 2024-09-14T11:17:26.708 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.706+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=SQOSQ3PXTD3S type=del size=1434300 2024-09-14T11:17:26.710 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.710+0000 7fe125ff88c0 1 < completed part key=_multipart_YFRH8WECBTJK.2~GU219WOD6ET7.0 size=720332 2024-09-14T11:17:26.716 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.718+0000 7fe125ff88c0 1 < completed multipart upload key=YFRH8WECBTJK upload=GU219WOD6ET7 tag=7NBCUMWNBZOV type=write size=1768908 2024-09-14T11:17:26.720 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.718+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=ZFLJCKCIWNSE type=del size=1229424 2024-09-14T11:17:26.724 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.722+0000 7fe125ff88c0 1 < completed write operation key=N80X3YUF4OEL tag=2PWKKND9W705 type=write size=180575 2024-09-14T11:17:26.728 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.726+0000 7fe125ff88c0 1 > prepared operation key=N80X3YUF4OEL tag=4DALSPA7R91Y type=del size=3409936 2024-09-14T11:17:26.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.734+0000 7fe125ff88c0 1 < suggested remove operation key=2UXA6SXDTUFT tag=IWX6YCBF0PU1 type=del 2024-09-14T11:17:26.739 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.738+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=KS71P2XY2X5F type=del size=1798025 2024-09-14T11:17:26.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.742+0000 7fe125ff88c0 -1 < failed to complete operation key=6PLUU2QIO9LJ tag=YD9FVDF69CZW type=del size=2175412: (22) Invalid argument 2024-09-14T11:17:26.747 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.746+0000 7fe125ff88c0 1 > prepared operation key=K05LARTJ2QZ3 tag=1GO91J66BI3S type=del size=2899489 2024-09-14T11:17:26.751 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.750+0000 7fe125ff88c0 1 < completed part key=_multipart_L4XO0WTYKNXY.2~ZEULP5V3CKU8.0 size=569007 2024-09-14T11:17:26.762 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.762+0000 7fe125ff88c0 1 < completed multipart upload key=L4XO0WTYKNXY upload=ZEULP5V3CKU8 tag=6KR8JEHLJKE3 type=write size=1617583 2024-09-14T11:17:26.766 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.766+0000 7fe125ff88c0 1 > prepared operation key=FQ5WT12KB664 tag=9R0BZ0BMLP2E type=write size=282524 2024-09-14T11:17:26.770 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.770+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~XBBF05617HSZ.0 size=253144 2024-09-14T11:17:26.776 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.774+0000 7fe125ff88c0 1 < completed multipart upload key=SSNV25PDLDIS upload=XBBF05617HSZ tag=08DF1O1QEWDB type=write size=1301720 2024-09-14T11:17:26.783 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.782+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~8UGHZTYYRHB1.0 size=1048576 2024-09-14T11:17:26.786 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.786+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~8UGHZTYYRHB1.1 size=376456 2024-09-14T11:17:26.786 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.786+0000 7fe125ff88c0 1 > prepared multipart upload key=SSNV25PDLDIS upload=8UGHZTYYRHB1 tag=4KLJF4VX7ZGC type=write size=2473608 2024-09-14T11:17:26.790 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.790+0000 7fe125ff88c0 1 < completed delete operation key=V6B470G93KFT tag=QZ0NOH811SA4 type=del 2024-09-14T11:17:26.794 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.794+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=JHQZ30B37PP2 type=write size=826863 2024-09-14T11:17:26.798 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.798+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~2K6COPE95FPV.0 size=1048576 2024-09-14T11:17:26.798 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.798+0000 7fe125ff88c0 1 < canceled part key=_multipart_YCF2PCJ9TZMR.2~2K6COPE95FPV.1 size=385035 2024-09-14T11:17:26.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.802+0000 7fe125ff88c0 1 < canceled multipart upload key=YCF2PCJ9TZMR upload=2K6COPE95FPV tag=OBWUQNFFN34W type=write size=2482187 2024-09-14T11:17:26.808 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.806+0000 7fe125ff88c0 1 > prepared operation key=N80X3YUF4OEL tag=I91ZLBV2K1CD type=del size=2382429 2024-09-14T11:17:26.812 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.810+0000 7fe125ff88c0 1 < completed write operation key=0VBX2FWYCFEZ tag=NCSMFM478T43 type=write size=269186 2024-09-14T11:17:26.819 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.818+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~NJKJOTYQ19AB.0 size=1048576 2024-09-14T11:17:26.822 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.822+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~NJKJOTYQ19AB.1 size=624119 2024-09-14T11:17:26.822 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.822+0000 7fe125ff88c0 1 > prepared multipart upload key=3YGN50MBAF41 upload=NJKJOTYQ19AB tag=FQIS1463EDKK type=write size=2721271 2024-09-14T11:17:26.830 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.830+0000 7fe125ff88c0 1 < suggested update operation key=SSNV25PDLDIS tag=LNMXO3AKKRFD type=del size=1635948 2024-09-14T11:17:26.835 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.834+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=8DBHTR6S1ZFO type=write size=406158 2024-09-14T11:17:26.839 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.838+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~PGERTE9FNL7J.0 size=1048576 2024-09-14T11:17:26.842 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.842+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~PGERTE9FNL7J.1 size=714595 2024-09-14T11:17:26.848 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.846+0000 7fe125ff88c0 1 < completed multipart upload key=SUCH37O8V1LY upload=PGERTE9FNL7J tag=I2789X3YKQUM type=write size=2811747 2024-09-14T11:17:26.852 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.850+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=517ZIXQ53DWE type=del size=36541 2024-09-14T11:17:26.856 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.854+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~INBVBC66ECJV.0 size=595009 2024-09-14T11:17:26.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.862+0000 7fe125ff88c0 1 < completed multipart upload key=K3P6U6NU8I01 upload=INBVBC66ECJV tag=OK7IZVPBIX6Z type=write size=1643585 2024-09-14T11:17:26.869 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.870+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~U1AVNQLTFWWG.0 size=1048576 2024-09-14T11:17:26.872 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.870+0000 7fe125ff88c0 1 > prepared part key=_multipart_K3P6U6NU8I01.2~U1AVNQLTFWWG.1 size=177748 2024-09-14T11:17:26.872 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.870+0000 7fe125ff88c0 1 > prepared multipart upload key=K3P6U6NU8I01 upload=U1AVNQLTFWWG tag=Y9BWFU265GX4 type=write size=2274900 2024-09-14T11:17:26.877 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.878+0000 7fe125ff88c0 1 < completed delete operation key=N80X3YUF4OEL tag=LUT319ZPN3D1 type=del 2024-09-14T11:17:26.883 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.882+0000 7fe125ff88c0 1 > prepared part key=_multipart_6PLUU2QIO9LJ.2~W5NKO0W36Y37.0 size=1048576 2024-09-14T11:17:26.886 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.886+0000 7fe125ff88c0 1 > prepared part key=_multipart_6PLUU2QIO9LJ.2~W5NKO0W36Y37.1 size=1048576 2024-09-14T11:17:26.888 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.890+0000 7fe125ff88c0 1 > prepared part key=_multipart_6PLUU2QIO9LJ.2~W5NKO0W36Y37.2 size=225454 2024-09-14T11:17:26.888 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.890+0000 7fe125ff88c0 1 > prepared multipart upload key=6PLUU2QIO9LJ upload=W5NKO0W36Y37 tag=RGL23H4A3F0W type=write size=3371182 2024-09-14T11:17:26.892 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.894+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~M2BIVFTKLE9K.0 size=1048576 2024-09-14T11:17:26.895 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.894+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~M2BIVFTKLE9K.1 size=1048576 2024-09-14T11:17:26.898 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.898+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~M2BIVFTKLE9K.2 size=669600 2024-09-14T11:17:26.904 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.902+0000 7fe125ff88c0 1 < completed multipart upload key=W0B19NBHNLMZ upload=M2BIVFTKLE9K tag=RL9UBL0XQFLS type=write size=3815328 2024-09-14T11:17:26.912 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.910+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~T2Y8K4JZMCND.0 size=1048576 2024-09-14T11:17:26.914 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.914+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~T2Y8K4JZMCND.1 size=1048576 2024-09-14T11:17:26.917 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.918+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~T2Y8K4JZMCND.2 size=893593 2024-09-14T11:17:26.917 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.918+0000 7fe125ff88c0 1 > prepared multipart upload key=V6B470G93KFT upload=T2Y8K4JZMCND tag=1BVC4HRCKSZB type=write size=4039321 2024-09-14T11:17:26.921 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.922+0000 7fe125ff88c0 -1 < failed to complete operation key=SSNV25PDLDIS tag=QEEHK01JZHRV type=del size=1816687: (22) Invalid argument 2024-09-14T11:17:26.925 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.926+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=A05HME44OJDS type=write size=848540 2024-09-14T11:17:26.929 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.930+0000 7fe125ff88c0 1 < completed delete operation key=YGEVGH840L18 tag=SQOSQ3PXTD3S type=del 2024-09-14T11:17:26.936 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.934+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~9U7E0X3R8QT4.0 size=1048576 2024-09-14T11:17:26.939 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.938+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~9U7E0X3R8QT4.1 size=230908 2024-09-14T11:17:26.939 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.938+0000 7fe125ff88c0 1 > prepared multipart upload key=0FITHLGQKQEC upload=9U7E0X3R8QT4 tag=QK8FIBVLQS7W type=write size=2328060 2024-09-14T11:17:26.943 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.942+0000 7fe125ff88c0 -1 < failed to complete operation key=2UXA6SXDTUFT tag=ZFLJCKCIWNSE type=del size=1229424: (22) Invalid argument 2024-09-14T11:17:26.946 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.946+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=1LKOYHESE704 type=del size=2005236 2024-09-14T11:17:26.951 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.950+0000 7fe125ff88c0 1 < completed delete operation key=N80X3YUF4OEL tag=4DALSPA7R91Y type=del 2024-09-14T11:17:26.957 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.958+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~612M0OXMFVPZ.0 size=1048576 2024-09-14T11:17:26.960 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.958+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~612M0OXMFVPZ.1 size=543178 2024-09-14T11:17:26.960 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.958+0000 7fe125ff88c0 1 > prepared multipart upload key=YN2HI39GPEDF upload=612M0OXMFVPZ tag=6G1TTSLCIHFJ type=write size=2640330 2024-09-14T11:17:26.964 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.962+0000 7fe125ff88c0 1 < completed delete operation key=2UXA6SXDTUFT tag=KS71P2XY2X5F type=del 2024-09-14T11:17:26.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.970+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~BQIHWYYUEUDF.0 size=460022 2024-09-14T11:17:26.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.970+0000 7fe125ff88c0 1 > prepared multipart upload key=W0B19NBHNLMZ upload=BQIHWYYUEUDF tag=PJN41EGK62ZJ type=write size=1508598 2024-09-14T11:17:26.978 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.978+0000 7fe125ff88c0 1 < suggested remove operation key=K05LARTJ2QZ3 tag=1GO91J66BI3S type=del 2024-09-14T11:17:26.981 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.982+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=4CI9XWXBFRJK type=write size=285914 2024-09-14T11:17:26.986 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.986+0000 7fe125ff88c0 1 < completed write operation key=FQ5WT12KB664 tag=9R0BZ0BMLP2E type=write size=282524 2024-09-14T11:17:26.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.994+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~1DYDWAFJUS7D.0 size=1048576 2024-09-14T11:17:26.995 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.994+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~1DYDWAFJUS7D.1 size=821610 2024-09-14T11:17:26.995 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.994+0000 7fe125ff88c0 1 > prepared multipart upload key=L4XO0WTYKNXY upload=1DYDWAFJUS7D tag=XSE1QRUGYMEW type=write size=2918762 2024-09-14T11:17:26.999 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:26.998+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~8UGHZTYYRHB1.0 size=1048576 2024-09-14T11:17:27.002 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.002+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~8UGHZTYYRHB1.1 size=376456 2024-09-14T11:17:27.008 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.006+0000 7fe125ff88c0 1 < completed multipart upload key=SSNV25PDLDIS upload=8UGHZTYYRHB1 tag=4KLJF4VX7ZGC type=write size=2473608 2024-09-14T11:17:27.012 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.010+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=HKUPESA3PON6 type=del size=1244342 2024-09-14T11:17:27.016 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.014+0000 7fe125ff88c0 1 < completed write operation key=6PLUU2QIO9LJ tag=JHQZ30B37PP2 type=write size=826863 2024-09-14T11:17:27.022 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.022+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~VK3XN5XJ4FJ8.0 size=1048576 2024-09-14T11:17:27.025 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.026+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~VK3XN5XJ4FJ8.1 size=143748 2024-09-14T11:17:27.025 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.026+0000 7fe125ff88c0 1 > prepared multipart upload key=FQ5WT12KB664 upload=VK3XN5XJ4FJ8 tag=EBMKLI5PGR57 type=write size=2240900 2024-09-14T11:17:27.029 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.030+0000 7fe125ff88c0 1 < completed delete operation key=N80X3YUF4OEL tag=I91ZLBV2K1CD type=del 2024-09-14T11:17:27.033 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.034+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=39BF1O5RGFIA type=del size=1030509 2024-09-14T11:17:27.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.038+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~NJKJOTYQ19AB.0 size=1048576 2024-09-14T11:17:27.040 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.038+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~NJKJOTYQ19AB.1 size=624119 2024-09-14T11:17:27.046 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.046+0000 7fe125ff88c0 1 < completed multipart upload key=3YGN50MBAF41 upload=NJKJOTYQ19AB tag=FQIS1463EDKK type=write size=2721271 2024-09-14T11:17:27.050 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.050+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=LT1ATBRV4T0D type=del size=2184057 2024-09-14T11:17:27.054 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.054+0000 7fe125ff88c0 1 < completed write operation key=YN2HI39GPEDF tag=8DBHTR6S1ZFO type=write size=406158 2024-09-14T11:17:27.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.062+0000 7fe125ff88c0 1 > prepared part key=_multipart_N94D3R7IOBNL.2~7QXU2XKGSHOR.0 size=459971 2024-09-14T11:17:27.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.062+0000 7fe125ff88c0 1 > prepared multipart upload key=N94D3R7IOBNL upload=7QXU2XKGSHOR tag=8Z8PFIZF8IPZ type=write size=1508547 2024-09-14T11:17:27.065 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.066+0000 7fe125ff88c0 1 < canceled operation key=35EB6U5O4A51 tag=517ZIXQ53DWE type=del size=36541 2024-09-14T11:17:27.069 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.070+0000 7fe125ff88c0 1 > prepared operation key=SUCH37O8V1LY tag=Y9A0EIK2I3UP type=del size=2990873 2024-09-14T11:17:27.073 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.074+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~U1AVNQLTFWWG.0 size=1048576 2024-09-14T11:17:27.076 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.074+0000 7fe125ff88c0 1 < completed part key=_multipart_K3P6U6NU8I01.2~U1AVNQLTFWWG.1 size=177748 2024-09-14T11:17:27.082 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.082+0000 7fe125ff88c0 1 < completed multipart upload key=K3P6U6NU8I01 upload=U1AVNQLTFWWG tag=Y9BWFU265GX4 type=write size=2274900 2024-09-14T11:17:27.086 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.086+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=CR5HOQLTEADW type=del size=1935097 2024-09-14T11:17:27.090 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.090+0000 7fe125ff88c0 1 < completed part key=_multipart_6PLUU2QIO9LJ.2~W5NKO0W36Y37.0 size=1048576 2024-09-14T11:17:27.092 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.094+0000 7fe125ff88c0 1 < completed part key=_multipart_6PLUU2QIO9LJ.2~W5NKO0W36Y37.1 size=1048576 2024-09-14T11:17:27.096 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.094+0000 7fe125ff88c0 1 < completed part key=_multipart_6PLUU2QIO9LJ.2~W5NKO0W36Y37.2 size=225454 2024-09-14T11:17:27.102 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.102+0000 7fe125ff88c0 1 < completed multipart upload key=6PLUU2QIO9LJ upload=W5NKO0W36Y37 tag=RGL23H4A3F0W type=write size=3371182 2024-09-14T11:17:27.113 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.118+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=V3M9T3RKWJGI type=del size=2346721 2024-09-14T11:17:27.118 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.118+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~T2Y8K4JZMCND.0 size=1048576 2024-09-14T11:17:27.118 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.118+0000 7fe125ff88c0 1 < canceled part key=_multipart_V6B470G93KFT.2~T2Y8K4JZMCND.1 size=1048576 2024-09-14T11:17:27.122 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.122+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~T2Y8K4JZMCND.2 size=893593 2024-09-14T11:17:27.129 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.130+0000 7fe125ff88c0 1 < canceled multipart upload key=V6B470G93KFT upload=T2Y8K4JZMCND tag=1BVC4HRCKSZB type=write size=4039321 2024-09-14T11:17:27.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.134+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=AZRJ9I00JBFI type=del size=460241 2024-09-14T11:17:27.138 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.138+0000 7fe125ff88c0 1 < completed write operation key=35EB6U5O4A51 tag=A05HME44OJDS type=write size=848540 2024-09-14T11:17:27.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.142+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=YUY4M3CG3ST4 type=del size=2268703 2024-09-14T11:17:27.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.146+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~9U7E0X3R8QT4.0 size=1048576 2024-09-14T11:17:27.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.150+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~9U7E0X3R8QT4.1 size=230908 2024-09-14T11:17:27.155 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.154+0000 7fe125ff88c0 1 < completed multipart upload key=0FITHLGQKQEC upload=9U7E0X3R8QT4 tag=QK8FIBVLQS7W type=write size=2328060 2024-09-14T11:17:27.159 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.158+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=YHBB0CG16RIF type=del size=2090728 2024-09-14T11:17:27.163 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.162+0000 7fe125ff88c0 1 < completed delete operation key=35EB6U5O4A51 tag=1LKOYHESE704 type=del 2024-09-14T11:17:27.169 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.170+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~FTBSY3CQWZX9.0 size=947168 2024-09-14T11:17:27.169 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.170+0000 7fe125ff88c0 1 > prepared multipart upload key=YCF2PCJ9TZMR upload=FTBSY3CQWZX9 tag=85FU8HT4ORU3 type=write size=1995744 2024-09-14T11:17:27.173 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.174+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~612M0OXMFVPZ.0 size=1048576 2024-09-14T11:17:27.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.174+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~612M0OXMFVPZ.1 size=543178 2024-09-14T11:17:27.181 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.182+0000 7fe125ff88c0 1 < completed multipart upload key=YN2HI39GPEDF upload=612M0OXMFVPZ tag=6G1TTSLCIHFJ type=write size=2640330 2024-09-14T11:17:27.185 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.186+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=1HL4AZM0PF4A type=del size=211844 2024-09-14T11:17:27.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.190+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~BQIHWYYUEUDF.0 size=460022 2024-09-14T11:17:27.193 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.194+0000 7fe125ff88c0 1 < completed multipart upload key=W0B19NBHNLMZ upload=BQIHWYYUEUDF tag=PJN41EGK62ZJ type=write size=1508598 2024-09-14T11:17:27.197 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.198+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=EHIFVYNVQV8J type=write size=971497 2024-09-14T11:17:27.203 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.202+0000 7fe125ff88c0 1 < suggested remove operation key=F9I82N7RQC81 tag=4CI9XWXBFRJK type=write 2024-09-14T11:17:27.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.206+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=L27GKQAB1IL8 type=write size=123823 2024-09-14T11:17:27.211 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.210+0000 7fe125ff88c0 1 < completed part key=_multipart_L4XO0WTYKNXY.2~1DYDWAFJUS7D.0 size=1048576 2024-09-14T11:17:27.213 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.214+0000 7fe125ff88c0 1 < completed part key=_multipart_L4XO0WTYKNXY.2~1DYDWAFJUS7D.1 size=821610 2024-09-14T11:17:27.219 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.218+0000 7fe125ff88c0 1 < completed multipart upload key=L4XO0WTYKNXY upload=1DYDWAFJUS7D tag=XSE1QRUGYMEW type=write size=2918762 2024-09-14T11:17:27.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.226+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~V367WE7E4CM8.0 size=788585 2024-09-14T11:17:27.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.226+0000 7fe125ff88c0 1 > prepared multipart upload key=L4XO0WTYKNXY upload=V367WE7E4CM8 tag=3FAVCDL3XD9L type=write size=1837161 2024-09-14T11:17:27.230 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.230+0000 7fe125ff88c0 1 < completed delete operation key=N94D3R7IOBNL tag=HKUPESA3PON6 type=del 2024-09-14T11:17:27.234 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.234+0000 7fe125ff88c0 1 > prepared operation key=46ZTDBWFVSUH tag=M5X8PA56ENSU type=del size=947086 2024-09-14T11:17:27.237 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.238+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~VK3XN5XJ4FJ8.0 size=1048576 2024-09-14T11:17:27.238 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.238+0000 7fe125ff88c0 1 < canceled part key=_multipart_FQ5WT12KB664.2~VK3XN5XJ4FJ8.1 size=143748 2024-09-14T11:17:27.244 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.242+0000 7fe125ff88c0 1 < canceled multipart upload key=FQ5WT12KB664 upload=VK3XN5XJ4FJ8 tag=EBMKLI5PGR57 type=write size=2240900 2024-09-14T11:17:27.248 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.246+0000 7fe125ff88c0 1 > prepared operation key=SUCH37O8V1LY tag=IE224Y6PIQPM type=del size=3976701 2024-09-14T11:17:27.253 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.254+0000 7fe125ff88c0 1 < completed delete operation key=W0B19NBHNLMZ tag=39BF1O5RGFIA type=del 2024-09-14T11:17:27.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.258+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~CEKLPL3NDL67.0 size=1048576 2024-09-14T11:17:27.263 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.262+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~CEKLPL3NDL67.1 size=554472 2024-09-14T11:17:27.263 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.262+0000 7fe125ff88c0 1 > prepared multipart upload key=YGEVGH840L18 upload=CEKLPL3NDL67 tag=ASNEW4PCZC0P type=write size=2651624 2024-09-14T11:17:27.267 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.266+0000 7fe125ff88c0 1 < completed delete operation key=2KEKSWK0UT6C tag=LT1ATBRV4T0D type=del 2024-09-14T11:17:27.271 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.270+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=ZT044V4ER6RI type=del size=3227137 2024-09-14T11:17:27.275 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.274+0000 7fe125ff88c0 1 < completed part key=_multipart_N94D3R7IOBNL.2~7QXU2XKGSHOR.0 size=459971 2024-09-14T11:17:27.281 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.282+0000 7fe125ff88c0 1 < completed multipart upload key=N94D3R7IOBNL upload=7QXU2XKGSHOR tag=8Z8PFIZF8IPZ type=write size=1508547 2024-09-14T11:17:27.285 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.286+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=IGHZA0GSSMWV type=del size=293027 2024-09-14T11:17:27.288 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.290+0000 7fe125ff88c0 1 < completed delete operation key=SUCH37O8V1LY tag=Y9A0EIK2I3UP type=del 2024-09-14T11:17:27.295 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.294+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~RQDMU46MRDTE.0 size=1048576 2024-09-14T11:17:27.298 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.298+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~RQDMU46MRDTE.1 size=390181 2024-09-14T11:17:27.298 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.298+0000 7fe125ff88c0 1 > prepared multipart upload key=0FITHLGQKQEC upload=RQDMU46MRDTE tag=ARXYK4A5V9CK type=write size=2487333 2024-09-14T11:17:27.302 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.302+0000 7fe125ff88c0 1 < completed delete operation key=YCF2PCJ9TZMR tag=CR5HOQLTEADW type=del 2024-09-14T11:17:27.307 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.306+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=25X3N6MNB4VV type=del size=2061906 2024-09-14T11:17:27.315 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.314+0000 7fe125ff88c0 1 < suggested update operation key=35EB6U5O4A51 tag=V3M9T3RKWJGI type=del size=2346721 2024-09-14T11:17:27.320 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.318+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=O201JMNQR85K type=del size=1770486 2024-09-14T11:17:27.323 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.322+0000 7fe125ff88c0 1 < completed delete operation key=YGEVGH840L18 tag=AZRJ9I00JBFI type=del 2024-09-14T11:17:27.329 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.330+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~8RQDO3G3E1DP.0 size=1048576 2024-09-14T11:17:27.332 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.334+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~8RQDO3G3E1DP.1 size=1048576 2024-09-14T11:17:27.335 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.334+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~8RQDO3G3E1DP.2 size=179085 2024-09-14T11:17:27.335 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.334+0000 7fe125ff88c0 1 > prepared multipart upload key=LYBGDNKUROWH upload=8RQDO3G3E1DP tag=IXLP7JTB0KGU type=write size=3324813 2024-09-14T11:17:27.339 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.338+0000 7fe125ff88c0 1 < completed delete operation key=WEA3MQ0DI42N tag=YUY4M3CG3ST4 type=del 2024-09-14T11:17:27.342 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.342+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=S5SJ29G3UI4J type=del size=4124213 2024-09-14T11:17:27.346 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.346+0000 7fe125ff88c0 1 < completed delete operation key=YGEVGH840L18 tag=YHBB0CG16RIF type=del 2024-09-14T11:17:27.353 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.354+0000 7fe125ff88c0 1 > prepared part key=_multipart_N94D3R7IOBNL.2~PJHU0PMQ71Z2.0 size=1048576 2024-09-14T11:17:27.357 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.358+0000 7fe125ff88c0 1 > prepared part key=_multipart_N94D3R7IOBNL.2~PJHU0PMQ71Z2.1 size=650632 2024-09-14T11:17:27.357 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.358+0000 7fe125ff88c0 1 > prepared multipart upload key=N94D3R7IOBNL upload=PJHU0PMQ71Z2 tag=1E2IWH1K47EF type=write size=2747784 2024-09-14T11:17:27.361 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.362+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~FTBSY3CQWZX9.0 size=947168 2024-09-14T11:17:27.366 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.366+0000 7fe125ff88c0 1 < completed multipart upload key=YCF2PCJ9TZMR upload=FTBSY3CQWZX9 tag=85FU8HT4ORU3 type=write size=1995744 2024-09-14T11:17:27.370 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.370+0000 7fe125ff88c0 1 > prepared operation key=SUCH37O8V1LY tag=BVSZR7JO74LS type=del size=700328 2024-09-14T11:17:27.374 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.374+0000 7fe125ff88c0 1 < completed delete operation key=YN2HI39GPEDF tag=1HL4AZM0PF4A type=del 2024-09-14T11:17:27.378 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.378+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=JHHPBBF9Q7ZH type=del size=1748157 2024-09-14T11:17:27.382 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.382+0000 7fe125ff88c0 1 < completed write operation key=N94D3R7IOBNL tag=EHIFVYNVQV8J type=write size=971497 2024-09-14T11:17:27.386 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.386+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=B6UNGBJG3ZHN type=write size=230889 2024-09-14T11:17:27.390 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.390+0000 7fe125ff88c0 1 < completed write operation key=SSNV25PDLDIS tag=L27GKQAB1IL8 type=write size=123823 2024-09-14T11:17:27.394 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.394+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=SOX2W8AX0IHF type=del size=886490 2024-09-14T11:17:27.399 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.398+0000 7fe125ff88c0 1 < completed part key=_multipart_L4XO0WTYKNXY.2~V367WE7E4CM8.0 size=788585 2024-09-14T11:17:27.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.406+0000 7fe125ff88c0 1 < completed multipart upload key=L4XO0WTYKNXY upload=V367WE7E4CM8 tag=3FAVCDL3XD9L type=write size=1837161 2024-09-14T11:17:27.412 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.410+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~INCOFHPKBD2G.0 size=1048576 2024-09-14T11:17:27.415 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.414+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~INCOFHPKBD2G.1 size=1048576 2024-09-14T11:17:27.418 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.418+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~INCOFHPKBD2G.2 size=218460 2024-09-14T11:17:27.418 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.418+0000 7fe125ff88c0 1 > prepared multipart upload key=3YGN50MBAF41 upload=INCOFHPKBD2G tag=OU6XEECTPMBB type=write size=3364188 2024-09-14T11:17:27.422 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.422+0000 7fe125ff88c0 1 < completed delete operation key=46ZTDBWFVSUH tag=M5X8PA56ENSU type=del 2024-09-14T11:17:27.426 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.426+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=WWKQW5QK4V29 type=write size=505986 2024-09-14T11:17:27.430 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.430+0000 7fe125ff88c0 1 < completed delete operation key=SUCH37O8V1LY tag=IE224Y6PIQPM type=del 2024-09-14T11:17:27.437 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.438+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~XZJ7OQM8602O.0 size=369391 2024-09-14T11:17:27.437 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.438+0000 7fe125ff88c0 1 > prepared multipart upload key=SSNV25PDLDIS upload=XZJ7OQM8602O tag=765XCK8GVNQD type=write size=1417967 2024-09-14T11:17:27.441 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.442+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~CEKLPL3NDL67.0 size=1048576 2024-09-14T11:17:27.445 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.446+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~CEKLPL3NDL67.1 size=554472 2024-09-14T11:17:27.451 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.450+0000 7fe125ff88c0 1 < completed multipart upload key=YGEVGH840L18 upload=CEKLPL3NDL67 tag=ASNEW4PCZC0P type=write size=2651624 2024-09-14T11:17:27.458 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.458+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~J91PGIZZRZDU.0 size=1048576 2024-09-14T11:17:27.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.462+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~J91PGIZZRZDU.1 size=1048576 2024-09-14T11:17:27.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.466+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~J91PGIZZRZDU.2 size=443406 2024-09-14T11:17:27.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.466+0000 7fe125ff88c0 1 > prepared multipart upload key=F9I82N7RQC81 upload=J91PGIZZRZDU tag=4S2L83516ICG type=write size=3589134 2024-09-14T11:17:27.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.470+0000 7fe125ff88c0 1 < completed delete operation key=6PLUU2QIO9LJ tag=ZT044V4ER6RI type=del 2024-09-14T11:17:27.479 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.478+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~NEATQHEK958O.0 size=1048576 2024-09-14T11:17:27.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.482+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~NEATQHEK958O.1 size=1048576 2024-09-14T11:17:27.485 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.486+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~NEATQHEK958O.2 size=207844 2024-09-14T11:17:27.485 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.486+0000 7fe125ff88c0 1 > prepared multipart upload key=0FITHLGQKQEC upload=NEATQHEK958O tag=OGUG06XL9GF3 type=write size=3353572 2024-09-14T11:17:27.489 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.490+0000 7fe125ff88c0 1 < completed delete operation key=2UXA6SXDTUFT tag=IGHZA0GSSMWV type=del 2024-09-14T11:17:27.492 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.494+0000 7fe125ff88c0 1 > prepared operation key=46ZTDBWFVSUH tag=LVL6HUFY5LKN type=del size=1473099 2024-09-14T11:17:27.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.494+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~RQDMU46MRDTE.0 size=1048576 2024-09-14T11:17:27.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.494+0000 7fe125ff88c0 1 < canceled part key=_multipart_0FITHLGQKQEC.2~RQDMU46MRDTE.1 size=390181 2024-09-14T11:17:27.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.502+0000 7fe125ff88c0 1 < canceled multipart upload key=0FITHLGQKQEC upload=RQDMU46MRDTE tag=ARXYK4A5V9CK type=write size=2487333 2024-09-14T11:17:27.505 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.506+0000 7fe125ff88c0 1 > prepared operation key=3OU4U9JF3ZD5 tag=RAF6438Q9YII type=del size=1399246 2024-09-14T11:17:27.509 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.510+0000 7fe125ff88c0 1 < completed delete operation key=N94D3R7IOBNL tag=25X3N6MNB4VV type=del 2024-09-14T11:17:27.515 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.514+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~1Y05GTO5AWWX.0 size=213006 2024-09-14T11:17:27.516 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.514+0000 7fe125ff88c0 1 > prepared multipart upload key=K05LARTJ2QZ3 upload=1Y05GTO5AWWX tag=KJIA1YSNV43J type=write size=1261582 2024-09-14T11:17:27.519 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.518+0000 7fe125ff88c0 1 < completed delete operation key=ESVFZQQXE3GT tag=O201JMNQR85K type=del 2024-09-14T11:17:27.523 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.522+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=7U3PSIOSLGVY type=write size=567829 2024-09-14T11:17:27.527 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.526+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~8RQDO3G3E1DP.0 size=1048576 2024-09-14T11:17:27.530 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.530+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~8RQDO3G3E1DP.1 size=1048576 2024-09-14T11:17:27.533 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.534+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~8RQDO3G3E1DP.2 size=179085 2024-09-14T11:17:27.539 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.538+0000 7fe125ff88c0 1 < completed multipart upload key=LYBGDNKUROWH upload=8RQDO3G3E1DP tag=IXLP7JTB0KGU type=write size=3324813 2024-09-14T11:17:27.543 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.542+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=GS9SXR59YN5L type=del size=3873518 2024-09-14T11:17:27.551 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.550+0000 7fe125ff88c0 1 < suggested remove operation key=V6B470G93KFT tag=S5SJ29G3UI4J type=del 2024-09-14T11:17:27.557 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.558+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~F6K34LGIEG5S.0 size=1048576 2024-09-14T11:17:27.560 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.562+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~F6K34LGIEG5S.1 size=1048576 2024-09-14T11:17:27.563 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.562+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~F6K34LGIEG5S.2 size=611365 2024-09-14T11:17:27.563 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.562+0000 7fe125ff88c0 1 > prepared multipart upload key=V6B470G93KFT upload=F6K34LGIEG5S tag=MKOEBMLUI7Y7 type=write size=3757093 2024-09-14T11:17:27.567 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.566+0000 7fe125ff88c0 1 < completed part key=_multipart_N94D3R7IOBNL.2~PJHU0PMQ71Z2.0 size=1048576 2024-09-14T11:17:27.570 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.570+0000 7fe125ff88c0 1 < completed part key=_multipart_N94D3R7IOBNL.2~PJHU0PMQ71Z2.1 size=650632 2024-09-14T11:17:27.577 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.578+0000 7fe125ff88c0 1 < completed multipart upload key=N94D3R7IOBNL upload=PJHU0PMQ71Z2 tag=1E2IWH1K47EF type=write size=2747784 2024-09-14T11:17:27.580 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.582+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=021NGIONUNBK type=del size=2868762 2024-09-14T11:17:27.584 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.582+0000 7fe125ff88c0 1 < completed delete operation key=SUCH37O8V1LY tag=BVSZR7JO74LS type=del 2024-09-14T11:17:27.588 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.586+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=QNVL8MAQ9QOP type=write size=147519 2024-09-14T11:17:27.592 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.590+0000 7fe125ff88c0 1 < completed delete operation key=F9I82N7RQC81 tag=JHHPBBF9Q7ZH type=del 2024-09-14T11:17:27.595 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.594+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=1WUEEWH0B39R type=del size=1026195 2024-09-14T11:17:27.599 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.598+0000 7fe125ff88c0 1 < canceled operation key=21HC4VMHXS6L tag=B6UNGBJG3ZHN type=write size=230889 2024-09-14T11:17:27.606 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.606+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~IJ0MGFCME6MZ.0 size=1048576 2024-09-14T11:17:27.609 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.610+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~IJ0MGFCME6MZ.1 size=1048576 2024-09-14T11:17:27.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.610+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~IJ0MGFCME6MZ.2 size=207710 2024-09-14T11:17:27.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.610+0000 7fe125ff88c0 1 > prepared multipart upload key=1ML6RIXI4C5P upload=IJ0MGFCME6MZ tag=N72JMHRY2W5L type=write size=3353438 2024-09-14T11:17:27.616 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.614+0000 7fe125ff88c0 1 < completed delete operation key=0VBX2FWYCFEZ tag=SOX2W8AX0IHF type=del 2024-09-14T11:17:27.620 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.622+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=V7KW9P0GFKKA type=del size=3684969 2024-09-14T11:17:27.624 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.622+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~INCOFHPKBD2G.0 size=1048576 2024-09-14T11:17:27.627 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.626+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~INCOFHPKBD2G.1 size=1048576 2024-09-14T11:17:27.630 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.630+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~INCOFHPKBD2G.2 size=218460 2024-09-14T11:17:27.637 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.638+0000 7fe125ff88c0 1 < completed multipart upload key=3YGN50MBAF41 upload=INCOFHPKBD2G tag=OU6XEECTPMBB type=write size=3364188 2024-09-14T11:17:27.641 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.642+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=RID4WP79I8Q0 type=del size=2727893 2024-09-14T11:17:27.644 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.646+0000 7fe125ff88c0 1 < completed write operation key=2UXA6SXDTUFT tag=WWKQW5QK4V29 type=write size=505986 2024-09-14T11:17:27.651 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.650+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~H49KJE691NNN.0 size=54114 2024-09-14T11:17:27.651 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.650+0000 7fe125ff88c0 1 > prepared multipart upload key=ESVFZQQXE3GT upload=H49KJE691NNN tag=XRK91PDTAP5T type=write size=1102690 2024-09-14T11:17:27.655 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.654+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~XZJ7OQM8602O.0 size=369391 2024-09-14T11:17:27.661 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.666+0000 7fe125ff88c0 1 < completed multipart upload key=SSNV25PDLDIS upload=XZJ7OQM8602O tag=765XCK8GVNQD type=write size=1417967 2024-09-14T11:17:27.665 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.666+0000 7fe125ff88c0 1 > prepared operation key=N80X3YUF4OEL tag=MO1KI7I5HZM6 type=write size=128065 2024-09-14T11:17:27.669 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.674+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~J91PGIZZRZDU.0 size=1048576 2024-09-14T11:17:27.672 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.674+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~J91PGIZZRZDU.1 size=1048576 2024-09-14T11:17:27.675 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.674+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~J91PGIZZRZDU.2 size=443406 2024-09-14T11:17:27.681 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.682+0000 7fe125ff88c0 1 < completed multipart upload key=F9I82N7RQC81 upload=J91PGIZZRZDU tag=4S2L83516ICG type=write size=3589134 2024-09-14T11:17:27.685 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.686+0000 7fe125ff88c0 1 > prepared operation key=46ZTDBWFVSUH tag=VRRAWGMKB671 type=del size=1072611 2024-09-14T11:17:27.689 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.690+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~NEATQHEK958O.0 size=1048576 2024-09-14T11:17:27.692 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.690+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~NEATQHEK958O.1 size=1048576 2024-09-14T11:17:27.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.694+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~NEATQHEK958O.2 size=207844 2024-09-14T11:17:27.701 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.702+0000 7fe125ff88c0 1 < completed multipart upload key=0FITHLGQKQEC upload=NEATQHEK958O tag=OGUG06XL9GF3 type=write size=3353572 2024-09-14T11:17:27.709 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.710+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~XA37DIRGHUXZ.0 size=1048576 2024-09-14T11:17:27.712 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.714+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~XA37DIRGHUXZ.1 size=631940 2024-09-14T11:17:27.712 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.714+0000 7fe125ff88c0 1 > prepared multipart upload key=FQ5WT12KB664 upload=XA37DIRGHUXZ tag=FNWS1DB02TSB type=write size=2729092 2024-09-14T11:17:27.716 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.718+0000 7fe125ff88c0 1 < completed delete operation key=46ZTDBWFVSUH tag=LVL6HUFY5LKN type=del 2024-09-14T11:17:27.724 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.722+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~FY5K0BWDXH98.0 size=1048576 2024-09-14T11:17:27.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.726+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~FY5K0BWDXH98.1 size=1048576 2024-09-14T11:17:27.731 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.730+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~FY5K0BWDXH98.2 size=1040836 2024-09-14T11:17:27.731 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.730+0000 7fe125ff88c0 1 > prepared multipart upload key=LYBGDNKUROWH upload=FY5K0BWDXH98 tag=I0GCUMWPMI26 type=write size=4186564 2024-09-14T11:17:27.740 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.738+0000 7fe125ff88c0 1 < suggested remove operation key=3OU4U9JF3ZD5 tag=RAF6438Q9YII type=del 2024-09-14T11:17:27.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.742+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=YZ167RRLPESB type=del size=2358506 2024-09-14T11:17:27.748 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.750+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~1Y05GTO5AWWX.0 size=213006 2024-09-14T11:17:27.755 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.754+0000 7fe125ff88c0 1 < completed multipart upload key=K05LARTJ2QZ3 upload=1Y05GTO5AWWX tag=KJIA1YSNV43J type=write size=1261582 2024-09-14T11:17:27.763 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.762+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~448R47N6LBSI.0 size=1048576 2024-09-14T11:17:27.766 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.766+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~448R47N6LBSI.1 size=164109 2024-09-14T11:17:27.766 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.766+0000 7fe125ff88c0 1 > prepared multipart upload key=N80X3YUF4OEL upload=448R47N6LBSI tag=UO2N810JN08Y type=write size=2261261 2024-09-14T11:17:27.771 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.770+0000 7fe125ff88c0 1 < completed write operation key=K3P6U6NU8I01 tag=7U3PSIOSLGVY type=write size=567829 2024-09-14T11:17:27.775 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.774+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=GORFRM2VX1HT type=del size=3669388 2024-09-14T11:17:27.779 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.778+0000 7fe125ff88c0 1 < completed delete operation key=F9I82N7RQC81 tag=GS9SXR59YN5L type=del 2024-09-14T11:17:27.784 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.782+0000 7fe125ff88c0 1 > prepared operation key=3OU4U9JF3ZD5 tag=ATX23U272SVS type=del size=3381662 2024-09-14T11:17:27.788 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.790+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~F6K34LGIEG5S.0 size=1048576 2024-09-14T11:17:27.788 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.790+0000 7fe125ff88c0 1 < canceled part key=_multipart_V6B470G93KFT.2~F6K34LGIEG5S.1 size=1048576 2024-09-14T11:17:27.788 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.790+0000 7fe125ff88c0 1 < canceled part key=_multipart_V6B470G93KFT.2~F6K34LGIEG5S.2 size=611365 2024-09-14T11:17:27.795 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.794+0000 7fe125ff88c0 1 < canceled multipart upload key=V6B470G93KFT upload=F6K34LGIEG5S tag=MKOEBMLUI7Y7 type=write size=3757093 2024-09-14T11:17:27.803 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.802+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~S772ETP9IUBI.0 size=1048576 2024-09-14T11:17:27.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.806+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~S772ETP9IUBI.1 size=1009778 2024-09-14T11:17:27.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.806+0000 7fe125ff88c0 1 > prepared multipart upload key=FQ5WT12KB664 upload=S772ETP9IUBI tag=F4BRQWCTABZO type=write size=3106930 2024-09-14T11:17:27.810 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.810+0000 7fe125ff88c0 1 < completed delete operation key=0VBX2FWYCFEZ tag=021NGIONUNBK type=del 2024-09-14T11:17:27.814 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.814+0000 7fe125ff88c0 1 > prepared operation key=FQ5WT12KB664 tag=DZTN7DM8J07N type=del size=60421 2024-09-14T11:17:27.818 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.818+0000 7fe125ff88c0 1 < completed write operation key=6PLUU2QIO9LJ tag=QNVL8MAQ9QOP type=write size=147519 2024-09-14T11:17:27.821 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.822+0000 7fe125ff88c0 1 > prepared operation key=YFRH8WECBTJK tag=PYDNTRT287F3 type=del size=1308092 2024-09-14T11:17:27.825 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.826+0000 7fe125ff88c0 1 < completed delete operation key=YGEVGH840L18 tag=1WUEEWH0B39R type=del 2024-09-14T11:17:27.834 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.838+0000 7fe125ff88c0 1 > prepared operation key=K05LARTJ2QZ3 tag=ZW4F0WY0H3ZK type=del size=1702742 2024-09-14T11:17:27.838 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.838+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~IJ0MGFCME6MZ.0 size=1048576 2024-09-14T11:17:27.841 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.842+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~IJ0MGFCME6MZ.1 size=1048576 2024-09-14T11:17:27.844 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.842+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~IJ0MGFCME6MZ.2 size=207710 2024-09-14T11:17:27.850 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.850+0000 7fe125ff88c0 1 < completed multipart upload key=1ML6RIXI4C5P upload=IJ0MGFCME6MZ tag=N72JMHRY2W5L type=write size=3353438 2024-09-14T11:17:27.854 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.854+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=J1FT47EO7FW3 type=del size=293540 2024-09-14T11:17:27.857 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.858+0000 7fe125ff88c0 1 < completed delete operation key=2KEKSWK0UT6C tag=V7KW9P0GFKKA type=del 2024-09-14T11:17:27.861 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.862+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=V4M8L0P10JSJ type=del size=833257 2024-09-14T11:17:27.865 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.866+0000 7fe125ff88c0 1 < completed delete operation key=6PLUU2QIO9LJ tag=RID4WP79I8Q0 type=del 2024-09-14T11:17:27.869 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.870+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=70NUGXH2RUMI type=del size=1805156 2024-09-14T11:17:27.873 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.874+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~H49KJE691NNN.0 size=54114 2024-09-14T11:17:27.879 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.878+0000 7fe125ff88c0 1 < completed multipart upload key=ESVFZQQXE3GT upload=H49KJE691NNN tag=XRK91PDTAP5T type=write size=1102690 2024-09-14T11:17:27.882 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.882+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=PM7P8PPV0W2M type=del size=4021845 2024-09-14T11:17:27.886 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.886+0000 7fe125ff88c0 1 < completed write operation key=N80X3YUF4OEL tag=MO1KI7I5HZM6 type=write size=128065 2024-09-14T11:17:27.891 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.890+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=UDH5RQWQF56B type=del size=429778 2024-09-14T11:17:27.895 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.894+0000 7fe125ff88c0 1 < completed delete operation key=46ZTDBWFVSUH tag=VRRAWGMKB671 type=del 2024-09-14T11:17:27.898 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.898+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=4ZN4JB2MW2CC type=del size=3526837 2024-09-14T11:17:27.902 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.902+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~XA37DIRGHUXZ.0 size=1048576 2024-09-14T11:17:27.905 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.906+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~XA37DIRGHUXZ.1 size=631940 2024-09-14T11:17:27.910 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.910+0000 7fe125ff88c0 1 < completed multipart upload key=FQ5WT12KB664 upload=XA37DIRGHUXZ tag=FNWS1DB02TSB type=write size=2729092 2024-09-14T11:17:27.914 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.914+0000 7fe125ff88c0 1 > prepared operation key=K05LARTJ2QZ3 tag=LGAXES7K56TV type=del size=3332784 2024-09-14T11:17:27.918 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.918+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~FY5K0BWDXH98.0 size=1048576 2024-09-14T11:17:27.921 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.922+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~FY5K0BWDXH98.1 size=1048576 2024-09-14T11:17:27.921 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.922+0000 7fe125ff88c0 1 < canceled part key=_multipart_LYBGDNKUROWH.2~FY5K0BWDXH98.2 size=1040836 2024-09-14T11:17:27.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.926+0000 7fe125ff88c0 1 < canceled multipart upload key=LYBGDNKUROWH upload=FY5K0BWDXH98 tag=I0GCUMWPMI26 type=write size=4186564 2024-09-14T11:17:27.935 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.934+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~QR2CNDFMVVA2.0 size=1048576 2024-09-14T11:17:27.937 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.938+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~QR2CNDFMVVA2.1 size=1048576 2024-09-14T11:17:27.940 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.938+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~QR2CNDFMVVA2.2 size=589788 2024-09-14T11:17:27.940 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.938+0000 7fe125ff88c0 1 > prepared multipart upload key=YN2HI39GPEDF upload=QR2CNDFMVVA2 tag=U92DV3N8N5H2 type=write size=3735516 2024-09-14T11:17:27.944 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.946+0000 7fe125ff88c0 1 < completed delete operation key=F9I82N7RQC81 tag=YZ167RRLPESB type=del 2024-09-14T11:17:27.948 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.950+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=767XNS6JIV8Y type=write size=570953 2024-09-14T11:17:27.952 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.954+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~448R47N6LBSI.0 size=1048576 2024-09-14T11:17:27.955 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.954+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~448R47N6LBSI.1 size=164109 2024-09-14T11:17:27.962 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.962+0000 7fe125ff88c0 1 < completed multipart upload key=N80X3YUF4OEL upload=448R47N6LBSI tag=UO2N810JN08Y type=write size=2261261 2024-09-14T11:17:27.965 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.966+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=DXGR6ORMNWRL type=write size=988060 2024-09-14T11:17:27.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.970+0000 7fe125ff88c0 1 < completed delete operation key=F9I82N7RQC81 tag=GORFRM2VX1HT type=del 2024-09-14T11:17:27.973 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.974+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=T8XGA0PSIYIB type=del size=602730 2024-09-14T11:17:27.977 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.978+0000 7fe125ff88c0 1 < completed delete operation key=3OU4U9JF3ZD5 tag=ATX23U272SVS type=del 2024-09-14T11:17:27.980 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.978+0000 7fe125ff88c0 1 > prepared operation key=0FITHLGQKQEC tag=UQP3703EGPK2 type=write size=465866 2024-09-14T11:17:27.984 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.986+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~S772ETP9IUBI.0 size=1048576 2024-09-14T11:17:27.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.986+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~S772ETP9IUBI.1 size=1009778 2024-09-14T11:17:27.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.994+0000 7fe125ff88c0 1 < completed multipart upload key=FQ5WT12KB664 upload=S772ETP9IUBI tag=F4BRQWCTABZO type=write size=3106930 2024-09-14T11:17:27.997 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:27.998+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=14QOWFJXD0AB type=del size=2866469 2024-09-14T11:17:28.002 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.002+0000 7fe125ff88c0 1 < completed delete operation key=FQ5WT12KB664 tag=DZTN7DM8J07N type=del 2024-09-14T11:17:28.008 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.006+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~S1V305TPGDYJ.0 size=1048576 2024-09-14T11:17:28.011 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.010+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~S1V305TPGDYJ.1 size=1048576 2024-09-14T11:17:28.013 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.014+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~S1V305TPGDYJ.2 size=771708 2024-09-14T11:17:28.013 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.014+0000 7fe125ff88c0 1 > prepared multipart upload key=YGEVGH840L18 upload=S1V305TPGDYJ tag=1BTCWU55J6UQ type=write size=3917436 2024-09-14T11:17:28.017 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.018+0000 7fe125ff88c0 1 < completed delete operation key=YFRH8WECBTJK tag=PYDNTRT287F3 type=del 2024-09-14T11:17:28.024 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.022+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~8MXONPOIQ1BF.0 size=14706 2024-09-14T11:17:28.024 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.022+0000 7fe125ff88c0 1 > prepared multipart upload key=FQ5WT12KB664 upload=8MXONPOIQ1BF tag=I7B47G03C9ZW type=write size=1063282 2024-09-14T11:17:28.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.026+0000 7fe125ff88c0 1 < completed delete operation key=K05LARTJ2QZ3 tag=ZW4F0WY0H3ZK type=del 2024-09-14T11:17:28.031 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.030+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=QC4T0K6NWH2A type=del size=626418 2024-09-14T11:17:28.038 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.038+0000 7fe125ff88c0 1 < suggested remove operation key=4D2X7151977X tag=J1FT47EO7FW3 type=del 2024-09-14T11:17:28.041 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.042+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=HDK4348DY8PD type=del size=2501223 2024-09-14T11:17:28.045 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.046+0000 7fe125ff88c0 1 < canceled operation key=L4XO0WTYKNXY tag=V4M8L0P10JSJ type=del size=833257 2024-09-14T11:17:28.050 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.050+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=0YKV83AO1FMU type=del size=1922063 2024-09-14T11:17:28.054 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.054+0000 7fe125ff88c0 1 < completed delete operation key=N94D3R7IOBNL tag=70NUGXH2RUMI type=del 2024-09-14T11:17:28.058 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.058+0000 7fe125ff88c0 1 > prepared operation key=N80X3YUF4OEL tag=TLAI19NI9H8X type=del size=1940294 2024-09-14T11:17:28.062 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.062+0000 7fe125ff88c0 1 < completed delete operation key=6PLUU2QIO9LJ tag=PM7P8PPV0W2M type=del 2024-09-14T11:17:28.066 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.066+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=QH88MHG5NA71 type=del size=4044408 2024-09-14T11:17:28.070 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.070+0000 7fe125ff88c0 1 < completed delete operation key=SSNV25PDLDIS tag=UDH5RQWQF56B type=del 2024-09-14T11:17:28.074 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.074+0000 7fe125ff88c0 1 > prepared operation key=46ZTDBWFVSUH tag=PV2N9Z3POFHN type=del size=1117592 2024-09-14T11:17:28.078 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.078+0000 7fe125ff88c0 1 < completed delete operation key=ESVFZQQXE3GT tag=4ZN4JB2MW2CC type=del 2024-09-14T11:17:28.082 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.082+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=N9MMJQPOI5NB type=del size=1811259 2024-09-14T11:17:28.086 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.086+0000 7fe125ff88c0 1 < completed delete operation key=K05LARTJ2QZ3 tag=LGAXES7K56TV type=del 2024-09-14T11:17:28.089 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.090+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=93XT3V0HGYG5 type=del size=902184 2024-09-14T11:17:28.090 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.090+0000 7fe125ff88c0 1 < canceled part key=_multipart_YN2HI39GPEDF.2~QR2CNDFMVVA2.0 size=1048576 2024-09-14T11:17:28.093 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.094+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~QR2CNDFMVVA2.1 size=1048576 2024-09-14T11:17:28.096 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.094+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~QR2CNDFMVVA2.2 size=589788 2024-09-14T11:17:28.103 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.102+0000 7fe125ff88c0 1 < canceled multipart upload key=YN2HI39GPEDF upload=QR2CNDFMVVA2 tag=U92DV3N8N5H2 type=write size=3735516 2024-09-14T11:17:28.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.110+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~BVBSGWZYYY5O.0 size=1048576 2024-09-14T11:17:28.113 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.114+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~BVBSGWZYYY5O.1 size=382099 2024-09-14T11:17:28.113 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.114+0000 7fe125ff88c0 1 > prepared multipart upload key=W0B19NBHNLMZ upload=BVBSGWZYYY5O tag=INZUFDB1YKF1 type=write size=2479251 2024-09-14T11:17:28.120 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.118+0000 7fe125ff88c0 1 < suggested remove operation key=V6B470G93KFT tag=767XNS6JIV8Y type=write 2024-09-14T11:17:28.124 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.122+0000 7fe125ff88c0 1 > prepared operation key=1ML6RIXI4C5P tag=THUGKD5FIXBX type=del size=1084464 2024-09-14T11:17:28.128 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.126+0000 7fe125ff88c0 1 < canceled operation key=6PLUU2QIO9LJ tag=DXGR6ORMNWRL type=write size=988060 2024-09-14T11:17:28.133 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.134+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=BF00DRKXZ8ZS type=del size=1121368 2024-09-14T11:17:28.137 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.138+0000 7fe125ff88c0 1 < completed delete operation key=ESVFZQQXE3GT tag=T8XGA0PSIYIB type=del 2024-09-14T11:17:28.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.146+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~82YKWZLKV170.0 size=1048576 2024-09-14T11:17:28.148 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.150+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~82YKWZLKV170.1 size=1048576 2024-09-14T11:17:28.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.150+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~82YKWZLKV170.2 size=790229 2024-09-14T11:17:28.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.150+0000 7fe125ff88c0 1 > prepared multipart upload key=V6B470G93KFT upload=82YKWZLKV170 tag=QQ1JIBUZQ9L2 type=write size=3935957 2024-09-14T11:17:28.155 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.154+0000 7fe125ff88c0 1 < completed write operation key=0FITHLGQKQEC tag=UQP3703EGPK2 type=write size=465866 2024-09-14T11:17:28.159 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.158+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=I0C49LZZJ92D type=del size=2577850 2024-09-14T11:17:28.163 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.162+0000 7fe125ff88c0 1 < completed delete operation key=SSNV25PDLDIS tag=14QOWFJXD0AB type=del 2024-09-14T11:17:28.166 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.166+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=4YK3M3AEZQ47 type=del size=2343476 2024-09-14T11:17:28.170 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.170+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~S1V305TPGDYJ.0 size=1048576 2024-09-14T11:17:28.173 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.178+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~S1V305TPGDYJ.1 size=1048576 2024-09-14T11:17:28.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.178+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~S1V305TPGDYJ.2 size=771708 2024-09-14T11:17:28.182 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.182+0000 7fe125ff88c0 1 < completed multipart upload key=YGEVGH840L18 upload=S1V305TPGDYJ tag=1BTCWU55J6UQ type=write size=3917436 2024-09-14T11:17:28.185 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.186+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=0BP6AGV36YA8 type=del size=3176722 2024-09-14T11:17:28.193 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.198+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~8MXONPOIQ1BF.0 size=14706 2024-09-14T11:17:28.201 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.202+0000 7fe125ff88c0 1 < completed multipart upload key=FQ5WT12KB664 upload=8MXONPOIQ1BF tag=I7B47G03C9ZW type=write size=1063282 2024-09-14T11:17:28.204 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.206+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=6BJ76IW0TQMH type=write size=171393 2024-09-14T11:17:28.208 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.210+0000 7fe125ff88c0 1 < completed delete operation key=YGEVGH840L18 tag=QC4T0K6NWH2A type=del 2024-09-14T11:17:28.212 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.210+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=NHZVZ8SO5Y1U type=del size=1999688 2024-09-14T11:17:28.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.222+0000 7fe125ff88c0 1 < suggested remove operation key=35EB6U5O4A51 tag=HDK4348DY8PD type=del 2024-09-14T11:17:28.224 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.222+0000 7fe125ff88c0 1 > prepared operation key=6C3JZKTB8BP3 tag=JAIPS5XK7477 type=write size=635127 2024-09-14T11:17:28.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.230+0000 7fe125ff88c0 1 < canceled operation key=SSNV25PDLDIS tag=0YKV83AO1FMU type=del size=1922063 2024-09-14T11:17:28.232 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.230+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=KF49RMCE05KQ type=del size=3060770 2024-09-14T11:17:28.236 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.234+0000 7fe125ff88c0 1 < completed delete operation key=N80X3YUF4OEL tag=TLAI19NI9H8X type=del 2024-09-14T11:17:28.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.242+0000 7fe125ff88c0 1 > prepared part key=_multipart_WEA3MQ0DI42N.2~9H8KXJ23SALP.0 size=1023057 2024-09-14T11:17:28.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.242+0000 7fe125ff88c0 1 > prepared multipart upload key=WEA3MQ0DI42N upload=9H8KXJ23SALP tag=3BWAIL551WK4 type=write size=2071633 2024-09-14T11:17:28.247 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.246+0000 7fe125ff88c0 1 < canceled operation key=SSNV25PDLDIS tag=QH88MHG5NA71 type=del size=4044408 2024-09-14T11:17:28.251 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.250+0000 7fe125ff88c0 1 > prepared operation key=0FITHLGQKQEC tag=LYRESB7V12UC type=write size=822583 2024-09-14T11:17:28.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.254+0000 7fe125ff88c0 1 < completed delete operation key=46ZTDBWFVSUH tag=PV2N9Z3POFHN type=del 2024-09-14T11:17:28.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.258+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=YJAZSKPJ8ZTS type=del size=2310011 2024-09-14T11:17:28.262 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.262+0000 7fe125ff88c0 1 < completed delete operation key=SSNV25PDLDIS tag=N9MMJQPOI5NB type=del 2024-09-14T11:17:28.266 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.266+0000 7fe125ff88c0 1 > prepared operation key=6C3JZKTB8BP3 tag=FENT1JBTYSMO type=del size=3102259 2024-09-14T11:17:28.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.270+0000 7fe125ff88c0 1 < completed delete operation key=YCF2PCJ9TZMR tag=93XT3V0HGYG5 type=del 2024-09-14T11:17:28.274 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.274+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=PWEG1KGB4G2H type=del size=2367873 2024-09-14T11:17:28.277 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.278+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~BVBSGWZYYY5O.0 size=1048576 2024-09-14T11:17:28.280 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.278+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~BVBSGWZYYY5O.1 size=382099 2024-09-14T11:17:28.286 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.286+0000 7fe125ff88c0 1 < completed multipart upload key=W0B19NBHNLMZ upload=BVBSGWZYYY5O tag=INZUFDB1YKF1 type=write size=2479251 2024-09-14T11:17:28.289 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.290+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=SSEE29XIE36Z type=del size=1891818 2024-09-14T11:17:28.293 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.294+0000 7fe125ff88c0 1 < completed delete operation key=1ML6RIXI4C5P tag=THUGKD5FIXBX type=del 2024-09-14T11:17:28.300 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.298+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~OUJ04G6L6R9Q.0 size=1048576 2024-09-14T11:17:28.303 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.302+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~OUJ04G6L6R9Q.1 size=662555 2024-09-14T11:17:28.303 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.302+0000 7fe125ff88c0 1 > prepared multipart upload key=3YGN50MBAF41 upload=OUJ04G6L6R9Q tag=SOU556B1QQF1 type=write size=2759707 2024-09-14T11:17:28.307 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.306+0000 7fe125ff88c0 1 < completed delete operation key=SSNV25PDLDIS tag=BF00DRKXZ8ZS type=del 2024-09-14T11:17:28.314 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.314+0000 7fe125ff88c0 1 > prepared part key=_multipart_WEA3MQ0DI42N.2~TJFDWPR2627C.0 size=1048576 2024-09-14T11:17:28.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.318+0000 7fe125ff88c0 1 > prepared part key=_multipart_WEA3MQ0DI42N.2~TJFDWPR2627C.1 size=422917 2024-09-14T11:17:28.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.318+0000 7fe125ff88c0 1 > prepared multipart upload key=WEA3MQ0DI42N upload=TJFDWPR2627C tag=3Y1A350HLVEC type=write size=2520069 2024-09-14T11:17:28.322 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.322+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~82YKWZLKV170.0 size=1048576 2024-09-14T11:17:28.324 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.326+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~82YKWZLKV170.1 size=1048576 2024-09-14T11:17:28.327 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.326+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~82YKWZLKV170.2 size=790229 2024-09-14T11:17:28.334 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.334+0000 7fe125ff88c0 1 < completed multipart upload key=V6B470G93KFT upload=82YKWZLKV170 tag=QQ1JIBUZQ9L2 type=write size=3935957 2024-09-14T11:17:28.340 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.338+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~86AY69RBS34Z.0 size=1048576 2024-09-14T11:17:28.343 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.342+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~86AY69RBS34Z.1 size=497648 2024-09-14T11:17:28.343 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.342+0000 7fe125ff88c0 1 > prepared multipart upload key=46ZTDBWFVSUH upload=86AY69RBS34Z tag=30O6PAEJ0KCC type=write size=2594800 2024-09-14T11:17:28.346 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.346+0000 7fe125ff88c0 1 < completed delete operation key=21HC4VMHXS6L tag=I0C49LZZJ92D type=del 2024-09-14T11:17:28.353 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.354+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~6EYFDXHKDB7V.0 size=752601 2024-09-14T11:17:28.353 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.354+0000 7fe125ff88c0 1 > prepared multipart upload key=21HC4VMHXS6L upload=6EYFDXHKDB7V tag=AYPZNDYW8AQP type=write size=1801177 2024-09-14T11:17:28.356 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.358+0000 7fe125ff88c0 1 < completed delete operation key=N94D3R7IOBNL tag=4YK3M3AEZQ47 type=del 2024-09-14T11:17:28.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.362+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~OX07A05XL29R.0 size=1048576 2024-09-14T11:17:28.365 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.366+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~OX07A05XL29R.1 size=454431 2024-09-14T11:17:28.365 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.366+0000 7fe125ff88c0 1 > prepared multipart upload key=SSNV25PDLDIS upload=OX07A05XL29R tag=78F4GIZVPPES type=write size=2551583 2024-09-14T11:17:28.369 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.370+0000 7fe125ff88c0 1 < completed delete operation key=K3P6U6NU8I01 tag=0BP6AGV36YA8 type=del 2024-09-14T11:17:28.376 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.378+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~AV5M0K3WO3BT.0 size=1048576 2024-09-14T11:17:28.379 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.378+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~AV5M0K3WO3BT.1 size=1048576 2024-09-14T11:17:28.382 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.382+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~AV5M0K3WO3BT.2 size=538675 2024-09-14T11:17:28.382 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.382+0000 7fe125ff88c0 1 > prepared multipart upload key=0VBX2FWYCFEZ upload=AV5M0K3WO3BT tag=TL9IHDJZFNS0 type=write size=3684403 2024-09-14T11:17:28.386 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.386+0000 7fe125ff88c0 1 < completed write operation key=21HC4VMHXS6L tag=6BJ76IW0TQMH type=write size=171393 2024-09-14T11:17:28.393 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.394+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~Z779B7F1S6DP.0 size=830213 2024-09-14T11:17:28.393 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.394+0000 7fe125ff88c0 1 > prepared multipart upload key=0FITHLGQKQEC upload=Z779B7F1S6DP tag=SKTUY75M3EUR type=write size=1878789 2024-09-14T11:17:28.398 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.398+0000 7fe125ff88c0 1 < completed delete operation key=4D2X7151977X tag=NHZVZ8SO5Y1U type=del 2024-09-14T11:17:28.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.406+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~KPCQLIA01N3E.0 size=227406 2024-09-14T11:17:28.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.406+0000 7fe125ff88c0 1 > prepared multipart upload key=SUCH37O8V1LY upload=KPCQLIA01N3E tag=68GE0IPSEX9Y type=write size=1275982 2024-09-14T11:17:28.409 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.410+0000 7fe125ff88c0 1 < canceled operation key=6C3JZKTB8BP3 tag=JAIPS5XK7477 type=write size=635127 2024-09-14T11:17:28.413 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.414+0000 7fe125ff88c0 1 > prepared operation key=46ZTDBWFVSUH tag=KRZ0B6S03BGH type=del size=1526775 2024-09-14T11:17:28.417 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.418+0000 7fe125ff88c0 1 < completed delete operation key=0VBX2FWYCFEZ tag=KF49RMCE05KQ type=del 2024-09-14T11:17:28.424 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.426+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~3QFC94HZ3UCT.0 size=713023 2024-09-14T11:17:28.424 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.426+0000 7fe125ff88c0 1 > prepared multipart upload key=YN2HI39GPEDF upload=3QFC94HZ3UCT tag=3UCUSFYBSZI3 type=write size=1761599 2024-09-14T11:17:28.428 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.430+0000 7fe125ff88c0 1 < completed part key=_multipart_WEA3MQ0DI42N.2~9H8KXJ23SALP.0 size=1023057 2024-09-14T11:17:28.434 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.434+0000 7fe125ff88c0 1 < completed multipart upload key=WEA3MQ0DI42N upload=9H8KXJ23SALP tag=3BWAIL551WK4 type=write size=2071633 2024-09-14T11:17:28.438 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.438+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=WY4ICMXKE8GF type=del size=1736891 2024-09-14T11:17:28.442 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.442+0000 7fe125ff88c0 1 < completed write operation key=0FITHLGQKQEC tag=LYRESB7V12UC type=write size=822583 2024-09-14T11:17:28.449 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.450+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~AR4YPMCXA8OI.0 size=1048576 2024-09-14T11:17:28.452 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.450+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~AR4YPMCXA8OI.1 size=484335 2024-09-14T11:17:28.452 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.450+0000 7fe125ff88c0 1 > prepared multipart upload key=3YGN50MBAF41 upload=AR4YPMCXA8OI tag=KWH6ZOR046AB type=write size=2581487 2024-09-14T11:17:28.455 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.454+0000 7fe125ff88c0 1 < canceled operation key=K3P6U6NU8I01 tag=YJAZSKPJ8ZTS type=del size=2310011 2024-09-14T11:17:28.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.458+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=T4LW00T0EB5J type=write size=289050 2024-09-14T11:17:28.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.462+0000 7fe125ff88c0 1 < completed delete operation key=6C3JZKTB8BP3 tag=FENT1JBTYSMO type=del 2024-09-14T11:17:28.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.466+0000 7fe125ff88c0 1 > prepared operation key=YFRH8WECBTJK tag=4Y1B7X6YLBQJ type=del size=3871173 2024-09-14T11:17:28.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.470+0000 7fe125ff88c0 1 < completed delete operation key=35EB6U5O4A51 tag=PWEG1KGB4G2H type=del 2024-09-14T11:17:28.475 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.474+0000 7fe125ff88c0 1 > prepared operation key=FQ5WT12KB664 tag=QNZ50K57BBD2 type=del size=1823015 2024-09-14T11:17:28.479 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.478+0000 7fe125ff88c0 1 < completed delete operation key=K3P6U6NU8I01 tag=SSEE29XIE36Z type=del 2024-09-14T11:17:28.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.482+0000 7fe125ff88c0 1 > prepared operation key=K05LARTJ2QZ3 tag=DB1PNJWTG7WK type=write size=262009 2024-09-14T11:17:28.486 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.486+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~OUJ04G6L6R9Q.0 size=1048576 2024-09-14T11:17:28.489 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.490+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~OUJ04G6L6R9Q.1 size=662555 2024-09-14T11:17:28.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.494+0000 7fe125ff88c0 1 < completed multipart upload key=3YGN50MBAF41 upload=OUJ04G6L6R9Q tag=SOU556B1QQF1 type=write size=2759707 2024-09-14T11:17:28.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.502+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~CXWV0YBHA0SP.0 size=1048576 2024-09-14T11:17:28.504 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.506+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~CXWV0YBHA0SP.1 size=1048576 2024-09-14T11:17:28.507 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.506+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~CXWV0YBHA0SP.2 size=367903 2024-09-14T11:17:28.507 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.506+0000 7fe125ff88c0 1 > prepared multipart upload key=FQ5WT12KB664 upload=CXWV0YBHA0SP tag=5Q0MHQ5GPGMC type=write size=3513631 2024-09-14T11:17:28.511 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.510+0000 7fe125ff88c0 1 < completed part key=_multipart_WEA3MQ0DI42N.2~TJFDWPR2627C.0 size=1048576 2024-09-14T11:17:28.514 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.514+0000 7fe125ff88c0 1 < completed part key=_multipart_WEA3MQ0DI42N.2~TJFDWPR2627C.1 size=422917 2024-09-14T11:17:28.519 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.518+0000 7fe125ff88c0 1 < completed multipart upload key=WEA3MQ0DI42N upload=TJFDWPR2627C tag=3Y1A350HLVEC type=write size=2520069 2024-09-14T11:17:28.523 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.522+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=2G9EARF2E6M9 type=write size=567874 2024-09-14T11:17:28.524 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.526+0000 7fe125ff88c0 1 < canceled part key=_multipart_46ZTDBWFVSUH.2~86AY69RBS34Z.0 size=1048576 2024-09-14T11:17:28.527 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.526+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~86AY69RBS34Z.1 size=497648 2024-09-14T11:17:28.533 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.534+0000 7fe125ff88c0 1 < canceled multipart upload key=46ZTDBWFVSUH upload=86AY69RBS34Z tag=30O6PAEJ0KCC type=write size=2594800 2024-09-14T11:17:28.537 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.538+0000 7fe125ff88c0 1 > prepared operation key=K05LARTJ2QZ3 tag=Y8JAP6BVN4QO type=write size=231034 2024-09-14T11:17:28.541 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.542+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~6EYFDXHKDB7V.0 size=752601 2024-09-14T11:17:28.551 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.550+0000 7fe125ff88c0 1 < completed multipart upload key=21HC4VMHXS6L upload=6EYFDXHKDB7V tag=AYPZNDYW8AQP type=write size=1801177 2024-09-14T11:17:28.554 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.554+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=YJ18W1LSJAF4 type=del size=3081571 2024-09-14T11:17:28.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.554+0000 7fe125ff88c0 1 < canceled part key=_multipart_SSNV25PDLDIS.2~OX07A05XL29R.0 size=1048576 2024-09-14T11:17:28.558 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.558+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~OX07A05XL29R.1 size=454431 2024-09-14T11:17:28.564 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.562+0000 7fe125ff88c0 1 < canceled multipart upload key=SSNV25PDLDIS upload=OX07A05XL29R tag=78F4GIZVPPES type=write size=2551583 2024-09-14T11:17:28.571 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.570+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~R4YLXNI6ZS5R.0 size=1048576 2024-09-14T11:17:28.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.574+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~R4YLXNI6ZS5R.1 size=1048576 2024-09-14T11:17:28.576 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.578+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~R4YLXNI6ZS5R.2 size=46312 2024-09-14T11:17:28.577 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.578+0000 7fe125ff88c0 1 > prepared multipart upload key=F9I82N7RQC81 upload=R4YLXNI6ZS5R tag=QOHQUN6S1G75 type=write size=3192040 2024-09-14T11:17:28.580 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.582+0000 7fe125ff88c0 1 < completed part key=_multipart_0VBX2FWYCFEZ.2~AV5M0K3WO3BT.0 size=1048576 2024-09-14T11:17:28.583 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.582+0000 7fe125ff88c0 1 < completed part key=_multipart_0VBX2FWYCFEZ.2~AV5M0K3WO3BT.1 size=1048576 2024-09-14T11:17:28.586 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.586+0000 7fe125ff88c0 1 < completed part key=_multipart_0VBX2FWYCFEZ.2~AV5M0K3WO3BT.2 size=538675 2024-09-14T11:17:28.592 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.590+0000 7fe125ff88c0 1 < completed multipart upload key=0VBX2FWYCFEZ upload=AV5M0K3WO3BT tag=TL9IHDJZFNS0 type=write size=3684403 2024-09-14T11:17:28.597 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.598+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~OLSH42KTU0R8.0 size=1048576 2024-09-14T11:17:28.601 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.602+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~OLSH42KTU0R8.1 size=1048576 2024-09-14T11:17:28.604 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.602+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~OLSH42KTU0R8.2 size=63093 2024-09-14T11:17:28.604 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.602+0000 7fe125ff88c0 1 > prepared multipart upload key=ESVFZQQXE3GT upload=OLSH42KTU0R8 tag=SIIHS188SOWL type=write size=3208821 2024-09-14T11:17:28.607 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.606+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~Z779B7F1S6DP.0 size=830213 2024-09-14T11:17:28.613 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.614+0000 7fe125ff88c0 1 < completed multipart upload key=0FITHLGQKQEC upload=Z779B7F1S6DP tag=SKTUY75M3EUR type=write size=1878789 2024-09-14T11:17:28.619 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.618+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~T2JLMVIR0OHJ.0 size=129124 2024-09-14T11:17:28.619 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.618+0000 7fe125ff88c0 1 > prepared multipart upload key=ESVFZQQXE3GT upload=T2JLMVIR0OHJ tag=WOFKCVQM45TP type=write size=1177700 2024-09-14T11:17:28.623 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.622+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~KPCQLIA01N3E.0 size=227406 2024-09-14T11:17:28.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.630+0000 7fe125ff88c0 1 < completed multipart upload key=SUCH37O8V1LY upload=KPCQLIA01N3E tag=68GE0IPSEX9Y type=write size=1275982 2024-09-14T11:17:28.633 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.634+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=RG6P9I7JX3B3 type=del size=383976 2024-09-14T11:17:28.637 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.638+0000 7fe125ff88c0 1 < completed delete operation key=46ZTDBWFVSUH tag=KRZ0B6S03BGH type=del 2024-09-14T11:17:28.640 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.642+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=HCSKJH6IBXKL type=write size=693502 2024-09-14T11:17:28.644 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.642+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~3QFC94HZ3UCT.0 size=713023 2024-09-14T11:17:28.650 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.650+0000 7fe125ff88c0 1 < completed multipart upload key=YN2HI39GPEDF upload=3QFC94HZ3UCT tag=3UCUSFYBSZI3 type=write size=1761599 2024-09-14T11:17:28.654 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.654+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=00P3W2QZ8L33 type=del size=2169627 2024-09-14T11:17:28.658 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.658+0000 7fe125ff88c0 1 < completed delete operation key=N94D3R7IOBNL tag=WY4ICMXKE8GF type=del 2024-09-14T11:17:28.661 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.662+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=QQ1Z9A1JN6LW type=del size=3641310 2024-09-14T11:17:28.665 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.666+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~AR4YPMCXA8OI.0 size=1048576 2024-09-14T11:17:28.667 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.666+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~AR4YPMCXA8OI.1 size=484335 2024-09-14T11:17:28.673 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.674+0000 7fe125ff88c0 1 < completed multipart upload key=3YGN50MBAF41 upload=AR4YPMCXA8OI tag=KWH6ZOR046AB type=write size=2581487 2024-09-14T11:17:28.676 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.674+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=DKX0A863004V type=del size=646619 2024-09-14T11:17:28.680 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.678+0000 7fe125ff88c0 1 < canceled operation key=YCF2PCJ9TZMR tag=T4LW00T0EB5J type=write size=289050 2024-09-14T11:17:28.686 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.686+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~ZVMER06CYID3.0 size=1048576 2024-09-14T11:17:28.689 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.690+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~ZVMER06CYID3.1 size=1048576 2024-09-14T11:17:28.692 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.690+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~ZVMER06CYID3.2 size=720111 2024-09-14T11:17:28.692 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.690+0000 7fe125ff88c0 1 > prepared multipart upload key=ESVFZQQXE3GT upload=ZVMER06CYID3 tag=CAV3Y8BNA7E5 type=write size=3865839 2024-09-14T11:17:28.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.694+0000 7fe125ff88c0 1 < completed delete operation key=YFRH8WECBTJK tag=4Y1B7X6YLBQJ type=del 2024-09-14T11:17:28.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.698+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=57ZE08C4J3NH type=write size=294436 2024-09-14T11:17:28.703 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.702+0000 7fe125ff88c0 1 < completed delete operation key=FQ5WT12KB664 tag=QNZ50K57BBD2 type=del 2024-09-14T11:17:28.707 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.706+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=IGA7NTEFEVX9 type=write size=801228 2024-09-14T11:17:28.710 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.710+0000 7fe125ff88c0 1 < completed write operation key=K05LARTJ2QZ3 tag=DB1PNJWTG7WK type=write size=262009 2024-09-14T11:17:28.714 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.714+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=IXUPJQHT3PMA type=write size=979851 2024-09-14T11:17:28.718 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.718+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~CXWV0YBHA0SP.0 size=1048576 2024-09-14T11:17:28.721 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.722+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~CXWV0YBHA0SP.1 size=1048576 2024-09-14T11:17:28.724 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.722+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~CXWV0YBHA0SP.2 size=367903 2024-09-14T11:17:28.730 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.730+0000 7fe125ff88c0 1 < completed multipart upload key=FQ5WT12KB664 upload=CXWV0YBHA0SP tag=5Q0MHQ5GPGMC type=write size=3513631 2024-09-14T11:17:28.734 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.734+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=5PV78L4UXRQ5 type=del size=1732355 2024-09-14T11:17:28.741 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.742+0000 7fe125ff88c0 1 < suggested update operation key=2LH5U05C2F8C tag=2G9EARF2E6M9 type=write size=567874 2024-09-14T11:17:28.748 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.746+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~C4B8981GD2NC.0 size=1048576 2024-09-14T11:17:28.751 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.750+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~C4B8981GD2NC.1 size=1048576 2024-09-14T11:17:28.754 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.754+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~C4B8981GD2NC.2 size=929386 2024-09-14T11:17:28.754 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.754+0000 7fe125ff88c0 1 > prepared multipart upload key=3YGN50MBAF41 upload=C4B8981GD2NC tag=BIK8Q9SUNSAR type=write size=4075114 2024-09-14T11:17:28.758 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.758+0000 7fe125ff88c0 1 < completed write operation key=K05LARTJ2QZ3 tag=Y8JAP6BVN4QO type=write size=231034 2024-09-14T11:17:28.762 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.762+0000 7fe125ff88c0 1 > prepared operation key=6C3JZKTB8BP3 tag=O7G84E4NKN20 type=del size=1660726 2024-09-14T11:17:28.765 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.766+0000 7fe125ff88c0 1 < completed delete operation key=YCF2PCJ9TZMR tag=YJ18W1LSJAF4 type=del 2024-09-14T11:17:28.772 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.770+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~0X6Z61JK4C68.0 size=965873 2024-09-14T11:17:28.772 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.770+0000 7fe125ff88c0 1 > prepared multipart upload key=N80X3YUF4OEL upload=0X6Z61JK4C68 tag=SEN7JBQVN8GA type=write size=2014449 2024-09-14T11:17:28.776 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.774+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~R4YLXNI6ZS5R.0 size=1048576 2024-09-14T11:17:28.779 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.778+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~R4YLXNI6ZS5R.1 size=1048576 2024-09-14T11:17:28.782 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.782+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~R4YLXNI6ZS5R.2 size=46312 2024-09-14T11:17:28.788 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.786+0000 7fe125ff88c0 1 < completed multipart upload key=F9I82N7RQC81 upload=R4YLXNI6ZS5R tag=QOHQUN6S1G75 type=write size=3192040 2024-09-14T11:17:28.792 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.794+0000 7fe125ff88c0 1 > prepared operation key=YFRH8WECBTJK tag=6TBI5J9PVE64 type=del size=634281 2024-09-14T11:17:28.796 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.794+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~OLSH42KTU0R8.0 size=1048576 2024-09-14T11:17:28.799 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.798+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~OLSH42KTU0R8.1 size=1048576 2024-09-14T11:17:28.800 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.798+0000 7fe125ff88c0 1 < canceled part key=_multipart_ESVFZQQXE3GT.2~OLSH42KTU0R8.2 size=63093 2024-09-14T11:17:28.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.806+0000 7fe125ff88c0 1 < canceled multipart upload key=ESVFZQQXE3GT upload=OLSH42KTU0R8 tag=SIIHS188SOWL type=write size=3208821 2024-09-14T11:17:28.810 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.810+0000 7fe125ff88c0 1 > prepared operation key=3OU4U9JF3ZD5 tag=DBFTL6E3T25C type=del size=1929212 2024-09-14T11:17:28.814 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.814+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~T2JLMVIR0OHJ.0 size=129124 2024-09-14T11:17:28.820 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.822+0000 7fe125ff88c0 1 < completed multipart upload key=ESVFZQQXE3GT upload=T2JLMVIR0OHJ tag=WOFKCVQM45TP type=write size=1177700 2024-09-14T11:17:28.828 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.826+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~GYXIHD2091AB.0 size=162192 2024-09-14T11:17:28.828 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.826+0000 7fe125ff88c0 1 > prepared multipart upload key=SSNV25PDLDIS upload=GYXIHD2091AB tag=JL3IN8MAX2PW type=write size=1210768 2024-09-14T11:17:28.835 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.834+0000 7fe125ff88c0 1 < suggested update operation key=2KEKSWK0UT6C tag=RG6P9I7JX3B3 type=del size=383976 2024-09-14T11:17:28.839 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.838+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=1Z9RYHKC46RU type=del size=1061422 2024-09-14T11:17:28.842 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.842+0000 7fe125ff88c0 1 < completed write operation key=21HC4VMHXS6L tag=HCSKJH6IBXKL type=write size=693502 2024-09-14T11:17:28.849 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.850+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~UVUYM06IZ0TW.0 size=1048576 2024-09-14T11:17:28.852 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.850+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~UVUYM06IZ0TW.1 size=1048576 2024-09-14T11:17:28.854 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.854+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~UVUYM06IZ0TW.2 size=695168 2024-09-14T11:17:28.855 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.854+0000 7fe125ff88c0 1 > prepared multipart upload key=K05LARTJ2QZ3 upload=UVUYM06IZ0TW tag=R3XVG48214YE type=write size=3840896 2024-09-14T11:17:28.859 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.858+0000 7fe125ff88c0 1 < completed delete operation key=WEA3MQ0DI42N tag=00P3W2QZ8L33 type=del 2024-09-14T11:17:28.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.862+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=LLFGTIBBMDSZ type=write size=664981 2024-09-14T11:17:28.866 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.866+0000 7fe125ff88c0 1 < completed delete operation key=N94D3R7IOBNL tag=QQ1Z9A1JN6LW type=del 2024-09-14T11:17:28.870 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.870+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=RMLK1IOLKF7G type=write size=963956 2024-09-14T11:17:28.877 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.878+0000 7fe125ff88c0 1 < suggested update operation key=K3P6U6NU8I01 tag=DKX0A863004V type=del size=646619 2024-09-14T11:17:28.881 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.882+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=227KCWHOTU0Z type=del size=1649438 2024-09-14T11:17:28.889 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.890+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~ZVMER06CYID3.0 size=1048576 2024-09-14T11:17:28.892 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.890+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~ZVMER06CYID3.1 size=1048576 2024-09-14T11:17:28.895 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.894+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~ZVMER06CYID3.2 size=720111 2024-09-14T11:17:28.902 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.902+0000 7fe125ff88c0 1 < completed multipart upload key=ESVFZQQXE3GT upload=ZVMER06CYID3 tag=CAV3Y8BNA7E5 type=write size=3865839 2024-09-14T11:17:28.908 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.906+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~YCK4BMZ9KF00.0 size=700576 2024-09-14T11:17:28.908 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.906+0000 7fe125ff88c0 1 > prepared multipart upload key=SSNV25PDLDIS upload=YCK4BMZ9KF00 tag=EISS49YDTUQJ type=write size=1749152 2024-09-14T11:17:28.912 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.910+0000 7fe125ff88c0 1 < completed write operation key=YGEVGH840L18 tag=57ZE08C4J3NH type=write size=294436 2024-09-14T11:17:28.918 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.918+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~J0SJFYI5KGJW.0 size=1048576 2024-09-14T11:17:28.921 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.922+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~J0SJFYI5KGJW.1 size=1048576 2024-09-14T11:17:28.923 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.922+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~J0SJFYI5KGJW.2 size=270456 2024-09-14T11:17:28.923 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.922+0000 7fe125ff88c0 1 > prepared multipart upload key=2UXA6SXDTUFT upload=J0SJFYI5KGJW tag=PBZZ5FBS1BNK type=write size=3416184 2024-09-14T11:17:28.931 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.930+0000 7fe125ff88c0 1 < suggested remove operation key=V6B470G93KFT tag=IGA7NTEFEVX9 type=write 2024-09-14T11:17:28.934 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.934+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=UXBKOPUQSNRS type=del size=2071918 2024-09-14T11:17:28.942 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.942+0000 7fe125ff88c0 1 < suggested update operation key=W0B19NBHNLMZ tag=IXUPJQHT3PMA type=write size=979851 2024-09-14T11:17:28.946 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.946+0000 7fe125ff88c0 1 > prepared operation key=6C3JZKTB8BP3 tag=OGH6IOC2U4N8 type=write size=127870 2024-09-14T11:17:28.949 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.950+0000 7fe125ff88c0 1 < completed delete operation key=SSNV25PDLDIS tag=5PV78L4UXRQ5 type=del 2024-09-14T11:17:28.953 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.954+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=33VSOSQ6Z82A type=write size=154 2024-09-14T11:17:28.957 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.958+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~C4B8981GD2NC.0 size=1048576 2024-09-14T11:17:28.960 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.958+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~C4B8981GD2NC.1 size=1048576 2024-09-14T11:17:28.962 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.962+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~C4B8981GD2NC.2 size=929386 2024-09-14T11:17:28.968 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.970+0000 7fe125ff88c0 1 < completed multipart upload key=3YGN50MBAF41 upload=C4B8981GD2NC tag=BIK8Q9SUNSAR type=write size=4075114 2024-09-14T11:17:28.975 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.974+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~9BRQQMVRFRNP.0 size=852006 2024-09-14T11:17:28.975 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.974+0000 7fe125ff88c0 1 > prepared multipart upload key=35EB6U5O4A51 upload=9BRQQMVRFRNP tag=BJOOEN9B8MGE type=write size=1900582 2024-09-14T11:17:28.979 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.978+0000 7fe125ff88c0 1 < completed delete operation key=6C3JZKTB8BP3 tag=O7G84E4NKN20 type=del 2024-09-14T11:17:28.983 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.982+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=JDH4ZMBR2KZE type=del size=791741 2024-09-14T11:17:28.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.986+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~0X6Z61JK4C68.0 size=965873 2024-09-14T11:17:28.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:28.994+0000 7fe125ff88c0 1 < completed multipart upload key=N80X3YUF4OEL upload=0X6Z61JK4C68 tag=SEN7JBQVN8GA type=write size=2014449 2024-09-14T11:17:29.000 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.002+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~PAPX9DGXL435.0 size=1048576 2024-09-14T11:17:29.004 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.002+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~PAPX9DGXL435.1 size=949081 2024-09-14T11:17:29.004 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.002+0000 7fe125ff88c0 1 > prepared multipart upload key=1ML6RIXI4C5P upload=PAPX9DGXL435 tag=9CG185RA336E type=write size=3046233 2024-09-14T11:17:29.008 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.010+0000 7fe125ff88c0 1 < completed delete operation key=YFRH8WECBTJK tag=6TBI5J9PVE64 type=del 2024-09-14T11:17:29.012 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.014+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=ZVXPMUGML0LG type=del size=642521 2024-09-14T11:17:29.016 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.018+0000 7fe125ff88c0 1 < completed delete operation key=3OU4U9JF3ZD5 tag=DBFTL6E3T25C type=del 2024-09-14T11:17:29.024 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.022+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~2P50ELFMA09T.0 size=1048576 2024-09-14T11:17:29.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.026+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~2P50ELFMA09T.1 size=600918 2024-09-14T11:17:29.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.026+0000 7fe125ff88c0 1 > prepared multipart upload key=LYBGDNKUROWH upload=2P50ELFMA09T tag=EMK87N537R9Q type=write size=2698070 2024-09-14T11:17:29.030 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.030+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~GYXIHD2091AB.0 size=162192 2024-09-14T11:17:29.035 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.034+0000 7fe125ff88c0 1 < completed multipart upload key=SSNV25PDLDIS upload=GYXIHD2091AB tag=JL3IN8MAX2PW type=write size=1210768 2024-09-14T11:17:29.041 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.042+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~F8WQHIVSFPZ8.0 size=1048576 2024-09-14T11:17:29.043 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.042+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~F8WQHIVSFPZ8.1 size=1048576 2024-09-14T11:17:29.045 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.046+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~F8WQHIVSFPZ8.2 size=509298 2024-09-14T11:17:29.045 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.046+0000 7fe125ff88c0 1 > prepared multipart upload key=4D2X7151977X upload=F8WQHIVSFPZ8 tag=9I80CRE6EZWE type=write size=3655026 2024-09-14T11:17:29.049 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.050+0000 7fe125ff88c0 1 < completed delete operation key=YGEVGH840L18 tag=1Z9RYHKC46RU type=del 2024-09-14T11:17:29.052 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.050+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=FRU7PNKH8QJ0 type=del size=1189625 2024-09-14T11:17:29.056 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.054+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~UVUYM06IZ0TW.0 size=1048576 2024-09-14T11:17:29.059 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.058+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~UVUYM06IZ0TW.1 size=1048576 2024-09-14T11:17:29.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.062+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~UVUYM06IZ0TW.2 size=695168 2024-09-14T11:17:29.067 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.066+0000 7fe125ff88c0 1 < completed multipart upload key=K05LARTJ2QZ3 upload=UVUYM06IZ0TW tag=R3XVG48214YE type=write size=3840896 2024-09-14T11:17:29.070 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.070+0000 7fe125ff88c0 1 > prepared operation key=K05LARTJ2QZ3 tag=KHUUR9HG07A1 type=write size=637174 2024-09-14T11:17:29.077 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.078+0000 7fe125ff88c0 1 < suggested remove operation key=L4XO0WTYKNXY tag=LLFGTIBBMDSZ type=write 2024-09-14T11:17:29.081 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.082+0000 7fe125ff88c0 1 > prepared operation key=FQ5WT12KB664 tag=NIA6SSNDW4XA type=del size=1197092 2024-09-14T11:17:29.085 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.086+0000 7fe125ff88c0 1 < completed write operation key=35EB6U5O4A51 tag=RMLK1IOLKF7G type=write size=963956 2024-09-14T11:17:29.091 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.090+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~NXT4XITT33YR.0 size=757122 2024-09-14T11:17:29.091 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.090+0000 7fe125ff88c0 1 > prepared multipart upload key=0VBX2FWYCFEZ upload=NXT4XITT33YR tag=T7S7ZC1EC05X type=write size=1805698 2024-09-14T11:17:29.094 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.094+0000 7fe125ff88c0 -1 < failed to complete operation key=V6B470G93KFT tag=227KCWHOTU0Z type=del size=1649438: (22) Invalid argument 2024-09-14T11:17:29.098 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.098+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=0LRQBSDA529N type=del size=3376819 2024-09-14T11:17:29.102 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.102+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~YCK4BMZ9KF00.0 size=700576 2024-09-14T11:17:29.107 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.106+0000 7fe125ff88c0 1 < completed multipart upload key=SSNV25PDLDIS upload=YCK4BMZ9KF00 tag=EISS49YDTUQJ type=write size=1749152 2024-09-14T11:17:29.111 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.110+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=48CPS1JBCA69 type=del size=1192623 2024-09-14T11:17:29.115 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.114+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~J0SJFYI5KGJW.0 size=1048576 2024-09-14T11:17:29.118 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.118+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~J0SJFYI5KGJW.1 size=1048576 2024-09-14T11:17:29.121 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.122+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~J0SJFYI5KGJW.2 size=270456 2024-09-14T11:17:29.127 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.126+0000 7fe125ff88c0 1 < completed multipart upload key=2UXA6SXDTUFT upload=J0SJFYI5KGJW tag=PBZZ5FBS1BNK type=write size=3416184 2024-09-14T11:17:29.131 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.130+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=CRV3DTZMMNAW type=del size=1555146 2024-09-14T11:17:29.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.134+0000 7fe125ff88c0 1 < completed delete operation key=0VBX2FWYCFEZ tag=UXBKOPUQSNRS type=del 2024-09-14T11:17:29.139 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.138+0000 7fe125ff88c0 1 > prepared operation key=6C3JZKTB8BP3 tag=PP0FFCUS1Q6X type=del size=1549900 2024-09-14T11:17:29.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.142+0000 7fe125ff88c0 1 < completed write operation key=6C3JZKTB8BP3 tag=OGH6IOC2U4N8 type=write size=127870 2024-09-14T11:17:29.147 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.146+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=3UU470GQ5ZXW type=write size=307912 2024-09-14T11:17:29.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.150+0000 7fe125ff88c0 1 < completed write operation key=K3P6U6NU8I01 tag=33VSOSQ6Z82A type=write size=154 2024-09-14T11:17:29.155 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.154+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=WGMTBTWIUL2U type=write size=1008784 2024-09-14T11:17:29.159 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.158+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~9BRQQMVRFRNP.0 size=852006 2024-09-14T11:17:29.165 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.166+0000 7fe125ff88c0 1 < completed multipart upload key=35EB6U5O4A51 upload=9BRQQMVRFRNP tag=BJOOEN9B8MGE type=write size=1900582 2024-09-14T11:17:29.172 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.170+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~N2VORZKQUP0O.0 size=1048576 2024-09-14T11:17:29.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.174+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~N2VORZKQUP0O.1 size=409980 2024-09-14T11:17:29.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.174+0000 7fe125ff88c0 1 > prepared multipart upload key=2UXA6SXDTUFT upload=N2VORZKQUP0O tag=72CKS3GWZBI3 type=write size=2507132 2024-09-14T11:17:29.179 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.178+0000 7fe125ff88c0 1 < completed delete operation key=YGEVGH840L18 tag=JDH4ZMBR2KZE type=del 2024-09-14T11:17:29.182 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.182+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=GGE557WMN5F6 type=del size=336722 2024-09-14T11:17:29.186 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.186+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~PAPX9DGXL435.0 size=1048576 2024-09-14T11:17:29.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.190+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~PAPX9DGXL435.1 size=949081 2024-09-14T11:17:29.194 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.194+0000 7fe125ff88c0 1 < completed multipart upload key=1ML6RIXI4C5P upload=PAPX9DGXL435 tag=9CG185RA336E type=write size=3046233 2024-09-14T11:17:29.198 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.198+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=UPQK8ETNPAMI type=write size=985047 2024-09-14T11:17:29.202 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.202+0000 7fe125ff88c0 1 < completed delete operation key=W0B19NBHNLMZ tag=ZVXPMUGML0LG type=del 2024-09-14T11:17:29.206 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.206+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=SAFJ5C7TXS72 type=del size=801403 2024-09-14T11:17:29.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.206+0000 7fe125ff88c0 1 < canceled part key=_multipart_LYBGDNKUROWH.2~2P50ELFMA09T.0 size=1048576 2024-09-14T11:17:29.210 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.210+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~2P50ELFMA09T.1 size=600918 2024-09-14T11:17:29.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.222+0000 7fe125ff88c0 1 < canceled multipart upload key=LYBGDNKUROWH upload=2P50ELFMA09T tag=EMK87N537R9Q type=write size=2698070 2024-09-14T11:17:29.225 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.226+0000 7fe125ff88c0 1 > prepared operation key=3OU4U9JF3ZD5 tag=D1OM2RK3JCYJ type=del size=1325752 2024-09-14T11:17:29.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.226+0000 7fe125ff88c0 1 < canceled part key=_multipart_4D2X7151977X.2~F8WQHIVSFPZ8.0 size=1048576 2024-09-14T11:17:29.229 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.230+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~F8WQHIVSFPZ8.1 size=1048576 2024-09-14T11:17:29.237 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.238+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~F8WQHIVSFPZ8.2 size=509298 2024-09-14T11:17:29.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.242+0000 7fe125ff88c0 1 < canceled multipart upload key=4D2X7151977X upload=F8WQHIVSFPZ8 tag=9I80CRE6EZWE type=write size=3655026 2024-09-14T11:17:29.246 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.246+0000 7fe125ff88c0 1 > prepared operation key=3OU4U9JF3ZD5 tag=OIYDYGVM41LX type=del size=1507026 2024-09-14T11:17:29.250 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.250+0000 7fe125ff88c0 1 < canceled operation key=2UXA6SXDTUFT tag=FRU7PNKH8QJ0 type=del size=1189625 2024-09-14T11:17:29.253 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.254+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=CHS96OFHW8YC type=del size=1369271 2024-09-14T11:17:29.257 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.258+0000 7fe125ff88c0 1 < canceled operation key=K05LARTJ2QZ3 tag=KHUUR9HG07A1 type=write size=637174 2024-09-14T11:17:29.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.262+0000 7fe125ff88c0 1 > prepared operation key=YFRH8WECBTJK tag=36CGWAUO95VI type=del size=648990 2024-09-14T11:17:29.264 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.262+0000 7fe125ff88c0 1 < completed delete operation key=FQ5WT12KB664 tag=NIA6SSNDW4XA type=del 2024-09-14T11:17:29.271 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.270+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~1CGY9SOOE97R.0 size=1048576 2024-09-14T11:17:29.273 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.274+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~1CGY9SOOE97R.1 size=1048576 2024-09-14T11:17:29.276 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.274+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~1CGY9SOOE97R.2 size=709350 2024-09-14T11:17:29.276 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.274+0000 7fe125ff88c0 1 > prepared multipart upload key=FQ5WT12KB664 upload=1CGY9SOOE97R tag=DI27HD7HC39B type=write size=3855078 2024-09-14T11:17:29.280 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.278+0000 7fe125ff88c0 1 < completed part key=_multipart_0VBX2FWYCFEZ.2~NXT4XITT33YR.0 size=757122 2024-09-14T11:17:29.285 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.286+0000 7fe125ff88c0 1 < completed multipart upload key=0VBX2FWYCFEZ upload=NXT4XITT33YR tag=T7S7ZC1EC05X type=write size=1805698 2024-09-14T11:17:29.289 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.290+0000 7fe125ff88c0 1 > prepared operation key=YN2HI39GPEDF tag=QU1EZ0YBRIKZ type=del size=1183701 2024-09-14T11:17:29.292 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.294+0000 7fe125ff88c0 1 < completed delete operation key=L4XO0WTYKNXY tag=0LRQBSDA529N type=del 2024-09-14T11:17:29.296 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.294+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=22QO9JQ23N7O type=del size=341194 2024-09-14T11:17:29.299 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.298+0000 7fe125ff88c0 1 < completed delete operation key=0VBX2FWYCFEZ tag=48CPS1JBCA69 type=del 2024-09-14T11:17:29.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.306+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~EXUMSRZOHKFT.0 size=1048576 2024-09-14T11:17:29.308 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.310+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~EXUMSRZOHKFT.1 size=1048576 2024-09-14T11:17:29.311 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.310+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~EXUMSRZOHKFT.2 size=978525 2024-09-14T11:17:29.311 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.310+0000 7fe125ff88c0 1 > prepared multipart upload key=YFRH8WECBTJK upload=EXUMSRZOHKFT tag=Y7UJ9DFWA2H5 type=write size=4124253 2024-09-14T11:17:29.315 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.314+0000 7fe125ff88c0 1 < canceled operation key=0VBX2FWYCFEZ tag=CRV3DTZMMNAW type=del size=1555146 2024-09-14T11:17:29.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.318+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=I6OMCTXGVKFX type=del size=1534342 2024-09-14T11:17:29.328 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.326+0000 7fe125ff88c0 1 < suggested remove operation key=6C3JZKTB8BP3 tag=PP0FFCUS1Q6X type=del 2024-09-14T11:17:29.332 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.334+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=4DH4SORRZZX5 type=write size=935850 2024-09-14T11:17:29.336 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.338+0000 7fe125ff88c0 1 < completed write operation key=35EB6U5O4A51 tag=3UU470GQ5ZXW type=write size=307912 2024-09-14T11:17:29.340 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.338+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=FYFR104GZ1YD type=del size=1999759 2024-09-14T11:17:29.344 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.346+0000 7fe125ff88c0 1 < completed write operation key=K3P6U6NU8I01 tag=WGMTBTWIUL2U type=write size=1008784 2024-09-14T11:17:29.348 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.346+0000 7fe125ff88c0 1 > prepared operation key=1ML6RIXI4C5P tag=9N1MYOMW7L1J type=del size=885929 2024-09-14T11:17:29.349 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.350+0000 7fe125ff88c0 1 < canceled part key=_multipart_2UXA6SXDTUFT.2~N2VORZKQUP0O.0 size=1048576 2024-09-14T11:17:29.352 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.354+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~N2VORZKQUP0O.1 size=409980 2024-09-14T11:17:29.360 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.358+0000 7fe125ff88c0 1 < canceled multipart upload key=2UXA6SXDTUFT upload=N2VORZKQUP0O tag=72CKS3GWZBI3 type=write size=2507132 2024-09-14T11:17:29.362 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.362+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=182ZQGUIW2HP type=write size=209957 2024-09-14T11:17:29.366 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.366+0000 7fe125ff88c0 1 < completed delete operation key=YCF2PCJ9TZMR tag=GGE557WMN5F6 type=del 2024-09-14T11:17:29.370 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.370+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=IGZOKPQ5LBPV type=del size=2433645 2024-09-14T11:17:29.373 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.374+0000 7fe125ff88c0 1 < completed write operation key=WEA3MQ0DI42N tag=UPQK8ETNPAMI type=write size=985047 2024-09-14T11:17:29.380 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.382+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~93RG4HZGE3XS.0 size=1048576 2024-09-14T11:17:29.384 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.382+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~93RG4HZGE3XS.1 size=1048576 2024-09-14T11:17:29.386 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.386+0000 7fe125ff88c0 1 > prepared part key=_multipart_N80X3YUF4OEL.2~93RG4HZGE3XS.2 size=182327 2024-09-14T11:17:29.386 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.386+0000 7fe125ff88c0 1 > prepared multipart upload key=N80X3YUF4OEL upload=93RG4HZGE3XS tag=0E7YI4BQ55BA type=write size=3328055 2024-09-14T11:17:29.390 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.390+0000 7fe125ff88c0 1 < completed delete operation key=V6B470G93KFT tag=SAFJ5C7TXS72 type=del 2024-09-14T11:17:29.395 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.394+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=FQKPUGMZUOOQ type=del size=890722 2024-09-14T11:17:29.403 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.402+0000 7fe125ff88c0 1 < suggested remove operation key=3OU4U9JF3ZD5 tag=D1OM2RK3JCYJ type=del 2024-09-14T11:17:29.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.406+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=S41L6IIETGNC type=del size=108963 2024-09-14T11:17:29.411 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.410+0000 7fe125ff88c0 -1 < failed to complete operation key=3OU4U9JF3ZD5 tag=OIYDYGVM41LX type=del size=1507026: (22) Invalid argument 2024-09-14T11:17:29.418 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.418+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~PKH3RDSFYRBM.0 size=1048576 2024-09-14T11:17:29.421 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.422+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~PKH3RDSFYRBM.1 size=1048576 2024-09-14T11:17:29.424 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.422+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~PKH3RDSFYRBM.2 size=70022 2024-09-14T11:17:29.424 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.422+0000 7fe125ff88c0 1 > prepared multipart upload key=0FITHLGQKQEC upload=PKH3RDSFYRBM tag=L5BHG86K9YAF type=write size=3215750 2024-09-14T11:17:29.427 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.426+0000 7fe125ff88c0 1 < completed delete operation key=V6B470G93KFT tag=CHS96OFHW8YC type=del 2024-09-14T11:17:29.431 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.430+0000 7fe125ff88c0 1 > prepared operation key=6C3JZKTB8BP3 tag=EXZ605PZ34NY type=write size=303893 2024-09-14T11:17:29.435 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.434+0000 7fe125ff88c0 1 < completed delete operation key=YFRH8WECBTJK tag=36CGWAUO95VI type=del 2024-09-14T11:17:29.442 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.442+0000 7fe125ff88c0 1 > prepared part key=_multipart_2KEKSWK0UT6C.2~80K1H1GUFREO.0 size=1048576 2024-09-14T11:17:29.445 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.446+0000 7fe125ff88c0 1 > prepared part key=_multipart_2KEKSWK0UT6C.2~80K1H1GUFREO.1 size=514460 2024-09-14T11:17:29.445 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.446+0000 7fe125ff88c0 1 > prepared multipart upload key=2KEKSWK0UT6C upload=80K1H1GUFREO tag=HWQ10BJM33IZ type=write size=2611612 2024-09-14T11:17:29.448 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.450+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~1CGY9SOOE97R.0 size=1048576 2024-09-14T11:17:29.451 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.450+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~1CGY9SOOE97R.1 size=1048576 2024-09-14T11:17:29.454 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.454+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~1CGY9SOOE97R.2 size=709350 2024-09-14T11:17:29.461 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.462+0000 7fe125ff88c0 1 < completed multipart upload key=FQ5WT12KB664 upload=1CGY9SOOE97R tag=DI27HD7HC39B type=write size=3855078 2024-09-14T11:17:29.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.466+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=ZJASTCCKGETN type=write size=186739 2024-09-14T11:17:29.469 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.470+0000 7fe125ff88c0 1 < completed delete operation key=YN2HI39GPEDF tag=QU1EZ0YBRIKZ type=del 2024-09-14T11:17:29.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.474+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=757OXDTBWUO6 type=write size=910845 2024-09-14T11:17:29.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.478+0000 7fe125ff88c0 1 < completed delete operation key=N94D3R7IOBNL tag=22QO9JQ23N7O type=del 2024-09-14T11:17:29.481 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.482+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=2GJV84H9ZA8D type=del size=1968535 2024-09-14T11:17:29.485 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.486+0000 7fe125ff88c0 1 < completed part key=_multipart_YFRH8WECBTJK.2~EXUMSRZOHKFT.0 size=1048576 2024-09-14T11:17:29.485 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.486+0000 7fe125ff88c0 1 < canceled part key=_multipart_YFRH8WECBTJK.2~EXUMSRZOHKFT.1 size=1048576 2024-09-14T11:17:29.485 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.486+0000 7fe125ff88c0 1 < canceled part key=_multipart_YFRH8WECBTJK.2~EXUMSRZOHKFT.2 size=978525 2024-09-14T11:17:29.491 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.490+0000 7fe125ff88c0 1 < canceled multipart upload key=YFRH8WECBTJK upload=EXUMSRZOHKFT tag=Y7UJ9DFWA2H5 type=write size=4124253 2024-09-14T11:17:29.498 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.498+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~Y2LQN27475GW.0 size=646893 2024-09-14T11:17:29.499 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.498+0000 7fe125ff88c0 1 > prepared multipart upload key=YCF2PCJ9TZMR upload=Y2LQN27475GW tag=GB5NF7QN73BS type=write size=1695469 2024-09-14T11:17:29.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.502+0000 7fe125ff88c0 1 < completed delete operation key=2LH5U05C2F8C tag=I6OMCTXGVKFX type=del 2024-09-14T11:17:29.507 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.506+0000 7fe125ff88c0 1 > prepared operation key=K05LARTJ2QZ3 tag=2P9C46AXNBSI type=del size=1431984 2024-09-14T11:17:29.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.510+0000 7fe125ff88c0 1 < completed write operation key=W0B19NBHNLMZ tag=4DH4SORRZZX5 type=write size=935850 2024-09-14T11:17:29.519 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.518+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~S9K3CPBMAN1D.0 size=1048576 2024-09-14T11:17:29.523 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.522+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~S9K3CPBMAN1D.1 size=132763 2024-09-14T11:17:29.523 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.522+0000 7fe125ff88c0 1 > prepared multipart upload key=3OU4U9JF3ZD5 upload=S9K3CPBMAN1D tag=7WFDTI5GRIRD type=write size=2229915 2024-09-14T11:17:29.527 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.526+0000 7fe125ff88c0 1 < canceled operation key=N94D3R7IOBNL tag=FYFR104GZ1YD type=del size=1999759 2024-09-14T11:17:29.532 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.530+0000 7fe125ff88c0 1 > prepared operation key=3OU4U9JF3ZD5 tag=PHB0MJNJLGEO type=del size=3571750 2024-09-14T11:17:29.536 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.534+0000 7fe125ff88c0 1 < completed delete operation key=1ML6RIXI4C5P tag=9N1MYOMW7L1J type=del 2024-09-14T11:17:29.540 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.542+0000 7fe125ff88c0 1 > prepared operation key=YFRH8WECBTJK tag=1VPFH4H3NXBG type=del size=1289473 2024-09-14T11:17:29.545 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.546+0000 7fe125ff88c0 1 < completed write operation key=W0B19NBHNLMZ tag=182ZQGUIW2HP type=write size=209957 2024-09-14T11:17:29.552 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.550+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~4QJX0RO2KVUH.0 size=1048576 2024-09-14T11:17:29.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.554+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~4QJX0RO2KVUH.1 size=1048576 2024-09-14T11:17:29.558 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.558+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~4QJX0RO2KVUH.2 size=824 2024-09-14T11:17:29.558 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.558+0000 7fe125ff88c0 1 > prepared multipart upload key=YGEVGH840L18 upload=4QJX0RO2KVUH tag=FTRGUZHW0LM6 type=write size=3146552 2024-09-14T11:17:29.564 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.562+0000 7fe125ff88c0 1 < completed delete operation key=L4XO0WTYKNXY tag=IGZOKPQ5LBPV type=del 2024-09-14T11:17:29.567 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.566+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=90F2XNRBROMH type=del size=3420265 2024-09-14T11:17:29.570 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.570+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~93RG4HZGE3XS.0 size=1048576 2024-09-14T11:17:29.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.574+0000 7fe125ff88c0 1 < completed part key=_multipart_N80X3YUF4OEL.2~93RG4HZGE3XS.1 size=1048576 2024-09-14T11:17:29.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.574+0000 7fe125ff88c0 1 < canceled part key=_multipart_N80X3YUF4OEL.2~93RG4HZGE3XS.2 size=182327 2024-09-14T11:17:29.579 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.578+0000 7fe125ff88c0 1 < canceled multipart upload key=N80X3YUF4OEL upload=93RG4HZGE3XS tag=0E7YI4BQ55BA type=write size=3328055 2024-09-14T11:17:29.583 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.582+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=32S1P0931YE9 type=del size=2261101 2024-09-14T11:17:29.587 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.586+0000 7fe125ff88c0 1 < completed delete operation key=6PLUU2QIO9LJ tag=FQKPUGMZUOOQ type=del 2024-09-14T11:17:29.591 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.590+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=NZL44K4B6RT8 type=del size=2684661 2024-09-14T11:17:29.595 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.594+0000 7fe125ff88c0 1 < completed delete operation key=2LH5U05C2F8C tag=S41L6IIETGNC type=del 2024-09-14T11:17:29.602 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.602+0000 7fe125ff88c0 1 > prepared operation key=3OU4U9JF3ZD5 tag=3KL2LBAJJLIW type=del size=480904 2024-09-14T11:17:29.606 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.606+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~PKH3RDSFYRBM.0 size=1048576 2024-09-14T11:17:29.609 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.610+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~PKH3RDSFYRBM.1 size=1048576 2024-09-14T11:17:29.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.610+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~PKH3RDSFYRBM.2 size=70022 2024-09-14T11:17:29.618 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.618+0000 7fe125ff88c0 1 < completed multipart upload key=0FITHLGQKQEC upload=PKH3RDSFYRBM tag=L5BHG86K9YAF type=write size=3215750 2024-09-14T11:17:29.622 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.622+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=W6WLN13TC9MR type=del size=3032688 2024-09-14T11:17:29.625 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.626+0000 7fe125ff88c0 1 < completed write operation key=6C3JZKTB8BP3 tag=EXZ605PZ34NY type=write size=303893 2024-09-14T11:17:29.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.630+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=7APXWUZASBHS type=del size=2666626 2024-09-14T11:17:29.633 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.634+0000 7fe125ff88c0 1 < completed part key=_multipart_2KEKSWK0UT6C.2~80K1H1GUFREO.0 size=1048576 2024-09-14T11:17:29.636 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.634+0000 7fe125ff88c0 1 < completed part key=_multipart_2KEKSWK0UT6C.2~80K1H1GUFREO.1 size=514460 2024-09-14T11:17:29.642 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.642+0000 7fe125ff88c0 1 < completed multipart upload key=2KEKSWK0UT6C upload=80K1H1GUFREO tag=HWQ10BJM33IZ type=write size=2611612 2024-09-14T11:17:29.645 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.646+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=WITZEP4CVQW5 type=write size=88300 2024-09-14T11:17:29.653 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.658+0000 7fe125ff88c0 1 < suggested update operation key=0VBX2FWYCFEZ tag=ZJASTCCKGETN type=write size=186739 2024-09-14T11:17:29.657 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.658+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=04F9QVET88Z4 type=del size=3828384 2024-09-14T11:17:29.661 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.662+0000 7fe125ff88c0 1 < completed write operation key=YGEVGH840L18 tag=757OXDTBWUO6 type=write size=910845 2024-09-14T11:17:29.664 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.662+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=GNSH1IZM1C0S type=del size=3654696 2024-09-14T11:17:29.671 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.670+0000 7fe125ff88c0 1 < suggested update operation key=N94D3R7IOBNL tag=2GJV84H9ZA8D type=del size=1968535 2024-09-14T11:17:29.675 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.674+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=0LD5JXAYP6F0 type=del size=2744854 2024-09-14T11:17:29.678 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.678+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~Y2LQN27475GW.0 size=646893 2024-09-14T11:17:29.684 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.686+0000 7fe125ff88c0 1 < completed multipart upload key=YCF2PCJ9TZMR upload=Y2LQN27475GW tag=GB5NF7QN73BS type=write size=1695469 2024-09-14T11:17:29.692 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.690+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~1FYM3TVGEISG.0 size=1042536 2024-09-14T11:17:29.692 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.690+0000 7fe125ff88c0 1 > prepared multipart upload key=YGEVGH840L18 upload=1FYM3TVGEISG tag=H0NY3PZA6FDY type=write size=2091112 2024-09-14T11:17:29.696 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.694+0000 7fe125ff88c0 1 < completed delete operation key=K05LARTJ2QZ3 tag=2P9C46AXNBSI type=del 2024-09-14T11:17:29.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.698+0000 7fe125ff88c0 1 > prepared operation key=1ML6RIXI4C5P tag=601IG8K062ZB type=del size=595554 2024-09-14T11:17:29.703 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.702+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~S9K3CPBMAN1D.0 size=1048576 2024-09-14T11:17:29.705 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.706+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~S9K3CPBMAN1D.1 size=132763 2024-09-14T11:17:29.710 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.710+0000 7fe125ff88c0 1 < completed multipart upload key=3OU4U9JF3ZD5 upload=S9K3CPBMAN1D tag=7WFDTI5GRIRD type=write size=2229915 2024-09-14T11:17:29.714 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.714+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=Y7CU7TN6W2SZ type=write size=476912 2024-09-14T11:17:29.718 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.718+0000 7fe125ff88c0 1 < completed delete operation key=3OU4U9JF3ZD5 tag=PHB0MJNJLGEO type=del 2024-09-14T11:17:29.721 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.722+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=WCN1T1IPKT9W type=write size=119516 2024-09-14T11:17:29.725 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.726+0000 7fe125ff88c0 1 < completed delete operation key=YFRH8WECBTJK tag=1VPFH4H3NXBG type=del 2024-09-14T11:17:29.731 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.730+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~DYWP3UO5GV5W.0 size=788467 2024-09-14T11:17:29.731 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.730+0000 7fe125ff88c0 1 > prepared multipart upload key=SSNV25PDLDIS upload=DYWP3UO5GV5W tag=1514ZG8I0M3Q type=write size=1837043 2024-09-14T11:17:29.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.734+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~4QJX0RO2KVUH.0 size=1048576 2024-09-14T11:17:29.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.738+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~4QJX0RO2KVUH.1 size=1048576 2024-09-14T11:17:29.740 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.742+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~4QJX0RO2KVUH.2 size=824 2024-09-14T11:17:29.746 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.746+0000 7fe125ff88c0 1 < completed multipart upload key=YGEVGH840L18 upload=4QJX0RO2KVUH tag=FTRGUZHW0LM6 type=write size=3146552 2024-09-14T11:17:29.750 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.750+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=Y3UV2VTWIQC6 type=del size=1671185 2024-09-14T11:17:29.754 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.754+0000 7fe125ff88c0 1 < completed delete operation key=W0B19NBHNLMZ tag=90F2XNRBROMH type=del 2024-09-14T11:17:29.759 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.758+0000 7fe125ff88c0 1 > prepared operation key=3OU4U9JF3ZD5 tag=HGH6TL8MAXGB type=del size=1027076 2024-09-14T11:17:29.763 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.762+0000 7fe125ff88c0 1 < completed delete operation key=SSNV25PDLDIS tag=32S1P0931YE9 type=del 2024-09-14T11:17:29.766 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.766+0000 7fe125ff88c0 1 > prepared operation key=46ZTDBWFVSUH tag=BSXG6O5QJYJF type=del size=2488261 2024-09-14T11:17:29.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.774+0000 7fe125ff88c0 1 < suggested remove operation key=YCF2PCJ9TZMR tag=NZL44K4B6RT8 type=del 2024-09-14T11:17:29.780 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.782+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~Z3491M0NXDRZ.0 size=1039125 2024-09-14T11:17:29.780 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.782+0000 7fe125ff88c0 1 > prepared multipart upload key=K05LARTJ2QZ3 upload=Z3491M0NXDRZ tag=96XJVPP37KSC type=write size=2087701 2024-09-14T11:17:29.788 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.786+0000 7fe125ff88c0 1 < suggested remove operation key=3OU4U9JF3ZD5 tag=3KL2LBAJJLIW type=del 2024-09-14T11:17:29.793 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.794+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=58V2CWQUJTWH type=write size=724186 2024-09-14T11:17:29.800 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.798+0000 7fe125ff88c0 1 < suggested remove operation key=F9I82N7RQC81 tag=W6WLN13TC9MR type=del 2024-09-14T11:17:29.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.802+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=BLJPQYH12FV3 type=del size=3960027 2024-09-14T11:17:29.811 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.810+0000 7fe125ff88c0 1 < suggested remove operation key=K3P6U6NU8I01 tag=7APXWUZASBHS type=del 2024-09-14T11:17:29.815 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.814+0000 7fe125ff88c0 1 > prepared operation key=46ZTDBWFVSUH tag=SBOT8PNVV43M type=write size=231104 2024-09-14T11:17:29.822 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.822+0000 7fe125ff88c0 1 < suggested remove operation key=WEA3MQ0DI42N tag=WITZEP4CVQW5 type=write 2024-09-14T11:17:29.830 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.830+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~RO9EG9GM7GT2.0 size=699931 2024-09-14T11:17:29.830 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.830+0000 7fe125ff88c0 1 > prepared multipart upload key=W0B19NBHNLMZ upload=RO9EG9GM7GT2 tag=QU78MUKJOHQT type=write size=1748507 2024-09-14T11:17:29.833 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.834+0000 7fe125ff88c0 1 < completed delete operation key=6PLUU2QIO9LJ tag=04F9QVET88Z4 type=del 2024-09-14T11:17:29.837 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.838+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=J5V5S84JMGSE type=del size=1519331 2024-09-14T11:17:29.844 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.846+0000 7fe125ff88c0 1 < suggested remove operation key=YGEVGH840L18 tag=GNSH1IZM1C0S type=del 2024-09-14T11:17:29.848 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.850+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=OXAWIGLGTOIU type=write size=956095 2024-09-14T11:17:29.854 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.854+0000 7fe125ff88c0 1 < completed delete operation key=4D2X7151977X tag=0LD5JXAYP6F0 type=del 2024-09-14T11:17:29.860 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.862+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~SR65S2XARMKR.0 size=566511 2024-09-14T11:17:29.860 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.862+0000 7fe125ff88c0 1 > prepared multipart upload key=F9I82N7RQC81 upload=SR65S2XARMKR tag=N6JPXCEIFAJ2 type=write size=1615087 2024-09-14T11:17:29.864 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.866+0000 7fe125ff88c0 1 < completed part key=_multipart_YGEVGH840L18.2~1FYM3TVGEISG.0 size=1042536 2024-09-14T11:17:29.870 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.870+0000 7fe125ff88c0 1 < completed multipart upload key=YGEVGH840L18 upload=1FYM3TVGEISG tag=H0NY3PZA6FDY type=write size=2091112 2024-09-14T11:17:29.875 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.874+0000 7fe125ff88c0 1 > prepared operation key=1ML6RIXI4C5P tag=N8AIHTYA9Q51 type=del size=1639581 2024-09-14T11:17:29.884 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.882+0000 7fe125ff88c0 1 < suggested update operation key=1ML6RIXI4C5P tag=601IG8K062ZB type=del size=595554 2024-09-14T11:17:29.887 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.886+0000 7fe125ff88c0 1 > prepared operation key=K05LARTJ2QZ3 tag=R7H8SD27T6AJ type=del size=1387059 2024-09-14T11:17:29.889 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.890+0000 7fe125ff88c0 -1 < no bi entry to suggest for operation key=YCF2PCJ9TZMR tag=Y7CU7TN6W2SZ type=write size=476912: (2) No such file or directory 2024-09-14T11:17:29.893 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.894+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=40B4YQ24Y43R type=del size=1971502 2024-09-14T11:17:29.897 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.898+0000 7fe125ff88c0 1 < completed write operation key=4D2X7151977X tag=WCN1T1IPKT9W type=write size=119516 2024-09-14T11:17:29.900 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.902+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=RWAE8MEUTOW2 type=del size=1203171 2024-09-14T11:17:29.904 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.906+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~DYWP3UO5GV5W.0 size=788467 2024-09-14T11:17:29.910 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.910+0000 7fe125ff88c0 1 < completed multipart upload key=SSNV25PDLDIS upload=DYWP3UO5GV5W tag=1514ZG8I0M3Q type=write size=1837043 2024-09-14T11:17:29.917 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.922+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~GX06SK330RBU.0 size=1048576 2024-09-14T11:17:29.920 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.922+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~GX06SK330RBU.1 size=1048576 2024-09-14T11:17:29.923 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.922+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~GX06SK330RBU.2 size=698586 2024-09-14T11:17:29.923 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.922+0000 7fe125ff88c0 1 > prepared multipart upload key=3YGN50MBAF41 upload=GX06SK330RBU tag=5OU7ZFL9XNJ9 type=write size=3844314 2024-09-14T11:17:29.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.926+0000 7fe125ff88c0 -1 < failed to complete operation key=F9I82N7RQC81 tag=Y3UV2VTWIQC6 type=del size=1671185: (22) Invalid argument 2024-09-14T11:17:29.934 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.934+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~ETI3SYYN3UOB.0 size=1048576 2024-09-14T11:17:29.937 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.938+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~ETI3SYYN3UOB.1 size=577529 2024-09-14T11:17:29.937 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.938+0000 7fe125ff88c0 1 > prepared multipart upload key=V6B470G93KFT upload=ETI3SYYN3UOB tag=WTMRS4JDMUBC type=write size=2674681 2024-09-14T11:17:29.940 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.942+0000 7fe125ff88c0 -1 < failed to complete operation key=3OU4U9JF3ZD5 tag=HGH6TL8MAXGB type=del size=1027076: (22) Invalid argument 2024-09-14T11:17:29.947 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.946+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~FKX9MD8ZKUV4.0 size=361981 2024-09-14T11:17:29.947 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.946+0000 7fe125ff88c0 1 > prepared multipart upload key=35EB6U5O4A51 upload=FKX9MD8ZKUV4 tag=BO8BSY77AS2G type=write size=1410557 2024-09-14T11:17:29.956 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.954+0000 7fe125ff88c0 1 < suggested remove operation key=46ZTDBWFVSUH tag=BSXG6O5QJYJF type=del 2024-09-14T11:17:29.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.962+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=IGB12CX2ZQZX type=del size=2035210 2024-09-14T11:17:29.967 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.966+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~Z3491M0NXDRZ.0 size=1039125 2024-09-14T11:17:29.972 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.974+0000 7fe125ff88c0 1 < completed multipart upload key=K05LARTJ2QZ3 upload=Z3491M0NXDRZ tag=96XJVPP37KSC type=write size=2087701 2024-09-14T11:17:29.980 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.978+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~03C362MPDIKV.0 size=1048576 2024-09-14T11:17:29.982 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.982+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~03C362MPDIKV.1 size=1048576 2024-09-14T11:17:29.985 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.986+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~03C362MPDIKV.2 size=1022024 2024-09-14T11:17:29.985 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.986+0000 7fe125ff88c0 1 > prepared multipart upload key=6C3JZKTB8BP3 upload=03C362MPDIKV tag=8ZKSTTQ16NQS type=write size=4167752 2024-09-14T11:17:29.989 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.990+0000 7fe125ff88c0 1 < completed write operation key=0VBX2FWYCFEZ tag=58V2CWQUJTWH type=write size=724186 2024-09-14T11:17:29.996 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.998+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~VMGYAVJM5OZU.0 size=349027 2024-09-14T11:17:29.996 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:29.998+0000 7fe125ff88c0 1 > prepared multipart upload key=K05LARTJ2QZ3 upload=VMGYAVJM5OZU tag=4FA2F5ZLAIUN type=write size=1397603 2024-09-14T11:17:30.000 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.002+0000 7fe125ff88c0 1 < completed delete operation key=21HC4VMHXS6L tag=BLJPQYH12FV3 type=del 2024-09-14T11:17:30.004 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.006+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=I6I5JU39OQR7 type=write size=645940 2024-09-14T11:17:30.006 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.006+0000 7fe125ff88c0 -1 < no bi entry to suggest for operation key=46ZTDBWFVSUH tag=SBOT8PNVV43M type=write size=231104: (2) No such file or directory 2024-09-14T11:17:30.013 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.014+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~JX50N0Q4A455.0 size=1048576 2024-09-14T11:17:30.016 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.014+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~JX50N0Q4A455.1 size=1048576 2024-09-14T11:17:30.019 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.018+0000 7fe125ff88c0 1 > prepared part key=_multipart_2UXA6SXDTUFT.2~JX50N0Q4A455.2 size=23882 2024-09-14T11:17:30.019 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.018+0000 7fe125ff88c0 1 > prepared multipart upload key=2UXA6SXDTUFT upload=JX50N0Q4A455 tag=IUL10OYQLMTG type=write size=3169610 2024-09-14T11:17:30.022 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.022+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~RO9EG9GM7GT2.0 size=699931 2024-09-14T11:17:30.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.030+0000 7fe125ff88c0 1 < completed multipart upload key=W0B19NBHNLMZ upload=RO9EG9GM7GT2 tag=QU78MUKJOHQT type=write size=1748507 2024-09-14T11:17:30.035 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.034+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~74J8QVIFS9I6.0 size=1048576 2024-09-14T11:17:30.039 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.038+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~74J8QVIFS9I6.1 size=748747 2024-09-14T11:17:30.039 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.038+0000 7fe125ff88c0 1 > prepared multipart upload key=2LH5U05C2F8C upload=74J8QVIFS9I6 tag=IINDEMMBY8S2 type=write size=2845899 2024-09-14T11:17:30.042 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.042+0000 7fe125ff88c0 1 < completed delete operation key=L4XO0WTYKNXY tag=J5V5S84JMGSE type=del 2024-09-14T11:17:30.046 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.046+0000 7fe125ff88c0 1 > prepared operation key=6C3JZKTB8BP3 tag=LH6V9TEKOWSA type=del size=2918651 2024-09-14T11:17:30.051 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.050+0000 7fe125ff88c0 1 < completed write operation key=21HC4VMHXS6L tag=OXAWIGLGTOIU type=write size=956095 2024-09-14T11:17:30.058 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.058+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~6C1ZO0BV6AFE.0 size=1048576 2024-09-14T11:17:30.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.062+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~6C1ZO0BV6AFE.1 size=1033953 2024-09-14T11:17:30.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.062+0000 7fe125ff88c0 1 > prepared multipart upload key=21HC4VMHXS6L upload=6C1ZO0BV6AFE tag=JFX261ZW5WVO type=write size=3131105 2024-09-14T11:17:30.065 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.066+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~SR65S2XARMKR.0 size=566511 2024-09-14T11:17:30.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.070+0000 7fe125ff88c0 1 < completed multipart upload key=F9I82N7RQC81 upload=SR65S2XARMKR tag=N6JPXCEIFAJ2 type=write size=1615087 2024-09-14T11:17:30.078 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.078+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~ARBGTBD9STO0.0 size=614848 2024-09-14T11:17:30.078 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.078+0000 7fe125ff88c0 1 > prepared multipart upload key=K05LARTJ2QZ3 upload=ARBGTBD9STO0 tag=C5W4A6060HQ5 type=write size=1663424 2024-09-14T11:17:30.082 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.082+0000 7fe125ff88c0 -1 < failed to complete operation key=1ML6RIXI4C5P tag=N8AIHTYA9Q51 type=del size=1639581: (22) Invalid argument 2024-09-14T11:17:30.086 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.086+0000 7fe125ff88c0 1 > prepared operation key=0FITHLGQKQEC tag=512FSPFB9C47 type=del size=1781151 2024-09-14T11:17:30.090 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.090+0000 7fe125ff88c0 1 < completed delete operation key=K05LARTJ2QZ3 tag=R7H8SD27T6AJ type=del 2024-09-14T11:17:30.094 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.094+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=YWB231A0GX2F type=del size=324255 2024-09-14T11:17:30.097 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.098+0000 7fe125ff88c0 1 < completed delete operation key=K3P6U6NU8I01 tag=40B4YQ24Y43R type=del 2024-09-14T11:17:30.103 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.102+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~TYK8O7J1Q0BM.0 size=868012 2024-09-14T11:17:30.103 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.102+0000 7fe125ff88c0 1 > prepared multipart upload key=ESVFZQQXE3GT upload=TYK8O7J1Q0BM tag=MEYHEV3XHRIK type=write size=1916588 2024-09-14T11:17:30.107 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.106+0000 7fe125ff88c0 1 < completed delete operation key=21HC4VMHXS6L tag=RWAE8MEUTOW2 type=del 2024-09-14T11:17:30.112 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.110+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=U1P3Z3EKCSX9 type=del size=3481434 2024-09-14T11:17:30.116 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.118+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~GX06SK330RBU.0 size=1048576 2024-09-14T11:17:30.119 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.118+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~GX06SK330RBU.1 size=1048576 2024-09-14T11:17:30.122 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.122+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~GX06SK330RBU.2 size=698586 2024-09-14T11:17:30.129 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.130+0000 7fe125ff88c0 1 < completed multipart upload key=3YGN50MBAF41 upload=GX06SK330RBU tag=5OU7ZFL9XNJ9 type=write size=3844314 2024-09-14T11:17:30.132 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.134+0000 7fe125ff88c0 1 > prepared operation key=3YGN50MBAF41 tag=09I5A0JI1F9Z type=write size=264983 2024-09-14T11:17:30.136 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.138+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~ETI3SYYN3UOB.0 size=1048576 2024-09-14T11:17:30.139 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.138+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~ETI3SYYN3UOB.1 size=577529 2024-09-14T11:17:30.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.146+0000 7fe125ff88c0 1 < completed multipart upload key=V6B470G93KFT upload=ETI3SYYN3UOB tag=WTMRS4JDMUBC type=write size=2674681 2024-09-14T11:17:30.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.150+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=SQB71HXHA9RA type=write size=940341 2024-09-14T11:17:30.153 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.154+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~FKX9MD8ZKUV4.0 size=361981 2024-09-14T11:17:30.159 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.158+0000 7fe125ff88c0 1 < completed multipart upload key=35EB6U5O4A51 upload=FKX9MD8ZKUV4 tag=BO8BSY77AS2G type=write size=1410557 2024-09-14T11:17:30.167 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.166+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~3UJB8QD5OIJF.0 size=891248 2024-09-14T11:17:30.167 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.166+0000 7fe125ff88c0 1 > prepared multipart upload key=LYBGDNKUROWH upload=3UJB8QD5OIJF tag=R7LY1Q2DLHYY type=write size=1939824 2024-09-14T11:17:30.171 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.170+0000 7fe125ff88c0 1 < completed delete operation key=21HC4VMHXS6L tag=IGB12CX2ZQZX type=del 2024-09-14T11:17:30.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.174+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=4UB1CWFD25N7 type=del size=4069147 2024-09-14T11:17:30.180 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.178+0000 7fe125ff88c0 1 < completed part key=_multipart_6C3JZKTB8BP3.2~03C362MPDIKV.0 size=1048576 2024-09-14T11:17:30.180 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.178+0000 7fe125ff88c0 1 < canceled part key=_multipart_6C3JZKTB8BP3.2~03C362MPDIKV.1 size=1048576 2024-09-14T11:17:30.183 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.182+0000 7fe125ff88c0 1 < completed part key=_multipart_6C3JZKTB8BP3.2~03C362MPDIKV.2 size=1022024 2024-09-14T11:17:30.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.190+0000 7fe125ff88c0 1 < canceled multipart upload key=6C3JZKTB8BP3 upload=03C362MPDIKV tag=8ZKSTTQ16NQS type=write size=4167752 2024-09-14T11:17:30.194 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.194+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=2ICDUNTC1W0S type=del size=4182556 2024-09-14T11:17:30.198 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.198+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~VMGYAVJM5OZU.0 size=349027 2024-09-14T11:17:30.204 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.202+0000 7fe125ff88c0 1 < completed multipart upload key=K05LARTJ2QZ3 upload=VMGYAVJM5OZU tag=4FA2F5ZLAIUN type=write size=1397603 2024-09-14T11:17:30.210 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.210+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~JOOIHKTDUIB2.0 size=1048576 2024-09-14T11:17:30.213 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.214+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~JOOIHKTDUIB2.1 size=246820 2024-09-14T11:17:30.213 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.214+0000 7fe125ff88c0 1 > prepared multipart upload key=YN2HI39GPEDF upload=JOOIHKTDUIB2 tag=NBV5QIWLBS43 type=write size=2343972 2024-09-14T11:17:30.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.218+0000 7fe125ff88c0 1 < suggested update operation key=N94D3R7IOBNL tag=I6I5JU39OQR7 type=write size=645940 2024-09-14T11:17:30.224 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.222+0000 7fe125ff88c0 1 > prepared operation key=3YGN50MBAF41 tag=UM5BPL7PZNJL type=del size=3608078 2024-09-14T11:17:30.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.226+0000 7fe125ff88c0 1 < completed part key=_multipart_2UXA6SXDTUFT.2~JX50N0Q4A455.0 size=1048576 2024-09-14T11:17:30.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.226+0000 7fe125ff88c0 1 < canceled part key=_multipart_2UXA6SXDTUFT.2~JX50N0Q4A455.1 size=1048576 2024-09-14T11:17:30.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.226+0000 7fe125ff88c0 1 < canceled part key=_multipart_2UXA6SXDTUFT.2~JX50N0Q4A455.2 size=23882 2024-09-14T11:17:30.233 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.234+0000 7fe125ff88c0 1 < canceled multipart upload key=2UXA6SXDTUFT upload=JX50N0Q4A455 tag=IUL10OYQLMTG type=write size=3169610 2024-09-14T11:17:30.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.238+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~0LCNTYV6262L.0 size=700911 2024-09-14T11:17:30.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.238+0000 7fe125ff88c0 1 > prepared multipart upload key=6C3JZKTB8BP3 upload=0LCNTYV6262L tag=MFL59VNOGKXT type=write size=1749487 2024-09-14T11:17:30.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.242+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~74J8QVIFS9I6.0 size=1048576 2024-09-14T11:17:30.246 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.246+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~74J8QVIFS9I6.1 size=748747 2024-09-14T11:17:30.251 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.250+0000 7fe125ff88c0 1 < completed multipart upload key=2LH5U05C2F8C upload=74J8QVIFS9I6 tag=IINDEMMBY8S2 type=write size=2845899 2024-09-14T11:17:30.257 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.258+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~WREE8ZH2WF14.0 size=693593 2024-09-14T11:17:30.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.258+0000 7fe125ff88c0 1 > prepared multipart upload key=3YGN50MBAF41 upload=WREE8ZH2WF14 tag=MKLJXU059R8E type=write size=1742169 2024-09-14T11:17:30.261 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.262+0000 7fe125ff88c0 1 < completed delete operation key=6C3JZKTB8BP3 tag=LH6V9TEKOWSA type=del 2024-09-14T11:17:30.264 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.266+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=51DH2SE60ARI type=del size=1506483 2024-09-14T11:17:30.268 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.266+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~6C1ZO0BV6AFE.0 size=1048576 2024-09-14T11:17:30.270 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.270+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~6C1ZO0BV6AFE.1 size=1033953 2024-09-14T11:17:30.276 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.278+0000 7fe125ff88c0 1 < completed multipart upload key=21HC4VMHXS6L upload=6C1ZO0BV6AFE tag=JFX261ZW5WVO type=write size=3131105 2024-09-14T11:17:30.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.282+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~L6T35UH0B3Y0.0 size=58543 2024-09-14T11:17:30.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.282+0000 7fe125ff88c0 1 > prepared multipart upload key=46ZTDBWFVSUH upload=L6T35UH0B3Y0 tag=TE76WPU1RTZP type=write size=1107119 2024-09-14T11:17:30.287 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.286+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~ARBGTBD9STO0.0 size=614848 2024-09-14T11:17:30.292 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.290+0000 7fe125ff88c0 1 < completed multipart upload key=K05LARTJ2QZ3 upload=ARBGTBD9STO0 tag=C5W4A6060HQ5 type=write size=1663424 2024-09-14T11:17:30.299 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.298+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~XMC8GCD03TKH.0 size=1048576 2024-09-14T11:17:30.302 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.302+0000 7fe125ff88c0 1 > prepared part key=_multipart_FQ5WT12KB664.2~XMC8GCD03TKH.1 size=910972 2024-09-14T11:17:30.302 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.302+0000 7fe125ff88c0 1 > prepared multipart upload key=FQ5WT12KB664 upload=XMC8GCD03TKH tag=LM0519SXI8BL type=write size=3008124 2024-09-14T11:17:30.309 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.310+0000 7fe125ff88c0 1 < completed delete operation key=0FITHLGQKQEC tag=512FSPFB9C47 type=del 2024-09-14T11:17:30.315 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.314+0000 7fe125ff88c0 1 > prepared part key=_multipart_2KEKSWK0UT6C.2~0L4P9K3AQD66.0 size=485203 2024-09-14T11:17:30.315 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.314+0000 7fe125ff88c0 1 > prepared multipart upload key=2KEKSWK0UT6C upload=0L4P9K3AQD66 tag=GPTE5KPVVC8X type=write size=1533779 2024-09-14T11:17:30.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.318+0000 7fe125ff88c0 1 < canceled operation key=L4XO0WTYKNXY tag=YWB231A0GX2F type=del size=324255 2024-09-14T11:17:30.323 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.322+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=3PXP2WD5ZXK2 type=del size=822485 2024-09-14T11:17:30.327 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.326+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~TYK8O7J1Q0BM.0 size=868012 2024-09-14T11:17:30.333 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.334+0000 7fe125ff88c0 1 < completed multipart upload key=ESVFZQQXE3GT upload=TYK8O7J1Q0BM tag=MEYHEV3XHRIK type=write size=1916588 2024-09-14T11:17:30.340 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.338+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~AMK2HYSKLF3O.0 size=962119 2024-09-14T11:17:30.340 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.338+0000 7fe125ff88c0 1 > prepared multipart upload key=6C3JZKTB8BP3 upload=AMK2HYSKLF3O tag=W36WBPXHAEZS type=write size=2010695 2024-09-14T11:17:30.343 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.342+0000 7fe125ff88c0 1 < completed delete operation key=YGEVGH840L18 tag=U1P3Z3EKCSX9 type=del 2024-09-14T11:17:30.347 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.346+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=2CLS520RYODV type=del size=58608 2024-09-14T11:17:30.351 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.350+0000 7fe125ff88c0 1 < completed write operation key=3YGN50MBAF41 tag=09I5A0JI1F9Z type=write size=264983 2024-09-14T11:17:30.354 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.354+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=1IDUIAE0E1V6 type=del size=3294345 2024-09-14T11:17:30.357 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.358+0000 7fe125ff88c0 1 < completed write operation key=6PLUU2QIO9LJ tag=SQB71HXHA9RA type=write size=940341 2024-09-14T11:17:30.361 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.362+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=5ONAJOPA6MZS type=del size=2790273 2024-09-14T11:17:30.362 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.362+0000 7fe125ff88c0 1 < canceled part key=_multipart_LYBGDNKUROWH.2~3UJB8QD5OIJF.0 size=891248 2024-09-14T11:17:30.368 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.366+0000 7fe125ff88c0 1 < canceled multipart upload key=LYBGDNKUROWH upload=3UJB8QD5OIJF tag=R7LY1Q2DLHYY type=write size=1939824 2024-09-14T11:17:30.374 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.374+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~I99XQVOBM98F.0 size=1048576 2024-09-14T11:17:30.377 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.378+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~I99XQVOBM98F.1 size=699903 2024-09-14T11:17:30.377 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.378+0000 7fe125ff88c0 1 > prepared multipart upload key=SUCH37O8V1LY upload=I99XQVOBM98F tag=P00EWSYPX6NP type=write size=2797055 2024-09-14T11:17:30.384 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.382+0000 7fe125ff88c0 1 < suggested update operation key=ESVFZQQXE3GT tag=4UB1CWFD25N7 type=del size=4069147 2024-09-14T11:17:30.387 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.386+0000 7fe125ff88c0 1 > prepared operation key=LYBGDNKUROWH tag=ZDIKUPARCPH1 type=del size=3631318 2024-09-14T11:17:30.391 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.390+0000 7fe125ff88c0 1 < completed delete operation key=K3P6U6NU8I01 tag=2ICDUNTC1W0S type=del 2024-09-14T11:17:30.394 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.394+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=8UXG36SRJOWH type=del size=1693384 2024-09-14T11:17:30.398 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.398+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~JOOIHKTDUIB2.0 size=1048576 2024-09-14T11:17:30.400 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.402+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~JOOIHKTDUIB2.1 size=246820 2024-09-14T11:17:30.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.406+0000 7fe125ff88c0 1 < completed multipart upload key=YN2HI39GPEDF upload=JOOIHKTDUIB2 tag=NBV5QIWLBS43 type=write size=2343972 2024-09-14T11:17:30.410 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.410+0000 7fe125ff88c0 1 > prepared operation key=K05LARTJ2QZ3 tag=CE2GWG6BB0PL type=del size=1794661 2024-09-14T11:17:30.414 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.414+0000 7fe125ff88c0 1 < completed delete operation key=3YGN50MBAF41 tag=UM5BPL7PZNJL type=del 2024-09-14T11:17:30.418 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.418+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=ZI8QL0EY682C type=del size=1927706 2024-09-14T11:17:30.422 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.422+0000 7fe125ff88c0 1 < completed part key=_multipart_6C3JZKTB8BP3.2~0LCNTYV6262L.0 size=700911 2024-09-14T11:17:30.428 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.426+0000 7fe125ff88c0 1 < completed multipart upload key=6C3JZKTB8BP3 upload=0LCNTYV6262L tag=MFL59VNOGKXT type=write size=1749487 2024-09-14T11:17:30.433 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.434+0000 7fe125ff88c0 1 > prepared part key=_multipart_2KEKSWK0UT6C.2~3VCEXL45YE4A.0 size=987592 2024-09-14T11:17:30.434 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.434+0000 7fe125ff88c0 1 > prepared multipart upload key=2KEKSWK0UT6C upload=3VCEXL45YE4A tag=97EUB1GRW851 type=write size=2036168 2024-09-14T11:17:30.437 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.438+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~WREE8ZH2WF14.0 size=693593 2024-09-14T11:17:30.443 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.442+0000 7fe125ff88c0 1 < completed multipart upload key=3YGN50MBAF41 upload=WREE8ZH2WF14 tag=MKLJXU059R8E type=write size=1742169 2024-09-14T11:17:30.449 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.450+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~0QSGUAS583N9.0 size=1048576 2024-09-14T11:17:30.452 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.450+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~0QSGUAS583N9.1 size=169241 2024-09-14T11:17:30.452 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.454+0000 7fe125ff88c0 1 > prepared multipart upload key=SUCH37O8V1LY upload=0QSGUAS583N9 tag=UBV0555DDATC type=write size=2266393 2024-09-14T11:17:30.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.454+0000 7fe125ff88c0 1 < completed delete operation key=0VBX2FWYCFEZ tag=51DH2SE60ARI type=del 2024-09-14T11:17:30.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.458+0000 7fe125ff88c0 1 > prepared operation key=K05LARTJ2QZ3 tag=DYD0GKDKGQ48 type=del size=1270392 2024-09-14T11:17:30.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.462+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~L6T35UH0B3Y0.0 size=58543 2024-09-14T11:17:30.469 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.470+0000 7fe125ff88c0 1 < completed multipart upload key=46ZTDBWFVSUH upload=L6T35UH0B3Y0 tag=TE76WPU1RTZP type=write size=1107119 2024-09-14T11:17:30.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.474+0000 7fe125ff88c0 1 > prepared operation key=6C3JZKTB8BP3 tag=JMWIMWBTLR17 type=del size=3843285 2024-09-14T11:17:30.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.474+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~XMC8GCD03TKH.0 size=1048576 2024-09-14T11:17:30.478 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.478+0000 7fe125ff88c0 1 < completed part key=_multipart_FQ5WT12KB664.2~XMC8GCD03TKH.1 size=910972 2024-09-14T11:17:30.484 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.482+0000 7fe125ff88c0 1 < completed multipart upload key=FQ5WT12KB664 upload=XMC8GCD03TKH tag=LM0519SXI8BL type=write size=3008124 2024-09-14T11:17:30.487 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.486+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=MDKJBK36MQ7B type=del size=290937 2024-09-14T11:17:30.491 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.490+0000 7fe125ff88c0 1 < completed part key=_multipart_2KEKSWK0UT6C.2~0L4P9K3AQD66.0 size=485203 2024-09-14T11:17:30.497 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.498+0000 7fe125ff88c0 1 < completed multipart upload key=2KEKSWK0UT6C upload=0L4P9K3AQD66 tag=GPTE5KPVVC8X type=write size=1533779 2024-09-14T11:17:30.501 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.502+0000 7fe125ff88c0 1 > prepared operation key=2UXA6SXDTUFT tag=P2XZU84WA7LH type=del size=2161265 2024-09-14T11:17:30.505 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.506+0000 7fe125ff88c0 1 < completed delete operation key=2UXA6SXDTUFT tag=3PXP2WD5ZXK2 type=del 2024-09-14T11:17:30.508 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.510+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=14OKZLWL2FIT type=del size=2039644 2024-09-14T11:17:30.509 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.510+0000 7fe125ff88c0 1 < canceled part key=_multipart_6C3JZKTB8BP3.2~AMK2HYSKLF3O.0 size=962119 2024-09-14T11:17:30.515 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.514+0000 7fe125ff88c0 1 < canceled multipart upload key=6C3JZKTB8BP3 upload=AMK2HYSKLF3O tag=W36WBPXHAEZS type=write size=2010695 2024-09-14T11:17:30.519 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.518+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=7308R5UIKVC1 type=del size=2317313 2024-09-14T11:17:30.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.522+0000 7fe125ff88c0 1 < completed delete operation key=2KEKSWK0UT6C tag=2CLS520RYODV type=del 2024-09-14T11:17:30.526 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.526+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=T4BKJ9F4CNVQ type=write size=975298 2024-09-14T11:17:30.530 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.530+0000 7fe125ff88c0 1 < completed delete operation key=K3P6U6NU8I01 tag=1IDUIAE0E1V6 type=del 2024-09-14T11:17:30.534 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.534+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=FF2XP4FJMT8C type=del size=1172806 2024-09-14T11:17:30.538 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.538+0000 7fe125ff88c0 -1 < failed to complete operation key=ESVFZQQXE3GT tag=5ONAJOPA6MZS type=del size=2790273: (22) Invalid argument 2024-09-14T11:17:30.545 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.546+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~TRZ4INSTGTMV.0 size=1048576 2024-09-14T11:17:30.548 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.546+0000 7fe125ff88c0 1 > prepared part key=_multipart_0FITHLGQKQEC.2~TRZ4INSTGTMV.1 size=238632 2024-09-14T11:17:30.548 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.546+0000 7fe125ff88c0 1 > prepared multipart upload key=0FITHLGQKQEC upload=TRZ4INSTGTMV tag=MTVN017C1WRM type=write size=2335784 2024-09-14T11:17:30.552 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.550+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~I99XQVOBM98F.0 size=1048576 2024-09-14T11:17:30.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.554+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~I99XQVOBM98F.1 size=699903 2024-09-14T11:17:30.561 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.562+0000 7fe125ff88c0 1 < completed multipart upload key=SUCH37O8V1LY upload=I99XQVOBM98F tag=P00EWSYPX6NP type=write size=2797055 2024-09-14T11:17:30.567 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.566+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~OYW510OIZZQ4.0 size=1048576 2024-09-14T11:17:30.570 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.570+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~OYW510OIZZQ4.1 size=1048576 2024-09-14T11:17:30.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.574+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~OYW510OIZZQ4.2 size=888317 2024-09-14T11:17:30.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.574+0000 7fe125ff88c0 1 > prepared multipart upload key=K05LARTJ2QZ3 upload=OYW510OIZZQ4 tag=CWNNHX6WF846 type=write size=4034045 2024-09-14T11:17:30.581 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.582+0000 7fe125ff88c0 1 < suggested remove operation key=LYBGDNKUROWH tag=ZDIKUPARCPH1 type=del 2024-09-14T11:17:30.584 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.586+0000 7fe125ff88c0 1 > prepared operation key=6C3JZKTB8BP3 tag=NC8E3LLH18F8 type=del size=2446572 2024-09-14T11:17:30.589 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.590+0000 7fe125ff88c0 1 < completed delete operation key=6PLUU2QIO9LJ tag=8UXG36SRJOWH type=del 2024-09-14T11:17:30.593 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.594+0000 7fe125ff88c0 1 > prepared operation key=FQ5WT12KB664 tag=47BUIL1AK7IL type=del size=4071539 2024-09-14T11:17:30.601 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.602+0000 7fe125ff88c0 1 < suggested remove operation key=K05LARTJ2QZ3 tag=CE2GWG6BB0PL type=del 2024-09-14T11:17:30.605 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.606+0000 7fe125ff88c0 1 > prepared operation key=YCF2PCJ9TZMR tag=AOMMTBT1NWKK type=del size=677337 2024-09-14T11:17:30.609 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.610+0000 7fe125ff88c0 1 < completed delete operation key=V6B470G93KFT tag=ZI8QL0EY682C type=del 2024-09-14T11:17:30.616 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.614+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~E60E2BNW591Y.0 size=1048576 2024-09-14T11:17:30.619 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.618+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~E60E2BNW591Y.1 size=1048576 2024-09-14T11:17:30.621 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.622+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~E60E2BNW591Y.2 size=372929 2024-09-14T11:17:30.622 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.622+0000 7fe125ff88c0 1 > prepared multipart upload key=LYBGDNKUROWH upload=E60E2BNW591Y tag=0MO0EW1GVZR0 type=write size=3518657 2024-09-14T11:17:30.623 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.622+0000 7fe125ff88c0 1 < canceled part key=_multipart_2KEKSWK0UT6C.2~3VCEXL45YE4A.0 size=987592 2024-09-14T11:17:30.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.630+0000 7fe125ff88c0 1 < canceled multipart upload key=2KEKSWK0UT6C upload=3VCEXL45YE4A tag=97EUB1GRW851 type=write size=2036168 2024-09-14T11:17:30.637 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.638+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~E0H686TZ5AMD.0 size=1048576 2024-09-14T11:17:30.640 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.642+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~E0H686TZ5AMD.1 size=1048576 2024-09-14T11:17:30.644 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.642+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~E0H686TZ5AMD.2 size=142472 2024-09-14T11:17:30.644 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.642+0000 7fe125ff88c0 1 > prepared multipart upload key=YFRH8WECBTJK upload=E0H686TZ5AMD tag=G9DNHGANJ0MV type=write size=3288200 2024-09-14T11:17:30.647 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.646+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~0QSGUAS583N9.0 size=1048576 2024-09-14T11:17:30.655 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.654+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~0QSGUAS583N9.1 size=169241 2024-09-14T11:17:30.661 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.662+0000 7fe125ff88c0 1 < completed multipart upload key=SUCH37O8V1LY upload=0QSGUAS583N9 tag=UBV0555DDATC type=write size=2266393 2024-09-14T11:17:30.665 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.666+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=OD2ZGVXZQ9TD type=del size=4097352 2024-09-14T11:17:30.669 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.670+0000 7fe125ff88c0 -1 < failed to complete operation key=K05LARTJ2QZ3 tag=DYD0GKDKGQ48 type=del size=1270392: (22) Invalid argument 2024-09-14T11:17:30.673 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.674+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=SB6Y3JPPU3H4 type=del size=3020376 2024-09-14T11:17:30.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.678+0000 7fe125ff88c0 1 < completed delete operation key=6C3JZKTB8BP3 tag=JMWIMWBTLR17 type=del 2024-09-14T11:17:30.684 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.682+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~O1NCQBOAZIFA.0 size=1048576 2024-09-14T11:17:30.687 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.686+0000 7fe125ff88c0 1 > prepared part key=_multipart_L4XO0WTYKNXY.2~O1NCQBOAZIFA.1 size=392303 2024-09-14T11:17:30.687 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.686+0000 7fe125ff88c0 1 > prepared multipart upload key=L4XO0WTYKNXY upload=O1NCQBOAZIFA tag=4KER51JDND85 type=write size=2489455 2024-09-14T11:17:30.692 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.690+0000 7fe125ff88c0 1 < canceled operation key=ESVFZQQXE3GT tag=MDKJBK36MQ7B type=del size=290937 2024-09-14T11:17:30.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.698+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~OD9O7ZQ0873F.0 size=1048576 2024-09-14T11:17:30.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.702+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~OD9O7ZQ0873F.1 size=1048576 2024-09-14T11:17:30.705 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.706+0000 7fe125ff88c0 1 > prepared part key=_multipart_6C3JZKTB8BP3.2~OD9O7ZQ0873F.2 size=939980 2024-09-14T11:17:30.705 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.706+0000 7fe125ff88c0 1 > prepared multipart upload key=6C3JZKTB8BP3 upload=OD9O7ZQ0873F tag=V0V8ML7OBQNI type=write size=4085708 2024-09-14T11:17:30.709 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.710+0000 7fe125ff88c0 1 < completed delete operation key=2UXA6SXDTUFT tag=P2XZU84WA7LH type=del 2024-09-14T11:17:30.717 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.718+0000 7fe125ff88c0 1 > prepared part key=_multipart_YN2HI39GPEDF.2~0UDLS8PVMBK0.0 size=708448 2024-09-14T11:17:30.717 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.718+0000 7fe125ff88c0 1 > prepared multipart upload key=YN2HI39GPEDF upload=0UDLS8PVMBK0 tag=J752I396OMOV type=write size=1757024 2024-09-14T11:17:30.721 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.722+0000 7fe125ff88c0 1 < completed delete operation key=2KEKSWK0UT6C tag=14OKZLWL2FIT type=del 2024-09-14T11:17:30.729 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.730+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~VOA86BVQHOXO.0 size=1048576 2024-09-14T11:17:30.732 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.730+0000 7fe125ff88c0 1 > prepared part key=_multipart_V6B470G93KFT.2~VOA86BVQHOXO.1 size=644957 2024-09-14T11:17:30.732 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.730+0000 7fe125ff88c0 1 > prepared multipart upload key=V6B470G93KFT upload=VOA86BVQHOXO tag=GPMF4LW9XLA6 type=write size=2742109 2024-09-14T11:17:30.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.734+0000 7fe125ff88c0 1 < completed delete operation key=K3P6U6NU8I01 tag=7308R5UIKVC1 type=del 2024-09-14T11:17:30.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.742+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~9NFGVKC50DPX.0 size=1048576 2024-09-14T11:17:30.746 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.746+0000 7fe125ff88c0 1 > prepared part key=_multipart_3YGN50MBAF41.2~9NFGVKC50DPX.1 size=189176 2024-09-14T11:17:30.746 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.746+0000 7fe125ff88c0 1 > prepared multipart upload key=3YGN50MBAF41 upload=9NFGVKC50DPX tag=OPC5I40204IA type=write size=2286328 2024-09-14T11:17:30.749 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.750+0000 7fe125ff88c0 1 < completed write operation key=6PLUU2QIO9LJ tag=T4BKJ9F4CNVQ type=write size=975298 2024-09-14T11:17:30.753 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.754+0000 7fe125ff88c0 1 > prepared operation key=SUCH37O8V1LY tag=F8237PJRUB84 type=del size=1647425 2024-09-14T11:17:30.757 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.758+0000 7fe125ff88c0 1 < completed delete operation key=0VBX2FWYCFEZ tag=FF2XP4FJMT8C type=del 2024-09-14T11:17:30.761 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.762+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=CA0VDRQH4T1S type=del size=1012017 2024-09-14T11:17:30.764 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.766+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~TRZ4INSTGTMV.0 size=1048576 2024-09-14T11:17:30.768 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.766+0000 7fe125ff88c0 1 < completed part key=_multipart_0FITHLGQKQEC.2~TRZ4INSTGTMV.1 size=238632 2024-09-14T11:17:30.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.774+0000 7fe125ff88c0 1 < completed multipart upload key=0FITHLGQKQEC upload=TRZ4INSTGTMV tag=MTVN017C1WRM type=write size=2335784 2024-09-14T11:17:30.777 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.778+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=FI0NQKUT1H7D type=del size=2096582 2024-09-14T11:17:30.781 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.782+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~OYW510OIZZQ4.0 size=1048576 2024-09-14T11:17:30.784 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.782+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~OYW510OIZZQ4.1 size=1048576 2024-09-14T11:17:30.787 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.786+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~OYW510OIZZQ4.2 size=888317 2024-09-14T11:17:30.793 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.794+0000 7fe125ff88c0 1 < completed multipart upload key=K05LARTJ2QZ3 upload=OYW510OIZZQ4 tag=CWNNHX6WF846 type=write size=4034045 2024-09-14T11:17:30.797 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.798+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=41BRZYUB2R65 type=del size=334298 2024-09-14T11:17:30.801 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.802+0000 7fe125ff88c0 1 < completed delete operation key=6C3JZKTB8BP3 tag=NC8E3LLH18F8 type=del 2024-09-14T11:17:30.805 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.806+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=9YWETR7CM8BI type=del size=693610 2024-09-14T11:17:30.809 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.810+0000 7fe125ff88c0 1 < completed delete operation key=FQ5WT12KB664 tag=47BUIL1AK7IL type=del 2024-09-14T11:17:30.813 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.814+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=EE2WKHVKUKYO type=del size=1339241 2024-09-14T11:17:30.816 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.818+0000 7fe125ff88c0 1 < completed delete operation key=YCF2PCJ9TZMR tag=AOMMTBT1NWKK type=del 2024-09-14T11:17:30.820 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.822+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=1GVZF93SR2C4 type=del size=3754524 2024-09-14T11:17:30.824 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.826+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~E60E2BNW591Y.0 size=1048576 2024-09-14T11:17:30.824 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.826+0000 7fe125ff88c0 1 < canceled part key=_multipart_LYBGDNKUROWH.2~E60E2BNW591Y.1 size=1048576 2024-09-14T11:17:30.827 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.826+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~E60E2BNW591Y.2 size=372929 2024-09-14T11:17:30.833 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.834+0000 7fe125ff88c0 1 < canceled multipart upload key=LYBGDNKUROWH upload=E60E2BNW591Y tag=0MO0EW1GVZR0 type=write size=3518657 2024-09-14T11:17:30.840 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.838+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~19U33FXDNCRV.0 size=1048576 2024-09-14T11:17:30.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.842+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~19U33FXDNCRV.1 size=1048576 2024-09-14T11:17:30.846 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.846+0000 7fe125ff88c0 1 > prepared part key=_multipart_1ML6RIXI4C5P.2~19U33FXDNCRV.2 size=424833 2024-09-14T11:17:30.846 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.846+0000 7fe125ff88c0 1 > prepared multipart upload key=1ML6RIXI4C5P upload=19U33FXDNCRV tag=OLCDSDVJSGUA type=write size=3570561 2024-09-14T11:17:30.850 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.850+0000 7fe125ff88c0 1 < completed part key=_multipart_YFRH8WECBTJK.2~E0H686TZ5AMD.0 size=1048576 2024-09-14T11:17:30.853 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.854+0000 7fe125ff88c0 1 < completed part key=_multipart_YFRH8WECBTJK.2~E0H686TZ5AMD.1 size=1048576 2024-09-14T11:17:30.856 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.854+0000 7fe125ff88c0 1 < completed part key=_multipart_YFRH8WECBTJK.2~E0H686TZ5AMD.2 size=142472 2024-09-14T11:17:30.861 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.862+0000 7fe125ff88c0 1 < completed multipart upload key=YFRH8WECBTJK upload=E0H686TZ5AMD tag=G9DNHGANJ0MV type=write size=3288200 2024-09-14T11:17:30.865 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.866+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=U7D31UH16T5Z type=write size=1006781 2024-09-14T11:17:30.869 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.870+0000 7fe125ff88c0 1 < completed delete operation key=2LH5U05C2F8C tag=OD2ZGVXZQ9TD type=del 2024-09-14T11:17:30.876 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.874+0000 7fe125ff88c0 1 > prepared part key=_multipart_2KEKSWK0UT6C.2~QGEHHA3TXC6I.0 size=1031721 2024-09-14T11:17:30.876 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.874+0000 7fe125ff88c0 1 > prepared multipart upload key=2KEKSWK0UT6C upload=QGEHHA3TXC6I tag=DQHZTQCNIZI0 type=write size=2080297 2024-09-14T11:17:30.880 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.882+0000 7fe125ff88c0 1 < completed delete operation key=F9I82N7RQC81 tag=SB6Y3JPPU3H4 type=del 2024-09-14T11:17:30.884 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.882+0000 7fe125ff88c0 1 > prepared operation key=6C3JZKTB8BP3 tag=VISL9FHU3JUC type=write size=93461 2024-09-14T11:17:30.889 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.890+0000 7fe125ff88c0 1 < completed part key=_multipart_L4XO0WTYKNXY.2~O1NCQBOAZIFA.0 size=1048576 2024-09-14T11:17:30.892 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.890+0000 7fe125ff88c0 1 < completed part key=_multipart_L4XO0WTYKNXY.2~O1NCQBOAZIFA.1 size=392303 2024-09-14T11:17:30.898 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.898+0000 7fe125ff88c0 1 < completed multipart upload key=L4XO0WTYKNXY upload=O1NCQBOAZIFA tag=4KER51JDND85 type=write size=2489455 2024-09-14T11:17:30.902 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.902+0000 7fe125ff88c0 1 > prepared operation key=SUCH37O8V1LY tag=QCH02ALXDN0G type=write size=1024624 2024-09-14T11:17:30.906 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.906+0000 7fe125ff88c0 1 < completed part key=_multipart_6C3JZKTB8BP3.2~OD9O7ZQ0873F.0 size=1048576 2024-09-14T11:17:30.906 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.906+0000 7fe125ff88c0 1 < canceled part key=_multipart_6C3JZKTB8BP3.2~OD9O7ZQ0873F.1 size=1048576 2024-09-14T11:17:30.909 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.910+0000 7fe125ff88c0 1 < completed part key=_multipart_6C3JZKTB8BP3.2~OD9O7ZQ0873F.2 size=939980 2024-09-14T11:17:30.916 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.918+0000 7fe125ff88c0 1 < canceled multipart upload key=6C3JZKTB8BP3 upload=OD9O7ZQ0873F tag=V0V8ML7OBQNI type=write size=4085708 2024-09-14T11:17:30.923 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.922+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~E335DEYCFZ06.0 size=1048576 2024-09-14T11:17:30.926 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.926+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~E335DEYCFZ06.1 size=1048576 2024-09-14T11:17:30.929 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.930+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~E335DEYCFZ06.2 size=751265 2024-09-14T11:17:30.930 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.930+0000 7fe125ff88c0 1 > prepared multipart upload key=F9I82N7RQC81 upload=E335DEYCFZ06 tag=DH32IDDGQV5V type=write size=3896993 2024-09-14T11:17:30.934 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.934+0000 7fe125ff88c0 1 < completed part key=_multipart_YN2HI39GPEDF.2~0UDLS8PVMBK0.0 size=708448 2024-09-14T11:17:30.941 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.942+0000 7fe125ff88c0 1 < completed multipart upload key=YN2HI39GPEDF upload=0UDLS8PVMBK0 tag=J752I396OMOV type=write size=1757024 2024-09-14T11:17:30.945 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.946+0000 7fe125ff88c0 1 > prepared operation key=YGEVGH840L18 tag=YS2GVSD1M1OS type=del size=2800897 2024-09-14T11:17:30.949 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.950+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~VOA86BVQHOXO.0 size=1048576 2024-09-14T11:17:30.952 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.950+0000 7fe125ff88c0 1 < completed part key=_multipart_V6B470G93KFT.2~VOA86BVQHOXO.1 size=644957 2024-09-14T11:17:30.959 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.958+0000 7fe125ff88c0 1 < completed multipart upload key=V6B470G93KFT upload=VOA86BVQHOXO tag=GPMF4LW9XLA6 type=write size=2742109 2024-09-14T11:17:30.966 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.966+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~MBD39GH6LXTA.0 size=1048576 2024-09-14T11:17:30.968 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.970+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~MBD39GH6LXTA.1 size=1048576 2024-09-14T11:17:30.971 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.970+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~MBD39GH6LXTA.2 size=881931 2024-09-14T11:17:30.971 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.970+0000 7fe125ff88c0 1 > prepared multipart upload key=YFRH8WECBTJK upload=MBD39GH6LXTA tag=WICQTLBR4LT2 type=write size=4027659 2024-09-14T11:17:30.975 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.974+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~9NFGVKC50DPX.0 size=1048576 2024-09-14T11:17:30.977 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.978+0000 7fe125ff88c0 1 < completed part key=_multipart_3YGN50MBAF41.2~9NFGVKC50DPX.1 size=189176 2024-09-14T11:17:30.984 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.982+0000 7fe125ff88c0 1 < completed multipart upload key=3YGN50MBAF41 upload=9NFGVKC50DPX tag=OPC5I40204IA type=write size=2286328 2024-09-14T11:17:30.990 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.990+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~SYDLBPBOT5CE.0 size=465589 2024-09-14T11:17:30.990 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.990+0000 7fe125ff88c0 1 > prepared multipart upload key=3OU4U9JF3ZD5 upload=SYDLBPBOT5CE tag=AK8OQLUPVHXF type=write size=1514165 2024-09-14T11:17:30.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.994+0000 7fe125ff88c0 1 < completed delete operation key=SUCH37O8V1LY tag=F8237PJRUB84 type=del 2024-09-14T11:17:30.998 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:30.998+0000 7fe125ff88c0 1 > prepared operation key=V6B470G93KFT tag=GZW4CREG12MV type=del size=1867269 2024-09-14T11:17:31.001 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.002+0000 7fe125ff88c0 1 < completed delete operation key=2KEKSWK0UT6C tag=CA0VDRQH4T1S type=del 2024-09-14T11:17:31.011 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.010+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~GCXCQB5YLMXW.0 size=250807 2024-09-14T11:17:31.011 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.010+0000 7fe125ff88c0 1 > prepared multipart upload key=2LH5U05C2F8C upload=GCXCQB5YLMXW tag=ZU2I775KVUQB type=write size=1299383 2024-09-14T11:17:31.014 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.014+0000 7fe125ff88c0 1 < completed delete operation key=21HC4VMHXS6L tag=FI0NQKUT1H7D type=del 2024-09-14T11:17:31.016 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.018+0000 7fe125ff88c0 1 > prepared operation key=W0B19NBHNLMZ tag=PTY3FCV175UV type=del size=887575 2024-09-14T11:17:31.020 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.022+0000 7fe125ff88c0 1 < completed delete operation key=YGEVGH840L18 tag=41BRZYUB2R65 type=del 2024-09-14T11:17:31.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.026+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~IWOXM22IMUWW.0 size=332433 2024-09-14T11:17:31.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.026+0000 7fe125ff88c0 1 > prepared multipart upload key=46ZTDBWFVSUH upload=IWOXM22IMUWW tag=RBI2YG93L6X4 type=write size=1381009 2024-09-14T11:17:31.030 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.030+0000 7fe125ff88c0 1 < canceled operation key=6PLUU2QIO9LJ tag=9YWETR7CM8BI type=del size=693610 2024-09-14T11:17:31.034 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.034+0000 7fe125ff88c0 1 > prepared operation key=3YGN50MBAF41 tag=904EYHZFPJPF type=del size=2050446 2024-09-14T11:17:31.039 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.038+0000 7fe125ff88c0 1 < suggested remove operation key=6PLUU2QIO9LJ tag=EE2WKHVKUKYO type=del 2024-09-14T11:17:31.044 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.042+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~NCPH9N0BOSH8.0 size=1041398 2024-09-14T11:17:31.044 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.042+0000 7fe125ff88c0 1 > prepared multipart upload key=LYBGDNKUROWH upload=NCPH9N0BOSH8 tag=Y57QFUOSY5ZR type=write size=2089974 2024-09-14T11:17:31.046 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.046+0000 7fe125ff88c0 1 < completed delete operation key=L4XO0WTYKNXY tag=1GVZF93SR2C4 type=del 2024-09-14T11:17:31.049 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.050+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=J2F1RS4KGI7O type=del size=945511 2024-09-14T11:17:31.052 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.050+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~19U33FXDNCRV.0 size=1048576 2024-09-14T11:17:31.054 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.054+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~19U33FXDNCRV.1 size=1048576 2024-09-14T11:17:31.056 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.054+0000 7fe125ff88c0 1 < completed part key=_multipart_1ML6RIXI4C5P.2~19U33FXDNCRV.2 size=424833 2024-09-14T11:17:31.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.062+0000 7fe125ff88c0 1 < completed multipart upload key=1ML6RIXI4C5P upload=19U33FXDNCRV tag=OLCDSDVJSGUA type=write size=3570561 2024-09-14T11:17:31.066 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.066+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~JRMWH111ADTV.0 size=1048576 2024-09-14T11:17:31.068 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.066+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~JRMWH111ADTV.1 size=1048576 2024-09-14T11:17:31.070 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.070+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~JRMWH111ADTV.2 size=688693 2024-09-14T11:17:31.070 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.070+0000 7fe125ff88c0 1 > prepared multipart upload key=ESVFZQQXE3GT upload=JRMWH111ADTV tag=8GIASJNLXZGT type=write size=3834421 2024-09-14T11:17:31.073 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.074+0000 7fe125ff88c0 1 < completed write operation key=YGEVGH840L18 tag=U7D31UH16T5Z type=write size=1006781 2024-09-14T11:17:31.075 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.074+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=08CJ3TPQPCZM type=del size=3511425 2024-09-14T11:17:31.078 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.078+0000 7fe125ff88c0 1 < completed part key=_multipart_2KEKSWK0UT6C.2~QGEHHA3TXC6I.0 size=1031721 2024-09-14T11:17:31.082 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.082+0000 7fe125ff88c0 1 < completed multipart upload key=2KEKSWK0UT6C upload=QGEHHA3TXC6I tag=DQHZTQCNIZI0 type=write size=2080297 2024-09-14T11:17:31.085 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.086+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=IIW5SHXCSFJI type=del size=2410234 2024-09-14T11:17:31.091 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.090+0000 7fe125ff88c0 1 < suggested update operation key=6C3JZKTB8BP3 tag=VISL9FHU3JUC type=write size=93461 2024-09-14T11:17:31.094 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.094+0000 7fe125ff88c0 1 > prepared operation key=SSNV25PDLDIS tag=DS20V90MKA4Q type=del size=2592366 2024-09-14T11:17:31.097 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.098+0000 7fe125ff88c0 1 < completed write operation key=SUCH37O8V1LY tag=QCH02ALXDN0G type=write size=1024624 2024-09-14T11:17:31.100 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.098+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=XJYED3NTXS0C type=del size=3203947 2024-09-14T11:17:31.103 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.102+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~E335DEYCFZ06.0 size=1048576 2024-09-14T11:17:31.105 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.106+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~E335DEYCFZ06.1 size=1048576 2024-09-14T11:17:31.107 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.106+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~E335DEYCFZ06.2 size=751265 2024-09-14T11:17:31.112 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.110+0000 7fe125ff88c0 1 < completed multipart upload key=F9I82N7RQC81 upload=E335DEYCFZ06 tag=DH32IDDGQV5V type=write size=3896993 2024-09-14T11:17:31.115 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.114+0000 7fe125ff88c0 1 > prepared operation key=46ZTDBWFVSUH tag=0N6S5Z7ZWZ4J type=del size=3605955 2024-09-14T11:17:31.122 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.122+0000 7fe125ff88c0 1 < suggested remove operation key=YGEVGH840L18 tag=YS2GVSD1M1OS type=del 2024-09-14T11:17:31.127 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.126+0000 7fe125ff88c0 1 > prepared part key=_multipart_N94D3R7IOBNL.2~SMW85DG1FVHG.0 size=55183 2024-09-14T11:17:31.127 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.126+0000 7fe125ff88c0 1 > prepared multipart upload key=N94D3R7IOBNL upload=SMW85DG1FVHG tag=3LXD4CQZTA55 type=write size=1103759 2024-09-14T11:17:31.130 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.130+0000 7fe125ff88c0 1 < completed part key=_multipart_YFRH8WECBTJK.2~MBD39GH6LXTA.0 size=1048576 2024-09-14T11:17:31.132 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.130+0000 7fe125ff88c0 1 < completed part key=_multipart_YFRH8WECBTJK.2~MBD39GH6LXTA.1 size=1048576 2024-09-14T11:17:31.135 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.134+0000 7fe125ff88c0 1 < completed part key=_multipart_YFRH8WECBTJK.2~MBD39GH6LXTA.2 size=881931 2024-09-14T11:17:31.139 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.138+0000 7fe125ff88c0 1 < completed multipart upload key=YFRH8WECBTJK upload=MBD39GH6LXTA tag=WICQTLBR4LT2 type=write size=4027659 2024-09-14T11:17:31.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.142+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=F94CJJRD0GT4 type=del size=2668148 2024-09-14T11:17:31.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.146+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~SYDLBPBOT5CE.0 size=465589 2024-09-14T11:17:31.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.150+0000 7fe125ff88c0 1 < completed multipart upload key=3OU4U9JF3ZD5 upload=SYDLBPBOT5CE tag=AK8OQLUPVHXF type=write size=1514165 2024-09-14T11:17:31.155 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.154+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=HVU5BVY65FS2 type=del size=688951 2024-09-14T11:17:31.158 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.158+0000 7fe125ff88c0 1 < completed delete operation key=V6B470G93KFT tag=GZW4CREG12MV type=del 2024-09-14T11:17:31.162 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.162+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=I0260OJMY1EH type=del size=1304250 2024-09-14T11:17:31.162 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.162+0000 7fe125ff88c0 1 < canceled part key=_multipart_2LH5U05C2F8C.2~GCXCQB5YLMXW.0 size=250807 2024-09-14T11:17:31.167 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.166+0000 7fe125ff88c0 1 < canceled multipart upload key=2LH5U05C2F8C upload=GCXCQB5YLMXW tag=ZU2I775KVUQB type=write size=1299383 2024-09-14T11:17:31.171 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.170+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=PHOBR58MFZ9P type=write size=475049 2024-09-14T11:17:31.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.174+0000 7fe125ff88c0 1 < completed delete operation key=W0B19NBHNLMZ tag=PTY3FCV175UV type=del 2024-09-14T11:17:31.182 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.182+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~FPVMB973FOI0.0 size=362379 2024-09-14T11:17:31.182 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.182+0000 7fe125ff88c0 1 > prepared multipart upload key=3OU4U9JF3ZD5 upload=FPVMB973FOI0 tag=F6Y0LVSCMYP7 type=write size=1410955 2024-09-14T11:17:31.186 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.186+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~IWOXM22IMUWW.0 size=332433 2024-09-14T11:17:31.192 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.190+0000 7fe125ff88c0 1 < completed multipart upload key=46ZTDBWFVSUH upload=IWOXM22IMUWW tag=RBI2YG93L6X4 type=write size=1381009 2024-09-14T11:17:31.198 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.198+0000 7fe125ff88c0 1 > prepared part key=_multipart_WEA3MQ0DI42N.2~A2I8ZHZXNYY1.0 size=1048576 2024-09-14T11:17:31.201 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.202+0000 7fe125ff88c0 1 > prepared part key=_multipart_WEA3MQ0DI42N.2~A2I8ZHZXNYY1.1 size=289776 2024-09-14T11:17:31.202 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.202+0000 7fe125ff88c0 1 > prepared multipart upload key=WEA3MQ0DI42N upload=A2I8ZHZXNYY1 tag=1YWSO2FUCU5N type=write size=2386928 2024-09-14T11:17:31.206 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.206+0000 7fe125ff88c0 1 < completed delete operation key=3YGN50MBAF41 tag=904EYHZFPJPF type=del 2024-09-14T11:17:31.212 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.214+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~A23NHM7JAUNO.0 size=1048576 2024-09-14T11:17:31.215 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.214+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~A23NHM7JAUNO.1 size=1048576 2024-09-14T11:17:31.218 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.218+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~A23NHM7JAUNO.2 size=707157 2024-09-14T11:17:31.218 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.218+0000 7fe125ff88c0 1 > prepared multipart upload key=21HC4VMHXS6L upload=A23NHM7JAUNO tag=L3KQ3NW74Q7U type=write size=3852885 2024-09-14T11:17:31.222 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.222+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~NCPH9N0BOSH8.0 size=1041398 2024-09-14T11:17:31.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.226+0000 7fe125ff88c0 1 < completed multipart upload key=LYBGDNKUROWH upload=NCPH9N0BOSH8 tag=Y57QFUOSY5ZR type=write size=2089974 2024-09-14T11:17:31.233 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.234+0000 7fe125ff88c0 1 > prepared part key=_multipart_2LH5U05C2F8C.2~BYKRNIMIEBUG.0 size=894548 2024-09-14T11:17:31.234 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.234+0000 7fe125ff88c0 1 > prepared multipart upload key=2LH5U05C2F8C upload=BYKRNIMIEBUG tag=V9HR3VE3UZV9 type=write size=1943124 2024-09-14T11:17:31.236 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.238+0000 7fe125ff88c0 1 < canceled operation key=2LH5U05C2F8C tag=J2F1RS4KGI7O type=del size=945511 2024-09-14T11:17:31.242 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.242+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~28WTECIC7RCX.0 size=1048576 2024-09-14T11:17:31.244 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.246+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~28WTECIC7RCX.1 size=938495 2024-09-14T11:17:31.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.246+0000 7fe125ff88c0 1 > prepared multipart upload key=46ZTDBWFVSUH upload=28WTECIC7RCX tag=DQXOSA10RBBH type=write size=3035647 2024-09-14T11:17:31.247 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.246+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~JRMWH111ADTV.0 size=1048576 2024-09-14T11:17:31.250 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.250+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~JRMWH111ADTV.1 size=1048576 2024-09-14T11:17:31.252 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.254+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~JRMWH111ADTV.2 size=688693 2024-09-14T11:17:31.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.258+0000 7fe125ff88c0 1 < completed multipart upload key=ESVFZQQXE3GT upload=JRMWH111ADTV tag=8GIASJNLXZGT type=write size=3834421 2024-09-14T11:17:31.261 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.262+0000 7fe125ff88c0 1 > prepared operation key=LYBGDNKUROWH tag=7SVVKT9Y37MA type=del size=3556832 2024-09-14T11:17:31.264 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.262+0000 7fe125ff88c0 1 < completed delete operation key=2KEKSWK0UT6C tag=08CJ3TPQPCZM type=del 2024-09-14T11:17:31.270 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.270+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~ERVHVVKVCBLX.0 size=1048576 2024-09-14T11:17:31.272 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.270+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~ERVHVVKVCBLX.1 size=1048576 2024-09-14T11:17:31.274 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.274+0000 7fe125ff88c0 1 > prepared part key=_multipart_ESVFZQQXE3GT.2~ERVHVVKVCBLX.2 size=477336 2024-09-14T11:17:31.274 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.274+0000 7fe125ff88c0 1 > prepared multipart upload key=ESVFZQQXE3GT upload=ERVHVVKVCBLX tag=IUK2EMQQSNCX type=write size=3623064 2024-09-14T11:17:31.278 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.278+0000 7fe125ff88c0 1 < completed delete operation key=6PLUU2QIO9LJ tag=IIW5SHXCSFJI type=del 2024-09-14T11:17:31.281 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.282+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=0Z0A3IF84JIY type=write size=681507 2024-09-14T11:17:31.284 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.282+0000 7fe125ff88c0 1 < completed delete operation key=SSNV25PDLDIS tag=DS20V90MKA4Q type=del 2024-09-14T11:17:31.289 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.290+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~K74FT1X0J0NC.0 size=742534 2024-09-14T11:17:31.289 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.290+0000 7fe125ff88c0 1 > prepared multipart upload key=SUCH37O8V1LY upload=K74FT1X0J0NC tag=YJMN939N8LPM type=write size=1791110 2024-09-14T11:17:31.299 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.298+0000 7fe125ff88c0 1 < suggested update operation key=ESVFZQQXE3GT tag=XJYED3NTXS0C type=del size=3203947 2024-09-14T11:17:31.302 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.302+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=3C83P900BIM7 type=del size=2041879 2024-09-14T11:17:31.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.306+0000 7fe125ff88c0 1 < canceled operation key=46ZTDBWFVSUH tag=0N6S5Z7ZWZ4J type=del size=3605955 2024-09-14T11:17:31.312 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.310+0000 7fe125ff88c0 1 > prepared part key=_multipart_6PLUU2QIO9LJ.2~0X8VHVVV85YO.0 size=951502 2024-09-14T11:17:31.312 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.310+0000 7fe125ff88c0 1 > prepared multipart upload key=6PLUU2QIO9LJ upload=0X8VHVVV85YO tag=6HK7QS5HUBIG type=write size=2000078 2024-09-14T11:17:31.314 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.314+0000 7fe125ff88c0 1 < completed part key=_multipart_N94D3R7IOBNL.2~SMW85DG1FVHG.0 size=55183 2024-09-14T11:17:31.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.318+0000 7fe125ff88c0 1 < completed multipart upload key=N94D3R7IOBNL upload=SMW85DG1FVHG tag=3LXD4CQZTA55 type=write size=1103759 2024-09-14T11:17:31.322 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.322+0000 7fe125ff88c0 1 > prepared operation key=3OU4U9JF3ZD5 tag=3TFO07FGNKFF type=del size=13069 2024-09-14T11:17:31.328 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.330+0000 7fe125ff88c0 1 < suggested remove operation key=35EB6U5O4A51 tag=F94CJJRD0GT4 type=del 2024-09-14T11:17:31.331 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.330+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=UMOR6YL9FO8R type=del size=955552 2024-09-14T11:17:31.335 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.334+0000 7fe125ff88c0 1 < completed delete operation key=WEA3MQ0DI42N tag=HVU5BVY65FS2 type=del 2024-09-14T11:17:31.338 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.338+0000 7fe125ff88c0 1 > prepared operation key=SUCH37O8V1LY tag=MA6L9HGUU42H type=del size=554332 2024-09-14T11:17:31.341 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.342+0000 7fe125ff88c0 1 < completed delete operation key=2KEKSWK0UT6C tag=I0260OJMY1EH type=del 2024-09-14T11:17:31.346 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.346+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~FZSGJZGS98ED.0 size=170245 2024-09-14T11:17:31.346 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.346+0000 7fe125ff88c0 1 > prepared multipart upload key=YCF2PCJ9TZMR upload=FZSGJZGS98ED tag=GRYL9PZOMU67 type=write size=1218821 2024-09-14T11:17:31.350 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.350+0000 7fe125ff88c0 1 < completed write operation key=L4XO0WTYKNXY tag=PHOBR58MFZ9P type=write size=475049 2024-09-14T11:17:31.356 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.354+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~QKSIL0289DUM.0 size=1048576 2024-09-14T11:17:31.358 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.358+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~QKSIL0289DUM.1 size=1048576 2024-09-14T11:17:31.361 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.362+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~QKSIL0289DUM.2 size=1015935 2024-09-14T11:17:31.361 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.362+0000 7fe125ff88c0 1 > prepared multipart upload key=YCF2PCJ9TZMR upload=QKSIL0289DUM tag=HX0CQ8YSLSG7 type=write size=4161663 2024-09-14T11:17:31.364 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.362+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~FPVMB973FOI0.0 size=362379 2024-09-14T11:17:31.369 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.370+0000 7fe125ff88c0 1 < completed multipart upload key=3OU4U9JF3ZD5 upload=FPVMB973FOI0 tag=F6Y0LVSCMYP7 type=write size=1410955 2024-09-14T11:17:31.373 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.374+0000 7fe125ff88c0 1 > prepared operation key=YFRH8WECBTJK tag=OWCAFJ5IQ4MH type=write size=774295 2024-09-14T11:17:31.376 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.378+0000 7fe125ff88c0 1 < completed part key=_multipart_WEA3MQ0DI42N.2~A2I8ZHZXNYY1.0 size=1048576 2024-09-14T11:17:31.379 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.378+0000 7fe125ff88c0 1 < completed part key=_multipart_WEA3MQ0DI42N.2~A2I8ZHZXNYY1.1 size=289776 2024-09-14T11:17:31.384 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.386+0000 7fe125ff88c0 1 < completed multipart upload key=WEA3MQ0DI42N upload=A2I8ZHZXNYY1 tag=1YWSO2FUCU5N type=write size=2386928 2024-09-14T11:17:31.391 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.390+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~1RBMSLM8C3XI.0 size=380847 2024-09-14T11:17:31.391 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.390+0000 7fe125ff88c0 1 > prepared multipart upload key=YCF2PCJ9TZMR upload=1RBMSLM8C3XI tag=IVPP7NM5XL99 type=write size=1429423 2024-09-14T11:17:31.394 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.394+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~A23NHM7JAUNO.0 size=1048576 2024-09-14T11:17:31.397 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.398+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~A23NHM7JAUNO.1 size=1048576 2024-09-14T11:17:31.399 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.398+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~A23NHM7JAUNO.2 size=707157 2024-09-14T11:17:31.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.406+0000 7fe125ff88c0 1 < completed multipart upload key=21HC4VMHXS6L upload=A23NHM7JAUNO tag=L3KQ3NW74Q7U type=write size=3852885 2024-09-14T11:17:31.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.406+0000 7fe125ff88c0 1 > prepared operation key=LYBGDNKUROWH tag=ANBY1CS7GR4Q type=del size=1031620 2024-09-14T11:17:31.411 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.410+0000 7fe125ff88c0 1 < completed part key=_multipart_2LH5U05C2F8C.2~BYKRNIMIEBUG.0 size=894548 2024-09-14T11:17:31.416 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.414+0000 7fe125ff88c0 1 < completed multipart upload key=2LH5U05C2F8C upload=BYKRNIMIEBUG tag=V9HR3VE3UZV9 type=write size=1943124 2024-09-14T11:17:31.419 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.418+0000 7fe125ff88c0 1 > prepared operation key=3YGN50MBAF41 tag=J42X8HK0CVPU type=del size=3009085 2024-09-14T11:17:31.423 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.422+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~28WTECIC7RCX.0 size=1048576 2024-09-14T11:17:31.425 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.426+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~28WTECIC7RCX.1 size=938495 2024-09-14T11:17:31.431 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.430+0000 7fe125ff88c0 1 < completed multipart upload key=46ZTDBWFVSUH upload=28WTECIC7RCX tag=DQXOSA10RBBH type=write size=3035647 2024-09-14T11:17:31.438 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.438+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~N2UJJETWGSK0.0 size=50091 2024-09-14T11:17:31.438 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.438+0000 7fe125ff88c0 1 > prepared multipart upload key=0VBX2FWYCFEZ upload=N2UJJETWGSK0 tag=SSNG2YZIJFYL type=write size=1098667 2024-09-14T11:17:31.442 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.442+0000 7fe125ff88c0 1 < completed delete operation key=LYBGDNKUROWH tag=7SVVKT9Y37MA type=del 2024-09-14T11:17:31.445 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.446+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=JA5I3QU1W5Q8 type=del size=215376 2024-09-14T11:17:31.449 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.450+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~ERVHVVKVCBLX.0 size=1048576 2024-09-14T11:17:31.452 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.450+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~ERVHVVKVCBLX.1 size=1048576 2024-09-14T11:17:31.455 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.454+0000 7fe125ff88c0 1 < completed part key=_multipart_ESVFZQQXE3GT.2~ERVHVVKVCBLX.2 size=477336 2024-09-14T11:17:31.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.462+0000 7fe125ff88c0 1 < completed multipart upload key=ESVFZQQXE3GT upload=ERVHVVKVCBLX tag=IUK2EMQQSNCX type=write size=3623064 2024-09-14T11:17:31.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.466+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=VN3BKILFYUV9 type=del size=1834851 2024-09-14T11:17:31.468 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.470+0000 7fe125ff88c0 1 < canceled operation key=K3P6U6NU8I01 tag=0Z0A3IF84JIY type=write size=681507 2024-09-14T11:17:31.475 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.474+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~0BM4OB73UBFG.0 size=151277 2024-09-14T11:17:31.475 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.474+0000 7fe125ff88c0 1 > prepared multipart upload key=46ZTDBWFVSUH upload=0BM4OB73UBFG tag=LFE57RJRAWXG type=write size=1199853 2024-09-14T11:17:31.478 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.478+0000 7fe125ff88c0 1 < completed part key=_multipart_SUCH37O8V1LY.2~K74FT1X0J0NC.0 size=742534 2024-09-14T11:17:31.484 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.486+0000 7fe125ff88c0 1 < completed multipart upload key=SUCH37O8V1LY upload=K74FT1X0J0NC tag=YJMN939N8LPM type=write size=1791110 2024-09-14T11:17:31.488 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.486+0000 7fe125ff88c0 1 > prepared operation key=SUCH37O8V1LY tag=GPDMXSOG9QXT type=del size=973305 2024-09-14T11:17:31.491 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.490+0000 7fe125ff88c0 1 < completed delete operation key=2LH5U05C2F8C tag=3C83P900BIM7 type=del 2024-09-14T11:17:31.498 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.498+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~4DJFZ0CYSDXN.0 size=1048576 2024-09-14T11:17:31.501 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.502+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~4DJFZ0CYSDXN.1 size=431230 2024-09-14T11:17:31.501 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.502+0000 7fe125ff88c0 1 > prepared multipart upload key=4D2X7151977X upload=4DJFZ0CYSDXN tag=L4QD3LLJCTR1 type=write size=2528382 2024-09-14T11:17:31.504 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.506+0000 7fe125ff88c0 1 < completed part key=_multipart_6PLUU2QIO9LJ.2~0X8VHVVV85YO.0 size=951502 2024-09-14T11:17:31.510 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.510+0000 7fe125ff88c0 1 < completed multipart upload key=6PLUU2QIO9LJ upload=0X8VHVVV85YO tag=6HK7QS5HUBIG type=write size=2000078 2024-09-14T11:17:31.514 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.514+0000 7fe125ff88c0 1 > prepared operation key=2KEKSWK0UT6C tag=O5Z9CW0AD78D type=del size=2890521 2024-09-14T11:17:31.517 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.518+0000 7fe125ff88c0 1 < completed delete operation key=3OU4U9JF3ZD5 tag=3TFO07FGNKFF type=del 2024-09-14T11:17:31.524 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.526+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~50ISLNBRT2ER.0 size=1048576 2024-09-14T11:17:31.528 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.526+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~50ISLNBRT2ER.1 size=442542 2024-09-14T11:17:31.528 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.526+0000 7fe125ff88c0 1 > prepared multipart upload key=SSNV25PDLDIS upload=50ISLNBRT2ER tag=534ONYPEEU4Z type=write size=2539694 2024-09-14T11:17:31.532 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.530+0000 7fe125ff88c0 1 < completed delete operation key=K3P6U6NU8I01 tag=UMOR6YL9FO8R type=del 2024-09-14T11:17:31.536 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.534+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=ZNMR8WXYD6K1 type=del size=1652598 2024-09-14T11:17:31.543 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.542+0000 7fe125ff88c0 1 < suggested update operation key=SUCH37O8V1LY tag=MA6L9HGUU42H type=del size=554332 2024-09-14T11:17:31.547 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.546+0000 7fe125ff88c0 1 > prepared operation key=WEA3MQ0DI42N tag=POUXB191O05P type=del size=2680613 2024-09-14T11:17:31.551 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.550+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~FZSGJZGS98ED.0 size=170245 2024-09-14T11:17:31.556 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.558+0000 7fe125ff88c0 1 < completed multipart upload key=YCF2PCJ9TZMR upload=FZSGJZGS98ED tag=GRYL9PZOMU67 type=write size=1218821 2024-09-14T11:17:31.560 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.562+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=QC7R891U1W8E type=del size=4012852 2024-09-14T11:17:31.564 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.562+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~QKSIL0289DUM.0 size=1048576 2024-09-14T11:17:31.567 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.566+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~QKSIL0289DUM.1 size=1048576 2024-09-14T11:17:31.570 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.570+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~QKSIL0289DUM.2 size=1015935 2024-09-14T11:17:31.577 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.578+0000 7fe125ff88c0 1 < completed multipart upload key=YCF2PCJ9TZMR upload=QKSIL0289DUM tag=HX0CQ8YSLSG7 type=write size=4161663 2024-09-14T11:17:31.584 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.582+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~23H1I7JDBKBD.0 size=1048576 2024-09-14T11:17:31.587 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.586+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~23H1I7JDBKBD.1 size=1048576 2024-09-14T11:17:31.590 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.590+0000 7fe125ff88c0 1 > prepared part key=_multipart_3OU4U9JF3ZD5.2~23H1I7JDBKBD.2 size=633395 2024-09-14T11:17:31.590 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.590+0000 7fe125ff88c0 1 > prepared multipart upload key=3OU4U9JF3ZD5 upload=23H1I7JDBKBD tag=LXMNQ1RLEAOA type=write size=3779123 2024-09-14T11:17:31.593 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.594+0000 7fe125ff88c0 1 < completed write operation key=YFRH8WECBTJK tag=OWCAFJ5IQ4MH type=write size=774295 2024-09-14T11:17:31.600 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.598+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~EVL7I6ZP5F24.0 size=1048576 2024-09-14T11:17:31.603 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.602+0000 7fe125ff88c0 1 > prepared part key=_multipart_F9I82N7RQC81.2~EVL7I6ZP5F24.1 size=354883 2024-09-14T11:17:31.603 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.602+0000 7fe125ff88c0 1 > prepared multipart upload key=F9I82N7RQC81 upload=EVL7I6ZP5F24 tag=W81IDZM6BYJC type=write size=2452035 2024-09-14T11:17:31.607 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.606+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~1RBMSLM8C3XI.0 size=380847 2024-09-14T11:17:31.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.614+0000 7fe125ff88c0 1 < completed multipart upload key=YCF2PCJ9TZMR upload=1RBMSLM8C3XI tag=IVPP7NM5XL99 type=write size=1429423 2024-09-14T11:17:31.621 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.622+0000 7fe125ff88c0 1 > prepared operation key=K3P6U6NU8I01 tag=JVQQ7HKFI4WP type=del size=3007299 2024-09-14T11:17:31.625 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.626+0000 7fe125ff88c0 1 < canceled operation key=LYBGDNKUROWH tag=ANBY1CS7GR4Q type=del size=1031620 2024-09-14T11:17:31.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.630+0000 7fe125ff88c0 1 > prepared operation key=6C3JZKTB8BP3 tag=FORFT0YTVYBC type=del size=2763392 2024-09-14T11:17:31.633 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.634+0000 7fe125ff88c0 1 < completed delete operation key=3YGN50MBAF41 tag=J42X8HK0CVPU type=del 2024-09-14T11:17:31.636 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.634+0000 7fe125ff88c0 1 > prepared operation key=35EB6U5O4A51 tag=VY5ON2M0D4FP type=del size=4176800 2024-09-14T11:17:31.640 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.638+0000 7fe125ff88c0 1 < completed part key=_multipart_0VBX2FWYCFEZ.2~N2UJJETWGSK0.0 size=50091 2024-09-14T11:17:31.646 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.646+0000 7fe125ff88c0 1 < completed multipart upload key=0VBX2FWYCFEZ upload=N2UJJETWGSK0 tag=SSNG2YZIJFYL type=write size=1098667 2024-09-14T11:17:31.652 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.654+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~WH4Z56NM0FKM.0 size=1048576 2024-09-14T11:17:31.655 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.654+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~WH4Z56NM0FKM.1 size=1048576 2024-09-14T11:17:31.658 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.658+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~WH4Z56NM0FKM.2 size=452884 2024-09-14T11:17:31.658 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.658+0000 7fe125ff88c0 1 > prepared multipart upload key=35EB6U5O4A51 upload=WH4Z56NM0FKM tag=41V3N4DHZLZH type=write size=3598612 2024-09-14T11:17:31.662 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.662+0000 7fe125ff88c0 1 < completed delete operation key=K3P6U6NU8I01 tag=JA5I3QU1W5Q8 type=del 2024-09-14T11:17:31.669 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.670+0000 7fe125ff88c0 1 > prepared part key=_multipart_YCF2PCJ9TZMR.2~PVUPU2WAYEU2.0 size=767115 2024-09-14T11:17:31.669 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.670+0000 7fe125ff88c0 1 > prepared multipart upload key=YCF2PCJ9TZMR upload=PVUPU2WAYEU2 tag=BO01IQB1F1DG type=write size=1815691 2024-09-14T11:17:31.673 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.674+0000 7fe125ff88c0 1 < completed delete operation key=2KEKSWK0UT6C tag=VN3BKILFYUV9 type=del 2024-09-14T11:17:31.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.678+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=JX1OYP7XT9OY type=del size=2697312 2024-09-14T11:17:31.680 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.682+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~0BM4OB73UBFG.0 size=151277 2024-09-14T11:17:31.686 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.686+0000 7fe125ff88c0 1 < completed multipart upload key=46ZTDBWFVSUH upload=0BM4OB73UBFG tag=LFE57RJRAWXG type=write size=1199853 2024-09-14T11:17:31.692 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.694+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~1TDKBGOPE5PS.0 size=1048576 2024-09-14T11:17:31.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.694+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~1TDKBGOPE5PS.1 size=1048576 2024-09-14T11:17:31.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.698+0000 7fe125ff88c0 1 > prepared part key=_multipart_W0B19NBHNLMZ.2~1TDKBGOPE5PS.2 size=667875 2024-09-14T11:17:31.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.698+0000 7fe125ff88c0 1 > prepared multipart upload key=W0B19NBHNLMZ upload=1TDKBGOPE5PS tag=4HYG4077TC84 type=write size=3813603 2024-09-14T11:17:31.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.702+0000 7fe125ff88c0 -1 < failed to complete operation key=SUCH37O8V1LY tag=GPDMXSOG9QXT type=del size=973305: (22) Invalid argument 2024-09-14T11:17:31.708 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.710+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~CYGQPTST7OAK.0 size=1048576 2024-09-14T11:17:31.712 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.710+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~CYGQPTST7OAK.1 size=1048576 2024-09-14T11:17:31.714 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.714+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~CYGQPTST7OAK.2 size=626244 2024-09-14T11:17:31.714 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.714+0000 7fe125ff88c0 1 > prepared multipart upload key=LYBGDNKUROWH upload=CYGQPTST7OAK tag=867TQA9RV9CX type=write size=3771972 2024-09-14T11:17:31.718 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.718+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~4DJFZ0CYSDXN.0 size=1048576 2024-09-14T11:17:31.721 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.722+0000 7fe125ff88c0 1 < completed part key=_multipart_4D2X7151977X.2~4DJFZ0CYSDXN.1 size=431230 2024-09-14T11:17:31.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.726+0000 7fe125ff88c0 1 < completed multipart upload key=4D2X7151977X upload=4DJFZ0CYSDXN tag=L4QD3LLJCTR1 type=write size=2528382 2024-09-14T11:17:31.734 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.734+0000 7fe125ff88c0 1 > prepared part key=_multipart_46ZTDBWFVSUH.2~NSN4S4OTUCHB.0 size=219580 2024-09-14T11:17:31.734 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.734+0000 7fe125ff88c0 1 > prepared multipart upload key=46ZTDBWFVSUH upload=NSN4S4OTUCHB tag=HPRBO1VMLFO0 type=write size=1268156 2024-09-14T11:17:31.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.738+0000 7fe125ff88c0 1 < completed delete operation key=2KEKSWK0UT6C tag=O5Z9CW0AD78D type=del 2024-09-14T11:17:31.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.746+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~HO67M0AY1V9Y.0 size=1048576 2024-09-14T11:17:31.747 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.746+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~HO67M0AY1V9Y.1 size=1048576 2024-09-14T11:17:31.750 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.750+0000 7fe125ff88c0 1 > prepared part key=_multipart_K05LARTJ2QZ3.2~HO67M0AY1V9Y.2 size=663316 2024-09-14T11:17:31.750 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.750+0000 7fe125ff88c0 1 > prepared multipart upload key=K05LARTJ2QZ3 upload=HO67M0AY1V9Y tag=80VH3L0XM9I8 type=write size=3809044 2024-09-14T11:17:31.753 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.754+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~50ISLNBRT2ER.0 size=1048576 2024-09-14T11:17:31.756 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.758+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~50ISLNBRT2ER.1 size=442542 2024-09-14T11:17:31.762 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.762+0000 7fe125ff88c0 1 < completed multipart upload key=SSNV25PDLDIS upload=50ISLNBRT2ER tag=534ONYPEEU4Z type=write size=2539694 2024-09-14T11:17:31.766 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.766+0000 7fe125ff88c0 1 > prepared operation key=YFRH8WECBTJK tag=3JLLBWA0P687 type=del size=4009150 2024-09-14T11:17:31.769 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.770+0000 7fe125ff88c0 1 < completed delete operation key=ESVFZQQXE3GT tag=ZNMR8WXYD6K1 type=del 2024-09-14T11:17:31.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.774+0000 7fe125ff88c0 1 > prepared operation key=46ZTDBWFVSUH tag=3AIE0JVQODQB type=del size=4189340 2024-09-14T11:17:31.777 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.778+0000 7fe125ff88c0 1 < completed delete operation key=WEA3MQ0DI42N tag=POUXB191O05P type=del 2024-09-14T11:17:31.781 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.782+0000 7fe125ff88c0 1 > prepared operation key=3OU4U9JF3ZD5 tag=BDKXKM2TXDB3 type=del size=3441714 2024-09-14T11:17:31.784 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.786+0000 7fe125ff88c0 1 < completed delete operation key=ESVFZQQXE3GT tag=QC7R891U1W8E type=del 2024-09-14T11:17:31.791 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.790+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~8BOCGVK6AC04.0 size=1048576 2024-09-14T11:17:31.794 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.794+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~8BOCGVK6AC04.1 size=1048576 2024-09-14T11:17:31.797 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.798+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~8BOCGVK6AC04.2 size=617498 2024-09-14T11:17:31.798 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.798+0000 7fe125ff88c0 1 > prepared multipart upload key=35EB6U5O4A51 upload=8BOCGVK6AC04 tag=6V5WN1P5OABK type=write size=3763226 2024-09-14T11:17:31.801 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.802+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~23H1I7JDBKBD.0 size=1048576 2024-09-14T11:17:31.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.802+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~23H1I7JDBKBD.1 size=1048576 2024-09-14T11:17:31.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.806+0000 7fe125ff88c0 1 < completed part key=_multipart_3OU4U9JF3ZD5.2~23H1I7JDBKBD.2 size=633395 2024-09-14T11:17:31.813 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.814+0000 7fe125ff88c0 1 < completed multipart upload key=3OU4U9JF3ZD5 upload=23H1I7JDBKBD tag=LXMNQ1RLEAOA type=write size=3779123 2024-09-14T11:17:31.816 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.818+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=20UXCNDJ4XW6 type=del size=644789 2024-09-14T11:17:31.820 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.822+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~EVL7I6ZP5F24.0 size=1048576 2024-09-14T11:17:31.823 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.822+0000 7fe125ff88c0 1 < completed part key=_multipart_F9I82N7RQC81.2~EVL7I6ZP5F24.1 size=354883 2024-09-14T11:17:31.829 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.830+0000 7fe125ff88c0 1 < completed multipart upload key=F9I82N7RQC81 upload=EVL7I6ZP5F24 tag=W81IDZM6BYJC type=write size=2452035 2024-09-14T11:17:31.835 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.834+0000 7fe125ff88c0 1 > prepared part key=_multipart_35EB6U5O4A51.2~TB9OCG7WRAA1.0 size=632752 2024-09-14T11:17:31.836 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.834+0000 7fe125ff88c0 1 > prepared multipart upload key=35EB6U5O4A51 upload=TB9OCG7WRAA1 tag=U0YU5QQOQ3EA type=write size=1681328 2024-09-14T11:17:31.839 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.838+0000 7fe125ff88c0 1 < canceled operation key=K3P6U6NU8I01 tag=JVQQ7HKFI4WP type=del size=3007299 2024-09-14T11:17:31.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.842+0000 7fe125ff88c0 1 > prepared operation key=N80X3YUF4OEL tag=HUTJVEIJ96NX type=del size=2711722 2024-09-14T11:17:31.847 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.846+0000 7fe125ff88c0 1 < completed delete operation key=6C3JZKTB8BP3 tag=FORFT0YTVYBC type=del 2024-09-14T11:17:31.851 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.850+0000 7fe125ff88c0 1 > prepared operation key=SUCH37O8V1LY tag=GVZXT7D08TRV type=write size=329108 2024-09-14T11:17:31.858 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.858+0000 7fe125ff88c0 1 < suggested update operation key=35EB6U5O4A51 tag=VY5ON2M0D4FP type=del size=4176800 2024-09-14T11:17:31.864 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.866+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~9Q6OZ2HJKPBT.0 size=1048576 2024-09-14T11:17:31.867 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.866+0000 7fe125ff88c0 1 > prepared part key=_multipart_21HC4VMHXS6L.2~9Q6OZ2HJKPBT.1 size=431444 2024-09-14T11:17:31.867 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.866+0000 7fe125ff88c0 1 > prepared multipart upload key=21HC4VMHXS6L upload=9Q6OZ2HJKPBT tag=WTPGQ3MJWHH1 type=write size=2528596 2024-09-14T11:17:31.871 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.870+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~WH4Z56NM0FKM.0 size=1048576 2024-09-14T11:17:31.874 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.878+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~WH4Z56NM0FKM.1 size=1048576 2024-09-14T11:17:31.877 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.878+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~WH4Z56NM0FKM.2 size=452884 2024-09-14T11:17:31.883 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.882+0000 7fe125ff88c0 1 < completed multipart upload key=35EB6U5O4A51 upload=WH4Z56NM0FKM tag=41V3N4DHZLZH type=write size=3598612 2024-09-14T11:17:31.887 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.886+0000 7fe125ff88c0 1 > prepared operation key=2LH5U05C2F8C tag=A6PCP7FMBUGL type=del size=3106290 2024-09-14T11:17:31.891 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.890+0000 7fe125ff88c0 1 < completed part key=_multipart_YCF2PCJ9TZMR.2~PVUPU2WAYEU2.0 size=767115 2024-09-14T11:17:31.898 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.898+0000 7fe125ff88c0 1 < completed multipart upload key=YCF2PCJ9TZMR upload=PVUPU2WAYEU2 tag=BO01IQB1F1DG type=write size=1815691 2024-09-14T11:17:31.901 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.902+0000 7fe125ff88c0 1 > prepared operation key=K05LARTJ2QZ3 tag=1JWOPFC2N19E type=del size=755642 2024-09-14T11:17:31.905 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.906+0000 7fe125ff88c0 1 < canceled operation key=2LH5U05C2F8C tag=JX1OYP7XT9OY type=del size=2697312 2024-09-14T11:17:31.909 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.910+0000 7fe125ff88c0 1 > prepared operation key=3OU4U9JF3ZD5 tag=AOSFAJPR7RX2 type=del size=1415302 2024-09-14T11:17:31.912 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.914+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~1TDKBGOPE5PS.0 size=1048576 2024-09-14T11:17:31.915 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.914+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~1TDKBGOPE5PS.1 size=1048576 2024-09-14T11:17:31.918 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.918+0000 7fe125ff88c0 1 < completed part key=_multipart_W0B19NBHNLMZ.2~1TDKBGOPE5PS.2 size=667875 2024-09-14T11:17:31.924 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.926+0000 7fe125ff88c0 1 < completed multipart upload key=W0B19NBHNLMZ upload=1TDKBGOPE5PS tag=4HYG4077TC84 type=write size=3813603 2024-09-14T11:17:31.928 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.926+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=SE3H3MW2TWDD type=del size=4034047 2024-09-14T11:17:31.932 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.930+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~CYGQPTST7OAK.0 size=1048576 2024-09-14T11:17:31.934 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.934+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~CYGQPTST7OAK.1 size=1048576 2024-09-14T11:17:31.937 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.938+0000 7fe125ff88c0 1 < completed part key=_multipart_LYBGDNKUROWH.2~CYGQPTST7OAK.2 size=626244 2024-09-14T11:17:31.943 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.942+0000 7fe125ff88c0 1 < completed multipart upload key=LYBGDNKUROWH upload=CYGQPTST7OAK tag=867TQA9RV9CX type=write size=3771972 2024-09-14T11:17:31.948 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.946+0000 7fe125ff88c0 1 > prepared operation key=L4XO0WTYKNXY tag=2JLONVRY57QC type=del size=3208424 2024-09-14T11:17:31.951 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.950+0000 7fe125ff88c0 1 < completed part key=_multipart_46ZTDBWFVSUH.2~NSN4S4OTUCHB.0 size=219580 2024-09-14T11:17:31.962 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.962+0000 7fe125ff88c0 1 < completed multipart upload key=46ZTDBWFVSUH upload=NSN4S4OTUCHB tag=HPRBO1VMLFO0 type=write size=1268156 2024-09-14T11:17:31.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.970+0000 7fe125ff88c0 1 > prepared part key=_multipart_SSNV25PDLDIS.2~S9HDUB0KK1GW.0 size=927692 2024-09-14T11:17:31.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.970+0000 7fe125ff88c0 1 > prepared multipart upload key=SSNV25PDLDIS upload=S9HDUB0KK1GW tag=LB8DDSPQFCLR type=write size=1976268 2024-09-14T11:17:31.973 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.974+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~HO67M0AY1V9Y.0 size=1048576 2024-09-14T11:17:31.976 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.974+0000 7fe125ff88c0 1 < completed part key=_multipart_K05LARTJ2QZ3.2~HO67M0AY1V9Y.1 size=1048576 2024-09-14T11:17:31.976 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.974+0000 7fe125ff88c0 1 < canceled part key=_multipart_K05LARTJ2QZ3.2~HO67M0AY1V9Y.2 size=663316 2024-09-14T11:17:31.981 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.982+0000 7fe125ff88c0 1 < canceled multipart upload key=K05LARTJ2QZ3 upload=HO67M0AY1V9Y tag=80VH3L0XM9I8 type=write size=3809044 2024-09-14T11:17:31.985 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.986+0000 7fe125ff88c0 1 > prepared operation key=4D2X7151977X tag=1PJL4SIOK5GH type=del size=637294 2024-09-14T11:17:31.989 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.990+0000 7fe125ff88c0 1 < completed delete operation key=YFRH8WECBTJK tag=3JLLBWA0P687 type=del 2024-09-14T11:17:31.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.994+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=EBX079094CXA type=del size=19580 2024-09-14T11:17:31.997 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:31.998+0000 7fe125ff88c0 1 < completed delete operation key=46ZTDBWFVSUH tag=3AIE0JVQODQB type=del 2024-09-14T11:17:32.000 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.002+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=I8VF8GROPL0C type=del size=409494 2024-09-14T11:17:32.004 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.006+0000 7fe125ff88c0 1 < completed delete operation key=3OU4U9JF3ZD5 tag=BDKXKM2TXDB3 type=del 2024-09-14T11:17:32.008 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.006+0000 7fe125ff88c0 1 > prepared operation key=3YGN50MBAF41 tag=VDBVPP6S362M type=del size=398896 2024-09-14T11:17:32.013 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.014+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~8BOCGVK6AC04.0 size=1048576 2024-09-14T11:17:32.016 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.018+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~8BOCGVK6AC04.1 size=1048576 2024-09-14T11:17:32.019 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.018+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~8BOCGVK6AC04.2 size=617498 2024-09-14T11:17:32.025 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.026+0000 7fe125ff88c0 1 < completed multipart upload key=35EB6U5O4A51 upload=8BOCGVK6AC04 tag=6V5WN1P5OABK type=write size=3763226 2024-09-14T11:17:32.029 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.030+0000 7fe125ff88c0 1 > prepared operation key=21HC4VMHXS6L tag=ZOJGW09PBMN0 type=write size=277643 2024-09-14T11:17:32.033 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.034+0000 7fe125ff88c0 1 < completed delete operation key=N94D3R7IOBNL tag=20UXCNDJ4XW6 type=del 2024-09-14T11:17:32.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.038+0000 7fe125ff88c0 1 > prepared operation key=0VBX2FWYCFEZ tag=Y5I5Q8A9T32A type=write size=199232 2024-09-14T11:17:32.041 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.042+0000 7fe125ff88c0 1 < completed part key=_multipart_35EB6U5O4A51.2~TB9OCG7WRAA1.0 size=632752 2024-09-14T11:17:32.047 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.046+0000 7fe125ff88c0 1 < completed multipart upload key=35EB6U5O4A51 upload=TB9OCG7WRAA1 tag=U0YU5QQOQ3EA type=write size=1681328 2024-09-14T11:17:32.053 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.054+0000 7fe125ff88c0 1 > prepared part key=_multipart_YFRH8WECBTJK.2~9RG1O9Z8SIHN.0 size=454310 2024-09-14T11:17:32.053 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.054+0000 7fe125ff88c0 1 > prepared multipart upload key=YFRH8WECBTJK upload=9RG1O9Z8SIHN tag=ASM0YH027OJX type=write size=1502886 2024-09-14T11:17:32.057 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.058+0000 7fe125ff88c0 1 < completed delete operation key=N80X3YUF4OEL tag=HUTJVEIJ96NX type=del 2024-09-14T11:17:32.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.062+0000 7fe125ff88c0 1 > prepared operation key=N94D3R7IOBNL tag=NP9MGQ0PGJ25 type=del size=3550374 2024-09-14T11:17:32.065 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.066+0000 7fe125ff88c0 1 < completed write operation key=SUCH37O8V1LY tag=GVZXT7D08TRV type=write size=329108 2024-09-14T11:17:32.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.070+0000 7fe125ff88c0 1 > prepared part key=_multipart_LYBGDNKUROWH.2~J1JD5SGJMG5T.0 size=271544 2024-09-14T11:17:32.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.070+0000 7fe125ff88c0 1 > prepared multipart upload key=LYBGDNKUROWH upload=J1JD5SGJMG5T tag=60TAN5D3VXAT type=write size=1320120 2024-09-14T11:17:32.075 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.074+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~9Q6OZ2HJKPBT.0 size=1048576 2024-09-14T11:17:32.078 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.078+0000 7fe125ff88c0 1 < completed part key=_multipart_21HC4VMHXS6L.2~9Q6OZ2HJKPBT.1 size=431444 2024-09-14T11:17:32.084 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.086+0000 7fe125ff88c0 1 < completed multipart upload key=21HC4VMHXS6L upload=9Q6OZ2HJKPBT tag=WTPGQ3MJWHH1 type=write size=2528596 2024-09-14T11:17:32.091 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.090+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~S0SJSE7DT8LD.0 size=1048576 2024-09-14T11:17:32.094 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.094+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~S0SJSE7DT8LD.1 size=1048576 2024-09-14T11:17:32.096 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.098+0000 7fe125ff88c0 1 > prepared part key=_multipart_YGEVGH840L18.2~S0SJSE7DT8LD.2 size=569025 2024-09-14T11:17:32.096 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.098+0000 7fe125ff88c0 1 > prepared multipart upload key=YGEVGH840L18 upload=S0SJSE7DT8LD tag=G1GEPNPZ5QIY type=write size=3714753 2024-09-14T11:17:32.100 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.098+0000 7fe125ff88c0 1 < completed delete operation key=2LH5U05C2F8C tag=A6PCP7FMBUGL type=del 2024-09-14T11:17:32.104 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.102+0000 7fe125ff88c0 1 > prepared operation key=3YGN50MBAF41 tag=MGJQ934JKONV type=del size=3804758 2024-09-14T11:17:32.111 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.110+0000 7fe125ff88c0 1 < suggested remove operation key=K05LARTJ2QZ3 tag=1JWOPFC2N19E type=del 2024-09-14T11:17:32.115 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.114+0000 7fe125ff88c0 1 > prepared operation key=6PLUU2QIO9LJ tag=6JYKKU8K0ZR5 type=del size=1012385 2024-09-14T11:17:32.119 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.118+0000 7fe125ff88c0 1 < completed delete operation key=3OU4U9JF3ZD5 tag=AOSFAJPR7RX2 type=del 2024-09-14T11:17:32.123 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.122+0000 7fe125ff88c0 1 > prepared operation key=F9I82N7RQC81 tag=AZE2XJXRTM70 type=del size=1793443 2024-09-14T11:17:32.127 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.126+0000 7fe125ff88c0 1 < completed delete operation key=ESVFZQQXE3GT tag=SE3H3MW2TWDD type=del 2024-09-14T11:17:32.131 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.130+0000 7fe125ff88c0 1 > prepared operation key=ESVFZQQXE3GT tag=7D7ET81KNT9J type=del size=2209780 2024-09-14T11:17:32.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.134+0000 7fe125ff88c0 1 < completed delete operation key=L4XO0WTYKNXY tag=2JLONVRY57QC type=del 2024-09-14T11:17:32.141 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.142+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~TL3L8ZVVEY8L.0 size=1048576 2024-09-14T11:17:32.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.142+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~TL3L8ZVVEY8L.1 size=1048576 2024-09-14T11:17:32.147 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.146+0000 7fe125ff88c0 1 > prepared part key=_multipart_SUCH37O8V1LY.2~TL3L8ZVVEY8L.2 size=471383 2024-09-14T11:17:32.147 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.146+0000 7fe125ff88c0 1 > prepared multipart upload key=SUCH37O8V1LY upload=TL3L8ZVVEY8L tag=SBZ2YHQTQ6PK type=write size=3617111 2024-09-14T11:17:32.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.150+0000 7fe125ff88c0 1 < completed part key=_multipart_SSNV25PDLDIS.2~S9HDUB0KK1GW.0 size=927692 2024-09-14T11:17:32.157 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.158+0000 7fe125ff88c0 1 < completed multipart upload key=SSNV25PDLDIS upload=S9HDUB0KK1GW tag=LB8DDSPQFCLR type=write size=1976268 2024-09-14T11:17:32.164 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.162+0000 7fe125ff88c0 1 > prepared part key=_multipart_4D2X7151977X.2~ANXNF21JP5R4.0 size=127211 2024-09-14T11:17:32.164 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.162+0000 7fe125ff88c0 1 > prepared multipart upload key=4D2X7151977X upload=ANXNF21JP5R4 tag=4D589ZJWX0AI type=write size=1175787 2024-09-14T11:17:32.171 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.170+0000 7fe125ff88c0 1 < suggested remove operation key=4D2X7151977X tag=1PJL4SIOK5GH type=del 2024-09-14T11:17:32.178 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.178+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~0YL072SL2WJX.0 size=1048576 2024-09-14T11:17:32.181 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.182+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~0YL072SL2WJX.1 size=1048576 2024-09-14T11:17:32.184 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.182+0000 7fe125ff88c0 1 > prepared part key=_multipart_0VBX2FWYCFEZ.2~0YL072SL2WJX.2 size=209690 2024-09-14T11:17:32.184 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.182+0000 7fe125ff88c0 1 > prepared multipart upload key=0VBX2FWYCFEZ upload=0YL072SL2WJX tag=150NZMI6YO42 type=write size=3355418 2024-09-14T11:17:32.192 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.190+0000 7fe125ff88c0 1 < suggested remove operation key=N94D3R7IOBNL tag=EBX079094CXA type=del 2024-09-14T11:17:32.197 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:17:32.198+0000 7fe125ff88c0 1 > prepared operation key=3OU4U9JF3ZD5 tag=8KR23P10XESI type=del size=3972813 2024-09-14T11:17:32.197 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] cls_rgw_stats.simulate (27891 ms) 2024-09-14T11:17:32.198 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 1 test from cls_rgw_stats (27891 ms total) 2024-09-14T11:17:32.198 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-14T11:17:32.198 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-14T11:17:32.241 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 1 test from 1 test suite ran. (29820 ms total) 2024-09-14T11:17:32.241 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 1 test. 2024-09-14T11:17:32.249 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:17:32.250 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:17:32.305 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-14T11:17:32.306 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-14T11:17:32.306 DEBUG:teuthology.orchestra.run.smithi071:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-14T11:17:32.370 INFO:tasks.workunit.client.0.smithi071.stdout:Running main() from gmock_main.cc 2024-09-14T11:17:32.370 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-14T11:17:32.370 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-14T11:17:34.269 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 31 tests from CmpOmap 2024-09-14T11:17:34.272 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-14T11:17:34.309 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (36 ms) 2024-09-14T11:17:34.309 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-14T11:17:34.314 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (5 ms) 2024-09-14T11:17:34.314 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-14T11:17:34.317 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (4 ms) 2024-09-14T11:17:34.318 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-14T11:17:34.325 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (8 ms) 2024-09-14T11:17:34.325 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-14T11:17:34.334 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] CmpOmap.cmp_vals_str (9 ms) 2024-09-14T11:17:34.334 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-14T11:17:34.356 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] CmpOmap.cmp_vals_u64 (22 ms) 2024-09-14T11:17:34.356 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-14T11:17:34.365 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (9 ms) 2024-09-14T11:17:34.365 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-14T11:17:34.370 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (5 ms) 2024-09-14T11:17:34.370 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-14T11:17:34.581 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (210 ms) 2024-09-14T11:17:34.581 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-14T11:17:34.591 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (10 ms) 2024-09-14T11:17:34.592 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-14T11:17:34.593 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (2 ms) 2024-09-14T11:17:34.593 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-14T11:17:34.595 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (2 ms) 2024-09-14T11:17:34.595 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-14T11:17:34.612 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (17 ms) 2024-09-14T11:17:34.612 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-14T11:17:34.631 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (19 ms) 2024-09-14T11:17:34.631 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-14T11:17:34.647 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (15 ms) 2024-09-14T11:17:34.647 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-14T11:17:34.667 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (20 ms) 2024-09-14T11:17:34.667 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-14T11:17:34.691 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] CmpOmap.cmp_set_vals_str (24 ms) 2024-09-14T11:17:34.691 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-14T11:17:34.711 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (19 ms) 2024-09-14T11:17:34.711 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-14T11:17:34.716 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (6 ms) 2024-09-14T11:17:34.716 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-14T11:17:34.722 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (6 ms) 2024-09-14T11:17:34.723 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-14T11:17:34.725 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (3 ms) 2024-09-14T11:17:34.726 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-14T11:17:34.727 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (2 ms) 2024-09-14T11:17:34.728 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-14T11:17:34.745 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (17 ms) 2024-09-14T11:17:34.745 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-14T11:17:34.763 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (18 ms) 2024-09-14T11:17:34.763 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-14T11:17:34.783 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (21 ms) 2024-09-14T11:17:34.783 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-14T11:17:34.803 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (19 ms) 2024-09-14T11:17:34.803 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-14T11:17:34.809 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (7 ms) 2024-09-14T11:17:34.809 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-14T11:17:34.817 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (7 ms) 2024-09-14T11:17:34.817 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-14T11:17:34.819 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (3 ms) 2024-09-14T11:17:34.819 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-14T11:17:34.821 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (2 ms) 2024-09-14T11:17:34.821 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-14T11:17:34.846 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (24 ms) 2024-09-14T11:17:34.846 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 31 tests from CmpOmap (573 ms total) 2024-09-14T11:17:34.846 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-14T11:17:34.846 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-14T11:17:35.274 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 31 tests from 1 test suite ran. (2904 ms total) 2024-09-14T11:17:35.274 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 31 tests. 2024-09-14T11:17:35.281 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:17:35.281 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:17:35.342 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-14T11:17:35.343 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-14T11:17:35.343 DEBUG:teuthology.orchestra.run.smithi071:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-14T11:17:35.412 INFO:tasks.workunit.client.0.smithi071.stdout:Running main() from gmock_main.cc 2024-09-14T11:17:35.412 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:17:35.412 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-14T11:17:35.412 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-14T11:17:35.413 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-14T11:17:38.322 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2910 ms) 2024-09-14T11:17:38.322 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-14T11:17:41.377 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3055 ms) 2024-09-14T11:17:41.378 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-14T11:17:44.385 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestCls2PCQueue.Reserve (3008 ms) 2024-09-14T11:17:44.385 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-14T11:17:47.472 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3084 ms) 2024-09-14T11:17:47.472 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-14T11:17:51.534 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestCls2PCQueue.Commit (4062 ms) 2024-09-14T11:17:51.534 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-14T11:17:55.575 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestCls2PCQueue.Stats (4044 ms) 2024-09-14T11:17:55.575 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-14T11:18:00.620 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (5044 ms) 2024-09-14T11:18:00.620 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-14T11:18:03.672 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestCls2PCQueue.Abort (3051 ms) 2024-09-14T11:18:03.672 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-14T11:18:06.685 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestCls2PCQueue.ReserveError (3014 ms) 2024-09-14T11:18:06.685 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-14T11:18:09.776 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestCls2PCQueue.CommitError (3085 ms) 2024-09-14T11:18:09.777 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-14T11:18:12.776 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestCls2PCQueue.AbortError (3005 ms) 2024-09-14T11:18:12.776 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-14T11:18:15.784 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3009 ms) 2024-09-14T11:18:15.785 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-14T11:18:18.800 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3015 ms) 2024-09-14T11:18:18.800 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-14T11:18:21.853 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3053 ms) 2024-09-14T11:18:21.853 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-14T11:18:24.865 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3013 ms) 2024-09-14T11:18:24.865 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-14T11:18:27.881 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3015 ms) 2024-09-14T11:18:27.881 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-14T11:18:30.884 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3003 ms) 2024-09-14T11:18:30.884 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-14T11:18:33.958 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestCls2PCQueue.Cleanup (3074 ms) 2024-09-14T11:18:33.958 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-14T11:18:48.273 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestCls2PCQueue.MultiProducer (14315 ms) 2024-09-14T11:18:48.273 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-14T11:18:53.361 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (5088 ms) 2024-09-14T11:18:53.362 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-14T11:19:06.272 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (12911 ms) 2024-09-14T11:19:06.273 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-14T11:19:12.637 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (6365 ms) 2024-09-14T11:19:12.637 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-14T11:19:21.284 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (8647 ms) 2024-09-14T11:19:21.284 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-14T11:19:30.284 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (8998 ms) 2024-09-14T11:19:30.284 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 24 tests from TestCls2PCQueue (114870 ms total) 2024-09-14T11:19:30.284 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-14T11:19:30.284 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-14T11:19:30.284 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 24 tests from 1 test suite ran. (114870 ms total) 2024-09-14T11:19:30.284 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 24 tests. 2024-09-14T11:19:30.288 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:19:30.288 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:19:30.349 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-14T11:19:30.350 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-14T11:19:30.350 DEBUG:teuthology.orchestra.run.smithi071:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-14T11:19:30.425 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:30.426 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:30.426 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T11:19:30.426 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-14T11:19:32.297 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 4 tests from ClsAccount 2024-09-14T11:19:32.297 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] ClsAccount.add 2024-09-14T11:19:32.352 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] ClsAccount.add (55 ms) 2024-09-14T11:19:32.352 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] ClsAccount.get 2024-09-14T11:19:32.365 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] ClsAccount.get (12 ms) 2024-09-14T11:19:32.365 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] ClsAccount.rm 2024-09-14T11:19:32.380 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] ClsAccount.rm (16 ms) 2024-09-14T11:19:32.381 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] ClsAccount.list 2024-09-14T11:19:32.429 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] ClsAccount.list (48 ms) 2024-09-14T11:19:32.429 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 4 tests from ClsAccount (132 ms total) 2024-09-14T11:19:32.429 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-14T11:19:32.429 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-14T11:19:33.327 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 4 tests from 1 test suite ran. (2901 ms total) 2024-09-14T11:19:33.327 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 4 tests. 2024-09-14T11:19:33.332 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:19:33.332 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:19:33.393 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-14T11:19:33.394 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-14T11:19:33.394 DEBUG:teuthology.orchestra.run.smithi071:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-14T11:19:33.468 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:33.468 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:33.468 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-14T11:19:33.468 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-14T11:19:35.331 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 6 tests from rgw_gc_log 2024-09-14T11:19:35.331 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-14T11:19:35.356 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] rgw_gc_log.init_existing_queue (25 ms) 2024-09-14T11:19:35.356 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-14T11:19:35.366 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] rgw_gc_log.init_existing_omap (10 ms) 2024-09-14T11:19:35.366 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-14T11:19:35.554 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (188 ms) 2024-09-14T11:19:35.554 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-14T11:19:35.556 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (2 ms) 2024-09-14T11:19:35.557 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-14T11:19:35.562 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] rgw_gc_log.defer1_after_init (6 ms) 2024-09-14T11:19:35.562 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-14T11:19:35.566 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] rgw_gc_log.defer2_before_init (5 ms) 2024-09-14T11:19:35.567 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 6 tests from rgw_gc_log (236 ms total) 2024-09-14T11:19:35.567 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-14T11:19:35.567 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-14T11:19:36.339 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 6 tests from 1 test suite ran. (2870 ms total) 2024-09-14T11:19:36.339 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 6 tests. 2024-09-14T11:19:36.344 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:19:36.345 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:19:36.400 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-14T11:19:36.401 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-14T11:19:36.401 DEBUG:teuthology.orchestra.run.smithi071:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-14T11:19:36.476 INFO:tasks.workunit.client.0.smithi071.stdout:Running main() from gmock_main.cc 2024-09-14T11:19:36.476 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T11:19:36.476 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-14T11:19:36.476 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 4 tests from TestRGWObj 2024-09-14T11:19:36.476 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestRGWObj.underscore 2024-09-14T11:19:36.476 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: _obj 2024-09-14T11:19:36.476 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: _obj 2024-09-14T11:19:36.476 INFO:tasks.workunit.client.0.smithi071.stdout:stripped: _obj ns= i= 2024-09-14T11:19:36.477 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: _obj 2024-09-14T11:19:36.477 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: _obj 2024-09-14T11:19:36.477 INFO:tasks.workunit.client.0.smithi071.stdout:stripped: _obj ns= i= 2024-09-14T11:19:36.477 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: _obj 2024-09-14T11:19:36.477 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: _obj 2024-09-14T11:19:36.477 INFO:tasks.workunit.client.0.smithi071.stdout:stripped: _obj ns= i= 2024-09-14T11:19:36.477 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.477 INFO:tasks.workunit.client.0.smithi071.stdout: "obj1": { 2024-09-14T11:19:36.477 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.477 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.477 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.477 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.477 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.477 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.478 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.478 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.478 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.478 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.478 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.478 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.478 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_obj", 2024-09-14T11:19:36.478 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.478 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.478 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.478 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.478 INFO:tasks.workunit.client.0.smithi071.stdout: "obj2": { 2024-09-14T11:19:36.478 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.479 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.479 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.479 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.479 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.479 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.479 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.479 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.479 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.479 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.479 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.479 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.479 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_obj", 2024-09-14T11:19:36.479 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.480 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.480 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.480 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.480 INFO:tasks.workunit.client.0.smithi071.stdout: "obj3": { 2024-09-14T11:19:36.480 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.480 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.480 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.480 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.480 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.480 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.480 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.480 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.480 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.480 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.481 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.481 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.481 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_obj", 2024-09-14T11:19:36.481 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.481 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.481 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.481 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.481 INFO:tasks.workunit.client.0.smithi071.stdout: "obj3-2": { 2024-09-14T11:19:36.481 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.481 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.481 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.481 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.481 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.481 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.482 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.482 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.482 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.482 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.482 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.482 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.482 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_obj", 2024-09-14T11:19:36.482 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.482 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.482 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.482 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.482 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.482 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: _obj 2024-09-14T11:19:36.482 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: _obj 2024-09-14T11:19:36.483 INFO:tasks.workunit.client.0.smithi071.stdout:stripped: _obj ns=ns i= 2024-09-14T11:19:36.483 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: _obj 2024-09-14T11:19:36.483 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: _obj 2024-09-14T11:19:36.483 INFO:tasks.workunit.client.0.smithi071.stdout:stripped: _obj ns=ns i= 2024-09-14T11:19:36.483 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: _obj 2024-09-14T11:19:36.483 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: _obj 2024-09-14T11:19:36.483 INFO:tasks.workunit.client.0.smithi071.stdout:stripped: _obj ns=ns i= 2024-09-14T11:19:36.483 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.483 INFO:tasks.workunit.client.0.smithi071.stdout: "obj1": { 2024-09-14T11:19:36.483 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.483 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.483 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.483 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.483 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.484 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.484 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.484 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.484 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.484 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.484 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.484 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.484 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_obj", 2024-09-14T11:19:36.484 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.484 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.484 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.484 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.484 INFO:tasks.workunit.client.0.smithi071.stdout: "obj2": { 2024-09-14T11:19:36.484 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.485 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.485 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.485 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.485 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.485 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.485 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.485 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.485 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.485 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.485 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.485 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.485 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_obj", 2024-09-14T11:19:36.485 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.486 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.486 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.486 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.486 INFO:tasks.workunit.client.0.smithi071.stdout: "obj3": { 2024-09-14T11:19:36.486 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.486 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.486 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.486 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.486 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.486 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.486 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.486 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.486 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.487 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.487 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.487 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.487 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_obj", 2024-09-14T11:19:36.487 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.487 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.487 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.487 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.487 INFO:tasks.workunit.client.0.smithi071.stdout: "obj3-2": { 2024-09-14T11:19:36.487 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.487 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.487 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.487 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.488 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.488 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.488 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.488 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.488 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.488 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.488 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.488 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.488 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_obj", 2024-09-14T11:19:36.488 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.488 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.488 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.488 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.489 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.489 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: _obj[v1] 2024-09-14T11:19:36.489 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: _obj[v1] 2024-09-14T11:19:36.489 INFO:tasks.workunit.client.0.smithi071.stdout:stripped: _obj ns= i=v1 2024-09-14T11:19:36.489 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: _obj[v1] 2024-09-14T11:19:36.489 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: _obj[v1] 2024-09-14T11:19:36.489 INFO:tasks.workunit.client.0.smithi071.stdout:stripped: _obj ns= i=v1 2024-09-14T11:19:36.489 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: _obj[v1] 2024-09-14T11:19:36.489 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: _obj[v1] 2024-09-14T11:19:36.489 INFO:tasks.workunit.client.0.smithi071.stdout:stripped: _obj ns= i=v1 2024-09-14T11:19:36.489 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.489 INFO:tasks.workunit.client.0.smithi071.stdout: "obj1": { 2024-09-14T11:19:36.489 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.489 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.489 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.490 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.490 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.490 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.490 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.490 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.490 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.490 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.490 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.490 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.490 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_obj", 2024-09-14T11:19:36.490 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "v1", 2024-09-14T11:19:36.490 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.490 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.490 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.491 INFO:tasks.workunit.client.0.smithi071.stdout: "obj2": { 2024-09-14T11:19:36.491 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.491 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.491 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.491 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.491 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.491 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.491 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.491 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.491 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.491 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.491 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.491 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.491 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_obj", 2024-09-14T11:19:36.492 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "v1", 2024-09-14T11:19:36.492 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.492 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.492 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.492 INFO:tasks.workunit.client.0.smithi071.stdout: "obj3": { 2024-09-14T11:19:36.492 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.492 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.492 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.492 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.492 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.492 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.492 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.492 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.493 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.493 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.493 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.493 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.493 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_obj", 2024-09-14T11:19:36.493 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.493 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.493 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.493 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.493 INFO:tasks.workunit.client.0.smithi071.stdout: "obj3-2": { 2024-09-14T11:19:36.493 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.493 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.493 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.493 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.493 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.494 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.494 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.494 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.494 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.494 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.494 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.494 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.494 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_obj", 2024-09-14T11:19:36.494 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "v1", 2024-09-14T11:19:36.494 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.494 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.494 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.494 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.494 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: _obj[v1] 2024-09-14T11:19:36.494 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: _obj[v1] 2024-09-14T11:19:36.494 INFO:tasks.workunit.client.0.smithi071.stdout:stripped: _obj ns=ns i=v1 2024-09-14T11:19:36.495 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: _obj[v1] 2024-09-14T11:19:36.495 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: _obj[v1] 2024-09-14T11:19:36.495 INFO:tasks.workunit.client.0.smithi071.stdout:stripped: _obj ns=ns i=v1 2024-09-14T11:19:36.495 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: _obj[v1] 2024-09-14T11:19:36.495 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: _obj[v1] 2024-09-14T11:19:36.495 INFO:tasks.workunit.client.0.smithi071.stdout:stripped: _obj ns=ns i=v1 2024-09-14T11:19:36.495 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.495 INFO:tasks.workunit.client.0.smithi071.stdout: "obj1": { 2024-09-14T11:19:36.495 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.495 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.495 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.495 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.495 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.495 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.495 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.495 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.496 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.496 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.496 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.496 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.496 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_obj", 2024-09-14T11:19:36.496 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "v1", 2024-09-14T11:19:36.496 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.496 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.496 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.496 INFO:tasks.workunit.client.0.smithi071.stdout: "obj2": { 2024-09-14T11:19:36.496 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.496 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.496 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.496 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.497 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.497 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.497 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.497 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.497 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.497 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.497 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.497 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.497 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_obj", 2024-09-14T11:19:36.497 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "v1", 2024-09-14T11:19:36.497 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.497 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.497 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.497 INFO:tasks.workunit.client.0.smithi071.stdout: "obj3": { 2024-09-14T11:19:36.497 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.497 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.498 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.498 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.498 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.498 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.498 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.498 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.498 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.498 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.498 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.498 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.498 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_obj", 2024-09-14T11:19:36.498 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.498 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.498 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.498 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.499 INFO:tasks.workunit.client.0.smithi071.stdout: "obj3-2": { 2024-09-14T11:19:36.499 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.499 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.499 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.499 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.499 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.499 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.499 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.499 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.499 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.499 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.499 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.499 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.499 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_obj", 2024-09-14T11:19:36.500 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "v1", 2024-09-14T11:19:36.500 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.500 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.500 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.500 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.500 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-09-14T11:19:36.500 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-14T11:19:36.500 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: obj 2024-09-14T11:19:36.500 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: obj 2024-09-14T11:19:36.500 INFO:tasks.workunit.client.0.smithi071.stdout:stripped: obj ns= i= 2024-09-14T11:19:36.500 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: obj 2024-09-14T11:19:36.500 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: obj 2024-09-14T11:19:36.500 INFO:tasks.workunit.client.0.smithi071.stdout:stripped: obj ns= i= 2024-09-14T11:19:36.500 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: obj 2024-09-14T11:19:36.500 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: obj 2024-09-14T11:19:36.501 INFO:tasks.workunit.client.0.smithi071.stdout:stripped: obj ns= i= 2024-09-14T11:19:36.501 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.501 INFO:tasks.workunit.client.0.smithi071.stdout: "obj1": { 2024-09-14T11:19:36.501 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.501 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.501 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.501 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.501 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.501 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.501 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.501 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.502 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.502 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.502 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.502 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.502 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "obj", 2024-09-14T11:19:36.502 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.502 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.502 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.502 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.502 INFO:tasks.workunit.client.0.smithi071.stdout: "obj2": { 2024-09-14T11:19:36.502 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.502 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.502 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.502 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.502 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.503 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.503 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.503 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.503 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.503 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.503 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.503 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.503 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "obj", 2024-09-14T11:19:36.503 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.503 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.503 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.503 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.503 INFO:tasks.workunit.client.0.smithi071.stdout: "obj3": { 2024-09-14T11:19:36.503 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.503 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.504 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.504 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.504 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.504 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.504 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.504 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.504 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.504 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.504 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.504 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.504 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "obj", 2024-09-14T11:19:36.504 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.504 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.504 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.505 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.505 INFO:tasks.workunit.client.0.smithi071.stdout: "obj3-2": { 2024-09-14T11:19:36.505 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.505 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.505 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.505 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.505 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.505 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.505 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.505 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.505 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.505 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.505 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.505 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.505 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "obj", 2024-09-14T11:19:36.506 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.506 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.506 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.506 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.506 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.506 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: obj 2024-09-14T11:19:36.506 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: obj 2024-09-14T11:19:36.506 INFO:tasks.workunit.client.0.smithi071.stdout:stripped: obj ns=ns i= 2024-09-14T11:19:36.506 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: obj 2024-09-14T11:19:36.506 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: obj 2024-09-14T11:19:36.506 INFO:tasks.workunit.client.0.smithi071.stdout:stripped: obj ns=ns i= 2024-09-14T11:19:36.506 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: obj 2024-09-14T11:19:36.506 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: obj 2024-09-14T11:19:36.506 INFO:tasks.workunit.client.0.smithi071.stdout:stripped: obj ns=ns i= 2024-09-14T11:19:36.506 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.506 INFO:tasks.workunit.client.0.smithi071.stdout: "obj1": { 2024-09-14T11:19:36.507 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.507 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.507 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.507 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.507 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.507 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.507 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.507 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.507 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.507 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.507 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.507 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.507 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "obj", 2024-09-14T11:19:36.508 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.508 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.508 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.508 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.508 INFO:tasks.workunit.client.0.smithi071.stdout: "obj2": { 2024-09-14T11:19:36.508 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.508 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.508 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.508 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.508 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.508 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.508 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.508 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.508 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.508 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.509 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.509 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.509 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "obj", 2024-09-14T11:19:36.509 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.509 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.509 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.509 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.509 INFO:tasks.workunit.client.0.smithi071.stdout: "obj3": { 2024-09-14T11:19:36.509 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.509 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.509 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.509 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.509 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.510 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.510 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.510 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.510 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.510 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.510 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.510 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.510 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "obj", 2024-09-14T11:19:36.510 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.510 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.510 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.510 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.511 INFO:tasks.workunit.client.0.smithi071.stdout: "obj3-2": { 2024-09-14T11:19:36.511 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.511 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.511 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.511 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.511 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.511 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.511 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.511 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.511 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.511 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.511 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.511 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.511 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "obj", 2024-09-14T11:19:36.512 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.512 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.512 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.512 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.512 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.512 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: obj[v1] 2024-09-14T11:19:36.512 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: obj[v1] 2024-09-14T11:19:36.512 INFO:tasks.workunit.client.0.smithi071.stdout:stripped: obj ns= i=v1 2024-09-14T11:19:36.512 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: obj[v1] 2024-09-14T11:19:36.512 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: obj[v1] 2024-09-14T11:19:36.512 INFO:tasks.workunit.client.0.smithi071.stdout:stripped: obj ns= i=v1 2024-09-14T11:19:36.512 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: obj[v1] 2024-09-14T11:19:36.513 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: obj[v1] 2024-09-14T11:19:36.513 INFO:tasks.workunit.client.0.smithi071.stdout:stripped: obj ns= i=v1 2024-09-14T11:19:36.513 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.513 INFO:tasks.workunit.client.0.smithi071.stdout: "obj1": { 2024-09-14T11:19:36.513 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.513 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.513 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.513 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.513 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.513 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.513 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.513 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.513 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.514 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.514 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.514 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.514 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "obj", 2024-09-14T11:19:36.514 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "v1", 2024-09-14T11:19:36.514 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.514 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.514 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.514 INFO:tasks.workunit.client.0.smithi071.stdout: "obj2": { 2024-09-14T11:19:36.514 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.514 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.514 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.514 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.514 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.515 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.515 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.515 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.515 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.515 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.515 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.515 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.515 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "obj", 2024-09-14T11:19:36.515 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "v1", 2024-09-14T11:19:36.515 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.515 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.515 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.515 INFO:tasks.workunit.client.0.smithi071.stdout: "obj3": { 2024-09-14T11:19:36.515 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.516 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.516 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.516 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.516 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.516 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.516 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.516 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.516 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.516 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.516 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.516 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.516 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "obj", 2024-09-14T11:19:36.516 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.516 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.517 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.517 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.517 INFO:tasks.workunit.client.0.smithi071.stdout: "obj3-2": { 2024-09-14T11:19:36.517 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.517 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.517 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.517 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.517 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.517 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.517 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.517 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.517 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.517 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.517 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.517 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.518 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "obj", 2024-09-14T11:19:36.518 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "v1", 2024-09-14T11:19:36.518 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.518 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.518 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.518 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.518 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: obj[v1] 2024-09-14T11:19:36.518 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: obj[v1] 2024-09-14T11:19:36.518 INFO:tasks.workunit.client.0.smithi071.stdout:stripped: obj ns=ns i=v1 2024-09-14T11:19:36.518 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: obj[v1] 2024-09-14T11:19:36.518 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: obj[v1] 2024-09-14T11:19:36.518 INFO:tasks.workunit.client.0.smithi071.stdout:stripped: obj ns=ns i=v1 2024-09-14T11:19:36.518 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: obj[v1] 2024-09-14T11:19:36.518 INFO:tasks.workunit.client.0.smithi071.stdout:parsed: obj[v1] 2024-09-14T11:19:36.518 INFO:tasks.workunit.client.0.smithi071.stdout:stripped: obj ns=ns i=v1 2024-09-14T11:19:36.518 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.519 INFO:tasks.workunit.client.0.smithi071.stdout: "obj1": { 2024-09-14T11:19:36.519 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.519 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.519 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.519 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.519 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.519 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.519 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.519 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.519 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.519 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.519 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.519 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.520 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "obj", 2024-09-14T11:19:36.520 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "v1", 2024-09-14T11:19:36.520 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.520 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.520 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.520 INFO:tasks.workunit.client.0.smithi071.stdout: "obj2": { 2024-09-14T11:19:36.520 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.520 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.520 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.520 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.520 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.520 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.520 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.520 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.520 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.521 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.521 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.521 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.521 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "obj", 2024-09-14T11:19:36.521 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "v1", 2024-09-14T11:19:36.521 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.521 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.521 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.521 INFO:tasks.workunit.client.0.smithi071.stdout: "obj3": { 2024-09-14T11:19:36.521 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.521 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.521 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.521 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.521 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.522 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.522 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.522 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.522 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.522 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.522 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.522 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.522 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "obj", 2024-09-14T11:19:36.522 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.522 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.522 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.522 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.522 INFO:tasks.workunit.client.0.smithi071.stdout: "obj3-2": { 2024-09-14T11:19:36.522 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.523 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.523 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.523 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.523 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.523 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.523 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.523 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.523 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.523 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.523 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.523 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.523 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "obj", 2024-09-14T11:19:36.523 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "v1", 2024-09-14T11:19:36.523 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.524 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.524 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.524 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.524 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-14T11:19:36.524 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-14T11:19:36.524 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.524 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.524 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.524 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.524 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.524 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.524 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.524 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.524 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.524 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.525 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.525 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.525 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.525 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.525 INFO:tasks.workunit.client.0.smithi071.stdout: "obj": { 2024-09-14T11:19:36.525 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.525 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.525 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.525 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.525 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.525 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.525 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.525 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.526 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.526 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.526 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.526 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.526 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "myobj", 2024-09-14T11:19:36.526 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.526 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.526 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.526 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.526 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.526 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.526 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj": { 2024-09-14T11:19:36.526 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": "default-placement.data", 2024-09-14T11:19:36.527 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker_myobj", 2024-09-14T11:19:36.527 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "" 2024-09-14T11:19:36.527 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.527 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.527 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.527 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj": { 2024-09-14T11:19:36.527 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.527 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.527 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.527 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.527 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.527 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.527 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.527 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.528 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.528 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.528 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.528 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.528 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "myobj", 2024-09-14T11:19:36.528 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.528 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.528 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.528 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.528 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.528 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.528 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.528 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.528 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.528 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.529 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.529 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.529 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.529 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.529 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.529 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.529 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.529 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.529 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.529 INFO:tasks.workunit.client.0.smithi071.stdout: "obj": { 2024-09-14T11:19:36.529 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.530 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.530 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.530 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.530 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.530 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.530 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.530 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.530 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.530 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.530 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.530 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.530 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "myobj", 2024-09-14T11:19:36.530 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.530 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.531 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.531 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.531 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.531 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.531 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj": { 2024-09-14T11:19:36.531 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": ".data-pool", 2024-09-14T11:19:36.531 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker_myobj", 2024-09-14T11:19:36.531 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "" 2024-09-14T11:19:36.531 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.531 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.531 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.531 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj": { 2024-09-14T11:19:36.531 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.532 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.532 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.532 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.532 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.532 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.532 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.532 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.532 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.532 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.532 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.532 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.532 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "myobj", 2024-09-14T11:19:36.532 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.532 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.533 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.533 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.533 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.533 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.533 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.533 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.533 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.533 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.533 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.533 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.533 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.533 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.534 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.534 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.534 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.534 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.534 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.534 INFO:tasks.workunit.client.0.smithi071.stdout: "obj": { 2024-09-14T11:19:36.534 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.534 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.534 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.534 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.534 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.534 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.534 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.534 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.534 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.535 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.535 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.535 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.535 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "myobj", 2024-09-14T11:19:36.535 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.535 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.535 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.535 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.535 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.535 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.535 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj": { 2024-09-14T11:19:36.535 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": "default-placement.data", 2024-09-14T11:19:36.535 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:19:36.535 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "" 2024-09-14T11:19:36.535 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.536 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.536 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.536 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj": { 2024-09-14T11:19:36.536 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.536 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.536 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.536 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.536 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.536 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.536 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.536 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.536 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.536 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.536 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.536 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.537 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "myobj", 2024-09-14T11:19:36.537 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.537 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.537 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.537 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.537 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.537 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.537 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.537 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.537 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.537 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.537 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.537 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.537 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.538 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.538 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.538 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.538 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.538 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.538 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.538 INFO:tasks.workunit.client.0.smithi071.stdout: "obj": { 2024-09-14T11:19:36.538 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.538 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.538 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.538 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.538 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.538 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.538 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.538 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.539 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.539 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.539 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.539 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.539 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "myobj", 2024-09-14T11:19:36.539 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.539 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.539 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.539 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.539 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.539 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.539 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj": { 2024-09-14T11:19:36.539 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": ".data-pool", 2024-09-14T11:19:36.539 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:19:36.539 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "" 2024-09-14T11:19:36.539 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.540 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.540 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.540 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj": { 2024-09-14T11:19:36.540 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.540 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.540 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.540 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.540 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.540 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.540 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.540 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.540 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.540 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.540 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.541 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.541 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "myobj", 2024-09-14T11:19:36.541 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.541 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.541 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.541 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.541 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.541 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.541 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.541 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.541 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.541 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.541 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.541 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.541 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.542 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.542 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.542 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.542 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.542 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.542 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.542 INFO:tasks.workunit.client.0.smithi071.stdout: "obj": { 2024-09-14T11:19:36.542 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.542 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.542 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.542 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.542 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.542 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.542 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.542 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.543 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.543 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.543 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.543 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.543 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "myobj", 2024-09-14T11:19:36.543 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "inst", 2024-09-14T11:19:36.543 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.543 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.543 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.543 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.543 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.543 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj": { 2024-09-14T11:19:36.543 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": "default-placement.data", 2024-09-14T11:19:36.543 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:19:36.543 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "" 2024-09-14T11:19:36.544 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.544 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.544 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.544 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj": { 2024-09-14T11:19:36.544 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.544 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.544 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.544 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.544 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.544 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.544 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.544 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.544 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.544 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.545 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.545 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.545 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "myobj", 2024-09-14T11:19:36.545 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "inst", 2024-09-14T11:19:36.545 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.545 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.545 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.545 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.545 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.545 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.545 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.545 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.545 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.545 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.545 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.546 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.546 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.546 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.546 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.546 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.546 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.546 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.546 INFO:tasks.workunit.client.0.smithi071.stdout: "obj": { 2024-09-14T11:19:36.546 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.546 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.546 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.546 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.546 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.546 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.547 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.547 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.547 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.547 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.547 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.547 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.547 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "myobj", 2024-09-14T11:19:36.547 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "inst", 2024-09-14T11:19:36.547 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.547 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.547 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.547 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.547 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.547 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj": { 2024-09-14T11:19:36.547 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": ".data-pool", 2024-09-14T11:19:36.548 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:19:36.548 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "" 2024-09-14T11:19:36.548 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.548 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.548 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.548 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj": { 2024-09-14T11:19:36.548 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.548 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.548 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.548 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.548 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.548 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.548 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.548 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.548 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.549 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.549 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.549 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.549 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "myobj", 2024-09-14T11:19:36.549 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "inst", 2024-09-14T11:19:36.549 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.549 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.549 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.549 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.549 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.549 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.549 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.549 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.549 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.549 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.550 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.550 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.550 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.550 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.550 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.550 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.550 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.550 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.550 INFO:tasks.workunit.client.0.smithi071.stdout: "obj": { 2024-09-14T11:19:36.550 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.550 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.550 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.550 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.550 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.550 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.551 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.551 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.551 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.551 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.551 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.551 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.551 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "myobj", 2024-09-14T11:19:36.551 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "inst", 2024-09-14T11:19:36.551 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.551 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.551 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.551 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.551 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.551 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj": { 2024-09-14T11:19:36.551 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": "default-placement.data", 2024-09-14T11:19:36.552 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:19:36.552 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "" 2024-09-14T11:19:36.552 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.552 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.552 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.552 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj": { 2024-09-14T11:19:36.552 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.552 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.552 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.552 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.552 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.552 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.553 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.553 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.553 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.553 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.553 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.553 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.553 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "myobj", 2024-09-14T11:19:36.553 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "inst", 2024-09-14T11:19:36.553 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.553 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.553 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.553 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.553 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.553 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.554 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.554 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.554 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.554 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.554 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.554 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.554 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.554 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.554 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.554 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.554 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.554 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.554 INFO:tasks.workunit.client.0.smithi071.stdout: "obj": { 2024-09-14T11:19:36.554 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.555 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.555 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.555 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.555 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.555 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.555 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.555 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.555 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.555 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.555 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.555 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.555 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "myobj", 2024-09-14T11:19:36.555 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "inst", 2024-09-14T11:19:36.555 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.556 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.556 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.556 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.556 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.556 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj": { 2024-09-14T11:19:36.556 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": ".data-pool", 2024-09-14T11:19:36.556 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:19:36.556 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "" 2024-09-14T11:19:36.556 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.556 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.556 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.556 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj": { 2024-09-14T11:19:36.556 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.556 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.557 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.557 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.557 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.557 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.557 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.557 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.557 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.557 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.557 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.557 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.557 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "myobj", 2024-09-14T11:19:36.557 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "inst", 2024-09-14T11:19:36.557 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.557 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.558 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.558 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.558 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.558 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.558 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.558 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.558 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.558 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.558 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.558 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.558 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.558 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.558 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.558 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.559 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.559 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.559 INFO:tasks.workunit.client.0.smithi071.stdout: "obj": { 2024-09-14T11:19:36.559 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.559 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.559 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.559 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.559 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.559 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.559 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.559 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.559 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.559 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.559 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.559 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.560 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj", 2024-09-14T11:19:36.560 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.560 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.560 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.560 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.560 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.560 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.560 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj": { 2024-09-14T11:19:36.560 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": "default-placement.data", 2024-09-14T11:19:36.560 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker___myobj", 2024-09-14T11:19:36.560 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "marker__myobj" 2024-09-14T11:19:36.560 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.560 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.560 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.561 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj": { 2024-09-14T11:19:36.561 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.561 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.561 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.561 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.561 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.561 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.561 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.561 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.561 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.561 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.561 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.561 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.561 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj", 2024-09-14T11:19:36.562 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.562 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.562 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.562 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.562 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.562 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.562 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.562 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.562 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.562 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.562 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.562 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.562 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.562 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.563 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.563 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.563 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.563 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.563 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.563 INFO:tasks.workunit.client.0.smithi071.stdout: "obj": { 2024-09-14T11:19:36.563 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.563 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.563 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.563 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.563 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.563 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.563 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.563 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.563 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.564 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.564 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.564 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.564 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj", 2024-09-14T11:19:36.564 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.564 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.564 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.564 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.564 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.564 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.564 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj": { 2024-09-14T11:19:36.564 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": ".data-pool", 2024-09-14T11:19:36.564 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker___myobj", 2024-09-14T11:19:36.564 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "marker__myobj" 2024-09-14T11:19:36.564 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.565 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.565 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.565 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj": { 2024-09-14T11:19:36.565 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.565 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.565 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.565 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.565 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.565 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.565 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.565 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.565 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.565 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.565 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.566 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.566 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj", 2024-09-14T11:19:36.566 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.566 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.566 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.566 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.566 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.566 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.566 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.566 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.566 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.566 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.566 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.566 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.566 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.567 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.567 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.567 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.567 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.567 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.567 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.567 INFO:tasks.workunit.client.0.smithi071.stdout: "obj": { 2024-09-14T11:19:36.567 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.567 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.567 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.567 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.567 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.567 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.567 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.568 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.568 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.568 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.568 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.568 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.568 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj", 2024-09-14T11:19:36.568 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.568 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.568 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.568 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.568 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.568 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.568 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj": { 2024-09-14T11:19:36.568 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": "default-placement.data", 2024-09-14T11:19:36.568 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:19:36.569 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "" 2024-09-14T11:19:36.569 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.569 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.569 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.569 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj": { 2024-09-14T11:19:36.569 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.569 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.569 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.569 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.569 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.569 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.569 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.569 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.569 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.570 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.570 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.570 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.570 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj", 2024-09-14T11:19:36.570 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.570 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.570 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.570 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.570 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.570 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.570 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.570 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.570 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.570 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.570 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.571 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.571 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.571 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.571 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.571 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.571 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.571 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.571 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.571 INFO:tasks.workunit.client.0.smithi071.stdout: "obj": { 2024-09-14T11:19:36.571 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.571 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.571 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.571 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.571 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.571 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.572 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.572 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.572 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.572 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.572 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.572 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.572 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj", 2024-09-14T11:19:36.572 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.572 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.572 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.572 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.572 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.572 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.572 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj": { 2024-09-14T11:19:36.572 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": ".data-pool", 2024-09-14T11:19:36.573 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:19:36.573 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "" 2024-09-14T11:19:36.573 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.573 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.573 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.573 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj": { 2024-09-14T11:19:36.573 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.573 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.573 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.573 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.573 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.573 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.573 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.573 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.573 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.573 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.574 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.574 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.574 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj", 2024-09-14T11:19:36.574 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.574 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.574 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.574 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.574 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.574 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.574 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.574 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.574 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.574 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.574 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.574 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.574 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.575 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.575 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.575 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.575 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.575 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.575 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.575 INFO:tasks.workunit.client.0.smithi071.stdout: "obj": { 2024-09-14T11:19:36.575 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.575 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.575 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.575 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.575 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.575 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.575 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.575 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.576 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.576 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.576 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.576 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.576 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj", 2024-09-14T11:19:36.576 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "inst", 2024-09-14T11:19:36.576 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.576 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.576 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.576 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.576 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.576 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj": { 2024-09-14T11:19:36.576 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": "default-placement.data", 2024-09-14T11:19:36.577 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:19:36.577 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "marker__myobj" 2024-09-14T11:19:36.577 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.577 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.577 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.577 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj": { 2024-09-14T11:19:36.577 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.577 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.577 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.577 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.577 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.578 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.578 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.578 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.578 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.578 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.578 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.578 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.578 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj", 2024-09-14T11:19:36.578 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "inst", 2024-09-14T11:19:36.578 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.578 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.578 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.578 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.578 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.578 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.579 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.579 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.579 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.579 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.579 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.579 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.579 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.579 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.579 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.579 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.579 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.579 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.579 INFO:tasks.workunit.client.0.smithi071.stdout: "obj": { 2024-09-14T11:19:36.579 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.579 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.580 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.580 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.580 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.580 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.580 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.580 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.580 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.580 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.580 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.580 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.580 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj", 2024-09-14T11:19:36.580 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "inst", 2024-09-14T11:19:36.580 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.580 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.581 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.581 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.581 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.581 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj": { 2024-09-14T11:19:36.581 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": ".data-pool", 2024-09-14T11:19:36.581 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:19:36.581 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "marker__myobj" 2024-09-14T11:19:36.581 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.581 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.581 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.581 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj": { 2024-09-14T11:19:36.581 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.581 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.581 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.581 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.582 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.582 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.582 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.582 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.582 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.582 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.582 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.582 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.582 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj", 2024-09-14T11:19:36.582 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "inst", 2024-09-14T11:19:36.582 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.582 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.582 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.583 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.583 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.583 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.583 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.583 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.583 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.583 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.583 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.583 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.583 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.583 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.583 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.583 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.583 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.583 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.583 INFO:tasks.workunit.client.0.smithi071.stdout: "obj": { 2024-09-14T11:19:36.584 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.584 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.584 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.584 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.584 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.584 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.584 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.584 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.584 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.584 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.584 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.584 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.584 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj", 2024-09-14T11:19:36.584 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "inst", 2024-09-14T11:19:36.584 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.585 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.585 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.585 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.585 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.585 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj": { 2024-09-14T11:19:36.585 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": "default-placement.data", 2024-09-14T11:19:36.585 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:19:36.585 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "" 2024-09-14T11:19:36.585 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.585 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.585 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.585 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj": { 2024-09-14T11:19:36.585 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.585 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.586 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.586 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.586 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.586 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.586 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.586 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.586 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.586 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.586 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.586 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.586 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj", 2024-09-14T11:19:36.586 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "inst", 2024-09-14T11:19:36.586 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.586 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.586 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.587 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.587 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.587 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.587 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.587 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.587 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.587 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.587 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.587 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.587 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.587 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.587 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.587 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.587 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.587 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.588 INFO:tasks.workunit.client.0.smithi071.stdout: "obj": { 2024-09-14T11:19:36.588 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.588 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.588 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.588 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.588 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.588 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.588 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.588 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.588 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.588 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.588 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.588 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.588 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj", 2024-09-14T11:19:36.589 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "inst", 2024-09-14T11:19:36.589 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.589 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.589 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.589 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.589 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.589 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj": { 2024-09-14T11:19:36.589 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": ".data-pool", 2024-09-14T11:19:36.589 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:19:36.589 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "" 2024-09-14T11:19:36.589 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.589 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.589 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.589 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj": { 2024-09-14T11:19:36.589 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.590 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.590 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.590 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.590 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.590 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.590 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.590 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.590 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.590 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.590 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.590 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.590 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj", 2024-09-14T11:19:36.590 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "inst", 2024-09-14T11:19:36.590 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.590 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.591 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.591 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.591 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.591 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.591 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.591 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.591 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.591 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.591 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.591 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.591 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.591 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.592 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.592 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.592 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.592 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.592 INFO:tasks.workunit.client.0.smithi071.stdout: "obj": { 2024-09-14T11:19:36.592 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.592 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.592 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.592 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.592 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.592 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.592 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.592 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.592 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.592 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.593 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.593 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.593 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj_", 2024-09-14T11:19:36.593 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.593 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.593 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.593 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.593 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.593 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.593 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj": { 2024-09-14T11:19:36.593 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": "default-placement.data", 2024-09-14T11:19:36.593 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker___myobj_", 2024-09-14T11:19:36.593 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "marker__myobj_" 2024-09-14T11:19:36.593 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.594 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.594 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.594 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj": { 2024-09-14T11:19:36.594 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.594 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.594 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.594 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.594 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.594 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.594 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.594 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.594 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.594 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.594 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.594 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.595 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj_", 2024-09-14T11:19:36.595 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.595 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.595 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.595 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.595 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.595 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.595 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.595 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.595 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.595 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.595 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.595 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.595 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.595 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.596 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.596 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.596 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.596 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.596 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.596 INFO:tasks.workunit.client.0.smithi071.stdout: "obj": { 2024-09-14T11:19:36.596 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.596 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.596 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.596 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.596 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.596 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.596 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.596 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.596 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.597 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.597 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.597 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.597 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj_", 2024-09-14T11:19:36.597 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.597 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.597 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.597 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.597 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.597 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.597 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj": { 2024-09-14T11:19:36.597 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": ".data-pool", 2024-09-14T11:19:36.597 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker___myobj_", 2024-09-14T11:19:36.597 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "marker__myobj_" 2024-09-14T11:19:36.597 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.598 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.598 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.598 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj": { 2024-09-14T11:19:36.598 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.598 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.598 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.598 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.598 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.598 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.598 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.598 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.598 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.598 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.598 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.598 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.599 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj_", 2024-09-14T11:19:36.599 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.599 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.599 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.599 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.599 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.599 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.599 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.599 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.599 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.599 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.599 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.599 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.599 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.599 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.600 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.600 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.600 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.600 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.600 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.600 INFO:tasks.workunit.client.0.smithi071.stdout: "obj": { 2024-09-14T11:19:36.600 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.600 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.600 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.600 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.600 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.600 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.600 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.600 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.601 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.601 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.601 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.601 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.601 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj_", 2024-09-14T11:19:36.601 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.601 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.601 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.601 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.601 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.601 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.601 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj": { 2024-09-14T11:19:36.601 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": "default-placement.data", 2024-09-14T11:19:36.601 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:19:36.601 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "" 2024-09-14T11:19:36.602 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.602 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.602 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.602 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj": { 2024-09-14T11:19:36.602 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.602 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.602 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.602 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.602 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.602 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.602 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.602 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.602 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.602 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.602 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.603 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.603 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj_", 2024-09-14T11:19:36.603 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.603 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.603 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.603 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.603 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.603 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.603 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.603 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.603 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.603 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.603 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.603 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.603 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.603 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.604 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.604 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.604 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.604 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.604 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.604 INFO:tasks.workunit.client.0.smithi071.stdout: "obj": { 2024-09-14T11:19:36.604 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.604 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.604 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.604 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.604 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.604 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.604 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.604 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.604 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.605 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.605 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.605 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.605 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj_", 2024-09-14T11:19:36.605 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.605 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.605 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.605 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.605 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.605 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.605 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj": { 2024-09-14T11:19:36.605 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": ".data-pool", 2024-09-14T11:19:36.605 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:19:36.605 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "" 2024-09-14T11:19:36.606 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.606 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.606 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.606 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj": { 2024-09-14T11:19:36.606 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.606 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.606 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.606 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.606 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.606 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.606 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.606 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.606 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.606 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.606 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.607 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.607 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj_", 2024-09-14T11:19:36.607 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.607 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.607 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.607 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.607 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.607 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.607 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.607 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.607 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.607 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.607 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.607 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.607 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.608 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.608 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.608 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.608 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.608 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.608 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.608 INFO:tasks.workunit.client.0.smithi071.stdout: "obj": { 2024-09-14T11:19:36.608 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.608 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.608 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.608 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.608 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.608 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.608 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.609 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.609 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.609 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.609 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.609 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.609 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj_", 2024-09-14T11:19:36.609 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "inst", 2024-09-14T11:19:36.609 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.609 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.609 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.609 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.609 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.609 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj": { 2024-09-14T11:19:36.609 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": "default-placement.data", 2024-09-14T11:19:36.609 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:19:36.610 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "marker__myobj_" 2024-09-14T11:19:36.610 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.610 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.610 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.610 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj": { 2024-09-14T11:19:36.610 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.610 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.610 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.610 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.610 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.610 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.610 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.610 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.611 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.611 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.611 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.612 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.612 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj_", 2024-09-14T11:19:36.612 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "inst", 2024-09-14T11:19:36.612 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.612 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.612 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.612 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.612 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.612 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.612 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.612 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.612 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.612 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.612 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.613 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.613 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.613 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.613 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.613 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.613 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.613 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.613 INFO:tasks.workunit.client.0.smithi071.stdout: "obj": { 2024-09-14T11:19:36.613 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.613 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.613 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.613 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.613 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.613 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.613 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.614 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.614 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.614 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.614 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.614 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.614 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj_", 2024-09-14T11:19:36.614 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "inst", 2024-09-14T11:19:36.614 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.614 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.614 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.614 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.614 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.614 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj": { 2024-09-14T11:19:36.614 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": ".data-pool", 2024-09-14T11:19:36.614 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:19:36.615 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "marker__myobj_" 2024-09-14T11:19:36.615 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.615 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.615 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.615 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj": { 2024-09-14T11:19:36.615 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.615 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.615 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.615 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.615 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.615 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.615 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.615 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.615 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.615 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.616 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.616 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.616 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj_", 2024-09-14T11:19:36.616 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "inst", 2024-09-14T11:19:36.616 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.616 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.616 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.616 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.616 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.616 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.616 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.616 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.616 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.616 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.616 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.617 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.617 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.617 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.617 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.617 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.617 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.617 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.617 INFO:tasks.workunit.client.0.smithi071.stdout: "obj": { 2024-09-14T11:19:36.617 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.617 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.617 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.617 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.617 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.617 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.617 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.618 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.618 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.618 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.618 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.618 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.618 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj_", 2024-09-14T11:19:36.618 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "inst", 2024-09-14T11:19:36.618 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.618 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.618 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.618 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.618 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.618 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj": { 2024-09-14T11:19:36.618 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": "default-placement.data", 2024-09-14T11:19:36.618 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:19:36.619 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "" 2024-09-14T11:19:36.619 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.619 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.619 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.619 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj": { 2024-09-14T11:19:36.619 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.619 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "test", 2024-09-14T11:19:36.619 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.619 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.619 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.619 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.619 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": "", 2024-09-14T11:19:36.619 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.619 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": "" 2024-09-14T11:19:36.619 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.620 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.620 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.620 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj_", 2024-09-14T11:19:36.620 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "inst", 2024-09-14T11:19:36.620 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.620 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.620 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.620 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.620 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.620 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.620 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.620 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.620 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.620 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.621 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.621 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.621 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.621 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.621 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.621 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.621 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.621 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.621 INFO:tasks.workunit.client.0.smithi071.stdout: "obj": { 2024-09-14T11:19:36.621 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.621 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.621 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.621 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.621 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.621 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.622 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.622 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.622 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.622 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.622 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.622 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.622 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj_", 2024-09-14T11:19:36.622 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "inst", 2024-09-14T11:19:36.622 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.622 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.622 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.622 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.622 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.622 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj": { 2024-09-14T11:19:36.623 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": ".data-pool", 2024-09-14T11:19:36.623 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:19:36.623 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "" 2024-09-14T11:19:36.623 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.623 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.623 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.623 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj": { 2024-09-14T11:19:36.623 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.623 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.623 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.623 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.623 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.623 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.623 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.623 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.624 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.624 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.624 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.624 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.624 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj_", 2024-09-14T11:19:36.624 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "inst", 2024-09-14T11:19:36.624 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.624 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.624 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.624 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.624 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestRGWObj.obj_to_raw (1 ms) 2024-09-14T11:19:36.624 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-14T11:19:36.625 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.625 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj": { 2024-09-14T11:19:36.625 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": ".data-pool", 2024-09-14T11:19:36.625 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker_myobj", 2024-09-14T11:19:36.625 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "" 2024-09-14T11:19:36.625 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.625 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.625 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.625 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj": { 2024-09-14T11:19:36.625 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.625 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.625 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.625 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.625 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.626 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.626 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.626 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.626 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.626 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.626 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.626 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.626 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "myobj", 2024-09-14T11:19:36.626 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.626 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.626 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.626 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.626 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.626 INFO:tasks.workunit.client.0.smithi071.stdout:raw=.data-pool:marker_myobj 2024-09-14T11:19:36.627 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.627 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj2": { 2024-09-14T11:19:36.627 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": ".data-pool", 2024-09-14T11:19:36.627 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker_myobj", 2024-09-14T11:19:36.627 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "" 2024-09-14T11:19:36.627 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.627 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.627 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.627 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj2": { 2024-09-14T11:19:36.627 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.627 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.627 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.627 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.628 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.628 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.628 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.628 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.628 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.628 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.628 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.628 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.628 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "myobj", 2024-09-14T11:19:36.628 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.628 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.628 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.628 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.628 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.628 INFO:tasks.workunit.client.0.smithi071.stdout:raw2=.data-pool:marker_myobj 2024-09-14T11:19:36.629 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.629 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj": { 2024-09-14T11:19:36.629 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": ".data-pool", 2024-09-14T11:19:36.629 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:19:36.629 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "" 2024-09-14T11:19:36.629 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.629 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.629 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.629 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj": { 2024-09-14T11:19:36.629 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.629 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.629 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.629 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.629 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.629 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.630 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.630 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.630 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.630 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.630 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.630 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.630 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "myobj", 2024-09-14T11:19:36.630 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.630 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.630 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.630 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.630 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.630 INFO:tasks.workunit.client.0.smithi071.stdout:raw=.data-pool:marker__ns_myobj 2024-09-14T11:19:36.630 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.630 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj2": { 2024-09-14T11:19:36.631 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": ".data-pool", 2024-09-14T11:19:36.631 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:19:36.631 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "" 2024-09-14T11:19:36.631 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.631 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.631 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.631 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj2": { 2024-09-14T11:19:36.631 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.631 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.631 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.631 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.631 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.631 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.631 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.631 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.632 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.632 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.632 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.632 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.632 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "myobj", 2024-09-14T11:19:36.632 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.632 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.632 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.632 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.632 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.632 INFO:tasks.workunit.client.0.smithi071.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-14T11:19:36.632 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.632 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj": { 2024-09-14T11:19:36.633 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": ".data-pool", 2024-09-14T11:19:36.633 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:19:36.633 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "" 2024-09-14T11:19:36.633 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.633 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.633 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.633 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj": { 2024-09-14T11:19:36.633 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.633 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.633 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.633 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.633 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.633 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.633 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.634 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.634 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.634 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.634 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.634 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.634 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "myobj", 2024-09-14T11:19:36.634 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "inst", 2024-09-14T11:19:36.634 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.634 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.634 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.634 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.634 INFO:tasks.workunit.client.0.smithi071.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-14T11:19:36.634 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.634 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj2": { 2024-09-14T11:19:36.634 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": ".data-pool", 2024-09-14T11:19:36.635 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:19:36.635 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "" 2024-09-14T11:19:36.635 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.635 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.635 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.635 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj2": { 2024-09-14T11:19:36.635 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.635 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.635 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.635 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.635 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.635 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.635 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.635 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.635 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.636 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.636 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.636 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.636 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "myobj", 2024-09-14T11:19:36.636 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "inst", 2024-09-14T11:19:36.636 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.636 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.636 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.636 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.636 INFO:tasks.workunit.client.0.smithi071.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-14T11:19:36.636 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.636 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj": { 2024-09-14T11:19:36.636 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": ".data-pool", 2024-09-14T11:19:36.636 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:19:36.636 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "" 2024-09-14T11:19:36.637 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.637 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.637 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.637 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj": { 2024-09-14T11:19:36.637 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.637 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.637 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.637 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.637 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.637 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.637 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.637 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.637 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.637 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.637 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.638 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.638 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "myobj", 2024-09-14T11:19:36.638 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "inst", 2024-09-14T11:19:36.638 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.638 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.638 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.638 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.638 INFO:tasks.workunit.client.0.smithi071.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-14T11:19:36.638 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.638 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj2": { 2024-09-14T11:19:36.638 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": ".data-pool", 2024-09-14T11:19:36.638 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:19:36.638 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "" 2024-09-14T11:19:36.638 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.639 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.639 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.639 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj2": { 2024-09-14T11:19:36.639 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.639 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.639 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.639 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.639 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.639 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.639 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.639 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.639 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.639 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.639 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.639 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.640 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "myobj", 2024-09-14T11:19:36.640 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "inst", 2024-09-14T11:19:36.640 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.640 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.640 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.640 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.640 INFO:tasks.workunit.client.0.smithi071.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-14T11:19:36.640 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.640 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj": { 2024-09-14T11:19:36.640 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": ".data-pool", 2024-09-14T11:19:36.640 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker___myobj", 2024-09-14T11:19:36.640 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "marker__myobj" 2024-09-14T11:19:36.640 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.640 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.640 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.641 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj": { 2024-09-14T11:19:36.641 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.641 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.641 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.641 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.641 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.641 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.641 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.641 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.641 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.641 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.641 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.641 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.641 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj", 2024-09-14T11:19:36.641 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.642 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.642 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.642 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.642 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.642 INFO:tasks.workunit.client.0.smithi071.stdout:raw=.data-pool:marker___myobj 2024-09-14T11:19:36.642 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.642 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj2": { 2024-09-14T11:19:36.642 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": ".data-pool", 2024-09-14T11:19:36.642 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker___myobj", 2024-09-14T11:19:36.642 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "marker__myobj" 2024-09-14T11:19:36.642 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.642 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.642 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.642 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj2": { 2024-09-14T11:19:36.642 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.643 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.643 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.643 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.643 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.643 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.643 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.643 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.643 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.643 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.643 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.643 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.643 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj", 2024-09-14T11:19:36.643 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.643 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.643 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.643 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.644 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.644 INFO:tasks.workunit.client.0.smithi071.stdout:raw2=.data-pool:marker___myobj 2024-09-14T11:19:36.644 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.644 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj": { 2024-09-14T11:19:36.644 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": ".data-pool", 2024-09-14T11:19:36.644 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:19:36.644 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "" 2024-09-14T11:19:36.644 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.644 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.644 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.644 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj": { 2024-09-14T11:19:36.644 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.644 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.644 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.645 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.645 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.645 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.645 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.645 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.645 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.645 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.645 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.645 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.645 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj", 2024-09-14T11:19:36.645 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.645 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.645 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.645 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.646 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.646 INFO:tasks.workunit.client.0.smithi071.stdout:raw=.data-pool:marker__ns__myobj 2024-09-14T11:19:36.646 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.646 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj2": { 2024-09-14T11:19:36.646 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": ".data-pool", 2024-09-14T11:19:36.646 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:19:36.646 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "" 2024-09-14T11:19:36.646 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.646 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.646 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.646 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj2": { 2024-09-14T11:19:36.646 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.646 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.646 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.646 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.646 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.647 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.647 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.647 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.647 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.647 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.647 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.647 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.647 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj", 2024-09-14T11:19:36.647 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.647 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.647 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.647 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.647 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.647 INFO:tasks.workunit.client.0.smithi071.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-14T11:19:36.647 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.648 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj": { 2024-09-14T11:19:36.648 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": ".data-pool", 2024-09-14T11:19:36.648 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:19:36.648 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "marker__myobj" 2024-09-14T11:19:36.648 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.648 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.648 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.648 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj": { 2024-09-14T11:19:36.648 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.648 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.648 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.648 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.648 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.648 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.649 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.649 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.649 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.649 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.649 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.649 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.649 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj", 2024-09-14T11:19:36.649 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "inst", 2024-09-14T11:19:36.649 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.649 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.649 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.649 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.649 INFO:tasks.workunit.client.0.smithi071.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-14T11:19:36.649 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.649 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj2": { 2024-09-14T11:19:36.650 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": ".data-pool", 2024-09-14T11:19:36.650 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:19:36.650 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "marker__myobj" 2024-09-14T11:19:36.650 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.650 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.650 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.650 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj2": { 2024-09-14T11:19:36.650 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.650 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.650 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.650 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.650 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.650 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.650 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.650 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.651 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.651 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.651 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.651 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.651 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj", 2024-09-14T11:19:36.651 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "inst", 2024-09-14T11:19:36.651 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.651 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.651 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.651 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.651 INFO:tasks.workunit.client.0.smithi071.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-14T11:19:36.651 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.651 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj": { 2024-09-14T11:19:36.651 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": ".data-pool", 2024-09-14T11:19:36.651 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:19:36.652 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "" 2024-09-14T11:19:36.652 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.652 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.652 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.652 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj": { 2024-09-14T11:19:36.652 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.652 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.652 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.652 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.652 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.652 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.652 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.652 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.652 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.653 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.653 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.653 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.653 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj", 2024-09-14T11:19:36.653 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "inst", 2024-09-14T11:19:36.653 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.653 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.653 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.653 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.653 INFO:tasks.workunit.client.0.smithi071.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-14T11:19:36.653 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.653 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj2": { 2024-09-14T11:19:36.653 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": ".data-pool", 2024-09-14T11:19:36.653 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:19:36.653 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "" 2024-09-14T11:19:36.654 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.654 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.654 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.654 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj2": { 2024-09-14T11:19:36.654 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.654 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.654 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.654 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.654 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.654 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.654 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.654 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.654 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.654 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.654 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.655 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.655 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj", 2024-09-14T11:19:36.655 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "inst", 2024-09-14T11:19:36.655 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.655 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.655 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.655 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.655 INFO:tasks.workunit.client.0.smithi071.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-14T11:19:36.655 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.655 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj": { 2024-09-14T11:19:36.655 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": ".data-pool", 2024-09-14T11:19:36.655 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker___myobj_", 2024-09-14T11:19:36.655 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "marker__myobj_" 2024-09-14T11:19:36.655 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.655 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.656 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.656 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj": { 2024-09-14T11:19:36.656 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.656 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.656 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.656 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.656 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.656 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.656 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.656 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.656 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.656 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.656 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.656 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.657 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj_", 2024-09-14T11:19:36.657 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.657 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.657 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.657 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.657 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.657 INFO:tasks.workunit.client.0.smithi071.stdout:raw=.data-pool:marker___myobj_ 2024-09-14T11:19:36.657 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.657 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj2": { 2024-09-14T11:19:36.657 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": ".data-pool", 2024-09-14T11:19:36.657 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker___myobj_", 2024-09-14T11:19:36.657 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "marker__myobj_" 2024-09-14T11:19:36.657 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.658 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.658 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.658 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj2": { 2024-09-14T11:19:36.658 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.658 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.658 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.658 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.658 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.658 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.658 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.658 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.658 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.658 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.658 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.658 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.658 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj_", 2024-09-14T11:19:36.659 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.659 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.659 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.659 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.659 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.659 INFO:tasks.workunit.client.0.smithi071.stdout:raw2=.data-pool:marker___myobj_ 2024-09-14T11:19:36.659 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.659 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj": { 2024-09-14T11:19:36.659 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": ".data-pool", 2024-09-14T11:19:36.659 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:19:36.659 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "" 2024-09-14T11:19:36.659 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.659 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.660 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.660 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj": { 2024-09-14T11:19:36.660 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.660 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.660 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.660 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.660 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.660 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.660 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.660 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.660 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.660 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.660 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.660 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.660 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj_", 2024-09-14T11:19:36.661 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.661 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.661 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.661 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.661 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.661 INFO:tasks.workunit.client.0.smithi071.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-14T11:19:36.661 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.661 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj2": { 2024-09-14T11:19:36.661 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": ".data-pool", 2024-09-14T11:19:36.661 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:19:36.661 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "" 2024-09-14T11:19:36.661 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.661 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.661 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.661 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj2": { 2024-09-14T11:19:36.662 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.662 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.662 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.662 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.662 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.662 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.662 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.662 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.662 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.662 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.662 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.662 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.662 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj_", 2024-09-14T11:19:36.662 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "", 2024-09-14T11:19:36.662 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.663 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.663 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.663 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.663 INFO:tasks.workunit.client.0.smithi071.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-14T11:19:36.663 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.663 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj": { 2024-09-14T11:19:36.663 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": ".data-pool", 2024-09-14T11:19:36.663 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:19:36.663 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "marker__myobj_" 2024-09-14T11:19:36.663 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.663 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.663 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.663 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj": { 2024-09-14T11:19:36.663 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.663 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.663 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.664 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.664 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.664 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.664 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.664 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.664 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.664 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.664 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.664 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.664 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj_", 2024-09-14T11:19:36.664 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "inst", 2024-09-14T11:19:36.664 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.665 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.665 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.665 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.665 INFO:tasks.workunit.client.0.smithi071.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-14T11:19:36.665 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.665 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj2": { 2024-09-14T11:19:36.665 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": ".data-pool", 2024-09-14T11:19:36.665 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:19:36.665 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "marker__myobj_" 2024-09-14T11:19:36.665 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.665 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.665 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.665 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj2": { 2024-09-14T11:19:36.665 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.666 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.666 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.666 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.666 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.666 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.666 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.666 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.666 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.666 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.666 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.666 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.666 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj_", 2024-09-14T11:19:36.666 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "inst", 2024-09-14T11:19:36.666 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "" 2024-09-14T11:19:36.666 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.666 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.667 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.667 INFO:tasks.workunit.client.0.smithi071.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-14T11:19:36.667 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.667 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj": { 2024-09-14T11:19:36.667 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": ".data-pool", 2024-09-14T11:19:36.667 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:19:36.667 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "" 2024-09-14T11:19:36.667 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.667 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.667 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.667 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj": { 2024-09-14T11:19:36.667 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.667 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.667 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.667 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.668 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.668 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.668 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.668 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.668 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.668 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.668 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.668 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.668 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj_", 2024-09-14T11:19:36.668 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "inst", 2024-09-14T11:19:36.668 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.668 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.668 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.668 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.668 INFO:tasks.workunit.client.0.smithi071.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-14T11:19:36.669 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.669 INFO:tasks.workunit.client.0.smithi071.stdout: "raw_obj2": { 2024-09-14T11:19:36.669 INFO:tasks.workunit.client.0.smithi071.stdout: "pool": ".data-pool", 2024-09-14T11:19:36.669 INFO:tasks.workunit.client.0.smithi071.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:19:36.669 INFO:tasks.workunit.client.0.smithi071.stdout: "loc": "" 2024-09-14T11:19:36.669 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.669 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.669 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:36.669 INFO:tasks.workunit.client.0.smithi071.stdout: "new_obj2": { 2024-09-14T11:19:36.669 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket": { 2024-09-14T11:19:36.669 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "ebtest", 2024-09-14T11:19:36.669 INFO:tasks.workunit.client.0.smithi071.stdout: "marker": "marker", 2024-09-14T11:19:36.669 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:36.669 INFO:tasks.workunit.client.0.smithi071.stdout: "tenant": "", 2024-09-14T11:19:36.669 INFO:tasks.workunit.client.0.smithi071.stdout: "explicit_placement": { 2024-09-14T11:19:36.669 INFO:tasks.workunit.client.0.smithi071.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:36.670 INFO:tasks.workunit.client.0.smithi071.stdout: "data_extra_pool": "", 2024-09-14T11:19:36.670 INFO:tasks.workunit.client.0.smithi071.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:36.670 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.670 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:36.670 INFO:tasks.workunit.client.0.smithi071.stdout: "key": { 2024-09-14T11:19:36.670 INFO:tasks.workunit.client.0.smithi071.stdout: "name": "_myobj_", 2024-09-14T11:19:36.670 INFO:tasks.workunit.client.0.smithi071.stdout: "instance": "inst", 2024-09-14T11:19:36.670 INFO:tasks.workunit.client.0.smithi071.stdout: "ns": "ns" 2024-09-14T11:19:36.670 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.670 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:36.670 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:36.670 INFO:tasks.workunit.client.0.smithi071.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-14T11:19:36.670 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-09-14T11:19:36.671 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-09-14T11:19:36.671 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-14T11:19:36.671 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-14T11:19:36.671 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 4 tests from 1 test suite ran. (2 ms total) 2024-09-14T11:19:36.671 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 4 tests. 2024-09-14T11:19:36.671 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:19:36.671 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:19:36.686 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-14T11:19:36.687 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-14T11:19:36.687 DEBUG:teuthology.orchestra.run.smithi071:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-14T11:19:36.820 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:36.820 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:36.876 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:36.880+0000 7fc7073709c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:36.879 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:36.880+0000 7fc7073709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:36.879 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:36.880+0000 7fc7073709c0 20 realm 2024-09-14T11:19:36.879 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:36.880+0000 7fc7073709c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:36.880 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:36.880+0000 7fc7073709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:36.880 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:36.880+0000 7fc7073709c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:36.880 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:36.880+0000 7fc7073709c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:36.880 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:36.884+0000 7fc7073709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:36.880 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:36.884+0000 7fc7073709c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:36.881 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:36.884+0000 7fc7073709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:36.881 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:36.884+0000 7fc7073709c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:36.881 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:36.884+0000 7fc7073709c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:36.882 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:36.884+0000 7fc7073709c0 20 searching for the correct realm 2024-09-14T11:19:36.888 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:36.892+0000 7fc705677640 0 -- 172.21.15.71:0/3888038919 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fc6f8008040 msgr2=0x7fc6f8063d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:19:37.125 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.128+0000 7fc705677640 0 -- 172.21.15.71:0/3888038919 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x561fa48520f0 msgr2=0x561fa48544e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:37.140 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.140+0000 7fc7073709c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:37.140 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.140+0000 7fc7073709c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:19:37.140 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.140+0000 7fc7073709c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:37.140 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.140+0000 7fc7073709c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:19:37.140 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.140+0000 7fc7073709c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:37.140 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.140+0000 7fc7073709c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:37.140 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.140+0000 7fc7073709c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:37.141 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.144+0000 7fc7073709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:37.141 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.144+0000 7fc7073709c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:37.141 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.144+0000 7fc7073709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:37.141 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.144+0000 7fc7073709c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:37.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.144+0000 7fc7073709c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:37.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.144+0000 7fc7073709c0 20 zone default found 2024-09-14T11:19:37.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.144+0000 7fc7073709c0 4 Realm: () 2024-09-14T11:19:37.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.144+0000 7fc7073709c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:19:37.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.144+0000 7fc7073709c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:19:37.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.144+0000 7fc7073709c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:37.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.144+0000 7fc7073709c0 20 zonegroup default 2024-09-14T11:19:37.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.144+0000 7fc7073709c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:37.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.144+0000 7fc7073709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:37.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.144+0000 7fc7073709c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:37.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.144+0000 7fc7073709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:37.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.144+0000 7fc7073709c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:37.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.148+0000 7fc7073709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:37.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.148+0000 7fc7073709c0 20 started sync module instance, tier type = 2024-09-14T11:19:37.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.148+0000 7fc7073709c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:19:37.169 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.172+0000 7fc7073709c0 20 add_watcher() i=0 2024-09-14T11:19:37.169 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.172+0000 7fc7073709c0 20 add_watcher() i=1 2024-09-14T11:19:37.169 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.172+0000 7fc7073709c0 20 add_watcher() i=2 2024-09-14T11:19:37.169 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.172+0000 7fc7073709c0 20 add_watcher() i=3 2024-09-14T11:19:37.169 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.172+0000 7fc7073709c0 20 add_watcher() i=4 2024-09-14T11:19:37.169 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.172+0000 7fc7073709c0 20 add_watcher() i=5 2024-09-14T11:19:37.169 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.172+0000 7fc7073709c0 20 add_watcher() i=6 2024-09-14T11:19:37.171 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.172+0000 7fc7073709c0 20 add_watcher() i=7 2024-09-14T11:19:37.171 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.172+0000 7fc7073709c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:37.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.176+0000 7fc5bafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:37.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.176+0000 7fc7073709c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:37.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.176+0000 7fc7073709c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:37.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.176+0000 7fc7073709c0 5 note: GC not initialized 2024-09-14T11:19:37.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.180+0000 7fc5b9fe3640 20 reqs_thread_entry: start 2024-09-14T11:19:37.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.180+0000 7fc7073709c0 20 init_complete bucket index max shards: 11 2024-09-14T11:19:37.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.180+0000 7fc7073709c0 20 Filter name: none 2024-09-14T11:19:37.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.180+0000 7fc52b7fe640 20 reqs_thread_entry: start 2024-09-14T11:19:37.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.180+0000 7fc7073709c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-14T11:19:37.178 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.180+0000 7fc7073709c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:37.178 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.180+0000 7fc7073709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:37.178 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.180+0000 7fc7073709c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-14T11:19:37.178 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.180+0000 7fc7073709c0 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T11:19:37.178 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.180+0000 7fc7073709c0 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-14T11:19:37.178 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.180+0000 7fc7073709c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:37.179 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.180+0000 7fc7073709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:37.179 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.180+0000 7fc7073709c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-14T11:19:37.179 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.180+0000 7fc7073709c0 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T11:19:37.179 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.180+0000 7fc7073709c0 10 cache get: name=default.rgw.meta+users.keys+q/y/sYBQBXUo632S3hnTxLUze78= : miss 2024-09-14T11:19:37.179 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.180+0000 7fc7073709c0 20 rados->read ofs=0 len=0 2024-09-14T11:19:37.179 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.180+0000 7fc7073709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:37.180 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.180+0000 7fc7073709c0 10 cache put: name=default.rgw.meta+users.keys+q/y/sYBQBXUo632S3hnTxLUze78= info.flags=0x0 2024-09-14T11:19:37.180 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.180+0000 7fc7073709c0 10 adding default.rgw.meta+users.keys+q/y/sYBQBXUo632S3hnTxLUze78= to cache LRU end 2024-09-14T11:19:37.180 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.180+0000 7fc7073709c0 10 cache get: name=default.rgw.meta+users.keys+q/y/sYBQBXUo632S3hnTxLUze78= : hit (negative entry) 2024-09-14T11:19:37.180 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.180+0000 7fc7073709c0 10 cache get: name=default.rgw.meta+users.keys+q/y/sYBQBXUo632S3hnTxLUze78= : hit (negative entry) 2024-09-14T11:19:37.181 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.184+0000 7fc7073709c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-14T11:19:37.181 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.184+0000 7fc7073709c0 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T11:19:37.181 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.184+0000 7fc7073709c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-14T11:19:37.181 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.184+0000 7fc5dbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758594 cookie 94693904198048 notifier 5529 bl.length()=697 2024-09-14T11:19:37.181 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.184+0000 7fc5dbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-14T11:19:37.181 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.184+0000 7fc5dbfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T11:19:37.184 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.188+0000 7fc7073709c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-14T11:19:37.184 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.188+0000 7fc7073709c0 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T11:19:37.184 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.188+0000 7fc7073709c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-14T11:19:37.184 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.188+0000 7fc5db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758595 cookie 94693904168816 notifier 5529 bl.length()=194 2024-09-14T11:19:37.184 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.188+0000 7fc5db7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-14T11:19:37.185 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.188+0000 7fc5db7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T11:19:37.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.188+0000 7fc7073709c0 10 cache put: name=default.rgw.meta+users.keys+q/y/sYBQBXUo632S3hnTxLUze78= info.flags=0x7 2024-09-14T11:19:37.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.188+0000 7fc7073709c0 10 moving default.rgw.meta+users.keys+q/y/sYBQBXUo632S3hnTxLUze78= to cache LRU end 2024-09-14T11:19:37.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.188+0000 7fc7073709c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:q/y/sYBQBXUo632S3hnTxLUze78=, ofs0, ns] 2024-09-14T11:19:37.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.188+0000 7fc5db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758595 cookie 94693904198048 notifier 5529 bl.length()=203 2024-09-14T11:19:37.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.188+0000 7fc5db7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+q/y/sYBQBXUo632S3hnTxLUze78= info.flags=0x7 2024-09-14T11:19:37.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.188+0000 7fc5db7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+q/y/sYBQBXUo632S3hnTxLUze78= to cache LRU end 2024-09-14T11:19:37.188 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:19:37.188 INFO:tasks.workunit.client.0.smithi071.stdout: "user_id": "ceph-test-librgw-file", 2024-09-14T11:19:37.189 INFO:tasks.workunit.client.0.smithi071.stdout: "display_name": "librgw test user", 2024-09-14T11:19:37.189 INFO:tasks.workunit.client.0.smithi071.stdout: "email": "librgw@example.com", 2024-09-14T11:19:37.189 INFO:tasks.workunit.client.0.smithi071.stdout: "suspended": 0, 2024-09-14T11:19:37.189 INFO:tasks.workunit.client.0.smithi071.stdout: "max_buckets": 1000, 2024-09-14T11:19:37.189 INFO:tasks.workunit.client.0.smithi071.stdout: "subusers": [], 2024-09-14T11:19:37.189 INFO:tasks.workunit.client.0.smithi071.stdout: "keys": [ 2024-09-14T11:19:37.189 INFO:tasks.workunit.client.0.smithi071.stdout: { 2024-09-14T11:19:37.189 INFO:tasks.workunit.client.0.smithi071.stdout: "user": "ceph-test-librgw-file", 2024-09-14T11:19:37.189 INFO:tasks.workunit.client.0.smithi071.stdout: "access_key": "q/y/sYBQBXUo632S3hnTxLUze78=", 2024-09-14T11:19:37.189 INFO:tasks.workunit.client.0.smithi071.stdout: "secret_key": "GuA6nOsgNpPMWWnONi1F8uQmpp5+hklMTJH4SS/BkeE4M/SzqfqO8A==", 2024-09-14T11:19:37.189 INFO:tasks.workunit.client.0.smithi071.stdout: "active": true, 2024-09-14T11:19:37.190 INFO:tasks.workunit.client.0.smithi071.stdout: "create_date": "2024-09-14T11:19:37.185104Z" 2024-09-14T11:19:37.190 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:19:37.190 INFO:tasks.workunit.client.0.smithi071.stdout: ], 2024-09-14T11:19:37.190 INFO:tasks.workunit.client.0.smithi071.stdout: "swift_keys": [], 2024-09-14T11:19:37.190 INFO:tasks.workunit.client.0.smithi071.stdout: "caps": [], 2024-09-14T11:19:37.190 INFO:tasks.workunit.client.0.smithi071.stdout: "op_mask": "read, write, delete", 2024-09-14T11:19:37.190 INFO:tasks.workunit.client.0.smithi071.stdout: "default_placement": "", 2024-09-14T11:19:37.190 INFO:tasks.workunit.client.0.smithi071.stdout: "default_storage_class": "", 2024-09-14T11:19:37.190 INFO:tasks.workunit.client.0.smithi071.stdout: "placement_tags": [], 2024-09-14T11:19:37.190 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_quota": { 2024-09-14T11:19:37.190 INFO:tasks.workunit.client.0.smithi071.stdout: "enabled": false, 2024-09-14T11:19:37.191 INFO:tasks.workunit.client.0.smithi071.stdout: "check_on_raw": false, 2024-09-14T11:19:37.191 INFO:tasks.workunit.client.0.smithi071.stdout: "max_size": -1, 2024-09-14T11:19:37.191 INFO:tasks.workunit.client.0.smithi071.stdout: "max_size_kb": 0, 2024-09-14T11:19:37.191 INFO:tasks.workunit.client.0.smithi071.stdout: "max_objects": -1 2024-09-14T11:19:37.191 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:37.191 INFO:tasks.workunit.client.0.smithi071.stdout: "user_quota": { 2024-09-14T11:19:37.191 INFO:tasks.workunit.client.0.smithi071.stdout: "enabled": false, 2024-09-14T11:19:37.191 INFO:tasks.workunit.client.0.smithi071.stdout: "check_on_raw": false, 2024-09-14T11:19:37.191 INFO:tasks.workunit.client.0.smithi071.stdout: "max_size": -1, 2024-09-14T11:19:37.191 INFO:tasks.workunit.client.0.smithi071.stdout: "max_size_kb": 0, 2024-09-14T11:19:37.191 INFO:tasks.workunit.client.0.smithi071.stdout: "max_objects": -1 2024-09-14T11:19:37.191 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:19:37.192 INFO:tasks.workunit.client.0.smithi071.stdout: "temp_url_keys": [], 2024-09-14T11:19:37.192 INFO:tasks.workunit.client.0.smithi071.stdout: "type": "rgw", 2024-09-14T11:19:37.192 INFO:tasks.workunit.client.0.smithi071.stdout: "mfa_ids": [], 2024-09-14T11:19:37.192 INFO:tasks.workunit.client.0.smithi071.stdout: "account_id": "", 2024-09-14T11:19:37.192 INFO:tasks.workunit.client.0.smithi071.stdout: "path": "/", 2024-09-14T11:19:37.192 INFO:tasks.workunit.client.0.smithi071.stdout: "create_date": "2024-09-14T11:19:37.185091Z", 2024-09-14T11:19:37.192 INFO:tasks.workunit.client.0.smithi071.stdout: "tags": [], 2024-09-14T11:19:37.192 INFO:tasks.workunit.client.0.smithi071.stdout: "group_ids": [] 2024-09-14T11:19:37.192 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:19:37.192 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-14T11:19:37.193 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.192+0000 7fc5bafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:37.193 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.196+0000 7fc7073709c0 20 remove_watcher() i=0 2024-09-14T11:19:37.194 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.196+0000 7fc7073709c0 2 removed watcher, disabling cache 2024-09-14T11:19:37.195 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.196+0000 7fc7073709c0 20 remove_watcher() i=1 2024-09-14T11:19:37.197 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.200+0000 7fc7073709c0 20 remove_watcher() i=2 2024-09-14T11:19:37.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.200+0000 7fc7073709c0 20 remove_watcher() i=3 2024-09-14T11:19:37.202 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.204+0000 7fc7073709c0 20 remove_watcher() i=4 2024-09-14T11:19:37.204 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.208+0000 7fc7073709c0 20 remove_watcher() i=5 2024-09-14T11:19:37.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.208+0000 7fc7073709c0 20 remove_watcher() i=6 2024-09-14T11:19:37.209 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:37.212+0000 7fc7073709c0 20 remove_watcher() i=7 2024-09-14T11:19:37.226 INFO:tasks.workunit.client.0.smithi071.stdout:phase 1.1 2024-09-14T11:19:37.245 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:19:37.245 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-14T11:19:37.245 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 24 tests from LibRGW 2024-09-14T11:19:37.245 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:19:37.257 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:37.258 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:37.800 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.INIT (555 ms) 2024-09-14T11:19:37.800 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T11:19:37.802 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-14T11:19:37.802 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:19:37.802 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T11:19:37.802 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T11:19:37.818 INFO:tasks.workunit.client.0.smithi071.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-14T11:19:37.825 INFO:tasks.workunit.client.0.smithi071.stdout:creating: nfsroot:foo/f1 2024-09-14T11:19:37.830 INFO:tasks.workunit.client.0.smithi071.stdout:creating: nfsroot:foo/f2 2024-09-14T11:19:37.836 INFO:tasks.workunit.client.0.smithi071.stdout:creating: nfsroot:foo/bar/f1 2024-09-14T11:19:37.841 INFO:tasks.workunit.client.0.smithi071.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-14T11:19:37.847 INFO:tasks.workunit.client.0.smithi071.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-14T11:19:37.854 INFO:tasks.workunit.client.0.smithi071.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-14T11:19:37.859 INFO:tasks.workunit.client.0.smithi071.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-14T11:19:38.072 INFO:tasks.workunit.client.0.smithi071.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-14T11:19:38.079 INFO:tasks.workunit.client.0.smithi071.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-14T11:19:38.087 INFO:tasks.workunit.client.0.smithi071.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-14T11:19:38.093 INFO:tasks.workunit.client.0.smithi071.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-14T11:19:38.101 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.SETUP_HIER1 (299 ms) 2024-09-14T11:19:38.101 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T11:19:38.356 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.SETUP_DIRS1 (255 ms) 2024-09-14T11:19:38.356 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T11:19:38.356 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T11:19:38.357 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T11:19:38.403 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (47 ms) 2024-09-14T11:19:38.403 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T11:19:38.507 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (104 ms) 2024-09-14T11:19:38.507 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T11:19:38.507 INFO:tasks.workunit.client.0.smithi071.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-14T11:19:38.523 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (16 ms) 2024-09-14T11:19:38.523 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T11:19:38.523 INFO:tasks.workunit.client.0.smithi071.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-14T11:19:38.539 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (16 ms) 2024-09-14T11:19:38.539 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T11:19:38.539 INFO:tasks.workunit.client.0.smithi071.stdout:scanning objects in /bdirs1/dir_0 2024-09-14T11:19:38.539 INFO:tasks.workunit.client.0.smithi071.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:19:38.539 INFO:tasks.workunit.client.0.smithi071.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:19:38.539 INFO:tasks.workunit.client.0.smithi071.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:19:38.540 INFO:tasks.workunit.client.0.smithi071.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:19:38.540 INFO:tasks.workunit.client.0.smithi071.stdout:scanning objects in /bdirs1/dir_1 2024-09-14T11:19:38.540 INFO:tasks.workunit.client.0.smithi071.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:19:38.540 INFO:tasks.workunit.client.0.smithi071.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:19:38.540 INFO:tasks.workunit.client.0.smithi071.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:19:38.540 INFO:tasks.workunit.client.0.smithi071.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:19:38.540 INFO:tasks.workunit.client.0.smithi071.stdout:scanning objects in /bdirs1/dir_2 2024-09-14T11:19:38.540 INFO:tasks.workunit.client.0.smithi071.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:19:38.540 INFO:tasks.workunit.client.0.smithi071.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:19:38.540 INFO:tasks.workunit.client.0.smithi071.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:19:38.540 INFO:tasks.workunit.client.0.smithi071.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:19:38.540 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T11:19:38.540 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T11:19:38.540 INFO:tasks.workunit.client.0.smithi071.stdout:read back objects in /bdirs1/dir_0 2024-09-14T11:19:38.541 INFO:tasks.workunit.client.0.smithi071.stdout:reading 0,256 dir_0/sfile_0 2024-09-14T11:19:38.542 INFO:tasks.workunit.client.0.smithi071.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:19:38.542 INFO:tasks.workunit.client.0.smithi071.stdout:reading 0,256 dir_0/sfile_1 2024-09-14T11:19:38.544 INFO:tasks.workunit.client.0.smithi071.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:19:38.544 INFO:tasks.workunit.client.0.smithi071.stdout:read back objects in /bdirs1/dir_1 2024-09-14T11:19:38.544 INFO:tasks.workunit.client.0.smithi071.stdout:reading 0,256 dir_1/sfile_0 2024-09-14T11:19:38.546 INFO:tasks.workunit.client.0.smithi071.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:19:38.547 INFO:tasks.workunit.client.0.smithi071.stdout:reading 0,256 dir_1/sfile_1 2024-09-14T11:19:38.549 INFO:tasks.workunit.client.0.smithi071.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:19:38.549 INFO:tasks.workunit.client.0.smithi071.stdout:read back objects in /bdirs1/dir_2 2024-09-14T11:19:38.549 INFO:tasks.workunit.client.0.smithi071.stdout:reading 0,256 dir_2/sfile_0 2024-09-14T11:19:38.552 INFO:tasks.workunit.client.0.smithi071.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:19:38.552 INFO:tasks.workunit.client.0.smithi071.stdout:reading 0,256 dir_2/sfile_1 2024-09-14T11:19:38.554 INFO:tasks.workunit.client.0.smithi071.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:19:38.554 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.READ_DIRS1 (15 ms) 2024-09-14T11:19:38.554 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T11:19:38.759 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.READF_SETUP1 (204 ms) 2024-09-14T11:19:38.759 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T11:19:38.759 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T11:19:38.759 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T11:19:38.759 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T11:19:38.759 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T11:19:38.759 INFO:tasks.workunit.client.0.smithi071.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:19:38.759 INFO:tasks.workunit.client.0.smithi071.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:19:38.759 INFO:tasks.workunit.client.0.smithi071.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:19:38.759 INFO:tasks.workunit.client.0.smithi071.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:19:38.759 INFO:tasks.workunit.client.0.smithi071.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:19:38.760 INFO:tasks.workunit.client.0.smithi071.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:19:38.760 INFO:tasks.workunit.client.0.smithi071.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:19:38.760 INFO:tasks.workunit.client.0.smithi071.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:19:38.760 INFO:tasks.workunit.client.0.smithi071.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:19:38.760 INFO:tasks.workunit.client.0.smithi071.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:19:38.760 INFO:tasks.workunit.client.0.smithi071.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:19:38.760 INFO:tasks.workunit.client.0.smithi071.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:19:38.760 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T11:19:38.760 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T11:19:38.774 INFO:tasks.workunit.client.0.smithi071.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-14T11:19:38.775 INFO:tasks.workunit.client.0.smithi071.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-14T11:19:38.782 INFO:tasks.workunit.client.0.smithi071.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-14T11:19:38.786 INFO:tasks.workunit.client.0.smithi071.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-14T11:19:38.793 INFO:tasks.workunit.client.0.smithi071.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:19:38.793 INFO:tasks.workunit.client.0.smithi071.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:19:38.794 INFO:tasks.workunit.client.0.smithi071.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-14T11:19:38.795 INFO:tasks.workunit.client.0.smithi071.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-14T11:19:38.796 INFO:tasks.workunit.client.0.smithi071.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:19:38.797 INFO:tasks.workunit.client.0.smithi071.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:19:38.798 INFO:tasks.workunit.client.0.smithi071.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-14T11:19:38.802 INFO:tasks.workunit.client.0.smithi071.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-14T11:19:38.802 INFO:tasks.workunit.client.0.smithi071.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-14T11:19:38.803 INFO:tasks.workunit.client.0.smithi071.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-14T11:19:38.803 INFO:tasks.workunit.client.0.smithi071.stdout:/nfsroot/foo (foo): DIR 2024-09-14T11:19:38.803 INFO:tasks.workunit.client.0.smithi071.stdout:/nfsroot (nfsroot): DIR 2024-09-14T11:19:38.803 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.HIER1 (44 ms) 2024-09-14T11:19:38.803 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:19:38.803 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T11:19:38.803 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:19:38.803 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:19:38.803 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:19:38.803 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:19:38.803 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:19:38.803 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:19:38.803 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:19:38.803 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:19:38.804 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:19:38.804 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:19:38.804 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:19:38.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:38.804+0000 7fe4b232fa80 -1 shutting down 2024-09-14T11:19:38.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:19:38.808+0000 7fe38c081640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 55846, si_uid : 1000, si_addr0x3e80000da26, si_status0 2024-09-14T11:20:07.962 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.SHUTDOWN (29160 ms) 2024-09-14T11:20:07.962 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 24 tests from LibRGW (30717 ms total) 2024-09-14T11:20:07.962 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-14T11:20:07.962 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-14T11:20:07.962 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 24 tests from 1 test suite ran. (30717 ms total) 2024-09-14T11:20:07.962 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 24 tests. 2024-09-14T11:20:07.976 INFO:tasks.workunit.client.0.smithi071.stdout:phase 1.2 2024-09-14T11:20:07.999 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:20:07.999 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-14T11:20:07.999 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 24 tests from LibRGW 2024-09-14T11:20:07.999 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:20:08.009 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:08.009 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:08.563 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.INIT (564 ms) 2024-09-14T11:20:08.563 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T11:20:08.565 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-14T11:20:08.565 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:20:08.565 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T11:20:08.565 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T11:20:08.565 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-14T11:20:08.566 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T11:20:08.566 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-14T11:20:08.566 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T11:20:08.566 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T11:20:08.566 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T11:20:08.566 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-14T11:20:08.566 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T11:20:08.566 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-14T11:20:08.566 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T11:20:08.566 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-14T11:20:08.566 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T11:20:08.566 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-14T11:20:08.566 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T11:20:08.566 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T11:20:08.567 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T11:20:08.567 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-14T11:20:08.567 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T11:20:08.567 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-14T11:20:08.567 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T11:20:08.567 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T11:20:08.567 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T11:20:08.567 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T11:20:08.567 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T11:20:08.567 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T11:20:08.567 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T11:20:08.567 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-14T11:20:08.568 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:20:08.568 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T11:20:08.568 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:20:08.568 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:20:08.568 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:20:08.568 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:20:08.568 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:20:08.568 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:20:08.568 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:20:08.568 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:20:08.568 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:20:08.568 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:20:08.568 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:20:08.569 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:20:08.568+0000 7ff3a34a8a80 -1 shutting down 2024-09-14T11:20:08.569 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:20:08.568+0000 7ff27d1fa640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 56499, si_uid : 1000, si_addr0x3e80000dcb3, si_status0 2024-09-14T11:20:38.816 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.SHUTDOWN (30251 ms) 2024-09-14T11:20:38.816 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 24 tests from LibRGW (30817 ms total) 2024-09-14T11:20:38.816 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-14T11:20:38.817 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-14T11:20:38.817 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 24 tests from 1 test suite ran. (30817 ms total) 2024-09-14T11:20:38.817 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 24 tests. 2024-09-14T11:20:38.831 INFO:tasks.workunit.client.0.smithi071.stdout:phase 1.3 2024-09-14T11:20:38.853 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:20:38.854 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-14T11:20:38.854 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 24 tests from LibRGW 2024-09-14T11:20:38.854 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:20:38.866 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:38.866 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:39.215 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.INIT (361 ms) 2024-09-14T11:20:39.215 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T11:20:39.216 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-14T11:20:39.216 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:20:39.216 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T11:20:39.216 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T11:20:39.223 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.SETUP_HIER1 (8 ms) 2024-09-14T11:20:39.223 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T11:20:39.334 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.SETUP_DIRS1 (110 ms) 2024-09-14T11:20:39.335 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T11:20:39.335 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T11:20:39.335 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T11:20:39.335 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-14T11:20:39.335 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T11:20:39.335 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-14T11:20:39.335 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T11:20:39.335 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-14T11:20:39.335 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T11:20:39.335 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-14T11:20:39.335 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T11:20:39.336 INFO:tasks.workunit.client.0.smithi071.stdout:scanning objects in /bdirs1/dir_0 2024-09-14T11:20:39.336 INFO:tasks.workunit.client.0.smithi071.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:20:39.336 INFO:tasks.workunit.client.0.smithi071.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:20:39.336 INFO:tasks.workunit.client.0.smithi071.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:20:39.336 INFO:tasks.workunit.client.0.smithi071.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:20:39.336 INFO:tasks.workunit.client.0.smithi071.stdout:scanning objects in /bdirs1/dir_1 2024-09-14T11:20:39.336 INFO:tasks.workunit.client.0.smithi071.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:20:39.336 INFO:tasks.workunit.client.0.smithi071.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:20:39.336 INFO:tasks.workunit.client.0.smithi071.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:20:39.336 INFO:tasks.workunit.client.0.smithi071.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:20:39.336 INFO:tasks.workunit.client.0.smithi071.stdout:scanning objects in /bdirs1/dir_2 2024-09-14T11:20:39.336 INFO:tasks.workunit.client.0.smithi071.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:20:39.336 INFO:tasks.workunit.client.0.smithi071.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:20:39.337 INFO:tasks.workunit.client.0.smithi071.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:20:39.337 INFO:tasks.workunit.client.0.smithi071.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:20:39.337 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T11:20:39.337 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T11:20:39.337 INFO:tasks.workunit.client.0.smithi071.stdout:read back objects in /bdirs1/dir_0 2024-09-14T11:20:39.337 INFO:tasks.workunit.client.0.smithi071.stdout:reading 0,256 dir_0/sfile_0 2024-09-14T11:20:39.337 INFO:tasks.workunit.client.0.smithi071.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:20:39.337 INFO:tasks.workunit.client.0.smithi071.stdout:reading 0,256 dir_0/sfile_1 2024-09-14T11:20:39.338 INFO:tasks.workunit.client.0.smithi071.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:20:39.338 INFO:tasks.workunit.client.0.smithi071.stdout:read back objects in /bdirs1/dir_1 2024-09-14T11:20:39.338 INFO:tasks.workunit.client.0.smithi071.stdout:reading 0,256 dir_1/sfile_0 2024-09-14T11:20:39.340 INFO:tasks.workunit.client.0.smithi071.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:20:39.340 INFO:tasks.workunit.client.0.smithi071.stdout:reading 0,256 dir_1/sfile_1 2024-09-14T11:20:39.343 INFO:tasks.workunit.client.0.smithi071.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:20:39.343 INFO:tasks.workunit.client.0.smithi071.stdout:read back objects in /bdirs1/dir_2 2024-09-14T11:20:39.343 INFO:tasks.workunit.client.0.smithi071.stdout:reading 0,256 dir_2/sfile_0 2024-09-14T11:20:39.346 INFO:tasks.workunit.client.0.smithi071.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:20:39.346 INFO:tasks.workunit.client.0.smithi071.stdout:reading 0,256 dir_2/sfile_1 2024-09-14T11:20:39.349 INFO:tasks.workunit.client.0.smithi071.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:20:39.349 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.READ_DIRS1 (15 ms) 2024-09-14T11:20:39.349 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T11:20:39.349 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-14T11:20:39.349 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T11:20:39.349 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T11:20:39.349 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T11:20:39.349 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T11:20:39.349 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T11:20:39.350 INFO:tasks.workunit.client.0.smithi071.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:20:39.350 INFO:tasks.workunit.client.0.smithi071.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:20:39.350 INFO:tasks.workunit.client.0.smithi071.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:20:39.350 INFO:tasks.workunit.client.0.smithi071.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:20:39.350 INFO:tasks.workunit.client.0.smithi071.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:20:39.350 INFO:tasks.workunit.client.0.smithi071.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:20:39.350 INFO:tasks.workunit.client.0.smithi071.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:20:39.350 INFO:tasks.workunit.client.0.smithi071.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:20:39.350 INFO:tasks.workunit.client.0.smithi071.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:20:39.350 INFO:tasks.workunit.client.0.smithi071.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:20:39.350 INFO:tasks.workunit.client.0.smithi071.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:20:39.350 INFO:tasks.workunit.client.0.smithi071.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:20:39.350 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T11:20:39.350 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T11:20:39.364 INFO:tasks.workunit.client.0.smithi071.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-14T11:20:39.364 INFO:tasks.workunit.client.0.smithi071.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-14T11:20:39.371 INFO:tasks.workunit.client.0.smithi071.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-14T11:20:39.375 INFO:tasks.workunit.client.0.smithi071.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-14T11:20:39.381 INFO:tasks.workunit.client.0.smithi071.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:20:39.382 INFO:tasks.workunit.client.0.smithi071.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:20:39.383 INFO:tasks.workunit.client.0.smithi071.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-14T11:20:39.383 INFO:tasks.workunit.client.0.smithi071.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-14T11:20:39.384 INFO:tasks.workunit.client.0.smithi071.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:20:39.385 INFO:tasks.workunit.client.0.smithi071.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:20:39.386 INFO:tasks.workunit.client.0.smithi071.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-14T11:20:39.391 INFO:tasks.workunit.client.0.smithi071.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-14T11:20:39.391 INFO:tasks.workunit.client.0.smithi071.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-14T11:20:39.391 INFO:tasks.workunit.client.0.smithi071.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-14T11:20:39.391 INFO:tasks.workunit.client.0.smithi071.stdout:/nfsroot/foo (foo): DIR 2024-09-14T11:20:39.391 INFO:tasks.workunit.client.0.smithi071.stdout:/nfsroot (nfsroot): DIR 2024-09-14T11:20:39.391 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.HIER1 (42 ms) 2024-09-14T11:20:39.391 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:20:39.391 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T11:20:39.391 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:20:39.391 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:20:39.391 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:20:39.391 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:20:39.391 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:20:39.392 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:20:39.392 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:20:39.392 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:20:39.392 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:20:39.392 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:20:39.392 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:20:39.392 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:20:39.392+0000 7f0efe1c6a80 -1 shutting down 2024-09-14T11:20:39.392 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:20:39.396+0000 7f0dd7f18640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 57144, si_uid : 1000, si_addr0x3e80000df38, si_status0 2024-09-14T11:21:09.333 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.SHUTDOWN (29942 ms) 2024-09-14T11:21:09.333 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 24 tests from LibRGW (30479 ms total) 2024-09-14T11:21:09.333 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-14T11:21:09.333 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-14T11:21:09.334 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 24 tests from 1 test suite ran. (30479 ms total) 2024-09-14T11:21:09.334 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 24 tests. 2024-09-14T11:21:09.348 INFO:tasks.workunit.client.0.smithi071.stdout:phase 2.1 2024-09-14T11:21:09.371 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T11:21:09.372 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-14T11:21:09.372 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 9 tests from LibRGW 2024-09-14T11:21:09.372 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:21:09.383 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:09.383 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:10.127 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.INIT (755 ms) 2024-09-14T11:21:10.127 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:21:10.128 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-14T11:21:10.128 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:21:10.144 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.CREATE_BUCKET (16 ms) 2024-09-14T11:21:10.145 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:21:10.145 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T11:21:10.145 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-14T11:21:10.163 INFO:tasks.workunit.client.0.smithi071.stdout:created: sorrydave0 2024-09-14T11:21:10.178 INFO:tasks.workunit.client.0.smithi071.stdout:created: sorrydave1 2024-09-14T11:21:10.196 INFO:tasks.workunit.client.0.smithi071.stdout:created: sorrydave2 2024-09-14T11:21:10.213 INFO:tasks.workunit.client.0.smithi071.stdout:created: sorrydave3 2024-09-14T11:21:10.229 INFO:tasks.workunit.client.0.smithi071.stdout:created: sorrydave4 2024-09-14T11:21:10.247 INFO:tasks.workunit.client.0.smithi071.stdout:created: sorrydave5 2024-09-14T11:21:10.267 INFO:tasks.workunit.client.0.smithi071.stdout:created: sorrydave6 2024-09-14T11:21:10.285 INFO:tasks.workunit.client.0.smithi071.stdout:created: sorrydave7 2024-09-14T11:21:10.305 INFO:tasks.workunit.client.0.smithi071.stdout:created: sorrydave8 2024-09-14T11:21:10.326 INFO:tasks.workunit.client.0.smithi071.stdout:created: sorrydave9 2024-09-14T11:21:10.326 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (181 ms) 2024-09-14T11:21:10.326 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-14T11:21:11.009 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (683 ms) 2024-09-14T11:21:11.009 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:21:11.009 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:21:11.009 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:21:11.009 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:21:11.009 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:21:11.010 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:21:11.011+0000 7f631ac19a80 -1 shutting down 2024-09-14T11:21:11.011 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:21:11.011+0000 7f61f496b640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 57796, si_uid : 1000, si_addr0x3e80000e1c4, si_status0 2024-09-14T11:21:40.377 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.SHUTDOWN (29369 ms) 2024-09-14T11:21:40.378 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 9 tests from LibRGW (31006 ms total) 2024-09-14T11:21:40.378 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-14T11:21:40.378 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-14T11:21:40.378 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 9 tests from 1 test suite ran. (31006 ms total) 2024-09-14T11:21:40.378 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 9 tests. 2024-09-14T11:21:40.388 INFO:tasks.workunit.client.0.smithi071.stdout:phase 2.2 2024-09-14T11:21:40.411 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T11:21:40.412 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-14T11:21:40.412 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 9 tests from LibRGW 2024-09-14T11:21:40.412 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:21:40.423 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:40.423 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:40.742 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.INIT (331 ms) 2024-09-14T11:21:40.742 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:21:40.743 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:21:40.743 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:21:40.743 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T11:21:40.744 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:21:40.801 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.DELETE_BUCKET (58 ms) 2024-09-14T11:21:40.801 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-14T11:21:40.821 INFO:tasks.workunit.client.0.smithi071.stdout:created: sorrydave0 2024-09-14T11:21:40.838 INFO:tasks.workunit.client.0.smithi071.stdout:created: sorrydave1 2024-09-14T11:21:40.857 INFO:tasks.workunit.client.0.smithi071.stdout:created: sorrydave2 2024-09-14T11:21:40.878 INFO:tasks.workunit.client.0.smithi071.stdout:created: sorrydave3 2024-09-14T11:21:40.894 INFO:tasks.workunit.client.0.smithi071.stdout:created: sorrydave4 2024-09-14T11:21:40.913 INFO:tasks.workunit.client.0.smithi071.stdout:created: sorrydave5 2024-09-14T11:21:40.928 INFO:tasks.workunit.client.0.smithi071.stdout:created: sorrydave6 2024-09-14T11:21:40.944 INFO:tasks.workunit.client.0.smithi071.stdout:created: sorrydave7 2024-09-14T11:21:40.962 INFO:tasks.workunit.client.0.smithi071.stdout:created: sorrydave8 2024-09-14T11:21:40.979 INFO:tasks.workunit.client.0.smithi071.stdout:created: sorrydave9 2024-09-14T11:21:40.979 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (178 ms) 2024-09-14T11:21:40.979 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-14T11:21:41.699 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (720 ms) 2024-09-14T11:21:41.699 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:21:41.699 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:21:41.700 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:21:41.700 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:21:41.700 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:21:41.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:21:41.699+0000 7f15326f2a80 -1 shutting down 2024-09-14T11:21:41.701 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:21:41.703+0000 7f140c444640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 58441, si_uid : 1000, si_addr0x3e80000e449, si_status0 2024-09-14T11:22:10.865 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.SHUTDOWN (29165 ms) 2024-09-14T11:22:10.865 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 9 tests from LibRGW (30453 ms total) 2024-09-14T11:22:10.865 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-14T11:22:10.865 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-14T11:22:10.865 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 9 tests from 1 test suite ran. (30453 ms total) 2024-09-14T11:22:10.865 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 9 tests. 2024-09-14T11:22:10.879 INFO:tasks.workunit.client.0.smithi071.stdout:phase 3.1 2024-09-14T11:22:11.223 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-14T11:22:11.224 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-14T11:22:11.224 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 13 tests from LibRGW 2024-09-14T11:22:11.224 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:22:11.233 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:11.233 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:11.502 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.INIT (279 ms) 2024-09-14T11:22:11.503 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:22:11.504 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:22:11.504 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:22:11.519 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.CREATE_BUCKET (16 ms) 2024-09-14T11:22:11.519 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:22:11.525 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-09-14T11:22:11.525 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:22:11.528 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2024-09-14T11:22:11.528 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.LARGE1 2024-09-14T11:22:11.616 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.LARGE1 (88 ms) 2024-09-14T11:22:11.616 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.LARGE2 2024-09-14T11:22:11.669 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.LARGE2 (52 ms) 2024-09-14T11:22:11.669 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:22:11.669 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:22:11.669 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:22:11.669 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-14T11:22:11.669 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:22:11.669 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T11:22:11.669 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:22:11.669 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:22:11.669 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:22:11.670 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:22:11.670 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:22:11.670 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:22:11.670+0000 7f91fee72a80 -1 shutting down 2024-09-14T11:22:11.670 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:22:11.670+0000 7f90d8bc4640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 59086, si_uid : 1000, si_addr0x3e80000e6ce, si_status0 2024-09-14T11:22:41.694 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.SHUTDOWN (30025 ms) 2024-09-14T11:22:41.695 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 13 tests from LibRGW (30470 ms total) 2024-09-14T11:22:41.695 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-14T11:22:41.695 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-14T11:22:41.695 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 13 tests from 1 test suite ran. (30471 ms total) 2024-09-14T11:22:41.695 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 13 tests. 2024-09-14T11:22:41.712 INFO:tasks.workunit.client.0.smithi071.stdout:phase 3.2 2024-09-14T11:22:42.055 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-14T11:22:42.055 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-14T11:22:42.055 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 13 tests from LibRGW 2024-09-14T11:22:42.055 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:22:42.064 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:42.064 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:42.617 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.INIT (562 ms) 2024-09-14T11:22:42.617 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:22:42.618 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:22:42.618 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:22:42.618 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T11:22:42.618 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:22:42.627 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (9 ms) 2024-09-14T11:22:42.627 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:22:42.633 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (6 ms) 2024-09-14T11:22:42.633 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.LARGE1 2024-09-14T11:22:42.730 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.LARGE1 (97 ms) 2024-09-14T11:22:42.730 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.LARGE2 2024-09-14T11:22:42.730 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-14T11:22:42.730 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:22:42.730 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:22:42.730 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:22:42.741 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.DELETE_OBJECT (12 ms) 2024-09-14T11:22:42.741 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:22:42.810 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.DELETE_BUCKET (68 ms) 2024-09-14T11:22:42.810 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:22:42.810 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:22:42.810 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:22:42.811 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:22:42.811 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:22:42.811 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:22:42.813+0000 7f165c335a80 -1 shutting down 2024-09-14T11:22:42.813 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:22:42.817+0000 7f1536087640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 59740, si_uid : 1000, si_addr0x3e80000e95c, si_status0 2024-09-14T11:23:12.627 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.SHUTDOWN (29816 ms) 2024-09-14T11:23:12.628 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 13 tests from LibRGW (30572 ms total) 2024-09-14T11:23:12.628 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-14T11:23:12.628 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-14T11:23:12.628 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 13 tests from 1 test suite ran. (30573 ms total) 2024-09-14T11:23:12.628 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 13 tests. 2024-09-14T11:23:12.647 INFO:tasks.workunit.client.0.smithi071.stdout:phase 4.1 2024-09-14T11:23:12.671 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T11:23:12.671 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-14T11:23:12.671 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 11 tests from LibRGW 2024-09-14T11:23:12.671 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.TVAR 2024-09-14T11:23:12.671 INFO:tasks.workunit.client.0.smithi071.stdout:read i1: 64001 2024-09-14T11:23:12.671 INFO:tasks.workunit.client.0.smithi071.stdout:read s1: blunderbuss 2024-09-14T11:23:12.671 INFO:tasks.workunit.client.0.smithi071.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-14T11:23:12.672 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:23:12.684 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:23:12.685 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:23:13.234 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.INIT (563 ms) 2024-09-14T11:23:13.234 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:23:13.235 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-14T11:23:13.235 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:23:13.266 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (30 ms) 2024-09-14T11:23:13.266 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:23:14.325 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_0 2024-09-14T11:23:14.325 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_1 2024-09-14T11:23:14.326 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_2 2024-09-14T11:23:14.326 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_3 2024-09-14T11:23:14.326 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_4 2024-09-14T11:23:14.326 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_5 2024-09-14T11:23:14.326 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_6 2024-09-14T11:23:14.326 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_7 2024-09-14T11:23:14.326 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_8 2024-09-14T11:23:14.326 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_9 2024-09-14T11:23:14.326 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_10 2024-09-14T11:23:14.326 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_11 2024-09-14T11:23:14.326 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_12 2024-09-14T11:23:14.326 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_13 2024-09-14T11:23:14.327 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_14 2024-09-14T11:23:14.327 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_15 2024-09-14T11:23:14.327 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_16 2024-09-14T11:23:14.327 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_17 2024-09-14T11:23:14.327 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_18 2024-09-14T11:23:14.327 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_19 2024-09-14T11:23:14.327 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_20 2024-09-14T11:23:14.327 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_21 2024-09-14T11:23:14.327 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_22 2024-09-14T11:23:14.327 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_23 2024-09-14T11:23:14.327 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_24 2024-09-14T11:23:14.327 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_25 2024-09-14T11:23:14.327 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_26 2024-09-14T11:23:14.327 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_27 2024-09-14T11:23:14.328 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_28 2024-09-14T11:23:14.328 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_29 2024-09-14T11:23:14.328 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_30 2024-09-14T11:23:14.328 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_31 2024-09-14T11:23:14.328 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_32 2024-09-14T11:23:14.328 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_33 2024-09-14T11:23:14.328 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_34 2024-09-14T11:23:14.328 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_35 2024-09-14T11:23:14.328 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_36 2024-09-14T11:23:14.328 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_37 2024-09-14T11:23:14.328 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_38 2024-09-14T11:23:14.328 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_39 2024-09-14T11:23:14.328 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_40 2024-09-14T11:23:14.329 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_41 2024-09-14T11:23:14.329 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_42 2024-09-14T11:23:14.329 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_43 2024-09-14T11:23:14.329 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_44 2024-09-14T11:23:14.329 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_45 2024-09-14T11:23:14.329 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_46 2024-09-14T11:23:14.329 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_47 2024-09-14T11:23:14.329 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_48 2024-09-14T11:23:14.329 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_49 2024-09-14T11:23:14.329 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_50 2024-09-14T11:23:14.329 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_51 2024-09-14T11:23:14.329 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_52 2024-09-14T11:23:14.329 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_53 2024-09-14T11:23:14.330 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_54 2024-09-14T11:23:14.330 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_55 2024-09-14T11:23:14.330 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_56 2024-09-14T11:23:14.330 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_57 2024-09-14T11:23:14.330 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_58 2024-09-14T11:23:14.330 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_59 2024-09-14T11:23:14.330 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_60 2024-09-14T11:23:14.330 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_61 2024-09-14T11:23:14.330 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_62 2024-09-14T11:23:14.330 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_63 2024-09-14T11:23:14.330 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_64 2024-09-14T11:23:14.330 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_65 2024-09-14T11:23:14.330 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_66 2024-09-14T11:23:14.330 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_67 2024-09-14T11:23:14.331 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_68 2024-09-14T11:23:14.331 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_69 2024-09-14T11:23:14.331 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_70 2024-09-14T11:23:14.331 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_71 2024-09-14T11:23:14.331 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_72 2024-09-14T11:23:14.331 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_73 2024-09-14T11:23:14.331 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_74 2024-09-14T11:23:14.331 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_75 2024-09-14T11:23:14.331 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_76 2024-09-14T11:23:14.331 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_77 2024-09-14T11:23:14.331 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_78 2024-09-14T11:23:14.331 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_79 2024-09-14T11:23:14.331 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_80 2024-09-14T11:23:14.332 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_81 2024-09-14T11:23:14.332 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_82 2024-09-14T11:23:14.332 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_83 2024-09-14T11:23:14.332 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_84 2024-09-14T11:23:14.332 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_85 2024-09-14T11:23:14.332 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_86 2024-09-14T11:23:14.332 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_87 2024-09-14T11:23:14.332 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_88 2024-09-14T11:23:14.332 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_89 2024-09-14T11:23:14.332 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_90 2024-09-14T11:23:14.332 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_91 2024-09-14T11:23:14.332 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_92 2024-09-14T11:23:14.333 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_93 2024-09-14T11:23:14.333 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_94 2024-09-14T11:23:14.333 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_95 2024-09-14T11:23:14.333 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_96 2024-09-14T11:23:14.333 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_97 2024-09-14T11:23:14.333 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_98 2024-09-14T11:23:14.333 INFO:tasks.workunit.client.0.smithi071.stdout:created: dmarker:f_99 2024-09-14T11:23:14.333 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (1059 ms) 2024-09-14T11:23:14.333 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:23:14.334 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-14T11:23:14.334 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-14T11:23:14.334 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T11:23:14.334 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T11:23:14.334 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T11:23:14.334 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T11:23:14.334 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T11:23:14.334 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T11:23:14.334 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T11:23:14.334 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T11:23:14.335 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T11:23:14.335 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T11:23:14.335 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T11:23:14.335 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T11:23:14.335 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T11:23:14.335 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T11:23:14.335 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T11:23:14.335 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T11:23:14.335 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T11:23:14.335 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T11:23:14.335 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T11:23:14.335 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T11:23:14.335 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T11:23:14.336 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T11:23:14.336 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T11:23:14.336 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T11:23:14.336 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T11:23:14.336 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T11:23:14.336 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T11:23:14.336 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T11:23:14.336 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T11:23:14.336 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T11:23:14.336 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T11:23:14.336 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T11:23:14.336 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T11:23:14.336 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T11:23:14.337 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T11:23:14.337 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T11:23:14.337 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T11:23:14.337 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T11:23:14.337 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T11:23:14.337 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T11:23:14.337 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T11:23:14.337 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T11:23:14.337 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T11:23:14.337 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T11:23:14.337 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T11:23:14.338 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T11:23:14.338 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T11:23:14.338 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T11:23:14.338 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T11:23:14.338 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T11:23:14.338 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T11:23:14.338 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T11:23:14.338 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T11:23:14.338 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T11:23:14.338 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T11:23:14.338 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T11:23:14.338 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T11:23:14.338 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T11:23:14.339 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T11:23:14.339 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T11:23:14.339 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T11:23:14.339 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T11:23:14.339 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T11:23:14.339 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T11:23:14.339 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T11:23:14.339 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T11:23:14.339 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T11:23:14.339 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T11:23:14.339 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T11:23:14.339 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T11:23:14.339 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T11:23:14.340 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T11:23:14.340 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T11:23:14.340 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T11:23:14.340 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T11:23:14.340 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T11:23:14.340 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T11:23:14.340 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T11:23:14.340 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T11:23:14.340 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T11:23:14.340 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T11:23:14.340 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T11:23:14.340 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T11:23:14.341 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T11:23:14.341 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T11:23:14.341 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T11:23:14.341 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T11:23:14.341 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T11:23:14.341 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T11:23:14.341 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T11:23:14.341 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T11:23:14.341 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T11:23:14.341 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T11:23:14.341 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T11:23:14.341 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T11:23:14.341 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T11:23:14.342 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T11:23:14.342 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T11:23:14.342 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T11:23:14.342 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T11:23:14.342 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MARKER1_READDIR (8 ms) 2024-09-14T11:23:14.342 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-14T11:23:14.343 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T11:23:14.343 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T11:23:14.343 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T11:23:14.343 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T11:23:14.343 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T11:23:14.343 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T11:23:14.343 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T11:23:14.343 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T11:23:14.344 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T11:23:14.344 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T11:23:14.344 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T11:23:14.344 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T11:23:14.344 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T11:23:14.344 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T11:23:14.344 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T11:23:14.344 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T11:23:14.344 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T11:23:14.344 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T11:23:14.344 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T11:23:14.344 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T11:23:14.344 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T11:23:14.344 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T11:23:14.345 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T11:23:14.345 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T11:23:14.345 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T11:23:14.345 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T11:23:14.345 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T11:23:14.345 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T11:23:14.345 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T11:23:14.345 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T11:23:14.345 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T11:23:14.345 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T11:23:14.345 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T11:23:14.345 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T11:23:14.345 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T11:23:14.346 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T11:23:14.346 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T11:23:14.346 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T11:23:14.346 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T11:23:14.346 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T11:23:14.346 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T11:23:14.346 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T11:23:14.346 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T11:23:14.346 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T11:23:14.346 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T11:23:14.346 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T11:23:14.346 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T11:23:14.347 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T11:23:14.347 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T11:23:14.347 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T11:23:14.347 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T11:23:14.347 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T11:23:14.347 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T11:23:14.347 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T11:23:14.347 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T11:23:14.347 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T11:23:14.347 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T11:23:14.347 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T11:23:14.347 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T11:23:14.348 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T11:23:14.348 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T11:23:14.348 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T11:23:14.348 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T11:23:14.348 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T11:23:14.348 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T11:23:14.348 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T11:23:14.348 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T11:23:14.348 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T11:23:14.348 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T11:23:14.348 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T11:23:14.348 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T11:23:14.348 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T11:23:14.348 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T11:23:14.349 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T11:23:14.349 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T11:23:14.349 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T11:23:14.349 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T11:23:14.349 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T11:23:14.349 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T11:23:14.349 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T11:23:14.349 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T11:23:14.349 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T11:23:14.349 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T11:23:14.349 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T11:23:14.349 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T11:23:14.349 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T11:23:14.350 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T11:23:14.350 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T11:23:14.350 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T11:23:14.350 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T11:23:14.350 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T11:23:14.350 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T11:23:14.350 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T11:23:14.350 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T11:23:14.350 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T11:23:14.350 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T11:23:14.350 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T11:23:14.350 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T11:23:14.351 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T11:23:14.351 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T11:23:14.351 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MARKER2_READDIR (6 ms) 2024-09-14T11:23:14.351 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:23:14.351 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:23:14.351 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:23:14.351 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:23:14.351 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:23:14.351 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:23:14.351 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:23:14.351 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:23:14.341+0000 7efd936e6a80 -1 shutting down 2024-09-14T11:23:14.352 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:23:14.345+0000 7efc6d438640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 60387, si_uid : 1000, si_addr0x3e80000ebe3, si_status0 2024-09-14T11:23:43.614 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.SHUTDOWN (29275 ms) 2024-09-14T11:23:43.615 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 11 tests from LibRGW (30943 ms total) 2024-09-14T11:23:43.615 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-14T11:23:43.615 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-14T11:23:43.615 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 11 tests from 1 test suite ran. (30943 ms total) 2024-09-14T11:23:43.615 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 11 tests. 2024-09-14T11:23:43.629 INFO:tasks.workunit.client.0.smithi071.stdout:phase 4.2 2024-09-14T11:23:43.652 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T11:23:43.652 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-14T11:23:43.652 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 11 tests from LibRGW 2024-09-14T11:23:43.652 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.TVAR 2024-09-14T11:23:43.652 INFO:tasks.workunit.client.0.smithi071.stdout:read i1: 64001 2024-09-14T11:23:43.652 INFO:tasks.workunit.client.0.smithi071.stdout:read s1: blunderbuss 2024-09-14T11:23:43.652 INFO:tasks.workunit.client.0.smithi071.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-14T11:23:43.652 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:23:43.662 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:23:43.662 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:23:43.997 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.INIT (345 ms) 2024-09-14T11:23:43.997 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:23:43.999 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-14T11:23:43.999 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:23:44.014 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (15 ms) 2024-09-14T11:23:44.014 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:23:44.014 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:23:44.014 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:23:44.014 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:23:44.014 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-14T11:23:44.019 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T11:23:44.019 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T11:23:44.019 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T11:23:44.019 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T11:23:44.019 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T11:23:44.019 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T11:23:44.019 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T11:23:44.019 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T11:23:44.020 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T11:23:44.020 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T11:23:44.020 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T11:23:44.020 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T11:23:44.020 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T11:23:44.020 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T11:23:44.020 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T11:23:44.020 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T11:23:44.020 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T11:23:44.020 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T11:23:44.020 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T11:23:44.020 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T11:23:44.021 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T11:23:44.021 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T11:23:44.021 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T11:23:44.021 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T11:23:44.021 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T11:23:44.021 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T11:23:44.021 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T11:23:44.021 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T11:23:44.021 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T11:23:44.021 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T11:23:44.021 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T11:23:44.021 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T11:23:44.021 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T11:23:44.022 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T11:23:44.022 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T11:23:44.022 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T11:23:44.022 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T11:23:44.022 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T11:23:44.022 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T11:23:44.022 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T11:23:44.022 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T11:23:44.022 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T11:23:44.022 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T11:23:44.022 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T11:23:44.022 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T11:23:44.023 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T11:23:44.023 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T11:23:44.023 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T11:23:44.023 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T11:23:44.023 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T11:23:44.023 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T11:23:44.023 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T11:23:44.023 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T11:23:44.023 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T11:23:44.023 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T11:23:44.023 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T11:23:44.023 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T11:23:44.023 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T11:23:44.023 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T11:23:44.023 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T11:23:44.024 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T11:23:44.024 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T11:23:44.024 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T11:23:44.024 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T11:23:44.024 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T11:23:44.024 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T11:23:44.024 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T11:23:44.024 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T11:23:44.024 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T11:23:44.024 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T11:23:44.024 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T11:23:44.024 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T11:23:44.024 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T11:23:44.024 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T11:23:44.025 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T11:23:44.025 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T11:23:44.025 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T11:23:44.025 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T11:23:44.025 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T11:23:44.025 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T11:23:44.025 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T11:23:44.025 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T11:23:44.025 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T11:23:44.025 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T11:23:44.025 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T11:23:44.025 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T11:23:44.025 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T11:23:44.025 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T11:23:44.025 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T11:23:44.026 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T11:23:44.026 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T11:23:44.026 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T11:23:44.026 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T11:23:44.026 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T11:23:44.026 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T11:23:44.026 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T11:23:44.026 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T11:23:44.026 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T11:23:44.026 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T11:23:44.026 INFO:tasks.workunit.client.0.smithi071.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T11:23:44.026 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MARKER2_READDIR (5 ms) 2024-09-14T11:23:44.026 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:23:44.027 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:23:44.027 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:23:44.027 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:23:44.027 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:23:44.027 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:23:44.027 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:23:44.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:23:44.020+0000 7fba9bb42a80 -1 shutting down 2024-09-14T11:23:44.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:23:44.024+0000 7fb975894640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61032, si_uid : 1000, si_addr0x3e80000ee68, si_status0 2024-09-14T11:24:14.049 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.SHUTDOWN (30030 ms) 2024-09-14T11:24:14.049 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 11 tests from LibRGW (30397 ms total) 2024-09-14T11:24:14.050 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-14T11:24:14.050 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-14T11:24:14.050 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 11 tests from 1 test suite ran. (30397 ms total) 2024-09-14T11:24:14.050 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 11 tests. 2024-09-14T11:24:14.059 INFO:tasks.workunit.client.0.smithi071.stdout:phase 5.1 2024-09-14T11:24:14.095 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-14T11:24:14.095 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-14T11:24:14.095 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 19 tests from LibRGW 2024-09-14T11:24:14.095 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:24:14.106 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:14.106 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:14.436 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.INIT (341 ms) 2024-09-14T11:24:14.436 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:24:14.437 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-14T11:24:14.437 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:24:14.455 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.CREATE_BUCKET (17 ms) 2024-09-14T11:24:14.455 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:24:14.460 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-09-14T11:24:14.460 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-14T11:24:14.460 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-14T11:24:14.460 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:24:14.463 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2024-09-14T11:24:14.464 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-14T11:24:14.464 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-14T11:24:14.464 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-14T11:24:14.469 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.PUT_OBJECT (5 ms) 2024-09-14T11:24:14.469 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-14T11:24:14.472 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.GET_OBJECT (2 ms) 2024-09-14T11:24:14.472 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:24:14.472 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:24:14.472 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-14T11:24:14.472 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-14T11:24:14.472 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.WRITEV 2024-09-14T11:24:14.472 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-14T11:24:14.472 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.READV 2024-09-14T11:24:14.473 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-14T11:24:14.473 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-14T11:24:14.473 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-14T11:24:14.473 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:24:14.473 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-14T11:24:14.473 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:24:14.473 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T11:24:14.473 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:24:14.473 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:24:14.473 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:24:14.473 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:24:14.474 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:24:14.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:24:14.471+0000 7f27d6ae0a80 -1 shutting down 2024-09-14T11:24:14.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:24:14.475+0000 7f26b0832640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61677, si_uid : 1000, si_addr0x3e80000f0ed, si_status0 2024-09-14T11:24:44.660 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.SHUTDOWN (30189 ms) 2024-09-14T11:24:44.660 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 19 tests from LibRGW (30565 ms total) 2024-09-14T11:24:44.661 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-14T11:24:44.661 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-14T11:24:44.661 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 19 tests from 1 test suite ran. (30565 ms total) 2024-09-14T11:24:44.661 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 19 tests. 2024-09-14T11:24:44.670 INFO:tasks.workunit.client.0.smithi071.stdout:phase 5.2 2024-09-14T11:24:44.704 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-14T11:24:44.705 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-14T11:24:44.705 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 19 tests from LibRGW 2024-09-14T11:24:44.705 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:24:44.713 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:44.713 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:45.077 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.INIT (372 ms) 2024-09-14T11:24:45.078 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:24:45.079 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-14T11:24:45.079 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:24:45.079 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T11:24:45.079 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:24:45.087 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (8 ms) 2024-09-14T11:24:45.087 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-14T11:24:45.087 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-14T11:24:45.087 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:24:45.087 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-14T11:24:45.087 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-14T11:24:45.087 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-14T11:24:45.087 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-14T11:24:45.087 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-14T11:24:45.087 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-14T11:24:45.087 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-14T11:24:45.087 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:24:45.087 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:24:45.088 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-14T11:24:45.088 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-14T11:24:45.088 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.WRITEV 2024-09-14T11:24:45.088 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-14T11:24:45.088 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.READV 2024-09-14T11:24:45.088 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-14T11:24:45.088 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-14T11:24:45.088 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-14T11:24:45.088 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:24:45.093 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.DELETE_OBJECT (6 ms) 2024-09-14T11:24:45.093 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:24:45.158 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.DELETE_BUCKET (65 ms) 2024-09-14T11:24:45.158 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:24:45.159 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:24:45.159 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:24:45.159 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:24:45.159 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:24:45.159 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:24:45.159+0000 7f948c701a80 -1 shutting down 2024-09-14T11:24:45.160 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:24:45.163+0000 7f9366453640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 62325, si_uid : 1000, si_addr0x3e80000f375, si_status0 2024-09-14T11:25:15.321 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.SHUTDOWN (30162 ms) 2024-09-14T11:25:15.321 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 19 tests from LibRGW (30616 ms total) 2024-09-14T11:25:15.321 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-14T11:25:15.321 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-14T11:25:15.321 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 19 tests from 1 test suite ran. (30617 ms total) 2024-09-14T11:25:15.321 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 19 tests. 2024-09-14T11:25:15.334 INFO:tasks.workunit.client.0.smithi071.stdout:phase 6.1 2024-09-14T11:25:15.359 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-14T11:25:15.359 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment set-up. 2024-09-14T11:25:15.359 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 10 tests from LibRGW 2024-09-14T11:25:15.359 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:25:15.368 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:15.368 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:15.920 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.INIT (561 ms) 2024-09-14T11:25:15.920 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:25:15.921 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:25:15.921 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-14T11:25:15.951 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.CREATE_BUCKETS (30 ms) 2024-09-14T11:25:15.951 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-14T11:25:15.962 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (11 ms) 2024-09-14T11:25:15.962 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-14T11:25:15.982 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.TOPDIR_RENAME (20 ms) 2024-09-14T11:25:15.982 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-14T11:25:16.018 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.SUBDIR_RENAME (36 ms) 2024-09-14T11:25:16.018 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-14T11:25:16.058 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (40 ms) 2024-09-14T11:25:16.058 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:25:16.058 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:25:16.058 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:25:16.059 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:25:16.059 INFO:tasks.workunit.client.0.smithi071.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:25:16.059 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:16.058+0000 7f15cd40ba80 -1 shutting down 2024-09-14T11:25:16.060 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:16.062+0000 7f14a715d640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 62973, si_uid : 1000, si_addr0x3e80000f5fd, si_status0 2024-09-14T11:25:46.293 INFO:tasks.workunit.client.0.smithi071.stdout:[ OK ] LibRGW.SHUTDOWN (30235 ms) 2024-09-14T11:25:46.294 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] 10 tests from LibRGW (30934 ms total) 2024-09-14T11:25:46.294 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-14T11:25:46.294 INFO:tasks.workunit.client.0.smithi071.stdout:[----------] Global test environment tear-down 2024-09-14T11:25:46.294 INFO:tasks.workunit.client.0.smithi071.stdout:[==========] 10 tests from 1 test suite ran. (30934 ms total) 2024-09-14T11:25:46.294 INFO:tasks.workunit.client.0.smithi071.stdout:[ PASSED ] 10 tests. 2024-09-14T11:25:46.308 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:25:46.308 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:25:46.323 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-14T11:25:46.324 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-14T11:25:46.324 DEBUG:teuthology.orchestra.run.smithi071:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-14T11:25:46.372 INFO:tasks.workunit.client.0.smithi071.stderr:+ [ -z ] 2024-09-14T11:25:46.372 INFO:tasks.workunit.client.0.smithi071.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-14T11:25:46.373 INFO:tasks.workunit.client.0.smithi071.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-14T11:25:46.373 INFO:tasks.workunit.client.0.smithi071.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name maven test user --email sigv4@example.com 2024-09-14T11:25:46.414 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:46.414 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:46.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.465+0000 7fdf7b8fb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:25:46.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.465+0000 7fdf7b8fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:46.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.465+0000 7fdf7b8fb9c0 20 realm 2024-09-14T11:25:46.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.465+0000 7fdf7b8fb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:25:46.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.465+0000 7fdf7b8fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:46.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.465+0000 7fdf7b8fb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:25:46.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.465+0000 7fdf7b8fb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:25:46.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.469+0000 7fdf7b8fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:46.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.469+0000 7fdf7b8fb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:25:46.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.469+0000 7fdf7b8fb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:46.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.469+0000 7fdf7b8fb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:25:46.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.469+0000 7fdf7b8fb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:25:46.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.469+0000 7fdf7b8fb9c0 20 searching for the correct realm 2024-09-14T11:25:46.469 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.473+0000 7fdf79c02640 0 -- 172.21.15.71:0/665700809 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fdf700e0140 msgr2=0x7fdf70119a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:46.683 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.685+0000 7fdf79c02640 0 -- 172.21.15.71:0/665700809 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x5631b93d4720 msgr2=0x5631b93d6b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:46.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.701+0000 7fdf7b8fb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:25:46.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.701+0000 7fdf7b8fb9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:25:46.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.701+0000 7fdf7b8fb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:25:46.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.701+0000 7fdf7b8fb9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:25:46.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.701+0000 7fdf7b8fb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:25:46.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.701+0000 7fdf7b8fb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:25:46.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.701+0000 7fdf7b8fb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:25:46.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.705+0000 7fdf7b8fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:46.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.705+0000 7fdf7b8fb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:25:46.701 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.705+0000 7fdf7b8fb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:46.701 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.705+0000 7fdf7b8fb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:25:46.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.705+0000 7fdf7b8fb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:25:46.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.705+0000 7fdf7b8fb9c0 20 zone default found 2024-09-14T11:25:46.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.705+0000 7fdf7b8fb9c0 4 Realm: () 2024-09-14T11:25:46.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.705+0000 7fdf7b8fb9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:25:46.703 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.705+0000 7fdf7b8fb9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:25:46.703 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.705+0000 7fdf7b8fb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:25:46.703 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.705+0000 7fdf7b8fb9c0 20 zonegroup default 2024-09-14T11:25:46.703 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.705+0000 7fdf7b8fb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:25:46.703 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.705+0000 7fdf7b8fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:46.703 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.705+0000 7fdf7b8fb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:25:46.703 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.705+0000 7fdf7b8fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:46.704 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.705+0000 7fdf7b8fb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:25:46.704 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.709+0000 7fdf7b8fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:46.704 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.709+0000 7fdf7b8fb9c0 20 started sync module instance, tier type = 2024-09-14T11:25:46.704 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.709+0000 7fdf7b8fb9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:25:46.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.729+0000 7fdf7b8fb9c0 20 add_watcher() i=0 2024-09-14T11:25:46.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.729+0000 7fdf7b8fb9c0 20 add_watcher() i=1 2024-09-14T11:25:46.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.729+0000 7fdf7b8fb9c0 20 add_watcher() i=2 2024-09-14T11:25:46.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.729+0000 7fdf7b8fb9c0 20 add_watcher() i=3 2024-09-14T11:25:46.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.729+0000 7fdf7b8fb9c0 20 add_watcher() i=4 2024-09-14T11:25:46.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.729+0000 7fdf7b8fb9c0 20 add_watcher() i=5 2024-09-14T11:25:46.728 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.729+0000 7fdf7b8fb9c0 20 add_watcher() i=6 2024-09-14T11:25:46.730 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.733+0000 7fdf7b8fb9c0 20 add_watcher() i=7 2024-09-14T11:25:46.730 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.733+0000 7fdf7b8fb9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:25:46.734 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.737+0000 7fde2ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:46.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.737+0000 7fdf7b8fb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:25:46.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.737+0000 7fdf7b8fb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:25:46.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.737+0000 7fdf7b8fb9c0 5 note: GC not initialized 2024-09-14T11:25:46.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.737+0000 7fde2efe5640 20 reqs_thread_entry: start 2024-09-14T11:25:46.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.737+0000 7fdf7b8fb9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:25:46.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.741+0000 7fdf7b8fb9c0 20 Filter name: none 2024-09-14T11:25:46.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.741+0000 7fde2cfe1640 20 reqs_thread_entry: start 2024-09-14T11:25:46.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.741+0000 7fdf7b8fb9c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-14T11:25:46.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.741+0000 7fdf7b8fb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:25:46.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.741+0000 7fdf7b8fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:46.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.741+0000 7fdf7b8fb9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-14T11:25:46.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.741+0000 7fdf7b8fb9c0 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T11:25:46.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.741+0000 7fdf7b8fb9c0 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-14T11:25:46.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.741+0000 7fdf7b8fb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:25:46.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.741+0000 7fdf7b8fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:46.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.741+0000 7fdf7b8fb9c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-14T11:25:46.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.741+0000 7fdf7b8fb9c0 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T11:25:46.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.741+0000 7fdf7b8fb9c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-14T11:25:46.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.741+0000 7fdf7b8fb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:25:46.739 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.741+0000 7fdf7b8fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:46.739 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.741+0000 7fdf7b8fb9c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-14T11:25:46.739 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.741+0000 7fdf7b8fb9c0 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T11:25:46.739 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.741+0000 7fdf7b8fb9c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-14T11:25:46.739 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.741+0000 7fdf7b8fb9c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-14T11:25:46.742 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.745+0000 7fdf7b8fb9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-14T11:25:46.742 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.745+0000 7fdf7b8fb9c0 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T11:25:46.742 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.745+0000 7fdf7b8fb9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-14T11:25:46.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.745+0000 7fde5cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758660 cookie 94771561239248 notifier 5513 bl.length()=677 2024-09-14T11:25:46.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.745+0000 7fde5cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-14T11:25:46.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.745+0000 7fde5cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T11:25:46.747 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.749+0000 7fdf7b8fb9c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-14T11:25:46.748 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.749+0000 7fdf7b8fb9c0 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T11:25:46.748 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.749+0000 7fdf7b8fb9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-14T11:25:46.748 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.753+0000 7fde5cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758601 cookie 94771561224144 notifier 5513 bl.length()=187 2024-09-14T11:25:46.748 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.753+0000 7fde5cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-14T11:25:46.748 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.753+0000 7fde5cff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T11:25:46.751 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.753+0000 7fdf7b8fb9c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-14T11:25:46.752 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.753+0000 7fdf7b8fb9c0 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T11:25:46.752 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.753+0000 7fdf7b8fb9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-14T11:25:46.752 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.757+0000 7fde5cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758602 cookie 94771561224144 notifier 5513 bl.length()=197 2024-09-14T11:25:46.752 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.757+0000 7fde5cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-14T11:25:46.752 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.757+0000 7fde5cff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T11:25:46.753 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:25:46.753 INFO:tasks.workunit.client.0.smithi071.stdout: "user_id": "ceph-test-maven", 2024-09-14T11:25:46.753 INFO:tasks.workunit.client.0.smithi071.stdout: "display_name": "maven test user", 2024-09-14T11:25:46.753 INFO:tasks.workunit.client.0.smithi071.stdout: "email": "sigv4@example.com", 2024-09-14T11:25:46.753 INFO:tasks.workunit.client.0.smithi071.stdout: "suspended": 0, 2024-09-14T11:25:46.753 INFO:tasks.workunit.client.0.smithi071.stdout: "max_buckets": 1000, 2024-09-14T11:25:46.754 INFO:tasks.workunit.client.0.smithi071.stdout: "subusers": [], 2024-09-14T11:25:46.754 INFO:tasks.workunit.client.0.smithi071.stdout: "keys": [ 2024-09-14T11:25:46.754 INFO:tasks.workunit.client.0.smithi071.stdout: { 2024-09-14T11:25:46.754 INFO:tasks.workunit.client.0.smithi071.stdout: "user": "ceph-test-maven", 2024-09-14T11:25:46.754 INFO:tasks.workunit.client.0.smithi071.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-14T11:25:46.754 INFO:tasks.workunit.client.0.smithi071.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-14T11:25:46.754 INFO:tasks.workunit.client.0.smithi071.stdout: "active": true, 2024-09-14T11:25:46.754 INFO:tasks.workunit.client.0.smithi071.stdout: "create_date": "2024-09-14T11:25:46.745270Z" 2024-09-14T11:25:46.754 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:25:46.754 INFO:tasks.workunit.client.0.smithi071.stdout: ], 2024-09-14T11:25:46.754 INFO:tasks.workunit.client.0.smithi071.stdout: "swift_keys": [], 2024-09-14T11:25:46.754 INFO:tasks.workunit.client.0.smithi071.stdout: "caps": [], 2024-09-14T11:25:46.754 INFO:tasks.workunit.client.0.smithi071.stdout: "op_mask": "read, write, delete", 2024-09-14T11:25:46.755 INFO:tasks.workunit.client.0.smithi071.stdout: "default_placement": "", 2024-09-14T11:25:46.755 INFO:tasks.workunit.client.0.smithi071.stdout: "default_storage_class": "", 2024-09-14T11:25:46.755 INFO:tasks.workunit.client.0.smithi071.stdout: "placement_tags": [], 2024-09-14T11:25:46.755 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_quota": { 2024-09-14T11:25:46.755 INFO:tasks.workunit.client.0.smithi071.stdout: "enabled": false, 2024-09-14T11:25:46.755 INFO:tasks.workunit.client.0.smithi071.stdout: "check_on_raw": false, 2024-09-14T11:25:46.755 INFO:tasks.workunit.client.0.smithi071.stdout: "max_size": -1, 2024-09-14T11:25:46.755 INFO:tasks.workunit.client.0.smithi071.stdout: "max_size_kb": 0, 2024-09-14T11:25:46.755 INFO:tasks.workunit.client.0.smithi071.stdout: "max_objects": -1 2024-09-14T11:25:46.755 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:25:46.755 INFO:tasks.workunit.client.0.smithi071.stdout: "user_quota": { 2024-09-14T11:25:46.755 INFO:tasks.workunit.client.0.smithi071.stdout: "enabled": false, 2024-09-14T11:25:46.755 INFO:tasks.workunit.client.0.smithi071.stdout: "check_on_raw": false, 2024-09-14T11:25:46.755 INFO:tasks.workunit.client.0.smithi071.stdout: "max_size": -1, 2024-09-14T11:25:46.755 INFO:tasks.workunit.client.0.smithi071.stdout: "max_size_kb": 0, 2024-09-14T11:25:46.756 INFO:tasks.workunit.client.0.smithi071.stdout: "max_objects": -1 2024-09-14T11:25:46.756 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:25:46.756 INFO:tasks.workunit.client.0.smithi071.stdout: "temp_url_keys": [], 2024-09-14T11:25:46.756 INFO:tasks.workunit.client.0.smithi071.stdout: "type": "rgw", 2024-09-14T11:25:46.756 INFO:tasks.workunit.client.0.smithi071.stdout: "mfa_ids": [], 2024-09-14T11:25:46.756 INFO:tasks.workunit.client.0.smithi071.stdout: "account_id": "", 2024-09-14T11:25:46.756 INFO:tasks.workunit.client.0.smithi071.stdout: "path": "/", 2024-09-14T11:25:46.756 INFO:tasks.workunit.client.0.smithi071.stdout: "create_date": "2024-09-14T11:25:46.745240Z", 2024-09-14T11:25:46.756 INFO:tasks.workunit.client.0.smithi071.stdout: "tags": [], 2024-09-14T11:25:46.756 INFO:tasks.workunit.client.0.smithi071.stdout: "group_ids": [] 2024-09-14T11:25:46.756 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:25:46.756 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-14T11:25:46.757 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.757+0000 7fde2ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:46.758 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.761+0000 7fdf7b8fb9c0 20 remove_watcher() i=0 2024-09-14T11:25:46.758 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.761+0000 7fdf7b8fb9c0 2 removed watcher, disabling cache 2024-09-14T11:25:46.761 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.765+0000 7fdf7b8fb9c0 20 remove_watcher() i=1 2024-09-14T11:25:46.763 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.765+0000 7fdf7b8fb9c0 20 remove_watcher() i=2 2024-09-14T11:25:46.765 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.769+0000 7fdf7b8fb9c0 20 remove_watcher() i=3 2024-09-14T11:25:46.767 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.769+0000 7fdf7b8fb9c0 20 remove_watcher() i=4 2024-09-14T11:25:46.769 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.773+0000 7fdf7b8fb9c0 20 remove_watcher() i=5 2024-09-14T11:25:46.771 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.773+0000 7fdf7b8fb9c0 20 remove_watcher() i=6 2024-09-14T11:25:46.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:25:46.777+0000 7fdf7b8fb9c0 20 remove_watcher() i=7 2024-09-14T11:25:46.791 INFO:tasks.workunit.client.0.smithi071.stderr:+ [ -z ] 2024-09-14T11:25:46.791 INFO:tasks.workunit.client.0.smithi071.stderr:+ [ -z /home/ubuntu/cephtest ] 2024-09-14T11:25:46.791 INFO:tasks.workunit.client.0.smithi071.stderr:+ cat /home/ubuntu/cephtest/url_file 2024-09-14T11:25:46.791 INFO:tasks.workunit.client.0.smithi071.stderr:+ export RGW_HTTP_ENDPOINT_URL=http://smithi071.front.sepia.ceph.com:80 2024-09-14T11:25:46.791 INFO:tasks.workunit.client.0.smithi071.stderr:+ [ -z /home/ubuntu/cephtest/clone.client.0 ] 2024-09-14T11:25:46.791 INFO:tasks.workunit.client.0.smithi071.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-14T11:25:46.792 INFO:tasks.workunit.client.0.smithi071.stderr:+ ./mvnw clean package 2024-09-14T11:25:46.799 INFO:tasks.workunit.client.0.smithi071.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-14T11:25:50.665 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] Scanning for projects... 2024-09-14T11:25:50.814 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-14T11:25:50.913 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 55 kB/s) 2024-09-14T11:25:50.932 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-14T11:25:50.967 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/83 kB Progress (1): 33/83 kB Progress (1): 49/83 kB Progress (1): 66/83 kB Progress (1): 82/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.3 MB/s) 2024-09-14T11:25:50.982 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-14T11:25:51.002 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 66/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.7 MB/s) 2024-09-14T11:25:51.037 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] 2024-09-14T11:25:51.037 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-14T11:25:51.037 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] Building jcksum 1.0 2024-09-14T11:25:51.037 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] from pom.xml 2024-09-14T11:25:51.037 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-14T11:25:51.041 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-14T11:25:51.058 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 312 kB/s) 2024-09-14T11:25:51.067 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-14T11:25:51.082 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 619 kB/s) 2024-09-14T11:25:51.086 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-14T11:25:51.102 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.8 MB/s) 2024-09-14T11:25:51.111 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-14T11:25:51.128 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.2 MB/s) 2024-09-14T11:25:51.142 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-14T11:25:51.158 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.2 MB/s) 2024-09-14T11:25:51.165 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-14T11:25:51.180 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 544 kB/s) 2024-09-14T11:25:51.183 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-14T11:25:51.198 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 539 kB/s) 2024-09-14T11:25:51.200 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-14T11:25:51.216 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 3.0 MB/s) 2024-09-14T11:25:51.220 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-14T11:25:51.234 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.5 MB/s) 2024-09-14T11:25:51.240 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-14T11:25:51.256 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 2.1 MB/s) 2024-09-14T11:25:51.261 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-14T11:25:51.276 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 654 kB/s) 2024-09-14T11:25:51.282 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-14T11:25:51.300 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.6 MB/s) 2024-09-14T11:25:51.309 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-14T11:25:51.325 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 332 kB/s) 2024-09-14T11:25:51.329 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-14T11:25:51.345 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.3 MB/s) 2024-09-14T11:25:51.349 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-14T11:25:51.365 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/50 kB Progress (1): 32/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 3.1 MB/s) 2024-09-14T11:25:51.371 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-14T11:25:51.387 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.5 MB/s) 2024-09-14T11:25:51.396 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-14T11:25:51.411 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 375 kB/s) 2024-09-14T11:25:51.416 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-14T11:25:51.432 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.8 MB/s) 2024-09-14T11:25:51.440 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-14T11:25:51.454 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 451 kB/s) 2024-09-14T11:25:51.457 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-14T11:25:51.471 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 707 kB/s) 2024-09-14T11:25:51.474 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-14T11:25:51.489 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 3.0 MB/s) 2024-09-14T11:25:51.493 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-14T11:25:51.508 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.4 MB/s) 2024-09-14T11:25:51.515 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-14T11:25:51.531 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.6 MB/s) 2024-09-14T11:25:51.547 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-14T11:25:51.562 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 406 kB/s) 2024-09-14T11:25:51.564 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-14T11:25:51.579 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.4 MB/s) 2024-09-14T11:25:51.586 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-14T11:25:51.602 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.2 MB/s) 2024-09-14T11:25:51.613 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-14T11:25:51.628 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 250 kB/s) 2024-09-14T11:25:51.631 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-14T11:25:51.646 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 104 kB/s) 2024-09-14T11:25:51.648 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-14T11:25:51.662 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 159 kB/s) 2024-09-14T11:25:51.668 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-14T11:25:51.684 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 243 kB/s) 2024-09-14T11:25:51.690 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-14T11:25:51.710 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 161 kB/s) 2024-09-14T11:25:51.717 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-14T11:25:51.732 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 685 kB/s) 2024-09-14T11:25:51.737 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-14T11:25:51.752 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 112 kB/s) 2024-09-14T11:25:51.756 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-14T11:25:51.771 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 255 kB/s) 2024-09-14T11:25:51.775 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-14T11:25:51.790 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 327 kB/s) 2024-09-14T11:25:51.793 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-14T11:25:51.808 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 77 kB/s) 2024-09-14T11:25:51.810 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-14T11:25:51.824 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 274 kB/s) 2024-09-14T11:25:51.826 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-14T11:25:51.841 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 920 kB/s) 2024-09-14T11:25:51.844 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-14T11:25:51.858 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 262 kB/s) 2024-09-14T11:25:51.863 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-14T11:25:51.877 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 175 kB/s) 2024-09-14T11:25:51.881 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-14T11:25:51.895 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 208 kB/s) 2024-09-14T11:25:51.899 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-14T11:25:51.914 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 494 kB/s) 2024-09-14T11:25:51.918 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-14T11:25:51.933 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 364 kB/s) 2024-09-14T11:25:51.940 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-14T11:25:51.956 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 218 kB/s) 2024-09-14T11:25:51.965 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-14T11:25:51.982 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 258 kB/s) 2024-09-14T11:25:51.987 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-14T11:25:52.004 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 142 kB/s) 2024-09-14T11:25:52.013 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-14T11:25:52.030 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 379 kB/s) 2024-09-14T11:25:52.037 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-14T11:25:52.053 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 379 kB/s) 2024-09-14T11:25:52.062 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-14T11:25:52.079 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 175 kB/s) 2024-09-14T11:25:52.089 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-14T11:25:52.105 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 217 kB/s) 2024-09-14T11:25:52.113 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-14T11:25:52.130 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 240 kB/s) 2024-09-14T11:25:52.133 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-14T11:25:52.150 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 105 kB/s) 2024-09-14T11:25:52.160 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-14T11:25:52.177 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 367 kB/s) 2024-09-14T11:25:52.184 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-14T11:25:52.203 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 15/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 910 kB/s) 2024-09-14T11:25:52.210 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-14T11:25:52.229 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 1.8 MB/s) 2024-09-14T11:25:52.236 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-14T11:25:52.252 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.1 MB/s) 2024-09-14T11:25:52.262 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-14T11:25:52.280 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 276 kB/s) 2024-09-14T11:25:52.287 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-14T11:25:52.305 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 693 kB/s) 2024-09-14T11:25:52.317 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-14T11:25:52.333 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 776 kB/s) 2024-09-14T11:25:52.338 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-14T11:25:52.356 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 62/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 3.8 MB/s) 2024-09-14T11:25:52.376 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-14T11:25:52.392 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 979 kB/s) 2024-09-14T11:25:52.400 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-14T11:25:52.416 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 965 kB/s) 2024-09-14T11:25:52.421 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-14T11:25:52.440 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 4.2 MB/s) 2024-09-14T11:25:52.450 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-14T11:25:52.468 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.0 MB/s) 2024-09-14T11:25:52.478 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-14T11:25:52.496 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.1 MB/s) 2024-09-14T11:25:52.503 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-14T11:25:52.521 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 4.1 MB/s) 2024-09-14T11:25:52.536 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-14T11:25:52.552 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 240 kB/s) 2024-09-14T11:25:52.556 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-14T11:25:52.573 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 812 kB/s) 2024-09-14T11:25:52.578 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-14T11:25:52.594 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 200 kB/s) 2024-09-14T11:25:52.598 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-14T11:25:52.614 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 199 kB/s) 2024-09-14T11:25:52.618 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-14T11:25:52.634 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 127 kB/s) 2024-09-14T11:25:52.640 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-14T11:25:52.655 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 177 kB/s) 2024-09-14T11:25:52.660 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-14T11:25:52.677 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 90 kB/s) 2024-09-14T11:25:52.681 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-14T11:25:52.697 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 188 kB/s) 2024-09-14T11:25:52.702 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-14T11:25:52.718 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 200 kB/s) 2024-09-14T11:25:52.722 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-14T11:25:52.738 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 200 kB/s) 2024-09-14T11:25:52.743 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-14T11:25:52.759 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 64 kB/s) 2024-09-14T11:25:52.768 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-14T11:25:52.784 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 57 kB/s) 2024-09-14T11:25:52.792 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-14T11:25:52.811 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 180 kB/s) 2024-09-14T11:25:52.816 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-14T11:25:52.832 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 178 kB/s) 2024-09-14T11:25:52.836 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-14T11:25:52.852 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 215 kB/s) 2024-09-14T11:25:52.858 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-14T11:25:52.874 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 215 kB/s) 2024-09-14T11:25:52.879 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-14T11:25:52.895 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 189 kB/s) 2024-09-14T11:25:52.940 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-14T11:25:53.063 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 27 MB/s) 2024-09-14T11:25:53.065 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-14T11:25:53.065 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-14T11:25:53.066 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-14T11:25:53.066 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-14T11:25:53.066 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-14T11:25:53.102 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 427 kB/s) 2024-09-14T11:25:53.102 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-14T11:25:53.118 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 308 kB/s) 2024-09-14T11:25:53.118 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-14T11:25:53.144 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 1.4/49 kB Progress (1): 2.8/49 kB Progress (1): 4.1/49 kB Progress (1): 5.5/49 kB Progress (1): 6.9/49 kB Progress (2): 6.9/49 kB | 16/71 kB Progress (2): 8.3/49 kB | 16/71 kB Progress (2): 9.7/49 kB | 16/71 kB Progress (2): 11/49 kB | 16/71 kB Progress (2): 12/49 kB | 16/71 kB Progress (2): 14/49 kB | 16/71 kB Progress (2): 15/49 kB | 16/71 kB Progress (2): 17/49 kB | 16/71 kB Progress (2): 18/49 kB | 16/71 kB Progress (2): 19/49 kB | 16/71 kB Progress (2): 21/49 kB | 16/71 kB Progress (3): 21/49 kB | 16/71 kB | 16/782 kB Progress (3): 22/49 kB | 16/71 kB | 16/782 kB Progress (3): 23/49 kB | 16/71 kB | 16/782 kB Progress (3): 23/49 kB | 16/71 kB | 33/782 kB Progress (3): 25/49 kB | 16/71 kB | 33/782 kB Progress (3): 25/49 kB | 16/71 kB | 49/782 kB Progress (3): 26/49 kB | 16/71 kB | 49/782 kB Progress (3): 26/49 kB | 16/71 kB | 66/782 kB Progress (3): 28/49 kB | 16/71 kB | 66/782 kB Progress (3): 28/49 kB | 16/71 kB | 82/782 kB Progress (3): 29/49 kB | 16/71 kB | 82/782 kB Progress (3): 29/49 kB | 33/71 kB | 82/782 kB Progress (3): 29/49 kB | 33/71 kB | 98/782 kB Progress (3): 30/49 kB | 33/71 kB | 98/782 kB Progress (3): 32/49 kB | 33/71 kB | 98/782 kB Progress (3): 32/49 kB | 33/71 kB | 115/782 kB Progress (3): 32/49 kB | 33/71 kB | 131/782 kB Progress (3): 33/49 kB | 33/71 kB | 131/782 kB Progress (3): 34/49 kB | 33/71 kB | 131/782 kB Progress (3): 34/49 kB | 33/71 kB | 147/782 kB Progress (3): 34/49 kB | 33/71 kB | 164/782 kB Progress (3): 36/49 kB | 33/71 kB | 164/782 kB Progress (3): 36/49 kB | 33/71 kB | 180/782 kB Progress (3): 37/49 kB | 33/71 kB | 180/782 kB Progress (3): 37/49 kB | 33/71 kB | 197/782 kB Progress (3): 39/49 kB | 33/71 kB | 197/782 kB Progress (3): 39/49 kB | 33/71 kB | 213/782 kB Progress (3): 39/49 kB | 33/71 kB | 229/782 kB Progress (3): 39/49 kB | 33/71 kB | 246/782 kB Progress (3): 40/49 kB | 33/71 kB | 246/782 kB Progress (3): 41/49 kB | 33/71 kB | 246/782 kB Progress (3): 41/49 kB | 33/71 kB | 256/782 kB Progress (3): 43/49 kB | 33/71 kB | 256/782 kB Progress (3): 44/49 kB | 33/71 kB | 256/782 kB Progress (3): 44/49 kB | 33/71 kB | 272/782 kB Progress (3): 46/49 kB | 33/71 kB | 272/782 kB Progress (3): 47/49 kB | 33/71 kB | 272/782 kB Progress (3): 47/49 kB | 33/71 kB | 289/782 kB Progress (3): 47/49 kB | 49/71 kB | 289/782 kB Progress (3): 47/49 kB | 49/71 kB | 305/782 kB Progress (3): 48/49 kB | 49/71 kB | 305/782 kB Progress (3): 49 kB | 49/71 kB | 305/782 kB Progress (3): 49 kB | 49/71 kB | 321/782 kB Progress (3): 49 kB | 49/71 kB | 338/782 kB Progress (3): 49 kB | 49/71 kB | 354/782 kB Progress (4): 49 kB | 49/71 kB | 354/782 kB | 1.4/35 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 639 kB/s) 2024-09-14T11:25:53.144 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (3): 49/71 kB | 354/782 kB | 2.8/35 kB Progress (3): 49/71 kB | 370/782 kB | 2.8/35 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-14T11:25:53.148 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (3): 49/71 kB | 370/782 kB | 4.1/35 kB Progress (3): 49/71 kB | 370/782 kB | 5.5/35 kB Progress (3): 49/71 kB | 387/782 kB | 5.5/35 kB Progress (3): 49/71 kB | 387/782 kB | 6.9/35 kB Progress (3): 49/71 kB | 387/782 kB | 8.3/35 kB Progress (3): 49/71 kB | 387/782 kB | 9.7/35 kB Progress (3): 49/71 kB | 403/782 kB | 9.7/35 kB Progress (4): 49/71 kB | 403/782 kB | 9.7/35 kB | 16/98 kB Progress (4): 49/71 kB | 420/782 kB | 9.7/35 kB | 16/98 kB Progress (4): 66/71 kB | 420/782 kB | 9.7/35 kB | 16/98 kB Progress (4): 66/71 kB | 420/782 kB | 11/35 kB | 16/98 kB Progress (4): 66/71 kB | 436/782 kB | 11/35 kB | 16/98 kB Progress (4): 66/71 kB | 436/782 kB | 12/35 kB | 16/98 kB Progress (4): 71 kB | 436/782 kB | 12/35 kB | 16/98 kB Progress (4): 71 kB | 452/782 kB | 12/35 kB | 16/98 kB Progress (4): 71 kB | 452/782 kB | 14/35 kB | 16/98 kB Progress (4): 71 kB | 452/782 kB | 15/35 kB | 16/98 kB Progress (4): 71 kB | 469/782 kB | 15/35 kB | 16/98 kB Progress (4): 71 kB | 469/782 kB | 16/35 kB | 16/98 kB Progress (4): 71 kB | 469/782 kB | 17/35 kB | 16/98 kB Progress (4): 71 kB | 485/782 kB | 17/35 kB | 16/98 kB Progress (4): 71 kB | 485/782 kB | 19/35 kB | 16/98 kB Progress (4): 71 kB | 485/782 kB | 20/35 kB | 16/98 kB Progress (4): 71 kB | 502/782 kB | 20/35 kB | 16/98 kB Progress (4): 71 kB | 502/782 kB | 21/35 kB | 16/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 850 kB/s) 2024-09-14T11:25:53.148 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (3): 518/782 kB | 21/35 kB | 16/98 kB Progress (3): 518/782 kB | 23/35 kB | 16/98 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-14T11:25:53.150 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (3): 518/782 kB | 24/35 kB | 16/98 kB Progress (3): 534/782 kB | 24/35 kB | 16/98 kB Progress (3): 534/782 kB | 25/35 kB | 16/98 kB Progress (3): 534/782 kB | 25/35 kB | 33/98 kB Progress (3): 534/782 kB | 27/35 kB | 33/98 kB Progress (3): 534/782 kB | 28/35 kB | 33/98 kB Progress (3): 551/782 kB | 28/35 kB | 33/98 kB Progress (3): 551/782 kB | 30/35 kB | 33/98 kB Progress (3): 551/782 kB | 31/35 kB | 33/98 kB Progress (3): 551/782 kB | 32/35 kB | 33/98 kB Progress (3): 567/782 kB | 32/35 kB | 33/98 kB Progress (3): 567/782 kB | 34/35 kB | 33/98 kB Progress (3): 567/782 kB | 35/35 kB | 33/98 kB Progress (3): 567/782 kB | 35 kB | 33/98 kB Progress (3): 583/782 kB | 35 kB | 33/98 kB Progress (3): 600/782 kB | 35 kB | 33/98 kB Progress (3): 616/782 kB | 35 kB | 33/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 414 kB/s) 2024-09-14T11:25:53.150 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-14T11:25:53.155 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (2): 633/782 kB | 33/98 kB Progress (2): 649/782 kB | 33/98 kB Progress (2): 665/782 kB | 33/98 kB Progress (2): 682/782 kB | 33/98 kB Progress (2): 698/782 kB | 33/98 kB Progress (2): 715/782 kB | 33/98 kB Progress (2): 731/782 kB | 33/98 kB Progress (2): 747/782 kB | 33/98 kB Progress (2): 764/782 kB | 33/98 kB Progress (2): 780/782 kB | 33/98 kB Progress (2): 782 kB | 33/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 8.8 MB/s) 2024-09-14T11:25:53.155 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-14T11:25:53.159 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 49/98 kB Progress (2): 49/98 kB | 1.4/11 kB Progress (2): 49/98 kB | 2.8/11 kB Progress (2): 49/98 kB | 4.1/11 kB Progress (2): 49/98 kB | 5.5/11 kB Progress (2): 49/98 kB | 6.9/11 kB Progress (2): 49/98 kB | 8.3/11 kB Progress (2): 66/98 kB | 8.3/11 kB Progress (2): 66/98 kB | 9.7/11 kB Progress (2): 66/98 kB | 11/11 kB Progress (2): 66/98 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 122 kB/s) 2024-09-14T11:25:53.159 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-14T11:25:53.162 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 82/98 kB Progress (1): 98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 991 kB/s) 2024-09-14T11:25:53.162 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-14T11:25:53.167 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/205 kB Progress (1): 33/205 kB Progress (1): 49/205 kB Progress (1): 66/205 kB Progress (2): 66/205 kB | 16/30 kB Progress (2): 82/205 kB | 16/30 kB Progress (2): 82/205 kB | 30 kB Progress (2): 98/205 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 305 kB/s) 2024-09-14T11:25:53.167 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-14T11:25:53.172 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (2): 98/205 kB | 16/81 kB Progress (2): 98/205 kB | 32/81 kB Progress (2): 98/205 kB | 49/81 kB Progress (2): 98/205 kB | 65/81 kB Progress (2): 98/205 kB | 81 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 774 kB/s) 2024-09-14T11:25:53.172 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-14T11:25:53.176 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 115/205 kB Progress (1): 131/205 kB Progress (1): 147/205 kB Progress (1): 164/205 kB Progress (1): 180/205 kB Progress (2): 180/205 kB | 13 kB Progress (3): 180/205 kB | 13 kB | 16/798 kB Progress (3): 197/205 kB | 13 kB | 16/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 123 kB/s) 2024-09-14T11:25:53.176 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-14T11:25:53.178 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (2): 205 kB | 16/798 kB Progress (2): 205 kB | 33/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 1.8 MB/s) 2024-09-14T11:25:53.178 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 49/798 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-14T11:25:53.192 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 66/798 kB Progress (1): 82/798 kB Progress (2): 82/798 kB | 16/182 kB Progress (2): 82/798 kB | 33/182 kB Progress (2): 82/798 kB | 49/182 kB Progress (2): 98/798 kB | 49/182 kB Progress (2): 115/798 kB | 49/182 kB Progress (3): 115/798 kB | 49/182 kB | 16/151 kB Progress (3): 115/798 kB | 49/182 kB | 33/151 kB Progress (3): 131/798 kB | 49/182 kB | 33/151 kB Progress (3): 131/798 kB | 49/182 kB | 49/151 kB Progress (3): 131/798 kB | 49/182 kB | 66/151 kB Progress (3): 147/798 kB | 49/182 kB | 66/151 kB Progress (3): 147/798 kB | 49/182 kB | 82/151 kB Progress (3): 164/798 kB | 49/182 kB | 82/151 kB Progress (3): 164/798 kB | 49/182 kB | 98/151 kB Progress (3): 164/798 kB | 49/182 kB | 115/151 kB Progress (3): 180/798 kB | 49/182 kB | 115/151 kB Progress (3): 180/798 kB | 49/182 kB | 131/151 kB Progress (3): 197/798 kB | 49/182 kB | 131/151 kB Progress (3): 197/798 kB | 49/182 kB | 147/151 kB Progress (3): 197/798 kB | 49/182 kB | 151 kB Progress (3): 213/798 kB | 49/182 kB | 151 kB Progress (4): 213/798 kB | 49/182 kB | 151 kB | 16/27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.2 MB/s) 2024-09-14T11:25:53.192 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (3): 229/798 kB | 49/182 kB | 16/27 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-14T11:25:53.193 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (3): 229/798 kB | 49/182 kB | 27 kB Progress (3): 246/798 kB | 49/182 kB | 27 kB Progress (3): 246/798 kB | 66/182 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 218 kB/s) 2024-09-14T11:25:53.193 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-14T11:25:53.194 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (3): 246/798 kB | 66/182 kB | 16/30 kB Progress (3): 246/798 kB | 82/182 kB | 16/30 kB Progress (3): 246/798 kB | 82/182 kB | 30 kB Progress (3): 246/798 kB | 98/182 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 239 kB/s) 2024-09-14T11:25:53.194 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-14T11:25:53.200 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (2): 246/798 kB | 115/182 kB Progress (2): 246/798 kB | 131/182 kB Progress (2): 246/798 kB | 147/182 kB Progress (2): 262/798 kB | 147/182 kB Progress (2): 262/798 kB | 164/182 kB Progress (2): 279/798 kB | 164/182 kB Progress (2): 295/798 kB | 164/182 kB Progress (2): 295/798 kB | 180/182 kB Progress (2): 311/798 kB | 180/182 kB Progress (2): 311/798 kB | 182 kB Progress (2): 328/798 kB | 182 kB Progress (2): 344/798 kB | 182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.4 MB/s) 2024-09-14T11:25:53.200 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-14T11:25:53.208 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 360/798 kB Progress (1): 377/798 kB Progress (1): 393/798 kB Progress (1): 410/798 kB Progress (1): 426/798 kB Progress (1): 442/798 kB Progress (1): 459/798 kB Progress (1): 475/798 kB Progress (1): 492/798 kB Progress (1): 508/798 kB Progress (1): 524/798 kB Progress (1): 541/798 kB Progress (1): 557/798 kB Progress (1): 573/798 kB Progress (2): 573/798 kB | 13 kB Progress (3): 573/798 kB | 13 kB | 16/385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 95 kB/s) 2024-09-14T11:25:53.208 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (2): 573/798 kB | 32/385 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-14T11:25:53.211 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (3): 573/798 kB | 32/385 kB | 16/75 kB Progress (3): 573/798 kB | 49/385 kB | 16/75 kB Progress (3): 573/798 kB | 49/385 kB | 32/75 kB Progress (3): 573/798 kB | 65/385 kB | 32/75 kB Progress (3): 573/798 kB | 65/385 kB | 49/75 kB Progress (3): 573/798 kB | 81/385 kB | 49/75 kB Progress (3): 573/798 kB | 98/385 kB | 49/75 kB Progress (3): 585/798 kB | 98/385 kB | 49/75 kB Progress (3): 601/798 kB | 98/385 kB | 49/75 kB Progress (3): 601/798 kB | 114/385 kB | 49/75 kB Progress (3): 601/798 kB | 114/385 kB | 65/75 kB Progress (3): 617/798 kB | 114/385 kB | 65/75 kB Progress (3): 617/798 kB | 114/385 kB | 75 kB Progress (3): 617/798 kB | 130/385 kB | 75 kB Progress (3): 634/798 kB | 130/385 kB | 75 kB Progress (3): 634/798 kB | 147/385 kB | 75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 525 kB/s) 2024-09-14T11:25:53.211 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (2): 650/798 kB | 147/385 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-14T11:25:53.214 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (2): 650/798 kB | 163/385 kB Progress (2): 667/798 kB | 163/385 kB Progress (2): 683/798 kB | 163/385 kB Progress (2): 683/798 kB | 180/385 kB Progress (2): 699/798 kB | 180/385 kB Progress (2): 699/798 kB | 196/385 kB Progress (2): 716/798 kB | 196/385 kB Progress (2): 716/798 kB | 212/385 kB Progress (2): 732/798 kB | 212/385 kB Progress (2): 749/798 kB | 212/385 kB Progress (2): 749/798 kB | 229/385 kB Progress (2): 765/798 kB | 229/385 kB Progress (2): 765/798 kB | 245/385 kB Progress (2): 781/798 kB | 245/385 kB Progress (2): 798/798 kB | 245/385 kB Progress (2): 798 kB | 245/385 kB Progress (2): 798 kB | 262/385 kB Progress (2): 798 kB | 278/385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 5.4 MB/s) 2024-09-14T11:25:53.214 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-14T11:25:53.221 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 294/385 kB Progress (1): 311/385 kB Progress (2): 311/385 kB | 16/780 kB Progress (2): 311/385 kB | 33/780 kB Progress (2): 311/385 kB | 49/780 kB Progress (2): 311/385 kB | 66/780 kB Progress (2): 311/385 kB | 82/780 kB Progress (2): 311/385 kB | 98/780 kB Progress (2): 311/385 kB | 115/780 kB Progress (2): 327/385 kB | 115/780 kB Progress (2): 327/385 kB | 131/780 kB Progress (2): 343/385 kB | 131/780 kB Progress (2): 343/385 kB | 147/780 kB Progress (2): 360/385 kB | 147/780 kB Progress (2): 360/385 kB | 164/780 kB Progress (2): 360/385 kB | 180/780 kB Progress (2): 376/385 kB | 180/780 kB Progress (2): 376/385 kB | 197/780 kB Progress (2): 385 kB | 197/780 kB Progress (2): 385 kB | 213/780 kB Progress (2): 385 kB | 229/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 2.5 MB/s) 2024-09-14T11:25:53.221 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-14T11:25:53.228 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 246/780 kB Progress (1): 256/780 kB Progress (2): 256/780 kB | 16/329 kB Progress (2): 256/780 kB | 33/329 kB Progress (2): 256/780 kB | 49/329 kB Progress (2): 256/780 kB | 64/329 kB Progress (2): 256/780 kB | 81/329 kB Progress (2): 256/780 kB | 97/329 kB Progress (2): 256/780 kB | 113/329 kB Progress (2): 256/780 kB | 130/329 kB Progress (2): 256/780 kB | 146/329 kB Progress (2): 256/780 kB | 162/329 kB Progress (2): 256/780 kB | 179/329 kB Progress (2): 256/780 kB | 195/329 kB Progress (2): 256/780 kB | 212/329 kB Progress (2): 256/780 kB | 228/329 kB Progress (2): 256/780 kB | 244/329 kB Progress (2): 256/780 kB | 261/329 kB Progress (2): 256/780 kB | 277/329 kB Progress (2): 256/780 kB | 294/329 kB Progress (2): 256/780 kB | 310/329 kB Progress (2): 256/780 kB | 326/329 kB Progress (2): 256/780 kB | 329 kB Progress (2): 272/780 kB | 329 kB Progress (2): 289/780 kB | 329 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 2.1 MB/s) 2024-09-14T11:25:53.228 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-14T11:25:53.237 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (2): 289/780 kB | 16/354 kB Progress (2): 305/780 kB | 16/354 kB Progress (2): 305/780 kB | 33/354 kB Progress (2): 321/780 kB | 33/354 kB Progress (2): 321/780 kB | 49/354 kB Progress (2): 321/780 kB | 63/354 kB Progress (2): 338/780 kB | 63/354 kB Progress (2): 338/780 kB | 79/354 kB Progress (2): 354/780 kB | 79/354 kB Progress (2): 354/780 kB | 96/354 kB Progress (2): 370/780 kB | 96/354 kB Progress (3): 370/780 kB | 96/354 kB | 16/501 kB Progress (3): 370/780 kB | 112/354 kB | 16/501 kB Progress (3): 387/780 kB | 112/354 kB | 16/501 kB Progress (3): 387/780 kB | 112/354 kB | 32/501 kB Progress (3): 387/780 kB | 129/354 kB | 32/501 kB Progress (3): 403/780 kB | 129/354 kB | 32/501 kB Progress (3): 403/780 kB | 129/354 kB | 49/501 kB Progress (3): 403/780 kB | 145/354 kB | 49/501 kB Progress (3): 420/780 kB | 145/354 kB | 49/501 kB Progress (3): 420/780 kB | 145/354 kB | 65/501 kB Progress (3): 420/780 kB | 161/354 kB | 65/501 kB Progress (3): 436/780 kB | 161/354 kB | 65/501 kB Progress (3): 436/780 kB | 161/354 kB | 81/501 kB Progress (3): 436/780 kB | 178/354 kB | 81/501 kB Progress (3): 452/780 kB | 178/354 kB | 81/501 kB Progress (3): 452/780 kB | 194/354 kB | 81/501 kB Progress (3): 452/780 kB | 194/354 kB | 98/501 kB Progress (3): 469/780 kB | 194/354 kB | 98/501 kB Progress (3): 469/780 kB | 210/354 kB | 98/501 kB Progress (3): 469/780 kB | 210/354 kB | 114/501 kB Progress (3): 485/780 kB | 210/354 kB | 114/501 kB Progress (3): 485/780 kB | 227/354 kB | 114/501 kB Progress (3): 485/780 kB | 227/354 kB | 130/501 kB Progress (3): 502/780 kB | 227/354 kB | 130/501 kB Progress (3): 502/780 kB | 243/354 kB | 130/501 kB Progress (3): 502/780 kB | 243/354 kB | 147/501 kB Progress (3): 518/780 kB | 243/354 kB | 147/501 kB Progress (3): 518/780 kB | 260/354 kB | 147/501 kB Progress (3): 534/780 kB | 260/354 kB | 147/501 kB Progress (4): 534/780 kB | 260/354 kB | 147/501 kB | 16/41 kB Progress (4): 534/780 kB | 276/354 kB | 147/501 kB | 16/41 kB Progress (4): 551/780 kB | 276/354 kB | 147/501 kB | 16/41 kB Progress (4): 551/780 kB | 276/354 kB | 147/501 kB | 33/41 kB Progress (4): 551/780 kB | 292/354 kB | 147/501 kB | 33/41 kB Progress (4): 567/780 kB | 292/354 kB | 147/501 kB | 33/41 kB Progress (4): 567/780 kB | 292/354 kB | 147/501 kB | 41 kB Progress (4): 567/780 kB | 309/354 kB | 147/501 kB | 41 kB Progress (4): 583/780 kB | 309/354 kB | 147/501 kB | 41 kB Progress (4): 583/780 kB | 325/354 kB | 147/501 kB | 41 kB Progress (4): 600/780 kB | 325/354 kB | 147/501 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 245 kB/s) 2024-09-14T11:25:53.237 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-14T11:25:53.238 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (3): 600/780 kB | 342/354 kB | 147/501 kB Progress (3): 616/780 kB | 342/354 kB | 147/501 kB Progress (3): 616/780 kB | 354 kB | 147/501 kB Progress (3): 633/780 kB | 354 kB | 147/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.1 MB/s) 2024-09-14T11:25:53.239 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-14T11:25:53.242 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (2): 649/780 kB | 147/501 kB Progress (2): 665/780 kB | 147/501 kB Progress (2): 682/780 kB | 147/501 kB Progress (2): 698/780 kB | 147/501 kB Progress (2): 698/780 kB | 163/501 kB Progress (3): 698/780 kB | 163/501 kB | 6.4 kB Progress (3): 715/780 kB | 163/501 kB | 6.4 kB Progress (3): 715/780 kB | 180/501 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 37 kB/s) 2024-09-14T11:25:53.242 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (2): 731/780 kB | 180/501 kB Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-14T11:25:53.244 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (2): 731/780 kB | 196/501 kB Progress (2): 747/780 kB | 196/501 kB Progress (2): 747/780 kB | 212/501 kB Progress (2): 764/780 kB | 212/501 kB Progress (2): 764/780 kB | 229/501 kB Progress (2): 780/780 kB | 229/501 kB Progress (2): 780/780 kB | 245/501 kB Progress (2): 780 kB | 245/501 kB Progress (2): 780 kB | 262/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 4.4 MB/s) 2024-09-14T11:25:53.244 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-14T11:25:53.255 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 278/501 kB Progress (1): 294/501 kB Progress (1): 311/501 kB Progress (1): 327/501 kB Progress (1): 343/501 kB Progress (1): 360/501 kB Progress (1): 376/501 kB Progress (1): 393/501 kB Progress (1): 402/501 kB Progress (1): 418/501 kB Progress (1): 435/501 kB Progress (1): 451/501 kB Progress (2): 451/501 kB | 16/586 kB Progress (2): 468/501 kB | 16/586 kB Progress (2): 468/501 kB | 33/586 kB Progress (2): 484/501 kB | 33/586 kB Progress (2): 484/501 kB | 49/586 kB Progress (3): 484/501 kB | 49/586 kB | 16/211 kB Progress (3): 500/501 kB | 49/586 kB | 16/211 kB Progress (3): 501 kB | 49/586 kB | 16/211 kB Progress (3): 501 kB | 66/586 kB | 16/211 kB Progress (3): 501 kB | 66/586 kB | 33/211 kB Progress (3): 501 kB | 66/586 kB | 49/211 kB Progress (3): 501 kB | 82/586 kB | 49/211 kB Progress (3): 501 kB | 82/586 kB | 66/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 2.7 MB/s) 2024-09-14T11:25:53.255 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (2): 98/586 kB | 66/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-14T11:25:53.256 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (2): 98/586 kB | 82/211 kB Progress (2): 115/586 kB | 82/211 kB Progress (2): 115/586 kB | 98/211 kB Progress (2): 131/586 kB | 98/211 kB Progress (2): 131/586 kB | 115/211 kB Progress (2): 147/586 kB | 115/211 kB Progress (3): 147/586 kB | 115/211 kB | 14 kB Progress (3): 147/586 kB | 131/211 kB | 14 kB Progress (3): 164/586 kB | 131/211 kB | 14 kB Progress (3): 164/586 kB | 147/211 kB | 14 kB Progress (3): 180/586 kB | 147/211 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 76 kB/s) 2024-09-14T11:25:53.257 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-14T11:25:53.258 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (2): 180/586 kB | 164/211 kB Progress (2): 197/586 kB | 164/211 kB Progress (2): 197/586 kB | 180/211 kB Progress (2): 213/586 kB | 180/211 kB Progress (2): 213/586 kB | 197/211 kB Progress (2): 229/586 kB | 197/211 kB Progress (2): 229/586 kB | 211 kB Progress (3): 229/586 kB | 211 kB | 16/106 kB Progress (3): 246/586 kB | 211 kB | 16/106 kB Progress (3): 246/586 kB | 211 kB | 33/106 kB Progress (3): 256/586 kB | 211 kB | 33/106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.1 MB/s) 2024-09-14T11:25:53.258 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-14T11:25:53.260 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (2): 256/586 kB | 49/106 kB Progress (2): 272/586 kB | 49/106 kB Progress (2): 289/586 kB | 49/106 kB Progress (2): 289/586 kB | 66/106 kB Progress (2): 305/586 kB | 66/106 kB Progress (2): 305/586 kB | 82/106 kB Progress (2): 305/586 kB | 98/106 kB Progress (2): 321/586 kB | 98/106 kB Progress (2): 321/586 kB | 106 kB Progress (2): 338/586 kB | 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 556 kB/s) 2024-09-14T11:25:53.260 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 354/586 kB Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-14T11:25:53.265 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 370/586 kB Progress (1): 387/586 kB Progress (1): 403/586 kB Progress (1): 420/586 kB Progress (1): 436/586 kB Progress (1): 452/586 kB Progress (1): 469/586 kB Progress (1): 485/586 kB Progress (1): 502/586 kB Progress (1): 518/586 kB Progress (1): 534/586 kB Progress (1): 551/586 kB Progress (1): 567/586 kB Progress (1): 583/586 kB Progress (1): 586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 3.0 MB/s) 2024-09-14T11:25:53.265 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-14T11:25:53.269 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 34 kB/s) 2024-09-14T11:25:53.269 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-14T11:25:53.274 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/245 kB Progress (1): 33/245 kB Progress (1): 49/245 kB Progress (1): 66/245 kB Progress (1): 82/245 kB Progress (1): 98/245 kB Progress (1): 115/245 kB Progress (2): 115/245 kB | 16/205 kB Progress (2): 131/245 kB | 16/205 kB Progress (2): 131/245 kB | 32/205 kB Progress (2): 147/245 kB | 32/205 kB Progress (2): 147/245 kB | 49/205 kB Progress (2): 164/245 kB | 49/205 kB Progress (2): 180/245 kB | 49/205 kB Progress (2): 180/245 kB | 65/205 kB Progress (3): 180/245 kB | 65/205 kB | 15 kB Progress (3): 197/245 kB | 65/205 kB | 15 kB Progress (3): 197/245 kB | 81/205 kB | 15 kB Progress (3): 213/245 kB | 81/205 kB | 15 kB Progress (3): 213/245 kB | 98/205 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 75 kB/s) 2024-09-14T11:25:53.274 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-14T11:25:53.275 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (2): 229/245 kB | 98/205 kB Progress (2): 229/245 kB | 114/205 kB Progress (2): 245 kB | 114/205 kB Progress (2): 245 kB | 131/205 kB Progress (2): 245 kB | 147/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.2 MB/s) 2024-09-14T11:25:53.276 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 163/205 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-14T11:25:53.277 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 180/205 kB Progress (1): 196/205 kB Progress (1): 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 989 kB/s) 2024-09-14T11:25:53.277 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-14T11:25:53.279 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 79 kB/s) 2024-09-14T11:25:53.279 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-14T11:25:53.292 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 29 kB/s) 2024-09-14T11:25:53.294 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/24 kB Progress (2): 16/24 kB | 16/17 kB Progress (3): 16/24 kB | 16/17 kB | 16/23 kB Progress (3): 16/24 kB | 17 kB | 16/23 kB Progress (3): 24 kB | 17 kB | 16/23 kB Progress (3): 24 kB | 17 kB | 23 kB Progress (4): 24 kB | 17 kB | 23 kB | 16/184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 101 kB/s) 2024-09-14T11:25:53.294 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (3): 24 kB | 17 kB | 33/184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 77 kB/s) 2024-09-14T11:25:53.294 INFO:tasks.workunit.client.0.smithi071.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 108 kB/s) 2024-09-14T11:25:53.298 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 49/184 kB Progress (1): 66/184 kB Progress (1): 82/184 kB Progress (1): 98/184 kB Progress (1): 115/184 kB Progress (1): 131/184 kB Progress (1): 147/184 kB Progress (1): 164/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 806 kB/s) 2024-09-14T11:25:53.317 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] 2024-09-14T11:25:53.317 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-14T11:25:53.324 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-14T11:25:53.339 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 389 kB/s) 2024-09-14T11:25:53.341 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-14T11:25:53.355 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 364 kB/s) 2024-09-14T11:25:53.357 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-14T11:25:53.371 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.9 MB/s) 2024-09-14T11:25:53.376 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-14T11:25:53.390 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 1.0 MB/s) 2024-09-14T11:25:53.395 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-14T11:25:53.411 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/153 kB Progress (1): 33/153 kB Progress (1): 49/153 kB Progress (1): 64/153 kB Progress (1): 80/153 kB Progress (1): 96/153 kB Progress (1): 113/153 kB Progress (1): 129/153 kB Progress (1): 146/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 9.6 MB/s) 2024-09-14T11:25:53.412 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-14T11:25:53.431 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 65/215 kB Progress (1): 82/215 kB Progress (1): 98/215 kB Progress (1): 114/215 kB Progress (1): 131/215 kB Progress (1): 147/215 kB Progress (1): 163/215 kB Progress (1): 180/215 kB Progress (1): 196/215 kB Progress (1): 213/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 11 MB/s) 2024-09-14T11:25:53.500 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] 2024-09-14T11:25:53.500 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-14T11:25:53.504 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-14T11:25:53.518 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 190 kB/s) 2024-09-14T11:25:53.520 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-14T11:25:53.534 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.6 MB/s) 2024-09-14T11:25:53.537 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-14T11:25:53.551 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 626 kB/s) 2024-09-14T11:25:53.554 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-14T11:25:53.567 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.8 MB/s) 2024-09-14T11:25:53.571 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-14T11:25:53.585 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 431 kB/s) 2024-09-14T11:25:53.587 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-14T11:25:53.601 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 230 kB/s) 2024-09-14T11:25:53.604 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-14T11:25:53.618 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 44 kB/s) 2024-09-14T11:25:53.620 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-14T11:25:53.634 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 196 kB/s) 2024-09-14T11:25:53.636 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-14T11:25:53.650 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 1.0 MB/s) 2024-09-14T11:25:53.653 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-14T11:25:53.667 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 229 kB/s) 2024-09-14T11:25:53.668 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-14T11:25:53.683 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 557 kB/s) 2024-09-14T11:25:53.685 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-14T11:25:53.700 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 558 kB/s) 2024-09-14T11:25:53.702 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-14T11:25:53.716 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 572 kB/s) 2024-09-14T11:25:53.719 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-14T11:25:53.733 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.4 MB/s) 2024-09-14T11:25:53.738 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-14T11:25:53.752 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 364 kB/s) 2024-09-14T11:25:53.754 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-14T11:25:53.768 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 2.2 MB/s) 2024-09-14T11:25:53.773 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-14T11:25:53.786 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 392 kB/s) 2024-09-14T11:25:53.791 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-14T11:25:53.805 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 6.1 MB/s) 2024-09-14T11:25:53.806 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-14T11:25:53.806 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-14T11:25:53.806 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-14T11:25:53.807 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-14T11:25:53.807 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-14T11:25:53.821 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 178 kB/s) 2024-09-14T11:25:53.821 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-14T11:25:53.823 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 8.5 kB Progress (2): 8.5 kB | 16/55 kB Progress (3): 8.5 kB | 16/55 kB | 16/269 kB Progress (4): 8.5 kB | 16/55 kB | 16/269 kB | 16/41 kB Progress (4): 8.5 kB | 32/55 kB | 16/269 kB | 16/41 kB Progress (4): 8.5 kB | 32/55 kB | 33/269 kB | 16/41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 530 kB/s) 2024-09-14T11:25:53.823 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (3): 32/55 kB | 33/269 kB | 33/41 kB Progress (3): 49/55 kB | 33/269 kB | 33/41 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-14T11:25:53.823 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (3): 49/55 kB | 49/269 kB | 33/41 kB Progress (3): 55 kB | 49/269 kB | 33/41 kB Progress (3): 55 kB | 49/269 kB | 41 kB Progress (3): 55 kB | 63/269 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 3.2 MB/s) 2024-09-14T11:25:53.823 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (2): 79/269 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.4 MB/s) 2024-09-14T11:25:53.828 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 96/269 kB Progress (1): 112/269 kB Progress (1): 128/269 kB Progress (1): 145/269 kB Progress (1): 161/269 kB Progress (1): 174/269 kB Progress (1): 190/269 kB Progress (1): 194/269 kB Progress (1): 210/269 kB Progress (1): 227/269 kB Progress (1): 243/269 kB Progress (1): 255/269 kB Progress (1): 260/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 12 MB/s) 2024-09-14T11:25:53.841 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/327 kB Progress (1): 33/327 kB Progress (2): 33/327 kB | 16/587 kB Progress (2): 49/327 kB | 16/587 kB Progress (2): 66/327 kB | 16/587 kB Progress (2): 66/327 kB | 33/587 kB Progress (2): 82/327 kB | 33/587 kB Progress (2): 98/327 kB | 33/587 kB Progress (2): 98/327 kB | 49/587 kB Progress (2): 115/327 kB | 49/587 kB Progress (2): 131/327 kB | 49/587 kB Progress (2): 131/327 kB | 64/587 kB Progress (2): 147/327 kB | 64/587 kB Progress (2): 164/327 kB | 64/587 kB Progress (2): 164/327 kB | 80/587 kB Progress (2): 180/327 kB | 80/587 kB Progress (2): 180/327 kB | 96/587 kB Progress (2): 197/327 kB | 96/587 kB Progress (2): 213/327 kB | 96/587 kB Progress (2): 213/327 kB | 113/587 kB Progress (2): 229/327 kB | 113/587 kB Progress (2): 246/327 kB | 113/587 kB Progress (2): 246/327 kB | 129/587 kB Progress (2): 262/327 kB | 129/587 kB Progress (2): 279/327 kB | 129/587 kB Progress (2): 279/327 kB | 145/587 kB Progress (2): 295/327 kB | 145/587 kB Progress (2): 311/327 kB | 145/587 kB Progress (2): 311/327 kB | 162/587 kB Progress (2): 327 kB | 162/587 kB Progress (2): 327 kB | 178/587 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 9.6 MB/s) 2024-09-14T11:25:53.849 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 195/587 kB Progress (1): 211/587 kB Progress (1): 227/587 kB Progress (1): 244/587 kB Progress (1): 260/587 kB Progress (1): 277/587 kB Progress (1): 293/587 kB Progress (1): 309/587 kB Progress (1): 326/587 kB Progress (1): 342/587 kB Progress (1): 358/587 kB Progress (1): 375/587 kB Progress (1): 391/587 kB Progress (1): 408/587 kB Progress (1): 424/587 kB Progress (1): 440/587 kB Progress (1): 457/587 kB Progress (1): 473/587 kB Progress (1): 490/587 kB Progress (1): 506/587 kB Progress (1): 522/587 kB Progress (1): 539/587 kB Progress (1): 555/587 kB Progress (1): 571/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 14 MB/s) 2024-09-14T11:25:53.908 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-14T11:25:53.908 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] 2024-09-14T11:25:53.909 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-14T11:25:53.916 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-14T11:25:53.931 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 316 kB/s) 2024-09-14T11:25:53.934 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-14T11:25:53.949 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 424 kB/s) 2024-09-14T11:25:53.952 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-14T11:25:53.966 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.3 MB/s) 2024-09-14T11:25:53.970 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-14T11:25:53.984 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 932 kB/s) 2024-09-14T11:25:53.989 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-14T11:25:54.004 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 54 kB/s) 2024-09-14T11:25:54.007 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-14T11:25:54.022 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 283 kB/s) 2024-09-14T11:25:54.024 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-14T11:25:54.039 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.2 MB/s) 2024-09-14T11:25:54.043 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-14T11:25:54.058 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 331 kB/s) 2024-09-14T11:25:54.060 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-14T11:25:54.075 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 276 kB/s) 2024-09-14T11:25:54.079 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-14T11:25:54.094 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 158 kB/s) 2024-09-14T11:25:54.096 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-14T11:25:54.111 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 753 kB/s) 2024-09-14T11:25:54.115 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-14T11:25:54.130 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.1 MB/s) 2024-09-14T11:25:54.134 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-14T11:25:54.148 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 469 kB/s) 2024-09-14T11:25:54.153 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-14T11:25:54.169 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 66 kB/s) 2024-09-14T11:25:54.174 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-14T11:25:54.191 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 493 kB/s) 2024-09-14T11:25:54.197 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-14T11:25:54.214 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 158 kB/s) 2024-09-14T11:25:54.220 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-14T11:25:54.235 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 375 kB/s) 2024-09-14T11:25:54.241 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-14T11:25:54.258 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 67 kB/s) 2024-09-14T11:25:54.266 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-14T11:25:54.282 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 48 kB/s) 2024-09-14T11:25:54.285 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-14T11:25:54.301 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 377 kB/s) 2024-09-14T11:25:54.305 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-14T11:25:54.322 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.5 MB/s) 2024-09-14T11:25:54.329 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-14T11:25:54.345 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 80 kB/s) 2024-09-14T11:25:54.348 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-14T11:25:54.364 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 83 kB/s) 2024-09-14T11:25:54.378 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-14T11:25:54.394 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 846 kB/s) 2024-09-14T11:25:54.394 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-14T11:25:54.395 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-14T11:25:54.395 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-14T11:25:54.395 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-14T11:25:54.396 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-14T11:25:54.412 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 4.2 kB Progress (2): 4.2 kB | 16/55 kB Progress (2): 4.2 kB | 33/55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 281 kB/s) 2024-09-14T11:25:54.413 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (2): 33/55 kB | 16/334 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-14T11:25:54.413 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (2): 49/55 kB | 16/334 kB Progress (3): 49/55 kB | 16/334 kB | 16/122 kB Progress (3): 55 kB | 16/334 kB | 16/122 kB Progress (3): 55 kB | 33/334 kB | 16/122 kB Progress (3): 55 kB | 37/334 kB | 16/122 kB Progress (4): 55 kB | 37/334 kB | 16/122 kB | 16/27 kB Progress (4): 55 kB | 37/334 kB | 32/122 kB | 16/27 kB Progress (4): 55 kB | 53/334 kB | 32/122 kB | 16/27 kB Progress (4): 55 kB | 53/334 kB | 32/122 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.4 MB/s) 2024-09-14T11:25:54.413 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (3): 53/334 kB | 49/122 kB | 27 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-14T11:25:54.413 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (3): 69/334 kB | 49/122 kB | 27 kB Progress (3): 69/334 kB | 65/122 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.7 MB/s) 2024-09-14T11:25:54.413 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (2): 86/334 kB | 65/122 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-14T11:25:54.413 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (2): 86/334 kB | 81/122 kB Progress (2): 102/334 kB | 81/122 kB Progress (2): 102/334 kB | 98/122 kB Progress (2): 118/334 kB | 98/122 kB Progress (2): 118/334 kB | 114/122 kB Progress (2): 118/334 kB | 122 kB Progress (2): 135/334 kB | 122 kB Progress (2): 151/334 kB | 122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 6.8 MB/s) 2024-09-14T11:25:54.416 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 168/334 kB Progress (1): 184/334 kB Progress (1): 200/334 kB Progress (1): 217/334 kB Progress (1): 233/334 kB Progress (1): 250/334 kB Progress (1): 266/334 kB Progress (1): 282/334 kB Progress (1): 299/334 kB Progress (1): 315/334 kB Progress (1): 331/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 16 MB/s) 2024-09-14T11:25:54.425 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/267 kB Progress (1): 33/267 kB Progress (2): 33/267 kB | 4.7 kB Progress (2): 49/267 kB | 4.7 kB Progress (3): 49/267 kB | 4.7 kB | 16/23 kB Progress (3): 66/267 kB | 4.7 kB | 16/23 kB Progress (3): 66/267 kB | 4.7 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 161 kB/s) 2024-09-14T11:25:54.426 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (2): 82/267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 786 kB/s) 2024-09-14T11:25:54.429 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 98/267 kB Progress (1): 115/267 kB Progress (1): 131/267 kB Progress (1): 147/267 kB Progress (1): 164/267 kB Progress (1): 180/267 kB Progress (1): 197/267 kB Progress (1): 213/267 kB Progress (1): 229/267 kB Progress (1): 246/267 kB Progress (1): 256/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 8.1 MB/s) 2024-09-14T11:25:54.555 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-14T11:25:54.557 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-14T11:25:55.791 INFO:tasks.workunit.client.0.smithi071.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-14T11:25:55.791 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] 2024-09-14T11:25:55.791 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-14T11:25:55.796 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-14T11:25:55.796 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] 2024-09-14T11:25:55.796 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-14T11:25:55.803 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-14T11:25:55.803 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-14T11:25:56.038 INFO:tasks.workunit.client.0.smithi071.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-14T11:25:56.038 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] 2024-09-14T11:25:56.038 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-14T11:25:56.044 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-14T11:25:56.060 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 390 kB/s) 2024-09-14T11:25:56.063 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-14T11:25:56.077 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 235 kB/s) 2024-09-14T11:25:56.083 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-14T11:25:56.098 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 217 kB/s) 2024-09-14T11:25:56.103 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-14T11:25:56.118 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 271 kB/s) 2024-09-14T11:25:56.123 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-14T11:25:56.138 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 220 kB/s) 2024-09-14T11:25:56.143 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-14T11:25:56.157 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 297 kB/s) 2024-09-14T11:25:56.162 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-14T11:25:56.176 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 126 kB/s) 2024-09-14T11:25:56.180 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-14T11:25:56.194 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 157 kB/s) 2024-09-14T11:25:56.196 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-14T11:25:56.211 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 2.0 MB/s) 2024-09-14T11:25:56.214 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-14T11:25:56.228 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 135 kB/s) 2024-09-14T11:25:56.231 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-14T11:25:56.246 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 387 kB/s) 2024-09-14T11:25:56.249 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-14T11:25:56.264 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 157 kB/s) 2024-09-14T11:25:56.266 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-14T11:25:56.282 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.4 MB/s) 2024-09-14T11:25:56.284 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-14T11:25:56.299 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.5 MB/s) 2024-09-14T11:25:56.302 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-14T11:25:56.316 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.1 MB/s) 2024-09-14T11:25:56.319 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-14T11:25:56.335 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 541 kB/s) 2024-09-14T11:25:56.337 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-14T11:25:56.352 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 1.8 MB/s) 2024-09-14T11:25:56.356 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-14T11:25:56.371 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 538 kB/s) 2024-09-14T11:25:56.375 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-14T11:25:56.390 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 145 kB/s) 2024-09-14T11:25:56.393 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-14T11:25:56.408 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 173 kB/s) 2024-09-14T11:25:56.411 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-14T11:25:56.425 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 110 kB/s) 2024-09-14T11:25:56.427 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-14T11:25:56.441 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 219 kB/s) 2024-09-14T11:25:56.442 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-14T11:25:56.456 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.5 MB/s) 2024-09-14T11:25:56.458 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-14T11:25:56.471 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 520 kB/s) 2024-09-14T11:25:56.473 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-14T11:25:56.487 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 969 kB/s) 2024-09-14T11:25:56.491 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-14T11:25:56.505 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 212 kB/s) 2024-09-14T11:25:56.506 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-14T11:25:56.521 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 453 kB/s) 2024-09-14T11:25:56.523 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-14T11:25:56.537 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 600 kB/s) 2024-09-14T11:25:56.540 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-14T11:25:56.554 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 148 kB/s) 2024-09-14T11:25:56.557 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-14T11:25:56.570 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 159 kB/s) 2024-09-14T11:25:56.573 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-14T11:25:56.588 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 202 kB/s) 2024-09-14T11:25:56.592 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-14T11:25:56.606 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 1.1 MB/s) 2024-09-14T11:25:56.608 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-14T11:25:56.622 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 1.0 MB/s) 2024-09-14T11:25:56.625 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-14T11:25:56.640 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 895 kB/s) 2024-09-14T11:25:56.642 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-14T11:25:56.656 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 342 kB/s) 2024-09-14T11:25:56.658 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-14T11:25:56.672 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 448 kB/s) 2024-09-14T11:25:56.674 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-14T11:25:56.688 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/32 kB Progress (1): 32/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 2.2 MB/s) 2024-09-14T11:25:56.690 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-14T11:25:56.705 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.2 MB/s) 2024-09-14T11:25:56.706 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-14T11:25:56.720 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 1.1 MB/s) 2024-09-14T11:25:56.724 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-14T11:25:56.738 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 54 kB/s) 2024-09-14T11:25:56.740 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-14T11:25:56.754 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 343 kB/s) 2024-09-14T11:25:56.757 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-14T11:25:56.771 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 527 kB/s) 2024-09-14T11:25:56.774 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-14T11:25:56.788 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 214 kB/s) 2024-09-14T11:25:56.791 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-14T11:25:56.805 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 304 kB/s) 2024-09-14T11:25:56.807 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-14T11:25:56.821 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 147 kB/s) 2024-09-14T11:25:56.823 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-14T11:25:56.837 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 248 kB/s) 2024-09-14T11:25:56.840 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-14T11:25:56.854 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 729 kB/s) 2024-09-14T11:25:56.855 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-14T11:25:56.870 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 898 kB/s) 2024-09-14T11:25:56.874 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-14T11:25:56.889 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.2 MB/s) 2024-09-14T11:25:56.895 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-14T11:25:56.910 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 23 kB/s) 2024-09-14T11:25:56.914 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-14T11:25:56.929 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 407 kB/s) 2024-09-14T11:25:56.932 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-14T11:25:56.948 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 458 kB/s) 2024-09-14T11:25:56.951 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-14T11:25:56.966 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 322 kB/s) 2024-09-14T11:25:56.972 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-14T11:25:56.988 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 457 kB/s) 2024-09-14T11:25:56.994 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-14T11:25:57.010 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.4 MB/s) 2024-09-14T11:25:57.014 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-14T11:25:57.035 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 3.7 MB/s) 2024-09-14T11:25:57.042 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-14T11:25:57.057 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.5 MB/s) 2024-09-14T11:25:57.063 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-14T11:25:57.078 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 377 kB/s) 2024-09-14T11:25:57.082 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-14T11:25:57.097 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 285 kB/s) 2024-09-14T11:25:57.100 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-14T11:25:57.115 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 213 kB/s) 2024-09-14T11:25:57.118 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-14T11:25:57.135 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.6 MB/s) 2024-09-14T11:25:57.141 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-14T11:25:57.157 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 158 kB/s) 2024-09-14T11:25:57.172 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-14T11:25:57.206 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 66/308 kB Progress (1): 82/308 kB Progress (1): 98/308 kB Progress (1): 115/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 164/308 kB Progress (1): 180/308 kB Progress (1): 197/308 kB Progress (1): 213/308 kB Progress (1): 229/308 kB Progress (1): 246/308 kB Progress (1): 256/308 kB Progress (1): 272/308 kB Progress (1): 289/308 kB Progress (1): 305/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 8.8 MB/s) 2024-09-14T11:25:57.207 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-14T11:25:57.208 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-14T11:25:57.208 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-14T11:25:57.209 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-14T11:25:57.209 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-14T11:25:57.224 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/171 kB Progress (1): 33/171 kB Progress (1): 49/171 kB Progress (2): 49/171 kB | 14 kB Progress (2): 66/171 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 799 kB/s) 2024-09-14T11:25:57.224 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-14T11:25:57.226 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 82/171 kB Progress (2): 82/171 kB | 16/118 kB Progress (3): 82/171 kB | 16/118 kB | 8.2 kB Progress (3): 98/171 kB | 16/118 kB | 8.2 kB Progress (3): 98/171 kB | 32/118 kB | 8.2 kB Progress (3): 115/171 kB | 32/118 kB | 8.2 kB Progress (3): 115/171 kB | 49/118 kB | 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 454 kB/s) 2024-09-14T11:25:57.226 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (2): 131/171 kB | 49/118 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-14T11:25:57.228 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (2): 131/171 kB | 65/118 kB Progress (3): 131/171 kB | 65/118 kB | 16/26 kB Progress (3): 147/171 kB | 65/118 kB | 16/26 kB Progress (3): 147/171 kB | 81/118 kB | 16/26 kB Progress (3): 147/171 kB | 81/118 kB | 26 kB Progress (3): 164/171 kB | 81/118 kB | 26 kB Progress (3): 164/171 kB | 98/118 kB | 26 kB Progress (3): 171 kB | 98/118 kB | 26 kB Progress (3): 171 kB | 114/118 kB | 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.3 MB/s) 2024-09-14T11:25:57.228 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-14T11:25:57.229 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (2): 171 kB | 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 8.1 MB/s) 2024-09-14T11:25:57.229 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-14T11:25:57.229 INFO:tasks.workunit.client.0.smithi071.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 5.6 MB/s) 2024-09-14T11:25:57.229 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-14T11:25:57.241 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/146 kB Progress (1): 33/146 kB Progress (1): 49/146 kB Progress (1): 66/146 kB Progress (1): 82/146 kB Progress (1): 98/146 kB Progress (1): 115/146 kB Progress (1): 131/146 kB Progress (1): 146 kB Progress (2): 146 kB | 16/136 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 4.6 MB/s) 2024-09-14T11:25:57.241 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-14T11:25:57.244 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 33/136 kB Progress (1): 49/136 kB Progress (2): 49/136 kB | 16/61 kB Progress (2): 66/136 kB | 16/61 kB Progress (2): 66/136 kB | 33/61 kB Progress (2): 82/136 kB | 33/61 kB Progress (2): 82/136 kB | 49/61 kB Progress (3): 82/136 kB | 49/61 kB | 16/58 kB Progress (3): 82/136 kB | 61 kB | 16/58 kB Progress (3): 98/136 kB | 61 kB | 16/58 kB Progress (3): 98/136 kB | 61 kB | 32/58 kB Progress (4): 98/136 kB | 61 kB | 32/58 kB | 16/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.8 MB/s) 2024-09-14T11:25:57.244 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-14T11:25:57.245 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (3): 115/136 kB | 32/58 kB | 16/501 kB Progress (3): 115/136 kB | 49/58 kB | 16/501 kB Progress (3): 115/136 kB | 49/58 kB | 33/501 kB Progress (3): 115/136 kB | 58 kB | 33/501 kB Progress (3): 131/136 kB | 58 kB | 33/501 kB Progress (3): 131/136 kB | 58 kB | 49/501 kB Progress (3): 136 kB | 58 kB | 49/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.6 MB/s) 2024-09-14T11:25:57.246 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (2): 136 kB | 66/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 3.8 MB/s) 2024-09-14T11:25:57.255 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 82/501 kB Progress (1): 98/501 kB Progress (1): 115/501 kB Progress (1): 131/501 kB Progress (1): 147/501 kB Progress (1): 164/501 kB Progress (1): 180/501 kB Progress (1): 197/501 kB Progress (1): 213/501 kB Progress (1): 229/501 kB Progress (1): 246/501 kB Progress (1): 256/501 kB Progress (1): 272/501 kB Progress (1): 289/501 kB Progress (1): 305/501 kB Progress (1): 321/501 kB Progress (1): 338/501 kB Progress (1): 354/501 kB Progress (1): 370/501 kB Progress (1): 387/501 kB Progress (1): 403/501 kB Progress (1): 420/501 kB Progress (1): 436/501 kB Progress (1): 452/501 kB Progress (1): 469/501 kB Progress (1): 485/501 kB Progress (1): 501 kB Progress (2): 501 kB | 16/124 kB Progress (2): 501 kB | 33/124 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 11 MB/s) 2024-09-14T11:25:57.256 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 49/124 kB Progress (1): 66/124 kB Progress (1): 82/124 kB Progress (1): 98/124 kB Progress (1): 115/124 kB Progress (1): 124 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.7 MB/s) 2024-09-14T11:25:57.310 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 24 MB/s) 2024-09-14T11:25:57.406 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] 2024-09-14T11:25:57.407 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-14T11:25:57.411 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-14T11:25:57.425 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 320 kB/s) 2024-09-14T11:25:57.427 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-14T11:25:57.441 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 350 kB/s) 2024-09-14T11:25:57.444 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-14T11:25:57.459 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 3.2 MB/s) 2024-09-14T11:25:57.462 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-14T11:25:57.476 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.5 MB/s) 2024-09-14T11:25:57.481 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-14T11:25:57.495 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 345 kB/s) 2024-09-14T11:25:57.498 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-14T11:25:57.512 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 280 kB/s) 2024-09-14T11:25:57.516 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-14T11:25:57.530 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 430 kB/s) 2024-09-14T11:25:57.534 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-14T11:25:57.548 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 447 kB/s) 2024-09-14T11:25:57.551 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-14T11:25:57.565 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.4 MB/s) 2024-09-14T11:25:57.570 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-14T11:25:57.584 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 1.0 MB/s) 2024-09-14T11:25:57.587 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-14T11:25:57.601 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 146 kB/s) 2024-09-14T11:25:57.604 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-14T11:25:57.618 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 587 kB/s) 2024-09-14T11:25:57.620 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-14T11:25:57.635 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.7 MB/s) 2024-09-14T11:25:57.642 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-14T11:25:57.657 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.4 MB/s) 2024-09-14T11:25:57.657 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-14T11:25:57.657 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-14T11:25:57.658 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-14T11:25:57.658 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-14T11:25:57.658 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-14T11:25:57.674 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/26 kB Progress (2): 16/26 kB | 16/58 kB Progress (3): 16/26 kB | 16/58 kB | 16/79 kB Progress (3): 26 kB | 16/58 kB | 16/79 kB Progress (3): 26 kB | 33/58 kB | 16/79 kB Progress (4): 26 kB | 33/58 kB | 16/79 kB | 16/211 kB Progress (4): 26 kB | 33/58 kB | 33/79 kB | 16/211 kB Progress (4): 26 kB | 49/58 kB | 33/79 kB | 16/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.6 MB/s) 2024-09-14T11:25:57.674 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (4): 49/58 kB | 33/79 kB | 16/211 kB | 0/1.0 MB Progress (4): 58 kB | 33/79 kB | 16/211 kB | 0/1.0 MB Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-14T11:25:57.674 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (4): 58 kB | 33/79 kB | 33/211 kB | 0/1.0 MB Progress (4): 58 kB | 49/79 kB | 33/211 kB | 0/1.0 MB Progress (4): 58 kB | 49/79 kB | 33/211 kB | 0/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.4 MB/s) 2024-09-14T11:25:57.674 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (3): 49/79 kB | 49/211 kB | 0/1.0 MB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-14T11:25:57.675 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (3): 49/79 kB | 49/211 kB | 0/1.0 MB Progress (3): 66/79 kB | 49/211 kB | 0/1.0 MB Progress (3): 66/79 kB | 66/211 kB | 0/1.0 MB Progress (3): 66/79 kB | 66/211 kB | 0.1/1.0 MB Progress (3): 79 kB | 66/211 kB | 0.1/1.0 MB Progress (3): 79 kB | 82/211 kB | 0.1/1.0 MB Progress (3): 79 kB | 82/211 kB | 0.1/1.0 MB Progress (3): 79 kB | 98/211 kB | 0.1/1.0 MB Progress (3): 79 kB | 98/211 kB | 0.1/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 4.4 MB/s) 2024-09-14T11:25:57.678 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (2): 115/211 kB | 0.1/1.0 MB Progress (2): 115/211 kB | 0.1/1.0 MB Progress (2): 131/211 kB | 0.1/1.0 MB Progress (2): 131/211 kB | 0.1/1.0 MB Progress (2): 147/211 kB | 0.1/1.0 MB Progress (2): 147/211 kB | 0.1/1.0 MB Progress (2): 164/211 kB | 0.1/1.0 MB Progress (2): 164/211 kB | 0.2/1.0 MB Progress (2): 180/211 kB | 0.2/1.0 MB Progress (2): 180/211 kB | 0.2/1.0 MB Progress (2): 197/211 kB | 0.2/1.0 MB Progress (2): 197/211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 10 MB/s) 2024-09-14T11:25:57.689 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (2): 0.6/1.0 MB | 16/116 kB Progress (2): 0.6/1.0 MB | 16/116 kB Progress (2): 0.6/1.0 MB | 33/116 kB Progress (2): 0.6/1.0 MB | 33/116 kB Progress (2): 0.6/1.0 MB | 49/116 kB Progress (2): 0.6/1.0 MB | 49/116 kB Progress (2): 0.6/1.0 MB | 66/116 kB Progress (3): 0.6/1.0 MB | 66/116 kB | 16/267 kB Progress (3): 0.6/1.0 MB | 82/116 kB | 16/267 kB Progress (3): 0.6/1.0 MB | 82/116 kB | 16/267 kB Progress (3): 0.6/1.0 MB | 82/116 kB | 33/267 kB Progress (3): 0.6/1.0 MB | 98/116 kB | 33/267 kB Progress (3): 0.7/1.0 MB | 98/116 kB | 33/267 kB Progress (3): 0.7/1.0 MB | 98/116 kB | 49/267 kB Progress (3): 0.7/1.0 MB | 115/116 kB | 49/267 kB Progress (3): 0.7/1.0 MB | 115/116 kB | 49/267 kB Progress (3): 0.7/1.0 MB | 116 kB | 49/267 kB Progress (3): 0.7/1.0 MB | 116 kB | 66/267 kB Progress (3): 0.7/1.0 MB | 116 kB | 66/267 kB Progress (3): 0.7/1.0 MB | 116 kB | 82/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.7 MB/s) 2024-09-14T11:25:57.693 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (2): 0.7/1.0 MB | 82/267 kB Progress (2): 0.7/1.0 MB | 98/267 kB Progress (2): 0.7/1.0 MB | 115/267 kB Progress (2): 0.7/1.0 MB | 115/267 kB Progress (2): 0.7/1.0 MB | 131/267 kB Progress (2): 0.7/1.0 MB | 131/267 kB Progress (2): 0.7/1.0 MB | 147/267 kB Progress (2): 0.7/1.0 MB | 164/267 kB Progress (2): 0.8/1.0 MB | 164/267 kB Progress (2): 0.8/1.0 MB | 180/267 kB Progress (2): 0.8/1.0 MB | 180/267 kB Progress (2): 0.8/1.0 MB | 197/267 kB Progress (2): 0.8/1.0 MB | 197/267 kB Progress (2): 0.8/1.0 MB | 213/267 kB Progress (2): 0.8/1.0 MB | 213/267 kB Progress (2): 0.8/1.0 MB | 229/267 kB Progress (2): 0.8/1.0 MB | 229/267 kB Progress (2): 0.8/1.0 MB | 246/267 kB Progress (2): 0.8/1.0 MB | 246/267 kB Progress (2): 0.8/1.0 MB | 262/267 kB Progress (2): 0.8/1.0 MB | 267 kB Progress (2): 0.9/1.0 MB | 267 kB Progress (2): 0.9/1.0 MB | 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 7.6 MB/s) 2024-09-14T11:25:57.697 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 25 MB/s) 2024-09-14T11:25:57.872 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-14T11:25:57.902 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:25:57.902 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] BUILD SUCCESS 2024-09-14T11:25:57.902 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:25:57.903 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] Total time: 7.260 s 2024-09-14T11:25:57.903 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] Finished at: 2024-09-14T11:25:57Z 2024-09-14T11:25:57.903 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:25:57.935 INFO:tasks.workunit.client.0.smithi071.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-14T11:25:57.941 INFO:tasks.workunit.client.0.smithi071.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-14T11:25:59.107 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] Scanning for projects... 2024-09-14T11:25:59.186 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] 2024-09-14T11:25:59.186 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-14T11:25:59.187 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] Building jcksum 1.0 2024-09-14T11:25:59.187 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] from pom.xml 2024-09-14T11:25:59.187 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-14T11:25:59.465 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] 2024-09-14T11:25:59.466 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-14T11:25:59.611 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-14T11:25:59.612 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] 2024-09-14T11:25:59.612 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-14T11:25:59.715 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-14T11:25:59.715 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] 2024-09-14T11:25:59.716 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-14T11:25:59.718 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-14T11:25:59.718 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] 2024-09-14T11:25:59.718 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-14T11:25:59.722 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-14T11:25:59.722 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] 2024-09-14T11:25:59.722 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-14T11:25:59.903 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-14T11:26:00.140 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-14T11:26:00.353 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 21 kB/s) 2024-09-14T11:26:00.362 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-14T11:26:00.379 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 145 kB/s) 2024-09-14T11:26:00.387 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-14T11:26:00.404 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 166 kB/s) 2024-09-14T11:26:00.411 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-14T11:26:00.430 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 159 kB/s) 2024-09-14T11:26:00.434 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-14T11:26:00.451 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 188 kB/s) 2024-09-14T11:26:00.455 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-14T11:26:00.471 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 105 kB/s) 2024-09-14T11:26:00.475 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-14T11:26:00.491 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 177 kB/s) 2024-09-14T11:26:00.499 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-14T11:26:00.522 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 17/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.1 MB/s) 2024-09-14T11:26:00.524 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-14T11:26:00.524 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-14T11:26:00.527 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-14T11:26:00.527 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-14T11:26:00.528 INFO:tasks.workunit.client.0.smithi071.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-14T11:26:00.573 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 16/169 kB Progress (1): 33/169 kB Progress (1): 49/169 kB Progress (1): 66/169 kB Progress (1): 82/169 kB Progress (1): 98/169 kB Progress (1): 115/169 kB Progress (1): 131/169 kB Progress (1): 147/169 kB Progress (1): 164/169 kB Progress (1): 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 3.4 MB/s) 2024-09-14T11:26:00.593 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 1.4/18 kB Progress (2): 1.4/18 kB | 1.4/7.7 kB Progress (2): 2.8/18 kB | 1.4/7.7 kB Progress (2): 2.8/18 kB | 2.8/7.7 kB Progress (2): 4.1/18 kB | 2.8/7.7 kB Progress (2): 4.1/18 kB | 4.1/7.7 kB Progress (3): 4.1/18 kB | 4.1/7.7 kB | 16/189 kB Progress (3): 4.1/18 kB | 5.5/7.7 kB | 16/189 kB Progress (3): 5.5/18 kB | 5.5/7.7 kB | 16/189 kB Progress (4): 5.5/18 kB | 5.5/7.7 kB | 16/189 kB | 16/103 kB Progress (4): 6.9/18 kB | 5.5/7.7 kB | 16/189 kB | 16/103 kB Progress (4): 6.9/18 kB | 6.9/7.7 kB | 16/189 kB | 16/103 kB Progress (4): 8.3/18 kB | 6.9/7.7 kB | 16/189 kB | 16/103 kB Progress (4): 8.3/18 kB | 7.7 kB | 16/189 kB | 16/103 kB Progress (4): 8.3/18 kB | 7.7 kB | 33/189 kB | 16/103 kB Progress (4): 9.7/18 kB | 7.7 kB | 33/189 kB | 16/103 kB Progress (4): 11/18 kB | 7.7 kB | 33/189 kB | 16/103 kB Progress (4): 12/18 kB | 7.7 kB | 33/189 kB | 16/103 kB Progress (4): 14/18 kB | 7.7 kB | 33/189 kB | 16/103 kB Progress (4): 15/18 kB | 7.7 kB | 33/189 kB | 16/103 kB Progress (4): 17/18 kB | 7.7 kB | 33/189 kB | 16/103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 111 kB/s) 2024-09-14T11:26:00.594 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (3): 18 kB | 33/189 kB | 16/103 kB Progress (3): 18 kB | 33/189 kB | 33/103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 244 kB/s) 2024-09-14T11:26:00.611 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (2): 49/189 kB | 33/103 kB Progress (2): 49/189 kB | 49/103 kB Progress (2): 66/189 kB | 49/103 kB Progress (2): 66/189 kB | 66/103 kB Progress (2): 82/189 kB | 66/103 kB Progress (2): 98/189 kB | 66/103 kB Progress (2): 98/189 kB | 82/103 kB Progress (2): 115/189 kB | 82/103 kB Progress (2): 115/189 kB | 98/103 kB Progress (2): 115/189 kB | 103 kB Progress (2): 131/189 kB | 103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.2 MB/s) 2024-09-14T11:26:00.614 INFO:tasks.workunit.client.0.smithi071.stdout:Progress (1): 147/189 kB Progress (1): 164/189 kB Progress (1): 180/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 2.1 MB/s) 2024-09-14T11:26:00.635 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] 2024-09-14T11:26:00.635 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] ------------------------------------------------------- 2024-09-14T11:26:00.635 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] T E S T S 2024-09-14T11:26:00.635 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] ------------------------------------------------------- 2024-09-14T11:26:01.207 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-14T11:26:01.293 INFO:tasks.workunit.client.0.smithi071.stdout:PutObjects.java: starting test run: 2024-09-14T11:26:01.293 INFO:tasks.workunit.client.0.smithi071.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-14T11:26:01.293 INFO:tasks.workunit.client.0.smithi071.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-14T11:26:01.293 INFO:tasks.workunit.client.0.smithi071.stdout: EndpointUrl=http://smithi071.front.sepia.ceph.com:80 2024-09-14T11:26:01.294 INFO:tasks.workunit.client.0.smithi071.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-14T11:26:01.491 INFO:tasks.workunit.client.0.smithi071.stdout:DEBUG: Environment Variables Read 2024-09-14T11:26:01.792 INFO:tasks.workunit.client.0.smithi071.stdout:DEBUG: S3 Client Initialized 2024-09-14T11:26:01.792 INFO:tasks.workunit.client.0.smithi071.stdout:DEBUG: Generating File 2024-09-14T11:26:01.792 INFO:tasks.workunit.client.0.smithi071.stdout:DEBUG: File Generated 2024-09-14T11:26:01.792 INFO:tasks.workunit.client.0.smithi071.stdout:DEBUG: Generating File 2024-09-14T11:26:01.792 INFO:tasks.workunit.client.0.smithi071.stdout:DEBUG: File Generated 2024-09-14T11:26:01.792 INFO:tasks.workunit.client.0.smithi071.stdout:DEBUG: Generating File 2024-09-14T11:26:01.892 INFO:tasks.workunit.client.0.smithi071.stdout:DEBUG: File Generated 2024-09-14T11:26:01.892 INFO:tasks.workunit.client.0.smithi071.stdout:DEBUG: Generating File 2024-09-14T11:26:01.892 INFO:tasks.workunit.client.0.smithi071.stdout:DEBUG: File Generated 2024-09-14T11:26:01.892 INFO:tasks.workunit.client.0.smithi071.stdout:DEBUG: Generating File 2024-09-14T11:26:01.893 INFO:tasks.workunit.client.0.smithi071.stdout:DEBUG: File Generated 2024-09-14T11:26:01.893 INFO:tasks.workunit.client.0.smithi071.stdout:DEBUG: Generating File 2024-09-14T11:26:01.893 INFO:tasks.workunit.client.0.smithi071.stdout:DEBUG: File Generated 2024-09-14T11:26:01.893 INFO:tasks.workunit.client.0.smithi071.stdout:DEBUG: Generated Big Files 2024-09-14T11:26:02.092 INFO:tasks.workunit.client.0.smithi071.stdout:HeadBucketResponse() 2024-09-14T11:26:02.092 INFO:tasks.workunit.client.0.smithi071.stdout:sheik is ready 2024-09-14T11:26:02.093 INFO:tasks.workunit.client.0.smithi071.stdout:DEBUG: Test Bucket Created 2024-09-14T11:26:02.192 INFO:tasks.workunit.client.0.smithi071.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-14T11:26:02.293 INFO:tasks.workunit.client.0.smithi071.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-14T11:26:02.379 INFO:tasks.workunit.client.0.smithi071.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-14T11:26:02.393 INFO:tasks.workunit.client.0.smithi071.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-14T11:26:02.493 INFO:tasks.workunit.client.0.smithi071.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-14T11:26:02.594 INFO:tasks.workunit.client.0.smithi071.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-14T11:26:02.694 INFO:tasks.workunit.client.0.smithi071.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-14T11:26:02.771 INFO:tasks.workunit.client.0.smithi071.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-14T11:26:02.794 INFO:tasks.workunit.client.0.smithi071.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-14T11:26:02.894 INFO:tasks.workunit.client.0.smithi071.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-14T11:26:04.899 INFO:tasks.workunit.client.0.smithi071.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-14T11:26:05.700 INFO:tasks.workunit.client.0.smithi071.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-14T11:26:09.245 INFO:tasks.workunit.client.0.smithi071.stdout:arg: file-0b 2024-09-14T11:26:09.247 INFO:tasks.workunit.client.0.smithi071.stdout:arg: file-8b 2024-09-14T11:26:09.248 INFO:tasks.workunit.client.0.smithi071.stdout:arg: file-200b 2024-09-14T11:26:09.249 INFO:tasks.workunit.client.0.smithi071.stdout:arg: file-21983b 2024-09-14T11:26:09.250 INFO:tasks.workunit.client.0.smithi071.stdout:arg: file-5519b 2024-09-14T11:26:09.251 INFO:tasks.workunit.client.0.smithi071.stdout:arg: file-204329b 2024-09-14T11:26:09.253 INFO:tasks.workunit.client.0.smithi071.stdout:arg: file-256k 2024-09-14T11:26:09.254 INFO:tasks.workunit.client.0.smithi071.stdout:arg: file-1m 2024-09-14T11:26:09.255 INFO:tasks.workunit.client.0.smithi071.stdout:arg: file-1038757b 2024-09-14T11:26:09.297 INFO:tasks.workunit.client.0.smithi071.stdout:putObjectFromFileCksum called with file-0b 2024-09-14T11:26:09.297 INFO:tasks.workunit.client.0.smithi071.stdout:PutObjectResponse 2024-09-14T11:26:09.308 INFO:tasks.workunit.client.0.smithi071.stdout:putObjectFromFileCksum called with file-8b 2024-09-14T11:26:09.361 INFO:tasks.workunit.client.0.smithi071.stdout:PutObjectResponse 2024-09-14T11:26:09.409 INFO:tasks.workunit.client.0.smithi071.stdout:putObjectFromFileCksum called with file-200b 2024-09-14T11:26:09.409 INFO:tasks.workunit.client.0.smithi071.stdout:PutObjectResponse 2024-09-14T11:26:09.507 INFO:tasks.workunit.client.0.smithi071.stdout:putObjectFromFileCksum called with file-21983b 2024-09-14T11:26:09.507 INFO:tasks.workunit.client.0.smithi071.stdout:PutObjectResponse 2024-09-14T11:26:09.582 INFO:tasks.workunit.client.0.smithi071.stdout:putObjectFromFileCksum called with file-5519b 2024-09-14T11:26:09.582 INFO:tasks.workunit.client.0.smithi071.stdout:PutObjectResponse 2024-09-14T11:26:09.609 INFO:tasks.workunit.client.0.smithi071.stdout:putObjectFromFileCksum called with file-204329b 2024-09-14T11:26:09.641 INFO:tasks.workunit.client.0.smithi071.stdout:PutObjectResponse 2024-09-14T11:26:09.686 INFO:tasks.workunit.client.0.smithi071.stdout:putObjectFromFileCksum called with file-256k 2024-09-14T11:26:09.686 INFO:tasks.workunit.client.0.smithi071.stdout:PutObjectResponse 2024-09-14T11:26:09.709 INFO:tasks.workunit.client.0.smithi071.stdout:putObjectFromFileCksum called with file-1m 2024-09-14T11:26:09.732 INFO:tasks.workunit.client.0.smithi071.stdout:PutObjectResponse 2024-09-14T11:26:09.800 INFO:tasks.workunit.client.0.smithi071.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-14T11:26:09.801 INFO:tasks.workunit.client.0.smithi071.stdout:PutObjectResponse 2024-09-14T11:26:09.810 INFO:tasks.workunit.client.0.smithi071.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-14T11:26:10.211 INFO:tasks.workunit.client.0.smithi071.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-14T11:26:10.812 INFO:tasks.workunit.client.0.smithi071.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-14T11:26:14.600 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.37 s -- in io.ceph.jcksum.PutObjects 2024-09-14T11:26:14.636 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] 2024-09-14T11:26:14.636 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] Results: 2024-09-14T11:26:14.636 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] 2024-09-14T11:26:14.636 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-14T11:26:14.637 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] 2024-09-14T11:26:14.638 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:26:14.639 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] BUILD SUCCESS 2024-09-14T11:26:14.639 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:26:14.639 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] Total time: 15.554 s 2024-09-14T11:26:14.640 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] Finished at: 2024-09-14T11:26:14Z 2024-09-14T11:26:14.640 INFO:tasks.workunit.client.0.smithi071.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:26:14.671 INFO:tasks.workunit.client.0.smithi071.stderr:+ exit 2024-09-14T11:26:14.672 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:26:14.672 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:26:14.723 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-14T11:26:14.723 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:26:15.086 DEBUG:teuthology.parallel:result is None 2024-09-14T11:26:15.086 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:26:15.096 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:26:15.096 DEBUG:teuthology.orchestra.run.smithi071:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:26:15.149 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:26:15.150 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:26:15.175 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:26:15.175 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:26:15.175 DEBUG:teuthology.orchestra.run.smithi071:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:26:15.208 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:26:15.209 INFO:teuthology.orchestra.run.smithi071.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:26:15.209 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:26:15.260 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:26:15.261 DEBUG:teuthology.orchestra.run.smithi071:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:26:15.314 INFO:tasks.workunit:timeout=3h 2024-09-14T11:26:15.314 INFO:tasks.workunit:cleanup=True 2024-09-14T11:26:15.314 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:26:15.363 INFO:tasks.workunit.client.0.smithi071.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:27:09.497 INFO:tasks.workunit.client.0.smithi071.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:27:09.497 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:27:09.497 INFO:tasks.workunit.client.0.smithi071.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:27:09.497 INFO:tasks.workunit.client.0.smithi071.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:27:09.497 INFO:tasks.workunit.client.0.smithi071.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:27:09.498 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:27:09.498 INFO:tasks.workunit.client.0.smithi071.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:27:09.498 INFO:tasks.workunit.client.0.smithi071.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:27:09.498 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:27:09.498 INFO:tasks.workunit.client.0.smithi071.stderr: git switch -c 2024-09-14T11:27:09.498 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:27:09.498 INFO:tasks.workunit.client.0.smithi071.stderr:Or undo this operation with: 2024-09-14T11:27:09.498 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:27:09.498 INFO:tasks.workunit.client.0.smithi071.stderr: git switch - 2024-09-14T11:27:09.498 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:27:09.498 INFO:tasks.workunit.client.0.smithi071.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:27:09.498 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:27:09.498 INFO:tasks.workunit.client.0.smithi071.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:27:09.499 DEBUG:teuthology.orchestra.run.smithi071:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:27:09.545 INFO:tasks.workunit.client.0.smithi071.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:27:09.549 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:27:09.549 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:27:09.600 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:27:09.649 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:27:09.694 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:27:09.696 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:27:09.696 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:27:09.739 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:27:09.743 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T11:27:09.743 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:27:09.789 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-14T11:27:09.790 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-14T11:27:09.790 DEBUG:teuthology.orchestra.run.smithi071:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-14T11:27:09.843 INFO:tasks.workunit.client.0.smithi071.stdout:INFO: fully qualified domain name: smithi071.front.sepia.ceph.com 2024-09-14T11:27:09.843 INFO:tasks.workunit.client.0.smithi071.stdout:== TESTING *ABORTING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-14T11:27:09.843 INFO:tasks.workunit.client.0.smithi071.stdout:== TESTING VERSIONED BUCKET == 2024-09-14T11:27:13.106 INFO:tasks.workunit.client.0.smithi071.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-14T11:27:13.318 INFO:tasks.workunit.client.0.smithi071.stdout:Collecting pip 2024-09-14T11:27:13.323 INFO:tasks.workunit.client.0.smithi071.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:27:13.357 INFO:tasks.workunit.client.0.smithi071.stdout:Installing collected packages: pip 2024-09-14T11:27:13.357 INFO:tasks.workunit.client.0.smithi071.stdout: Attempting uninstall: pip 2024-09-14T11:27:13.358 INFO:tasks.workunit.client.0.smithi071.stdout: Found existing installation: pip 22.0.2 2024-09-14T11:27:13.612 INFO:tasks.workunit.client.0.smithi071.stdout: Uninstalling pip-22.0.2: 2024-09-14T11:27:13.618 INFO:tasks.workunit.client.0.smithi071.stdout: Successfully uninstalled pip-22.0.2 2024-09-14T11:27:14.355 INFO:tasks.workunit.client.0.smithi071.stdout:Successfully installed pip-24.2 2024-09-14T11:27:15.392 INFO:tasks.workunit.client.0.smithi071.stdout:Collecting boto3 2024-09-14T11:27:15.394 INFO:tasks.workunit.client.0.smithi071.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:27:15.895 INFO:tasks.workunit.client.0.smithi071.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:27:15.896 INFO:tasks.workunit.client.0.smithi071.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:27:15.946 INFO:tasks.workunit.client.0.smithi071.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:27:15.947 INFO:tasks.workunit.client.0.smithi071.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:27:15.992 INFO:tasks.workunit.client.0.smithi071.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:27:15.994 INFO:tasks.workunit.client.0.smithi071.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:27:16.049 INFO:tasks.workunit.client.0.smithi071.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:27:16.051 INFO:tasks.workunit.client.0.smithi071.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:27:16.160 INFO:tasks.workunit.client.0.smithi071.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:27:16.162 INFO:tasks.workunit.client.0.smithi071.stdout: Using cached urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-14T11:27:16.300 INFO:tasks.workunit.client.0.smithi071.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:27:16.301 INFO:tasks.workunit.client.0.smithi071.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:27:16.305 INFO:tasks.workunit.client.0.smithi071.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:27:16.306 INFO:tasks.workunit.client.0.smithi071.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:27:16.317 INFO:tasks.workunit.client.0.smithi071.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:27:16.318 INFO:tasks.workunit.client.0.smithi071.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:27:16.319 INFO:tasks.workunit.client.0.smithi071.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:27:16.321 INFO:tasks.workunit.client.0.smithi071.stdout:Using cached urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-14T11:27:16.322 INFO:tasks.workunit.client.0.smithi071.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:27:16.394 INFO:tasks.workunit.client.0.smithi071.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:27:17.470 INFO:tasks.workunit.client.0.smithi071.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-14T11:27:17.857 INFO:tasks.workunit.client.0.smithi071.stdout:INFO: creating user 2024-09-14T11:27:18.214 INFO:tasks.workunit.client.0.smithi071.stdout:{ 2024-09-14T11:27:18.214 INFO:tasks.workunit.client.0.smithi071.stdout: "user_id": "testid", 2024-09-14T11:27:18.214 INFO:tasks.workunit.client.0.smithi071.stdout: "display_name": "M. Tester", 2024-09-14T11:27:18.214 INFO:tasks.workunit.client.0.smithi071.stdout: "email": "tester@ceph.com", 2024-09-14T11:27:18.214 INFO:tasks.workunit.client.0.smithi071.stdout: "suspended": 0, 2024-09-14T11:27:18.214 INFO:tasks.workunit.client.0.smithi071.stdout: "max_buckets": 1000, 2024-09-14T11:27:18.214 INFO:tasks.workunit.client.0.smithi071.stdout: "subusers": [], 2024-09-14T11:27:18.214 INFO:tasks.workunit.client.0.smithi071.stdout: "keys": [ 2024-09-14T11:27:18.214 INFO:tasks.workunit.client.0.smithi071.stdout: { 2024-09-14T11:27:18.214 INFO:tasks.workunit.client.0.smithi071.stdout: "user": "testid", 2024-09-14T11:27:18.214 INFO:tasks.workunit.client.0.smithi071.stdout: "access_key": "0555b35654ad1656d804", 2024-09-14T11:27:18.214 INFO:tasks.workunit.client.0.smithi071.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-14T11:27:18.215 INFO:tasks.workunit.client.0.smithi071.stdout: "active": true, 2024-09-14T11:27:18.215 INFO:tasks.workunit.client.0.smithi071.stdout: "create_date": "2024-09-14T11:27:18.205820Z" 2024-09-14T11:27:18.215 INFO:tasks.workunit.client.0.smithi071.stdout: } 2024-09-14T11:27:18.215 INFO:tasks.workunit.client.0.smithi071.stdout: ], 2024-09-14T11:27:18.215 INFO:tasks.workunit.client.0.smithi071.stdout: "swift_keys": [], 2024-09-14T11:27:18.215 INFO:tasks.workunit.client.0.smithi071.stdout: "caps": [], 2024-09-14T11:27:18.215 INFO:tasks.workunit.client.0.smithi071.stdout: "op_mask": "read, write, delete", 2024-09-14T11:27:18.215 INFO:tasks.workunit.client.0.smithi071.stdout: "default_placement": "", 2024-09-14T11:27:18.215 INFO:tasks.workunit.client.0.smithi071.stdout: "default_storage_class": "", 2024-09-14T11:27:18.215 INFO:tasks.workunit.client.0.smithi071.stdout: "placement_tags": [], 2024-09-14T11:27:18.215 INFO:tasks.workunit.client.0.smithi071.stdout: "bucket_quota": { 2024-09-14T11:27:18.215 INFO:tasks.workunit.client.0.smithi071.stdout: "enabled": false, 2024-09-14T11:27:18.215 INFO:tasks.workunit.client.0.smithi071.stdout: "check_on_raw": false, 2024-09-14T11:27:18.215 INFO:tasks.workunit.client.0.smithi071.stdout: "max_size": -1, 2024-09-14T11:27:18.216 INFO:tasks.workunit.client.0.smithi071.stdout: "max_size_kb": 0, 2024-09-14T11:27:18.216 INFO:tasks.workunit.client.0.smithi071.stdout: "max_objects": -1 2024-09-14T11:27:18.216 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:27:18.216 INFO:tasks.workunit.client.0.smithi071.stdout: "user_quota": { 2024-09-14T11:27:18.216 INFO:tasks.workunit.client.0.smithi071.stdout: "enabled": false, 2024-09-14T11:27:18.216 INFO:tasks.workunit.client.0.smithi071.stdout: "check_on_raw": false, 2024-09-14T11:27:18.216 INFO:tasks.workunit.client.0.smithi071.stdout: "max_size": -1, 2024-09-14T11:27:18.216 INFO:tasks.workunit.client.0.smithi071.stdout: "max_size_kb": 0, 2024-09-14T11:27:18.216 INFO:tasks.workunit.client.0.smithi071.stdout: "max_objects": -1 2024-09-14T11:27:18.216 INFO:tasks.workunit.client.0.smithi071.stdout: }, 2024-09-14T11:27:18.216 INFO:tasks.workunit.client.0.smithi071.stdout: "temp_url_keys": [], 2024-09-14T11:27:18.216 INFO:tasks.workunit.client.0.smithi071.stdout: "type": "rgw", 2024-09-14T11:27:18.216 INFO:tasks.workunit.client.0.smithi071.stdout: "mfa_ids": [], 2024-09-14T11:27:18.216 INFO:tasks.workunit.client.0.smithi071.stdout: "account_id": "", 2024-09-14T11:27:18.217 INFO:tasks.workunit.client.0.smithi071.stdout: "path": "/", 2024-09-14T11:27:18.217 INFO:tasks.workunit.client.0.smithi071.stdout: "create_date": "2024-09-14T11:27:18.205788Z", 2024-09-14T11:27:18.217 INFO:tasks.workunit.client.0.smithi071.stdout: "tags": [], 2024-09-14T11:27:18.217 INFO:tasks.workunit.client.0.smithi071.stdout: "group_ids": [] 2024-09-14T11:27:18.217 INFO:tasks.workunit.client.0.smithi071.stdout:} 2024-09-14T11:27:18.217 INFO:tasks.workunit.client.0.smithi071.stdout: 2024-09-14T11:27:18.518 INFO:tasks.workunit.client.0.smithi071.stderr:5+0 records in 2024-09-14T11:27:18.518 INFO:tasks.workunit.client.0.smithi071.stderr:5+0 records out 2024-09-14T11:27:18.518 INFO:tasks.workunit.client.0.smithi071.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.020761 s, 253 MB/s 2024-09-14T11:27:20.751 INFO:tasks.workunit.client.0.smithi071.stdout:bucket nams is reupload-bkt-103647 2024-09-14T11:27:20.751 INFO:tasks.workunit.client.0.smithi071.stdout:endpoint is http://smithi071.front.sepia.ceph.com:80 2024-09-14T11:27:20.751 INFO:tasks.workunit.client.0.smithi071.stdout:start UploadId=2~v8lU9QR5aZ-9YobENCM4ze_japiGoap 2024-09-14T11:27:20.751 INFO:tasks.workunit.client.0.smithi071.stdout:phase 1 uploaded part {'ETag': '"ea4fc20533ff192277d2329e6f8ef3b3"', 'PartNumber': 1} 2024-09-14T11:27:20.751 INFO:tasks.workunit.client.0.smithi071.stdout:phase 1 uploaded part {'ETag': '"ea4fc20533ff192277d2329e6f8ef3b3"', 'PartNumber': 2} 2024-09-14T11:27:20.751 INFO:tasks.workunit.client.0.smithi071.stdout:phase 2 uploaded part {'ETag': '"ea4fc20533ff192277d2329e6f8ef3b3"', 'PartNumber': 1} 2024-09-14T11:27:20.751 INFO:tasks.workunit.client.0.smithi071.stdout:phase 2 uploaded part {'ETag': '"ea4fc20533ff192277d2329e6f8ef3b3"', 'PartNumber': 1} 2024-09-14T11:27:20.751 INFO:tasks.workunit.client.0.smithi071.stdout:phase 2 uploaded part {'ETag': '"ea4fc20533ff192277d2329e6f8ef3b3"', 'PartNumber': 1} 2024-09-14T11:27:20.751 INFO:tasks.workunit.client.0.smithi071.stdout:phase 2 uploaded part {'ETag': '"ea4fc20533ff192277d2329e6f8ef3b3"', 'PartNumber': 1} 2024-09-14T11:27:20.751 INFO:tasks.workunit.client.0.smithi071.stdout:phase 2 uploaded part {'ETag': '"ea4fc20533ff192277d2329e6f8ef3b3"', 'PartNumber': 1} 2024-09-14T11:27:20.751 INFO:tasks.workunit.client.0.smithi071.stdout:phase 2 uploaded part {'ETag': '"ea4fc20533ff192277d2329e6f8ef3b3"', 'PartNumber': 1} 2024-09-14T11:27:20.752 INFO:tasks.workunit.client.0.smithi071.stdout:phase 2 uploaded part {'ETag': '"ea4fc20533ff192277d2329e6f8ef3b3"', 'PartNumber': 1} 2024-09-14T11:27:20.752 INFO:tasks.workunit.client.0.smithi071.stdout:phase 2 uploaded part {'ETag': '"ea4fc20533ff192277d2329e6f8ef3b3"', 'PartNumber': 1} 2024-09-14T11:27:20.752 INFO:tasks.workunit.client.0.smithi071.stdout:phase 2 uploaded part {'ETag': '"ea4fc20533ff192277d2329e6f8ef3b3"', 'PartNumber': 1} 2024-09-14T11:27:20.752 INFO:tasks.workunit.client.0.smithi071.stdout:phase 2 uploaded part {'ETag': '"ea4fc20533ff192277d2329e6f8ef3b3"', 'PartNumber': 1} 2024-09-14T11:27:20.752 INFO:tasks.workunit.client.0.smithi071.stdout:phase 2 uploaded part {'ETag': '"ea4fc20533ff192277d2329e6f8ef3b3"', 'PartNumber': 1} 2024-09-14T11:27:20.752 INFO:tasks.workunit.client.0.smithi071.stdout:aborting multipart upload, parts=[{'ETag': '"ea4fc20533ff192277d2329e6f8ef3b3"', 'PartNumber': 1}, {'ETag': '"ea4fc20533ff192277d2329e6f8ef3b3"', 'PartNumber': 2}] 2024-09-14T11:27:22.234 INFO:tasks.workunit.client.0.smithi071.stdout:radosgw-admin bucket radoslist: 2024-09-14T11:27:22.525 INFO:tasks.workunit.client.0.smithi071.stdout:rados ls: 2024-09-14T11:27:22.539 INFO:tasks.workunit.client.0.smithi071.stdout:== PASSED == 2024-09-14T11:27:22.540 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:27:22.540 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:27:22.592 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-14T11:27:22.592 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:27:23.002 DEBUG:teuthology.parallel:result is None 2024-09-14T11:27:23.002 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:27:23.015 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:27:23.015 DEBUG:teuthology.orchestra.run.smithi071:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:27:23.061 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:27:23.061 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-14T11:27:23.527 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-14T11:27:23.528 INFO:tasks.ragweed:Downloading ragweed... 2024-09-14T11:27:23.528 INFO:tasks.ragweed:Using branch 'main' for ragweed 2024-09-14T11:27:23.528 DEBUG:teuthology.orchestra.run.smithi071:> git clone -b main https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:27:23.534 INFO:teuthology.orchestra.run.smithi071.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-14T11:27:23.591 INFO:teuthology.orchestra.run.smithi071.stderr:fatal: Remote branch main not found in upstream origin 2024-09-14T11:27:23.592 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-09-14T11:27:23.593 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-09-14T11:27:23.593 DEBUG:teuthology.orchestra.run.smithi071:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:27:23.642 INFO:teuthology.orchestra.run.smithi071.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-14T11:27:23.820 INFO:tasks.ragweed:Creating rgw users... 2024-09-14T11:27:23.820 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-14T11:27:23.821 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key PZMSHYFTQVSNBYXRDOXH --secret eYnkFi3MOTvSV3q4ZMdO0rZxULR7pevmNe1cg4r/uIBwhQ7vcC0dOg== --email ragweed.client.0+test@test.test --system false 2024-09-14T11:27:23.911 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:27:23.911 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:27:23.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:23.951+0000 7fe0696ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:23.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:23.955+0000 7fe0696ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:23.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:23.955+0000 7fe0696ab9c0 20 realm 2024-09-14T11:27:23.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:23.955+0000 7fe0696ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:23.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:23.955+0000 7fe0696ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:23.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:23.955+0000 7fe0696ab9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:27:23.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:23.955+0000 7fe0696ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:23.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:23.955+0000 7fe0696ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:23.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:23.955+0000 7fe0696ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:23.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:23.955+0000 7fe0696ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:27:23.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:23.955+0000 7fe0696ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:23.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:23.959+0000 7fe0696ab9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:27:23.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:23.959+0000 7fe0696ab9c0 20 searching for the correct realm 2024-09-14T11:27:23.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:23.963+0000 7fe0679b2640 0 -- 172.21.15.71:0/4199243695 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fe05c008040 msgr2=0x7fe05c045920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:27:24.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.175+0000 7fe0679b2640 0 -- 172.21.15.71:0/4199243695 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x559d5bafcbf0 msgr2=0x559d5baff000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:27:24.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.191+0000 7fe0696ab9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:27:24.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.191+0000 7fe0696ab9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:27:24.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.191+0000 7fe0696ab9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:27:24.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.191+0000 7fe0696ab9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:27:24.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.191+0000 7fe0696ab9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:27:24.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.191+0000 7fe0696ab9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:27:24.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.191+0000 7fe0696ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:24.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.191+0000 7fe0696ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:24.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.191+0000 7fe0696ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:24.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.191+0000 7fe0696ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:27:24.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.191+0000 7fe0696ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:24.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.195+0000 7fe0696ab9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:27:24.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.195+0000 7fe0696ab9c0 20 zone default found 2024-09-14T11:27:24.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.195+0000 7fe0696ab9c0 4 Realm: () 2024-09-14T11:27:24.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.195+0000 7fe0696ab9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:27:24.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.195+0000 7fe0696ab9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:27:24.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.195+0000 7fe0696ab9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:27:24.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.195+0000 7fe0696ab9c0 20 zonegroup default 2024-09-14T11:27:24.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.195+0000 7fe0696ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:24.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.195+0000 7fe0696ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:24.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.195+0000 7fe0696ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:24.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.195+0000 7fe0696ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:24.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.195+0000 7fe0696ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:24.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.195+0000 7fe0696ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:24.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.195+0000 7fe0696ab9c0 20 started sync module instance, tier type = 2024-09-14T11:27:24.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.195+0000 7fe0696ab9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:27:24.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.219+0000 7fe0696ab9c0 20 add_watcher() i=0 2024-09-14T11:27:24.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.219+0000 7fe0696ab9c0 20 add_watcher() i=1 2024-09-14T11:27:24.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.219+0000 7fe0696ab9c0 20 add_watcher() i=2 2024-09-14T11:27:24.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.219+0000 7fe0696ab9c0 20 add_watcher() i=3 2024-09-14T11:27:24.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.219+0000 7fe0696ab9c0 20 add_watcher() i=4 2024-09-14T11:27:24.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.219+0000 7fe0696ab9c0 20 add_watcher() i=5 2024-09-14T11:27:24.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.219+0000 7fe0696ab9c0 20 add_watcher() i=6 2024-09-14T11:27:24.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.223+0000 7fe0696ab9c0 20 add_watcher() i=7 2024-09-14T11:27:24.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.223+0000 7fe0696ab9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:27:24.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.227+0000 7fdf1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:27:24.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.227+0000 7fe0696ab9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:27:24.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.227+0000 7fe0696ab9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:27:24.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.227+0000 7fe0696ab9c0 5 note: GC not initialized 2024-09-14T11:27:24.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.227+0000 7fdf1cfe1640 20 reqs_thread_entry: start 2024-09-14T11:27:24.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.227+0000 7fe0696ab9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:27:24.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.227+0000 7fe0696ab9c0 20 Filter name: none 2024-09-14T11:27:24.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.227+0000 7fde967fc640 20 reqs_thread_entry: start 2024-09-14T11:27:24.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.227+0000 7fe0696ab9c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-14T11:27:24.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.227+0000 7fe0696ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:24.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.227+0000 7fe0696ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:24.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.227+0000 7fe0696ab9c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-14T11:27:24.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.227+0000 7fe0696ab9c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:27:24.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.227+0000 7fe0696ab9c0 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-14T11:27:24.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.227+0000 7fe0696ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:24.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.231+0000 7fe0696ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:24.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.231+0000 7fe0696ab9c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-14T11:27:24.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.231+0000 7fe0696ab9c0 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:27:24.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.231+0000 7fe0696ab9c0 10 cache get: name=default.rgw.meta+users.keys+PZMSHYFTQVSNBYXRDOXH : miss 2024-09-14T11:27:24.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.231+0000 7fe0696ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:24.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.231+0000 7fe0696ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:24.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.231+0000 7fe0696ab9c0 10 cache put: name=default.rgw.meta+users.keys+PZMSHYFTQVSNBYXRDOXH info.flags=0x0 2024-09-14T11:27:24.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.231+0000 7fe0696ab9c0 10 adding default.rgw.meta+users.keys+PZMSHYFTQVSNBYXRDOXH to cache LRU end 2024-09-14T11:27:24.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.231+0000 7fe0696ab9c0 10 cache get: name=default.rgw.meta+users.keys+PZMSHYFTQVSNBYXRDOXH : hit (negative entry) 2024-09-14T11:27:24.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.231+0000 7fe0696ab9c0 10 cache get: name=default.rgw.meta+users.keys+PZMSHYFTQVSNBYXRDOXH : hit (negative entry) 2024-09-14T11:27:24.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.231+0000 7fe0696ab9c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-14T11:27:24.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.231+0000 7fe0696ab9c0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:27:24.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.231+0000 7fe0696ab9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-14T11:27:24.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.231+0000 7fdf4affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660538 cookie 94134336513744 notifier 5624 bl.length()=675 2024-09-14T11:27:24.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.231+0000 7fdf4affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-14T11:27:24.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.231+0000 7fdf4affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:27:24.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.235+0000 7fe0696ab9c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-14T11:27:24.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.235+0000 7fe0696ab9c0 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:27:24.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.235+0000 7fe0696ab9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-14T11:27:24.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.235+0000 7fdf4affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660491 cookie 94134336511440 notifier 5624 bl.length()=202 2024-09-14T11:27:24.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.235+0000 7fdf4affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-14T11:27:24.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.235+0000 7fdf4affd640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:27:24.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.235+0000 7fe0696ab9c0 10 cache put: name=default.rgw.meta+users.keys+PZMSHYFTQVSNBYXRDOXH info.flags=0x7 2024-09-14T11:27:24.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.235+0000 7fe0696ab9c0 10 moving default.rgw.meta+users.keys+PZMSHYFTQVSNBYXRDOXH to cache LRU end 2024-09-14T11:27:24.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.235+0000 7fe0696ab9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:PZMSHYFTQVSNBYXRDOXH, ofs0, ns] 2024-09-14T11:27:24.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.239+0000 7fdf4a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660550 cookie 94134336520304 notifier 5624 bl.length()=190 2024-09-14T11:27:24.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.239+0000 7fdf4a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+PZMSHYFTQVSNBYXRDOXH info.flags=0x7 2024-09-14T11:27:24.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.239+0000 7fdf4a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+PZMSHYFTQVSNBYXRDOXH to cache LRU end 2024-09-14T11:27:24.238 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T11:27:24.238 INFO:teuthology.orchestra.run.smithi071.stdout: "user_id": "ragweed.client.0", 2024-09-14T11:27:24.238 INFO:teuthology.orchestra.run.smithi071.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-14T11:27:24.238 INFO:teuthology.orchestra.run.smithi071.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-14T11:27:24.238 INFO:teuthology.orchestra.run.smithi071.stdout: "suspended": 0, 2024-09-14T11:27:24.238 INFO:teuthology.orchestra.run.smithi071.stdout: "max_buckets": 1000, 2024-09-14T11:27:24.239 INFO:teuthology.orchestra.run.smithi071.stdout: "subusers": [], 2024-09-14T11:27:24.239 INFO:teuthology.orchestra.run.smithi071.stdout: "keys": [ 2024-09-14T11:27:24.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T11:27:24.239 INFO:teuthology.orchestra.run.smithi071.stdout: "user": "ragweed.client.0", 2024-09-14T11:27:24.239 INFO:teuthology.orchestra.run.smithi071.stdout: "access_key": "PZMSHYFTQVSNBYXRDOXH", 2024-09-14T11:27:24.239 INFO:teuthology.orchestra.run.smithi071.stdout: "secret_key": "eYnkFi3MOTvSV3q4ZMdO0rZxULR7pevmNe1cg4r/uIBwhQ7vcC0dOg==", 2024-09-14T11:27:24.239 INFO:teuthology.orchestra.run.smithi071.stdout: "active": true, 2024-09-14T11:27:24.239 INFO:teuthology.orchestra.run.smithi071.stdout: "create_date": "2024-09-14T11:27:24.235147Z" 2024-09-14T11:27:24.239 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T11:27:24.239 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-14T11:27:24.239 INFO:teuthology.orchestra.run.smithi071.stdout: "swift_keys": [], 2024-09-14T11:27:24.239 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": [], 2024-09-14T11:27:24.240 INFO:teuthology.orchestra.run.smithi071.stdout: "op_mask": "read, write, delete", 2024-09-14T11:27:24.240 INFO:teuthology.orchestra.run.smithi071.stdout: "default_placement": "", 2024-09-14T11:27:24.240 INFO:teuthology.orchestra.run.smithi071.stdout: "default_storage_class": "", 2024-09-14T11:27:24.240 INFO:teuthology.orchestra.run.smithi071.stdout: "placement_tags": [], 2024-09-14T11:27:24.240 INFO:teuthology.orchestra.run.smithi071.stdout: "bucket_quota": { 2024-09-14T11:27:24.240 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": false, 2024-09-14T11:27:24.240 INFO:teuthology.orchestra.run.smithi071.stdout: "check_on_raw": false, 2024-09-14T11:27:24.240 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size": -1, 2024-09-14T11:27:24.240 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size_kb": 0, 2024-09-14T11:27:24.240 INFO:teuthology.orchestra.run.smithi071.stdout: "max_objects": -1 2024-09-14T11:27:24.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T11:27:24.241 INFO:teuthology.orchestra.run.smithi071.stdout: "user_quota": { 2024-09-14T11:27:24.241 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": false, 2024-09-14T11:27:24.241 INFO:teuthology.orchestra.run.smithi071.stdout: "check_on_raw": false, 2024-09-14T11:27:24.241 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size": -1, 2024-09-14T11:27:24.241 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size_kb": 0, 2024-09-14T11:27:24.241 INFO:teuthology.orchestra.run.smithi071.stdout: "max_objects": -1 2024-09-14T11:27:24.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T11:27:24.241 INFO:teuthology.orchestra.run.smithi071.stdout: "temp_url_keys": [], 2024-09-14T11:27:24.241 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "rgw", 2024-09-14T11:27:24.241 INFO:teuthology.orchestra.run.smithi071.stdout: "mfa_ids": [], 2024-09-14T11:27:24.241 INFO:teuthology.orchestra.run.smithi071.stdout: "account_id": "", 2024-09-14T11:27:24.241 INFO:teuthology.orchestra.run.smithi071.stdout: "path": "/", 2024-09-14T11:27:24.242 INFO:teuthology.orchestra.run.smithi071.stdout: "create_date": "2024-09-14T11:27:24.235121Z", 2024-09-14T11:27:24.242 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-09-14T11:27:24.242 INFO:teuthology.orchestra.run.smithi071.stdout: "group_ids": [] 2024-09-14T11:27:24.242 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T11:27:24.242 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:27:24.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.239+0000 7fdf1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:27:24.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.243+0000 7fe0696ab9c0 20 remove_watcher() i=0 2024-09-14T11:27:24.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.243+0000 7fe0696ab9c0 2 removed watcher, disabling cache 2024-09-14T11:27:24.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.247+0000 7fe0696ab9c0 20 remove_watcher() i=1 2024-09-14T11:27:24.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.247+0000 7fe0696ab9c0 20 remove_watcher() i=2 2024-09-14T11:27:24.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.251+0000 7fe0696ab9c0 20 remove_watcher() i=3 2024-09-14T11:27:24.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.251+0000 7fe0696ab9c0 20 remove_watcher() i=4 2024-09-14T11:27:24.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.255+0000 7fe0696ab9c0 20 remove_watcher() i=5 2024-09-14T11:27:24.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.259+0000 7fe0696ab9c0 20 remove_watcher() i=6 2024-09-14T11:27:24.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.259+0000 7fe0696ab9c0 20 remove_watcher() i=7 2024-09-14T11:27:24.277 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-14T11:27:24.277 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key VQVQXWPYCCLLVRNHPLDW --secret 09nUQ1VQMaA8m3TxQloUWeJFWYR9k6O9jwJbkKcxYA0hAeyeIlZwOQ== --email sysuser.client.0+test@test.test --system true 2024-09-14T11:27:24.322 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:27:24.322 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:27:24.365 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.367+0000 7f13e67109c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:24.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.367+0000 7f13e67109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:24.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.367+0000 7f13e67109c0 20 realm 2024-09-14T11:27:24.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.367+0000 7f13e67109c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:24.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.371+0000 7f13e67109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:24.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.371+0000 7f13e67109c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:27:24.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.371+0000 7f13e67109c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:24.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.371+0000 7f13e67109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:24.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.371+0000 7f13e67109c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:24.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.371+0000 7f13e67109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:27:24.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.371+0000 7f13e67109c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:24.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.371+0000 7f13e67109c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:27:24.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.371+0000 7f13e67109c0 20 searching for the correct realm 2024-09-14T11:27:24.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.375+0000 7f13e4a17640 0 -- 172.21.15.71:0/3571866398 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f13d8051040 msgr2=0x7f13d8073870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:27:24.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.383+0000 7f13e4a17640 0 -- 172.21.15.71:0/3571866398 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x555c0e379990 msgr2=0x555c0e37bd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:27:24.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.391+0000 7f13e67109c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:27:24.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.391+0000 7f13e67109c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:27:24.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.391+0000 7f13e67109c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:27:24.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.391+0000 7f13e67109c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:27:24.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.391+0000 7f13e67109c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:27:24.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.391+0000 7f13e67109c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:27:24.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.391+0000 7f13e67109c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:24.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.391+0000 7f13e67109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:24.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.391+0000 7f13e67109c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:24.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.391+0000 7f13e67109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:27:24.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.391+0000 7f13e67109c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:24.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.395+0000 7f13e67109c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:27:24.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.395+0000 7f13e67109c0 20 zone default found 2024-09-14T11:27:24.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.395+0000 7f13e67109c0 4 Realm: () 2024-09-14T11:27:24.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.395+0000 7f13e67109c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:27:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.395+0000 7f13e67109c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:27:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.395+0000 7f13e67109c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:27:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.395+0000 7f13e67109c0 20 zonegroup default 2024-09-14T11:27:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.395+0000 7f13e67109c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.395+0000 7f13e67109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.395+0000 7f13e67109c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.395+0000 7f13e67109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:24.394 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.395+0000 7f13e67109c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:24.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.395+0000 7f13e67109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:24.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.395+0000 7f13e67109c0 20 started sync module instance, tier type = 2024-09-14T11:27:24.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.395+0000 7f13e67109c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:27:24.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.411+0000 7f13e67109c0 20 add_watcher() i=0 2024-09-14T11:27:24.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.411+0000 7f13e67109c0 20 add_watcher() i=1 2024-09-14T11:27:24.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.411+0000 7f13e67109c0 20 add_watcher() i=2 2024-09-14T11:27:24.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.411+0000 7f13e67109c0 20 add_watcher() i=3 2024-09-14T11:27:24.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.411+0000 7f13e67109c0 20 add_watcher() i=4 2024-09-14T11:27:24.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.411+0000 7f13e67109c0 20 add_watcher() i=5 2024-09-14T11:27:24.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.411+0000 7f13e67109c0 20 add_watcher() i=6 2024-09-14T11:27:24.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.415+0000 7f13e67109c0 20 add_watcher() i=7 2024-09-14T11:27:24.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.415+0000 7f13e67109c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:27:24.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.419+0000 7f129b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:27:24.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.419+0000 7f13e67109c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:27:24.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.419+0000 7f13e67109c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:27:24.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.419+0000 7f13e67109c0 5 note: GC not initialized 2024-09-14T11:27:24.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.419+0000 7f129a7dc640 20 reqs_thread_entry: start 2024-09-14T11:27:24.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.419+0000 7f13e67109c0 20 init_complete bucket index max shards: 11 2024-09-14T11:27:24.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.419+0000 7f13e67109c0 20 Filter name: none 2024-09-14T11:27:24.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.419+0000 7f13e67109c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-14T11:27:24.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.419+0000 7f13e67109c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:24.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.419+0000 7f12937fe640 20 reqs_thread_entry: start 2024-09-14T11:27:24.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.419+0000 7f13e67109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:24.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.419+0000 7f13e67109c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-14T11:27:24.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.419+0000 7f13e67109c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:27:24.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.419+0000 7f13e67109c0 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-14T11:27:24.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.419+0000 7f13e67109c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:24.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.419+0000 7f13e67109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:24.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.419+0000 7f13e67109c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-14T11:27:24.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.419+0000 7f13e67109c0 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:27:24.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.419+0000 7f13e67109c0 10 cache get: name=default.rgw.meta+users.keys+VQVQXWPYCCLLVRNHPLDW : miss 2024-09-14T11:27:24.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.419+0000 7f13e67109c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:24.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.423+0000 7f13e67109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:24.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.423+0000 7f13e67109c0 10 cache put: name=default.rgw.meta+users.keys+VQVQXWPYCCLLVRNHPLDW info.flags=0x0 2024-09-14T11:27:24.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.423+0000 7f13e67109c0 10 adding default.rgw.meta+users.keys+VQVQXWPYCCLLVRNHPLDW to cache LRU end 2024-09-14T11:27:24.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.423+0000 7f13e67109c0 10 cache get: name=default.rgw.meta+users.keys+VQVQXWPYCCLLVRNHPLDW : hit (negative entry) 2024-09-14T11:27:24.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.423+0000 7f13e67109c0 10 cache get: name=default.rgw.meta+users.keys+VQVQXWPYCCLLVRNHPLDW : hit (negative entry) 2024-09-14T11:27:24.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.423+0000 7f13e67109c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-14T11:27:24.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.423+0000 7f13e67109c0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:27:24.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.423+0000 7f13e67109c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-14T11:27:24.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.423+0000 7f12bb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660492 cookie 93853863912624 notifier 5901 bl.length()=675 2024-09-14T11:27:24.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.423+0000 7f12bb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-14T11:27:24.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.423+0000 7f12bb7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:27:24.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.427+0000 7f13e67109c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-14T11:27:24.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.427+0000 7f13e67109c0 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:27:24.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.427+0000 7f13e67109c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-14T11:27:24.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.427+0000 7f12baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660539 cookie 93853863916448 notifier 5901 bl.length()=202 2024-09-14T11:27:24.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.427+0000 7f12baffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-14T11:27:24.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.427+0000 7f12baffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:27:24.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.431+0000 7f13e67109c0 10 cache put: name=default.rgw.meta+users.keys+VQVQXWPYCCLLVRNHPLDW info.flags=0x7 2024-09-14T11:27:24.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.431+0000 7f13e67109c0 10 moving default.rgw.meta+users.keys+VQVQXWPYCCLLVRNHPLDW to cache LRU end 2024-09-14T11:27:24.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.431+0000 7f13e67109c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:VQVQXWPYCCLLVRNHPLDW, ofs0, ns] 2024-09-14T11:27:24.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.431+0000 7f12bb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660551 cookie 93853863922320 notifier 5901 bl.length()=190 2024-09-14T11:27:24.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.431+0000 7f12bb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+VQVQXWPYCCLLVRNHPLDW info.flags=0x7 2024-09-14T11:27:24.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.431+0000 7f12bb7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+VQVQXWPYCCLLVRNHPLDW to cache LRU end 2024-09-14T11:27:24.432 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T11:27:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: "user_id": "sysuser.client.0", 2024-09-14T11:27:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-14T11:27:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-14T11:27:24.432 INFO:teuthology.orchestra.run.smithi071.stdout: "suspended": 0, 2024-09-14T11:27:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: "max_buckets": 1000, 2024-09-14T11:27:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: "subusers": [], 2024-09-14T11:27:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: "keys": [ 2024-09-14T11:27:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T11:27:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: "user": "sysuser.client.0", 2024-09-14T11:27:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: "access_key": "VQVQXWPYCCLLVRNHPLDW", 2024-09-14T11:27:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: "secret_key": "09nUQ1VQMaA8m3TxQloUWeJFWYR9k6O9jwJbkKcxYA0hAeyeIlZwOQ==", 2024-09-14T11:27:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: "active": true, 2024-09-14T11:27:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: "create_date": "2024-09-14T11:27:24.426660Z" 2024-09-14T11:27:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T11:27:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-14T11:27:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: "swift_keys": [], 2024-09-14T11:27:24.433 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": [], 2024-09-14T11:27:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: "op_mask": "read, write, delete", 2024-09-14T11:27:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: "system": true, 2024-09-14T11:27:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: "default_placement": "", 2024-09-14T11:27:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: "default_storage_class": "", 2024-09-14T11:27:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: "placement_tags": [], 2024-09-14T11:27:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: "bucket_quota": { 2024-09-14T11:27:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": false, 2024-09-14T11:27:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: "check_on_raw": false, 2024-09-14T11:27:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size": -1, 2024-09-14T11:27:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size_kb": 0, 2024-09-14T11:27:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: "max_objects": -1 2024-09-14T11:27:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T11:27:24.434 INFO:teuthology.orchestra.run.smithi071.stdout: "user_quota": { 2024-09-14T11:27:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": false, 2024-09-14T11:27:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: "check_on_raw": false, 2024-09-14T11:27:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size": -1, 2024-09-14T11:27:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size_kb": 0, 2024-09-14T11:27:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: "max_objects": -1 2024-09-14T11:27:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T11:27:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: "temp_url_keys": [], 2024-09-14T11:27:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "rgw", 2024-09-14T11:27:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: "mfa_ids": [], 2024-09-14T11:27:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: "account_id": "", 2024-09-14T11:27:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: "path": "/", 2024-09-14T11:27:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: "create_date": "2024-09-14T11:27:24.426603Z", 2024-09-14T11:27:24.435 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-09-14T11:27:24.436 INFO:teuthology.orchestra.run.smithi071.stdout: "group_ids": [] 2024-09-14T11:27:24.436 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T11:27:24.436 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:27:24.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.435+0000 7f129b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:27:24.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.439+0000 7f13e67109c0 20 remove_watcher() i=0 2024-09-14T11:27:24.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.439+0000 7f13e67109c0 2 removed watcher, disabling cache 2024-09-14T11:27:24.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.439+0000 7f13e67109c0 20 remove_watcher() i=1 2024-09-14T11:27:24.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.443+0000 7f13e67109c0 20 remove_watcher() i=2 2024-09-14T11:27:24.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.443+0000 7f13e67109c0 20 remove_watcher() i=3 2024-09-14T11:27:24.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.447+0000 7f13e67109c0 20 remove_watcher() i=4 2024-09-14T11:27:24.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.447+0000 7f13e67109c0 20 remove_watcher() i=5 2024-09-14T11:27:24.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.451+0000 7f13e67109c0 20 remove_watcher() i=6 2024-09-14T11:27:24.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:24.455+0000 7f13e67109c0 20 remove_watcher() i=7 2024-09-14T11:27:24.467 INFO:tasks.ragweed:Configuring ragweed... 2024-09-14T11:27:24.468 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T11:27:24.468 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-14T11:27:24.473 INFO:tasks.ragweed:Configuring boto... 2024-09-14T11:27:24.473 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T11:27:24.473 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-14T11:27:24.521 DEBUG:teuthology.orchestra.run.smithi071:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-14T11:27:24.710 INFO:teuthology.orchestra.run.smithi071.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-14T11:27:24.885 INFO:teuthology.orchestra.run.smithi071.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-14T11:27:25.497 INFO:teuthology.orchestra.run.smithi071.stdout:py installdeps: -rrequirements.txt 2024-09-14T11:27:28.173 INFO:teuthology.orchestra.run.smithi071.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-14T11:27:32.711 INFO:teuthology.orchestra.run.smithi071.stdout:py installed: appdirs==1.4.4,asyncssh==2.5.0,attrs==21.2.0,Babel==2.8.0,bcrypt==3.2.0,beautifulsoup4==4.10.0,beniget==0.4.1,blinker==1.4,boto==2.49.0,Brotli==1.0.9,cachetools==5.0.0,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2020.6.20,chardet==4.0.0,cheroot==8.5.2+ds1,CherryPy==18.6.1,command-not-found==0.3,configobj==5.0.6,cryptography==3.4.8,cycler==0.11.0,dbus-python==1.2.18,decorator==4.4.2,distlib==0.3.4,distro==1.7.0,distro-info===1.1build1,docopt==0.6.2,execnet==1.9.0,filelock==3.6.0,fonttools==4.29.1,fs==2.4.12,gast==0.5.2,gevent==21.8.0,google-auth==1.5.1,greenlet==1.1.2,html5lib==1.1,httplib2==0.20.2,idna==3.3,importlib-metadata==4.6.4,iniconfig==1.1.1,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.4.0,jaraco.functools==3.4.0,jaraco.text==3.6.0,jeepney==0.7.1,Jinja2==3.0.3,joblib==0.17.0,keyring==23.5.0,kiwisolver==1.3.2,kubernetes==12.0.1,language-selector==0.1,launchpadlib==1.10.16,lazr.restfulclient==0.14.4,lazr.uri==1.0.6,logutils==0.3.3,lxml==4.8.0,lz4==3.1.3+dfsg,Mako==1.1.3,MarkupSafe==2.0.1,matplotlib==3.5.1,more-itertools==8.10.0,mpmath==0.0.0,munch==4.0.0,natsort==8.0.2,netifaces==0.11.0,nose==1.3.7,numpy==1.21.5,oauthlib==3.2.0,olefile==0.46,packaging==21.3,Paste==3.5.0,PasteDeploy==2.1.1,PasteScript==2.0.2,pecan==1.3.3,Pillow==9.0.1,platformdirs==2.5.1,pluggy==0.13.0,ply==3.11,portend==3.0.0,prettytable==2.5.0,psutil==5.9.0,py==1.10.0,pyasn1==0.4.8,pyasn1-modules==0.2.1,Pygments==2.11.2,PyGObject==3.42.1,pyinotify==0.9.6,PyJWT==2.3.0,pymacaroons==0.13.0,PyNaCl==1.5.0,pyOpenSSL==21.0.0,pyparsing==2.4.7,pytest==6.2.5,python-apt==2.3.0+ubuntu2.1,python-dateutil==2.8.1,python-magic==0.4.24,pythran==0.10.0,pytz==2022.1,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=9886744d0f71550742e61ab466bcaea14c8e8331a46731980385ac4c1554a98e,rbd==2.0.0,registries-conf-ctl @ git+https://github.com/sebastian-philipp/registries-conf-ctl@0e9bf2dc202aa9be9b0bf8e8265aac3f2308f9db,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rsa==4.8,s3cmd==2.2.0,scikit-learn==0.23.2,scipy==1.8.0,SecretStorage==3.3.1,simplegeneric==0.8.1,simplejson==3.17.6,six==1.16.0,soupsieve==2.3.1,ssh-import-id==5.11,sympy==1.9,Tempita==0.5.2,tempora==4.1.2,threadpoolctl==3.1.0,toml==0.10.2,ubuntu-advantage-tools==27.12,ufoLib2==0.13.1,ufw==0.36.1,unattended-upgrades==0.1,unicodedata2==14.0.0,urllib3==1.26.5,virtualenv==20.13.0+ds,wadllib==1.3.6,waitress==1.4.4,wcwidth==0.2.5,webencodings==0.5.1,WebOb==1.8.6,websocket-client==1.2.3,WebTest==2.0.35,Werkzeug==2.0.2,zc.lockfile==2.0,zipp==1.0.0,zope.event==4.4,zope.interface==5.4.0 2024-09-14T11:27:32.712 INFO:teuthology.orchestra.run.smithi071.stdout:py run-test-pre: PYTHONHASHSEED='3194841483' 2024-09-14T11:27:32.712 INFO:teuthology.orchestra.run.smithi071.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-14T11:27:32.890 INFO:teuthology.orchestra.run.smithi071.stdout:============================= test session starts ============================== 2024-09-14T11:27:32.891 INFO:teuthology.orchestra.run.smithi071.stdout:platform linux -- Python 3.10.6, pytest-6.2.5, py-1.10.0, pluggy-0.13.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-14T11:27:32.891 INFO:teuthology.orchestra.run.smithi071.stdout:cachedir: .tox/py/.pytest_cache 2024-09-14T11:27:32.891 INFO:teuthology.orchestra.run.smithi071.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0, configfile: pytest.ini 2024-09-14T11:27:33.050 INFO:teuthology.orchestra.run.smithi071.stdout:collecting ... collected 9 items 2024-09-14T11:27:33.050 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:27:33.856 INFO:teuthology.orchestra.run.smithi071.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-14T11:27:34.734 INFO:teuthology.orchestra.run.smithi071.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-14T11:27:35.431 INFO:teuthology.orchestra.run.smithi071.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-14T11:27:36.351 INFO:teuthology.orchestra.run.smithi071.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-14T11:27:37.277 INFO:teuthology.orchestra.run.smithi071.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-14T11:27:43.394 INFO:teuthology.orchestra.run.smithi071.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-14T11:27:45.542 INFO:teuthology.orchestra.run.smithi071.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-14T11:27:47.368 INFO:teuthology.orchestra.run.smithi071.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-14T11:27:50.913 INFO:teuthology.orchestra.run.smithi071.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-14T11:27:50.913 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:27:50.913 INFO:teuthology.orchestra.run.smithi071.stdout:=============================== warnings summary =============================== 2024-09-14T11:27:50.913 INFO:teuthology.orchestra.run.smithi071.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-14T11:27:50.913 INFO:teuthology.orchestra.run.smithi071.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-14T11:27:50.913 INFO:teuthology.orchestra.run.smithi071.stdout: import imp 2024-09-14T11:27:50.913 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:27:50.913 INFO:teuthology.orchestra.run.smithi071.stdout:-- Docs: https://docs.pytest.org/en/stable/warnings.html 2024-09-14T11:27:50.913 INFO:teuthology.orchestra.run.smithi071.stdout:======================== 9 passed, 1 warning in 18.02s ========================= 2024-09-14T11:27:50.959 INFO:teuthology.orchestra.run.smithi071.stdout:___________________________________ summary ____________________________________ 2024-09-14T11:27:50.959 INFO:teuthology.orchestra.run.smithi071.stdout: py: commands succeeded 2024-09-14T11:27:50.959 INFO:teuthology.orchestra.run.smithi071.stdout: congratulations :) 2024-09-14T11:27:50.983 INFO:tasks.ragweed:Cleaning up boto... 2024-09-14T11:27:50.983 DEBUG:teuthology.orchestra.run.smithi071:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-14T11:27:50.989 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-14T11:27:51.067 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:27:51.067 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:27:51.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.107+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:51.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.111+0000 7faa387349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:51.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.111+0000 7faa387349c0 20 realm 2024-09-14T11:27:51.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.111+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:51.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.111+0000 7faa387349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:51.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.111+0000 7faa387349c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:27:51.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.111+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:51.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.111+0000 7faa387349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:51.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.111+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:51.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.115+0000 7faa387349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:27:51.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.115+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:51.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.115+0000 7faa387349c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:27:51.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.115+0000 7faa387349c0 20 searching for the correct realm 2024-09-14T11:27:51.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.119+0000 7faa36a3b640 0 -- 172.21.15.71:0/206247699 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7faa2c02f060 msgr2=0x7faa2c0629c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:27:51.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.331+0000 7faa36a3b640 0 -- 172.21.15.71:0/206247699 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55fa68647f90 msgr2=0x55fa6864a380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:27:51.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.347+0000 7faa387349c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:27:51.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.347+0000 7faa387349c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:27:51.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.347+0000 7faa387349c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:27:51.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.347+0000 7faa387349c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:27:51.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.347+0000 7faa387349c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:27:51.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.347+0000 7faa387349c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:27:51.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.347+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:51.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.347+0000 7faa387349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:51.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.347+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:51.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.347+0000 7faa387349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:27:51.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.347+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:51.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.351+0000 7faa387349c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:27:51.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.351+0000 7faa387349c0 20 zone default found 2024-09-14T11:27:51.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.351+0000 7faa387349c0 4 Realm: () 2024-09-14T11:27:51.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.351+0000 7faa387349c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:27:51.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.351+0000 7faa387349c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:27:51.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.351+0000 7faa387349c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:27:51.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.351+0000 7faa387349c0 20 zonegroup default 2024-09-14T11:27:51.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.351+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:51.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.351+0000 7faa387349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:51.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.351+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:51.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.351+0000 7faa387349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:51.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.351+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:51.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.351+0000 7faa387349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:51.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.351+0000 7faa387349c0 20 started sync module instance, tier type = 2024-09-14T11:27:51.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.351+0000 7faa387349c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:27:51.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.375+0000 7faa387349c0 20 add_watcher() i=0 2024-09-14T11:27:51.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.375+0000 7faa387349c0 20 add_watcher() i=1 2024-09-14T11:27:51.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.375+0000 7faa387349c0 20 add_watcher() i=2 2024-09-14T11:27:51.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.375+0000 7faa387349c0 20 add_watcher() i=3 2024-09-14T11:27:51.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.375+0000 7faa387349c0 20 add_watcher() i=4 2024-09-14T11:27:51.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.375+0000 7faa387349c0 20 add_watcher() i=5 2024-09-14T11:27:51.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.375+0000 7faa387349c0 20 add_watcher() i=6 2024-09-14T11:27:51.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.379+0000 7faa387349c0 20 add_watcher() i=7 2024-09-14T11:27:51.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.379+0000 7faa387349c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:27:51.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.383+0000 7fa8ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:27:51.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.383+0000 7faa387349c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:27:51.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.383+0000 7faa387349c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:27:51.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.471+0000 7fa8677fe640 20 reqs_thread_entry: start 2024-09-14T11:27:51.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.471+0000 7faa387349c0 20 init_complete bucket index max shards: 11 2024-09-14T11:27:51.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.471+0000 7faa387349c0 20 Filter name: none 2024-09-14T11:27:51.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.471+0000 7fa8657fa640 20 reqs_thread_entry: start 2024-09-14T11:27:51.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.471+0000 7faa387349c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-14T11:27:51.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.471+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:51.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.475+0000 7faa387349c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:27:51.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.475+0000 7faa387349c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-14T11:27:51.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.475+0000 7faa387349c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:27:51.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.475+0000 7faa387349c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:27:51.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.475+0000 7faa387349c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:4444f441-0c56-48df-a905-d49e7e44d629.4596.5 : miss 2024-09-14T11:27:51.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.475+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:51.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.475+0000 7faa387349c0 20 rados_obj.operate() r=0 bl.length=426 2024-09-14T11:27:51.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.475+0000 7faa387349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:4444f441-0c56-48df-a905-d49e7e44d629.4596.5 info.flags=0x17 2024-09-14T11:27:51.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.475+0000 7faa387349c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:4444f441-0c56-48df-a905-d49e7e44d629.4596.5 to cache LRU end 2024-09-14T11:27:51.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.475+0000 7faa387349c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:27:51.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.475+0000 7faa387349c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:27:51.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.475+0000 7faa387349c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:4444f441-0c56-48df-a905-d49e7e44d629.4596.5 2024-09-14T11:27:51.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.479+0000 7faa387349c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-14T11:27:51.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.479+0000 7faa387349c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-14T11:27:51.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.479+0000 7faa387349c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-14T11:27:51.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.479+0000 7faa387349c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-14T11:27:51.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.479+0000 7faa387349c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-14T11:27:51.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.479+0000 7faa387349c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-14T11:27:51.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.483+0000 7faa387349c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-14T11:27:51.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.483+0000 7faa387349c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-14T11:27:51.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.483+0000 7faa387349c0 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-14T11:27:51.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.483+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2c082b90 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55fa686fe048 s->prefetch_data=0 2024-09-14T11:27:51.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.487+0000 7faa387349c0 10 manifest: total_size = 7744 2024-09-14T11:27:51.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.487+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.14025977292362122266 2024-09-14T11:27:51.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.487+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2c082b90 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55fa686fe048 s->prefetch_data=0 2024-09-14T11:27:51.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.487+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa686fe048 2024-09-14T11:27:51.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.487+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.5.1 2024-09-14T11:27:51.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.491+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2c082b90 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55fa68688a78 s->prefetch_data=0 2024-09-14T11:27:51.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.491+0000 7faa387349c0 10 manifest: total_size = 12813 2024-09-14T11:27:51.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.491+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.1412161319491922018 2024-09-14T11:27:51.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.491+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2c082b90 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55fa68688a78 s->prefetch_data=0 2024-09-14T11:27:51.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.491+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68688a78 2024-09-14T11:27:51.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.491+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.5.2 2024-09-14T11:27:51.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.495+0000 7fa919ffb640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-14T11:27:51.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.499+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2c082b90 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55fa68688a78 s->prefetch_data=0 2024-09-14T11:27:51.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.499+0000 7faa387349c0 10 manifest: total_size = 5284 2024-09-14T11:27:51.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.499+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.6229246305111921187 2024-09-14T11:27:51.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.499+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2c082b90 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55fa68688a78 s->prefetch_data=0 2024-09-14T11:27:51.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.499+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68688a78 2024-09-14T11:27:51.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.499+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.5.2 2024-09-14T11:27:51.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.499+0000 7fa9197fa640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-14T11:27:51.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.503+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2c082b90 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55fa68688a78 s->prefetch_data=0 2024-09-14T11:27:51.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.503+0000 7faa387349c0 10 manifest: total_size = 13088 2024-09-14T11:27:51.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.503+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.5724643626773656371 2024-09-14T11:27:51.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.503+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2c082b90 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55fa68688a78 s->prefetch_data=0 2024-09-14T11:27:51.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.503+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68688a78 2024-09-14T11:27:51.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.503+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.5.3 2024-09-14T11:27:51.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.507+0000 7fa919ffb640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-14T11:27:51.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.511+0000 7faa387349c0 20 get_obj_state: octx=0x55fa686ff670 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55fa68688a78 s->prefetch_data=0 2024-09-14T11:27:51.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.511+0000 7faa387349c0 10 manifest: total_size = 13074 2024-09-14T11:27:51.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.511+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.3809060820765183997 2024-09-14T11:27:51.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.511+0000 7faa387349c0 20 get_obj_state: octx=0x55fa686ff670 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55fa68688a78 s->prefetch_data=0 2024-09-14T11:27:51.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.511+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68688a78 2024-09-14T11:27:51.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.511+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.5.4 2024-09-14T11:27:51.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.515+0000 7fa9197fa640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-14T11:27:51.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.515+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2805d950 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55fa68688a78 s->prefetch_data=0 2024-09-14T11:27:51.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.515+0000 7faa387349c0 10 manifest: total_size = 13552 2024-09-14T11:27:51.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.515+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.17869612327105109210 2024-09-14T11:27:51.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.515+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2805d950 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55fa68688a78 s->prefetch_data=0 2024-09-14T11:27:51.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.515+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68688a78 2024-09-14T11:27:51.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.515+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.5.4 2024-09-14T11:27:51.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.519+0000 7fa919ffb640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-14T11:27:51.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.523+0000 7faa387349c0 20 get_obj_state: octx=0x55fa6865cc90 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55fa68688a78 s->prefetch_data=0 2024-09-14T11:27:51.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.523+0000 7faa387349c0 10 manifest: total_size = 7508 2024-09-14T11:27:51.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.523+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.16110142547577169535 2024-09-14T11:27:51.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.523+0000 7faa387349c0 20 get_obj_state: octx=0x55fa6865cc90 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55fa68688a78 s->prefetch_data=0 2024-09-14T11:27:51.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.523+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68688a78 2024-09-14T11:27:51.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.523+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.5.5 2024-09-14T11:27:51.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.527+0000 7fa9197fa640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-14T11:27:51.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.531+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2805d950 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55fa68688a78 s->prefetch_data=0 2024-09-14T11:27:51.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.531+0000 7faa387349c0 10 manifest: total_size = 5420 2024-09-14T11:27:51.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.531+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.17984823669110183756 2024-09-14T11:27:51.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.531+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2805d950 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55fa68688a78 s->prefetch_data=0 2024-09-14T11:27:51.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.531+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68688a78 2024-09-14T11:27:51.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.531+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.5.7 2024-09-14T11:27:51.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.531+0000 7fa919ffb640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-14T11:27:51.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.535+0000 7faa387349c0 20 get_obj_state: octx=0x55fa6865cc90 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55fa68688a78 s->prefetch_data=0 2024-09-14T11:27:51.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.535+0000 7faa387349c0 10 manifest: total_size = 7737 2024-09-14T11:27:51.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.535+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.4479507180852165677 2024-09-14T11:27:51.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.535+0000 7faa387349c0 20 get_obj_state: octx=0x55fa6865cc90 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55fa68688a78 s->prefetch_data=0 2024-09-14T11:27:51.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.535+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68688a78 2024-09-14T11:27:51.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.535+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.5.8 2024-09-14T11:27:51.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.539+0000 7fa9197fa640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-14T11:27:51.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.543+0000 7faa387349c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:27:51.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.543+0000 7faa387349c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:27:51.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.543+0000 7fa919ffb640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-14T11:27:51.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.543+0000 7faa387349c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:27:51.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.543+0000 7faa387349c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:27:51.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.543+0000 7faa387349c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:27:51.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.543+0000 7faa387349c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:27:51.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.543+0000 7faa387349c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[4444f441-0c56-48df-a905-d49e7e44d629.4596.5])"; uploads.size()=0; is_truncated=0 2024-09-14T11:27:51.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.547+0000 7faa387349c0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-14T11:27:51.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.547+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:51.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.547+0000 7faa387349c0 20 rados_obj.operate() r=0 bl.length=204 2024-09-14T11:27:51.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.547+0000 7faa387349c0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-14T11:27:51.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.547+0000 7faa387349c0 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-14T11:27:51.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.551+0000 7faa387349c0 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-14T11:27:51.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.551+0000 7faa387349c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-14T11:27:51.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.551+0000 7fa919ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464273 cookie 94533981607312 notifier 5931 bl.length()=162 2024-09-14T11:27:51.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.555+0000 7faa387349c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:4444f441-0c56-48df-a905-d49e7e44d629.4596.5 from cache 2024-09-14T11:27:51.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.555+0000 7faa387349c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:4444f441-0c56-48df-a905-d49e7e44d629.4596.5, ofs0, ns] 2024-09-14T11:27:51.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.555+0000 7fa9197fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464336 cookie 94533981647664 notifier 5931 bl.length()=219 2024-09-14T11:27:51.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.563+0000 7faa387349c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/4444f441-0c56-48df-a905-d49e7e44d629.4596.5 : miss 2024-09-14T11:27:51.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.563+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:51.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.563+0000 7faa387349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:51.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.563+0000 7faa387349c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/4444f441-0c56-48df-a905-d49e7e44d629.4596.5 info.flags=0x0 2024-09-14T11:27:51.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.563+0000 7faa387349c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/4444f441-0c56-48df-a905-d49e7e44d629.4596.5 to cache LRU end 2024-09-14T11:27:51.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.571+0000 7faa387349c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.12 : miss 2024-09-14T11:27:51.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.571+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:51.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.571+0000 7faa387349c0 20 rados_obj.operate() r=0 bl.length=457 2024-09-14T11:27:51.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.571+0000 7faa387349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.12 info.flags=0x17 2024-09-14T11:27:51.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.571+0000 7faa387349c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.12 to cache LRU end 2024-09-14T11:27:51.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.571+0000 7faa387349c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:27:51.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.571+0000 7faa387349c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:27:51.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.571+0000 7faa387349c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.12 2024-09-14T11:27:51.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.579+0000 7faa387349c0 10 cls_bucket_list_unordered: got foo 2024-09-14T11:27:51.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.579+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2805d950 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55fa68688a78 s->prefetch_data=0 2024-09-14T11:27:51.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.579+0000 7faa387349c0 10 manifest: total_size = 74198 2024-09-14T11:27:51.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.579+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.3191211840646490391 2024-09-14T11:27:51.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.579+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2805d950 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55fa68688a78 s->prefetch_data=0 2024-09-14T11:27:51.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.579+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68688a78 2024-09-14T11:27:51.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.579+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.12.10 2024-09-14T11:27:51.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.587+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:27:51.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.587+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-09-14T11:27:51.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.587+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-14T11:27:51.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.587+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:27:51.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.587+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2024-09-14T11:27:51.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.587+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-14T11:27:51.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.587+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:27:51.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.587+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=20613 2024-09-14T11:27:51.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.587+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-14T11:27:51.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.587+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-14T11:27:51.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.587+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=4256143 part_ofs=61839 rule->part_size=12359 2024-09-14T11:27:51.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.587+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-14T11:27:51.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.587+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.3191211840646490391 2024-09-14T11:27:51.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.587+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:51.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.587+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.12__multipart_foo.2~RgUV0a2AutdXXNPezH4-p8Y_HGHBtFw.1 2024-09-14T11:27:51.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.587+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-14T11:27:51.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.587+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.12__multipart_foo.2~RgUV0a2AutdXXNPezH4-p8Y_HGHBtFw.2 2024-09-14T11:27:51.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.587+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-14T11:27:51.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.587+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.12__multipart_foo.2~RgUV0a2AutdXXNPezH4-p8Y_HGHBtFw.3 2024-09-14T11:27:51.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.587+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-14T11:27:51.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.587+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.12__multipart_foo.2~RgUV0a2AutdXXNPezH4-p8Y_HGHBtFw.4 2024-09-14T11:27:51.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.587+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-14T11:27:51.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.587+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:51.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.587+0000 7faa387349c0 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.3191211840646490391 2024-09-14T11:27:51.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.587+0000 7fa9197fa640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:27:51.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.591+0000 7faa387349c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:27:51.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.591+0000 7faa387349c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:27:51.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.591+0000 7faa387349c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:27:51.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.591+0000 7faa387349c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:27:51.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.591+0000 7faa387349c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:27:51.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.591+0000 7faa387349c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:27:51.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.591+0000 7faa387349c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[4444f441-0c56-48df-a905-d49e7e44d629.4596.12])"; uploads.size()=0; is_truncated=0 2024-09-14T11:27:51.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.595+0000 7faa387349c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-14T11:27:51.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.595+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:51.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.595+0000 7faa387349c0 20 rados_obj.operate() r=0 bl.length=235 2024-09-14T11:27:51.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.595+0000 7faa387349c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-14T11:27:51.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.595+0000 7faa387349c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-14T11:27:51.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.599+0000 7faa387349c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-14T11:27:51.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.599+0000 7faa387349c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-14T11:27:51.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.599+0000 7fa9197fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464327 cookie 94533981609520 notifier 5931 bl.length()=191 2024-09-14T11:27:51.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.599+0000 7faa387349c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.12 from cache 2024-09-14T11:27:51.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.599+0000 7faa387349c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.12, ofs0, ns] 2024-09-14T11:27:51.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.603+0000 7fa919ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464328 cookie 94533981642896 notifier 5931 bl.length()=249 2024-09-14T11:27:51.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.607+0000 7faa387349c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/4444f441-0c56-48df-a905-d49e7e44d629.4596.12 : miss 2024-09-14T11:27:51.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.607+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:51.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.607+0000 7faa387349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:51.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.607+0000 7faa387349c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/4444f441-0c56-48df-a905-d49e7e44d629.4596.12 info.flags=0x0 2024-09-14T11:27:51.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.607+0000 7faa387349c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/4444f441-0c56-48df-a905-d49e7e44d629.4596.12 to cache LRU end 2024-09-14T11:27:51.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.611+0000 7faa387349c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.13 : miss 2024-09-14T11:27:51.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.611+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:51.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.615+0000 7faa387349c0 20 rados_obj.operate() r=0 bl.length=464 2024-09-14T11:27:51.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.615+0000 7faa387349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.13 info.flags=0x17 2024-09-14T11:27:51.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.615+0000 7faa387349c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.13 to cache LRU end 2024-09-14T11:27:51.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.615+0000 7faa387349c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:27:51.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.615+0000 7faa387349c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:27:51.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.615+0000 7faa387349c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.13 2024-09-14T11:27:51.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.623+0000 7faa387349c0 10 cls_bucket_list_unordered: got foo 2024-09-14T11:27:51.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.623+0000 7faa387349c0 20 get_obj_state: octx=0x55fa686ff5b0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55fa68686128 s->prefetch_data=0 2024-09-14T11:27:51.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.623+0000 7faa387349c0 10 manifest: total_size = 74198 2024-09-14T11:27:51.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.623+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.13092448305453608123 2024-09-14T11:27:51.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.623+0000 7faa387349c0 20 get_obj_state: octx=0x55fa686ff5b0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55fa68686128 s->prefetch_data=0 2024-09-14T11:27:51.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.623+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68686128 2024-09-14T11:27:51.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.623+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.13.10 2024-09-14T11:27:51.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.631+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:27:51.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.631+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-09-14T11:27:51.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.631+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-14T11:27:51.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.631+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:27:51.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.631+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2024-09-14T11:27:51.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.631+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-14T11:27:51.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.631+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:27:51.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.631+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=20613 2024-09-14T11:27:51.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.631+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-14T11:27:51.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.631+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-14T11:27:51.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.631+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=4256143 part_ofs=61839 rule->part_size=12359 2024-09-14T11:27:51.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.631+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-14T11:27:51.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.631+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.13092448305453608123 2024-09-14T11:27:51.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.631+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:51.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.631+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.13__multipart_foo.2~6R_Xep2QplJg4wL2LIgbe5EgHgL5iSh.1 2024-09-14T11:27:51.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.631+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-14T11:27:51.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.631+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.13__multipart_foo.2~6R_Xep2QplJg4wL2LIgbe5EgHgL5iSh.2 2024-09-14T11:27:51.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.631+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-14T11:27:51.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.631+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.13__multipart_foo.2~6R_Xep2QplJg4wL2LIgbe5EgHgL5iSh.3 2024-09-14T11:27:51.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.631+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-14T11:27:51.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.631+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.13__multipart_foo.2~6R_Xep2QplJg4wL2LIgbe5EgHgL5iSh.4 2024-09-14T11:27:51.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.631+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-14T11:27:51.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.631+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:51.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.631+0000 7faa387349c0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.13092448305453608123 2024-09-14T11:27:51.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.631+0000 7fa9197fa640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:27:51.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.635+0000 7faa387349c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:27:51.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.635+0000 7faa387349c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:27:51.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.635+0000 7faa387349c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:27:51.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.635+0000 7faa387349c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:27:51.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.635+0000 7faa387349c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:27:51.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.635+0000 7faa387349c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:27:51.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.635+0000 7faa387349c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[4444f441-0c56-48df-a905-d49e7e44d629.4596.13])"; uploads.size()=0; is_truncated=0 2024-09-14T11:27:51.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.639+0000 7faa387349c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-14T11:27:51.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.639+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:51.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.639+0000 7faa387349c0 20 rados_obj.operate() r=0 bl.length=242 2024-09-14T11:27:51.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.639+0000 7faa387349c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-14T11:27:51.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.639+0000 7faa387349c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-14T11:27:51.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.643+0000 7faa387349c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-14T11:27:51.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.643+0000 7faa387349c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-14T11:27:51.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.643+0000 7fa919ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464275 cookie 94533981637232 notifier 5931 bl.length()=198 2024-09-14T11:27:51.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.647+0000 7faa387349c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.13 from cache 2024-09-14T11:27:51.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.647+0000 7faa387349c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.13, ofs0, ns] 2024-09-14T11:27:51.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.647+0000 7fa919ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464329 cookie 94533981609520 notifier 5931 bl.length()=256 2024-09-14T11:27:51.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.651+0000 7faa387349c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/4444f441-0c56-48df-a905-d49e7e44d629.4596.13 : miss 2024-09-14T11:27:51.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.651+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:51.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.651+0000 7faa387349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:51.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.651+0000 7faa387349c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/4444f441-0c56-48df-a905-d49e7e44d629.4596.13 info.flags=0x0 2024-09-14T11:27:51.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.651+0000 7faa387349c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/4444f441-0c56-48df-a905-d49e7e44d629.4596.13 to cache LRU end 2024-09-14T11:27:51.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.659+0000 7faa387349c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.11 : miss 2024-09-14T11:27:51.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.659+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:51.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.659+0000 7faa387349c0 20 rados_obj.operate() r=0 bl.length=459 2024-09-14T11:27:51.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.659+0000 7faa387349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.11 info.flags=0x17 2024-09-14T11:27:51.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.659+0000 7faa387349c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.11 to cache LRU end 2024-09-14T11:27:51.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.659+0000 7faa387349c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:27:51.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.659+0000 7faa387349c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:27:51.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.659+0000 7faa387349c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.11 2024-09-14T11:27:51.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.667+0000 7faa387349c0 10 cls_bucket_list_unordered: got foo[92m0MwMBUyBbbOitV0sUykjkbr7kurJ] 2024-09-14T11:27:51.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.667+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.11.10 2024-09-14T11:27:51.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.667+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2805d2f0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55fa68684af8 s->prefetch_data=0 2024-09-14T11:27:51.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.667+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 8zz868pnjvctugkt0atxowvck1dip6yg 2024-09-14T11:27:51.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.667+0000 7faa387349c0 20 get_obj_state_impl: setting s->olh_tag to pfzr5hv416d3qeu0yjbwo4lhhobly3du 2024-09-14T11:27:51.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.667+0000 7faa387349c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=pfzr5hv416d3qeu0yjbwo4lhhobly3du 2024-09-14T11:27:51.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.671+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.11.10 2024-09-14T11:27:51.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.675+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.11.10 2024-09-14T11:27:51.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.675+0000 7faa387349c0 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-14T11:27:51.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.675+0000 7faa387349c0 20 olh_log_entry: epoch=3 op=3 key=foo[92m0MwMBUyBbbOitV0sUykjkbr7kurJ] 2024-09-14T11:27:51.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.675+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2805d2f0 obj=test-client.0-r-test-multipart-index-versioning.1:_:92m0MwMBUyBbbOitV0sUykjkbr7kurJ_foo state=0x55fa686ae3f8 s->prefetch_data=0 2024-09-14T11:27:51.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.675+0000 7faa387349c0 10 manifest: total_size = 74198 2024-09-14T11:27:51.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.675+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.9686345642249279478 2024-09-14T11:27:51.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.675+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2805d2f0 obj=test-client.0-r-test-multipart-index-versioning.1:_:92m0MwMBUyBbbOitV0sUykjkbr7kurJ_foo state=0x55fa686ae3f8 s->prefetch_data=0 2024-09-14T11:27:51.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.675+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa686ae3f8 2024-09-14T11:27:51.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.675+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.11.10 2024-09-14T11:27:51.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.683+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:27:51.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.683+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-09-14T11:27:51.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.683+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-14T11:27:51.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.683+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:27:51.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.683+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2024-09-14T11:27:51.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.683+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-14T11:27:51.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.683+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:27:51.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.683+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=20613 2024-09-14T11:27:51.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.683+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-14T11:27:51.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.683+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-14T11:27:51.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.683+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=4256143 part_ofs=61839 rule->part_size=12359 2024-09-14T11:27:51.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.683+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-14T11:27:51.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.683+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.9686345642249279478 2024-09-14T11:27:51.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.683+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:51.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.683+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.11__multipart_foo.2~2OoCl30kmY2RdV0wwJOAZ2sLLiC51n4.1 2024-09-14T11:27:51.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.683+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-14T11:27:51.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.683+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.11__multipart_foo.2~2OoCl30kmY2RdV0wwJOAZ2sLLiC51n4.2 2024-09-14T11:27:51.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.683+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-14T11:27:51.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.683+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.11__multipart_foo.2~2OoCl30kmY2RdV0wwJOAZ2sLLiC51n4.3 2024-09-14T11:27:51.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.683+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-14T11:27:51.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.683+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.11__multipart_foo.2~2OoCl30kmY2RdV0wwJOAZ2sLLiC51n4.4 2024-09-14T11:27:51.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.683+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-14T11:27:51.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.683+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:51.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.683+0000 7faa387349c0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.9686345642249279478 2024-09-14T11:27:51.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.687+0000 7fa919ffb640 20 handle_completion(): completion ok for obj=foo[92m0MwMBUyBbbOitV0sUykjkbr7kurJ] 2024-09-14T11:27:51.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.687+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2805d2f0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55fa68684af8 s->prefetch_data=0 2024-09-14T11:27:51.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.691+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.11.10 2024-09-14T11:27:51.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.691+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.11.10 2024-09-14T11:27:51.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.691+0000 7faa387349c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:27:51.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.691+0000 7faa387349c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:27:51.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.695+0000 7faa387349c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:27:51.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.695+0000 7faa387349c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:27:51.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.695+0000 7faa387349c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:27:51.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.695+0000 7faa387349c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:27:51.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.695+0000 7faa387349c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[4444f441-0c56-48df-a905-d49e7e44d629.4596.11])"; uploads.size()=0; is_truncated=0 2024-09-14T11:27:51.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.699+0000 7faa387349c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-14T11:27:51.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.699+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:51.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.699+0000 7faa387349c0 20 rados_obj.operate() r=0 bl.length=237 2024-09-14T11:27:51.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.699+0000 7faa387349c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-14T11:27:51.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.699+0000 7faa387349c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-14T11:27:51.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.703+0000 7faa387349c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-14T11:27:51.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.703+0000 7faa387349c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-14T11:27:51.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.703+0000 7fa919ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464276 cookie 94533981637232 notifier 5931 bl.length()=193 2024-09-14T11:27:51.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.707+0000 7faa387349c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.11 from cache 2024-09-14T11:27:51.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.707+0000 7faa387349c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.11, ofs0, ns] 2024-09-14T11:27:51.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.707+0000 7fa9197fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464337 cookie 94533981653632 notifier 5931 bl.length()=251 2024-09-14T11:27:51.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.715+0000 7faa387349c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/4444f441-0c56-48df-a905-d49e7e44d629.4596.11 : miss 2024-09-14T11:27:51.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.715+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:51.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.715+0000 7faa387349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:51.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.715+0000 7faa387349c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/4444f441-0c56-48df-a905-d49e7e44d629.4596.11 info.flags=0x0 2024-09-14T11:27:51.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.715+0000 7faa387349c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/4444f441-0c56-48df-a905-d49e7e44d629.4596.11 to cache LRU end 2024-09-14T11:27:51.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.719+0000 7faa387349c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.10 : miss 2024-09-14T11:27:51.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.719+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:51.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.723+0000 7faa387349c0 20 rados_obj.operate() r=0 bl.length=449 2024-09-14T11:27:51.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.723+0000 7faa387349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.10 info.flags=0x17 2024-09-14T11:27:51.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.723+0000 7faa387349c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.10 to cache LRU end 2024-09-14T11:27:51.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.723+0000 7faa387349c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:27:51.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.723+0000 7faa387349c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:27:51.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.723+0000 7faa387349c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.10 2024-09-14T11:27:51.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.731+0000 7faa387349c0 10 cls_bucket_list_unordered: got foo 2024-09-14T11:27:51.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.731+0000 7faa387349c0 20 get_obj_state: octx=0x55fa68659aa0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55fa686a3f08 s->prefetch_data=0 2024-09-14T11:27:51.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.735+0000 7faa387349c0 10 manifest: total_size = 74198 2024-09-14T11:27:51.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.735+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.6910468811735193230 2024-09-14T11:27:51.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.735+0000 7faa387349c0 20 get_obj_state: octx=0x55fa68659aa0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55fa686a3f08 s->prefetch_data=0 2024-09-14T11:27:51.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.735+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa686a3f08 2024-09-14T11:27:51.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.735+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.10.10 2024-09-14T11:27:51.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.739+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:27:51.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.739+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-09-14T11:27:51.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.739+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-14T11:27:51.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.739+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:27:51.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.739+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2024-09-14T11:27:51.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.739+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-14T11:27:51.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.739+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:27:51.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.739+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=20613 2024-09-14T11:27:51.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.739+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-14T11:27:51.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.739+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-14T11:27:51.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.739+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=4256143 part_ofs=61839 rule->part_size=12359 2024-09-14T11:27:51.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.739+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-14T11:27:51.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.739+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.6910468811735193230 2024-09-14T11:27:51.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.739+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:51.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.739+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.10__multipart_foo.2~qOkeBLCZltEPanteIm6avI1371rWb-y.1 2024-09-14T11:27:51.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.739+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-14T11:27:51.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.739+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.10__multipart_foo.2~qOkeBLCZltEPanteIm6avI1371rWb-y.2 2024-09-14T11:27:51.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.739+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-14T11:27:51.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.739+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.10__multipart_foo.2~qOkeBLCZltEPanteIm6avI1371rWb-y.3 2024-09-14T11:27:51.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.739+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-14T11:27:51.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.739+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.10__multipart_foo.2~qOkeBLCZltEPanteIm6avI1371rWb-y.4 2024-09-14T11:27:51.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.739+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-14T11:27:51.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.739+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:51.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.739+0000 7faa387349c0 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.6910468811735193230 2024-09-14T11:27:51.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.743+0000 7fa919ffb640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:27:51.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.743+0000 7faa387349c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:27:51.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.743+0000 7faa387349c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:27:51.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.743+0000 7faa387349c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:27:51.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.743+0000 7faa387349c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:27:51.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.743+0000 7faa387349c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:27:51.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.743+0000 7faa387349c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:27:51.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.743+0000 7faa387349c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[4444f441-0c56-48df-a905-d49e7e44d629.4596.10])"; uploads.size()=0; is_truncated=0 2024-09-14T11:27:51.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.747+0000 7faa387349c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-14T11:27:51.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.747+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:51.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.751+0000 7faa387349c0 20 rados_obj.operate() r=0 bl.length=227 2024-09-14T11:27:51.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.751+0000 7faa387349c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-14T11:27:51.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.751+0000 7faa387349c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-14T11:27:51.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.751+0000 7faa387349c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-14T11:27:51.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.751+0000 7faa387349c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-14T11:27:51.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.751+0000 7fa919ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464330 cookie 94533981642896 notifier 5931 bl.length()=183 2024-09-14T11:27:51.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.755+0000 7faa387349c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.10 from cache 2024-09-14T11:27:51.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.755+0000 7faa387349c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.10, ofs0, ns] 2024-09-14T11:27:51.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.755+0000 7fa9197fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464338 cookie 94533981646336 notifier 5931 bl.length()=241 2024-09-14T11:27:51.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.763+0000 7faa387349c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/4444f441-0c56-48df-a905-d49e7e44d629.4596.10 : miss 2024-09-14T11:27:51.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.763+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:51.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.763+0000 7faa387349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:51.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.763+0000 7faa387349c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/4444f441-0c56-48df-a905-d49e7e44d629.4596.10 info.flags=0x0 2024-09-14T11:27:51.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.763+0000 7faa387349c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/4444f441-0c56-48df-a905-d49e7e44d629.4596.10 to cache LRU end 2024-09-14T11:27:51.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.771+0000 7faa387349c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.16 : miss 2024-09-14T11:27:51.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.771+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:51.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.771+0000 7faa387349c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:27:51.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.771+0000 7faa387349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.16 info.flags=0x17 2024-09-14T11:27:51.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.771+0000 7faa387349c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.16 to cache LRU end 2024-09-14T11:27:51.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.771+0000 7faa387349c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:27:51.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.771+0000 7faa387349c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:27:51.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.771+0000 7faa387349c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.16 2024-09-14T11:27:51.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.771+0000 7faa387349c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-14T11:27:51.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.775+0000 7faa387349c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-14T11:27:51.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.775+0000 7faa387349c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:27:51.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.779+0000 7faa387349c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-14T11:27:51.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.779+0000 7faa387349c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-14T11:27:51.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.779+0000 7faa387349c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:27:51.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.779+0000 7faa387349c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-14T11:27:51.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.779+0000 7faa387349c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:27:51.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.779+0000 7faa387349c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-14T11:27:51.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.783+0000 7faa387349c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-14T11:27:51.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.783+0000 7faa387349c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-14T11:27:51.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.783+0000 7faa387349c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-14T11:27:51.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.783+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2805d950 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55fa686a36f8 s->prefetch_data=0 2024-09-14T11:27:51.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.787+0000 7faa387349c0 10 manifest: total_size = 27196 2024-09-14T11:27:51.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.787+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to _35v80u_EhgUGaKp6Jf9LqzfSk8w8bW7 2024-09-14T11:27:51.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.787+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2805d950 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55fa686a36f8 s->prefetch_data=0 2024-09-14T11:27:51.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.787+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa686a36f8 2024-09-14T11:27:51.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.787+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.16.0 2024-09-14T11:27:51.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.791+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:51.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.791+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=27196 stripe_ofs=27196 part_ofs=0 rule->part_size=0 2024-09-14T11:27:51.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.791+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - tag is: _35v80u_EhgUGaKp6Jf9LqzfSk8w8bW7 2024-09-14T11:27:51.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.791+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:51.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.791+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.16__shadow_.VZwIiKPS5qQZFd0Lu4ezofoaHYB0gPN_0 2024-09-14T11:27:51.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.791+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:27:51.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.791+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:51.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.791+0000 7faa387349c0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: _35v80u_EhgUGaKp6Jf9LqzfSk8w8bW7 2024-09-14T11:27:51.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.795+0000 7fa919ffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-14T11:27:51.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.795+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2805d950 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55fa686a36f8 s->prefetch_data=0 2024-09-14T11:27:51.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.795+0000 7faa387349c0 10 manifest: total_size = 5242880 2024-09-14T11:27:51.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.795+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to _rVi17clicgbLD6ty84WUvZDNyg26rm1 2024-09-14T11:27:51.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.795+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2805d950 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55fa686a36f8 s->prefetch_data=0 2024-09-14T11:27:51.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.795+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa686a36f8 2024-09-14T11:27:51.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.795+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.16.2 2024-09-14T11:27:51.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.807+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:51.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.807+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:27:51.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.807+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - tag is: _rVi17clicgbLD6ty84WUvZDNyg26rm1 2024-09-14T11:27:51.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.807+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:51.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.807+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.16__shadow_.dPHvP8Vey-u-OsnxahCFfBL3Kzj_z_r_1 2024-09-14T11:27:51.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.807+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:27:51.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.807+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:51.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.807+0000 7faa387349c0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: _rVi17clicgbLD6ty84WUvZDNyg26rm1 2024-09-14T11:27:51.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.807+0000 7fa9197fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-14T11:27:51.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.807+0000 7faa387349c0 20 get_obj_state: octx=0x55fa68682850 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55fa686a36f8 s->prefetch_data=0 2024-09-14T11:27:51.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.811+0000 7faa387349c0 10 manifest: total_size = 5242880 2024-09-14T11:27:51.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.811+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.2052927584773766205 2024-09-14T11:27:51.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.811+0000 7faa387349c0 20 get_obj_state: octx=0x55fa68682850 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55fa686a36f8 s->prefetch_data=0 2024-09-14T11:27:51.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.811+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa686a36f8 2024-09-14T11:27:51.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.811+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.16.3 2024-09-14T11:27:51.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.815+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:51.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.815+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:27:51.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.815+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:51.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.815+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:27:51.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.815+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.2052927584773766205 2024-09-14T11:27:51.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.815+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:51.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.815+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.16__shadow_.g6sq6Rn7qrpVyLqE2LIWJDgnfTZSSP9_0 2024-09-14T11:27:51.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.815+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-14T11:27:51.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.815+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.16__shadow_.g6sq6Rn7qrpVyLqE2LIWJDgnfTZSSP9_1 2024-09-14T11:27:51.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.815+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-14T11:27:51.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.815+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:51.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.815+0000 7faa387349c0 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.2052927584773766205 2024-09-14T11:27:51.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.819+0000 7fa919ffb640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:27:51.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.819+0000 7faa387349c0 20 get_obj_state: octx=0x55fa686835f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55fa686a36f8 s->prefetch_data=0 2024-09-14T11:27:51.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.819+0000 7faa387349c0 10 manifest: total_size = 5242880 2024-09-14T11:27:51.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.819+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to _hlcTxeHtlgN6n-r_UHawzvKRI-B4_At 2024-09-14T11:27:51.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.819+0000 7faa387349c0 20 get_obj_state: octx=0x55fa686835f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55fa686a36f8 s->prefetch_data=0 2024-09-14T11:27:51.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.819+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa686a36f8 2024-09-14T11:27:51.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.819+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.16.5 2024-09-14T11:27:51.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.827+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:51.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.827+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:27:51.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.827+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:51.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.827+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:27:51.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.827+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - tag is: _hlcTxeHtlgN6n-r_UHawzvKRI-B4_At 2024-09-14T11:27:51.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.827+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:51.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.827+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.16__shadow_.0tdH4twfeD8hBlBrzlQbuiNlHc2HVom_0 2024-09-14T11:27:51.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.827+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:27:51.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.827+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.16__shadow_.0tdH4twfeD8hBlBrzlQbuiNlHc2HVom_1 2024-09-14T11:27:51.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.827+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-14T11:27:51.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.827+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:51.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.827+0000 7faa387349c0 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: _hlcTxeHtlgN6n-r_UHawzvKRI-B4_At 2024-09-14T11:27:51.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.827+0000 7fa9197fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-14T11:27:51.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.831+0000 7faa387349c0 20 get_obj_state: octx=0x7faa300b2fc0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55fa686a36f8 s->prefetch_data=0 2024-09-14T11:27:51.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.831+0000 7faa387349c0 10 manifest: total_size = 5242880 2024-09-14T11:27:51.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.831+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to _N4GSpgIep1FJ-APUgWG5aEKS4OhG5bC 2024-09-14T11:27:51.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.831+0000 7faa387349c0 20 get_obj_state: octx=0x7faa300b2fc0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55fa686a36f8 s->prefetch_data=0 2024-09-14T11:27:51.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.831+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa686a36f8 2024-09-14T11:27:51.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.831+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.16.5 2024-09-14T11:27:51.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.839+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:51.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.839+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:27:51.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.839+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:51.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.839+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:27:51.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.839+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - tag is: _N4GSpgIep1FJ-APUgWG5aEKS4OhG5bC 2024-09-14T11:27:51.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.839+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:51.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.839+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.16__shadow_.Xuu6HsF9QkZmTAdMWGRq4uA9hbJYCEy_0 2024-09-14T11:27:51.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.839+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:27:51.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.839+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.16__shadow_.Xuu6HsF9QkZmTAdMWGRq4uA9hbJYCEy_1 2024-09-14T11:27:51.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.839+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-14T11:27:51.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.839+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:51.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.839+0000 7faa387349c0 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: _N4GSpgIep1FJ-APUgWG5aEKS4OhG5bC 2024-09-14T11:27:51.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.843+0000 7fa919ffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-14T11:27:51.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.843+0000 7faa387349c0 20 get_obj_state: octx=0x55fa6868a430 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55fa686a36f8 s->prefetch_data=0 2024-09-14T11:27:51.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.843+0000 7faa387349c0 10 manifest: total_size = 27196 2024-09-14T11:27:51.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.843+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.2329500463694295228 2024-09-14T11:27:51.843 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.843+0000 7faa387349c0 20 get_obj_state: octx=0x55fa6868a430 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55fa686a36f8 s->prefetch_data=0 2024-09-14T11:27:51.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.843+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa686a36f8 2024-09-14T11:27:51.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.843+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.16.5 2024-09-14T11:27:51.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.847+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2805d950 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55fa686a36f8 s->prefetch_data=0 2024-09-14T11:27:51.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.851+0000 7faa387349c0 10 manifest: total_size = 5242880 2024-09-14T11:27:51.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.851+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to _x1PfNkElFUp7ruIivay9VNBSwx2qLuC 2024-09-14T11:27:51.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.851+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2805d950 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55fa686a36f8 s->prefetch_data=0 2024-09-14T11:27:51.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.851+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa686a36f8 2024-09-14T11:27:51.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.851+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.16.7 2024-09-14T11:27:51.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.851+0000 7fa9197fa640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:27:51.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.859+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:51.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.859+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:27:51.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.859+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - tag is: _x1PfNkElFUp7ruIivay9VNBSwx2qLuC 2024-09-14T11:27:51.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.859+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:51.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.859+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.16__shadow_.a1g67wTKQM9cY0OVZFZ08fLf7hGdADX_1 2024-09-14T11:27:51.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.859+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:27:51.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.859+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:51.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.859+0000 7faa387349c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: _x1PfNkElFUp7ruIivay9VNBSwx2qLuC 2024-09-14T11:27:51.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.863+0000 7fa919ffb640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-14T11:27:51.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.863+0000 7faa387349c0 20 get_obj_state: octx=0x55fa686835f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55fa686a36f8 s->prefetch_data=0 2024-09-14T11:27:51.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.863+0000 7faa387349c0 10 manifest: total_size = 5242880 2024-09-14T11:27:51.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.863+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.5874220928900087383 2024-09-14T11:27:51.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.863+0000 7faa387349c0 20 get_obj_state: octx=0x55fa686835f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55fa686a36f8 s->prefetch_data=0 2024-09-14T11:27:51.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.863+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa686a36f8 2024-09-14T11:27:51.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.863+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.16.7 2024-09-14T11:27:51.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.871+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:51.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.871+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:27:51.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.871+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:51.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.871+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:27:51.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.871+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.5874220928900087383 2024-09-14T11:27:51.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.871+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:51.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.871+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.16__shadow_.CgDU-ASKYTEkR7gJy21pheomq78MAe3_0 2024-09-14T11:27:51.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.871+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-14T11:27:51.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.871+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.16__shadow_.CgDU-ASKYTEkR7gJy21pheomq78MAe3_1 2024-09-14T11:27:51.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.871+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-14T11:27:51.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.871+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:51.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.871+0000 7faa387349c0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.5874220928900087383 2024-09-14T11:27:51.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.871+0000 7faa387349c0 20 get_obj_state: octx=0x7faa300b2fc0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55fa686a36f8 s->prefetch_data=0 2024-09-14T11:27:51.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.871+0000 7fa9197fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:27:51.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.875+0000 7faa387349c0 10 manifest: total_size = 27196 2024-09-14T11:27:51.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.875+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to _HBS0nBUhTPr91SgCW2iXy099q-JnUSU 2024-09-14T11:27:51.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.875+0000 7faa387349c0 20 get_obj_state: octx=0x7faa300b2fc0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55fa686a36f8 s->prefetch_data=0 2024-09-14T11:27:51.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.875+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa686a36f8 2024-09-14T11:27:51.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.875+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.16.7 2024-09-14T11:27:51.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.879+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2805d950 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55fa686a36f8 s->prefetch_data=0 2024-09-14T11:27:51.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.879+0000 7faa387349c0 10 manifest: total_size = 5242880 2024-09-14T11:27:51.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.879+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.9396261497937821289 2024-09-14T11:27:51.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.879+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2805d950 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55fa686a36f8 s->prefetch_data=0 2024-09-14T11:27:51.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.879+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa686a36f8 2024-09-14T11:27:51.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.879+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.16.8 2024-09-14T11:27:51.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.883+0000 7fa919ffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-14T11:27:51.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.887+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:51.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.887+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:27:51.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.887+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:51.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.887+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:27:51.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.887+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.9396261497937821289 2024-09-14T11:27:51.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.887+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:51.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.887+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.16__shadow_.CgDU-ASKYTEkR7gJy21pheomq78MAe3_0 2024-09-14T11:27:51.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.887+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-14T11:27:51.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.887+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.16__shadow_.CgDU-ASKYTEkR7gJy21pheomq78MAe3_1 2024-09-14T11:27:51.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.887+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-14T11:27:51.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.887+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:51.887 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.887+0000 7faa387349c0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.9396261497937821289 2024-09-14T11:27:51.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.891+0000 7fa9197fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-14T11:27:51.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.891+0000 7faa387349c0 20 get_obj_state: octx=0x55fa686835f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55fa686a36f8 s->prefetch_data=0 2024-09-14T11:27:51.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.891+0000 7faa387349c0 10 manifest: total_size = 27196 2024-09-14T11:27:51.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.891+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to _JyXHmYTKy5ZsuLSHxjrOIU2XM7tOwy8 2024-09-14T11:27:51.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.891+0000 7faa387349c0 20 get_obj_state: octx=0x55fa686835f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55fa686a36f8 s->prefetch_data=0 2024-09-14T11:27:51.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.891+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa686a36f8 2024-09-14T11:27:51.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.891+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.16.8 2024-09-14T11:27:51.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.899+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:51.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.899+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=27196 stripe_ofs=27196 part_ofs=0 rule->part_size=0 2024-09-14T11:27:51.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.899+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - tag is: _JyXHmYTKy5ZsuLSHxjrOIU2XM7tOwy8 2024-09-14T11:27:51.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.899+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:51.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.899+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.16__shadow_.rjW8L7jgXZDXf1BMIlFl0q4z3pSiVFQ_0 2024-09-14T11:27:51.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.899+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:27:51.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.899+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:51.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.899+0000 7faa387349c0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: _JyXHmYTKy5ZsuLSHxjrOIU2XM7tOwy8 2024-09-14T11:27:51.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.899+0000 7fa919ffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-14T11:27:51.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.903+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2c001c40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55fa686a36f8 s->prefetch_data=0 2024-09-14T11:27:51.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.903+0000 7faa387349c0 10 manifest: total_size = 5242880 2024-09-14T11:27:51.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.903+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.11486585344214849425 2024-09-14T11:27:51.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.903+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2c001c40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55fa686a36f8 s->prefetch_data=0 2024-09-14T11:27:51.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.903+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa686a36f8 2024-09-14T11:27:51.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.903+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.16.9 2024-09-14T11:27:51.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.911+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:51.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.911+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:27:51.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.911+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:51.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.911+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:27:51.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.911+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.11486585344214849425 2024-09-14T11:27:51.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.911+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:51.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.911+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.16__shadow_.g6sq6Rn7qrpVyLqE2LIWJDgnfTZSSP9_0 2024-09-14T11:27:51.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.911+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-14T11:27:51.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.911+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.16__shadow_.g6sq6Rn7qrpVyLqE2LIWJDgnfTZSSP9_1 2024-09-14T11:27:51.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.911+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-14T11:27:51.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.911+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:51.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.911+0000 7faa387349c0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.11486585344214849425 2024-09-14T11:27:51.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.911+0000 7fa9197fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-14T11:27:51.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.915+0000 7faa387349c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:27:51.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.915+0000 7faa387349c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:27:51.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.915+0000 7faa387349c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:27:51.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.915+0000 7faa387349c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:27:51.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.915+0000 7faa387349c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:27:51.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.915+0000 7faa387349c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:27:51.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.915+0000 7faa387349c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[4444f441-0c56-48df-a905-d49e7e44d629.4596.16])"; uploads.size()=0; is_truncated=0 2024-09-14T11:27:51.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.919+0000 7faa387349c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-14T11:27:51.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.919+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:51.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.919+0000 7faa387349c0 20 rados_obj.operate() r=0 bl.length=233 2024-09-14T11:27:51.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.919+0000 7faa387349c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-14T11:27:51.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.919+0000 7faa387349c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-14T11:27:51.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.923+0000 7faa387349c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-14T11:27:51.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.923+0000 7faa387349c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-14T11:27:51.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.923+0000 7fa9197fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464277 cookie 94533981637232 notifier 5931 bl.length()=189 2024-09-14T11:27:51.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.927+0000 7faa387349c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.16 from cache 2024-09-14T11:27:51.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.927+0000 7faa387349c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.16, ofs0, ns] 2024-09-14T11:27:51.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.927+0000 7fa919ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464339 cookie 94533981653632 notifier 5931 bl.length()=247 2024-09-14T11:27:51.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.939+0000 7faa387349c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/4444f441-0c56-48df-a905-d49e7e44d629.4596.16 : miss 2024-09-14T11:27:51.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.939+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:51.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.939+0000 7faa387349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:51.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.939+0000 7faa387349c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/4444f441-0c56-48df-a905-d49e7e44d629.4596.16 info.flags=0x0 2024-09-14T11:27:51.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.939+0000 7faa387349c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/4444f441-0c56-48df-a905-d49e7e44d629.4596.16 to cache LRU end 2024-09-14T11:27:51.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.943+0000 7faa387349c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.17 : miss 2024-09-14T11:27:51.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.943+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:51.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.947+0000 7faa387349c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:27:51.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.947+0000 7faa387349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.17 info.flags=0x17 2024-09-14T11:27:51.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.947+0000 7faa387349c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.17 to cache LRU end 2024-09-14T11:27:51.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.947+0000 7faa387349c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:27:51.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.947+0000 7faa387349c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:27:51.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.947+0000 7faa387349c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.17 2024-09-14T11:27:51.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.947+0000 7faa387349c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-14T11:27:51.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.947+0000 7faa387349c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-14T11:27:51.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.951+0000 7faa387349c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:27:51.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.951+0000 7faa387349c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-14T11:27:51.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.951+0000 7faa387349c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-14T11:27:51.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.951+0000 7faa387349c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:27:51.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.955+0000 7faa387349c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-14T11:27:51.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.955+0000 7faa387349c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:27:51.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.955+0000 7faa387349c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-14T11:27:51.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.955+0000 7faa387349c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-14T11:27:51.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.955+0000 7faa387349c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-14T11:27:51.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.955+0000 7faa387349c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-14T11:27:51.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.955+0000 7faa387349c0 20 get_obj_state: octx=0x55fa68660f00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55fa68698bc8 s->prefetch_data=0 2024-09-14T11:27:51.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.959+0000 7faa387349c0 10 manifest: total_size = 541681 2024-09-14T11:27:51.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.959+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to _Gm8wD5KmXYyuZCDueJQwJka2TnU30ux 2024-09-14T11:27:51.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.959+0000 7faa387349c0 20 get_obj_state: octx=0x55fa68660f00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55fa68698bc8 s->prefetch_data=0 2024-09-14T11:27:51.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.959+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68698bc8 2024-09-14T11:27:51.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.959+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.17.0 2024-09-14T11:27:51.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.963+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:51.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.963+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=0 rule->part_size=0 2024-09-14T11:27:51.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.963+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - tag is: _Gm8wD5KmXYyuZCDueJQwJka2TnU30ux 2024-09-14T11:27:51.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.963+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:51.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.963+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_.HBEZZ0957jeoV1S-Dd1gk3xvuNP_bYH_0 2024-09-14T11:27:51.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.963+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:27:51.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.963+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:51.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.963+0000 7faa387349c0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: _Gm8wD5KmXYyuZCDueJQwJka2TnU30ux 2024-09-14T11:27:51.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.967+0000 7fa919ffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-14T11:27:51.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.967+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2c06d450 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55fa68698b88 s->prefetch_data=0 2024-09-14T11:27:51.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.967+0000 7faa387349c0 10 manifest: total_size = 11534336 2024-09-14T11:27:51.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.967+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to _PXFUfaFOvxzz92ufSpJfoBvLANkrLV_ 2024-09-14T11:27:51.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.967+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2c06d450 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55fa68698b88 s->prefetch_data=0 2024-09-14T11:27:51.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.967+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68698b88 2024-09-14T11:27:51.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.967+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.17.2 2024-09-14T11:27:51.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.975+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:51.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.975+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-14T11:27:51.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.975+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:51.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.975+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:27:51.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.975+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - tag is: _PXFUfaFOvxzz92ufSpJfoBvLANkrLV_ 2024-09-14T11:27:51.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.975+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:51.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.975+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_.KU0e3prm6JTxtPHSfejsygpPLYcVaHn_1 2024-09-14T11:27:51.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.975+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:27:51.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.975+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_.KU0e3prm6JTxtPHSfejsygpPLYcVaHn_2 2024-09-14T11:27:51.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.975+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-14T11:27:51.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.975+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:51.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.975+0000 7faa387349c0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: _PXFUfaFOvxzz92ufSpJfoBvLANkrLV_ 2024-09-14T11:27:51.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.979+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2805d950 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55fa68698b88 s->prefetch_data=0 2024-09-14T11:27:51.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.979+0000 7fa9197fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-14T11:27:51.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.979+0000 7faa387349c0 10 manifest: total_size = 11534336 2024-09-14T11:27:51.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.979+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.917786962471870912 2024-09-14T11:27:51.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.979+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2805d950 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55fa68698b88 s->prefetch_data=0 2024-09-14T11:27:51.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.979+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68698b88 2024-09-14T11:27:51.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.983+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.17.3 2024-09-14T11:27:51.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.987+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:51.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.987+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:51.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.987+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:51.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.987+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:51.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.987+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:51.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.987+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:51.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.987+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:51.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.987+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:51.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.987+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:51.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.987+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:51.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.987+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:51.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.987+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:27:51.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.987+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:27:51.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.987+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:27:51.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.987+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:27:51.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.987+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.917786962471870912 2024-09-14T11:27:51.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.987+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:51.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.987+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__multipart_foo-FROZEN.2~Z2XsI4VViPIwKl8YefERH4QpfwU7wbu.1 2024-09-14T11:27:51.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.987+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 366 2024-09-14T11:27:51.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.987+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_foo-FROZEN.2~Z2XsI4VViPIwKl8YefERH4QpfwU7wbu.1_1 2024-09-14T11:27:51.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.987+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 631 2024-09-14T11:27:51.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.987+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__multipart_foo-FROZEN.2~Z2XsI4VViPIwKl8YefERH4QpfwU7wbu.2 2024-09-14T11:27:51.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.987+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 898 2024-09-14T11:27:51.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.987+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_foo-FROZEN.2~Z2XsI4VViPIwKl8YefERH4QpfwU7wbu.2_1 2024-09-14T11:27:51.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.987+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1163 2024-09-14T11:27:51.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.987+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__multipart_foo-FROZEN.2~Z2XsI4VViPIwKl8YefERH4QpfwU7wbu.3 2024-09-14T11:27:51.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.987+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1430 2024-09-14T11:27:51.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.987+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:51.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.987+0000 7faa387349c0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.917786962471870912 2024-09-14T11:27:51.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.991+0000 7fa919ffb640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:27:51.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.991+0000 7faa387349c0 20 get_obj_state: octx=0x55fa68660f00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55fa68698b88 s->prefetch_data=0 2024-09-14T11:27:51.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.991+0000 7faa387349c0 10 manifest: total_size = 11534336 2024-09-14T11:27:51.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.991+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to _TmOp8RidCet_RFvBfGje759qdGjU2Mi 2024-09-14T11:27:51.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.991+0000 7faa387349c0 20 get_obj_state: octx=0x55fa68660f00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55fa68698b88 s->prefetch_data=0 2024-09-14T11:27:51.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.991+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68698b88 2024-09-14T11:27:51.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.991+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.17.5 2024-09-14T11:27:51.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.999+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:51.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.999+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:27:51.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.999+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:51.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.999+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-14T11:27:51.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.999+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:51.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.999+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:27:51.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.999+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - tag is: _TmOp8RidCet_RFvBfGje759qdGjU2Mi 2024-09-14T11:27:51.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.999+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:51.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.999+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_.HLvejBt-OW582ZPnwGF9lILyTF9ES2I_0 2024-09-14T11:27:51.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.999+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:27:51.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.999+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_.HLvejBt-OW582ZPnwGF9lILyTF9ES2I_1 2024-09-14T11:27:51.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.999+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-14T11:27:51.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.999+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_.HLvejBt-OW582ZPnwGF9lILyTF9ES2I_2 2024-09-14T11:27:51.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.999+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2024-09-14T11:27:51.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.999+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:51.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:51.999+0000 7faa387349c0 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: _TmOp8RidCet_RFvBfGje759qdGjU2Mi 2024-09-14T11:27:52.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.003+0000 7fa9197fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-14T11:27:52.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.003+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2c083870 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55fa68698b88 s->prefetch_data=0 2024-09-14T11:27:52.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.003+0000 7faa387349c0 10 manifest: total_size = 11534336 2024-09-14T11:27:52.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.003+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to _zcHJf3d2rDv9ChU8RXXFemh1AxDpXYl 2024-09-14T11:27:52.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.003+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2c083870 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55fa68698b88 s->prefetch_data=0 2024-09-14T11:27:52.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.003+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68698b88 2024-09-14T11:27:52.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.003+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.17.5 2024-09-14T11:27:52.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.011+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:52.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.011+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:27:52.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.011+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:52.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.011+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-14T11:27:52.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.011+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:52.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.011+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:27:52.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.011+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - tag is: _zcHJf3d2rDv9ChU8RXXFemh1AxDpXYl 2024-09-14T11:27:52.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.011+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:52.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.011+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_.sHGs8TuBw9JzJZE_EZteMRUZuHcPjUT_0 2024-09-14T11:27:52.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.011+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:27:52.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.011+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_.sHGs8TuBw9JzJZE_EZteMRUZuHcPjUT_1 2024-09-14T11:27:52.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.011+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-14T11:27:52.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.011+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_.sHGs8TuBw9JzJZE_EZteMRUZuHcPjUT_2 2024-09-14T11:27:52.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.011+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2024-09-14T11:27:52.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.011+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:52.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.011+0000 7faa387349c0 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: _zcHJf3d2rDv9ChU8RXXFemh1AxDpXYl 2024-09-14T11:27:52.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.011+0000 7fa919ffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-14T11:27:52.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.015+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2805d950 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55fa68696138 s->prefetch_data=0 2024-09-14T11:27:52.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.015+0000 7faa387349c0 10 manifest: total_size = 541681 2024-09-14T11:27:52.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.015+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.8037930266624252016 2024-09-14T11:27:52.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.015+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2805d950 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55fa68696138 s->prefetch_data=0 2024-09-14T11:27:52.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.015+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68696138 2024-09-14T11:27:52.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.015+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.17.5 2024-09-14T11:27:52.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.019+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:27:52.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.019+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2024-09-14T11:27:52.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.019+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-14T11:27:52.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.019+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:27:52.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.019+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2024-09-14T11:27:52.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.019+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2024-09-14T11:27:52.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.019+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2024-09-14T11:27:52.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.019+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=49187 2024-09-14T11:27:52.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.019+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2024-09-14T11:27:52.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.019+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.8037930266624252016 2024-09-14T11:27:52.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.019+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:52.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.019+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__multipart_foo-STANDARD.2~vfDoXiTVhFA7T9j9Mah7i0_qIuVFA2D.1 2024-09-14T11:27:52.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.019+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-14T11:27:52.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.019+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__multipart_foo-STANDARD.2~vfDoXiTVhFA7T9j9Mah7i0_qIuVFA2D.2 2024-09-14T11:27:52.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.019+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-14T11:27:52.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.019+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__multipart_foo-STANDARD.2~vfDoXiTVhFA7T9j9Mah7i0_qIuVFA2D.3 2024-09-14T11:27:52.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.019+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-14T11:27:52.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.019+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:52.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.019+0000 7faa387349c0 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.8037930266624252016 2024-09-14T11:27:52.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.023+0000 7fa9197fa640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:27:52.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.023+0000 7faa387349c0 20 get_obj_state: octx=0x7faa280596a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55fa68696138 s->prefetch_data=0 2024-09-14T11:27:52.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.027+0000 7faa387349c0 10 manifest: total_size = 11534336 2024-09-14T11:27:52.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.027+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to _CUTfoLMNojCKIxCgzZN_3pxniI6pmyj 2024-09-14T11:27:52.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.027+0000 7faa387349c0 20 get_obj_state: octx=0x7faa280596a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55fa68696138 s->prefetch_data=0 2024-09-14T11:27:52.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.027+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68696138 2024-09-14T11:27:52.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.027+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.17.7 2024-09-14T11:27:52.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.035+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:52.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.035+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-14T11:27:52.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.035+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:52.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.035+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:27:52.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.035+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - tag is: _CUTfoLMNojCKIxCgzZN_3pxniI6pmyj 2024-09-14T11:27:52.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.035+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:52.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.035+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_.53Pknlk-PbEsb6wq7sR0Gf6HJRoAJRy_1 2024-09-14T11:27:52.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.035+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:27:52.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.035+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_.53Pknlk-PbEsb6wq7sR0Gf6HJRoAJRy_2 2024-09-14T11:27:52.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.035+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-14T11:27:52.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.035+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:52.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.035+0000 7faa387349c0 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: _CUTfoLMNojCKIxCgzZN_3pxniI6pmyj 2024-09-14T11:27:52.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.035+0000 7fa919ffb640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-14T11:27:52.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.035+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2c083870 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55fa68696138 s->prefetch_data=0 2024-09-14T11:27:52.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.039+0000 7faa387349c0 10 manifest: total_size = 11534336 2024-09-14T11:27:52.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.039+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.12543994024347469545 2024-09-14T11:27:52.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.039+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2c083870 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55fa68696138 s->prefetch_data=0 2024-09-14T11:27:52.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.039+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68696138 2024-09-14T11:27:52.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.039+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.17.7 2024-09-14T11:27:52.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.043+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:52.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.043+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:52.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.043+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:52.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.043+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:52.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.043+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:52.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.043+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:52.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.043+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:52.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.043+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:52.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.043+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:52.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.043+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:52.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.043+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:52.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.043+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:27:52.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.043+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:27:52.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.043+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:27:52.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.043+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:27:52.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.043+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.12543994024347469545 2024-09-14T11:27:52.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.043+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:52.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.043+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__multipart_foo-LUKEWARM.2~wnGxUZz24rQ8pCuVTC2BozMef0w5grr.1 2024-09-14T11:27:52.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.043+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-14T11:27:52.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.043+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_foo-LUKEWARM.2~wnGxUZz24rQ8pCuVTC2BozMef0w5grr.1_1 2024-09-14T11:27:52.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.043+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-14T11:27:52.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.043+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__multipart_foo-LUKEWARM.2~wnGxUZz24rQ8pCuVTC2BozMef0w5grr.2 2024-09-14T11:27:52.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.043+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-14T11:27:52.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.043+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_foo-LUKEWARM.2~wnGxUZz24rQ8pCuVTC2BozMef0w5grr.2_1 2024-09-14T11:27:52.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.043+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2024-09-14T11:27:52.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.043+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__multipart_foo-LUKEWARM.2~wnGxUZz24rQ8pCuVTC2BozMef0w5grr.3 2024-09-14T11:27:52.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.043+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2024-09-14T11:27:52.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.043+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:52.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.043+0000 7faa387349c0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.12543994024347469545 2024-09-14T11:27:52.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.047+0000 7fa9197fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:27:52.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.047+0000 7faa387349c0 20 get_obj_state: octx=0x55fa68689200 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55fa68696138 s->prefetch_data=0 2024-09-14T11:27:52.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.047+0000 7faa387349c0 10 manifest: total_size = 541681 2024-09-14T11:27:52.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.047+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.13717130956286753088 2024-09-14T11:27:52.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.047+0000 7faa387349c0 20 get_obj_state: octx=0x55fa68689200 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55fa68696138 s->prefetch_data=0 2024-09-14T11:27:52.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.047+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68696138 2024-09-14T11:27:52.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.047+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.17.7 2024-09-14T11:27:52.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.055+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:27:52.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.055+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2024-09-14T11:27:52.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.055+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-14T11:27:52.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.055+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:27:52.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.055+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2024-09-14T11:27:52.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.055+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2024-09-14T11:27:52.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.055+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2024-09-14T11:27:52.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.055+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=49187 2024-09-14T11:27:52.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.055+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2024-09-14T11:27:52.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.055+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.13717130956286753088 2024-09-14T11:27:52.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.055+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:52.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.055+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__multipart_foo-STANDARD.2~vfDoXiTVhFA7T9j9Mah7i0_qIuVFA2D.1 2024-09-14T11:27:52.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.055+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-14T11:27:52.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.055+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__multipart_foo-STANDARD.2~vfDoXiTVhFA7T9j9Mah7i0_qIuVFA2D.2 2024-09-14T11:27:52.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.055+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-14T11:27:52.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.055+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__multipart_foo-STANDARD.2~vfDoXiTVhFA7T9j9Mah7i0_qIuVFA2D.3 2024-09-14T11:27:52.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.055+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-14T11:27:52.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.055+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:52.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.055+0000 7faa387349c0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.13717130956286753088 2024-09-14T11:27:52.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.059+0000 7fa919ffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-14T11:27:52.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.059+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2805ca70 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55fa68696138 s->prefetch_data=0 2024-09-14T11:27:52.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.059+0000 7faa387349c0 10 manifest: total_size = 11534336 2024-09-14T11:27:52.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.059+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.8930030370581082418 2024-09-14T11:27:52.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.059+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2805ca70 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55fa68696138 s->prefetch_data=0 2024-09-14T11:27:52.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.059+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68696138 2024-09-14T11:27:52.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.059+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.17.8 2024-09-14T11:27:52.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.067+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:52.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.067+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:52.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.067+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:52.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.067+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:52.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.067+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:52.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.067+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:52.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.067+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:52.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.067+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:52.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.067+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:52.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.067+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:52.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.067+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:52.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.067+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:27:52.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.067+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:27:52.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.067+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:27:52.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.067+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:27:52.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.067+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.8930030370581082418 2024-09-14T11:27:52.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.067+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:52.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.067+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__multipart_foo-LUKEWARM.2~wnGxUZz24rQ8pCuVTC2BozMef0w5grr.1 2024-09-14T11:27:52.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.067+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-14T11:27:52.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.067+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_foo-LUKEWARM.2~wnGxUZz24rQ8pCuVTC2BozMef0w5grr.1_1 2024-09-14T11:27:52.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.067+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-09-14T11:27:52.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.067+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__multipart_foo-LUKEWARM.2~wnGxUZz24rQ8pCuVTC2BozMef0w5grr.2 2024-09-14T11:27:52.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.067+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-09-14T11:27:52.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.067+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_foo-LUKEWARM.2~wnGxUZz24rQ8pCuVTC2BozMef0w5grr.2_1 2024-09-14T11:27:52.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.067+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-09-14T11:27:52.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.067+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__multipart_foo-LUKEWARM.2~wnGxUZz24rQ8pCuVTC2BozMef0w5grr.3 2024-09-14T11:27:52.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.067+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-09-14T11:27:52.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.067+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:52.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.067+0000 7faa387349c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.8930030370581082418 2024-09-14T11:27:52.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.067+0000 7fa9197fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-14T11:27:52.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.071+0000 7faa387349c0 20 get_obj_state: octx=0x55fa6868d330 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55fa68696138 s->prefetch_data=0 2024-09-14T11:27:52.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.071+0000 7faa387349c0 10 manifest: total_size = 541681 2024-09-14T11:27:52.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.071+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to _X6fkfTDX0KCwF-pexucVwN8MgSsAen_ 2024-09-14T11:27:52.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.071+0000 7faa387349c0 20 get_obj_state: octx=0x55fa6868d330 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55fa68696138 s->prefetch_data=0 2024-09-14T11:27:52.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.071+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68696138 2024-09-14T11:27:52.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.071+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.17.8 2024-09-14T11:27:52.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.075+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:52.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.075+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=0 rule->part_size=0 2024-09-14T11:27:52.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.075+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - tag is: _X6fkfTDX0KCwF-pexucVwN8MgSsAen_ 2024-09-14T11:27:52.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.075+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:52.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.075+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_.eq9ST321Tm8ugkG1z6_CiGWxIH2gF4W_0 2024-09-14T11:27:52.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.075+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:27:52.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.075+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:52.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.075+0000 7faa387349c0 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: _X6fkfTDX0KCwF-pexucVwN8MgSsAen_ 2024-09-14T11:27:52.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.079+0000 7faa387349c0 20 get_obj_state: octx=0x55fa686867c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55fa68696138 s->prefetch_data=0 2024-09-14T11:27:52.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.079+0000 7fa919ffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-14T11:27:52.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.079+0000 7faa387349c0 10 manifest: total_size = 11534336 2024-09-14T11:27:52.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.079+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.17420912978980184107 2024-09-14T11:27:52.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.079+0000 7faa387349c0 20 get_obj_state: octx=0x55fa686867c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55fa68696138 s->prefetch_data=0 2024-09-14T11:27:52.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.079+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68696138 2024-09-14T11:27:52.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.079+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.17.9 2024-09-14T11:27:52.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.087+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:52.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.087+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:52.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.087+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:52.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.087+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:52.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.087+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:52.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.087+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:52.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.087+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:52.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.087+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:52.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.087+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:52.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.087+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:52.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.087+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:52.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.087+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:27:52.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.087+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:27:52.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.087+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:27:52.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.087+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:27:52.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.087+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17420912978980184107 2024-09-14T11:27:52.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.087+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:52.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.087+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__multipart_foo-FROZEN.2~Z2XsI4VViPIwKl8YefERH4QpfwU7wbu.1 2024-09-14T11:27:52.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.087+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-14T11:27:52.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.087+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_foo-FROZEN.2~Z2XsI4VViPIwKl8YefERH4QpfwU7wbu.1_1 2024-09-14T11:27:52.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.087+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-09-14T11:27:52.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.087+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__multipart_foo-FROZEN.2~Z2XsI4VViPIwKl8YefERH4QpfwU7wbu.2 2024-09-14T11:27:52.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.087+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-09-14T11:27:52.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.087+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_foo-FROZEN.2~Z2XsI4VViPIwKl8YefERH4QpfwU7wbu.2_1 2024-09-14T11:27:52.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.087+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2024-09-14T11:27:52.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.087+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17__multipart_foo-FROZEN.2~Z2XsI4VViPIwKl8YefERH4QpfwU7wbu.3 2024-09-14T11:27:52.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.087+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2024-09-14T11:27:52.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.087+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:52.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.087+0000 7faa387349c0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.17420912978980184107 2024-09-14T11:27:52.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.091+0000 7fa9197fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-14T11:27:52.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.091+0000 7faa387349c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:27:52.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.091+0000 7faa387349c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:27:52.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.091+0000 7faa387349c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:27:52.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.091+0000 7faa387349c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:27:52.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.091+0000 7faa387349c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:27:52.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.091+0000 7faa387349c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:27:52.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.091+0000 7faa387349c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[4444f441-0c56-48df-a905-d49e7e44d629.4596.17])"; uploads.size()=0; is_truncated=0 2024-09-14T11:27:52.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.095+0000 7faa387349c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-14T11:27:52.096 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.095+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:52.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.099+0000 7faa387349c0 20 rados_obj.operate() r=0 bl.length=243 2024-09-14T11:27:52.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.099+0000 7faa387349c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-14T11:27:52.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.099+0000 7faa387349c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-14T11:27:52.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.099+0000 7faa387349c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-14T11:27:52.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.099+0000 7faa387349c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-14T11:27:52.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.103+0000 7fa9197fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464267 cookie 94533981641568 notifier 5931 bl.length()=199 2024-09-14T11:27:52.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.107+0000 7faa387349c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.17 from cache 2024-09-14T11:27:52.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.107+0000 7faa387349c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.17, ofs0, ns] 2024-09-14T11:27:52.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.107+0000 7fa9197fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464278 cookie 94533981637232 notifier 5931 bl.length()=257 2024-09-14T11:27:52.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.115+0000 7faa387349c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/4444f441-0c56-48df-a905-d49e7e44d629.4596.17 : miss 2024-09-14T11:27:52.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.115+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:52.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.115+0000 7faa387349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:52.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.115+0000 7faa387349c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/4444f441-0c56-48df-a905-d49e7e44d629.4596.17 info.flags=0x0 2024-09-14T11:27:52.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.115+0000 7faa387349c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/4444f441-0c56-48df-a905-d49e7e44d629.4596.17 to cache LRU end 2024-09-14T11:27:52.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.119+0000 7faa387349c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.15 : miss 2024-09-14T11:27:52.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.119+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:52.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.123+0000 7faa387349c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T11:27:52.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.123+0000 7faa387349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.15 info.flags=0x17 2024-09-14T11:27:52.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.123+0000 7faa387349c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.15 to cache LRU end 2024-09-14T11:27:52.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.123+0000 7faa387349c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:27:52.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.123+0000 7faa387349c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:27:52.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.123+0000 7faa387349c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.15 2024-09-14T11:27:52.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.127+0000 7faa387349c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:27:52.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.127+0000 7faa387349c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:27:52.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.131+0000 7faa387349c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:27:52.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.131+0000 7faa387349c0 20 get_obj_state: octx=0x55fa6868b5a0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55fa68697428 s->prefetch_data=0 2024-09-14T11:27:52.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.135+0000 7faa387349c0 10 manifest: total_size = 11534336 2024-09-14T11:27:52.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.135+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.14726407191215750792 2024-09-14T11:27:52.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.135+0000 7faa387349c0 20 get_obj_state: octx=0x55fa6868b5a0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55fa68697428 s->prefetch_data=0 2024-09-14T11:27:52.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.135+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68697428 2024-09-14T11:27:52.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.135+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.15.3 2024-09-14T11:27:52.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.139+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:52.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.139+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:52.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.139+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:52.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.139+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:52.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.139+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:52.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.139+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:52.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.139+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:52.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.139+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:52.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.139+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:52.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.139+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:52.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.139+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:52.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.139+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:27:52.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.139+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:27:52.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.139+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:27:52.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.139+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:27:52.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.139+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.14726407191215750792 2024-09-14T11:27:52.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.139+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:52.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.139+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.15__multipart_foo-FROZEN.2~FfoX9V2Ci3TsZQUZwus2W4ghQDo916Y.1 2024-09-14T11:27:52.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.139+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-14T11:27:52.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.139+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.15__shadow_foo-FROZEN.2~FfoX9V2Ci3TsZQUZwus2W4ghQDo916Y.1_1 2024-09-14T11:27:52.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.139+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-09-14T11:27:52.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.139+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.15__multipart_foo-FROZEN.2~FfoX9V2Ci3TsZQUZwus2W4ghQDo916Y.2 2024-09-14T11:27:52.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.139+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-09-14T11:27:52.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.139+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.15__shadow_foo-FROZEN.2~FfoX9V2Ci3TsZQUZwus2W4ghQDo916Y.2_1 2024-09-14T11:27:52.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.139+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2024-09-14T11:27:52.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.139+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.15__multipart_foo-FROZEN.2~FfoX9V2Ci3TsZQUZwus2W4ghQDo916Y.3 2024-09-14T11:27:52.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.139+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2024-09-14T11:27:52.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.139+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:52.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.139+0000 7faa387349c0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.14726407191215750792 2024-09-14T11:27:52.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.143+0000 7fa9197fa640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:27:52.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.143+0000 7faa387349c0 20 get_obj_state: octx=0x7faa280596a0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55fa68697428 s->prefetch_data=0 2024-09-14T11:27:52.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.143+0000 7faa387349c0 10 manifest: total_size = 16376 2024-09-14T11:27:52.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.143+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.2794250060553398098 2024-09-14T11:27:52.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.143+0000 7faa387349c0 20 get_obj_state: octx=0x7faa280596a0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55fa68697428 s->prefetch_data=0 2024-09-14T11:27:52.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.143+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68697428 2024-09-14T11:27:52.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.143+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.15.5 2024-09-14T11:27:52.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.151+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=7669 rules.size()=3 2024-09-14T11:27:52.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.151+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=7669 2024-09-14T11:27:52.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.151+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=7669 stripe_ofs=7669 part_ofs=7669 rule->part_size=7672 2024-09-14T11:27:52.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.151+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2024-09-14T11:27:52.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.151+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=4201973 part_ofs=7669 rule->part_size=7672 2024-09-14T11:27:52.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.151+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=15341 stripe_ofs=15341 part_ofs=15341 rule->part_size=1035 2024-09-14T11:27:52.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.151+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2024-09-14T11:27:52.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.151+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=4209645 part_ofs=15341 rule->part_size=1035 2024-09-14T11:27:52.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.151+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=16376 stripe_ofs=16376 part_ofs=16376 rule->part_size=1035 2024-09-14T11:27:52.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.151+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.2794250060553398098 2024-09-14T11:27:52.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.151+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:52.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.151+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.15__multipart_foo-STANDARD.2~W5E7QNlMzdhY1Us2WBAPt2dK8dy9XLx.1 2024-09-14T11:27:52.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.151+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-14T11:27:52.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.151+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.15__multipart_foo-STANDARD.2~W5E7QNlMzdhY1Us2WBAPt2dK8dy9XLx.2 2024-09-14T11:27:52.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.151+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-14T11:27:52.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.151+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.15__multipart_foo-STANDARD.2~W5E7QNlMzdhY1Us2WBAPt2dK8dy9XLx.3 2024-09-14T11:27:52.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.151+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-14T11:27:52.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.151+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:52.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.151+0000 7faa387349c0 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.2794250060553398098 2024-09-14T11:27:52.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.155+0000 7faa387349c0 20 get_obj_state: octx=0x55fa68689750 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55fa68697428 s->prefetch_data=0 2024-09-14T11:27:52.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.155+0000 7fa919ffb640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:27:52.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.155+0000 7faa387349c0 10 manifest: total_size = 11534336 2024-09-14T11:27:52.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.155+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.10206638901650819103 2024-09-14T11:27:52.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.155+0000 7faa387349c0 20 get_obj_state: octx=0x55fa68689750 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55fa68697428 s->prefetch_data=0 2024-09-14T11:27:52.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.155+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68697428 2024-09-14T11:27:52.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.155+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.15.7 2024-09-14T11:27:52.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.159+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:52.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.159+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:52.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.159+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:52.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.159+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:52.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.159+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:52.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.159+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:52.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.159+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:52.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.159+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:52.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.159+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:52.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.159+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:52.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.159+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:52.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.159+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:27:52.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.159+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:27:52.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.159+0000 7faa387349c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:27:52.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.159+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:27:52.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.159+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.10206638901650819103 2024-09-14T11:27:52.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.159+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:52.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.159+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.15__multipart_foo-LUKEWARM.2~v_EepglqXwkb2GCnKZuRv55Y-yVzA16.1 2024-09-14T11:27:52.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.159+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-14T11:27:52.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.159+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.15__shadow_foo-LUKEWARM.2~v_EepglqXwkb2GCnKZuRv55Y-yVzA16.1_1 2024-09-14T11:27:52.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.159+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-14T11:27:52.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.159+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.15__multipart_foo-LUKEWARM.2~v_EepglqXwkb2GCnKZuRv55Y-yVzA16.2 2024-09-14T11:27:52.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.159+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-14T11:27:52.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.159+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.15__shadow_foo-LUKEWARM.2~v_EepglqXwkb2GCnKZuRv55Y-yVzA16.2_1 2024-09-14T11:27:52.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.159+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2024-09-14T11:27:52.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.159+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.15__multipart_foo-LUKEWARM.2~v_EepglqXwkb2GCnKZuRv55Y-yVzA16.3 2024-09-14T11:27:52.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.159+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2024-09-14T11:27:52.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.159+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:52.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.159+0000 7faa387349c0 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.10206638901650819103 2024-09-14T11:27:52.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.163+0000 7fa9197fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:27:52.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.163+0000 7faa387349c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:27:52.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.163+0000 7faa387349c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:27:52.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.167+0000 7faa387349c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:27:52.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.167+0000 7faa387349c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:27:52.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.167+0000 7faa387349c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:27:52.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.167+0000 7faa387349c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:27:52.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.167+0000 7faa387349c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[4444f441-0c56-48df-a905-d49e7e44d629.4596.15])"; uploads.size()=0; is_truncated=0 2024-09-14T11:27:52.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.171+0000 7faa387349c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-14T11:27:52.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.171+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:52.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.171+0000 7faa387349c0 20 rados_obj.operate() r=0 bl.length=238 2024-09-14T11:27:52.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.171+0000 7faa387349c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-14T11:27:52.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.171+0000 7faa387349c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-14T11:27:52.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.175+0000 7faa387349c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-14T11:27:52.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.175+0000 7faa387349c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-14T11:27:52.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.175+0000 7fa919ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464340 cookie 94533981646336 notifier 5931 bl.length()=194 2024-09-14T11:27:52.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.179+0000 7faa387349c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.15 from cache 2024-09-14T11:27:52.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.179+0000 7faa387349c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.15, ofs0, ns] 2024-09-14T11:27:52.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.183+0000 7fa9197fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464279 cookie 94533981637232 notifier 5931 bl.length()=252 2024-09-14T11:27:52.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.191+0000 7faa387349c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/4444f441-0c56-48df-a905-d49e7e44d629.4596.15 : miss 2024-09-14T11:27:52.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.191+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:52.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.191+0000 7faa387349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:52.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.191+0000 7faa387349c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/4444f441-0c56-48df-a905-d49e7e44d629.4596.15 info.flags=0x0 2024-09-14T11:27:52.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.191+0000 7faa387349c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/4444f441-0c56-48df-a905-d49e7e44d629.4596.15 to cache LRU end 2024-09-14T11:27:52.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.195+0000 7faa387349c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.14 : miss 2024-09-14T11:27:52.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.195+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:52.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.199+0000 7faa387349c0 20 rados_obj.operate() r=0 bl.length=450 2024-09-14T11:27:52.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.199+0000 7faa387349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.14 info.flags=0x17 2024-09-14T11:27:52.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.199+0000 7faa387349c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.14 to cache LRU end 2024-09-14T11:27:52.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.199+0000 7faa387349c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:27:52.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.199+0000 7faa387349c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:27:52.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.199+0000 7faa387349c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.14 2024-09-14T11:27:52.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.203+0000 7faa387349c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:27:52.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.203+0000 7faa387349c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:27:52.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.207+0000 7faa387349c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:27:52.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.207+0000 7faa387349c0 20 get_obj_state: octx=0x55fa6868b720 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55fa68697428 s->prefetch_data=0 2024-09-14T11:27:52.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.211+0000 7faa387349c0 10 manifest: total_size = 10485760 2024-09-14T11:27:52.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.211+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.16615220495683222752 2024-09-14T11:27:52.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.211+0000 7faa387349c0 20 get_obj_state: octx=0x55fa6868b720 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55fa68697428 s->prefetch_data=0 2024-09-14T11:27:52.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.211+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68697428 2024-09-14T11:27:52.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.211+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.14.3 2024-09-14T11:27:52.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.215+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:52.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.215+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:27:52.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.215+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:52.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.215+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-14T11:27:52.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.215+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:52.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.215+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-14T11:27:52.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.215+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.16615220495683222752 2024-09-14T11:27:52.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.215+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:52.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.215+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.14__shadow_.JnrMy6l1epGhjU9F5I5LlUDMe0hMSmD_0 2024-09-14T11:27:52.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.215+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-14T11:27:52.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.215+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.14__shadow_.JnrMy6l1epGhjU9F5I5LlUDMe0hMSmD_1 2024-09-14T11:27:52.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.215+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-14T11:27:52.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.215+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.14__shadow_.JnrMy6l1epGhjU9F5I5LlUDMe0hMSmD_2 2024-09-14T11:27:52.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.215+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 812 2024-09-14T11:27:52.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.215+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:52.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.215+0000 7faa387349c0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.16615220495683222752 2024-09-14T11:27:52.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.219+0000 7fa9197fa640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:27:52.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.219+0000 7faa387349c0 20 get_obj_state: octx=0x55fa68659aa0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55fa68697428 s->prefetch_data=0 2024-09-14T11:27:52.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.219+0000 7faa387349c0 10 manifest: total_size = 53502 2024-09-14T11:27:52.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.219+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.10546892908598329730 2024-09-14T11:27:52.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.219+0000 7faa387349c0 20 get_obj_state: octx=0x55fa68659aa0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55fa68697428 s->prefetch_data=0 2024-09-14T11:27:52.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.219+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68697428 2024-09-14T11:27:52.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.219+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.14.5 2024-09-14T11:27:52.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.227+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2805d950 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55fa68697428 s->prefetch_data=0 2024-09-14T11:27:52.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.227+0000 7faa387349c0 10 manifest: total_size = 10485760 2024-09-14T11:27:52.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.227+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.4949082907019608828 2024-09-14T11:27:52.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.227+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2805d950 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55fa68697428 s->prefetch_data=0 2024-09-14T11:27:52.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.227+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68697428 2024-09-14T11:27:52.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.227+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.14.7 2024-09-14T11:27:52.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.231+0000 7fa919ffb640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:27:52.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.235+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:52.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.235+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:27:52.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.235+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:52.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.235+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-14T11:27:52.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.235+0000 7faa387349c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:52.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.235+0000 7faa387349c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-14T11:27:52.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.235+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.4949082907019608828 2024-09-14T11:27:52.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.235+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:52.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.235+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.14__shadow_.UMp4Mq3VuzxrP8luL67QKnJipTCrINQ_0 2024-09-14T11:27:52.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.235+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-14T11:27:52.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.235+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.14__shadow_.UMp4Mq3VuzxrP8luL67QKnJipTCrINQ_1 2024-09-14T11:27:52.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.235+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-14T11:27:52.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.235+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 4444f441-0c56-48df-a905-d49e7e44d629.4596.14__shadow_.UMp4Mq3VuzxrP8luL67QKnJipTCrINQ_2 2024-09-14T11:27:52.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.235+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 817 2024-09-14T11:27:52.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.235+0000 7faa387349c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:52.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.235+0000 7faa387349c0 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 4444f441-0c56-48df-a905-d49e7e44d629.4596.4949082907019608828 2024-09-14T11:27:52.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.239+0000 7faa387349c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:27:52.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.239+0000 7faa387349c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:27:52.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.239+0000 7fa9197fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:27:52.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.239+0000 7faa387349c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:27:52.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.239+0000 7faa387349c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:27:52.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.239+0000 7faa387349c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:27:52.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.239+0000 7faa387349c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:27:52.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.239+0000 7faa387349c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[4444f441-0c56-48df-a905-d49e7e44d629.4596.14])"; uploads.size()=0; is_truncated=0 2024-09-14T11:27:52.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.247+0000 7faa387349c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-14T11:27:52.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.247+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:52.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.247+0000 7faa387349c0 20 rados_obj.operate() r=0 bl.length=228 2024-09-14T11:27:52.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.247+0000 7faa387349c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-14T11:27:52.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.247+0000 7faa387349c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-14T11:27:52.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.251+0000 7faa387349c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-14T11:27:52.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.251+0000 7faa387349c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-14T11:27:52.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.251+0000 7fa919ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464280 cookie 94533981637232 notifier 5931 bl.length()=184 2024-09-14T11:27:52.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.255+0000 7faa387349c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.14 from cache 2024-09-14T11:27:52.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.255+0000 7faa387349c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.14, ofs0, ns] 2024-09-14T11:27:52.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.255+0000 7fa9197fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464331 cookie 94533981609520 notifier 5931 bl.length()=242 2024-09-14T11:27:52.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.263+0000 7faa387349c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/4444f441-0c56-48df-a905-d49e7e44d629.4596.14 : miss 2024-09-14T11:27:52.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.263+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:52.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.263+0000 7faa387349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:52.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.263+0000 7faa387349c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/4444f441-0c56-48df-a905-d49e7e44d629.4596.14 info.flags=0x0 2024-09-14T11:27:52.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.263+0000 7faa387349c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/4444f441-0c56-48df-a905-d49e7e44d629.4596.14 to cache LRU end 2024-09-14T11:27:52.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.271+0000 7faa387349c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.7 : miss 2024-09-14T11:27:52.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.271+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:52.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.271+0000 7faa387349c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:27:52.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.271+0000 7faa387349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.7 info.flags=0x17 2024-09-14T11:27:52.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.271+0000 7faa387349c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.7 to cache LRU end 2024-09-14T11:27:52.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.271+0000 7faa387349c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:27:52.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.271+0000 7faa387349c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:27:52.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.271+0000 7faa387349c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.7 2024-09-14T11:27:52.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.275+0000 7faa387349c0 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:27:52.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.275+0000 7faa387349c0 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:27:52.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.279+0000 7faa387349c0 10 cls_bucket_list_unordered: got __ 2024-09-14T11:27:52.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.279+0000 7faa387349c0 10 cls_bucket_list_unordered: got obj 2024-09-14T11:27:52.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.283+0000 7faa387349c0 20 get_obj_state: octx=0x55fa686899d0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55fa68697938 s->prefetch_data=0 2024-09-14T11:27:52.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.283+0000 7faa387349c0 10 manifest: total_size = 0 2024-09-14T11:27:52.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.283+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.2514207688490785609 2024-09-14T11:27:52.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.283+0000 7faa387349c0 20 get_obj_state: octx=0x55fa686899d0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55fa68697938 s->prefetch_data=0 2024-09-14T11:27:52.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.283+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68697938 2024-09-14T11:27:52.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.283+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.7.2 2024-09-14T11:27:52.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.291+0000 7faa387349c0 20 get_obj_state: octx=0x55fa686899d0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55fa68697938 s->prefetch_data=0 2024-09-14T11:27:52.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.291+0000 7faa387349c0 10 manifest: total_size = 0 2024-09-14T11:27:52.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.291+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.9025761484718247737 2024-09-14T11:27:52.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.291+0000 7faa387349c0 20 get_obj_state: octx=0x55fa686899d0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55fa68697938 s->prefetch_data=0 2024-09-14T11:27:52.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.291+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68697938 2024-09-14T11:27:52.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.291+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.7.3 2024-09-14T11:27:52.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.291+0000 7fa9197fa640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:27:52.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.295+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2805c5a0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55fa68697938 s->prefetch_data=0 2024-09-14T11:27:52.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.299+0000 7faa387349c0 10 manifest: total_size = 0 2024-09-14T11:27:52.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.299+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.10731931600089757467 2024-09-14T11:27:52.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.299+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2805c5a0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55fa68697938 s->prefetch_data=0 2024-09-14T11:27:52.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.299+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68697938 2024-09-14T11:27:52.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.299+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.7.6 2024-09-14T11:27:52.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.299+0000 7fa919ffb640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:27:52.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.307+0000 7faa387349c0 20 get_obj_state: octx=0x55fa6868d490 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55fa68697938 s->prefetch_data=0 2024-09-14T11:27:52.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.307+0000 7faa387349c0 10 manifest: total_size = 0 2024-09-14T11:27:52.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.307+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.15328221698138611175 2024-09-14T11:27:52.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.307+0000 7faa387349c0 20 get_obj_state: octx=0x55fa6868d490 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55fa68697938 s->prefetch_data=0 2024-09-14T11:27:52.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.307+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68697938 2024-09-14T11:27:52.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.307+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.7.8 2024-09-14T11:27:52.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.307+0000 7fa9197fa640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:27:52.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.311+0000 7faa387349c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:27:52.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.311+0000 7faa387349c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:27:52.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.315+0000 7fa919ffb640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:27:52.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.315+0000 7faa387349c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:27:52.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.315+0000 7faa387349c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:27:52.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.315+0000 7faa387349c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:27:52.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.315+0000 7faa387349c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:27:52.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.315+0000 7faa387349c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[4444f441-0c56-48df-a905-d49e7e44d629.4596.7])"; uploads.size()=0; is_truncated=0 2024-09-14T11:27:52.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.323+0000 7faa387349c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-14T11:27:52.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.323+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:52.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.323+0000 7faa387349c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:27:52.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.323+0000 7faa387349c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-14T11:27:52.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.323+0000 7faa387349c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-14T11:27:52.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.327+0000 7faa387349c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-14T11:27:52.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.327+0000 7faa387349c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-14T11:27:52.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.327+0000 7fa919ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464332 cookie 94533981609520 notifier 5931 bl.length()=181 2024-09-14T11:27:52.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.331+0000 7faa387349c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.7 from cache 2024-09-14T11:27:52.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.331+0000 7faa387349c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:4444f441-0c56-48df-a905-d49e7e44d629.4596.7, ofs0, ns] 2024-09-14T11:27:52.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.331+0000 7fa919ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464333 cookie 94533981609520 notifier 5931 bl.length()=238 2024-09-14T11:27:52.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.339+0000 7faa387349c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/4444f441-0c56-48df-a905-d49e7e44d629.4596.7 : miss 2024-09-14T11:27:52.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.339+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:52.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.339+0000 7faa387349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:52.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.339+0000 7faa387349c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/4444f441-0c56-48df-a905-d49e7e44d629.4596.7 info.flags=0x0 2024-09-14T11:27:52.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.339+0000 7faa387349c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/4444f441-0c56-48df-a905-d49e7e44d629.4596.7 to cache LRU end 2024-09-14T11:27:52.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.347+0000 7faa387349c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:4444f441-0c56-48df-a905-d49e7e44d629.4596.8 : miss 2024-09-14T11:27:52.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.347+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:52.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.347+0000 7faa387349c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:27:52.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.347+0000 7faa387349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:4444f441-0c56-48df-a905-d49e7e44d629.4596.8 info.flags=0x17 2024-09-14T11:27:52.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.347+0000 7faa387349c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:4444f441-0c56-48df-a905-d49e7e44d629.4596.8 to cache LRU end 2024-09-14T11:27:52.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.347+0000 7faa387349c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:27:52.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.347+0000 7faa387349c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:27:52.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.347+0000 7faa387349c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:4444f441-0c56-48df-a905-d49e7e44d629.4596.8 2024-09-14T11:27:52.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.351+0000 7faa387349c0 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:27:52.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.351+0000 7faa387349c0 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:27:52.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.355+0000 7faa387349c0 10 cls_bucket_list_unordered: got __ 2024-09-14T11:27:52.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.359+0000 7faa387349c0 10 cls_bucket_list_unordered: got obj 2024-09-14T11:27:52.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.359+0000 7faa387349c0 20 get_obj_state: octx=0x55fa68659aa0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55fa68698628 s->prefetch_data=0 2024-09-14T11:27:52.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.359+0000 7faa387349c0 10 manifest: total_size = 38 2024-09-14T11:27:52.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.359+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.9238072688929316143 2024-09-14T11:27:52.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.359+0000 7faa387349c0 20 get_obj_state: octx=0x55fa68659aa0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55fa68698628 s->prefetch_data=0 2024-09-14T11:27:52.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.359+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68698628 2024-09-14T11:27:52.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.359+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.8.2 2024-09-14T11:27:52.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.367+0000 7faa387349c0 20 get_obj_state: octx=0x55fa68659aa0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55fa68698628 s->prefetch_data=0 2024-09-14T11:27:52.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.367+0000 7faa387349c0 10 manifest: total_size = 24595 2024-09-14T11:27:52.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.367+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.17603056607930750860 2024-09-14T11:27:52.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.367+0000 7faa387349c0 20 get_obj_state: octx=0x55fa68659aa0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55fa68698628 s->prefetch_data=0 2024-09-14T11:27:52.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.367+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68698628 2024-09-14T11:27:52.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.367+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.8.3 2024-09-14T11:27:52.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.371+0000 7fa9197fa640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:27:52.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.375+0000 7faa387349c0 20 get_obj_state: octx=0x55fa68659aa0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55fa68698628 s->prefetch_data=0 2024-09-14T11:27:52.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.375+0000 7faa387349c0 10 manifest: total_size = 38 2024-09-14T11:27:52.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.375+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.398446768066440817 2024-09-14T11:27:52.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.375+0000 7faa387349c0 20 get_obj_state: octx=0x55fa68659aa0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55fa68698628 s->prefetch_data=0 2024-09-14T11:27:52.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.375+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68698628 2024-09-14T11:27:52.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.375+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.8.6 2024-09-14T11:27:52.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.379+0000 7fa919ffb640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:27:52.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.383+0000 7faa387349c0 20 get_obj_state: octx=0x7faa301545d0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55fa68698628 s->prefetch_data=0 2024-09-14T11:27:52.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.383+0000 7faa387349c0 10 manifest: total_size = 524288 2024-09-14T11:27:52.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.383+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.2803781745609627714 2024-09-14T11:27:52.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.383+0000 7faa387349c0 20 get_obj_state: octx=0x7faa301545d0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55fa68698628 s->prefetch_data=0 2024-09-14T11:27:52.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.383+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68698628 2024-09-14T11:27:52.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.383+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.8.8 2024-09-14T11:27:52.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.387+0000 7fa9197fa640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:27:52.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.391+0000 7faa387349c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:27:52.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.391+0000 7faa387349c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:27:52.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.395+0000 7fa9197fa640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:27:52.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.395+0000 7faa387349c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:27:52.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.395+0000 7faa387349c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:27:52.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.395+0000 7faa387349c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:27:52.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.395+0000 7faa387349c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:27:52.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.395+0000 7faa387349c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[4444f441-0c56-48df-a905-d49e7e44d629.4596.8])"; uploads.size()=0; is_truncated=0 2024-09-14T11:27:52.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.399+0000 7faa387349c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-14T11:27:52.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.399+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:52.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.399+0000 7faa387349c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:27:52.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.399+0000 7faa387349c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-14T11:27:52.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.399+0000 7faa387349c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-14T11:27:52.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.403+0000 7faa387349c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-14T11:27:52.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.403+0000 7faa387349c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-14T11:27:52.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.403+0000 7fa919ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464334 cookie 94533981609520 notifier 5931 bl.length()=181 2024-09-14T11:27:52.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.407+0000 7faa387349c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:4444f441-0c56-48df-a905-d49e7e44d629.4596.8 from cache 2024-09-14T11:27:52.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.407+0000 7faa387349c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:4444f441-0c56-48df-a905-d49e7e44d629.4596.8, ofs0, ns] 2024-09-14T11:27:52.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.407+0000 7fa9197fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464335 cookie 94533981609520 notifier 5931 bl.length()=238 2024-09-14T11:27:52.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.415+0000 7faa387349c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/4444f441-0c56-48df-a905-d49e7e44d629.4596.8 : miss 2024-09-14T11:27:52.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.415+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:52.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.419+0000 7faa387349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:52.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.419+0000 7faa387349c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/4444f441-0c56-48df-a905-d49e7e44d629.4596.8 info.flags=0x0 2024-09-14T11:27:52.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.419+0000 7faa387349c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/4444f441-0c56-48df-a905-d49e7e44d629.4596.8 to cache LRU end 2024-09-14T11:27:52.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.423+0000 7faa387349c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:4444f441-0c56-48df-a905-d49e7e44d629.4596.9 : miss 2024-09-14T11:27:52.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.423+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:52.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.423+0000 7faa387349c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:27:52.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.423+0000 7faa387349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:4444f441-0c56-48df-a905-d49e7e44d629.4596.9 info.flags=0x17 2024-09-14T11:27:52.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.423+0000 7faa387349c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:4444f441-0c56-48df-a905-d49e7e44d629.4596.9 to cache LRU end 2024-09-14T11:27:52.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.423+0000 7faa387349c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:27:52.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.423+0000 7faa387349c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:27:52.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.423+0000 7faa387349c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:4444f441-0c56-48df-a905-d49e7e44d629.4596.9 2024-09-14T11:27:52.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.427+0000 7faa387349c0 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:27:52.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.431+0000 7faa387349c0 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:27:52.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.431+0000 7faa387349c0 10 cls_bucket_list_unordered: got __ 2024-09-14T11:27:52.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.435+0000 7faa387349c0 10 cls_bucket_list_unordered: got obj 2024-09-14T11:27:52.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.435+0000 7faa387349c0 20 get_obj_state: octx=0x55fa686feb30 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55fa68698628 s->prefetch_data=0 2024-09-14T11:27:52.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.439+0000 7faa387349c0 10 manifest: total_size = 1048576 2024-09-14T11:27:52.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.439+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.11451320227801255088 2024-09-14T11:27:52.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.439+0000 7faa387349c0 20 get_obj_state: octx=0x55fa686feb30 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55fa68698628 s->prefetch_data=0 2024-09-14T11:27:52.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.439+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68698628 2024-09-14T11:27:52.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.439+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.9.2 2024-09-14T11:27:52.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.443+0000 7faa387349c0 20 get_obj_state: octx=0x55fa686feb30 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55fa68698628 s->prefetch_data=0 2024-09-14T11:27:52.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.447+0000 7faa387349c0 10 manifest: total_size = 4134 2024-09-14T11:27:52.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.447+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.2184339693819769288 2024-09-14T11:27:52.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.447+0000 7faa387349c0 20 get_obj_state: octx=0x55fa686feb30 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55fa68698628 s->prefetch_data=0 2024-09-14T11:27:52.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.447+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68698628 2024-09-14T11:27:52.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.447+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.9.3 2024-09-14T11:27:52.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.447+0000 7fa9197fa640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:27:52.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.451+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2805c5a0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55fa68698628 s->prefetch_data=0 2024-09-14T11:27:52.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.451+0000 7faa387349c0 10 manifest: total_size = 1048576 2024-09-14T11:27:52.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.451+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.8372535462609849887 2024-09-14T11:27:52.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.451+0000 7faa387349c0 20 get_obj_state: octx=0x7faa2805c5a0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55fa68698628 s->prefetch_data=0 2024-09-14T11:27:52.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.451+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68698628 2024-09-14T11:27:52.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.451+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.9.6 2024-09-14T11:27:52.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.455+0000 7fa919ffb640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:27:52.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.459+0000 7faa387349c0 20 get_obj_state: octx=0x55fa686feb30 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55fa68698628 s->prefetch_data=0 2024-09-14T11:27:52.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.459+0000 7faa387349c0 10 manifest: total_size = 1035 2024-09-14T11:27:52.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.459+0000 7faa387349c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.12051804356045914294 2024-09-14T11:27:52.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.459+0000 7faa387349c0 20 get_obj_state: octx=0x55fa686feb30 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55fa68698628 s->prefetch_data=0 2024-09-14T11:27:52.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.459+0000 7faa387349c0 20 prepare_atomic_modification: state is not atomic. state=0x55fa68698628 2024-09-14T11:27:52.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.459+0000 7faa387349c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.9.8 2024-09-14T11:27:52.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.463+0000 7fa9197fa640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:27:52.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.467+0000 7faa387349c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:27:52.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.467+0000 7faa387349c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:27:52.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.471+0000 7fa9197fa640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:27:52.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.471+0000 7faa387349c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:27:52.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.471+0000 7faa387349c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:27:52.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.471+0000 7faa387349c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:27:52.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.471+0000 7faa387349c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:27:52.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.471+0000 7faa387349c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[4444f441-0c56-48df-a905-d49e7e44d629.4596.9])"; uploads.size()=0; is_truncated=0 2024-09-14T11:27:52.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.475+0000 7faa387349c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-14T11:27:52.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.475+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:52.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.475+0000 7faa387349c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:27:52.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.475+0000 7faa387349c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-14T11:27:52.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.475+0000 7faa387349c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-14T11:27:52.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.479+0000 7faa387349c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-14T11:27:52.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.479+0000 7faa387349c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-14T11:27:52.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.479+0000 7fa9197fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464336 cookie 94533981609520 notifier 5931 bl.length()=181 2024-09-14T11:27:52.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.483+0000 7faa387349c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:4444f441-0c56-48df-a905-d49e7e44d629.4596.9 from cache 2024-09-14T11:27:52.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.483+0000 7faa387349c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:4444f441-0c56-48df-a905-d49e7e44d629.4596.9, ofs0, ns] 2024-09-14T11:27:52.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.487+0000 7fa9197fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464337 cookie 94533981609520 notifier 5931 bl.length()=238 2024-09-14T11:27:52.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.491+0000 7faa387349c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/4444f441-0c56-48df-a905-d49e7e44d629.4596.9 : miss 2024-09-14T11:27:52.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.491+0000 7faa387349c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:52.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.491+0000 7faa387349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:52.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.491+0000 7faa387349c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/4444f441-0c56-48df-a905-d49e7e44d629.4596.9 info.flags=0x0 2024-09-14T11:27:52.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.491+0000 7faa387349c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/4444f441-0c56-48df-a905-d49e7e44d629.4596.9 to cache LRU end 2024-09-14T11:27:52.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.499+0000 7faa387349c0 10 removing key index: PZMSHYFTQVSNBYXRDOXH 2024-09-14T11:27:52.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.499+0000 7faa387349c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.keys:PZMSHYFTQVSNBYXRDOXH, ofs0, ns] 2024-09-14T11:27:52.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.503+0000 7fa9197fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464341 cookie 94533981653632 notifier 5931 bl.length()=170 2024-09-14T11:27:52.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.503+0000 7faa387349c0 10 removing email index: ragweed.client.0+test@test.test 2024-09-14T11:27:52.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.507+0000 7faa387349c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-14T11:27:52.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.507+0000 7fa919ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464281 cookie 94533981637232 notifier 5931 bl.length()=182 2024-09-14T11:27:52.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.507+0000 7faa387349c0 10 removing user buckets index 2024-09-14T11:27:52.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.511+0000 7faa387349c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-14T11:27:52.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.511+0000 7fa9197fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464342 cookie 94533981646336 notifier 5931 bl.length()=173 2024-09-14T11:27:52.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.511+0000 7faa387349c0 10 removing user index: ragweed.client.0 2024-09-14T11:27:52.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.515+0000 7faa387349c0 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-14T11:27:52.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.515+0000 7faa387349c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-14T11:27:52.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.515+0000 7fa9197fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464338 cookie 94533981642896 notifier 5931 bl.length()=165 2024-09-14T11:27:52.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.519+0000 7fa8ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:27:52.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.523+0000 7faa387349c0 20 remove_watcher() i=0 2024-09-14T11:27:52.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.523+0000 7faa387349c0 2 removed watcher, disabling cache 2024-09-14T11:27:52.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.527+0000 7faa387349c0 20 remove_watcher() i=1 2024-09-14T11:27:52.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.531+0000 7faa387349c0 20 remove_watcher() i=2 2024-09-14T11:27:52.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.531+0000 7faa387349c0 20 remove_watcher() i=3 2024-09-14T11:27:52.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.535+0000 7faa387349c0 20 remove_watcher() i=4 2024-09-14T11:27:52.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.535+0000 7faa387349c0 20 remove_watcher() i=5 2024-09-14T11:27:52.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.539+0000 7faa387349c0 20 remove_watcher() i=6 2024-09-14T11:27:52.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.543+0000 7faa387349c0 20 remove_watcher() i=7 2024-09-14T11:27:52.560 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-14T11:27:52.640 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:27:52.640 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:27:52.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.683+0000 7f5fc96ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:52.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.687+0000 7f5fc96ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:52.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.687+0000 7f5fc96ec9c0 20 realm 2024-09-14T11:27:52.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.687+0000 7f5fc96ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:52.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.687+0000 7f5fc96ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:52.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.687+0000 7f5fc96ec9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:27:52.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.687+0000 7f5fc96ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:52.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.687+0000 7f5fc96ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:52.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.687+0000 7f5fc96ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:52.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.687+0000 7f5fc96ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:27:52.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.687+0000 7f5fc96ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:52.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.691+0000 7f5fc96ec9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:27:52.688 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.691+0000 7f5fc96ec9c0 20 searching for the correct realm 2024-09-14T11:27:52.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.695+0000 7f5fc79f3640 0 -- 172.21.15.71:0/942220023 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f5fbc07a040 msgr2=0x7f5fbc065d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:27:52.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.911+0000 7f5fc79f3640 0 -- 172.21.15.71:0/942220023 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x5590c1c38cb0 msgr2=0x5590c1c3b0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:27:52.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.923+0000 7f5fc96ec9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:27:52.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.923+0000 7f5fc96ec9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:27:52.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.923+0000 7f5fc96ec9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:27:52.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.923+0000 7f5fc96ec9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:27:52.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.923+0000 7f5fc96ec9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:27:52.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.923+0000 7f5fc96ec9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:27:52.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.923+0000 7f5fc96ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:52.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.923+0000 7f5fc96ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:52.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.923+0000 7f5fc96ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:52.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.923+0000 7f5fc96ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:27:52.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.923+0000 7f5fc96ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:52.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.927+0000 7f5fc96ec9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:27:52.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.927+0000 7f5fc96ec9c0 20 zone default found 2024-09-14T11:27:52.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.927+0000 7f5fc96ec9c0 4 Realm: () 2024-09-14T11:27:52.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.927+0000 7f5fc96ec9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:27:52.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.927+0000 7f5fc96ec9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:27:52.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.927+0000 7f5fc96ec9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:27:52.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.927+0000 7f5fc96ec9c0 20 zonegroup default 2024-09-14T11:27:52.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.927+0000 7f5fc96ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:52.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.927+0000 7f5fc96ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:52.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.927+0000 7f5fc96ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:52.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.927+0000 7f5fc96ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:52.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.927+0000 7f5fc96ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:52.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.927+0000 7f5fc96ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:52.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.927+0000 7f5fc96ec9c0 20 started sync module instance, tier type = 2024-09-14T11:27:52.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.927+0000 7f5fc96ec9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:27:52.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.951+0000 7f5fc96ec9c0 20 add_watcher() i=0 2024-09-14T11:27:52.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.951+0000 7f5fc96ec9c0 20 add_watcher() i=1 2024-09-14T11:27:52.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.951+0000 7f5fc96ec9c0 20 add_watcher() i=2 2024-09-14T11:27:52.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.951+0000 7f5fc96ec9c0 20 add_watcher() i=3 2024-09-14T11:27:52.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.951+0000 7f5fc96ec9c0 20 add_watcher() i=4 2024-09-14T11:27:52.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.951+0000 7f5fc96ec9c0 20 add_watcher() i=5 2024-09-14T11:27:52.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.951+0000 7f5fc96ec9c0 20 add_watcher() i=6 2024-09-14T11:27:52.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.951+0000 7f5fc96ec9c0 20 add_watcher() i=7 2024-09-14T11:27:52.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.951+0000 7f5fc96ec9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:27:52.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.955+0000 7f5e7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:27:52.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.959+0000 7f5fc96ec9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:27:52.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:52.959+0000 7f5fc96ec9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:27:53.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:53.051+0000 7f5e7cfe1640 20 reqs_thread_entry: start 2024-09-14T11:27:53.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:53.051+0000 7f5fc96ec9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:27:53.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:53.051+0000 7f5fc96ec9c0 20 Filter name: none 2024-09-14T11:27:53.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:53.051+0000 7f5df67fc640 20 reqs_thread_entry: start 2024-09-14T11:27:53.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:53.051+0000 7f5fc96ec9c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-14T11:27:53.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:53.051+0000 7f5fc96ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:27:53.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:53.051+0000 7f5fc96ec9c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:27:53.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:53.051+0000 7f5fc96ec9c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-14T11:27:53.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:53.051+0000 7f5fc96ec9c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:27:53.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:53.051+0000 7f5fc96ec9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:27:53.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:53.051+0000 7f5fc96ec9c0 10 removing key index: VQVQXWPYCCLLVRNHPLDW 2024-09-14T11:27:53.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:53.055+0000 7f5fc96ec9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:VQVQXWPYCCLLVRNHPLDW, ofs0, ns] 2024-09-14T11:27:53.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:53.055+0000 7f5eaaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464343 cookie 94080214515456 notifier 5690 bl.length()=170 2024-09-14T11:27:53.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:53.059+0000 7f5fc96ec9c0 10 removing email index: sysuser.client.0+test@test.test 2024-09-14T11:27:53.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:53.059+0000 7f5fc96ec9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-14T11:27:53.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:53.059+0000 7f5eaaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464339 cookie 94080214511856 notifier 5690 bl.length()=182 2024-09-14T11:27:53.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:53.059+0000 7f5fc96ec9c0 10 removing user buckets index 2024-09-14T11:27:53.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:53.063+0000 7f5fc96ec9c0 10 removing user index: sysuser.client.0 2024-09-14T11:27:53.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:53.063+0000 7f5fc96ec9c0 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-14T11:27:53.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:53.063+0000 7f5fc96ec9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-14T11:27:53.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:53.063+0000 7f5eaa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464282 cookie 94080214507984 notifier 5690 bl.length()=165 2024-09-14T11:27:53.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:53.067+0000 7f5e7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:27:53.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:53.071+0000 7f5fc96ec9c0 20 remove_watcher() i=0 2024-09-14T11:27:53.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:53.071+0000 7f5fc96ec9c0 2 removed watcher, disabling cache 2024-09-14T11:27:53.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:53.075+0000 7f5fc96ec9c0 20 remove_watcher() i=1 2024-09-14T11:27:53.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:53.075+0000 7f5fc96ec9c0 20 remove_watcher() i=2 2024-09-14T11:27:53.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:53.079+0000 7f5fc96ec9c0 20 remove_watcher() i=3 2024-09-14T11:27:53.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:53.079+0000 7f5fc96ec9c0 20 remove_watcher() i=4 2024-09-14T11:27:53.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:53.083+0000 7f5fc96ec9c0 20 remove_watcher() i=5 2024-09-14T11:27:53.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:53.083+0000 7f5fc96ec9c0 20 remove_watcher() i=6 2024-09-14T11:27:53.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:27:53.087+0000 7f5fc96ec9c0 20 remove_watcher() i=7 2024-09-14T11:27:53.101 INFO:tasks.ragweed:Removing ragweed... 2024-09-14T11:27:53.101 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:27:53.189 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:27:53.746 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:27:53.746 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:27:53.746 DEBUG:teuthology.orchestra.run.smithi071:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:27:53.753 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:27:53.753 INFO:teuthology.orchestra.run.smithi071.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:27:53.754 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:27:53.801 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:27:53.801 DEBUG:teuthology.orchestra.run.smithi071:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:27:53.849 INFO:tasks.workunit:timeout=3h 2024-09-14T11:27:53.849 INFO:tasks.workunit:cleanup=True 2024-09-14T11:27:53.849 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:27:53.900 INFO:tasks.workunit.client.0.smithi071.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:28:48.458 INFO:tasks.workunit.client.0.smithi071.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:28:48.459 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:28:48.459 INFO:tasks.workunit.client.0.smithi071.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:28:48.459 INFO:tasks.workunit.client.0.smithi071.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:28:48.459 INFO:tasks.workunit.client.0.smithi071.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:28:48.459 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:28:48.459 INFO:tasks.workunit.client.0.smithi071.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:28:48.459 INFO:tasks.workunit.client.0.smithi071.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:28:48.459 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:28:48.459 INFO:tasks.workunit.client.0.smithi071.stderr: git switch -c 2024-09-14T11:28:48.459 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:28:48.459 INFO:tasks.workunit.client.0.smithi071.stderr:Or undo this operation with: 2024-09-14T11:28:48.460 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:28:48.460 INFO:tasks.workunit.client.0.smithi071.stderr: git switch - 2024-09-14T11:28:48.460 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:28:48.460 INFO:tasks.workunit.client.0.smithi071.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:28:48.460 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:28:48.460 INFO:tasks.workunit.client.0.smithi071.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:28:48.461 DEBUG:teuthology.orchestra.run.smithi071:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:28:48.507 INFO:tasks.workunit.client.0.smithi071.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:28:48.509 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:28:48.510 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:28:48.570 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:28:48.626 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:28:48.665 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:28:48.667 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:28:48.667 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:28:48.707 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:28:48.711 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T11:28:48.711 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:28:48.758 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-14T11:28:48.759 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-14T11:28:48.759 DEBUG:teuthology.orchestra.run.smithi071:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-14T11:28:48.811 INFO:tasks.workunit.client.0.smithi071.stderr:+ ulimit -c 0 2024-09-14T11:28:48.811 INFO:tasks.workunit.client.0.smithi071.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-14T11:28:48.812 INFO:tasks.workunit.client.0.smithi071.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:28:48.812 INFO:tasks.workunit.client.0.smithi071.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:28:51.808 INFO:tasks.workunit.client.0.smithi071.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T11:28:51.808 INFO:tasks.workunit.client.0.smithi071.stderr:++ deactivate nondestructive 2024-09-14T11:28:51.808 INFO:tasks.workunit.client.0.smithi071.stderr:++ '[' -n '' ']' 2024-09-14T11:28:51.808 INFO:tasks.workunit.client.0.smithi071.stderr:++ '[' -n '' ']' 2024-09-14T11:28:51.808 INFO:tasks.workunit.client.0.smithi071.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:28:51.808 INFO:tasks.workunit.client.0.smithi071.stderr:++ hash -r 2024-09-14T11:28:51.808 INFO:tasks.workunit.client.0.smithi071.stderr:++ '[' -n '' ']' 2024-09-14T11:28:51.808 INFO:tasks.workunit.client.0.smithi071.stderr:++ unset VIRTUAL_ENV 2024-09-14T11:28:51.809 INFO:tasks.workunit.client.0.smithi071.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-14T11:28:51.809 INFO:tasks.workunit.client.0.smithi071.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T11:28:51.809 INFO:tasks.workunit.client.0.smithi071.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:28:51.809 INFO:tasks.workunit.client.0.smithi071.stderr:++ export VIRTUAL_ENV 2024-09-14T11:28:51.809 INFO:tasks.workunit.client.0.smithi071.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T11:28:51.809 INFO:tasks.workunit.client.0.smithi071.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T11:28:51.809 INFO:tasks.workunit.client.0.smithi071.stderr:++ export PATH 2024-09-14T11:28:51.809 INFO:tasks.workunit.client.0.smithi071.stderr:++ '[' -n '' ']' 2024-09-14T11:28:51.809 INFO:tasks.workunit.client.0.smithi071.stderr:++ '[' -z '' ']' 2024-09-14T11:28:51.809 INFO:tasks.workunit.client.0.smithi071.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T11:28:51.809 INFO:tasks.workunit.client.0.smithi071.stderr:++ PS1='(rgw) ' 2024-09-14T11:28:51.809 INFO:tasks.workunit.client.0.smithi071.stderr:++ export PS1 2024-09-14T11:28:51.809 INFO:tasks.workunit.client.0.smithi071.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-14T11:28:51.810 INFO:tasks.workunit.client.0.smithi071.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-14T11:28:51.810 INFO:tasks.workunit.client.0.smithi071.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:28:51.810 INFO:tasks.workunit.client.0.smithi071.stderr:++ hash -r 2024-09-14T11:28:51.810 INFO:tasks.workunit.client.0.smithi071.stderr:+ pip install pip --upgrade 2024-09-14T11:28:52.197 INFO:tasks.workunit.client.0.smithi071.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-14T11:28:52.394 INFO:tasks.workunit.client.0.smithi071.stdout:Collecting pip 2024-09-14T11:28:52.400 INFO:tasks.workunit.client.0.smithi071.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:28:52.434 INFO:tasks.workunit.client.0.smithi071.stdout:Installing collected packages: pip 2024-09-14T11:28:52.434 INFO:tasks.workunit.client.0.smithi071.stdout: Attempting uninstall: pip 2024-09-14T11:28:52.434 INFO:tasks.workunit.client.0.smithi071.stdout: Found existing installation: pip 22.0.2 2024-09-14T11:28:52.688 INFO:tasks.workunit.client.0.smithi071.stdout: Uninstalling pip-22.0.2: 2024-09-14T11:28:52.694 INFO:tasks.workunit.client.0.smithi071.stdout: Successfully uninstalled pip-22.0.2 2024-09-14T11:28:53.741 INFO:tasks.workunit.client.0.smithi071.stdout:Successfully installed pip-24.2 2024-09-14T11:28:53.811 INFO:tasks.workunit.client.0.smithi071.stderr:+ pip install boto3 2024-09-14T11:28:54.785 INFO:tasks.workunit.client.0.smithi071.stdout:Collecting boto3 2024-09-14T11:28:54.786 INFO:tasks.workunit.client.0.smithi071.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:28:55.324 INFO:tasks.workunit.client.0.smithi071.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:28:55.325 INFO:tasks.workunit.client.0.smithi071.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:28:55.369 INFO:tasks.workunit.client.0.smithi071.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:28:55.370 INFO:tasks.workunit.client.0.smithi071.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:28:55.407 INFO:tasks.workunit.client.0.smithi071.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:28:55.409 INFO:tasks.workunit.client.0.smithi071.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:28:55.449 INFO:tasks.workunit.client.0.smithi071.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:28:55.451 INFO:tasks.workunit.client.0.smithi071.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:28:55.527 INFO:tasks.workunit.client.0.smithi071.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:28:55.528 INFO:tasks.workunit.client.0.smithi071.stdout: Using cached urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-14T11:28:55.739 INFO:tasks.workunit.client.0.smithi071.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:28:55.740 INFO:tasks.workunit.client.0.smithi071.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:28:55.743 INFO:tasks.workunit.client.0.smithi071.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:28:55.744 INFO:tasks.workunit.client.0.smithi071.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:28:55.754 INFO:tasks.workunit.client.0.smithi071.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:28:55.755 INFO:tasks.workunit.client.0.smithi071.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:28:55.757 INFO:tasks.workunit.client.0.smithi071.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:28:55.758 INFO:tasks.workunit.client.0.smithi071.stdout:Using cached urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-14T11:28:55.759 INFO:tasks.workunit.client.0.smithi071.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:28:55.827 INFO:tasks.workunit.client.0.smithi071.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:28:57.045 INFO:tasks.workunit.client.0.smithi071.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-14T11:28:57.269 INFO:tasks.workunit.client.0.smithi071.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-14T11:28:57.415 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-14T11:28:57.453 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:28:57.453 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:28:57.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.502+0000 7fc0d291b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:57.499 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.502+0000 7fc0d291b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:57.499 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.502+0000 7fc0d291b9c0 20 realm 2024-09-14T11:28:57.499 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.502+0000 7fc0d291b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:57.500 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.502+0000 7fc0d291b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:57.500 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.502+0000 7fc0d291b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:28:57.500 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.502+0000 7fc0d291b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:57.500 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.502+0000 7fc0d291b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:57.500 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.502+0000 7fc0d291b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:57.501 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.506+0000 7fc0d291b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:28:57.501 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.506+0000 7fc0d291b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:57.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.506+0000 7fc0d291b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:28:57.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.506+0000 7fc0d291b9c0 20 searching for the correct realm 2024-09-14T11:28:57.506 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.510+0000 7fc0d0c22640 0 -- 172.21.15.71:0/4078111480 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fc0c4015070 msgr2=0x7fc0c406df30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:28:57.720 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.722+0000 7fc0d0c22640 0 -- 172.21.15.71:0/4078111480 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x555e58af5020 msgr2=0x555e58af7430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:28:57.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.738+0000 7fc0d291b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:28:57.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.738+0000 7fc0d291b9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:28:57.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.738+0000 7fc0d291b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:28:57.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.738+0000 7fc0d291b9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:28:57.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.738+0000 7fc0d291b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:28:57.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.738+0000 7fc0d291b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:28:57.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.738+0000 7fc0d291b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:57.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.738+0000 7fc0d291b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:57.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.738+0000 7fc0d291b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:57.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.742+0000 7fc0d291b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:28:57.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.742+0000 7fc0d291b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:57.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.742+0000 7fc0d291b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:28:57.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.742+0000 7fc0d291b9c0 20 zone default found 2024-09-14T11:28:57.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.742+0000 7fc0d291b9c0 4 Realm: () 2024-09-14T11:28:57.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.742+0000 7fc0d291b9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:28:57.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.742+0000 7fc0d291b9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:28:57.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.742+0000 7fc0d291b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:28:57.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.742+0000 7fc0d291b9c0 20 zonegroup default 2024-09-14T11:28:57.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.742+0000 7fc0d291b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:57.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.742+0000 7fc0d291b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:57.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.742+0000 7fc0d291b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:57.739 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.742+0000 7fc0d291b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:57.739 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.742+0000 7fc0d291b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:57.740 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.742+0000 7fc0d291b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:57.740 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.742+0000 7fc0d291b9c0 20 started sync module instance, tier type = 2024-09-14T11:28:57.740 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.742+0000 7fc0d291b9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:28:57.763 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.766+0000 7fc0d291b9c0 20 add_watcher() i=0 2024-09-14T11:28:57.763 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.766+0000 7fc0d291b9c0 20 add_watcher() i=1 2024-09-14T11:28:57.763 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.766+0000 7fc0d291b9c0 20 add_watcher() i=2 2024-09-14T11:28:57.763 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.766+0000 7fc0d291b9c0 20 add_watcher() i=3 2024-09-14T11:28:57.763 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.766+0000 7fc0d291b9c0 20 add_watcher() i=4 2024-09-14T11:28:57.763 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.766+0000 7fc0d291b9c0 20 add_watcher() i=5 2024-09-14T11:28:57.763 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.766+0000 7fc0d291b9c0 20 add_watcher() i=6 2024-09-14T11:28:57.765 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.770+0000 7fc0d291b9c0 20 add_watcher() i=7 2024-09-14T11:28:57.765 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.770+0000 7fc0d291b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:28:57.769 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.774+0000 7fbf86fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:28:57.770 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.774+0000 7fc0d291b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:28:57.770 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.774+0000 7fc0d291b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:28:57.771 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.774+0000 7fc0d291b9c0 5 note: GC not initialized 2024-09-14T11:28:57.771 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.774+0000 7fbf85fdb640 20 reqs_thread_entry: start 2024-09-14T11:28:57.771 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.774+0000 7fc0d291b9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:28:57.772 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.774+0000 7fc0d291b9c0 20 Filter name: none 2024-09-14T11:28:57.772 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.774+0000 7fbef77fe640 20 reqs_thread_entry: start 2024-09-14T11:28:57.772 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.774+0000 7fc0d291b9c0 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-14T11:28:57.772 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.774+0000 7fc0d291b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:57.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.778+0000 7fc0d291b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:57.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.778+0000 7fc0d291b9c0 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-14T11:28:57.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.778+0000 7fc0d291b9c0 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-14T11:28:57.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.778+0000 7fc0d291b9c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-14T11:28:57.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.778+0000 7fc0d291b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:57.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.778+0000 7fc0d291b9c0 20 rados_obj.operate() r=0 bl.length=22 2024-09-14T11:28:57.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.778+0000 7fc0d291b9c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x5 2024-09-14T11:28:57.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.778+0000 7fc0d291b9c0 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-14T11:28:57.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.778+0000 7fc0d291b9c0 10 cache get: name=default.rgw.meta+users.uid+rgw_datacache_user : miss 2024-09-14T11:28:57.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.778+0000 7fc0d291b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:57.775 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.778+0000 7fc0d291b9c0 20 rados_obj.operate() r=0 bl.length=420 2024-09-14T11:28:57.775 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.778+0000 7fc0d291b9c0 10 cache put: name=default.rgw.meta+users.uid+rgw_datacache_user info.flags=0x13 2024-09-14T11:28:57.775 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.778+0000 7fc0d291b9c0 10 adding default.rgw.meta+users.uid+rgw_datacache_user to cache LRU end 2024-09-14T11:28:57.775 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.778+0000 7fc0d291b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:28:57.775 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.778+0000 7fc0d291b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+rgw_datacache_user 2024-09-14T11:28:57.775 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.778+0000 7fc0d291b9c0 20 get_user_info_from_index found 0 xattrs 2024-09-14T11:28:57.775 INFO:tasks.workunit.client.0.smithi071.stderr:could not create user: unable to parse parameters, duplicate key provided 2024-09-14T11:28:57.776 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.778+0000 7fbf86fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:28:57.780 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.786+0000 7fc0d291b9c0 20 remove_watcher() i=0 2024-09-14T11:28:57.780 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.786+0000 7fc0d291b9c0 2 removed watcher, disabling cache 2024-09-14T11:28:57.782 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.786+0000 7fc0d291b9c0 20 remove_watcher() i=1 2024-09-14T11:28:57.784 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.786+0000 7fc0d291b9c0 20 remove_watcher() i=2 2024-09-14T11:28:57.786 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.790+0000 7fc0d291b9c0 20 remove_watcher() i=3 2024-09-14T11:28:57.789 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.794+0000 7fc0d291b9c0 20 remove_watcher() i=4 2024-09-14T11:28:57.791 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.794+0000 7fc0d291b9c0 20 remove_watcher() i=5 2024-09-14T11:28:57.794 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.798+0000 7fc0d291b9c0 20 remove_watcher() i=6 2024-09-14T11:28:57.796 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:57.802+0000 7fc0d291b9c0 20 remove_watcher() i=7 2024-09-14T11:28:58.093 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: reshard add 2024-09-14T11:28:58.093 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:28:58.094 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:28:58.127 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:28:58.127 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:28:58.172 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.174+0000 7f667e8ff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.178+0000 7f667e8ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:58.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.178+0000 7f667e8ff9c0 20 realm 2024-09-14T11:28:58.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.178+0000 7f667e8ff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.178+0000 7f667e8ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:58.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.178+0000 7f667e8ff9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:28:58.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.178+0000 7f667e8ff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.178+0000 7f667e8ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:58.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.178+0000 7f667e8ff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.182+0000 7f667e8ff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:28:58.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.182+0000 7f667e8ff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.182+0000 7f667e8ff9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:28:58.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.182+0000 7f667e8ff9c0 20 searching for the correct realm 2024-09-14T11:28:58.182 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.186+0000 7f667c405640 0 -- 172.21.15.71:0/2376173917 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x555cceb56890 msgr2=0x555cceb58d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:28:58.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.194+0000 7f667cc06640 0 -- 172.21.15.71:0/2376173917 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x555cceb51b30 msgr2=0x555cceb53f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:28:58.198 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.202+0000 7f667e8ff9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:28:58.198 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.202+0000 7f667e8ff9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:28:58.198 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.202+0000 7f667e8ff9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:28:58.198 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.202+0000 7f667e8ff9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:28:58.198 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.202+0000 7f667e8ff9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:28:58.199 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.202+0000 7f667e8ff9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:28:58.199 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.202+0000 7f667e8ff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.199 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.202+0000 7f667e8ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:58.199 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.202+0000 7f667e8ff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.199 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.202+0000 7f667e8ff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:28:58.199 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.202+0000 7f667e8ff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.202+0000 7f667e8ff9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:28:58.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.202+0000 7f667e8ff9c0 20 zone default found 2024-09-14T11:28:58.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.202+0000 7f667e8ff9c0 4 Realm: () 2024-09-14T11:28:58.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.202+0000 7f667e8ff9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:28:58.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.202+0000 7f667e8ff9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:28:58.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.202+0000 7f667e8ff9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:28:58.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.202+0000 7f667e8ff9c0 20 zonegroup default 2024-09-14T11:28:58.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.202+0000 7f667e8ff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.201 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.206+0000 7f667e8ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:58.201 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.206+0000 7f667e8ff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.201 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.206+0000 7f667e8ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:58.201 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.206+0000 7f667e8ff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.202 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.206+0000 7f667e8ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:58.202 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.206+0000 7f667e8ff9c0 20 started sync module instance, tier type = 2024-09-14T11:28:58.202 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.206+0000 7f667e8ff9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:28:58.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.222+0000 7f667e8ff9c0 20 add_watcher() i=0 2024-09-14T11:28:58.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.222+0000 7f667e8ff9c0 20 add_watcher() i=1 2024-09-14T11:28:58.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.222+0000 7f667e8ff9c0 20 add_watcher() i=2 2024-09-14T11:28:58.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.222+0000 7f667e8ff9c0 20 add_watcher() i=3 2024-09-14T11:28:58.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.222+0000 7f667e8ff9c0 20 add_watcher() i=4 2024-09-14T11:28:58.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.222+0000 7f667e8ff9c0 20 add_watcher() i=5 2024-09-14T11:28:58.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.222+0000 7f667e8ff9c0 20 add_watcher() i=6 2024-09-14T11:28:58.222 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.226+0000 7f667e8ff9c0 20 add_watcher() i=7 2024-09-14T11:28:58.222 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.226+0000 7f667e8ff9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:28:58.225 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.230+0000 7f6532fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:28:58.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.230+0000 7f667e8ff9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:28:58.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.230+0000 7f667e8ff9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:28:58.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.230+0000 7f667e8ff9c0 5 note: GC not initialized 2024-09-14T11:28:58.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.230+0000 7f6531fdb640 20 reqs_thread_entry: start 2024-09-14T11:28:58.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.230+0000 7f667e8ff9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:28:58.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.230+0000 7f667e8ff9c0 20 Filter name: none 2024-09-14T11:28:58.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.230+0000 7f667e8ff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.230+0000 7f64a37fe640 20 reqs_thread_entry: start 2024-09-14T11:28:58.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.230+0000 7f667e8ff9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:28:58.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.230+0000 7f667e8ff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.230+0000 7f667e8ff9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:28:58.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.230+0000 7f667e8ff9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:28:58.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.230+0000 7f667e8ff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.230+0000 7f667e8ff9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:28:58.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.230+0000 7f667e8ff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.230+0000 7f667e8ff9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:28:58.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.230+0000 7f667e8ff9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:28:58.230 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.234+0000 7f6532fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:28:58.234 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.238+0000 7f667e8ff9c0 20 remove_watcher() i=0 2024-09-14T11:28:58.234 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.238+0000 7f667e8ff9c0 2 removed watcher, disabling cache 2024-09-14T11:28:58.236 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.238+0000 7f667e8ff9c0 20 remove_watcher() i=1 2024-09-14T11:28:58.238 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.242+0000 7f667e8ff9c0 20 remove_watcher() i=2 2024-09-14T11:28:58.240 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.242+0000 7f667e8ff9c0 20 remove_watcher() i=3 2024-09-14T11:28:58.242 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.246+0000 7f667e8ff9c0 20 remove_watcher() i=4 2024-09-14T11:28:58.244 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.246+0000 7f667e8ff9c0 20 remove_watcher() i=5 2024-09-14T11:28:58.246 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.250+0000 7f667e8ff9c0 20 remove_watcher() i=6 2024-09-14T11:28:58.249 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.254+0000 7f667e8ff9c0 20 remove_watcher() i=7 2024-09-14T11:28:58.262 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:28:58.263 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:28:58.263 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: a-bucket id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-14T11:28:58.263 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:28:58.263 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-09-14T11:28:58.291 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:28:58.292 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:28:58.334 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.338+0000 7f201a7db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.337 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.342+0000 7f201a7db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:58.337 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.342+0000 7f201a7db9c0 20 realm 2024-09-14T11:28:58.337 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.342+0000 7f201a7db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.337 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.342+0000 7f201a7db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:58.337 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.342+0000 7f201a7db9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:28:58.338 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.342+0000 7f201a7db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.338 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.342+0000 7f201a7db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:58.338 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.342+0000 7f201a7db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.339 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.342+0000 7f201a7db9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:28:58.339 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.342+0000 7f201a7db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.340 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.342+0000 7f201a7db9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:28:58.340 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.342+0000 7f201a7db9c0 20 searching for the correct realm 2024-09-14T11:28:58.343 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.346+0000 7f2018ae2640 0 -- 172.21.15.71:0/433905863 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f200c0b9450 msgr2=0x7f200c0b98d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:28:58.556 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.558+0000 7f2018ae2640 0 -- 172.21.15.71:0/433905863 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x561a304c7e00 msgr2=0x561a304ca230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:28:58.570 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.574+0000 7f201a7db9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:28:58.570 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.574+0000 7f201a7db9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:28:58.570 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.574+0000 7f201a7db9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:28:58.571 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.574+0000 7f201a7db9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:28:58.571 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.574+0000 7f201a7db9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:28:58.571 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.574+0000 7f201a7db9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:28:58.571 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.574+0000 7f201a7db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.571 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.574+0000 7f201a7db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:58.571 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.574+0000 7f201a7db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.572 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.574+0000 7f201a7db9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:28:58.572 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.574+0000 7f201a7db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.578+0000 7f201a7db9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:28:58.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.578+0000 7f201a7db9c0 20 zone default found 2024-09-14T11:28:58.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.578+0000 7f201a7db9c0 4 Realm: () 2024-09-14T11:28:58.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.578+0000 7f201a7db9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:28:58.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.578+0000 7f201a7db9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:28:58.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.578+0000 7f201a7db9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:28:58.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.578+0000 7f201a7db9c0 20 zonegroup default 2024-09-14T11:28:58.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.578+0000 7f201a7db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.578+0000 7f201a7db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:58.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.578+0000 7f201a7db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.578+0000 7f201a7db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:58.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.578+0000 7f201a7db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.575 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.578+0000 7f201a7db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:58.575 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.578+0000 7f201a7db9c0 20 started sync module instance, tier type = 2024-09-14T11:28:58.575 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.578+0000 7f201a7db9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:28:58.597 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.602+0000 7f201a7db9c0 20 add_watcher() i=0 2024-09-14T11:28:58.597 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.602+0000 7f201a7db9c0 20 add_watcher() i=1 2024-09-14T11:28:58.597 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.602+0000 7f201a7db9c0 20 add_watcher() i=2 2024-09-14T11:28:58.597 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.602+0000 7f201a7db9c0 20 add_watcher() i=3 2024-09-14T11:28:58.598 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.602+0000 7f201a7db9c0 20 add_watcher() i=4 2024-09-14T11:28:58.598 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.602+0000 7f201a7db9c0 20 add_watcher() i=5 2024-09-14T11:28:58.598 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.602+0000 7f201a7db9c0 20 add_watcher() i=6 2024-09-14T11:28:58.600 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.602+0000 7f201a7db9c0 20 add_watcher() i=7 2024-09-14T11:28:58.600 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.602+0000 7f201a7db9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:28:58.604 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.606+0000 7f1ecefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:28:58.605 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.610+0000 7f201a7db9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:28:58.606 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.610+0000 7f201a7db9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:28:58.606 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.610+0000 7f201a7db9c0 5 note: GC not initialized 2024-09-14T11:28:58.606 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.610+0000 7f1ecdfdb640 20 reqs_thread_entry: start 2024-09-14T11:28:58.606 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.610+0000 7f201a7db9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:28:58.607 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.610+0000 7f201a7db9c0 20 Filter name: none 2024-09-14T11:28:58.607 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.610+0000 7f1e3f7fe640 20 reqs_thread_entry: start 2024-09-14T11:28:58.607 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.610+0000 7f201a7db9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:28:58.607 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.610+0000 7f201a7db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.607 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.610+0000 7f201a7db9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:28:58.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.610+0000 7f201a7db9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:28:58.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.610+0000 7f201a7db9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:28:58.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.610+0000 7f201a7db9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 : miss 2024-09-14T11:28:58.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.610+0000 7f201a7db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.610+0000 7f201a7db9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:28:58.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.610+0000 7f201a7db9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:28:58.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.610+0000 7f201a7db9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:28:58.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.610+0000 7f201a7db9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:28:58.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.610+0000 7f201a7db9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:28:58.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.610+0000 7f201a7db9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 2024-09-14T11:28:58.611 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.614+0000 7f1ecefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:28:58.615 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.618+0000 7f201a7db9c0 20 remove_watcher() i=0 2024-09-14T11:28:58.615 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.618+0000 7f201a7db9c0 2 removed watcher, disabling cache 2024-09-14T11:28:58.618 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.622+0000 7f201a7db9c0 20 remove_watcher() i=1 2024-09-14T11:28:58.619 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.622+0000 7f201a7db9c0 20 remove_watcher() i=2 2024-09-14T11:28:58.622 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.626+0000 7f201a7db9c0 20 remove_watcher() i=3 2024-09-14T11:28:58.624 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.626+0000 7f201a7db9c0 20 remove_watcher() i=4 2024-09-14T11:28:58.626 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.630+0000 7f201a7db9c0 20 remove_watcher() i=5 2024-09-14T11:28:58.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.634+0000 7f201a7db9c0 20 remove_watcher() i=6 2024-09-14T11:28:58.631 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.634+0000 7f201a7db9c0 20 remove_watcher() i=7 2024-09-14T11:28:58.648 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin reshard list 2024-09-14T11:28:58.677 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:28:58.677 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:28:58.722 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.726+0000 7fdff15789c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.724 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.726+0000 7fdff15789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:58.724 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.726+0000 7fdff15789c0 20 realm 2024-09-14T11:28:58.724 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.726+0000 7fdff15789c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.725 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.730+0000 7fdff15789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:58.725 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.730+0000 7fdff15789c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:28:58.725 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.730+0000 7fdff15789c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.725 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.730+0000 7fdff15789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:58.725 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.730+0000 7fdff15789c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.726 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.730+0000 7fdff15789c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:28:58.726 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.730+0000 7fdff15789c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.730+0000 7fdff15789c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:28:58.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.730+0000 7fdff15789c0 20 searching for the correct realm 2024-09-14T11:28:58.731 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.734+0000 7fdfef87f640 0 -- 172.21.15.71:0/3939323875 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fdfd8008070 msgr2=0x7fdfd8093050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:28:58.945 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.950+0000 7fdfef87f640 0 -- 172.21.15.71:0/3939323875 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55ed58e62cb0 msgr2=0x55ed58e650a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:28:58.960 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.962+0000 7fdff15789c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:28:58.960 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.962+0000 7fdff15789c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:28:58.960 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.962+0000 7fdff15789c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:28:58.960 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.962+0000 7fdff15789c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:28:58.961 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.962+0000 7fdff15789c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:28:58.961 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.962+0000 7fdff15789c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:28:58.961 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.962+0000 7fdff15789c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.961 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.966+0000 7fdff15789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:58.961 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.966+0000 7fdff15789c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.962 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.966+0000 7fdff15789c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:28:58.962 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.966+0000 7fdff15789c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.966+0000 7fdff15789c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:28:58.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.966+0000 7fdff15789c0 20 zone default found 2024-09-14T11:28:58.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.966+0000 7fdff15789c0 4 Realm: () 2024-09-14T11:28:58.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.966+0000 7fdff15789c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:28:58.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.966+0000 7fdff15789c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:28:58.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.966+0000 7fdff15789c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:28:58.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.966+0000 7fdff15789c0 20 zonegroup default 2024-09-14T11:28:58.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.966+0000 7fdff15789c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.964 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.966+0000 7fdff15789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:58.964 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.966+0000 7fdff15789c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.964 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.966+0000 7fdff15789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:58.964 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.966+0000 7fdff15789c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:58.965 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.970+0000 7fdff15789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:58.965 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.970+0000 7fdff15789c0 20 started sync module instance, tier type = 2024-09-14T11:28:58.965 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.970+0000 7fdff15789c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:28:58.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.990+0000 7fdff15789c0 20 add_watcher() i=0 2024-09-14T11:28:58.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.990+0000 7fdff15789c0 20 add_watcher() i=1 2024-09-14T11:28:58.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.990+0000 7fdff15789c0 20 add_watcher() i=2 2024-09-14T11:28:58.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.990+0000 7fdff15789c0 20 add_watcher() i=3 2024-09-14T11:28:58.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.990+0000 7fdff15789c0 20 add_watcher() i=4 2024-09-14T11:28:58.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.990+0000 7fdff15789c0 20 add_watcher() i=5 2024-09-14T11:28:58.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.990+0000 7fdff15789c0 20 add_watcher() i=6 2024-09-14T11:28:58.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.994+0000 7fdff15789c0 20 add_watcher() i=7 2024-09-14T11:28:58.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.994+0000 7fdff15789c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:28:58.995 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.998+0000 7fdea5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:28:58.996 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.998+0000 7fdff15789c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:28:58.996 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.998+0000 7fdff15789c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:28:58.996 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.998+0000 7fdff15789c0 5 note: GC not initialized 2024-09-14T11:28:58.996 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:58.998+0000 7fdea4fe1640 20 reqs_thread_entry: start 2024-09-14T11:28:58.996 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.002+0000 7fdff15789c0 20 init_complete bucket index max shards: 11 2024-09-14T11:28:58.997 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.002+0000 7fdff15789c0 20 Filter name: none 2024-09-14T11:28:58.997 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.002+0000 7fde1e7fc640 20 reqs_thread_entry: start 2024-09-14T11:28:59.009 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.014+0000 7fdea5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:28:59.013 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.018+0000 7fdff15789c0 20 remove_watcher() i=0 2024-09-14T11:28:59.014 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.018+0000 7fdff15789c0 2 removed watcher, disabling cache 2024-09-14T11:28:59.016 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.018+0000 7fdff15789c0 20 remove_watcher() i=1 2024-09-14T11:28:59.018 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.022+0000 7fdff15789c0 20 remove_watcher() i=2 2024-09-14T11:28:59.020 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.022+0000 7fdff15789c0 20 remove_watcher() i=3 2024-09-14T11:28:59.022 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.026+0000 7fdff15789c0 20 remove_watcher() i=4 2024-09-14T11:28:59.025 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.030+0000 7fdff15789c0 20 remove_watcher() i=5 2024-09-14T11:28:59.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.030+0000 7fdff15789c0 20 remove_watcher() i=6 2024-09-14T11:28:59.030 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.034+0000 7fdff15789c0 20 remove_watcher() i=7 2024-09-14T11:28:59.046 INFO:tasks.workunit.client.0.smithi071.stderr:bucket name a-bucket 2024-09-14T11:28:59.047 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: reshard process 2024-09-14T11:28:59.047 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:28:59.047 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin reshard process 2024-09-14T11:28:59.073 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:28:59.073 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:28:59.117 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.122+0000 7faecc9d59c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.119 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.122+0000 7faecc9d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:59.119 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.122+0000 7faecc9d59c0 20 realm 2024-09-14T11:28:59.119 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.122+0000 7faecc9d59c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.120 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.122+0000 7faecc9d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:59.120 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.122+0000 7faecc9d59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:28:59.120 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.122+0000 7faecc9d59c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.120 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.126+0000 7faecc9d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:59.121 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.126+0000 7faecc9d59c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.121 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.126+0000 7faecc9d59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:28:59.121 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.126+0000 7faecc9d59c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.122 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.126+0000 7faecc9d59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:28:59.122 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.126+0000 7faecc9d59c0 20 searching for the correct realm 2024-09-14T11:28:59.126 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.130+0000 7faecacdc640 0 -- 172.21.15.71:0/887957767 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7faeb40d3070 msgr2=0x7faeb40c2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:28:59.341 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.346+0000 7faecacdc640 0 -- 172.21.15.71:0/887957767 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x561b357e65c0 msgr2=0x561b357e89d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:28:59.355 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.358+0000 7faecc9d59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:28:59.355 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.358+0000 7faecc9d59c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:28:59.355 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.358+0000 7faecc9d59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:28:59.355 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.358+0000 7faecc9d59c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:28:59.356 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.358+0000 7faecc9d59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:28:59.356 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.358+0000 7faecc9d59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:28:59.356 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.358+0000 7faecc9d59c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.356 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.358+0000 7faecc9d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:59.356 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.358+0000 7faecc9d59c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.357 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.362+0000 7faecc9d59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:28:59.357 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.362+0000 7faecc9d59c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.358 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.362+0000 7faecc9d59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:28:59.358 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.362+0000 7faecc9d59c0 20 zone default found 2024-09-14T11:28:59.358 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.362+0000 7faecc9d59c0 4 Realm: () 2024-09-14T11:28:59.358 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.362+0000 7faecc9d59c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:28:59.358 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.362+0000 7faecc9d59c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:28:59.358 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.362+0000 7faecc9d59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:28:59.358 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.362+0000 7faecc9d59c0 20 zonegroup default 2024-09-14T11:28:59.358 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.362+0000 7faecc9d59c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.359 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.362+0000 7faecc9d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:59.359 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.362+0000 7faecc9d59c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.359 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.362+0000 7faecc9d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:59.359 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.362+0000 7faecc9d59c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.361 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.366+0000 7faecc9d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:59.361 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.366+0000 7faecc9d59c0 20 started sync module instance, tier type = 2024-09-14T11:28:59.362 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.366+0000 7faecc9d59c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:28:59.383 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.386+0000 7faecc9d59c0 20 add_watcher() i=0 2024-09-14T11:28:59.383 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.386+0000 7faecc9d59c0 20 add_watcher() i=1 2024-09-14T11:28:59.384 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.386+0000 7faecc9d59c0 20 add_watcher() i=2 2024-09-14T11:28:59.384 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.386+0000 7faecc9d59c0 20 add_watcher() i=3 2024-09-14T11:28:59.384 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.386+0000 7faecc9d59c0 20 add_watcher() i=4 2024-09-14T11:28:59.384 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.386+0000 7faecc9d59c0 20 add_watcher() i=5 2024-09-14T11:28:59.384 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.386+0000 7faecc9d59c0 20 add_watcher() i=6 2024-09-14T11:28:59.386 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.390+0000 7faecc9d59c0 20 add_watcher() i=7 2024-09-14T11:28:59.386 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.390+0000 7faecc9d59c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:28:59.390 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.394+0000 7fad80fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:28:59.391 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.394+0000 7faecc9d59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:28:59.391 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.394+0000 7faecc9d59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:28:59.391 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.394+0000 7faecc9d59c0 5 note: GC not initialized 2024-09-14T11:28:59.392 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.394+0000 7facfb7fe640 20 reqs_thread_entry: start 2024-09-14T11:28:59.392 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.394+0000 7faecc9d59c0 20 init_complete bucket index max shards: 11 2024-09-14T11:28:59.392 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.394+0000 7faecc9d59c0 20 Filter name: none 2024-09-14T11:28:59.393 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.398+0000 7facf97fa640 20 reqs_thread_entry: start 2024-09-14T11:28:59.393 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.398+0000 7faecc9d59c0 20 processing logshard = reshard.0000000000 2024-09-14T11:28:59.397 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.402+0000 7faecc9d59c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-14T11:28:59.397 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.402+0000 7faecc9d59c0 20 processing logshard = reshard.0000000001 2024-09-14T11:28:59.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.406+0000 7faecc9d59c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-14T11:28:59.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.406+0000 7faecc9d59c0 20 processing logshard = reshard.0000000002 2024-09-14T11:28:59.410 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.414+0000 7faecc9d59c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-14T11:28:59.410 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.414+0000 7faecc9d59c0 20 processing logshard = reshard.0000000003 2024-09-14T11:28:59.415 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.418+0000 7faecc9d59c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-14T11:28:59.415 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.418+0000 7faecc9d59c0 20 processing logshard = reshard.0000000004 2024-09-14T11:28:59.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.426+0000 7faecc9d59c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-14T11:28:59.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.426+0000 7faecc9d59c0 20 processing logshard = reshard.0000000005 2024-09-14T11:28:59.427 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.430+0000 7faecc9d59c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-14T11:28:59.427 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.430+0000 7faecc9d59c0 20 processing logshard = reshard.0000000006 2024-09-14T11:28:59.430 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.434+0000 7faecc9d59c0 20 process_entry resharding a-bucket 2024-09-14T11:28:59.430 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.434+0000 7faecc9d59c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:28:59.430 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.434+0000 7faecc9d59c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.431 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.434+0000 7faecc9d59c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:28:59.431 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.434+0000 7faecc9d59c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-14T11:28:59.431 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.434+0000 7faecc9d59c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:28:59.431 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.434+0000 7faecc9d59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 : miss 2024-09-14T11:28:59.431 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.434+0000 7faecc9d59c0 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.432 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.434+0000 7faecc9d59c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:28:59.432 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.434+0000 7faecc9d59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:28:59.432 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.434+0000 7faecc9d59c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:28:59.432 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.434+0000 7faecc9d59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:28:59.432 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.434+0000 7faecc9d59c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:28:59.432 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.434+0000 7faecc9d59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 2024-09-14T11:28:59.445 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.450+0000 7faecc9d59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:28:59.446 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.450+0000 7faecc9d59c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:28:59.446 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.450+0000 7faecc9d59c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:28:59.446 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.450+0000 7faecc9d59c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18, ofs0, ns] 2024-09-14T11:28:59.446 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.450+0000 7fadadffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464342 cookie 94674861610240 notifier 6039 bl.length()=911 2024-09-14T11:28:59.446 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.450+0000 7fadadffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:28:59.446 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.450+0000 7fadadffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:28:59.446 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.450+0000 7fadadffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:28:59.446 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.450+0000 7faecc9d59c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_sources= new_sources= 2024-09-14T11:28:59.447 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.450+0000 7faecc9d59c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential sources added=[] removed=[] 2024-09-14T11:28:59.447 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.450+0000 7faecc9d59c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_dests= new_dests= 2024-09-14T11:28:59.447 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.450+0000 7faecc9d59c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential dests added=[] removed=[] 2024-09-14T11:28:59.458 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.462+0000 7faecc9d59c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.0 2024-09-14T11:28:59.458 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.462+0000 7faecc9d59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.0 2024-09-14T11:28:59.458 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.462+0000 7faecc9d59c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.1 2024-09-14T11:28:59.458 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.462+0000 7faecc9d59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.1 2024-09-14T11:28:59.458 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.462+0000 7faecc9d59c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.2 2024-09-14T11:28:59.458 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.462+0000 7faecc9d59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.2 2024-09-14T11:28:59.458 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.462+0000 7faecc9d59c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.3 2024-09-14T11:28:59.458 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.462+0000 7faecc9d59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.3 2024-09-14T11:28:59.458 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.462+0000 7faecc9d59c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.4 2024-09-14T11:28:59.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.462+0000 7faecc9d59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.4 2024-09-14T11:28:59.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.462+0000 7faecc9d59c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.5 2024-09-14T11:28:59.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.462+0000 7faecc9d59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.5 2024-09-14T11:28:59.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.462+0000 7faecc9d59c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.6 2024-09-14T11:28:59.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.462+0000 7faecc9d59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.6 2024-09-14T11:28:59.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.462+0000 7faecc9d59c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.7 2024-09-14T11:28:59.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.462+0000 7faecc9d59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.7 2024-09-14T11:28:59.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.462+0000 7faecc9d59c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.8 2024-09-14T11:28:59.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.462+0000 7faecc9d59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.8 2024-09-14T11:28:59.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.462+0000 7faecc9d59c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.9 2024-09-14T11:28:59.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.462+0000 7faecc9d59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.9 2024-09-14T11:28:59.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.462+0000 7faecc9d59c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.10 2024-09-14T11:28:59.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.462+0000 7faecc9d59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.10 2024-09-14T11:28:59.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.462+0000 7faecc9d59c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.11 2024-09-14T11:28:59.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.462+0000 7faecc9d59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.11 2024-09-14T11:28:59.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.462+0000 7faecc9d59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.0 2024-09-14T11:28:59.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.462+0000 7faecc9d59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1 2024-09-14T11:28:59.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.462+0000 7faecc9d59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2 2024-09-14T11:28:59.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.462+0000 7faecc9d59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3 2024-09-14T11:28:59.461 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.466+0000 7faecc9d59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.4 2024-09-14T11:28:59.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.466+0000 7faecc9d59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.5 2024-09-14T11:28:59.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.466+0000 7faecc9d59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.6 2024-09-14T11:28:59.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.470+0000 7faecc9d59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.7 2024-09-14T11:28:59.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.470+0000 7faecc9d59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.8 2024-09-14T11:28:59.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.470+0000 7faecc9d59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.9 2024-09-14T11:28:59.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.470+0000 7faecc9d59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.10 2024-09-14T11:28:59.468 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.474+0000 7faecc9d59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:28:59.468 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.474+0000 7faecc9d59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 2024-09-14T11:28:59.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.474+0000 7faecc9d59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:28:59.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.474+0000 7faecc9d59c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:28:59.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.474+0000 7faecc9d59c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:28:59.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.474+0000 7faecc9d59c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18, ofs0, ns] 2024-09-14T11:28:59.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.474+0000 7fadad7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464343 cookie 94674861610240 notifier 6039 bl.length()=911 2024-09-14T11:28:59.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.474+0000 7fadad7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:28:59.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.474+0000 7fadad7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:28:59.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.474+0000 7fadad7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:28:59.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.474+0000 7faecc9d59c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_sources= new_sources= 2024-09-14T11:28:59.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.474+0000 7faecc9d59c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential sources added=[] removed=[] 2024-09-14T11:28:59.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.474+0000 7faecc9d59c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_dests= new_dests= 2024-09-14T11:28:59.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.474+0000 7faecc9d59c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential dests added=[] removed=[] 2024-09-14T11:28:59.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.482+0000 7faecc9d59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.0 2024-09-14T11:28:59.478 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.482+0000 7faecc9d59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1 2024-09-14T11:28:59.479 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.482+0000 7faecc9d59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2 2024-09-14T11:28:59.480 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.482+0000 7faecc9d59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3 2024-09-14T11:28:59.480 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.482+0000 7faecc9d59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.4 2024-09-14T11:28:59.480 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.486+0000 7faecc9d59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.5 2024-09-14T11:28:59.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.486+0000 7faecc9d59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.6 2024-09-14T11:28:59.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.486+0000 7faecc9d59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.7 2024-09-14T11:28:59.483 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.486+0000 7faecc9d59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.8 2024-09-14T11:28:59.484 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.486+0000 7faecc9d59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.9 2024-09-14T11:28:59.485 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.490+0000 7faecc9d59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.10 2024-09-14T11:28:59.486 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.490+0000 7faecc9d59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:28:59.486 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.490+0000 7faecc9d59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 2024-09-14T11:28:59.487 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.490+0000 7faecc9d59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:28:59.488 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.490+0000 7faecc9d59c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:28:59.488 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.490+0000 7faecc9d59c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:28:59.488 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.490+0000 7faecc9d59c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18, ofs0, ns] 2024-09-14T11:28:59.488 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.490+0000 7fadad7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464344 cookie 94674861610240 notifier 6039 bl.length()=879 2024-09-14T11:28:59.488 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.490+0000 7fadad7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:28:59.488 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.490+0000 7fadad7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:28:59.488 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.490+0000 7fadad7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:28:59.489 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.494+0000 7faecc9d59c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_sources= new_sources= 2024-09-14T11:28:59.489 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.494+0000 7faecc9d59c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential sources added=[] removed=[] 2024-09-14T11:28:59.489 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.494+0000 7faecc9d59c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_dests= new_dests= 2024-09-14T11:28:59.489 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.494+0000 7faecc9d59c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential dests added=[] removed=[] 2024-09-14T11:28:59.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.498+0000 7faecc9d59c0 1 execute INFO: reshard of bucket "a-bucket" from 11 shards to 12 shards completed successfully 2024-09-14T11:28:59.497 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.502+0000 7faecc9d59c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-14T11:28:59.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.506+0000 7faecc9d59c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-14T11:28:59.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.506+0000 7faecc9d59c0 20 processing logshard = reshard.0000000007 2024-09-14T11:28:59.508 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.510+0000 7faecc9d59c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-14T11:28:59.508 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.510+0000 7faecc9d59c0 20 processing logshard = reshard.0000000008 2024-09-14T11:28:59.513 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.518+0000 7faecc9d59c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-14T11:28:59.513 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.518+0000 7faecc9d59c0 20 processing logshard = reshard.0000000009 2024-09-14T11:28:59.518 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.522+0000 7faecc9d59c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-14T11:28:59.518 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.522+0000 7faecc9d59c0 20 processing logshard = reshard.0000000010 2024-09-14T11:28:59.524 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.526+0000 7faecc9d59c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-14T11:28:59.524 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.526+0000 7faecc9d59c0 20 processing logshard = reshard.0000000011 2024-09-14T11:28:59.529 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.534+0000 7faecc9d59c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-14T11:28:59.529 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.534+0000 7faecc9d59c0 20 processing logshard = reshard.0000000012 2024-09-14T11:28:59.533 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.538+0000 7faecc9d59c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-14T11:28:59.533 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.538+0000 7faecc9d59c0 20 processing logshard = reshard.0000000013 2024-09-14T11:28:59.538 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.542+0000 7faecc9d59c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-14T11:28:59.538 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.542+0000 7faecc9d59c0 20 processing logshard = reshard.0000000014 2024-09-14T11:28:59.545 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.550+0000 7faecc9d59c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-14T11:28:59.545 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.550+0000 7faecc9d59c0 20 processing logshard = reshard.0000000015 2024-09-14T11:28:59.549 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.554+0000 7faecc9d59c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-14T11:28:59.551 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.554+0000 7fad80fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:28:59.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.558+0000 7faecc9d59c0 20 remove_watcher() i=0 2024-09-14T11:28:59.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.558+0000 7faecc9d59c0 2 removed watcher, disabling cache 2024-09-14T11:28:59.557 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.562+0000 7faecc9d59c0 20 remove_watcher() i=1 2024-09-14T11:28:59.560 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.562+0000 7faecc9d59c0 20 remove_watcher() i=2 2024-09-14T11:28:59.562 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.566+0000 7faecc9d59c0 20 remove_watcher() i=3 2024-09-14T11:28:59.564 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.566+0000 7faecc9d59c0 20 remove_watcher() i=4 2024-09-14T11:28:59.566 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.570+0000 7faecc9d59c0 20 remove_watcher() i=5 2024-09-14T11:28:59.569 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.574+0000 7faecc9d59c0 20 remove_watcher() i=6 2024-09-14T11:28:59.572 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:28:59.574+0000 7faecc9d59c0 20 remove_watcher() i=7 2024-09-14T11:29:04.594 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:29:04.627 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:04.628 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:04.672 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.673+0000 7fbbc24d79c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:04.675 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.677+0000 7fbbc24d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:04.675 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.677+0000 7fbbc24d79c0 20 realm 2024-09-14T11:29:04.675 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.677+0000 7fbbc24d79c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:04.676 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.677+0000 7fbbc24d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:04.676 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.677+0000 7fbbc24d79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:04.676 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.677+0000 7fbbc24d79c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:04.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.677+0000 7fbbc24d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:04.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.677+0000 7fbbc24d79c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:04.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.681+0000 7fbbc24d79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:04.678 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.681+0000 7fbbc24d79c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:04.678 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.681+0000 7fbbc24d79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:04.678 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.681+0000 7fbbc24d79c0 20 searching for the correct realm 2024-09-14T11:29:04.681 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.685+0000 7fbbc07de640 0 -- 172.21.15.71:0/2230329497 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fbbb4081040 msgr2=0x7fbbb4063da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:04.896 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.897+0000 7fbbc07de640 0 -- 172.21.15.71:0/2230329497 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x56532b29d5c0 msgr2=0x56532b29f9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:04.911 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.913+0000 7fbbc24d79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:04.911 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.913+0000 7fbbc24d79c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:29:04.911 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.913+0000 7fbbc24d79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:04.911 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.913+0000 7fbbc24d79c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:29:04.912 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.913+0000 7fbbc24d79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:04.912 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.913+0000 7fbbc24d79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:04.912 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.913+0000 7fbbc24d79c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:04.912 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.913+0000 7fbbc24d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:04.913 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.913+0000 7fbbc24d79c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:04.913 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.913+0000 7fbbc24d79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:04.913 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.913+0000 7fbbc24d79c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:04.914 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.917+0000 7fbbc24d79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:04.914 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.917+0000 7fbbc24d79c0 20 zone default found 2024-09-14T11:29:04.914 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.917+0000 7fbbc24d79c0 4 Realm: () 2024-09-14T11:29:04.914 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.917+0000 7fbbc24d79c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:29:04.914 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.917+0000 7fbbc24d79c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:29:04.915 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.917+0000 7fbbc24d79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:04.915 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.917+0000 7fbbc24d79c0 20 zonegroup default 2024-09-14T11:29:04.915 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.917+0000 7fbbc24d79c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:04.915 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.917+0000 7fbbc24d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:04.915 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.917+0000 7fbbc24d79c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:04.916 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.917+0000 7fbbc24d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:04.916 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.917+0000 7fbbc24d79c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:04.916 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.917+0000 7fbbc24d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:04.916 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.917+0000 7fbbc24d79c0 20 started sync module instance, tier type = 2024-09-14T11:29:04.916 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.917+0000 7fbbc24d79c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:29:04.940 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.941+0000 7fbbc24d79c0 20 add_watcher() i=0 2024-09-14T11:29:04.940 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.941+0000 7fbbc24d79c0 20 add_watcher() i=1 2024-09-14T11:29:04.940 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.941+0000 7fbbc24d79c0 20 add_watcher() i=2 2024-09-14T11:29:04.940 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.941+0000 7fbbc24d79c0 20 add_watcher() i=3 2024-09-14T11:29:04.940 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.941+0000 7fbbc24d79c0 20 add_watcher() i=4 2024-09-14T11:29:04.940 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.941+0000 7fbbc24d79c0 20 add_watcher() i=5 2024-09-14T11:29:04.940 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.941+0000 7fbbc24d79c0 20 add_watcher() i=6 2024-09-14T11:29:04.942 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.945+0000 7fbbc24d79c0 20 add_watcher() i=7 2024-09-14T11:29:04.942 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.945+0000 7fbbc24d79c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:04.947 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.949+0000 7fba75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:04.948 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.949+0000 7fbbc24d79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:04.948 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.949+0000 7fbbc24d79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:04.948 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.949+0000 7fbbc24d79c0 5 note: GC not initialized 2024-09-14T11:29:04.949 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.949+0000 7fba74fe1640 20 reqs_thread_entry: start 2024-09-14T11:29:04.949 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.949+0000 7fbbc24d79c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:04.950 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.953+0000 7fbbc24d79c0 20 Filter name: none 2024-09-14T11:29:04.950 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.953+0000 7fb9ee7fc640 20 reqs_thread_entry: start 2024-09-14T11:29:04.950 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.953+0000 7fbbc24d79c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:04.950 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.953+0000 7fbbc24d79c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:29:04.950 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.953+0000 7fbbc24d79c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:04.952 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.953+0000 7fbbc24d79c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:29:04.952 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.953+0000 7fbbc24d79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:04.952 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.953+0000 7fbbc24d79c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:04.952 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.953+0000 7fbbc24d79c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:29:04.952 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.953+0000 7fbbc24d79c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:04.952 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.953+0000 7fbbc24d79c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:29:04.953 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.953+0000 7fbbc24d79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:04.954 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.957+0000 7fba75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:04.959 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.961+0000 7fbbc24d79c0 20 remove_watcher() i=0 2024-09-14T11:29:04.959 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.961+0000 7fbbc24d79c0 2 removed watcher, disabling cache 2024-09-14T11:29:04.961 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.961+0000 7fbbc24d79c0 20 remove_watcher() i=1 2024-09-14T11:29:04.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.965+0000 7fbbc24d79c0 20 remove_watcher() i=2 2024-09-14T11:29:04.965 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.969+0000 7fbbc24d79c0 20 remove_watcher() i=3 2024-09-14T11:29:04.967 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.969+0000 7fbbc24d79c0 20 remove_watcher() i=4 2024-09-14T11:29:04.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.973+0000 7fbbc24d79c0 20 remove_watcher() i=5 2024-09-14T11:29:04.973 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.977+0000 7fbbc24d79c0 20 remove_watcher() i=6 2024-09-14T11:29:04.975 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:04.977+0000 7fbbc24d79c0 20 remove_watcher() i=7 2024-09-14T11:29:04.990 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:04.990 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:29:04.990 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: a-bucket id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-14T11:29:04.991 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:04.991 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: reshard add non empty bucket 2024-09-14T11:29:04.991 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:05.093 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:29:05.126 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:05.126 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:05.172 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.173+0000 7f4e2b27e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.177+0000 7f4e2b27e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:05.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.177+0000 7f4e2b27e9c0 20 realm 2024-09-14T11:29:05.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.177+0000 7f4e2b27e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.177+0000 7f4e2b27e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:05.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.177+0000 7f4e2b27e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:05.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.177+0000 7f4e2b27e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.177+0000 7f4e2b27e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:05.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.177+0000 7f4e2b27e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.177+0000 7f4e2b27e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:05.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.177+0000 7f4e2b27e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.181+0000 7f4e2b27e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:05.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.181+0000 7f4e2b27e9c0 20 searching for the correct realm 2024-09-14T11:29:05.181 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.185+0000 7f4e29585640 0 -- 172.21.15.71:0/220755846 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f4e1c0e8070 msgr2=0x7f4e1c0e9910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:05.396 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.397+0000 7f4e29585640 0 -- 172.21.15.71:0/220755846 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x5654d38e4ed0 msgr2=0x5654d38e72c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:05.412 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.413+0000 7f4e2b27e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:05.412 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.413+0000 7f4e2b27e9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:29:05.412 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.413+0000 7f4e2b27e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:05.413 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.413+0000 7f4e2b27e9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:29:05.413 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.413+0000 7f4e2b27e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:05.413 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.413+0000 7f4e2b27e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:05.413 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.413+0000 7f4e2b27e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.414 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.417+0000 7f4e2b27e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:05.414 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.417+0000 7f4e2b27e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.414 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.417+0000 7f4e2b27e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:05.414 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.417+0000 7f4e2b27e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.415 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.417+0000 7f4e2b27e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:05.415 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.417+0000 7f4e2b27e9c0 20 zone default found 2024-09-14T11:29:05.415 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.417+0000 7f4e2b27e9c0 4 Realm: () 2024-09-14T11:29:05.415 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.417+0000 7f4e2b27e9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:29:05.415 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.417+0000 7f4e2b27e9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:29:05.416 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.417+0000 7f4e2b27e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:05.416 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.417+0000 7f4e2b27e9c0 20 zonegroup default 2024-09-14T11:29:05.416 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.417+0000 7f4e2b27e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.416 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.417+0000 7f4e2b27e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:05.416 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.417+0000 7f4e2b27e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.417 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.417+0000 7f4e2b27e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:05.417 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.417+0000 7f4e2b27e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.417 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.421+0000 7f4e2b27e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:05.417 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.421+0000 7f4e2b27e9c0 20 started sync module instance, tier type = 2024-09-14T11:29:05.417 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.421+0000 7f4e2b27e9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:29:05.440 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.441+0000 7f4e2b27e9c0 20 add_watcher() i=0 2024-09-14T11:29:05.440 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.441+0000 7f4e2b27e9c0 20 add_watcher() i=1 2024-09-14T11:29:05.440 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.441+0000 7f4e2b27e9c0 20 add_watcher() i=2 2024-09-14T11:29:05.440 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.441+0000 7f4e2b27e9c0 20 add_watcher() i=3 2024-09-14T11:29:05.440 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.441+0000 7f4e2b27e9c0 20 add_watcher() i=4 2024-09-14T11:29:05.440 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.441+0000 7f4e2b27e9c0 20 add_watcher() i=5 2024-09-14T11:29:05.440 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.441+0000 7f4e2b27e9c0 20 add_watcher() i=6 2024-09-14T11:29:05.442 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.445+0000 7f4e2b27e9c0 20 add_watcher() i=7 2024-09-14T11:29:05.442 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.445+0000 7f4e2b27e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:05.446 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.449+0000 7f4cdefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:05.447 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.449+0000 7f4e2b27e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:05.447 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.449+0000 7f4e2b27e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:05.448 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.449+0000 7f4e2b27e9c0 5 note: GC not initialized 2024-09-14T11:29:05.448 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.449+0000 7f4cddfe3640 20 reqs_thread_entry: start 2024-09-14T11:29:05.449 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.449+0000 7f4e2b27e9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:05.449 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.449+0000 7f4e2b27e9c0 20 Filter name: none 2024-09-14T11:29:05.449 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.453+0000 7f4c4f7fe640 20 reqs_thread_entry: start 2024-09-14T11:29:05.449 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.453+0000 7f4e2b27e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.450 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.453+0000 7f4e2b27e9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:29:05.450 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.453+0000 7f4e2b27e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.450 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.453+0000 7f4e2b27e9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:29:05.451 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.453+0000 7f4e2b27e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:05.451 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.453+0000 7f4e2b27e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.451 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.453+0000 7f4e2b27e9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:29:05.452 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.453+0000 7f4e2b27e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.452 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.453+0000 7f4e2b27e9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:29:05.452 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.453+0000 7f4e2b27e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:05.455 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.457+0000 7f4cdefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:05.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.461+0000 7f4e2b27e9c0 20 remove_watcher() i=0 2024-09-14T11:29:05.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.461+0000 7f4e2b27e9c0 2 removed watcher, disabling cache 2024-09-14T11:29:05.461 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.465+0000 7f4e2b27e9c0 20 remove_watcher() i=1 2024-09-14T11:29:05.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.465+0000 7f4e2b27e9c0 20 remove_watcher() i=2 2024-09-14T11:29:05.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.469+0000 7f4e2b27e9c0 20 remove_watcher() i=3 2024-09-14T11:29:05.468 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.469+0000 7f4e2b27e9c0 20 remove_watcher() i=4 2024-09-14T11:29:05.470 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.473+0000 7f4e2b27e9c0 20 remove_watcher() i=5 2024-09-14T11:29:05.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.477+0000 7f4e2b27e9c0 20 remove_watcher() i=6 2024-09-14T11:29:05.475 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.477+0000 7f4e2b27e9c0 20 remove_watcher() i=7 2024-09-14T11:29:05.491 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:05.492 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:29:05.492 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: a-bucket id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.18 num_objects: 8 size_kb: 1 num_shards: 12 2024-09-14T11:29:05.492 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:05.492 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-09-14T11:29:05.525 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:05.525 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:05.570 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.573+0000 7fe89e29c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.577+0000 7fe89e29c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:05.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.577+0000 7fe89e29c9c0 20 realm 2024-09-14T11:29:05.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.577+0000 7fe89e29c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.577+0000 7fe89e29c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:05.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.577+0000 7fe89e29c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:05.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.577+0000 7fe89e29c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.575 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.577+0000 7fe89e29c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:05.575 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.577+0000 7fe89e29c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.576 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.577+0000 7fe89e29c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:05.576 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.577+0000 7fe89e29c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.576 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.577+0000 7fe89e29c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:05.576 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.577+0000 7fe89e29c9c0 20 searching for the correct realm 2024-09-14T11:29:05.580 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.581+0000 7fe89c5a3640 0 -- 172.21.15.71:0/3985067305 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fe88411c000 msgr2=0x7fe88411c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:05.586 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.589+0000 7fe89c5a3640 0 -- 172.21.15.71:0/3985067305 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x559f14f90d50 msgr2=0x559f14f93160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:05.596 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.597+0000 7fe89e29c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:05.597 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.597+0000 7fe89e29c9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:29:05.597 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.597+0000 7fe89e29c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:05.597 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.597+0000 7fe89e29c9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:29:05.597 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.597+0000 7fe89e29c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:05.597 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.597+0000 7fe89e29c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:05.597 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.597+0000 7fe89e29c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.597 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.597+0000 7fe89e29c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:05.597 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.597+0000 7fe89e29c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.598 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.597+0000 7fe89e29c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:05.598 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.597+0000 7fe89e29c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.599 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.601+0000 7fe89e29c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:05.599 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.601+0000 7fe89e29c9c0 20 zone default found 2024-09-14T11:29:05.599 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.601+0000 7fe89e29c9c0 4 Realm: () 2024-09-14T11:29:05.599 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.601+0000 7fe89e29c9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:29:05.599 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.601+0000 7fe89e29c9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:29:05.599 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.601+0000 7fe89e29c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:05.600 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.601+0000 7fe89e29c9c0 20 zonegroup default 2024-09-14T11:29:05.600 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.601+0000 7fe89e29c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.600 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.601+0000 7fe89e29c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:05.600 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.601+0000 7fe89e29c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.600 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.601+0000 7fe89e29c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:05.600 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.601+0000 7fe89e29c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.600 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.601+0000 7fe89e29c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:05.600 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.601+0000 7fe89e29c9c0 20 started sync module instance, tier type = 2024-09-14T11:29:05.600 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.601+0000 7fe89e29c9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:29:05.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.621+0000 7fe89e29c9c0 20 add_watcher() i=0 2024-09-14T11:29:05.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.621+0000 7fe89e29c9c0 20 add_watcher() i=1 2024-09-14T11:29:05.618 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.621+0000 7fe89e29c9c0 20 add_watcher() i=2 2024-09-14T11:29:05.618 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.621+0000 7fe89e29c9c0 20 add_watcher() i=3 2024-09-14T11:29:05.618 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.621+0000 7fe89e29c9c0 20 add_watcher() i=4 2024-09-14T11:29:05.618 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.621+0000 7fe89e29c9c0 20 add_watcher() i=5 2024-09-14T11:29:05.618 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.621+0000 7fe89e29c9c0 20 add_watcher() i=6 2024-09-14T11:29:05.619 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.621+0000 7fe89e29c9c0 20 add_watcher() i=7 2024-09-14T11:29:05.619 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.621+0000 7fe89e29c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:05.627 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.629+0000 7fe751fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:05.627 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.629+0000 7fe89e29c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:05.627 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.629+0000 7fe89e29c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:05.627 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.629+0000 7fe89e29c9c0 5 note: GC not initialized 2024-09-14T11:29:05.627 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.629+0000 7fe750fe1640 20 reqs_thread_entry: start 2024-09-14T11:29:05.627 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.629+0000 7fe89e29c9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:05.627 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.629+0000 7fe89e29c9c0 20 Filter name: none 2024-09-14T11:29:05.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.629+0000 7fe6ca7fc640 20 reqs_thread_entry: start 2024-09-14T11:29:05.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.629+0000 7fe89e29c9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:29:05.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.629+0000 7fe89e29c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.629+0000 7fe89e29c9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:29:05.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.629+0000 7fe89e29c9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:29:05.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.629+0000 7fe89e29c9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:29:05.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.629+0000 7fe89e29c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 : miss 2024-09-14T11:29:05.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.629+0000 7fe89e29c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.629+0000 7fe89e29c9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:29:05.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.629+0000 7fe89e29c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:29:05.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.629+0000 7fe89e29c9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:29:05.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.629+0000 7fe89e29c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:29:05.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.629+0000 7fe89e29c9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:29:05.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.629+0000 7fe89e29c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 2024-09-14T11:29:05.630 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.633+0000 7fe751fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:05.634 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.637+0000 7fe89e29c9c0 20 remove_watcher() i=0 2024-09-14T11:29:05.634 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.637+0000 7fe89e29c9c0 2 removed watcher, disabling cache 2024-09-14T11:29:05.636 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.637+0000 7fe89e29c9c0 20 remove_watcher() i=1 2024-09-14T11:29:05.638 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.641+0000 7fe89e29c9c0 20 remove_watcher() i=2 2024-09-14T11:29:05.640 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.641+0000 7fe89e29c9c0 20 remove_watcher() i=3 2024-09-14T11:29:05.642 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.645+0000 7fe89e29c9c0 20 remove_watcher() i=4 2024-09-14T11:29:05.644 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.645+0000 7fe89e29c9c0 20 remove_watcher() i=5 2024-09-14T11:29:05.647 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.649+0000 7fe89e29c9c0 20 remove_watcher() i=6 2024-09-14T11:29:05.650 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.653+0000 7fe89e29c9c0 20 remove_watcher() i=7 2024-09-14T11:29:05.664 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin reshard list 2024-09-14T11:29:05.688 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:05.689 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:05.731 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.733+0000 7f315cf1a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.737+0000 7f315cf1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:05.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.737+0000 7f315cf1a9c0 20 realm 2024-09-14T11:29:05.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.737+0000 7f315cf1a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.737+0000 7f315cf1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:05.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.737+0000 7f315cf1a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:05.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.737+0000 7f315cf1a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.737+0000 7f315cf1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:05.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.737+0000 7f315cf1a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.737+0000 7f315cf1a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:05.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.737+0000 7f315cf1a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.741+0000 7f315cf1a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:05.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.741+0000 7f315cf1a9c0 20 searching for the correct realm 2024-09-14T11:29:05.740 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.741+0000 7f315b221640 0 -- 172.21.15.71:0/2760643518 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f3150008040 msgr2=0x7f315004c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:05.953 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.957+0000 7f315b221640 0 -- 172.21.15.71:0/2760643518 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x5642fd2ed1f0 msgr2=0x5642fd2ef5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:05.968 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.969+0000 7f315cf1a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:05.968 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.969+0000 7f315cf1a9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:29:05.968 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.969+0000 7f315cf1a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:05.968 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.969+0000 7f315cf1a9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:29:05.968 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.969+0000 7f315cf1a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:05.968 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.969+0000 7f315cf1a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:05.968 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.969+0000 7f315cf1a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.969+0000 7f315cf1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:05.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.969+0000 7f315cf1a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.973+0000 7f315cf1a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:05.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.973+0000 7f315cf1a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.973+0000 7f315cf1a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:05.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.973+0000 7f315cf1a9c0 20 zone default found 2024-09-14T11:29:05.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.973+0000 7f315cf1a9c0 4 Realm: () 2024-09-14T11:29:05.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.973+0000 7f315cf1a9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:29:05.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.973+0000 7f315cf1a9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:29:05.971 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.973+0000 7f315cf1a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:05.971 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.973+0000 7f315cf1a9c0 20 zonegroup default 2024-09-14T11:29:05.971 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.973+0000 7f315cf1a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.971 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.973+0000 7f315cf1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:05.971 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.973+0000 7f315cf1a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.971 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.973+0000 7f315cf1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:05.972 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.973+0000 7f315cf1a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:05.972 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.973+0000 7f315cf1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:05.972 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.973+0000 7f315cf1a9c0 20 started sync module instance, tier type = 2024-09-14T11:29:05.972 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.973+0000 7f315cf1a9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:29:05.995 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.997+0000 7f315cf1a9c0 20 add_watcher() i=0 2024-09-14T11:29:05.995 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.997+0000 7f315cf1a9c0 20 add_watcher() i=1 2024-09-14T11:29:05.995 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.997+0000 7f315cf1a9c0 20 add_watcher() i=2 2024-09-14T11:29:05.995 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.997+0000 7f315cf1a9c0 20 add_watcher() i=3 2024-09-14T11:29:05.995 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.997+0000 7f315cf1a9c0 20 add_watcher() i=4 2024-09-14T11:29:05.995 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.997+0000 7f315cf1a9c0 20 add_watcher() i=5 2024-09-14T11:29:05.996 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:05.997+0000 7f315cf1a9c0 20 add_watcher() i=6 2024-09-14T11:29:05.998 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.001+0000 7f315cf1a9c0 20 add_watcher() i=7 2024-09-14T11:29:05.998 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.001+0000 7f315cf1a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:06.002 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.005+0000 7f30117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:06.003 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.005+0000 7f315cf1a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:06.003 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.005+0000 7f315cf1a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:06.003 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.005+0000 7f315cf1a9c0 5 note: GC not initialized 2024-09-14T11:29:06.004 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.005+0000 7f2f8bfff640 20 reqs_thread_entry: start 2024-09-14T11:29:06.004 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.005+0000 7f315cf1a9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:06.004 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.005+0000 7f315cf1a9c0 20 Filter name: none 2024-09-14T11:29:06.004 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.005+0000 7f2f89ffb640 20 reqs_thread_entry: start 2024-09-14T11:29:06.016 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.021+0000 7f30117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:06.021 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.025+0000 7f315cf1a9c0 20 remove_watcher() i=0 2024-09-14T11:29:06.021 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.025+0000 7f315cf1a9c0 2 removed watcher, disabling cache 2024-09-14T11:29:06.023 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.025+0000 7f315cf1a9c0 20 remove_watcher() i=1 2024-09-14T11:29:06.026 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.029+0000 7f315cf1a9c0 20 remove_watcher() i=2 2024-09-14T11:29:06.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.029+0000 7f315cf1a9c0 20 remove_watcher() i=3 2024-09-14T11:29:06.030 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.033+0000 7f315cf1a9c0 20 remove_watcher() i=4 2024-09-14T11:29:06.033 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.037+0000 7f315cf1a9c0 20 remove_watcher() i=5 2024-09-14T11:29:06.035 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.037+0000 7f315cf1a9c0 20 remove_watcher() i=6 2024-09-14T11:29:06.038 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.041+0000 7f315cf1a9c0 20 remove_watcher() i=7 2024-09-14T11:29:06.054 INFO:tasks.workunit.client.0.smithi071.stderr:bucket name a-bucket 2024-09-14T11:29:06.054 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: reshard process non empty bucket 2024-09-14T11:29:06.054 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:06.054 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin reshard process 2024-09-14T11:29:06.080 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:06.081 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:06.125 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.129+0000 7f85ca4859c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:06.128 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.129+0000 7f85ca4859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:06.128 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.129+0000 7f85ca4859c0 20 realm 2024-09-14T11:29:06.128 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.129+0000 7f85ca4859c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:06.129 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.133+0000 7f85ca4859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:06.129 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.133+0000 7f85ca4859c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:06.129 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.133+0000 7f85ca4859c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:06.129 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.133+0000 7f85ca4859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:06.129 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.133+0000 7f85ca4859c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:06.130 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.133+0000 7f85ca4859c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:06.130 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.133+0000 7f85ca4859c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:06.131 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.133+0000 7f85ca4859c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:06.131 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.133+0000 7f85ca4859c0 20 searching for the correct realm 2024-09-14T11:29:06.135 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.137+0000 7f85c878c640 0 -- 172.21.15.71:0/1904178885 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f85bc031400 msgr2=0x7f85bc031860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:06.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.145+0000 7f85c878c640 0 -- 172.21.15.71:0/1904178885 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x5616f349f560 msgr2=0x5616f34a1990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:06.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.153+0000 7f85ca4859c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:06.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.153+0000 7f85ca4859c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:29:06.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.153+0000 7f85ca4859c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:06.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.153+0000 7f85ca4859c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:29:06.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.153+0000 7f85ca4859c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:06.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.153+0000 7f85ca4859c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:06.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.153+0000 7f85ca4859c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:06.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.153+0000 7f85ca4859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:06.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.153+0000 7f85ca4859c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:06.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.153+0000 7f85ca4859c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:06.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.153+0000 7f85ca4859c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:06.152 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.153+0000 7f85ca4859c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:06.152 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.153+0000 7f85ca4859c0 20 zone default found 2024-09-14T11:29:06.152 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.153+0000 7f85ca4859c0 4 Realm: () 2024-09-14T11:29:06.152 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.153+0000 7f85ca4859c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:29:06.152 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.153+0000 7f85ca4859c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:29:06.152 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.153+0000 7f85ca4859c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:06.152 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.153+0000 7f85ca4859c0 20 zonegroup default 2024-09-14T11:29:06.153 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.153+0000 7f85ca4859c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:06.153 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.157+0000 7f85ca4859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:06.153 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.157+0000 7f85ca4859c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:06.153 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.157+0000 7f85ca4859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:06.153 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.157+0000 7f85ca4859c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:06.154 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.157+0000 7f85ca4859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:06.154 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.157+0000 7f85ca4859c0 20 started sync module instance, tier type = 2024-09-14T11:29:06.154 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.157+0000 7f85ca4859c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:29:06.172 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.173+0000 7f85ca4859c0 20 add_watcher() i=0 2024-09-14T11:29:06.172 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.173+0000 7f85ca4859c0 20 add_watcher() i=1 2024-09-14T11:29:06.172 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.173+0000 7f85ca4859c0 20 add_watcher() i=2 2024-09-14T11:29:06.172 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.173+0000 7f85ca4859c0 20 add_watcher() i=3 2024-09-14T11:29:06.172 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.173+0000 7f85ca4859c0 20 add_watcher() i=4 2024-09-14T11:29:06.172 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.173+0000 7f85ca4859c0 20 add_watcher() i=5 2024-09-14T11:29:06.172 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.173+0000 7f85ca4859c0 20 add_watcher() i=6 2024-09-14T11:29:06.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.177+0000 7f85ca4859c0 20 add_watcher() i=7 2024-09-14T11:29:06.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.177+0000 7f85ca4859c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:06.178 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.181+0000 7f847dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:06.178 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.181+0000 7f85ca4859c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:06.178 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.181+0000 7f85ca4859c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:06.178 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.181+0000 7f85ca4859c0 5 note: GC not initialized 2024-09-14T11:29:06.179 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.181+0000 7f847cfe1640 20 reqs_thread_entry: start 2024-09-14T11:29:06.179 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.181+0000 7f85ca4859c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:06.179 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.181+0000 7f85ca4859c0 20 Filter name: none 2024-09-14T11:29:06.179 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.181+0000 7f83f67fc640 20 reqs_thread_entry: start 2024-09-14T11:29:06.179 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.181+0000 7f85ca4859c0 20 processing logshard = reshard.0000000000 2024-09-14T11:29:06.183 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.185+0000 7f85ca4859c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-14T11:29:06.183 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.185+0000 7f85ca4859c0 20 processing logshard = reshard.0000000001 2024-09-14T11:29:06.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.189+0000 7f85ca4859c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-14T11:29:06.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.189+0000 7f85ca4859c0 20 processing logshard = reshard.0000000002 2024-09-14T11:29:06.193 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.197+0000 7f85ca4859c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-14T11:29:06.193 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.197+0000 7f85ca4859c0 20 processing logshard = reshard.0000000003 2024-09-14T11:29:06.197 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.201+0000 7f85ca4859c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-14T11:29:06.197 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.201+0000 7f85ca4859c0 20 processing logshard = reshard.0000000004 2024-09-14T11:29:06.203 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.205+0000 7f85ca4859c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-14T11:29:06.204 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.205+0000 7f85ca4859c0 20 processing logshard = reshard.0000000005 2024-09-14T11:29:06.209 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.213+0000 7f85ca4859c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-14T11:29:06.210 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.213+0000 7f85ca4859c0 20 processing logshard = reshard.0000000006 2024-09-14T11:29:06.213 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.217+0000 7f85ca4859c0 20 process_entry resharding a-bucket 2024-09-14T11:29:06.213 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.217+0000 7f85ca4859c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:29:06.213 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.217+0000 7f85ca4859c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:06.214 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.217+0000 7f85ca4859c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:29:06.214 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.217+0000 7f85ca4859c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-14T11:29:06.214 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.217+0000 7f85ca4859c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:29:06.214 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.217+0000 7f85ca4859c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 : miss 2024-09-14T11:29:06.214 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.217+0000 7f85ca4859c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:06.215 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.217+0000 7f85ca4859c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:29:06.215 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.217+0000 7f85ca4859c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:29:06.215 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.217+0000 7f85ca4859c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:29:06.215 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.217+0000 7f85ca4859c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:29:06.215 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.217+0000 7f85ca4859c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:29:06.215 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.217+0000 7f85ca4859c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 2024-09-14T11:29:06.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.229+0000 7f85ca4859c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:29:06.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.229+0000 7f85ca4859c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:29:06.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.229+0000 7f85ca4859c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:29:06.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.229+0000 7f85ca4859c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18, ofs0, ns] 2024-09-14T11:29:06.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.229+0000 7f84a6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464345 cookie 94656571021056 notifier 5864 bl.length()=911 2024-09-14T11:29:06.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.229+0000 7f84a6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:29:06.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.229+0000 7f84a6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:29:06.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.229+0000 7f84a6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:29:06.229 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.233+0000 7f85ca4859c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_sources= new_sources= 2024-09-14T11:29:06.229 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.233+0000 7f85ca4859c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential sources added=[] removed=[] 2024-09-14T11:29:06.229 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.233+0000 7f85ca4859c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_dests= new_dests= 2024-09-14T11:29:06.229 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.233+0000 7f85ca4859c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential dests added=[] removed=[] 2024-09-14T11:29:06.238 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.241+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.0 2024-09-14T11:29:06.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.241+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.0 2024-09-14T11:29:06.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.241+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.1 2024-09-14T11:29:06.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.241+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.1 2024-09-14T11:29:06.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.241+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.2 2024-09-14T11:29:06.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.241+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.2 2024-09-14T11:29:06.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.241+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.3 2024-09-14T11:29:06.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.241+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.3 2024-09-14T11:29:06.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.241+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.4 2024-09-14T11:29:06.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.241+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.4 2024-09-14T11:29:06.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.241+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.5 2024-09-14T11:29:06.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.241+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.5 2024-09-14T11:29:06.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.241+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.6 2024-09-14T11:29:06.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.241+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.6 2024-09-14T11:29:06.240 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.241+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.7 2024-09-14T11:29:06.240 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.241+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.7 2024-09-14T11:29:06.240 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.241+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.8 2024-09-14T11:29:06.240 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.241+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.8 2024-09-14T11:29:06.240 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.241+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.9 2024-09-14T11:29:06.240 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.241+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.9 2024-09-14T11:29:06.240 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.241+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.10 2024-09-14T11:29:06.240 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.241+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.10 2024-09-14T11:29:06.240 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.241+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.11 2024-09-14T11:29:06.240 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.241+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.11 2024-09-14T11:29:06.240 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.241+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.12 2024-09-14T11:29:06.240 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.241+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.12 2024-09-14T11:29:06.241 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.241+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.0 2024-09-14T11:29:06.241 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.241+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.0 2024-09-14T11:29:06.241 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.241+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.1 2024-09-14T11:29:06.241 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.241+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.1 2024-09-14T11:29:06.241 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.245+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.2 2024-09-14T11:29:06.241 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.245+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.2 2024-09-14T11:29:06.242 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.245+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.3 2024-09-14T11:29:06.242 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.245+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.3 2024-09-14T11:29:06.242 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.245+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.4 2024-09-14T11:29:06.242 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.245+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.4 2024-09-14T11:29:06.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.245+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.5 2024-09-14T11:29:06.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.245+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.5 2024-09-14T11:29:06.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.245+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.6 2024-09-14T11:29:06.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.245+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.6 2024-09-14T11:29:06.244 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.249+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.7 2024-09-14T11:29:06.244 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.249+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.7 2024-09-14T11:29:06.246 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.249+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.8 2024-09-14T11:29:06.246 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.249+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.8 2024-09-14T11:29:06.247 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.249+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.9 2024-09-14T11:29:06.247 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.249+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.9 2024-09-14T11:29:06.247 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.249+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.10 2024-09-14T11:29:06.248 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.249+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.10 2024-09-14T11:29:06.248 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.249+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.11 2024-09-14T11:29:06.248 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.249+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.11 2024-09-14T11:29:06.252 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.257+0000 7f85ca4859c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:29:06.252 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.257+0000 7f85ca4859c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 2024-09-14T11:29:06.254 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.257+0000 7f85ca4859c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:29:06.254 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.257+0000 7f85ca4859c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:29:06.254 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.257+0000 7f85ca4859c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:29:06.254 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.257+0000 7f85ca4859c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18, ofs0, ns] 2024-09-14T11:29:06.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.257+0000 7f84a67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464346 cookie 94656571021056 notifier 5864 bl.length()=911 2024-09-14T11:29:06.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.257+0000 7f84a67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:29:06.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.257+0000 7f84a67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:29:06.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.257+0000 7f84a67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:29:06.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.257+0000 7f85ca4859c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_sources= new_sources= 2024-09-14T11:29:06.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.257+0000 7f85ca4859c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential sources added=[] removed=[] 2024-09-14T11:29:06.256 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.257+0000 7f85ca4859c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_dests= new_dests= 2024-09-14T11:29:06.256 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.257+0000 7f85ca4859c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential dests added=[] removed=[] 2024-09-14T11:29:06.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.265+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.0 2024-09-14T11:29:06.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.265+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.0 2024-09-14T11:29:06.261 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.265+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.1 2024-09-14T11:29:06.261 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.265+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.1 2024-09-14T11:29:06.262 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.265+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.2 2024-09-14T11:29:06.262 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.265+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.2 2024-09-14T11:29:06.262 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.265+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.3 2024-09-14T11:29:06.263 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.265+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.3 2024-09-14T11:29:06.263 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.265+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.4 2024-09-14T11:29:06.263 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.265+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.4 2024-09-14T11:29:06.263 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.265+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.5 2024-09-14T11:29:06.264 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.265+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.5 2024-09-14T11:29:06.264 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.265+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.6 2024-09-14T11:29:06.264 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.265+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.6 2024-09-14T11:29:06.265 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.269+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.7 2024-09-14T11:29:06.265 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.269+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.7 2024-09-14T11:29:06.266 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.269+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.8 2024-09-14T11:29:06.266 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.269+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.8 2024-09-14T11:29:06.266 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.269+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.9 2024-09-14T11:29:06.266 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.269+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.9 2024-09-14T11:29:06.267 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.269+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.10 2024-09-14T11:29:06.267 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.269+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.10 2024-09-14T11:29:06.267 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.269+0000 7f85ca4859c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.11 2024-09-14T11:29:06.267 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.269+0000 7f85ca4859c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.1.11 2024-09-14T11:29:06.268 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.269+0000 7f85ca4859c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:29:06.268 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.269+0000 7f85ca4859c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 2024-09-14T11:29:06.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.273+0000 7f85ca4859c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:29:06.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.273+0000 7f85ca4859c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:29:06.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.273+0000 7f85ca4859c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:29:06.270 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.273+0000 7f85ca4859c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18, ofs0, ns] 2024-09-14T11:29:06.270 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.273+0000 7f84a6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464347 cookie 94656571021056 notifier 5864 bl.length()=879 2024-09-14T11:29:06.270 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.273+0000 7f84a6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:29:06.270 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.273+0000 7f84a6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:29:06.270 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.273+0000 7f84a6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:29:06.271 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.273+0000 7f85ca4859c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_sources= new_sources= 2024-09-14T11:29:06.271 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.273+0000 7f85ca4859c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential sources added=[] removed=[] 2024-09-14T11:29:06.271 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.273+0000 7f85ca4859c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_dests= new_dests= 2024-09-14T11:29:06.271 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.273+0000 7f85ca4859c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential dests added=[] removed=[] 2024-09-14T11:29:06.275 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.277+0000 7f85ca4859c0 1 execute INFO: reshard of bucket "a-bucket" from 12 shards to 13 shards completed successfully 2024-09-14T11:29:06.278 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.281+0000 7f85ca4859c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-14T11:29:06.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.285+0000 7f85ca4859c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-14T11:29:06.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.285+0000 7f85ca4859c0 20 processing logshard = reshard.0000000007 2024-09-14T11:29:06.287 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.289+0000 7f85ca4859c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-14T11:29:06.287 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.289+0000 7f85ca4859c0 20 processing logshard = reshard.0000000008 2024-09-14T11:29:06.292 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.293+0000 7f85ca4859c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-14T11:29:06.292 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.293+0000 7f85ca4859c0 20 processing logshard = reshard.0000000009 2024-09-14T11:29:06.296 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.301+0000 7f85ca4859c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-14T11:29:06.297 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.301+0000 7f85ca4859c0 20 processing logshard = reshard.0000000010 2024-09-14T11:29:06.304 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.305+0000 7f85ca4859c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-14T11:29:06.304 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.305+0000 7f85ca4859c0 20 processing logshard = reshard.0000000011 2024-09-14T11:29:06.310 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.313+0000 7f85ca4859c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-14T11:29:06.310 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.313+0000 7f85ca4859c0 20 processing logshard = reshard.0000000012 2024-09-14T11:29:06.315 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.317+0000 7f85ca4859c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-14T11:29:06.315 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.317+0000 7f85ca4859c0 20 processing logshard = reshard.0000000013 2024-09-14T11:29:06.321 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.325+0000 7f85ca4859c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-14T11:29:06.322 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.325+0000 7f85ca4859c0 20 processing logshard = reshard.0000000014 2024-09-14T11:29:06.328 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.329+0000 7f85ca4859c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-14T11:29:06.328 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.329+0000 7f85ca4859c0 20 processing logshard = reshard.0000000015 2024-09-14T11:29:06.333 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.337+0000 7f85ca4859c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-14T11:29:06.335 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.337+0000 7f847dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:06.340 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.341+0000 7f85ca4859c0 20 remove_watcher() i=0 2024-09-14T11:29:06.340 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.341+0000 7f85ca4859c0 2 removed watcher, disabling cache 2024-09-14T11:29:06.343 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.345+0000 7f85ca4859c0 20 remove_watcher() i=1 2024-09-14T11:29:06.345 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.349+0000 7f85ca4859c0 20 remove_watcher() i=2 2024-09-14T11:29:06.348 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.349+0000 7f85ca4859c0 20 remove_watcher() i=3 2024-09-14T11:29:06.350 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.353+0000 7f85ca4859c0 20 remove_watcher() i=4 2024-09-14T11:29:06.353 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.357+0000 7f85ca4859c0 20 remove_watcher() i=5 2024-09-14T11:29:06.355 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.357+0000 7f85ca4859c0 20 remove_watcher() i=6 2024-09-14T11:29:06.358 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.361+0000 7f85ca4859c0 20 remove_watcher() i=7 2024-09-14T11:29:06.380 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:29:06.411 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:06.411 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:06.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.457+0000 7f9235ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:06.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.461+0000 7f9235ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:06.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.461+0000 7f9235ef59c0 20 realm 2024-09-14T11:29:06.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.461+0000 7f9235ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:06.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.461+0000 7f9235ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:06.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.461+0000 7f9235ef59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:06.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.461+0000 7f9235ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:06.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.461+0000 7f9235ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:06.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.461+0000 7f9235ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:06.461 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.465+0000 7f9235ef59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:06.461 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.465+0000 7f9235ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:06.461 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.465+0000 7f9235ef59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:06.461 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.465+0000 7f9235ef59c0 20 searching for the correct realm 2024-09-14T11:29:06.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.469+0000 7f92339fb640 0 -- 172.21.15.71:0/612481597 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x56536514fd90 msgr2=0x565365152250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:29:06.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.477+0000 7f92341fc640 0 -- 172.21.15.71:0/612481597 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x56536514b020 msgr2=0x56536514d410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:29:06.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.485+0000 7f9235ef59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:06.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.485+0000 7f9235ef59c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:29:06.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.485+0000 7f9235ef59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:06.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.485+0000 7f9235ef59c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:29:06.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.485+0000 7f9235ef59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:06.483 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.485+0000 7f9235ef59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:06.483 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.485+0000 7f9235ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:06.483 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.485+0000 7f9235ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:06.483 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.485+0000 7f9235ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:06.483 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.485+0000 7f9235ef59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:06.483 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.485+0000 7f9235ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:06.484 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.485+0000 7f9235ef59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:06.484 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.485+0000 7f9235ef59c0 20 zone default found 2024-09-14T11:29:06.484 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.485+0000 7f9235ef59c0 4 Realm: () 2024-09-14T11:29:06.484 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.485+0000 7f9235ef59c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:29:06.485 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.485+0000 7f9235ef59c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:29:06.485 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.485+0000 7f9235ef59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:06.485 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.485+0000 7f9235ef59c0 20 zonegroup default 2024-09-14T11:29:06.485 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.485+0000 7f9235ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:06.485 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.485+0000 7f9235ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:06.485 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.485+0000 7f9235ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:06.485 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.489+0000 7f9235ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:06.485 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.489+0000 7f9235ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:06.485 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.489+0000 7f9235ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:06.486 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.489+0000 7f9235ef59c0 20 started sync module instance, tier type = 2024-09-14T11:29:06.486 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.489+0000 7f9235ef59c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:29:06.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.505+0000 7f9235ef59c0 20 add_watcher() i=0 2024-09-14T11:29:06.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.505+0000 7f9235ef59c0 20 add_watcher() i=1 2024-09-14T11:29:06.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.505+0000 7f9235ef59c0 20 add_watcher() i=2 2024-09-14T11:29:06.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.505+0000 7f9235ef59c0 20 add_watcher() i=3 2024-09-14T11:29:06.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.505+0000 7f9235ef59c0 20 add_watcher() i=4 2024-09-14T11:29:06.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.505+0000 7f9235ef59c0 20 add_watcher() i=5 2024-09-14T11:29:06.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.505+0000 7f9235ef59c0 20 add_watcher() i=6 2024-09-14T11:29:06.505 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.509+0000 7f9235ef59c0 20 add_watcher() i=7 2024-09-14T11:29:06.506 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.509+0000 7f9235ef59c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:06.509 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.513+0000 7f90e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:06.510 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.513+0000 7f9235ef59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:06.510 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.513+0000 7f9235ef59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:06.510 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.513+0000 7f9235ef59c0 5 note: GC not initialized 2024-09-14T11:29:06.510 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.513+0000 7f90e8fe1640 20 reqs_thread_entry: start 2024-09-14T11:29:06.510 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.513+0000 7f9235ef59c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:06.510 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.513+0000 7f9235ef59c0 20 Filter name: none 2024-09-14T11:29:06.510 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.513+0000 7f90627fc640 20 reqs_thread_entry: start 2024-09-14T11:29:06.510 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.513+0000 7f9235ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:06.511 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.513+0000 7f9235ef59c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:29:06.511 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.513+0000 7f9235ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:06.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.513+0000 7f9235ef59c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:29:06.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.513+0000 7f9235ef59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:06.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.513+0000 7f9235ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:06.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.513+0000 7f9235ef59c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:29:06.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.513+0000 7f9235ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:06.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.513+0000 7f9235ef59c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:29:06.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.513+0000 7f9235ef59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:06.514 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.517+0000 7f90e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:06.518 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.521+0000 7f9235ef59c0 20 remove_watcher() i=0 2024-09-14T11:29:06.518 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.521+0000 7f9235ef59c0 2 removed watcher, disabling cache 2024-09-14T11:29:06.520 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.521+0000 7f9235ef59c0 20 remove_watcher() i=1 2024-09-14T11:29:06.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.525+0000 7f9235ef59c0 20 remove_watcher() i=2 2024-09-14T11:29:06.524 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.529+0000 7f9235ef59c0 20 remove_watcher() i=3 2024-09-14T11:29:06.526 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.529+0000 7f9235ef59c0 20 remove_watcher() i=4 2024-09-14T11:29:06.528 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.529+0000 7f9235ef59c0 20 remove_watcher() i=5 2024-09-14T11:29:06.530 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.533+0000 7f9235ef59c0 20 remove_watcher() i=6 2024-09-14T11:29:06.533 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.537+0000 7f9235ef59c0 20 remove_watcher() i=7 2024-09-14T11:29:06.547 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:06.547 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:29:06.548 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: a-bucket id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.18 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-14T11:29:06.548 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:06.548 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-14T11:29:06.548 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:06.843 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:29:06.875 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:06.875 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:06.920 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.921+0000 7fb1fea8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:06.923 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.925+0000 7fb1fea8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:06.923 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.925+0000 7fb1fea8d9c0 20 realm 2024-09-14T11:29:06.923 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.925+0000 7fb1fea8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:06.923 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.925+0000 7fb1fea8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:06.924 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.925+0000 7fb1fea8d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:06.924 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.925+0000 7fb1fea8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:06.924 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.925+0000 7fb1fea8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:06.924 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.925+0000 7fb1fea8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:06.924 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.929+0000 7fb1fea8d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:06.925 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.929+0000 7fb1fea8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:06.925 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.929+0000 7fb1fea8d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:06.925 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.929+0000 7fb1fea8d9c0 20 searching for the correct realm 2024-09-14T11:29:06.929 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:06.933+0000 7fb1fcd94640 0 -- 172.21.15.71:0/2453118184 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fb1f0062050 msgr2=0x7fb1f0046ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:29:07.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.145+0000 7fb1fcd94640 0 -- 172.21.15.71:0/2453118184 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x5617db5925a0 msgr2=0x5617db594990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:07.159 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.161+0000 7fb1fea8d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:07.160 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.161+0000 7fb1fea8d9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:29:07.160 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.161+0000 7fb1fea8d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:07.160 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.161+0000 7fb1fea8d9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:29:07.160 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.161+0000 7fb1fea8d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:07.160 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.161+0000 7fb1fea8d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:07.160 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.161+0000 7fb1fea8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.160 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.161+0000 7fb1fea8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:07.160 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.161+0000 7fb1fea8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.161 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.165+0000 7fb1fea8d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:07.161 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.165+0000 7fb1fea8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.162 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.165+0000 7fb1fea8d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:07.162 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.165+0000 7fb1fea8d9c0 20 zone default found 2024-09-14T11:29:07.162 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.165+0000 7fb1fea8d9c0 4 Realm: () 2024-09-14T11:29:07.162 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.165+0000 7fb1fea8d9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:29:07.162 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.165+0000 7fb1fea8d9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:29:07.162 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.165+0000 7fb1fea8d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:07.162 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.165+0000 7fb1fea8d9c0 20 zonegroup default 2024-09-14T11:29:07.162 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.165+0000 7fb1fea8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.163 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.165+0000 7fb1fea8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:07.163 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.165+0000 7fb1fea8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.163 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.165+0000 7fb1fea8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:07.163 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.165+0000 7fb1fea8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.164 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.169+0000 7fb1fea8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:07.165 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.169+0000 7fb1fea8d9c0 20 started sync module instance, tier type = 2024-09-14T11:29:07.165 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.169+0000 7fb1fea8d9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:29:07.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.189+0000 7fb1fea8d9c0 20 add_watcher() i=0 2024-09-14T11:29:07.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.189+0000 7fb1fea8d9c0 20 add_watcher() i=1 2024-09-14T11:29:07.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.189+0000 7fb1fea8d9c0 20 add_watcher() i=2 2024-09-14T11:29:07.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.189+0000 7fb1fea8d9c0 20 add_watcher() i=3 2024-09-14T11:29:07.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.189+0000 7fb1fea8d9c0 20 add_watcher() i=4 2024-09-14T11:29:07.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.189+0000 7fb1fea8d9c0 20 add_watcher() i=5 2024-09-14T11:29:07.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.189+0000 7fb1fea8d9c0 20 add_watcher() i=6 2024-09-14T11:29:07.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.193+0000 7fb1fea8d9c0 20 add_watcher() i=7 2024-09-14T11:29:07.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.193+0000 7fb1fea8d9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:07.194 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.197+0000 7fb0b2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:07.194 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.197+0000 7fb1fea8d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:07.194 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.197+0000 7fb1fea8d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:07.194 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.197+0000 7fb1fea8d9c0 5 note: GC not initialized 2024-09-14T11:29:07.195 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.197+0000 7fb0b1fdb640 20 reqs_thread_entry: start 2024-09-14T11:29:07.195 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.197+0000 7fb1fea8d9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:07.195 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.197+0000 7fb1fea8d9c0 20 Filter name: none 2024-09-14T11:29:07.195 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.197+0000 7fb0237fe640 20 reqs_thread_entry: start 2024-09-14T11:29:07.195 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.197+0000 7fb1fea8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.196 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.197+0000 7fb1fea8d9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:29:07.196 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.197+0000 7fb1fea8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.197 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.201+0000 7fb1fea8d9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:29:07.197 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.201+0000 7fb1fea8d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:07.198 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.201+0000 7fb1fea8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.198 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.201+0000 7fb1fea8d9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:29:07.198 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.201+0000 7fb1fea8d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.199 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.201+0000 7fb1fea8d9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:29:07.199 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.201+0000 7fb1fea8d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:07.202 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.205+0000 7fb0b2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:07.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.209+0000 7fb1fea8d9c0 20 remove_watcher() i=0 2024-09-14T11:29:07.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.209+0000 7fb1fea8d9c0 2 removed watcher, disabling cache 2024-09-14T11:29:07.209 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.213+0000 7fb1fea8d9c0 20 remove_watcher() i=1 2024-09-14T11:29:07.211 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.213+0000 7fb1fea8d9c0 20 remove_watcher() i=2 2024-09-14T11:29:07.213 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.217+0000 7fb1fea8d9c0 20 remove_watcher() i=3 2024-09-14T11:29:07.214 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.217+0000 7fb1fea8d9c0 20 remove_watcher() i=4 2024-09-14T11:29:07.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.221+0000 7fb1fea8d9c0 20 remove_watcher() i=5 2024-09-14T11:29:07.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.221+0000 7fb1fea8d9c0 20 remove_watcher() i=6 2024-09-14T11:29:07.223 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.225+0000 7fb1fea8d9c0 20 remove_watcher() i=7 2024-09-14T11:29:07.237 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:07.237 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:29:07.238 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: error-at-init-index id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:29:07.238 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:07.238 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-14T11:29:07.274 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:07.274 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:07.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.321+0000 7f5b62bd59c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.320 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.321+0000 7f5b62bd59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:07.320 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.321+0000 7f5b62bd59c0 20 realm 2024-09-14T11:29:07.320 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.321+0000 7f5b62bd59c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.321 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.321+0000 7f5b62bd59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:07.321 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.321+0000 7f5b62bd59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:07.321 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.321+0000 7f5b62bd59c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.321 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.325+0000 7f5b62bd59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:07.321 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.325+0000 7f5b62bd59c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.322 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.325+0000 7f5b62bd59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:07.322 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.325+0000 7f5b62bd59c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.322 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.325+0000 7f5b62bd59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:07.322 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.325+0000 7f5b62bd59c0 20 searching for the correct realm 2024-09-14T11:29:07.327 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.329+0000 7f5b606db640 0 -- 172.21.15.71:0/2533452437 >> [v2:172.21.15.157:6808/527702018,v1:172.21.15.157:6809/527702018] conn(0x7f5b50066690 msgr2=0x7f5b50066060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:07.542 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.545+0000 7f5b606db640 0 -- 172.21.15.71:0/2533452437 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x560d8c485880 msgr2=0x560d8c487d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:07.551 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.553+0000 7f5b62bd59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:07.551 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.553+0000 7f5b62bd59c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:29:07.551 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.553+0000 7f5b62bd59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:07.551 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.553+0000 7f5b62bd59c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:29:07.552 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.553+0000 7f5b62bd59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:07.552 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.553+0000 7f5b62bd59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:07.552 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.553+0000 7f5b62bd59c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.552 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.553+0000 7f5b62bd59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:07.552 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.553+0000 7f5b62bd59c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.552 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.553+0000 7f5b62bd59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:07.553 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.553+0000 7f5b62bd59c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.553 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.557+0000 7f5b62bd59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:07.554 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.557+0000 7f5b62bd59c0 20 zone default found 2024-09-14T11:29:07.554 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.557+0000 7f5b62bd59c0 4 Realm: () 2024-09-14T11:29:07.554 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.557+0000 7f5b62bd59c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:29:07.554 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.557+0000 7f5b62bd59c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:29:07.554 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.557+0000 7f5b62bd59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:07.554 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.557+0000 7f5b62bd59c0 20 zonegroup default 2024-09-14T11:29:07.554 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.557+0000 7f5b62bd59c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.554 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.557+0000 7f5b62bd59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:07.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.557+0000 7f5b62bd59c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.557+0000 7f5b62bd59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:07.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.557+0000 7f5b62bd59c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.556 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.557+0000 7f5b62bd59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:07.556 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.557+0000 7f5b62bd59c0 20 started sync module instance, tier type = 2024-09-14T11:29:07.557 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.557+0000 7f5b62bd59c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:29:07.580 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.581+0000 7f5b62bd59c0 20 add_watcher() i=0 2024-09-14T11:29:07.580 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.581+0000 7f5b62bd59c0 20 add_watcher() i=1 2024-09-14T11:29:07.581 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.581+0000 7f5b62bd59c0 20 add_watcher() i=2 2024-09-14T11:29:07.581 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.581+0000 7f5b62bd59c0 20 add_watcher() i=3 2024-09-14T11:29:07.581 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.581+0000 7f5b62bd59c0 20 add_watcher() i=4 2024-09-14T11:29:07.581 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.581+0000 7f5b62bd59c0 20 add_watcher() i=5 2024-09-14T11:29:07.581 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.581+0000 7f5b62bd59c0 20 add_watcher() i=6 2024-09-14T11:29:07.583 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.585+0000 7f5b62bd59c0 20 add_watcher() i=7 2024-09-14T11:29:07.583 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.585+0000 7f5b62bd59c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:07.587 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.589+0000 7f5a16fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:07.588 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.589+0000 7f5b62bd59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:07.588 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.589+0000 7f5b62bd59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:07.589 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.589+0000 7f5b62bd59c0 5 note: GC not initialized 2024-09-14T11:29:07.589 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.593+0000 7f5a15fdb640 20 reqs_thread_entry: start 2024-09-14T11:29:07.590 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.593+0000 7f5b62bd59c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:07.590 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.593+0000 7f5b62bd59c0 20 Filter name: none 2024-09-14T11:29:07.590 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.593+0000 7f59877fe640 20 reqs_thread_entry: start 2024-09-14T11:29:07.590 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.593+0000 7f5b62bd59c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:29:07.590 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.593+0000 7f5b62bd59c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.590 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.593+0000 7f5b62bd59c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:29:07.591 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.593+0000 7f5b62bd59c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:29:07.591 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.593+0000 7f5b62bd59c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:29:07.591 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.593+0000 7f5b62bd59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.20 : miss 2024-09-14T11:29:07.591 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.593+0000 7f5b62bd59c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.592 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.593+0000 7f5b62bd59c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:29:07.592 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.593+0000 7f5b62bd59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.20 info.flags=0x17 2024-09-14T11:29:07.592 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.593+0000 7f5b62bd59c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.20 to cache LRU end 2024-09-14T11:29:07.592 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.593+0000 7f5b62bd59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:29:07.592 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.593+0000 7f5b62bd59c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:07.592 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.593+0000 7f5b62bd59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.20 2024-09-14T11:29:07.594 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.597+0000 7f5b62bd59c0 -1 Injecting error=-5 at location=init_index 2024-09-14T11:29:07.594 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.597+0000 7f5b62bd59c0 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-14T11:29:07.599 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.601+0000 7f5a16fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:07.603 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.605+0000 7f5b62bd59c0 20 remove_watcher() i=0 2024-09-14T11:29:07.603 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.605+0000 7f5b62bd59c0 2 removed watcher, disabling cache 2024-09-14T11:29:07.605 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.609+0000 7f5b62bd59c0 20 remove_watcher() i=1 2024-09-14T11:29:07.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.609+0000 7f5b62bd59c0 20 remove_watcher() i=2 2024-09-14T11:29:07.610 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.613+0000 7f5b62bd59c0 20 remove_watcher() i=3 2024-09-14T11:29:07.613 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.617+0000 7f5b62bd59c0 20 remove_watcher() i=4 2024-09-14T11:29:07.615 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.617+0000 7f5b62bd59c0 20 remove_watcher() i=5 2024-09-14T11:29:07.618 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.621+0000 7f5b62bd59c0 20 remove_watcher() i=6 2024-09-14T11:29:07.621 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.625+0000 7f5b62bd59c0 20 remove_watcher() i=7 2024-09-14T11:29:07.639 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:29:07.669 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:07.669 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:07.715 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.717+0000 7fd2efe3a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.718 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.721+0000 7fd2efe3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:07.718 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.721+0000 7fd2efe3a9c0 20 realm 2024-09-14T11:29:07.718 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.721+0000 7fd2efe3a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.718 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.721+0000 7fd2efe3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:07.718 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.721+0000 7fd2efe3a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:07.718 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.721+0000 7fd2efe3a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.719 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.721+0000 7fd2efe3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:07.719 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.721+0000 7fd2efe3a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.719 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.721+0000 7fd2efe3a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:07.719 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.721+0000 7fd2efe3a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.720 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.721+0000 7fd2efe3a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:07.720 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.721+0000 7fd2efe3a9c0 20 searching for the correct realm 2024-09-14T11:29:07.722 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.725+0000 7fd2ed13f640 0 -- 172.21.15.71:0/2562246655 >> [v2:172.21.15.71:6824/2436891866,v1:172.21.15.71:6825/2436891866] conn(0x7fd2e00c2060 msgr2=0x7fd2e00f5ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:07.936 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.937+0000 7fd2ed940640 0 -- 172.21.15.71:0/2562246655 >> [v2:172.21.15.157:6816/1231501119,v1:172.21.15.157:6817/1231501119] conn(0x55eaf3df7930 msgr2=0x55eaf3df9d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:07.953 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.957+0000 7fd2efe3a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:07.953 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.957+0000 7fd2efe3a9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:29:07.953 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.957+0000 7fd2efe3a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:07.953 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.957+0000 7fd2efe3a9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:29:07.953 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.957+0000 7fd2efe3a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:07.953 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.957+0000 7fd2efe3a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:07.953 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.957+0000 7fd2efe3a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.954 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.957+0000 7fd2efe3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:07.954 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.957+0000 7fd2efe3a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.954 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.957+0000 7fd2efe3a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:07.954 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.957+0000 7fd2efe3a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.955 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.957+0000 7fd2efe3a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:07.955 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.957+0000 7fd2efe3a9c0 20 zone default found 2024-09-14T11:29:07.956 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.957+0000 7fd2efe3a9c0 4 Realm: () 2024-09-14T11:29:07.956 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.957+0000 7fd2efe3a9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:29:07.956 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.957+0000 7fd2efe3a9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:29:07.956 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.957+0000 7fd2efe3a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:07.956 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.957+0000 7fd2efe3a9c0 20 zonegroup default 2024-09-14T11:29:07.956 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.957+0000 7fd2efe3a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.956 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.957+0000 7fd2efe3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:07.956 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.957+0000 7fd2efe3a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.957 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.961+0000 7fd2efe3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:07.957 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.961+0000 7fd2efe3a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.957 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.961+0000 7fd2efe3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:07.958 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.961+0000 7fd2efe3a9c0 20 started sync module instance, tier type = 2024-09-14T11:29:07.958 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.961+0000 7fd2efe3a9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:29:07.982 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.985+0000 7fd2efe3a9c0 20 add_watcher() i=0 2024-09-14T11:29:07.982 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.985+0000 7fd2efe3a9c0 20 add_watcher() i=1 2024-09-14T11:29:07.982 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.985+0000 7fd2efe3a9c0 20 add_watcher() i=2 2024-09-14T11:29:07.982 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.985+0000 7fd2efe3a9c0 20 add_watcher() i=3 2024-09-14T11:29:07.982 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.985+0000 7fd2efe3a9c0 20 add_watcher() i=4 2024-09-14T11:29:07.982 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.985+0000 7fd2efe3a9c0 20 add_watcher() i=5 2024-09-14T11:29:07.982 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.985+0000 7fd2efe3a9c0 20 add_watcher() i=6 2024-09-14T11:29:07.984 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.985+0000 7fd2efe3a9c0 20 add_watcher() i=7 2024-09-14T11:29:07.984 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.985+0000 7fd2efe3a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:07.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.989+0000 7fd19f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:07.989 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.993+0000 7fd2efe3a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:07.989 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.993+0000 7fd2efe3a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:07.989 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.993+0000 7fd2efe3a9c0 5 note: GC not initialized 2024-09-14T11:29:07.990 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.993+0000 7fd19e7fc640 20 reqs_thread_entry: start 2024-09-14T11:29:07.990 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.993+0000 7fd2efe3a9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:07.990 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.993+0000 7fd2efe3a9c0 20 Filter name: none 2024-09-14T11:29:07.990 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.993+0000 7fd10ffff640 20 reqs_thread_entry: start 2024-09-14T11:29:07.990 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.993+0000 7fd2efe3a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.993+0000 7fd2efe3a9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:29:07.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.993+0000 7fd2efe3a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.993+0000 7fd2efe3a9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:29:07.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.993+0000 7fd2efe3a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:07.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.993+0000 7fd2efe3a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.993+0000 7fd2efe3a9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:29:07.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.993+0000 7fd2efe3a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:07.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.997+0000 7fd2efe3a9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:29:07.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.997+0000 7fd2efe3a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:07.996 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:07.997+0000 7fd19f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:08.000 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.001+0000 7fd2efe3a9c0 20 remove_watcher() i=0 2024-09-14T11:29:08.000 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.001+0000 7fd2efe3a9c0 2 removed watcher, disabling cache 2024-09-14T11:29:08.002 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.005+0000 7fd2efe3a9c0 20 remove_watcher() i=1 2024-09-14T11:29:08.004 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.009+0000 7fd2efe3a9c0 20 remove_watcher() i=2 2024-09-14T11:29:08.007 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.009+0000 7fd2efe3a9c0 20 remove_watcher() i=3 2024-09-14T11:29:08.009 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.013+0000 7fd2efe3a9c0 20 remove_watcher() i=4 2024-09-14T11:29:08.011 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.013+0000 7fd2efe3a9c0 20 remove_watcher() i=5 2024-09-14T11:29:08.014 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.017+0000 7fd2efe3a9c0 20 remove_watcher() i=6 2024-09-14T11:29:08.016 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.021+0000 7fd2efe3a9c0 20 remove_watcher() i=7 2024-09-14T11:29:08.031 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:08.031 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:29:08.032 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: error-at-init-index id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:29:08.032 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:08.086 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:29:08.122 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:08.122 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:08.169 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.173+0000 7f775df2b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:08.171 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.173+0000 7f775df2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:08.171 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.173+0000 7f775df2b9c0 20 realm 2024-09-14T11:29:08.171 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.173+0000 7f775df2b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:08.171 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.173+0000 7f775df2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:08.172 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.173+0000 7f775df2b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:08.172 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.173+0000 7f775df2b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:08.172 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.173+0000 7f775df2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:08.172 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.173+0000 7f775df2b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:08.172 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.177+0000 7f775df2b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:08.173 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.177+0000 7f775df2b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:08.173 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.177+0000 7f775df2b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:08.173 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.177+0000 7f775df2b9c0 20 searching for the correct realm 2024-09-14T11:29:08.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.177+0000 7f775b230640 0 -- 172.21.15.71:0/694967394 >> [v2:172.21.15.71:6824/2436891866,v1:172.21.15.71:6825/2436891866] conn(0x7f774c0c4040 msgr2=0x7f774c0c4930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:29:08.388 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.389+0000 7f775ba31640 0 -- 172.21.15.71:0/694967394 >> [v2:172.21.15.157:6816/1231501119,v1:172.21.15.157:6817/1231501119] conn(0x55dcfe108760 msgr2=0x55dcfe10ac20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:08.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.409+0000 7f775df2b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:08.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.409+0000 7f775df2b9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:29:08.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.409+0000 7f775df2b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:08.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.409+0000 7f775df2b9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:29:08.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.409+0000 7f775df2b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:08.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.409+0000 7f775df2b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:08.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.409+0000 7f775df2b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:08.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.409+0000 7f775df2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:08.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.409+0000 7f775df2b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:08.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.409+0000 7f775df2b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:08.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.409+0000 7f775df2b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:08.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.409+0000 7f775df2b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:08.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.409+0000 7f775df2b9c0 20 zone default found 2024-09-14T11:29:08.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.409+0000 7f775df2b9c0 4 Realm: () 2024-09-14T11:29:08.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.409+0000 7f775df2b9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:29:08.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.409+0000 7f775df2b9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:29:08.409 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.409+0000 7f775df2b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:08.409 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.409+0000 7f775df2b9c0 20 zonegroup default 2024-09-14T11:29:08.409 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.409+0000 7f775df2b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:08.409 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.413+0000 7f775df2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:08.409 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.413+0000 7f775df2b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:08.410 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.413+0000 7f775df2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:08.410 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.413+0000 7f775df2b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:08.410 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.413+0000 7f775df2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:08.410 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.413+0000 7f775df2b9c0 20 started sync module instance, tier type = 2024-09-14T11:29:08.410 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.413+0000 7f775df2b9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:29:08.433 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.437+0000 7f775df2b9c0 20 add_watcher() i=0 2024-09-14T11:29:08.433 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.437+0000 7f775df2b9c0 20 add_watcher() i=1 2024-09-14T11:29:08.433 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.437+0000 7f775df2b9c0 20 add_watcher() i=2 2024-09-14T11:29:08.433 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.437+0000 7f775df2b9c0 20 add_watcher() i=3 2024-09-14T11:29:08.433 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.437+0000 7f775df2b9c0 20 add_watcher() i=4 2024-09-14T11:29:08.433 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.437+0000 7f775df2b9c0 20 add_watcher() i=5 2024-09-14T11:29:08.433 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.437+0000 7f775df2b9c0 20 add_watcher() i=6 2024-09-14T11:29:08.435 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.437+0000 7f775df2b9c0 20 add_watcher() i=7 2024-09-14T11:29:08.435 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.437+0000 7f775df2b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:08.439 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.441+0000 7f7611fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:08.441 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.445+0000 7f775df2b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:08.441 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.445+0000 7f775df2b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:08.441 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.445+0000 7f775df2b9c0 5 note: GC not initialized 2024-09-14T11:29:08.442 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.445+0000 7f7610fe1640 20 reqs_thread_entry: start 2024-09-14T11:29:08.442 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.445+0000 7f775df2b9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:08.442 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.445+0000 7f775df2b9c0 20 Filter name: none 2024-09-14T11:29:08.442 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.445+0000 7f758a7fc640 20 reqs_thread_entry: start 2024-09-14T11:29:08.442 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.445+0000 7f775df2b9c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:29:08.442 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.445+0000 7f775df2b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:08.443 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.445+0000 7f775df2b9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:29:08.443 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.445+0000 7f775df2b9c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:29:08.443 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.445+0000 7f775df2b9c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:29:08.443 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.445+0000 7f775df2b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.20 : miss 2024-09-14T11:29:08.443 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.445+0000 7f775df2b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:08.444 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.445+0000 7f775df2b9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:29:08.444 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.445+0000 7f775df2b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.20 info.flags=0x17 2024-09-14T11:29:08.444 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.445+0000 7f775df2b9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.20 to cache LRU end 2024-09-14T11:29:08.444 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.445+0000 7f775df2b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:29:08.444 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.445+0000 7f775df2b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:08.444 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.445+0000 7f775df2b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.20 2024-09-14T11:29:08.454 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.457+0000 7f775df2b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.20 info.flags=0x17 2024-09-14T11:29:08.454 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.457+0000 7f775df2b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.20 to cache LRU end 2024-09-14T11:29:08.454 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.457+0000 7f775df2b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:08.454 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.457+0000 7f775df2b9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.20, ofs0, ns] 2024-09-14T11:29:08.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.461+0000 7f763a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464348 cookie 94407643725792 notifier 5948 bl.length()=995 2024-09-14T11:29:08.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.461+0000 7f763a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.20 info.flags=0x17 2024-09-14T11:29:08.458 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.461+0000 7f763a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.20 to cache LRU end 2024-09-14T11:29:08.458 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.461+0000 7f763a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:08.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.461+0000 7f775df2b9c0 20 handle_bi_update(): bucket=:error-at-init-index[4444f441-0c56-48df-a905-d49e7e44d629.4596.20]): orig_sources= new_sources= 2024-09-14T11:29:08.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.461+0000 7f775df2b9c0 20 handle_bi_update(): bucket=:error-at-init-index[4444f441-0c56-48df-a905-d49e7e44d629.4596.20]): potential sources added=[] removed=[] 2024-09-14T11:29:08.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.461+0000 7f775df2b9c0 20 handle_bi_update(): bucket=:error-at-init-index[4444f441-0c56-48df-a905-d49e7e44d629.4596.20]): orig_dests= new_dests= 2024-09-14T11:29:08.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.461+0000 7f775df2b9c0 20 handle_bi_update(): bucket=:error-at-init-index[4444f441-0c56-48df-a905-d49e7e44d629.4596.20]): potential dests added=[] removed=[] 2024-09-14T11:29:08.469 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.473+0000 7f775df2b9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.1.0 2024-09-14T11:29:08.470 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.473+0000 7f775df2b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.1.0 2024-09-14T11:29:08.470 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.473+0000 7f775df2b9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.1.1 2024-09-14T11:29:08.470 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.473+0000 7f775df2b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.1.1 2024-09-14T11:29:08.470 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.473+0000 7f775df2b9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.1.2 2024-09-14T11:29:08.470 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.473+0000 7f775df2b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.1.2 2024-09-14T11:29:08.470 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.473+0000 7f775df2b9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.1.3 2024-09-14T11:29:08.470 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.473+0000 7f775df2b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.1.3 2024-09-14T11:29:08.470 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.473+0000 7f775df2b9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.1.4 2024-09-14T11:29:08.470 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.473+0000 7f775df2b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.1.4 2024-09-14T11:29:08.470 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.473+0000 7f775df2b9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.1.5 2024-09-14T11:29:08.470 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.473+0000 7f775df2b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.1.5 2024-09-14T11:29:08.470 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.473+0000 7f775df2b9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.1.6 2024-09-14T11:29:08.470 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.473+0000 7f775df2b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.1.6 2024-09-14T11:29:08.470 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.473+0000 7f775df2b9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.1.7 2024-09-14T11:29:08.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.473+0000 7f775df2b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.1.7 2024-09-14T11:29:08.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.473+0000 7f775df2b9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.1.8 2024-09-14T11:29:08.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.473+0000 7f775df2b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.1.8 2024-09-14T11:29:08.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.473+0000 7f775df2b9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.1.9 2024-09-14T11:29:08.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.473+0000 7f775df2b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.1.9 2024-09-14T11:29:08.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.473+0000 7f775df2b9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.1.10 2024-09-14T11:29:08.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.473+0000 7f775df2b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.1.10 2024-09-14T11:29:08.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.473+0000 7f775df2b9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.1.11 2024-09-14T11:29:08.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.473+0000 7f775df2b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.1.11 2024-09-14T11:29:08.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.473+0000 7f775df2b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.0 2024-09-14T11:29:08.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.473+0000 7f775df2b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.1 2024-09-14T11:29:08.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.473+0000 7f775df2b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.2 2024-09-14T11:29:08.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.473+0000 7f775df2b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.3 2024-09-14T11:29:08.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.477+0000 7f775df2b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.4 2024-09-14T11:29:08.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.477+0000 7f775df2b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.5 2024-09-14T11:29:08.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.477+0000 7f775df2b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.6 2024-09-14T11:29:08.475 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.477+0000 7f775df2b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.7 2024-09-14T11:29:08.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.481+0000 7f775df2b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.8 2024-09-14T11:29:08.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.481+0000 7f775df2b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.9 2024-09-14T11:29:08.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.481+0000 7f775df2b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.10 2024-09-14T11:29:08.483 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.485+0000 7f775df2b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.20 : hit (requested=0x17, cached=0x17) 2024-09-14T11:29:08.483 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.485+0000 7f775df2b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.20 2024-09-14T11:29:08.486 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.489+0000 7f775df2b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.20 info.flags=0x17 2024-09-14T11:29:08.486 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.489+0000 7f775df2b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.20 to cache LRU end 2024-09-14T11:29:08.486 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.489+0000 7f775df2b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:08.486 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.489+0000 7f775df2b9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.20, ofs0, ns] 2024-09-14T11:29:08.487 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.489+0000 7f763affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464349 cookie 94407643725792 notifier 5948 bl.length()=995 2024-09-14T11:29:08.487 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.489+0000 7f763affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.20 info.flags=0x17 2024-09-14T11:29:08.487 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.489+0000 7f763affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.20 to cache LRU end 2024-09-14T11:29:08.487 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.489+0000 7f763affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:08.487 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.489+0000 7f775df2b9c0 20 handle_bi_update(): bucket=:error-at-init-index[4444f441-0c56-48df-a905-d49e7e44d629.4596.20]): orig_sources= new_sources= 2024-09-14T11:29:08.487 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.489+0000 7f775df2b9c0 20 handle_bi_update(): bucket=:error-at-init-index[4444f441-0c56-48df-a905-d49e7e44d629.4596.20]): potential sources added=[] removed=[] 2024-09-14T11:29:08.487 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.489+0000 7f775df2b9c0 20 handle_bi_update(): bucket=:error-at-init-index[4444f441-0c56-48df-a905-d49e7e44d629.4596.20]): orig_dests= new_dests= 2024-09-14T11:29:08.488 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.489+0000 7f775df2b9c0 20 handle_bi_update(): bucket=:error-at-init-index[4444f441-0c56-48df-a905-d49e7e44d629.4596.20]): potential dests added=[] removed=[] 2024-09-14T11:29:08.492 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.493+0000 7f775df2b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.0 2024-09-14T11:29:08.492 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.493+0000 7f775df2b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.1 2024-09-14T11:29:08.493 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.497+0000 7f775df2b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.2 2024-09-14T11:29:08.493 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.497+0000 7f775df2b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.3 2024-09-14T11:29:08.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.497+0000 7f775df2b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.4 2024-09-14T11:29:08.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.497+0000 7f775df2b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.5 2024-09-14T11:29:08.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.497+0000 7f775df2b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.6 2024-09-14T11:29:08.497 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.501+0000 7f775df2b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.7 2024-09-14T11:29:08.497 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.501+0000 7f775df2b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.8 2024-09-14T11:29:08.497 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.501+0000 7f775df2b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.9 2024-09-14T11:29:08.498 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.501+0000 7f775df2b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.20.10 2024-09-14T11:29:08.498 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.501+0000 7f775df2b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.20 : hit (requested=0x17, cached=0x17) 2024-09-14T11:29:08.498 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.501+0000 7f775df2b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.20 2024-09-14T11:29:08.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.505+0000 7f775df2b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.20 info.flags=0x17 2024-09-14T11:29:08.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.505+0000 7f775df2b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.20 to cache LRU end 2024-09-14T11:29:08.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.505+0000 7f775df2b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:08.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.505+0000 7f775df2b9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.20, ofs0, ns] 2024-09-14T11:29:08.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.505+0000 7f763affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464350 cookie 94407643725792 notifier 5948 bl.length()=963 2024-09-14T11:29:08.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.505+0000 7f763affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.20 info.flags=0x17 2024-09-14T11:29:08.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.505+0000 7f763affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.20 to cache LRU end 2024-09-14T11:29:08.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.505+0000 7f763affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:08.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.505+0000 7f775df2b9c0 20 handle_bi_update(): bucket=:error-at-init-index[4444f441-0c56-48df-a905-d49e7e44d629.4596.20]): orig_sources= new_sources= 2024-09-14T11:29:08.504 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.505+0000 7f775df2b9c0 20 handle_bi_update(): bucket=:error-at-init-index[4444f441-0c56-48df-a905-d49e7e44d629.4596.20]): potential sources added=[] removed=[] 2024-09-14T11:29:08.504 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.505+0000 7f775df2b9c0 20 handle_bi_update(): bucket=:error-at-init-index[4444f441-0c56-48df-a905-d49e7e44d629.4596.20]): orig_dests= new_dests= 2024-09-14T11:29:08.504 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.505+0000 7f775df2b9c0 20 handle_bi_update(): bucket=:error-at-init-index[4444f441-0c56-48df-a905-d49e7e44d629.4596.20]): potential dests added=[] removed=[] 2024-09-14T11:29:08.509 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.513+0000 7f775df2b9c0 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-14T11:29:08.513 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.517+0000 7f7611fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:08.517 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.521+0000 7f775df2b9c0 20 remove_watcher() i=0 2024-09-14T11:29:08.517 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.521+0000 7f775df2b9c0 2 removed watcher, disabling cache 2024-09-14T11:29:08.519 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.521+0000 7f775df2b9c0 20 remove_watcher() i=1 2024-09-14T11:29:08.521 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.525+0000 7f775df2b9c0 20 remove_watcher() i=2 2024-09-14T11:29:08.524 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.525+0000 7f775df2b9c0 20 remove_watcher() i=3 2024-09-14T11:29:08.526 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.529+0000 7f775df2b9c0 20 remove_watcher() i=4 2024-09-14T11:29:08.528 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.529+0000 7f775df2b9c0 20 remove_watcher() i=5 2024-09-14T11:29:08.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.533+0000 7f775df2b9c0 20 remove_watcher() i=6 2024-09-14T11:29:08.534 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.537+0000 7f775df2b9c0 20 remove_watcher() i=7 2024-09-14T11:29:08.550 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:29:08.580 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:08.580 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:08.624 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.625+0000 7f3b9baec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:08.627 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.629+0000 7f3b9baec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:08.627 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.629+0000 7f3b9baec9c0 20 realm 2024-09-14T11:29:08.627 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.629+0000 7f3b9baec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:08.627 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.629+0000 7f3b9baec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:08.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.629+0000 7f3b9baec9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:08.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.629+0000 7f3b9baec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:08.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.629+0000 7f3b9baec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:08.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.629+0000 7f3b9baec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:08.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.633+0000 7f3b9baec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:08.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.633+0000 7f3b9baec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:08.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.633+0000 7f3b9baec9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:08.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.633+0000 7f3b9baec9c0 20 searching for the correct realm 2024-09-14T11:29:08.635 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.637+0000 7f3b995f2640 0 -- 172.21.15.71:0/2590245097 >> [v2:172.21.15.157:6808/527702018,v1:172.21.15.157:6809/527702018] conn(0x7f3b8c021900 msgr2=0x7f3b8c038410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:08.851 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.853+0000 7f3b995f2640 0 -- 172.21.15.71:0/2590245097 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x55acdce84030 msgr2=0x55acdce864f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:08.859 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.861+0000 7f3b9baec9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:08.860 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.861+0000 7f3b9baec9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:29:08.860 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.861+0000 7f3b9baec9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:08.860 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.861+0000 7f3b9baec9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:29:08.860 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.861+0000 7f3b9baec9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:08.860 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.861+0000 7f3b9baec9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:08.860 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.861+0000 7f3b9baec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:08.860 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.861+0000 7f3b9baec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:08.861 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.861+0000 7f3b9baec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:08.861 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.865+0000 7f3b9baec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:08.861 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.865+0000 7f3b9baec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:08.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.865+0000 7f3b9baec9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:08.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.865+0000 7f3b9baec9c0 20 zone default found 2024-09-14T11:29:08.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.865+0000 7f3b9baec9c0 4 Realm: () 2024-09-14T11:29:08.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.865+0000 7f3b9baec9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:29:08.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.865+0000 7f3b9baec9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:29:08.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.865+0000 7f3b9baec9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:08.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.865+0000 7f3b9baec9c0 20 zonegroup default 2024-09-14T11:29:08.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.865+0000 7f3b9baec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:08.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.865+0000 7f3b9baec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:08.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.865+0000 7f3b9baec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:08.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.865+0000 7f3b9baec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:08.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.865+0000 7f3b9baec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:08.864 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.865+0000 7f3b9baec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:08.864 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.865+0000 7f3b9baec9c0 20 started sync module instance, tier type = 2024-09-14T11:29:08.864 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.865+0000 7f3b9baec9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:29:08.890 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.893+0000 7f3b9baec9c0 20 add_watcher() i=0 2024-09-14T11:29:08.890 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.893+0000 7f3b9baec9c0 20 add_watcher() i=1 2024-09-14T11:29:08.890 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.893+0000 7f3b9baec9c0 20 add_watcher() i=2 2024-09-14T11:29:08.890 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.893+0000 7f3b9baec9c0 20 add_watcher() i=3 2024-09-14T11:29:08.890 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.893+0000 7f3b9baec9c0 20 add_watcher() i=4 2024-09-14T11:29:08.890 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.893+0000 7f3b9baec9c0 20 add_watcher() i=5 2024-09-14T11:29:08.893 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.897+0000 7f3b9baec9c0 20 add_watcher() i=6 2024-09-14T11:29:08.896 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.897+0000 7f3b9baec9c0 20 add_watcher() i=7 2024-09-14T11:29:08.896 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.897+0000 7f3b9baec9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:08.900 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.901+0000 7f3a4f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:08.901 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.905+0000 7f3b9baec9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:08.901 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.905+0000 7f3b9baec9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:08.901 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.905+0000 7f3b9baec9c0 5 note: GC not initialized 2024-09-14T11:29:08.902 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.905+0000 7f3a4e7e4640 20 reqs_thread_entry: start 2024-09-14T11:29:08.902 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.905+0000 7f3b9baec9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:08.903 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.905+0000 7f3b9baec9c0 20 Filter name: none 2024-09-14T11:29:08.903 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.905+0000 7f39bffff640 20 reqs_thread_entry: start 2024-09-14T11:29:08.903 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.905+0000 7f3b9baec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:08.903 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.905+0000 7f3b9baec9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:29:08.903 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.905+0000 7f3b9baec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:08.904 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.905+0000 7f3b9baec9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:29:08.904 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.905+0000 7f3b9baec9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:08.904 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.905+0000 7f3b9baec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:08.905 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.909+0000 7f3b9baec9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:29:08.905 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.909+0000 7f3b9baec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:08.906 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.909+0000 7f3b9baec9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:29:08.906 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.909+0000 7f3b9baec9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:08.909 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.913+0000 7f3a4f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:08.913 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.917+0000 7f3b9baec9c0 20 remove_watcher() i=0 2024-09-14T11:29:08.913 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.917+0000 7f3b9baec9c0 2 removed watcher, disabling cache 2024-09-14T11:29:08.915 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.917+0000 7f3b9baec9c0 20 remove_watcher() i=1 2024-09-14T11:29:08.918 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.921+0000 7f3b9baec9c0 20 remove_watcher() i=2 2024-09-14T11:29:08.922 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.925+0000 7f3b9baec9c0 20 remove_watcher() i=3 2024-09-14T11:29:08.924 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.925+0000 7f3b9baec9c0 20 remove_watcher() i=4 2024-09-14T11:29:08.926 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.929+0000 7f3b9baec9c0 20 remove_watcher() i=5 2024-09-14T11:29:08.929 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.933+0000 7f3b9baec9c0 20 remove_watcher() i=6 2024-09-14T11:29:08.932 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:08.933+0000 7f3b9baec9c0 20 remove_watcher() i=7 2024-09-14T11:29:08.946 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:08.947 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:29:08.947 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: error-at-init-index id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.20 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:29:08.947 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:09.060 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-14T11:29:09.060 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:09.430 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:29:09.462 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:09.462 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:09.507 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.509+0000 7f5f73e619c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.509 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.513+0000 7f5f73e619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:09.510 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.513+0000 7f5f73e619c0 20 realm 2024-09-14T11:29:09.510 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.513+0000 7f5f73e619c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.510 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.513+0000 7f5f73e619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:09.510 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.513+0000 7f5f73e619c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:09.510 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.513+0000 7f5f73e619c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.511 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.513+0000 7f5f73e619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:09.511 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.513+0000 7f5f73e619c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.511 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.513+0000 7f5f73e619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:09.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.513+0000 7f5f73e619c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.517+0000 7f5f73e619c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:09.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.517+0000 7f5f73e619c0 20 searching for the correct realm 2024-09-14T11:29:09.516 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.517+0000 7f5f72168640 0 -- 172.21.15.71:0/825732462 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f5f68106010 msgr2=0x7f5f68108100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:09.728 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.729+0000 7f5f72168640 0 -- 172.21.15.71:0/825732462 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55598bb16ae0 msgr2=0x55598bb18ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:09.742 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.745+0000 7f5f73e619c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:09.742 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.745+0000 7f5f73e619c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:29:09.742 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.745+0000 7f5f73e619c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:09.742 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.745+0000 7f5f73e619c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:29:09.742 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.745+0000 7f5f73e619c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:09.742 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.745+0000 7f5f73e619c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:09.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.745+0000 7f5f73e619c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.745+0000 7f5f73e619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:09.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.745+0000 7f5f73e619c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.745+0000 7f5f73e619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:09.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.745+0000 7f5f73e619c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.745 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.749+0000 7f5f73e619c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:09.745 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.749+0000 7f5f73e619c0 20 zone default found 2024-09-14T11:29:09.745 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.749+0000 7f5f73e619c0 4 Realm: () 2024-09-14T11:29:09.745 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.749+0000 7f5f73e619c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:29:09.745 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.749+0000 7f5f73e619c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:29:09.745 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.749+0000 7f5f73e619c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:09.745 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.749+0000 7f5f73e619c0 20 zonegroup default 2024-09-14T11:29:09.745 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.749+0000 7f5f73e619c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.746 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.749+0000 7f5f73e619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:09.746 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.749+0000 7f5f73e619c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.746 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.749+0000 7f5f73e619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:09.746 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.749+0000 7f5f73e619c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.747 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.749+0000 7f5f73e619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:09.747 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.749+0000 7f5f73e619c0 20 started sync module instance, tier type = 2024-09-14T11:29:09.747 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.749+0000 7f5f73e619c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:29:09.772 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.777+0000 7f5f73e619c0 20 add_watcher() i=0 2024-09-14T11:29:09.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.777+0000 7f5f73e619c0 20 add_watcher() i=1 2024-09-14T11:29:09.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.777+0000 7f5f73e619c0 20 add_watcher() i=2 2024-09-14T11:29:09.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.777+0000 7f5f73e619c0 20 add_watcher() i=3 2024-09-14T11:29:09.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.777+0000 7f5f73e619c0 20 add_watcher() i=4 2024-09-14T11:29:09.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.777+0000 7f5f73e619c0 20 add_watcher() i=5 2024-09-14T11:29:09.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.777+0000 7f5f73e619c0 20 add_watcher() i=6 2024-09-14T11:29:09.775 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.777+0000 7f5f73e619c0 20 add_watcher() i=7 2024-09-14T11:29:09.775 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.777+0000 7f5f73e619c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:09.779 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.781+0000 7f5e237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:09.780 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.781+0000 7f5f73e619c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:09.780 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.781+0000 7f5f73e619c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:09.780 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.781+0000 7f5f73e619c0 5 note: GC not initialized 2024-09-14T11:29:09.781 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.785+0000 7f5e227fc640 20 reqs_thread_entry: start 2024-09-14T11:29:09.781 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.785+0000 7f5f73e619c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:09.781 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.785+0000 7f5f73e619c0 20 Filter name: none 2024-09-14T11:29:09.781 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.785+0000 7f5d93fff640 20 reqs_thread_entry: start 2024-09-14T11:29:09.781 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.785+0000 7f5f73e619c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.782 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.785+0000 7f5f73e619c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:29:09.782 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.785+0000 7f5f73e619c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.784 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.785+0000 7f5f73e619c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:29:09.784 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.785+0000 7f5f73e619c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:09.784 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.785+0000 7f5f73e619c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.784 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.785+0000 7f5f73e619c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:29:09.784 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.785+0000 7f5f73e619c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.786 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.789+0000 7f5f73e619c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:29:09.786 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.789+0000 7f5f73e619c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:09.789 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.793+0000 7f5e237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:09.793 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.797+0000 7f5f73e619c0 20 remove_watcher() i=0 2024-09-14T11:29:09.793 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.797+0000 7f5f73e619c0 2 removed watcher, disabling cache 2024-09-14T11:29:09.794 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.797+0000 7f5f73e619c0 20 remove_watcher() i=1 2024-09-14T11:29:09.796 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.801+0000 7f5f73e619c0 20 remove_watcher() i=2 2024-09-14T11:29:09.799 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.801+0000 7f5f73e619c0 20 remove_watcher() i=3 2024-09-14T11:29:09.801 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.805+0000 7f5f73e619c0 20 remove_watcher() i=4 2024-09-14T11:29:09.803 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.805+0000 7f5f73e619c0 20 remove_watcher() i=5 2024-09-14T11:29:09.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.809+0000 7f5f73e619c0 20 remove_watcher() i=6 2024-09-14T11:29:09.809 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.813+0000 7f5f73e619c0 20 remove_watcher() i=7 2024-09-14T11:29:09.825 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:09.825 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:29:09.826 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: error-at-init-index id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:29:09.826 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:09.826 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-14T11:29:09.867 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:09.867 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:09.915 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.917+0000 7f187afb69c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.918 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.921+0000 7f187afb69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:09.918 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.921+0000 7f187afb69c0 20 realm 2024-09-14T11:29:09.918 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.921+0000 7f187afb69c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.919 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.921+0000 7f187afb69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:09.919 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.921+0000 7f187afb69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:09.919 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.921+0000 7f187afb69c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.919 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.921+0000 7f187afb69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:09.919 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.921+0000 7f187afb69c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.920 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.921+0000 7f187afb69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:09.920 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.921+0000 7f187afb69c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.921 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.925+0000 7f187afb69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:09.921 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.925+0000 7f187afb69c0 20 searching for the correct realm 2024-09-14T11:29:09.922 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.925+0000 7f1878abc640 0 -- 172.21.15.71:0/1468758052 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x560f36df3ac0 msgr2=0x560f36df5f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:09.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.929+0000 7f1878abc640 0 -- 172.21.15.71:0/1468758052 >> [v2:172.21.15.157:6808/527702018,v1:172.21.15.157:6809/527702018] conn(0x7f1868108d10 msgr2=0x7f18681086e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:09.940 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.941+0000 7f187afb69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:09.940 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.941+0000 7f187afb69c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:29:09.940 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.941+0000 7f187afb69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:09.940 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.941+0000 7f187afb69c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:29:09.940 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.941+0000 7f187afb69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:09.940 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.941+0000 7f187afb69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:09.940 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.941+0000 7f187afb69c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.941 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.941+0000 7f187afb69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:09.941 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.941+0000 7f187afb69c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.941 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.945+0000 7f187afb69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:09.941 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.945+0000 7f187afb69c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.942 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.945+0000 7f187afb69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:09.942 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.945+0000 7f187afb69c0 20 zone default found 2024-09-14T11:29:09.942 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.945+0000 7f187afb69c0 4 Realm: () 2024-09-14T11:29:09.942 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.945+0000 7f187afb69c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:29:09.942 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.945+0000 7f187afb69c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:29:09.942 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.945+0000 7f187afb69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:09.942 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.945+0000 7f187afb69c0 20 zonegroup default 2024-09-14T11:29:09.942 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.945+0000 7f187afb69c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.943 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.945+0000 7f187afb69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:09.943 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.945+0000 7f187afb69c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.943 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.945+0000 7f187afb69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:09.943 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.945+0000 7f187afb69c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.943 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.945+0000 7f187afb69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:09.944 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.945+0000 7f187afb69c0 20 started sync module instance, tier type = 2024-09-14T11:29:09.944 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.945+0000 7f187afb69c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:29:09.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.965+0000 7f187afb69c0 20 add_watcher() i=0 2024-09-14T11:29:09.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.965+0000 7f187afb69c0 20 add_watcher() i=1 2024-09-14T11:29:09.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.965+0000 7f187afb69c0 20 add_watcher() i=2 2024-09-14T11:29:09.964 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.965+0000 7f187afb69c0 20 add_watcher() i=3 2024-09-14T11:29:09.964 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.965+0000 7f187afb69c0 20 add_watcher() i=4 2024-09-14T11:29:09.964 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.965+0000 7f187afb69c0 20 add_watcher() i=5 2024-09-14T11:29:09.964 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.965+0000 7f187afb69c0 20 add_watcher() i=6 2024-09-14T11:29:09.966 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.969+0000 7f187afb69c0 20 add_watcher() i=7 2024-09-14T11:29:09.966 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.969+0000 7f187afb69c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:09.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.973+0000 7f172f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:09.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.973+0000 7f187afb69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:09.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.973+0000 7f187afb69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:09.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.973+0000 7f187afb69c0 5 note: GC not initialized 2024-09-14T11:29:09.971 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.973+0000 7f172e7e4640 20 reqs_thread_entry: start 2024-09-14T11:29:09.971 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.973+0000 7f187afb69c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:09.971 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.973+0000 7f187afb69c0 20 Filter name: none 2024-09-14T11:29:09.971 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.973+0000 7f17277fe640 20 reqs_thread_entry: start 2024-09-14T11:29:09.971 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.973+0000 7f187afb69c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:29:09.971 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.973+0000 7f187afb69c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.971 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.973+0000 7f187afb69c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:29:09.972 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.973+0000 7f187afb69c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:29:09.972 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.973+0000 7f187afb69c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:29:09.972 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.973+0000 7f187afb69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.21 : miss 2024-09-14T11:29:09.972 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.973+0000 7f187afb69c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.972 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.973+0000 7f187afb69c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:29:09.972 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.973+0000 7f187afb69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.21 info.flags=0x17 2024-09-14T11:29:09.973 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.973+0000 7f187afb69c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.21 to cache LRU end 2024-09-14T11:29:09.973 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.973+0000 7f187afb69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:29:09.973 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.973+0000 7f187afb69c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:09.973 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.973+0000 7f187afb69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.21 2024-09-14T11:29:09.974 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.977+0000 7f187afb69c0 -1 Injecting error=-95 at location=init_index 2024-09-14T11:29:09.975 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.977+0000 7f187afb69c0 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-14T11:29:09.984 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.989+0000 7f187afb69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.21 info.flags=0x17 2024-09-14T11:29:09.985 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.989+0000 7f187afb69c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.21 to cache LRU end 2024-09-14T11:29:09.985 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.989+0000 7f187afb69c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:09.985 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.989+0000 7f187afb69c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.21, ofs0, ns] 2024-09-14T11:29:09.985 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.989+0000 7f174ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464355 cookie 94623345116176 notifier 6270 bl.length()=995 2024-09-14T11:29:09.985 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.989+0000 7f174ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.21 info.flags=0x17 2024-09-14T11:29:09.985 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.989+0000 7f174ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.21 to cache LRU end 2024-09-14T11:29:09.985 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.989+0000 7f174ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:09.986 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.989+0000 7f187afb69c0 20 handle_bi_update(): bucket=:error-at-init-index[4444f441-0c56-48df-a905-d49e7e44d629.4596.21]): orig_sources= new_sources= 2024-09-14T11:29:09.986 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.989+0000 7f187afb69c0 20 handle_bi_update(): bucket=:error-at-init-index[4444f441-0c56-48df-a905-d49e7e44d629.4596.21]): potential sources added=[] removed=[] 2024-09-14T11:29:09.986 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.989+0000 7f187afb69c0 20 handle_bi_update(): bucket=:error-at-init-index[4444f441-0c56-48df-a905-d49e7e44d629.4596.21]): orig_dests= new_dests= 2024-09-14T11:29:09.986 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.989+0000 7f187afb69c0 20 handle_bi_update(): bucket=:error-at-init-index[4444f441-0c56-48df-a905-d49e7e44d629.4596.21]): potential dests added=[] removed=[] 2024-09-14T11:29:09.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.993+0000 7f187afb69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.21.1.0 2024-09-14T11:29:09.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.993+0000 7f187afb69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.21.1.0 2024-09-14T11:29:09.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.993+0000 7f187afb69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.21.1.1 2024-09-14T11:29:09.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.993+0000 7f187afb69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.21.1.1 2024-09-14T11:29:09.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.993+0000 7f187afb69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.21.1.2 2024-09-14T11:29:09.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.993+0000 7f187afb69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.21.1.2 2024-09-14T11:29:09.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.993+0000 7f187afb69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.21.1.3 2024-09-14T11:29:09.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.993+0000 7f187afb69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.21.1.3 2024-09-14T11:29:09.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.993+0000 7f187afb69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.21.1.4 2024-09-14T11:29:09.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.993+0000 7f187afb69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.21.1.4 2024-09-14T11:29:09.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.993+0000 7f187afb69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.21.1.5 2024-09-14T11:29:09.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.993+0000 7f187afb69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.21.1.5 2024-09-14T11:29:09.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.993+0000 7f187afb69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.21.1.6 2024-09-14T11:29:09.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.993+0000 7f187afb69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.21.1.6 2024-09-14T11:29:09.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.993+0000 7f187afb69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.21.1.7 2024-09-14T11:29:09.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.993+0000 7f187afb69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.21.1.7 2024-09-14T11:29:09.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.993+0000 7f187afb69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.21.1.8 2024-09-14T11:29:09.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.993+0000 7f187afb69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.21.1.8 2024-09-14T11:29:09.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.993+0000 7f187afb69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.21.1.9 2024-09-14T11:29:09.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.993+0000 7f187afb69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.21.1.9 2024-09-14T11:29:09.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.993+0000 7f187afb69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.21.1.10 2024-09-14T11:29:09.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.993+0000 7f187afb69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.21.1.10 2024-09-14T11:29:09.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.993+0000 7f187afb69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.21.1.11 2024-09-14T11:29:09.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.993+0000 7f187afb69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.21.1.11 2024-09-14T11:29:09.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.993+0000 7f187afb69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.21.0 2024-09-14T11:29:09.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.993+0000 7f187afb69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.21.1 2024-09-14T11:29:09.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:09.997+0000 7f187afb69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.21.2 2024-09-14T11:29:09.997 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.001+0000 7f187afb69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.21.3 2024-09-14T11:29:09.997 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.001+0000 7f187afb69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.21.4 2024-09-14T11:29:09.998 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.001+0000 7f187afb69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.21.5 2024-09-14T11:29:09.998 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.001+0000 7f187afb69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.21.6 2024-09-14T11:29:09.999 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.001+0000 7f187afb69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.21.7 2024-09-14T11:29:10.001 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.005+0000 7f187afb69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.21.8 2024-09-14T11:29:10.001 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.005+0000 7f187afb69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.21.9 2024-09-14T11:29:10.002 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.005+0000 7f187afb69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.21.10 2024-09-14T11:29:10.008 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.009+0000 7f187afb69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.21 : hit (requested=0x17, cached=0x17) 2024-09-14T11:29:10.008 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.009+0000 7f187afb69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.21 2024-09-14T11:29:10.011 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.013+0000 7f187afb69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.21 info.flags=0x17 2024-09-14T11:29:10.011 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.013+0000 7f187afb69c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.21 to cache LRU end 2024-09-14T11:29:10.011 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.013+0000 7f187afb69c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:10.011 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.013+0000 7f187afb69c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.21, ofs0, ns] 2024-09-14T11:29:10.012 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.013+0000 7f174f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464356 cookie 94623345116176 notifier 6270 bl.length()=963 2024-09-14T11:29:10.012 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.013+0000 7f174f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.21 info.flags=0x17 2024-09-14T11:29:10.012 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.013+0000 7f174f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:4444f441-0c56-48df-a905-d49e7e44d629.4596.21 to cache LRU end 2024-09-14T11:29:10.012 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.013+0000 7f174f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:10.013 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.017+0000 7f187afb69c0 20 handle_bi_update(): bucket=:error-at-init-index[4444f441-0c56-48df-a905-d49e7e44d629.4596.21]): orig_sources= new_sources= 2024-09-14T11:29:10.013 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.017+0000 7f187afb69c0 20 handle_bi_update(): bucket=:error-at-init-index[4444f441-0c56-48df-a905-d49e7e44d629.4596.21]): potential sources added=[] removed=[] 2024-09-14T11:29:10.013 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.017+0000 7f187afb69c0 20 handle_bi_update(): bucket=:error-at-init-index[4444f441-0c56-48df-a905-d49e7e44d629.4596.21]): orig_dests= new_dests= 2024-09-14T11:29:10.013 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.017+0000 7f187afb69c0 20 handle_bi_update(): bucket=:error-at-init-index[4444f441-0c56-48df-a905-d49e7e44d629.4596.21]): potential dests added=[] removed=[] 2024-09-14T11:29:10.016 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.017+0000 7f187afb69c0 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-14T11:29:10.019 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.021+0000 7f172f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:10.023 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.025+0000 7f187afb69c0 20 remove_watcher() i=0 2024-09-14T11:29:10.023 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.025+0000 7f187afb69c0 2 removed watcher, disabling cache 2024-09-14T11:29:10.024 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.025+0000 7f187afb69c0 20 remove_watcher() i=1 2024-09-14T11:29:10.026 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.029+0000 7f187afb69c0 20 remove_watcher() i=2 2024-09-14T11:29:10.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.029+0000 7f187afb69c0 20 remove_watcher() i=3 2024-09-14T11:29:10.030 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.033+0000 7f187afb69c0 20 remove_watcher() i=4 2024-09-14T11:29:10.031 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.033+0000 7f187afb69c0 20 remove_watcher() i=5 2024-09-14T11:29:10.034 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.037+0000 7f187afb69c0 20 remove_watcher() i=6 2024-09-14T11:29:10.036 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.041+0000 7f187afb69c0 20 remove_watcher() i=7 2024-09-14T11:29:10.051 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:29:10.079 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:10.079 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:10.124 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.125+0000 7fc6eea079c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:10.126 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.129+0000 7fc6eea079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:10.126 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.129+0000 7fc6eea079c0 20 realm 2024-09-14T11:29:10.126 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.129+0000 7fc6eea079c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:10.127 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.129+0000 7fc6eea079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:10.127 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.129+0000 7fc6eea079c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:10.127 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.129+0000 7fc6eea079c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:10.127 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.129+0000 7fc6eea079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:10.127 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.129+0000 7fc6eea079c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:10.128 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.129+0000 7fc6eea079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:10.128 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.129+0000 7fc6eea079c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:10.129 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.133+0000 7fc6eea079c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:10.129 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.133+0000 7fc6eea079c0 20 searching for the correct realm 2024-09-14T11:29:10.132 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.137+0000 7fc6ecd0e640 0 -- 172.21.15.71:0/3924711390 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fc6d40c0020 msgr2=0x7fc6d411ba40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:10.349 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.353+0000 7fc6ecd0e640 0 -- 172.21.15.71:0/3924711390 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55557eb9ddd0 msgr2=0x55557eba01c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:10.362 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.365+0000 7fc6eea079c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:10.362 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.365+0000 7fc6eea079c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:29:10.362 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.365+0000 7fc6eea079c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:10.362 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.365+0000 7fc6eea079c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:29:10.362 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.365+0000 7fc6eea079c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:10.362 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.365+0000 7fc6eea079c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:10.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.365+0000 7fc6eea079c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:10.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.365+0000 7fc6eea079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:10.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.365+0000 7fc6eea079c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:10.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.365+0000 7fc6eea079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:10.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.365+0000 7fc6eea079c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:10.364 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.365+0000 7fc6eea079c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:10.364 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.365+0000 7fc6eea079c0 20 zone default found 2024-09-14T11:29:10.364 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.365+0000 7fc6eea079c0 4 Realm: () 2024-09-14T11:29:10.365 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.365+0000 7fc6eea079c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:29:10.365 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.365+0000 7fc6eea079c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:29:10.365 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.365+0000 7fc6eea079c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:10.365 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.365+0000 7fc6eea079c0 20 zonegroup default 2024-09-14T11:29:10.365 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.365+0000 7fc6eea079c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:10.365 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.369+0000 7fc6eea079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:10.366 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.369+0000 7fc6eea079c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:10.366 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.369+0000 7fc6eea079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:10.366 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.369+0000 7fc6eea079c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:10.367 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.369+0000 7fc6eea079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:10.367 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.369+0000 7fc6eea079c0 20 started sync module instance, tier type = 2024-09-14T11:29:10.367 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.369+0000 7fc6eea079c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:29:10.389 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.393+0000 7fc6eea079c0 20 add_watcher() i=0 2024-09-14T11:29:10.389 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.393+0000 7fc6eea079c0 20 add_watcher() i=1 2024-09-14T11:29:10.389 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.393+0000 7fc6eea079c0 20 add_watcher() i=2 2024-09-14T11:29:10.389 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.393+0000 7fc6eea079c0 20 add_watcher() i=3 2024-09-14T11:29:10.389 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.393+0000 7fc6eea079c0 20 add_watcher() i=4 2024-09-14T11:29:10.389 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.393+0000 7fc6eea079c0 20 add_watcher() i=5 2024-09-14T11:29:10.389 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.393+0000 7fc6eea079c0 20 add_watcher() i=6 2024-09-14T11:29:10.391 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.393+0000 7fc6eea079c0 20 add_watcher() i=7 2024-09-14T11:29:10.391 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.393+0000 7fc6eea079c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:10.395 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.397+0000 7fc5a2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:10.396 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.397+0000 7fc6eea079c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:10.396 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.397+0000 7fc6eea079c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:10.396 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.397+0000 7fc6eea079c0 5 note: GC not initialized 2024-09-14T11:29:10.397 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.401+0000 7fc5a1fdb640 20 reqs_thread_entry: start 2024-09-14T11:29:10.398 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.401+0000 7fc6eea079c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:10.398 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.401+0000 7fc6eea079c0 20 Filter name: none 2024-09-14T11:29:10.398 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.401+0000 7fc5137fe640 20 reqs_thread_entry: start 2024-09-14T11:29:10.398 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.401+0000 7fc6eea079c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:10.398 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.401+0000 7fc6eea079c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:29:10.398 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.401+0000 7fc6eea079c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:10.399 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.401+0000 7fc6eea079c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:29:10.399 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.401+0000 7fc6eea079c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:10.399 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.401+0000 7fc6eea079c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:10.400 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.401+0000 7fc6eea079c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:29:10.400 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.401+0000 7fc6eea079c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:10.401 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.405+0000 7fc6eea079c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:29:10.401 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.405+0000 7fc6eea079c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:10.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.405+0000 7fc5a2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:10.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.409+0000 7fc6eea079c0 20 remove_watcher() i=0 2024-09-14T11:29:10.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.409+0000 7fc6eea079c0 2 removed watcher, disabling cache 2024-09-14T11:29:10.410 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.413+0000 7fc6eea079c0 20 remove_watcher() i=1 2024-09-14T11:29:10.412 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.413+0000 7fc6eea079c0 20 remove_watcher() i=2 2024-09-14T11:29:10.414 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.417+0000 7fc6eea079c0 20 remove_watcher() i=3 2024-09-14T11:29:10.416 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.417+0000 7fc6eea079c0 20 remove_watcher() i=4 2024-09-14T11:29:10.419 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.421+0000 7fc6eea079c0 20 remove_watcher() i=5 2024-09-14T11:29:10.422 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.425+0000 7fc6eea079c0 20 remove_watcher() i=6 2024-09-14T11:29:10.424 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:10.425+0000 7fc6eea079c0 20 remove_watcher() i=7 2024-09-14T11:29:10.439 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:10.439 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:29:10.439 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: error-at-init-index id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.21 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:29:10.439 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:10.556 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: reshard bucket with abort at init_index 2024-09-14T11:29:10.556 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:10.953 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:29:10.986 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:10.986 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:11.033 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.037+0000 7f4f458739c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.036 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.037+0000 7f4f458739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.036 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.037+0000 7f4f458739c0 20 realm 2024-09-14T11:29:11.036 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.037+0000 7f4f458739c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.041+0000 7f4f458739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.041+0000 7f4f458739c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:11.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.041+0000 7f4f458739c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.041+0000 7f4f458739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.041+0000 7f4f458739c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.041+0000 7f4f458739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:11.038 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.041+0000 7f4f458739c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.039 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.041+0000 7f4f458739c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:11.039 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.041+0000 7f4f458739c0 20 searching for the correct realm 2024-09-14T11:29:11.042 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.045+0000 7f4f43b7a640 0 -- 172.21.15.71:0/2318932243 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f4f2c04b060 msgr2=0x7f4f2c0688b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:11.050 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.053+0000 7f4f42b78640 0 -- 172.21.15.71:0/2318932243 >> [v2:172.21.15.157:6800/3420822707,v1:172.21.15.157:6801/3420822707] conn(0x7f4f2c017070 msgr2=0x7f4f2c0086b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:11.058 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.061+0000 7f4f458739c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:11.058 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.061+0000 7f4f458739c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:29:11.058 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.061+0000 7f4f458739c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:11.058 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.061+0000 7f4f458739c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:29:11.058 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.061+0000 7f4f458739c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:11.058 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.061+0000 7f4f458739c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:11.058 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.061+0000 7f4f458739c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.059 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.061+0000 7f4f458739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.059 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.061+0000 7f4f458739c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.059 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.061+0000 7f4f458739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:11.059 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.061+0000 7f4f458739c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.060 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.061+0000 7f4f458739c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:11.060 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.061+0000 7f4f458739c0 20 zone default found 2024-09-14T11:29:11.060 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.061+0000 7f4f458739c0 4 Realm: () 2024-09-14T11:29:11.060 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.061+0000 7f4f458739c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:29:11.060 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.061+0000 7f4f458739c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:29:11.060 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.061+0000 7f4f458739c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:11.060 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.061+0000 7f4f458739c0 20 zonegroup default 2024-09-14T11:29:11.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.061+0000 7f4f458739c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.061+0000 7f4f458739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.061+0000 7f4f458739c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.065+0000 7f4f458739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.065+0000 7f4f458739c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.065+0000 7f4f458739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.065+0000 7f4f458739c0 20 started sync module instance, tier type = 2024-09-14T11:29:11.062 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.065+0000 7f4f458739c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:29:11.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.081+0000 7f4f458739c0 20 add_watcher() i=0 2024-09-14T11:29:11.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.081+0000 7f4f458739c0 20 add_watcher() i=1 2024-09-14T11:29:11.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.081+0000 7f4f458739c0 20 add_watcher() i=2 2024-09-14T11:29:11.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.081+0000 7f4f458739c0 20 add_watcher() i=3 2024-09-14T11:29:11.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.081+0000 7f4f458739c0 20 add_watcher() i=4 2024-09-14T11:29:11.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.081+0000 7f4f458739c0 20 add_watcher() i=5 2024-09-14T11:29:11.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.081+0000 7f4f458739c0 20 add_watcher() i=6 2024-09-14T11:29:11.081 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.085+0000 7f4f458739c0 20 add_watcher() i=7 2024-09-14T11:29:11.081 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.085+0000 7f4f458739c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:11.085 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.089+0000 7f4df9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:11.085 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.089+0000 7f4f458739c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:11.086 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.089+0000 7f4f458739c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:11.086 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.089+0000 7f4f458739c0 5 note: GC not initialized 2024-09-14T11:29:11.086 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.089+0000 7f4df8fe1640 20 reqs_thread_entry: start 2024-09-14T11:29:11.086 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.089+0000 7f4f458739c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:11.087 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.089+0000 7f4f458739c0 20 Filter name: none 2024-09-14T11:29:11.087 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.089+0000 7f4d727fc640 20 reqs_thread_entry: start 2024-09-14T11:29:11.087 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.089+0000 7f4f458739c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.087 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.089+0000 7f4f458739c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:29:11.087 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.089+0000 7f4f458739c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.088 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.089+0000 7f4f458739c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:29:11.088 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.089+0000 7f4f458739c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:11.088 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.089+0000 7f4f458739c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.089 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.093+0000 7f4f458739c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:29:11.089 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.093+0000 7f4f458739c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.089 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.093+0000 7f4f458739c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:29:11.090 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.093+0000 7f4f458739c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:11.092 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.097+0000 7f4df9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:11.097 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.101+0000 7f4f458739c0 20 remove_watcher() i=0 2024-09-14T11:29:11.097 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.101+0000 7f4f458739c0 2 removed watcher, disabling cache 2024-09-14T11:29:11.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.101+0000 7f4f458739c0 20 remove_watcher() i=1 2024-09-14T11:29:11.101 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.105+0000 7f4f458739c0 20 remove_watcher() i=2 2024-09-14T11:29:11.103 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.105+0000 7f4f458739c0 20 remove_watcher() i=3 2024-09-14T11:29:11.105 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.109+0000 7f4f458739c0 20 remove_watcher() i=4 2024-09-14T11:29:11.107 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.109+0000 7f4f458739c0 20 remove_watcher() i=5 2024-09-14T11:29:11.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.113+0000 7f4f458739c0 20 remove_watcher() i=6 2024-09-14T11:29:11.112 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.117+0000 7f4f458739c0 20 remove_watcher() i=7 2024-09-14T11:29:11.127 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.127 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:29:11.127 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: abort-at-init-indext id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:29:11.128 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.128 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-14T11:29:11.160 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:11.161 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:11.205 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.209+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.208 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.209+0000 7f95a9df19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.208 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.209+0000 7f95a9df19c0 20 realm 2024-09-14T11:29:11.208 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.209+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.209 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.209+0000 7f95a9df19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.209 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.209+0000 7f95a9df19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:11.209 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.209+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.209 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.213+0000 7f95a9df19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.209 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.213+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.209 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.213+0000 7f95a9df19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:11.210 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.213+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.210 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.213+0000 7f95a9df19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:11.211 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.213+0000 7f95a9df19c0 20 searching for the correct realm 2024-09-14T11:29:11.212 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.213+0000 7f95a78f7640 0 -- 172.21.15.71:0/2796809309 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x5570fac9ee70 msgr2=0x5570faca1330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:11.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.221+0000 7f95a78f7640 0 -- 172.21.15.71:0/2796809309 >> [v2:172.21.15.157:6808/527702018,v1:172.21.15.157:6809/527702018] conn(0x7f95980ff610 msgr2=0x7f9598119040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:11.229 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:11.229 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:29:11.229 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:11.229 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:29:11.229 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:11.230 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:11.230 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.230 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.230 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.230 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:11.231 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.231 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:11.232 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 zone default found 2024-09-14T11:29:11.232 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.233+0000 7f95a9df19c0 4 Realm: () 2024-09-14T11:29:11.232 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.233+0000 7f95a9df19c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:29:11.232 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.233+0000 7f95a9df19c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:29:11.232 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.233+0000 7f95a9df19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:11.232 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 zonegroup default 2024-09-14T11:29:11.232 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.232 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.232 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.232 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.232 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.233 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.233 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 started sync module instance, tier type = 2024-09-14T11:29:11.233 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:29:11.251 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.253+0000 7f95a9df19c0 20 add_watcher() i=0 2024-09-14T11:29:11.251 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.253+0000 7f95a9df19c0 20 add_watcher() i=1 2024-09-14T11:29:11.251 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.253+0000 7f95a9df19c0 20 add_watcher() i=2 2024-09-14T11:29:11.251 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.253+0000 7f95a9df19c0 20 add_watcher() i=3 2024-09-14T11:29:11.251 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.253+0000 7f95a9df19c0 20 add_watcher() i=4 2024-09-14T11:29:11.251 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.253+0000 7f95a9df19c0 20 add_watcher() i=5 2024-09-14T11:29:11.251 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.253+0000 7f95a9df19c0 20 add_watcher() i=6 2024-09-14T11:29:11.253 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.257+0000 7f95a9df19c0 20 add_watcher() i=7 2024-09-14T11:29:11.253 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.257+0000 7f95a9df19c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:11.257 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.261+0000 7f945dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:11.257 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.261+0000 7f95a9df19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:11.257 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.261+0000 7f95a9df19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:11.257 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 note: GC not initialized 2024-09-14T11:29:11.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.261+0000 7f945cfe1640 20 reqs_thread_entry: start 2024-09-14T11:29:11.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.261+0000 7f95a9df19c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:11.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.261+0000 7f95a9df19c0 20 Filter name: none 2024-09-14T11:29:11.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.261+0000 7f93d67fc640 20 reqs_thread_entry: start 2024-09-14T11:29:11.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.261+0000 7f95a9df19c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:29:11.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.261+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.259 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.261+0000 7f95a9df19c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:29:11.259 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.261+0000 7f95a9df19c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:29:11.259 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.261+0000 7f95a9df19c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:29:11.259 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.261+0000 7f95a9df19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 : miss 2024-09-14T11:29:11.259 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.261+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.259 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.261+0000 7f95a9df19c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:29:11.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.261+0000 7f95a9df19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 info.flags=0x17 2024-09-14T11:29:11.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.261+0000 7f95a9df19c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 to cache LRU end 2024-09-14T11:29:11.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.261+0000 7f95a9df19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:29:11.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.261+0000 7f95a9df19c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:11.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.261+0000 7f95a9df19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 2024-09-14T11:29:11.261 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f95a9df19c0 time 2024-09-14T11:29:11.267254+0000 2024-09-14T11:29:11.261 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:29:11.263 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:29:11.263 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f95ad6cb2eb] 2024-09-14T11:29:11.263 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f95ad6cb49f] 2024-09-14T11:29:11.263 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5570f7a71c01] 2024-09-14T11:29:11.263 INFO:tasks.workunit.client.0.smithi071.stderr: 4: radosgw-admin(+0x14226e2) [0x5570f84cf6e2] 2024-09-14T11:29:11.263 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5570f7a86ecd] 2024-09-14T11:29:11.263 INFO:tasks.workunit.client.0.smithi071.stderr: 6: main() 2024-09-14T11:29:11.263 INFO:tasks.workunit.client.0.smithi071.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f95ac531d90] 2024-09-14T11:29:11.264 INFO:tasks.workunit.client.0.smithi071.stderr: 8: __libc_start_main() 2024-09-14T11:29:11.264 INFO:tasks.workunit.client.0.smithi071.stderr: 9: _start() 2024-09-14T11:29:11.264 INFO:tasks.workunit.client.0.smithi071.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:29:11.264 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f95a9df19c0 thread_name:radosgw-admin 2024-09-14T11:29:11.264 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.265+0000 7f95a9df19c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f95a9df19c0 time 2024-09-14T11:29:11.267254+0000 2024-09-14T11:29:11.264 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:29:11.264 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.264 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:29:11.264 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f95ad6cb2eb] 2024-09-14T11:29:11.264 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f95ad6cb49f] 2024-09-14T11:29:11.264 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5570f7a71c01] 2024-09-14T11:29:11.264 INFO:tasks.workunit.client.0.smithi071.stderr: 4: radosgw-admin(+0x14226e2) [0x5570f84cf6e2] 2024-09-14T11:29:11.265 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5570f7a86ecd] 2024-09-14T11:29:11.265 INFO:tasks.workunit.client.0.smithi071.stderr: 6: main() 2024-09-14T11:29:11.265 INFO:tasks.workunit.client.0.smithi071.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f95ac531d90] 2024-09-14T11:29:11.265 INFO:tasks.workunit.client.0.smithi071.stderr: 8: __libc_start_main() 2024-09-14T11:29:11.265 INFO:tasks.workunit.client.0.smithi071.stderr: 9: _start() 2024-09-14T11:29:11.265 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.284 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:29:11.284 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f95ac54a520] 2024-09-14T11:29:11.284 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:29:11.284 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:29:11.284 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:29:11.284 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f95ad6cb345] 2024-09-14T11:29:11.284 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f95ad6cb49f] 2024-09-14T11:29:11.285 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5570f7a71c01] 2024-09-14T11:29:11.285 INFO:tasks.workunit.client.0.smithi071.stderr: 8: radosgw-admin(+0x14226e2) [0x5570f84cf6e2] 2024-09-14T11:29:11.285 INFO:tasks.workunit.client.0.smithi071.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5570f7a86ecd] 2024-09-14T11:29:11.285 INFO:tasks.workunit.client.0.smithi071.stderr: 10: main() 2024-09-14T11:29:11.285 INFO:tasks.workunit.client.0.smithi071.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f95ac531d90] 2024-09-14T11:29:11.285 INFO:tasks.workunit.client.0.smithi071.stderr: 12: __libc_start_main() 2024-09-14T11:29:11.285 INFO:tasks.workunit.client.0.smithi071.stderr: 13: _start() 2024-09-14T11:29:11.285 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.265+0000 7f95a9df19c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:29:11.285 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f95a9df19c0 thread_name:radosgw-admin 2024-09-14T11:29:11.285 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.285 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:29:11.285 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f95ac54a520] 2024-09-14T11:29:11.285 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:29:11.286 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:29:11.286 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:29:11.286 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f95ad6cb345] 2024-09-14T11:29:11.286 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f95ad6cb49f] 2024-09-14T11:29:11.286 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5570f7a71c01] 2024-09-14T11:29:11.286 INFO:tasks.workunit.client.0.smithi071.stderr: 8: radosgw-admin(+0x14226e2) [0x5570f84cf6e2] 2024-09-14T11:29:11.286 INFO:tasks.workunit.client.0.smithi071.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5570f7a86ecd] 2024-09-14T11:29:11.286 INFO:tasks.workunit.client.0.smithi071.stderr: 10: main() 2024-09-14T11:29:11.286 INFO:tasks.workunit.client.0.smithi071.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f95ac531d90] 2024-09-14T11:29:11.286 INFO:tasks.workunit.client.0.smithi071.stderr: 12: __libc_start_main() 2024-09-14T11:29:11.286 INFO:tasks.workunit.client.0.smithi071.stderr: 13: _start() 2024-09-14T11:29:11.287 INFO:tasks.workunit.client.0.smithi071.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:29:11.287 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.287 INFO:tasks.workunit.client.0.smithi071.stderr:--- begin dump of recent events --- 2024-09-14T11:29:11.287 INFO:tasks.workunit.client.0.smithi071.stderr: -499> 2024-09-14T11:29:11.185+0000 7f95a78f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:11.287 INFO:tasks.workunit.client.0.smithi071.stderr: -498> 2024-09-14T11:29:11.185+0000 7f95a78f7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:11.287 INFO:tasks.workunit.client.0.smithi071.stderr: -497> 2024-09-14T11:29:11.185+0000 7f95a70f6640 10 monclient(hunting): handle_auth_done global_id 6312 payload 274 2024-09-14T11:29:11.287 INFO:tasks.workunit.client.0.smithi071.stderr: -496> 2024-09-14T11:29:11.185+0000 7f95a70f6640 10 monclient: _finish_hunting 0 2024-09-14T11:29:11.287 INFO:tasks.workunit.client.0.smithi071.stderr: -495> 2024-09-14T11:29:11.185+0000 7f95a70f6640 1 monclient: found mon.noname-a 2024-09-14T11:29:11.287 INFO:tasks.workunit.client.0.smithi071.stderr: -494> 2024-09-14T11:29:11.185+0000 7f95a70f6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:29:11.287 INFO:tasks.workunit.client.0.smithi071.stderr: -493> 2024-09-14T11:29:11.185+0000 7f9495e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:11.287 INFO:tasks.workunit.client.0.smithi071.stderr: -492> 2024-09-14T11:29:11.185+0000 7f9495e0b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:29:11.287 INFO:tasks.workunit.client.0.smithi071.stderr: -491> 2024-09-14T11:29:11.185+0000 7f9495e0b640 10 monclient: dump: 2024-09-14T11:29:11.287 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:11.288 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:11.288 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.288 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.288 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:11.288 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:11.288 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:11.288 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:11.288 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:11.288 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.288 INFO:tasks.workunit.client.0.smithi071.stderr: -490> 2024-09-14T11:29:11.185+0000 7f9495e0b640 10 monclient: _finish_auth 0 2024-09-14T11:29:11.288 INFO:tasks.workunit.client.0.smithi071.stderr: -489> 2024-09-14T11:29:11.185+0000 7f9495e0b640 10 monclient: _check_auth_tickets 2024-09-14T11:29:11.288 INFO:tasks.workunit.client.0.smithi071.stderr: -488> 2024-09-14T11:29:11.185+0000 7f9495e0b640 10 monclient: handle_config config(0 keys) 2024-09-14T11:29:11.288 INFO:tasks.workunit.client.0.smithi071.stderr: -487> 2024-09-14T11:29:11.185+0000 7f9495e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:11.289 INFO:tasks.workunit.client.0.smithi071.stderr: -486> 2024-09-14T11:29:11.185+0000 7f9495e0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:29:11.289 INFO:tasks.workunit.client.0.smithi071.stderr: -485> 2024-09-14T11:29:11.185+0000 7f9495e0b640 10 monclient: dump: 2024-09-14T11:29:11.289 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:11.289 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:11.289 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.289 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.289 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:11.289 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:11.289 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:11.289 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:11.289 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:11.289 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.289 INFO:tasks.workunit.client.0.smithi071.stderr: -484> 2024-09-14T11:29:11.185+0000 7f95a9df19c0 5 monclient: authenticate success, global_id 6312 2024-09-14T11:29:11.290 INFO:tasks.workunit.client.0.smithi071.stderr: -483> 2024-09-14T11:29:11.185+0000 7f95a9df19c0 10 monclient: get_monmap_and_config success 2024-09-14T11:29:11.290 INFO:tasks.workunit.client.0.smithi071.stderr: -482> 2024-09-14T11:29:11.185+0000 7f95a9df19c0 4 set_mon_vals no callback set 2024-09-14T11:29:11.290 INFO:tasks.workunit.client.0.smithi071.stderr: -481> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 10 monclient: shutdown 2024-09-14T11:29:11.290 INFO:tasks.workunit.client.0.smithi071.stderr: -480> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 asok(0x5570fa99ad90) unregister_commands rotate-key 2024-09-14T11:29:11.290 INFO:tasks.workunit.client.0.smithi071.stderr: -479> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 10 monclient: build_initial_monmap 2024-09-14T11:29:11.290 INFO:tasks.workunit.client.0.smithi071.stderr: -478> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 1 build_initial for_mkfs: 0 2024-09-14T11:29:11.290 INFO:tasks.workunit.client.0.smithi071.stderr: -477> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 10 monclient: monmap: 2024-09-14T11:29:11.290 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:29:11.290 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:29:11.290 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:29:11.290 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:29:11.290 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:29:11.290 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:11.291 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:29:11.291 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:29:11.291 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:29:11.291 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.291 INFO:tasks.workunit.client.0.smithi071.stderr: -476> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabcdc50) adding auth protocol: cephx 2024-09-14T11:29:11.291 INFO:tasks.workunit.client.0.smithi071.stderr: -475> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabcdc50) adding auth protocol: cephx 2024-09-14T11:29:11.291 INFO:tasks.workunit.client.0.smithi071.stderr: -474> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabcdc50) adding auth protocol: cephx 2024-09-14T11:29:11.291 INFO:tasks.workunit.client.0.smithi071.stderr: -473> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabcdc50) adding con mode: secure 2024-09-14T11:29:11.291 INFO:tasks.workunit.client.0.smithi071.stderr: -472> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabcdc50) adding con mode: crc 2024-09-14T11:29:11.291 INFO:tasks.workunit.client.0.smithi071.stderr: -471> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabcdc50) adding con mode: secure 2024-09-14T11:29:11.291 INFO:tasks.workunit.client.0.smithi071.stderr: -470> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabcdc50) adding con mode: crc 2024-09-14T11:29:11.291 INFO:tasks.workunit.client.0.smithi071.stderr: -469> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabcdc50) adding con mode: secure 2024-09-14T11:29:11.291 INFO:tasks.workunit.client.0.smithi071.stderr: -468> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabcdc50) adding con mode: crc 2024-09-14T11:29:11.292 INFO:tasks.workunit.client.0.smithi071.stderr: -467> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabcdc50) adding con mode: crc 2024-09-14T11:29:11.292 INFO:tasks.workunit.client.0.smithi071.stderr: -466> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabcdc50) adding con mode: secure 2024-09-14T11:29:11.292 INFO:tasks.workunit.client.0.smithi071.stderr: -465> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabcdc50) adding con mode: crc 2024-09-14T11:29:11.292 INFO:tasks.workunit.client.0.smithi071.stderr: -464> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabcdc50) adding con mode: secure 2024-09-14T11:29:11.292 INFO:tasks.workunit.client.0.smithi071.stderr: -463> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabcdc50) adding con mode: crc 2024-09-14T11:29:11.292 INFO:tasks.workunit.client.0.smithi071.stderr: -462> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabcdc50) adding con mode: secure 2024-09-14T11:29:11.292 INFO:tasks.workunit.client.0.smithi071.stderr: -461> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:11.292 INFO:tasks.workunit.client.0.smithi071.stderr: -460> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 1 librados: starting msgr at 2024-09-14T11:29:11.292 INFO:tasks.workunit.client.0.smithi071.stderr: -459> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 1 librados: starting objecter 2024-09-14T11:29:11.292 INFO:tasks.workunit.client.0.smithi071.stderr: -458> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 asok(0x5570fa99ad90) register_command objecter_requests hook 0x5570fabd59a0 2024-09-14T11:29:11.292 INFO:tasks.workunit.client.0.smithi071.stderr: -457> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 1 librados: setting wanted keys 2024-09-14T11:29:11.292 INFO:tasks.workunit.client.0.smithi071.stderr: -456> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 1 librados: calling monclient init 2024-09-14T11:29:11.293 INFO:tasks.workunit.client.0.smithi071.stderr: -455> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 10 monclient: init 2024-09-14T11:29:11.293 INFO:tasks.workunit.client.0.smithi071.stderr: -454> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570faba4250) adding auth protocol: cephx 2024-09-14T11:29:11.293 INFO:tasks.workunit.client.0.smithi071.stderr: -453> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570faba4250) adding auth protocol: cephx 2024-09-14T11:29:11.293 INFO:tasks.workunit.client.0.smithi071.stderr: -452> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570faba4250) adding auth protocol: cephx 2024-09-14T11:29:11.293 INFO:tasks.workunit.client.0.smithi071.stderr: -451> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570faba4250) adding con mode: secure 2024-09-14T11:29:11.293 INFO:tasks.workunit.client.0.smithi071.stderr: -450> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570faba4250) adding con mode: crc 2024-09-14T11:29:11.293 INFO:tasks.workunit.client.0.smithi071.stderr: -449> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570faba4250) adding con mode: secure 2024-09-14T11:29:11.293 INFO:tasks.workunit.client.0.smithi071.stderr: -448> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570faba4250) adding con mode: crc 2024-09-14T11:29:11.293 INFO:tasks.workunit.client.0.smithi071.stderr: -447> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570faba4250) adding con mode: secure 2024-09-14T11:29:11.293 INFO:tasks.workunit.client.0.smithi071.stderr: -446> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570faba4250) adding con mode: crc 2024-09-14T11:29:11.293 INFO:tasks.workunit.client.0.smithi071.stderr: -445> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570faba4250) adding con mode: crc 2024-09-14T11:29:11.293 INFO:tasks.workunit.client.0.smithi071.stderr: -444> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570faba4250) adding con mode: secure 2024-09-14T11:29:11.294 INFO:tasks.workunit.client.0.smithi071.stderr: -443> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570faba4250) adding con mode: crc 2024-09-14T11:29:11.294 INFO:tasks.workunit.client.0.smithi071.stderr: -442> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570faba4250) adding con mode: secure 2024-09-14T11:29:11.294 INFO:tasks.workunit.client.0.smithi071.stderr: -441> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570faba4250) adding con mode: crc 2024-09-14T11:29:11.294 INFO:tasks.workunit.client.0.smithi071.stderr: -440> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570faba4250) adding con mode: secure 2024-09-14T11:29:11.294 INFO:tasks.workunit.client.0.smithi071.stderr: -439> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:11.294 INFO:tasks.workunit.client.0.smithi071.stderr: -438> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:11.294 INFO:tasks.workunit.client.0.smithi071.stderr: -437> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 asok(0x5570fa99ad90) register_command rotate-key hook 0x5570faba4398 2024-09-14T11:29:11.294 INFO:tasks.workunit.client.0.smithi071.stderr: -436> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 10 monclient: _reopen_session rank -1 2024-09-14T11:29:11.294 INFO:tasks.workunit.client.0.smithi071.stderr: -435> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:29:11.294 INFO:tasks.workunit.client.0.smithi071.stderr: -434> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 10 monclient(hunting): picked mon.noname-b con 0x5570fabaa8e0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:29:11.294 INFO:tasks.workunit.client.0.smithi071.stderr: -433> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 10 monclient(hunting): picked mon.noname-c con 0x5570fabcd7a0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:29:11.294 INFO:tasks.workunit.client.0.smithi071.stderr: -432> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 10 monclient(hunting): picked mon.noname-a con 0x7f9590002410 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:29:11.294 INFO:tasks.workunit.client.0.smithi071.stderr: -431> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:11.295 INFO:tasks.workunit.client.0.smithi071.stderr: -430> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:11.295 INFO:tasks.workunit.client.0.smithi071.stderr: -429> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:11.295 INFO:tasks.workunit.client.0.smithi071.stderr: -428> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 10 monclient(hunting): _renew_subs 2024-09-14T11:29:11.295 INFO:tasks.workunit.client.0.smithi071.stderr: -427> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 10 monclient(hunting): authenticate will time out at 2163.309978s 2024-09-14T11:29:11.295 INFO:tasks.workunit.client.0.smithi071.stderr: -426> 2024-09-14T11:29:11.189+0000 7f95a80f8640 10 monclient(hunting): get_auth_request con 0x7f9590002410 auth_method 0 2024-09-14T11:29:11.295 INFO:tasks.workunit.client.0.smithi071.stderr: -425> 2024-09-14T11:29:11.189+0000 7f95a80f8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:11.295 INFO:tasks.workunit.client.0.smithi071.stderr: -424> 2024-09-14T11:29:11.189+0000 7f95a80f8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:11.295 INFO:tasks.workunit.client.0.smithi071.stderr: -423> 2024-09-14T11:29:11.189+0000 7f95a80f8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:11.295 INFO:tasks.workunit.client.0.smithi071.stderr: -422> 2024-09-14T11:29:11.189+0000 7f95a70f6640 10 monclient(hunting): get_auth_request con 0x5570fabcd7a0 auth_method 0 2024-09-14T11:29:11.295 INFO:tasks.workunit.client.0.smithi071.stderr: -421> 2024-09-14T11:29:11.189+0000 7f95a70f6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:11.295 INFO:tasks.workunit.client.0.smithi071.stderr: -420> 2024-09-14T11:29:11.189+0000 7f95a70f6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:11.295 INFO:tasks.workunit.client.0.smithi071.stderr: -419> 2024-09-14T11:29:11.189+0000 7f95a70f6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:11.295 INFO:tasks.workunit.client.0.smithi071.stderr: -418> 2024-09-14T11:29:11.189+0000 7f95a80f8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:11.296 INFO:tasks.workunit.client.0.smithi071.stderr: -417> 2024-09-14T11:29:11.189+0000 7f95a80f8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:11.296 INFO:tasks.workunit.client.0.smithi071.stderr: -416> 2024-09-14T11:29:11.189+0000 7f95a80f8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:11.296 INFO:tasks.workunit.client.0.smithi071.stderr: -415> 2024-09-14T11:29:11.189+0000 7f95a70f6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:11.296 INFO:tasks.workunit.client.0.smithi071.stderr: -414> 2024-09-14T11:29:11.189+0000 7f95a70f6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:11.296 INFO:tasks.workunit.client.0.smithi071.stderr: -413> 2024-09-14T11:29:11.189+0000 7f95a70f6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:11.296 INFO:tasks.workunit.client.0.smithi071.stderr: -412> 2024-09-14T11:29:11.189+0000 7f95a78f7640 10 monclient(hunting): get_auth_request con 0x5570fabaa8e0 auth_method 0 2024-09-14T11:29:11.296 INFO:tasks.workunit.client.0.smithi071.stderr: -411> 2024-09-14T11:29:11.189+0000 7f95a78f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:11.296 INFO:tasks.workunit.client.0.smithi071.stderr: -410> 2024-09-14T11:29:11.189+0000 7f95a78f7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:11.296 INFO:tasks.workunit.client.0.smithi071.stderr: -409> 2024-09-14T11:29:11.189+0000 7f95a78f7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:11.296 INFO:tasks.workunit.client.0.smithi071.stderr: -408> 2024-09-14T11:29:11.189+0000 7f95a70f6640 10 monclient(hunting): handle_auth_done global_id 6035 payload 824 2024-09-14T11:29:11.296 INFO:tasks.workunit.client.0.smithi071.stderr: -407> 2024-09-14T11:29:11.189+0000 7f95a70f6640 10 monclient: _finish_hunting 0 2024-09-14T11:29:11.297 INFO:tasks.workunit.client.0.smithi071.stderr: -406> 2024-09-14T11:29:11.189+0000 7f95a70f6640 1 monclient: found mon.noname-c 2024-09-14T11:29:11.297 INFO:tasks.workunit.client.0.smithi071.stderr: -405> 2024-09-14T11:29:11.189+0000 7f95a70f6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:29:11.297 INFO:tasks.workunit.client.0.smithi071.stderr: -404> 2024-09-14T11:29:11.189+0000 7f948ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:11.297 INFO:tasks.workunit.client.0.smithi071.stderr: -403> 2024-09-14T11:29:11.189+0000 7f948ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:29:11.297 INFO:tasks.workunit.client.0.smithi071.stderr: -402> 2024-09-14T11:29:11.189+0000 7f948ffff640 10 monclient: dump: 2024-09-14T11:29:11.297 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:11.297 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:11.297 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.297 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.297 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:11.297 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:11.297 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:11.297 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:11.297 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:11.298 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.298 INFO:tasks.workunit.client.0.smithi071.stderr: -401> 2024-09-14T11:29:11.189+0000 7f948ffff640 10 monclient: _finish_auth 0 2024-09-14T11:29:11.298 INFO:tasks.workunit.client.0.smithi071.stderr: -400> 2024-09-14T11:29:11.189+0000 7f948ffff640 10 monclient: _check_auth_tickets 2024-09-14T11:29:11.298 INFO:tasks.workunit.client.0.smithi071.stderr: -399> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 monclient: authenticate success, global_id 6035 2024-09-14T11:29:11.298 INFO:tasks.workunit.client.0.smithi071.stderr: -398> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 10 monclient: _renew_subs 2024-09-14T11:29:11.298 INFO:tasks.workunit.client.0.smithi071.stderr: -397> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:29:11.298 INFO:tasks.workunit.client.0.smithi071.stderr: -396> 2024-09-14T11:29:11.189+0000 7f948ffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:29:11.298 INFO:tasks.workunit.client.0.smithi071.stderr: -395> 2024-09-14T11:29:11.189+0000 7f948ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:11.298 INFO:tasks.workunit.client.0.smithi071.stderr: -394> 2024-09-14T11:29:11.189+0000 7f948ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:29:11.298 INFO:tasks.workunit.client.0.smithi071.stderr: -393> 2024-09-14T11:29:11.189+0000 7f948ffff640 10 monclient: dump: 2024-09-14T11:29:11.298 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:11.298 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:11.298 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.298 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.299 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:11.299 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:11.299 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:11.299 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:11.299 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:11.299 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.299 INFO:tasks.workunit.client.0.smithi071.stderr: -392> 2024-09-14T11:29:11.189+0000 7f9495e0b640 4 set_mon_vals no callback set 2024-09-14T11:29:11.299 INFO:tasks.workunit.client.0.smithi071.stderr: -391> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 10 monclient: _renew_subs 2024-09-14T11:29:11.299 INFO:tasks.workunit.client.0.smithi071.stderr: -390> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:29:11.299 INFO:tasks.workunit.client.0.smithi071.stderr: -389> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 1 librados: init done 2024-09-14T11:29:11.299 INFO:tasks.workunit.client.0.smithi071.stderr: -388> 2024-09-14T11:29:11.193+0000 7f948ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:29:11.299 INFO:tasks.workunit.client.0.smithi071.stderr: -387> 2024-09-14T11:29:11.193+0000 7f948ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:29:11.299 INFO:tasks.workunit.client.0.smithi071.stderr: -386> 2024-09-14T11:29:11.193+0000 7f948ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:29:11.299 INFO:tasks.workunit.client.0.smithi071.stderr: -385> 2024-09-14T11:29:11.193+0000 7f95a78f7640 10 monclient: get_auth_request con 0x7f94900718d0 auth_method 0 2024-09-14T11:29:11.300 INFO:tasks.workunit.client.0.smithi071.stderr: -384> 2024-09-14T11:29:11.193+0000 7f95a80f8640 10 monclient: get_auth_request con 0x5570fabcc5d0 auth_method 0 2024-09-14T11:29:11.300 INFO:tasks.workunit.client.0.smithi071.stderr: -383> 2024-09-14T11:29:11.193+0000 7f95a78f7640 10 monclient: get_auth_request con 0x5570fabf17b0 auth_method 0 2024-09-14T11:29:11.300 INFO:tasks.workunit.client.0.smithi071.stderr: -382> 2024-09-14T11:29:11.193+0000 7f95a70f6640 10 monclient: get_auth_request con 0x5570fabf5b10 auth_method 0 2024-09-14T11:29:11.300 INFO:tasks.workunit.client.0.smithi071.stderr: -381> 2024-09-14T11:29:11.197+0000 7f95a80f8640 10 monclient: get_auth_request con 0x5570fabf5030 auth_method 0 2024-09-14T11:29:11.300 INFO:tasks.workunit.client.0.smithi071.stderr: -380> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 10 monclient: build_initial_monmap 2024-09-14T11:29:11.300 INFO:tasks.workunit.client.0.smithi071.stderr: -379> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 1 build_initial for_mkfs: 0 2024-09-14T11:29:11.300 INFO:tasks.workunit.client.0.smithi071.stderr: -378> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 10 monclient: monmap: 2024-09-14T11:29:11.300 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:29:11.300 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:29:11.300 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:29:11.300 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:29:11.300 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:29:11.300 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:11.300 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:29:11.301 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:29:11.301 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:29:11.301 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.301 INFO:tasks.workunit.client.0.smithi071.stderr: -377> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfdc00) adding auth protocol: cephx 2024-09-14T11:29:11.301 INFO:tasks.workunit.client.0.smithi071.stderr: -376> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfdc00) adding auth protocol: cephx 2024-09-14T11:29:11.301 INFO:tasks.workunit.client.0.smithi071.stderr: -375> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfdc00) adding auth protocol: cephx 2024-09-14T11:29:11.301 INFO:tasks.workunit.client.0.smithi071.stderr: -374> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfdc00) adding con mode: secure 2024-09-14T11:29:11.301 INFO:tasks.workunit.client.0.smithi071.stderr: -373> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfdc00) adding con mode: crc 2024-09-14T11:29:11.301 INFO:tasks.workunit.client.0.smithi071.stderr: -372> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfdc00) adding con mode: secure 2024-09-14T11:29:11.301 INFO:tasks.workunit.client.0.smithi071.stderr: -371> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfdc00) adding con mode: crc 2024-09-14T11:29:11.301 INFO:tasks.workunit.client.0.smithi071.stderr: -370> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfdc00) adding con mode: secure 2024-09-14T11:29:11.301 INFO:tasks.workunit.client.0.smithi071.stderr: -369> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfdc00) adding con mode: crc 2024-09-14T11:29:11.301 INFO:tasks.workunit.client.0.smithi071.stderr: -368> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfdc00) adding con mode: crc 2024-09-14T11:29:11.302 INFO:tasks.workunit.client.0.smithi071.stderr: -367> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfdc00) adding con mode: secure 2024-09-14T11:29:11.302 INFO:tasks.workunit.client.0.smithi071.stderr: -366> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfdc00) adding con mode: crc 2024-09-14T11:29:11.302 INFO:tasks.workunit.client.0.smithi071.stderr: -365> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfdc00) adding con mode: secure 2024-09-14T11:29:11.302 INFO:tasks.workunit.client.0.smithi071.stderr: -364> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfdc00) adding con mode: crc 2024-09-14T11:29:11.302 INFO:tasks.workunit.client.0.smithi071.stderr: -363> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfdc00) adding con mode: secure 2024-09-14T11:29:11.302 INFO:tasks.workunit.client.0.smithi071.stderr: -362> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:11.302 INFO:tasks.workunit.client.0.smithi071.stderr: -361> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 asok(0x5570fa99ad90) register_command objecter_requests cmddesc objecter_requests hook 0x5570fac015f0 EEXIST 2024-09-14T11:29:11.302 INFO:tasks.workunit.client.0.smithi071.stderr: -360> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 10 monclient: init 2024-09-14T11:29:11.302 INFO:tasks.workunit.client.0.smithi071.stderr: -359> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfcaf8) adding auth protocol: cephx 2024-09-14T11:29:11.302 INFO:tasks.workunit.client.0.smithi071.stderr: -358> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfcaf8) adding auth protocol: cephx 2024-09-14T11:29:11.302 INFO:tasks.workunit.client.0.smithi071.stderr: -357> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfcaf8) adding auth protocol: cephx 2024-09-14T11:29:11.302 INFO:tasks.workunit.client.0.smithi071.stderr: -356> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfcaf8) adding con mode: secure 2024-09-14T11:29:11.302 INFO:tasks.workunit.client.0.smithi071.stderr: -355> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfcaf8) adding con mode: crc 2024-09-14T11:29:11.302 INFO:tasks.workunit.client.0.smithi071.stderr: -354> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfcaf8) adding con mode: secure 2024-09-14T11:29:11.303 INFO:tasks.workunit.client.0.smithi071.stderr: -353> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfcaf8) adding con mode: crc 2024-09-14T11:29:11.303 INFO:tasks.workunit.client.0.smithi071.stderr: -352> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfcaf8) adding con mode: secure 2024-09-14T11:29:11.303 INFO:tasks.workunit.client.0.smithi071.stderr: -351> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfcaf8) adding con mode: crc 2024-09-14T11:29:11.303 INFO:tasks.workunit.client.0.smithi071.stderr: -350> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfcaf8) adding con mode: crc 2024-09-14T11:29:11.303 INFO:tasks.workunit.client.0.smithi071.stderr: -349> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfcaf8) adding con mode: secure 2024-09-14T11:29:11.303 INFO:tasks.workunit.client.0.smithi071.stderr: -348> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfcaf8) adding con mode: crc 2024-09-14T11:29:11.303 INFO:tasks.workunit.client.0.smithi071.stderr: -347> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfcaf8) adding con mode: secure 2024-09-14T11:29:11.303 INFO:tasks.workunit.client.0.smithi071.stderr: -346> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfcaf8) adding con mode: crc 2024-09-14T11:29:11.303 INFO:tasks.workunit.client.0.smithi071.stderr: -345> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfcaf8) adding con mode: secure 2024-09-14T11:29:11.303 INFO:tasks.workunit.client.0.smithi071.stderr: -344> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:11.303 INFO:tasks.workunit.client.0.smithi071.stderr: -343> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:11.303 INFO:tasks.workunit.client.0.smithi071.stderr: -342> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 asok(0x5570fa99ad90) register_command rotate-key cmddesc rotate-key hook 0x5570fabfcc40 EEXIST 2024-09-14T11:29:11.303 INFO:tasks.workunit.client.0.smithi071.stderr: -341> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 10 monclient: _reopen_session rank -1 2024-09-14T11:29:11.303 INFO:tasks.workunit.client.0.smithi071.stderr: -340> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:29:11.303 INFO:tasks.workunit.client.0.smithi071.stderr: -339> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 10 monclient(hunting): picked mon.noname-b con 0x5570fac257a0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:29:11.304 INFO:tasks.workunit.client.0.smithi071.stderr: -338> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 10 monclient(hunting): picked mon.noname-a con 0x5570fac250d0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:29:11.304 INFO:tasks.workunit.client.0.smithi071.stderr: -337> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 10 monclient(hunting): picked mon.noname-c con 0x5570fac23ab0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:29:11.304 INFO:tasks.workunit.client.0.smithi071.stderr: -336> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:11.304 INFO:tasks.workunit.client.0.smithi071.stderr: -335> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:11.304 INFO:tasks.workunit.client.0.smithi071.stderr: -334> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:11.304 INFO:tasks.workunit.client.0.smithi071.stderr: -333> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 10 monclient(hunting): _renew_subs 2024-09-14T11:29:11.304 INFO:tasks.workunit.client.0.smithi071.stderr: -332> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 10 monclient(hunting): authenticate will time out at 2163.319793s 2024-09-14T11:29:11.304 INFO:tasks.workunit.client.0.smithi071.stderr: -331> 2024-09-14T11:29:11.197+0000 7f95a78f7640 10 monclient(hunting): get_auth_request con 0x5570fac23ab0 auth_method 0 2024-09-14T11:29:11.304 INFO:tasks.workunit.client.0.smithi071.stderr: -330> 2024-09-14T11:29:11.197+0000 7f95a78f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:11.304 INFO:tasks.workunit.client.0.smithi071.stderr: -329> 2024-09-14T11:29:11.197+0000 7f95a78f7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:11.304 INFO:tasks.workunit.client.0.smithi071.stderr: -328> 2024-09-14T11:29:11.197+0000 7f95a78f7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:11.304 INFO:tasks.workunit.client.0.smithi071.stderr: -327> 2024-09-14T11:29:11.197+0000 7f95a80f8640 10 monclient(hunting): get_auth_request con 0x5570fac250d0 auth_method 0 2024-09-14T11:29:11.304 INFO:tasks.workunit.client.0.smithi071.stderr: -326> 2024-09-14T11:29:11.197+0000 7f95a80f8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:11.304 INFO:tasks.workunit.client.0.smithi071.stderr: -325> 2024-09-14T11:29:11.197+0000 7f95a80f8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:11.305 INFO:tasks.workunit.client.0.smithi071.stderr: -324> 2024-09-14T11:29:11.197+0000 7f95a80f8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:11.305 INFO:tasks.workunit.client.0.smithi071.stderr: -323> 2024-09-14T11:29:11.201+0000 7f95a78f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:11.305 INFO:tasks.workunit.client.0.smithi071.stderr: -322> 2024-09-14T11:29:11.201+0000 7f95a78f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:11.305 INFO:tasks.workunit.client.0.smithi071.stderr: -321> 2024-09-14T11:29:11.201+0000 7f95a78f7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:11.305 INFO:tasks.workunit.client.0.smithi071.stderr: -320> 2024-09-14T11:29:11.201+0000 7f95a80f8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:11.305 INFO:tasks.workunit.client.0.smithi071.stderr: -319> 2024-09-14T11:29:11.201+0000 7f95a80f8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:11.305 INFO:tasks.workunit.client.0.smithi071.stderr: -318> 2024-09-14T11:29:11.201+0000 7f95a80f8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:11.305 INFO:tasks.workunit.client.0.smithi071.stderr: -317> 2024-09-14T11:29:11.201+0000 7f95a70f6640 10 monclient(hunting): get_auth_request con 0x5570fac257a0 auth_method 0 2024-09-14T11:29:11.305 INFO:tasks.workunit.client.0.smithi071.stderr: -316> 2024-09-14T11:29:11.201+0000 7f95a70f6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:11.305 INFO:tasks.workunit.client.0.smithi071.stderr: -315> 2024-09-14T11:29:11.201+0000 7f95a70f6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:11.305 INFO:tasks.workunit.client.0.smithi071.stderr: -314> 2024-09-14T11:29:11.201+0000 7f95a70f6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:11.305 INFO:tasks.workunit.client.0.smithi071.stderr: -313> 2024-09-14T11:29:11.201+0000 7f95a78f7640 10 monclient(hunting): handle_auth_done global_id 6038 payload 824 2024-09-14T11:29:11.305 INFO:tasks.workunit.client.0.smithi071.stderr: -312> 2024-09-14T11:29:11.201+0000 7f95a78f7640 10 monclient: _finish_hunting 0 2024-09-14T11:29:11.305 INFO:tasks.workunit.client.0.smithi071.stderr: -311> 2024-09-14T11:29:11.201+0000 7f95a78f7640 1 monclient: found mon.noname-c 2024-09-14T11:29:11.306 INFO:tasks.workunit.client.0.smithi071.stderr: -310> 2024-09-14T11:29:11.201+0000 7f95a78f7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:29:11.306 INFO:tasks.workunit.client.0.smithi071.stderr: -309> 2024-09-14T11:29:11.201+0000 7f948d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:11.306 INFO:tasks.workunit.client.0.smithi071.stderr: -308> 2024-09-14T11:29:11.201+0000 7f948d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:29:11.306 INFO:tasks.workunit.client.0.smithi071.stderr: -307> 2024-09-14T11:29:11.201+0000 7f948d7fa640 10 monclient: dump: 2024-09-14T11:29:11.306 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:11.306 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:11.306 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.306 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.306 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:11.306 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:11.306 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:11.306 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:11.306 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:11.306 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.307 INFO:tasks.workunit.client.0.smithi071.stderr: -306> 2024-09-14T11:29:11.201+0000 7f948d7fa640 10 monclient: _finish_auth 0 2024-09-14T11:29:11.307 INFO:tasks.workunit.client.0.smithi071.stderr: -305> 2024-09-14T11:29:11.201+0000 7f948d7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:29:11.307 INFO:tasks.workunit.client.0.smithi071.stderr: -304> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 monclient: authenticate success, global_id 6038 2024-09-14T11:29:11.307 INFO:tasks.workunit.client.0.smithi071.stderr: -303> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 10 monclient: _renew_subs 2024-09-14T11:29:11.307 INFO:tasks.workunit.client.0.smithi071.stderr: -302> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:29:11.307 INFO:tasks.workunit.client.0.smithi071.stderr: -301> 2024-09-14T11:29:11.201+0000 7f948d7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:29:11.307 INFO:tasks.workunit.client.0.smithi071.stderr: -300> 2024-09-14T11:29:11.201+0000 7f948d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:11.307 INFO:tasks.workunit.client.0.smithi071.stderr: -299> 2024-09-14T11:29:11.201+0000 7f948d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:29:11.307 INFO:tasks.workunit.client.0.smithi071.stderr: -298> 2024-09-14T11:29:11.201+0000 7f948d7fa640 10 monclient: dump: 2024-09-14T11:29:11.307 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:11.307 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:11.307 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.307 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.307 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:11.307 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:11.308 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:11.308 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:11.308 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:11.308 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.308 INFO:tasks.workunit.client.0.smithi071.stderr: -297> 2024-09-14T11:29:11.201+0000 7f95a88f9640 4 set_mon_vals no callback set 2024-09-14T11:29:11.308 INFO:tasks.workunit.client.0.smithi071.stderr: -296> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 10 monclient: _renew_subs 2024-09-14T11:29:11.308 INFO:tasks.workunit.client.0.smithi071.stderr: -295> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:29:11.308 INFO:tasks.workunit.client.0.smithi071.stderr: -294> 2024-09-14T11:29:11.201+0000 7f948d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:29:11.308 INFO:tasks.workunit.client.0.smithi071.stderr: -293> 2024-09-14T11:29:11.201+0000 7f948d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:29:11.308 INFO:tasks.workunit.client.0.smithi071.stderr: -292> 2024-09-14T11:29:11.201+0000 7f948d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:29:11.308 INFO:tasks.workunit.client.0.smithi071.stderr: -291> 2024-09-14T11:29:11.201+0000 7f95a70f6640 10 monclient: get_auth_request con 0x7f94800717e0 auth_method 0 2024-09-14T11:29:11.308 INFO:tasks.workunit.client.0.smithi071.stderr: -290> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 10 monclient: get_monmap_and_config 2024-09-14T11:29:11.309 INFO:tasks.workunit.client.0.smithi071.stderr: -289> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 10 monclient: build_initial_monmap 2024-09-14T11:29:11.309 INFO:tasks.workunit.client.0.smithi071.stderr: -288> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 1 build_initial for_mkfs: 0 2024-09-14T11:29:11.309 INFO:tasks.workunit.client.0.smithi071.stderr: -287> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 10 monclient: monmap: 2024-09-14T11:29:11.309 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:29:11.309 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:29:11.309 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:29:11.309 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:29:11.309 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:29:11.309 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:11.309 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:29:11.309 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:29:11.309 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:29:11.309 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.309 INFO:tasks.workunit.client.0.smithi071.stderr: -286> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac45180) adding auth protocol: cephx 2024-09-14T11:29:11.309 INFO:tasks.workunit.client.0.smithi071.stderr: -285> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac45180) adding auth protocol: cephx 2024-09-14T11:29:11.310 INFO:tasks.workunit.client.0.smithi071.stderr: -284> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac45180) adding auth protocol: cephx 2024-09-14T11:29:11.310 INFO:tasks.workunit.client.0.smithi071.stderr: -283> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac45180) adding con mode: secure 2024-09-14T11:29:11.310 INFO:tasks.workunit.client.0.smithi071.stderr: -282> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac45180) adding con mode: crc 2024-09-14T11:29:11.310 INFO:tasks.workunit.client.0.smithi071.stderr: -281> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac45180) adding con mode: secure 2024-09-14T11:29:11.310 INFO:tasks.workunit.client.0.smithi071.stderr: -280> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac45180) adding con mode: crc 2024-09-14T11:29:11.310 INFO:tasks.workunit.client.0.smithi071.stderr: -279> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac45180) adding con mode: secure 2024-09-14T11:29:11.310 INFO:tasks.workunit.client.0.smithi071.stderr: -278> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac45180) adding con mode: crc 2024-09-14T11:29:11.310 INFO:tasks.workunit.client.0.smithi071.stderr: -277> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac45180) adding con mode: crc 2024-09-14T11:29:11.310 INFO:tasks.workunit.client.0.smithi071.stderr: -276> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac45180) adding con mode: secure 2024-09-14T11:29:11.310 INFO:tasks.workunit.client.0.smithi071.stderr: -275> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac45180) adding con mode: crc 2024-09-14T11:29:11.310 INFO:tasks.workunit.client.0.smithi071.stderr: -274> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac45180) adding con mode: secure 2024-09-14T11:29:11.310 INFO:tasks.workunit.client.0.smithi071.stderr: -273> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac45180) adding con mode: crc 2024-09-14T11:29:11.310 INFO:tasks.workunit.client.0.smithi071.stderr: -272> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac45180) adding con mode: secure 2024-09-14T11:29:11.310 INFO:tasks.workunit.client.0.smithi071.stderr: -271> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:11.311 INFO:tasks.workunit.client.0.smithi071.stderr: -270> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 10 monclient: init 2024-09-14T11:29:11.311 INFO:tasks.workunit.client.0.smithi071.stderr: -269> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd110719d0) adding auth protocol: cephx 2024-09-14T11:29:11.311 INFO:tasks.workunit.client.0.smithi071.stderr: -268> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd110719d0) adding auth protocol: cephx 2024-09-14T11:29:11.311 INFO:tasks.workunit.client.0.smithi071.stderr: -267> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd110719d0) adding auth protocol: cephx 2024-09-14T11:29:11.311 INFO:tasks.workunit.client.0.smithi071.stderr: -266> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd110719d0) adding con mode: secure 2024-09-14T11:29:11.311 INFO:tasks.workunit.client.0.smithi071.stderr: -265> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd110719d0) adding con mode: crc 2024-09-14T11:29:11.311 INFO:tasks.workunit.client.0.smithi071.stderr: -264> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd110719d0) adding con mode: secure 2024-09-14T11:29:11.311 INFO:tasks.workunit.client.0.smithi071.stderr: -263> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd110719d0) adding con mode: crc 2024-09-14T11:29:11.311 INFO:tasks.workunit.client.0.smithi071.stderr: -262> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd110719d0) adding con mode: secure 2024-09-14T11:29:11.311 INFO:tasks.workunit.client.0.smithi071.stderr: -261> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd110719d0) adding con mode: crc 2024-09-14T11:29:11.311 INFO:tasks.workunit.client.0.smithi071.stderr: -260> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd110719d0) adding con mode: crc 2024-09-14T11:29:11.311 INFO:tasks.workunit.client.0.smithi071.stderr: -259> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd110719d0) adding con mode: secure 2024-09-14T11:29:11.311 INFO:tasks.workunit.client.0.smithi071.stderr: -258> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd110719d0) adding con mode: crc 2024-09-14T11:29:11.311 INFO:tasks.workunit.client.0.smithi071.stderr: -257> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd110719d0) adding con mode: secure 2024-09-14T11:29:11.312 INFO:tasks.workunit.client.0.smithi071.stderr: -256> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd110719d0) adding con mode: crc 2024-09-14T11:29:11.312 INFO:tasks.workunit.client.0.smithi071.stderr: -255> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd110719d0) adding con mode: secure 2024-09-14T11:29:11.312 INFO:tasks.workunit.client.0.smithi071.stderr: -254> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:11.312 INFO:tasks.workunit.client.0.smithi071.stderr: -253> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:11.312 INFO:tasks.workunit.client.0.smithi071.stderr: -252> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 asok(0x5570fa99ad90) register_command rotate-key cmddesc rotate-key hook 0x7ffd11071b18 EEXIST 2024-09-14T11:29:11.312 INFO:tasks.workunit.client.0.smithi071.stderr: -251> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 10 monclient: _reopen_session rank -1 2024-09-14T11:29:11.312 INFO:tasks.workunit.client.0.smithi071.stderr: -250> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:29:11.312 INFO:tasks.workunit.client.0.smithi071.stderr: -249> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 10 monclient(hunting): picked mon.noname-a con 0x5570fac79810 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:29:11.312 INFO:tasks.workunit.client.0.smithi071.stderr: -248> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 10 monclient(hunting): picked mon.noname-b con 0x5570fac49230 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:29:11.312 INFO:tasks.workunit.client.0.smithi071.stderr: -247> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 10 monclient(hunting): picked mon.noname-c con 0x5570fac74fe0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:29:11.312 INFO:tasks.workunit.client.0.smithi071.stderr: -246> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:11.312 INFO:tasks.workunit.client.0.smithi071.stderr: -245> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:11.312 INFO:tasks.workunit.client.0.smithi071.stderr: -244> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:11.313 INFO:tasks.workunit.client.0.smithi071.stderr: -243> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 10 monclient(hunting): _renew_subs 2024-09-14T11:29:11.313 INFO:tasks.workunit.client.0.smithi071.stderr: -242> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 10 monclient(hunting): authenticate will time out at 2163.323982s 2024-09-14T11:29:11.313 INFO:tasks.workunit.client.0.smithi071.stderr: -241> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient(hunting): get_auth_request con 0x5570fac79810 auth_method 0 2024-09-14T11:29:11.313 INFO:tasks.workunit.client.0.smithi071.stderr: -240> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:11.313 INFO:tasks.workunit.client.0.smithi071.stderr: -239> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:11.313 INFO:tasks.workunit.client.0.smithi071.stderr: -238> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:11.313 INFO:tasks.workunit.client.0.smithi071.stderr: -237> 2024-09-14T11:29:11.205+0000 7f95a78f7640 10 monclient(hunting): get_auth_request con 0x5570fac74fe0 auth_method 0 2024-09-14T11:29:11.313 INFO:tasks.workunit.client.0.smithi071.stderr: -236> 2024-09-14T11:29:11.205+0000 7f95a78f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:11.313 INFO:tasks.workunit.client.0.smithi071.stderr: -235> 2024-09-14T11:29:11.205+0000 7f95a78f7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:11.313 INFO:tasks.workunit.client.0.smithi071.stderr: -234> 2024-09-14T11:29:11.205+0000 7f95a78f7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:11.313 INFO:tasks.workunit.client.0.smithi071.stderr: -233> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:11.313 INFO:tasks.workunit.client.0.smithi071.stderr: -232> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:11.313 INFO:tasks.workunit.client.0.smithi071.stderr: -231> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:11.313 INFO:tasks.workunit.client.0.smithi071.stderr: -230> 2024-09-14T11:29:11.205+0000 7f95a78f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:11.314 INFO:tasks.workunit.client.0.smithi071.stderr: -229> 2024-09-14T11:29:11.205+0000 7f95a78f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:11.314 INFO:tasks.workunit.client.0.smithi071.stderr: -228> 2024-09-14T11:29:11.205+0000 7f95a78f7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:11.314 INFO:tasks.workunit.client.0.smithi071.stderr: -227> 2024-09-14T11:29:11.205+0000 7f95a80f8640 10 monclient(hunting): get_auth_request con 0x5570fac49230 auth_method 0 2024-09-14T11:29:11.314 INFO:tasks.workunit.client.0.smithi071.stderr: -226> 2024-09-14T11:29:11.205+0000 7f95a80f8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:11.314 INFO:tasks.workunit.client.0.smithi071.stderr: -225> 2024-09-14T11:29:11.205+0000 7f95a80f8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:11.314 INFO:tasks.workunit.client.0.smithi071.stderr: -224> 2024-09-14T11:29:11.205+0000 7f95a80f8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:11.314 INFO:tasks.workunit.client.0.smithi071.stderr: -223> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient(hunting): handle_auth_done global_id 6321 payload 274 2024-09-14T11:29:11.314 INFO:tasks.workunit.client.0.smithi071.stderr: -222> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient: _finish_hunting 0 2024-09-14T11:29:11.314 INFO:tasks.workunit.client.0.smithi071.stderr: -221> 2024-09-14T11:29:11.205+0000 7f95a70f6640 1 monclient: found mon.noname-a 2024-09-14T11:29:11.314 INFO:tasks.workunit.client.0.smithi071.stderr: -220> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:29:11.314 INFO:tasks.workunit.client.0.smithi071.stderr: -219> 2024-09-14T11:29:11.205+0000 7f9486ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:11.314 INFO:tasks.workunit.client.0.smithi071.stderr: -218> 2024-09-14T11:29:11.205+0000 7f9486ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:29:11.315 INFO:tasks.workunit.client.0.smithi071.stderr: -217> 2024-09-14T11:29:11.205+0000 7f9486ffd640 10 monclient: dump: 2024-09-14T11:29:11.315 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:11.315 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:11.315 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.315 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.315 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:11.315 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:11.315 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:11.315 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:11.315 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:11.315 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.315 INFO:tasks.workunit.client.0.smithi071.stderr: -216> 2024-09-14T11:29:11.205+0000 7f9486ffd640 10 monclient: _finish_auth 0 2024-09-14T11:29:11.315 INFO:tasks.workunit.client.0.smithi071.stderr: -215> 2024-09-14T11:29:11.205+0000 7f9486ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:29:11.315 INFO:tasks.workunit.client.0.smithi071.stderr: -214> 2024-09-14T11:29:11.205+0000 7f9486ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:29:11.315 INFO:tasks.workunit.client.0.smithi071.stderr: -213> 2024-09-14T11:29:11.205+0000 7f9486ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:11.316 INFO:tasks.workunit.client.0.smithi071.stderr: -212> 2024-09-14T11:29:11.205+0000 7f9486ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:29:11.316 INFO:tasks.workunit.client.0.smithi071.stderr: -211> 2024-09-14T11:29:11.205+0000 7f9486ffd640 10 monclient: dump: 2024-09-14T11:29:11.316 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:11.316 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:11.316 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.316 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.316 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:11.316 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:11.316 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:11.316 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:11.316 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:11.316 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.317 INFO:tasks.workunit.client.0.smithi071.stderr: -210> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 monclient: authenticate success, global_id 6321 2024-09-14T11:29:11.317 INFO:tasks.workunit.client.0.smithi071.stderr: -209> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient: get_monmap_and_config success 2024-09-14T11:29:11.317 INFO:tasks.workunit.client.0.smithi071.stderr: -208> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 4 set_mon_vals no callback set 2024-09-14T11:29:11.317 INFO:tasks.workunit.client.0.smithi071.stderr: -207> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient: shutdown 2024-09-14T11:29:11.317 INFO:tasks.workunit.client.0.smithi071.stderr: -206> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient: build_initial_monmap 2024-09-14T11:29:11.317 INFO:tasks.workunit.client.0.smithi071.stderr: -205> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 1 build_initial for_mkfs: 0 2024-09-14T11:29:11.317 INFO:tasks.workunit.client.0.smithi071.stderr: -204> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient: monmap: 2024-09-14T11:29:11.317 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:29:11.317 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:29:11.317 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:29:11.317 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:29:11.317 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:29:11.317 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:11.318 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:29:11.318 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:29:11.318 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:29:11.318 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.318 INFO:tasks.workunit.client.0.smithi071.stderr: -203> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac6a230) adding auth protocol: cephx 2024-09-14T11:29:11.318 INFO:tasks.workunit.client.0.smithi071.stderr: -202> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac6a230) adding auth protocol: cephx 2024-09-14T11:29:11.318 INFO:tasks.workunit.client.0.smithi071.stderr: -201> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac6a230) adding auth protocol: cephx 2024-09-14T11:29:11.318 INFO:tasks.workunit.client.0.smithi071.stderr: -200> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac6a230) adding con mode: secure 2024-09-14T11:29:11.318 INFO:tasks.workunit.client.0.smithi071.stderr: -199> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac6a230) adding con mode: crc 2024-09-14T11:29:11.318 INFO:tasks.workunit.client.0.smithi071.stderr: -198> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac6a230) adding con mode: secure 2024-09-14T11:29:11.318 INFO:tasks.workunit.client.0.smithi071.stderr: -197> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac6a230) adding con mode: crc 2024-09-14T11:29:11.318 INFO:tasks.workunit.client.0.smithi071.stderr: -196> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac6a230) adding con mode: secure 2024-09-14T11:29:11.318 INFO:tasks.workunit.client.0.smithi071.stderr: -195> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac6a230) adding con mode: crc 2024-09-14T11:29:11.318 INFO:tasks.workunit.client.0.smithi071.stderr: -194> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac6a230) adding con mode: crc 2024-09-14T11:29:11.319 INFO:tasks.workunit.client.0.smithi071.stderr: -193> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac6a230) adding con mode: secure 2024-09-14T11:29:11.319 INFO:tasks.workunit.client.0.smithi071.stderr: -192> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac6a230) adding con mode: crc 2024-09-14T11:29:11.319 INFO:tasks.workunit.client.0.smithi071.stderr: -191> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac6a230) adding con mode: secure 2024-09-14T11:29:11.319 INFO:tasks.workunit.client.0.smithi071.stderr: -190> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac6a230) adding con mode: crc 2024-09-14T11:29:11.319 INFO:tasks.workunit.client.0.smithi071.stderr: -189> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac6a230) adding con mode: secure 2024-09-14T11:29:11.319 INFO:tasks.workunit.client.0.smithi071.stderr: -188> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:11.319 INFO:tasks.workunit.client.0.smithi071.stderr: -187> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 1 librados: starting msgr at 2024-09-14T11:29:11.319 INFO:tasks.workunit.client.0.smithi071.stderr: -186> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 1 librados: starting objecter 2024-09-14T11:29:11.319 INFO:tasks.workunit.client.0.smithi071.stderr: -185> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 asok(0x5570fa99ad90) register_command objecter_requests cmddesc objecter_requests hook 0x5570fac738f0 EEXIST 2024-09-14T11:29:11.319 INFO:tasks.workunit.client.0.smithi071.stderr: -184> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 1 librados: setting wanted keys 2024-09-14T11:29:11.319 INFO:tasks.workunit.client.0.smithi071.stderr: -183> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 1 librados: calling monclient init 2024-09-14T11:29:11.319 INFO:tasks.workunit.client.0.smithi071.stderr: -182> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient: init 2024-09-14T11:29:11.319 INFO:tasks.workunit.client.0.smithi071.stderr: -181> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac275c0) adding auth protocol: cephx 2024-09-14T11:29:11.319 INFO:tasks.workunit.client.0.smithi071.stderr: -180> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac275c0) adding auth protocol: cephx 2024-09-14T11:29:11.320 INFO:tasks.workunit.client.0.smithi071.stderr: -179> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac275c0) adding auth protocol: cephx 2024-09-14T11:29:11.320 INFO:tasks.workunit.client.0.smithi071.stderr: -178> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac275c0) adding con mode: secure 2024-09-14T11:29:11.320 INFO:tasks.workunit.client.0.smithi071.stderr: -177> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac275c0) adding con mode: crc 2024-09-14T11:29:11.320 INFO:tasks.workunit.client.0.smithi071.stderr: -176> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac275c0) adding con mode: secure 2024-09-14T11:29:11.320 INFO:tasks.workunit.client.0.smithi071.stderr: -175> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac275c0) adding con mode: crc 2024-09-14T11:29:11.320 INFO:tasks.workunit.client.0.smithi071.stderr: -174> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac275c0) adding con mode: secure 2024-09-14T11:29:11.320 INFO:tasks.workunit.client.0.smithi071.stderr: -173> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac275c0) adding con mode: crc 2024-09-14T11:29:11.320 INFO:tasks.workunit.client.0.smithi071.stderr: -172> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac275c0) adding con mode: crc 2024-09-14T11:29:11.320 INFO:tasks.workunit.client.0.smithi071.stderr: -171> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac275c0) adding con mode: secure 2024-09-14T11:29:11.320 INFO:tasks.workunit.client.0.smithi071.stderr: -170> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac275c0) adding con mode: crc 2024-09-14T11:29:11.320 INFO:tasks.workunit.client.0.smithi071.stderr: -169> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac275c0) adding con mode: secure 2024-09-14T11:29:11.320 INFO:tasks.workunit.client.0.smithi071.stderr: -168> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac275c0) adding con mode: crc 2024-09-14T11:29:11.321 INFO:tasks.workunit.client.0.smithi071.stderr: -167> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac275c0) adding con mode: secure 2024-09-14T11:29:11.321 INFO:tasks.workunit.client.0.smithi071.stderr: -166> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:11.321 INFO:tasks.workunit.client.0.smithi071.stderr: -165> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:11.321 INFO:tasks.workunit.client.0.smithi071.stderr: -164> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 asok(0x5570fa99ad90) register_command rotate-key cmddesc rotate-key hook 0x5570fac27708 EEXIST 2024-09-14T11:29:11.321 INFO:tasks.workunit.client.0.smithi071.stderr: -163> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient: _reopen_session rank -1 2024-09-14T11:29:11.321 INFO:tasks.workunit.client.0.smithi071.stderr: -162> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:29:11.321 INFO:tasks.workunit.client.0.smithi071.stderr: -161> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient(hunting): picked mon.noname-a con 0x5570fac49230 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:29:11.321 INFO:tasks.workunit.client.0.smithi071.stderr: -160> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient(hunting): picked mon.noname-b con 0x5570fac74fe0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:29:11.321 INFO:tasks.workunit.client.0.smithi071.stderr: -159> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient(hunting): picked mon.noname-c con 0x5570fac79810 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:29:11.321 INFO:tasks.workunit.client.0.smithi071.stderr: -158> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:11.321 INFO:tasks.workunit.client.0.smithi071.stderr: -157> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:11.321 INFO:tasks.workunit.client.0.smithi071.stderr: -156> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:11.321 INFO:tasks.workunit.client.0.smithi071.stderr: -155> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient(hunting): _renew_subs 2024-09-14T11:29:11.322 INFO:tasks.workunit.client.0.smithi071.stderr: -154> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient(hunting): authenticate will time out at 2163.326547s 2024-09-14T11:29:11.322 INFO:tasks.workunit.client.0.smithi071.stderr: -153> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient(hunting): get_auth_request con 0x5570fac49230 auth_method 0 2024-09-14T11:29:11.322 INFO:tasks.workunit.client.0.smithi071.stderr: -152> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:11.322 INFO:tasks.workunit.client.0.smithi071.stderr: -151> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:11.322 INFO:tasks.workunit.client.0.smithi071.stderr: -150> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:11.322 INFO:tasks.workunit.client.0.smithi071.stderr: -149> 2024-09-14T11:29:11.205+0000 7f95a78f7640 10 monclient(hunting): get_auth_request con 0x5570fac79810 auth_method 0 2024-09-14T11:29:11.322 INFO:tasks.workunit.client.0.smithi071.stderr: -148> 2024-09-14T11:29:11.205+0000 7f95a78f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:11.322 INFO:tasks.workunit.client.0.smithi071.stderr: -147> 2024-09-14T11:29:11.205+0000 7f95a78f7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:11.322 INFO:tasks.workunit.client.0.smithi071.stderr: -146> 2024-09-14T11:29:11.205+0000 7f95a78f7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:11.322 INFO:tasks.workunit.client.0.smithi071.stderr: -145> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:11.322 INFO:tasks.workunit.client.0.smithi071.stderr: -144> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:11.322 INFO:tasks.workunit.client.0.smithi071.stderr: -143> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:11.322 INFO:tasks.workunit.client.0.smithi071.stderr: -142> 2024-09-14T11:29:11.205+0000 7f95a78f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:11.322 INFO:tasks.workunit.client.0.smithi071.stderr: -141> 2024-09-14T11:29:11.205+0000 7f95a78f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:11.322 INFO:tasks.workunit.client.0.smithi071.stderr: -140> 2024-09-14T11:29:11.205+0000 7f95a78f7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:11.323 INFO:tasks.workunit.client.0.smithi071.stderr: -139> 2024-09-14T11:29:11.205+0000 7f95a80f8640 10 monclient(hunting): get_auth_request con 0x5570fac74fe0 auth_method 0 2024-09-14T11:29:11.323 INFO:tasks.workunit.client.0.smithi071.stderr: -138> 2024-09-14T11:29:11.205+0000 7f95a80f8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:11.323 INFO:tasks.workunit.client.0.smithi071.stderr: -137> 2024-09-14T11:29:11.205+0000 7f95a80f8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:11.323 INFO:tasks.workunit.client.0.smithi071.stderr: -136> 2024-09-14T11:29:11.205+0000 7f95a80f8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:11.323 INFO:tasks.workunit.client.0.smithi071.stderr: -135> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient(hunting): handle_auth_done global_id 6324 payload 824 2024-09-14T11:29:11.323 INFO:tasks.workunit.client.0.smithi071.stderr: -134> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient: _finish_hunting 0 2024-09-14T11:29:11.323 INFO:tasks.workunit.client.0.smithi071.stderr: -133> 2024-09-14T11:29:11.205+0000 7f95a70f6640 1 monclient: found mon.noname-a 2024-09-14T11:29:11.323 INFO:tasks.workunit.client.0.smithi071.stderr: -132> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:29:11.323 INFO:tasks.workunit.client.0.smithi071.stderr: -131> 2024-09-14T11:29:11.205+0000 7f94857fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:11.323 INFO:tasks.workunit.client.0.smithi071.stderr: -130> 2024-09-14T11:29:11.205+0000 7f94857fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:29:11.323 INFO:tasks.workunit.client.0.smithi071.stderr: -129> 2024-09-14T11:29:11.205+0000 7f94857fa640 10 monclient: dump: 2024-09-14T11:29:11.323 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:11.323 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:11.323 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.324 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.324 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:11.324 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:11.324 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:11.324 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:11.324 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:11.324 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.324 INFO:tasks.workunit.client.0.smithi071.stderr: -128> 2024-09-14T11:29:11.205+0000 7f94857fa640 10 monclient: _finish_auth 0 2024-09-14T11:29:11.324 INFO:tasks.workunit.client.0.smithi071.stderr: -127> 2024-09-14T11:29:11.205+0000 7f94857fa640 10 monclient: _check_auth_tickets 2024-09-14T11:29:11.324 INFO:tasks.workunit.client.0.smithi071.stderr: -126> 2024-09-14T11:29:11.205+0000 7f94857fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:29:11.324 INFO:tasks.workunit.client.0.smithi071.stderr: -125> 2024-09-14T11:29:11.205+0000 7f94857fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:11.324 INFO:tasks.workunit.client.0.smithi071.stderr: -124> 2024-09-14T11:29:11.205+0000 7f94857fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:29:11.324 INFO:tasks.workunit.client.0.smithi071.stderr: -123> 2024-09-14T11:29:11.205+0000 7f94857fa640 10 monclient: dump: 2024-09-14T11:29:11.324 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:11.325 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:11.325 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.325 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.325 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:11.325 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:11.325 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:11.325 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:11.325 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:11.325 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.325 INFO:tasks.workunit.client.0.smithi071.stderr: -122> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 monclient: authenticate success, global_id 6324 2024-09-14T11:29:11.325 INFO:tasks.workunit.client.0.smithi071.stderr: -121> 2024-09-14T11:29:11.205+0000 7f9486ffd640 4 set_mon_vals no callback set 2024-09-14T11:29:11.325 INFO:tasks.workunit.client.0.smithi071.stderr: -120> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient: _renew_subs 2024-09-14T11:29:11.325 INFO:tasks.workunit.client.0.smithi071.stderr: -119> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:29:11.326 INFO:tasks.workunit.client.0.smithi071.stderr: -118> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient: _renew_subs 2024-09-14T11:29:11.326 INFO:tasks.workunit.client.0.smithi071.stderr: -117> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:29:11.326 INFO:tasks.workunit.client.0.smithi071.stderr: -116> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 1 librados: init done 2024-09-14T11:29:11.326 INFO:tasks.workunit.client.0.smithi071.stderr: -115> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 asok(0x5570fa99ad90) register_command cr dump hook 0x5570fac49938 2024-09-14T11:29:11.326 INFO:tasks.workunit.client.0.smithi071.stderr: -114> 2024-09-14T11:29:11.209+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.326 INFO:tasks.workunit.client.0.smithi071.stderr: -113> 2024-09-14T11:29:11.209+0000 7f94857fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:29:11.326 INFO:tasks.workunit.client.0.smithi071.stderr: -112> 2024-09-14T11:29:11.209+0000 7f94857fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:29:11.326 INFO:tasks.workunit.client.0.smithi071.stderr: -111> 2024-09-14T11:29:11.209+0000 7f94857fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:29:11.326 INFO:tasks.workunit.client.0.smithi071.stderr: -110> 2024-09-14T11:29:11.209+0000 7f95a80f8640 10 monclient: get_auth_request con 0x7f94700718a0 auth_method 0 2024-09-14T11:29:11.326 INFO:tasks.workunit.client.0.smithi071.stderr: -109> 2024-09-14T11:29:11.209+0000 7f95a78f7640 10 monclient: get_auth_request con 0x5570fac925e0 auth_method 0 2024-09-14T11:29:11.326 INFO:tasks.workunit.client.0.smithi071.stderr: -108> 2024-09-14T11:29:11.209+0000 7f95a9df19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.326 INFO:tasks.workunit.client.0.smithi071.stderr: -107> 2024-09-14T11:29:11.209+0000 7f95a9df19c0 20 realm 2024-09-14T11:29:11.326 INFO:tasks.workunit.client.0.smithi071.stderr: -106> 2024-09-14T11:29:11.209+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.326 INFO:tasks.workunit.client.0.smithi071.stderr: -105> 2024-09-14T11:29:11.209+0000 7f95a9df19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.327 INFO:tasks.workunit.client.0.smithi071.stderr: -104> 2024-09-14T11:29:11.209+0000 7f95a9df19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:11.327 INFO:tasks.workunit.client.0.smithi071.stderr: -103> 2024-09-14T11:29:11.209+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.327 INFO:tasks.workunit.client.0.smithi071.stderr: -102> 2024-09-14T11:29:11.213+0000 7f95a9df19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.327 INFO:tasks.workunit.client.0.smithi071.stderr: -101> 2024-09-14T11:29:11.213+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.327 INFO:tasks.workunit.client.0.smithi071.stderr: -100> 2024-09-14T11:29:11.213+0000 7f95a70f6640 10 monclient: get_auth_request con 0x5570fac96850 auth_method 0 2024-09-14T11:29:11.327 INFO:tasks.workunit.client.0.smithi071.stderr: -99> 2024-09-14T11:29:11.213+0000 7f95a9df19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:11.327 INFO:tasks.workunit.client.0.smithi071.stderr: -98> 2024-09-14T11:29:11.213+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.327 INFO:tasks.workunit.client.0.smithi071.stderr: -97> 2024-09-14T11:29:11.213+0000 7f95a80f8640 10 monclient: get_auth_request con 0x5570fac9a0b0 auth_method 0 2024-09-14T11:29:11.327 INFO:tasks.workunit.client.0.smithi071.stderr: -96> 2024-09-14T11:29:11.213+0000 7f95a9df19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:11.327 INFO:tasks.workunit.client.0.smithi071.stderr: -95> 2024-09-14T11:29:11.213+0000 7f95a9df19c0 20 searching for the correct realm 2024-09-14T11:29:11.327 INFO:tasks.workunit.client.0.smithi071.stderr: -94> 2024-09-14T11:29:11.213+0000 7f95a78f7640 10 monclient: get_auth_request con 0x5570fac9ee70 auth_method 0 2024-09-14T11:29:11.327 INFO:tasks.workunit.client.0.smithi071.stderr: -93> 2024-09-14T11:29:11.213+0000 7f95a78f7640 0 -- 172.21.15.71:0/2796809309 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x5570fac9ee70 msgr2=0x5570faca1330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:11.327 INFO:tasks.workunit.client.0.smithi071.stderr: -92> 2024-09-14T11:29:11.213+0000 7f94857fa640 1 client.6324.objecter ms_handle_reset 0x5570fac9ee70 session 0x5570fac9e7f0 osd.4 2024-09-14T11:29:11.327 INFO:tasks.workunit.client.0.smithi071.stderr: -91> 2024-09-14T11:29:11.213+0000 7f94857fa640 10 monclient: _renew_subs 2024-09-14T11:29:11.328 INFO:tasks.workunit.client.0.smithi071.stderr: -90> 2024-09-14T11:29:11.213+0000 7f94857fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:29:11.328 INFO:tasks.workunit.client.0.smithi071.stderr: -89> 2024-09-14T11:29:11.213+0000 7f95a70f6640 10 monclient: get_auth_request con 0x7f9598118040 auth_method 0 2024-09-14T11:29:11.328 INFO:tasks.workunit.client.0.smithi071.stderr: -88> 2024-09-14T11:29:11.217+0000 7f95a78f7640 10 monclient: get_auth_request con 0x7f94700813c0 auth_method 0 2024-09-14T11:29:11.328 INFO:tasks.workunit.client.0.smithi071.stderr: -87> 2024-09-14T11:29:11.217+0000 7f95a80f8640 10 monclient: get_auth_request con 0x7f959c0686b0 auth_method 0 2024-09-14T11:29:11.328 INFO:tasks.workunit.client.0.smithi071.stderr: -86> 2024-09-14T11:29:11.217+0000 7f95a78f7640 10 monclient: get_auth_request con 0x7f95980ff610 auth_method 0 2024-09-14T11:29:11.328 INFO:tasks.workunit.client.0.smithi071.stderr: -85> 2024-09-14T11:29:11.221+0000 7f95a78f7640 0 -- 172.21.15.71:0/2796809309 >> [v2:172.21.15.157:6808/527702018,v1:172.21.15.157:6809/527702018] conn(0x7f95980ff610 msgr2=0x7f9598119040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:11.328 INFO:tasks.workunit.client.0.smithi071.stderr: -84> 2024-09-14T11:29:11.221+0000 7f94857fa640 1 client.6324.objecter ms_handle_reset 0x7f95980ff610 session 0x7f95980b3040 osd.5 2024-09-14T11:29:11.328 INFO:tasks.workunit.client.0.smithi071.stderr: -83> 2024-09-14T11:29:11.221+0000 7f95a78f7640 10 monclient: get_auth_request con 0x5570fac9ee70 auth_method 0 2024-09-14T11:29:11.328 INFO:tasks.workunit.client.0.smithi071.stderr: -82> 2024-09-14T11:29:11.221+0000 7f95a70f6640 10 monclient: get_auth_request con 0x7f959c024b60 auth_method 0 2024-09-14T11:29:11.328 INFO:tasks.workunit.client.0.smithi071.stderr: -81> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:11.328 INFO:tasks.workunit.client.0.smithi071.stderr: -80> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:29:11.328 INFO:tasks.workunit.client.0.smithi071.stderr: -79> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:11.328 INFO:tasks.workunit.client.0.smithi071.stderr: -78> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:29:11.328 INFO:tasks.workunit.client.0.smithi071.stderr: -77> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:11.329 INFO:tasks.workunit.client.0.smithi071.stderr: -76> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:11.329 INFO:tasks.workunit.client.0.smithi071.stderr: -75> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.329 INFO:tasks.workunit.client.0.smithi071.stderr: -74> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.329 INFO:tasks.workunit.client.0.smithi071.stderr: -73> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.329 INFO:tasks.workunit.client.0.smithi071.stderr: -72> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:11.329 INFO:tasks.workunit.client.0.smithi071.stderr: -71> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.329 INFO:tasks.workunit.client.0.smithi071.stderr: -70> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:11.329 INFO:tasks.workunit.client.0.smithi071.stderr: -69> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 zone default found 2024-09-14T11:29:11.329 INFO:tasks.workunit.client.0.smithi071.stderr: -68> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 4 Realm: () 2024-09-14T11:29:11.329 INFO:tasks.workunit.client.0.smithi071.stderr: -67> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:29:11.329 INFO:tasks.workunit.client.0.smithi071.stderr: -66> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:29:11.329 INFO:tasks.workunit.client.0.smithi071.stderr: -65> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:11.329 INFO:tasks.workunit.client.0.smithi071.stderr: -64> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 zonegroup default 2024-09-14T11:29:11.329 INFO:tasks.workunit.client.0.smithi071.stderr: -63> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.329 INFO:tasks.workunit.client.0.smithi071.stderr: -62> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.330 INFO:tasks.workunit.client.0.smithi071.stderr: -61> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.330 INFO:tasks.workunit.client.0.smithi071.stderr: -60> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.330 INFO:tasks.workunit.client.0.smithi071.stderr: -59> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.330 INFO:tasks.workunit.client.0.smithi071.stderr: -58> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.330 INFO:tasks.workunit.client.0.smithi071.stderr: -57> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 started sync module instance, tier type = 2024-09-14T11:29:11.330 INFO:tasks.workunit.client.0.smithi071.stderr: -56> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:29:11.330 INFO:tasks.workunit.client.0.smithi071.stderr: -55> 2024-09-14T11:29:11.253+0000 7f95a9df19c0 20 add_watcher() i=0 2024-09-14T11:29:11.330 INFO:tasks.workunit.client.0.smithi071.stderr: -54> 2024-09-14T11:29:11.253+0000 7f95a9df19c0 20 add_watcher() i=1 2024-09-14T11:29:11.330 INFO:tasks.workunit.client.0.smithi071.stderr: -53> 2024-09-14T11:29:11.253+0000 7f95a9df19c0 20 add_watcher() i=2 2024-09-14T11:29:11.330 INFO:tasks.workunit.client.0.smithi071.stderr: -52> 2024-09-14T11:29:11.253+0000 7f95a9df19c0 20 add_watcher() i=3 2024-09-14T11:29:11.330 INFO:tasks.workunit.client.0.smithi071.stderr: -51> 2024-09-14T11:29:11.253+0000 7f95a9df19c0 20 add_watcher() i=4 2024-09-14T11:29:11.330 INFO:tasks.workunit.client.0.smithi071.stderr: -50> 2024-09-14T11:29:11.253+0000 7f95a9df19c0 20 add_watcher() i=5 2024-09-14T11:29:11.330 INFO:tasks.workunit.client.0.smithi071.stderr: -49> 2024-09-14T11:29:11.253+0000 7f95a9df19c0 20 add_watcher() i=6 2024-09-14T11:29:11.330 INFO:tasks.workunit.client.0.smithi071.stderr: -48> 2024-09-14T11:29:11.257+0000 7f95a9df19c0 20 add_watcher() i=7 2024-09-14T11:29:11.331 INFO:tasks.workunit.client.0.smithi071.stderr: -47> 2024-09-14T11:29:11.257+0000 7f95a9df19c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:11.331 INFO:tasks.workunit.client.0.smithi071.stderr: -46> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd11071eb0) adding auth protocol: cephx 2024-09-14T11:29:11.331 INFO:tasks.workunit.client.0.smithi071.stderr: -45> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd11071eb0) adding auth protocol: cephx 2024-09-14T11:29:11.331 INFO:tasks.workunit.client.0.smithi071.stderr: -44> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd11071eb0) adding auth protocol: cephx 2024-09-14T11:29:11.331 INFO:tasks.workunit.client.0.smithi071.stderr: -43> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd11071eb0) adding con mode: secure 2024-09-14T11:29:11.331 INFO:tasks.workunit.client.0.smithi071.stderr: -42> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd11071eb0) adding con mode: crc 2024-09-14T11:29:11.331 INFO:tasks.workunit.client.0.smithi071.stderr: -41> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd11071eb0) adding con mode: secure 2024-09-14T11:29:11.331 INFO:tasks.workunit.client.0.smithi071.stderr: -40> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd11071eb0) adding con mode: crc 2024-09-14T11:29:11.331 INFO:tasks.workunit.client.0.smithi071.stderr: -39> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd11071eb0) adding con mode: secure 2024-09-14T11:29:11.331 INFO:tasks.workunit.client.0.smithi071.stderr: -38> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd11071eb0) adding con mode: crc 2024-09-14T11:29:11.331 INFO:tasks.workunit.client.0.smithi071.stderr: -37> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd11071eb0) adding con mode: crc 2024-09-14T11:29:11.331 INFO:tasks.workunit.client.0.smithi071.stderr: -36> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd11071eb0) adding con mode: secure 2024-09-14T11:29:11.331 INFO:tasks.workunit.client.0.smithi071.stderr: -35> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd11071eb0) adding con mode: crc 2024-09-14T11:29:11.331 INFO:tasks.workunit.client.0.smithi071.stderr: -34> 2024-09-14T11:29:11.261+0000 7f945dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:11.332 INFO:tasks.workunit.client.0.smithi071.stderr: -33> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd11071eb0) adding con mode: secure 2024-09-14T11:29:11.332 INFO:tasks.workunit.client.0.smithi071.stderr: -32> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd11071eb0) adding con mode: crc 2024-09-14T11:29:11.332 INFO:tasks.workunit.client.0.smithi071.stderr: -31> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd11071eb0) adding con mode: secure 2024-09-14T11:29:11.332 INFO:tasks.workunit.client.0.smithi071.stderr: -30> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:11.332 INFO:tasks.workunit.client.0.smithi071.stderr: -29> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:11.332 INFO:tasks.workunit.client.0.smithi071.stderr: -28> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:11.332 INFO:tasks.workunit.client.0.smithi071.stderr: -27> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 asok(0x5570fa99ad90) register_command cache list hook 0x5570fac7f390 2024-09-14T11:29:11.332 INFO:tasks.workunit.client.0.smithi071.stderr: -26> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 asok(0x5570fa99ad90) register_command cache inspect hook 0x5570fac7f390 2024-09-14T11:29:11.332 INFO:tasks.workunit.client.0.smithi071.stderr: -25> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 asok(0x5570fa99ad90) register_command cache erase hook 0x5570fac7f390 2024-09-14T11:29:11.332 INFO:tasks.workunit.client.0.smithi071.stderr: -24> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 asok(0x5570fa99ad90) register_command cache zap hook 0x5570fac7f390 2024-09-14T11:29:11.332 INFO:tasks.workunit.client.0.smithi071.stderr: -23> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 note: GC not initialized 2024-09-14T11:29:11.332 INFO:tasks.workunit.client.0.smithi071.stderr: -22> 2024-09-14T11:29:11.261+0000 7f945cfe1640 20 reqs_thread_entry: start 2024-09-14T11:29:11.332 INFO:tasks.workunit.client.0.smithi071.stderr: -21> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 asok(0x5570fa99ad90) register_command sync trace show hook 0x7f959c001120 2024-09-14T11:29:11.333 INFO:tasks.workunit.client.0.smithi071.stderr: -20> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 asok(0x5570fa99ad90) register_command sync trace history hook 0x7f959c001120 2024-09-14T11:29:11.333 INFO:tasks.workunit.client.0.smithi071.stderr: -19> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 asok(0x5570fa99ad90) register_command sync trace active hook 0x7f959c001120 2024-09-14T11:29:11.333 INFO:tasks.workunit.client.0.smithi071.stderr: -18> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 asok(0x5570fa99ad90) register_command sync trace active_short hook 0x7f959c001120 2024-09-14T11:29:11.333 INFO:tasks.workunit.client.0.smithi071.stderr: -17> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:11.333 INFO:tasks.workunit.client.0.smithi071.stderr: -16> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 20 Filter name: none 2024-09-14T11:29:11.333 INFO:tasks.workunit.client.0.smithi071.stderr: -15> 2024-09-14T11:29:11.261+0000 7f93d67fc640 20 reqs_thread_entry: start 2024-09-14T11:29:11.333 INFO:tasks.workunit.client.0.smithi071.stderr: -14> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:29:11.333 INFO:tasks.workunit.client.0.smithi071.stderr: -13> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.333 INFO:tasks.workunit.client.0.smithi071.stderr: -12> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:29:11.333 INFO:tasks.workunit.client.0.smithi071.stderr: -11> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:29:11.333 INFO:tasks.workunit.client.0.smithi071.stderr: -10> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:29:11.333 INFO:tasks.workunit.client.0.smithi071.stderr: -9> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 : miss 2024-09-14T11:29:11.333 INFO:tasks.workunit.client.0.smithi071.stderr: -8> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.333 INFO:tasks.workunit.client.0.smithi071.stderr: -7> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:29:11.333 INFO:tasks.workunit.client.0.smithi071.stderr: -6> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 info.flags=0x17 2024-09-14T11:29:11.334 INFO:tasks.workunit.client.0.smithi071.stderr: -5> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 to cache LRU end 2024-09-14T11:29:11.334 INFO:tasks.workunit.client.0.smithi071.stderr: -4> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:29:11.334 INFO:tasks.workunit.client.0.smithi071.stderr: -3> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:11.334 INFO:tasks.workunit.client.0.smithi071.stderr: -2> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 2024-09-14T11:29:11.334 INFO:tasks.workunit.client.0.smithi071.stderr: -1> 2024-09-14T11:29:11.265+0000 7f95a9df19c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f95a9df19c0 time 2024-09-14T11:29:11.267254+0000 2024-09-14T11:29:11.334 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:29:11.334 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.334 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:29:11.334 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f95ad6cb2eb] 2024-09-14T11:29:11.334 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f95ad6cb49f] 2024-09-14T11:29:11.334 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5570f7a71c01] 2024-09-14T11:29:11.334 INFO:tasks.workunit.client.0.smithi071.stderr: 4: radosgw-admin(+0x14226e2) [0x5570f84cf6e2] 2024-09-14T11:29:11.334 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5570f7a86ecd] 2024-09-14T11:29:11.334 INFO:tasks.workunit.client.0.smithi071.stderr: 6: main() 2024-09-14T11:29:11.335 INFO:tasks.workunit.client.0.smithi071.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f95ac531d90] 2024-09-14T11:29:11.335 INFO:tasks.workunit.client.0.smithi071.stderr: 8: __libc_start_main() 2024-09-14T11:29:11.335 INFO:tasks.workunit.client.0.smithi071.stderr: 9: _start() 2024-09-14T11:29:11.335 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.335 INFO:tasks.workunit.client.0.smithi071.stderr: 0> 2024-09-14T11:29:11.265+0000 7f95a9df19c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:29:11.335 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f95a9df19c0 thread_name:radosgw-admin 2024-09-14T11:29:11.335 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.335 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:29:11.335 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f95ac54a520] 2024-09-14T11:29:11.335 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:29:11.335 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:29:11.335 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:29:11.335 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f95ad6cb345] 2024-09-14T11:29:11.335 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f95ad6cb49f] 2024-09-14T11:29:11.336 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5570f7a71c01] 2024-09-14T11:29:11.336 INFO:tasks.workunit.client.0.smithi071.stderr: 8: radosgw-admin(+0x14226e2) [0x5570f84cf6e2] 2024-09-14T11:29:11.336 INFO:tasks.workunit.client.0.smithi071.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5570f7a86ecd] 2024-09-14T11:29:11.336 INFO:tasks.workunit.client.0.smithi071.stderr: 10: main() 2024-09-14T11:29:11.336 INFO:tasks.workunit.client.0.smithi071.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f95ac531d90] 2024-09-14T11:29:11.336 INFO:tasks.workunit.client.0.smithi071.stderr: 12: __libc_start_main() 2024-09-14T11:29:11.336 INFO:tasks.workunit.client.0.smithi071.stderr: 13: _start() 2024-09-14T11:29:11.336 INFO:tasks.workunit.client.0.smithi071.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:29:11.336 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.336 INFO:tasks.workunit.client.0.smithi071.stderr:--- logging levels --- 2024-09-14T11:29:11.336 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 none 2024-09-14T11:29:11.336 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 lockdep 2024-09-14T11:29:11.336 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 context 2024-09-14T11:29:11.336 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 crush 2024-09-14T11:29:11.337 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds 2024-09-14T11:29:11.337 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_balancer 2024-09-14T11:29:11.337 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_locker 2024-09-14T11:29:11.337 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log 2024-09-14T11:29:11.337 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log_expire 2024-09-14T11:29:11.337 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_migrator 2024-09-14T11:29:11.337 INFO:tasks.workunit.client.0.smithi071.stderr: 3/ 5 mds_quiesce 2024-09-14T11:29:11.337 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 buffer 2024-09-14T11:29:11.337 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 timer 2024-09-14T11:29:11.337 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 filer 2024-09-14T11:29:11.337 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 striper 2024-09-14T11:29:11.337 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 objecter 2024-09-14T11:29:11.337 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rados 2024-09-14T11:29:11.337 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd 2024-09-14T11:29:11.337 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_mirror 2024-09-14T11:29:11.338 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_replay 2024-09-14T11:29:11.338 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_pwl 2024-09-14T11:29:11.338 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 journaler 2024-09-14T11:29:11.338 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objectcacher 2024-09-14T11:29:11.338 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:29:11.338 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 client 2024-09-14T11:29:11.338 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 osd 2024-09-14T11:29:11.338 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 optracker 2024-09-14T11:29:11.338 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objclass 2024-09-14T11:29:11.338 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 filestore 2024-09-14T11:29:11.338 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 journal 2024-09-14T11:29:11.338 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 ms 2024-09-14T11:29:11.338 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mon 2024-09-14T11:29:11.338 INFO:tasks.workunit.client.0.smithi071.stderr: 0/10 monc 2024-09-14T11:29:11.338 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 paxos 2024-09-14T11:29:11.339 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 tp 2024-09-14T11:29:11.339 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 auth 2024-09-14T11:29:11.339 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 crypto 2024-09-14T11:29:11.339 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 finisher 2024-09-14T11:29:11.339 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 reserver 2024-09-14T11:29:11.339 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 heartbeatmap 2024-09-14T11:29:11.339 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 perfcounter 2024-09-14T11:29:11.339 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw 2024-09-14T11:29:11.339 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_sync 2024-09-14T11:29:11.339 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_datacache 2024-09-14T11:29:11.339 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_access 2024-09-14T11:29:11.339 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:29:11.339 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_flight 2024-09-14T11:29:11.339 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:29:11.339 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw_notification 2024-09-14T11:29:11.339 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 javaclient 2024-09-14T11:29:11.340 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 asok 2024-09-14T11:29:11.340 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 throttle 2024-09-14T11:29:11.340 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 refs 2024-09-14T11:29:11.340 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 compressor 2024-09-14T11:29:11.340 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluestore 2024-09-14T11:29:11.340 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluefs 2024-09-14T11:29:11.340 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 bdev 2024-09-14T11:29:11.340 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 kstore 2024-09-14T11:29:11.340 INFO:tasks.workunit.client.0.smithi071.stderr: 4/ 5 rocksdb 2024-09-14T11:29:11.340 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 fuse 2024-09-14T11:29:11.340 INFO:tasks.workunit.client.0.smithi071.stderr: 2/ 5 mgr 2024-09-14T11:29:11.340 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mgrc 2024-09-14T11:29:11.340 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 dpdk 2024-09-14T11:29:11.340 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 eventtrace 2024-09-14T11:29:11.341 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 prioritycache 2024-09-14T11:29:11.341 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 test 2024-09-14T11:29:11.341 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:29:11.341 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephsqlite 2024-09-14T11:29:11.341 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:29:11.341 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore 2024-09-14T11:29:11.341 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_onode 2024-09-14T11:29:11.341 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_odata 2024-09-14T11:29:11.341 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_omap 2024-09-14T11:29:11.341 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_tm 2024-09-14T11:29:11.341 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_t 2024-09-14T11:29:11.341 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:29:11.341 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_epm 2024-09-14T11:29:11.341 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_lba 2024-09-14T11:29:11.341 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:29:11.342 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cache 2024-09-14T11:29:11.342 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_journal 2024-09-14T11:29:11.342 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_device 2024-09-14T11:29:11.342 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_backref 2024-09-14T11:29:11.342 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 alienstore 2024-09-14T11:29:11.342 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mclock 2024-09-14T11:29:11.342 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cyanstore 2024-09-14T11:29:11.342 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 ceph_exporter 2024-09-14T11:29:11.342 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 memstore 2024-09-14T11:29:11.342 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 trace 2024-09-14T11:29:11.342 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 ceph_dedup 2024-09-14T11:29:11.342 INFO:tasks.workunit.client.0.smithi071.stderr: -2/-2 (syslog threshold) 2024-09-14T11:29:11.342 INFO:tasks.workunit.client.0.smithi071.stderr: 99/99 (stderr threshold) 2024-09-14T11:29:11.342 INFO:tasks.workunit.client.0.smithi071.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:29:11.343 INFO:tasks.workunit.client.0.smithi071.stderr: 7f93d67fc640 / http_manager 2024-09-14T11:29:11.343 INFO:tasks.workunit.client.0.smithi071.stderr: 7f945cfe1640 / http_manager 2024-09-14T11:29:11.343 INFO:tasks.workunit.client.0.smithi071.stderr: 7f945dfe3640 / rgw_dt_lg_renew 2024-09-14T11:29:11.343 INFO:tasks.workunit.client.0.smithi071.stderr: 7f94857fa640 / ms_dispatch 2024-09-14T11:29:11.343 INFO:tasks.workunit.client.0.smithi071.stderr: 7f9486ffd640 / io_context_pool 2024-09-14T11:29:11.343 INFO:tasks.workunit.client.0.smithi071.stderr: 7f948d7fa640 / ms_dispatch 2024-09-14T11:29:11.343 INFO:tasks.workunit.client.0.smithi071.stderr: 7f948ffff640 / ms_dispatch 2024-09-14T11:29:11.343 INFO:tasks.workunit.client.0.smithi071.stderr: 7f9495e0b640 / io_context_pool 2024-09-14T11:29:11.343 INFO:tasks.workunit.client.0.smithi071.stderr: 7f95a70f6640 / msgr-worker-2 2024-09-14T11:29:11.343 INFO:tasks.workunit.client.0.smithi071.stderr: 7f95a78f7640 / msgr-worker-1 2024-09-14T11:29:11.343 INFO:tasks.workunit.client.0.smithi071.stderr: 7f95a80f8640 / msgr-worker-0 2024-09-14T11:29:11.343 INFO:tasks.workunit.client.0.smithi071.stderr: 7f95a88f9640 / io_context_pool 2024-09-14T11:29:11.343 INFO:tasks.workunit.client.0.smithi071.stderr: 7f95a9df19c0 / radosgw-admin 2024-09-14T11:29:11.343 INFO:tasks.workunit.client.0.smithi071.stderr: max_recent 500 2024-09-14T11:29:11.344 INFO:tasks.workunit.client.0.smithi071.stderr: max_new 1000 2024-09-14T11:29:11.344 INFO:tasks.workunit.client.0.smithi071.stderr: log_file /var/log/ceph/ceph-client.admin.81921.log 2024-09-14T11:29:11.344 INFO:tasks.workunit.client.0.smithi071.stderr:--- end dump of recent events --- 2024-09-14T11:29:11.344 INFO:tasks.workunit.client.0.smithi071.stderr:--- begin dump of recent events --- 2024-09-14T11:29:11.344 INFO:tasks.workunit.client.0.smithi071.stderr: -499> 2024-09-14T11:29:11.185+0000 7f95a78f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:11.344 INFO:tasks.workunit.client.0.smithi071.stderr: -498> 2024-09-14T11:29:11.185+0000 7f95a78f7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:11.344 INFO:tasks.workunit.client.0.smithi071.stderr: -497> 2024-09-14T11:29:11.185+0000 7f95a70f6640 10 monclient(hunting): handle_auth_done global_id 6312 payload 274 2024-09-14T11:29:11.344 INFO:tasks.workunit.client.0.smithi071.stderr: -496> 2024-09-14T11:29:11.185+0000 7f95a70f6640 10 monclient: _finish_hunting 0 2024-09-14T11:29:11.344 INFO:tasks.workunit.client.0.smithi071.stderr: -495> 2024-09-14T11:29:11.185+0000 7f95a70f6640 1 monclient: found mon.noname-a 2024-09-14T11:29:11.344 INFO:tasks.workunit.client.0.smithi071.stderr: -494> 2024-09-14T11:29:11.185+0000 7f95a70f6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:29:11.344 INFO:tasks.workunit.client.0.smithi071.stderr: -493> 2024-09-14T11:29:11.185+0000 7f9495e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:11.344 INFO:tasks.workunit.client.0.smithi071.stderr: -492> 2024-09-14T11:29:11.185+0000 7f9495e0b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:29:11.344 INFO:tasks.workunit.client.0.smithi071.stderr: -491> 2024-09-14T11:29:11.185+0000 7f9495e0b640 10 monclient: dump: 2024-09-14T11:29:11.344 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:11.345 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:11.345 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.345 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.345 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:11.345 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:11.345 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:11.345 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:11.345 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:11.345 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.345 INFO:tasks.workunit.client.0.smithi071.stderr: -490> 2024-09-14T11:29:11.185+0000 7f9495e0b640 10 monclient: _finish_auth 0 2024-09-14T11:29:11.345 INFO:tasks.workunit.client.0.smithi071.stderr: -489> 2024-09-14T11:29:11.185+0000 7f9495e0b640 10 monclient: _check_auth_tickets 2024-09-14T11:29:11.345 INFO:tasks.workunit.client.0.smithi071.stderr: -488> 2024-09-14T11:29:11.185+0000 7f9495e0b640 10 monclient: handle_config config(0 keys) 2024-09-14T11:29:11.345 INFO:tasks.workunit.client.0.smithi071.stderr: -487> 2024-09-14T11:29:11.185+0000 7f9495e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:11.346 INFO:tasks.workunit.client.0.smithi071.stderr: -486> 2024-09-14T11:29:11.185+0000 7f9495e0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:29:11.346 INFO:tasks.workunit.client.0.smithi071.stderr: -485> 2024-09-14T11:29:11.185+0000 7f9495e0b640 10 monclient: dump: 2024-09-14T11:29:11.346 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:11.346 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:11.346 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.346 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.346 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:11.346 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:11.346 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:11.346 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:11.346 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:11.346 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.346 INFO:tasks.workunit.client.0.smithi071.stderr: -484> 2024-09-14T11:29:11.185+0000 7f95a9df19c0 5 monclient: authenticate success, global_id 6312 2024-09-14T11:29:11.346 INFO:tasks.workunit.client.0.smithi071.stderr: -483> 2024-09-14T11:29:11.185+0000 7f95a9df19c0 10 monclient: get_monmap_and_config success 2024-09-14T11:29:11.347 INFO:tasks.workunit.client.0.smithi071.stderr: -482> 2024-09-14T11:29:11.185+0000 7f95a9df19c0 4 set_mon_vals no callback set 2024-09-14T11:29:11.347 INFO:tasks.workunit.client.0.smithi071.stderr: -481> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 10 monclient: shutdown 2024-09-14T11:29:11.347 INFO:tasks.workunit.client.0.smithi071.stderr: -480> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 asok(0x5570fa99ad90) unregister_commands rotate-key 2024-09-14T11:29:11.347 INFO:tasks.workunit.client.0.smithi071.stderr: -479> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 10 monclient: build_initial_monmap 2024-09-14T11:29:11.347 INFO:tasks.workunit.client.0.smithi071.stderr: -478> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 1 build_initial for_mkfs: 0 2024-09-14T11:29:11.347 INFO:tasks.workunit.client.0.smithi071.stderr: -477> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 10 monclient: monmap: 2024-09-14T11:29:11.347 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:29:11.347 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:29:11.347 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:29:11.347 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:29:11.347 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:29:11.347 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:11.347 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:29:11.348 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:29:11.348 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:29:11.348 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.348 INFO:tasks.workunit.client.0.smithi071.stderr: -476> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabcdc50) adding auth protocol: cephx 2024-09-14T11:29:11.348 INFO:tasks.workunit.client.0.smithi071.stderr: -475> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabcdc50) adding auth protocol: cephx 2024-09-14T11:29:11.348 INFO:tasks.workunit.client.0.smithi071.stderr: -474> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabcdc50) adding auth protocol: cephx 2024-09-14T11:29:11.348 INFO:tasks.workunit.client.0.smithi071.stderr: -473> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabcdc50) adding con mode: secure 2024-09-14T11:29:11.348 INFO:tasks.workunit.client.0.smithi071.stderr: -472> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabcdc50) adding con mode: crc 2024-09-14T11:29:11.348 INFO:tasks.workunit.client.0.smithi071.stderr: -471> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabcdc50) adding con mode: secure 2024-09-14T11:29:11.348 INFO:tasks.workunit.client.0.smithi071.stderr: -470> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabcdc50) adding con mode: crc 2024-09-14T11:29:11.348 INFO:tasks.workunit.client.0.smithi071.stderr: -469> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabcdc50) adding con mode: secure 2024-09-14T11:29:11.348 INFO:tasks.workunit.client.0.smithi071.stderr: -468> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabcdc50) adding con mode: crc 2024-09-14T11:29:11.348 INFO:tasks.workunit.client.0.smithi071.stderr: -467> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabcdc50) adding con mode: crc 2024-09-14T11:29:11.348 INFO:tasks.workunit.client.0.smithi071.stderr: -466> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabcdc50) adding con mode: secure 2024-09-14T11:29:11.349 INFO:tasks.workunit.client.0.smithi071.stderr: -465> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabcdc50) adding con mode: crc 2024-09-14T11:29:11.349 INFO:tasks.workunit.client.0.smithi071.stderr: -464> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabcdc50) adding con mode: secure 2024-09-14T11:29:11.349 INFO:tasks.workunit.client.0.smithi071.stderr: -463> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabcdc50) adding con mode: crc 2024-09-14T11:29:11.349 INFO:tasks.workunit.client.0.smithi071.stderr: -462> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabcdc50) adding con mode: secure 2024-09-14T11:29:11.349 INFO:tasks.workunit.client.0.smithi071.stderr: -461> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:11.349 INFO:tasks.workunit.client.0.smithi071.stderr: -460> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 1 librados: starting msgr at 2024-09-14T11:29:11.349 INFO:tasks.workunit.client.0.smithi071.stderr: -459> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 1 librados: starting objecter 2024-09-14T11:29:11.349 INFO:tasks.workunit.client.0.smithi071.stderr: -458> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 asok(0x5570fa99ad90) register_command objecter_requests hook 0x5570fabd59a0 2024-09-14T11:29:11.349 INFO:tasks.workunit.client.0.smithi071.stderr: -457> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 1 librados: setting wanted keys 2024-09-14T11:29:11.349 INFO:tasks.workunit.client.0.smithi071.stderr: -456> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 1 librados: calling monclient init 2024-09-14T11:29:11.349 INFO:tasks.workunit.client.0.smithi071.stderr: -455> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 10 monclient: init 2024-09-14T11:29:11.349 INFO:tasks.workunit.client.0.smithi071.stderr: -454> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570faba4250) adding auth protocol: cephx 2024-09-14T11:29:11.349 INFO:tasks.workunit.client.0.smithi071.stderr: -453> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570faba4250) adding auth protocol: cephx 2024-09-14T11:29:11.349 INFO:tasks.workunit.client.0.smithi071.stderr: -452> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570faba4250) adding auth protocol: cephx 2024-09-14T11:29:11.349 INFO:tasks.workunit.client.0.smithi071.stderr: -451> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570faba4250) adding con mode: secure 2024-09-14T11:29:11.350 INFO:tasks.workunit.client.0.smithi071.stderr: -450> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570faba4250) adding con mode: crc 2024-09-14T11:29:11.350 INFO:tasks.workunit.client.0.smithi071.stderr: -449> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570faba4250) adding con mode: secure 2024-09-14T11:29:11.350 INFO:tasks.workunit.client.0.smithi071.stderr: -448> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570faba4250) adding con mode: crc 2024-09-14T11:29:11.350 INFO:tasks.workunit.client.0.smithi071.stderr: -447> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570faba4250) adding con mode: secure 2024-09-14T11:29:11.350 INFO:tasks.workunit.client.0.smithi071.stderr: -446> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570faba4250) adding con mode: crc 2024-09-14T11:29:11.350 INFO:tasks.workunit.client.0.smithi071.stderr: -445> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570faba4250) adding con mode: crc 2024-09-14T11:29:11.350 INFO:tasks.workunit.client.0.smithi071.stderr: -444> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570faba4250) adding con mode: secure 2024-09-14T11:29:11.350 INFO:tasks.workunit.client.0.smithi071.stderr: -443> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570faba4250) adding con mode: crc 2024-09-14T11:29:11.350 INFO:tasks.workunit.client.0.smithi071.stderr: -442> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570faba4250) adding con mode: secure 2024-09-14T11:29:11.350 INFO:tasks.workunit.client.0.smithi071.stderr: -441> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570faba4250) adding con mode: crc 2024-09-14T11:29:11.350 INFO:tasks.workunit.client.0.smithi071.stderr: -440> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 AuthRegistry(0x5570faba4250) adding con mode: secure 2024-09-14T11:29:11.350 INFO:tasks.workunit.client.0.smithi071.stderr: -439> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:11.350 INFO:tasks.workunit.client.0.smithi071.stderr: -438> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:11.350 INFO:tasks.workunit.client.0.smithi071.stderr: -437> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 asok(0x5570fa99ad90) register_command rotate-key hook 0x5570faba4398 2024-09-14T11:29:11.351 INFO:tasks.workunit.client.0.smithi071.stderr: -436> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 10 monclient: _reopen_session rank -1 2024-09-14T11:29:11.351 INFO:tasks.workunit.client.0.smithi071.stderr: -435> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:29:11.351 INFO:tasks.workunit.client.0.smithi071.stderr: -434> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 10 monclient(hunting): picked mon.noname-b con 0x5570fabaa8e0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:29:11.351 INFO:tasks.workunit.client.0.smithi071.stderr: -433> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 10 monclient(hunting): picked mon.noname-c con 0x5570fabcd7a0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:29:11.351 INFO:tasks.workunit.client.0.smithi071.stderr: -432> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 10 monclient(hunting): picked mon.noname-a con 0x7f9590002410 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:29:11.351 INFO:tasks.workunit.client.0.smithi071.stderr: -431> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:11.351 INFO:tasks.workunit.client.0.smithi071.stderr: -430> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:11.351 INFO:tasks.workunit.client.0.smithi071.stderr: -429> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:11.351 INFO:tasks.workunit.client.0.smithi071.stderr: -428> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 10 monclient(hunting): _renew_subs 2024-09-14T11:29:11.351 INFO:tasks.workunit.client.0.smithi071.stderr: -427> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 10 monclient(hunting): authenticate will time out at 2163.309978s 2024-09-14T11:29:11.351 INFO:tasks.workunit.client.0.smithi071.stderr: -426> 2024-09-14T11:29:11.189+0000 7f95a80f8640 10 monclient(hunting): get_auth_request con 0x7f9590002410 auth_method 0 2024-09-14T11:29:11.351 INFO:tasks.workunit.client.0.smithi071.stderr: -425> 2024-09-14T11:29:11.189+0000 7f95a80f8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:11.351 INFO:tasks.workunit.client.0.smithi071.stderr: -424> 2024-09-14T11:29:11.189+0000 7f95a80f8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:11.351 INFO:tasks.workunit.client.0.smithi071.stderr: -423> 2024-09-14T11:29:11.189+0000 7f95a80f8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:11.352 INFO:tasks.workunit.client.0.smithi071.stderr: -422> 2024-09-14T11:29:11.189+0000 7f95a70f6640 10 monclient(hunting): get_auth_request con 0x5570fabcd7a0 auth_method 0 2024-09-14T11:29:11.352 INFO:tasks.workunit.client.0.smithi071.stderr: -421> 2024-09-14T11:29:11.189+0000 7f95a70f6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:11.352 INFO:tasks.workunit.client.0.smithi071.stderr: -420> 2024-09-14T11:29:11.189+0000 7f95a70f6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:11.352 INFO:tasks.workunit.client.0.smithi071.stderr: -419> 2024-09-14T11:29:11.189+0000 7f95a70f6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:11.352 INFO:tasks.workunit.client.0.smithi071.stderr: -418> 2024-09-14T11:29:11.189+0000 7f95a80f8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:11.352 INFO:tasks.workunit.client.0.smithi071.stderr: -417> 2024-09-14T11:29:11.189+0000 7f95a80f8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:11.352 INFO:tasks.workunit.client.0.smithi071.stderr: -416> 2024-09-14T11:29:11.189+0000 7f95a80f8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:11.352 INFO:tasks.workunit.client.0.smithi071.stderr: -415> 2024-09-14T11:29:11.189+0000 7f95a70f6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:11.352 INFO:tasks.workunit.client.0.smithi071.stderr: -414> 2024-09-14T11:29:11.189+0000 7f95a70f6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:11.352 INFO:tasks.workunit.client.0.smithi071.stderr: -413> 2024-09-14T11:29:11.189+0000 7f95a70f6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:11.352 INFO:tasks.workunit.client.0.smithi071.stderr: -412> 2024-09-14T11:29:11.189+0000 7f95a78f7640 10 monclient(hunting): get_auth_request con 0x5570fabaa8e0 auth_method 0 2024-09-14T11:29:11.352 INFO:tasks.workunit.client.0.smithi071.stderr: -411> 2024-09-14T11:29:11.189+0000 7f95a78f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:11.352 INFO:tasks.workunit.client.0.smithi071.stderr: -410> 2024-09-14T11:29:11.189+0000 7f95a78f7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:11.352 INFO:tasks.workunit.client.0.smithi071.stderr: -409> 2024-09-14T11:29:11.189+0000 7f95a78f7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:11.353 INFO:tasks.workunit.client.0.smithi071.stderr: -408> 2024-09-14T11:29:11.189+0000 7f95a70f6640 10 monclient(hunting): handle_auth_done global_id 6035 payload 824 2024-09-14T11:29:11.353 INFO:tasks.workunit.client.0.smithi071.stderr: -407> 2024-09-14T11:29:11.189+0000 7f95a70f6640 10 monclient: _finish_hunting 0 2024-09-14T11:29:11.353 INFO:tasks.workunit.client.0.smithi071.stderr: -406> 2024-09-14T11:29:11.189+0000 7f95a70f6640 1 monclient: found mon.noname-c 2024-09-14T11:29:11.353 INFO:tasks.workunit.client.0.smithi071.stderr: -405> 2024-09-14T11:29:11.189+0000 7f95a70f6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:29:11.353 INFO:tasks.workunit.client.0.smithi071.stderr: -404> 2024-09-14T11:29:11.189+0000 7f948ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:11.353 INFO:tasks.workunit.client.0.smithi071.stderr: -403> 2024-09-14T11:29:11.189+0000 7f948ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:29:11.353 INFO:tasks.workunit.client.0.smithi071.stderr: -402> 2024-09-14T11:29:11.189+0000 7f948ffff640 10 monclient: dump: 2024-09-14T11:29:11.353 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:11.353 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:11.353 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.353 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.353 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:11.353 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:11.354 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:11.354 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:11.354 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:11.354 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.354 INFO:tasks.workunit.client.0.smithi071.stderr: -401> 2024-09-14T11:29:11.189+0000 7f948ffff640 10 monclient: _finish_auth 0 2024-09-14T11:29:11.354 INFO:tasks.workunit.client.0.smithi071.stderr: -400> 2024-09-14T11:29:11.189+0000 7f948ffff640 10 monclient: _check_auth_tickets 2024-09-14T11:29:11.354 INFO:tasks.workunit.client.0.smithi071.stderr: -399> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 5 monclient: authenticate success, global_id 6035 2024-09-14T11:29:11.354 INFO:tasks.workunit.client.0.smithi071.stderr: -398> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 10 monclient: _renew_subs 2024-09-14T11:29:11.354 INFO:tasks.workunit.client.0.smithi071.stderr: -397> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:29:11.354 INFO:tasks.workunit.client.0.smithi071.stderr: -396> 2024-09-14T11:29:11.189+0000 7f948ffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:29:11.354 INFO:tasks.workunit.client.0.smithi071.stderr: -395> 2024-09-14T11:29:11.189+0000 7f948ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:11.354 INFO:tasks.workunit.client.0.smithi071.stderr: -394> 2024-09-14T11:29:11.189+0000 7f948ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:29:11.355 INFO:tasks.workunit.client.0.smithi071.stderr: -393> 2024-09-14T11:29:11.189+0000 7f948ffff640 10 monclient: dump: 2024-09-14T11:29:11.355 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:11.355 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:11.355 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.355 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.355 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:11.355 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:11.355 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:11.355 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:11.355 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:11.355 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.355 INFO:tasks.workunit.client.0.smithi071.stderr: -392> 2024-09-14T11:29:11.189+0000 7f9495e0b640 4 set_mon_vals no callback set 2024-09-14T11:29:11.355 INFO:tasks.workunit.client.0.smithi071.stderr: -391> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 10 monclient: _renew_subs 2024-09-14T11:29:11.355 INFO:tasks.workunit.client.0.smithi071.stderr: -390> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:29:11.356 INFO:tasks.workunit.client.0.smithi071.stderr: -389> 2024-09-14T11:29:11.189+0000 7f95a9df19c0 1 librados: init done 2024-09-14T11:29:11.356 INFO:tasks.workunit.client.0.smithi071.stderr: -388> 2024-09-14T11:29:11.193+0000 7f948ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:29:11.356 INFO:tasks.workunit.client.0.smithi071.stderr: -387> 2024-09-14T11:29:11.193+0000 7f948ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:29:11.356 INFO:tasks.workunit.client.0.smithi071.stderr: -386> 2024-09-14T11:29:11.193+0000 7f948ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:29:11.356 INFO:tasks.workunit.client.0.smithi071.stderr: -385> 2024-09-14T11:29:11.193+0000 7f95a78f7640 10 monclient: get_auth_request con 0x7f94900718d0 auth_method 0 2024-09-14T11:29:11.356 INFO:tasks.workunit.client.0.smithi071.stderr: -384> 2024-09-14T11:29:11.193+0000 7f95a80f8640 10 monclient: get_auth_request con 0x5570fabcc5d0 auth_method 0 2024-09-14T11:29:11.356 INFO:tasks.workunit.client.0.smithi071.stderr: -383> 2024-09-14T11:29:11.193+0000 7f95a78f7640 10 monclient: get_auth_request con 0x5570fabf17b0 auth_method 0 2024-09-14T11:29:11.356 INFO:tasks.workunit.client.0.smithi071.stderr: -382> 2024-09-14T11:29:11.193+0000 7f95a70f6640 10 monclient: get_auth_request con 0x5570fabf5b10 auth_method 0 2024-09-14T11:29:11.356 INFO:tasks.workunit.client.0.smithi071.stderr: -381> 2024-09-14T11:29:11.197+0000 7f95a80f8640 10 monclient: get_auth_request con 0x5570fabf5030 auth_method 0 2024-09-14T11:29:11.356 INFO:tasks.workunit.client.0.smithi071.stderr: -380> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 10 monclient: build_initial_monmap 2024-09-14T11:29:11.356 INFO:tasks.workunit.client.0.smithi071.stderr: -379> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 1 build_initial for_mkfs: 0 2024-09-14T11:29:11.356 INFO:tasks.workunit.client.0.smithi071.stderr: -378> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 10 monclient: monmap: 2024-09-14T11:29:11.356 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:29:11.356 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:29:11.357 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:29:11.357 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:29:11.357 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:29:11.357 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:11.357 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:29:11.357 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:29:11.357 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:29:11.357 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.357 INFO:tasks.workunit.client.0.smithi071.stderr: -377> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfdc00) adding auth protocol: cephx 2024-09-14T11:29:11.357 INFO:tasks.workunit.client.0.smithi071.stderr: -376> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfdc00) adding auth protocol: cephx 2024-09-14T11:29:11.357 INFO:tasks.workunit.client.0.smithi071.stderr: -375> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfdc00) adding auth protocol: cephx 2024-09-14T11:29:11.357 INFO:tasks.workunit.client.0.smithi071.stderr: -374> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfdc00) adding con mode: secure 2024-09-14T11:29:11.357 INFO:tasks.workunit.client.0.smithi071.stderr: -373> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfdc00) adding con mode: crc 2024-09-14T11:29:11.357 INFO:tasks.workunit.client.0.smithi071.stderr: -372> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfdc00) adding con mode: secure 2024-09-14T11:29:11.358 INFO:tasks.workunit.client.0.smithi071.stderr: -371> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfdc00) adding con mode: crc 2024-09-14T11:29:11.358 INFO:tasks.workunit.client.0.smithi071.stderr: -370> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfdc00) adding con mode: secure 2024-09-14T11:29:11.358 INFO:tasks.workunit.client.0.smithi071.stderr: -369> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfdc00) adding con mode: crc 2024-09-14T11:29:11.358 INFO:tasks.workunit.client.0.smithi071.stderr: -368> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfdc00) adding con mode: crc 2024-09-14T11:29:11.358 INFO:tasks.workunit.client.0.smithi071.stderr: -367> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfdc00) adding con mode: secure 2024-09-14T11:29:11.358 INFO:tasks.workunit.client.0.smithi071.stderr: -366> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfdc00) adding con mode: crc 2024-09-14T11:29:11.358 INFO:tasks.workunit.client.0.smithi071.stderr: -365> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfdc00) adding con mode: secure 2024-09-14T11:29:11.358 INFO:tasks.workunit.client.0.smithi071.stderr: -364> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfdc00) adding con mode: crc 2024-09-14T11:29:11.358 INFO:tasks.workunit.client.0.smithi071.stderr: -363> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfdc00) adding con mode: secure 2024-09-14T11:29:11.358 INFO:tasks.workunit.client.0.smithi071.stderr: -362> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:11.358 INFO:tasks.workunit.client.0.smithi071.stderr: -361> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 asok(0x5570fa99ad90) register_command objecter_requests cmddesc objecter_requests hook 0x5570fac015f0 EEXIST 2024-09-14T11:29:11.358 INFO:tasks.workunit.client.0.smithi071.stderr: -360> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 10 monclient: init 2024-09-14T11:29:11.359 INFO:tasks.workunit.client.0.smithi071.stderr: -359> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfcaf8) adding auth protocol: cephx 2024-09-14T11:29:11.359 INFO:tasks.workunit.client.0.smithi071.stderr: -358> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfcaf8) adding auth protocol: cephx 2024-09-14T11:29:11.359 INFO:tasks.workunit.client.0.smithi071.stderr: -357> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfcaf8) adding auth protocol: cephx 2024-09-14T11:29:11.359 INFO:tasks.workunit.client.0.smithi071.stderr: -356> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfcaf8) adding con mode: secure 2024-09-14T11:29:11.359 INFO:tasks.workunit.client.0.smithi071.stderr: -355> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfcaf8) adding con mode: crc 2024-09-14T11:29:11.359 INFO:tasks.workunit.client.0.smithi071.stderr: -354> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfcaf8) adding con mode: secure 2024-09-14T11:29:11.359 INFO:tasks.workunit.client.0.smithi071.stderr: -353> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfcaf8) adding con mode: crc 2024-09-14T11:29:11.359 INFO:tasks.workunit.client.0.smithi071.stderr: -352> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfcaf8) adding con mode: secure 2024-09-14T11:29:11.359 INFO:tasks.workunit.client.0.smithi071.stderr: -351> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfcaf8) adding con mode: crc 2024-09-14T11:29:11.359 INFO:tasks.workunit.client.0.smithi071.stderr: -350> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfcaf8) adding con mode: crc 2024-09-14T11:29:11.359 INFO:tasks.workunit.client.0.smithi071.stderr: -349> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfcaf8) adding con mode: secure 2024-09-14T11:29:11.359 INFO:tasks.workunit.client.0.smithi071.stderr: -348> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfcaf8) adding con mode: crc 2024-09-14T11:29:11.359 INFO:tasks.workunit.client.0.smithi071.stderr: -347> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfcaf8) adding con mode: secure 2024-09-14T11:29:11.359 INFO:tasks.workunit.client.0.smithi071.stderr: -346> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfcaf8) adding con mode: crc 2024-09-14T11:29:11.360 INFO:tasks.workunit.client.0.smithi071.stderr: -345> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 AuthRegistry(0x5570fabfcaf8) adding con mode: secure 2024-09-14T11:29:11.360 INFO:tasks.workunit.client.0.smithi071.stderr: -344> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:11.360 INFO:tasks.workunit.client.0.smithi071.stderr: -343> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:11.360 INFO:tasks.workunit.client.0.smithi071.stderr: -342> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 5 asok(0x5570fa99ad90) register_command rotate-key cmddesc rotate-key hook 0x5570fabfcc40 EEXIST 2024-09-14T11:29:11.360 INFO:tasks.workunit.client.0.smithi071.stderr: -341> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 10 monclient: _reopen_session rank -1 2024-09-14T11:29:11.360 INFO:tasks.workunit.client.0.smithi071.stderr: -340> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:29:11.360 INFO:tasks.workunit.client.0.smithi071.stderr: -339> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 10 monclient(hunting): picked mon.noname-b con 0x5570fac257a0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:29:11.360 INFO:tasks.workunit.client.0.smithi071.stderr: -338> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 10 monclient(hunting): picked mon.noname-a con 0x5570fac250d0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:29:11.360 INFO:tasks.workunit.client.0.smithi071.stderr: -337> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 10 monclient(hunting): picked mon.noname-c con 0x5570fac23ab0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:29:11.360 INFO:tasks.workunit.client.0.smithi071.stderr: -336> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:11.360 INFO:tasks.workunit.client.0.smithi071.stderr: -335> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:11.360 INFO:tasks.workunit.client.0.smithi071.stderr: -334> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:11.360 INFO:tasks.workunit.client.0.smithi071.stderr: -333> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 10 monclient(hunting): _renew_subs 2024-09-14T11:29:11.361 INFO:tasks.workunit.client.0.smithi071.stderr: -332> 2024-09-14T11:29:11.197+0000 7f95a9df19c0 10 monclient(hunting): authenticate will time out at 2163.319793s 2024-09-14T11:29:11.361 INFO:tasks.workunit.client.0.smithi071.stderr: -331> 2024-09-14T11:29:11.197+0000 7f95a78f7640 10 monclient(hunting): get_auth_request con 0x5570fac23ab0 auth_method 0 2024-09-14T11:29:11.361 INFO:tasks.workunit.client.0.smithi071.stderr: -330> 2024-09-14T11:29:11.197+0000 7f95a78f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:11.361 INFO:tasks.workunit.client.0.smithi071.stderr: -329> 2024-09-14T11:29:11.197+0000 7f95a78f7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:11.361 INFO:tasks.workunit.client.0.smithi071.stderr: -328> 2024-09-14T11:29:11.197+0000 7f95a78f7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:11.361 INFO:tasks.workunit.client.0.smithi071.stderr: -327> 2024-09-14T11:29:11.197+0000 7f95a80f8640 10 monclient(hunting): get_auth_request con 0x5570fac250d0 auth_method 0 2024-09-14T11:29:11.361 INFO:tasks.workunit.client.0.smithi071.stderr: -326> 2024-09-14T11:29:11.197+0000 7f95a80f8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:11.361 INFO:tasks.workunit.client.0.smithi071.stderr: -325> 2024-09-14T11:29:11.197+0000 7f95a80f8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:11.361 INFO:tasks.workunit.client.0.smithi071.stderr: -324> 2024-09-14T11:29:11.197+0000 7f95a80f8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:11.361 INFO:tasks.workunit.client.0.smithi071.stderr: -323> 2024-09-14T11:29:11.201+0000 7f95a78f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:11.361 INFO:tasks.workunit.client.0.smithi071.stderr: -322> 2024-09-14T11:29:11.201+0000 7f95a78f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:11.361 INFO:tasks.workunit.client.0.smithi071.stderr: -321> 2024-09-14T11:29:11.201+0000 7f95a78f7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:11.361 INFO:tasks.workunit.client.0.smithi071.stderr: -320> 2024-09-14T11:29:11.201+0000 7f95a80f8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:11.362 INFO:tasks.workunit.client.0.smithi071.stderr: -319> 2024-09-14T11:29:11.201+0000 7f95a80f8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:11.362 INFO:tasks.workunit.client.0.smithi071.stderr: -318> 2024-09-14T11:29:11.201+0000 7f95a80f8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:11.362 INFO:tasks.workunit.client.0.smithi071.stderr: -317> 2024-09-14T11:29:11.201+0000 7f95a70f6640 10 monclient(hunting): get_auth_request con 0x5570fac257a0 auth_method 0 2024-09-14T11:29:11.362 INFO:tasks.workunit.client.0.smithi071.stderr: -316> 2024-09-14T11:29:11.201+0000 7f95a70f6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:11.362 INFO:tasks.workunit.client.0.smithi071.stderr: -315> 2024-09-14T11:29:11.201+0000 7f95a70f6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:11.362 INFO:tasks.workunit.client.0.smithi071.stderr: -314> 2024-09-14T11:29:11.201+0000 7f95a70f6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:11.362 INFO:tasks.workunit.client.0.smithi071.stderr: -313> 2024-09-14T11:29:11.201+0000 7f95a78f7640 10 monclient(hunting): handle_auth_done global_id 6038 payload 824 2024-09-14T11:29:11.362 INFO:tasks.workunit.client.0.smithi071.stderr: -312> 2024-09-14T11:29:11.201+0000 7f95a78f7640 10 monclient: _finish_hunting 0 2024-09-14T11:29:11.362 INFO:tasks.workunit.client.0.smithi071.stderr: -311> 2024-09-14T11:29:11.201+0000 7f95a78f7640 1 monclient: found mon.noname-c 2024-09-14T11:29:11.362 INFO:tasks.workunit.client.0.smithi071.stderr: -310> 2024-09-14T11:29:11.201+0000 7f95a78f7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:29:11.362 INFO:tasks.workunit.client.0.smithi071.stderr: -309> 2024-09-14T11:29:11.201+0000 7f948d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:11.362 INFO:tasks.workunit.client.0.smithi071.stderr: -308> 2024-09-14T11:29:11.201+0000 7f948d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:29:11.362 INFO:tasks.workunit.client.0.smithi071.stderr: -307> 2024-09-14T11:29:11.201+0000 7f948d7fa640 10 monclient: dump: 2024-09-14T11:29:11.363 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:11.363 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:11.363 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.363 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.363 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:11.363 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:11.363 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:11.363 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:11.363 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:11.363 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.363 INFO:tasks.workunit.client.0.smithi071.stderr: -306> 2024-09-14T11:29:11.201+0000 7f948d7fa640 10 monclient: _finish_auth 0 2024-09-14T11:29:11.363 INFO:tasks.workunit.client.0.smithi071.stderr: -305> 2024-09-14T11:29:11.201+0000 7f948d7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:29:11.363 INFO:tasks.workunit.client.0.smithi071.stderr: -304> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 monclient: authenticate success, global_id 6038 2024-09-14T11:29:11.363 INFO:tasks.workunit.client.0.smithi071.stderr: -303> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 10 monclient: _renew_subs 2024-09-14T11:29:11.363 INFO:tasks.workunit.client.0.smithi071.stderr: -302> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:29:11.364 INFO:tasks.workunit.client.0.smithi071.stderr: -301> 2024-09-14T11:29:11.201+0000 7f948d7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:29:11.364 INFO:tasks.workunit.client.0.smithi071.stderr: -300> 2024-09-14T11:29:11.201+0000 7f948d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:11.364 INFO:tasks.workunit.client.0.smithi071.stderr: -299> 2024-09-14T11:29:11.201+0000 7f948d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:29:11.364 INFO:tasks.workunit.client.0.smithi071.stderr: -298> 2024-09-14T11:29:11.201+0000 7f948d7fa640 10 monclient: dump: 2024-09-14T11:29:11.364 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:11.364 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:11.364 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.364 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.364 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:11.364 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:11.364 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:11.364 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:11.364 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:11.365 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.365 INFO:tasks.workunit.client.0.smithi071.stderr: -297> 2024-09-14T11:29:11.201+0000 7f95a88f9640 4 set_mon_vals no callback set 2024-09-14T11:29:11.365 INFO:tasks.workunit.client.0.smithi071.stderr: -296> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 10 monclient: _renew_subs 2024-09-14T11:29:11.365 INFO:tasks.workunit.client.0.smithi071.stderr: -295> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:29:11.365 INFO:tasks.workunit.client.0.smithi071.stderr: -294> 2024-09-14T11:29:11.201+0000 7f948d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:29:11.365 INFO:tasks.workunit.client.0.smithi071.stderr: -293> 2024-09-14T11:29:11.201+0000 7f948d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:29:11.365 INFO:tasks.workunit.client.0.smithi071.stderr: -292> 2024-09-14T11:29:11.201+0000 7f948d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:29:11.365 INFO:tasks.workunit.client.0.smithi071.stderr: -291> 2024-09-14T11:29:11.201+0000 7f95a70f6640 10 monclient: get_auth_request con 0x7f94800717e0 auth_method 0 2024-09-14T11:29:11.365 INFO:tasks.workunit.client.0.smithi071.stderr: -290> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 10 monclient: get_monmap_and_config 2024-09-14T11:29:11.365 INFO:tasks.workunit.client.0.smithi071.stderr: -289> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 10 monclient: build_initial_monmap 2024-09-14T11:29:11.365 INFO:tasks.workunit.client.0.smithi071.stderr: -288> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 1 build_initial for_mkfs: 0 2024-09-14T11:29:11.365 INFO:tasks.workunit.client.0.smithi071.stderr: -287> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 10 monclient: monmap: 2024-09-14T11:29:11.365 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:29:11.365 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:29:11.366 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:29:11.366 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:29:11.366 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:29:11.366 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:11.366 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:29:11.366 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:29:11.366 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:29:11.366 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.366 INFO:tasks.workunit.client.0.smithi071.stderr: -286> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac45180) adding auth protocol: cephx 2024-09-14T11:29:11.366 INFO:tasks.workunit.client.0.smithi071.stderr: -285> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac45180) adding auth protocol: cephx 2024-09-14T11:29:11.366 INFO:tasks.workunit.client.0.smithi071.stderr: -284> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac45180) adding auth protocol: cephx 2024-09-14T11:29:11.366 INFO:tasks.workunit.client.0.smithi071.stderr: -283> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac45180) adding con mode: secure 2024-09-14T11:29:11.366 INFO:tasks.workunit.client.0.smithi071.stderr: -282> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac45180) adding con mode: crc 2024-09-14T11:29:11.366 INFO:tasks.workunit.client.0.smithi071.stderr: -281> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac45180) adding con mode: secure 2024-09-14T11:29:11.366 INFO:tasks.workunit.client.0.smithi071.stderr: -280> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac45180) adding con mode: crc 2024-09-14T11:29:11.367 INFO:tasks.workunit.client.0.smithi071.stderr: -279> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac45180) adding con mode: secure 2024-09-14T11:29:11.367 INFO:tasks.workunit.client.0.smithi071.stderr: -278> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac45180) adding con mode: crc 2024-09-14T11:29:11.367 INFO:tasks.workunit.client.0.smithi071.stderr: -277> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac45180) adding con mode: crc 2024-09-14T11:29:11.367 INFO:tasks.workunit.client.0.smithi071.stderr: -276> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac45180) adding con mode: secure 2024-09-14T11:29:11.367 INFO:tasks.workunit.client.0.smithi071.stderr: -275> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac45180) adding con mode: crc 2024-09-14T11:29:11.367 INFO:tasks.workunit.client.0.smithi071.stderr: -274> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac45180) adding con mode: secure 2024-09-14T11:29:11.367 INFO:tasks.workunit.client.0.smithi071.stderr: -273> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac45180) adding con mode: crc 2024-09-14T11:29:11.367 INFO:tasks.workunit.client.0.smithi071.stderr: -272> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac45180) adding con mode: secure 2024-09-14T11:29:11.367 INFO:tasks.workunit.client.0.smithi071.stderr: -271> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:11.367 INFO:tasks.workunit.client.0.smithi071.stderr: -270> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 10 monclient: init 2024-09-14T11:29:11.367 INFO:tasks.workunit.client.0.smithi071.stderr: -269> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd110719d0) adding auth protocol: cephx 2024-09-14T11:29:11.367 INFO:tasks.workunit.client.0.smithi071.stderr: -268> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd110719d0) adding auth protocol: cephx 2024-09-14T11:29:11.367 INFO:tasks.workunit.client.0.smithi071.stderr: -267> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd110719d0) adding auth protocol: cephx 2024-09-14T11:29:11.367 INFO:tasks.workunit.client.0.smithi071.stderr: -266> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd110719d0) adding con mode: secure 2024-09-14T11:29:11.367 INFO:tasks.workunit.client.0.smithi071.stderr: -265> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd110719d0) adding con mode: crc 2024-09-14T11:29:11.368 INFO:tasks.workunit.client.0.smithi071.stderr: -264> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd110719d0) adding con mode: secure 2024-09-14T11:29:11.368 INFO:tasks.workunit.client.0.smithi071.stderr: -263> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd110719d0) adding con mode: crc 2024-09-14T11:29:11.368 INFO:tasks.workunit.client.0.smithi071.stderr: -262> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd110719d0) adding con mode: secure 2024-09-14T11:29:11.368 INFO:tasks.workunit.client.0.smithi071.stderr: -261> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd110719d0) adding con mode: crc 2024-09-14T11:29:11.368 INFO:tasks.workunit.client.0.smithi071.stderr: -260> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd110719d0) adding con mode: crc 2024-09-14T11:29:11.368 INFO:tasks.workunit.client.0.smithi071.stderr: -259> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd110719d0) adding con mode: secure 2024-09-14T11:29:11.368 INFO:tasks.workunit.client.0.smithi071.stderr: -258> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd110719d0) adding con mode: crc 2024-09-14T11:29:11.368 INFO:tasks.workunit.client.0.smithi071.stderr: -257> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd110719d0) adding con mode: secure 2024-09-14T11:29:11.368 INFO:tasks.workunit.client.0.smithi071.stderr: -256> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd110719d0) adding con mode: crc 2024-09-14T11:29:11.368 INFO:tasks.workunit.client.0.smithi071.stderr: -255> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd110719d0) adding con mode: secure 2024-09-14T11:29:11.368 INFO:tasks.workunit.client.0.smithi071.stderr: -254> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:11.368 INFO:tasks.workunit.client.0.smithi071.stderr: -253> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:11.368 INFO:tasks.workunit.client.0.smithi071.stderr: -252> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 5 asok(0x5570fa99ad90) register_command rotate-key cmddesc rotate-key hook 0x7ffd11071b18 EEXIST 2024-09-14T11:29:11.369 INFO:tasks.workunit.client.0.smithi071.stderr: -251> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 10 monclient: _reopen_session rank -1 2024-09-14T11:29:11.369 INFO:tasks.workunit.client.0.smithi071.stderr: -250> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:29:11.369 INFO:tasks.workunit.client.0.smithi071.stderr: -249> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 10 monclient(hunting): picked mon.noname-a con 0x5570fac79810 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:29:11.369 INFO:tasks.workunit.client.0.smithi071.stderr: -248> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 10 monclient(hunting): picked mon.noname-b con 0x5570fac49230 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:29:11.369 INFO:tasks.workunit.client.0.smithi071.stderr: -247> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 10 monclient(hunting): picked mon.noname-c con 0x5570fac74fe0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:29:11.369 INFO:tasks.workunit.client.0.smithi071.stderr: -246> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:11.369 INFO:tasks.workunit.client.0.smithi071.stderr: -245> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:11.369 INFO:tasks.workunit.client.0.smithi071.stderr: -244> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:11.369 INFO:tasks.workunit.client.0.smithi071.stderr: -243> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 10 monclient(hunting): _renew_subs 2024-09-14T11:29:11.369 INFO:tasks.workunit.client.0.smithi071.stderr: -242> 2024-09-14T11:29:11.201+0000 7f95a9df19c0 10 monclient(hunting): authenticate will time out at 2163.323982s 2024-09-14T11:29:11.369 INFO:tasks.workunit.client.0.smithi071.stderr: -241> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient(hunting): get_auth_request con 0x5570fac79810 auth_method 0 2024-09-14T11:29:11.369 INFO:tasks.workunit.client.0.smithi071.stderr: -240> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:11.369 INFO:tasks.workunit.client.0.smithi071.stderr: -239> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:11.369 INFO:tasks.workunit.client.0.smithi071.stderr: -238> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:11.370 INFO:tasks.workunit.client.0.smithi071.stderr: -237> 2024-09-14T11:29:11.205+0000 7f95a78f7640 10 monclient(hunting): get_auth_request con 0x5570fac74fe0 auth_method 0 2024-09-14T11:29:11.370 INFO:tasks.workunit.client.0.smithi071.stderr: -236> 2024-09-14T11:29:11.205+0000 7f95a78f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:11.370 INFO:tasks.workunit.client.0.smithi071.stderr: -235> 2024-09-14T11:29:11.205+0000 7f95a78f7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:11.370 INFO:tasks.workunit.client.0.smithi071.stderr: -234> 2024-09-14T11:29:11.205+0000 7f95a78f7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:11.370 INFO:tasks.workunit.client.0.smithi071.stderr: -233> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:11.370 INFO:tasks.workunit.client.0.smithi071.stderr: -232> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:11.370 INFO:tasks.workunit.client.0.smithi071.stderr: -231> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:11.370 INFO:tasks.workunit.client.0.smithi071.stderr: -230> 2024-09-14T11:29:11.205+0000 7f95a78f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:11.370 INFO:tasks.workunit.client.0.smithi071.stderr: -229> 2024-09-14T11:29:11.205+0000 7f95a78f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:11.370 INFO:tasks.workunit.client.0.smithi071.stderr: -228> 2024-09-14T11:29:11.205+0000 7f95a78f7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:11.370 INFO:tasks.workunit.client.0.smithi071.stderr: -227> 2024-09-14T11:29:11.205+0000 7f95a80f8640 10 monclient(hunting): get_auth_request con 0x5570fac49230 auth_method 0 2024-09-14T11:29:11.370 INFO:tasks.workunit.client.0.smithi071.stderr: -226> 2024-09-14T11:29:11.205+0000 7f95a80f8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:11.370 INFO:tasks.workunit.client.0.smithi071.stderr: -225> 2024-09-14T11:29:11.205+0000 7f95a80f8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:11.370 INFO:tasks.workunit.client.0.smithi071.stderr: -224> 2024-09-14T11:29:11.205+0000 7f95a80f8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:11.371 INFO:tasks.workunit.client.0.smithi071.stderr: -223> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient(hunting): handle_auth_done global_id 6321 payload 274 2024-09-14T11:29:11.371 INFO:tasks.workunit.client.0.smithi071.stderr: -222> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient: _finish_hunting 0 2024-09-14T11:29:11.371 INFO:tasks.workunit.client.0.smithi071.stderr: -221> 2024-09-14T11:29:11.205+0000 7f95a70f6640 1 monclient: found mon.noname-a 2024-09-14T11:29:11.371 INFO:tasks.workunit.client.0.smithi071.stderr: -220> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:29:11.371 INFO:tasks.workunit.client.0.smithi071.stderr: -219> 2024-09-14T11:29:11.205+0000 7f9486ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:11.371 INFO:tasks.workunit.client.0.smithi071.stderr: -218> 2024-09-14T11:29:11.205+0000 7f9486ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:29:11.371 INFO:tasks.workunit.client.0.smithi071.stderr: -217> 2024-09-14T11:29:11.205+0000 7f9486ffd640 10 monclient: dump: 2024-09-14T11:29:11.371 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:11.371 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:11.371 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.371 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.371 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:11.371 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:11.371 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:11.372 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:11.372 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:11.372 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.372 INFO:tasks.workunit.client.0.smithi071.stderr: -216> 2024-09-14T11:29:11.205+0000 7f9486ffd640 10 monclient: _finish_auth 0 2024-09-14T11:29:11.372 INFO:tasks.workunit.client.0.smithi071.stderr: -215> 2024-09-14T11:29:11.205+0000 7f9486ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:29:11.372 INFO:tasks.workunit.client.0.smithi071.stderr: -214> 2024-09-14T11:29:11.205+0000 7f9486ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:29:11.372 INFO:tasks.workunit.client.0.smithi071.stderr: -213> 2024-09-14T11:29:11.205+0000 7f9486ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:11.372 INFO:tasks.workunit.client.0.smithi071.stderr: -212> 2024-09-14T11:29:11.205+0000 7f9486ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:29:11.372 INFO:tasks.workunit.client.0.smithi071.stderr: -211> 2024-09-14T11:29:11.205+0000 7f9486ffd640 10 monclient: dump: 2024-09-14T11:29:11.372 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:11.372 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:11.372 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.372 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.372 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:11.373 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:11.373 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:11.373 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:11.373 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:11.373 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.373 INFO:tasks.workunit.client.0.smithi071.stderr: -210> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 monclient: authenticate success, global_id 6321 2024-09-14T11:29:11.373 INFO:tasks.workunit.client.0.smithi071.stderr: -209> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient: get_monmap_and_config success 2024-09-14T11:29:11.373 INFO:tasks.workunit.client.0.smithi071.stderr: -208> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 4 set_mon_vals no callback set 2024-09-14T11:29:11.373 INFO:tasks.workunit.client.0.smithi071.stderr: -207> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient: shutdown 2024-09-14T11:29:11.373 INFO:tasks.workunit.client.0.smithi071.stderr: -206> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient: build_initial_monmap 2024-09-14T11:29:11.373 INFO:tasks.workunit.client.0.smithi071.stderr: -205> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 1 build_initial for_mkfs: 0 2024-09-14T11:29:11.373 INFO:tasks.workunit.client.0.smithi071.stderr: -204> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient: monmap: 2024-09-14T11:29:11.373 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:29:11.373 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:29:11.373 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:29:11.374 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:29:11.374 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:29:11.374 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:11.374 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:29:11.374 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:29:11.374 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:29:11.374 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.374 INFO:tasks.workunit.client.0.smithi071.stderr: -203> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac6a230) adding auth protocol: cephx 2024-09-14T11:29:11.374 INFO:tasks.workunit.client.0.smithi071.stderr: -202> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac6a230) adding auth protocol: cephx 2024-09-14T11:29:11.374 INFO:tasks.workunit.client.0.smithi071.stderr: -201> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac6a230) adding auth protocol: cephx 2024-09-14T11:29:11.374 INFO:tasks.workunit.client.0.smithi071.stderr: -200> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac6a230) adding con mode: secure 2024-09-14T11:29:11.374 INFO:tasks.workunit.client.0.smithi071.stderr: -199> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac6a230) adding con mode: crc 2024-09-14T11:29:11.374 INFO:tasks.workunit.client.0.smithi071.stderr: -198> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac6a230) adding con mode: secure 2024-09-14T11:29:11.374 INFO:tasks.workunit.client.0.smithi071.stderr: -197> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac6a230) adding con mode: crc 2024-09-14T11:29:11.374 INFO:tasks.workunit.client.0.smithi071.stderr: -196> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac6a230) adding con mode: secure 2024-09-14T11:29:11.375 INFO:tasks.workunit.client.0.smithi071.stderr: -195> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac6a230) adding con mode: crc 2024-09-14T11:29:11.375 INFO:tasks.workunit.client.0.smithi071.stderr: -194> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac6a230) adding con mode: crc 2024-09-14T11:29:11.375 INFO:tasks.workunit.client.0.smithi071.stderr: -193> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac6a230) adding con mode: secure 2024-09-14T11:29:11.375 INFO:tasks.workunit.client.0.smithi071.stderr: -192> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac6a230) adding con mode: crc 2024-09-14T11:29:11.375 INFO:tasks.workunit.client.0.smithi071.stderr: -191> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac6a230) adding con mode: secure 2024-09-14T11:29:11.375 INFO:tasks.workunit.client.0.smithi071.stderr: -190> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac6a230) adding con mode: crc 2024-09-14T11:29:11.375 INFO:tasks.workunit.client.0.smithi071.stderr: -189> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac6a230) adding con mode: secure 2024-09-14T11:29:11.375 INFO:tasks.workunit.client.0.smithi071.stderr: -188> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:11.375 INFO:tasks.workunit.client.0.smithi071.stderr: -187> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 1 librados: starting msgr at 2024-09-14T11:29:11.375 INFO:tasks.workunit.client.0.smithi071.stderr: -186> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 1 librados: starting objecter 2024-09-14T11:29:11.375 INFO:tasks.workunit.client.0.smithi071.stderr: -185> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 asok(0x5570fa99ad90) register_command objecter_requests cmddesc objecter_requests hook 0x5570fac738f0 EEXIST 2024-09-14T11:29:11.375 INFO:tasks.workunit.client.0.smithi071.stderr: -184> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 1 librados: setting wanted keys 2024-09-14T11:29:11.375 INFO:tasks.workunit.client.0.smithi071.stderr: -183> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 1 librados: calling monclient init 2024-09-14T11:29:11.375 INFO:tasks.workunit.client.0.smithi071.stderr: -182> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient: init 2024-09-14T11:29:11.375 INFO:tasks.workunit.client.0.smithi071.stderr: -181> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac275c0) adding auth protocol: cephx 2024-09-14T11:29:11.376 INFO:tasks.workunit.client.0.smithi071.stderr: -180> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac275c0) adding auth protocol: cephx 2024-09-14T11:29:11.376 INFO:tasks.workunit.client.0.smithi071.stderr: -179> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac275c0) adding auth protocol: cephx 2024-09-14T11:29:11.376 INFO:tasks.workunit.client.0.smithi071.stderr: -178> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac275c0) adding con mode: secure 2024-09-14T11:29:11.376 INFO:tasks.workunit.client.0.smithi071.stderr: -177> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac275c0) adding con mode: crc 2024-09-14T11:29:11.376 INFO:tasks.workunit.client.0.smithi071.stderr: -176> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac275c0) adding con mode: secure 2024-09-14T11:29:11.376 INFO:tasks.workunit.client.0.smithi071.stderr: -175> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac275c0) adding con mode: crc 2024-09-14T11:29:11.376 INFO:tasks.workunit.client.0.smithi071.stderr: -174> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac275c0) adding con mode: secure 2024-09-14T11:29:11.376 INFO:tasks.workunit.client.0.smithi071.stderr: -173> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac275c0) adding con mode: crc 2024-09-14T11:29:11.376 INFO:tasks.workunit.client.0.smithi071.stderr: -172> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac275c0) adding con mode: crc 2024-09-14T11:29:11.376 INFO:tasks.workunit.client.0.smithi071.stderr: -171> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac275c0) adding con mode: secure 2024-09-14T11:29:11.376 INFO:tasks.workunit.client.0.smithi071.stderr: -170> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac275c0) adding con mode: crc 2024-09-14T11:29:11.376 INFO:tasks.workunit.client.0.smithi071.stderr: -169> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac275c0) adding con mode: secure 2024-09-14T11:29:11.376 INFO:tasks.workunit.client.0.smithi071.stderr: -168> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac275c0) adding con mode: crc 2024-09-14T11:29:11.376 INFO:tasks.workunit.client.0.smithi071.stderr: -167> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 AuthRegistry(0x5570fac275c0) adding con mode: secure 2024-09-14T11:29:11.376 INFO:tasks.workunit.client.0.smithi071.stderr: -166> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:11.377 INFO:tasks.workunit.client.0.smithi071.stderr: -165> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:11.377 INFO:tasks.workunit.client.0.smithi071.stderr: -164> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 asok(0x5570fa99ad90) register_command rotate-key cmddesc rotate-key hook 0x5570fac27708 EEXIST 2024-09-14T11:29:11.377 INFO:tasks.workunit.client.0.smithi071.stderr: -163> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient: _reopen_session rank -1 2024-09-14T11:29:11.377 INFO:tasks.workunit.client.0.smithi071.stderr: -162> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:29:11.377 INFO:tasks.workunit.client.0.smithi071.stderr: -161> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient(hunting): picked mon.noname-a con 0x5570fac49230 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:29:11.377 INFO:tasks.workunit.client.0.smithi071.stderr: -160> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient(hunting): picked mon.noname-b con 0x5570fac74fe0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:29:11.377 INFO:tasks.workunit.client.0.smithi071.stderr: -159> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient(hunting): picked mon.noname-c con 0x5570fac79810 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:29:11.377 INFO:tasks.workunit.client.0.smithi071.stderr: -158> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:11.377 INFO:tasks.workunit.client.0.smithi071.stderr: -157> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:11.377 INFO:tasks.workunit.client.0.smithi071.stderr: -156> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:11.377 INFO:tasks.workunit.client.0.smithi071.stderr: -155> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient(hunting): _renew_subs 2024-09-14T11:29:11.377 INFO:tasks.workunit.client.0.smithi071.stderr: -154> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient(hunting): authenticate will time out at 2163.326547s 2024-09-14T11:29:11.377 INFO:tasks.workunit.client.0.smithi071.stderr: -153> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient(hunting): get_auth_request con 0x5570fac49230 auth_method 0 2024-09-14T11:29:11.377 INFO:tasks.workunit.client.0.smithi071.stderr: -152> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:11.377 INFO:tasks.workunit.client.0.smithi071.stderr: -151> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:11.377 INFO:tasks.workunit.client.0.smithi071.stderr: -150> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:11.378 INFO:tasks.workunit.client.0.smithi071.stderr: -149> 2024-09-14T11:29:11.205+0000 7f95a78f7640 10 monclient(hunting): get_auth_request con 0x5570fac79810 auth_method 0 2024-09-14T11:29:11.378 INFO:tasks.workunit.client.0.smithi071.stderr: -148> 2024-09-14T11:29:11.205+0000 7f95a78f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:11.378 INFO:tasks.workunit.client.0.smithi071.stderr: -147> 2024-09-14T11:29:11.205+0000 7f95a78f7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:11.378 INFO:tasks.workunit.client.0.smithi071.stderr: -146> 2024-09-14T11:29:11.205+0000 7f95a78f7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:11.378 INFO:tasks.workunit.client.0.smithi071.stderr: -145> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:11.378 INFO:tasks.workunit.client.0.smithi071.stderr: -144> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:11.378 INFO:tasks.workunit.client.0.smithi071.stderr: -143> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:11.378 INFO:tasks.workunit.client.0.smithi071.stderr: -142> 2024-09-14T11:29:11.205+0000 7f95a78f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:11.378 INFO:tasks.workunit.client.0.smithi071.stderr: -141> 2024-09-14T11:29:11.205+0000 7f95a78f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:11.378 INFO:tasks.workunit.client.0.smithi071.stderr: -140> 2024-09-14T11:29:11.205+0000 7f95a78f7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:11.378 INFO:tasks.workunit.client.0.smithi071.stderr: -139> 2024-09-14T11:29:11.205+0000 7f95a80f8640 10 monclient(hunting): get_auth_request con 0x5570fac74fe0 auth_method 0 2024-09-14T11:29:11.378 INFO:tasks.workunit.client.0.smithi071.stderr: -138> 2024-09-14T11:29:11.205+0000 7f95a80f8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:11.378 INFO:tasks.workunit.client.0.smithi071.stderr: -137> 2024-09-14T11:29:11.205+0000 7f95a80f8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:11.378 INFO:tasks.workunit.client.0.smithi071.stderr: -136> 2024-09-14T11:29:11.205+0000 7f95a80f8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:11.378 INFO:tasks.workunit.client.0.smithi071.stderr: -135> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient(hunting): handle_auth_done global_id 6324 payload 824 2024-09-14T11:29:11.379 INFO:tasks.workunit.client.0.smithi071.stderr: -134> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient: _finish_hunting 0 2024-09-14T11:29:11.379 INFO:tasks.workunit.client.0.smithi071.stderr: -133> 2024-09-14T11:29:11.205+0000 7f95a70f6640 1 monclient: found mon.noname-a 2024-09-14T11:29:11.379 INFO:tasks.workunit.client.0.smithi071.stderr: -132> 2024-09-14T11:29:11.205+0000 7f95a70f6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:29:11.379 INFO:tasks.workunit.client.0.smithi071.stderr: -131> 2024-09-14T11:29:11.205+0000 7f94857fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:11.379 INFO:tasks.workunit.client.0.smithi071.stderr: -130> 2024-09-14T11:29:11.205+0000 7f94857fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:29:11.379 INFO:tasks.workunit.client.0.smithi071.stderr: -129> 2024-09-14T11:29:11.205+0000 7f94857fa640 10 monclient: dump: 2024-09-14T11:29:11.379 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:11.379 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:11.379 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.379 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.379 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:11.379 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:11.379 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:11.379 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:11.379 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:11.380 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.380 INFO:tasks.workunit.client.0.smithi071.stderr: -128> 2024-09-14T11:29:11.205+0000 7f94857fa640 10 monclient: _finish_auth 0 2024-09-14T11:29:11.380 INFO:tasks.workunit.client.0.smithi071.stderr: -127> 2024-09-14T11:29:11.205+0000 7f94857fa640 10 monclient: _check_auth_tickets 2024-09-14T11:29:11.380 INFO:tasks.workunit.client.0.smithi071.stderr: -126> 2024-09-14T11:29:11.205+0000 7f94857fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:29:11.380 INFO:tasks.workunit.client.0.smithi071.stderr: -125> 2024-09-14T11:29:11.205+0000 7f94857fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:11.380 INFO:tasks.workunit.client.0.smithi071.stderr: -124> 2024-09-14T11:29:11.205+0000 7f94857fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:29:11.380 INFO:tasks.workunit.client.0.smithi071.stderr: -123> 2024-09-14T11:29:11.205+0000 7f94857fa640 10 monclient: dump: 2024-09-14T11:29:11.380 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:11.380 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:11.380 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.380 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:11.380 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:11.380 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:11.380 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:11.380 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:11.381 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:11.381 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.381 INFO:tasks.workunit.client.0.smithi071.stderr: -122> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 monclient: authenticate success, global_id 6324 2024-09-14T11:29:11.381 INFO:tasks.workunit.client.0.smithi071.stderr: -121> 2024-09-14T11:29:11.205+0000 7f9486ffd640 4 set_mon_vals no callback set 2024-09-14T11:29:11.381 INFO:tasks.workunit.client.0.smithi071.stderr: -120> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient: _renew_subs 2024-09-14T11:29:11.381 INFO:tasks.workunit.client.0.smithi071.stderr: -119> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:29:11.381 INFO:tasks.workunit.client.0.smithi071.stderr: -118> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient: _renew_subs 2024-09-14T11:29:11.381 INFO:tasks.workunit.client.0.smithi071.stderr: -117> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:29:11.381 INFO:tasks.workunit.client.0.smithi071.stderr: -116> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 1 librados: init done 2024-09-14T11:29:11.381 INFO:tasks.workunit.client.0.smithi071.stderr: -115> 2024-09-14T11:29:11.205+0000 7f95a9df19c0 5 asok(0x5570fa99ad90) register_command cr dump hook 0x5570fac49938 2024-09-14T11:29:11.381 INFO:tasks.workunit.client.0.smithi071.stderr: -114> 2024-09-14T11:29:11.209+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.381 INFO:tasks.workunit.client.0.smithi071.stderr: -113> 2024-09-14T11:29:11.209+0000 7f94857fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:29:11.381 INFO:tasks.workunit.client.0.smithi071.stderr: -112> 2024-09-14T11:29:11.209+0000 7f94857fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:29:11.381 INFO:tasks.workunit.client.0.smithi071.stderr: -111> 2024-09-14T11:29:11.209+0000 7f94857fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:29:11.381 INFO:tasks.workunit.client.0.smithi071.stderr: -110> 2024-09-14T11:29:11.209+0000 7f95a80f8640 10 monclient: get_auth_request con 0x7f94700718a0 auth_method 0 2024-09-14T11:29:11.382 INFO:tasks.workunit.client.0.smithi071.stderr: -109> 2024-09-14T11:29:11.209+0000 7f95a78f7640 10 monclient: get_auth_request con 0x5570fac925e0 auth_method 0 2024-09-14T11:29:11.382 INFO:tasks.workunit.client.0.smithi071.stderr: -108> 2024-09-14T11:29:11.209+0000 7f95a9df19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.382 INFO:tasks.workunit.client.0.smithi071.stderr: -107> 2024-09-14T11:29:11.209+0000 7f95a9df19c0 20 realm 2024-09-14T11:29:11.382 INFO:tasks.workunit.client.0.smithi071.stderr: -106> 2024-09-14T11:29:11.209+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.382 INFO:tasks.workunit.client.0.smithi071.stderr: -105> 2024-09-14T11:29:11.209+0000 7f95a9df19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.382 INFO:tasks.workunit.client.0.smithi071.stderr: -104> 2024-09-14T11:29:11.209+0000 7f95a9df19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:11.382 INFO:tasks.workunit.client.0.smithi071.stderr: -103> 2024-09-14T11:29:11.209+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.382 INFO:tasks.workunit.client.0.smithi071.stderr: -102> 2024-09-14T11:29:11.213+0000 7f95a9df19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.382 INFO:tasks.workunit.client.0.smithi071.stderr: -101> 2024-09-14T11:29:11.213+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.382 INFO:tasks.workunit.client.0.smithi071.stderr: -100> 2024-09-14T11:29:11.213+0000 7f95a70f6640 10 monclient: get_auth_request con 0x5570fac96850 auth_method 0 2024-09-14T11:29:11.382 INFO:tasks.workunit.client.0.smithi071.stderr: -99> 2024-09-14T11:29:11.213+0000 7f95a9df19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:11.382 INFO:tasks.workunit.client.0.smithi071.stderr: -98> 2024-09-14T11:29:11.213+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.382 INFO:tasks.workunit.client.0.smithi071.stderr: -97> 2024-09-14T11:29:11.213+0000 7f95a80f8640 10 monclient: get_auth_request con 0x5570fac9a0b0 auth_method 0 2024-09-14T11:29:11.382 INFO:tasks.workunit.client.0.smithi071.stderr: -96> 2024-09-14T11:29:11.213+0000 7f95a9df19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:11.382 INFO:tasks.workunit.client.0.smithi071.stderr: -95> 2024-09-14T11:29:11.213+0000 7f95a9df19c0 20 searching for the correct realm 2024-09-14T11:29:11.383 INFO:tasks.workunit.client.0.smithi071.stderr: -94> 2024-09-14T11:29:11.213+0000 7f95a78f7640 10 monclient: get_auth_request con 0x5570fac9ee70 auth_method 0 2024-09-14T11:29:11.383 INFO:tasks.workunit.client.0.smithi071.stderr: -93> 2024-09-14T11:29:11.213+0000 7f95a78f7640 0 -- 172.21.15.71:0/2796809309 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x5570fac9ee70 msgr2=0x5570faca1330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:11.383 INFO:tasks.workunit.client.0.smithi071.stderr: -92> 2024-09-14T11:29:11.213+0000 7f94857fa640 1 client.6324.objecter ms_handle_reset 0x5570fac9ee70 session 0x5570fac9e7f0 osd.4 2024-09-14T11:29:11.383 INFO:tasks.workunit.client.0.smithi071.stderr: -91> 2024-09-14T11:29:11.213+0000 7f94857fa640 10 monclient: _renew_subs 2024-09-14T11:29:11.383 INFO:tasks.workunit.client.0.smithi071.stderr: -90> 2024-09-14T11:29:11.213+0000 7f94857fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:29:11.383 INFO:tasks.workunit.client.0.smithi071.stderr: -89> 2024-09-14T11:29:11.213+0000 7f95a70f6640 10 monclient: get_auth_request con 0x7f9598118040 auth_method 0 2024-09-14T11:29:11.383 INFO:tasks.workunit.client.0.smithi071.stderr: -88> 2024-09-14T11:29:11.217+0000 7f95a78f7640 10 monclient: get_auth_request con 0x7f94700813c0 auth_method 0 2024-09-14T11:29:11.383 INFO:tasks.workunit.client.0.smithi071.stderr: -87> 2024-09-14T11:29:11.217+0000 7f95a80f8640 10 monclient: get_auth_request con 0x7f959c0686b0 auth_method 0 2024-09-14T11:29:11.383 INFO:tasks.workunit.client.0.smithi071.stderr: -86> 2024-09-14T11:29:11.217+0000 7f95a78f7640 10 monclient: get_auth_request con 0x7f95980ff610 auth_method 0 2024-09-14T11:29:11.383 INFO:tasks.workunit.client.0.smithi071.stderr: -85> 2024-09-14T11:29:11.221+0000 7f95a78f7640 0 -- 172.21.15.71:0/2796809309 >> [v2:172.21.15.157:6808/527702018,v1:172.21.15.157:6809/527702018] conn(0x7f95980ff610 msgr2=0x7f9598119040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:11.383 INFO:tasks.workunit.client.0.smithi071.stderr: -84> 2024-09-14T11:29:11.221+0000 7f94857fa640 1 client.6324.objecter ms_handle_reset 0x7f95980ff610 session 0x7f95980b3040 osd.5 2024-09-14T11:29:11.383 INFO:tasks.workunit.client.0.smithi071.stderr: -83> 2024-09-14T11:29:11.221+0000 7f95a78f7640 10 monclient: get_auth_request con 0x5570fac9ee70 auth_method 0 2024-09-14T11:29:11.383 INFO:tasks.workunit.client.0.smithi071.stderr: -82> 2024-09-14T11:29:11.221+0000 7f95a70f6640 10 monclient: get_auth_request con 0x7f959c024b60 auth_method 0 2024-09-14T11:29:11.383 INFO:tasks.workunit.client.0.smithi071.stderr: -81> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:11.383 INFO:tasks.workunit.client.0.smithi071.stderr: -80> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:29:11.384 INFO:tasks.workunit.client.0.smithi071.stderr: -79> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:11.384 INFO:tasks.workunit.client.0.smithi071.stderr: -78> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:29:11.384 INFO:tasks.workunit.client.0.smithi071.stderr: -77> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:11.384 INFO:tasks.workunit.client.0.smithi071.stderr: -76> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:11.384 INFO:tasks.workunit.client.0.smithi071.stderr: -75> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.384 INFO:tasks.workunit.client.0.smithi071.stderr: -74> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.384 INFO:tasks.workunit.client.0.smithi071.stderr: -73> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.384 INFO:tasks.workunit.client.0.smithi071.stderr: -72> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:11.384 INFO:tasks.workunit.client.0.smithi071.stderr: -71> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.384 INFO:tasks.workunit.client.0.smithi071.stderr: -70> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:11.384 INFO:tasks.workunit.client.0.smithi071.stderr: -69> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 zone default found 2024-09-14T11:29:11.384 INFO:tasks.workunit.client.0.smithi071.stderr: -68> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 4 Realm: () 2024-09-14T11:29:11.384 INFO:tasks.workunit.client.0.smithi071.stderr: -67> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:29:11.385 INFO:tasks.workunit.client.0.smithi071.stderr: -66> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:29:11.385 INFO:tasks.workunit.client.0.smithi071.stderr: -65> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:11.385 INFO:tasks.workunit.client.0.smithi071.stderr: -64> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 zonegroup default 2024-09-14T11:29:11.385 INFO:tasks.workunit.client.0.smithi071.stderr: -63> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.385 INFO:tasks.workunit.client.0.smithi071.stderr: -62> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.385 INFO:tasks.workunit.client.0.smithi071.stderr: -61> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.385 INFO:tasks.workunit.client.0.smithi071.stderr: -60> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.385 INFO:tasks.workunit.client.0.smithi071.stderr: -59> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.385 INFO:tasks.workunit.client.0.smithi071.stderr: -58> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.385 INFO:tasks.workunit.client.0.smithi071.stderr: -57> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 started sync module instance, tier type = 2024-09-14T11:29:11.385 INFO:tasks.workunit.client.0.smithi071.stderr: -56> 2024-09-14T11:29:11.233+0000 7f95a9df19c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:29:11.385 INFO:tasks.workunit.client.0.smithi071.stderr: -55> 2024-09-14T11:29:11.253+0000 7f95a9df19c0 20 add_watcher() i=0 2024-09-14T11:29:11.385 INFO:tasks.workunit.client.0.smithi071.stderr: -54> 2024-09-14T11:29:11.253+0000 7f95a9df19c0 20 add_watcher() i=1 2024-09-14T11:29:11.385 INFO:tasks.workunit.client.0.smithi071.stderr: -53> 2024-09-14T11:29:11.253+0000 7f95a9df19c0 20 add_watcher() i=2 2024-09-14T11:29:11.386 INFO:tasks.workunit.client.0.smithi071.stderr: -52> 2024-09-14T11:29:11.253+0000 7f95a9df19c0 20 add_watcher() i=3 2024-09-14T11:29:11.386 INFO:tasks.workunit.client.0.smithi071.stderr: -51> 2024-09-14T11:29:11.253+0000 7f95a9df19c0 20 add_watcher() i=4 2024-09-14T11:29:11.386 INFO:tasks.workunit.client.0.smithi071.stderr: -50> 2024-09-14T11:29:11.253+0000 7f95a9df19c0 20 add_watcher() i=5 2024-09-14T11:29:11.386 INFO:tasks.workunit.client.0.smithi071.stderr: -49> 2024-09-14T11:29:11.253+0000 7f95a9df19c0 20 add_watcher() i=6 2024-09-14T11:29:11.386 INFO:tasks.workunit.client.0.smithi071.stderr: -48> 2024-09-14T11:29:11.257+0000 7f95a9df19c0 20 add_watcher() i=7 2024-09-14T11:29:11.386 INFO:tasks.workunit.client.0.smithi071.stderr: -47> 2024-09-14T11:29:11.257+0000 7f95a9df19c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:11.386 INFO:tasks.workunit.client.0.smithi071.stderr: -46> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd11071eb0) adding auth protocol: cephx 2024-09-14T11:29:11.386 INFO:tasks.workunit.client.0.smithi071.stderr: -45> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd11071eb0) adding auth protocol: cephx 2024-09-14T11:29:11.386 INFO:tasks.workunit.client.0.smithi071.stderr: -44> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd11071eb0) adding auth protocol: cephx 2024-09-14T11:29:11.386 INFO:tasks.workunit.client.0.smithi071.stderr: -43> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd11071eb0) adding con mode: secure 2024-09-14T11:29:11.386 INFO:tasks.workunit.client.0.smithi071.stderr: -42> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd11071eb0) adding con mode: crc 2024-09-14T11:29:11.386 INFO:tasks.workunit.client.0.smithi071.stderr: -41> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd11071eb0) adding con mode: secure 2024-09-14T11:29:11.386 INFO:tasks.workunit.client.0.smithi071.stderr: -40> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd11071eb0) adding con mode: crc 2024-09-14T11:29:11.386 INFO:tasks.workunit.client.0.smithi071.stderr: -39> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd11071eb0) adding con mode: secure 2024-09-14T11:29:11.387 INFO:tasks.workunit.client.0.smithi071.stderr: -38> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd11071eb0) adding con mode: crc 2024-09-14T11:29:11.387 INFO:tasks.workunit.client.0.smithi071.stderr: -37> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd11071eb0) adding con mode: crc 2024-09-14T11:29:11.387 INFO:tasks.workunit.client.0.smithi071.stderr: -36> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd11071eb0) adding con mode: secure 2024-09-14T11:29:11.387 INFO:tasks.workunit.client.0.smithi071.stderr: -35> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd11071eb0) adding con mode: crc 2024-09-14T11:29:11.387 INFO:tasks.workunit.client.0.smithi071.stderr: -34> 2024-09-14T11:29:11.261+0000 7f945dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:11.387 INFO:tasks.workunit.client.0.smithi071.stderr: -33> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd11071eb0) adding con mode: secure 2024-09-14T11:29:11.387 INFO:tasks.workunit.client.0.smithi071.stderr: -32> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd11071eb0) adding con mode: crc 2024-09-14T11:29:11.387 INFO:tasks.workunit.client.0.smithi071.stderr: -31> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 AuthRegistry(0x7ffd11071eb0) adding con mode: secure 2024-09-14T11:29:11.387 INFO:tasks.workunit.client.0.smithi071.stderr: -30> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:11.387 INFO:tasks.workunit.client.0.smithi071.stderr: -29> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:11.387 INFO:tasks.workunit.client.0.smithi071.stderr: -28> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:11.387 INFO:tasks.workunit.client.0.smithi071.stderr: -27> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 asok(0x5570fa99ad90) register_command cache list hook 0x5570fac7f390 2024-09-14T11:29:11.387 INFO:tasks.workunit.client.0.smithi071.stderr: -26> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 asok(0x5570fa99ad90) register_command cache inspect hook 0x5570fac7f390 2024-09-14T11:29:11.387 INFO:tasks.workunit.client.0.smithi071.stderr: -25> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 asok(0x5570fa99ad90) register_command cache erase hook 0x5570fac7f390 2024-09-14T11:29:11.387 INFO:tasks.workunit.client.0.smithi071.stderr: -24> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 asok(0x5570fa99ad90) register_command cache zap hook 0x5570fac7f390 2024-09-14T11:29:11.388 INFO:tasks.workunit.client.0.smithi071.stderr: -23> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 note: GC not initialized 2024-09-14T11:29:11.388 INFO:tasks.workunit.client.0.smithi071.stderr: -22> 2024-09-14T11:29:11.261+0000 7f945cfe1640 20 reqs_thread_entry: start 2024-09-14T11:29:11.388 INFO:tasks.workunit.client.0.smithi071.stderr: -21> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 asok(0x5570fa99ad90) register_command sync trace show hook 0x7f959c001120 2024-09-14T11:29:11.388 INFO:tasks.workunit.client.0.smithi071.stderr: -20> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 asok(0x5570fa99ad90) register_command sync trace history hook 0x7f959c001120 2024-09-14T11:29:11.388 INFO:tasks.workunit.client.0.smithi071.stderr: -19> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 asok(0x5570fa99ad90) register_command sync trace active hook 0x7f959c001120 2024-09-14T11:29:11.388 INFO:tasks.workunit.client.0.smithi071.stderr: -18> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 5 asok(0x5570fa99ad90) register_command sync trace active_short hook 0x7f959c001120 2024-09-14T11:29:11.388 INFO:tasks.workunit.client.0.smithi071.stderr: -17> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:11.388 INFO:tasks.workunit.client.0.smithi071.stderr: -16> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 20 Filter name: none 2024-09-14T11:29:11.388 INFO:tasks.workunit.client.0.smithi071.stderr: -15> 2024-09-14T11:29:11.261+0000 7f93d67fc640 20 reqs_thread_entry: start 2024-09-14T11:29:11.388 INFO:tasks.workunit.client.0.smithi071.stderr: -14> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:29:11.388 INFO:tasks.workunit.client.0.smithi071.stderr: -13> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.388 INFO:tasks.workunit.client.0.smithi071.stderr: -12> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:29:11.388 INFO:tasks.workunit.client.0.smithi071.stderr: -11> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:29:11.389 INFO:tasks.workunit.client.0.smithi071.stderr: -10> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:29:11.389 INFO:tasks.workunit.client.0.smithi071.stderr: -9> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 : miss 2024-09-14T11:29:11.389 INFO:tasks.workunit.client.0.smithi071.stderr: -8> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.389 INFO:tasks.workunit.client.0.smithi071.stderr: -7> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:29:11.389 INFO:tasks.workunit.client.0.smithi071.stderr: -6> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 info.flags=0x17 2024-09-14T11:29:11.389 INFO:tasks.workunit.client.0.smithi071.stderr: -5> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 to cache LRU end 2024-09-14T11:29:11.389 INFO:tasks.workunit.client.0.smithi071.stderr: -4> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:29:11.389 INFO:tasks.workunit.client.0.smithi071.stderr: -3> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:11.389 INFO:tasks.workunit.client.0.smithi071.stderr: -2> 2024-09-14T11:29:11.261+0000 7f95a9df19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 2024-09-14T11:29:11.389 INFO:tasks.workunit.client.0.smithi071.stderr: -1> 2024-09-14T11:29:11.265+0000 7f95a9df19c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f95a9df19c0 time 2024-09-14T11:29:11.267254+0000 2024-09-14T11:29:11.389 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:29:11.389 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.389 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:29:11.389 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f95ad6cb2eb] 2024-09-14T11:29:11.389 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f95ad6cb49f] 2024-09-14T11:29:11.390 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5570f7a71c01] 2024-09-14T11:29:11.390 INFO:tasks.workunit.client.0.smithi071.stderr: 4: radosgw-admin(+0x14226e2) [0x5570f84cf6e2] 2024-09-14T11:29:11.390 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5570f7a86ecd] 2024-09-14T11:29:11.390 INFO:tasks.workunit.client.0.smithi071.stderr: 6: main() 2024-09-14T11:29:11.390 INFO:tasks.workunit.client.0.smithi071.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f95ac531d90] 2024-09-14T11:29:11.390 INFO:tasks.workunit.client.0.smithi071.stderr: 8: __libc_start_main() 2024-09-14T11:29:11.390 INFO:tasks.workunit.client.0.smithi071.stderr: 9: _start() 2024-09-14T11:29:11.390 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.390 INFO:tasks.workunit.client.0.smithi071.stderr: 0> 2024-09-14T11:29:11.265+0000 7f95a9df19c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:29:11.390 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f95a9df19c0 thread_name:radosgw-admin 2024-09-14T11:29:11.390 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.390 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:29:11.390 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f95ac54a520] 2024-09-14T11:29:11.391 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:29:11.391 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:29:11.391 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:29:11.391 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f95ad6cb345] 2024-09-14T11:29:11.391 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f95ad6cb49f] 2024-09-14T11:29:11.391 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5570f7a71c01] 2024-09-14T11:29:11.391 INFO:tasks.workunit.client.0.smithi071.stderr: 8: radosgw-admin(+0x14226e2) [0x5570f84cf6e2] 2024-09-14T11:29:11.391 INFO:tasks.workunit.client.0.smithi071.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5570f7a86ecd] 2024-09-14T11:29:11.391 INFO:tasks.workunit.client.0.smithi071.stderr: 10: main() 2024-09-14T11:29:11.391 INFO:tasks.workunit.client.0.smithi071.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f95ac531d90] 2024-09-14T11:29:11.391 INFO:tasks.workunit.client.0.smithi071.stderr: 12: __libc_start_main() 2024-09-14T11:29:11.391 INFO:tasks.workunit.client.0.smithi071.stderr: 13: _start() 2024-09-14T11:29:11.391 INFO:tasks.workunit.client.0.smithi071.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:29:11.391 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.392 INFO:tasks.workunit.client.0.smithi071.stderr:--- logging levels --- 2024-09-14T11:29:11.392 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 none 2024-09-14T11:29:11.392 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 lockdep 2024-09-14T11:29:11.392 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 context 2024-09-14T11:29:11.392 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 crush 2024-09-14T11:29:11.392 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds 2024-09-14T11:29:11.392 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_balancer 2024-09-14T11:29:11.392 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_locker 2024-09-14T11:29:11.392 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log 2024-09-14T11:29:11.392 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log_expire 2024-09-14T11:29:11.392 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_migrator 2024-09-14T11:29:11.392 INFO:tasks.workunit.client.0.smithi071.stderr: 3/ 5 mds_quiesce 2024-09-14T11:29:11.392 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 buffer 2024-09-14T11:29:11.392 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 timer 2024-09-14T11:29:11.393 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 filer 2024-09-14T11:29:11.393 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 striper 2024-09-14T11:29:11.393 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 objecter 2024-09-14T11:29:11.393 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rados 2024-09-14T11:29:11.393 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd 2024-09-14T11:29:11.393 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_mirror 2024-09-14T11:29:11.393 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_replay 2024-09-14T11:29:11.393 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_pwl 2024-09-14T11:29:11.393 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 journaler 2024-09-14T11:29:11.393 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objectcacher 2024-09-14T11:29:11.393 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:29:11.393 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 client 2024-09-14T11:29:11.393 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 osd 2024-09-14T11:29:11.393 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 optracker 2024-09-14T11:29:11.394 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objclass 2024-09-14T11:29:11.394 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 filestore 2024-09-14T11:29:11.394 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 journal 2024-09-14T11:29:11.394 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 ms 2024-09-14T11:29:11.394 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mon 2024-09-14T11:29:11.394 INFO:tasks.workunit.client.0.smithi071.stderr: 0/10 monc 2024-09-14T11:29:11.394 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 paxos 2024-09-14T11:29:11.394 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 tp 2024-09-14T11:29:11.394 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 auth 2024-09-14T11:29:11.394 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 crypto 2024-09-14T11:29:11.394 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 finisher 2024-09-14T11:29:11.394 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 reserver 2024-09-14T11:29:11.394 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 heartbeatmap 2024-09-14T11:29:11.394 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 perfcounter 2024-09-14T11:29:11.395 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw 2024-09-14T11:29:11.395 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_sync 2024-09-14T11:29:11.395 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_datacache 2024-09-14T11:29:11.395 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_access 2024-09-14T11:29:11.395 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:29:11.395 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_flight 2024-09-14T11:29:11.395 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:29:11.395 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw_notification 2024-09-14T11:29:11.395 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 javaclient 2024-09-14T11:29:11.395 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 asok 2024-09-14T11:29:11.395 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 throttle 2024-09-14T11:29:11.395 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 refs 2024-09-14T11:29:11.395 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 compressor 2024-09-14T11:29:11.395 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluestore 2024-09-14T11:29:11.395 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluefs 2024-09-14T11:29:11.396 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 bdev 2024-09-14T11:29:11.396 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 kstore 2024-09-14T11:29:11.396 INFO:tasks.workunit.client.0.smithi071.stderr: 4/ 5 rocksdb 2024-09-14T11:29:11.396 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 fuse 2024-09-14T11:29:11.396 INFO:tasks.workunit.client.0.smithi071.stderr: 2/ 5 mgr 2024-09-14T11:29:11.396 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mgrc 2024-09-14T11:29:11.396 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 dpdk 2024-09-14T11:29:11.396 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 eventtrace 2024-09-14T11:29:11.396 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 prioritycache 2024-09-14T11:29:11.396 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 test 2024-09-14T11:29:11.396 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:29:11.396 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephsqlite 2024-09-14T11:29:11.396 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:29:11.397 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore 2024-09-14T11:29:11.397 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_onode 2024-09-14T11:29:11.397 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_odata 2024-09-14T11:29:11.397 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_omap 2024-09-14T11:29:11.397 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_tm 2024-09-14T11:29:11.397 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_t 2024-09-14T11:29:11.397 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:29:11.397 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_epm 2024-09-14T11:29:11.397 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_lba 2024-09-14T11:29:11.397 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:29:11.397 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cache 2024-09-14T11:29:11.397 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_journal 2024-09-14T11:29:11.397 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_device 2024-09-14T11:29:11.397 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_backref 2024-09-14T11:29:11.398 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 alienstore 2024-09-14T11:29:11.398 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mclock 2024-09-14T11:29:11.398 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cyanstore 2024-09-14T11:29:11.398 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 ceph_exporter 2024-09-14T11:29:11.398 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 memstore 2024-09-14T11:29:11.398 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 trace 2024-09-14T11:29:11.398 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 ceph_dedup 2024-09-14T11:29:11.398 INFO:tasks.workunit.client.0.smithi071.stderr: -2/-2 (syslog threshold) 2024-09-14T11:29:11.398 INFO:tasks.workunit.client.0.smithi071.stderr: 99/99 (stderr threshold) 2024-09-14T11:29:11.398 INFO:tasks.workunit.client.0.smithi071.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:29:11.398 INFO:tasks.workunit.client.0.smithi071.stderr: 7f93d67fc640 / http_manager 2024-09-14T11:29:11.398 INFO:tasks.workunit.client.0.smithi071.stderr: 7f945cfe1640 / http_manager 2024-09-14T11:29:11.398 INFO:tasks.workunit.client.0.smithi071.stderr: 7f945dfe3640 / rgw_dt_lg_renew 2024-09-14T11:29:11.398 INFO:tasks.workunit.client.0.smithi071.stderr: 7f94857fa640 / ms_dispatch 2024-09-14T11:29:11.398 INFO:tasks.workunit.client.0.smithi071.stderr: 7f9486ffd640 / io_context_pool 2024-09-14T11:29:11.399 INFO:tasks.workunit.client.0.smithi071.stderr: 7f948d7fa640 / ms_dispatch 2024-09-14T11:29:11.399 INFO:tasks.workunit.client.0.smithi071.stderr: 7f948ffff640 / ms_dispatch 2024-09-14T11:29:11.399 INFO:tasks.workunit.client.0.smithi071.stderr: 7f9495e0b640 / io_context_pool 2024-09-14T11:29:11.399 INFO:tasks.workunit.client.0.smithi071.stderr: 7f95a70f6640 / msgr-worker-2 2024-09-14T11:29:11.399 INFO:tasks.workunit.client.0.smithi071.stderr: 7f95a78f7640 / msgr-worker-1 2024-09-14T11:29:11.399 INFO:tasks.workunit.client.0.smithi071.stderr: 7f95a80f8640 / msgr-worker-0 2024-09-14T11:29:11.399 INFO:tasks.workunit.client.0.smithi071.stderr: 7f95a88f9640 / io_context_pool 2024-09-14T11:29:11.399 INFO:tasks.workunit.client.0.smithi071.stderr: 7f95a9df19c0 / radosgw-admin 2024-09-14T11:29:11.399 INFO:tasks.workunit.client.0.smithi071.stderr: max_recent 500 2024-09-14T11:29:11.399 INFO:tasks.workunit.client.0.smithi071.stderr: max_new 1000 2024-09-14T11:29:11.399 INFO:tasks.workunit.client.0.smithi071.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:29:11.269711Z_df9386fc-0f58-4090-b1ec-1d805ea44ee1/log 2024-09-14T11:29:11.399 INFO:tasks.workunit.client.0.smithi071.stderr:--- end dump of recent events --- 2024-09-14T11:29:11.399 INFO:tasks.workunit.client.0.smithi071.stderr:Aborted 2024-09-14T11:29:11.399 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:29:11.403 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:11.403 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:11.403 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.345+0000 7fc3e495e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.403 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.349+0000 7fc3e495e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.403 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.349+0000 7fc3e495e9c0 20 realm 2024-09-14T11:29:11.403 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.349+0000 7fc3e495e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.349+0000 7fc3e495e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.349+0000 7fc3e495e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:11.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.349+0000 7fc3e495e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.349+0000 7fc3e495e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.349+0000 7fc3e495e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.349+0000 7fc3e495e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:11.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.349+0000 7fc3e495e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.353+0000 7fc3e495e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:11.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.353+0000 7fc3e495e9c0 20 searching for the correct realm 2024-09-14T11:29:11.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.357+0000 7fc3e2c65640 0 -- 172.21.15.71:0/1650841208 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fc3d8097040 msgr2=0x7fc3d807e860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:11.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.361+0000 7fc3e2c65640 0 -- 172.21.15.71:0/1650841208 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x555816c07e50 msgr2=0x555816c0a240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:11.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.369+0000 7fc3e495e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:11.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.369+0000 7fc3e495e9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:29:11.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.369+0000 7fc3e495e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:11.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.369+0000 7fc3e495e9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:29:11.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.369+0000 7fc3e495e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:11.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.369+0000 7fc3e495e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:11.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.369+0000 7fc3e495e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.369+0000 7fc3e495e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.369+0000 7fc3e495e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.373+0000 7fc3e495e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:11.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.373+0000 7fc3e495e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.373+0000 7fc3e495e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:11.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.373+0000 7fc3e495e9c0 20 zone default found 2024-09-14T11:29:11.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.373+0000 7fc3e495e9c0 4 Realm: () 2024-09-14T11:29:11.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.373+0000 7fc3e495e9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:29:11.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.373+0000 7fc3e495e9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:29:11.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.373+0000 7fc3e495e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:11.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.373+0000 7fc3e495e9c0 20 zonegroup default 2024-09-14T11:29:11.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.373+0000 7fc3e495e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.373+0000 7fc3e495e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.373+0000 7fc3e495e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.373+0000 7fc3e495e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.373+0000 7fc3e495e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.373+0000 7fc3e495e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.373+0000 7fc3e495e9c0 20 started sync module instance, tier type = 2024-09-14T11:29:11.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.373+0000 7fc3e495e9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:29:11.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.389+0000 7fc3e495e9c0 20 add_watcher() i=0 2024-09-14T11:29:11.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.389+0000 7fc3e495e9c0 20 add_watcher() i=1 2024-09-14T11:29:11.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.389+0000 7fc3e495e9c0 20 add_watcher() i=2 2024-09-14T11:29:11.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.389+0000 7fc3e495e9c0 20 add_watcher() i=3 2024-09-14T11:29:11.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.389+0000 7fc3e495e9c0 20 add_watcher() i=4 2024-09-14T11:29:11.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.389+0000 7fc3e495e9c0 20 add_watcher() i=5 2024-09-14T11:29:11.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.389+0000 7fc3e495e9c0 20 add_watcher() i=6 2024-09-14T11:29:11.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.393+0000 7fc3e495e9c0 20 add_watcher() i=7 2024-09-14T11:29:11.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.393+0000 7fc3e495e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:11.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.397+0000 7fc298fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:11.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.397+0000 7fc3e495e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:11.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.397+0000 7fc3e495e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:11.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.397+0000 7fc3e495e9c0 5 note: GC not initialized 2024-09-14T11:29:11.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.397+0000 7fc2137fe640 20 reqs_thread_entry: start 2024-09-14T11:29:11.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.397+0000 7fc3e495e9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:11.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.397+0000 7fc3e495e9c0 20 Filter name: none 2024-09-14T11:29:11.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.397+0000 7fc2117fa640 20 reqs_thread_entry: start 2024-09-14T11:29:11.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.397+0000 7fc3e495e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.397+0000 7fc3e495e9c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:29:11.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.397+0000 7fc3e495e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.397+0000 7fc3e495e9c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:29:11.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.397+0000 7fc3e495e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:11.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.397+0000 7fc3e495e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.401+0000 7fc3e495e9c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:29:11.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.401+0000 7fc3e495e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.401+0000 7fc3e495e9c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:29:11.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.401+0000 7fc3e495e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:11.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.401+0000 7fc298fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:11.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.405+0000 7fc3e495e9c0 20 remove_watcher() i=0 2024-09-14T11:29:11.409 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.405+0000 7fc3e495e9c0 2 removed watcher, disabling cache 2024-09-14T11:29:11.409 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.409+0000 7fc3e495e9c0 20 remove_watcher() i=1 2024-09-14T11:29:11.409 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.413+0000 7fc3e495e9c0 20 remove_watcher() i=2 2024-09-14T11:29:11.410 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.413+0000 7fc3e495e9c0 20 remove_watcher() i=3 2024-09-14T11:29:11.412 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.413+0000 7fc3e495e9c0 20 remove_watcher() i=4 2024-09-14T11:29:11.414 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.417+0000 7fc3e495e9c0 20 remove_watcher() i=5 2024-09-14T11:29:11.416 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.421+0000 7fc3e495e9c0 20 remove_watcher() i=6 2024-09-14T11:29:11.419 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.421+0000 7fc3e495e9c0 20 remove_watcher() i=7 2024-09-14T11:29:11.433 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.433 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:29:11.433 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: abort-at-init-indext id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:29:11.433 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:11.489 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:29:11.523 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:11.523 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:11.567 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.569+0000 7f5ae55a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.570 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.573+0000 7f5ae55a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.570 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.573+0000 7f5ae55a29c0 20 realm 2024-09-14T11:29:11.571 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.573+0000 7f5ae55a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.571 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.573+0000 7f5ae55a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.571 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.573+0000 7f5ae55a29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:11.571 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.573+0000 7f5ae55a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.571 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.573+0000 7f5ae55a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.571 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.573+0000 7f5ae55a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.572 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.573+0000 7f5ae55a29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:11.572 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.573+0000 7f5ae55a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.577+0000 7f5ae55a29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:11.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.577+0000 7f5ae55a29c0 20 searching for the correct realm 2024-09-14T11:29:11.578 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.581+0000 7f5ae30a8640 0 -- 172.21.15.71:0/1371746422 >> [v2:172.21.15.157:6808/527702018,v1:172.21.15.157:6809/527702018] conn(0x7f5ad40d9910 msgr2=0x7f5ad40b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:11.794 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.797+0000 7f5ae30a8640 0 -- 172.21.15.71:0/1371746422 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x5622ed772ca0 msgr2=0x5622ed775160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:11.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.805+0000 7f5ae55a29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:11.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.805+0000 7f5ae55a29c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:29:11.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.805+0000 7f5ae55a29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:11.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.805+0000 7f5ae55a29c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:29:11.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.805+0000 7f5ae55a29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:11.805 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.805+0000 7f5ae55a29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:11.805 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.805+0000 7f5ae55a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.805 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.809+0000 7f5ae55a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.805 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.809+0000 7f5ae55a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.809+0000 7f5ae55a29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:11.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.809+0000 7f5ae55a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.809+0000 7f5ae55a29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:11.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.809+0000 7f5ae55a29c0 20 zone default found 2024-09-14T11:29:11.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.809+0000 7f5ae55a29c0 4 Realm: () 2024-09-14T11:29:11.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.809+0000 7f5ae55a29c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:29:11.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.809+0000 7f5ae55a29c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:29:11.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.809+0000 7f5ae55a29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:11.808 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.809+0000 7f5ae55a29c0 20 zonegroup default 2024-09-14T11:29:11.808 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.809+0000 7f5ae55a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.808 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.809+0000 7f5ae55a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.808 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.809+0000 7f5ae55a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.808 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.813+0000 7f5ae55a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.808 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.813+0000 7f5ae55a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.809 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.813+0000 7f5ae55a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.809 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.813+0000 7f5ae55a29c0 20 started sync module instance, tier type = 2024-09-14T11:29:11.809 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.813+0000 7f5ae55a29c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:29:11.832 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.833+0000 7f5ae55a29c0 20 add_watcher() i=0 2024-09-14T11:29:11.832 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.833+0000 7f5ae55a29c0 20 add_watcher() i=1 2024-09-14T11:29:11.832 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.833+0000 7f5ae55a29c0 20 add_watcher() i=2 2024-09-14T11:29:11.832 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.833+0000 7f5ae55a29c0 20 add_watcher() i=3 2024-09-14T11:29:11.832 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.833+0000 7f5ae55a29c0 20 add_watcher() i=4 2024-09-14T11:29:11.832 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.833+0000 7f5ae55a29c0 20 add_watcher() i=5 2024-09-14T11:29:11.833 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.833+0000 7f5ae55a29c0 20 add_watcher() i=6 2024-09-14T11:29:11.835 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.837+0000 7f5ae55a29c0 20 add_watcher() i=7 2024-09-14T11:29:11.835 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.837+0000 7f5ae55a29c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:11.839 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.841+0000 7f5999fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:11.840 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.841+0000 7f5ae55a29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:11.840 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.841+0000 7f5ae55a29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:11.840 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.841+0000 7f5ae55a29c0 5 note: GC not initialized 2024-09-14T11:29:11.841 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.845+0000 7f5998fe1640 20 reqs_thread_entry: start 2024-09-14T11:29:11.841 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.845+0000 7f5ae55a29c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:11.841 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.845+0000 7f5ae55a29c0 20 Filter name: none 2024-09-14T11:29:11.841 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.845+0000 7f59127fc640 20 reqs_thread_entry: start 2024-09-14T11:29:11.842 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.845+0000 7f5ae55a29c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:29:11.842 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.845+0000 7f5ae55a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.842 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.845+0000 7f5ae55a29c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:29:11.842 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.845+0000 7f5ae55a29c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:29:11.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.845+0000 7f5ae55a29c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:29:11.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.845+0000 7f5ae55a29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 : miss 2024-09-14T11:29:11.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.845+0000 7f5ae55a29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.845+0000 7f5ae55a29c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:29:11.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.845+0000 7f5ae55a29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 info.flags=0x17 2024-09-14T11:29:11.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.845+0000 7f5ae55a29c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 to cache LRU end 2024-09-14T11:29:11.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.845+0000 7f5ae55a29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:29:11.844 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.845+0000 7f5ae55a29c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:11.844 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.845+0000 7f5ae55a29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 2024-09-14T11:29:11.846 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.849+0000 7f5ae55a29c0 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 to be held by another RGW process; skipping for now 2024-09-14T11:29:11.847 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.849+0000 7f5999fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:11.852 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.853+0000 7f5ae55a29c0 20 remove_watcher() i=0 2024-09-14T11:29:11.852 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.853+0000 7f5ae55a29c0 2 removed watcher, disabling cache 2024-09-14T11:29:11.854 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.857+0000 7f5ae55a29c0 20 remove_watcher() i=1 2024-09-14T11:29:11.856 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.857+0000 7f5ae55a29c0 20 remove_watcher() i=2 2024-09-14T11:29:11.859 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.861+0000 7f5ae55a29c0 20 remove_watcher() i=3 2024-09-14T11:29:11.860 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.865+0000 7f5ae55a29c0 20 remove_watcher() i=4 2024-09-14T11:29:11.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.865+0000 7f5ae55a29c0 20 remove_watcher() i=5 2024-09-14T11:29:11.865 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.869+0000 7f5ae55a29c0 20 remove_watcher() i=6 2024-09-14T11:29:11.867 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:11.869+0000 7f5ae55a29c0 20 remove_watcher() i=7 2024-09-14T11:29:11.892 INFO:tasks.workunit.client.0.smithi071.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:29:41.917 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:29:41.954 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:41.954 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:42.000 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.001+0000 7fd6a46919c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:42.003 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.005+0000 7fd6a46919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:42.003 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.005+0000 7fd6a46919c0 20 realm 2024-09-14T11:29:42.003 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.005+0000 7fd6a46919c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:42.004 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.005+0000 7fd6a46919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:42.004 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.005+0000 7fd6a46919c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:42.004 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.005+0000 7fd6a46919c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:42.004 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.005+0000 7fd6a46919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:42.004 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.005+0000 7fd6a46919c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:42.005 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.009+0000 7fd6a46919c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:42.005 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.009+0000 7fd6a46919c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:42.006 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.009+0000 7fd6a46919c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:42.006 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.009+0000 7fd6a46919c0 20 searching for the correct realm 2024-09-14T11:29:42.008 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.013+0000 7fd6a1996640 0 -- 172.21.15.71:0/1053119511 >> [v2:172.21.15.71:6824/2436891866,v1:172.21.15.71:6825/2436891866] conn(0x7fd694027040 msgr2=0x7fd694030880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:42.015 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.017+0000 7fd6a1996640 0 -- 172.21.15.71:0/1053119511 >> [v2:172.21.15.71:6808/1268087573,v1:172.21.15.71:6809/1268087573] conn(0x5580830432f0 msgr2=0x558083045720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:42.026 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.029+0000 7fd6a46919c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:42.026 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.029+0000 7fd6a46919c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:29:42.026 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.029+0000 7fd6a46919c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:42.026 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.029+0000 7fd6a46919c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:29:42.026 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.029+0000 7fd6a46919c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:42.026 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.029+0000 7fd6a46919c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:42.026 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.029+0000 7fd6a46919c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:42.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.029+0000 7fd6a46919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:42.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.029+0000 7fd6a46919c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:42.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.029+0000 7fd6a46919c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:42.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.029+0000 7fd6a46919c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:42.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.029+0000 7fd6a46919c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:42.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.029+0000 7fd6a46919c0 20 zone default found 2024-09-14T11:29:42.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.029+0000 7fd6a46919c0 4 Realm: () 2024-09-14T11:29:42.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.029+0000 7fd6a46919c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:29:42.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.029+0000 7fd6a46919c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:29:42.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.029+0000 7fd6a46919c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:42.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.029+0000 7fd6a46919c0 20 zonegroup default 2024-09-14T11:29:42.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.029+0000 7fd6a46919c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:42.029 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.029+0000 7fd6a46919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:42.029 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.029+0000 7fd6a46919c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:42.029 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.033+0000 7fd6a46919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:42.029 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.033+0000 7fd6a46919c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:42.029 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.033+0000 7fd6a46919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:42.030 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.033+0000 7fd6a46919c0 20 started sync module instance, tier type = 2024-09-14T11:29:42.030 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.033+0000 7fd6a46919c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:29:42.047 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.049+0000 7fd6a46919c0 20 add_watcher() i=0 2024-09-14T11:29:42.047 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.049+0000 7fd6a46919c0 20 add_watcher() i=1 2024-09-14T11:29:42.047 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.049+0000 7fd6a46919c0 20 add_watcher() i=2 2024-09-14T11:29:42.047 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.049+0000 7fd6a46919c0 20 add_watcher() i=3 2024-09-14T11:29:42.047 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.049+0000 7fd6a46919c0 20 add_watcher() i=4 2024-09-14T11:29:42.048 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.049+0000 7fd6a46919c0 20 add_watcher() i=5 2024-09-14T11:29:42.048 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.049+0000 7fd6a46919c0 20 add_watcher() i=6 2024-09-14T11:29:42.049 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.053+0000 7fd6a46919c0 20 add_watcher() i=7 2024-09-14T11:29:42.049 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.053+0000 7fd6a46919c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:42.052 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.057+0000 7fd558fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:42.053 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.057+0000 7fd6a46919c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:42.053 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.057+0000 7fd6a46919c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:42.054 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.057+0000 7fd6a46919c0 5 note: GC not initialized 2024-09-14T11:29:42.054 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.057+0000 7fd4d37fe640 20 reqs_thread_entry: start 2024-09-14T11:29:42.054 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.057+0000 7fd6a46919c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:42.054 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.057+0000 7fd6a46919c0 20 Filter name: none 2024-09-14T11:29:42.054 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.057+0000 7fd4d17fa640 20 reqs_thread_entry: start 2024-09-14T11:29:42.054 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.057+0000 7fd6a46919c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:29:42.054 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.057+0000 7fd6a46919c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:42.054 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.057+0000 7fd6a46919c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:29:42.055 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.057+0000 7fd6a46919c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:29:42.055 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.057+0000 7fd6a46919c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:29:42.055 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.057+0000 7fd6a46919c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 : miss 2024-09-14T11:29:42.055 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.057+0000 7fd6a46919c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:42.055 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.057+0000 7fd6a46919c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:29:42.055 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.057+0000 7fd6a46919c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 info.flags=0x17 2024-09-14T11:29:42.055 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.057+0000 7fd6a46919c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 to cache LRU end 2024-09-14T11:29:42.055 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.057+0000 7fd6a46919c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:29:42.055 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.057+0000 7fd6a46919c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:42.056 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.057+0000 7fd6a46919c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 2024-09-14T11:29:42.067 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.069+0000 7fd6a46919c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 info.flags=0x17 2024-09-14T11:29:42.067 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.069+0000 7fd6a46919c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 to cache LRU end 2024-09-14T11:29:42.067 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.069+0000 7fd6a46919c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:42.067 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.069+0000 7fd6a46919c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22, ofs0, ns] 2024-09-14T11:29:42.068 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.069+0000 7fd5857fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464360 cookie 94010442312624 notifier 6092 bl.length()=997 2024-09-14T11:29:42.068 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.069+0000 7fd5857fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 info.flags=0x17 2024-09-14T11:29:42.068 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.069+0000 7fd5857fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 to cache LRU end 2024-09-14T11:29:42.068 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.069+0000 7fd5857fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:42.068 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.073+0000 7fd6a46919c0 20 handle_bi_update(): bucket=:abort-at-init-indext[4444f441-0c56-48df-a905-d49e7e44d629.4596.22]): orig_sources= new_sources= 2024-09-14T11:29:42.068 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.073+0000 7fd6a46919c0 20 handle_bi_update(): bucket=:abort-at-init-indext[4444f441-0c56-48df-a905-d49e7e44d629.4596.22]): potential sources added=[] removed=[] 2024-09-14T11:29:42.068 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.073+0000 7fd6a46919c0 20 handle_bi_update(): bucket=:abort-at-init-indext[4444f441-0c56-48df-a905-d49e7e44d629.4596.22]): orig_dests= new_dests= 2024-09-14T11:29:42.069 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.073+0000 7fd6a46919c0 20 handle_bi_update(): bucket=:abort-at-init-indext[4444f441-0c56-48df-a905-d49e7e44d629.4596.22]): potential dests added=[] removed=[] 2024-09-14T11:29:42.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.085+0000 7fd6a46919c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.1.0 2024-09-14T11:29:42.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.085+0000 7fd6a46919c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.1.0 2024-09-14T11:29:42.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.085+0000 7fd6a46919c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.1.1 2024-09-14T11:29:42.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.085+0000 7fd6a46919c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.1.1 2024-09-14T11:29:42.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.085+0000 7fd6a46919c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.1.2 2024-09-14T11:29:42.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.085+0000 7fd6a46919c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.1.2 2024-09-14T11:29:42.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.085+0000 7fd6a46919c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.1.3 2024-09-14T11:29:42.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.085+0000 7fd6a46919c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.1.3 2024-09-14T11:29:42.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.085+0000 7fd6a46919c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.1.4 2024-09-14T11:29:42.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.085+0000 7fd6a46919c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.1.4 2024-09-14T11:29:42.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.085+0000 7fd6a46919c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.1.5 2024-09-14T11:29:42.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.085+0000 7fd6a46919c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.1.5 2024-09-14T11:29:42.084 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.085+0000 7fd6a46919c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.1.6 2024-09-14T11:29:42.084 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.085+0000 7fd6a46919c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.1.6 2024-09-14T11:29:42.084 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.085+0000 7fd6a46919c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.1.7 2024-09-14T11:29:42.084 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.085+0000 7fd6a46919c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.1.7 2024-09-14T11:29:42.084 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.085+0000 7fd6a46919c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.1.8 2024-09-14T11:29:42.084 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.085+0000 7fd6a46919c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.1.8 2024-09-14T11:29:42.084 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.085+0000 7fd6a46919c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.1.9 2024-09-14T11:29:42.084 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.085+0000 7fd6a46919c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.1.9 2024-09-14T11:29:42.084 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.085+0000 7fd6a46919c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.1.10 2024-09-14T11:29:42.084 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.085+0000 7fd6a46919c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.1.10 2024-09-14T11:29:42.084 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.085+0000 7fd6a46919c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.1.11 2024-09-14T11:29:42.084 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.085+0000 7fd6a46919c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.1.11 2024-09-14T11:29:42.084 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.085+0000 7fd6a46919c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.0 2024-09-14T11:29:42.085 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.085+0000 7fd6a46919c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.1 2024-09-14T11:29:42.085 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.085+0000 7fd6a46919c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.2 2024-09-14T11:29:42.085 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.089+0000 7fd6a46919c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.3 2024-09-14T11:29:42.086 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.089+0000 7fd6a46919c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.4 2024-09-14T11:29:42.087 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.089+0000 7fd6a46919c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.5 2024-09-14T11:29:42.088 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.089+0000 7fd6a46919c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.6 2024-09-14T11:29:42.089 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.093+0000 7fd6a46919c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.7 2024-09-14T11:29:42.090 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.093+0000 7fd6a46919c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.8 2024-09-14T11:29:42.092 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.093+0000 7fd6a46919c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.9 2024-09-14T11:29:42.092 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.097+0000 7fd6a46919c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.10 2024-09-14T11:29:42.101 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.105+0000 7fd6a46919c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 : hit (requested=0x17, cached=0x17) 2024-09-14T11:29:42.101 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.105+0000 7fd6a46919c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 2024-09-14T11:29:42.103 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.105+0000 7fd6a46919c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 info.flags=0x17 2024-09-14T11:29:42.103 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.105+0000 7fd6a46919c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 to cache LRU end 2024-09-14T11:29:42.104 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.105+0000 7fd6a46919c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:42.104 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.105+0000 7fd6a46919c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22, ofs0, ns] 2024-09-14T11:29:42.104 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.105+0000 7fd5857fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464361 cookie 94010442312624 notifier 6092 bl.length()=997 2024-09-14T11:29:42.104 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.105+0000 7fd5857fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 info.flags=0x17 2024-09-14T11:29:42.104 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.105+0000 7fd5857fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 to cache LRU end 2024-09-14T11:29:42.104 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.105+0000 7fd5857fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:42.105 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.109+0000 7fd6a46919c0 20 handle_bi_update(): bucket=:abort-at-init-indext[4444f441-0c56-48df-a905-d49e7e44d629.4596.22]): orig_sources= new_sources= 2024-09-14T11:29:42.105 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.109+0000 7fd6a46919c0 20 handle_bi_update(): bucket=:abort-at-init-indext[4444f441-0c56-48df-a905-d49e7e44d629.4596.22]): potential sources added=[] removed=[] 2024-09-14T11:29:42.105 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.109+0000 7fd6a46919c0 20 handle_bi_update(): bucket=:abort-at-init-indext[4444f441-0c56-48df-a905-d49e7e44d629.4596.22]): orig_dests= new_dests= 2024-09-14T11:29:42.105 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.109+0000 7fd6a46919c0 20 handle_bi_update(): bucket=:abort-at-init-indext[4444f441-0c56-48df-a905-d49e7e44d629.4596.22]): potential dests added=[] removed=[] 2024-09-14T11:29:42.111 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.113+0000 7fd6a46919c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.0 2024-09-14T11:29:42.112 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.113+0000 7fd6a46919c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.1 2024-09-14T11:29:42.113 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.117+0000 7fd6a46919c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.2 2024-09-14T11:29:42.114 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.117+0000 7fd6a46919c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.3 2024-09-14T11:29:42.114 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.117+0000 7fd6a46919c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.4 2024-09-14T11:29:42.115 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.117+0000 7fd6a46919c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.5 2024-09-14T11:29:42.117 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.117+0000 7fd6a46919c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.6 2024-09-14T11:29:42.117 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.121+0000 7fd6a46919c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.7 2024-09-14T11:29:42.118 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.121+0000 7fd6a46919c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.8 2024-09-14T11:29:42.119 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.121+0000 7fd6a46919c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.9 2024-09-14T11:29:42.120 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.121+0000 7fd6a46919c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.22.10 2024-09-14T11:29:42.121 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.125+0000 7fd6a46919c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 : hit (requested=0x17, cached=0x17) 2024-09-14T11:29:42.121 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.125+0000 7fd6a46919c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 2024-09-14T11:29:42.123 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.125+0000 7fd6a46919c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 info.flags=0x17 2024-09-14T11:29:42.123 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.125+0000 7fd6a46919c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 to cache LRU end 2024-09-14T11:29:42.123 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.125+0000 7fd6a46919c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:42.124 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.125+0000 7fd6a46919c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22, ofs0, ns] 2024-09-14T11:29:42.124 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.125+0000 7fd585ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464362 cookie 94010442312624 notifier 6092 bl.length()=965 2024-09-14T11:29:42.124 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.125+0000 7fd585ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 info.flags=0x17 2024-09-14T11:29:42.124 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.125+0000 7fd585ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:4444f441-0c56-48df-a905-d49e7e44d629.4596.22 to cache LRU end 2024-09-14T11:29:42.124 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.125+0000 7fd585ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:42.125 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.129+0000 7fd6a46919c0 20 handle_bi_update(): bucket=:abort-at-init-indext[4444f441-0c56-48df-a905-d49e7e44d629.4596.22]): orig_sources= new_sources= 2024-09-14T11:29:42.126 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.129+0000 7fd6a46919c0 20 handle_bi_update(): bucket=:abort-at-init-indext[4444f441-0c56-48df-a905-d49e7e44d629.4596.22]): potential sources added=[] removed=[] 2024-09-14T11:29:42.126 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.129+0000 7fd6a46919c0 20 handle_bi_update(): bucket=:abort-at-init-indext[4444f441-0c56-48df-a905-d49e7e44d629.4596.22]): orig_dests= new_dests= 2024-09-14T11:29:42.126 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.129+0000 7fd6a46919c0 20 handle_bi_update(): bucket=:abort-at-init-indext[4444f441-0c56-48df-a905-d49e7e44d629.4596.22]): potential dests added=[] removed=[] 2024-09-14T11:29:42.132 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.133+0000 7fd6a46919c0 1 execute INFO: reshard of bucket "abort-at-init-indext" from 11 shards to 12 shards completed successfully 2024-09-14T11:29:42.136 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.137+0000 7fd558fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:42.140 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.141+0000 7fd6a46919c0 20 remove_watcher() i=0 2024-09-14T11:29:42.140 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.141+0000 7fd6a46919c0 2 removed watcher, disabling cache 2024-09-14T11:29:42.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.145+0000 7fd6a46919c0 20 remove_watcher() i=1 2024-09-14T11:29:42.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.145+0000 7fd6a46919c0 20 remove_watcher() i=2 2024-09-14T11:29:42.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.149+0000 7fd6a46919c0 20 remove_watcher() i=3 2024-09-14T11:29:42.148 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.153+0000 7fd6a46919c0 20 remove_watcher() i=4 2024-09-14T11:29:42.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.153+0000 7fd6a46919c0 20 remove_watcher() i=5 2024-09-14T11:29:42.153 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.157+0000 7fd6a46919c0 20 remove_watcher() i=6 2024-09-14T11:29:42.156 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.157+0000 7fd6a46919c0 20 remove_watcher() i=7 2024-09-14T11:29:42.177 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:29:42.208 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:42.208 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:42.253 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.257+0000 7fe25cf9b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:42.256 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.257+0000 7fe25cf9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:42.256 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.257+0000 7fe25cf9b9c0 20 realm 2024-09-14T11:29:42.256 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.257+0000 7fe25cf9b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:42.257 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.261+0000 7fe25cf9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:42.257 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.261+0000 7fe25cf9b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:42.257 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.261+0000 7fe25cf9b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:42.257 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.261+0000 7fe25cf9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:42.257 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.261+0000 7fe25cf9b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:42.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.261+0000 7fe25cf9b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:42.259 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.261+0000 7fe25cf9b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:42.259 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.261+0000 7fe25cf9b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:42.259 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.261+0000 7fe25cf9b9c0 20 searching for the correct realm 2024-09-14T11:29:42.263 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.265+0000 7fe25b2a2640 0 -- 172.21.15.71:0/1691619875 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fe250091070 msgr2=0x7fe25004e4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:29:42.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.477+0000 7fe25b2a2640 0 -- 172.21.15.71:0/1691619875 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x564430d45df0 msgr2=0x564430d481e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:42.491 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.493+0000 7fe25cf9b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:42.492 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.493+0000 7fe25cf9b9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:29:42.492 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.493+0000 7fe25cf9b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:42.492 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.493+0000 7fe25cf9b9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:29:42.492 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.493+0000 7fe25cf9b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:42.492 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.493+0000 7fe25cf9b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:42.492 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.493+0000 7fe25cf9b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:42.492 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.493+0000 7fe25cf9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:42.492 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.493+0000 7fe25cf9b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:42.493 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.497+0000 7fe25cf9b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:42.493 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.497+0000 7fe25cf9b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:42.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.497+0000 7fe25cf9b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:42.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.497+0000 7fe25cf9b9c0 20 zone default found 2024-09-14T11:29:42.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.497+0000 7fe25cf9b9c0 4 Realm: () 2024-09-14T11:29:42.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.497+0000 7fe25cf9b9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:29:42.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.497+0000 7fe25cf9b9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:29:42.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.497+0000 7fe25cf9b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:42.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.497+0000 7fe25cf9b9c0 20 zonegroup default 2024-09-14T11:29:42.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.497+0000 7fe25cf9b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:42.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.497+0000 7fe25cf9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:42.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.497+0000 7fe25cf9b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:42.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.497+0000 7fe25cf9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:42.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.497+0000 7fe25cf9b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:42.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.497+0000 7fe25cf9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:42.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.497+0000 7fe25cf9b9c0 20 started sync module instance, tier type = 2024-09-14T11:29:42.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.497+0000 7fe25cf9b9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:29:42.518 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.521+0000 7fe25cf9b9c0 20 add_watcher() i=0 2024-09-14T11:29:42.518 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.521+0000 7fe25cf9b9c0 20 add_watcher() i=1 2024-09-14T11:29:42.519 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.521+0000 7fe25cf9b9c0 20 add_watcher() i=2 2024-09-14T11:29:42.519 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.521+0000 7fe25cf9b9c0 20 add_watcher() i=3 2024-09-14T11:29:42.519 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.521+0000 7fe25cf9b9c0 20 add_watcher() i=4 2024-09-14T11:29:42.519 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.521+0000 7fe25cf9b9c0 20 add_watcher() i=5 2024-09-14T11:29:42.519 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.521+0000 7fe25cf9b9c0 20 add_watcher() i=6 2024-09-14T11:29:42.521 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.525+0000 7fe25cf9b9c0 20 add_watcher() i=7 2024-09-14T11:29:42.521 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.525+0000 7fe25cf9b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:42.525 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.529+0000 7fe1117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:42.526 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.529+0000 7fe25cf9b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:42.526 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.529+0000 7fe25cf9b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:42.526 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.529+0000 7fe25cf9b9c0 5 note: GC not initialized 2024-09-14T11:29:42.527 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.529+0000 7fe08bfff640 20 reqs_thread_entry: start 2024-09-14T11:29:42.527 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.529+0000 7fe25cf9b9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:42.527 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.529+0000 7fe25cf9b9c0 20 Filter name: none 2024-09-14T11:29:42.527 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.529+0000 7fe089ffb640 20 reqs_thread_entry: start 2024-09-14T11:29:42.527 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.529+0000 7fe25cf9b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:42.528 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.529+0000 7fe25cf9b9c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:29:42.528 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.529+0000 7fe25cf9b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:42.529 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.533+0000 7fe25cf9b9c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:29:42.529 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.533+0000 7fe25cf9b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:42.529 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.533+0000 7fe25cf9b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:42.530 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.533+0000 7fe25cf9b9c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:29:42.530 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.533+0000 7fe25cf9b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:42.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.533+0000 7fe25cf9b9c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:29:42.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.533+0000 7fe25cf9b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:42.534 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.537+0000 7fe1117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:42.539 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.541+0000 7fe25cf9b9c0 20 remove_watcher() i=0 2024-09-14T11:29:42.539 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.541+0000 7fe25cf9b9c0 2 removed watcher, disabling cache 2024-09-14T11:29:42.541 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.545+0000 7fe25cf9b9c0 20 remove_watcher() i=1 2024-09-14T11:29:42.543 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.545+0000 7fe25cf9b9c0 20 remove_watcher() i=2 2024-09-14T11:29:42.546 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.549+0000 7fe25cf9b9c0 20 remove_watcher() i=3 2024-09-14T11:29:42.548 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.549+0000 7fe25cf9b9c0 20 remove_watcher() i=4 2024-09-14T11:29:42.550 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.553+0000 7fe25cf9b9c0 20 remove_watcher() i=5 2024-09-14T11:29:42.553 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.557+0000 7fe25cf9b9c0 20 remove_watcher() i=6 2024-09-14T11:29:42.556 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:42.557+0000 7fe25cf9b9c0 20 remove_watcher() i=7 2024-09-14T11:29:42.573 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:42.574 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:29:42.574 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: abort-at-init-indext id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:29:42.574 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:42.692 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-14T11:29:42.692 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:43.084 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:29:43.116 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:43.116 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:43.161 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.165+0000 7fd544aff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:43.164 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.165+0000 7fd544aff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:43.164 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.165+0000 7fd544aff9c0 20 realm 2024-09-14T11:29:43.164 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.165+0000 7fd544aff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:43.165 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.169+0000 7fd544aff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:43.165 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.169+0000 7fd544aff9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:43.165 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.169+0000 7fd544aff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:43.165 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.169+0000 7fd544aff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:43.165 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.169+0000 7fd544aff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:43.166 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.169+0000 7fd544aff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:43.166 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.169+0000 7fd544aff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:43.167 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.169+0000 7fd544aff9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:43.167 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.169+0000 7fd544aff9c0 20 searching for the correct realm 2024-09-14T11:29:43.171 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.173+0000 7fd542e06640 0 -- 172.21.15.71:0/2992048268 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fd538066390 msgr2=0x7fd53805e7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:29:43.385 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.389+0000 7fd542e06640 0 -- 172.21.15.71:0/2992048268 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x555cb5614000 msgr2=0x555cb56163f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:43.400 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.401+0000 7fd544aff9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:43.401 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.401+0000 7fd544aff9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:29:43.401 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.401+0000 7fd544aff9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:43.401 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.401+0000 7fd544aff9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:29:43.401 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.401+0000 7fd544aff9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:43.401 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.401+0000 7fd544aff9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:43.401 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.401+0000 7fd544aff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:43.402 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.405+0000 7fd544aff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:43.402 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.405+0000 7fd544aff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:43.402 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.405+0000 7fd544aff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:43.402 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.405+0000 7fd544aff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:43.403 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.405+0000 7fd544aff9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:43.403 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.405+0000 7fd544aff9c0 20 zone default found 2024-09-14T11:29:43.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.405+0000 7fd544aff9c0 4 Realm: () 2024-09-14T11:29:43.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.405+0000 7fd544aff9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:29:43.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.405+0000 7fd544aff9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:29:43.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.405+0000 7fd544aff9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:43.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.405+0000 7fd544aff9c0 20 zonegroup default 2024-09-14T11:29:43.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.405+0000 7fd544aff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:43.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.405+0000 7fd544aff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:43.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.405+0000 7fd544aff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:43.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.409+0000 7fd544aff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:43.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.409+0000 7fd544aff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:43.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.409+0000 7fd544aff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:43.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.409+0000 7fd544aff9c0 20 started sync module instance, tier type = 2024-09-14T11:29:43.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.409+0000 7fd544aff9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:29:43.427 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.429+0000 7fd544aff9c0 20 add_watcher() i=0 2024-09-14T11:29:43.427 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.429+0000 7fd544aff9c0 20 add_watcher() i=1 2024-09-14T11:29:43.427 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.429+0000 7fd544aff9c0 20 add_watcher() i=2 2024-09-14T11:29:43.427 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.429+0000 7fd544aff9c0 20 add_watcher() i=3 2024-09-14T11:29:43.427 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.429+0000 7fd544aff9c0 20 add_watcher() i=4 2024-09-14T11:29:43.427 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.429+0000 7fd544aff9c0 20 add_watcher() i=5 2024-09-14T11:29:43.427 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.429+0000 7fd544aff9c0 20 add_watcher() i=6 2024-09-14T11:29:43.429 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.433+0000 7fd544aff9c0 20 add_watcher() i=7 2024-09-14T11:29:43.429 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.433+0000 7fd544aff9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:43.433 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.437+0000 7fd3f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:43.434 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.437+0000 7fd544aff9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:43.434 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.437+0000 7fd544aff9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:43.435 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.437+0000 7fd544aff9c0 5 note: GC not initialized 2024-09-14T11:29:43.435 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.437+0000 7fd3737fe640 20 reqs_thread_entry: start 2024-09-14T11:29:43.435 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.437+0000 7fd544aff9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:43.435 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.437+0000 7fd544aff9c0 20 Filter name: none 2024-09-14T11:29:43.436 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.437+0000 7fd3717fa640 20 reqs_thread_entry: start 2024-09-14T11:29:43.436 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.437+0000 7fd544aff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:43.437 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.441+0000 7fd544aff9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:29:43.437 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.441+0000 7fd544aff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:43.439 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.441+0000 7fd544aff9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:29:43.439 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.441+0000 7fd544aff9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:43.439 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.441+0000 7fd544aff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:43.440 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.441+0000 7fd544aff9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:29:43.440 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.441+0000 7fd544aff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:43.441 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.445+0000 7fd544aff9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:29:43.441 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.445+0000 7fd544aff9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:43.444 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.445+0000 7fd3f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:43.450 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.453+0000 7fd544aff9c0 20 remove_watcher() i=0 2024-09-14T11:29:43.450 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.453+0000 7fd544aff9c0 2 removed watcher, disabling cache 2024-09-14T11:29:43.451 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.453+0000 7fd544aff9c0 20 remove_watcher() i=1 2024-09-14T11:29:43.454 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.457+0000 7fd544aff9c0 20 remove_watcher() i=2 2024-09-14T11:29:43.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.457+0000 7fd544aff9c0 20 remove_watcher() i=3 2024-09-14T11:29:43.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.461+0000 7fd544aff9c0 20 remove_watcher() i=4 2024-09-14T11:29:43.461 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.465+0000 7fd544aff9c0 20 remove_watcher() i=5 2024-09-14T11:29:43.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.465+0000 7fd544aff9c0 20 remove_watcher() i=6 2024-09-14T11:29:43.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.469+0000 7fd544aff9c0 20 remove_watcher() i=7 2024-09-14T11:29:43.483 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:43.483 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:29:43.483 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: error-at-set-target-layout id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:29:43.484 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:43.484 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-14T11:29:43.517 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:43.517 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:43.562 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.565+0000 7fc1630ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:43.565 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.569+0000 7fc1630ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:43.565 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.569+0000 7fc1630ad9c0 20 realm 2024-09-14T11:29:43.565 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.569+0000 7fc1630ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:43.565 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.569+0000 7fc1630ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:43.566 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.569+0000 7fc1630ad9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:43.566 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.569+0000 7fc1630ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:43.566 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.569+0000 7fc1630ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:43.566 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.569+0000 7fc1630ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:43.566 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.569+0000 7fc1630ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:43.566 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.569+0000 7fc1630ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:43.567 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.569+0000 7fc1630ad9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:43.567 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.569+0000 7fc1630ad9c0 20 searching for the correct realm 2024-09-14T11:29:43.571 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.573+0000 7fc1613b4640 0 -- 172.21.15.71:0/2581713003 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fc148074020 msgr2=0x7fc148065ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:43.785 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.789+0000 7fc1613b4640 0 -- 172.21.15.71:0/2581713003 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55ba76416390 msgr2=0x55ba76418780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:43.801 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.801+0000 7fc1630ad9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:43.801 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.805+0000 7fc1630ad9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:29:43.801 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.805+0000 7fc1630ad9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:43.801 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.805+0000 7fc1630ad9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:29:43.801 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.805+0000 7fc1630ad9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:43.801 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.805+0000 7fc1630ad9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:43.801 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.805+0000 7fc1630ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:43.801 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.805+0000 7fc1630ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:43.802 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.805+0000 7fc1630ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:43.802 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.805+0000 7fc1630ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:43.802 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.805+0000 7fc1630ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:43.803 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.805+0000 7fc1630ad9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:43.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.805+0000 7fc1630ad9c0 20 zone default found 2024-09-14T11:29:43.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.805+0000 7fc1630ad9c0 4 Realm: () 2024-09-14T11:29:43.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.805+0000 7fc1630ad9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:29:43.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.805+0000 7fc1630ad9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:29:43.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.805+0000 7fc1630ad9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:43.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.805+0000 7fc1630ad9c0 20 zonegroup default 2024-09-14T11:29:43.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.805+0000 7fc1630ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:43.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.805+0000 7fc1630ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:43.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.805+0000 7fc1630ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:43.805 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.809+0000 7fc1630ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:43.805 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.809+0000 7fc1630ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:43.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.809+0000 7fc1630ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:43.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.809+0000 7fc1630ad9c0 20 started sync module instance, tier type = 2024-09-14T11:29:43.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.809+0000 7fc1630ad9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:29:43.829 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.829+0000 7fc1630ad9c0 20 add_watcher() i=0 2024-09-14T11:29:43.829 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.829+0000 7fc1630ad9c0 20 add_watcher() i=1 2024-09-14T11:29:43.829 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.829+0000 7fc1630ad9c0 20 add_watcher() i=2 2024-09-14T11:29:43.829 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.829+0000 7fc1630ad9c0 20 add_watcher() i=3 2024-09-14T11:29:43.829 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.829+0000 7fc1630ad9c0 20 add_watcher() i=4 2024-09-14T11:29:43.829 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.829+0000 7fc1630ad9c0 20 add_watcher() i=5 2024-09-14T11:29:43.829 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.829+0000 7fc1630ad9c0 20 add_watcher() i=6 2024-09-14T11:29:43.831 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.833+0000 7fc1630ad9c0 20 add_watcher() i=7 2024-09-14T11:29:43.831 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.833+0000 7fc1630ad9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:43.836 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.837+0000 7fc016fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:43.837 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.841+0000 7fc1630ad9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:43.837 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.841+0000 7fc1630ad9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:43.837 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.841+0000 7fc1630ad9c0 5 note: GC not initialized 2024-09-14T11:29:43.838 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.841+0000 7fc015fe3640 20 reqs_thread_entry: start 2024-09-14T11:29:43.838 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.841+0000 7fc1630ad9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:43.838 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.841+0000 7fc1630ad9c0 20 Filter name: none 2024-09-14T11:29:43.838 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.841+0000 7fbf877fe640 20 reqs_thread_entry: start 2024-09-14T11:29:43.838 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.841+0000 7fc1630ad9c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:29:43.839 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.841+0000 7fc1630ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:43.839 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.841+0000 7fc1630ad9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:29:43.839 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.841+0000 7fc1630ad9c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:29:43.840 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.841+0000 7fc1630ad9c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:29:43.840 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.841+0000 7fc1630ad9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.23 : miss 2024-09-14T11:29:43.840 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.841+0000 7fc1630ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:43.841 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.845+0000 7fc1630ad9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:29:43.841 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.845+0000 7fc1630ad9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.23 info.flags=0x17 2024-09-14T11:29:43.841 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.845+0000 7fc1630ad9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.23 to cache LRU end 2024-09-14T11:29:43.841 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.845+0000 7fc1630ad9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:29:43.841 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.845+0000 7fc1630ad9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:43.841 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.845+0000 7fc1630ad9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.23 2024-09-14T11:29:43.849 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.853+0000 7fc1630ad9c0 -1 Injecting error=-5 at location=set_target_layout 2024-09-14T11:29:43.849 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.853+0000 7fc1630ad9c0 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-14T11:29:43.856 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.861+0000 7fc016fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:43.860 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.865+0000 7fc1630ad9c0 20 remove_watcher() i=0 2024-09-14T11:29:43.861 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.865+0000 7fc1630ad9c0 2 removed watcher, disabling cache 2024-09-14T11:29:43.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.865+0000 7fc1630ad9c0 20 remove_watcher() i=1 2024-09-14T11:29:43.864 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.865+0000 7fc1630ad9c0 20 remove_watcher() i=2 2024-09-14T11:29:43.866 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.869+0000 7fc1630ad9c0 20 remove_watcher() i=3 2024-09-14T11:29:43.868 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.869+0000 7fc1630ad9c0 20 remove_watcher() i=4 2024-09-14T11:29:43.870 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.873+0000 7fc1630ad9c0 20 remove_watcher() i=5 2024-09-14T11:29:43.873 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.877+0000 7fc1630ad9c0 20 remove_watcher() i=6 2024-09-14T11:29:43.876 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.877+0000 7fc1630ad9c0 20 remove_watcher() i=7 2024-09-14T11:29:43.891 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:29:43.919 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:43.919 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:43.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.965+0000 7f6ff8fc29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:43.966 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.969+0000 7f6ff8fc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:43.966 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.969+0000 7f6ff8fc29c0 20 realm 2024-09-14T11:29:43.967 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.969+0000 7f6ff8fc29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:43.967 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.969+0000 7f6ff8fc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:43.967 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.969+0000 7f6ff8fc29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:43.967 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.969+0000 7f6ff8fc29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:43.967 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.969+0000 7f6ff8fc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:43.967 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.969+0000 7f6ff8fc29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:43.968 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.969+0000 7f6ff8fc29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:43.968 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.969+0000 7f6ff8fc29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:43.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.973+0000 7f6ff8fc29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:43.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.973+0000 7f6ff8fc29c0 20 searching for the correct realm 2024-09-14T11:29:43.973 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:43.977+0000 7f6ff72c9640 0 -- 172.21.15.71:0/1169916222 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f6fe00ca020 msgr2=0x7f6fe01003d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:29:44.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.193+0000 7f6ff72c9640 0 -- 172.21.15.71:0/1169916222 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x557682c50d50 msgr2=0x557682c53140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:44.204 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.205+0000 7f6ff8fc29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:44.204 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.205+0000 7f6ff8fc29c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:29:44.204 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.205+0000 7f6ff8fc29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:44.204 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.205+0000 7f6ff8fc29c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:29:44.204 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.205+0000 7f6ff8fc29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:44.205 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.205+0000 7f6ff8fc29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:44.205 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.205+0000 7f6ff8fc29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:44.205 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.209+0000 7f6ff8fc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:44.205 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.209+0000 7f6ff8fc29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:44.206 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.209+0000 7f6ff8fc29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:44.206 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.209+0000 7f6ff8fc29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:44.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.209+0000 7f6ff8fc29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:44.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.209+0000 7f6ff8fc29c0 20 zone default found 2024-09-14T11:29:44.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.209+0000 7f6ff8fc29c0 4 Realm: () 2024-09-14T11:29:44.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.209+0000 7f6ff8fc29c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:29:44.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.209+0000 7f6ff8fc29c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:29:44.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.209+0000 7f6ff8fc29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:44.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.209+0000 7f6ff8fc29c0 20 zonegroup default 2024-09-14T11:29:44.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.209+0000 7f6ff8fc29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:44.208 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.209+0000 7f6ff8fc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:44.208 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.209+0000 7f6ff8fc29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:44.208 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.209+0000 7f6ff8fc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:44.208 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.209+0000 7f6ff8fc29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:44.209 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.213+0000 7f6ff8fc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:44.210 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.213+0000 7f6ff8fc29c0 20 started sync module instance, tier type = 2024-09-14T11:29:44.210 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.213+0000 7f6ff8fc29c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:29:44.233 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.237+0000 7f6ff8fc29c0 20 add_watcher() i=0 2024-09-14T11:29:44.233 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.237+0000 7f6ff8fc29c0 20 add_watcher() i=1 2024-09-14T11:29:44.233 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.237+0000 7f6ff8fc29c0 20 add_watcher() i=2 2024-09-14T11:29:44.233 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.237+0000 7f6ff8fc29c0 20 add_watcher() i=3 2024-09-14T11:29:44.234 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.237+0000 7f6ff8fc29c0 20 add_watcher() i=4 2024-09-14T11:29:44.234 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.237+0000 7f6ff8fc29c0 20 add_watcher() i=5 2024-09-14T11:29:44.234 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.237+0000 7f6ff8fc29c0 20 add_watcher() i=6 2024-09-14T11:29:44.236 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.237+0000 7f6ff8fc29c0 20 add_watcher() i=7 2024-09-14T11:29:44.236 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.237+0000 7f6ff8fc29c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:44.240 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.241+0000 7f6eadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:44.241 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.245+0000 7f6ff8fc29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:44.241 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.245+0000 7f6ff8fc29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:44.242 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.245+0000 7f6ff8fc29c0 5 note: GC not initialized 2024-09-14T11:29:44.242 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.245+0000 7f6eacfe1640 20 reqs_thread_entry: start 2024-09-14T11:29:44.242 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.245+0000 7f6ff8fc29c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:44.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.245+0000 7f6ff8fc29c0 20 Filter name: none 2024-09-14T11:29:44.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.245+0000 7f6ea5ffb640 20 reqs_thread_entry: start 2024-09-14T11:29:44.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.245+0000 7f6ff8fc29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:44.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.245+0000 7f6ff8fc29c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:29:44.244 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.245+0000 7f6ff8fc29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:44.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.245+0000 7f6ff8fc29c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:29:44.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.245+0000 7f6ff8fc29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:44.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.245+0000 7f6ff8fc29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:44.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.249+0000 7f6ff8fc29c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:29:44.246 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.249+0000 7f6ff8fc29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:44.247 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.249+0000 7f6ff8fc29c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:29:44.247 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.249+0000 7f6ff8fc29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:44.252 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.253+0000 7f6eadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:44.256 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.257+0000 7f6ff8fc29c0 20 remove_watcher() i=0 2024-09-14T11:29:44.256 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.257+0000 7f6ff8fc29c0 2 removed watcher, disabling cache 2024-09-14T11:29:44.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.261+0000 7f6ff8fc29c0 20 remove_watcher() i=1 2024-09-14T11:29:44.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.261+0000 7f6ff8fc29c0 20 remove_watcher() i=2 2024-09-14T11:29:44.262 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.265+0000 7f6ff8fc29c0 20 remove_watcher() i=3 2024-09-14T11:29:44.264 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.265+0000 7f6ff8fc29c0 20 remove_watcher() i=4 2024-09-14T11:29:44.267 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.269+0000 7f6ff8fc29c0 20 remove_watcher() i=5 2024-09-14T11:29:44.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.273+0000 7f6ff8fc29c0 20 remove_watcher() i=6 2024-09-14T11:29:44.272 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.273+0000 7f6ff8fc29c0 20 remove_watcher() i=7 2024-09-14T11:29:44.287 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:44.287 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:29:44.287 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: error-at-set-target-layout id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:29:44.287 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:44.342 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:29:44.378 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:44.379 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:44.424 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.425+0000 7f3445cf19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:44.426 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.429+0000 7f3445cf19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:44.426 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.429+0000 7f3445cf19c0 20 realm 2024-09-14T11:29:44.426 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.429+0000 7f3445cf19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:44.427 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.429+0000 7f3445cf19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:44.427 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.429+0000 7f3445cf19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:44.427 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.429+0000 7f3445cf19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:44.427 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.429+0000 7f3445cf19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:44.427 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.429+0000 7f3445cf19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:44.428 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.429+0000 7f3445cf19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:44.428 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.429+0000 7f3445cf19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:44.429 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.433+0000 7f3445cf19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:44.429 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.433+0000 7f3445cf19c0 20 searching for the correct realm 2024-09-14T11:29:44.433 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.437+0000 7f3443ff8640 0 -- 172.21.15.71:0/2617524749 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f342c027020 msgr2=0x7f342c00bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:44.649 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.649+0000 7f3443ff8640 0 -- 172.21.15.71:0/2617524749 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55c73b7f0c40 msgr2=0x55c73b7f3050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:44.663 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.665+0000 7f3445cf19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:44.663 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.665+0000 7f3445cf19c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:29:44.663 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.665+0000 7f3445cf19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:44.663 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.665+0000 7f3445cf19c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:29:44.664 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.665+0000 7f3445cf19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:44.664 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.665+0000 7f3445cf19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:44.664 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.665+0000 7f3445cf19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:44.664 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.665+0000 7f3445cf19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:44.664 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.665+0000 7f3445cf19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:44.665 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.669+0000 7f3445cf19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:44.665 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.669+0000 7f3445cf19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:44.666 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.669+0000 7f3445cf19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:44.666 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.669+0000 7f3445cf19c0 20 zone default found 2024-09-14T11:29:44.666 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.669+0000 7f3445cf19c0 4 Realm: () 2024-09-14T11:29:44.666 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.669+0000 7f3445cf19c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:29:44.666 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.669+0000 7f3445cf19c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:29:44.666 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.669+0000 7f3445cf19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:44.666 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.669+0000 7f3445cf19c0 20 zonegroup default 2024-09-14T11:29:44.666 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.669+0000 7f3445cf19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:44.667 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.669+0000 7f3445cf19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:44.667 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.669+0000 7f3445cf19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:44.667 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.669+0000 7f3445cf19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:44.667 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.669+0000 7f3445cf19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:44.668 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.669+0000 7f3445cf19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:44.668 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.669+0000 7f3445cf19c0 20 started sync module instance, tier type = 2024-09-14T11:29:44.669 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.669+0000 7f3445cf19c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:29:44.690 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.693+0000 7f3445cf19c0 20 add_watcher() i=0 2024-09-14T11:29:44.690 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.693+0000 7f3445cf19c0 20 add_watcher() i=1 2024-09-14T11:29:44.690 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.693+0000 7f3445cf19c0 20 add_watcher() i=2 2024-09-14T11:29:44.690 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.693+0000 7f3445cf19c0 20 add_watcher() i=3 2024-09-14T11:29:44.691 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.693+0000 7f3445cf19c0 20 add_watcher() i=4 2024-09-14T11:29:44.691 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.693+0000 7f3445cf19c0 20 add_watcher() i=5 2024-09-14T11:29:44.691 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.693+0000 7f3445cf19c0 20 add_watcher() i=6 2024-09-14T11:29:44.692 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.693+0000 7f3445cf19c0 20 add_watcher() i=7 2024-09-14T11:29:44.693 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.693+0000 7f3445cf19c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:44.697 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.701+0000 7f32f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:44.697 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.701+0000 7f3445cf19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:44.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.701+0000 7f3445cf19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:44.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.701+0000 7f3445cf19c0 5 note: GC not initialized 2024-09-14T11:29:44.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.701+0000 7f32f8fe1640 20 reqs_thread_entry: start 2024-09-14T11:29:44.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.701+0000 7f3445cf19c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:44.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.701+0000 7f3445cf19c0 20 Filter name: none 2024-09-14T11:29:44.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.701+0000 7f32727fc640 20 reqs_thread_entry: start 2024-09-14T11:29:44.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.701+0000 7f3445cf19c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:29:44.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.701+0000 7f3445cf19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:44.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.701+0000 7f3445cf19c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:29:44.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.701+0000 7f3445cf19c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:29:44.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.701+0000 7f3445cf19c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:29:44.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.701+0000 7f3445cf19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.23 : miss 2024-09-14T11:29:44.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.701+0000 7f3445cf19c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:44.701 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.705+0000 7f3445cf19c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:29:44.701 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.705+0000 7f3445cf19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.23 info.flags=0x17 2024-09-14T11:29:44.701 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.705+0000 7f3445cf19c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.23 to cache LRU end 2024-09-14T11:29:44.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.705+0000 7f3445cf19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:29:44.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.705+0000 7f3445cf19c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:44.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.705+0000 7f3445cf19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.23 2024-09-14T11:29:44.712 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.713+0000 7f3445cf19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.23 info.flags=0x17 2024-09-14T11:29:44.712 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.713+0000 7f3445cf19c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.23 to cache LRU end 2024-09-14T11:29:44.712 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.713+0000 7f3445cf19c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:44.712 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.713+0000 7f3445cf19c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.23, ofs0, ns] 2024-09-14T11:29:44.712 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.713+0000 7f3326ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464351 cookie 94314185073136 notifier 6462 bl.length()=1009 2024-09-14T11:29:44.712 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.713+0000 7f3326ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.23 info.flags=0x17 2024-09-14T11:29:44.712 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.713+0000 7f3326ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.23 to cache LRU end 2024-09-14T11:29:44.712 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.713+0000 7f3326ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:44.713 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.713+0000 7f3445cf19c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.23]): orig_sources= new_sources= 2024-09-14T11:29:44.713 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.713+0000 7f3445cf19c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.23]): potential sources added=[] removed=[] 2024-09-14T11:29:44.713 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.713+0000 7f3445cf19c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.23]): orig_dests= new_dests= 2024-09-14T11:29:44.713 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.713+0000 7f3445cf19c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.23]): potential dests added=[] removed=[] 2024-09-14T11:29:44.725 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.729+0000 7f3445cf19c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.1.0 2024-09-14T11:29:44.725 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.729+0000 7f3445cf19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.1.0 2024-09-14T11:29:44.725 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.729+0000 7f3445cf19c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.1.1 2024-09-14T11:29:44.726 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.729+0000 7f3445cf19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.1.1 2024-09-14T11:29:44.726 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.729+0000 7f3445cf19c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.1.2 2024-09-14T11:29:44.726 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.729+0000 7f3445cf19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.1.2 2024-09-14T11:29:44.726 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.729+0000 7f3445cf19c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.1.3 2024-09-14T11:29:44.726 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.729+0000 7f3445cf19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.1.3 2024-09-14T11:29:44.726 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.729+0000 7f3445cf19c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.1.4 2024-09-14T11:29:44.726 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.729+0000 7f3445cf19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.1.4 2024-09-14T11:29:44.726 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.729+0000 7f3445cf19c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.1.5 2024-09-14T11:29:44.726 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.729+0000 7f3445cf19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.1.5 2024-09-14T11:29:44.726 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.729+0000 7f3445cf19c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.1.6 2024-09-14T11:29:44.726 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.729+0000 7f3445cf19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.1.6 2024-09-14T11:29:44.726 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.729+0000 7f3445cf19c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.1.7 2024-09-14T11:29:44.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.729+0000 7f3445cf19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.1.7 2024-09-14T11:29:44.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.729+0000 7f3445cf19c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.1.8 2024-09-14T11:29:44.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.729+0000 7f3445cf19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.1.8 2024-09-14T11:29:44.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.729+0000 7f3445cf19c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.1.9 2024-09-14T11:29:44.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.729+0000 7f3445cf19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.1.9 2024-09-14T11:29:44.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.729+0000 7f3445cf19c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.1.10 2024-09-14T11:29:44.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.729+0000 7f3445cf19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.1.10 2024-09-14T11:29:44.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.729+0000 7f3445cf19c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.1.11 2024-09-14T11:29:44.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.729+0000 7f3445cf19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.1.11 2024-09-14T11:29:44.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.729+0000 7f3445cf19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.0 2024-09-14T11:29:44.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.729+0000 7f3445cf19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.1 2024-09-14T11:29:44.728 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.729+0000 7f3445cf19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.2 2024-09-14T11:29:44.728 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.729+0000 7f3445cf19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.3 2024-09-14T11:29:44.729 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.733+0000 7f3445cf19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.4 2024-09-14T11:29:44.730 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.733+0000 7f3445cf19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.5 2024-09-14T11:29:44.731 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.733+0000 7f3445cf19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.6 2024-09-14T11:29:44.732 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.733+0000 7f3445cf19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.7 2024-09-14T11:29:44.733 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.737+0000 7f3445cf19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.8 2024-09-14T11:29:44.734 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.737+0000 7f3445cf19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.9 2024-09-14T11:29:44.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.737+0000 7f3445cf19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.10 2024-09-14T11:29:44.741 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.745+0000 7f3445cf19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.23 : hit (requested=0x17, cached=0x17) 2024-09-14T11:29:44.741 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.745+0000 7f3445cf19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.23 2024-09-14T11:29:44.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.745+0000 7f3445cf19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.23 info.flags=0x17 2024-09-14T11:29:44.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.745+0000 7f3445cf19c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.23 to cache LRU end 2024-09-14T11:29:44.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.745+0000 7f3445cf19c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:44.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.745+0000 7f3445cf19c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.23, ofs0, ns] 2024-09-14T11:29:44.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.745+0000 7f3326ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464352 cookie 94314185073136 notifier 6462 bl.length()=1009 2024-09-14T11:29:44.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.745+0000 7f3326ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.23 info.flags=0x17 2024-09-14T11:29:44.745 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.745+0000 7f3326ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.23 to cache LRU end 2024-09-14T11:29:44.745 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.745+0000 7f3326ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:44.745 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.745+0000 7f3445cf19c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.23]): orig_sources= new_sources= 2024-09-14T11:29:44.745 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.749+0000 7f3445cf19c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.23]): potential sources added=[] removed=[] 2024-09-14T11:29:44.745 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.749+0000 7f3445cf19c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.23]): orig_dests= new_dests= 2024-09-14T11:29:44.745 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.749+0000 7f3445cf19c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.23]): potential dests added=[] removed=[] 2024-09-14T11:29:44.750 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.753+0000 7f3445cf19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.0 2024-09-14T11:29:44.751 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.753+0000 7f3445cf19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.1 2024-09-14T11:29:44.752 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.753+0000 7f3445cf19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.2 2024-09-14T11:29:44.752 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.753+0000 7f3445cf19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.3 2024-09-14T11:29:44.753 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.757+0000 7f3445cf19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.4 2024-09-14T11:29:44.754 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.757+0000 7f3445cf19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.5 2024-09-14T11:29:44.754 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.757+0000 7f3445cf19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.6 2024-09-14T11:29:44.755 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.757+0000 7f3445cf19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.7 2024-09-14T11:29:44.756 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.757+0000 7f3445cf19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.8 2024-09-14T11:29:44.757 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.761+0000 7f3445cf19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.9 2024-09-14T11:29:44.758 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.761+0000 7f3445cf19c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.23.10 2024-09-14T11:29:44.758 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.761+0000 7f3445cf19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.23 : hit (requested=0x17, cached=0x17) 2024-09-14T11:29:44.758 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.761+0000 7f3445cf19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.23 2024-09-14T11:29:44.761 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.765+0000 7f3445cf19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.23 info.flags=0x17 2024-09-14T11:29:44.761 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.765+0000 7f3445cf19c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.23 to cache LRU end 2024-09-14T11:29:44.761 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.765+0000 7f3445cf19c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:44.761 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.765+0000 7f3445cf19c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.23, ofs0, ns] 2024-09-14T11:29:44.762 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.765+0000 7f33267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464353 cookie 94314185073136 notifier 6462 bl.length()=977 2024-09-14T11:29:44.762 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.765+0000 7f33267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.23 info.flags=0x17 2024-09-14T11:29:44.762 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.765+0000 7f33267fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.23 to cache LRU end 2024-09-14T11:29:44.762 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.765+0000 7f33267fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:44.762 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.765+0000 7f3445cf19c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.23]): orig_sources= new_sources= 2024-09-14T11:29:44.762 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.765+0000 7f3445cf19c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.23]): potential sources added=[] removed=[] 2024-09-14T11:29:44.763 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.765+0000 7f3445cf19c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.23]): orig_dests= new_dests= 2024-09-14T11:29:44.763 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.765+0000 7f3445cf19c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.23]): potential dests added=[] removed=[] 2024-09-14T11:29:44.769 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.773+0000 7f3445cf19c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:29:44.772 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.773+0000 7f32f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:44.777 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.781+0000 7f3445cf19c0 20 remove_watcher() i=0 2024-09-14T11:29:44.777 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.781+0000 7f3445cf19c0 2 removed watcher, disabling cache 2024-09-14T11:29:44.779 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.781+0000 7f3445cf19c0 20 remove_watcher() i=1 2024-09-14T11:29:44.782 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.785+0000 7f3445cf19c0 20 remove_watcher() i=2 2024-09-14T11:29:44.784 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.785+0000 7f3445cf19c0 20 remove_watcher() i=3 2024-09-14T11:29:44.786 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.789+0000 7f3445cf19c0 20 remove_watcher() i=4 2024-09-14T11:29:44.788 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.789+0000 7f3445cf19c0 20 remove_watcher() i=5 2024-09-14T11:29:44.791 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.793+0000 7f3445cf19c0 20 remove_watcher() i=6 2024-09-14T11:29:44.794 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.797+0000 7f3445cf19c0 20 remove_watcher() i=7 2024-09-14T11:29:44.811 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:29:44.841 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:44.841 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:44.885 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.889+0000 7f0cd05a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:44.888 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.889+0000 7f0cd05a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:44.888 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.889+0000 7f0cd05a09c0 20 realm 2024-09-14T11:29:44.888 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.889+0000 7f0cd05a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:44.889 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.893+0000 7f0cd05a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:44.889 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.893+0000 7f0cd05a09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:44.889 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.893+0000 7f0cd05a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:44.889 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.893+0000 7f0cd05a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:44.889 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.893+0000 7f0cd05a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:44.890 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.893+0000 7f0cd05a09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:44.890 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.893+0000 7f0cd05a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:44.891 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.893+0000 7f0cd05a09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:44.891 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.893+0000 7f0cd05a09c0 20 searching for the correct realm 2024-09-14T11:29:44.896 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:44.897+0000 7f0cce0a6640 0 -- 172.21.15.71:0/794133576 >> [v2:172.21.15.157:6808/527702018,v1:172.21.15.157:6809/527702018] conn(0x7f0cc806e320 msgr2=0x7f0cc806aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:29:45.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.113+0000 7f0cce0a6640 0 -- 172.21.15.71:0/794133576 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x55947dac25f0 msgr2=0x55947dac4a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:45.119 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.121+0000 7f0cd05a09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:45.120 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.121+0000 7f0cd05a09c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:29:45.120 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.121+0000 7f0cd05a09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:45.120 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.121+0000 7f0cd05a09c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:29:45.120 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.121+0000 7f0cd05a09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:45.120 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.121+0000 7f0cd05a09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:45.120 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.121+0000 7f0cd05a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:45.120 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.121+0000 7f0cd05a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:45.120 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.121+0000 7f0cd05a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:45.121 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.125+0000 7f0cd05a09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:45.121 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.125+0000 7f0cd05a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:45.122 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.125+0000 7f0cd05a09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:45.122 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.125+0000 7f0cd05a09c0 20 zone default found 2024-09-14T11:29:45.122 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.125+0000 7f0cd05a09c0 4 Realm: () 2024-09-14T11:29:45.122 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.125+0000 7f0cd05a09c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:29:45.122 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.125+0000 7f0cd05a09c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:29:45.122 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.125+0000 7f0cd05a09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:45.122 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.125+0000 7f0cd05a09c0 20 zonegroup default 2024-09-14T11:29:45.122 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.125+0000 7f0cd05a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:45.123 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.125+0000 7f0cd05a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:45.123 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.125+0000 7f0cd05a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:45.123 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.125+0000 7f0cd05a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:45.123 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.125+0000 7f0cd05a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:45.124 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.125+0000 7f0cd05a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:45.124 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.125+0000 7f0cd05a09c0 20 started sync module instance, tier type = 2024-09-14T11:29:45.124 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.125+0000 7f0cd05a09c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:29:45.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.145+0000 7f0cd05a09c0 20 add_watcher() i=0 2024-09-14T11:29:45.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.145+0000 7f0cd05a09c0 20 add_watcher() i=1 2024-09-14T11:29:45.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.145+0000 7f0cd05a09c0 20 add_watcher() i=2 2024-09-14T11:29:45.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.145+0000 7f0cd05a09c0 20 add_watcher() i=3 2024-09-14T11:29:45.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.145+0000 7f0cd05a09c0 20 add_watcher() i=4 2024-09-14T11:29:45.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.145+0000 7f0cd05a09c0 20 add_watcher() i=5 2024-09-14T11:29:45.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.145+0000 7f0cd05a09c0 20 add_watcher() i=6 2024-09-14T11:29:45.147 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.149+0000 7f0cd05a09c0 20 add_watcher() i=7 2024-09-14T11:29:45.147 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.149+0000 7f0cd05a09c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:45.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.153+0000 7f0b84fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:45.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.153+0000 7f0cd05a09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:45.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.153+0000 7f0cd05a09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:45.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.153+0000 7f0cd05a09c0 5 note: GC not initialized 2024-09-14T11:29:45.152 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.153+0000 7f0aff7fe640 20 reqs_thread_entry: start 2024-09-14T11:29:45.152 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.153+0000 7f0cd05a09c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:45.152 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.153+0000 7f0cd05a09c0 20 Filter name: none 2024-09-14T11:29:45.153 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.153+0000 7f0afd7fa640 20 reqs_thread_entry: start 2024-09-14T11:29:45.153 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.157+0000 7f0cd05a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:45.154 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.157+0000 7f0cd05a09c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:29:45.154 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.157+0000 7f0cd05a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:45.155 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.157+0000 7f0cd05a09c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:29:45.155 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.157+0000 7f0cd05a09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:45.155 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.157+0000 7f0cd05a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:45.156 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.157+0000 7f0cd05a09c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:29:45.156 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.157+0000 7f0cd05a09c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:45.157 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.161+0000 7f0cd05a09c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:29:45.157 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.161+0000 7f0cd05a09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:45.160 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.161+0000 7f0b84fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:45.164 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.165+0000 7f0cd05a09c0 20 remove_watcher() i=0 2024-09-14T11:29:45.164 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.165+0000 7f0cd05a09c0 2 removed watcher, disabling cache 2024-09-14T11:29:45.166 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.169+0000 7f0cd05a09c0 20 remove_watcher() i=1 2024-09-14T11:29:45.168 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.169+0000 7f0cd05a09c0 20 remove_watcher() i=2 2024-09-14T11:29:45.170 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.173+0000 7f0cd05a09c0 20 remove_watcher() i=3 2024-09-14T11:29:45.172 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.173+0000 7f0cd05a09c0 20 remove_watcher() i=4 2024-09-14T11:29:45.174 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.177+0000 7f0cd05a09c0 20 remove_watcher() i=5 2024-09-14T11:29:45.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.181+0000 7f0cd05a09c0 20 remove_watcher() i=6 2024-09-14T11:29:45.179 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.181+0000 7f0cd05a09c0 20 remove_watcher() i=7 2024-09-14T11:29:45.196 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:45.196 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:29:45.196 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: error-at-set-target-layout id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.23 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:29:45.196 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:45.300 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-14T11:29:45.301 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:45.671 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:29:45.703 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:45.703 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:45.748 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.749+0000 7f651bb509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:45.750 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.753+0000 7f651bb509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:45.750 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.753+0000 7f651bb509c0 20 realm 2024-09-14T11:29:45.751 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.753+0000 7f651bb509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:45.751 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.753+0000 7f651bb509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:45.751 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.753+0000 7f651bb509c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:45.751 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.753+0000 7f651bb509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:45.752 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.753+0000 7f651bb509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:45.752 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.753+0000 7f651bb509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:45.752 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.753+0000 7f651bb509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:45.752 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.753+0000 7f651bb509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:45.753 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.757+0000 7f651bb509c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:45.753 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.757+0000 7f651bb509c0 20 searching for the correct realm 2024-09-14T11:29:45.758 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.761+0000 7f6519656640 0 -- 172.21.15.71:0/4126563146 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x5584ade8cca0 msgr2=0x5584ade8f160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:45.764 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.765+0000 7f6519656640 0 -- 172.21.15.71:0/4126563146 >> [v2:172.21.15.157:6816/1231501119,v1:172.21.15.157:6817/1231501119] conn(0x5584ade804a0 msgr2=0x5584ade82940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:29:45.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.777+0000 7f651bb509c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:45.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.777+0000 7f651bb509c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:29:45.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.777+0000 7f651bb509c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:45.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.777+0000 7f651bb509c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:29:45.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.777+0000 7f651bb509c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:45.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.777+0000 7f651bb509c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:45.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.777+0000 7f651bb509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:45.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.777+0000 7f651bb509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:45.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.777+0000 7f651bb509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:45.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.777+0000 7f651bb509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:45.775 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.777+0000 7f651bb509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:45.775 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.777+0000 7f651bb509c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:45.775 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.777+0000 7f651bb509c0 20 zone default found 2024-09-14T11:29:45.775 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.777+0000 7f651bb509c0 4 Realm: () 2024-09-14T11:29:45.775 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.777+0000 7f651bb509c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:29:45.775 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.777+0000 7f651bb509c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:29:45.776 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.777+0000 7f651bb509c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:45.776 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.777+0000 7f651bb509c0 20 zonegroup default 2024-09-14T11:29:45.776 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.777+0000 7f651bb509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:45.776 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.777+0000 7f651bb509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:45.777 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.777+0000 7f651bb509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:45.777 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.777+0000 7f651bb509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:45.777 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.777+0000 7f651bb509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:45.777 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.777+0000 7f651bb509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:45.777 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.777+0000 7f651bb509c0 20 started sync module instance, tier type = 2024-09-14T11:29:45.777 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.777+0000 7f651bb509c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:29:45.795 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.797+0000 7f651bb509c0 20 add_watcher() i=0 2024-09-14T11:29:45.795 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.797+0000 7f651bb509c0 20 add_watcher() i=1 2024-09-14T11:29:45.795 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.797+0000 7f651bb509c0 20 add_watcher() i=2 2024-09-14T11:29:45.795 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.797+0000 7f651bb509c0 20 add_watcher() i=3 2024-09-14T11:29:45.795 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.797+0000 7f651bb509c0 20 add_watcher() i=4 2024-09-14T11:29:45.795 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.797+0000 7f651bb509c0 20 add_watcher() i=5 2024-09-14T11:29:45.795 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.797+0000 7f651bb509c0 20 add_watcher() i=6 2024-09-14T11:29:45.797 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.801+0000 7f651bb509c0 20 add_watcher() i=7 2024-09-14T11:29:45.797 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.801+0000 7f651bb509c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:45.801 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.805+0000 7f63cffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:45.801 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.805+0000 7f651bb509c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:45.801 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.805+0000 7f651bb509c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:45.801 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.805+0000 7f651bb509c0 5 note: GC not initialized 2024-09-14T11:29:45.802 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.805+0000 7f63cefe5640 20 reqs_thread_entry: start 2024-09-14T11:29:45.802 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.805+0000 7f651bb509c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:45.802 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.805+0000 7f651bb509c0 20 Filter name: none 2024-09-14T11:29:45.802 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.805+0000 7f63ccfe1640 20 reqs_thread_entry: start 2024-09-14T11:29:45.802 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.805+0000 7f651bb509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:45.803 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.805+0000 7f651bb509c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:29:45.803 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.805+0000 7f651bb509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:45.803 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.805+0000 7f651bb509c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:29:45.803 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.805+0000 7f651bb509c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:45.803 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.805+0000 7f651bb509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:45.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.809+0000 7f651bb509c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:29:45.805 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.809+0000 7f651bb509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:45.805 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.809+0000 7f651bb509c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:29:45.805 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.809+0000 7f651bb509c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:45.808 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.809+0000 7f63cffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:45.811 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.813+0000 7f651bb509c0 20 remove_watcher() i=0 2024-09-14T11:29:45.811 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.813+0000 7f651bb509c0 2 removed watcher, disabling cache 2024-09-14T11:29:45.813 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.817+0000 7f651bb509c0 20 remove_watcher() i=1 2024-09-14T11:29:45.815 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.817+0000 7f651bb509c0 20 remove_watcher() i=2 2024-09-14T11:29:45.817 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.821+0000 7f651bb509c0 20 remove_watcher() i=3 2024-09-14T11:29:45.819 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.821+0000 7f651bb509c0 20 remove_watcher() i=4 2024-09-14T11:29:45.821 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.825+0000 7f651bb509c0 20 remove_watcher() i=5 2024-09-14T11:29:45.823 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.825+0000 7f651bb509c0 20 remove_watcher() i=6 2024-09-14T11:29:45.826 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.829+0000 7f651bb509c0 20 remove_watcher() i=7 2024-09-14T11:29:45.840 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:45.840 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:29:45.840 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: error-at-set-target-layout id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:29:45.841 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:45.841 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-14T11:29:45.876 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:45.876 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:45.920 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.925+0000 7fcea28269c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:45.923 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.925+0000 7fcea28269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:45.923 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.925+0000 7fcea28269c0 20 realm 2024-09-14T11:29:45.923 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.925+0000 7fcea28269c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:45.924 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.925+0000 7fcea28269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:45.924 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.925+0000 7fcea28269c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:45.924 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.925+0000 7fcea28269c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:45.924 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.925+0000 7fcea28269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:45.924 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.925+0000 7fcea28269c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:45.925 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.929+0000 7fcea28269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:45.925 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.929+0000 7fcea28269c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:45.926 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.929+0000 7fcea28269c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:45.926 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.929+0000 7fcea28269c0 20 searching for the correct realm 2024-09-14T11:29:45.930 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:45.933+0000 7fcea0b2d640 0 -- 172.21.15.71:0/266110724 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fce94008040 msgr2=0x7fce94045940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:29:46.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.145+0000 7fcea0b2d640 0 -- 172.21.15.71:0/266110724 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x556c9b06f3b0 msgr2=0x556c9b0717a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:29:46.158 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.161+0000 7fcea28269c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:46.158 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.161+0000 7fcea28269c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:29:46.158 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.161+0000 7fcea28269c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:46.158 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.161+0000 7fcea28269c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:29:46.159 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.161+0000 7fcea28269c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:46.159 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.161+0000 7fcea28269c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:46.159 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.161+0000 7fcea28269c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:46.159 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.161+0000 7fcea28269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:46.159 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.161+0000 7fcea28269c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:46.160 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.161+0000 7fcea28269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:46.160 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.161+0000 7fcea28269c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:46.160 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.161+0000 7fcea28269c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:46.161 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.161+0000 7fcea28269c0 20 zone default found 2024-09-14T11:29:46.161 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.161+0000 7fcea28269c0 4 Realm: () 2024-09-14T11:29:46.161 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.161+0000 7fcea28269c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:29:46.161 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.161+0000 7fcea28269c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:29:46.161 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.161+0000 7fcea28269c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:46.161 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.161+0000 7fcea28269c0 20 zonegroup default 2024-09-14T11:29:46.161 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.161+0000 7fcea28269c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:46.161 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.165+0000 7fcea28269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:46.161 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.165+0000 7fcea28269c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:46.162 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.165+0000 7fcea28269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:46.162 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.165+0000 7fcea28269c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:46.163 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.165+0000 7fcea28269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:46.163 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.165+0000 7fcea28269c0 20 started sync module instance, tier type = 2024-09-14T11:29:46.163 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.165+0000 7fcea28269c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:29:46.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.189+0000 7fcea28269c0 20 add_watcher() i=0 2024-09-14T11:29:46.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.189+0000 7fcea28269c0 20 add_watcher() i=1 2024-09-14T11:29:46.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.189+0000 7fcea28269c0 20 add_watcher() i=2 2024-09-14T11:29:46.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.189+0000 7fcea28269c0 20 add_watcher() i=3 2024-09-14T11:29:46.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.189+0000 7fcea28269c0 20 add_watcher() i=4 2024-09-14T11:29:46.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.189+0000 7fcea28269c0 20 add_watcher() i=5 2024-09-14T11:29:46.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.189+0000 7fcea28269c0 20 add_watcher() i=6 2024-09-14T11:29:46.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.189+0000 7fcea28269c0 20 add_watcher() i=7 2024-09-14T11:29:46.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.189+0000 7fcea28269c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:46.192 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.193+0000 7fcd56fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:46.193 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.197+0000 7fcea28269c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:46.193 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.197+0000 7fcea28269c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:46.193 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.197+0000 7fcea28269c0 5 note: GC not initialized 2024-09-14T11:29:46.194 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.197+0000 7fcd55fdb640 20 reqs_thread_entry: start 2024-09-14T11:29:46.194 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.197+0000 7fcea28269c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:46.194 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.197+0000 7fcea28269c0 20 Filter name: none 2024-09-14T11:29:46.194 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.197+0000 7fcea28269c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:29:46.194 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.197+0000 7fcea28269c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:46.194 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.197+0000 7fccc77fe640 20 reqs_thread_entry: start 2024-09-14T11:29:46.195 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.197+0000 7fcea28269c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:29:46.195 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.197+0000 7fcea28269c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:29:46.195 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.197+0000 7fcea28269c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:29:46.195 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.197+0000 7fcea28269c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.24 : miss 2024-09-14T11:29:46.195 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.197+0000 7fcea28269c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:46.196 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.197+0000 7fcea28269c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:29:46.196 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.197+0000 7fcea28269c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.24 info.flags=0x17 2024-09-14T11:29:46.196 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.197+0000 7fcea28269c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.24 to cache LRU end 2024-09-14T11:29:46.196 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.197+0000 7fcea28269c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:29:46.196 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.197+0000 7fcea28269c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:46.196 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.197+0000 7fcea28269c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.24 2024-09-14T11:29:46.204 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.205+0000 7fcea28269c0 -1 Injecting error=-125 at location=set_target_layout 2024-09-14T11:29:46.206 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.209+0000 7fcea28269c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.24 info.flags=0x17 2024-09-14T11:29:46.206 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.209+0000 7fcea28269c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.24 to cache LRU end 2024-09-14T11:29:46.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.209+0000 7fcea28269c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:46.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.209+0000 7fcea28269c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.24, ofs0, ns] 2024-09-14T11:29:46.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.209+0000 7fcd76ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464356 cookie 93924945796128 notifier 6230 bl.length()=1009 2024-09-14T11:29:46.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.209+0000 7fcd76ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.24 info.flags=0x17 2024-09-14T11:29:46.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.209+0000 7fcd76ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.24 to cache LRU end 2024-09-14T11:29:46.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.209+0000 7fcd76ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:46.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.209+0000 7fcea28269c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.24]): orig_sources= new_sources= 2024-09-14T11:29:46.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.209+0000 7fcea28269c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.24]): potential sources added=[] removed=[] 2024-09-14T11:29:46.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.209+0000 7fcea28269c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.24]): orig_dests= new_dests= 2024-09-14T11:29:46.208 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.209+0000 7fcea28269c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.24]): potential dests added=[] removed=[] 2024-09-14T11:29:46.218 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.221+0000 7fcea28269c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.1.0 2024-09-14T11:29:46.219 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.221+0000 7fcea28269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.1.0 2024-09-14T11:29:46.219 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.221+0000 7fcea28269c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.1.1 2024-09-14T11:29:46.219 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.221+0000 7fcea28269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.1.1 2024-09-14T11:29:46.219 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.221+0000 7fcea28269c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.1.2 2024-09-14T11:29:46.219 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.221+0000 7fcea28269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.1.2 2024-09-14T11:29:46.219 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.221+0000 7fcea28269c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.1.3 2024-09-14T11:29:46.219 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.221+0000 7fcea28269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.1.3 2024-09-14T11:29:46.219 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.221+0000 7fcea28269c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.1.4 2024-09-14T11:29:46.219 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.221+0000 7fcea28269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.1.4 2024-09-14T11:29:46.219 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.221+0000 7fcea28269c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.1.5 2024-09-14T11:29:46.219 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.221+0000 7fcea28269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.1.5 2024-09-14T11:29:46.219 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.221+0000 7fcea28269c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.1.6 2024-09-14T11:29:46.219 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.221+0000 7fcea28269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.1.6 2024-09-14T11:29:46.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.221+0000 7fcea28269c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.1.7 2024-09-14T11:29:46.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.221+0000 7fcea28269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.1.7 2024-09-14T11:29:46.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.221+0000 7fcea28269c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.1.8 2024-09-14T11:29:46.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.221+0000 7fcea28269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.1.8 2024-09-14T11:29:46.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.221+0000 7fcea28269c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.1.9 2024-09-14T11:29:46.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.221+0000 7fcea28269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.1.9 2024-09-14T11:29:46.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.221+0000 7fcea28269c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.1.10 2024-09-14T11:29:46.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.221+0000 7fcea28269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.1.10 2024-09-14T11:29:46.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.221+0000 7fcea28269c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.1.11 2024-09-14T11:29:46.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.221+0000 7fcea28269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.1.11 2024-09-14T11:29:46.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.221+0000 7fcea28269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.0 2024-09-14T11:29:46.221 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.221+0000 7fcea28269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.1 2024-09-14T11:29:46.221 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.225+0000 7fcea28269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.2 2024-09-14T11:29:46.222 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.225+0000 7fcea28269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.3 2024-09-14T11:29:46.222 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.225+0000 7fcea28269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.4 2024-09-14T11:29:46.223 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.225+0000 7fcea28269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.5 2024-09-14T11:29:46.225 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.229+0000 7fcea28269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.6 2024-09-14T11:29:46.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.229+0000 7fcea28269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.7 2024-09-14T11:29:46.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.229+0000 7fcea28269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.8 2024-09-14T11:29:46.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.229+0000 7fcea28269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.9 2024-09-14T11:29:46.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.229+0000 7fcea28269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.10 2024-09-14T11:29:46.235 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.237+0000 7fcea28269c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.24 : hit (requested=0x17, cached=0x17) 2024-09-14T11:29:46.235 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.237+0000 7fcea28269c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.24 2024-09-14T11:29:46.237 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.241+0000 7fcea28269c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.24 info.flags=0x17 2024-09-14T11:29:46.237 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.241+0000 7fcea28269c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.24 to cache LRU end 2024-09-14T11:29:46.238 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.241+0000 7fcea28269c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:46.238 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.241+0000 7fcea28269c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.24, ofs0, ns] 2024-09-14T11:29:46.238 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.241+0000 7fcd777fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464357 cookie 93924945796128 notifier 6230 bl.length()=1009 2024-09-14T11:29:46.238 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.241+0000 7fcd777fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.24 info.flags=0x17 2024-09-14T11:29:46.238 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.241+0000 7fcd777fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.24 to cache LRU end 2024-09-14T11:29:46.238 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.241+0000 7fcd777fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:46.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.241+0000 7fcea28269c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.24]): orig_sources= new_sources= 2024-09-14T11:29:46.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.241+0000 7fcea28269c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.24]): potential sources added=[] removed=[] 2024-09-14T11:29:46.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.241+0000 7fcea28269c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.24]): orig_dests= new_dests= 2024-09-14T11:29:46.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.241+0000 7fcea28269c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.24]): potential dests added=[] removed=[] 2024-09-14T11:29:46.244 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.245+0000 7fcea28269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.0 2024-09-14T11:29:46.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.249+0000 7fcea28269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.1 2024-09-14T11:29:46.246 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.249+0000 7fcea28269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.2 2024-09-14T11:29:46.247 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.249+0000 7fcea28269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.3 2024-09-14T11:29:46.247 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.249+0000 7fcea28269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.4 2024-09-14T11:29:46.248 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.249+0000 7fcea28269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.5 2024-09-14T11:29:46.248 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.253+0000 7fcea28269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.6 2024-09-14T11:29:46.249 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.253+0000 7fcea28269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.7 2024-09-14T11:29:46.250 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.253+0000 7fcea28269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.8 2024-09-14T11:29:46.250 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.253+0000 7fcea28269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.9 2024-09-14T11:29:46.251 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.253+0000 7fcea28269c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.24.10 2024-09-14T11:29:46.251 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.253+0000 7fcea28269c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.24 : hit (requested=0x17, cached=0x17) 2024-09-14T11:29:46.252 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.253+0000 7fcea28269c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.24 2024-09-14T11:29:46.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.257+0000 7fcea28269c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.24 info.flags=0x17 2024-09-14T11:29:46.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.257+0000 7fcea28269c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.24 to cache LRU end 2024-09-14T11:29:46.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.257+0000 7fcea28269c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:46.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.257+0000 7fcea28269c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.24, ofs0, ns] 2024-09-14T11:29:46.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.257+0000 7fcd76ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464358 cookie 93924945796128 notifier 6230 bl.length()=977 2024-09-14T11:29:46.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.257+0000 7fcd76ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.24 info.flags=0x17 2024-09-14T11:29:46.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.257+0000 7fcd76ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.24 to cache LRU end 2024-09-14T11:29:46.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.257+0000 7fcd76ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:46.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.257+0000 7fcea28269c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.24]): orig_sources= new_sources= 2024-09-14T11:29:46.256 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.257+0000 7fcea28269c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.24]): potential sources added=[] removed=[] 2024-09-14T11:29:46.256 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.257+0000 7fcea28269c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.24]): orig_dests= new_dests= 2024-09-14T11:29:46.256 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.257+0000 7fcea28269c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.24]): potential dests added=[] removed=[] 2024-09-14T11:29:46.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.261+0000 7fcea28269c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:29:46.263 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.265+0000 7fcd56fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:46.268 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.269+0000 7fcea28269c0 20 remove_watcher() i=0 2024-09-14T11:29:46.268 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.269+0000 7fcea28269c0 2 removed watcher, disabling cache 2024-09-14T11:29:46.270 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.273+0000 7fcea28269c0 20 remove_watcher() i=1 2024-09-14T11:29:46.273 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.277+0000 7fcea28269c0 20 remove_watcher() i=2 2024-09-14T11:29:46.275 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.277+0000 7fcea28269c0 20 remove_watcher() i=3 2024-09-14T11:29:46.277 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.281+0000 7fcea28269c0 20 remove_watcher() i=4 2024-09-14T11:29:46.279 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.281+0000 7fcea28269c0 20 remove_watcher() i=5 2024-09-14T11:29:46.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.285+0000 7fcea28269c0 20 remove_watcher() i=6 2024-09-14T11:29:46.285 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.289+0000 7fcea28269c0 20 remove_watcher() i=7 2024-09-14T11:29:46.301 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:29:46.332 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:46.332 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:46.377 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.381+0000 7fab7ab1b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:46.379 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.381+0000 7fab7ab1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:46.379 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.381+0000 7fab7ab1b9c0 20 realm 2024-09-14T11:29:46.379 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.381+0000 7fab7ab1b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:46.380 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.381+0000 7fab7ab1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:46.380 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.381+0000 7fab7ab1b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:46.380 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.381+0000 7fab7ab1b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:46.380 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.381+0000 7fab7ab1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:46.380 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.381+0000 7fab7ab1b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:46.381 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.385+0000 7fab7ab1b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:46.381 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.385+0000 7fab7ab1b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:46.382 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.385+0000 7fab7ab1b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:46.382 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.385+0000 7fab7ab1b9c0 20 searching for the correct realm 2024-09-14T11:29:46.386 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.389+0000 7fab78e22640 0 -- 172.21.15.71:0/758313766 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fab6c018070 msgr2=0x7fab6c074970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:46.601 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.601+0000 7fab78e22640 0 -- 172.21.15.71:0/758313766 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55c6de881240 msgr2=0x55c6de883630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:46.614 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.617+0000 7fab7ab1b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:46.614 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.617+0000 7fab7ab1b9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:29:46.614 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.617+0000 7fab7ab1b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:46.614 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.617+0000 7fab7ab1b9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:29:46.615 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.617+0000 7fab7ab1b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:46.615 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.617+0000 7fab7ab1b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:46.615 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.617+0000 7fab7ab1b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:46.615 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.617+0000 7fab7ab1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:46.615 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.617+0000 7fab7ab1b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:46.616 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.617+0000 7fab7ab1b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:46.616 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.617+0000 7fab7ab1b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:46.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.621+0000 7fab7ab1b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:46.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.621+0000 7fab7ab1b9c0 20 zone default found 2024-09-14T11:29:46.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.621+0000 7fab7ab1b9c0 4 Realm: () 2024-09-14T11:29:46.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.621+0000 7fab7ab1b9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:29:46.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.621+0000 7fab7ab1b9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:29:46.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.621+0000 7fab7ab1b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:46.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.621+0000 7fab7ab1b9c0 20 zonegroup default 2024-09-14T11:29:46.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.621+0000 7fab7ab1b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:46.618 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.621+0000 7fab7ab1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:46.618 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.621+0000 7fab7ab1b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:46.618 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.621+0000 7fab7ab1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:46.618 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.621+0000 7fab7ab1b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:46.619 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.621+0000 7fab7ab1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:46.619 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.621+0000 7fab7ab1b9c0 20 started sync module instance, tier type = 2024-09-14T11:29:46.619 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.621+0000 7fab7ab1b9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:29:46.641 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.645+0000 7fab7ab1b9c0 20 add_watcher() i=0 2024-09-14T11:29:46.641 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.645+0000 7fab7ab1b9c0 20 add_watcher() i=1 2024-09-14T11:29:46.641 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.645+0000 7fab7ab1b9c0 20 add_watcher() i=2 2024-09-14T11:29:46.641 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.645+0000 7fab7ab1b9c0 20 add_watcher() i=3 2024-09-14T11:29:46.641 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.645+0000 7fab7ab1b9c0 20 add_watcher() i=4 2024-09-14T11:29:46.641 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.645+0000 7fab7ab1b9c0 20 add_watcher() i=5 2024-09-14T11:29:46.642 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.645+0000 7fab7ab1b9c0 20 add_watcher() i=6 2024-09-14T11:29:46.644 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.645+0000 7fab7ab1b9c0 20 add_watcher() i=7 2024-09-14T11:29:46.644 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.645+0000 7fab7ab1b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:46.648 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.649+0000 7faa2efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:46.649 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.653+0000 7fab7ab1b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:46.649 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.653+0000 7fab7ab1b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:46.649 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.653+0000 7fab7ab1b9c0 5 note: GC not initialized 2024-09-14T11:29:46.650 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.653+0000 7faa2dfdb640 20 reqs_thread_entry: start 2024-09-14T11:29:46.650 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.653+0000 7fab7ab1b9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:46.650 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.653+0000 7fab7ab1b9c0 20 Filter name: none 2024-09-14T11:29:46.650 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.653+0000 7fa99f7fe640 20 reqs_thread_entry: start 2024-09-14T11:29:46.651 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.653+0000 7fab7ab1b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:46.651 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.653+0000 7fab7ab1b9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:29:46.651 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.653+0000 7fab7ab1b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:46.652 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.653+0000 7fab7ab1b9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:29:46.652 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.653+0000 7fab7ab1b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:46.653 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.653+0000 7fab7ab1b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:46.653 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.657+0000 7fab7ab1b9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:29:46.653 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.657+0000 7fab7ab1b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:46.654 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.657+0000 7fab7ab1b9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:29:46.654 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.657+0000 7fab7ab1b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:46.658 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.661+0000 7faa2efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:46.661 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.665+0000 7fab7ab1b9c0 20 remove_watcher() i=0 2024-09-14T11:29:46.662 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.665+0000 7fab7ab1b9c0 2 removed watcher, disabling cache 2024-09-14T11:29:46.664 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.665+0000 7fab7ab1b9c0 20 remove_watcher() i=1 2024-09-14T11:29:46.665 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.669+0000 7fab7ab1b9c0 20 remove_watcher() i=2 2024-09-14T11:29:46.668 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.669+0000 7fab7ab1b9c0 20 remove_watcher() i=3 2024-09-14T11:29:46.670 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.673+0000 7fab7ab1b9c0 20 remove_watcher() i=4 2024-09-14T11:29:46.672 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.673+0000 7fab7ab1b9c0 20 remove_watcher() i=5 2024-09-14T11:29:46.675 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.677+0000 7fab7ab1b9c0 20 remove_watcher() i=6 2024-09-14T11:29:46.678 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:46.681+0000 7fab7ab1b9c0 20 remove_watcher() i=7 2024-09-14T11:29:46.693 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:46.693 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:29:46.693 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: error-at-set-target-layout id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.24 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:29:46.693 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:46.812 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-14T11:29:46.812 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:47.211 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:29:47.245 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:47.246 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:47.291 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.293+0000 7fca0e6b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:47.499 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.500+0000 7fca0e6b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:47.499 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.500+0000 7fca0e6b89c0 20 realm 2024-09-14T11:29:47.499 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.500+0000 7fca0e6b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:47.499 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.500+0000 7fca0e6b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:47.500 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.500+0000 7fca0e6b89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:47.500 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.500+0000 7fca0e6b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:47.500 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.500+0000 7fca0e6b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:47.500 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.500+0000 7fca0e6b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:47.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.504+0000 7fca0e6b89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:47.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.504+0000 7fca0e6b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:47.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.504+0000 7fca0e6b89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:47.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.504+0000 7fca0e6b89c0 20 searching for the correct realm 2024-09-14T11:29:47.509 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.512+0000 7fca0c9bf640 0 -- 172.21.15.71:0/2823901289 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fca00017020 msgr2=0x7fca000927f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:47.725 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.728+0000 7fca0c9bf640 0 -- 172.21.15.71:0/2823901289 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x555a3f4a64e0 msgr2=0x555a3f4a88d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:47.740 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.740+0000 7fca0e6b89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:47.740 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.740+0000 7fca0e6b89c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:29:47.740 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.740+0000 7fca0e6b89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:47.741 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.740+0000 7fca0e6b89c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:29:47.741 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.740+0000 7fca0e6b89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:47.741 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.740+0000 7fca0e6b89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:47.741 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.740+0000 7fca0e6b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:47.741 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.744+0000 7fca0e6b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:47.741 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.744+0000 7fca0e6b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:47.742 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.744+0000 7fca0e6b89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:47.742 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.744+0000 7fca0e6b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:47.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.744+0000 7fca0e6b89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:47.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.744+0000 7fca0e6b89c0 20 zone default found 2024-09-14T11:29:47.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.744+0000 7fca0e6b89c0 4 Realm: () 2024-09-14T11:29:47.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.744+0000 7fca0e6b89c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:29:47.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.744+0000 7fca0e6b89c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:29:47.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.744+0000 7fca0e6b89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:47.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.744+0000 7fca0e6b89c0 20 zonegroup default 2024-09-14T11:29:47.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.744+0000 7fca0e6b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:47.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.744+0000 7fca0e6b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:47.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.744+0000 7fca0e6b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:47.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.744+0000 7fca0e6b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:47.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.744+0000 7fca0e6b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:47.746 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.748+0000 7fca0e6b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:47.746 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.748+0000 7fca0e6b89c0 20 started sync module instance, tier type = 2024-09-14T11:29:47.746 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.748+0000 7fca0e6b89c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:29:47.769 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.772+0000 7fca0e6b89c0 20 add_watcher() i=0 2024-09-14T11:29:47.769 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.772+0000 7fca0e6b89c0 20 add_watcher() i=1 2024-09-14T11:29:47.770 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.772+0000 7fca0e6b89c0 20 add_watcher() i=2 2024-09-14T11:29:47.770 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.772+0000 7fca0e6b89c0 20 add_watcher() i=3 2024-09-14T11:29:47.770 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.772+0000 7fca0e6b89c0 20 add_watcher() i=4 2024-09-14T11:29:47.770 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.772+0000 7fca0e6b89c0 20 add_watcher() i=5 2024-09-14T11:29:47.770 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.772+0000 7fca0e6b89c0 20 add_watcher() i=6 2024-09-14T11:29:47.772 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.772+0000 7fca0e6b89c0 20 add_watcher() i=7 2024-09-14T11:29:47.772 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.772+0000 7fca0e6b89c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:47.776 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.776+0000 7fc8c2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:47.777 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.780+0000 7fca0e6b89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:47.777 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.780+0000 7fca0e6b89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:47.777 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.780+0000 7fca0e6b89c0 5 note: GC not initialized 2024-09-14T11:29:47.778 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.780+0000 7fc8c1fdb640 20 reqs_thread_entry: start 2024-09-14T11:29:47.778 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.780+0000 7fca0e6b89c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:47.778 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.780+0000 7fca0e6b89c0 20 Filter name: none 2024-09-14T11:29:47.778 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.780+0000 7fc8337fe640 20 reqs_thread_entry: start 2024-09-14T11:29:47.778 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.780+0000 7fca0e6b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:47.779 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.780+0000 7fca0e6b89c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:29:47.779 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.780+0000 7fca0e6b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:47.780 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.780+0000 7fca0e6b89c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:29:47.780 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.780+0000 7fca0e6b89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:47.781 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.780+0000 7fca0e6b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:47.781 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.780+0000 7fca0e6b89c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:29:47.781 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.780+0000 7fca0e6b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:47.781 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.784+0000 7fca0e6b89c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:29:47.781 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.784+0000 7fca0e6b89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:47.784 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.784+0000 7fc8c2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:47.788 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.788+0000 7fca0e6b89c0 20 remove_watcher() i=0 2024-09-14T11:29:47.788 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.788+0000 7fca0e6b89c0 2 removed watcher, disabling cache 2024-09-14T11:29:47.790 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.792+0000 7fca0e6b89c0 20 remove_watcher() i=1 2024-09-14T11:29:47.792 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.792+0000 7fca0e6b89c0 20 remove_watcher() i=2 2024-09-14T11:29:47.794 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.796+0000 7fca0e6b89c0 20 remove_watcher() i=3 2024-09-14T11:29:47.795 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.796+0000 7fca0e6b89c0 20 remove_watcher() i=4 2024-09-14T11:29:47.797 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.800+0000 7fca0e6b89c0 20 remove_watcher() i=5 2024-09-14T11:29:47.800 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.800+0000 7fca0e6b89c0 20 remove_watcher() i=6 2024-09-14T11:29:47.803 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.804+0000 7fca0e6b89c0 20 remove_watcher() i=7 2024-09-14T11:29:47.819 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:47.819 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:29:47.819 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: abort-at-set-target-layout id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:29:47.819 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:47.819 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-14T11:29:47.851 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:47.852 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:47.895 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.896+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:47.897 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.900+0000 7fb05a0509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:47.897 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.900+0000 7fb05a0509c0 20 realm 2024-09-14T11:29:47.897 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.900+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:47.898 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.900+0000 7fb05a0509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:47.898 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.900+0000 7fb05a0509c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:47.898 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.900+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:47.898 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.900+0000 7fb05a0509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:47.898 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.900+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:47.899 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.900+0000 7fb05a0509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:47.899 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.900+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:47.900 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.900+0000 7fb05a0509c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:47.900 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.900+0000 7fb05a0509c0 20 searching for the correct realm 2024-09-14T11:29:47.904 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.904+0000 7fb058357640 0 -- 172.21.15.71:0/1336183276 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fb04004d020 msgr2=0x7fb040075150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:47.910 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.912+0000 7fb057355640 0 -- 172.21.15.71:0/1336183276 >> [v2:172.21.15.157:6800/3420822707,v1:172.21.15.157:6801/3420822707] conn(0x7fb040008040 msgr2=0x7fb040035a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:47.919 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.920+0000 7fb05a0509c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:47.919 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.920+0000 7fb05a0509c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:29:47.919 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.920+0000 7fb05a0509c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:47.919 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.920+0000 7fb05a0509c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:29:47.919 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.920+0000 7fb05a0509c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:47.920 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.920+0000 7fb05a0509c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:47.920 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.920+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:47.920 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.920+0000 7fb05a0509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:47.920 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.920+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:47.920 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.920+0000 7fb05a0509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:47.921 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.920+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:47.921 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.924+0000 7fb05a0509c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:47.921 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.924+0000 7fb05a0509c0 20 zone default found 2024-09-14T11:29:47.921 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.924+0000 7fb05a0509c0 4 Realm: () 2024-09-14T11:29:47.921 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.924+0000 7fb05a0509c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:29:47.921 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.924+0000 7fb05a0509c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:29:47.922 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.924+0000 7fb05a0509c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:47.922 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.924+0000 7fb05a0509c0 20 zonegroup default 2024-09-14T11:29:47.922 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.924+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:47.922 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.924+0000 7fb05a0509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:47.922 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.924+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:47.922 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.924+0000 7fb05a0509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:47.922 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.924+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:47.922 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.924+0000 7fb05a0509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:47.923 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.924+0000 7fb05a0509c0 20 started sync module instance, tier type = 2024-09-14T11:29:47.923 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.924+0000 7fb05a0509c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:29:47.940 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.940+0000 7fb05a0509c0 20 add_watcher() i=0 2024-09-14T11:29:47.940 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.940+0000 7fb05a0509c0 20 add_watcher() i=1 2024-09-14T11:29:47.940 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.940+0000 7fb05a0509c0 20 add_watcher() i=2 2024-09-14T11:29:47.940 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.940+0000 7fb05a0509c0 20 add_watcher() i=3 2024-09-14T11:29:47.941 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.940+0000 7fb05a0509c0 20 add_watcher() i=4 2024-09-14T11:29:47.941 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.940+0000 7fb05a0509c0 20 add_watcher() i=5 2024-09-14T11:29:47.941 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.940+0000 7fb05a0509c0 20 add_watcher() i=6 2024-09-14T11:29:47.942 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.944+0000 7fb05a0509c0 20 add_watcher() i=7 2024-09-14T11:29:47.943 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.944+0000 7fb05a0509c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:47.945 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.948+0000 7faf0dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:47.946 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.948+0000 7fb05a0509c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:47.946 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.948+0000 7fb05a0509c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:47.947 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 note: GC not initialized 2024-09-14T11:29:47.947 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.948+0000 7faf0cfe1640 20 reqs_thread_entry: start 2024-09-14T11:29:47.947 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.948+0000 7fb05a0509c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:47.947 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.948+0000 7fb05a0509c0 20 Filter name: none 2024-09-14T11:29:47.947 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.948+0000 7fae867fc640 20 reqs_thread_entry: start 2024-09-14T11:29:47.947 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.948+0000 7fb05a0509c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:29:47.947 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.948+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:47.947 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.948+0000 7fb05a0509c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:29:47.947 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.948+0000 7fb05a0509c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:29:47.948 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.948+0000 7fb05a0509c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:29:47.948 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.948+0000 7fb05a0509c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 : miss 2024-09-14T11:29:47.948 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.948+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:47.948 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.948+0000 7fb05a0509c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:29:47.948 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.948+0000 7fb05a0509c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 info.flags=0x17 2024-09-14T11:29:47.948 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.948+0000 7fb05a0509c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 to cache LRU end 2024-09-14T11:29:47.948 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.948+0000 7fb05a0509c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:29:47.948 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.948+0000 7fb05a0509c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:47.949 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.948+0000 7fb05a0509c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 2024-09-14T11:29:47.956 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb05a0509c0 time 2024-09-14T11:29:47.961699+0000 2024-09-14T11:29:47.956 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:29:47.958 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:29:47.958 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fb05d92a2eb] 2024-09-14T11:29:47.958 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb05d92a49f] 2024-09-14T11:29:47.958 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b5b71f7c01] 2024-09-14T11:29:47.958 INFO:tasks.workunit.client.0.smithi071.stderr: 4: radosgw-admin(+0x1422828) [0x55b5b7c55828] 2024-09-14T11:29:47.958 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b5b720cecd] 2024-09-14T11:29:47.958 INFO:tasks.workunit.client.0.smithi071.stderr: 6: main() 2024-09-14T11:29:47.958 INFO:tasks.workunit.client.0.smithi071.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb05c790d90] 2024-09-14T11:29:47.958 INFO:tasks.workunit.client.0.smithi071.stderr: 8: __libc_start_main() 2024-09-14T11:29:47.958 INFO:tasks.workunit.client.0.smithi071.stderr: 9: _start() 2024-09-14T11:29:47.958 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.960+0000 7fb05a0509c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb05a0509c0 time 2024-09-14T11:29:47.961699+0000 2024-09-14T11:29:47.958 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:29:47.958 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:47.959 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:29:47.959 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fb05d92a2eb] 2024-09-14T11:29:47.959 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb05d92a49f] 2024-09-14T11:29:47.959 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b5b71f7c01] 2024-09-14T11:29:47.959 INFO:tasks.workunit.client.0.smithi071.stderr: 4: radosgw-admin(+0x1422828) [0x55b5b7c55828] 2024-09-14T11:29:47.959 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b5b720cecd] 2024-09-14T11:29:47.959 INFO:tasks.workunit.client.0.smithi071.stderr: 6: main() 2024-09-14T11:29:47.959 INFO:tasks.workunit.client.0.smithi071.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb05c790d90] 2024-09-14T11:29:47.959 INFO:tasks.workunit.client.0.smithi071.stderr: 8: __libc_start_main() 2024-09-14T11:29:47.959 INFO:tasks.workunit.client.0.smithi071.stderr: 9: _start() 2024-09-14T11:29:47.959 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:47.959 INFO:tasks.workunit.client.0.smithi071.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:29:47.960 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7fb05a0509c0 thread_name:radosgw-admin 2024-09-14T11:29:47.975 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:29:47.975 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fb05c7a9520] 2024-09-14T11:29:47.975 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:29:47.975 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:29:47.975 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:29:47.975 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fb05d92a345] 2024-09-14T11:29:47.975 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb05d92a49f] 2024-09-14T11:29:47.976 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b5b71f7c01] 2024-09-14T11:29:47.976 INFO:tasks.workunit.client.0.smithi071.stderr: 8: radosgw-admin(+0x1422828) [0x55b5b7c55828] 2024-09-14T11:29:47.976 INFO:tasks.workunit.client.0.smithi071.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b5b720cecd] 2024-09-14T11:29:47.976 INFO:tasks.workunit.client.0.smithi071.stderr: 10: main() 2024-09-14T11:29:47.976 INFO:tasks.workunit.client.0.smithi071.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb05c790d90] 2024-09-14T11:29:47.976 INFO:tasks.workunit.client.0.smithi071.stderr: 12: __libc_start_main() 2024-09-14T11:29:47.976 INFO:tasks.workunit.client.0.smithi071.stderr: 13: _start() 2024-09-14T11:29:47.976 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:47.960+0000 7fb05a0509c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:29:47.976 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7fb05a0509c0 thread_name:radosgw-admin 2024-09-14T11:29:47.976 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:47.976 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:29:47.976 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fb05c7a9520] 2024-09-14T11:29:47.976 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:29:47.976 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:29:47.977 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:29:47.977 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fb05d92a345] 2024-09-14T11:29:47.977 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb05d92a49f] 2024-09-14T11:29:47.977 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b5b71f7c01] 2024-09-14T11:29:47.977 INFO:tasks.workunit.client.0.smithi071.stderr: 8: radosgw-admin(+0x1422828) [0x55b5b7c55828] 2024-09-14T11:29:47.977 INFO:tasks.workunit.client.0.smithi071.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b5b720cecd] 2024-09-14T11:29:47.977 INFO:tasks.workunit.client.0.smithi071.stderr: 10: main() 2024-09-14T11:29:47.977 INFO:tasks.workunit.client.0.smithi071.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb05c790d90] 2024-09-14T11:29:47.977 INFO:tasks.workunit.client.0.smithi071.stderr: 12: __libc_start_main() 2024-09-14T11:29:47.977 INFO:tasks.workunit.client.0.smithi071.stderr: 13: _start() 2024-09-14T11:29:47.977 INFO:tasks.workunit.client.0.smithi071.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:29:47.977 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:47.977 INFO:tasks.workunit.client.0.smithi071.stderr:--- begin dump of recent events --- 2024-09-14T11:29:47.978 INFO:tasks.workunit.client.0.smithi071.stderr: -499> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient(hunting): get_auth_request con 0x55b5b9217070 auth_method 0 2024-09-14T11:29:47.978 INFO:tasks.workunit.client.0.smithi071.stderr: -498> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:47.978 INFO:tasks.workunit.client.0.smithi071.stderr: -497> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:47.978 INFO:tasks.workunit.client.0.smithi071.stderr: -496> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:47.978 INFO:tasks.workunit.client.0.smithi071.stderr: -495> 2024-09-14T11:29:47.876+0000 7fb057355640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:47.978 INFO:tasks.workunit.client.0.smithi071.stderr: -494> 2024-09-14T11:29:47.876+0000 7fb057355640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:47.978 INFO:tasks.workunit.client.0.smithi071.stderr: -493> 2024-09-14T11:29:47.876+0000 7fb057355640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:47.978 INFO:tasks.workunit.client.0.smithi071.stderr: -492> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:47.978 INFO:tasks.workunit.client.0.smithi071.stderr: -491> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:47.978 INFO:tasks.workunit.client.0.smithi071.stderr: -490> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:47.978 INFO:tasks.workunit.client.0.smithi071.stderr: -489> 2024-09-14T11:29:47.876+0000 7fb058357640 10 monclient(hunting): get_auth_request con 0x55b5b92b06a0 auth_method 0 2024-09-14T11:29:47.978 INFO:tasks.workunit.client.0.smithi071.stderr: -488> 2024-09-14T11:29:47.876+0000 7fb058357640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:47.978 INFO:tasks.workunit.client.0.smithi071.stderr: -487> 2024-09-14T11:29:47.876+0000 7fb058357640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:47.979 INFO:tasks.workunit.client.0.smithi071.stderr: -486> 2024-09-14T11:29:47.876+0000 7fb058357640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:47.979 INFO:tasks.workunit.client.0.smithi071.stderr: -485> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient(hunting): handle_auth_done global_id 6561 payload 274 2024-09-14T11:29:47.979 INFO:tasks.workunit.client.0.smithi071.stderr: -484> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient: _finish_hunting 0 2024-09-14T11:29:47.979 INFO:tasks.workunit.client.0.smithi071.stderr: -483> 2024-09-14T11:29:47.876+0000 7fb057b56640 1 monclient: found mon.noname-a 2024-09-14T11:29:47.979 INFO:tasks.workunit.client.0.smithi071.stderr: -482> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:29:47.979 INFO:tasks.workunit.client.0.smithi071.stderr: -481> 2024-09-14T11:29:47.876+0000 7faf45e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:47.979 INFO:tasks.workunit.client.0.smithi071.stderr: -480> 2024-09-14T11:29:47.876+0000 7faf45e0b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:29:47.979 INFO:tasks.workunit.client.0.smithi071.stderr: -479> 2024-09-14T11:29:47.876+0000 7faf45e0b640 10 monclient: dump: 2024-09-14T11:29:47.979 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:47.979 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:47.979 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:47.979 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:47.979 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:47.979 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:47.979 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:47.980 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:47.980 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:47.980 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:47.980 INFO:tasks.workunit.client.0.smithi071.stderr: -478> 2024-09-14T11:29:47.876+0000 7faf45e0b640 10 monclient: _finish_auth 0 2024-09-14T11:29:47.980 INFO:tasks.workunit.client.0.smithi071.stderr: -477> 2024-09-14T11:29:47.876+0000 7faf45e0b640 10 monclient: _check_auth_tickets 2024-09-14T11:29:47.980 INFO:tasks.workunit.client.0.smithi071.stderr: -476> 2024-09-14T11:29:47.876+0000 7faf45e0b640 10 monclient: handle_config config(0 keys) 2024-09-14T11:29:47.980 INFO:tasks.workunit.client.0.smithi071.stderr: -475> 2024-09-14T11:29:47.876+0000 7faf45e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:47.980 INFO:tasks.workunit.client.0.smithi071.stderr: -474> 2024-09-14T11:29:47.876+0000 7faf45e0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:29:47.980 INFO:tasks.workunit.client.0.smithi071.stderr: -473> 2024-09-14T11:29:47.876+0000 7faf45e0b640 10 monclient: dump: 2024-09-14T11:29:47.980 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:47.980 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:47.980 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:47.980 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:47.980 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:47.981 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:47.981 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:47.981 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:47.981 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:47.981 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:47.981 INFO:tasks.workunit.client.0.smithi071.stderr: -472> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 monclient: authenticate success, global_id 6561 2024-09-14T11:29:47.981 INFO:tasks.workunit.client.0.smithi071.stderr: -471> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient: get_monmap_and_config success 2024-09-14T11:29:47.981 INFO:tasks.workunit.client.0.smithi071.stderr: -470> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 4 set_mon_vals no callback set 2024-09-14T11:29:47.981 INFO:tasks.workunit.client.0.smithi071.stderr: -469> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient: shutdown 2024-09-14T11:29:47.981 INFO:tasks.workunit.client.0.smithi071.stderr: -468> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 asok(0x55b5b915cd90) unregister_commands rotate-key 2024-09-14T11:29:47.981 INFO:tasks.workunit.client.0.smithi071.stderr: -467> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient: build_initial_monmap 2024-09-14T11:29:47.981 INFO:tasks.workunit.client.0.smithi071.stderr: -466> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 1 build_initial for_mkfs: 0 2024-09-14T11:29:47.981 INFO:tasks.workunit.client.0.smithi071.stderr: -465> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient: monmap: 2024-09-14T11:29:47.982 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:29:47.982 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:29:47.982 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:29:47.982 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:29:47.982 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:29:47.982 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:47.982 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:29:47.982 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:29:47.982 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:29:47.982 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:47.982 INFO:tasks.workunit.client.0.smithi071.stderr: -464> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b936d330) adding auth protocol: cephx 2024-09-14T11:29:47.982 INFO:tasks.workunit.client.0.smithi071.stderr: -463> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b936d330) adding auth protocol: cephx 2024-09-14T11:29:47.982 INFO:tasks.workunit.client.0.smithi071.stderr: -462> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b936d330) adding auth protocol: cephx 2024-09-14T11:29:47.982 INFO:tasks.workunit.client.0.smithi071.stderr: -461> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b936d330) adding con mode: secure 2024-09-14T11:29:47.983 INFO:tasks.workunit.client.0.smithi071.stderr: -460> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b936d330) adding con mode: crc 2024-09-14T11:29:47.983 INFO:tasks.workunit.client.0.smithi071.stderr: -459> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b936d330) adding con mode: secure 2024-09-14T11:29:47.983 INFO:tasks.workunit.client.0.smithi071.stderr: -458> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b936d330) adding con mode: crc 2024-09-14T11:29:47.983 INFO:tasks.workunit.client.0.smithi071.stderr: -457> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b936d330) adding con mode: secure 2024-09-14T11:29:47.983 INFO:tasks.workunit.client.0.smithi071.stderr: -456> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b936d330) adding con mode: crc 2024-09-14T11:29:47.983 INFO:tasks.workunit.client.0.smithi071.stderr: -455> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b936d330) adding con mode: crc 2024-09-14T11:29:47.983 INFO:tasks.workunit.client.0.smithi071.stderr: -454> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b936d330) adding con mode: secure 2024-09-14T11:29:47.983 INFO:tasks.workunit.client.0.smithi071.stderr: -453> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b936d330) adding con mode: crc 2024-09-14T11:29:47.983 INFO:tasks.workunit.client.0.smithi071.stderr: -452> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b936d330) adding con mode: secure 2024-09-14T11:29:47.983 INFO:tasks.workunit.client.0.smithi071.stderr: -451> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b936d330) adding con mode: crc 2024-09-14T11:29:47.983 INFO:tasks.workunit.client.0.smithi071.stderr: -450> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b936d330) adding con mode: secure 2024-09-14T11:29:47.983 INFO:tasks.workunit.client.0.smithi071.stderr: -449> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:47.983 INFO:tasks.workunit.client.0.smithi071.stderr: -448> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 1 librados: starting msgr at 2024-09-14T11:29:47.984 INFO:tasks.workunit.client.0.smithi071.stderr: -447> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 1 librados: starting objecter 2024-09-14T11:29:47.984 INFO:tasks.workunit.client.0.smithi071.stderr: -446> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 asok(0x55b5b915cd90) register_command objecter_requests hook 0x55b5b90d7e00 2024-09-14T11:29:47.984 INFO:tasks.workunit.client.0.smithi071.stderr: -445> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 1 librados: setting wanted keys 2024-09-14T11:29:47.984 INFO:tasks.workunit.client.0.smithi071.stderr: -444> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 1 librados: calling monclient init 2024-09-14T11:29:47.984 INFO:tasks.workunit.client.0.smithi071.stderr: -443> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient: init 2024-09-14T11:29:47.984 INFO:tasks.workunit.client.0.smithi071.stderr: -442> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9367140) adding auth protocol: cephx 2024-09-14T11:29:47.984 INFO:tasks.workunit.client.0.smithi071.stderr: -441> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9367140) adding auth protocol: cephx 2024-09-14T11:29:47.984 INFO:tasks.workunit.client.0.smithi071.stderr: -440> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9367140) adding auth protocol: cephx 2024-09-14T11:29:47.984 INFO:tasks.workunit.client.0.smithi071.stderr: -439> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9367140) adding con mode: secure 2024-09-14T11:29:47.984 INFO:tasks.workunit.client.0.smithi071.stderr: -438> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9367140) adding con mode: crc 2024-09-14T11:29:47.984 INFO:tasks.workunit.client.0.smithi071.stderr: -437> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9367140) adding con mode: secure 2024-09-14T11:29:47.984 INFO:tasks.workunit.client.0.smithi071.stderr: -436> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9367140) adding con mode: crc 2024-09-14T11:29:47.984 INFO:tasks.workunit.client.0.smithi071.stderr: -435> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9367140) adding con mode: secure 2024-09-14T11:29:47.985 INFO:tasks.workunit.client.0.smithi071.stderr: -434> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9367140) adding con mode: crc 2024-09-14T11:29:47.985 INFO:tasks.workunit.client.0.smithi071.stderr: -433> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9367140) adding con mode: crc 2024-09-14T11:29:47.985 INFO:tasks.workunit.client.0.smithi071.stderr: -432> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9367140) adding con mode: secure 2024-09-14T11:29:47.985 INFO:tasks.workunit.client.0.smithi071.stderr: -431> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9367140) adding con mode: crc 2024-09-14T11:29:47.985 INFO:tasks.workunit.client.0.smithi071.stderr: -430> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9367140) adding con mode: secure 2024-09-14T11:29:47.985 INFO:tasks.workunit.client.0.smithi071.stderr: -429> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9367140) adding con mode: crc 2024-09-14T11:29:47.985 INFO:tasks.workunit.client.0.smithi071.stderr: -428> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9367140) adding con mode: secure 2024-09-14T11:29:47.985 INFO:tasks.workunit.client.0.smithi071.stderr: -427> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:47.985 INFO:tasks.workunit.client.0.smithi071.stderr: -426> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:47.985 INFO:tasks.workunit.client.0.smithi071.stderr: -425> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 asok(0x55b5b915cd90) register_command rotate-key hook 0x55b5b9367288 2024-09-14T11:29:47.985 INFO:tasks.workunit.client.0.smithi071.stderr: -424> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient: _reopen_session rank -1 2024-09-14T11:29:47.985 INFO:tasks.workunit.client.0.smithi071.stderr: -423> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:29:47.985 INFO:tasks.workunit.client.0.smithi071.stderr: -422> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient(hunting): picked mon.noname-c con 0x55b5b9217070 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:29:47.985 INFO:tasks.workunit.client.0.smithi071.stderr: -421> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient(hunting): picked mon.noname-b con 0x55b5b92b0290 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:29:47.985 INFO:tasks.workunit.client.0.smithi071.stderr: -420> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient(hunting): picked mon.noname-a con 0x55b5b92b06a0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:29:47.986 INFO:tasks.workunit.client.0.smithi071.stderr: -419> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:47.986 INFO:tasks.workunit.client.0.smithi071.stderr: -418> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:47.986 INFO:tasks.workunit.client.0.smithi071.stderr: -417> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:47.986 INFO:tasks.workunit.client.0.smithi071.stderr: -416> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient(hunting): _renew_subs 2024-09-14T11:29:47.986 INFO:tasks.workunit.client.0.smithi071.stderr: -415> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient(hunting): authenticate will time out at 2199.999047s 2024-09-14T11:29:47.986 INFO:tasks.workunit.client.0.smithi071.stderr: -414> 2024-09-14T11:29:47.876+0000 7fb058357640 10 monclient(hunting): get_auth_request con 0x55b5b92b06a0 auth_method 0 2024-09-14T11:29:47.986 INFO:tasks.workunit.client.0.smithi071.stderr: -413> 2024-09-14T11:29:47.876+0000 7fb058357640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:47.986 INFO:tasks.workunit.client.0.smithi071.stderr: -412> 2024-09-14T11:29:47.876+0000 7fb058357640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:47.986 INFO:tasks.workunit.client.0.smithi071.stderr: -411> 2024-09-14T11:29:47.876+0000 7fb058357640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:47.986 INFO:tasks.workunit.client.0.smithi071.stderr: -410> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient(hunting): get_auth_request con 0x55b5b9217070 auth_method 0 2024-09-14T11:29:47.986 INFO:tasks.workunit.client.0.smithi071.stderr: -409> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:47.986 INFO:tasks.workunit.client.0.smithi071.stderr: -408> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:47.986 INFO:tasks.workunit.client.0.smithi071.stderr: -407> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:47.986 INFO:tasks.workunit.client.0.smithi071.stderr: -406> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:47.986 INFO:tasks.workunit.client.0.smithi071.stderr: -405> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:47.987 INFO:tasks.workunit.client.0.smithi071.stderr: -404> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:47.987 INFO:tasks.workunit.client.0.smithi071.stderr: -403> 2024-09-14T11:29:47.876+0000 7fb058357640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:47.987 INFO:tasks.workunit.client.0.smithi071.stderr: -402> 2024-09-14T11:29:47.876+0000 7fb058357640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:47.987 INFO:tasks.workunit.client.0.smithi071.stderr: -401> 2024-09-14T11:29:47.876+0000 7fb058357640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:47.987 INFO:tasks.workunit.client.0.smithi071.stderr: -400> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient(hunting): handle_auth_done global_id 6272 payload 824 2024-09-14T11:29:47.987 INFO:tasks.workunit.client.0.smithi071.stderr: -399> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient: _finish_hunting 0 2024-09-14T11:29:47.987 INFO:tasks.workunit.client.0.smithi071.stderr: -398> 2024-09-14T11:29:47.876+0000 7fb057b56640 1 monclient: found mon.noname-c 2024-09-14T11:29:47.987 INFO:tasks.workunit.client.0.smithi071.stderr: -397> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:29:47.987 INFO:tasks.workunit.client.0.smithi071.stderr: -396> 2024-09-14T11:29:47.876+0000 7faf3ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:47.987 INFO:tasks.workunit.client.0.smithi071.stderr: -395> 2024-09-14T11:29:47.876+0000 7faf3ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:29:47.987 INFO:tasks.workunit.client.0.smithi071.stderr: -394> 2024-09-14T11:29:47.876+0000 7faf3ffff640 10 monclient: dump: 2024-09-14T11:29:47.987 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:47.987 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:47.987 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:47.988 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:47.988 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:47.988 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:47.988 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:47.988 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:47.988 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:47.988 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:47.988 INFO:tasks.workunit.client.0.smithi071.stderr: -393> 2024-09-14T11:29:47.876+0000 7faf3ffff640 10 monclient: _finish_auth 0 2024-09-14T11:29:47.988 INFO:tasks.workunit.client.0.smithi071.stderr: -392> 2024-09-14T11:29:47.876+0000 7faf3ffff640 10 monclient: _check_auth_tickets 2024-09-14T11:29:47.988 INFO:tasks.workunit.client.0.smithi071.stderr: -391> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 monclient: authenticate success, global_id 6272 2024-09-14T11:29:47.988 INFO:tasks.workunit.client.0.smithi071.stderr: -390> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient: _renew_subs 2024-09-14T11:29:47.988 INFO:tasks.workunit.client.0.smithi071.stderr: -389> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:29:47.988 INFO:tasks.workunit.client.0.smithi071.stderr: -388> 2024-09-14T11:29:47.876+0000 7faf3ffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:29:47.988 INFO:tasks.workunit.client.0.smithi071.stderr: -387> 2024-09-14T11:29:47.876+0000 7faf3ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:47.989 INFO:tasks.workunit.client.0.smithi071.stderr: -386> 2024-09-14T11:29:47.876+0000 7faf3ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:29:47.989 INFO:tasks.workunit.client.0.smithi071.stderr: -385> 2024-09-14T11:29:47.876+0000 7faf3ffff640 10 monclient: dump: 2024-09-14T11:29:47.989 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:47.989 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:47.989 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:47.989 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:47.989 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:47.989 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:47.989 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:47.989 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:47.989 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:47.989 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:47.989 INFO:tasks.workunit.client.0.smithi071.stderr: -384> 2024-09-14T11:29:47.876+0000 7faf45e0b640 4 set_mon_vals no callback set 2024-09-14T11:29:47.990 INFO:tasks.workunit.client.0.smithi071.stderr: -383> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient: _renew_subs 2024-09-14T11:29:47.990 INFO:tasks.workunit.client.0.smithi071.stderr: -382> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:29:47.990 INFO:tasks.workunit.client.0.smithi071.stderr: -381> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 1 librados: init done 2024-09-14T11:29:47.990 INFO:tasks.workunit.client.0.smithi071.stderr: -380> 2024-09-14T11:29:47.880+0000 7faf3ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:29:47.990 INFO:tasks.workunit.client.0.smithi071.stderr: -379> 2024-09-14T11:29:47.880+0000 7faf3ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:29:47.990 INFO:tasks.workunit.client.0.smithi071.stderr: -378> 2024-09-14T11:29:47.880+0000 7faf3ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:29:47.990 INFO:tasks.workunit.client.0.smithi071.stderr: -377> 2024-09-14T11:29:47.880+0000 7fb057355640 10 monclient: get_auth_request con 0x7faf400718a0 auth_method 0 2024-09-14T11:29:47.990 INFO:tasks.workunit.client.0.smithi071.stderr: -376> 2024-09-14T11:29:47.880+0000 7fb058357640 10 monclient: get_auth_request con 0x55b5b93a9860 auth_method 0 2024-09-14T11:29:47.990 INFO:tasks.workunit.client.0.smithi071.stderr: -375> 2024-09-14T11:29:47.880+0000 7fb057b56640 10 monclient: get_auth_request con 0x55b5b93b2d90 auth_method 0 2024-09-14T11:29:47.990 INFO:tasks.workunit.client.0.smithi071.stderr: -374> 2024-09-14T11:29:47.884+0000 7fb057355640 10 monclient: get_auth_request con 0x55b5b93b6fd0 auth_method 0 2024-09-14T11:29:47.990 INFO:tasks.workunit.client.0.smithi071.stderr: -373> 2024-09-14T11:29:47.884+0000 7fb058357640 10 monclient: get_auth_request con 0x55b5b93b6640 auth_method 0 2024-09-14T11:29:47.990 INFO:tasks.workunit.client.0.smithi071.stderr: -372> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 10 monclient: build_initial_monmap 2024-09-14T11:29:47.990 INFO:tasks.workunit.client.0.smithi071.stderr: -371> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 1 build_initial for_mkfs: 0 2024-09-14T11:29:47.990 INFO:tasks.workunit.client.0.smithi071.stderr: -370> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 10 monclient: monmap: 2024-09-14T11:29:47.990 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:29:47.991 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:29:47.991 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:29:47.991 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:29:47.991 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:29:47.991 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:47.991 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:29:47.991 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:29:47.991 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:29:47.991 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:47.991 INFO:tasks.workunit.client.0.smithi071.stderr: -369> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93bf110) adding auth protocol: cephx 2024-09-14T11:29:47.991 INFO:tasks.workunit.client.0.smithi071.stderr: -368> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93bf110) adding auth protocol: cephx 2024-09-14T11:29:47.991 INFO:tasks.workunit.client.0.smithi071.stderr: -367> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93bf110) adding auth protocol: cephx 2024-09-14T11:29:47.991 INFO:tasks.workunit.client.0.smithi071.stderr: -366> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93bf110) adding con mode: secure 2024-09-14T11:29:47.992 INFO:tasks.workunit.client.0.smithi071.stderr: -365> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93bf110) adding con mode: crc 2024-09-14T11:29:47.992 INFO:tasks.workunit.client.0.smithi071.stderr: -364> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93bf110) adding con mode: secure 2024-09-14T11:29:47.992 INFO:tasks.workunit.client.0.smithi071.stderr: -363> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93bf110) adding con mode: crc 2024-09-14T11:29:47.992 INFO:tasks.workunit.client.0.smithi071.stderr: -362> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93bf110) adding con mode: secure 2024-09-14T11:29:47.992 INFO:tasks.workunit.client.0.smithi071.stderr: -361> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93bf110) adding con mode: crc 2024-09-14T11:29:47.992 INFO:tasks.workunit.client.0.smithi071.stderr: -360> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93bf110) adding con mode: crc 2024-09-14T11:29:47.992 INFO:tasks.workunit.client.0.smithi071.stderr: -359> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93bf110) adding con mode: secure 2024-09-14T11:29:47.992 INFO:tasks.workunit.client.0.smithi071.stderr: -358> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93bf110) adding con mode: crc 2024-09-14T11:29:47.992 INFO:tasks.workunit.client.0.smithi071.stderr: -357> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93bf110) adding con mode: secure 2024-09-14T11:29:47.992 INFO:tasks.workunit.client.0.smithi071.stderr: -356> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93bf110) adding con mode: crc 2024-09-14T11:29:47.992 INFO:tasks.workunit.client.0.smithi071.stderr: -355> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93bf110) adding con mode: secure 2024-09-14T11:29:47.992 INFO:tasks.workunit.client.0.smithi071.stderr: -354> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:47.992 INFO:tasks.workunit.client.0.smithi071.stderr: -353> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 5 asok(0x55b5b915cd90) register_command objecter_requests cmddesc objecter_requests hook 0x55b5b93c2b20 EEXIST 2024-09-14T11:29:47.992 INFO:tasks.workunit.client.0.smithi071.stderr: -352> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 10 monclient: init 2024-09-14T11:29:47.993 INFO:tasks.workunit.client.0.smithi071.stderr: -351> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93be058) adding auth protocol: cephx 2024-09-14T11:29:47.993 INFO:tasks.workunit.client.0.smithi071.stderr: -350> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93be058) adding auth protocol: cephx 2024-09-14T11:29:47.993 INFO:tasks.workunit.client.0.smithi071.stderr: -349> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93be058) adding auth protocol: cephx 2024-09-14T11:29:47.993 INFO:tasks.workunit.client.0.smithi071.stderr: -348> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93be058) adding con mode: secure 2024-09-14T11:29:47.993 INFO:tasks.workunit.client.0.smithi071.stderr: -347> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93be058) adding con mode: crc 2024-09-14T11:29:47.993 INFO:tasks.workunit.client.0.smithi071.stderr: -346> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93be058) adding con mode: secure 2024-09-14T11:29:47.993 INFO:tasks.workunit.client.0.smithi071.stderr: -345> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93be058) adding con mode: crc 2024-09-14T11:29:47.993 INFO:tasks.workunit.client.0.smithi071.stderr: -344> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93be058) adding con mode: secure 2024-09-14T11:29:47.993 INFO:tasks.workunit.client.0.smithi071.stderr: -343> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93be058) adding con mode: crc 2024-09-14T11:29:47.993 INFO:tasks.workunit.client.0.smithi071.stderr: -342> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93be058) adding con mode: crc 2024-09-14T11:29:47.993 INFO:tasks.workunit.client.0.smithi071.stderr: -341> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93be058) adding con mode: secure 2024-09-14T11:29:47.993 INFO:tasks.workunit.client.0.smithi071.stderr: -340> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93be058) adding con mode: crc 2024-09-14T11:29:47.993 INFO:tasks.workunit.client.0.smithi071.stderr: -339> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93be058) adding con mode: secure 2024-09-14T11:29:47.993 INFO:tasks.workunit.client.0.smithi071.stderr: -338> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93be058) adding con mode: crc 2024-09-14T11:29:47.993 INFO:tasks.workunit.client.0.smithi071.stderr: -337> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93be058) adding con mode: secure 2024-09-14T11:29:47.994 INFO:tasks.workunit.client.0.smithi071.stderr: -336> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:47.994 INFO:tasks.workunit.client.0.smithi071.stderr: -335> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:47.994 INFO:tasks.workunit.client.0.smithi071.stderr: -334> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 5 asok(0x55b5b915cd90) register_command rotate-key cmddesc rotate-key hook 0x55b5b93be1a0 EEXIST 2024-09-14T11:29:47.994 INFO:tasks.workunit.client.0.smithi071.stderr: -333> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 10 monclient: _reopen_session rank -1 2024-09-14T11:29:47.994 INFO:tasks.workunit.client.0.smithi071.stderr: -332> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:29:47.994 INFO:tasks.workunit.client.0.smithi071.stderr: -331> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 10 monclient(hunting): picked mon.noname-a con 0x55b5b93e6cd0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:29:47.994 INFO:tasks.workunit.client.0.smithi071.stderr: -330> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 10 monclient(hunting): picked mon.noname-c con 0x55b5b93e6600 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:29:47.994 INFO:tasks.workunit.client.0.smithi071.stderr: -329> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 10 monclient(hunting): picked mon.noname-b con 0x55b5b93e4fe0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:29:47.994 INFO:tasks.workunit.client.0.smithi071.stderr: -328> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:47.994 INFO:tasks.workunit.client.0.smithi071.stderr: -327> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:47.994 INFO:tasks.workunit.client.0.smithi071.stderr: -326> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:47.994 INFO:tasks.workunit.client.0.smithi071.stderr: -325> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 10 monclient(hunting): _renew_subs 2024-09-14T11:29:47.994 INFO:tasks.workunit.client.0.smithi071.stderr: -324> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 10 monclient(hunting): authenticate will time out at 2200.008678s 2024-09-14T11:29:47.994 INFO:tasks.workunit.client.0.smithi071.stderr: -323> 2024-09-14T11:29:47.888+0000 7fb058357640 10 monclient(hunting): get_auth_request con 0x55b5b93e6600 auth_method 0 2024-09-14T11:29:47.995 INFO:tasks.workunit.client.0.smithi071.stderr: -322> 2024-09-14T11:29:47.888+0000 7fb058357640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:47.995 INFO:tasks.workunit.client.0.smithi071.stderr: -321> 2024-09-14T11:29:47.888+0000 7fb058357640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:47.995 INFO:tasks.workunit.client.0.smithi071.stderr: -320> 2024-09-14T11:29:47.888+0000 7fb058357640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:47.995 INFO:tasks.workunit.client.0.smithi071.stderr: -319> 2024-09-14T11:29:47.888+0000 7fb057355640 10 monclient(hunting): get_auth_request con 0x55b5b93e6cd0 auth_method 0 2024-09-14T11:29:47.995 INFO:tasks.workunit.client.0.smithi071.stderr: -318> 2024-09-14T11:29:47.888+0000 7fb057355640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:47.995 INFO:tasks.workunit.client.0.smithi071.stderr: -317> 2024-09-14T11:29:47.888+0000 7fb057355640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:47.995 INFO:tasks.workunit.client.0.smithi071.stderr: -316> 2024-09-14T11:29:47.888+0000 7fb057355640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:47.995 INFO:tasks.workunit.client.0.smithi071.stderr: -315> 2024-09-14T11:29:47.888+0000 7fb058357640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:47.995 INFO:tasks.workunit.client.0.smithi071.stderr: -314> 2024-09-14T11:29:47.888+0000 7fb058357640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:47.995 INFO:tasks.workunit.client.0.smithi071.stderr: -313> 2024-09-14T11:29:47.888+0000 7fb058357640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:47.995 INFO:tasks.workunit.client.0.smithi071.stderr: -312> 2024-09-14T11:29:47.888+0000 7fb057355640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:47.995 INFO:tasks.workunit.client.0.smithi071.stderr: -311> 2024-09-14T11:29:47.888+0000 7fb057355640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:47.995 INFO:tasks.workunit.client.0.smithi071.stderr: -310> 2024-09-14T11:29:47.888+0000 7fb057355640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:47.995 INFO:tasks.workunit.client.0.smithi071.stderr: -309> 2024-09-14T11:29:47.888+0000 7fb057b56640 10 monclient(hunting): get_auth_request con 0x55b5b93e4fe0 auth_method 0 2024-09-14T11:29:47.995 INFO:tasks.workunit.client.0.smithi071.stderr: -308> 2024-09-14T11:29:47.888+0000 7fb057b56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:47.996 INFO:tasks.workunit.client.0.smithi071.stderr: -307> 2024-09-14T11:29:47.888+0000 7fb057b56640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:47.996 INFO:tasks.workunit.client.0.smithi071.stderr: -306> 2024-09-14T11:29:47.888+0000 7fb057b56640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:47.996 INFO:tasks.workunit.client.0.smithi071.stderr: -305> 2024-09-14T11:29:47.888+0000 7fb058357640 10 monclient(hunting): handle_auth_done global_id 6275 payload 824 2024-09-14T11:29:47.996 INFO:tasks.workunit.client.0.smithi071.stderr: -304> 2024-09-14T11:29:47.888+0000 7fb058357640 10 monclient: _finish_hunting 0 2024-09-14T11:29:47.996 INFO:tasks.workunit.client.0.smithi071.stderr: -303> 2024-09-14T11:29:47.888+0000 7fb058357640 1 monclient: found mon.noname-c 2024-09-14T11:29:47.996 INFO:tasks.workunit.client.0.smithi071.stderr: -302> 2024-09-14T11:29:47.888+0000 7fb058357640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:29:47.996 INFO:tasks.workunit.client.0.smithi071.stderr: -301> 2024-09-14T11:29:47.888+0000 7faf3d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:47.996 INFO:tasks.workunit.client.0.smithi071.stderr: -300> 2024-09-14T11:29:47.888+0000 7faf3d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:29:47.996 INFO:tasks.workunit.client.0.smithi071.stderr: -299> 2024-09-14T11:29:47.888+0000 7faf3d7fa640 10 monclient: dump: 2024-09-14T11:29:47.996 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:47.996 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:47.996 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:47.996 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:47.996 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:47.997 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:47.997 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:47.997 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:47.997 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:47.997 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:47.997 INFO:tasks.workunit.client.0.smithi071.stderr: -298> 2024-09-14T11:29:47.888+0000 7faf3d7fa640 10 monclient: _finish_auth 0 2024-09-14T11:29:47.997 INFO:tasks.workunit.client.0.smithi071.stderr: -297> 2024-09-14T11:29:47.888+0000 7faf3d7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:29:47.997 INFO:tasks.workunit.client.0.smithi071.stderr: -296> 2024-09-14T11:29:47.888+0000 7faf3d7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:29:47.997 INFO:tasks.workunit.client.0.smithi071.stderr: -295> 2024-09-14T11:29:47.888+0000 7faf3d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:47.997 INFO:tasks.workunit.client.0.smithi071.stderr: -294> 2024-09-14T11:29:47.888+0000 7faf3d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:29:47.997 INFO:tasks.workunit.client.0.smithi071.stderr: -293> 2024-09-14T11:29:47.888+0000 7faf3d7fa640 10 monclient: dump: 2024-09-14T11:29:47.997 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:47.997 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:47.997 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:47.998 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:47.998 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:47.998 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:47.998 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:47.998 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:47.998 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:47.998 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:47.998 INFO:tasks.workunit.client.0.smithi071.stderr: -292> 2024-09-14T11:29:47.888+0000 7fb058b58640 4 set_mon_vals no callback set 2024-09-14T11:29:47.998 INFO:tasks.workunit.client.0.smithi071.stderr: -291> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 5 monclient: authenticate success, global_id 6275 2024-09-14T11:29:47.998 INFO:tasks.workunit.client.0.smithi071.stderr: -290> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 10 monclient: _renew_subs 2024-09-14T11:29:47.998 INFO:tasks.workunit.client.0.smithi071.stderr: -289> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:29:47.998 INFO:tasks.workunit.client.0.smithi071.stderr: -288> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 10 monclient: _renew_subs 2024-09-14T11:29:47.998 INFO:tasks.workunit.client.0.smithi071.stderr: -287> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:29:47.998 INFO:tasks.workunit.client.0.smithi071.stderr: -286> 2024-09-14T11:29:47.888+0000 7faf3d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:29:47.999 INFO:tasks.workunit.client.0.smithi071.stderr: -285> 2024-09-14T11:29:47.888+0000 7faf3d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:29:47.999 INFO:tasks.workunit.client.0.smithi071.stderr: -284> 2024-09-14T11:29:47.888+0000 7faf3d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:29:47.999 INFO:tasks.workunit.client.0.smithi071.stderr: -283> 2024-09-14T11:29:47.892+0000 7fb057355640 10 monclient: get_auth_request con 0x7faf300717e0 auth_method 0 2024-09-14T11:29:47.999 INFO:tasks.workunit.client.0.smithi071.stderr: -282> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient: get_monmap_and_config 2024-09-14T11:29:47.999 INFO:tasks.workunit.client.0.smithi071.stderr: -281> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient: build_initial_monmap 2024-09-14T11:29:47.999 INFO:tasks.workunit.client.0.smithi071.stderr: -280> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 1 build_initial for_mkfs: 0 2024-09-14T11:29:47.999 INFO:tasks.workunit.client.0.smithi071.stderr: -279> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient: monmap: 2024-09-14T11:29:47.999 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:29:47.999 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:29:47.999 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:29:47.999 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:29:47.999 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:29:47.999 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:47.999 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:29:48.000 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:29:48.000 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:29:48.000 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:48.000 INFO:tasks.workunit.client.0.smithi071.stderr: -278> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9406480) adding auth protocol: cephx 2024-09-14T11:29:48.000 INFO:tasks.workunit.client.0.smithi071.stderr: -277> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9406480) adding auth protocol: cephx 2024-09-14T11:29:48.000 INFO:tasks.workunit.client.0.smithi071.stderr: -276> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9406480) adding auth protocol: cephx 2024-09-14T11:29:48.000 INFO:tasks.workunit.client.0.smithi071.stderr: -275> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9406480) adding con mode: secure 2024-09-14T11:29:48.000 INFO:tasks.workunit.client.0.smithi071.stderr: -274> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9406480) adding con mode: crc 2024-09-14T11:29:48.000 INFO:tasks.workunit.client.0.smithi071.stderr: -273> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9406480) adding con mode: secure 2024-09-14T11:29:48.000 INFO:tasks.workunit.client.0.smithi071.stderr: -272> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9406480) adding con mode: crc 2024-09-14T11:29:48.000 INFO:tasks.workunit.client.0.smithi071.stderr: -271> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9406480) adding con mode: secure 2024-09-14T11:29:48.000 INFO:tasks.workunit.client.0.smithi071.stderr: -270> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9406480) adding con mode: crc 2024-09-14T11:29:48.000 INFO:tasks.workunit.client.0.smithi071.stderr: -269> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9406480) adding con mode: crc 2024-09-14T11:29:48.000 INFO:tasks.workunit.client.0.smithi071.stderr: -268> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9406480) adding con mode: secure 2024-09-14T11:29:48.001 INFO:tasks.workunit.client.0.smithi071.stderr: -267> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9406480) adding con mode: crc 2024-09-14T11:29:48.001 INFO:tasks.workunit.client.0.smithi071.stderr: -266> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9406480) adding con mode: secure 2024-09-14T11:29:48.001 INFO:tasks.workunit.client.0.smithi071.stderr: -265> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9406480) adding con mode: crc 2024-09-14T11:29:48.001 INFO:tasks.workunit.client.0.smithi071.stderr: -264> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9406480) adding con mode: secure 2024-09-14T11:29:48.001 INFO:tasks.workunit.client.0.smithi071.stderr: -263> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:48.001 INFO:tasks.workunit.client.0.smithi071.stderr: -262> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient: init 2024-09-14T11:29:48.001 INFO:tasks.workunit.client.0.smithi071.stderr: -261> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de3b0) adding auth protocol: cephx 2024-09-14T11:29:48.001 INFO:tasks.workunit.client.0.smithi071.stderr: -260> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de3b0) adding auth protocol: cephx 2024-09-14T11:29:48.001 INFO:tasks.workunit.client.0.smithi071.stderr: -259> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de3b0) adding auth protocol: cephx 2024-09-14T11:29:48.001 INFO:tasks.workunit.client.0.smithi071.stderr: -258> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de3b0) adding con mode: secure 2024-09-14T11:29:48.001 INFO:tasks.workunit.client.0.smithi071.stderr: -257> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de3b0) adding con mode: crc 2024-09-14T11:29:48.001 INFO:tasks.workunit.client.0.smithi071.stderr: -256> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de3b0) adding con mode: secure 2024-09-14T11:29:48.001 INFO:tasks.workunit.client.0.smithi071.stderr: -255> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de3b0) adding con mode: crc 2024-09-14T11:29:48.002 INFO:tasks.workunit.client.0.smithi071.stderr: -254> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de3b0) adding con mode: secure 2024-09-14T11:29:48.002 INFO:tasks.workunit.client.0.smithi071.stderr: -253> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de3b0) adding con mode: crc 2024-09-14T11:29:48.002 INFO:tasks.workunit.client.0.smithi071.stderr: -252> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de3b0) adding con mode: crc 2024-09-14T11:29:48.002 INFO:tasks.workunit.client.0.smithi071.stderr: -251> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de3b0) adding con mode: secure 2024-09-14T11:29:48.002 INFO:tasks.workunit.client.0.smithi071.stderr: -250> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de3b0) adding con mode: crc 2024-09-14T11:29:48.002 INFO:tasks.workunit.client.0.smithi071.stderr: -249> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de3b0) adding con mode: secure 2024-09-14T11:29:48.002 INFO:tasks.workunit.client.0.smithi071.stderr: -248> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de3b0) adding con mode: crc 2024-09-14T11:29:48.002 INFO:tasks.workunit.client.0.smithi071.stderr: -247> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de3b0) adding con mode: secure 2024-09-14T11:29:48.002 INFO:tasks.workunit.client.0.smithi071.stderr: -246> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:48.002 INFO:tasks.workunit.client.0.smithi071.stderr: -245> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:48.002 INFO:tasks.workunit.client.0.smithi071.stderr: -244> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 asok(0x55b5b915cd90) register_command rotate-key cmddesc rotate-key hook 0x7ffd0d9de4f8 EEXIST 2024-09-14T11:29:48.002 INFO:tasks.workunit.client.0.smithi071.stderr: -243> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient: _reopen_session rank -1 2024-09-14T11:29:48.002 INFO:tasks.workunit.client.0.smithi071.stderr: -242> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:29:48.003 INFO:tasks.workunit.client.0.smithi071.stderr: -241> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient(hunting): picked mon.noname-a con 0x55b5b943aaf0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:29:48.003 INFO:tasks.workunit.client.0.smithi071.stderr: -240> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient(hunting): picked mon.noname-b con 0x55b5b940a510 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:29:48.003 INFO:tasks.workunit.client.0.smithi071.stderr: -239> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient(hunting): picked mon.noname-c con 0x55b5b94362c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:29:48.003 INFO:tasks.workunit.client.0.smithi071.stderr: -238> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:48.003 INFO:tasks.workunit.client.0.smithi071.stderr: -237> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:48.003 INFO:tasks.workunit.client.0.smithi071.stderr: -236> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:48.003 INFO:tasks.workunit.client.0.smithi071.stderr: -235> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient(hunting): _renew_subs 2024-09-14T11:29:48.003 INFO:tasks.workunit.client.0.smithi071.stderr: -234> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient(hunting): authenticate will time out at 2200.013313s 2024-09-14T11:29:48.003 INFO:tasks.workunit.client.0.smithi071.stderr: -233> 2024-09-14T11:29:47.892+0000 7fb057355640 10 monclient(hunting): get_auth_request con 0x55b5b943aaf0 auth_method 0 2024-09-14T11:29:48.003 INFO:tasks.workunit.client.0.smithi071.stderr: -232> 2024-09-14T11:29:47.892+0000 7fb057355640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:48.003 INFO:tasks.workunit.client.0.smithi071.stderr: -231> 2024-09-14T11:29:47.892+0000 7fb057355640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:48.003 INFO:tasks.workunit.client.0.smithi071.stderr: -230> 2024-09-14T11:29:47.892+0000 7fb057355640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:48.003 INFO:tasks.workunit.client.0.smithi071.stderr: -229> 2024-09-14T11:29:47.892+0000 7fb057b56640 10 monclient(hunting): get_auth_request con 0x55b5b94362c0 auth_method 0 2024-09-14T11:29:48.003 INFO:tasks.workunit.client.0.smithi071.stderr: -228> 2024-09-14T11:29:47.892+0000 7fb057b56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:48.004 INFO:tasks.workunit.client.0.smithi071.stderr: -227> 2024-09-14T11:29:47.892+0000 7fb057b56640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:48.004 INFO:tasks.workunit.client.0.smithi071.stderr: -226> 2024-09-14T11:29:47.892+0000 7fb057b56640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:48.004 INFO:tasks.workunit.client.0.smithi071.stderr: -225> 2024-09-14T11:29:47.892+0000 7fb057355640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:48.004 INFO:tasks.workunit.client.0.smithi071.stderr: -224> 2024-09-14T11:29:47.892+0000 7fb057355640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:48.004 INFO:tasks.workunit.client.0.smithi071.stderr: -223> 2024-09-14T11:29:47.892+0000 7fb057355640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:48.004 INFO:tasks.workunit.client.0.smithi071.stderr: -222> 2024-09-14T11:29:47.892+0000 7fb057b56640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:48.004 INFO:tasks.workunit.client.0.smithi071.stderr: -221> 2024-09-14T11:29:47.892+0000 7fb057b56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:48.004 INFO:tasks.workunit.client.0.smithi071.stderr: -220> 2024-09-14T11:29:47.892+0000 7fb057b56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:48.004 INFO:tasks.workunit.client.0.smithi071.stderr: -219> 2024-09-14T11:29:47.892+0000 7fb057355640 10 monclient(hunting): handle_auth_done global_id 6570 payload 274 2024-09-14T11:29:48.004 INFO:tasks.workunit.client.0.smithi071.stderr: -218> 2024-09-14T11:29:47.892+0000 7fb057355640 10 monclient: _finish_hunting 0 2024-09-14T11:29:48.004 INFO:tasks.workunit.client.0.smithi071.stderr: -217> 2024-09-14T11:29:47.892+0000 7fb057355640 1 monclient: found mon.noname-a 2024-09-14T11:29:48.004 INFO:tasks.workunit.client.0.smithi071.stderr: -216> 2024-09-14T11:29:47.892+0000 7fb057355640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:29:48.004 INFO:tasks.workunit.client.0.smithi071.stderr: -215> 2024-09-14T11:29:47.892+0000 7faf36ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:48.005 INFO:tasks.workunit.client.0.smithi071.stderr: -214> 2024-09-14T11:29:47.892+0000 7faf36ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:29:48.005 INFO:tasks.workunit.client.0.smithi071.stderr: -213> 2024-09-14T11:29:47.892+0000 7faf36ffd640 10 monclient: dump: 2024-09-14T11:29:48.005 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:48.005 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:48.005 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:48.005 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:48.005 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:48.005 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:48.005 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:48.005 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:48.005 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:48.005 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:48.005 INFO:tasks.workunit.client.0.smithi071.stderr: -212> 2024-09-14T11:29:47.892+0000 7faf36ffd640 10 monclient: _finish_auth 0 2024-09-14T11:29:48.005 INFO:tasks.workunit.client.0.smithi071.stderr: -211> 2024-09-14T11:29:47.892+0000 7faf36ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:29:48.006 INFO:tasks.workunit.client.0.smithi071.stderr: -210> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 monclient: authenticate success, global_id 6570 2024-09-14T11:29:48.006 INFO:tasks.workunit.client.0.smithi071.stderr: -209> 2024-09-14T11:29:47.892+0000 7faf36ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:29:48.006 INFO:tasks.workunit.client.0.smithi071.stderr: -208> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient: get_monmap_and_config success 2024-09-14T11:29:48.006 INFO:tasks.workunit.client.0.smithi071.stderr: -207> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 4 set_mon_vals no callback set 2024-09-14T11:29:48.006 INFO:tasks.workunit.client.0.smithi071.stderr: -206> 2024-09-14T11:29:47.892+0000 7faf36ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:48.006 INFO:tasks.workunit.client.0.smithi071.stderr: -205> 2024-09-14T11:29:47.892+0000 7faf36ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:29:48.006 INFO:tasks.workunit.client.0.smithi071.stderr: -204> 2024-09-14T11:29:47.892+0000 7faf36ffd640 10 monclient: dump: 2024-09-14T11:29:48.006 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:48.006 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:48.006 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:48.006 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:48.006 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:48.006 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:48.006 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:48.007 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:48.007 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:48.007 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:48.007 INFO:tasks.workunit.client.0.smithi071.stderr: -203> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient: shutdown 2024-09-14T11:29:48.007 INFO:tasks.workunit.client.0.smithi071.stderr: -202> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient: build_initial_monmap 2024-09-14T11:29:48.007 INFO:tasks.workunit.client.0.smithi071.stderr: -201> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 1 build_initial for_mkfs: 0 2024-09-14T11:29:48.007 INFO:tasks.workunit.client.0.smithi071.stderr: -200> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient: monmap: 2024-09-14T11:29:48.007 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:29:48.007 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:29:48.007 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:29:48.007 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:29:48.007 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:29:48.008 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:48.008 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:29:48.008 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:29:48.008 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:29:48.008 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:48.008 INFO:tasks.workunit.client.0.smithi071.stderr: -199> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b942b510) adding auth protocol: cephx 2024-09-14T11:29:48.008 INFO:tasks.workunit.client.0.smithi071.stderr: -198> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b942b510) adding auth protocol: cephx 2024-09-14T11:29:48.008 INFO:tasks.workunit.client.0.smithi071.stderr: -197> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b942b510) adding auth protocol: cephx 2024-09-14T11:29:48.008 INFO:tasks.workunit.client.0.smithi071.stderr: -196> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b942b510) adding con mode: secure 2024-09-14T11:29:48.008 INFO:tasks.workunit.client.0.smithi071.stderr: -195> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b942b510) adding con mode: crc 2024-09-14T11:29:48.008 INFO:tasks.workunit.client.0.smithi071.stderr: -194> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b942b510) adding con mode: secure 2024-09-14T11:29:48.008 INFO:tasks.workunit.client.0.smithi071.stderr: -193> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b942b510) adding con mode: crc 2024-09-14T11:29:48.008 INFO:tasks.workunit.client.0.smithi071.stderr: -192> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b942b510) adding con mode: secure 2024-09-14T11:29:48.008 INFO:tasks.workunit.client.0.smithi071.stderr: -191> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b942b510) adding con mode: crc 2024-09-14T11:29:48.009 INFO:tasks.workunit.client.0.smithi071.stderr: -190> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b942b510) adding con mode: crc 2024-09-14T11:29:48.009 INFO:tasks.workunit.client.0.smithi071.stderr: -189> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b942b510) adding con mode: secure 2024-09-14T11:29:48.009 INFO:tasks.workunit.client.0.smithi071.stderr: -188> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b942b510) adding con mode: crc 2024-09-14T11:29:48.009 INFO:tasks.workunit.client.0.smithi071.stderr: -187> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b942b510) adding con mode: secure 2024-09-14T11:29:48.009 INFO:tasks.workunit.client.0.smithi071.stderr: -186> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b942b510) adding con mode: crc 2024-09-14T11:29:48.009 INFO:tasks.workunit.client.0.smithi071.stderr: -185> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b942b510) adding con mode: secure 2024-09-14T11:29:48.009 INFO:tasks.workunit.client.0.smithi071.stderr: -184> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:48.009 INFO:tasks.workunit.client.0.smithi071.stderr: -183> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 1 librados: starting msgr at 2024-09-14T11:29:48.009 INFO:tasks.workunit.client.0.smithi071.stderr: -182> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 1 librados: starting objecter 2024-09-14T11:29:48.009 INFO:tasks.workunit.client.0.smithi071.stderr: -181> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 asok(0x55b5b915cd90) register_command objecter_requests cmddesc objecter_requests hook 0x55b5b9434f10 EEXIST 2024-09-14T11:29:48.009 INFO:tasks.workunit.client.0.smithi071.stderr: -180> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 1 librados: setting wanted keys 2024-09-14T11:29:48.009 INFO:tasks.workunit.client.0.smithi071.stderr: -179> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 1 librados: calling monclient init 2024-09-14T11:29:48.009 INFO:tasks.workunit.client.0.smithi071.stderr: -178> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient: init 2024-09-14T11:29:48.009 INFO:tasks.workunit.client.0.smithi071.stderr: -177> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93e8af0) adding auth protocol: cephx 2024-09-14T11:29:48.009 INFO:tasks.workunit.client.0.smithi071.stderr: -176> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93e8af0) adding auth protocol: cephx 2024-09-14T11:29:48.010 INFO:tasks.workunit.client.0.smithi071.stderr: -175> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93e8af0) adding auth protocol: cephx 2024-09-14T11:29:48.010 INFO:tasks.workunit.client.0.smithi071.stderr: -174> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93e8af0) adding con mode: secure 2024-09-14T11:29:48.010 INFO:tasks.workunit.client.0.smithi071.stderr: -173> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93e8af0) adding con mode: crc 2024-09-14T11:29:48.010 INFO:tasks.workunit.client.0.smithi071.stderr: -172> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93e8af0) adding con mode: secure 2024-09-14T11:29:48.010 INFO:tasks.workunit.client.0.smithi071.stderr: -171> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93e8af0) adding con mode: crc 2024-09-14T11:29:48.010 INFO:tasks.workunit.client.0.smithi071.stderr: -170> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93e8af0) adding con mode: secure 2024-09-14T11:29:48.010 INFO:tasks.workunit.client.0.smithi071.stderr: -169> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93e8af0) adding con mode: crc 2024-09-14T11:29:48.010 INFO:tasks.workunit.client.0.smithi071.stderr: -168> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93e8af0) adding con mode: crc 2024-09-14T11:29:48.010 INFO:tasks.workunit.client.0.smithi071.stderr: -167> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93e8af0) adding con mode: secure 2024-09-14T11:29:48.010 INFO:tasks.workunit.client.0.smithi071.stderr: -166> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93e8af0) adding con mode: crc 2024-09-14T11:29:48.010 INFO:tasks.workunit.client.0.smithi071.stderr: -165> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93e8af0) adding con mode: secure 2024-09-14T11:29:48.010 INFO:tasks.workunit.client.0.smithi071.stderr: -164> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93e8af0) adding con mode: crc 2024-09-14T11:29:48.010 INFO:tasks.workunit.client.0.smithi071.stderr: -163> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93e8af0) adding con mode: secure 2024-09-14T11:29:48.010 INFO:tasks.workunit.client.0.smithi071.stderr: -162> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:48.010 INFO:tasks.workunit.client.0.smithi071.stderr: -161> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:48.011 INFO:tasks.workunit.client.0.smithi071.stderr: -160> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 asok(0x55b5b915cd90) register_command rotate-key cmddesc rotate-key hook 0x55b5b93e8c38 EEXIST 2024-09-14T11:29:48.011 INFO:tasks.workunit.client.0.smithi071.stderr: -159> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient: _reopen_session rank -1 2024-09-14T11:29:48.011 INFO:tasks.workunit.client.0.smithi071.stderr: -158> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:29:48.011 INFO:tasks.workunit.client.0.smithi071.stderr: -157> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient(hunting): picked mon.noname-c con 0x55b5b940a510 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:29:48.011 INFO:tasks.workunit.client.0.smithi071.stderr: -156> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient(hunting): picked mon.noname-a con 0x55b5b94362c0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:29:48.011 INFO:tasks.workunit.client.0.smithi071.stderr: -155> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient(hunting): picked mon.noname-b con 0x55b5b943aaf0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:29:48.011 INFO:tasks.workunit.client.0.smithi071.stderr: -154> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:48.011 INFO:tasks.workunit.client.0.smithi071.stderr: -153> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:48.011 INFO:tasks.workunit.client.0.smithi071.stderr: -152> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:48.011 INFO:tasks.workunit.client.0.smithi071.stderr: -151> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient(hunting): _renew_subs 2024-09-14T11:29:48.011 INFO:tasks.workunit.client.0.smithi071.stderr: -150> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient(hunting): authenticate will time out at 2200.015931s 2024-09-14T11:29:48.011 INFO:tasks.workunit.client.0.smithi071.stderr: -149> 2024-09-14T11:29:47.896+0000 7fb058357640 10 monclient(hunting): get_auth_request con 0x55b5b94362c0 auth_method 0 2024-09-14T11:29:48.011 INFO:tasks.workunit.client.0.smithi071.stderr: -148> 2024-09-14T11:29:47.896+0000 7fb058357640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:48.011 INFO:tasks.workunit.client.0.smithi071.stderr: -147> 2024-09-14T11:29:47.896+0000 7fb058357640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:48.011 INFO:tasks.workunit.client.0.smithi071.stderr: -146> 2024-09-14T11:29:47.896+0000 7fb058357640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:48.012 INFO:tasks.workunit.client.0.smithi071.stderr: -145> 2024-09-14T11:29:47.896+0000 7fb057355640 10 monclient(hunting): get_auth_request con 0x55b5b940a510 auth_method 0 2024-09-14T11:29:48.012 INFO:tasks.workunit.client.0.smithi071.stderr: -144> 2024-09-14T11:29:47.896+0000 7fb057355640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:48.012 INFO:tasks.workunit.client.0.smithi071.stderr: -143> 2024-09-14T11:29:47.896+0000 7fb057355640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:48.012 INFO:tasks.workunit.client.0.smithi071.stderr: -142> 2024-09-14T11:29:47.896+0000 7fb057355640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:48.012 INFO:tasks.workunit.client.0.smithi071.stderr: -141> 2024-09-14T11:29:47.896+0000 7fb057355640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:48.012 INFO:tasks.workunit.client.0.smithi071.stderr: -140> 2024-09-14T11:29:47.896+0000 7fb057355640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:48.012 INFO:tasks.workunit.client.0.smithi071.stderr: -139> 2024-09-14T11:29:47.896+0000 7fb057355640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:48.012 INFO:tasks.workunit.client.0.smithi071.stderr: -138> 2024-09-14T11:29:47.896+0000 7fb058357640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:48.012 INFO:tasks.workunit.client.0.smithi071.stderr: -137> 2024-09-14T11:29:47.896+0000 7fb058357640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:48.012 INFO:tasks.workunit.client.0.smithi071.stderr: -136> 2024-09-14T11:29:47.896+0000 7fb058357640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:48.012 INFO:tasks.workunit.client.0.smithi071.stderr: -135> 2024-09-14T11:29:47.896+0000 7fb057355640 10 monclient(hunting): handle_auth_done global_id 6281 payload 824 2024-09-14T11:29:48.012 INFO:tasks.workunit.client.0.smithi071.stderr: -134> 2024-09-14T11:29:47.896+0000 7fb057355640 10 monclient: _finish_hunting 0 2024-09-14T11:29:48.012 INFO:tasks.workunit.client.0.smithi071.stderr: -133> 2024-09-14T11:29:47.896+0000 7fb057355640 1 monclient: found mon.noname-c 2024-09-14T11:29:48.012 INFO:tasks.workunit.client.0.smithi071.stderr: -132> 2024-09-14T11:29:47.896+0000 7fb057355640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:29:48.013 INFO:tasks.workunit.client.0.smithi071.stderr: -131> 2024-09-14T11:29:47.896+0000 7faf357fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:48.013 INFO:tasks.workunit.client.0.smithi071.stderr: -130> 2024-09-14T11:29:47.896+0000 7faf357fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:29:48.013 INFO:tasks.workunit.client.0.smithi071.stderr: -129> 2024-09-14T11:29:47.896+0000 7faf357fa640 10 monclient: dump: 2024-09-14T11:29:48.013 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:48.013 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:48.013 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:48.013 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:48.013 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:48.013 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:48.013 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:48.013 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:48.013 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:48.013 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:48.013 INFO:tasks.workunit.client.0.smithi071.stderr: -128> 2024-09-14T11:29:47.896+0000 7faf357fa640 10 monclient: _finish_auth 0 2024-09-14T11:29:48.013 INFO:tasks.workunit.client.0.smithi071.stderr: -127> 2024-09-14T11:29:47.896+0000 7faf357fa640 10 monclient: _check_auth_tickets 2024-09-14T11:29:48.014 INFO:tasks.workunit.client.0.smithi071.stderr: -126> 2024-09-14T11:29:47.896+0000 7faf357fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:29:48.014 INFO:tasks.workunit.client.0.smithi071.stderr: -125> 2024-09-14T11:29:47.896+0000 7faf357fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:48.014 INFO:tasks.workunit.client.0.smithi071.stderr: -124> 2024-09-14T11:29:47.896+0000 7faf357fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:29:48.014 INFO:tasks.workunit.client.0.smithi071.stderr: -123> 2024-09-14T11:29:47.896+0000 7faf357fa640 10 monclient: dump: 2024-09-14T11:29:48.014 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:48.014 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:48.014 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:48.014 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:48.014 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:48.014 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:48.014 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:48.014 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:48.014 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:48.015 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:48.015 INFO:tasks.workunit.client.0.smithi071.stderr: -122> 2024-09-14T11:29:47.896+0000 7faf36ffd640 4 set_mon_vals no callback set 2024-09-14T11:29:48.015 INFO:tasks.workunit.client.0.smithi071.stderr: -121> 2024-09-14T11:29:47.896+0000 7fb05a0509c0 5 monclient: authenticate success, global_id 6281 2024-09-14T11:29:48.015 INFO:tasks.workunit.client.0.smithi071.stderr: -120> 2024-09-14T11:29:47.896+0000 7fb05a0509c0 10 monclient: _renew_subs 2024-09-14T11:29:48.015 INFO:tasks.workunit.client.0.smithi071.stderr: -119> 2024-09-14T11:29:47.896+0000 7fb05a0509c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:29:48.015 INFO:tasks.workunit.client.0.smithi071.stderr: -118> 2024-09-14T11:29:47.896+0000 7fb05a0509c0 10 monclient: _renew_subs 2024-09-14T11:29:48.015 INFO:tasks.workunit.client.0.smithi071.stderr: -117> 2024-09-14T11:29:47.896+0000 7fb05a0509c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:29:48.015 INFO:tasks.workunit.client.0.smithi071.stderr: -116> 2024-09-14T11:29:47.896+0000 7fb05a0509c0 1 librados: init done 2024-09-14T11:29:48.015 INFO:tasks.workunit.client.0.smithi071.stderr: -115> 2024-09-14T11:29:47.896+0000 7fb05a0509c0 5 asok(0x55b5b915cd90) register_command cr dump hook 0x7fb040008a08 2024-09-14T11:29:48.015 INFO:tasks.workunit.client.0.smithi071.stderr: -114> 2024-09-14T11:29:47.896+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.015 INFO:tasks.workunit.client.0.smithi071.stderr: -113> 2024-09-14T11:29:47.896+0000 7faf357fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:29:48.015 INFO:tasks.workunit.client.0.smithi071.stderr: -112> 2024-09-14T11:29:47.896+0000 7faf357fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:29:48.015 INFO:tasks.workunit.client.0.smithi071.stderr: -111> 2024-09-14T11:29:47.896+0000 7faf357fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:29:48.015 INFO:tasks.workunit.client.0.smithi071.stderr: -110> 2024-09-14T11:29:47.896+0000 7fb058357640 10 monclient: get_auth_request con 0x7faf200718a0 auth_method 0 2024-09-14T11:29:48.015 INFO:tasks.workunit.client.0.smithi071.stderr: -109> 2024-09-14T11:29:47.896+0000 7fb057b56640 10 monclient: get_auth_request con 0x55b5b9454750 auth_method 0 2024-09-14T11:29:48.016 INFO:tasks.workunit.client.0.smithi071.stderr: -108> 2024-09-14T11:29:47.900+0000 7fb05a0509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:48.016 INFO:tasks.workunit.client.0.smithi071.stderr: -107> 2024-09-14T11:29:47.900+0000 7fb05a0509c0 20 realm 2024-09-14T11:29:48.016 INFO:tasks.workunit.client.0.smithi071.stderr: -106> 2024-09-14T11:29:47.900+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.016 INFO:tasks.workunit.client.0.smithi071.stderr: -105> 2024-09-14T11:29:47.900+0000 7fb05a0509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:48.016 INFO:tasks.workunit.client.0.smithi071.stderr: -104> 2024-09-14T11:29:47.900+0000 7fb05a0509c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:48.016 INFO:tasks.workunit.client.0.smithi071.stderr: -103> 2024-09-14T11:29:47.900+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.016 INFO:tasks.workunit.client.0.smithi071.stderr: -102> 2024-09-14T11:29:47.900+0000 7fb05a0509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:48.016 INFO:tasks.workunit.client.0.smithi071.stderr: -101> 2024-09-14T11:29:47.900+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.016 INFO:tasks.workunit.client.0.smithi071.stderr: -100> 2024-09-14T11:29:47.900+0000 7fb057355640 10 monclient: get_auth_request con 0x55b5b9458a20 auth_method 0 2024-09-14T11:29:48.016 INFO:tasks.workunit.client.0.smithi071.stderr: -99> 2024-09-14T11:29:47.900+0000 7fb05a0509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:48.016 INFO:tasks.workunit.client.0.smithi071.stderr: -98> 2024-09-14T11:29:47.900+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.016 INFO:tasks.workunit.client.0.smithi071.stderr: -97> 2024-09-14T11:29:47.900+0000 7fb058357640 10 monclient: get_auth_request con 0x55b5b945c140 auth_method 0 2024-09-14T11:29:48.016 INFO:tasks.workunit.client.0.smithi071.stderr: -96> 2024-09-14T11:29:47.900+0000 7fb05a0509c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:48.016 INFO:tasks.workunit.client.0.smithi071.stderr: -95> 2024-09-14T11:29:47.900+0000 7fb05a0509c0 20 searching for the correct realm 2024-09-14T11:29:48.017 INFO:tasks.workunit.client.0.smithi071.stderr: -94> 2024-09-14T11:29:47.900+0000 7fb057b56640 10 monclient: get_auth_request con 0x55b5b9460ee0 auth_method 0 2024-09-14T11:29:48.017 INFO:tasks.workunit.client.0.smithi071.stderr: -93> 2024-09-14T11:29:47.904+0000 7fb057355640 10 monclient: get_auth_request con 0x7fb04802d060 auth_method 0 2024-09-14T11:29:48.017 INFO:tasks.workunit.client.0.smithi071.stderr: -92> 2024-09-14T11:29:47.904+0000 7fb058357640 10 monclient: get_auth_request con 0x7fb04004d020 auth_method 0 2024-09-14T11:29:48.017 INFO:tasks.workunit.client.0.smithi071.stderr: -91> 2024-09-14T11:29:47.904+0000 7fb058357640 0 -- 172.21.15.71:0/1336183276 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fb04004d020 msgr2=0x7fb040075150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:48.017 INFO:tasks.workunit.client.0.smithi071.stderr: -90> 2024-09-14T11:29:47.904+0000 7faf357fa640 1 client.6281.objecter ms_handle_reset 0x7fb04004d020 session 0x7fb040030ee0 osd.0 2024-09-14T11:29:48.017 INFO:tasks.workunit.client.0.smithi071.stderr: -89> 2024-09-14T11:29:47.904+0000 7faf357fa640 10 monclient: _renew_subs 2024-09-14T11:29:48.017 INFO:tasks.workunit.client.0.smithi071.stderr: -88> 2024-09-14T11:29:47.904+0000 7faf357fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:29:48.017 INFO:tasks.workunit.client.0.smithi071.stderr: -87> 2024-09-14T11:29:47.904+0000 7fb058357640 10 monclient: get_auth_request con 0x7faf200813c0 auth_method 0 2024-09-14T11:29:48.017 INFO:tasks.workunit.client.0.smithi071.stderr: -86> 2024-09-14T11:29:47.908+0000 7fb057b56640 10 monclient: get_auth_request con 0x7fb048017020 auth_method 0 2024-09-14T11:29:48.017 INFO:tasks.workunit.client.0.smithi071.stderr: -85> 2024-09-14T11:29:47.912+0000 7fb057355640 10 monclient: get_auth_request con 0x7fb040008040 auth_method 0 2024-09-14T11:29:48.017 INFO:tasks.workunit.client.0.smithi071.stderr: -84> 2024-09-14T11:29:47.912+0000 7fb057355640 0 -- 172.21.15.71:0/1336183276 >> [v2:172.21.15.157:6800/3420822707,v1:172.21.15.157:6801/3420822707] conn(0x7fb040008040 msgr2=0x7fb040035a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:48.017 INFO:tasks.workunit.client.0.smithi071.stderr: -83> 2024-09-14T11:29:47.912+0000 7faf357fa640 1 client.6281.objecter ms_handle_reset 0x7fb040008040 session 0x7fb040020680 osd.7 2024-09-14T11:29:48.017 INFO:tasks.workunit.client.0.smithi071.stderr: -82> 2024-09-14T11:29:47.912+0000 7fb057355640 10 monclient: get_auth_request con 0x7fb04004d020 auth_method 0 2024-09-14T11:29:48.017 INFO:tasks.workunit.client.0.smithi071.stderr: -81> 2024-09-14T11:29:47.920+0000 7fb05a0509c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:48.018 INFO:tasks.workunit.client.0.smithi071.stderr: -80> 2024-09-14T11:29:47.920+0000 7fb05a0509c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:29:48.018 INFO:tasks.workunit.client.0.smithi071.stderr: -79> 2024-09-14T11:29:47.920+0000 7fb05a0509c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:48.018 INFO:tasks.workunit.client.0.smithi071.stderr: -78> 2024-09-14T11:29:47.920+0000 7fb05a0509c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:29:48.018 INFO:tasks.workunit.client.0.smithi071.stderr: -77> 2024-09-14T11:29:47.920+0000 7fb05a0509c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:48.018 INFO:tasks.workunit.client.0.smithi071.stderr: -76> 2024-09-14T11:29:47.920+0000 7fb05a0509c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:48.018 INFO:tasks.workunit.client.0.smithi071.stderr: -75> 2024-09-14T11:29:47.920+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.018 INFO:tasks.workunit.client.0.smithi071.stderr: -74> 2024-09-14T11:29:47.920+0000 7fb05a0509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:48.018 INFO:tasks.workunit.client.0.smithi071.stderr: -73> 2024-09-14T11:29:47.920+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.018 INFO:tasks.workunit.client.0.smithi071.stderr: -72> 2024-09-14T11:29:47.920+0000 7fb05a0509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:48.018 INFO:tasks.workunit.client.0.smithi071.stderr: -71> 2024-09-14T11:29:47.920+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.018 INFO:tasks.workunit.client.0.smithi071.stderr: -70> 2024-09-14T11:29:47.924+0000 7fb05a0509c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:48.018 INFO:tasks.workunit.client.0.smithi071.stderr: -69> 2024-09-14T11:29:47.924+0000 7fb05a0509c0 20 zone default found 2024-09-14T11:29:48.018 INFO:tasks.workunit.client.0.smithi071.stderr: -68> 2024-09-14T11:29:47.924+0000 7fb05a0509c0 4 Realm: () 2024-09-14T11:29:48.018 INFO:tasks.workunit.client.0.smithi071.stderr: -67> 2024-09-14T11:29:47.924+0000 7fb05a0509c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:29:48.018 INFO:tasks.workunit.client.0.smithi071.stderr: -66> 2024-09-14T11:29:47.924+0000 7fb05a0509c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:29:48.019 INFO:tasks.workunit.client.0.smithi071.stderr: -65> 2024-09-14T11:29:47.924+0000 7fb05a0509c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:48.019 INFO:tasks.workunit.client.0.smithi071.stderr: -64> 2024-09-14T11:29:47.924+0000 7fb05a0509c0 20 zonegroup default 2024-09-14T11:29:48.019 INFO:tasks.workunit.client.0.smithi071.stderr: -63> 2024-09-14T11:29:47.924+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.019 INFO:tasks.workunit.client.0.smithi071.stderr: -62> 2024-09-14T11:29:47.924+0000 7fb05a0509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:48.019 INFO:tasks.workunit.client.0.smithi071.stderr: -61> 2024-09-14T11:29:47.924+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.019 INFO:tasks.workunit.client.0.smithi071.stderr: -60> 2024-09-14T11:29:47.924+0000 7fb05a0509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:48.019 INFO:tasks.workunit.client.0.smithi071.stderr: -59> 2024-09-14T11:29:47.924+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.019 INFO:tasks.workunit.client.0.smithi071.stderr: -58> 2024-09-14T11:29:47.924+0000 7fb05a0509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:48.019 INFO:tasks.workunit.client.0.smithi071.stderr: -57> 2024-09-14T11:29:47.924+0000 7fb05a0509c0 20 started sync module instance, tier type = 2024-09-14T11:29:48.019 INFO:tasks.workunit.client.0.smithi071.stderr: -56> 2024-09-14T11:29:47.924+0000 7fb05a0509c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:29:48.019 INFO:tasks.workunit.client.0.smithi071.stderr: -55> 2024-09-14T11:29:47.940+0000 7fb05a0509c0 20 add_watcher() i=0 2024-09-14T11:29:48.019 INFO:tasks.workunit.client.0.smithi071.stderr: -54> 2024-09-14T11:29:47.940+0000 7fb05a0509c0 20 add_watcher() i=1 2024-09-14T11:29:48.019 INFO:tasks.workunit.client.0.smithi071.stderr: -53> 2024-09-14T11:29:47.940+0000 7fb05a0509c0 20 add_watcher() i=2 2024-09-14T11:29:48.019 INFO:tasks.workunit.client.0.smithi071.stderr: -52> 2024-09-14T11:29:47.940+0000 7fb05a0509c0 20 add_watcher() i=3 2024-09-14T11:29:48.019 INFO:tasks.workunit.client.0.smithi071.stderr: -51> 2024-09-14T11:29:47.940+0000 7fb05a0509c0 20 add_watcher() i=4 2024-09-14T11:29:48.020 INFO:tasks.workunit.client.0.smithi071.stderr: -50> 2024-09-14T11:29:47.940+0000 7fb05a0509c0 20 add_watcher() i=5 2024-09-14T11:29:48.020 INFO:tasks.workunit.client.0.smithi071.stderr: -49> 2024-09-14T11:29:47.940+0000 7fb05a0509c0 20 add_watcher() i=6 2024-09-14T11:29:48.020 INFO:tasks.workunit.client.0.smithi071.stderr: -48> 2024-09-14T11:29:47.944+0000 7fb05a0509c0 20 add_watcher() i=7 2024-09-14T11:29:48.020 INFO:tasks.workunit.client.0.smithi071.stderr: -47> 2024-09-14T11:29:47.944+0000 7fb05a0509c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:48.020 INFO:tasks.workunit.client.0.smithi071.stderr: -46> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de890) adding auth protocol: cephx 2024-09-14T11:29:48.020 INFO:tasks.workunit.client.0.smithi071.stderr: -45> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de890) adding auth protocol: cephx 2024-09-14T11:29:48.020 INFO:tasks.workunit.client.0.smithi071.stderr: -44> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de890) adding auth protocol: cephx 2024-09-14T11:29:48.020 INFO:tasks.workunit.client.0.smithi071.stderr: -43> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de890) adding con mode: secure 2024-09-14T11:29:48.020 INFO:tasks.workunit.client.0.smithi071.stderr: -42> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de890) adding con mode: crc 2024-09-14T11:29:48.020 INFO:tasks.workunit.client.0.smithi071.stderr: -41> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de890) adding con mode: secure 2024-09-14T11:29:48.020 INFO:tasks.workunit.client.0.smithi071.stderr: -40> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de890) adding con mode: crc 2024-09-14T11:29:48.020 INFO:tasks.workunit.client.0.smithi071.stderr: -39> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de890) adding con mode: secure 2024-09-14T11:29:48.020 INFO:tasks.workunit.client.0.smithi071.stderr: -38> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de890) adding con mode: crc 2024-09-14T11:29:48.020 INFO:tasks.workunit.client.0.smithi071.stderr: -37> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de890) adding con mode: crc 2024-09-14T11:29:48.021 INFO:tasks.workunit.client.0.smithi071.stderr: -36> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de890) adding con mode: secure 2024-09-14T11:29:48.021 INFO:tasks.workunit.client.0.smithi071.stderr: -35> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de890) adding con mode: crc 2024-09-14T11:29:48.021 INFO:tasks.workunit.client.0.smithi071.stderr: -34> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de890) adding con mode: secure 2024-09-14T11:29:48.021 INFO:tasks.workunit.client.0.smithi071.stderr: -33> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de890) adding con mode: crc 2024-09-14T11:29:48.021 INFO:tasks.workunit.client.0.smithi071.stderr: -32> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de890) adding con mode: secure 2024-09-14T11:29:48.021 INFO:tasks.workunit.client.0.smithi071.stderr: -31> 2024-09-14T11:29:47.948+0000 7faf0dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:48.021 INFO:tasks.workunit.client.0.smithi071.stderr: -30> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:48.021 INFO:tasks.workunit.client.0.smithi071.stderr: -29> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:48.021 INFO:tasks.workunit.client.0.smithi071.stderr: -28> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:48.021 INFO:tasks.workunit.client.0.smithi071.stderr: -27> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 asok(0x55b5b915cd90) register_command cache list hook 0x55b5b9428ed0 2024-09-14T11:29:48.021 INFO:tasks.workunit.client.0.smithi071.stderr: -26> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 asok(0x55b5b915cd90) register_command cache inspect hook 0x55b5b9428ed0 2024-09-14T11:29:48.021 INFO:tasks.workunit.client.0.smithi071.stderr: -25> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 asok(0x55b5b915cd90) register_command cache erase hook 0x55b5b9428ed0 2024-09-14T11:29:48.021 INFO:tasks.workunit.client.0.smithi071.stderr: -24> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 asok(0x55b5b915cd90) register_command cache zap hook 0x55b5b9428ed0 2024-09-14T11:29:48.022 INFO:tasks.workunit.client.0.smithi071.stderr: -23> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 note: GC not initialized 2024-09-14T11:29:48.022 INFO:tasks.workunit.client.0.smithi071.stderr: -22> 2024-09-14T11:29:47.948+0000 7faf0cfe1640 20 reqs_thread_entry: start 2024-09-14T11:29:48.022 INFO:tasks.workunit.client.0.smithi071.stderr: -21> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 asok(0x55b5b915cd90) register_command sync trace show hook 0x7fb0400203b0 2024-09-14T11:29:48.022 INFO:tasks.workunit.client.0.smithi071.stderr: -20> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 asok(0x55b5b915cd90) register_command sync trace history hook 0x7fb0400203b0 2024-09-14T11:29:48.022 INFO:tasks.workunit.client.0.smithi071.stderr: -19> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 asok(0x55b5b915cd90) register_command sync trace active hook 0x7fb0400203b0 2024-09-14T11:29:48.022 INFO:tasks.workunit.client.0.smithi071.stderr: -18> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 asok(0x55b5b915cd90) register_command sync trace active_short hook 0x7fb0400203b0 2024-09-14T11:29:48.022 INFO:tasks.workunit.client.0.smithi071.stderr: -17> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:48.022 INFO:tasks.workunit.client.0.smithi071.stderr: -16> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 20 Filter name: none 2024-09-14T11:29:48.022 INFO:tasks.workunit.client.0.smithi071.stderr: -15> 2024-09-14T11:29:47.948+0000 7fae867fc640 20 reqs_thread_entry: start 2024-09-14T11:29:48.022 INFO:tasks.workunit.client.0.smithi071.stderr: -14> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:29:48.022 INFO:tasks.workunit.client.0.smithi071.stderr: -13> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.022 INFO:tasks.workunit.client.0.smithi071.stderr: -12> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:29:48.022 INFO:tasks.workunit.client.0.smithi071.stderr: -11> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:29:48.022 INFO:tasks.workunit.client.0.smithi071.stderr: -10> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:29:48.023 INFO:tasks.workunit.client.0.smithi071.stderr: -9> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 : miss 2024-09-14T11:29:48.023 INFO:tasks.workunit.client.0.smithi071.stderr: -8> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.023 INFO:tasks.workunit.client.0.smithi071.stderr: -7> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:29:48.023 INFO:tasks.workunit.client.0.smithi071.stderr: -6> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 info.flags=0x17 2024-09-14T11:29:48.023 INFO:tasks.workunit.client.0.smithi071.stderr: -5> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 to cache LRU end 2024-09-14T11:29:48.023 INFO:tasks.workunit.client.0.smithi071.stderr: -4> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:29:48.023 INFO:tasks.workunit.client.0.smithi071.stderr: -3> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:48.023 INFO:tasks.workunit.client.0.smithi071.stderr: -2> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 2024-09-14T11:29:48.023 INFO:tasks.workunit.client.0.smithi071.stderr: -1> 2024-09-14T11:29:47.960+0000 7fb05a0509c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb05a0509c0 time 2024-09-14T11:29:47.961699+0000 2024-09-14T11:29:48.023 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:29:48.023 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:48.023 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:29:48.023 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fb05d92a2eb] 2024-09-14T11:29:48.023 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb05d92a49f] 2024-09-14T11:29:48.023 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b5b71f7c01] 2024-09-14T11:29:48.024 INFO:tasks.workunit.client.0.smithi071.stderr: 4: radosgw-admin(+0x1422828) [0x55b5b7c55828] 2024-09-14T11:29:48.024 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b5b720cecd] 2024-09-14T11:29:48.024 INFO:tasks.workunit.client.0.smithi071.stderr: 6: main() 2024-09-14T11:29:48.024 INFO:tasks.workunit.client.0.smithi071.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb05c790d90] 2024-09-14T11:29:48.024 INFO:tasks.workunit.client.0.smithi071.stderr: 8: __libc_start_main() 2024-09-14T11:29:48.024 INFO:tasks.workunit.client.0.smithi071.stderr: 9: _start() 2024-09-14T11:29:48.024 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:48.024 INFO:tasks.workunit.client.0.smithi071.stderr: 0> 2024-09-14T11:29:47.960+0000 7fb05a0509c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:29:48.024 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7fb05a0509c0 thread_name:radosgw-admin 2024-09-14T11:29:48.024 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:48.024 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:29:48.024 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fb05c7a9520] 2024-09-14T11:29:48.024 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:29:48.024 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:29:48.025 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:29:48.025 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fb05d92a345] 2024-09-14T11:29:48.025 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb05d92a49f] 2024-09-14T11:29:48.025 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b5b71f7c01] 2024-09-14T11:29:48.025 INFO:tasks.workunit.client.0.smithi071.stderr: 8: radosgw-admin(+0x1422828) [0x55b5b7c55828] 2024-09-14T11:29:48.025 INFO:tasks.workunit.client.0.smithi071.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b5b720cecd] 2024-09-14T11:29:48.025 INFO:tasks.workunit.client.0.smithi071.stderr: 10: main() 2024-09-14T11:29:48.025 INFO:tasks.workunit.client.0.smithi071.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb05c790d90] 2024-09-14T11:29:48.025 INFO:tasks.workunit.client.0.smithi071.stderr: 12: __libc_start_main() 2024-09-14T11:29:48.025 INFO:tasks.workunit.client.0.smithi071.stderr: 13: _start() 2024-09-14T11:29:48.025 INFO:tasks.workunit.client.0.smithi071.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:29:48.025 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:48.025 INFO:tasks.workunit.client.0.smithi071.stderr:--- logging levels --- 2024-09-14T11:29:48.025 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 none 2024-09-14T11:29:48.026 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 lockdep 2024-09-14T11:29:48.026 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 context 2024-09-14T11:29:48.026 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 crush 2024-09-14T11:29:48.026 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds 2024-09-14T11:29:48.026 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_balancer 2024-09-14T11:29:48.026 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_locker 2024-09-14T11:29:48.026 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log 2024-09-14T11:29:48.026 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log_expire 2024-09-14T11:29:48.027 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_migrator 2024-09-14T11:29:48.027 INFO:tasks.workunit.client.0.smithi071.stderr: 3/ 5 mds_quiesce 2024-09-14T11:29:48.027 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 buffer 2024-09-14T11:29:48.027 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 timer 2024-09-14T11:29:48.028 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 filer 2024-09-14T11:29:48.028 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 striper 2024-09-14T11:29:48.028 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 objecter 2024-09-14T11:29:48.028 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rados 2024-09-14T11:29:48.028 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd 2024-09-14T11:29:48.028 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_mirror 2024-09-14T11:29:48.028 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_replay 2024-09-14T11:29:48.028 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_pwl 2024-09-14T11:29:48.028 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 journaler 2024-09-14T11:29:48.028 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objectcacher 2024-09-14T11:29:48.028 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:29:48.028 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 client 2024-09-14T11:29:48.028 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 osd 2024-09-14T11:29:48.028 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 optracker 2024-09-14T11:29:48.028 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objclass 2024-09-14T11:29:48.029 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 filestore 2024-09-14T11:29:48.029 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 journal 2024-09-14T11:29:48.029 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 ms 2024-09-14T11:29:48.029 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mon 2024-09-14T11:29:48.029 INFO:tasks.workunit.client.0.smithi071.stderr: 0/10 monc 2024-09-14T11:29:48.029 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 paxos 2024-09-14T11:29:48.029 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 tp 2024-09-14T11:29:48.029 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 auth 2024-09-14T11:29:48.029 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 crypto 2024-09-14T11:29:48.029 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 finisher 2024-09-14T11:29:48.029 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 reserver 2024-09-14T11:29:48.029 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 heartbeatmap 2024-09-14T11:29:48.029 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 perfcounter 2024-09-14T11:29:48.029 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw 2024-09-14T11:29:48.029 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_sync 2024-09-14T11:29:48.030 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_datacache 2024-09-14T11:29:48.030 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_access 2024-09-14T11:29:48.030 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:29:48.030 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_flight 2024-09-14T11:29:48.030 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:29:48.030 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw_notification 2024-09-14T11:29:48.030 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 javaclient 2024-09-14T11:29:48.030 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 asok 2024-09-14T11:29:48.030 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 throttle 2024-09-14T11:29:48.030 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 refs 2024-09-14T11:29:48.030 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 compressor 2024-09-14T11:29:48.030 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluestore 2024-09-14T11:29:48.030 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluefs 2024-09-14T11:29:48.030 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 bdev 2024-09-14T11:29:48.030 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 kstore 2024-09-14T11:29:48.030 INFO:tasks.workunit.client.0.smithi071.stderr: 4/ 5 rocksdb 2024-09-14T11:29:48.031 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 fuse 2024-09-14T11:29:48.031 INFO:tasks.workunit.client.0.smithi071.stderr: 2/ 5 mgr 2024-09-14T11:29:48.031 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mgrc 2024-09-14T11:29:48.031 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 dpdk 2024-09-14T11:29:48.031 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 eventtrace 2024-09-14T11:29:48.031 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 prioritycache 2024-09-14T11:29:48.031 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 test 2024-09-14T11:29:48.031 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:29:48.031 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephsqlite 2024-09-14T11:29:48.031 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:29:48.031 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore 2024-09-14T11:29:48.031 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_onode 2024-09-14T11:29:48.031 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_odata 2024-09-14T11:29:48.031 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_omap 2024-09-14T11:29:48.032 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_tm 2024-09-14T11:29:48.032 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_t 2024-09-14T11:29:48.032 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:29:48.032 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_epm 2024-09-14T11:29:48.032 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_lba 2024-09-14T11:29:48.032 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:29:48.032 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cache 2024-09-14T11:29:48.032 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_journal 2024-09-14T11:29:48.032 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_device 2024-09-14T11:29:48.032 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_backref 2024-09-14T11:29:48.032 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 alienstore 2024-09-14T11:29:48.032 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mclock 2024-09-14T11:29:48.032 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cyanstore 2024-09-14T11:29:48.032 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 ceph_exporter 2024-09-14T11:29:48.032 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 memstore 2024-09-14T11:29:48.033 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 trace 2024-09-14T11:29:48.033 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 ceph_dedup 2024-09-14T11:29:48.033 INFO:tasks.workunit.client.0.smithi071.stderr: -2/-2 (syslog threshold) 2024-09-14T11:29:48.033 INFO:tasks.workunit.client.0.smithi071.stderr: 99/99 (stderr threshold) 2024-09-14T11:29:48.033 INFO:tasks.workunit.client.0.smithi071.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:29:48.033 INFO:tasks.workunit.client.0.smithi071.stderr: 7fae867fc640 / http_manager 2024-09-14T11:29:48.033 INFO:tasks.workunit.client.0.smithi071.stderr: 7faf0cfe1640 / http_manager 2024-09-14T11:29:48.033 INFO:tasks.workunit.client.0.smithi071.stderr: 7faf0dfe3640 / rgw_dt_lg_renew 2024-09-14T11:29:48.033 INFO:tasks.workunit.client.0.smithi071.stderr: 7faf357fa640 / ms_dispatch 2024-09-14T11:29:48.033 INFO:tasks.workunit.client.0.smithi071.stderr: 7faf36ffd640 / io_context_pool 2024-09-14T11:29:48.033 INFO:tasks.workunit.client.0.smithi071.stderr: 7faf3d7fa640 / ms_dispatch 2024-09-14T11:29:48.033 INFO:tasks.workunit.client.0.smithi071.stderr: 7faf3ffff640 / ms_dispatch 2024-09-14T11:29:48.033 INFO:tasks.workunit.client.0.smithi071.stderr: 7faf45e0b640 / io_context_pool 2024-09-14T11:29:48.033 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb057355640 / msgr-worker-2 2024-09-14T11:29:48.033 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb057b56640 / msgr-worker-1 2024-09-14T11:29:48.034 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb058357640 / msgr-worker-0 2024-09-14T11:29:48.034 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb058b58640 / io_context_pool 2024-09-14T11:29:48.034 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb05a0509c0 / radosgw-admin 2024-09-14T11:29:48.034 INFO:tasks.workunit.client.0.smithi071.stderr: max_recent 500 2024-09-14T11:29:48.034 INFO:tasks.workunit.client.0.smithi071.stderr: max_new 1000 2024-09-14T11:29:48.034 INFO:tasks.workunit.client.0.smithi071.stderr: log_file /var/log/ceph/ceph-client.admin.90181.log 2024-09-14T11:29:48.034 INFO:tasks.workunit.client.0.smithi071.stderr:--- end dump of recent events --- 2024-09-14T11:29:48.034 INFO:tasks.workunit.client.0.smithi071.stderr:--- begin dump of recent events --- 2024-09-14T11:29:48.034 INFO:tasks.workunit.client.0.smithi071.stderr: -499> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient(hunting): get_auth_request con 0x55b5b9217070 auth_method 0 2024-09-14T11:29:48.034 INFO:tasks.workunit.client.0.smithi071.stderr: -498> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:48.034 INFO:tasks.workunit.client.0.smithi071.stderr: -497> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:48.034 INFO:tasks.workunit.client.0.smithi071.stderr: -496> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:48.034 INFO:tasks.workunit.client.0.smithi071.stderr: -495> 2024-09-14T11:29:47.876+0000 7fb057355640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:48.034 INFO:tasks.workunit.client.0.smithi071.stderr: -494> 2024-09-14T11:29:47.876+0000 7fb057355640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:48.035 INFO:tasks.workunit.client.0.smithi071.stderr: -493> 2024-09-14T11:29:47.876+0000 7fb057355640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:48.035 INFO:tasks.workunit.client.0.smithi071.stderr: -492> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:48.035 INFO:tasks.workunit.client.0.smithi071.stderr: -491> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:48.035 INFO:tasks.workunit.client.0.smithi071.stderr: -490> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:48.035 INFO:tasks.workunit.client.0.smithi071.stderr: -489> 2024-09-14T11:29:47.876+0000 7fb058357640 10 monclient(hunting): get_auth_request con 0x55b5b92b06a0 auth_method 0 2024-09-14T11:29:48.035 INFO:tasks.workunit.client.0.smithi071.stderr: -488> 2024-09-14T11:29:47.876+0000 7fb058357640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:48.035 INFO:tasks.workunit.client.0.smithi071.stderr: -487> 2024-09-14T11:29:47.876+0000 7fb058357640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:48.035 INFO:tasks.workunit.client.0.smithi071.stderr: -486> 2024-09-14T11:29:47.876+0000 7fb058357640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:48.035 INFO:tasks.workunit.client.0.smithi071.stderr: -485> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient(hunting): handle_auth_done global_id 6561 payload 274 2024-09-14T11:29:48.035 INFO:tasks.workunit.client.0.smithi071.stderr: -484> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient: _finish_hunting 0 2024-09-14T11:29:48.035 INFO:tasks.workunit.client.0.smithi071.stderr: -483> 2024-09-14T11:29:47.876+0000 7fb057b56640 1 monclient: found mon.noname-a 2024-09-14T11:29:48.035 INFO:tasks.workunit.client.0.smithi071.stderr: -482> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:29:48.035 INFO:tasks.workunit.client.0.smithi071.stderr: -481> 2024-09-14T11:29:47.876+0000 7faf45e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:48.035 INFO:tasks.workunit.client.0.smithi071.stderr: -480> 2024-09-14T11:29:47.876+0000 7faf45e0b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:29:48.035 INFO:tasks.workunit.client.0.smithi071.stderr: -479> 2024-09-14T11:29:47.876+0000 7faf45e0b640 10 monclient: dump: 2024-09-14T11:29:48.036 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:48.036 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:48.036 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:48.036 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:48.036 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:48.036 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:48.036 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:48.036 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:48.036 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:48.036 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:48.036 INFO:tasks.workunit.client.0.smithi071.stderr: -478> 2024-09-14T11:29:47.876+0000 7faf45e0b640 10 monclient: _finish_auth 0 2024-09-14T11:29:48.036 INFO:tasks.workunit.client.0.smithi071.stderr: -477> 2024-09-14T11:29:47.876+0000 7faf45e0b640 10 monclient: _check_auth_tickets 2024-09-14T11:29:48.036 INFO:tasks.workunit.client.0.smithi071.stderr: -476> 2024-09-14T11:29:47.876+0000 7faf45e0b640 10 monclient: handle_config config(0 keys) 2024-09-14T11:29:48.036 INFO:tasks.workunit.client.0.smithi071.stderr: -475> 2024-09-14T11:29:47.876+0000 7faf45e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:48.037 INFO:tasks.workunit.client.0.smithi071.stderr: -474> 2024-09-14T11:29:47.876+0000 7faf45e0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:29:48.037 INFO:tasks.workunit.client.0.smithi071.stderr: -473> 2024-09-14T11:29:47.876+0000 7faf45e0b640 10 monclient: dump: 2024-09-14T11:29:48.037 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:48.037 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:48.037 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:48.037 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:48.037 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:48.037 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:48.037 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:48.037 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:48.037 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:48.037 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:48.037 INFO:tasks.workunit.client.0.smithi071.stderr: -472> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 monclient: authenticate success, global_id 6561 2024-09-14T11:29:48.037 INFO:tasks.workunit.client.0.smithi071.stderr: -471> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient: get_monmap_and_config success 2024-09-14T11:29:48.038 INFO:tasks.workunit.client.0.smithi071.stderr: -470> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 4 set_mon_vals no callback set 2024-09-14T11:29:48.038 INFO:tasks.workunit.client.0.smithi071.stderr: -469> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient: shutdown 2024-09-14T11:29:48.038 INFO:tasks.workunit.client.0.smithi071.stderr: -468> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 asok(0x55b5b915cd90) unregister_commands rotate-key 2024-09-14T11:29:48.038 INFO:tasks.workunit.client.0.smithi071.stderr: -467> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient: build_initial_monmap 2024-09-14T11:29:48.038 INFO:tasks.workunit.client.0.smithi071.stderr: -466> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 1 build_initial for_mkfs: 0 2024-09-14T11:29:48.038 INFO:tasks.workunit.client.0.smithi071.stderr: -465> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient: monmap: 2024-09-14T11:29:48.038 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:29:48.038 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:29:48.038 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:29:48.038 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:29:48.038 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:29:48.038 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:48.038 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:29:48.038 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:29:48.039 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:29:48.039 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:48.039 INFO:tasks.workunit.client.0.smithi071.stderr: -464> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b936d330) adding auth protocol: cephx 2024-09-14T11:29:48.039 INFO:tasks.workunit.client.0.smithi071.stderr: -463> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b936d330) adding auth protocol: cephx 2024-09-14T11:29:48.039 INFO:tasks.workunit.client.0.smithi071.stderr: -462> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b936d330) adding auth protocol: cephx 2024-09-14T11:29:48.039 INFO:tasks.workunit.client.0.smithi071.stderr: -461> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b936d330) adding con mode: secure 2024-09-14T11:29:48.039 INFO:tasks.workunit.client.0.smithi071.stderr: -460> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b936d330) adding con mode: crc 2024-09-14T11:29:48.039 INFO:tasks.workunit.client.0.smithi071.stderr: -459> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b936d330) adding con mode: secure 2024-09-14T11:29:48.039 INFO:tasks.workunit.client.0.smithi071.stderr: -458> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b936d330) adding con mode: crc 2024-09-14T11:29:48.039 INFO:tasks.workunit.client.0.smithi071.stderr: -457> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b936d330) adding con mode: secure 2024-09-14T11:29:48.039 INFO:tasks.workunit.client.0.smithi071.stderr: -456> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b936d330) adding con mode: crc 2024-09-14T11:29:48.039 INFO:tasks.workunit.client.0.smithi071.stderr: -455> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b936d330) adding con mode: crc 2024-09-14T11:29:48.039 INFO:tasks.workunit.client.0.smithi071.stderr: -454> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b936d330) adding con mode: secure 2024-09-14T11:29:48.039 INFO:tasks.workunit.client.0.smithi071.stderr: -453> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b936d330) adding con mode: crc 2024-09-14T11:29:48.039 INFO:tasks.workunit.client.0.smithi071.stderr: -452> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b936d330) adding con mode: secure 2024-09-14T11:29:48.040 INFO:tasks.workunit.client.0.smithi071.stderr: -451> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b936d330) adding con mode: crc 2024-09-14T11:29:48.040 INFO:tasks.workunit.client.0.smithi071.stderr: -450> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b936d330) adding con mode: secure 2024-09-14T11:29:48.040 INFO:tasks.workunit.client.0.smithi071.stderr: -449> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:48.040 INFO:tasks.workunit.client.0.smithi071.stderr: -448> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 1 librados: starting msgr at 2024-09-14T11:29:48.040 INFO:tasks.workunit.client.0.smithi071.stderr: -447> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 1 librados: starting objecter 2024-09-14T11:29:48.040 INFO:tasks.workunit.client.0.smithi071.stderr: -446> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 asok(0x55b5b915cd90) register_command objecter_requests hook 0x55b5b90d7e00 2024-09-14T11:29:48.040 INFO:tasks.workunit.client.0.smithi071.stderr: -445> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 1 librados: setting wanted keys 2024-09-14T11:29:48.040 INFO:tasks.workunit.client.0.smithi071.stderr: -444> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 1 librados: calling monclient init 2024-09-14T11:29:48.040 INFO:tasks.workunit.client.0.smithi071.stderr: -443> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient: init 2024-09-14T11:29:48.040 INFO:tasks.workunit.client.0.smithi071.stderr: -442> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9367140) adding auth protocol: cephx 2024-09-14T11:29:48.040 INFO:tasks.workunit.client.0.smithi071.stderr: -441> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9367140) adding auth protocol: cephx 2024-09-14T11:29:48.040 INFO:tasks.workunit.client.0.smithi071.stderr: -440> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9367140) adding auth protocol: cephx 2024-09-14T11:29:48.040 INFO:tasks.workunit.client.0.smithi071.stderr: -439> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9367140) adding con mode: secure 2024-09-14T11:29:48.040 INFO:tasks.workunit.client.0.smithi071.stderr: -438> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9367140) adding con mode: crc 2024-09-14T11:29:48.040 INFO:tasks.workunit.client.0.smithi071.stderr: -437> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9367140) adding con mode: secure 2024-09-14T11:29:48.041 INFO:tasks.workunit.client.0.smithi071.stderr: -436> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9367140) adding con mode: crc 2024-09-14T11:29:48.041 INFO:tasks.workunit.client.0.smithi071.stderr: -435> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9367140) adding con mode: secure 2024-09-14T11:29:48.041 INFO:tasks.workunit.client.0.smithi071.stderr: -434> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9367140) adding con mode: crc 2024-09-14T11:29:48.041 INFO:tasks.workunit.client.0.smithi071.stderr: -433> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9367140) adding con mode: crc 2024-09-14T11:29:48.041 INFO:tasks.workunit.client.0.smithi071.stderr: -432> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9367140) adding con mode: secure 2024-09-14T11:29:48.041 INFO:tasks.workunit.client.0.smithi071.stderr: -431> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9367140) adding con mode: crc 2024-09-14T11:29:48.041 INFO:tasks.workunit.client.0.smithi071.stderr: -430> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9367140) adding con mode: secure 2024-09-14T11:29:48.041 INFO:tasks.workunit.client.0.smithi071.stderr: -429> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9367140) adding con mode: crc 2024-09-14T11:29:48.041 INFO:tasks.workunit.client.0.smithi071.stderr: -428> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9367140) adding con mode: secure 2024-09-14T11:29:48.041 INFO:tasks.workunit.client.0.smithi071.stderr: -427> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:48.041 INFO:tasks.workunit.client.0.smithi071.stderr: -426> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:48.041 INFO:tasks.workunit.client.0.smithi071.stderr: -425> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 asok(0x55b5b915cd90) register_command rotate-key hook 0x55b5b9367288 2024-09-14T11:29:48.041 INFO:tasks.workunit.client.0.smithi071.stderr: -424> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient: _reopen_session rank -1 2024-09-14T11:29:48.041 INFO:tasks.workunit.client.0.smithi071.stderr: -423> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:29:48.042 INFO:tasks.workunit.client.0.smithi071.stderr: -422> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient(hunting): picked mon.noname-c con 0x55b5b9217070 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:29:48.042 INFO:tasks.workunit.client.0.smithi071.stderr: -421> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient(hunting): picked mon.noname-b con 0x55b5b92b0290 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:29:48.042 INFO:tasks.workunit.client.0.smithi071.stderr: -420> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient(hunting): picked mon.noname-a con 0x55b5b92b06a0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:29:48.042 INFO:tasks.workunit.client.0.smithi071.stderr: -419> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:48.042 INFO:tasks.workunit.client.0.smithi071.stderr: -418> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:48.042 INFO:tasks.workunit.client.0.smithi071.stderr: -417> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:48.042 INFO:tasks.workunit.client.0.smithi071.stderr: -416> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient(hunting): _renew_subs 2024-09-14T11:29:48.042 INFO:tasks.workunit.client.0.smithi071.stderr: -415> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient(hunting): authenticate will time out at 2199.999047s 2024-09-14T11:29:48.042 INFO:tasks.workunit.client.0.smithi071.stderr: -414> 2024-09-14T11:29:47.876+0000 7fb058357640 10 monclient(hunting): get_auth_request con 0x55b5b92b06a0 auth_method 0 2024-09-14T11:29:48.042 INFO:tasks.workunit.client.0.smithi071.stderr: -413> 2024-09-14T11:29:47.876+0000 7fb058357640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:48.042 INFO:tasks.workunit.client.0.smithi071.stderr: -412> 2024-09-14T11:29:47.876+0000 7fb058357640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:48.042 INFO:tasks.workunit.client.0.smithi071.stderr: -411> 2024-09-14T11:29:47.876+0000 7fb058357640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:48.042 INFO:tasks.workunit.client.0.smithi071.stderr: -410> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient(hunting): get_auth_request con 0x55b5b9217070 auth_method 0 2024-09-14T11:29:48.042 INFO:tasks.workunit.client.0.smithi071.stderr: -409> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:48.042 INFO:tasks.workunit.client.0.smithi071.stderr: -408> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:48.043 INFO:tasks.workunit.client.0.smithi071.stderr: -407> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:48.043 INFO:tasks.workunit.client.0.smithi071.stderr: -406> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:48.043 INFO:tasks.workunit.client.0.smithi071.stderr: -405> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:48.043 INFO:tasks.workunit.client.0.smithi071.stderr: -404> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:48.043 INFO:tasks.workunit.client.0.smithi071.stderr: -403> 2024-09-14T11:29:47.876+0000 7fb058357640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:48.043 INFO:tasks.workunit.client.0.smithi071.stderr: -402> 2024-09-14T11:29:47.876+0000 7fb058357640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:48.043 INFO:tasks.workunit.client.0.smithi071.stderr: -401> 2024-09-14T11:29:47.876+0000 7fb058357640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:48.043 INFO:tasks.workunit.client.0.smithi071.stderr: -400> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient(hunting): handle_auth_done global_id 6272 payload 824 2024-09-14T11:29:48.043 INFO:tasks.workunit.client.0.smithi071.stderr: -399> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient: _finish_hunting 0 2024-09-14T11:29:48.043 INFO:tasks.workunit.client.0.smithi071.stderr: -398> 2024-09-14T11:29:47.876+0000 7fb057b56640 1 monclient: found mon.noname-c 2024-09-14T11:29:48.043 INFO:tasks.workunit.client.0.smithi071.stderr: -397> 2024-09-14T11:29:47.876+0000 7fb057b56640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:29:48.043 INFO:tasks.workunit.client.0.smithi071.stderr: -396> 2024-09-14T11:29:47.876+0000 7faf3ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:48.043 INFO:tasks.workunit.client.0.smithi071.stderr: -395> 2024-09-14T11:29:47.876+0000 7faf3ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:29:48.043 INFO:tasks.workunit.client.0.smithi071.stderr: -394> 2024-09-14T11:29:47.876+0000 7faf3ffff640 10 monclient: dump: 2024-09-14T11:29:48.044 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:48.044 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:48.044 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:48.044 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:48.044 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:48.044 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:48.044 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:48.044 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:48.044 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:48.044 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:48.044 INFO:tasks.workunit.client.0.smithi071.stderr: -393> 2024-09-14T11:29:47.876+0000 7faf3ffff640 10 monclient: _finish_auth 0 2024-09-14T11:29:48.044 INFO:tasks.workunit.client.0.smithi071.stderr: -392> 2024-09-14T11:29:47.876+0000 7faf3ffff640 10 monclient: _check_auth_tickets 2024-09-14T11:29:48.044 INFO:tasks.workunit.client.0.smithi071.stderr: -391> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 5 monclient: authenticate success, global_id 6272 2024-09-14T11:29:48.044 INFO:tasks.workunit.client.0.smithi071.stderr: -390> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient: _renew_subs 2024-09-14T11:29:48.044 INFO:tasks.workunit.client.0.smithi071.stderr: -389> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:29:48.045 INFO:tasks.workunit.client.0.smithi071.stderr: -388> 2024-09-14T11:29:47.876+0000 7faf3ffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:29:48.045 INFO:tasks.workunit.client.0.smithi071.stderr: -387> 2024-09-14T11:29:47.876+0000 7faf3ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:48.045 INFO:tasks.workunit.client.0.smithi071.stderr: -386> 2024-09-14T11:29:47.876+0000 7faf3ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:29:48.045 INFO:tasks.workunit.client.0.smithi071.stderr: -385> 2024-09-14T11:29:47.876+0000 7faf3ffff640 10 monclient: dump: 2024-09-14T11:29:48.045 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:48.045 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:48.045 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:48.045 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:48.045 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:48.045 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:48.045 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:48.045 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:48.045 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:48.046 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:48.046 INFO:tasks.workunit.client.0.smithi071.stderr: -384> 2024-09-14T11:29:47.876+0000 7faf45e0b640 4 set_mon_vals no callback set 2024-09-14T11:29:48.046 INFO:tasks.workunit.client.0.smithi071.stderr: -383> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient: _renew_subs 2024-09-14T11:29:48.046 INFO:tasks.workunit.client.0.smithi071.stderr: -382> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:29:48.046 INFO:tasks.workunit.client.0.smithi071.stderr: -381> 2024-09-14T11:29:47.876+0000 7fb05a0509c0 1 librados: init done 2024-09-14T11:29:48.046 INFO:tasks.workunit.client.0.smithi071.stderr: -380> 2024-09-14T11:29:47.880+0000 7faf3ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:29:48.046 INFO:tasks.workunit.client.0.smithi071.stderr: -379> 2024-09-14T11:29:47.880+0000 7faf3ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:29:48.046 INFO:tasks.workunit.client.0.smithi071.stderr: -378> 2024-09-14T11:29:47.880+0000 7faf3ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:29:48.046 INFO:tasks.workunit.client.0.smithi071.stderr: -377> 2024-09-14T11:29:47.880+0000 7fb057355640 10 monclient: get_auth_request con 0x7faf400718a0 auth_method 0 2024-09-14T11:29:48.046 INFO:tasks.workunit.client.0.smithi071.stderr: -376> 2024-09-14T11:29:47.880+0000 7fb058357640 10 monclient: get_auth_request con 0x55b5b93a9860 auth_method 0 2024-09-14T11:29:48.046 INFO:tasks.workunit.client.0.smithi071.stderr: -375> 2024-09-14T11:29:47.880+0000 7fb057b56640 10 monclient: get_auth_request con 0x55b5b93b2d90 auth_method 0 2024-09-14T11:29:48.046 INFO:tasks.workunit.client.0.smithi071.stderr: -374> 2024-09-14T11:29:47.884+0000 7fb057355640 10 monclient: get_auth_request con 0x55b5b93b6fd0 auth_method 0 2024-09-14T11:29:48.046 INFO:tasks.workunit.client.0.smithi071.stderr: -373> 2024-09-14T11:29:47.884+0000 7fb058357640 10 monclient: get_auth_request con 0x55b5b93b6640 auth_method 0 2024-09-14T11:29:48.046 INFO:tasks.workunit.client.0.smithi071.stderr: -372> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 10 monclient: build_initial_monmap 2024-09-14T11:29:48.046 INFO:tasks.workunit.client.0.smithi071.stderr: -371> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 1 build_initial for_mkfs: 0 2024-09-14T11:29:48.047 INFO:tasks.workunit.client.0.smithi071.stderr: -370> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 10 monclient: monmap: 2024-09-14T11:29:48.047 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:29:48.047 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:29:48.047 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:29:48.047 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:29:48.047 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:29:48.047 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:48.047 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:29:48.047 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:29:48.047 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:29:48.047 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:48.047 INFO:tasks.workunit.client.0.smithi071.stderr: -369> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93bf110) adding auth protocol: cephx 2024-09-14T11:29:48.047 INFO:tasks.workunit.client.0.smithi071.stderr: -368> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93bf110) adding auth protocol: cephx 2024-09-14T11:29:48.047 INFO:tasks.workunit.client.0.smithi071.stderr: -367> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93bf110) adding auth protocol: cephx 2024-09-14T11:29:48.047 INFO:tasks.workunit.client.0.smithi071.stderr: -366> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93bf110) adding con mode: secure 2024-09-14T11:29:48.048 INFO:tasks.workunit.client.0.smithi071.stderr: -365> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93bf110) adding con mode: crc 2024-09-14T11:29:48.048 INFO:tasks.workunit.client.0.smithi071.stderr: -364> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93bf110) adding con mode: secure 2024-09-14T11:29:48.048 INFO:tasks.workunit.client.0.smithi071.stderr: -363> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93bf110) adding con mode: crc 2024-09-14T11:29:48.048 INFO:tasks.workunit.client.0.smithi071.stderr: -362> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93bf110) adding con mode: secure 2024-09-14T11:29:48.048 INFO:tasks.workunit.client.0.smithi071.stderr: -361> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93bf110) adding con mode: crc 2024-09-14T11:29:48.048 INFO:tasks.workunit.client.0.smithi071.stderr: -360> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93bf110) adding con mode: crc 2024-09-14T11:29:48.048 INFO:tasks.workunit.client.0.smithi071.stderr: -359> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93bf110) adding con mode: secure 2024-09-14T11:29:48.048 INFO:tasks.workunit.client.0.smithi071.stderr: -358> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93bf110) adding con mode: crc 2024-09-14T11:29:48.048 INFO:tasks.workunit.client.0.smithi071.stderr: -357> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93bf110) adding con mode: secure 2024-09-14T11:29:48.048 INFO:tasks.workunit.client.0.smithi071.stderr: -356> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93bf110) adding con mode: crc 2024-09-14T11:29:48.048 INFO:tasks.workunit.client.0.smithi071.stderr: -355> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93bf110) adding con mode: secure 2024-09-14T11:29:48.048 INFO:tasks.workunit.client.0.smithi071.stderr: -354> 2024-09-14T11:29:47.884+0000 7fb05a0509c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:48.048 INFO:tasks.workunit.client.0.smithi071.stderr: -353> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 5 asok(0x55b5b915cd90) register_command objecter_requests cmddesc objecter_requests hook 0x55b5b93c2b20 EEXIST 2024-09-14T11:29:48.048 INFO:tasks.workunit.client.0.smithi071.stderr: -352> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 10 monclient: init 2024-09-14T11:29:48.048 INFO:tasks.workunit.client.0.smithi071.stderr: -351> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93be058) adding auth protocol: cephx 2024-09-14T11:29:48.049 INFO:tasks.workunit.client.0.smithi071.stderr: -350> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93be058) adding auth protocol: cephx 2024-09-14T11:29:48.049 INFO:tasks.workunit.client.0.smithi071.stderr: -349> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93be058) adding auth protocol: cephx 2024-09-14T11:29:48.049 INFO:tasks.workunit.client.0.smithi071.stderr: -348> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93be058) adding con mode: secure 2024-09-14T11:29:48.049 INFO:tasks.workunit.client.0.smithi071.stderr: -347> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93be058) adding con mode: crc 2024-09-14T11:29:48.049 INFO:tasks.workunit.client.0.smithi071.stderr: -346> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93be058) adding con mode: secure 2024-09-14T11:29:48.049 INFO:tasks.workunit.client.0.smithi071.stderr: -345> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93be058) adding con mode: crc 2024-09-14T11:29:48.049 INFO:tasks.workunit.client.0.smithi071.stderr: -344> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93be058) adding con mode: secure 2024-09-14T11:29:48.049 INFO:tasks.workunit.client.0.smithi071.stderr: -343> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93be058) adding con mode: crc 2024-09-14T11:29:48.049 INFO:tasks.workunit.client.0.smithi071.stderr: -342> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93be058) adding con mode: crc 2024-09-14T11:29:48.049 INFO:tasks.workunit.client.0.smithi071.stderr: -341> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93be058) adding con mode: secure 2024-09-14T11:29:48.049 INFO:tasks.workunit.client.0.smithi071.stderr: -340> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93be058) adding con mode: crc 2024-09-14T11:29:48.049 INFO:tasks.workunit.client.0.smithi071.stderr: -339> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93be058) adding con mode: secure 2024-09-14T11:29:48.049 INFO:tasks.workunit.client.0.smithi071.stderr: -338> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93be058) adding con mode: crc 2024-09-14T11:29:48.050 INFO:tasks.workunit.client.0.smithi071.stderr: -337> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93be058) adding con mode: secure 2024-09-14T11:29:48.050 INFO:tasks.workunit.client.0.smithi071.stderr: -336> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:48.050 INFO:tasks.workunit.client.0.smithi071.stderr: -335> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:48.050 INFO:tasks.workunit.client.0.smithi071.stderr: -334> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 5 asok(0x55b5b915cd90) register_command rotate-key cmddesc rotate-key hook 0x55b5b93be1a0 EEXIST 2024-09-14T11:29:48.050 INFO:tasks.workunit.client.0.smithi071.stderr: -333> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 10 monclient: _reopen_session rank -1 2024-09-14T11:29:48.050 INFO:tasks.workunit.client.0.smithi071.stderr: -332> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:29:48.050 INFO:tasks.workunit.client.0.smithi071.stderr: -331> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 10 monclient(hunting): picked mon.noname-a con 0x55b5b93e6cd0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:29:48.050 INFO:tasks.workunit.client.0.smithi071.stderr: -330> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 10 monclient(hunting): picked mon.noname-c con 0x55b5b93e6600 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:29:48.050 INFO:tasks.workunit.client.0.smithi071.stderr: -329> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 10 monclient(hunting): picked mon.noname-b con 0x55b5b93e4fe0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:29:48.050 INFO:tasks.workunit.client.0.smithi071.stderr: -328> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:48.050 INFO:tasks.workunit.client.0.smithi071.stderr: -327> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:48.050 INFO:tasks.workunit.client.0.smithi071.stderr: -326> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:48.050 INFO:tasks.workunit.client.0.smithi071.stderr: -325> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 10 monclient(hunting): _renew_subs 2024-09-14T11:29:48.050 INFO:tasks.workunit.client.0.smithi071.stderr: -324> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 10 monclient(hunting): authenticate will time out at 2200.008678s 2024-09-14T11:29:48.050 INFO:tasks.workunit.client.0.smithi071.stderr: -323> 2024-09-14T11:29:47.888+0000 7fb058357640 10 monclient(hunting): get_auth_request con 0x55b5b93e6600 auth_method 0 2024-09-14T11:29:48.051 INFO:tasks.workunit.client.0.smithi071.stderr: -322> 2024-09-14T11:29:47.888+0000 7fb058357640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:48.051 INFO:tasks.workunit.client.0.smithi071.stderr: -321> 2024-09-14T11:29:47.888+0000 7fb058357640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:48.051 INFO:tasks.workunit.client.0.smithi071.stderr: -320> 2024-09-14T11:29:47.888+0000 7fb058357640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:48.051 INFO:tasks.workunit.client.0.smithi071.stderr: -319> 2024-09-14T11:29:47.888+0000 7fb057355640 10 monclient(hunting): get_auth_request con 0x55b5b93e6cd0 auth_method 0 2024-09-14T11:29:48.051 INFO:tasks.workunit.client.0.smithi071.stderr: -318> 2024-09-14T11:29:47.888+0000 7fb057355640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:48.051 INFO:tasks.workunit.client.0.smithi071.stderr: -317> 2024-09-14T11:29:47.888+0000 7fb057355640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:48.051 INFO:tasks.workunit.client.0.smithi071.stderr: -316> 2024-09-14T11:29:47.888+0000 7fb057355640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:48.051 INFO:tasks.workunit.client.0.smithi071.stderr: -315> 2024-09-14T11:29:47.888+0000 7fb058357640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:48.051 INFO:tasks.workunit.client.0.smithi071.stderr: -314> 2024-09-14T11:29:47.888+0000 7fb058357640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:48.051 INFO:tasks.workunit.client.0.smithi071.stderr: -313> 2024-09-14T11:29:47.888+0000 7fb058357640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:48.051 INFO:tasks.workunit.client.0.smithi071.stderr: -312> 2024-09-14T11:29:47.888+0000 7fb057355640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:48.051 INFO:tasks.workunit.client.0.smithi071.stderr: -311> 2024-09-14T11:29:47.888+0000 7fb057355640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:48.051 INFO:tasks.workunit.client.0.smithi071.stderr: -310> 2024-09-14T11:29:47.888+0000 7fb057355640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:48.052 INFO:tasks.workunit.client.0.smithi071.stderr: -309> 2024-09-14T11:29:47.888+0000 7fb057b56640 10 monclient(hunting): get_auth_request con 0x55b5b93e4fe0 auth_method 0 2024-09-14T11:29:48.052 INFO:tasks.workunit.client.0.smithi071.stderr: -308> 2024-09-14T11:29:47.888+0000 7fb057b56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:48.052 INFO:tasks.workunit.client.0.smithi071.stderr: -307> 2024-09-14T11:29:47.888+0000 7fb057b56640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:48.052 INFO:tasks.workunit.client.0.smithi071.stderr: -306> 2024-09-14T11:29:47.888+0000 7fb057b56640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:48.052 INFO:tasks.workunit.client.0.smithi071.stderr: -305> 2024-09-14T11:29:47.888+0000 7fb058357640 10 monclient(hunting): handle_auth_done global_id 6275 payload 824 2024-09-14T11:29:48.052 INFO:tasks.workunit.client.0.smithi071.stderr: -304> 2024-09-14T11:29:47.888+0000 7fb058357640 10 monclient: _finish_hunting 0 2024-09-14T11:29:48.052 INFO:tasks.workunit.client.0.smithi071.stderr: -303> 2024-09-14T11:29:47.888+0000 7fb058357640 1 monclient: found mon.noname-c 2024-09-14T11:29:48.052 INFO:tasks.workunit.client.0.smithi071.stderr: -302> 2024-09-14T11:29:47.888+0000 7fb058357640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:29:48.052 INFO:tasks.workunit.client.0.smithi071.stderr: -301> 2024-09-14T11:29:47.888+0000 7faf3d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:48.052 INFO:tasks.workunit.client.0.smithi071.stderr: -300> 2024-09-14T11:29:47.888+0000 7faf3d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:29:48.052 INFO:tasks.workunit.client.0.smithi071.stderr: -299> 2024-09-14T11:29:47.888+0000 7faf3d7fa640 10 monclient: dump: 2024-09-14T11:29:48.052 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:48.052 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:48.053 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:48.053 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:48.053 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:48.053 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:48.053 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:48.053 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:48.053 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:48.053 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:48.053 INFO:tasks.workunit.client.0.smithi071.stderr: -298> 2024-09-14T11:29:47.888+0000 7faf3d7fa640 10 monclient: _finish_auth 0 2024-09-14T11:29:48.053 INFO:tasks.workunit.client.0.smithi071.stderr: -297> 2024-09-14T11:29:47.888+0000 7faf3d7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:29:48.053 INFO:tasks.workunit.client.0.smithi071.stderr: -296> 2024-09-14T11:29:47.888+0000 7faf3d7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:29:48.053 INFO:tasks.workunit.client.0.smithi071.stderr: -295> 2024-09-14T11:29:47.888+0000 7faf3d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:48.053 INFO:tasks.workunit.client.0.smithi071.stderr: -294> 2024-09-14T11:29:47.888+0000 7faf3d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:29:48.053 INFO:tasks.workunit.client.0.smithi071.stderr: -293> 2024-09-14T11:29:47.888+0000 7faf3d7fa640 10 monclient: dump: 2024-09-14T11:29:48.054 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:48.054 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:48.054 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:48.054 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:48.054 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:48.054 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:48.054 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:48.054 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:48.054 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:48.054 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:48.054 INFO:tasks.workunit.client.0.smithi071.stderr: -292> 2024-09-14T11:29:47.888+0000 7fb058b58640 4 set_mon_vals no callback set 2024-09-14T11:29:48.054 INFO:tasks.workunit.client.0.smithi071.stderr: -291> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 5 monclient: authenticate success, global_id 6275 2024-09-14T11:29:48.054 INFO:tasks.workunit.client.0.smithi071.stderr: -290> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 10 monclient: _renew_subs 2024-09-14T11:29:48.054 INFO:tasks.workunit.client.0.smithi071.stderr: -289> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:29:48.055 INFO:tasks.workunit.client.0.smithi071.stderr: -288> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 10 monclient: _renew_subs 2024-09-14T11:29:48.055 INFO:tasks.workunit.client.0.smithi071.stderr: -287> 2024-09-14T11:29:47.888+0000 7fb05a0509c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:29:48.055 INFO:tasks.workunit.client.0.smithi071.stderr: -286> 2024-09-14T11:29:47.888+0000 7faf3d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:29:48.055 INFO:tasks.workunit.client.0.smithi071.stderr: -285> 2024-09-14T11:29:47.888+0000 7faf3d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:29:48.055 INFO:tasks.workunit.client.0.smithi071.stderr: -284> 2024-09-14T11:29:47.888+0000 7faf3d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:29:48.055 INFO:tasks.workunit.client.0.smithi071.stderr: -283> 2024-09-14T11:29:47.892+0000 7fb057355640 10 monclient: get_auth_request con 0x7faf300717e0 auth_method 0 2024-09-14T11:29:48.055 INFO:tasks.workunit.client.0.smithi071.stderr: -282> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient: get_monmap_and_config 2024-09-14T11:29:48.055 INFO:tasks.workunit.client.0.smithi071.stderr: -281> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient: build_initial_monmap 2024-09-14T11:29:48.055 INFO:tasks.workunit.client.0.smithi071.stderr: -280> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 1 build_initial for_mkfs: 0 2024-09-14T11:29:48.055 INFO:tasks.workunit.client.0.smithi071.stderr: -279> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient: monmap: 2024-09-14T11:29:48.055 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:29:48.055 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:29:48.055 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:29:48.055 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:29:48.055 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:29:48.056 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:48.056 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:29:48.056 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:29:48.056 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:29:48.056 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:48.056 INFO:tasks.workunit.client.0.smithi071.stderr: -278> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9406480) adding auth protocol: cephx 2024-09-14T11:29:48.056 INFO:tasks.workunit.client.0.smithi071.stderr: -277> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9406480) adding auth protocol: cephx 2024-09-14T11:29:48.056 INFO:tasks.workunit.client.0.smithi071.stderr: -276> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9406480) adding auth protocol: cephx 2024-09-14T11:29:48.056 INFO:tasks.workunit.client.0.smithi071.stderr: -275> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9406480) adding con mode: secure 2024-09-14T11:29:48.056 INFO:tasks.workunit.client.0.smithi071.stderr: -274> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9406480) adding con mode: crc 2024-09-14T11:29:48.056 INFO:tasks.workunit.client.0.smithi071.stderr: -273> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9406480) adding con mode: secure 2024-09-14T11:29:48.056 INFO:tasks.workunit.client.0.smithi071.stderr: -272> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9406480) adding con mode: crc 2024-09-14T11:29:48.056 INFO:tasks.workunit.client.0.smithi071.stderr: -271> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9406480) adding con mode: secure 2024-09-14T11:29:48.056 INFO:tasks.workunit.client.0.smithi071.stderr: -270> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9406480) adding con mode: crc 2024-09-14T11:29:48.057 INFO:tasks.workunit.client.0.smithi071.stderr: -269> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9406480) adding con mode: crc 2024-09-14T11:29:48.057 INFO:tasks.workunit.client.0.smithi071.stderr: -268> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9406480) adding con mode: secure 2024-09-14T11:29:48.057 INFO:tasks.workunit.client.0.smithi071.stderr: -267> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9406480) adding con mode: crc 2024-09-14T11:29:48.057 INFO:tasks.workunit.client.0.smithi071.stderr: -266> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9406480) adding con mode: secure 2024-09-14T11:29:48.057 INFO:tasks.workunit.client.0.smithi071.stderr: -265> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9406480) adding con mode: crc 2024-09-14T11:29:48.057 INFO:tasks.workunit.client.0.smithi071.stderr: -264> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b9406480) adding con mode: secure 2024-09-14T11:29:48.057 INFO:tasks.workunit.client.0.smithi071.stderr: -263> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:48.057 INFO:tasks.workunit.client.0.smithi071.stderr: -262> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient: init 2024-09-14T11:29:48.057 INFO:tasks.workunit.client.0.smithi071.stderr: -261> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de3b0) adding auth protocol: cephx 2024-09-14T11:29:48.057 INFO:tasks.workunit.client.0.smithi071.stderr: -260> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de3b0) adding auth protocol: cephx 2024-09-14T11:29:48.057 INFO:tasks.workunit.client.0.smithi071.stderr: -259> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de3b0) adding auth protocol: cephx 2024-09-14T11:29:48.057 INFO:tasks.workunit.client.0.smithi071.stderr: -258> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de3b0) adding con mode: secure 2024-09-14T11:29:48.057 INFO:tasks.workunit.client.0.smithi071.stderr: -257> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de3b0) adding con mode: crc 2024-09-14T11:29:48.058 INFO:tasks.workunit.client.0.smithi071.stderr: -256> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de3b0) adding con mode: secure 2024-09-14T11:29:48.058 INFO:tasks.workunit.client.0.smithi071.stderr: -255> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de3b0) adding con mode: crc 2024-09-14T11:29:48.058 INFO:tasks.workunit.client.0.smithi071.stderr: -254> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de3b0) adding con mode: secure 2024-09-14T11:29:48.058 INFO:tasks.workunit.client.0.smithi071.stderr: -253> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de3b0) adding con mode: crc 2024-09-14T11:29:48.058 INFO:tasks.workunit.client.0.smithi071.stderr: -252> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de3b0) adding con mode: crc 2024-09-14T11:29:48.058 INFO:tasks.workunit.client.0.smithi071.stderr: -251> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de3b0) adding con mode: secure 2024-09-14T11:29:48.058 INFO:tasks.workunit.client.0.smithi071.stderr: -250> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de3b0) adding con mode: crc 2024-09-14T11:29:48.058 INFO:tasks.workunit.client.0.smithi071.stderr: -249> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de3b0) adding con mode: secure 2024-09-14T11:29:48.058 INFO:tasks.workunit.client.0.smithi071.stderr: -248> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de3b0) adding con mode: crc 2024-09-14T11:29:48.058 INFO:tasks.workunit.client.0.smithi071.stderr: -247> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de3b0) adding con mode: secure 2024-09-14T11:29:48.058 INFO:tasks.workunit.client.0.smithi071.stderr: -246> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:48.058 INFO:tasks.workunit.client.0.smithi071.stderr: -245> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:48.058 INFO:tasks.workunit.client.0.smithi071.stderr: -244> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 asok(0x55b5b915cd90) register_command rotate-key cmddesc rotate-key hook 0x7ffd0d9de4f8 EEXIST 2024-09-14T11:29:48.058 INFO:tasks.workunit.client.0.smithi071.stderr: -243> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient: _reopen_session rank -1 2024-09-14T11:29:48.058 INFO:tasks.workunit.client.0.smithi071.stderr: -242> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:29:48.059 INFO:tasks.workunit.client.0.smithi071.stderr: -241> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient(hunting): picked mon.noname-a con 0x55b5b943aaf0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:29:48.059 INFO:tasks.workunit.client.0.smithi071.stderr: -240> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient(hunting): picked mon.noname-b con 0x55b5b940a510 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:29:48.059 INFO:tasks.workunit.client.0.smithi071.stderr: -239> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient(hunting): picked mon.noname-c con 0x55b5b94362c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:29:48.059 INFO:tasks.workunit.client.0.smithi071.stderr: -238> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:48.059 INFO:tasks.workunit.client.0.smithi071.stderr: -237> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:48.059 INFO:tasks.workunit.client.0.smithi071.stderr: -236> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:48.059 INFO:tasks.workunit.client.0.smithi071.stderr: -235> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient(hunting): _renew_subs 2024-09-14T11:29:48.059 INFO:tasks.workunit.client.0.smithi071.stderr: -234> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient(hunting): authenticate will time out at 2200.013313s 2024-09-14T11:29:48.059 INFO:tasks.workunit.client.0.smithi071.stderr: -233> 2024-09-14T11:29:47.892+0000 7fb057355640 10 monclient(hunting): get_auth_request con 0x55b5b943aaf0 auth_method 0 2024-09-14T11:29:48.059 INFO:tasks.workunit.client.0.smithi071.stderr: -232> 2024-09-14T11:29:47.892+0000 7fb057355640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:48.059 INFO:tasks.workunit.client.0.smithi071.stderr: -231> 2024-09-14T11:29:47.892+0000 7fb057355640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:48.059 INFO:tasks.workunit.client.0.smithi071.stderr: -230> 2024-09-14T11:29:47.892+0000 7fb057355640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:48.059 INFO:tasks.workunit.client.0.smithi071.stderr: -229> 2024-09-14T11:29:47.892+0000 7fb057b56640 10 monclient(hunting): get_auth_request con 0x55b5b94362c0 auth_method 0 2024-09-14T11:29:48.059 INFO:tasks.workunit.client.0.smithi071.stderr: -228> 2024-09-14T11:29:47.892+0000 7fb057b56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:48.059 INFO:tasks.workunit.client.0.smithi071.stderr: -227> 2024-09-14T11:29:47.892+0000 7fb057b56640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:48.060 INFO:tasks.workunit.client.0.smithi071.stderr: -226> 2024-09-14T11:29:47.892+0000 7fb057b56640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:48.060 INFO:tasks.workunit.client.0.smithi071.stderr: -225> 2024-09-14T11:29:47.892+0000 7fb057355640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:48.060 INFO:tasks.workunit.client.0.smithi071.stderr: -224> 2024-09-14T11:29:47.892+0000 7fb057355640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:48.060 INFO:tasks.workunit.client.0.smithi071.stderr: -223> 2024-09-14T11:29:47.892+0000 7fb057355640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:48.060 INFO:tasks.workunit.client.0.smithi071.stderr: -222> 2024-09-14T11:29:47.892+0000 7fb057b56640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:48.060 INFO:tasks.workunit.client.0.smithi071.stderr: -221> 2024-09-14T11:29:47.892+0000 7fb057b56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:48.060 INFO:tasks.workunit.client.0.smithi071.stderr: -220> 2024-09-14T11:29:47.892+0000 7fb057b56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:48.060 INFO:tasks.workunit.client.0.smithi071.stderr: -219> 2024-09-14T11:29:47.892+0000 7fb057355640 10 monclient(hunting): handle_auth_done global_id 6570 payload 274 2024-09-14T11:29:48.060 INFO:tasks.workunit.client.0.smithi071.stderr: -218> 2024-09-14T11:29:47.892+0000 7fb057355640 10 monclient: _finish_hunting 0 2024-09-14T11:29:48.060 INFO:tasks.workunit.client.0.smithi071.stderr: -217> 2024-09-14T11:29:47.892+0000 7fb057355640 1 monclient: found mon.noname-a 2024-09-14T11:29:48.060 INFO:tasks.workunit.client.0.smithi071.stderr: -216> 2024-09-14T11:29:47.892+0000 7fb057355640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:29:48.060 INFO:tasks.workunit.client.0.smithi071.stderr: -215> 2024-09-14T11:29:47.892+0000 7faf36ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:48.060 INFO:tasks.workunit.client.0.smithi071.stderr: -214> 2024-09-14T11:29:47.892+0000 7faf36ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:29:48.060 INFO:tasks.workunit.client.0.smithi071.stderr: -213> 2024-09-14T11:29:47.892+0000 7faf36ffd640 10 monclient: dump: 2024-09-14T11:29:48.061 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:48.061 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:48.061 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:48.061 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:48.061 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:48.061 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:48.061 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:48.061 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:48.061 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:48.061 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:48.061 INFO:tasks.workunit.client.0.smithi071.stderr: -212> 2024-09-14T11:29:47.892+0000 7faf36ffd640 10 monclient: _finish_auth 0 2024-09-14T11:29:48.061 INFO:tasks.workunit.client.0.smithi071.stderr: -211> 2024-09-14T11:29:47.892+0000 7faf36ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:29:48.061 INFO:tasks.workunit.client.0.smithi071.stderr: -210> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 monclient: authenticate success, global_id 6570 2024-09-14T11:29:48.061 INFO:tasks.workunit.client.0.smithi071.stderr: -209> 2024-09-14T11:29:47.892+0000 7faf36ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:29:48.061 INFO:tasks.workunit.client.0.smithi071.stderr: -208> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient: get_monmap_and_config success 2024-09-14T11:29:48.062 INFO:tasks.workunit.client.0.smithi071.stderr: -207> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 4 set_mon_vals no callback set 2024-09-14T11:29:48.062 INFO:tasks.workunit.client.0.smithi071.stderr: -206> 2024-09-14T11:29:47.892+0000 7faf36ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:48.062 INFO:tasks.workunit.client.0.smithi071.stderr: -205> 2024-09-14T11:29:47.892+0000 7faf36ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:29:48.062 INFO:tasks.workunit.client.0.smithi071.stderr: -204> 2024-09-14T11:29:47.892+0000 7faf36ffd640 10 monclient: dump: 2024-09-14T11:29:48.062 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:48.062 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:48.062 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:48.062 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:48.062 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:48.062 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:48.062 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:48.062 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:48.062 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:48.062 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:48.063 INFO:tasks.workunit.client.0.smithi071.stderr: -203> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient: shutdown 2024-09-14T11:29:48.063 INFO:tasks.workunit.client.0.smithi071.stderr: -202> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient: build_initial_monmap 2024-09-14T11:29:48.063 INFO:tasks.workunit.client.0.smithi071.stderr: -201> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 1 build_initial for_mkfs: 0 2024-09-14T11:29:48.063 INFO:tasks.workunit.client.0.smithi071.stderr: -200> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient: monmap: 2024-09-14T11:29:48.063 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:29:48.063 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:29:48.063 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:29:48.063 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:29:48.063 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:29:48.063 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:48.063 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:29:48.063 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:29:48.063 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:29:48.063 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:48.064 INFO:tasks.workunit.client.0.smithi071.stderr: -199> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b942b510) adding auth protocol: cephx 2024-09-14T11:29:48.064 INFO:tasks.workunit.client.0.smithi071.stderr: -198> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b942b510) adding auth protocol: cephx 2024-09-14T11:29:48.064 INFO:tasks.workunit.client.0.smithi071.stderr: -197> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b942b510) adding auth protocol: cephx 2024-09-14T11:29:48.064 INFO:tasks.workunit.client.0.smithi071.stderr: -196> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b942b510) adding con mode: secure 2024-09-14T11:29:48.064 INFO:tasks.workunit.client.0.smithi071.stderr: -195> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b942b510) adding con mode: crc 2024-09-14T11:29:48.064 INFO:tasks.workunit.client.0.smithi071.stderr: -194> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b942b510) adding con mode: secure 2024-09-14T11:29:48.064 INFO:tasks.workunit.client.0.smithi071.stderr: -193> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b942b510) adding con mode: crc 2024-09-14T11:29:48.064 INFO:tasks.workunit.client.0.smithi071.stderr: -192> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b942b510) adding con mode: secure 2024-09-14T11:29:48.064 INFO:tasks.workunit.client.0.smithi071.stderr: -191> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b942b510) adding con mode: crc 2024-09-14T11:29:48.064 INFO:tasks.workunit.client.0.smithi071.stderr: -190> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b942b510) adding con mode: crc 2024-09-14T11:29:48.064 INFO:tasks.workunit.client.0.smithi071.stderr: -189> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b942b510) adding con mode: secure 2024-09-14T11:29:48.064 INFO:tasks.workunit.client.0.smithi071.stderr: -188> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b942b510) adding con mode: crc 2024-09-14T11:29:48.064 INFO:tasks.workunit.client.0.smithi071.stderr: -187> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b942b510) adding con mode: secure 2024-09-14T11:29:48.064 INFO:tasks.workunit.client.0.smithi071.stderr: -186> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b942b510) adding con mode: crc 2024-09-14T11:29:48.064 INFO:tasks.workunit.client.0.smithi071.stderr: -185> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b942b510) adding con mode: secure 2024-09-14T11:29:48.065 INFO:tasks.workunit.client.0.smithi071.stderr: -184> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:48.065 INFO:tasks.workunit.client.0.smithi071.stderr: -183> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 1 librados: starting msgr at 2024-09-14T11:29:48.065 INFO:tasks.workunit.client.0.smithi071.stderr: -182> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 1 librados: starting objecter 2024-09-14T11:29:48.065 INFO:tasks.workunit.client.0.smithi071.stderr: -181> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 asok(0x55b5b915cd90) register_command objecter_requests cmddesc objecter_requests hook 0x55b5b9434f10 EEXIST 2024-09-14T11:29:48.065 INFO:tasks.workunit.client.0.smithi071.stderr: -180> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 1 librados: setting wanted keys 2024-09-14T11:29:48.065 INFO:tasks.workunit.client.0.smithi071.stderr: -179> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 1 librados: calling monclient init 2024-09-14T11:29:48.065 INFO:tasks.workunit.client.0.smithi071.stderr: -178> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient: init 2024-09-14T11:29:48.065 INFO:tasks.workunit.client.0.smithi071.stderr: -177> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93e8af0) adding auth protocol: cephx 2024-09-14T11:29:48.065 INFO:tasks.workunit.client.0.smithi071.stderr: -176> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93e8af0) adding auth protocol: cephx 2024-09-14T11:29:48.065 INFO:tasks.workunit.client.0.smithi071.stderr: -175> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93e8af0) adding auth protocol: cephx 2024-09-14T11:29:48.065 INFO:tasks.workunit.client.0.smithi071.stderr: -174> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93e8af0) adding con mode: secure 2024-09-14T11:29:48.065 INFO:tasks.workunit.client.0.smithi071.stderr: -173> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93e8af0) adding con mode: crc 2024-09-14T11:29:48.065 INFO:tasks.workunit.client.0.smithi071.stderr: -172> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93e8af0) adding con mode: secure 2024-09-14T11:29:48.065 INFO:tasks.workunit.client.0.smithi071.stderr: -171> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93e8af0) adding con mode: crc 2024-09-14T11:29:48.065 INFO:tasks.workunit.client.0.smithi071.stderr: -170> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93e8af0) adding con mode: secure 2024-09-14T11:29:48.066 INFO:tasks.workunit.client.0.smithi071.stderr: -169> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93e8af0) adding con mode: crc 2024-09-14T11:29:48.066 INFO:tasks.workunit.client.0.smithi071.stderr: -168> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93e8af0) adding con mode: crc 2024-09-14T11:29:48.066 INFO:tasks.workunit.client.0.smithi071.stderr: -167> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93e8af0) adding con mode: secure 2024-09-14T11:29:48.066 INFO:tasks.workunit.client.0.smithi071.stderr: -166> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93e8af0) adding con mode: crc 2024-09-14T11:29:48.066 INFO:tasks.workunit.client.0.smithi071.stderr: -165> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93e8af0) adding con mode: secure 2024-09-14T11:29:48.066 INFO:tasks.workunit.client.0.smithi071.stderr: -164> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93e8af0) adding con mode: crc 2024-09-14T11:29:48.066 INFO:tasks.workunit.client.0.smithi071.stderr: -163> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 AuthRegistry(0x55b5b93e8af0) adding con mode: secure 2024-09-14T11:29:48.066 INFO:tasks.workunit.client.0.smithi071.stderr: -162> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:48.066 INFO:tasks.workunit.client.0.smithi071.stderr: -161> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:48.066 INFO:tasks.workunit.client.0.smithi071.stderr: -160> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 5 asok(0x55b5b915cd90) register_command rotate-key cmddesc rotate-key hook 0x55b5b93e8c38 EEXIST 2024-09-14T11:29:48.066 INFO:tasks.workunit.client.0.smithi071.stderr: -159> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient: _reopen_session rank -1 2024-09-14T11:29:48.066 INFO:tasks.workunit.client.0.smithi071.stderr: -158> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:29:48.066 INFO:tasks.workunit.client.0.smithi071.stderr: -157> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient(hunting): picked mon.noname-c con 0x55b5b940a510 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:29:48.066 INFO:tasks.workunit.client.0.smithi071.stderr: -156> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient(hunting): picked mon.noname-a con 0x55b5b94362c0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:29:48.066 INFO:tasks.workunit.client.0.smithi071.stderr: -155> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient(hunting): picked mon.noname-b con 0x55b5b943aaf0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:29:48.067 INFO:tasks.workunit.client.0.smithi071.stderr: -154> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:48.067 INFO:tasks.workunit.client.0.smithi071.stderr: -153> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:48.067 INFO:tasks.workunit.client.0.smithi071.stderr: -152> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:48.067 INFO:tasks.workunit.client.0.smithi071.stderr: -151> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient(hunting): _renew_subs 2024-09-14T11:29:48.067 INFO:tasks.workunit.client.0.smithi071.stderr: -150> 2024-09-14T11:29:47.892+0000 7fb05a0509c0 10 monclient(hunting): authenticate will time out at 2200.015931s 2024-09-14T11:29:48.067 INFO:tasks.workunit.client.0.smithi071.stderr: -149> 2024-09-14T11:29:47.896+0000 7fb058357640 10 monclient(hunting): get_auth_request con 0x55b5b94362c0 auth_method 0 2024-09-14T11:29:48.067 INFO:tasks.workunit.client.0.smithi071.stderr: -148> 2024-09-14T11:29:47.896+0000 7fb058357640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:48.067 INFO:tasks.workunit.client.0.smithi071.stderr: -147> 2024-09-14T11:29:47.896+0000 7fb058357640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:48.067 INFO:tasks.workunit.client.0.smithi071.stderr: -146> 2024-09-14T11:29:47.896+0000 7fb058357640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:48.067 INFO:tasks.workunit.client.0.smithi071.stderr: -145> 2024-09-14T11:29:47.896+0000 7fb057355640 10 monclient(hunting): get_auth_request con 0x55b5b940a510 auth_method 0 2024-09-14T11:29:48.067 INFO:tasks.workunit.client.0.smithi071.stderr: -144> 2024-09-14T11:29:47.896+0000 7fb057355640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:48.067 INFO:tasks.workunit.client.0.smithi071.stderr: -143> 2024-09-14T11:29:47.896+0000 7fb057355640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:48.067 INFO:tasks.workunit.client.0.smithi071.stderr: -142> 2024-09-14T11:29:47.896+0000 7fb057355640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:48.067 INFO:tasks.workunit.client.0.smithi071.stderr: -141> 2024-09-14T11:29:47.896+0000 7fb057355640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:48.067 INFO:tasks.workunit.client.0.smithi071.stderr: -140> 2024-09-14T11:29:47.896+0000 7fb057355640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:48.068 INFO:tasks.workunit.client.0.smithi071.stderr: -139> 2024-09-14T11:29:47.896+0000 7fb057355640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:48.068 INFO:tasks.workunit.client.0.smithi071.stderr: -138> 2024-09-14T11:29:47.896+0000 7fb058357640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:48.068 INFO:tasks.workunit.client.0.smithi071.stderr: -137> 2024-09-14T11:29:47.896+0000 7fb058357640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:48.068 INFO:tasks.workunit.client.0.smithi071.stderr: -136> 2024-09-14T11:29:47.896+0000 7fb058357640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:48.068 INFO:tasks.workunit.client.0.smithi071.stderr: -135> 2024-09-14T11:29:47.896+0000 7fb057355640 10 monclient(hunting): handle_auth_done global_id 6281 payload 824 2024-09-14T11:29:48.068 INFO:tasks.workunit.client.0.smithi071.stderr: -134> 2024-09-14T11:29:47.896+0000 7fb057355640 10 monclient: _finish_hunting 0 2024-09-14T11:29:48.068 INFO:tasks.workunit.client.0.smithi071.stderr: -133> 2024-09-14T11:29:47.896+0000 7fb057355640 1 monclient: found mon.noname-c 2024-09-14T11:29:48.068 INFO:tasks.workunit.client.0.smithi071.stderr: -132> 2024-09-14T11:29:47.896+0000 7fb057355640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:29:48.068 INFO:tasks.workunit.client.0.smithi071.stderr: -131> 2024-09-14T11:29:47.896+0000 7faf357fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:48.068 INFO:tasks.workunit.client.0.smithi071.stderr: -130> 2024-09-14T11:29:47.896+0000 7faf357fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:29:48.068 INFO:tasks.workunit.client.0.smithi071.stderr: -129> 2024-09-14T11:29:47.896+0000 7faf357fa640 10 monclient: dump: 2024-09-14T11:29:48.068 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:48.068 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:48.068 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:48.069 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:48.069 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:48.069 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:48.069 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:48.069 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:48.069 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:48.069 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:48.069 INFO:tasks.workunit.client.0.smithi071.stderr: -128> 2024-09-14T11:29:47.896+0000 7faf357fa640 10 monclient: _finish_auth 0 2024-09-14T11:29:48.069 INFO:tasks.workunit.client.0.smithi071.stderr: -127> 2024-09-14T11:29:47.896+0000 7faf357fa640 10 monclient: _check_auth_tickets 2024-09-14T11:29:48.069 INFO:tasks.workunit.client.0.smithi071.stderr: -126> 2024-09-14T11:29:47.896+0000 7faf357fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:29:48.069 INFO:tasks.workunit.client.0.smithi071.stderr: -125> 2024-09-14T11:29:47.896+0000 7faf357fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:48.069 INFO:tasks.workunit.client.0.smithi071.stderr: -124> 2024-09-14T11:29:47.896+0000 7faf357fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:29:48.069 INFO:tasks.workunit.client.0.smithi071.stderr: -123> 2024-09-14T11:29:47.896+0000 7faf357fa640 10 monclient: dump: 2024-09-14T11:29:48.069 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:29:48.069 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:29:48.070 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:48.070 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:29:48.070 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:48.070 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:29:48.070 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:29:48.070 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:29:48.070 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:29:48.070 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:48.070 INFO:tasks.workunit.client.0.smithi071.stderr: -122> 2024-09-14T11:29:47.896+0000 7faf36ffd640 4 set_mon_vals no callback set 2024-09-14T11:29:48.070 INFO:tasks.workunit.client.0.smithi071.stderr: -121> 2024-09-14T11:29:47.896+0000 7fb05a0509c0 5 monclient: authenticate success, global_id 6281 2024-09-14T11:29:48.070 INFO:tasks.workunit.client.0.smithi071.stderr: -120> 2024-09-14T11:29:47.896+0000 7fb05a0509c0 10 monclient: _renew_subs 2024-09-14T11:29:48.070 INFO:tasks.workunit.client.0.smithi071.stderr: -119> 2024-09-14T11:29:47.896+0000 7fb05a0509c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:29:48.070 INFO:tasks.workunit.client.0.smithi071.stderr: -118> 2024-09-14T11:29:47.896+0000 7fb05a0509c0 10 monclient: _renew_subs 2024-09-14T11:29:48.070 INFO:tasks.workunit.client.0.smithi071.stderr: -117> 2024-09-14T11:29:47.896+0000 7fb05a0509c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:29:48.070 INFO:tasks.workunit.client.0.smithi071.stderr: -116> 2024-09-14T11:29:47.896+0000 7fb05a0509c0 1 librados: init done 2024-09-14T11:29:48.071 INFO:tasks.workunit.client.0.smithi071.stderr: -115> 2024-09-14T11:29:47.896+0000 7fb05a0509c0 5 asok(0x55b5b915cd90) register_command cr dump hook 0x7fb040008a08 2024-09-14T11:29:48.071 INFO:tasks.workunit.client.0.smithi071.stderr: -114> 2024-09-14T11:29:47.896+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.071 INFO:tasks.workunit.client.0.smithi071.stderr: -113> 2024-09-14T11:29:47.896+0000 7faf357fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:29:48.071 INFO:tasks.workunit.client.0.smithi071.stderr: -112> 2024-09-14T11:29:47.896+0000 7faf357fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:29:48.071 INFO:tasks.workunit.client.0.smithi071.stderr: -111> 2024-09-14T11:29:47.896+0000 7faf357fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:29:48.071 INFO:tasks.workunit.client.0.smithi071.stderr: -110> 2024-09-14T11:29:47.896+0000 7fb058357640 10 monclient: get_auth_request con 0x7faf200718a0 auth_method 0 2024-09-14T11:29:48.071 INFO:tasks.workunit.client.0.smithi071.stderr: -109> 2024-09-14T11:29:47.896+0000 7fb057b56640 10 monclient: get_auth_request con 0x55b5b9454750 auth_method 0 2024-09-14T11:29:48.071 INFO:tasks.workunit.client.0.smithi071.stderr: -108> 2024-09-14T11:29:47.900+0000 7fb05a0509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:48.071 INFO:tasks.workunit.client.0.smithi071.stderr: -107> 2024-09-14T11:29:47.900+0000 7fb05a0509c0 20 realm 2024-09-14T11:29:48.071 INFO:tasks.workunit.client.0.smithi071.stderr: -106> 2024-09-14T11:29:47.900+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.071 INFO:tasks.workunit.client.0.smithi071.stderr: -105> 2024-09-14T11:29:47.900+0000 7fb05a0509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:48.071 INFO:tasks.workunit.client.0.smithi071.stderr: -104> 2024-09-14T11:29:47.900+0000 7fb05a0509c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:48.071 INFO:tasks.workunit.client.0.smithi071.stderr: -103> 2024-09-14T11:29:47.900+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.071 INFO:tasks.workunit.client.0.smithi071.stderr: -102> 2024-09-14T11:29:47.900+0000 7fb05a0509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:48.072 INFO:tasks.workunit.client.0.smithi071.stderr: -101> 2024-09-14T11:29:47.900+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.072 INFO:tasks.workunit.client.0.smithi071.stderr: -100> 2024-09-14T11:29:47.900+0000 7fb057355640 10 monclient: get_auth_request con 0x55b5b9458a20 auth_method 0 2024-09-14T11:29:48.072 INFO:tasks.workunit.client.0.smithi071.stderr: -99> 2024-09-14T11:29:47.900+0000 7fb05a0509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:48.072 INFO:tasks.workunit.client.0.smithi071.stderr: -98> 2024-09-14T11:29:47.900+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.072 INFO:tasks.workunit.client.0.smithi071.stderr: -97> 2024-09-14T11:29:47.900+0000 7fb058357640 10 monclient: get_auth_request con 0x55b5b945c140 auth_method 0 2024-09-14T11:29:48.072 INFO:tasks.workunit.client.0.smithi071.stderr: -96> 2024-09-14T11:29:47.900+0000 7fb05a0509c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:48.072 INFO:tasks.workunit.client.0.smithi071.stderr: -95> 2024-09-14T11:29:47.900+0000 7fb05a0509c0 20 searching for the correct realm 2024-09-14T11:29:48.072 INFO:tasks.workunit.client.0.smithi071.stderr: -94> 2024-09-14T11:29:47.900+0000 7fb057b56640 10 monclient: get_auth_request con 0x55b5b9460ee0 auth_method 0 2024-09-14T11:29:48.072 INFO:tasks.workunit.client.0.smithi071.stderr: -93> 2024-09-14T11:29:47.904+0000 7fb057355640 10 monclient: get_auth_request con 0x7fb04802d060 auth_method 0 2024-09-14T11:29:48.072 INFO:tasks.workunit.client.0.smithi071.stderr: -92> 2024-09-14T11:29:47.904+0000 7fb058357640 10 monclient: get_auth_request con 0x7fb04004d020 auth_method 0 2024-09-14T11:29:48.072 INFO:tasks.workunit.client.0.smithi071.stderr: -91> 2024-09-14T11:29:47.904+0000 7fb058357640 0 -- 172.21.15.71:0/1336183276 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fb04004d020 msgr2=0x7fb040075150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:48.072 INFO:tasks.workunit.client.0.smithi071.stderr: -90> 2024-09-14T11:29:47.904+0000 7faf357fa640 1 client.6281.objecter ms_handle_reset 0x7fb04004d020 session 0x7fb040030ee0 osd.0 2024-09-14T11:29:48.072 INFO:tasks.workunit.client.0.smithi071.stderr: -89> 2024-09-14T11:29:47.904+0000 7faf357fa640 10 monclient: _renew_subs 2024-09-14T11:29:48.072 INFO:tasks.workunit.client.0.smithi071.stderr: -88> 2024-09-14T11:29:47.904+0000 7faf357fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:29:48.072 INFO:tasks.workunit.client.0.smithi071.stderr: -87> 2024-09-14T11:29:47.904+0000 7fb058357640 10 monclient: get_auth_request con 0x7faf200813c0 auth_method 0 2024-09-14T11:29:48.073 INFO:tasks.workunit.client.0.smithi071.stderr: -86> 2024-09-14T11:29:47.908+0000 7fb057b56640 10 monclient: get_auth_request con 0x7fb048017020 auth_method 0 2024-09-14T11:29:48.073 INFO:tasks.workunit.client.0.smithi071.stderr: -85> 2024-09-14T11:29:47.912+0000 7fb057355640 10 monclient: get_auth_request con 0x7fb040008040 auth_method 0 2024-09-14T11:29:48.073 INFO:tasks.workunit.client.0.smithi071.stderr: -84> 2024-09-14T11:29:47.912+0000 7fb057355640 0 -- 172.21.15.71:0/1336183276 >> [v2:172.21.15.157:6800/3420822707,v1:172.21.15.157:6801/3420822707] conn(0x7fb040008040 msgr2=0x7fb040035a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:48.073 INFO:tasks.workunit.client.0.smithi071.stderr: -83> 2024-09-14T11:29:47.912+0000 7faf357fa640 1 client.6281.objecter ms_handle_reset 0x7fb040008040 session 0x7fb040020680 osd.7 2024-09-14T11:29:48.073 INFO:tasks.workunit.client.0.smithi071.stderr: -82> 2024-09-14T11:29:47.912+0000 7fb057355640 10 monclient: get_auth_request con 0x7fb04004d020 auth_method 0 2024-09-14T11:29:48.073 INFO:tasks.workunit.client.0.smithi071.stderr: -81> 2024-09-14T11:29:47.920+0000 7fb05a0509c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:48.073 INFO:tasks.workunit.client.0.smithi071.stderr: -80> 2024-09-14T11:29:47.920+0000 7fb05a0509c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:29:48.073 INFO:tasks.workunit.client.0.smithi071.stderr: -79> 2024-09-14T11:29:47.920+0000 7fb05a0509c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:48.073 INFO:tasks.workunit.client.0.smithi071.stderr: -78> 2024-09-14T11:29:47.920+0000 7fb05a0509c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:29:48.073 INFO:tasks.workunit.client.0.smithi071.stderr: -77> 2024-09-14T11:29:47.920+0000 7fb05a0509c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:48.073 INFO:tasks.workunit.client.0.smithi071.stderr: -76> 2024-09-14T11:29:47.920+0000 7fb05a0509c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:48.073 INFO:tasks.workunit.client.0.smithi071.stderr: -75> 2024-09-14T11:29:47.920+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.073 INFO:tasks.workunit.client.0.smithi071.stderr: -74> 2024-09-14T11:29:47.920+0000 7fb05a0509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:48.073 INFO:tasks.workunit.client.0.smithi071.stderr: -73> 2024-09-14T11:29:47.920+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.074 INFO:tasks.workunit.client.0.smithi071.stderr: -72> 2024-09-14T11:29:47.920+0000 7fb05a0509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:48.074 INFO:tasks.workunit.client.0.smithi071.stderr: -71> 2024-09-14T11:29:47.920+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.074 INFO:tasks.workunit.client.0.smithi071.stderr: -70> 2024-09-14T11:29:47.924+0000 7fb05a0509c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:48.074 INFO:tasks.workunit.client.0.smithi071.stderr: -69> 2024-09-14T11:29:47.924+0000 7fb05a0509c0 20 zone default found 2024-09-14T11:29:48.074 INFO:tasks.workunit.client.0.smithi071.stderr: -68> 2024-09-14T11:29:47.924+0000 7fb05a0509c0 4 Realm: () 2024-09-14T11:29:48.074 INFO:tasks.workunit.client.0.smithi071.stderr: -67> 2024-09-14T11:29:47.924+0000 7fb05a0509c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:29:48.074 INFO:tasks.workunit.client.0.smithi071.stderr: -66> 2024-09-14T11:29:47.924+0000 7fb05a0509c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:29:48.074 INFO:tasks.workunit.client.0.smithi071.stderr: -65> 2024-09-14T11:29:47.924+0000 7fb05a0509c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:48.074 INFO:tasks.workunit.client.0.smithi071.stderr: -64> 2024-09-14T11:29:47.924+0000 7fb05a0509c0 20 zonegroup default 2024-09-14T11:29:48.074 INFO:tasks.workunit.client.0.smithi071.stderr: -63> 2024-09-14T11:29:47.924+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.074 INFO:tasks.workunit.client.0.smithi071.stderr: -62> 2024-09-14T11:29:47.924+0000 7fb05a0509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:48.074 INFO:tasks.workunit.client.0.smithi071.stderr: -61> 2024-09-14T11:29:47.924+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.074 INFO:tasks.workunit.client.0.smithi071.stderr: -60> 2024-09-14T11:29:47.924+0000 7fb05a0509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:48.074 INFO:tasks.workunit.client.0.smithi071.stderr: -59> 2024-09-14T11:29:47.924+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.075 INFO:tasks.workunit.client.0.smithi071.stderr: -58> 2024-09-14T11:29:47.924+0000 7fb05a0509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:48.075 INFO:tasks.workunit.client.0.smithi071.stderr: -57> 2024-09-14T11:29:47.924+0000 7fb05a0509c0 20 started sync module instance, tier type = 2024-09-14T11:29:48.075 INFO:tasks.workunit.client.0.smithi071.stderr: -56> 2024-09-14T11:29:47.924+0000 7fb05a0509c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:29:48.075 INFO:tasks.workunit.client.0.smithi071.stderr: -55> 2024-09-14T11:29:47.940+0000 7fb05a0509c0 20 add_watcher() i=0 2024-09-14T11:29:48.075 INFO:tasks.workunit.client.0.smithi071.stderr: -54> 2024-09-14T11:29:47.940+0000 7fb05a0509c0 20 add_watcher() i=1 2024-09-14T11:29:48.075 INFO:tasks.workunit.client.0.smithi071.stderr: -53> 2024-09-14T11:29:47.940+0000 7fb05a0509c0 20 add_watcher() i=2 2024-09-14T11:29:48.075 INFO:tasks.workunit.client.0.smithi071.stderr: -52> 2024-09-14T11:29:47.940+0000 7fb05a0509c0 20 add_watcher() i=3 2024-09-14T11:29:48.075 INFO:tasks.workunit.client.0.smithi071.stderr: -51> 2024-09-14T11:29:47.940+0000 7fb05a0509c0 20 add_watcher() i=4 2024-09-14T11:29:48.075 INFO:tasks.workunit.client.0.smithi071.stderr: -50> 2024-09-14T11:29:47.940+0000 7fb05a0509c0 20 add_watcher() i=5 2024-09-14T11:29:48.075 INFO:tasks.workunit.client.0.smithi071.stderr: -49> 2024-09-14T11:29:47.940+0000 7fb05a0509c0 20 add_watcher() i=6 2024-09-14T11:29:48.075 INFO:tasks.workunit.client.0.smithi071.stderr: -48> 2024-09-14T11:29:47.944+0000 7fb05a0509c0 20 add_watcher() i=7 2024-09-14T11:29:48.075 INFO:tasks.workunit.client.0.smithi071.stderr: -47> 2024-09-14T11:29:47.944+0000 7fb05a0509c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:48.075 INFO:tasks.workunit.client.0.smithi071.stderr: -46> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de890) adding auth protocol: cephx 2024-09-14T11:29:48.075 INFO:tasks.workunit.client.0.smithi071.stderr: -45> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de890) adding auth protocol: cephx 2024-09-14T11:29:48.075 INFO:tasks.workunit.client.0.smithi071.stderr: -44> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de890) adding auth protocol: cephx 2024-09-14T11:29:48.076 INFO:tasks.workunit.client.0.smithi071.stderr: -43> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de890) adding con mode: secure 2024-09-14T11:29:48.076 INFO:tasks.workunit.client.0.smithi071.stderr: -42> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de890) adding con mode: crc 2024-09-14T11:29:48.076 INFO:tasks.workunit.client.0.smithi071.stderr: -41> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de890) adding con mode: secure 2024-09-14T11:29:48.076 INFO:tasks.workunit.client.0.smithi071.stderr: -40> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de890) adding con mode: crc 2024-09-14T11:29:48.076 INFO:tasks.workunit.client.0.smithi071.stderr: -39> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de890) adding con mode: secure 2024-09-14T11:29:48.076 INFO:tasks.workunit.client.0.smithi071.stderr: -38> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de890) adding con mode: crc 2024-09-14T11:29:48.076 INFO:tasks.workunit.client.0.smithi071.stderr: -37> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de890) adding con mode: crc 2024-09-14T11:29:48.076 INFO:tasks.workunit.client.0.smithi071.stderr: -36> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de890) adding con mode: secure 2024-09-14T11:29:48.076 INFO:tasks.workunit.client.0.smithi071.stderr: -35> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de890) adding con mode: crc 2024-09-14T11:29:48.076 INFO:tasks.workunit.client.0.smithi071.stderr: -34> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de890) adding con mode: secure 2024-09-14T11:29:48.076 INFO:tasks.workunit.client.0.smithi071.stderr: -33> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de890) adding con mode: crc 2024-09-14T11:29:48.076 INFO:tasks.workunit.client.0.smithi071.stderr: -32> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 AuthRegistry(0x7ffd0d9de890) adding con mode: secure 2024-09-14T11:29:48.076 INFO:tasks.workunit.client.0.smithi071.stderr: -31> 2024-09-14T11:29:47.948+0000 7faf0dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:48.076 INFO:tasks.workunit.client.0.smithi071.stderr: -30> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:48.077 INFO:tasks.workunit.client.0.smithi071.stderr: -29> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:48.077 INFO:tasks.workunit.client.0.smithi071.stderr: -28> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:48.077 INFO:tasks.workunit.client.0.smithi071.stderr: -27> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 asok(0x55b5b915cd90) register_command cache list hook 0x55b5b9428ed0 2024-09-14T11:29:48.077 INFO:tasks.workunit.client.0.smithi071.stderr: -26> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 asok(0x55b5b915cd90) register_command cache inspect hook 0x55b5b9428ed0 2024-09-14T11:29:48.077 INFO:tasks.workunit.client.0.smithi071.stderr: -25> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 asok(0x55b5b915cd90) register_command cache erase hook 0x55b5b9428ed0 2024-09-14T11:29:48.077 INFO:tasks.workunit.client.0.smithi071.stderr: -24> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 asok(0x55b5b915cd90) register_command cache zap hook 0x55b5b9428ed0 2024-09-14T11:29:48.077 INFO:tasks.workunit.client.0.smithi071.stderr: -23> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 note: GC not initialized 2024-09-14T11:29:48.077 INFO:tasks.workunit.client.0.smithi071.stderr: -22> 2024-09-14T11:29:47.948+0000 7faf0cfe1640 20 reqs_thread_entry: start 2024-09-14T11:29:48.077 INFO:tasks.workunit.client.0.smithi071.stderr: -21> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 asok(0x55b5b915cd90) register_command sync trace show hook 0x7fb0400203b0 2024-09-14T11:29:48.077 INFO:tasks.workunit.client.0.smithi071.stderr: -20> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 asok(0x55b5b915cd90) register_command sync trace history hook 0x7fb0400203b0 2024-09-14T11:29:48.077 INFO:tasks.workunit.client.0.smithi071.stderr: -19> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 asok(0x55b5b915cd90) register_command sync trace active hook 0x7fb0400203b0 2024-09-14T11:29:48.077 INFO:tasks.workunit.client.0.smithi071.stderr: -18> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 5 asok(0x55b5b915cd90) register_command sync trace active_short hook 0x7fb0400203b0 2024-09-14T11:29:48.077 INFO:tasks.workunit.client.0.smithi071.stderr: -17> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:48.077 INFO:tasks.workunit.client.0.smithi071.stderr: -16> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 20 Filter name: none 2024-09-14T11:29:48.077 INFO:tasks.workunit.client.0.smithi071.stderr: -15> 2024-09-14T11:29:47.948+0000 7fae867fc640 20 reqs_thread_entry: start 2024-09-14T11:29:48.078 INFO:tasks.workunit.client.0.smithi071.stderr: -14> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:29:48.078 INFO:tasks.workunit.client.0.smithi071.stderr: -13> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.078 INFO:tasks.workunit.client.0.smithi071.stderr: -12> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:29:48.078 INFO:tasks.workunit.client.0.smithi071.stderr: -11> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:29:48.078 INFO:tasks.workunit.client.0.smithi071.stderr: -10> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:29:48.078 INFO:tasks.workunit.client.0.smithi071.stderr: -9> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 : miss 2024-09-14T11:29:48.078 INFO:tasks.workunit.client.0.smithi071.stderr: -8> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.078 INFO:tasks.workunit.client.0.smithi071.stderr: -7> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:29:48.078 INFO:tasks.workunit.client.0.smithi071.stderr: -6> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 info.flags=0x17 2024-09-14T11:29:48.078 INFO:tasks.workunit.client.0.smithi071.stderr: -5> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 to cache LRU end 2024-09-14T11:29:48.078 INFO:tasks.workunit.client.0.smithi071.stderr: -4> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:29:48.078 INFO:tasks.workunit.client.0.smithi071.stderr: -3> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:48.078 INFO:tasks.workunit.client.0.smithi071.stderr: -2> 2024-09-14T11:29:47.948+0000 7fb05a0509c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 2024-09-14T11:29:48.078 INFO:tasks.workunit.client.0.smithi071.stderr: -1> 2024-09-14T11:29:47.960+0000 7fb05a0509c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb05a0509c0 time 2024-09-14T11:29:47.961699+0000 2024-09-14T11:29:48.078 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:29:48.079 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:48.079 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:29:48.079 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fb05d92a2eb] 2024-09-14T11:29:48.079 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb05d92a49f] 2024-09-14T11:29:48.079 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b5b71f7c01] 2024-09-14T11:29:48.079 INFO:tasks.workunit.client.0.smithi071.stderr: 4: radosgw-admin(+0x1422828) [0x55b5b7c55828] 2024-09-14T11:29:48.079 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b5b720cecd] 2024-09-14T11:29:48.079 INFO:tasks.workunit.client.0.smithi071.stderr: 6: main() 2024-09-14T11:29:48.079 INFO:tasks.workunit.client.0.smithi071.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb05c790d90] 2024-09-14T11:29:48.079 INFO:tasks.workunit.client.0.smithi071.stderr: 8: __libc_start_main() 2024-09-14T11:29:48.079 INFO:tasks.workunit.client.0.smithi071.stderr: 9: _start() 2024-09-14T11:29:48.079 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:48.079 INFO:tasks.workunit.client.0.smithi071.stderr: 0> 2024-09-14T11:29:47.960+0000 7fb05a0509c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:29:48.079 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7fb05a0509c0 thread_name:radosgw-admin 2024-09-14T11:29:48.080 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:48.080 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:29:48.080 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fb05c7a9520] 2024-09-14T11:29:48.080 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:29:48.080 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:29:48.080 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:29:48.080 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fb05d92a345] 2024-09-14T11:29:48.080 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb05d92a49f] 2024-09-14T11:29:48.080 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b5b71f7c01] 2024-09-14T11:29:48.080 INFO:tasks.workunit.client.0.smithi071.stderr: 8: radosgw-admin(+0x1422828) [0x55b5b7c55828] 2024-09-14T11:29:48.080 INFO:tasks.workunit.client.0.smithi071.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b5b720cecd] 2024-09-14T11:29:48.080 INFO:tasks.workunit.client.0.smithi071.stderr: 10: main() 2024-09-14T11:29:48.080 INFO:tasks.workunit.client.0.smithi071.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb05c790d90] 2024-09-14T11:29:48.080 INFO:tasks.workunit.client.0.smithi071.stderr: 12: __libc_start_main() 2024-09-14T11:29:48.081 INFO:tasks.workunit.client.0.smithi071.stderr: 13: _start() 2024-09-14T11:29:48.081 INFO:tasks.workunit.client.0.smithi071.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:29:48.081 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:48.081 INFO:tasks.workunit.client.0.smithi071.stderr:--- logging levels --- 2024-09-14T11:29:48.081 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 none 2024-09-14T11:29:48.081 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 lockdep 2024-09-14T11:29:48.081 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 context 2024-09-14T11:29:48.081 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 crush 2024-09-14T11:29:48.081 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds 2024-09-14T11:29:48.081 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_balancer 2024-09-14T11:29:48.081 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_locker 2024-09-14T11:29:48.081 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log 2024-09-14T11:29:48.081 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log_expire 2024-09-14T11:29:48.081 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_migrator 2024-09-14T11:29:48.081 INFO:tasks.workunit.client.0.smithi071.stderr: 3/ 5 mds_quiesce 2024-09-14T11:29:48.082 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 buffer 2024-09-14T11:29:48.082 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 timer 2024-09-14T11:29:48.082 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 filer 2024-09-14T11:29:48.082 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 striper 2024-09-14T11:29:48.082 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 objecter 2024-09-14T11:29:48.082 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rados 2024-09-14T11:29:48.082 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd 2024-09-14T11:29:48.082 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_mirror 2024-09-14T11:29:48.082 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_replay 2024-09-14T11:29:48.082 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_pwl 2024-09-14T11:29:48.082 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 journaler 2024-09-14T11:29:48.082 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objectcacher 2024-09-14T11:29:48.082 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:29:48.082 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 client 2024-09-14T11:29:48.082 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 osd 2024-09-14T11:29:48.083 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 optracker 2024-09-14T11:29:48.083 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objclass 2024-09-14T11:29:48.083 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 filestore 2024-09-14T11:29:48.083 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 journal 2024-09-14T11:29:48.083 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 ms 2024-09-14T11:29:48.083 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mon 2024-09-14T11:29:48.083 INFO:tasks.workunit.client.0.smithi071.stderr: 0/10 monc 2024-09-14T11:29:48.083 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 paxos 2024-09-14T11:29:48.083 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 tp 2024-09-14T11:29:48.083 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 auth 2024-09-14T11:29:48.083 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 crypto 2024-09-14T11:29:48.083 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 finisher 2024-09-14T11:29:48.083 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 reserver 2024-09-14T11:29:48.083 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 heartbeatmap 2024-09-14T11:29:48.083 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 perfcounter 2024-09-14T11:29:48.084 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw 2024-09-14T11:29:48.084 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_sync 2024-09-14T11:29:48.084 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_datacache 2024-09-14T11:29:48.084 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_access 2024-09-14T11:29:48.084 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:29:48.084 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_flight 2024-09-14T11:29:48.084 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:29:48.084 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw_notification 2024-09-14T11:29:48.084 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 javaclient 2024-09-14T11:29:48.084 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 asok 2024-09-14T11:29:48.084 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 throttle 2024-09-14T11:29:48.084 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 refs 2024-09-14T11:29:48.084 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 compressor 2024-09-14T11:29:48.084 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluestore 2024-09-14T11:29:48.085 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluefs 2024-09-14T11:29:48.085 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 bdev 2024-09-14T11:29:48.085 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 kstore 2024-09-14T11:29:48.085 INFO:tasks.workunit.client.0.smithi071.stderr: 4/ 5 rocksdb 2024-09-14T11:29:48.085 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 fuse 2024-09-14T11:29:48.085 INFO:tasks.workunit.client.0.smithi071.stderr: 2/ 5 mgr 2024-09-14T11:29:48.085 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mgrc 2024-09-14T11:29:48.085 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 dpdk 2024-09-14T11:29:48.085 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 eventtrace 2024-09-14T11:29:48.085 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 prioritycache 2024-09-14T11:29:48.085 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 test 2024-09-14T11:29:48.085 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:29:48.085 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephsqlite 2024-09-14T11:29:48.085 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:29:48.085 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore 2024-09-14T11:29:48.086 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_onode 2024-09-14T11:29:48.086 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_odata 2024-09-14T11:29:48.086 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_omap 2024-09-14T11:29:48.086 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_tm 2024-09-14T11:29:48.086 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_t 2024-09-14T11:29:48.086 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:29:48.086 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_epm 2024-09-14T11:29:48.086 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_lba 2024-09-14T11:29:48.086 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:29:48.086 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cache 2024-09-14T11:29:48.086 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_journal 2024-09-14T11:29:48.086 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_device 2024-09-14T11:29:48.086 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_backref 2024-09-14T11:29:48.086 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 alienstore 2024-09-14T11:29:48.086 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mclock 2024-09-14T11:29:48.087 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cyanstore 2024-09-14T11:29:48.087 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 ceph_exporter 2024-09-14T11:29:48.087 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 memstore 2024-09-14T11:29:48.087 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 trace 2024-09-14T11:29:48.087 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 ceph_dedup 2024-09-14T11:29:48.087 INFO:tasks.workunit.client.0.smithi071.stderr: -2/-2 (syslog threshold) 2024-09-14T11:29:48.087 INFO:tasks.workunit.client.0.smithi071.stderr: 99/99 (stderr threshold) 2024-09-14T11:29:48.087 INFO:tasks.workunit.client.0.smithi071.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:29:48.087 INFO:tasks.workunit.client.0.smithi071.stderr: 7fae867fc640 / http_manager 2024-09-14T11:29:48.087 INFO:tasks.workunit.client.0.smithi071.stderr: 7faf0cfe1640 / http_manager 2024-09-14T11:29:48.087 INFO:tasks.workunit.client.0.smithi071.stderr: 7faf0dfe3640 / rgw_dt_lg_renew 2024-09-14T11:29:48.087 INFO:tasks.workunit.client.0.smithi071.stderr: 7faf357fa640 / ms_dispatch 2024-09-14T11:29:48.087 INFO:tasks.workunit.client.0.smithi071.stderr: 7faf36ffd640 / io_context_pool 2024-09-14T11:29:48.087 INFO:tasks.workunit.client.0.smithi071.stderr: 7faf3d7fa640 / ms_dispatch 2024-09-14T11:29:48.088 INFO:tasks.workunit.client.0.smithi071.stderr: 7faf3ffff640 / ms_dispatch 2024-09-14T11:29:48.088 INFO:tasks.workunit.client.0.smithi071.stderr: 7faf45e0b640 / io_context_pool 2024-09-14T11:29:48.088 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb057355640 / msgr-worker-2 2024-09-14T11:29:48.088 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb057b56640 / msgr-worker-1 2024-09-14T11:29:48.088 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb058357640 / msgr-worker-0 2024-09-14T11:29:48.088 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb058b58640 / io_context_pool 2024-09-14T11:29:48.088 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb05a0509c0 / radosgw-admin 2024-09-14T11:29:48.088 INFO:tasks.workunit.client.0.smithi071.stderr: max_recent 500 2024-09-14T11:29:48.088 INFO:tasks.workunit.client.0.smithi071.stderr: max_new 1000 2024-09-14T11:29:48.088 INFO:tasks.workunit.client.0.smithi071.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:29:47.964876Z_c351c3b8-db01-4304-92ff-89a6a0fe46d1/log 2024-09-14T11:29:48.088 INFO:tasks.workunit.client.0.smithi071.stderr:--- end dump of recent events --- 2024-09-14T11:29:48.088 INFO:tasks.workunit.client.0.smithi071.stderr:Aborted 2024-09-14T11:29:48.088 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:29:48.089 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:48.089 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:48.090 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.044+0000 7f1ded96a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.090 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.048+0000 7f1ded96a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:48.090 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.048+0000 7f1ded96a9c0 20 realm 2024-09-14T11:29:48.090 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.048+0000 7f1ded96a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.090 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.048+0000 7f1ded96a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:48.090 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.048+0000 7f1ded96a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:48.090 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.048+0000 7f1ded96a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.090 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.048+0000 7f1ded96a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:48.090 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.048+0000 7f1ded96a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.090 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.048+0000 7f1ded96a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:48.090 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.048+0000 7f1ded96a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.090 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.052+0000 7f1ded96a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:48.090 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.052+0000 7f1ded96a9c0 20 searching for the correct realm 2024-09-14T11:29:48.090 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.052+0000 7f1debc71640 0 -- 172.21.15.71:0/3671760530 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f1de0047020 msgr2=0x7f1de006e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:48.265 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.268+0000 7f1debc71640 0 -- 172.21.15.71:0/3671760530 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x5594d7e36520 msgr2=0x5594d7e38910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:48.279 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.280+0000 7f1ded96a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:48.279 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.280+0000 7f1ded96a9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:29:48.279 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.280+0000 7f1ded96a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:48.279 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.280+0000 7f1ded96a9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:29:48.279 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.280+0000 7f1ded96a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:48.280 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.280+0000 7f1ded96a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:48.280 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.280+0000 7f1ded96a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.280 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.280+0000 7f1ded96a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:48.280 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.280+0000 7f1ded96a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.281 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.284+0000 7f1ded96a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:48.281 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.284+0000 7f1ded96a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.284+0000 7f1ded96a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:48.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.284+0000 7f1ded96a9c0 20 zone default found 2024-09-14T11:29:48.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.284+0000 7f1ded96a9c0 4 Realm: () 2024-09-14T11:29:48.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.284+0000 7f1ded96a9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:29:48.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.284+0000 7f1ded96a9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:29:48.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.284+0000 7f1ded96a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:48.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.284+0000 7f1ded96a9c0 20 zonegroup default 2024-09-14T11:29:48.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.284+0000 7f1ded96a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.284+0000 7f1ded96a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:48.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.284+0000 7f1ded96a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.284+0000 7f1ded96a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:48.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.284+0000 7f1ded96a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.284 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.284+0000 7f1ded96a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:48.284 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.284+0000 7f1ded96a9c0 20 started sync module instance, tier type = 2024-09-14T11:29:48.284 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.284+0000 7f1ded96a9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:29:48.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.308+0000 7f1ded96a9c0 20 add_watcher() i=0 2024-09-14T11:29:48.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.308+0000 7f1ded96a9c0 20 add_watcher() i=1 2024-09-14T11:29:48.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.308+0000 7f1ded96a9c0 20 add_watcher() i=2 2024-09-14T11:29:48.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.308+0000 7f1ded96a9c0 20 add_watcher() i=3 2024-09-14T11:29:48.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.308+0000 7f1ded96a9c0 20 add_watcher() i=4 2024-09-14T11:29:48.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.308+0000 7f1ded96a9c0 20 add_watcher() i=5 2024-09-14T11:29:48.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.308+0000 7f1ded96a9c0 20 add_watcher() i=6 2024-09-14T11:29:48.308 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.308+0000 7f1ded96a9c0 20 add_watcher() i=7 2024-09-14T11:29:48.308 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.308+0000 7f1ded96a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:48.313 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.316+0000 7f1ca1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:48.314 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.316+0000 7f1ded96a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:48.314 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.316+0000 7f1ded96a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:48.314 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.316+0000 7f1ded96a9c0 5 note: GC not initialized 2024-09-14T11:29:48.314 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.316+0000 7f1ca0fe1640 20 reqs_thread_entry: start 2024-09-14T11:29:48.314 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.316+0000 7f1ded96a9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:48.315 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.316+0000 7f1ded96a9c0 20 Filter name: none 2024-09-14T11:29:48.315 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.316+0000 7f1c1a7fc640 20 reqs_thread_entry: start 2024-09-14T11:29:48.315 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.316+0000 7f1ded96a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.315 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.316+0000 7f1ded96a9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:29:48.315 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.316+0000 7f1ded96a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.316 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.316+0000 7f1ded96a9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:29:48.316 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.316+0000 7f1ded96a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:48.316 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.316+0000 7f1ded96a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.316 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.316+0000 7f1ded96a9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:29:48.316 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.316+0000 7f1ded96a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.320+0000 7f1ded96a9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:29:48.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.320+0000 7f1ded96a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:48.320 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.320+0000 7f1ca1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:48.324 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.324+0000 7f1ded96a9c0 20 remove_watcher() i=0 2024-09-14T11:29:48.324 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.324+0000 7f1ded96a9c0 2 removed watcher, disabling cache 2024-09-14T11:29:48.326 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.328+0000 7f1ded96a9c0 20 remove_watcher() i=1 2024-09-14T11:29:48.328 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.328+0000 7f1ded96a9c0 20 remove_watcher() i=2 2024-09-14T11:29:48.330 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.332+0000 7f1ded96a9c0 20 remove_watcher() i=3 2024-09-14T11:29:48.332 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.332+0000 7f1ded96a9c0 20 remove_watcher() i=4 2024-09-14T11:29:48.334 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.336+0000 7f1ded96a9c0 20 remove_watcher() i=5 2024-09-14T11:29:48.337 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.340+0000 7f1ded96a9c0 20 remove_watcher() i=6 2024-09-14T11:29:48.340 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.340+0000 7f1ded96a9c0 20 remove_watcher() i=7 2024-09-14T11:29:48.356 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:48.356 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:29:48.356 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: abort-at-set-target-layout id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:29:48.357 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:29:48.418 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:29:48.454 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:48.454 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:48.500 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.500+0000 7fd30f4d29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.504+0000 7fd30f4d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:48.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.504+0000 7fd30f4d29c0 20 realm 2024-09-14T11:29:48.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.504+0000 7fd30f4d29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.504+0000 7fd30f4d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:48.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.504+0000 7fd30f4d29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:48.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.504+0000 7fd30f4d29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.504+0000 7fd30f4d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:48.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.504+0000 7fd30f4d29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.504 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.504+0000 7fd30f4d29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:48.504 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.504+0000 7fd30f4d29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.505 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.508+0000 7fd30f4d29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:48.505 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.508+0000 7fd30f4d29c0 20 searching for the correct realm 2024-09-14T11:29:48.509 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.512+0000 7fd30d7d9640 0 -- 172.21.15.71:0/2921658155 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fd30012d040 msgr2=0x7fd300121c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:48.724 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.724+0000 7fd30d7d9640 0 -- 172.21.15.71:0/2921658155 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x5601988eaee0 msgr2=0x5601988ed2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:48.740 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.740+0000 7fd30f4d29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:48.740 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.740+0000 7fd30f4d29c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:29:48.740 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.740+0000 7fd30f4d29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:48.740 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.740+0000 7fd30f4d29c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:29:48.740 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.740+0000 7fd30f4d29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:48.740 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.740+0000 7fd30f4d29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:48.740 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.740+0000 7fd30f4d29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.741 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.744+0000 7fd30f4d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:48.741 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.744+0000 7fd30f4d29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.741 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.744+0000 7fd30f4d29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:48.741 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.744+0000 7fd30f4d29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.742 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.744+0000 7fd30f4d29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:48.742 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.744+0000 7fd30f4d29c0 20 zone default found 2024-09-14T11:29:48.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.744+0000 7fd30f4d29c0 4 Realm: () 2024-09-14T11:29:48.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.744+0000 7fd30f4d29c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:29:48.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.744+0000 7fd30f4d29c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:29:48.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.744+0000 7fd30f4d29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:48.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.744+0000 7fd30f4d29c0 20 zonegroup default 2024-09-14T11:29:48.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.744+0000 7fd30f4d29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.744+0000 7fd30f4d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:48.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.744+0000 7fd30f4d29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.744+0000 7fd30f4d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:48.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.744+0000 7fd30f4d29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.744+0000 7fd30f4d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:48.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.744+0000 7fd30f4d29c0 20 started sync module instance, tier type = 2024-09-14T11:29:48.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.744+0000 7fd30f4d29c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:29:48.766 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.768+0000 7fd30f4d29c0 20 add_watcher() i=0 2024-09-14T11:29:48.766 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.768+0000 7fd30f4d29c0 20 add_watcher() i=1 2024-09-14T11:29:48.766 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.768+0000 7fd30f4d29c0 20 add_watcher() i=2 2024-09-14T11:29:48.766 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.768+0000 7fd30f4d29c0 20 add_watcher() i=3 2024-09-14T11:29:48.767 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.768+0000 7fd30f4d29c0 20 add_watcher() i=4 2024-09-14T11:29:48.767 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.768+0000 7fd30f4d29c0 20 add_watcher() i=5 2024-09-14T11:29:48.767 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.768+0000 7fd30f4d29c0 20 add_watcher() i=6 2024-09-14T11:29:48.769 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.772+0000 7fd30f4d29c0 20 add_watcher() i=7 2024-09-14T11:29:48.769 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.772+0000 7fd30f4d29c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:48.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.776+0000 7fd1c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:48.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.776+0000 7fd30f4d29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:48.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.776+0000 7fd30f4d29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:48.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.776+0000 7fd30f4d29c0 5 note: GC not initialized 2024-09-14T11:29:48.775 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.776+0000 7fd1c27e4640 20 reqs_thread_entry: start 2024-09-14T11:29:48.775 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.776+0000 7fd30f4d29c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:48.775 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.776+0000 7fd30f4d29c0 20 Filter name: none 2024-09-14T11:29:48.775 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.776+0000 7fd1bbfff640 20 reqs_thread_entry: start 2024-09-14T11:29:48.775 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.776+0000 7fd30f4d29c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:29:48.775 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.776+0000 7fd30f4d29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.776 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.776+0000 7fd30f4d29c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:29:48.776 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.776+0000 7fd30f4d29c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:29:48.776 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.776+0000 7fd30f4d29c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:29:48.776 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.776+0000 7fd30f4d29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 : miss 2024-09-14T11:29:48.776 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.776+0000 7fd30f4d29c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:48.777 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.780+0000 7fd30f4d29c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:29:48.777 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.780+0000 7fd30f4d29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 info.flags=0x17 2024-09-14T11:29:48.777 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.780+0000 7fd30f4d29c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 to cache LRU end 2024-09-14T11:29:48.777 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.780+0000 7fd30f4d29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:29:48.777 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.780+0000 7fd30f4d29c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:48.777 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.780+0000 7fd30f4d29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 2024-09-14T11:29:48.780 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.780+0000 7fd30f4d29c0 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 to be held by another RGW process; skipping for now 2024-09-14T11:29:48.781 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.784+0000 7fd1c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:48.786 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.788+0000 7fd30f4d29c0 20 remove_watcher() i=0 2024-09-14T11:29:48.787 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.788+0000 7fd30f4d29c0 2 removed watcher, disabling cache 2024-09-14T11:29:48.789 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.792+0000 7fd30f4d29c0 20 remove_watcher() i=1 2024-09-14T11:29:48.791 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.792+0000 7fd30f4d29c0 20 remove_watcher() i=2 2024-09-14T11:29:48.793 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.796+0000 7fd30f4d29c0 20 remove_watcher() i=3 2024-09-14T11:29:48.795 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.796+0000 7fd30f4d29c0 20 remove_watcher() i=4 2024-09-14T11:29:48.798 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.800+0000 7fd30f4d29c0 20 remove_watcher() i=5 2024-09-14T11:29:48.801 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.804+0000 7fd30f4d29c0 20 remove_watcher() i=6 2024-09-14T11:29:48.803 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:29:48.804+0000 7fd30f4d29c0 20 remove_watcher() i=7 2024-09-14T11:29:48.818 INFO:tasks.workunit.client.0.smithi071.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:30:18.839 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:30:18.877 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:18.877 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:18.923 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:18.924+0000 7ff626e8c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:18.926 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:18.928+0000 7ff626e8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:18.926 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:18.928+0000 7ff626e8c9c0 20 realm 2024-09-14T11:30:18.926 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:18.928+0000 7ff626e8c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:18.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:18.928+0000 7ff626e8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:18.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:18.928+0000 7ff626e8c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:18.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:18.928+0000 7ff626e8c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:18.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:18.928+0000 7ff626e8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:18.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:18.928+0000 7ff626e8c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:18.928 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:18.928+0000 7ff626e8c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:18.928 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:18.928+0000 7ff626e8c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:18.929 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:18.932+0000 7ff626e8c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:18.929 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:18.932+0000 7ff626e8c9c0 20 searching for the correct realm 2024-09-14T11:30:18.932 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:18.936+0000 7ff625193640 0 -- 172.21.15.71:0/3266532928 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7ff6180e7060 msgr2=0x7ff61810ec90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:19.148 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.148+0000 7ff625193640 0 -- 172.21.15.71:0/3266532928 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x564e2f788fe0 msgr2=0x564e2f78b3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:19.163 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.164+0000 7ff626e8c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:19.163 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.164+0000 7ff626e8c9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:30:19.163 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.164+0000 7ff626e8c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:19.163 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.164+0000 7ff626e8c9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:30:19.163 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.164+0000 7ff626e8c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:19.163 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.164+0000 7ff626e8c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:19.163 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.164+0000 7ff626e8c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.164 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.164+0000 7ff626e8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:19.164 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.164+0000 7ff626e8c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.164 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.164+0000 7ff626e8c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:19.164 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.164+0000 7ff626e8c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.165 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.168+0000 7ff626e8c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:19.166 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.168+0000 7ff626e8c9c0 20 zone default found 2024-09-14T11:30:19.166 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.168+0000 7ff626e8c9c0 4 Realm: () 2024-09-14T11:30:19.166 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.168+0000 7ff626e8c9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:30:19.166 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.168+0000 7ff626e8c9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:30:19.166 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.168+0000 7ff626e8c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:19.166 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.168+0000 7ff626e8c9c0 20 zonegroup default 2024-09-14T11:30:19.166 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.168+0000 7ff626e8c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.166 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.168+0000 7ff626e8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:19.166 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.168+0000 7ff626e8c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.167 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.168+0000 7ff626e8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:19.167 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.168+0000 7ff626e8c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.168 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.168+0000 7ff626e8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:19.168 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.168+0000 7ff626e8c9c0 20 started sync module instance, tier type = 2024-09-14T11:30:19.168 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.168+0000 7ff626e8c9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:30:19.191 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.192+0000 7ff626e8c9c0 20 add_watcher() i=0 2024-09-14T11:30:19.191 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.192+0000 7ff626e8c9c0 20 add_watcher() i=1 2024-09-14T11:30:19.191 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.192+0000 7ff626e8c9c0 20 add_watcher() i=2 2024-09-14T11:30:19.191 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.192+0000 7ff626e8c9c0 20 add_watcher() i=3 2024-09-14T11:30:19.191 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.192+0000 7ff626e8c9c0 20 add_watcher() i=4 2024-09-14T11:30:19.191 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.192+0000 7ff626e8c9c0 20 add_watcher() i=5 2024-09-14T11:30:19.191 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.192+0000 7ff626e8c9c0 20 add_watcher() i=6 2024-09-14T11:30:19.193 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.196+0000 7ff626e8c9c0 20 add_watcher() i=7 2024-09-14T11:30:19.193 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.196+0000 7ff626e8c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:19.197 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.200+0000 7ff4dafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:19.198 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.200+0000 7ff626e8c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:19.199 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.200+0000 7ff626e8c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:19.199 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.200+0000 7ff626e8c9c0 5 note: GC not initialized 2024-09-14T11:30:19.199 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.200+0000 7ff4d9fe3640 20 reqs_thread_entry: start 2024-09-14T11:30:19.199 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.200+0000 7ff626e8c9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:30:19.199 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.200+0000 7ff626e8c9c0 20 Filter name: none 2024-09-14T11:30:19.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.200+0000 7ff44b7fe640 20 reqs_thread_entry: start 2024-09-14T11:30:19.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.200+0000 7ff626e8c9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:30:19.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.200+0000 7ff626e8c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.201 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.204+0000 7ff626e8c9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:30:19.201 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.204+0000 7ff626e8c9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:30:19.201 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.204+0000 7ff626e8c9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:30:19.201 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.204+0000 7ff626e8c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 : miss 2024-09-14T11:30:19.201 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.204+0000 7ff626e8c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.201 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.204+0000 7ff626e8c9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:30:19.202 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.204+0000 7ff626e8c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 info.flags=0x17 2024-09-14T11:30:19.202 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.204+0000 7ff626e8c9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 to cache LRU end 2024-09-14T11:30:19.202 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.204+0000 7ff626e8c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:19.202 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.204+0000 7ff626e8c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:19.202 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.204+0000 7ff626e8c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 2024-09-14T11:30:19.211 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.212+0000 7ff626e8c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 info.flags=0x17 2024-09-14T11:30:19.211 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.212+0000 7ff626e8c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 to cache LRU end 2024-09-14T11:30:19.211 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.212+0000 7ff626e8c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:19.211 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.212+0000 7ff626e8c9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25, ofs0, ns] 2024-09-14T11:30:19.212 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.212+0000 7ff4fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464361 cookie 94893803900048 notifier 6633 bl.length()=1009 2024-09-14T11:30:19.212 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.212+0000 7ff4fb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 info.flags=0x17 2024-09-14T11:30:19.212 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.212+0000 7ff4fb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 to cache LRU end 2024-09-14T11:30:19.212 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.212+0000 7ff4fb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:19.212 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.212+0000 7ff626e8c9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.25]): orig_sources= new_sources= 2024-09-14T11:30:19.212 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.212+0000 7ff626e8c9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.25]): potential sources added=[] removed=[] 2024-09-14T11:30:19.212 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.212+0000 7ff626e8c9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.25]): orig_dests= new_dests= 2024-09-14T11:30:19.212 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.212+0000 7ff626e8c9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.25]): potential dests added=[] removed=[] 2024-09-14T11:30:19.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.228+0000 7ff626e8c9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.1.0 2024-09-14T11:30:19.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.228+0000 7ff626e8c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.1.0 2024-09-14T11:30:19.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.228+0000 7ff626e8c9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.1.1 2024-09-14T11:30:19.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.228+0000 7ff626e8c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.1.1 2024-09-14T11:30:19.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.228+0000 7ff626e8c9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.1.2 2024-09-14T11:30:19.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.228+0000 7ff626e8c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.1.2 2024-09-14T11:30:19.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.228+0000 7ff626e8c9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.1.3 2024-09-14T11:30:19.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.228+0000 7ff626e8c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.1.3 2024-09-14T11:30:19.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.228+0000 7ff626e8c9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.1.4 2024-09-14T11:30:19.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.228+0000 7ff626e8c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.1.4 2024-09-14T11:30:19.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.228+0000 7ff626e8c9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.1.5 2024-09-14T11:30:19.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.228+0000 7ff626e8c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.1.5 2024-09-14T11:30:19.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.228+0000 7ff626e8c9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.1.6 2024-09-14T11:30:19.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.228+0000 7ff626e8c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.1.6 2024-09-14T11:30:19.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.228+0000 7ff626e8c9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.1.7 2024-09-14T11:30:19.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.228+0000 7ff626e8c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.1.7 2024-09-14T11:30:19.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.228+0000 7ff626e8c9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.1.8 2024-09-14T11:30:19.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.228+0000 7ff626e8c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.1.8 2024-09-14T11:30:19.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.228+0000 7ff626e8c9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.1.9 2024-09-14T11:30:19.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.228+0000 7ff626e8c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.1.9 2024-09-14T11:30:19.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.228+0000 7ff626e8c9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.1.10 2024-09-14T11:30:19.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.228+0000 7ff626e8c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.1.10 2024-09-14T11:30:19.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.228+0000 7ff626e8c9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.1.11 2024-09-14T11:30:19.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.228+0000 7ff626e8c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.1.11 2024-09-14T11:30:19.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.228+0000 7ff626e8c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.0 2024-09-14T11:30:19.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.228+0000 7ff626e8c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.1 2024-09-14T11:30:19.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.228+0000 7ff626e8c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.2 2024-09-14T11:30:19.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.228+0000 7ff626e8c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.3 2024-09-14T11:30:19.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.228+0000 7ff626e8c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.4 2024-09-14T11:30:19.230 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.232+0000 7ff626e8c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.5 2024-09-14T11:30:19.231 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.232+0000 7ff626e8c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.6 2024-09-14T11:30:19.232 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.232+0000 7ff626e8c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.7 2024-09-14T11:30:19.233 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.236+0000 7ff626e8c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.8 2024-09-14T11:30:19.234 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.236+0000 7ff626e8c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.9 2024-09-14T11:30:19.235 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.236+0000 7ff626e8c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.10 2024-09-14T11:30:19.242 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.244+0000 7ff626e8c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 : hit (requested=0x17, cached=0x17) 2024-09-14T11:30:19.242 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.244+0000 7ff626e8c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 2024-09-14T11:30:19.244 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.244+0000 7ff626e8c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 info.flags=0x17 2024-09-14T11:30:19.244 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.244+0000 7ff626e8c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 to cache LRU end 2024-09-14T11:30:19.244 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.244+0000 7ff626e8c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:19.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.244+0000 7ff626e8c9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25, ofs0, ns] 2024-09-14T11:30:19.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.248+0000 7ff4fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464362 cookie 94893803900048 notifier 6633 bl.length()=1009 2024-09-14T11:30:19.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.248+0000 7ff4fb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 info.flags=0x17 2024-09-14T11:30:19.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.248+0000 7ff4fb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 to cache LRU end 2024-09-14T11:30:19.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.248+0000 7ff4fb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:19.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.248+0000 7ff626e8c9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.25]): orig_sources= new_sources= 2024-09-14T11:30:19.246 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.248+0000 7ff626e8c9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.25]): potential sources added=[] removed=[] 2024-09-14T11:30:19.246 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.248+0000 7ff626e8c9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.25]): orig_dests= new_dests= 2024-09-14T11:30:19.246 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.248+0000 7ff626e8c9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.25]): potential dests added=[] removed=[] 2024-09-14T11:30:19.252 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.252+0000 7ff626e8c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.0 2024-09-14T11:30:19.252 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.252+0000 7ff626e8c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.1 2024-09-14T11:30:19.253 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.256+0000 7ff626e8c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.2 2024-09-14T11:30:19.254 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.256+0000 7ff626e8c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.3 2024-09-14T11:30:19.254 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.256+0000 7ff626e8c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.4 2024-09-14T11:30:19.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.256+0000 7ff626e8c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.5 2024-09-14T11:30:19.256 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.256+0000 7ff626e8c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.6 2024-09-14T11:30:19.256 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.256+0000 7ff626e8c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.7 2024-09-14T11:30:19.257 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.260+0000 7ff626e8c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.8 2024-09-14T11:30:19.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.260+0000 7ff626e8c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.9 2024-09-14T11:30:19.259 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.260+0000 7ff626e8c9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.25.10 2024-09-14T11:30:19.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.260+0000 7ff626e8c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 : hit (requested=0x17, cached=0x17) 2024-09-14T11:30:19.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.260+0000 7ff626e8c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 2024-09-14T11:30:19.262 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.264+0000 7ff626e8c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 info.flags=0x17 2024-09-14T11:30:19.262 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.264+0000 7ff626e8c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 to cache LRU end 2024-09-14T11:30:19.262 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.264+0000 7ff626e8c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:19.262 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.264+0000 7ff626e8c9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25, ofs0, ns] 2024-09-14T11:30:19.262 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.264+0000 7ff4fbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464363 cookie 94893803900048 notifier 6633 bl.length()=977 2024-09-14T11:30:19.263 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.264+0000 7ff4fbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 info.flags=0x17 2024-09-14T11:30:19.263 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.264+0000 7ff4fbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.25 to cache LRU end 2024-09-14T11:30:19.263 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.264+0000 7ff4fbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:19.263 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.264+0000 7ff626e8c9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.25]): orig_sources= new_sources= 2024-09-14T11:30:19.263 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.264+0000 7ff626e8c9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.25]): potential sources added=[] removed=[] 2024-09-14T11:30:19.263 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.264+0000 7ff626e8c9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.25]): orig_dests= new_dests= 2024-09-14T11:30:19.263 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.264+0000 7ff626e8c9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.25]): potential dests added=[] removed=[] 2024-09-14T11:30:19.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.272+0000 7ff626e8c9c0 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:30:19.273 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.276+0000 7ff4dafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:19.278 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.280+0000 7ff626e8c9c0 20 remove_watcher() i=0 2024-09-14T11:30:19.278 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.280+0000 7ff626e8c9c0 2 removed watcher, disabling cache 2024-09-14T11:30:19.280 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.280+0000 7ff626e8c9c0 20 remove_watcher() i=1 2024-09-14T11:30:19.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.284+0000 7ff626e8c9c0 20 remove_watcher() i=2 2024-09-14T11:30:19.284 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.284+0000 7ff626e8c9c0 20 remove_watcher() i=3 2024-09-14T11:30:19.286 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.288+0000 7ff626e8c9c0 20 remove_watcher() i=4 2024-09-14T11:30:19.288 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.288+0000 7ff626e8c9c0 20 remove_watcher() i=5 2024-09-14T11:30:19.291 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.292+0000 7ff626e8c9c0 20 remove_watcher() i=6 2024-09-14T11:30:19.294 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.296+0000 7ff626e8c9c0 20 remove_watcher() i=7 2024-09-14T11:30:19.312 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:30:19.339 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:19.339 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:19.382 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.384+0000 7f5236a659c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.385 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.388+0000 7f5236a659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:19.385 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.388+0000 7f5236a659c0 20 realm 2024-09-14T11:30:19.385 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.388+0000 7f5236a659c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.385 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.388+0000 7f5236a659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:19.385 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.388+0000 7f5236a659c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:19.386 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.388+0000 7f5236a659c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.386 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.388+0000 7f5236a659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:19.386 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.388+0000 7f5236a659c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.387 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.388+0000 7f5236a659c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:19.387 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.388+0000 7f5236a659c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.388 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.388+0000 7f5236a659c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:19.388 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.388+0000 7f5236a659c0 20 searching for the correct realm 2024-09-14T11:30:19.391 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.392+0000 7f5234d6c640 0 -- 172.21.15.71:0/1404662259 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f5228008070 msgr2=0x7f5228016920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:19.604 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.604+0000 7f5234d6c640 0 -- 172.21.15.71:0/1404662259 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x5569cd4cf9e0 msgr2=0x5569cd4d1dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:19.619 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.620+0000 7f5236a659c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:19.619 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.620+0000 7f5236a659c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:30:19.619 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.620+0000 7f5236a659c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:19.619 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.620+0000 7f5236a659c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:30:19.619 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.620+0000 7f5236a659c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:19.619 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.620+0000 7f5236a659c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:19.619 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.620+0000 7f5236a659c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.619 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.620+0000 7f5236a659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:19.620 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.620+0000 7f5236a659c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.620 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.620+0000 7f5236a659c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:19.620 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.620+0000 7f5236a659c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.621 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.624+0000 7f5236a659c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:19.621 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.624+0000 7f5236a659c0 20 zone default found 2024-09-14T11:30:19.621 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.624+0000 7f5236a659c0 4 Realm: () 2024-09-14T11:30:19.621 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.624+0000 7f5236a659c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:30:19.621 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.624+0000 7f5236a659c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:30:19.621 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.624+0000 7f5236a659c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:19.621 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.624+0000 7f5236a659c0 20 zonegroup default 2024-09-14T11:30:19.622 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.624+0000 7f5236a659c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.622 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.624+0000 7f5236a659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:19.622 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.624+0000 7f5236a659c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.623 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.624+0000 7f5236a659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:19.623 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.624+0000 7f5236a659c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.624 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.624+0000 7f5236a659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:19.624 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.624+0000 7f5236a659c0 20 started sync module instance, tier type = 2024-09-14T11:30:19.624 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.624+0000 7f5236a659c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:30:19.646 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.648+0000 7f5236a659c0 20 add_watcher() i=0 2024-09-14T11:30:19.646 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.648+0000 7f5236a659c0 20 add_watcher() i=1 2024-09-14T11:30:19.646 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.648+0000 7f5236a659c0 20 add_watcher() i=2 2024-09-14T11:30:19.646 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.648+0000 7f5236a659c0 20 add_watcher() i=3 2024-09-14T11:30:19.646 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.648+0000 7f5236a659c0 20 add_watcher() i=4 2024-09-14T11:30:19.646 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.648+0000 7f5236a659c0 20 add_watcher() i=5 2024-09-14T11:30:19.646 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.648+0000 7f5236a659c0 20 add_watcher() i=6 2024-09-14T11:30:19.649 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.648+0000 7f5236a659c0 20 add_watcher() i=7 2024-09-14T11:30:19.649 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.648+0000 7f5236a659c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:19.653 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.656+0000 7f50eafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:19.653 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.656+0000 7f5236a659c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:19.653 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.656+0000 7f5236a659c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:19.654 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.656+0000 7f5236a659c0 5 note: GC not initialized 2024-09-14T11:30:19.654 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.656+0000 7f50e9fdb640 20 reqs_thread_entry: start 2024-09-14T11:30:19.654 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.656+0000 7f5236a659c0 20 init_complete bucket index max shards: 11 2024-09-14T11:30:19.654 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.656+0000 7f5236a659c0 20 Filter name: none 2024-09-14T11:30:19.655 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.656+0000 7f505b7fe640 20 reqs_thread_entry: start 2024-09-14T11:30:19.655 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.656+0000 7f5236a659c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.655 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.656+0000 7f5236a659c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:30:19.655 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.656+0000 7f5236a659c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.656 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.656+0000 7f5236a659c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:30:19.656 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.656+0000 7f5236a659c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:19.656 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.656+0000 7f5236a659c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.656 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.656+0000 7f5236a659c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:30:19.656 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.656+0000 7f5236a659c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.657 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.660+0000 7f5236a659c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:30:19.657 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.660+0000 7f5236a659c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:19.660 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.660+0000 7f50eafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:19.664 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.664+0000 7f5236a659c0 20 remove_watcher() i=0 2024-09-14T11:30:19.664 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.664+0000 7f5236a659c0 2 removed watcher, disabling cache 2024-09-14T11:30:19.665 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.668+0000 7f5236a659c0 20 remove_watcher() i=1 2024-09-14T11:30:19.667 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.668+0000 7f5236a659c0 20 remove_watcher() i=2 2024-09-14T11:30:19.669 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.672+0000 7f5236a659c0 20 remove_watcher() i=3 2024-09-14T11:30:19.671 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.672+0000 7f5236a659c0 20 remove_watcher() i=4 2024-09-14T11:30:19.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.676+0000 7f5236a659c0 20 remove_watcher() i=5 2024-09-14T11:30:19.676 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.676+0000 7f5236a659c0 20 remove_watcher() i=6 2024-09-14T11:30:19.680 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:19.680+0000 7f5236a659c0 20 remove_watcher() i=7 2024-09-14T11:30:19.695 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:19.695 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:30:19.695 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: abort-at-set-target-layout id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.25 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:30:19.696 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:19.819 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-14T11:30:19.819 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:20.213 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:30:20.246 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:20.246 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:20.293 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.296+0000 7f340b5059c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.295 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.296+0000 7f340b5059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.296 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.296+0000 7f340b5059c0 20 realm 2024-09-14T11:30:20.296 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.296+0000 7f340b5059c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.296 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.296+0000 7f340b5059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.296 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.296+0000 7f340b5059c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:20.296 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.296+0000 7f340b5059c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.297 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.296+0000 7f340b5059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.297 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.296+0000 7f340b5059c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.297 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.300+0000 7f340b5059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:20.297 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.300+0000 7f340b5059c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.298 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.300+0000 7f340b5059c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:20.299 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.300+0000 7f340b5059c0 20 searching for the correct realm 2024-09-14T11:30:20.302 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.304+0000 7f340980c640 0 -- 172.21.15.71:0/4230581536 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f340008e040 msgr2=0x7f3400044410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:20.516 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.516+0000 7f340980c640 0 -- 172.21.15.71:0/4230581536 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55ff4480f610 msgr2=0x55ff44811a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:20.530 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.532+0000 7f340b5059c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:20.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.532+0000 7f340b5059c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:30:20.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.532+0000 7f340b5059c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:20.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.532+0000 7f340b5059c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:30:20.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.532+0000 7f340b5059c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:20.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.532+0000 7f340b5059c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:20.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.532+0000 7f340b5059c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.532+0000 7f340b5059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.532 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.532+0000 7f340b5059c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.532 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.532+0000 7f340b5059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:20.532 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.532+0000 7f340b5059c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.533 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.536+0000 7f340b5059c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:20.533 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.536+0000 7f340b5059c0 20 zone default found 2024-09-14T11:30:20.533 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.536+0000 7f340b5059c0 4 Realm: () 2024-09-14T11:30:20.533 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.536+0000 7f340b5059c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:30:20.533 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.536+0000 7f340b5059c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:30:20.533 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.536+0000 7f340b5059c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:20.533 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.536+0000 7f340b5059c0 20 zonegroup default 2024-09-14T11:30:20.534 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.536+0000 7f340b5059c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.534 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.536+0000 7f340b5059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.534 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.536+0000 7f340b5059c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.534 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.536+0000 7f340b5059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.534 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.536+0000 7f340b5059c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.535 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.536+0000 7f340b5059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.535 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.536+0000 7f340b5059c0 20 started sync module instance, tier type = 2024-09-14T11:30:20.535 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.536+0000 7f340b5059c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:30:20.559 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.560+0000 7f340b5059c0 20 add_watcher() i=0 2024-09-14T11:30:20.559 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.560+0000 7f340b5059c0 20 add_watcher() i=1 2024-09-14T11:30:20.559 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.560+0000 7f340b5059c0 20 add_watcher() i=2 2024-09-14T11:30:20.559 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.560+0000 7f340b5059c0 20 add_watcher() i=3 2024-09-14T11:30:20.559 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.560+0000 7f340b5059c0 20 add_watcher() i=4 2024-09-14T11:30:20.560 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.560+0000 7f340b5059c0 20 add_watcher() i=5 2024-09-14T11:30:20.560 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.560+0000 7f340b5059c0 20 add_watcher() i=6 2024-09-14T11:30:20.562 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.564+0000 7f340b5059c0 20 add_watcher() i=7 2024-09-14T11:30:20.562 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.564+0000 7f340b5059c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:20.566 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.568+0000 7f32bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:20.567 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.568+0000 7f340b5059c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:20.567 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.568+0000 7f340b5059c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:20.567 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.568+0000 7f340b5059c0 5 note: GC not initialized 2024-09-14T11:30:20.568 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.568+0000 7f32be7e4640 20 reqs_thread_entry: start 2024-09-14T11:30:20.568 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.568+0000 7f340b5059c0 20 init_complete bucket index max shards: 11 2024-09-14T11:30:20.568 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.568+0000 7f340b5059c0 20 Filter name: none 2024-09-14T11:30:20.569 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.568+0000 7f322ffff640 20 reqs_thread_entry: start 2024-09-14T11:30:20.569 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.568+0000 7f340b5059c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.569 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.572+0000 7f340b5059c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:20.569 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.572+0000 7f340b5059c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.570 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.572+0000 7f340b5059c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:30:20.570 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.572+0000 7f340b5059c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:20.570 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.572+0000 7f340b5059c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.571 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.572+0000 7f340b5059c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:20.571 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.572+0000 7f340b5059c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.571 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.572+0000 7f340b5059c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:30:20.571 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.572+0000 7f340b5059c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:20.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.576+0000 7f32bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:20.580 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.580+0000 7f340b5059c0 20 remove_watcher() i=0 2024-09-14T11:30:20.580 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.580+0000 7f340b5059c0 2 removed watcher, disabling cache 2024-09-14T11:30:20.583 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.584+0000 7f340b5059c0 20 remove_watcher() i=1 2024-09-14T11:30:20.584 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.584+0000 7f340b5059c0 20 remove_watcher() i=2 2024-09-14T11:30:20.587 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.588+0000 7f340b5059c0 20 remove_watcher() i=3 2024-09-14T11:30:20.589 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.592+0000 7f340b5059c0 20 remove_watcher() i=4 2024-09-14T11:30:20.591 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.592+0000 7f340b5059c0 20 remove_watcher() i=5 2024-09-14T11:30:20.594 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.596+0000 7f340b5059c0 20 remove_watcher() i=6 2024-09-14T11:30:20.597 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.600+0000 7f340b5059c0 20 remove_watcher() i=7 2024-09-14T11:30:20.612 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:20.612 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:30:20.612 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: error-at-trim-reshard-log-entries id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:30:20.612 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:20.613 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-14T11:30:20.646 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:20.646 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:20.689 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.692+0000 7fbefc0be9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.692 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.692+0000 7fbefc0be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.692 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.692+0000 7fbefc0be9c0 20 realm 2024-09-14T11:30:20.692 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.692+0000 7fbefc0be9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.693 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.696+0000 7fbefc0be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.693 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.696+0000 7fbefc0be9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:20.693 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.696+0000 7fbefc0be9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.693 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.696+0000 7fbefc0be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.693 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.696+0000 7fbefc0be9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.694 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.696+0000 7fbefc0be9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:20.694 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.696+0000 7fbefc0be9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.696+0000 7fbefc0be9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:20.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.696+0000 7fbefc0be9c0 20 searching for the correct realm 2024-09-14T11:30:20.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.700+0000 7fbefa3c5640 0 -- 172.21.15.71:0/3220373645 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fbef00ca070 msgr2=0x7fbef0115060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:20.912 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.912+0000 7fbefa3c5640 0 -- 172.21.15.71:0/3220373645 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x56457428de10 msgr2=0x564574290200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:20.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.928+0000 7fbefc0be9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:20.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.928+0000 7fbefc0be9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:30:20.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.928+0000 7fbefc0be9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:20.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.928+0000 7fbefc0be9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:30:20.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.928+0000 7fbefc0be9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:20.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.928+0000 7fbefc0be9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:20.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.928+0000 7fbefc0be9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.928+0000 7fbefc0be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.928 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.928+0000 7fbefc0be9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.928 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.928+0000 7fbefc0be9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:20.928 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.928+0000 7fbefc0be9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.929 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.932+0000 7fbefc0be9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:20.929 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.932+0000 7fbefc0be9c0 20 zone default found 2024-09-14T11:30:20.929 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.932+0000 7fbefc0be9c0 4 Realm: () 2024-09-14T11:30:20.930 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.932+0000 7fbefc0be9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:30:20.930 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.932+0000 7fbefc0be9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:30:20.930 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.932+0000 7fbefc0be9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:20.930 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.932+0000 7fbefc0be9c0 20 zonegroup default 2024-09-14T11:30:20.930 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.932+0000 7fbefc0be9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.930 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.932+0000 7fbefc0be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.930 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.932+0000 7fbefc0be9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.931 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.932+0000 7fbefc0be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.931 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.932+0000 7fbefc0be9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.931 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.932+0000 7fbefc0be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.931 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.932+0000 7fbefc0be9c0 20 started sync module instance, tier type = 2024-09-14T11:30:20.931 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.932+0000 7fbefc0be9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:30:20.953 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.956+0000 7fbefc0be9c0 20 add_watcher() i=0 2024-09-14T11:30:20.953 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.956+0000 7fbefc0be9c0 20 add_watcher() i=1 2024-09-14T11:30:20.953 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.956+0000 7fbefc0be9c0 20 add_watcher() i=2 2024-09-14T11:30:20.953 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.956+0000 7fbefc0be9c0 20 add_watcher() i=3 2024-09-14T11:30:20.953 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.956+0000 7fbefc0be9c0 20 add_watcher() i=4 2024-09-14T11:30:20.953 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.956+0000 7fbefc0be9c0 20 add_watcher() i=5 2024-09-14T11:30:20.953 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.956+0000 7fbefc0be9c0 20 add_watcher() i=6 2024-09-14T11:30:20.955 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.956+0000 7fbefc0be9c0 20 add_watcher() i=7 2024-09-14T11:30:20.955 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.956+0000 7fbefc0be9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:20.959 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.960+0000 7fbdab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:20.960 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.960+0000 7fbefc0be9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:20.960 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.960+0000 7fbefc0be9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:20.960 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.960+0000 7fbefc0be9c0 5 note: GC not initialized 2024-09-14T11:30:20.961 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.960+0000 7fbdaa7fc640 20 reqs_thread_entry: start 2024-09-14T11:30:20.961 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.960+0000 7fbefc0be9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:30:20.961 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.964+0000 7fbefc0be9c0 20 Filter name: none 2024-09-14T11:30:20.961 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.964+0000 7fbd1bfff640 20 reqs_thread_entry: start 2024-09-14T11:30:20.961 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.964+0000 7fbefc0be9c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:30:20.961 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.964+0000 7fbefc0be9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.962 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.964+0000 7fbefc0be9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:20.962 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.964+0000 7fbefc0be9c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:30:20.962 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.964+0000 7fbefc0be9c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:30:20.962 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.964+0000 7fbefc0be9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.26 : miss 2024-09-14T11:30:20.962 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.964+0000 7fbefc0be9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.962 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.964+0000 7fbefc0be9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:30:20.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.964+0000 7fbefc0be9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.26 info.flags=0x17 2024-09-14T11:30:20.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.964+0000 7fbefc0be9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.26 to cache LRU end 2024-09-14T11:30:20.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.964+0000 7fbefc0be9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:20.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.964+0000 7fbefc0be9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:20.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.964+0000 7fbefc0be9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.26 2024-09-14T11:30:20.972 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.972+0000 7fbefc0be9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.26 info.flags=0x17 2024-09-14T11:30:20.972 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.972+0000 7fbefc0be9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.26 to cache LRU end 2024-09-14T11:30:20.972 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.972+0000 7fbefc0be9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:20.972 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.972+0000 7fbefc0be9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.26, ofs0, ns] 2024-09-14T11:30:20.972 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.972+0000 7fbddcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464286 cookie 94856301604576 notifier 6380 bl.length()=1023 2024-09-14T11:30:20.972 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.972+0000 7fbddcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.26 info.flags=0x17 2024-09-14T11:30:20.972 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.972+0000 7fbddcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.26 to cache LRU end 2024-09-14T11:30:20.972 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.972+0000 7fbddcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:20.973 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.976+0000 7fbefc0be9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.26]): orig_sources= new_sources= 2024-09-14T11:30:20.973 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.976+0000 7fbefc0be9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.26]): potential sources added=[] removed=[] 2024-09-14T11:30:20.973 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.976+0000 7fbefc0be9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.26]): orig_dests= new_dests= 2024-09-14T11:30:20.973 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.976+0000 7fbefc0be9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.26]): potential dests added=[] removed=[] 2024-09-14T11:30:20.973 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.976+0000 7fbefc0be9c0 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-14T11:30:20.973 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.976+0000 7fbefc0be9c0 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-14T11:30:20.975 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.976+0000 7fbdab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:20.980 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.980+0000 7fbefc0be9c0 20 remove_watcher() i=0 2024-09-14T11:30:20.980 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.980+0000 7fbefc0be9c0 2 removed watcher, disabling cache 2024-09-14T11:30:20.981 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.984+0000 7fbefc0be9c0 20 remove_watcher() i=1 2024-09-14T11:30:20.983 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.984+0000 7fbefc0be9c0 20 remove_watcher() i=2 2024-09-14T11:30:20.986 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.988+0000 7fbefc0be9c0 20 remove_watcher() i=3 2024-09-14T11:30:20.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.988+0000 7fbefc0be9c0 20 remove_watcher() i=4 2024-09-14T11:30:20.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.992+0000 7fbefc0be9c0 20 remove_watcher() i=5 2024-09-14T11:30:20.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.996+0000 7fbefc0be9c0 20 remove_watcher() i=6 2024-09-14T11:30:20.996 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:20.996+0000 7fbefc0be9c0 20 remove_watcher() i=7 2024-09-14T11:30:21.014 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:30:21.044 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:21.044 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:21.087 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.088+0000 7fd6f7a6f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:21.090 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.092+0000 7fd6f7a6f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:21.090 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.092+0000 7fd6f7a6f9c0 20 realm 2024-09-14T11:30:21.090 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.092+0000 7fd6f7a6f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:21.091 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.092+0000 7fd6f7a6f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:21.091 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.092+0000 7fd6f7a6f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:21.091 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.092+0000 7fd6f7a6f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:21.091 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.092+0000 7fd6f7a6f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:21.091 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.092+0000 7fd6f7a6f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:21.092 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.092+0000 7fd6f7a6f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:21.092 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.092+0000 7fd6f7a6f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:21.093 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.096+0000 7fd6f7a6f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:21.093 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.096+0000 7fd6f7a6f9c0 20 searching for the correct realm 2024-09-14T11:30:21.094 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.096+0000 7fd6f4d74640 0 -- 172.21.15.71:0/2355143879 >> [v2:172.21.15.71:6824/2436891866,v1:172.21.15.71:6825/2436891866] conn(0x7fd6e8018070 msgr2=0x7fd6e8037960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:21.312 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.312+0000 7fd6f5575640 0 -- 172.21.15.71:0/2355143879 >> [v2:172.21.15.157:6816/1231501119,v1:172.21.15.157:6817/1231501119] conn(0x55945a846a90 msgr2=0x55945a848e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:21.325 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.328+0000 7fd6f7a6f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:21.325 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.328+0000 7fd6f7a6f9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:30:21.325 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.328+0000 7fd6f7a6f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:21.325 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.328+0000 7fd6f7a6f9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:30:21.326 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.328+0000 7fd6f7a6f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:21.326 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.328+0000 7fd6f7a6f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:21.326 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.328+0000 7fd6f7a6f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:21.326 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.328+0000 7fd6f7a6f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:21.326 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.328+0000 7fd6f7a6f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:21.327 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.328+0000 7fd6f7a6f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:21.327 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.328+0000 7fd6f7a6f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:21.327 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.328+0000 7fd6f7a6f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:21.328 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.328+0000 7fd6f7a6f9c0 20 zone default found 2024-09-14T11:30:21.328 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.328+0000 7fd6f7a6f9c0 4 Realm: () 2024-09-14T11:30:21.328 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.328+0000 7fd6f7a6f9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:30:21.328 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.328+0000 7fd6f7a6f9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:30:21.328 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.328+0000 7fd6f7a6f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:21.328 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.328+0000 7fd6f7a6f9c0 20 zonegroup default 2024-09-14T11:30:21.328 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.328+0000 7fd6f7a6f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:21.329 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.328+0000 7fd6f7a6f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:21.329 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.328+0000 7fd6f7a6f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:21.329 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.332+0000 7fd6f7a6f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:21.329 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.332+0000 7fd6f7a6f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:21.329 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.332+0000 7fd6f7a6f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:21.329 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.332+0000 7fd6f7a6f9c0 20 started sync module instance, tier type = 2024-09-14T11:30:21.329 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.332+0000 7fd6f7a6f9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:30:21.352 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.352+0000 7fd6f7a6f9c0 20 add_watcher() i=0 2024-09-14T11:30:21.352 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.352+0000 7fd6f7a6f9c0 20 add_watcher() i=1 2024-09-14T11:30:21.352 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.352+0000 7fd6f7a6f9c0 20 add_watcher() i=2 2024-09-14T11:30:21.352 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.352+0000 7fd6f7a6f9c0 20 add_watcher() i=3 2024-09-14T11:30:21.352 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.352+0000 7fd6f7a6f9c0 20 add_watcher() i=4 2024-09-14T11:30:21.352 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.352+0000 7fd6f7a6f9c0 20 add_watcher() i=5 2024-09-14T11:30:21.352 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.352+0000 7fd6f7a6f9c0 20 add_watcher() i=6 2024-09-14T11:30:21.354 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.356+0000 7fd6f7a6f9c0 20 add_watcher() i=7 2024-09-14T11:30:21.354 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.356+0000 7fd6f7a6f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:21.358 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.360+0000 7fd5ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:21.359 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.360+0000 7fd6f7a6f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:21.359 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.360+0000 7fd6f7a6f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:21.359 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.360+0000 7fd6f7a6f9c0 5 note: GC not initialized 2024-09-14T11:30:21.360 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.360+0000 7fd5aa7e4640 20 reqs_thread_entry: start 2024-09-14T11:30:21.360 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.360+0000 7fd6f7a6f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:30:21.360 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.360+0000 7fd6f7a6f9c0 20 Filter name: none 2024-09-14T11:30:21.361 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.360+0000 7fd51bfff640 20 reqs_thread_entry: start 2024-09-14T11:30:21.361 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.360+0000 7fd6f7a6f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:21.361 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.364+0000 7fd6f7a6f9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:21.361 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.364+0000 7fd6f7a6f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:21.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.364+0000 7fd6f7a6f9c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:30:21.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.364+0000 7fd6f7a6f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:21.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.364+0000 7fd6f7a6f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:21.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.364+0000 7fd6f7a6f9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:21.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.364+0000 7fd6f7a6f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:21.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.364+0000 7fd6f7a6f9c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:30:21.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.364+0000 7fd6f7a6f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:21.366 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.368+0000 7fd5ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:21.370 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.372+0000 7fd6f7a6f9c0 20 remove_watcher() i=0 2024-09-14T11:30:21.370 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.372+0000 7fd6f7a6f9c0 2 removed watcher, disabling cache 2024-09-14T11:30:21.372 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.372+0000 7fd6f7a6f9c0 20 remove_watcher() i=1 2024-09-14T11:30:21.374 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.376+0000 7fd6f7a6f9c0 20 remove_watcher() i=2 2024-09-14T11:30:21.376 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.376+0000 7fd6f7a6f9c0 20 remove_watcher() i=3 2024-09-14T11:30:21.378 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.380+0000 7fd6f7a6f9c0 20 remove_watcher() i=4 2024-09-14T11:30:21.380 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.380+0000 7fd6f7a6f9c0 20 remove_watcher() i=5 2024-09-14T11:30:21.383 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.384+0000 7fd6f7a6f9c0 20 remove_watcher() i=6 2024-09-14T11:30:21.386 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.388+0000 7fd6f7a6f9c0 20 remove_watcher() i=7 2024-09-14T11:30:21.402 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:21.402 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:30:21.402 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: error-at-trim-reshard-log-entries id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:30:21.402 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:21.458 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:30:21.496 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:21.496 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:21.542 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.544+0000 7fcf553669c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:21.545 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.548+0000 7fcf553669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:21.545 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.548+0000 7fcf553669c0 20 realm 2024-09-14T11:30:21.545 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.548+0000 7fcf553669c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:21.546 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.548+0000 7fcf553669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:21.546 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.548+0000 7fcf553669c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:21.546 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.548+0000 7fcf553669c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:21.546 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.548+0000 7fcf553669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:21.546 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.548+0000 7fcf553669c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:21.751 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.752+0000 7fcf553669c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:21.751 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.752+0000 7fcf553669c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:21.753 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.756+0000 7fcf553669c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:21.753 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.756+0000 7fcf553669c0 20 searching for the correct realm 2024-09-14T11:30:21.754 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.756+0000 7fcf52e6c640 0 -- 172.21.15.71:0/4249450084 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x557067d90ab0 msgr2=0x557067d92f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:21.967 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.968+0000 7fcf52e6c640 0 -- 172.21.15.71:0/4249450084 >> [v2:172.21.15.157:6808/527702018,v1:172.21.15.157:6809/527702018] conn(0x7fcf4401b040 msgr2=0x7fcf4403b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:21.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.988+0000 7fcf553669c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:21.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.988+0000 7fcf553669c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:30:21.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.988+0000 7fcf553669c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:21.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.988+0000 7fcf553669c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:30:21.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.988+0000 7fcf553669c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:21.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.988+0000 7fcf553669c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:21.989 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.988+0000 7fcf553669c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:21.989 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.992+0000 7fcf553669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:21.989 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.992+0000 7fcf553669c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:21.989 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.992+0000 7fcf553669c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:21.989 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.992+0000 7fcf553669c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:21.990 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.992+0000 7fcf553669c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:21.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.992+0000 7fcf553669c0 20 zone default found 2024-09-14T11:30:21.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.992+0000 7fcf553669c0 4 Realm: () 2024-09-14T11:30:21.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.992+0000 7fcf553669c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:30:21.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.992+0000 7fcf553669c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:30:21.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.992+0000 7fcf553669c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:21.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.992+0000 7fcf553669c0 20 zonegroup default 2024-09-14T11:30:21.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.992+0000 7fcf553669c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:21.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.992+0000 7fcf553669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:21.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.992+0000 7fcf553669c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:21.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.992+0000 7fcf553669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:21.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.992+0000 7fcf553669c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:21.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.996+0000 7fcf553669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:21.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.996+0000 7fcf553669c0 20 started sync module instance, tier type = 2024-09-14T11:30:21.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:21.996+0000 7fcf553669c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:30:22.015 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.016+0000 7fcf553669c0 20 add_watcher() i=0 2024-09-14T11:30:22.015 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.016+0000 7fcf553669c0 20 add_watcher() i=1 2024-09-14T11:30:22.016 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.016+0000 7fcf553669c0 20 add_watcher() i=2 2024-09-14T11:30:22.016 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.016+0000 7fcf553669c0 20 add_watcher() i=3 2024-09-14T11:30:22.016 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.016+0000 7fcf553669c0 20 add_watcher() i=4 2024-09-14T11:30:22.016 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.016+0000 7fcf553669c0 20 add_watcher() i=5 2024-09-14T11:30:22.016 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.016+0000 7fcf553669c0 20 add_watcher() i=6 2024-09-14T11:30:22.018 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.020+0000 7fcf553669c0 20 add_watcher() i=7 2024-09-14T11:30:22.018 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.020+0000 7fcf553669c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:22.022 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.024+0000 7fce097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:22.023 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.024+0000 7fcf553669c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:22.024 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.024+0000 7fcf553669c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:22.024 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.024+0000 7fcf553669c0 5 note: GC not initialized 2024-09-14T11:30:22.024 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.024+0000 7fcd83fff640 20 reqs_thread_entry: start 2024-09-14T11:30:22.024 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.024+0000 7fcf553669c0 20 init_complete bucket index max shards: 11 2024-09-14T11:30:22.024 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.024+0000 7fcf553669c0 20 Filter name: none 2024-09-14T11:30:22.025 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.028+0000 7fcd81ffb640 20 reqs_thread_entry: start 2024-09-14T11:30:22.025 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.028+0000 7fcf553669c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:30:22.025 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.028+0000 7fcf553669c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:22.026 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.028+0000 7fcf553669c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:22.026 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.028+0000 7fcf553669c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:30:22.026 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.028+0000 7fcf553669c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:30:22.026 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.028+0000 7fcf553669c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.26 : miss 2024-09-14T11:30:22.026 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.028+0000 7fcf553669c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:22.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.028+0000 7fcf553669c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:30:22.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.028+0000 7fcf553669c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.26 info.flags=0x17 2024-09-14T11:30:22.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.028+0000 7fcf553669c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.26 to cache LRU end 2024-09-14T11:30:22.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.028+0000 7fcf553669c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:22.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.028+0000 7fcf553669c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:22.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.028+0000 7fcf553669c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.26 2024-09-14T11:30:22.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.028+0000 7fcf553669c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:30:22.041 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.044+0000 7fcf553669c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.26 info.flags=0x17 2024-09-14T11:30:22.041 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.044+0000 7fcf553669c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.26 to cache LRU end 2024-09-14T11:30:22.041 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.044+0000 7fcf553669c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:22.041 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.044+0000 7fcf553669c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.26, ofs0, ns] 2024-09-14T11:30:22.042 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.044+0000 7fce35ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464287 cookie 93941267004320 notifier 6410 bl.length()=1023 2024-09-14T11:30:22.042 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.044+0000 7fce35ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.26 info.flags=0x17 2024-09-14T11:30:22.042 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.044+0000 7fce35ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.26 to cache LRU end 2024-09-14T11:30:22.042 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.044+0000 7fce35ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:22.042 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.044+0000 7fcf553669c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.26]): orig_sources= new_sources= 2024-09-14T11:30:22.043 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.044+0000 7fcf553669c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.26]): potential sources added=[] removed=[] 2024-09-14T11:30:22.043 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.044+0000 7fcf553669c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.26]): orig_dests= new_dests= 2024-09-14T11:30:22.043 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.044+0000 7fcf553669c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.26]): potential dests added=[] removed=[] 2024-09-14T11:30:22.051 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.052+0000 7fcf553669c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.2.0 2024-09-14T11:30:22.051 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.052+0000 7fcf553669c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.2.0 2024-09-14T11:30:22.051 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.052+0000 7fcf553669c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.2.1 2024-09-14T11:30:22.051 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.052+0000 7fcf553669c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.2.1 2024-09-14T11:30:22.051 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.052+0000 7fcf553669c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.2.2 2024-09-14T11:30:22.051 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.052+0000 7fcf553669c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.2.2 2024-09-14T11:30:22.051 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.052+0000 7fcf553669c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.2.3 2024-09-14T11:30:22.051 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.052+0000 7fcf553669c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.2.3 2024-09-14T11:30:22.051 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.052+0000 7fcf553669c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.2.4 2024-09-14T11:30:22.052 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.052+0000 7fcf553669c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.2.4 2024-09-14T11:30:22.052 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.052+0000 7fcf553669c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.2.5 2024-09-14T11:30:22.052 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.052+0000 7fcf553669c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.2.5 2024-09-14T11:30:22.052 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.052+0000 7fcf553669c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.2.6 2024-09-14T11:30:22.052 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.052+0000 7fcf553669c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.2.6 2024-09-14T11:30:22.052 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.052+0000 7fcf553669c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.2.7 2024-09-14T11:30:22.052 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.052+0000 7fcf553669c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.2.7 2024-09-14T11:30:22.052 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.052+0000 7fcf553669c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.2.8 2024-09-14T11:30:22.052 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.052+0000 7fcf553669c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.2.8 2024-09-14T11:30:22.052 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.052+0000 7fcf553669c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.2.9 2024-09-14T11:30:22.052 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.052+0000 7fcf553669c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.2.9 2024-09-14T11:30:22.052 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.052+0000 7fcf553669c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.2.10 2024-09-14T11:30:22.052 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.052+0000 7fcf553669c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.2.10 2024-09-14T11:30:22.053 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.052+0000 7fcf553669c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.2.11 2024-09-14T11:30:22.053 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.052+0000 7fcf553669c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.2.11 2024-09-14T11:30:22.053 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.052+0000 7fcf553669c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.0 2024-09-14T11:30:22.053 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.052+0000 7fcf553669c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.1 2024-09-14T11:30:22.053 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.052+0000 7fcf553669c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.2 2024-09-14T11:30:22.054 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.056+0000 7fcf553669c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.3 2024-09-14T11:30:22.054 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.056+0000 7fcf553669c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.4 2024-09-14T11:30:22.055 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.056+0000 7fcf553669c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.5 2024-09-14T11:30:22.056 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.056+0000 7fcf553669c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.6 2024-09-14T11:30:22.058 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.060+0000 7fcf553669c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.7 2024-09-14T11:30:22.058 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.060+0000 7fcf553669c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.8 2024-09-14T11:30:22.059 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.060+0000 7fcf553669c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.9 2024-09-14T11:30:22.060 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.060+0000 7fcf553669c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.10 2024-09-14T11:30:22.067 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.068+0000 7fcf553669c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.26 : hit (requested=0x17, cached=0x17) 2024-09-14T11:30:22.068 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.068+0000 7fcf553669c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.26 2024-09-14T11:30:22.070 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.072+0000 7fcf553669c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.26 info.flags=0x17 2024-09-14T11:30:22.070 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.072+0000 7fcf553669c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.26 to cache LRU end 2024-09-14T11:30:22.070 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.072+0000 7fcf553669c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:22.070 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.072+0000 7fcf553669c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.26, ofs0, ns] 2024-09-14T11:30:22.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.072+0000 7fce35ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464288 cookie 93941267004320 notifier 6410 bl.length()=1023 2024-09-14T11:30:22.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.072+0000 7fce35ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.26 info.flags=0x17 2024-09-14T11:30:22.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.072+0000 7fce35ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.26 to cache LRU end 2024-09-14T11:30:22.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.072+0000 7fce35ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:22.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.072+0000 7fcf553669c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.26]): orig_sources= new_sources= 2024-09-14T11:30:22.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.072+0000 7fcf553669c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.26]): potential sources added=[] removed=[] 2024-09-14T11:30:22.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.072+0000 7fcf553669c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.26]): orig_dests= new_dests= 2024-09-14T11:30:22.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.072+0000 7fcf553669c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.26]): potential dests added=[] removed=[] 2024-09-14T11:30:22.075 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.076+0000 7fcf553669c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.0 2024-09-14T11:30:22.076 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.076+0000 7fcf553669c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.1 2024-09-14T11:30:22.077 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.080+0000 7fcf553669c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.2 2024-09-14T11:30:22.078 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.080+0000 7fcf553669c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.3 2024-09-14T11:30:22.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.080+0000 7fcf553669c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.4 2024-09-14T11:30:22.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.080+0000 7fcf553669c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.5 2024-09-14T11:30:22.080 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.080+0000 7fcf553669c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.6 2024-09-14T11:30:22.081 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.084+0000 7fcf553669c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.7 2024-09-14T11:30:22.081 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.084+0000 7fcf553669c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.8 2024-09-14T11:30:22.082 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.084+0000 7fcf553669c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.9 2024-09-14T11:30:22.082 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.084+0000 7fcf553669c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.26.10 2024-09-14T11:30:22.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.084+0000 7fcf553669c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.26 : hit (requested=0x17, cached=0x17) 2024-09-14T11:30:22.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.084+0000 7fcf553669c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.26 2024-09-14T11:30:22.085 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.088+0000 7fcf553669c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.26 info.flags=0x17 2024-09-14T11:30:22.085 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.088+0000 7fcf553669c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.26 to cache LRU end 2024-09-14T11:30:22.085 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.088+0000 7fcf553669c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:22.086 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.088+0000 7fcf553669c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.26, ofs0, ns] 2024-09-14T11:30:22.086 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.088+0000 7fce367fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464289 cookie 93941267004320 notifier 6410 bl.length()=991 2024-09-14T11:30:22.086 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.088+0000 7fce367fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.26 info.flags=0x17 2024-09-14T11:30:22.086 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.088+0000 7fce367fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.26 to cache LRU end 2024-09-14T11:30:22.086 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.088+0000 7fce367fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:22.087 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.088+0000 7fcf553669c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.26]): orig_sources= new_sources= 2024-09-14T11:30:22.087 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.088+0000 7fcf553669c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.26]): potential sources added=[] removed=[] 2024-09-14T11:30:22.087 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.088+0000 7fcf553669c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.26]): orig_dests= new_dests= 2024-09-14T11:30:22.087 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.088+0000 7fcf553669c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.26]): potential dests added=[] removed=[] 2024-09-14T11:30:22.091 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.092+0000 7fcf553669c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-14T11:30:22.094 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.096+0000 7fce097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:22.098 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.100+0000 7fcf553669c0 20 remove_watcher() i=0 2024-09-14T11:30:22.098 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.100+0000 7fcf553669c0 2 removed watcher, disabling cache 2024-09-14T11:30:22.100 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.100+0000 7fcf553669c0 20 remove_watcher() i=1 2024-09-14T11:30:22.103 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.104+0000 7fcf553669c0 20 remove_watcher() i=2 2024-09-14T11:30:22.105 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.108+0000 7fcf553669c0 20 remove_watcher() i=3 2024-09-14T11:30:22.107 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.108+0000 7fcf553669c0 20 remove_watcher() i=4 2024-09-14T11:30:22.109 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.112+0000 7fcf553669c0 20 remove_watcher() i=5 2024-09-14T11:30:22.112 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.112+0000 7fcf553669c0 20 remove_watcher() i=6 2024-09-14T11:30:22.114 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.116+0000 7fcf553669c0 20 remove_watcher() i=7 2024-09-14T11:30:22.129 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:30:22.155 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:22.156 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:22.198 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.200+0000 7fb007a329c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:22.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.200+0000 7fb007a329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:22.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.200+0000 7fb007a329c0 20 realm 2024-09-14T11:30:22.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.200+0000 7fb007a329c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:22.201 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.204+0000 7fb007a329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:22.201 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.204+0000 7fb007a329c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:22.201 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.204+0000 7fb007a329c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:22.201 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.204+0000 7fb007a329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:22.202 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.204+0000 7fb007a329c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:22.202 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.204+0000 7fb007a329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:22.202 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.204+0000 7fb007a329c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:22.203 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.204+0000 7fb007a329c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:22.203 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.204+0000 7fb007a329c0 20 searching for the correct realm 2024-09-14T11:30:22.206 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.208+0000 7fb005d39640 0 -- 172.21.15.71:0/982828512 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7faff0056060 msgr2=0x7faff0097ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:22.421 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.420+0000 7fb005d39640 0 -- 172.21.15.71:0/982828512 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x559b24437000 msgr2=0x559b244393f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:22.435 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.436+0000 7fb007a329c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:22.435 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.436+0000 7fb007a329c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:30:22.436 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.436+0000 7fb007a329c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:22.436 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.436+0000 7fb007a329c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:30:22.436 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.436+0000 7fb007a329c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:22.436 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.436+0000 7fb007a329c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:22.436 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.436+0000 7fb007a329c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:22.436 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.436+0000 7fb007a329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:22.436 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.436+0000 7fb007a329c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:22.437 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.440+0000 7fb007a329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:22.437 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.440+0000 7fb007a329c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:22.438 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.440+0000 7fb007a329c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:22.438 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.440+0000 7fb007a329c0 20 zone default found 2024-09-14T11:30:22.438 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.440+0000 7fb007a329c0 4 Realm: () 2024-09-14T11:30:22.438 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.440+0000 7fb007a329c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:30:22.438 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.440+0000 7fb007a329c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:30:22.438 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.440+0000 7fb007a329c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:22.438 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.440+0000 7fb007a329c0 20 zonegroup default 2024-09-14T11:30:22.439 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.440+0000 7fb007a329c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:22.439 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.440+0000 7fb007a329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:22.439 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.440+0000 7fb007a329c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:22.439 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.440+0000 7fb007a329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:22.439 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.440+0000 7fb007a329c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:22.440 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.440+0000 7fb007a329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:22.440 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.440+0000 7fb007a329c0 20 started sync module instance, tier type = 2024-09-14T11:30:22.440 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.440+0000 7fb007a329c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:30:22.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.464+0000 7fb007a329c0 20 add_watcher() i=0 2024-09-14T11:30:22.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.464+0000 7fb007a329c0 20 add_watcher() i=1 2024-09-14T11:30:22.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.464+0000 7fb007a329c0 20 add_watcher() i=2 2024-09-14T11:30:22.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.464+0000 7fb007a329c0 20 add_watcher() i=3 2024-09-14T11:30:22.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.464+0000 7fb007a329c0 20 add_watcher() i=4 2024-09-14T11:30:22.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.464+0000 7fb007a329c0 20 add_watcher() i=5 2024-09-14T11:30:22.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.464+0000 7fb007a329c0 20 add_watcher() i=6 2024-09-14T11:30:22.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.468+0000 7fb007a329c0 20 add_watcher() i=7 2024-09-14T11:30:22.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.468+0000 7fb007a329c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:22.470 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.472+0000 7faebbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:22.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.472+0000 7fb007a329c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:22.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.472+0000 7fb007a329c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:22.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.472+0000 7fb007a329c0 5 note: GC not initialized 2024-09-14T11:30:22.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.472+0000 7faebafe5640 20 reqs_thread_entry: start 2024-09-14T11:30:22.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.472+0000 7fb007a329c0 20 init_complete bucket index max shards: 11 2024-09-14T11:30:22.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.472+0000 7fb007a329c0 20 Filter name: none 2024-09-14T11:30:22.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.476+0000 7faeb8fe1640 20 reqs_thread_entry: start 2024-09-14T11:30:22.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.476+0000 7fb007a329c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:22.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.476+0000 7fb007a329c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:22.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.476+0000 7fb007a329c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:22.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.476+0000 7fb007a329c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:30:22.475 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.476+0000 7fb007a329c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:22.475 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.476+0000 7fb007a329c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:22.475 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.476+0000 7fb007a329c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:22.475 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.476+0000 7fb007a329c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:22.475 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.476+0000 7fb007a329c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:30:22.475 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.476+0000 7fb007a329c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:22.478 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.480+0000 7faebbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:22.483 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.484+0000 7fb007a329c0 20 remove_watcher() i=0 2024-09-14T11:30:22.483 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.484+0000 7fb007a329c0 2 removed watcher, disabling cache 2024-09-14T11:30:22.485 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.488+0000 7fb007a329c0 20 remove_watcher() i=1 2024-09-14T11:30:22.487 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.488+0000 7fb007a329c0 20 remove_watcher() i=2 2024-09-14T11:30:22.489 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.492+0000 7fb007a329c0 20 remove_watcher() i=3 2024-09-14T11:30:22.491 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.492+0000 7fb007a329c0 20 remove_watcher() i=4 2024-09-14T11:30:22.493 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.496+0000 7fb007a329c0 20 remove_watcher() i=5 2024-09-14T11:30:22.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.496+0000 7fb007a329c0 20 remove_watcher() i=6 2024-09-14T11:30:22.500 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:22.500+0000 7fb007a329c0 20 remove_watcher() i=7 2024-09-14T11:30:22.515 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:22.515 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:30:22.515 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: error-at-trim-reshard-log-entries id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.26 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:30:22.515 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:22.631 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-14T11:30:22.632 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:23.060 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:30:23.094 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:23.094 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:23.138 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.140+0000 7f65d71f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.141 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.144+0000 7f65d71f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:23.141 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.144+0000 7f65d71f69c0 20 realm 2024-09-14T11:30:23.141 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.144+0000 7f65d71f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.144+0000 7f65d71f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:23.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.144+0000 7f65d71f69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:23.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.144+0000 7f65d71f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.144+0000 7f65d71f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:23.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.144+0000 7f65d71f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.144+0000 7f65d71f69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:23.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.144+0000 7f65d71f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.144+0000 7f65d71f69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:23.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.144+0000 7f65d71f69c0 20 searching for the correct realm 2024-09-14T11:30:23.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.152+0000 7f65d4cfc640 0 -- 172.21.15.71:0/1079646144 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x56181f0e4600 msgr2=0x56181f0e6ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:23.155 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.156+0000 7f65d54fd640 0 -- 172.21.15.71:0/1079646144 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x56181f0df890 msgr2=0x56181f0e1c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:23.162 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.164+0000 7f65d71f69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:23.162 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.164+0000 7f65d71f69c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:30:23.162 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.164+0000 7f65d71f69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:23.162 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.164+0000 7f65d71f69c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:30:23.162 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.164+0000 7f65d71f69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:23.163 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.164+0000 7f65d71f69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:23.163 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.164+0000 7f65d71f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.163 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.164+0000 7f65d71f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:23.163 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.164+0000 7f65d71f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.163 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.164+0000 7f65d71f69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:23.163 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.164+0000 7f65d71f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.164 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.164+0000 7f65d71f69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:23.164 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.164+0000 7f65d71f69c0 20 zone default found 2024-09-14T11:30:23.164 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.164+0000 7f65d71f69c0 4 Realm: () 2024-09-14T11:30:23.164 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.164+0000 7f65d71f69c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:30:23.164 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.164+0000 7f65d71f69c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:30:23.164 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.164+0000 7f65d71f69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:23.165 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.164+0000 7f65d71f69c0 20 zonegroup default 2024-09-14T11:30:23.165 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.164+0000 7f65d71f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.165 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.164+0000 7f65d71f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:23.165 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.164+0000 7f65d71f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.165 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.168+0000 7f65d71f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:23.165 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.168+0000 7f65d71f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.165 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.168+0000 7f65d71f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:23.165 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.168+0000 7f65d71f69c0 20 started sync module instance, tier type = 2024-09-14T11:30:23.166 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.168+0000 7f65d71f69c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:30:23.183 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.184+0000 7f65d71f69c0 20 add_watcher() i=0 2024-09-14T11:30:23.183 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.184+0000 7f65d71f69c0 20 add_watcher() i=1 2024-09-14T11:30:23.183 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.184+0000 7f65d71f69c0 20 add_watcher() i=2 2024-09-14T11:30:23.183 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.184+0000 7f65d71f69c0 20 add_watcher() i=3 2024-09-14T11:30:23.183 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.184+0000 7f65d71f69c0 20 add_watcher() i=4 2024-09-14T11:30:23.183 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.184+0000 7f65d71f69c0 20 add_watcher() i=5 2024-09-14T11:30:23.183 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.184+0000 7f65d71f69c0 20 add_watcher() i=6 2024-09-14T11:30:23.185 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.188+0000 7f65d71f69c0 20 add_watcher() i=7 2024-09-14T11:30:23.185 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.188+0000 7f65d71f69c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:23.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.188+0000 7f648afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:23.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.192+0000 7f65d71f69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:23.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.192+0000 7f65d71f69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:23.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.192+0000 7f65d71f69c0 5 note: GC not initialized 2024-09-14T11:30:23.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.192+0000 7f6489fe3640 20 reqs_thread_entry: start 2024-09-14T11:30:23.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.192+0000 7f65d71f69c0 20 init_complete bucket index max shards: 11 2024-09-14T11:30:23.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.192+0000 7f65d71f69c0 20 Filter name: none 2024-09-14T11:30:23.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.192+0000 7f63fb7fe640 20 reqs_thread_entry: start 2024-09-14T11:30:23.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.192+0000 7f65d71f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.192+0000 7f65d71f69c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:23.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.192+0000 7f65d71f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.191 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.192+0000 7f65d71f69c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:30:23.191 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.192+0000 7f65d71f69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:23.191 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.192+0000 7f65d71f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.191 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.192+0000 7f65d71f69c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:23.192 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.192+0000 7f65d71f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.192 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.192+0000 7f65d71f69c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:30:23.192 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.192+0000 7f65d71f69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:23.194 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.196+0000 7f648afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:23.198 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.200+0000 7f65d71f69c0 20 remove_watcher() i=0 2024-09-14T11:30:23.198 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.200+0000 7f65d71f69c0 2 removed watcher, disabling cache 2024-09-14T11:30:23.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.200+0000 7f65d71f69c0 20 remove_watcher() i=1 2024-09-14T11:30:23.202 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.204+0000 7f65d71f69c0 20 remove_watcher() i=2 2024-09-14T11:30:23.204 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.204+0000 7f65d71f69c0 20 remove_watcher() i=3 2024-09-14T11:30:23.206 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.208+0000 7f65d71f69c0 20 remove_watcher() i=4 2024-09-14T11:30:23.208 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.208+0000 7f65d71f69c0 20 remove_watcher() i=5 2024-09-14T11:30:23.211 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.212+0000 7f65d71f69c0 20 remove_watcher() i=6 2024-09-14T11:30:23.213 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.216+0000 7f65d71f69c0 20 remove_watcher() i=7 2024-09-14T11:30:23.227 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:23.227 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:30:23.227 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: error-at-trim-reshard-log-entries id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:30:23.227 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:23.228 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-14T11:30:23.262 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:23.263 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:23.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.512+0000 7f9d634bf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.514 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.516+0000 7f9d634bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:23.514 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.516+0000 7f9d634bf9c0 20 realm 2024-09-14T11:30:23.514 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.516+0000 7f9d634bf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.515 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.516+0000 7f9d634bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:23.515 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.516+0000 7f9d634bf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:23.515 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.516+0000 7f9d634bf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.516 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.516+0000 7f9d634bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:23.516 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.516+0000 7f9d634bf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.517 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.520+0000 7f9d634bf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:23.517 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.520+0000 7f9d634bf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.518 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.520+0000 7f9d634bf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:23.518 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.520+0000 7f9d634bf9c0 20 searching for the correct realm 2024-09-14T11:30:23.520 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.520+0000 7f9d607c4640 0 -- 172.21.15.71:0/3821249163 >> [v2:172.21.15.71:6824/2436891866,v1:172.21.15.71:6825/2436891866] conn(0x7f9d5002b040 msgr2=0x7f9d5002c530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:23.732 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.732+0000 7f9d60fc5640 0 -- 172.21.15.71:0/3821249163 >> [v2:172.21.15.157:6816/1231501119,v1:172.21.15.157:6817/1231501119] conn(0x7f9c2c0813c0 msgr2=0x7f9c2c0837f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:23.748 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.748+0000 7f9d634bf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:23.748 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.748+0000 7f9d634bf9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:30:23.748 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.748+0000 7f9d634bf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:23.748 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.748+0000 7f9d634bf9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:30:23.748 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.748+0000 7f9d634bf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:23.748 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.748+0000 7f9d634bf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:23.748 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.748+0000 7f9d634bf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.749 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.752+0000 7f9d634bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:23.749 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.752+0000 7f9d634bf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.749 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.752+0000 7f9d634bf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:23.749 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.752+0000 7f9d634bf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.750 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.752+0000 7f9d634bf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:23.750 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.752+0000 7f9d634bf9c0 20 zone default found 2024-09-14T11:30:23.751 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.752+0000 7f9d634bf9c0 4 Realm: () 2024-09-14T11:30:23.751 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.752+0000 7f9d634bf9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:30:23.751 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.752+0000 7f9d634bf9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:30:23.751 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.752+0000 7f9d634bf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:23.751 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.752+0000 7f9d634bf9c0 20 zonegroup default 2024-09-14T11:30:23.751 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.752+0000 7f9d634bf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.751 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.752+0000 7f9d634bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:23.751 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.752+0000 7f9d634bf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.752 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.752+0000 7f9d634bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:23.752 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.752+0000 7f9d634bf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.753 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.756+0000 7f9d634bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:23.753 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.756+0000 7f9d634bf9c0 20 started sync module instance, tier type = 2024-09-14T11:30:23.753 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.756+0000 7f9d634bf9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:30:23.777 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.780+0000 7f9d634bf9c0 20 add_watcher() i=0 2024-09-14T11:30:23.777 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.780+0000 7f9d634bf9c0 20 add_watcher() i=1 2024-09-14T11:30:23.777 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.780+0000 7f9d634bf9c0 20 add_watcher() i=2 2024-09-14T11:30:23.777 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.780+0000 7f9d634bf9c0 20 add_watcher() i=3 2024-09-14T11:30:23.777 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.780+0000 7f9d634bf9c0 20 add_watcher() i=4 2024-09-14T11:30:23.777 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.780+0000 7f9d634bf9c0 20 add_watcher() i=5 2024-09-14T11:30:23.778 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.780+0000 7f9d634bf9c0 20 add_watcher() i=6 2024-09-14T11:30:23.780 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.780+0000 7f9d634bf9c0 20 add_watcher() i=7 2024-09-14T11:30:23.780 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.780+0000 7f9d634bf9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:23.784 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.784+0000 7f9c16fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:23.785 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.788+0000 7f9d634bf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:23.785 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.788+0000 7f9d634bf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:23.785 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.788+0000 7f9d634bf9c0 5 note: GC not initialized 2024-09-14T11:30:23.786 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.788+0000 7f9c15fe3640 20 reqs_thread_entry: start 2024-09-14T11:30:23.786 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.788+0000 7f9d634bf9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:30:23.786 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.788+0000 7f9d634bf9c0 20 Filter name: none 2024-09-14T11:30:23.787 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.788+0000 7f9b877fe640 20 reqs_thread_entry: start 2024-09-14T11:30:23.787 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.788+0000 7f9d634bf9c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:30:23.787 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.788+0000 7f9d634bf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.787 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.788+0000 7f9d634bf9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:23.787 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.788+0000 7f9d634bf9c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:30:23.788 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.788+0000 7f9d634bf9c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:30:23.788 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.788+0000 7f9d634bf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.27 : miss 2024-09-14T11:30:23.788 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.788+0000 7f9d634bf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.788 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.788+0000 7f9d634bf9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:30:23.788 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.788+0000 7f9d634bf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.27 info.flags=0x17 2024-09-14T11:30:23.789 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.788+0000 7f9d634bf9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.27 to cache LRU end 2024-09-14T11:30:23.789 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.788+0000 7f9d634bf9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:23.789 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.788+0000 7f9d634bf9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:23.789 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.788+0000 7f9d634bf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.27 2024-09-14T11:30:23.800 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.800+0000 7f9d634bf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.27 info.flags=0x17 2024-09-14T11:30:23.801 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.800+0000 7f9d634bf9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.27 to cache LRU end 2024-09-14T11:30:23.801 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.800+0000 7f9d634bf9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:23.801 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.800+0000 7f9d634bf9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.27, ofs0, ns] 2024-09-14T11:30:23.801 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.804+0000 7f9c37fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464292 cookie 94096448677312 notifier 6780 bl.length()=1023 2024-09-14T11:30:23.801 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.804+0000 7f9c37fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.27 info.flags=0x17 2024-09-14T11:30:23.801 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.804+0000 7f9c37fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.27 to cache LRU end 2024-09-14T11:30:23.801 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.804+0000 7f9c37fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:23.802 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.804+0000 7f9d634bf9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.27]): orig_sources= new_sources= 2024-09-14T11:30:23.802 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.804+0000 7f9d634bf9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.27]): potential sources added=[] removed=[] 2024-09-14T11:30:23.802 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.804+0000 7f9d634bf9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.27]): orig_dests= new_dests= 2024-09-14T11:30:23.802 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.804+0000 7f9d634bf9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.27]): potential dests added=[] removed=[] 2024-09-14T11:30:23.802 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.804+0000 7f9d634bf9c0 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-14T11:30:23.802 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.804+0000 7f9d634bf9c0 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-14T11:30:23.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.808+0000 7f9d634bf9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.27.1.0 2024-09-14T11:30:23.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.808+0000 7f9d634bf9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.27.1.0 2024-09-14T11:30:23.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.808+0000 7f9d634bf9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.27.1.1 2024-09-14T11:30:23.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.808+0000 7f9d634bf9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.27.1.1 2024-09-14T11:30:23.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.808+0000 7f9d634bf9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.27.1.2 2024-09-14T11:30:23.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.808+0000 7f9d634bf9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.27.1.2 2024-09-14T11:30:23.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.808+0000 7f9d634bf9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.27.1.3 2024-09-14T11:30:23.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.808+0000 7f9d634bf9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.27.1.3 2024-09-14T11:30:23.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.808+0000 7f9d634bf9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.27.1.4 2024-09-14T11:30:23.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.808+0000 7f9d634bf9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.27.1.4 2024-09-14T11:30:23.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.808+0000 7f9d634bf9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.27.1.5 2024-09-14T11:30:23.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.808+0000 7f9d634bf9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.27.1.5 2024-09-14T11:30:23.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.808+0000 7f9d634bf9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.27.1.6 2024-09-14T11:30:23.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.808+0000 7f9d634bf9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.27.1.6 2024-09-14T11:30:23.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.808+0000 7f9d634bf9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.27.1.7 2024-09-14T11:30:23.808 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.808+0000 7f9d634bf9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.27.1.7 2024-09-14T11:30:23.808 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.808+0000 7f9d634bf9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.27.1.8 2024-09-14T11:30:23.808 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.808+0000 7f9d634bf9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.27.1.8 2024-09-14T11:30:23.808 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.808+0000 7f9d634bf9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.27.1.9 2024-09-14T11:30:23.808 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.808+0000 7f9d634bf9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.27.1.9 2024-09-14T11:30:23.808 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.808+0000 7f9d634bf9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.27.1.10 2024-09-14T11:30:23.808 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.808+0000 7f9d634bf9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.27.1.10 2024-09-14T11:30:23.808 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.808+0000 7f9d634bf9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.27.1.11 2024-09-14T11:30:23.808 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.808+0000 7f9d634bf9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.27.1.11 2024-09-14T11:30:23.808 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.808+0000 7f9d634bf9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.27.0 2024-09-14T11:30:23.809 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.808+0000 7f9d634bf9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.27.1 2024-09-14T11:30:23.809 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.808+0000 7f9d634bf9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.27.2 2024-09-14T11:30:23.809 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.812+0000 7f9d634bf9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.27.3 2024-09-14T11:30:23.810 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.812+0000 7f9d634bf9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.27.4 2024-09-14T11:30:23.812 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.812+0000 7f9d634bf9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.27.5 2024-09-14T11:30:23.812 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.812+0000 7f9d634bf9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.27.6 2024-09-14T11:30:23.813 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.816+0000 7f9d634bf9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.27.7 2024-09-14T11:30:23.814 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.816+0000 7f9d634bf9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.27.8 2024-09-14T11:30:23.815 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.816+0000 7f9d634bf9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.27.9 2024-09-14T11:30:23.815 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.816+0000 7f9d634bf9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.27.10 2024-09-14T11:30:23.822 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.824+0000 7f9d634bf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.27 : hit (requested=0x17, cached=0x17) 2024-09-14T11:30:23.822 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.824+0000 7f9d634bf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.27 2024-09-14T11:30:23.825 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.828+0000 7f9d634bf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.27 info.flags=0x17 2024-09-14T11:30:23.825 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.828+0000 7f9d634bf9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.27 to cache LRU end 2024-09-14T11:30:23.825 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.828+0000 7f9d634bf9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:23.825 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.828+0000 7f9d634bf9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.27, ofs0, ns] 2024-09-14T11:30:23.826 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.828+0000 7f9c37fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464293 cookie 94096448677312 notifier 6780 bl.length()=991 2024-09-14T11:30:23.826 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.828+0000 7f9c37fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.27 info.flags=0x17 2024-09-14T11:30:23.826 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.828+0000 7f9c37fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.27 to cache LRU end 2024-09-14T11:30:23.826 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.828+0000 7f9c37fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:23.826 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.828+0000 7f9d634bf9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.27]): orig_sources= new_sources= 2024-09-14T11:30:23.826 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.828+0000 7f9d634bf9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.27]): potential sources added=[] removed=[] 2024-09-14T11:30:23.826 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.828+0000 7f9d634bf9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.27]): orig_dests= new_dests= 2024-09-14T11:30:23.826 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.828+0000 7f9d634bf9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.27]): potential dests added=[] removed=[] 2024-09-14T11:30:23.831 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.832+0000 7f9d634bf9c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-14T11:30:23.835 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.836+0000 7f9c16fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:23.839 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.840+0000 7f9d634bf9c0 20 remove_watcher() i=0 2024-09-14T11:30:23.839 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.840+0000 7f9d634bf9c0 2 removed watcher, disabling cache 2024-09-14T11:30:23.841 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.844+0000 7f9d634bf9c0 20 remove_watcher() i=1 2024-09-14T11:30:23.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.844+0000 7f9d634bf9c0 20 remove_watcher() i=2 2024-09-14T11:30:23.845 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.848+0000 7f9d634bf9c0 20 remove_watcher() i=3 2024-09-14T11:30:23.847 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.848+0000 7f9d634bf9c0 20 remove_watcher() i=4 2024-09-14T11:30:23.849 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.852+0000 7f9d634bf9c0 20 remove_watcher() i=5 2024-09-14T11:30:23.852 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.852+0000 7f9d634bf9c0 20 remove_watcher() i=6 2024-09-14T11:30:23.855 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.856+0000 7f9d634bf9c0 20 remove_watcher() i=7 2024-09-14T11:30:23.872 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:30:23.898 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:23.899 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:23.941 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.944+0000 7fed8e4b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.944 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.944+0000 7fed8e4b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:23.944 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.944+0000 7fed8e4b49c0 20 realm 2024-09-14T11:30:23.944 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.944+0000 7fed8e4b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.944 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.944+0000 7fed8e4b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:23.944 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.944+0000 7fed8e4b49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:23.945 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.944+0000 7fed8e4b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.945 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.948+0000 7fed8e4b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:23.945 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.948+0000 7fed8e4b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.945 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.948+0000 7fed8e4b49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:23.945 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.948+0000 7fed8e4b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.946 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.948+0000 7fed8e4b49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:23.946 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.948+0000 7fed8e4b49c0 20 searching for the correct realm 2024-09-14T11:30:23.950 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.952+0000 7fed8c7bb640 0 -- 172.21.15.71:0/739686752 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fed80138c20 msgr2=0x7fed800fd460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:23.957 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.960+0000 7fed8c7bb640 0 -- 172.21.15.71:0/739686752 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x56442bcf9af0 msgr2=0x56442bcfbee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:23.966 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.968+0000 7fed8e4b49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:23.966 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.968+0000 7fed8e4b49c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:30:23.966 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.968+0000 7fed8e4b49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:23.966 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.968+0000 7fed8e4b49c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:30:23.966 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.968+0000 7fed8e4b49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:23.966 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.968+0000 7fed8e4b49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:23.966 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.968+0000 7fed8e4b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.967 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.968+0000 7fed8e4b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:23.967 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.968+0000 7fed8e4b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.967 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.968+0000 7fed8e4b49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:23.967 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.968+0000 7fed8e4b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.968 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.968+0000 7fed8e4b49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:23.968 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.968+0000 7fed8e4b49c0 20 zone default found 2024-09-14T11:30:23.968 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.968+0000 7fed8e4b49c0 4 Realm: () 2024-09-14T11:30:23.968 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.968+0000 7fed8e4b49c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:30:23.968 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.968+0000 7fed8e4b49c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:30:23.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.968+0000 7fed8e4b49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:23.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.968+0000 7fed8e4b49c0 20 zonegroup default 2024-09-14T11:30:23.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.968+0000 7fed8e4b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.968+0000 7fed8e4b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:23.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.968+0000 7fed8e4b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.968+0000 7fed8e4b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:23.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.968+0000 7fed8e4b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.972+0000 7fed8e4b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:23.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.972+0000 7fed8e4b49c0 20 started sync module instance, tier type = 2024-09-14T11:30:23.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.972+0000 7fed8e4b49c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:30:23.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.988+0000 7fed8e4b49c0 20 add_watcher() i=0 2024-09-14T11:30:23.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.988+0000 7fed8e4b49c0 20 add_watcher() i=1 2024-09-14T11:30:23.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.988+0000 7fed8e4b49c0 20 add_watcher() i=2 2024-09-14T11:30:23.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.988+0000 7fed8e4b49c0 20 add_watcher() i=3 2024-09-14T11:30:23.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.988+0000 7fed8e4b49c0 20 add_watcher() i=4 2024-09-14T11:30:23.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.988+0000 7fed8e4b49c0 20 add_watcher() i=5 2024-09-14T11:30:23.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.988+0000 7fed8e4b49c0 20 add_watcher() i=6 2024-09-14T11:30:23.989 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.992+0000 7fed8e4b49c0 20 add_watcher() i=7 2024-09-14T11:30:23.989 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.992+0000 7fed8e4b49c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:23.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.992+0000 7fec41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:23.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.996+0000 7fed8e4b49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:23.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.996+0000 7fed8e4b49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:23.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.996+0000 7fed8e4b49c0 5 note: GC not initialized 2024-09-14T11:30:23.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.996+0000 7fec40fe1640 20 reqs_thread_entry: start 2024-09-14T11:30:23.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.996+0000 7fed8e4b49c0 20 init_complete bucket index max shards: 11 2024-09-14T11:30:23.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.996+0000 7fed8e4b49c0 20 Filter name: none 2024-09-14T11:30:23.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.996+0000 7febba7fc640 20 reqs_thread_entry: start 2024-09-14T11:30:23.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.996+0000 7fed8e4b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.995 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.996+0000 7fed8e4b49c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:23.995 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.996+0000 7fed8e4b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.995 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.996+0000 7fed8e4b49c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:30:23.995 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.996+0000 7fed8e4b49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:23.995 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.996+0000 7fed8e4b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.995 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.996+0000 7fed8e4b49c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:23.995 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.996+0000 7fed8e4b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:23.995 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.996+0000 7fed8e4b49c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:30:23.996 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:23.996+0000 7fed8e4b49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:23.998 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.000+0000 7fec41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:24.002 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.004+0000 7fed8e4b49c0 20 remove_watcher() i=0 2024-09-14T11:30:24.002 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.004+0000 7fed8e4b49c0 2 removed watcher, disabling cache 2024-09-14T11:30:24.004 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.004+0000 7fed8e4b49c0 20 remove_watcher() i=1 2024-09-14T11:30:24.006 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.008+0000 7fed8e4b49c0 20 remove_watcher() i=2 2024-09-14T11:30:24.008 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.008+0000 7fed8e4b49c0 20 remove_watcher() i=3 2024-09-14T11:30:24.010 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.012+0000 7fed8e4b49c0 20 remove_watcher() i=4 2024-09-14T11:30:24.012 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.012+0000 7fed8e4b49c0 20 remove_watcher() i=5 2024-09-14T11:30:24.015 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.016+0000 7fed8e4b49c0 20 remove_watcher() i=6 2024-09-14T11:30:24.018 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.020+0000 7fed8e4b49c0 20 remove_watcher() i=7 2024-09-14T11:30:24.031 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:24.032 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:30:24.032 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: error-at-trim-reshard-log-entries id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.27 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:30:24.032 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:24.136 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-14T11:30:24.136 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:24.497 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:30:24.530 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:24.530 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:24.575 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.576+0000 7fd8aa6289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:24.578 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.580+0000 7fd8aa6289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:24.578 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.580+0000 7fd8aa6289c0 20 realm 2024-09-14T11:30:24.578 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.580+0000 7fd8aa6289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:24.578 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.580+0000 7fd8aa6289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:24.578 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.580+0000 7fd8aa6289c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:24.578 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.580+0000 7fd8aa6289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:24.579 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.580+0000 7fd8aa6289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:24.579 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.580+0000 7fd8aa6289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:24.579 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.580+0000 7fd8aa6289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:24.580 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.580+0000 7fd8aa6289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:24.580 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.580+0000 7fd8aa6289c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:24.581 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.580+0000 7fd8aa6289c0 20 searching for the correct realm 2024-09-14T11:30:24.584 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.584+0000 7fd8a892f640 0 -- 172.21.15.71:0/711352313 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fd890136040 msgr2=0x7fd890109450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:24.800 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.800+0000 7fd8a892f640 0 -- 172.21.15.71:0/711352313 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x564ee5efd060 msgr2=0x564ee5eff450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:24.815 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.816+0000 7fd8aa6289c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:24.815 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.816+0000 7fd8aa6289c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:30:24.815 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.816+0000 7fd8aa6289c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:24.815 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.816+0000 7fd8aa6289c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:30:24.815 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.816+0000 7fd8aa6289c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:24.815 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.816+0000 7fd8aa6289c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:24.815 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.816+0000 7fd8aa6289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:24.816 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.816+0000 7fd8aa6289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:24.816 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.816+0000 7fd8aa6289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:24.816 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.816+0000 7fd8aa6289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:24.817 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.816+0000 7fd8aa6289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:24.818 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.820+0000 7fd8aa6289c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:24.818 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.820+0000 7fd8aa6289c0 20 zone default found 2024-09-14T11:30:24.818 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.820+0000 7fd8aa6289c0 4 Realm: () 2024-09-14T11:30:24.818 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.820+0000 7fd8aa6289c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:30:24.818 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.820+0000 7fd8aa6289c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:30:24.818 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.820+0000 7fd8aa6289c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:24.818 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.820+0000 7fd8aa6289c0 20 zonegroup default 2024-09-14T11:30:24.818 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.820+0000 7fd8aa6289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:24.818 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.820+0000 7fd8aa6289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:24.818 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.820+0000 7fd8aa6289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:24.819 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.820+0000 7fd8aa6289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:24.819 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.820+0000 7fd8aa6289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:24.820 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.820+0000 7fd8aa6289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:24.820 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.820+0000 7fd8aa6289c0 20 started sync module instance, tier type = 2024-09-14T11:30:24.820 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.820+0000 7fd8aa6289c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:30:24.842 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.844+0000 7fd8aa6289c0 20 add_watcher() i=0 2024-09-14T11:30:24.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.844+0000 7fd8aa6289c0 20 add_watcher() i=1 2024-09-14T11:30:24.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.844+0000 7fd8aa6289c0 20 add_watcher() i=2 2024-09-14T11:30:24.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.844+0000 7fd8aa6289c0 20 add_watcher() i=3 2024-09-14T11:30:24.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.844+0000 7fd8aa6289c0 20 add_watcher() i=4 2024-09-14T11:30:24.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.844+0000 7fd8aa6289c0 20 add_watcher() i=5 2024-09-14T11:30:24.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.844+0000 7fd8aa6289c0 20 add_watcher() i=6 2024-09-14T11:30:24.845 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.848+0000 7fd8aa6289c0 20 add_watcher() i=7 2024-09-14T11:30:24.845 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.848+0000 7fd8aa6289c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:24.849 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.852+0000 7fd75efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:24.850 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.852+0000 7fd8aa6289c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:24.850 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.852+0000 7fd8aa6289c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:24.850 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.852+0000 7fd8aa6289c0 5 note: GC not initialized 2024-09-14T11:30:24.851 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.852+0000 7fd75dfdb640 20 reqs_thread_entry: start 2024-09-14T11:30:24.851 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.852+0000 7fd8aa6289c0 20 init_complete bucket index max shards: 11 2024-09-14T11:30:24.851 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.852+0000 7fd8aa6289c0 20 Filter name: none 2024-09-14T11:30:24.851 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.852+0000 7fd6cf7fe640 20 reqs_thread_entry: start 2024-09-14T11:30:24.851 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.852+0000 7fd8aa6289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:24.852 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.852+0000 7fd8aa6289c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:24.852 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.852+0000 7fd8aa6289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:24.853 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.856+0000 7fd8aa6289c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:30:24.853 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.856+0000 7fd8aa6289c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:24.853 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.856+0000 7fd8aa6289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:24.854 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.856+0000 7fd8aa6289c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:24.854 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.856+0000 7fd8aa6289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:24.854 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.856+0000 7fd8aa6289c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:30:24.854 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.856+0000 7fd8aa6289c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:24.857 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.860+0000 7fd75efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:24.864 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.864+0000 7fd8aa6289c0 20 remove_watcher() i=0 2024-09-14T11:30:24.864 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.864+0000 7fd8aa6289c0 2 removed watcher, disabling cache 2024-09-14T11:30:24.866 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.868+0000 7fd8aa6289c0 20 remove_watcher() i=1 2024-09-14T11:30:24.868 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.868+0000 7fd8aa6289c0 20 remove_watcher() i=2 2024-09-14T11:30:24.870 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.872+0000 7fd8aa6289c0 20 remove_watcher() i=3 2024-09-14T11:30:24.872 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.872+0000 7fd8aa6289c0 20 remove_watcher() i=4 2024-09-14T11:30:24.875 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.876+0000 7fd8aa6289c0 20 remove_watcher() i=5 2024-09-14T11:30:24.878 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.880+0000 7fd8aa6289c0 20 remove_watcher() i=6 2024-09-14T11:30:24.881 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.884+0000 7fd8aa6289c0 20 remove_watcher() i=7 2024-09-14T11:30:24.898 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:24.898 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:30:24.898 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: abort-at-trim-reshard-log-entries id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:30:24.898 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:24.898 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-14T11:30:24.931 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:24.931 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:24.977 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.980+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:24.979 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.980+0000 7f2e55e289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:24.979 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.980+0000 7f2e55e289c0 20 realm 2024-09-14T11:30:24.979 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.980+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:24.980 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.980+0000 7f2e55e289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:24.980 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.980+0000 7f2e55e289c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:24.980 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.980+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:24.980 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.980+0000 7f2e55e289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:24.980 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.980+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:24.981 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.984+0000 7f2e55e289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:24.981 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.984+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:24.984 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.984+0000 7f2e55e289c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:24.984 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.984+0000 7f2e55e289c0 20 searching for the correct realm 2024-09-14T11:30:24.985 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:24.988+0000 7f2e5412f640 0 -- 172.21.15.71:0/869225631 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f2e48008050 msgr2=0x7f2e480507e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:25.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.200+0000 7f2e5412f640 0 -- 172.21.15.71:0/869225631 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55cfc260c9f0 msgr2=0x55cfc260ee00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:25.216 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.216+0000 7f2e55e289c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:25.216 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.216+0000 7f2e55e289c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:30:25.216 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.216+0000 7f2e55e289c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:25.216 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.216+0000 7f2e55e289c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:30:25.216 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.216+0000 7f2e55e289c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:25.216 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.216+0000 7f2e55e289c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:25.216 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.216+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.216+0000 7f2e55e289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:25.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.216+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:25.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.218 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:25.218 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 zone default found 2024-09-14T11:30:25.218 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.220+0000 7f2e55e289c0 4 Realm: () 2024-09-14T11:30:25.218 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.220+0000 7f2e55e289c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:30:25.218 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.220+0000 7f2e55e289c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:30:25.218 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.220+0000 7f2e55e289c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:25.218 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 zonegroup default 2024-09-14T11:30:25.218 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.219 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:25.219 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.219 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:25.219 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:25.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 started sync module instance, tier type = 2024-09-14T11:30:25.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:30:25.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.248+0000 7f2e55e289c0 20 add_watcher() i=0 2024-09-14T11:30:25.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.248+0000 7f2e55e289c0 20 add_watcher() i=1 2024-09-14T11:30:25.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.248+0000 7f2e55e289c0 20 add_watcher() i=2 2024-09-14T11:30:25.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.248+0000 7f2e55e289c0 20 add_watcher() i=3 2024-09-14T11:30:25.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.248+0000 7f2e55e289c0 20 add_watcher() i=4 2024-09-14T11:30:25.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.248+0000 7f2e55e289c0 20 add_watcher() i=5 2024-09-14T11:30:25.246 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.248+0000 7f2e55e289c0 20 add_watcher() i=6 2024-09-14T11:30:25.251 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.252+0000 7f2e55e289c0 20 add_watcher() i=7 2024-09-14T11:30:25.251 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.252+0000 7f2e55e289c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:25.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.256+0000 7f2d09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:25.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.256+0000 7f2e55e289c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:25.256 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.256+0000 7f2e55e289c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:25.256 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 note: GC not initialized 2024-09-14T11:30:25.256 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.256+0000 7f2d08fe1640 20 reqs_thread_entry: start 2024-09-14T11:30:25.257 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.256+0000 7f2e55e289c0 20 init_complete bucket index max shards: 11 2024-09-14T11:30:25.257 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.256+0000 7f2e55e289c0 20 Filter name: none 2024-09-14T11:30:25.257 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.256+0000 7f2c827fc640 20 reqs_thread_entry: start 2024-09-14T11:30:25.257 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.256+0000 7f2e55e289c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:30:25.257 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.256+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.260+0000 7f2e55e289c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:25.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.260+0000 7f2e55e289c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:30:25.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.260+0000 7f2e55e289c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:30:25.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.260+0000 7f2e55e289c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 : miss 2024-09-14T11:30:25.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.260+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.260+0000 7f2e55e289c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:30:25.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.260+0000 7f2e55e289c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 info.flags=0x17 2024-09-14T11:30:25.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.260+0000 7f2e55e289c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 to cache LRU end 2024-09-14T11:30:25.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.260+0000 7f2e55e289c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:25.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.260+0000 7f2e55e289c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:25.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.260+0000 7f2e55e289c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 2024-09-14T11:30:25.267 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.268+0000 7f2e55e289c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 info.flags=0x17 2024-09-14T11:30:25.268 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.268+0000 7f2e55e289c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 to cache LRU end 2024-09-14T11:30:25.268 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.268+0000 7f2e55e289c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:25.268 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.268+0000 7f2e55e289c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28, ofs0, ns] 2024-09-14T11:30:25.268 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.268+0000 7f2d327fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464366 cookie 94350807721360 notifier 6834 bl.length()=1023 2024-09-14T11:30:25.268 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.268+0000 7f2d327fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 info.flags=0x17 2024-09-14T11:30:25.268 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.268+0000 7f2d327fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 to cache LRU end 2024-09-14T11:30:25.268 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.268+0000 7f2d327fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:25.268 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.268+0000 7f2e55e289c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.28]): orig_sources= new_sources= 2024-09-14T11:30:25.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.268+0000 7f2e55e289c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.28]): potential sources added=[] removed=[] 2024-09-14T11:30:25.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.268+0000 7f2e55e289c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.28]): orig_dests= new_dests= 2024-09-14T11:30:25.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.268+0000 7f2e55e289c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.28]): potential dests added=[] removed=[] 2024-09-14T11:30:25.269 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2e55e289c0 time 2024-09-14T11:30:25.273928+0000 2024-09-14T11:30:25.269 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:30:25.269 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:25.269 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2e597022eb] 2024-09-14T11:30:25.270 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2e5970249f] 2024-09-14T11:30:25.270 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cfc0096c01] 2024-09-14T11:30:25.270 INFO:tasks.workunit.client.0.smithi071.stderr: 4: radosgw-admin(+0x14231ee) [0x55cfc0af51ee] 2024-09-14T11:30:25.270 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55cfc00abecd] 2024-09-14T11:30:25.270 INFO:tasks.workunit.client.0.smithi071.stderr: 6: main() 2024-09-14T11:30:25.270 INFO:tasks.workunit.client.0.smithi071.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2e58568d90] 2024-09-14T11:30:25.270 INFO:tasks.workunit.client.0.smithi071.stderr: 8: __libc_start_main() 2024-09-14T11:30:25.270 INFO:tasks.workunit.client.0.smithi071.stderr: 9: _start() 2024-09-14T11:30:25.270 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.272+0000 7f2e55e289c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2e55e289c0 time 2024-09-14T11:30:25.273928+0000 2024-09-14T11:30:25.270 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:30:25.270 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.270 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:25.271 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2e597022eb] 2024-09-14T11:30:25.271 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2e5970249f] 2024-09-14T11:30:25.271 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cfc0096c01] 2024-09-14T11:30:25.271 INFO:tasks.workunit.client.0.smithi071.stderr: 4: radosgw-admin(+0x14231ee) [0x55cfc0af51ee] 2024-09-14T11:30:25.271 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55cfc00abecd] 2024-09-14T11:30:25.271 INFO:tasks.workunit.client.0.smithi071.stderr: 6: main() 2024-09-14T11:30:25.271 INFO:tasks.workunit.client.0.smithi071.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2e58568d90] 2024-09-14T11:30:25.271 INFO:tasks.workunit.client.0.smithi071.stderr: 8: __libc_start_main() 2024-09-14T11:30:25.271 INFO:tasks.workunit.client.0.smithi071.stderr: 9: _start() 2024-09-14T11:30:25.271 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.271 INFO:tasks.workunit.client.0.smithi071.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:30:25.271 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f2e55e289c0 thread_name:radosgw-admin 2024-09-14T11:30:25.289 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:25.289 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2e58581520] 2024-09-14T11:30:25.289 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:30:25.289 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:30:25.289 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:30:25.289 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2e59702345] 2024-09-14T11:30:25.289 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2e5970249f] 2024-09-14T11:30:25.289 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cfc0096c01] 2024-09-14T11:30:25.289 INFO:tasks.workunit.client.0.smithi071.stderr: 8: radosgw-admin(+0x14231ee) [0x55cfc0af51ee] 2024-09-14T11:30:25.289 INFO:tasks.workunit.client.0.smithi071.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55cfc00abecd] 2024-09-14T11:30:25.290 INFO:tasks.workunit.client.0.smithi071.stderr: 10: main() 2024-09-14T11:30:25.290 INFO:tasks.workunit.client.0.smithi071.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2e58568d90] 2024-09-14T11:30:25.290 INFO:tasks.workunit.client.0.smithi071.stderr: 12: __libc_start_main() 2024-09-14T11:30:25.290 INFO:tasks.workunit.client.0.smithi071.stderr: 13: _start() 2024-09-14T11:30:25.290 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.272+0000 7f2e55e289c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:30:25.290 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f2e55e289c0 thread_name:radosgw-admin 2024-09-14T11:30:25.290 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.290 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:25.290 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2e58581520] 2024-09-14T11:30:25.290 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:30:25.290 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:30:25.290 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:30:25.290 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2e59702345] 2024-09-14T11:30:25.291 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2e5970249f] 2024-09-14T11:30:25.291 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cfc0096c01] 2024-09-14T11:30:25.291 INFO:tasks.workunit.client.0.smithi071.stderr: 8: radosgw-admin(+0x14231ee) [0x55cfc0af51ee] 2024-09-14T11:30:25.291 INFO:tasks.workunit.client.0.smithi071.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55cfc00abecd] 2024-09-14T11:30:25.291 INFO:tasks.workunit.client.0.smithi071.stderr: 10: main() 2024-09-14T11:30:25.291 INFO:tasks.workunit.client.0.smithi071.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2e58568d90] 2024-09-14T11:30:25.291 INFO:tasks.workunit.client.0.smithi071.stderr: 12: __libc_start_main() 2024-09-14T11:30:25.291 INFO:tasks.workunit.client.0.smithi071.stderr: 13: _start() 2024-09-14T11:30:25.291 INFO:tasks.workunit.client.0.smithi071.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:30:25.291 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.291 INFO:tasks.workunit.client.0.smithi071.stderr:--- begin dump of recent events --- 2024-09-14T11:30:25.291 INFO:tasks.workunit.client.0.smithi071.stderr: -499> 2024-09-14T11:30:24.956+0000 7f2e5312d640 1 monclient: found mon.noname-c 2024-09-14T11:30:25.291 INFO:tasks.workunit.client.0.smithi071.stderr: -498> 2024-09-14T11:30:24.956+0000 7f2e5312d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:30:25.292 INFO:tasks.workunit.client.0.smithi071.stderr: -497> 2024-09-14T11:30:24.956+0000 7f2d41e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:25.292 INFO:tasks.workunit.client.0.smithi071.stderr: -496> 2024-09-14T11:30:24.956+0000 7f2d41e0b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:30:25.292 INFO:tasks.workunit.client.0.smithi071.stderr: -495> 2024-09-14T11:30:24.956+0000 7f2d41e0b640 10 monclient: dump: 2024-09-14T11:30:25.292 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:30:25.292 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:30:25.292 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.292 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.292 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:25.292 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:30:25.292 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:30:25.292 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:30:25.292 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:30:25.292 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.292 INFO:tasks.workunit.client.0.smithi071.stderr: -494> 2024-09-14T11:30:24.956+0000 7f2d41e0b640 10 monclient: _finish_auth 0 2024-09-14T11:30:25.293 INFO:tasks.workunit.client.0.smithi071.stderr: -493> 2024-09-14T11:30:24.956+0000 7f2d41e0b640 10 monclient: _check_auth_tickets 2024-09-14T11:30:25.293 INFO:tasks.workunit.client.0.smithi071.stderr: -492> 2024-09-14T11:30:24.956+0000 7f2d41e0b640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:25.293 INFO:tasks.workunit.client.0.smithi071.stderr: -491> 2024-09-14T11:30:24.956+0000 7f2d41e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:25.293 INFO:tasks.workunit.client.0.smithi071.stderr: -490> 2024-09-14T11:30:24.956+0000 7f2d41e0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:30:25.293 INFO:tasks.workunit.client.0.smithi071.stderr: -489> 2024-09-14T11:30:24.956+0000 7f2d41e0b640 10 monclient: dump: 2024-09-14T11:30:25.293 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:30:25.293 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:30:25.293 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.293 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.293 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:25.293 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:30:25.293 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:30:25.293 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:30:25.293 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:30:25.294 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.294 INFO:tasks.workunit.client.0.smithi071.stderr: -488> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 monclient: authenticate success, global_id 6500 2024-09-14T11:30:25.294 INFO:tasks.workunit.client.0.smithi071.stderr: -487> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 10 monclient: get_monmap_and_config success 2024-09-14T11:30:25.294 INFO:tasks.workunit.client.0.smithi071.stderr: -486> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 4 set_mon_vals no callback set 2024-09-14T11:30:25.294 INFO:tasks.workunit.client.0.smithi071.stderr: -485> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 10 monclient: shutdown 2024-09-14T11:30:25.294 INFO:tasks.workunit.client.0.smithi071.stderr: -484> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 asok(0x55cfc230dd90) unregister_commands rotate-key 2024-09-14T11:30:25.294 INFO:tasks.workunit.client.0.smithi071.stderr: -483> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 10 monclient: build_initial_monmap 2024-09-14T11:30:25.294 INFO:tasks.workunit.client.0.smithi071.stderr: -482> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 1 build_initial for_mkfs: 0 2024-09-14T11:30:25.294 INFO:tasks.workunit.client.0.smithi071.stderr: -481> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 10 monclient: monmap: 2024-09-14T11:30:25.294 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:30:25.294 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:25.294 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:30:25.294 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:30:25.294 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:25.294 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:30:25.295 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:30:25.295 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:30:25.295 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:30:25.295 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.295 INFO:tasks.workunit.client.0.smithi071.stderr: -480> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc251c5e0) adding auth protocol: cephx 2024-09-14T11:30:25.295 INFO:tasks.workunit.client.0.smithi071.stderr: -479> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc251c5e0) adding auth protocol: cephx 2024-09-14T11:30:25.295 INFO:tasks.workunit.client.0.smithi071.stderr: -478> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc251c5e0) adding auth protocol: cephx 2024-09-14T11:30:25.295 INFO:tasks.workunit.client.0.smithi071.stderr: -477> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc251c5e0) adding con mode: secure 2024-09-14T11:30:25.295 INFO:tasks.workunit.client.0.smithi071.stderr: -476> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc251c5e0) adding con mode: crc 2024-09-14T11:30:25.295 INFO:tasks.workunit.client.0.smithi071.stderr: -475> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc251c5e0) adding con mode: secure 2024-09-14T11:30:25.295 INFO:tasks.workunit.client.0.smithi071.stderr: -474> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc251c5e0) adding con mode: crc 2024-09-14T11:30:25.295 INFO:tasks.workunit.client.0.smithi071.stderr: -473> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc251c5e0) adding con mode: secure 2024-09-14T11:30:25.295 INFO:tasks.workunit.client.0.smithi071.stderr: -472> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc251c5e0) adding con mode: crc 2024-09-14T11:30:25.295 INFO:tasks.workunit.client.0.smithi071.stderr: -471> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc251c5e0) adding con mode: crc 2024-09-14T11:30:25.295 INFO:tasks.workunit.client.0.smithi071.stderr: -470> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc251c5e0) adding con mode: secure 2024-09-14T11:30:25.296 INFO:tasks.workunit.client.0.smithi071.stderr: -469> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc251c5e0) adding con mode: crc 2024-09-14T11:30:25.296 INFO:tasks.workunit.client.0.smithi071.stderr: -468> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc251c5e0) adding con mode: secure 2024-09-14T11:30:25.296 INFO:tasks.workunit.client.0.smithi071.stderr: -467> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc251c5e0) adding con mode: crc 2024-09-14T11:30:25.296 INFO:tasks.workunit.client.0.smithi071.stderr: -466> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc251c5e0) adding con mode: secure 2024-09-14T11:30:25.296 INFO:tasks.workunit.client.0.smithi071.stderr: -465> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:25.296 INFO:tasks.workunit.client.0.smithi071.stderr: -464> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 1 librados: starting msgr at 2024-09-14T11:30:25.296 INFO:tasks.workunit.client.0.smithi071.stderr: -463> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 1 librados: starting objecter 2024-09-14T11:30:25.296 INFO:tasks.workunit.client.0.smithi071.stderr: -462> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 asok(0x55cfc230dd90) register_command objecter_requests hook 0x55cfc2520e20 2024-09-14T11:30:25.296 INFO:tasks.workunit.client.0.smithi071.stderr: -461> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 1 librados: setting wanted keys 2024-09-14T11:30:25.296 INFO:tasks.workunit.client.0.smithi071.stderr: -460> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 1 librados: calling monclient init 2024-09-14T11:30:25.296 INFO:tasks.workunit.client.0.smithi071.stderr: -459> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 10 monclient: init 2024-09-14T11:30:25.296 INFO:tasks.workunit.client.0.smithi071.stderr: -458> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25194d0) adding auth protocol: cephx 2024-09-14T11:30:25.296 INFO:tasks.workunit.client.0.smithi071.stderr: -457> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25194d0) adding auth protocol: cephx 2024-09-14T11:30:25.297 INFO:tasks.workunit.client.0.smithi071.stderr: -456> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25194d0) adding auth protocol: cephx 2024-09-14T11:30:25.297 INFO:tasks.workunit.client.0.smithi071.stderr: -455> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25194d0) adding con mode: secure 2024-09-14T11:30:25.297 INFO:tasks.workunit.client.0.smithi071.stderr: -454> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25194d0) adding con mode: crc 2024-09-14T11:30:25.297 INFO:tasks.workunit.client.0.smithi071.stderr: -453> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25194d0) adding con mode: secure 2024-09-14T11:30:25.297 INFO:tasks.workunit.client.0.smithi071.stderr: -452> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25194d0) adding con mode: crc 2024-09-14T11:30:25.297 INFO:tasks.workunit.client.0.smithi071.stderr: -451> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25194d0) adding con mode: secure 2024-09-14T11:30:25.297 INFO:tasks.workunit.client.0.smithi071.stderr: -450> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25194d0) adding con mode: crc 2024-09-14T11:30:25.297 INFO:tasks.workunit.client.0.smithi071.stderr: -449> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25194d0) adding con mode: crc 2024-09-14T11:30:25.297 INFO:tasks.workunit.client.0.smithi071.stderr: -448> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25194d0) adding con mode: secure 2024-09-14T11:30:25.297 INFO:tasks.workunit.client.0.smithi071.stderr: -447> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25194d0) adding con mode: crc 2024-09-14T11:30:25.297 INFO:tasks.workunit.client.0.smithi071.stderr: -446> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25194d0) adding con mode: secure 2024-09-14T11:30:25.297 INFO:tasks.workunit.client.0.smithi071.stderr: -445> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25194d0) adding con mode: crc 2024-09-14T11:30:25.297 INFO:tasks.workunit.client.0.smithi071.stderr: -444> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25194d0) adding con mode: secure 2024-09-14T11:30:25.297 INFO:tasks.workunit.client.0.smithi071.stderr: -443> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:25.297 INFO:tasks.workunit.client.0.smithi071.stderr: -442> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:25.298 INFO:tasks.workunit.client.0.smithi071.stderr: -441> 2024-09-14T11:30:24.960+0000 7f2e55e289c0 5 asok(0x55cfc230dd90) register_command rotate-key hook 0x55cfc2519618 2024-09-14T11:30:25.298 INFO:tasks.workunit.client.0.smithi071.stderr: -440> 2024-09-14T11:30:24.960+0000 7f2e55e289c0 10 monclient: _reopen_session rank -1 2024-09-14T11:30:25.298 INFO:tasks.workunit.client.0.smithi071.stderr: -439> 2024-09-14T11:30:24.960+0000 7f2e55e289c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:30:25.298 INFO:tasks.workunit.client.0.smithi071.stderr: -438> 2024-09-14T11:30:24.960+0000 7f2e55e289c0 10 monclient(hunting): picked mon.noname-b con 0x55cfc23d27a0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:30:25.298 INFO:tasks.workunit.client.0.smithi071.stderr: -437> 2024-09-14T11:30:24.960+0000 7f2e55e289c0 10 monclient(hunting): picked mon.noname-c con 0x55cfc23d7a10 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:30:25.298 INFO:tasks.workunit.client.0.smithi071.stderr: -436> 2024-09-14T11:30:24.960+0000 7f2e55e289c0 10 monclient(hunting): picked mon.noname-a con 0x55cfc245f3b0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:30:25.298 INFO:tasks.workunit.client.0.smithi071.stderr: -435> 2024-09-14T11:30:24.960+0000 7f2e55e289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:25.298 INFO:tasks.workunit.client.0.smithi071.stderr: -434> 2024-09-14T11:30:24.960+0000 7f2e55e289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:25.298 INFO:tasks.workunit.client.0.smithi071.stderr: -433> 2024-09-14T11:30:24.960+0000 7f2e55e289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:25.298 INFO:tasks.workunit.client.0.smithi071.stderr: -432> 2024-09-14T11:30:24.960+0000 7f2e55e289c0 10 monclient(hunting): _renew_subs 2024-09-14T11:30:25.298 INFO:tasks.workunit.client.0.smithi071.stderr: -431> 2024-09-14T11:30:24.960+0000 7f2e55e289c0 10 monclient(hunting): authenticate will time out at 2237.080084s 2024-09-14T11:30:25.298 INFO:tasks.workunit.client.0.smithi071.stderr: -430> 2024-09-14T11:30:24.960+0000 7f2e5312d640 10 monclient(hunting): get_auth_request con 0x55cfc23d7a10 auth_method 0 2024-09-14T11:30:25.298 INFO:tasks.workunit.client.0.smithi071.stderr: -429> 2024-09-14T11:30:24.960+0000 7f2e5312d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:25.298 INFO:tasks.workunit.client.0.smithi071.stderr: -428> 2024-09-14T11:30:24.960+0000 7f2e5312d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:25.299 INFO:tasks.workunit.client.0.smithi071.stderr: -427> 2024-09-14T11:30:24.960+0000 7f2e5312d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:25.299 INFO:tasks.workunit.client.0.smithi071.stderr: -426> 2024-09-14T11:30:24.960+0000 7f2e5412f640 10 monclient(hunting): get_auth_request con 0x55cfc245f3b0 auth_method 0 2024-09-14T11:30:25.299 INFO:tasks.workunit.client.0.smithi071.stderr: -425> 2024-09-14T11:30:24.960+0000 7f2e5412f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:25.299 INFO:tasks.workunit.client.0.smithi071.stderr: -424> 2024-09-14T11:30:24.960+0000 7f2e5412f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:25.299 INFO:tasks.workunit.client.0.smithi071.stderr: -423> 2024-09-14T11:30:24.960+0000 7f2e5412f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:25.299 INFO:tasks.workunit.client.0.smithi071.stderr: -422> 2024-09-14T11:30:24.960+0000 7f2e5312d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:25.299 INFO:tasks.workunit.client.0.smithi071.stderr: -421> 2024-09-14T11:30:24.960+0000 7f2e5312d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:25.299 INFO:tasks.workunit.client.0.smithi071.stderr: -420> 2024-09-14T11:30:24.960+0000 7f2e5312d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:25.299 INFO:tasks.workunit.client.0.smithi071.stderr: -419> 2024-09-14T11:30:24.960+0000 7f2e5412f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:25.299 INFO:tasks.workunit.client.0.smithi071.stderr: -418> 2024-09-14T11:30:24.960+0000 7f2e5412f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:25.299 INFO:tasks.workunit.client.0.smithi071.stderr: -417> 2024-09-14T11:30:24.960+0000 7f2e5412f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:25.299 INFO:tasks.workunit.client.0.smithi071.stderr: -416> 2024-09-14T11:30:24.960+0000 7f2e5392e640 10 monclient(hunting): get_auth_request con 0x55cfc23d27a0 auth_method 0 2024-09-14T11:30:25.299 INFO:tasks.workunit.client.0.smithi071.stderr: -415> 2024-09-14T11:30:24.960+0000 7f2e5392e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:25.299 INFO:tasks.workunit.client.0.smithi071.stderr: -414> 2024-09-14T11:30:24.960+0000 7f2e5392e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:25.300 INFO:tasks.workunit.client.0.smithi071.stderr: -413> 2024-09-14T11:30:24.960+0000 7f2e5392e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:25.300 INFO:tasks.workunit.client.0.smithi071.stderr: -412> 2024-09-14T11:30:24.960+0000 7f2e5312d640 10 monclient(hunting): handle_auth_done global_id 6503 payload 824 2024-09-14T11:30:25.300 INFO:tasks.workunit.client.0.smithi071.stderr: -411> 2024-09-14T11:30:24.960+0000 7f2e5312d640 10 monclient: _finish_hunting 0 2024-09-14T11:30:25.300 INFO:tasks.workunit.client.0.smithi071.stderr: -410> 2024-09-14T11:30:24.960+0000 7f2e5312d640 1 monclient: found mon.noname-c 2024-09-14T11:30:25.300 INFO:tasks.workunit.client.0.smithi071.stderr: -409> 2024-09-14T11:30:24.960+0000 7f2e5312d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:30:25.300 INFO:tasks.workunit.client.0.smithi071.stderr: -408> 2024-09-14T11:30:24.960+0000 7f2d3bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:25.300 INFO:tasks.workunit.client.0.smithi071.stderr: -407> 2024-09-14T11:30:24.960+0000 7f2d3bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:30:25.300 INFO:tasks.workunit.client.0.smithi071.stderr: -406> 2024-09-14T11:30:24.960+0000 7f2d3bfff640 10 monclient: dump: 2024-09-14T11:30:25.300 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:30:25.300 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:30:25.300 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.300 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.300 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:25.301 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:30:25.301 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:30:25.301 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:30:25.301 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:30:25.301 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.301 INFO:tasks.workunit.client.0.smithi071.stderr: -405> 2024-09-14T11:30:24.960+0000 7f2d3bfff640 10 monclient: _finish_auth 0 2024-09-14T11:30:25.301 INFO:tasks.workunit.client.0.smithi071.stderr: -404> 2024-09-14T11:30:24.960+0000 7f2d3bfff640 10 monclient: _check_auth_tickets 2024-09-14T11:30:25.301 INFO:tasks.workunit.client.0.smithi071.stderr: -403> 2024-09-14T11:30:24.960+0000 7f2d3bfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:25.301 INFO:tasks.workunit.client.0.smithi071.stderr: -402> 2024-09-14T11:30:24.960+0000 7f2d3bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:25.301 INFO:tasks.workunit.client.0.smithi071.stderr: -401> 2024-09-14T11:30:24.960+0000 7f2d3bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:30:25.301 INFO:tasks.workunit.client.0.smithi071.stderr: -400> 2024-09-14T11:30:24.960+0000 7f2d3bfff640 10 monclient: dump: 2024-09-14T11:30:25.301 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:30:25.301 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:30:25.301 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.302 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.302 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:25.302 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:30:25.302 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:30:25.302 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:30:25.302 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:30:25.302 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.302 INFO:tasks.workunit.client.0.smithi071.stderr: -399> 2024-09-14T11:30:24.960+0000 7f2d41e0b640 4 set_mon_vals no callback set 2024-09-14T11:30:25.302 INFO:tasks.workunit.client.0.smithi071.stderr: -398> 2024-09-14T11:30:24.960+0000 7f2e55e289c0 5 monclient: authenticate success, global_id 6503 2024-09-14T11:30:25.302 INFO:tasks.workunit.client.0.smithi071.stderr: -397> 2024-09-14T11:30:24.960+0000 7f2e55e289c0 10 monclient: _renew_subs 2024-09-14T11:30:25.302 INFO:tasks.workunit.client.0.smithi071.stderr: -396> 2024-09-14T11:30:24.960+0000 7f2e55e289c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:30:25.302 INFO:tasks.workunit.client.0.smithi071.stderr: -395> 2024-09-14T11:30:24.960+0000 7f2e55e289c0 10 monclient: _renew_subs 2024-09-14T11:30:25.302 INFO:tasks.workunit.client.0.smithi071.stderr: -394> 2024-09-14T11:30:24.960+0000 7f2e55e289c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:30:25.302 INFO:tasks.workunit.client.0.smithi071.stderr: -393> 2024-09-14T11:30:24.960+0000 7f2e55e289c0 1 librados: init done 2024-09-14T11:30:25.302 INFO:tasks.workunit.client.0.smithi071.stderr: -392> 2024-09-14T11:30:24.960+0000 7f2d3bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:30:25.303 INFO:tasks.workunit.client.0.smithi071.stderr: -391> 2024-09-14T11:30:24.960+0000 7f2d3bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:30:25.303 INFO:tasks.workunit.client.0.smithi071.stderr: -390> 2024-09-14T11:30:24.960+0000 7f2d3bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:30:25.303 INFO:tasks.workunit.client.0.smithi071.stderr: -389> 2024-09-14T11:30:24.960+0000 7f2e5392e640 10 monclient: get_auth_request con 0x7f2d3c0718a0 auth_method 0 2024-09-14T11:30:25.303 INFO:tasks.workunit.client.0.smithi071.stderr: -388> 2024-09-14T11:30:24.964+0000 7f2e5412f640 10 monclient: get_auth_request con 0x55cfc25414c0 auth_method 0 2024-09-14T11:30:25.303 INFO:tasks.workunit.client.0.smithi071.stderr: -387> 2024-09-14T11:30:24.964+0000 7f2e5392e640 10 monclient: get_auth_request con 0x55cfc2564130 auth_method 0 2024-09-14T11:30:25.303 INFO:tasks.workunit.client.0.smithi071.stderr: -386> 2024-09-14T11:30:24.964+0000 7f2e5312d640 10 monclient: get_auth_request con 0x55cfc2568490 auth_method 0 2024-09-14T11:30:25.303 INFO:tasks.workunit.client.0.smithi071.stderr: -385> 2024-09-14T11:30:24.964+0000 7f2e5412f640 10 monclient: get_auth_request con 0x55cfc25679e0 auth_method 0 2024-09-14T11:30:25.303 INFO:tasks.workunit.client.0.smithi071.stderr: -384> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 10 monclient: build_initial_monmap 2024-09-14T11:30:25.303 INFO:tasks.workunit.client.0.smithi071.stderr: -383> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 1 build_initial for_mkfs: 0 2024-09-14T11:30:25.303 INFO:tasks.workunit.client.0.smithi071.stderr: -382> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 10 monclient: monmap: 2024-09-14T11:30:25.303 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:30:25.303 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:25.303 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:30:25.303 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:30:25.304 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:25.304 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:30:25.304 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:30:25.304 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:30:25.304 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:30:25.304 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.304 INFO:tasks.workunit.client.0.smithi071.stderr: -381> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25705f0) adding auth protocol: cephx 2024-09-14T11:30:25.304 INFO:tasks.workunit.client.0.smithi071.stderr: -380> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25705f0) adding auth protocol: cephx 2024-09-14T11:30:25.304 INFO:tasks.workunit.client.0.smithi071.stderr: -379> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25705f0) adding auth protocol: cephx 2024-09-14T11:30:25.304 INFO:tasks.workunit.client.0.smithi071.stderr: -378> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25705f0) adding con mode: secure 2024-09-14T11:30:25.304 INFO:tasks.workunit.client.0.smithi071.stderr: -377> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25705f0) adding con mode: crc 2024-09-14T11:30:25.304 INFO:tasks.workunit.client.0.smithi071.stderr: -376> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25705f0) adding con mode: secure 2024-09-14T11:30:25.304 INFO:tasks.workunit.client.0.smithi071.stderr: -375> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25705f0) adding con mode: crc 2024-09-14T11:30:25.304 INFO:tasks.workunit.client.0.smithi071.stderr: -374> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25705f0) adding con mode: secure 2024-09-14T11:30:25.305 INFO:tasks.workunit.client.0.smithi071.stderr: -373> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25705f0) adding con mode: crc 2024-09-14T11:30:25.305 INFO:tasks.workunit.client.0.smithi071.stderr: -372> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25705f0) adding con mode: crc 2024-09-14T11:30:25.305 INFO:tasks.workunit.client.0.smithi071.stderr: -371> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25705f0) adding con mode: secure 2024-09-14T11:30:25.305 INFO:tasks.workunit.client.0.smithi071.stderr: -370> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25705f0) adding con mode: crc 2024-09-14T11:30:25.305 INFO:tasks.workunit.client.0.smithi071.stderr: -369> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25705f0) adding con mode: secure 2024-09-14T11:30:25.305 INFO:tasks.workunit.client.0.smithi071.stderr: -368> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25705f0) adding con mode: crc 2024-09-14T11:30:25.305 INFO:tasks.workunit.client.0.smithi071.stderr: -367> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25705f0) adding con mode: secure 2024-09-14T11:30:25.305 INFO:tasks.workunit.client.0.smithi071.stderr: -366> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:25.305 INFO:tasks.workunit.client.0.smithi071.stderr: -365> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 asok(0x55cfc230dd90) register_command objecter_requests cmddesc objecter_requests hook 0x55cfc2573fe0 EEXIST 2024-09-14T11:30:25.305 INFO:tasks.workunit.client.0.smithi071.stderr: -364> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 10 monclient: init 2024-09-14T11:30:25.305 INFO:tasks.workunit.client.0.smithi071.stderr: -363> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc256f4e8) adding auth protocol: cephx 2024-09-14T11:30:25.305 INFO:tasks.workunit.client.0.smithi071.stderr: -362> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc256f4e8) adding auth protocol: cephx 2024-09-14T11:30:25.305 INFO:tasks.workunit.client.0.smithi071.stderr: -361> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc256f4e8) adding auth protocol: cephx 2024-09-14T11:30:25.305 INFO:tasks.workunit.client.0.smithi071.stderr: -360> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc256f4e8) adding con mode: secure 2024-09-14T11:30:25.306 INFO:tasks.workunit.client.0.smithi071.stderr: -359> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc256f4e8) adding con mode: crc 2024-09-14T11:30:25.306 INFO:tasks.workunit.client.0.smithi071.stderr: -358> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc256f4e8) adding con mode: secure 2024-09-14T11:30:25.306 INFO:tasks.workunit.client.0.smithi071.stderr: -357> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc256f4e8) adding con mode: crc 2024-09-14T11:30:25.306 INFO:tasks.workunit.client.0.smithi071.stderr: -356> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc256f4e8) adding con mode: secure 2024-09-14T11:30:25.306 INFO:tasks.workunit.client.0.smithi071.stderr: -355> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc256f4e8) adding con mode: crc 2024-09-14T11:30:25.306 INFO:tasks.workunit.client.0.smithi071.stderr: -354> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc256f4e8) adding con mode: crc 2024-09-14T11:30:25.306 INFO:tasks.workunit.client.0.smithi071.stderr: -353> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc256f4e8) adding con mode: secure 2024-09-14T11:30:25.306 INFO:tasks.workunit.client.0.smithi071.stderr: -352> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc256f4e8) adding con mode: crc 2024-09-14T11:30:25.306 INFO:tasks.workunit.client.0.smithi071.stderr: -351> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc256f4e8) adding con mode: secure 2024-09-14T11:30:25.306 INFO:tasks.workunit.client.0.smithi071.stderr: -350> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc256f4e8) adding con mode: crc 2024-09-14T11:30:25.306 INFO:tasks.workunit.client.0.smithi071.stderr: -349> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc256f4e8) adding con mode: secure 2024-09-14T11:30:25.306 INFO:tasks.workunit.client.0.smithi071.stderr: -348> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:25.306 INFO:tasks.workunit.client.0.smithi071.stderr: -347> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:25.306 INFO:tasks.workunit.client.0.smithi071.stderr: -346> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 asok(0x55cfc230dd90) register_command rotate-key cmddesc rotate-key hook 0x55cfc256f630 EEXIST 2024-09-14T11:30:25.307 INFO:tasks.workunit.client.0.smithi071.stderr: -345> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 10 monclient: _reopen_session rank -1 2024-09-14T11:30:25.307 INFO:tasks.workunit.client.0.smithi071.stderr: -344> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:30:25.307 INFO:tasks.workunit.client.0.smithi071.stderr: -343> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 10 monclient(hunting): picked mon.noname-a con 0x55cfc2598190 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:30:25.307 INFO:tasks.workunit.client.0.smithi071.stderr: -342> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 10 monclient(hunting): picked mon.noname-c con 0x55cfc2597ac0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:30:25.307 INFO:tasks.workunit.client.0.smithi071.stderr: -341> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 10 monclient(hunting): picked mon.noname-b con 0x55cfc25964a0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:30:25.307 INFO:tasks.workunit.client.0.smithi071.stderr: -340> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:25.307 INFO:tasks.workunit.client.0.smithi071.stderr: -339> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:25.307 INFO:tasks.workunit.client.0.smithi071.stderr: -338> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:25.307 INFO:tasks.workunit.client.0.smithi071.stderr: -337> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 10 monclient(hunting): _renew_subs 2024-09-14T11:30:25.307 INFO:tasks.workunit.client.0.smithi071.stderr: -336> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 10 monclient(hunting): authenticate will time out at 2237.090558s 2024-09-14T11:30:25.307 INFO:tasks.workunit.client.0.smithi071.stderr: -335> 2024-09-14T11:30:24.968+0000 7f2e5312d640 10 monclient(hunting): get_auth_request con 0x55cfc2598190 auth_method 0 2024-09-14T11:30:25.307 INFO:tasks.workunit.client.0.smithi071.stderr: -334> 2024-09-14T11:30:24.968+0000 7f2e5312d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:25.307 INFO:tasks.workunit.client.0.smithi071.stderr: -333> 2024-09-14T11:30:24.968+0000 7f2e5312d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:25.307 INFO:tasks.workunit.client.0.smithi071.stderr: -332> 2024-09-14T11:30:24.968+0000 7f2e5312d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:25.307 INFO:tasks.workunit.client.0.smithi071.stderr: -331> 2024-09-14T11:30:24.968+0000 7f2e5412f640 10 monclient(hunting): get_auth_request con 0x55cfc2597ac0 auth_method 0 2024-09-14T11:30:25.308 INFO:tasks.workunit.client.0.smithi071.stderr: -330> 2024-09-14T11:30:24.968+0000 7f2e5412f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:25.308 INFO:tasks.workunit.client.0.smithi071.stderr: -329> 2024-09-14T11:30:24.968+0000 7f2e5412f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:25.308 INFO:tasks.workunit.client.0.smithi071.stderr: -328> 2024-09-14T11:30:24.968+0000 7f2e5412f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:25.308 INFO:tasks.workunit.client.0.smithi071.stderr: -327> 2024-09-14T11:30:24.968+0000 7f2e5312d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:25.308 INFO:tasks.workunit.client.0.smithi071.stderr: -326> 2024-09-14T11:30:24.968+0000 7f2e5312d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:25.308 INFO:tasks.workunit.client.0.smithi071.stderr: -325> 2024-09-14T11:30:24.968+0000 7f2e5312d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:25.308 INFO:tasks.workunit.client.0.smithi071.stderr: -324> 2024-09-14T11:30:24.968+0000 7f2e5412f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:25.308 INFO:tasks.workunit.client.0.smithi071.stderr: -323> 2024-09-14T11:30:24.968+0000 7f2e5412f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:25.308 INFO:tasks.workunit.client.0.smithi071.stderr: -322> 2024-09-14T11:30:24.968+0000 7f2e5412f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:25.308 INFO:tasks.workunit.client.0.smithi071.stderr: -321> 2024-09-14T11:30:24.968+0000 7f2e5392e640 10 monclient(hunting): get_auth_request con 0x55cfc25964a0 auth_method 0 2024-09-14T11:30:25.308 INFO:tasks.workunit.client.0.smithi071.stderr: -320> 2024-09-14T11:30:24.968+0000 7f2e5392e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:25.308 INFO:tasks.workunit.client.0.smithi071.stderr: -319> 2024-09-14T11:30:24.968+0000 7f2e5392e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:25.308 INFO:tasks.workunit.client.0.smithi071.stderr: -318> 2024-09-14T11:30:24.968+0000 7f2e5392e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:25.308 INFO:tasks.workunit.client.0.smithi071.stderr: -317> 2024-09-14T11:30:24.968+0000 7f2e5312d640 10 monclient(hunting): handle_auth_done global_id 6828 payload 824 2024-09-14T11:30:25.309 INFO:tasks.workunit.client.0.smithi071.stderr: -316> 2024-09-14T11:30:24.968+0000 7f2e5312d640 10 monclient: _finish_hunting 0 2024-09-14T11:30:25.309 INFO:tasks.workunit.client.0.smithi071.stderr: -315> 2024-09-14T11:30:24.968+0000 7f2e5312d640 1 monclient: found mon.noname-a 2024-09-14T11:30:25.309 INFO:tasks.workunit.client.0.smithi071.stderr: -314> 2024-09-14T11:30:24.968+0000 7f2e5312d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:30:25.309 INFO:tasks.workunit.client.0.smithi071.stderr: -313> 2024-09-14T11:30:24.968+0000 7f2d397fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:25.309 INFO:tasks.workunit.client.0.smithi071.stderr: -312> 2024-09-14T11:30:24.968+0000 7f2d397fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:30:25.309 INFO:tasks.workunit.client.0.smithi071.stderr: -311> 2024-09-14T11:30:24.968+0000 7f2d397fa640 10 monclient: dump: 2024-09-14T11:30:25.309 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:30:25.309 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:30:25.309 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.310 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.310 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:25.310 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:30:25.310 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:30:25.310 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:30:25.310 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:30:25.310 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.310 INFO:tasks.workunit.client.0.smithi071.stderr: -310> 2024-09-14T11:30:24.968+0000 7f2d397fa640 10 monclient: _finish_auth 0 2024-09-14T11:30:25.310 INFO:tasks.workunit.client.0.smithi071.stderr: -309> 2024-09-14T11:30:24.968+0000 7f2d397fa640 10 monclient: _check_auth_tickets 2024-09-14T11:30:25.310 INFO:tasks.workunit.client.0.smithi071.stderr: -308> 2024-09-14T11:30:24.968+0000 7f2d397fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:25.310 INFO:tasks.workunit.client.0.smithi071.stderr: -307> 2024-09-14T11:30:24.968+0000 7f2d397fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:25.310 INFO:tasks.workunit.client.0.smithi071.stderr: -306> 2024-09-14T11:30:24.968+0000 7f2d397fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:30:25.310 INFO:tasks.workunit.client.0.smithi071.stderr: -305> 2024-09-14T11:30:24.968+0000 7f2d397fa640 10 monclient: dump: 2024-09-14T11:30:25.311 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:30:25.311 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:30:25.311 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.311 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.311 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:25.311 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:30:25.311 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:30:25.311 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:30:25.311 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:30:25.311 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.311 INFO:tasks.workunit.client.0.smithi071.stderr: -304> 2024-09-14T11:30:24.968+0000 7f2e54930640 4 set_mon_vals no callback set 2024-09-14T11:30:25.311 INFO:tasks.workunit.client.0.smithi071.stderr: -303> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 monclient: authenticate success, global_id 6828 2024-09-14T11:30:25.311 INFO:tasks.workunit.client.0.smithi071.stderr: -302> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient: _renew_subs 2024-09-14T11:30:25.311 INFO:tasks.workunit.client.0.smithi071.stderr: -301> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:30:25.311 INFO:tasks.workunit.client.0.smithi071.stderr: -300> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient: _renew_subs 2024-09-14T11:30:25.312 INFO:tasks.workunit.client.0.smithi071.stderr: -299> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:30:25.312 INFO:tasks.workunit.client.0.smithi071.stderr: -298> 2024-09-14T11:30:24.972+0000 7f2d397fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:30:25.312 INFO:tasks.workunit.client.0.smithi071.stderr: -297> 2024-09-14T11:30:24.972+0000 7f2d397fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:30:25.312 INFO:tasks.workunit.client.0.smithi071.stderr: -296> 2024-09-14T11:30:24.972+0000 7f2d397fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:30:25.312 INFO:tasks.workunit.client.0.smithi071.stderr: -295> 2024-09-14T11:30:24.972+0000 7f2e5412f640 10 monclient: get_auth_request con 0x7f2d2c0717e0 auth_method 0 2024-09-14T11:30:25.312 INFO:tasks.workunit.client.0.smithi071.stderr: -294> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient: get_monmap_and_config 2024-09-14T11:30:25.312 INFO:tasks.workunit.client.0.smithi071.stderr: -293> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient: build_initial_monmap 2024-09-14T11:30:25.312 INFO:tasks.workunit.client.0.smithi071.stderr: -292> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 1 build_initial for_mkfs: 0 2024-09-14T11:30:25.312 INFO:tasks.workunit.client.0.smithi071.stderr: -291> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient: monmap: 2024-09-14T11:30:25.312 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:30:25.312 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:25.312 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:30:25.312 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:30:25.312 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:25.313 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:30:25.313 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:30:25.313 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:30:25.313 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:30:25.313 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.313 INFO:tasks.workunit.client.0.smithi071.stderr: -290> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25b76a0) adding auth protocol: cephx 2024-09-14T11:30:25.313 INFO:tasks.workunit.client.0.smithi071.stderr: -289> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25b76a0) adding auth protocol: cephx 2024-09-14T11:30:25.313 INFO:tasks.workunit.client.0.smithi071.stderr: -288> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25b76a0) adding auth protocol: cephx 2024-09-14T11:30:25.313 INFO:tasks.workunit.client.0.smithi071.stderr: -287> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25b76a0) adding con mode: secure 2024-09-14T11:30:25.313 INFO:tasks.workunit.client.0.smithi071.stderr: -286> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25b76a0) adding con mode: crc 2024-09-14T11:30:25.313 INFO:tasks.workunit.client.0.smithi071.stderr: -285> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25b76a0) adding con mode: secure 2024-09-14T11:30:25.313 INFO:tasks.workunit.client.0.smithi071.stderr: -284> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25b76a0) adding con mode: crc 2024-09-14T11:30:25.313 INFO:tasks.workunit.client.0.smithi071.stderr: -283> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25b76a0) adding con mode: secure 2024-09-14T11:30:25.313 INFO:tasks.workunit.client.0.smithi071.stderr: -282> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25b76a0) adding con mode: crc 2024-09-14T11:30:25.313 INFO:tasks.workunit.client.0.smithi071.stderr: -281> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25b76a0) adding con mode: crc 2024-09-14T11:30:25.314 INFO:tasks.workunit.client.0.smithi071.stderr: -280> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25b76a0) adding con mode: secure 2024-09-14T11:30:25.314 INFO:tasks.workunit.client.0.smithi071.stderr: -279> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25b76a0) adding con mode: crc 2024-09-14T11:30:25.314 INFO:tasks.workunit.client.0.smithi071.stderr: -278> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25b76a0) adding con mode: secure 2024-09-14T11:30:25.314 INFO:tasks.workunit.client.0.smithi071.stderr: -277> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25b76a0) adding con mode: crc 2024-09-14T11:30:25.314 INFO:tasks.workunit.client.0.smithi071.stderr: -276> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25b76a0) adding con mode: secure 2024-09-14T11:30:25.314 INFO:tasks.workunit.client.0.smithi071.stderr: -275> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:25.314 INFO:tasks.workunit.client.0.smithi071.stderr: -274> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient: init 2024-09-14T11:30:25.314 INFO:tasks.workunit.client.0.smithi071.stderr: -273> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27423da0) adding auth protocol: cephx 2024-09-14T11:30:25.314 INFO:tasks.workunit.client.0.smithi071.stderr: -272> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27423da0) adding auth protocol: cephx 2024-09-14T11:30:25.314 INFO:tasks.workunit.client.0.smithi071.stderr: -271> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27423da0) adding auth protocol: cephx 2024-09-14T11:30:25.314 INFO:tasks.workunit.client.0.smithi071.stderr: -270> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27423da0) adding con mode: secure 2024-09-14T11:30:25.314 INFO:tasks.workunit.client.0.smithi071.stderr: -269> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27423da0) adding con mode: crc 2024-09-14T11:30:25.314 INFO:tasks.workunit.client.0.smithi071.stderr: -268> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27423da0) adding con mode: secure 2024-09-14T11:30:25.314 INFO:tasks.workunit.client.0.smithi071.stderr: -267> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27423da0) adding con mode: crc 2024-09-14T11:30:25.314 INFO:tasks.workunit.client.0.smithi071.stderr: -266> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27423da0) adding con mode: secure 2024-09-14T11:30:25.315 INFO:tasks.workunit.client.0.smithi071.stderr: -265> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27423da0) adding con mode: crc 2024-09-14T11:30:25.315 INFO:tasks.workunit.client.0.smithi071.stderr: -264> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27423da0) adding con mode: crc 2024-09-14T11:30:25.315 INFO:tasks.workunit.client.0.smithi071.stderr: -263> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27423da0) adding con mode: secure 2024-09-14T11:30:25.315 INFO:tasks.workunit.client.0.smithi071.stderr: -262> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27423da0) adding con mode: crc 2024-09-14T11:30:25.315 INFO:tasks.workunit.client.0.smithi071.stderr: -261> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27423da0) adding con mode: secure 2024-09-14T11:30:25.315 INFO:tasks.workunit.client.0.smithi071.stderr: -260> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27423da0) adding con mode: crc 2024-09-14T11:30:25.315 INFO:tasks.workunit.client.0.smithi071.stderr: -259> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27423da0) adding con mode: secure 2024-09-14T11:30:25.315 INFO:tasks.workunit.client.0.smithi071.stderr: -258> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:25.315 INFO:tasks.workunit.client.0.smithi071.stderr: -257> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:25.315 INFO:tasks.workunit.client.0.smithi071.stderr: -256> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 asok(0x55cfc230dd90) register_command rotate-key cmddesc rotate-key hook 0x7ffe27423ee8 EEXIST 2024-09-14T11:30:25.315 INFO:tasks.workunit.client.0.smithi071.stderr: -255> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient: _reopen_session rank -1 2024-09-14T11:30:25.315 INFO:tasks.workunit.client.0.smithi071.stderr: -254> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:30:25.315 INFO:tasks.workunit.client.0.smithi071.stderr: -253> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient(hunting): picked mon.noname-a con 0x55cfc25bb870 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:30:25.315 INFO:tasks.workunit.client.0.smithi071.stderr: -252> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient(hunting): picked mon.noname-c con 0x55cfc25ebf20 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:30:25.315 INFO:tasks.workunit.client.0.smithi071.stderr: -251> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient(hunting): picked mon.noname-b con 0x55cfc25e70d0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:30:25.316 INFO:tasks.workunit.client.0.smithi071.stderr: -250> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:25.316 INFO:tasks.workunit.client.0.smithi071.stderr: -249> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:25.316 INFO:tasks.workunit.client.0.smithi071.stderr: -248> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:25.316 INFO:tasks.workunit.client.0.smithi071.stderr: -247> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient(hunting): _renew_subs 2024-09-14T11:30:25.316 INFO:tasks.workunit.client.0.smithi071.stderr: -246> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient(hunting): authenticate will time out at 2237.095195s 2024-09-14T11:30:25.316 INFO:tasks.workunit.client.0.smithi071.stderr: -245> 2024-09-14T11:30:24.972+0000 7f2e5312d640 10 monclient(hunting): get_auth_request con 0x55cfc25bb870 auth_method 0 2024-09-14T11:30:25.316 INFO:tasks.workunit.client.0.smithi071.stderr: -244> 2024-09-14T11:30:24.972+0000 7f2e5312d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:25.316 INFO:tasks.workunit.client.0.smithi071.stderr: -243> 2024-09-14T11:30:24.972+0000 7f2e5312d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:25.316 INFO:tasks.workunit.client.0.smithi071.stderr: -242> 2024-09-14T11:30:24.972+0000 7f2e5312d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:25.316 INFO:tasks.workunit.client.0.smithi071.stderr: -241> 2024-09-14T11:30:24.972+0000 7f2e5412f640 10 monclient(hunting): get_auth_request con 0x55cfc25ebf20 auth_method 0 2024-09-14T11:30:25.316 INFO:tasks.workunit.client.0.smithi071.stderr: -240> 2024-09-14T11:30:24.972+0000 7f2e5412f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:25.316 INFO:tasks.workunit.client.0.smithi071.stderr: -239> 2024-09-14T11:30:24.972+0000 7f2e5412f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:25.316 INFO:tasks.workunit.client.0.smithi071.stderr: -238> 2024-09-14T11:30:24.972+0000 7f2e5412f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:25.316 INFO:tasks.workunit.client.0.smithi071.stderr: -237> 2024-09-14T11:30:24.972+0000 7f2e5312d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:25.317 INFO:tasks.workunit.client.0.smithi071.stderr: -236> 2024-09-14T11:30:24.972+0000 7f2e5312d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:25.317 INFO:tasks.workunit.client.0.smithi071.stderr: -235> 2024-09-14T11:30:24.972+0000 7f2e5312d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:25.317 INFO:tasks.workunit.client.0.smithi071.stderr: -234> 2024-09-14T11:30:24.972+0000 7f2e5412f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:25.317 INFO:tasks.workunit.client.0.smithi071.stderr: -233> 2024-09-14T11:30:24.972+0000 7f2e5412f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:25.317 INFO:tasks.workunit.client.0.smithi071.stderr: -232> 2024-09-14T11:30:24.972+0000 7f2e5412f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:25.317 INFO:tasks.workunit.client.0.smithi071.stderr: -231> 2024-09-14T11:30:24.972+0000 7f2e5312d640 10 monclient(hunting): handle_auth_done global_id 6831 payload 274 2024-09-14T11:30:25.317 INFO:tasks.workunit.client.0.smithi071.stderr: -230> 2024-09-14T11:30:24.972+0000 7f2e5312d640 10 monclient: _finish_hunting 0 2024-09-14T11:30:25.317 INFO:tasks.workunit.client.0.smithi071.stderr: -229> 2024-09-14T11:30:24.972+0000 7f2e5312d640 1 monclient: found mon.noname-a 2024-09-14T11:30:25.317 INFO:tasks.workunit.client.0.smithi071.stderr: -228> 2024-09-14T11:30:24.972+0000 7f2e5312d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:30:25.317 INFO:tasks.workunit.client.0.smithi071.stderr: -227> 2024-09-14T11:30:24.972+0000 7f2e5392e640 10 monclient: get_auth_request con 0x55cfc25e70d0 auth_method 0 2024-09-14T11:30:25.317 INFO:tasks.workunit.client.0.smithi071.stderr: -226> 2024-09-14T11:30:24.972+0000 7f2d32ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:25.317 INFO:tasks.workunit.client.0.smithi071.stderr: -225> 2024-09-14T11:30:24.972+0000 7f2d32ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:30:25.317 INFO:tasks.workunit.client.0.smithi071.stderr: -224> 2024-09-14T11:30:24.972+0000 7f2d32ffd640 10 monclient: dump: 2024-09-14T11:30:25.317 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:30:25.317 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:30:25.318 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.318 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.318 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:25.318 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:30:25.318 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:30:25.318 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:30:25.318 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:30:25.318 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.318 INFO:tasks.workunit.client.0.smithi071.stderr: -223> 2024-09-14T11:30:24.972+0000 7f2d32ffd640 10 monclient: _finish_auth 0 2024-09-14T11:30:25.318 INFO:tasks.workunit.client.0.smithi071.stderr: -222> 2024-09-14T11:30:24.972+0000 7f2d32ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:30:25.318 INFO:tasks.workunit.client.0.smithi071.stderr: -221> 2024-09-14T11:30:24.972+0000 7f2d32ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:25.318 INFO:tasks.workunit.client.0.smithi071.stderr: -220> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 monclient: authenticate success, global_id 6831 2024-09-14T11:30:25.318 INFO:tasks.workunit.client.0.smithi071.stderr: -219> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient: get_monmap_and_config success 2024-09-14T11:30:25.318 INFO:tasks.workunit.client.0.smithi071.stderr: -218> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 4 set_mon_vals no callback set 2024-09-14T11:30:25.319 INFO:tasks.workunit.client.0.smithi071.stderr: -217> 2024-09-14T11:30:24.972+0000 7f2d32ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:25.319 INFO:tasks.workunit.client.0.smithi071.stderr: -216> 2024-09-14T11:30:24.972+0000 7f2d32ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:30:25.319 INFO:tasks.workunit.client.0.smithi071.stderr: -215> 2024-09-14T11:30:24.972+0000 7f2d32ffd640 10 monclient: dump: 2024-09-14T11:30:25.319 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:30:25.319 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:30:25.319 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.319 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.319 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:25.319 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:30:25.319 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:30:25.319 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:30:25.319 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:30:25.319 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.319 INFO:tasks.workunit.client.0.smithi071.stderr: -214> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 10 monclient: shutdown 2024-09-14T11:30:25.319 INFO:tasks.workunit.client.0.smithi071.stderr: -213> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 10 monclient: build_initial_monmap 2024-09-14T11:30:25.320 INFO:tasks.workunit.client.0.smithi071.stderr: -212> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 1 build_initial for_mkfs: 0 2024-09-14T11:30:25.320 INFO:tasks.workunit.client.0.smithi071.stderr: -211> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 10 monclient: monmap: 2024-09-14T11:30:25.320 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:30:25.320 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:25.320 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:30:25.320 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:30:25.320 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:25.320 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:30:25.320 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:30:25.320 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:30:25.320 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:30:25.320 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.320 INFO:tasks.workunit.client.0.smithi071.stderr: -210> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25bc850) adding auth protocol: cephx 2024-09-14T11:30:25.320 INFO:tasks.workunit.client.0.smithi071.stderr: -209> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25bc850) adding auth protocol: cephx 2024-09-14T11:30:25.320 INFO:tasks.workunit.client.0.smithi071.stderr: -208> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25bc850) adding auth protocol: cephx 2024-09-14T11:30:25.321 INFO:tasks.workunit.client.0.smithi071.stderr: -207> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25bc850) adding con mode: secure 2024-09-14T11:30:25.321 INFO:tasks.workunit.client.0.smithi071.stderr: -206> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25bc850) adding con mode: crc 2024-09-14T11:30:25.321 INFO:tasks.workunit.client.0.smithi071.stderr: -205> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25bc850) adding con mode: secure 2024-09-14T11:30:25.321 INFO:tasks.workunit.client.0.smithi071.stderr: -204> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25bc850) adding con mode: crc 2024-09-14T11:30:25.321 INFO:tasks.workunit.client.0.smithi071.stderr: -203> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25bc850) adding con mode: secure 2024-09-14T11:30:25.321 INFO:tasks.workunit.client.0.smithi071.stderr: -202> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25bc850) adding con mode: crc 2024-09-14T11:30:25.321 INFO:tasks.workunit.client.0.smithi071.stderr: -201> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25bc850) adding con mode: crc 2024-09-14T11:30:25.321 INFO:tasks.workunit.client.0.smithi071.stderr: -200> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25bc850) adding con mode: secure 2024-09-14T11:30:25.321 INFO:tasks.workunit.client.0.smithi071.stderr: -199> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25bc850) adding con mode: crc 2024-09-14T11:30:25.321 INFO:tasks.workunit.client.0.smithi071.stderr: -198> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25bc850) adding con mode: secure 2024-09-14T11:30:25.321 INFO:tasks.workunit.client.0.smithi071.stderr: -197> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25bc850) adding con mode: crc 2024-09-14T11:30:25.321 INFO:tasks.workunit.client.0.smithi071.stderr: -196> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25bc850) adding con mode: secure 2024-09-14T11:30:25.321 INFO:tasks.workunit.client.0.smithi071.stderr: -195> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:25.321 INFO:tasks.workunit.client.0.smithi071.stderr: -194> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 1 librados: starting msgr at 2024-09-14T11:30:25.321 INFO:tasks.workunit.client.0.smithi071.stderr: -193> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 1 librados: starting objecter 2024-09-14T11:30:25.322 INFO:tasks.workunit.client.0.smithi071.stderr: -192> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 asok(0x55cfc230dd90) register_command objecter_requests cmddesc objecter_requests hook 0x55cfc25bd920 EEXIST 2024-09-14T11:30:25.322 INFO:tasks.workunit.client.0.smithi071.stderr: -191> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 1 librados: setting wanted keys 2024-09-14T11:30:25.322 INFO:tasks.workunit.client.0.smithi071.stderr: -190> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 1 librados: calling monclient init 2024-09-14T11:30:25.322 INFO:tasks.workunit.client.0.smithi071.stderr: -189> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 10 monclient: init 2024-09-14T11:30:25.322 INFO:tasks.workunit.client.0.smithi071.stderr: -188> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc2599fb0) adding auth protocol: cephx 2024-09-14T11:30:25.322 INFO:tasks.workunit.client.0.smithi071.stderr: -187> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc2599fb0) adding auth protocol: cephx 2024-09-14T11:30:25.322 INFO:tasks.workunit.client.0.smithi071.stderr: -186> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc2599fb0) adding auth protocol: cephx 2024-09-14T11:30:25.322 INFO:tasks.workunit.client.0.smithi071.stderr: -185> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc2599fb0) adding con mode: secure 2024-09-14T11:30:25.322 INFO:tasks.workunit.client.0.smithi071.stderr: -184> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc2599fb0) adding con mode: crc 2024-09-14T11:30:25.322 INFO:tasks.workunit.client.0.smithi071.stderr: -183> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc2599fb0) adding con mode: secure 2024-09-14T11:30:25.322 INFO:tasks.workunit.client.0.smithi071.stderr: -182> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc2599fb0) adding con mode: crc 2024-09-14T11:30:25.322 INFO:tasks.workunit.client.0.smithi071.stderr: -181> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc2599fb0) adding con mode: secure 2024-09-14T11:30:25.322 INFO:tasks.workunit.client.0.smithi071.stderr: -180> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc2599fb0) adding con mode: crc 2024-09-14T11:30:25.322 INFO:tasks.workunit.client.0.smithi071.stderr: -179> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc2599fb0) adding con mode: crc 2024-09-14T11:30:25.322 INFO:tasks.workunit.client.0.smithi071.stderr: -178> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc2599fb0) adding con mode: secure 2024-09-14T11:30:25.323 INFO:tasks.workunit.client.0.smithi071.stderr: -177> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc2599fb0) adding con mode: crc 2024-09-14T11:30:25.323 INFO:tasks.workunit.client.0.smithi071.stderr: -176> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc2599fb0) adding con mode: secure 2024-09-14T11:30:25.323 INFO:tasks.workunit.client.0.smithi071.stderr: -175> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc2599fb0) adding con mode: crc 2024-09-14T11:30:25.323 INFO:tasks.workunit.client.0.smithi071.stderr: -174> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc2599fb0) adding con mode: secure 2024-09-14T11:30:25.323 INFO:tasks.workunit.client.0.smithi071.stderr: -173> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:25.323 INFO:tasks.workunit.client.0.smithi071.stderr: -172> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:25.323 INFO:tasks.workunit.client.0.smithi071.stderr: -171> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 asok(0x55cfc230dd90) register_command rotate-key cmddesc rotate-key hook 0x55cfc259a0f8 EEXIST 2024-09-14T11:30:25.323 INFO:tasks.workunit.client.0.smithi071.stderr: -170> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 10 monclient: _reopen_session rank -1 2024-09-14T11:30:25.323 INFO:tasks.workunit.client.0.smithi071.stderr: -169> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:30:25.323 INFO:tasks.workunit.client.0.smithi071.stderr: -168> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 10 monclient(hunting): picked mon.noname-a con 0x55cfc25bb870 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:30:25.323 INFO:tasks.workunit.client.0.smithi071.stderr: -167> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 10 monclient(hunting): picked mon.noname-c con 0x55cfc25e70d0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:30:25.323 INFO:tasks.workunit.client.0.smithi071.stderr: -166> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 10 monclient(hunting): picked mon.noname-b con 0x55cfc25ebf20 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:30:25.323 INFO:tasks.workunit.client.0.smithi071.stderr: -165> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:25.323 INFO:tasks.workunit.client.0.smithi071.stderr: -164> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:25.323 INFO:tasks.workunit.client.0.smithi071.stderr: -163> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:25.324 INFO:tasks.workunit.client.0.smithi071.stderr: -162> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 10 monclient(hunting): _renew_subs 2024-09-14T11:30:25.324 INFO:tasks.workunit.client.0.smithi071.stderr: -161> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 10 monclient(hunting): authenticate will time out at 2237.097816s 2024-09-14T11:30:25.324 INFO:tasks.workunit.client.0.smithi071.stderr: -160> 2024-09-14T11:30:24.976+0000 7f2e5312d640 10 monclient(hunting): get_auth_request con 0x55cfc25bb870 auth_method 0 2024-09-14T11:30:25.324 INFO:tasks.workunit.client.0.smithi071.stderr: -159> 2024-09-14T11:30:24.976+0000 7f2e5312d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:25.324 INFO:tasks.workunit.client.0.smithi071.stderr: -158> 2024-09-14T11:30:24.976+0000 7f2e5312d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:25.324 INFO:tasks.workunit.client.0.smithi071.stderr: -157> 2024-09-14T11:30:24.976+0000 7f2e5312d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:25.324 INFO:tasks.workunit.client.0.smithi071.stderr: -156> 2024-09-14T11:30:24.976+0000 7f2e5412f640 10 monclient(hunting): get_auth_request con 0x55cfc25e70d0 auth_method 0 2024-09-14T11:30:25.324 INFO:tasks.workunit.client.0.smithi071.stderr: -155> 2024-09-14T11:30:24.976+0000 7f2e5412f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:25.324 INFO:tasks.workunit.client.0.smithi071.stderr: -154> 2024-09-14T11:30:24.976+0000 7f2e5412f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:25.324 INFO:tasks.workunit.client.0.smithi071.stderr: -153> 2024-09-14T11:30:24.976+0000 7f2e5412f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:25.324 INFO:tasks.workunit.client.0.smithi071.stderr: -152> 2024-09-14T11:30:24.976+0000 7f2e5312d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:25.324 INFO:tasks.workunit.client.0.smithi071.stderr: -151> 2024-09-14T11:30:24.976+0000 7f2e5312d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:25.324 INFO:tasks.workunit.client.0.smithi071.stderr: -150> 2024-09-14T11:30:24.976+0000 7f2e5312d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:25.324 INFO:tasks.workunit.client.0.smithi071.stderr: -149> 2024-09-14T11:30:24.976+0000 7f2e5412f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:25.325 INFO:tasks.workunit.client.0.smithi071.stderr: -148> 2024-09-14T11:30:24.976+0000 7f2e5412f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:25.325 INFO:tasks.workunit.client.0.smithi071.stderr: -147> 2024-09-14T11:30:24.976+0000 7f2e5412f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:25.325 INFO:tasks.workunit.client.0.smithi071.stderr: -146> 2024-09-14T11:30:24.976+0000 7f2e5312d640 10 monclient(hunting): handle_auth_done global_id 6834 payload 824 2024-09-14T11:30:25.325 INFO:tasks.workunit.client.0.smithi071.stderr: -145> 2024-09-14T11:30:24.976+0000 7f2e5312d640 10 monclient: _finish_hunting 0 2024-09-14T11:30:25.325 INFO:tasks.workunit.client.0.smithi071.stderr: -144> 2024-09-14T11:30:24.976+0000 7f2e5312d640 1 monclient: found mon.noname-a 2024-09-14T11:30:25.325 INFO:tasks.workunit.client.0.smithi071.stderr: -143> 2024-09-14T11:30:24.976+0000 7f2e5312d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:30:25.325 INFO:tasks.workunit.client.0.smithi071.stderr: -142> 2024-09-14T11:30:24.976+0000 7f2d317fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:25.325 INFO:tasks.workunit.client.0.smithi071.stderr: -141> 2024-09-14T11:30:24.976+0000 7f2d317fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:30:25.325 INFO:tasks.workunit.client.0.smithi071.stderr: -140> 2024-09-14T11:30:24.976+0000 7f2d317fa640 10 monclient: dump: 2024-09-14T11:30:25.325 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:30:25.325 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:30:25.325 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.325 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.325 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:25.326 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:30:25.326 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:30:25.326 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:30:25.326 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:30:25.326 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.326 INFO:tasks.workunit.client.0.smithi071.stderr: -139> 2024-09-14T11:30:24.976+0000 7f2d317fa640 10 monclient: _finish_auth 0 2024-09-14T11:30:25.326 INFO:tasks.workunit.client.0.smithi071.stderr: -138> 2024-09-14T11:30:24.976+0000 7f2d317fa640 10 monclient: _check_auth_tickets 2024-09-14T11:30:25.326 INFO:tasks.workunit.client.0.smithi071.stderr: -137> 2024-09-14T11:30:24.976+0000 7f2d317fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:25.326 INFO:tasks.workunit.client.0.smithi071.stderr: -136> 2024-09-14T11:30:24.976+0000 7f2d317fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:25.326 INFO:tasks.workunit.client.0.smithi071.stderr: -135> 2024-09-14T11:30:24.976+0000 7f2d317fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:30:25.326 INFO:tasks.workunit.client.0.smithi071.stderr: -134> 2024-09-14T11:30:24.976+0000 7f2d317fa640 10 monclient: dump: 2024-09-14T11:30:25.326 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:30:25.326 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:30:25.326 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.327 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.327 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:25.327 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:30:25.327 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:30:25.327 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:30:25.327 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:30:25.327 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.327 INFO:tasks.workunit.client.0.smithi071.stderr: -133> 2024-09-14T11:30:24.976+0000 7f2d32ffd640 4 set_mon_vals no callback set 2024-09-14T11:30:25.327 INFO:tasks.workunit.client.0.smithi071.stderr: -132> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 monclient: authenticate success, global_id 6834 2024-09-14T11:30:25.327 INFO:tasks.workunit.client.0.smithi071.stderr: -131> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 10 monclient: _renew_subs 2024-09-14T11:30:25.327 INFO:tasks.workunit.client.0.smithi071.stderr: -130> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:30:25.327 INFO:tasks.workunit.client.0.smithi071.stderr: -129> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 10 monclient: _renew_subs 2024-09-14T11:30:25.327 INFO:tasks.workunit.client.0.smithi071.stderr: -128> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:30:25.327 INFO:tasks.workunit.client.0.smithi071.stderr: -127> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 1 librados: init done 2024-09-14T11:30:25.327 INFO:tasks.workunit.client.0.smithi071.stderr: -126> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 asok(0x55cfc230dd90) register_command cr dump hook 0x7f2e4805dd28 2024-09-14T11:30:25.328 INFO:tasks.workunit.client.0.smithi071.stderr: -125> 2024-09-14T11:30:24.980+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.328 INFO:tasks.workunit.client.0.smithi071.stderr: -124> 2024-09-14T11:30:24.980+0000 7f2d317fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:30:25.328 INFO:tasks.workunit.client.0.smithi071.stderr: -123> 2024-09-14T11:30:24.980+0000 7f2d317fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:30:25.328 INFO:tasks.workunit.client.0.smithi071.stderr: -122> 2024-09-14T11:30:24.980+0000 7f2d317fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:30:25.328 INFO:tasks.workunit.client.0.smithi071.stderr: -121> 2024-09-14T11:30:24.980+0000 7f2e5412f640 10 monclient: get_auth_request con 0x7f2d1c0718a0 auth_method 0 2024-09-14T11:30:25.328 INFO:tasks.workunit.client.0.smithi071.stderr: -120> 2024-09-14T11:30:24.980+0000 7f2e5392e640 10 monclient: get_auth_request con 0x55cfc2604f40 auth_method 0 2024-09-14T11:30:25.328 INFO:tasks.workunit.client.0.smithi071.stderr: -119> 2024-09-14T11:30:24.980+0000 7f2e55e289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:25.328 INFO:tasks.workunit.client.0.smithi071.stderr: -118> 2024-09-14T11:30:24.980+0000 7f2e55e289c0 20 realm 2024-09-14T11:30:25.328 INFO:tasks.workunit.client.0.smithi071.stderr: -117> 2024-09-14T11:30:24.980+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.328 INFO:tasks.workunit.client.0.smithi071.stderr: -116> 2024-09-14T11:30:24.980+0000 7f2e55e289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:25.328 INFO:tasks.workunit.client.0.smithi071.stderr: -115> 2024-09-14T11:30:24.980+0000 7f2e55e289c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:25.328 INFO:tasks.workunit.client.0.smithi071.stderr: -114> 2024-09-14T11:30:24.980+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.328 INFO:tasks.workunit.client.0.smithi071.stderr: -113> 2024-09-14T11:30:24.980+0000 7f2e55e289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:25.328 INFO:tasks.workunit.client.0.smithi071.stderr: -112> 2024-09-14T11:30:24.980+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.328 INFO:tasks.workunit.client.0.smithi071.stderr: -111> 2024-09-14T11:30:24.980+0000 7f2e5312d640 10 monclient: get_auth_request con 0x55cfc26091b0 auth_method 0 2024-09-14T11:30:25.329 INFO:tasks.workunit.client.0.smithi071.stderr: -110> 2024-09-14T11:30:24.984+0000 7f2e55e289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:25.329 INFO:tasks.workunit.client.0.smithi071.stderr: -109> 2024-09-14T11:30:24.984+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.329 INFO:tasks.workunit.client.0.smithi071.stderr: -108> 2024-09-14T11:30:24.984+0000 7f2e5412f640 10 monclient: get_auth_request con 0x55cfc260c9f0 auth_method 0 2024-09-14T11:30:25.329 INFO:tasks.workunit.client.0.smithi071.stderr: -107> 2024-09-14T11:30:24.984+0000 7f2e55e289c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:25.329 INFO:tasks.workunit.client.0.smithi071.stderr: -106> 2024-09-14T11:30:24.984+0000 7f2e55e289c0 20 searching for the correct realm 2024-09-14T11:30:25.329 INFO:tasks.workunit.client.0.smithi071.stderr: -105> 2024-09-14T11:30:24.984+0000 7f2e5392e640 10 monclient: get_auth_request con 0x55cfc26117d0 auth_method 0 2024-09-14T11:30:25.329 INFO:tasks.workunit.client.0.smithi071.stderr: -104> 2024-09-14T11:30:24.984+0000 7f2e5312d640 10 monclient: get_auth_request con 0x7f2e440b9b40 auth_method 0 2024-09-14T11:30:25.329 INFO:tasks.workunit.client.0.smithi071.stderr: -103> 2024-09-14T11:30:24.988+0000 7f2e5412f640 10 monclient: get_auth_request con 0x7f2e48008050 auth_method 0 2024-09-14T11:30:25.329 INFO:tasks.workunit.client.0.smithi071.stderr: -102> 2024-09-14T11:30:24.988+0000 7f2e5412f640 0 -- 172.21.15.71:0/869225631 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f2e48008050 msgr2=0x7f2e480507e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:25.329 INFO:tasks.workunit.client.0.smithi071.stderr: -101> 2024-09-14T11:30:25.192+0000 7f2e5412f640 10 monclient: get_auth_request con 0x7f2e48008050 auth_method 0 2024-09-14T11:30:25.329 INFO:tasks.workunit.client.0.smithi071.stderr: -100> 2024-09-14T11:30:25.192+0000 7f2e5392e640 10 monclient: get_auth_request con 0x7f2e440d4910 auth_method 0 2024-09-14T11:30:25.329 INFO:tasks.workunit.client.0.smithi071.stderr: -99> 2024-09-14T11:30:25.200+0000 7f2e5312d640 10 monclient: get_auth_request con 0x7f2e48052670 auth_method 0 2024-09-14T11:30:25.329 INFO:tasks.workunit.client.0.smithi071.stderr: -98> 2024-09-14T11:30:25.200+0000 7f2e5412f640 0 -- 172.21.15.71:0/869225631 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55cfc260c9f0 msgr2=0x55cfc260ee00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:25.329 INFO:tasks.workunit.client.0.smithi071.stderr: -97> 2024-09-14T11:30:25.200+0000 7f2d317fa640 1 client.6834.objecter ms_handle_reset 0x55cfc260c9f0 session 0x55cfc2608540 osd.3 2024-09-14T11:30:25.330 INFO:tasks.workunit.client.0.smithi071.stderr: -96> 2024-09-14T11:30:25.204+0000 7f2d317fa640 10 monclient: _renew_subs 2024-09-14T11:30:25.330 INFO:tasks.workunit.client.0.smithi071.stderr: -95> 2024-09-14T11:30:25.204+0000 7f2d317fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:30:25.330 INFO:tasks.workunit.client.0.smithi071.stderr: -94> 2024-09-14T11:30:25.204+0000 7f2e5412f640 10 monclient: get_auth_request con 0x7f2d1c0813c0 auth_method 0 2024-09-14T11:30:25.330 INFO:tasks.workunit.client.0.smithi071.stderr: -93> 2024-09-14T11:30:25.216+0000 7f2e55e289c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:25.330 INFO:tasks.workunit.client.0.smithi071.stderr: -92> 2024-09-14T11:30:25.216+0000 7f2e55e289c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:30:25.330 INFO:tasks.workunit.client.0.smithi071.stderr: -91> 2024-09-14T11:30:25.216+0000 7f2e55e289c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:25.330 INFO:tasks.workunit.client.0.smithi071.stderr: -90> 2024-09-14T11:30:25.216+0000 7f2e55e289c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:30:25.330 INFO:tasks.workunit.client.0.smithi071.stderr: -89> 2024-09-14T11:30:25.216+0000 7f2e55e289c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:25.330 INFO:tasks.workunit.client.0.smithi071.stderr: -88> 2024-09-14T11:30:25.216+0000 7f2e55e289c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:25.330 INFO:tasks.workunit.client.0.smithi071.stderr: -87> 2024-09-14T11:30:25.216+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.330 INFO:tasks.workunit.client.0.smithi071.stderr: -86> 2024-09-14T11:30:25.216+0000 7f2e55e289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:25.330 INFO:tasks.workunit.client.0.smithi071.stderr: -85> 2024-09-14T11:30:25.216+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.330 INFO:tasks.workunit.client.0.smithi071.stderr: -84> 2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:25.330 INFO:tasks.workunit.client.0.smithi071.stderr: -83> 2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.331 INFO:tasks.workunit.client.0.smithi071.stderr: -82> 2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:25.331 INFO:tasks.workunit.client.0.smithi071.stderr: -81> 2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 zone default found 2024-09-14T11:30:25.331 INFO:tasks.workunit.client.0.smithi071.stderr: -80> 2024-09-14T11:30:25.220+0000 7f2e55e289c0 4 Realm: () 2024-09-14T11:30:25.331 INFO:tasks.workunit.client.0.smithi071.stderr: -79> 2024-09-14T11:30:25.220+0000 7f2e55e289c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:30:25.331 INFO:tasks.workunit.client.0.smithi071.stderr: -78> 2024-09-14T11:30:25.220+0000 7f2e55e289c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:30:25.331 INFO:tasks.workunit.client.0.smithi071.stderr: -77> 2024-09-14T11:30:25.220+0000 7f2e55e289c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:25.331 INFO:tasks.workunit.client.0.smithi071.stderr: -76> 2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 zonegroup default 2024-09-14T11:30:25.331 INFO:tasks.workunit.client.0.smithi071.stderr: -75> 2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.331 INFO:tasks.workunit.client.0.smithi071.stderr: -74> 2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:25.331 INFO:tasks.workunit.client.0.smithi071.stderr: -73> 2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.331 INFO:tasks.workunit.client.0.smithi071.stderr: -72> 2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:25.331 INFO:tasks.workunit.client.0.smithi071.stderr: -71> 2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.331 INFO:tasks.workunit.client.0.smithi071.stderr: -70> 2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:25.331 INFO:tasks.workunit.client.0.smithi071.stderr: -69> 2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 started sync module instance, tier type = 2024-09-14T11:30:25.332 INFO:tasks.workunit.client.0.smithi071.stderr: -68> 2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:30:25.332 INFO:tasks.workunit.client.0.smithi071.stderr: -67> 2024-09-14T11:30:25.248+0000 7f2e55e289c0 20 add_watcher() i=0 2024-09-14T11:30:25.332 INFO:tasks.workunit.client.0.smithi071.stderr: -66> 2024-09-14T11:30:25.248+0000 7f2e55e289c0 20 add_watcher() i=1 2024-09-14T11:30:25.332 INFO:tasks.workunit.client.0.smithi071.stderr: -65> 2024-09-14T11:30:25.248+0000 7f2e55e289c0 20 add_watcher() i=2 2024-09-14T11:30:25.332 INFO:tasks.workunit.client.0.smithi071.stderr: -64> 2024-09-14T11:30:25.248+0000 7f2e55e289c0 20 add_watcher() i=3 2024-09-14T11:30:25.332 INFO:tasks.workunit.client.0.smithi071.stderr: -63> 2024-09-14T11:30:25.248+0000 7f2e55e289c0 20 add_watcher() i=4 2024-09-14T11:30:25.332 INFO:tasks.workunit.client.0.smithi071.stderr: -62> 2024-09-14T11:30:25.248+0000 7f2e55e289c0 20 add_watcher() i=5 2024-09-14T11:30:25.332 INFO:tasks.workunit.client.0.smithi071.stderr: -61> 2024-09-14T11:30:25.248+0000 7f2e55e289c0 20 add_watcher() i=6 2024-09-14T11:30:25.332 INFO:tasks.workunit.client.0.smithi071.stderr: -60> 2024-09-14T11:30:25.252+0000 7f2e55e289c0 20 add_watcher() i=7 2024-09-14T11:30:25.332 INFO:tasks.workunit.client.0.smithi071.stderr: -59> 2024-09-14T11:30:25.252+0000 7f2e55e289c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:25.332 INFO:tasks.workunit.client.0.smithi071.stderr: -58> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27424280) adding auth protocol: cephx 2024-09-14T11:30:25.332 INFO:tasks.workunit.client.0.smithi071.stderr: -57> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27424280) adding auth protocol: cephx 2024-09-14T11:30:25.332 INFO:tasks.workunit.client.0.smithi071.stderr: -56> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27424280) adding auth protocol: cephx 2024-09-14T11:30:25.332 INFO:tasks.workunit.client.0.smithi071.stderr: -55> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27424280) adding con mode: secure 2024-09-14T11:30:25.332 INFO:tasks.workunit.client.0.smithi071.stderr: -54> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27424280) adding con mode: crc 2024-09-14T11:30:25.333 INFO:tasks.workunit.client.0.smithi071.stderr: -53> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27424280) adding con mode: secure 2024-09-14T11:30:25.333 INFO:tasks.workunit.client.0.smithi071.stderr: -52> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27424280) adding con mode: crc 2024-09-14T11:30:25.333 INFO:tasks.workunit.client.0.smithi071.stderr: -51> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27424280) adding con mode: secure 2024-09-14T11:30:25.333 INFO:tasks.workunit.client.0.smithi071.stderr: -50> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27424280) adding con mode: crc 2024-09-14T11:30:25.333 INFO:tasks.workunit.client.0.smithi071.stderr: -49> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27424280) adding con mode: crc 2024-09-14T11:30:25.333 INFO:tasks.workunit.client.0.smithi071.stderr: -48> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27424280) adding con mode: secure 2024-09-14T11:30:25.333 INFO:tasks.workunit.client.0.smithi071.stderr: -47> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27424280) adding con mode: crc 2024-09-14T11:30:25.333 INFO:tasks.workunit.client.0.smithi071.stderr: -46> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27424280) adding con mode: secure 2024-09-14T11:30:25.333 INFO:tasks.workunit.client.0.smithi071.stderr: -45> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27424280) adding con mode: crc 2024-09-14T11:30:25.333 INFO:tasks.workunit.client.0.smithi071.stderr: -44> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27424280) adding con mode: secure 2024-09-14T11:30:25.333 INFO:tasks.workunit.client.0.smithi071.stderr: -43> 2024-09-14T11:30:25.256+0000 7f2d09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:25.333 INFO:tasks.workunit.client.0.smithi071.stderr: -42> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:25.333 INFO:tasks.workunit.client.0.smithi071.stderr: -41> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:25.334 INFO:tasks.workunit.client.0.smithi071.stderr: -40> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:25.334 INFO:tasks.workunit.client.0.smithi071.stderr: -39> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 asok(0x55cfc230dd90) register_command cache list hook 0x55cfc25e3310 2024-09-14T11:30:25.334 INFO:tasks.workunit.client.0.smithi071.stderr: -38> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 asok(0x55cfc230dd90) register_command cache inspect hook 0x55cfc25e3310 2024-09-14T11:30:25.334 INFO:tasks.workunit.client.0.smithi071.stderr: -37> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 asok(0x55cfc230dd90) register_command cache erase hook 0x55cfc25e3310 2024-09-14T11:30:25.334 INFO:tasks.workunit.client.0.smithi071.stderr: -36> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 asok(0x55cfc230dd90) register_command cache zap hook 0x55cfc25e3310 2024-09-14T11:30:25.334 INFO:tasks.workunit.client.0.smithi071.stderr: -35> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 note: GC not initialized 2024-09-14T11:30:25.334 INFO:tasks.workunit.client.0.smithi071.stderr: -34> 2024-09-14T11:30:25.256+0000 7f2d08fe1640 20 reqs_thread_entry: start 2024-09-14T11:30:25.334 INFO:tasks.workunit.client.0.smithi071.stderr: -33> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 asok(0x55cfc230dd90) register_command sync trace show hook 0x7f2e440ab430 2024-09-14T11:30:25.334 INFO:tasks.workunit.client.0.smithi071.stderr: -32> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 asok(0x55cfc230dd90) register_command sync trace history hook 0x7f2e440ab430 2024-09-14T11:30:25.334 INFO:tasks.workunit.client.0.smithi071.stderr: -31> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 asok(0x55cfc230dd90) register_command sync trace active hook 0x7f2e440ab430 2024-09-14T11:30:25.334 INFO:tasks.workunit.client.0.smithi071.stderr: -30> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 asok(0x55cfc230dd90) register_command sync trace active_short hook 0x7f2e440ab430 2024-09-14T11:30:25.334 INFO:tasks.workunit.client.0.smithi071.stderr: -29> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 20 init_complete bucket index max shards: 11 2024-09-14T11:30:25.334 INFO:tasks.workunit.client.0.smithi071.stderr: -28> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 20 Filter name: none 2024-09-14T11:30:25.335 INFO:tasks.workunit.client.0.smithi071.stderr: -27> 2024-09-14T11:30:25.256+0000 7f2c827fc640 20 reqs_thread_entry: start 2024-09-14T11:30:25.335 INFO:tasks.workunit.client.0.smithi071.stderr: -26> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:30:25.335 INFO:tasks.workunit.client.0.smithi071.stderr: -25> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.335 INFO:tasks.workunit.client.0.smithi071.stderr: -24> 2024-09-14T11:30:25.260+0000 7f2e55e289c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:25.335 INFO:tasks.workunit.client.0.smithi071.stderr: -23> 2024-09-14T11:30:25.260+0000 7f2e55e289c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:30:25.335 INFO:tasks.workunit.client.0.smithi071.stderr: -22> 2024-09-14T11:30:25.260+0000 7f2e55e289c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:30:25.335 INFO:tasks.workunit.client.0.smithi071.stderr: -21> 2024-09-14T11:30:25.260+0000 7f2e55e289c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 : miss 2024-09-14T11:30:25.335 INFO:tasks.workunit.client.0.smithi071.stderr: -20> 2024-09-14T11:30:25.260+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.335 INFO:tasks.workunit.client.0.smithi071.stderr: -19> 2024-09-14T11:30:25.260+0000 7f2e55e289c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:30:25.335 INFO:tasks.workunit.client.0.smithi071.stderr: -18> 2024-09-14T11:30:25.260+0000 7f2e55e289c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 info.flags=0x17 2024-09-14T11:30:25.335 INFO:tasks.workunit.client.0.smithi071.stderr: -17> 2024-09-14T11:30:25.260+0000 7f2e55e289c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 to cache LRU end 2024-09-14T11:30:25.335 INFO:tasks.workunit.client.0.smithi071.stderr: -16> 2024-09-14T11:30:25.260+0000 7f2e55e289c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:25.336 INFO:tasks.workunit.client.0.smithi071.stderr: -15> 2024-09-14T11:30:25.260+0000 7f2e55e289c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:25.336 INFO:tasks.workunit.client.0.smithi071.stderr: -14> 2024-09-14T11:30:25.260+0000 7f2e55e289c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 2024-09-14T11:30:25.336 INFO:tasks.workunit.client.0.smithi071.stderr: -13> 2024-09-14T11:30:25.268+0000 7f2e55e289c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 info.flags=0x17 2024-09-14T11:30:25.336 INFO:tasks.workunit.client.0.smithi071.stderr: -12> 2024-09-14T11:30:25.268+0000 7f2e55e289c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 to cache LRU end 2024-09-14T11:30:25.336 INFO:tasks.workunit.client.0.smithi071.stderr: -11> 2024-09-14T11:30:25.268+0000 7f2e55e289c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:25.336 INFO:tasks.workunit.client.0.smithi071.stderr: -10> 2024-09-14T11:30:25.268+0000 7f2e55e289c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28, ofs0, ns] 2024-09-14T11:30:25.336 INFO:tasks.workunit.client.0.smithi071.stderr: -9> 2024-09-14T11:30:25.268+0000 7f2d327fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464366 cookie 94350807721360 notifier 6834 bl.length()=1023 2024-09-14T11:30:25.336 INFO:tasks.workunit.client.0.smithi071.stderr: -8> 2024-09-14T11:30:25.268+0000 7f2d327fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 info.flags=0x17 2024-09-14T11:30:25.336 INFO:tasks.workunit.client.0.smithi071.stderr: -7> 2024-09-14T11:30:25.268+0000 7f2d327fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 to cache LRU end 2024-09-14T11:30:25.336 INFO:tasks.workunit.client.0.smithi071.stderr: -6> 2024-09-14T11:30:25.268+0000 7f2d327fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:25.336 INFO:tasks.workunit.client.0.smithi071.stderr: -5> 2024-09-14T11:30:25.268+0000 7f2e55e289c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.28]): orig_sources= new_sources= 2024-09-14T11:30:25.337 INFO:tasks.workunit.client.0.smithi071.stderr: -4> 2024-09-14T11:30:25.268+0000 7f2e55e289c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.28]): potential sources added=[] removed=[] 2024-09-14T11:30:25.337 INFO:tasks.workunit.client.0.smithi071.stderr: -3> 2024-09-14T11:30:25.268+0000 7f2e55e289c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.28]): orig_dests= new_dests= 2024-09-14T11:30:25.337 INFO:tasks.workunit.client.0.smithi071.stderr: -2> 2024-09-14T11:30:25.268+0000 7f2e55e289c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.28]): potential dests added=[] removed=[] 2024-09-14T11:30:25.337 INFO:tasks.workunit.client.0.smithi071.stderr: -1> 2024-09-14T11:30:25.272+0000 7f2e55e289c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2e55e289c0 time 2024-09-14T11:30:25.273928+0000 2024-09-14T11:30:25.337 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:30:25.337 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.337 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:25.337 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2e597022eb] 2024-09-14T11:30:25.337 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2e5970249f] 2024-09-14T11:30:25.337 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cfc0096c01] 2024-09-14T11:30:25.337 INFO:tasks.workunit.client.0.smithi071.stderr: 4: radosgw-admin(+0x14231ee) [0x55cfc0af51ee] 2024-09-14T11:30:25.337 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55cfc00abecd] 2024-09-14T11:30:25.338 INFO:tasks.workunit.client.0.smithi071.stderr: 6: main() 2024-09-14T11:30:25.338 INFO:tasks.workunit.client.0.smithi071.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2e58568d90] 2024-09-14T11:30:25.338 INFO:tasks.workunit.client.0.smithi071.stderr: 8: __libc_start_main() 2024-09-14T11:30:25.338 INFO:tasks.workunit.client.0.smithi071.stderr: 9: _start() 2024-09-14T11:30:25.338 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.338 INFO:tasks.workunit.client.0.smithi071.stderr: 0> 2024-09-14T11:30:25.272+0000 7f2e55e289c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:30:25.338 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f2e55e289c0 thread_name:radosgw-admin 2024-09-14T11:30:25.338 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.338 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:25.338 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2e58581520] 2024-09-14T11:30:25.338 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:30:25.338 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:30:25.338 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:30:25.338 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2e59702345] 2024-09-14T11:30:25.338 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2e5970249f] 2024-09-14T11:30:25.339 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cfc0096c01] 2024-09-14T11:30:25.339 INFO:tasks.workunit.client.0.smithi071.stderr: 8: radosgw-admin(+0x14231ee) [0x55cfc0af51ee] 2024-09-14T11:30:25.339 INFO:tasks.workunit.client.0.smithi071.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55cfc00abecd] 2024-09-14T11:30:25.339 INFO:tasks.workunit.client.0.smithi071.stderr: 10: main() 2024-09-14T11:30:25.339 INFO:tasks.workunit.client.0.smithi071.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2e58568d90] 2024-09-14T11:30:25.339 INFO:tasks.workunit.client.0.smithi071.stderr: 12: __libc_start_main() 2024-09-14T11:30:25.339 INFO:tasks.workunit.client.0.smithi071.stderr: 13: _start() 2024-09-14T11:30:25.339 INFO:tasks.workunit.client.0.smithi071.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:30:25.339 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.339 INFO:tasks.workunit.client.0.smithi071.stderr:--- logging levels --- 2024-09-14T11:30:25.339 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 none 2024-09-14T11:30:25.339 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 lockdep 2024-09-14T11:30:25.339 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 context 2024-09-14T11:30:25.339 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 crush 2024-09-14T11:30:25.339 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds 2024-09-14T11:30:25.340 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_balancer 2024-09-14T11:30:25.340 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_locker 2024-09-14T11:30:25.340 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log 2024-09-14T11:30:25.340 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log_expire 2024-09-14T11:30:25.340 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_migrator 2024-09-14T11:30:25.340 INFO:tasks.workunit.client.0.smithi071.stderr: 3/ 5 mds_quiesce 2024-09-14T11:30:25.340 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 buffer 2024-09-14T11:30:25.340 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 timer 2024-09-14T11:30:25.340 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 filer 2024-09-14T11:30:25.340 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 striper 2024-09-14T11:30:25.340 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 objecter 2024-09-14T11:30:25.340 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rados 2024-09-14T11:30:25.340 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd 2024-09-14T11:30:25.340 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_mirror 2024-09-14T11:30:25.340 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_replay 2024-09-14T11:30:25.341 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_pwl 2024-09-14T11:30:25.341 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 journaler 2024-09-14T11:30:25.341 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objectcacher 2024-09-14T11:30:25.341 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:30:25.341 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 client 2024-09-14T11:30:25.341 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 osd 2024-09-14T11:30:25.341 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 optracker 2024-09-14T11:30:25.341 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objclass 2024-09-14T11:30:25.341 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 filestore 2024-09-14T11:30:25.341 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 journal 2024-09-14T11:30:25.341 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 ms 2024-09-14T11:30:25.341 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mon 2024-09-14T11:30:25.341 INFO:tasks.workunit.client.0.smithi071.stderr: 0/10 monc 2024-09-14T11:30:25.341 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 paxos 2024-09-14T11:30:25.341 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 tp 2024-09-14T11:30:25.342 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 auth 2024-09-14T11:30:25.342 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 crypto 2024-09-14T11:30:25.342 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 finisher 2024-09-14T11:30:25.342 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 reserver 2024-09-14T11:30:25.342 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 heartbeatmap 2024-09-14T11:30:25.342 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 perfcounter 2024-09-14T11:30:25.342 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw 2024-09-14T11:30:25.342 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_sync 2024-09-14T11:30:25.342 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_datacache 2024-09-14T11:30:25.342 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_access 2024-09-14T11:30:25.342 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:30:25.342 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_flight 2024-09-14T11:30:25.342 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:30:25.342 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw_notification 2024-09-14T11:30:25.342 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 javaclient 2024-09-14T11:30:25.343 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 asok 2024-09-14T11:30:25.343 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 throttle 2024-09-14T11:30:25.343 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 refs 2024-09-14T11:30:25.343 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 compressor 2024-09-14T11:30:25.343 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluestore 2024-09-14T11:30:25.343 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluefs 2024-09-14T11:30:25.343 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 bdev 2024-09-14T11:30:25.343 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 kstore 2024-09-14T11:30:25.343 INFO:tasks.workunit.client.0.smithi071.stderr: 4/ 5 rocksdb 2024-09-14T11:30:25.343 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 fuse 2024-09-14T11:30:25.343 INFO:tasks.workunit.client.0.smithi071.stderr: 2/ 5 mgr 2024-09-14T11:30:25.343 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mgrc 2024-09-14T11:30:25.343 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 dpdk 2024-09-14T11:30:25.343 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 eventtrace 2024-09-14T11:30:25.343 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 prioritycache 2024-09-14T11:30:25.344 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 test 2024-09-14T11:30:25.344 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:30:25.344 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephsqlite 2024-09-14T11:30:25.344 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:30:25.344 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore 2024-09-14T11:30:25.344 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_onode 2024-09-14T11:30:25.344 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_odata 2024-09-14T11:30:25.344 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_omap 2024-09-14T11:30:25.344 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_tm 2024-09-14T11:30:25.344 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_t 2024-09-14T11:30:25.344 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:30:25.344 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_epm 2024-09-14T11:30:25.344 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_lba 2024-09-14T11:30:25.344 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:30:25.344 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cache 2024-09-14T11:30:25.345 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_journal 2024-09-14T11:30:25.345 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_device 2024-09-14T11:30:25.345 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_backref 2024-09-14T11:30:25.345 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 alienstore 2024-09-14T11:30:25.345 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mclock 2024-09-14T11:30:25.345 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cyanstore 2024-09-14T11:30:25.345 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 ceph_exporter 2024-09-14T11:30:25.345 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 memstore 2024-09-14T11:30:25.345 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 trace 2024-09-14T11:30:25.345 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 ceph_dedup 2024-09-14T11:30:25.345 INFO:tasks.workunit.client.0.smithi071.stderr: -2/-2 (syslog threshold) 2024-09-14T11:30:25.345 INFO:tasks.workunit.client.0.smithi071.stderr: 99/99 (stderr threshold) 2024-09-14T11:30:25.345 INFO:tasks.workunit.client.0.smithi071.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:30:25.345 INFO:tasks.workunit.client.0.smithi071.stderr: 7f2c827fc640 / http_manager 2024-09-14T11:30:25.346 INFO:tasks.workunit.client.0.smithi071.stderr: 7f2d08fe1640 / http_manager 2024-09-14T11:30:25.346 INFO:tasks.workunit.client.0.smithi071.stderr: 7f2d09fe3640 / rgw_dt_lg_renew 2024-09-14T11:30:25.346 INFO:tasks.workunit.client.0.smithi071.stderr: 7f2d317fa640 / ms_dispatch 2024-09-14T11:30:25.346 INFO:tasks.workunit.client.0.smithi071.stderr: 7f2d327fc640 / io_context_pool 2024-09-14T11:30:25.346 INFO:tasks.workunit.client.0.smithi071.stderr: 7f2d32ffd640 / io_context_pool 2024-09-14T11:30:25.346 INFO:tasks.workunit.client.0.smithi071.stderr: 7f2d397fa640 / ms_dispatch 2024-09-14T11:30:25.346 INFO:tasks.workunit.client.0.smithi071.stderr: 7f2d3bfff640 / ms_dispatch 2024-09-14T11:30:25.346 INFO:tasks.workunit.client.0.smithi071.stderr: 7f2d41e0b640 / io_context_pool 2024-09-14T11:30:25.346 INFO:tasks.workunit.client.0.smithi071.stderr: 7f2e5312d640 / msgr-worker-2 2024-09-14T11:30:25.346 INFO:tasks.workunit.client.0.smithi071.stderr: 7f2e5392e640 / msgr-worker-1 2024-09-14T11:30:25.346 INFO:tasks.workunit.client.0.smithi071.stderr: 7f2e5412f640 / msgr-worker-0 2024-09-14T11:30:25.346 INFO:tasks.workunit.client.0.smithi071.stderr: 7f2e54930640 / io_context_pool 2024-09-14T11:30:25.346 INFO:tasks.workunit.client.0.smithi071.stderr: 7f2e55e289c0 / radosgw-admin 2024-09-14T11:30:25.346 INFO:tasks.workunit.client.0.smithi071.stderr: max_recent 500 2024-09-14T11:30:25.347 INFO:tasks.workunit.client.0.smithi071.stderr: max_new 1000 2024-09-14T11:30:25.347 INFO:tasks.workunit.client.0.smithi071.stderr: log_file /var/log/ceph/ceph-client.admin.98443.log 2024-09-14T11:30:25.347 INFO:tasks.workunit.client.0.smithi071.stderr:--- end dump of recent events --- 2024-09-14T11:30:25.347 INFO:tasks.workunit.client.0.smithi071.stderr:--- begin dump of recent events --- 2024-09-14T11:30:25.347 INFO:tasks.workunit.client.0.smithi071.stderr: -499> 2024-09-14T11:30:24.956+0000 7f2e5312d640 1 monclient: found mon.noname-c 2024-09-14T11:30:25.347 INFO:tasks.workunit.client.0.smithi071.stderr: -498> 2024-09-14T11:30:24.956+0000 7f2e5312d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:30:25.347 INFO:tasks.workunit.client.0.smithi071.stderr: -497> 2024-09-14T11:30:24.956+0000 7f2d41e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:25.347 INFO:tasks.workunit.client.0.smithi071.stderr: -496> 2024-09-14T11:30:24.956+0000 7f2d41e0b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:30:25.347 INFO:tasks.workunit.client.0.smithi071.stderr: -495> 2024-09-14T11:30:24.956+0000 7f2d41e0b640 10 monclient: dump: 2024-09-14T11:30:25.347 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:30:25.347 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:30:25.347 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.348 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.348 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:25.348 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:30:25.348 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:30:25.348 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:30:25.348 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:30:25.348 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.348 INFO:tasks.workunit.client.0.smithi071.stderr: -494> 2024-09-14T11:30:24.956+0000 7f2d41e0b640 10 monclient: _finish_auth 0 2024-09-14T11:30:25.348 INFO:tasks.workunit.client.0.smithi071.stderr: -493> 2024-09-14T11:30:24.956+0000 7f2d41e0b640 10 monclient: _check_auth_tickets 2024-09-14T11:30:25.348 INFO:tasks.workunit.client.0.smithi071.stderr: -492> 2024-09-14T11:30:24.956+0000 7f2d41e0b640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:25.348 INFO:tasks.workunit.client.0.smithi071.stderr: -491> 2024-09-14T11:30:24.956+0000 7f2d41e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:25.348 INFO:tasks.workunit.client.0.smithi071.stderr: -490> 2024-09-14T11:30:24.956+0000 7f2d41e0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:30:25.348 INFO:tasks.workunit.client.0.smithi071.stderr: -489> 2024-09-14T11:30:24.956+0000 7f2d41e0b640 10 monclient: dump: 2024-09-14T11:30:25.349 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:30:25.349 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:30:25.349 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.349 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.349 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:25.349 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:30:25.349 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:30:25.349 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:30:25.349 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:30:25.349 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.349 INFO:tasks.workunit.client.0.smithi071.stderr: -488> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 monclient: authenticate success, global_id 6500 2024-09-14T11:30:25.349 INFO:tasks.workunit.client.0.smithi071.stderr: -487> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 10 monclient: get_monmap_and_config success 2024-09-14T11:30:25.349 INFO:tasks.workunit.client.0.smithi071.stderr: -486> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 4 set_mon_vals no callback set 2024-09-14T11:30:25.349 INFO:tasks.workunit.client.0.smithi071.stderr: -485> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 10 monclient: shutdown 2024-09-14T11:30:25.349 INFO:tasks.workunit.client.0.smithi071.stderr: -484> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 asok(0x55cfc230dd90) unregister_commands rotate-key 2024-09-14T11:30:25.350 INFO:tasks.workunit.client.0.smithi071.stderr: -483> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 10 monclient: build_initial_monmap 2024-09-14T11:30:25.350 INFO:tasks.workunit.client.0.smithi071.stderr: -482> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 1 build_initial for_mkfs: 0 2024-09-14T11:30:25.350 INFO:tasks.workunit.client.0.smithi071.stderr: -481> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 10 monclient: monmap: 2024-09-14T11:30:25.350 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:30:25.350 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:25.350 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:30:25.350 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:30:25.350 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:25.350 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:30:25.350 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:30:25.350 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:30:25.350 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:30:25.350 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.350 INFO:tasks.workunit.client.0.smithi071.stderr: -480> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc251c5e0) adding auth protocol: cephx 2024-09-14T11:30:25.350 INFO:tasks.workunit.client.0.smithi071.stderr: -479> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc251c5e0) adding auth protocol: cephx 2024-09-14T11:30:25.351 INFO:tasks.workunit.client.0.smithi071.stderr: -478> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc251c5e0) adding auth protocol: cephx 2024-09-14T11:30:25.351 INFO:tasks.workunit.client.0.smithi071.stderr: -477> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc251c5e0) adding con mode: secure 2024-09-14T11:30:25.351 INFO:tasks.workunit.client.0.smithi071.stderr: -476> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc251c5e0) adding con mode: crc 2024-09-14T11:30:25.351 INFO:tasks.workunit.client.0.smithi071.stderr: -475> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc251c5e0) adding con mode: secure 2024-09-14T11:30:25.351 INFO:tasks.workunit.client.0.smithi071.stderr: -474> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc251c5e0) adding con mode: crc 2024-09-14T11:30:25.351 INFO:tasks.workunit.client.0.smithi071.stderr: -473> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc251c5e0) adding con mode: secure 2024-09-14T11:30:25.351 INFO:tasks.workunit.client.0.smithi071.stderr: -472> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc251c5e0) adding con mode: crc 2024-09-14T11:30:25.351 INFO:tasks.workunit.client.0.smithi071.stderr: -471> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc251c5e0) adding con mode: crc 2024-09-14T11:30:25.351 INFO:tasks.workunit.client.0.smithi071.stderr: -470> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc251c5e0) adding con mode: secure 2024-09-14T11:30:25.351 INFO:tasks.workunit.client.0.smithi071.stderr: -469> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc251c5e0) adding con mode: crc 2024-09-14T11:30:25.351 INFO:tasks.workunit.client.0.smithi071.stderr: -468> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc251c5e0) adding con mode: secure 2024-09-14T11:30:25.351 INFO:tasks.workunit.client.0.smithi071.stderr: -467> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc251c5e0) adding con mode: crc 2024-09-14T11:30:25.351 INFO:tasks.workunit.client.0.smithi071.stderr: -466> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc251c5e0) adding con mode: secure 2024-09-14T11:30:25.351 INFO:tasks.workunit.client.0.smithi071.stderr: -465> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:25.351 INFO:tasks.workunit.client.0.smithi071.stderr: -464> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 1 librados: starting msgr at 2024-09-14T11:30:25.351 INFO:tasks.workunit.client.0.smithi071.stderr: -463> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 1 librados: starting objecter 2024-09-14T11:30:25.352 INFO:tasks.workunit.client.0.smithi071.stderr: -462> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 asok(0x55cfc230dd90) register_command objecter_requests hook 0x55cfc2520e20 2024-09-14T11:30:25.352 INFO:tasks.workunit.client.0.smithi071.stderr: -461> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 1 librados: setting wanted keys 2024-09-14T11:30:25.352 INFO:tasks.workunit.client.0.smithi071.stderr: -460> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 1 librados: calling monclient init 2024-09-14T11:30:25.352 INFO:tasks.workunit.client.0.smithi071.stderr: -459> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 10 monclient: init 2024-09-14T11:30:25.352 INFO:tasks.workunit.client.0.smithi071.stderr: -458> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25194d0) adding auth protocol: cephx 2024-09-14T11:30:25.352 INFO:tasks.workunit.client.0.smithi071.stderr: -457> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25194d0) adding auth protocol: cephx 2024-09-14T11:30:25.352 INFO:tasks.workunit.client.0.smithi071.stderr: -456> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25194d0) adding auth protocol: cephx 2024-09-14T11:30:25.352 INFO:tasks.workunit.client.0.smithi071.stderr: -455> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25194d0) adding con mode: secure 2024-09-14T11:30:25.352 INFO:tasks.workunit.client.0.smithi071.stderr: -454> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25194d0) adding con mode: crc 2024-09-14T11:30:25.352 INFO:tasks.workunit.client.0.smithi071.stderr: -453> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25194d0) adding con mode: secure 2024-09-14T11:30:25.352 INFO:tasks.workunit.client.0.smithi071.stderr: -452> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25194d0) adding con mode: crc 2024-09-14T11:30:25.352 INFO:tasks.workunit.client.0.smithi071.stderr: -451> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25194d0) adding con mode: secure 2024-09-14T11:30:25.352 INFO:tasks.workunit.client.0.smithi071.stderr: -450> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25194d0) adding con mode: crc 2024-09-14T11:30:25.352 INFO:tasks.workunit.client.0.smithi071.stderr: -449> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25194d0) adding con mode: crc 2024-09-14T11:30:25.353 INFO:tasks.workunit.client.0.smithi071.stderr: -448> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25194d0) adding con mode: secure 2024-09-14T11:30:25.353 INFO:tasks.workunit.client.0.smithi071.stderr: -447> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25194d0) adding con mode: crc 2024-09-14T11:30:25.353 INFO:tasks.workunit.client.0.smithi071.stderr: -446> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25194d0) adding con mode: secure 2024-09-14T11:30:25.353 INFO:tasks.workunit.client.0.smithi071.stderr: -445> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25194d0) adding con mode: crc 2024-09-14T11:30:25.353 INFO:tasks.workunit.client.0.smithi071.stderr: -444> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25194d0) adding con mode: secure 2024-09-14T11:30:25.353 INFO:tasks.workunit.client.0.smithi071.stderr: -443> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:25.353 INFO:tasks.workunit.client.0.smithi071.stderr: -442> 2024-09-14T11:30:24.956+0000 7f2e55e289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:25.353 INFO:tasks.workunit.client.0.smithi071.stderr: -441> 2024-09-14T11:30:24.960+0000 7f2e55e289c0 5 asok(0x55cfc230dd90) register_command rotate-key hook 0x55cfc2519618 2024-09-14T11:30:25.353 INFO:tasks.workunit.client.0.smithi071.stderr: -440> 2024-09-14T11:30:24.960+0000 7f2e55e289c0 10 monclient: _reopen_session rank -1 2024-09-14T11:30:25.353 INFO:tasks.workunit.client.0.smithi071.stderr: -439> 2024-09-14T11:30:24.960+0000 7f2e55e289c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:30:25.353 INFO:tasks.workunit.client.0.smithi071.stderr: -438> 2024-09-14T11:30:24.960+0000 7f2e55e289c0 10 monclient(hunting): picked mon.noname-b con 0x55cfc23d27a0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:30:25.353 INFO:tasks.workunit.client.0.smithi071.stderr: -437> 2024-09-14T11:30:24.960+0000 7f2e55e289c0 10 monclient(hunting): picked mon.noname-c con 0x55cfc23d7a10 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:30:25.353 INFO:tasks.workunit.client.0.smithi071.stderr: -436> 2024-09-14T11:30:24.960+0000 7f2e55e289c0 10 monclient(hunting): picked mon.noname-a con 0x55cfc245f3b0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:30:25.353 INFO:tasks.workunit.client.0.smithi071.stderr: -435> 2024-09-14T11:30:24.960+0000 7f2e55e289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:25.353 INFO:tasks.workunit.client.0.smithi071.stderr: -434> 2024-09-14T11:30:24.960+0000 7f2e55e289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:25.354 INFO:tasks.workunit.client.0.smithi071.stderr: -433> 2024-09-14T11:30:24.960+0000 7f2e55e289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:25.354 INFO:tasks.workunit.client.0.smithi071.stderr: -432> 2024-09-14T11:30:24.960+0000 7f2e55e289c0 10 monclient(hunting): _renew_subs 2024-09-14T11:30:25.354 INFO:tasks.workunit.client.0.smithi071.stderr: -431> 2024-09-14T11:30:24.960+0000 7f2e55e289c0 10 monclient(hunting): authenticate will time out at 2237.080084s 2024-09-14T11:30:25.354 INFO:tasks.workunit.client.0.smithi071.stderr: -430> 2024-09-14T11:30:24.960+0000 7f2e5312d640 10 monclient(hunting): get_auth_request con 0x55cfc23d7a10 auth_method 0 2024-09-14T11:30:25.354 INFO:tasks.workunit.client.0.smithi071.stderr: -429> 2024-09-14T11:30:24.960+0000 7f2e5312d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:25.354 INFO:tasks.workunit.client.0.smithi071.stderr: -428> 2024-09-14T11:30:24.960+0000 7f2e5312d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:25.354 INFO:tasks.workunit.client.0.smithi071.stderr: -427> 2024-09-14T11:30:24.960+0000 7f2e5312d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:25.354 INFO:tasks.workunit.client.0.smithi071.stderr: -426> 2024-09-14T11:30:24.960+0000 7f2e5412f640 10 monclient(hunting): get_auth_request con 0x55cfc245f3b0 auth_method 0 2024-09-14T11:30:25.354 INFO:tasks.workunit.client.0.smithi071.stderr: -425> 2024-09-14T11:30:24.960+0000 7f2e5412f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:25.354 INFO:tasks.workunit.client.0.smithi071.stderr: -424> 2024-09-14T11:30:24.960+0000 7f2e5412f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:25.354 INFO:tasks.workunit.client.0.smithi071.stderr: -423> 2024-09-14T11:30:24.960+0000 7f2e5412f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:25.354 INFO:tasks.workunit.client.0.smithi071.stderr: -422> 2024-09-14T11:30:24.960+0000 7f2e5312d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:25.354 INFO:tasks.workunit.client.0.smithi071.stderr: -421> 2024-09-14T11:30:24.960+0000 7f2e5312d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:25.354 INFO:tasks.workunit.client.0.smithi071.stderr: -420> 2024-09-14T11:30:24.960+0000 7f2e5312d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:25.354 INFO:tasks.workunit.client.0.smithi071.stderr: -419> 2024-09-14T11:30:24.960+0000 7f2e5412f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:25.355 INFO:tasks.workunit.client.0.smithi071.stderr: -418> 2024-09-14T11:30:24.960+0000 7f2e5412f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:25.355 INFO:tasks.workunit.client.0.smithi071.stderr: -417> 2024-09-14T11:30:24.960+0000 7f2e5412f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:25.355 INFO:tasks.workunit.client.0.smithi071.stderr: -416> 2024-09-14T11:30:24.960+0000 7f2e5392e640 10 monclient(hunting): get_auth_request con 0x55cfc23d27a0 auth_method 0 2024-09-14T11:30:25.355 INFO:tasks.workunit.client.0.smithi071.stderr: -415> 2024-09-14T11:30:24.960+0000 7f2e5392e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:25.355 INFO:tasks.workunit.client.0.smithi071.stderr: -414> 2024-09-14T11:30:24.960+0000 7f2e5392e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:25.355 INFO:tasks.workunit.client.0.smithi071.stderr: -413> 2024-09-14T11:30:24.960+0000 7f2e5392e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:25.355 INFO:tasks.workunit.client.0.smithi071.stderr: -412> 2024-09-14T11:30:24.960+0000 7f2e5312d640 10 monclient(hunting): handle_auth_done global_id 6503 payload 824 2024-09-14T11:30:25.355 INFO:tasks.workunit.client.0.smithi071.stderr: -411> 2024-09-14T11:30:24.960+0000 7f2e5312d640 10 monclient: _finish_hunting 0 2024-09-14T11:30:25.355 INFO:tasks.workunit.client.0.smithi071.stderr: -410> 2024-09-14T11:30:24.960+0000 7f2e5312d640 1 monclient: found mon.noname-c 2024-09-14T11:30:25.355 INFO:tasks.workunit.client.0.smithi071.stderr: -409> 2024-09-14T11:30:24.960+0000 7f2e5312d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:30:25.355 INFO:tasks.workunit.client.0.smithi071.stderr: -408> 2024-09-14T11:30:24.960+0000 7f2d3bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:25.355 INFO:tasks.workunit.client.0.smithi071.stderr: -407> 2024-09-14T11:30:24.960+0000 7f2d3bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:30:25.355 INFO:tasks.workunit.client.0.smithi071.stderr: -406> 2024-09-14T11:30:24.960+0000 7f2d3bfff640 10 monclient: dump: 2024-09-14T11:30:25.355 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:30:25.356 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:30:25.356 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.356 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.356 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:25.356 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:30:25.356 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:30:25.356 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:30:25.356 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:30:25.356 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.356 INFO:tasks.workunit.client.0.smithi071.stderr: -405> 2024-09-14T11:30:24.960+0000 7f2d3bfff640 10 monclient: _finish_auth 0 2024-09-14T11:30:25.356 INFO:tasks.workunit.client.0.smithi071.stderr: -404> 2024-09-14T11:30:24.960+0000 7f2d3bfff640 10 monclient: _check_auth_tickets 2024-09-14T11:30:25.356 INFO:tasks.workunit.client.0.smithi071.stderr: -403> 2024-09-14T11:30:24.960+0000 7f2d3bfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:25.356 INFO:tasks.workunit.client.0.smithi071.stderr: -402> 2024-09-14T11:30:24.960+0000 7f2d3bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:25.357 INFO:tasks.workunit.client.0.smithi071.stderr: -401> 2024-09-14T11:30:24.960+0000 7f2d3bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:30:25.357 INFO:tasks.workunit.client.0.smithi071.stderr: -400> 2024-09-14T11:30:24.960+0000 7f2d3bfff640 10 monclient: dump: 2024-09-14T11:30:25.357 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:30:25.357 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:30:25.357 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.357 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.357 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:25.357 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:30:25.357 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:30:25.357 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:30:25.357 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:30:25.357 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.357 INFO:tasks.workunit.client.0.smithi071.stderr: -399> 2024-09-14T11:30:24.960+0000 7f2d41e0b640 4 set_mon_vals no callback set 2024-09-14T11:30:25.357 INFO:tasks.workunit.client.0.smithi071.stderr: -398> 2024-09-14T11:30:24.960+0000 7f2e55e289c0 5 monclient: authenticate success, global_id 6503 2024-09-14T11:30:25.357 INFO:tasks.workunit.client.0.smithi071.stderr: -397> 2024-09-14T11:30:24.960+0000 7f2e55e289c0 10 monclient: _renew_subs 2024-09-14T11:30:25.358 INFO:tasks.workunit.client.0.smithi071.stderr: -396> 2024-09-14T11:30:24.960+0000 7f2e55e289c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:30:25.358 INFO:tasks.workunit.client.0.smithi071.stderr: -395> 2024-09-14T11:30:24.960+0000 7f2e55e289c0 10 monclient: _renew_subs 2024-09-14T11:30:25.358 INFO:tasks.workunit.client.0.smithi071.stderr: -394> 2024-09-14T11:30:24.960+0000 7f2e55e289c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:30:25.358 INFO:tasks.workunit.client.0.smithi071.stderr: -393> 2024-09-14T11:30:24.960+0000 7f2e55e289c0 1 librados: init done 2024-09-14T11:30:25.358 INFO:tasks.workunit.client.0.smithi071.stderr: -392> 2024-09-14T11:30:24.960+0000 7f2d3bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:30:25.358 INFO:tasks.workunit.client.0.smithi071.stderr: -391> 2024-09-14T11:30:24.960+0000 7f2d3bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:30:25.358 INFO:tasks.workunit.client.0.smithi071.stderr: -390> 2024-09-14T11:30:24.960+0000 7f2d3bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:30:25.358 INFO:tasks.workunit.client.0.smithi071.stderr: -389> 2024-09-14T11:30:24.960+0000 7f2e5392e640 10 monclient: get_auth_request con 0x7f2d3c0718a0 auth_method 0 2024-09-14T11:30:25.358 INFO:tasks.workunit.client.0.smithi071.stderr: -388> 2024-09-14T11:30:24.964+0000 7f2e5412f640 10 monclient: get_auth_request con 0x55cfc25414c0 auth_method 0 2024-09-14T11:30:25.358 INFO:tasks.workunit.client.0.smithi071.stderr: -387> 2024-09-14T11:30:24.964+0000 7f2e5392e640 10 monclient: get_auth_request con 0x55cfc2564130 auth_method 0 2024-09-14T11:30:25.358 INFO:tasks.workunit.client.0.smithi071.stderr: -386> 2024-09-14T11:30:24.964+0000 7f2e5312d640 10 monclient: get_auth_request con 0x55cfc2568490 auth_method 0 2024-09-14T11:30:25.358 INFO:tasks.workunit.client.0.smithi071.stderr: -385> 2024-09-14T11:30:24.964+0000 7f2e5412f640 10 monclient: get_auth_request con 0x55cfc25679e0 auth_method 0 2024-09-14T11:30:25.358 INFO:tasks.workunit.client.0.smithi071.stderr: -384> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 10 monclient: build_initial_monmap 2024-09-14T11:30:25.359 INFO:tasks.workunit.client.0.smithi071.stderr: -383> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 1 build_initial for_mkfs: 0 2024-09-14T11:30:25.359 INFO:tasks.workunit.client.0.smithi071.stderr: -382> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 10 monclient: monmap: 2024-09-14T11:30:25.359 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:30:25.359 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:25.359 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:30:25.359 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:30:25.359 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:25.359 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:30:25.359 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:30:25.359 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:30:25.359 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:30:25.359 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.359 INFO:tasks.workunit.client.0.smithi071.stderr: -381> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25705f0) adding auth protocol: cephx 2024-09-14T11:30:25.359 INFO:tasks.workunit.client.0.smithi071.stderr: -380> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25705f0) adding auth protocol: cephx 2024-09-14T11:30:25.359 INFO:tasks.workunit.client.0.smithi071.stderr: -379> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25705f0) adding auth protocol: cephx 2024-09-14T11:30:25.360 INFO:tasks.workunit.client.0.smithi071.stderr: -378> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25705f0) adding con mode: secure 2024-09-14T11:30:25.360 INFO:tasks.workunit.client.0.smithi071.stderr: -377> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25705f0) adding con mode: crc 2024-09-14T11:30:25.360 INFO:tasks.workunit.client.0.smithi071.stderr: -376> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25705f0) adding con mode: secure 2024-09-14T11:30:25.360 INFO:tasks.workunit.client.0.smithi071.stderr: -375> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25705f0) adding con mode: crc 2024-09-14T11:30:25.360 INFO:tasks.workunit.client.0.smithi071.stderr: -374> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25705f0) adding con mode: secure 2024-09-14T11:30:25.360 INFO:tasks.workunit.client.0.smithi071.stderr: -373> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25705f0) adding con mode: crc 2024-09-14T11:30:25.360 INFO:tasks.workunit.client.0.smithi071.stderr: -372> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25705f0) adding con mode: crc 2024-09-14T11:30:25.360 INFO:tasks.workunit.client.0.smithi071.stderr: -371> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25705f0) adding con mode: secure 2024-09-14T11:30:25.360 INFO:tasks.workunit.client.0.smithi071.stderr: -370> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25705f0) adding con mode: crc 2024-09-14T11:30:25.360 INFO:tasks.workunit.client.0.smithi071.stderr: -369> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25705f0) adding con mode: secure 2024-09-14T11:30:25.360 INFO:tasks.workunit.client.0.smithi071.stderr: -368> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25705f0) adding con mode: crc 2024-09-14T11:30:25.361 INFO:tasks.workunit.client.0.smithi071.stderr: -367> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25705f0) adding con mode: secure 2024-09-14T11:30:25.361 INFO:tasks.workunit.client.0.smithi071.stderr: -366> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:25.361 INFO:tasks.workunit.client.0.smithi071.stderr: -365> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 asok(0x55cfc230dd90) register_command objecter_requests cmddesc objecter_requests hook 0x55cfc2573fe0 EEXIST 2024-09-14T11:30:25.361 INFO:tasks.workunit.client.0.smithi071.stderr: -364> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 10 monclient: init 2024-09-14T11:30:25.361 INFO:tasks.workunit.client.0.smithi071.stderr: -363> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc256f4e8) adding auth protocol: cephx 2024-09-14T11:30:25.361 INFO:tasks.workunit.client.0.smithi071.stderr: -362> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc256f4e8) adding auth protocol: cephx 2024-09-14T11:30:25.361 INFO:tasks.workunit.client.0.smithi071.stderr: -361> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc256f4e8) adding auth protocol: cephx 2024-09-14T11:30:25.361 INFO:tasks.workunit.client.0.smithi071.stderr: -360> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc256f4e8) adding con mode: secure 2024-09-14T11:30:25.361 INFO:tasks.workunit.client.0.smithi071.stderr: -359> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc256f4e8) adding con mode: crc 2024-09-14T11:30:25.361 INFO:tasks.workunit.client.0.smithi071.stderr: -358> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc256f4e8) adding con mode: secure 2024-09-14T11:30:25.361 INFO:tasks.workunit.client.0.smithi071.stderr: -357> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc256f4e8) adding con mode: crc 2024-09-14T11:30:25.361 INFO:tasks.workunit.client.0.smithi071.stderr: -356> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc256f4e8) adding con mode: secure 2024-09-14T11:30:25.361 INFO:tasks.workunit.client.0.smithi071.stderr: -355> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc256f4e8) adding con mode: crc 2024-09-14T11:30:25.361 INFO:tasks.workunit.client.0.smithi071.stderr: -354> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc256f4e8) adding con mode: crc 2024-09-14T11:30:25.362 INFO:tasks.workunit.client.0.smithi071.stderr: -353> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc256f4e8) adding con mode: secure 2024-09-14T11:30:25.362 INFO:tasks.workunit.client.0.smithi071.stderr: -352> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc256f4e8) adding con mode: crc 2024-09-14T11:30:25.362 INFO:tasks.workunit.client.0.smithi071.stderr: -351> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc256f4e8) adding con mode: secure 2024-09-14T11:30:25.362 INFO:tasks.workunit.client.0.smithi071.stderr: -350> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc256f4e8) adding con mode: crc 2024-09-14T11:30:25.362 INFO:tasks.workunit.client.0.smithi071.stderr: -349> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc256f4e8) adding con mode: secure 2024-09-14T11:30:25.362 INFO:tasks.workunit.client.0.smithi071.stderr: -348> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:25.362 INFO:tasks.workunit.client.0.smithi071.stderr: -347> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:25.362 INFO:tasks.workunit.client.0.smithi071.stderr: -346> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 5 asok(0x55cfc230dd90) register_command rotate-key cmddesc rotate-key hook 0x55cfc256f630 EEXIST 2024-09-14T11:30:25.362 INFO:tasks.workunit.client.0.smithi071.stderr: -345> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 10 monclient: _reopen_session rank -1 2024-09-14T11:30:25.362 INFO:tasks.workunit.client.0.smithi071.stderr: -344> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:30:25.362 INFO:tasks.workunit.client.0.smithi071.stderr: -343> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 10 monclient(hunting): picked mon.noname-a con 0x55cfc2598190 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:30:25.362 INFO:tasks.workunit.client.0.smithi071.stderr: -342> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 10 monclient(hunting): picked mon.noname-c con 0x55cfc2597ac0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:30:25.362 INFO:tasks.workunit.client.0.smithi071.stderr: -341> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 10 monclient(hunting): picked mon.noname-b con 0x55cfc25964a0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:30:25.362 INFO:tasks.workunit.client.0.smithi071.stderr: -340> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:25.362 INFO:tasks.workunit.client.0.smithi071.stderr: -339> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:25.363 INFO:tasks.workunit.client.0.smithi071.stderr: -338> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:25.363 INFO:tasks.workunit.client.0.smithi071.stderr: -337> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 10 monclient(hunting): _renew_subs 2024-09-14T11:30:25.363 INFO:tasks.workunit.client.0.smithi071.stderr: -336> 2024-09-14T11:30:24.968+0000 7f2e55e289c0 10 monclient(hunting): authenticate will time out at 2237.090558s 2024-09-14T11:30:25.363 INFO:tasks.workunit.client.0.smithi071.stderr: -335> 2024-09-14T11:30:24.968+0000 7f2e5312d640 10 monclient(hunting): get_auth_request con 0x55cfc2598190 auth_method 0 2024-09-14T11:30:25.363 INFO:tasks.workunit.client.0.smithi071.stderr: -334> 2024-09-14T11:30:24.968+0000 7f2e5312d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:25.363 INFO:tasks.workunit.client.0.smithi071.stderr: -333> 2024-09-14T11:30:24.968+0000 7f2e5312d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:25.363 INFO:tasks.workunit.client.0.smithi071.stderr: -332> 2024-09-14T11:30:24.968+0000 7f2e5312d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:25.363 INFO:tasks.workunit.client.0.smithi071.stderr: -331> 2024-09-14T11:30:24.968+0000 7f2e5412f640 10 monclient(hunting): get_auth_request con 0x55cfc2597ac0 auth_method 0 2024-09-14T11:30:25.363 INFO:tasks.workunit.client.0.smithi071.stderr: -330> 2024-09-14T11:30:24.968+0000 7f2e5412f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:25.363 INFO:tasks.workunit.client.0.smithi071.stderr: -329> 2024-09-14T11:30:24.968+0000 7f2e5412f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:25.363 INFO:tasks.workunit.client.0.smithi071.stderr: -328> 2024-09-14T11:30:24.968+0000 7f2e5412f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:25.363 INFO:tasks.workunit.client.0.smithi071.stderr: -327> 2024-09-14T11:30:24.968+0000 7f2e5312d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:25.364 INFO:tasks.workunit.client.0.smithi071.stderr: -326> 2024-09-14T11:30:24.968+0000 7f2e5312d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:25.364 INFO:tasks.workunit.client.0.smithi071.stderr: -325> 2024-09-14T11:30:24.968+0000 7f2e5312d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:25.364 INFO:tasks.workunit.client.0.smithi071.stderr: -324> 2024-09-14T11:30:24.968+0000 7f2e5412f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:25.364 INFO:tasks.workunit.client.0.smithi071.stderr: -323> 2024-09-14T11:30:24.968+0000 7f2e5412f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:25.364 INFO:tasks.workunit.client.0.smithi071.stderr: -322> 2024-09-14T11:30:24.968+0000 7f2e5412f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:25.364 INFO:tasks.workunit.client.0.smithi071.stderr: -321> 2024-09-14T11:30:24.968+0000 7f2e5392e640 10 monclient(hunting): get_auth_request con 0x55cfc25964a0 auth_method 0 2024-09-14T11:30:25.364 INFO:tasks.workunit.client.0.smithi071.stderr: -320> 2024-09-14T11:30:24.968+0000 7f2e5392e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:25.364 INFO:tasks.workunit.client.0.smithi071.stderr: -319> 2024-09-14T11:30:24.968+0000 7f2e5392e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:25.364 INFO:tasks.workunit.client.0.smithi071.stderr: -318> 2024-09-14T11:30:24.968+0000 7f2e5392e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:25.364 INFO:tasks.workunit.client.0.smithi071.stderr: -317> 2024-09-14T11:30:24.968+0000 7f2e5312d640 10 monclient(hunting): handle_auth_done global_id 6828 payload 824 2024-09-14T11:30:25.364 INFO:tasks.workunit.client.0.smithi071.stderr: -316> 2024-09-14T11:30:24.968+0000 7f2e5312d640 10 monclient: _finish_hunting 0 2024-09-14T11:30:25.364 INFO:tasks.workunit.client.0.smithi071.stderr: -315> 2024-09-14T11:30:24.968+0000 7f2e5312d640 1 monclient: found mon.noname-a 2024-09-14T11:30:25.364 INFO:tasks.workunit.client.0.smithi071.stderr: -314> 2024-09-14T11:30:24.968+0000 7f2e5312d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:30:25.364 INFO:tasks.workunit.client.0.smithi071.stderr: -313> 2024-09-14T11:30:24.968+0000 7f2d397fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:25.365 INFO:tasks.workunit.client.0.smithi071.stderr: -312> 2024-09-14T11:30:24.968+0000 7f2d397fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:30:25.365 INFO:tasks.workunit.client.0.smithi071.stderr: -311> 2024-09-14T11:30:24.968+0000 7f2d397fa640 10 monclient: dump: 2024-09-14T11:30:25.365 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:30:25.365 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:30:25.365 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.365 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.365 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:25.365 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:30:25.365 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:30:25.365 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:30:25.365 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:30:25.365 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.365 INFO:tasks.workunit.client.0.smithi071.stderr: -310> 2024-09-14T11:30:24.968+0000 7f2d397fa640 10 monclient: _finish_auth 0 2024-09-14T11:30:25.365 INFO:tasks.workunit.client.0.smithi071.stderr: -309> 2024-09-14T11:30:24.968+0000 7f2d397fa640 10 monclient: _check_auth_tickets 2024-09-14T11:30:25.366 INFO:tasks.workunit.client.0.smithi071.stderr: -308> 2024-09-14T11:30:24.968+0000 7f2d397fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:25.366 INFO:tasks.workunit.client.0.smithi071.stderr: -307> 2024-09-14T11:30:24.968+0000 7f2d397fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:25.366 INFO:tasks.workunit.client.0.smithi071.stderr: -306> 2024-09-14T11:30:24.968+0000 7f2d397fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:30:25.366 INFO:tasks.workunit.client.0.smithi071.stderr: -305> 2024-09-14T11:30:24.968+0000 7f2d397fa640 10 monclient: dump: 2024-09-14T11:30:25.366 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:30:25.366 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:30:25.366 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.366 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.366 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:25.366 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:30:25.366 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:30:25.366 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:30:25.366 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:30:25.366 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.366 INFO:tasks.workunit.client.0.smithi071.stderr: -304> 2024-09-14T11:30:24.968+0000 7f2e54930640 4 set_mon_vals no callback set 2024-09-14T11:30:25.367 INFO:tasks.workunit.client.0.smithi071.stderr: -303> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 monclient: authenticate success, global_id 6828 2024-09-14T11:30:25.367 INFO:tasks.workunit.client.0.smithi071.stderr: -302> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient: _renew_subs 2024-09-14T11:30:25.367 INFO:tasks.workunit.client.0.smithi071.stderr: -301> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:30:25.367 INFO:tasks.workunit.client.0.smithi071.stderr: -300> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient: _renew_subs 2024-09-14T11:30:25.367 INFO:tasks.workunit.client.0.smithi071.stderr: -299> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:30:25.367 INFO:tasks.workunit.client.0.smithi071.stderr: -298> 2024-09-14T11:30:24.972+0000 7f2d397fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:30:25.367 INFO:tasks.workunit.client.0.smithi071.stderr: -297> 2024-09-14T11:30:24.972+0000 7f2d397fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:30:25.367 INFO:tasks.workunit.client.0.smithi071.stderr: -296> 2024-09-14T11:30:24.972+0000 7f2d397fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:30:25.367 INFO:tasks.workunit.client.0.smithi071.stderr: -295> 2024-09-14T11:30:24.972+0000 7f2e5412f640 10 monclient: get_auth_request con 0x7f2d2c0717e0 auth_method 0 2024-09-14T11:30:25.367 INFO:tasks.workunit.client.0.smithi071.stderr: -294> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient: get_monmap_and_config 2024-09-14T11:30:25.367 INFO:tasks.workunit.client.0.smithi071.stderr: -293> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient: build_initial_monmap 2024-09-14T11:30:25.367 INFO:tasks.workunit.client.0.smithi071.stderr: -292> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 1 build_initial for_mkfs: 0 2024-09-14T11:30:25.367 INFO:tasks.workunit.client.0.smithi071.stderr: -291> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient: monmap: 2024-09-14T11:30:25.368 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:30:25.368 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:25.368 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:30:25.368 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:30:25.368 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:25.368 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:30:25.368 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:30:25.368 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:30:25.368 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:30:25.368 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.368 INFO:tasks.workunit.client.0.smithi071.stderr: -290> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25b76a0) adding auth protocol: cephx 2024-09-14T11:30:25.368 INFO:tasks.workunit.client.0.smithi071.stderr: -289> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25b76a0) adding auth protocol: cephx 2024-09-14T11:30:25.368 INFO:tasks.workunit.client.0.smithi071.stderr: -288> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25b76a0) adding auth protocol: cephx 2024-09-14T11:30:25.369 INFO:tasks.workunit.client.0.smithi071.stderr: -287> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25b76a0) adding con mode: secure 2024-09-14T11:30:25.369 INFO:tasks.workunit.client.0.smithi071.stderr: -286> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25b76a0) adding con mode: crc 2024-09-14T11:30:25.369 INFO:tasks.workunit.client.0.smithi071.stderr: -285> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25b76a0) adding con mode: secure 2024-09-14T11:30:25.369 INFO:tasks.workunit.client.0.smithi071.stderr: -284> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25b76a0) adding con mode: crc 2024-09-14T11:30:25.369 INFO:tasks.workunit.client.0.smithi071.stderr: -283> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25b76a0) adding con mode: secure 2024-09-14T11:30:25.369 INFO:tasks.workunit.client.0.smithi071.stderr: -282> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25b76a0) adding con mode: crc 2024-09-14T11:30:25.369 INFO:tasks.workunit.client.0.smithi071.stderr: -281> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25b76a0) adding con mode: crc 2024-09-14T11:30:25.369 INFO:tasks.workunit.client.0.smithi071.stderr: -280> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25b76a0) adding con mode: secure 2024-09-14T11:30:25.369 INFO:tasks.workunit.client.0.smithi071.stderr: -279> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25b76a0) adding con mode: crc 2024-09-14T11:30:25.369 INFO:tasks.workunit.client.0.smithi071.stderr: -278> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25b76a0) adding con mode: secure 2024-09-14T11:30:25.369 INFO:tasks.workunit.client.0.smithi071.stderr: -277> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25b76a0) adding con mode: crc 2024-09-14T11:30:25.370 INFO:tasks.workunit.client.0.smithi071.stderr: -276> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25b76a0) adding con mode: secure 2024-09-14T11:30:25.370 INFO:tasks.workunit.client.0.smithi071.stderr: -275> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:25.370 INFO:tasks.workunit.client.0.smithi071.stderr: -274> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient: init 2024-09-14T11:30:25.370 INFO:tasks.workunit.client.0.smithi071.stderr: -273> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27423da0) adding auth protocol: cephx 2024-09-14T11:30:25.370 INFO:tasks.workunit.client.0.smithi071.stderr: -272> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27423da0) adding auth protocol: cephx 2024-09-14T11:30:25.370 INFO:tasks.workunit.client.0.smithi071.stderr: -271> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27423da0) adding auth protocol: cephx 2024-09-14T11:30:25.370 INFO:tasks.workunit.client.0.smithi071.stderr: -270> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27423da0) adding con mode: secure 2024-09-14T11:30:25.370 INFO:tasks.workunit.client.0.smithi071.stderr: -269> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27423da0) adding con mode: crc 2024-09-14T11:30:25.370 INFO:tasks.workunit.client.0.smithi071.stderr: -268> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27423da0) adding con mode: secure 2024-09-14T11:30:25.370 INFO:tasks.workunit.client.0.smithi071.stderr: -267> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27423da0) adding con mode: crc 2024-09-14T11:30:25.370 INFO:tasks.workunit.client.0.smithi071.stderr: -266> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27423da0) adding con mode: secure 2024-09-14T11:30:25.370 INFO:tasks.workunit.client.0.smithi071.stderr: -265> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27423da0) adding con mode: crc 2024-09-14T11:30:25.370 INFO:tasks.workunit.client.0.smithi071.stderr: -264> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27423da0) adding con mode: crc 2024-09-14T11:30:25.370 INFO:tasks.workunit.client.0.smithi071.stderr: -263> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27423da0) adding con mode: secure 2024-09-14T11:30:25.371 INFO:tasks.workunit.client.0.smithi071.stderr: -262> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27423da0) adding con mode: crc 2024-09-14T11:30:25.371 INFO:tasks.workunit.client.0.smithi071.stderr: -261> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27423da0) adding con mode: secure 2024-09-14T11:30:25.371 INFO:tasks.workunit.client.0.smithi071.stderr: -260> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27423da0) adding con mode: crc 2024-09-14T11:30:25.371 INFO:tasks.workunit.client.0.smithi071.stderr: -259> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27423da0) adding con mode: secure 2024-09-14T11:30:25.371 INFO:tasks.workunit.client.0.smithi071.stderr: -258> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:25.371 INFO:tasks.workunit.client.0.smithi071.stderr: -257> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:25.371 INFO:tasks.workunit.client.0.smithi071.stderr: -256> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 asok(0x55cfc230dd90) register_command rotate-key cmddesc rotate-key hook 0x7ffe27423ee8 EEXIST 2024-09-14T11:30:25.371 INFO:tasks.workunit.client.0.smithi071.stderr: -255> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient: _reopen_session rank -1 2024-09-14T11:30:25.371 INFO:tasks.workunit.client.0.smithi071.stderr: -254> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:30:25.371 INFO:tasks.workunit.client.0.smithi071.stderr: -253> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient(hunting): picked mon.noname-a con 0x55cfc25bb870 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:30:25.371 INFO:tasks.workunit.client.0.smithi071.stderr: -252> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient(hunting): picked mon.noname-c con 0x55cfc25ebf20 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:30:25.371 INFO:tasks.workunit.client.0.smithi071.stderr: -251> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient(hunting): picked mon.noname-b con 0x55cfc25e70d0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:30:25.371 INFO:tasks.workunit.client.0.smithi071.stderr: -250> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:25.372 INFO:tasks.workunit.client.0.smithi071.stderr: -249> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:25.372 INFO:tasks.workunit.client.0.smithi071.stderr: -248> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:25.372 INFO:tasks.workunit.client.0.smithi071.stderr: -247> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient(hunting): _renew_subs 2024-09-14T11:30:25.372 INFO:tasks.workunit.client.0.smithi071.stderr: -246> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient(hunting): authenticate will time out at 2237.095195s 2024-09-14T11:30:25.372 INFO:tasks.workunit.client.0.smithi071.stderr: -245> 2024-09-14T11:30:24.972+0000 7f2e5312d640 10 monclient(hunting): get_auth_request con 0x55cfc25bb870 auth_method 0 2024-09-14T11:30:25.372 INFO:tasks.workunit.client.0.smithi071.stderr: -244> 2024-09-14T11:30:24.972+0000 7f2e5312d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:25.372 INFO:tasks.workunit.client.0.smithi071.stderr: -243> 2024-09-14T11:30:24.972+0000 7f2e5312d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:25.372 INFO:tasks.workunit.client.0.smithi071.stderr: -242> 2024-09-14T11:30:24.972+0000 7f2e5312d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:25.372 INFO:tasks.workunit.client.0.smithi071.stderr: -241> 2024-09-14T11:30:24.972+0000 7f2e5412f640 10 monclient(hunting): get_auth_request con 0x55cfc25ebf20 auth_method 0 2024-09-14T11:30:25.372 INFO:tasks.workunit.client.0.smithi071.stderr: -240> 2024-09-14T11:30:24.972+0000 7f2e5412f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:25.372 INFO:tasks.workunit.client.0.smithi071.stderr: -239> 2024-09-14T11:30:24.972+0000 7f2e5412f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:25.372 INFO:tasks.workunit.client.0.smithi071.stderr: -238> 2024-09-14T11:30:24.972+0000 7f2e5412f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:25.372 INFO:tasks.workunit.client.0.smithi071.stderr: -237> 2024-09-14T11:30:24.972+0000 7f2e5312d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:25.372 INFO:tasks.workunit.client.0.smithi071.stderr: -236> 2024-09-14T11:30:24.972+0000 7f2e5312d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:25.373 INFO:tasks.workunit.client.0.smithi071.stderr: -235> 2024-09-14T11:30:24.972+0000 7f2e5312d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:25.373 INFO:tasks.workunit.client.0.smithi071.stderr: -234> 2024-09-14T11:30:24.972+0000 7f2e5412f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:25.373 INFO:tasks.workunit.client.0.smithi071.stderr: -233> 2024-09-14T11:30:24.972+0000 7f2e5412f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:25.373 INFO:tasks.workunit.client.0.smithi071.stderr: -232> 2024-09-14T11:30:24.972+0000 7f2e5412f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:25.373 INFO:tasks.workunit.client.0.smithi071.stderr: -231> 2024-09-14T11:30:24.972+0000 7f2e5312d640 10 monclient(hunting): handle_auth_done global_id 6831 payload 274 2024-09-14T11:30:25.373 INFO:tasks.workunit.client.0.smithi071.stderr: -230> 2024-09-14T11:30:24.972+0000 7f2e5312d640 10 monclient: _finish_hunting 0 2024-09-14T11:30:25.373 INFO:tasks.workunit.client.0.smithi071.stderr: -229> 2024-09-14T11:30:24.972+0000 7f2e5312d640 1 monclient: found mon.noname-a 2024-09-14T11:30:25.373 INFO:tasks.workunit.client.0.smithi071.stderr: -228> 2024-09-14T11:30:24.972+0000 7f2e5312d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:30:25.373 INFO:tasks.workunit.client.0.smithi071.stderr: -227> 2024-09-14T11:30:24.972+0000 7f2e5392e640 10 monclient: get_auth_request con 0x55cfc25e70d0 auth_method 0 2024-09-14T11:30:25.373 INFO:tasks.workunit.client.0.smithi071.stderr: -226> 2024-09-14T11:30:24.972+0000 7f2d32ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:25.373 INFO:tasks.workunit.client.0.smithi071.stderr: -225> 2024-09-14T11:30:24.972+0000 7f2d32ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:30:25.373 INFO:tasks.workunit.client.0.smithi071.stderr: -224> 2024-09-14T11:30:24.972+0000 7f2d32ffd640 10 monclient: dump: 2024-09-14T11:30:25.373 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:30:25.373 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:30:25.374 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.374 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.374 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:25.374 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:30:25.374 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:30:25.374 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:30:25.374 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:30:25.374 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.374 INFO:tasks.workunit.client.0.smithi071.stderr: -223> 2024-09-14T11:30:24.972+0000 7f2d32ffd640 10 monclient: _finish_auth 0 2024-09-14T11:30:25.374 INFO:tasks.workunit.client.0.smithi071.stderr: -222> 2024-09-14T11:30:24.972+0000 7f2d32ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:30:25.374 INFO:tasks.workunit.client.0.smithi071.stderr: -221> 2024-09-14T11:30:24.972+0000 7f2d32ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:25.374 INFO:tasks.workunit.client.0.smithi071.stderr: -220> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 5 monclient: authenticate success, global_id 6831 2024-09-14T11:30:25.374 INFO:tasks.workunit.client.0.smithi071.stderr: -219> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 10 monclient: get_monmap_and_config success 2024-09-14T11:30:25.374 INFO:tasks.workunit.client.0.smithi071.stderr: -218> 2024-09-14T11:30:24.972+0000 7f2e55e289c0 4 set_mon_vals no callback set 2024-09-14T11:30:25.374 INFO:tasks.workunit.client.0.smithi071.stderr: -217> 2024-09-14T11:30:24.972+0000 7f2d32ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:25.375 INFO:tasks.workunit.client.0.smithi071.stderr: -216> 2024-09-14T11:30:24.972+0000 7f2d32ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:30:25.375 INFO:tasks.workunit.client.0.smithi071.stderr: -215> 2024-09-14T11:30:24.972+0000 7f2d32ffd640 10 monclient: dump: 2024-09-14T11:30:25.375 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:30:25.375 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:30:25.375 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.375 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.375 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:25.375 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:30:25.375 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:30:25.375 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:30:25.375 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:30:25.375 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.375 INFO:tasks.workunit.client.0.smithi071.stderr: -214> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 10 monclient: shutdown 2024-09-14T11:30:25.375 INFO:tasks.workunit.client.0.smithi071.stderr: -213> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 10 monclient: build_initial_monmap 2024-09-14T11:30:25.375 INFO:tasks.workunit.client.0.smithi071.stderr: -212> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 1 build_initial for_mkfs: 0 2024-09-14T11:30:25.376 INFO:tasks.workunit.client.0.smithi071.stderr: -211> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 10 monclient: monmap: 2024-09-14T11:30:25.376 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:30:25.376 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:25.376 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:30:25.376 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:30:25.376 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:25.376 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:30:25.376 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:30:25.376 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:30:25.376 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:30:25.376 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.376 INFO:tasks.workunit.client.0.smithi071.stderr: -210> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25bc850) adding auth protocol: cephx 2024-09-14T11:30:25.376 INFO:tasks.workunit.client.0.smithi071.stderr: -209> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25bc850) adding auth protocol: cephx 2024-09-14T11:30:25.376 INFO:tasks.workunit.client.0.smithi071.stderr: -208> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25bc850) adding auth protocol: cephx 2024-09-14T11:30:25.376 INFO:tasks.workunit.client.0.smithi071.stderr: -207> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25bc850) adding con mode: secure 2024-09-14T11:30:25.377 INFO:tasks.workunit.client.0.smithi071.stderr: -206> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25bc850) adding con mode: crc 2024-09-14T11:30:25.377 INFO:tasks.workunit.client.0.smithi071.stderr: -205> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25bc850) adding con mode: secure 2024-09-14T11:30:25.377 INFO:tasks.workunit.client.0.smithi071.stderr: -204> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25bc850) adding con mode: crc 2024-09-14T11:30:25.377 INFO:tasks.workunit.client.0.smithi071.stderr: -203> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25bc850) adding con mode: secure 2024-09-14T11:30:25.377 INFO:tasks.workunit.client.0.smithi071.stderr: -202> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25bc850) adding con mode: crc 2024-09-14T11:30:25.377 INFO:tasks.workunit.client.0.smithi071.stderr: -201> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25bc850) adding con mode: crc 2024-09-14T11:30:25.377 INFO:tasks.workunit.client.0.smithi071.stderr: -200> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25bc850) adding con mode: secure 2024-09-14T11:30:25.377 INFO:tasks.workunit.client.0.smithi071.stderr: -199> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25bc850) adding con mode: crc 2024-09-14T11:30:25.377 INFO:tasks.workunit.client.0.smithi071.stderr: -198> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25bc850) adding con mode: secure 2024-09-14T11:30:25.377 INFO:tasks.workunit.client.0.smithi071.stderr: -197> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25bc850) adding con mode: crc 2024-09-14T11:30:25.377 INFO:tasks.workunit.client.0.smithi071.stderr: -196> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc25bc850) adding con mode: secure 2024-09-14T11:30:25.377 INFO:tasks.workunit.client.0.smithi071.stderr: -195> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:25.377 INFO:tasks.workunit.client.0.smithi071.stderr: -194> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 1 librados: starting msgr at 2024-09-14T11:30:25.377 INFO:tasks.workunit.client.0.smithi071.stderr: -193> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 1 librados: starting objecter 2024-09-14T11:30:25.378 INFO:tasks.workunit.client.0.smithi071.stderr: -192> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 asok(0x55cfc230dd90) register_command objecter_requests cmddesc objecter_requests hook 0x55cfc25bd920 EEXIST 2024-09-14T11:30:25.378 INFO:tasks.workunit.client.0.smithi071.stderr: -191> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 1 librados: setting wanted keys 2024-09-14T11:30:25.378 INFO:tasks.workunit.client.0.smithi071.stderr: -190> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 1 librados: calling monclient init 2024-09-14T11:30:25.378 INFO:tasks.workunit.client.0.smithi071.stderr: -189> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 10 monclient: init 2024-09-14T11:30:25.378 INFO:tasks.workunit.client.0.smithi071.stderr: -188> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc2599fb0) adding auth protocol: cephx 2024-09-14T11:30:25.378 INFO:tasks.workunit.client.0.smithi071.stderr: -187> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc2599fb0) adding auth protocol: cephx 2024-09-14T11:30:25.378 INFO:tasks.workunit.client.0.smithi071.stderr: -186> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc2599fb0) adding auth protocol: cephx 2024-09-14T11:30:25.378 INFO:tasks.workunit.client.0.smithi071.stderr: -185> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc2599fb0) adding con mode: secure 2024-09-14T11:30:25.378 INFO:tasks.workunit.client.0.smithi071.stderr: -184> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc2599fb0) adding con mode: crc 2024-09-14T11:30:25.378 INFO:tasks.workunit.client.0.smithi071.stderr: -183> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc2599fb0) adding con mode: secure 2024-09-14T11:30:25.378 INFO:tasks.workunit.client.0.smithi071.stderr: -182> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc2599fb0) adding con mode: crc 2024-09-14T11:30:25.378 INFO:tasks.workunit.client.0.smithi071.stderr: -181> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc2599fb0) adding con mode: secure 2024-09-14T11:30:25.378 INFO:tasks.workunit.client.0.smithi071.stderr: -180> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc2599fb0) adding con mode: crc 2024-09-14T11:30:25.378 INFO:tasks.workunit.client.0.smithi071.stderr: -179> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc2599fb0) adding con mode: crc 2024-09-14T11:30:25.378 INFO:tasks.workunit.client.0.smithi071.stderr: -178> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc2599fb0) adding con mode: secure 2024-09-14T11:30:25.379 INFO:tasks.workunit.client.0.smithi071.stderr: -177> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc2599fb0) adding con mode: crc 2024-09-14T11:30:25.379 INFO:tasks.workunit.client.0.smithi071.stderr: -176> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc2599fb0) adding con mode: secure 2024-09-14T11:30:25.379 INFO:tasks.workunit.client.0.smithi071.stderr: -175> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc2599fb0) adding con mode: crc 2024-09-14T11:30:25.379 INFO:tasks.workunit.client.0.smithi071.stderr: -174> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 AuthRegistry(0x55cfc2599fb0) adding con mode: secure 2024-09-14T11:30:25.379 INFO:tasks.workunit.client.0.smithi071.stderr: -173> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:25.379 INFO:tasks.workunit.client.0.smithi071.stderr: -172> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:25.379 INFO:tasks.workunit.client.0.smithi071.stderr: -171> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 asok(0x55cfc230dd90) register_command rotate-key cmddesc rotate-key hook 0x55cfc259a0f8 EEXIST 2024-09-14T11:30:25.379 INFO:tasks.workunit.client.0.smithi071.stderr: -170> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 10 monclient: _reopen_session rank -1 2024-09-14T11:30:25.379 INFO:tasks.workunit.client.0.smithi071.stderr: -169> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:30:25.379 INFO:tasks.workunit.client.0.smithi071.stderr: -168> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 10 monclient(hunting): picked mon.noname-a con 0x55cfc25bb870 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:30:25.379 INFO:tasks.workunit.client.0.smithi071.stderr: -167> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 10 monclient(hunting): picked mon.noname-c con 0x55cfc25e70d0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:30:25.379 INFO:tasks.workunit.client.0.smithi071.stderr: -166> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 10 monclient(hunting): picked mon.noname-b con 0x55cfc25ebf20 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:30:25.379 INFO:tasks.workunit.client.0.smithi071.stderr: -165> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:25.379 INFO:tasks.workunit.client.0.smithi071.stderr: -164> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:25.380 INFO:tasks.workunit.client.0.smithi071.stderr: -163> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:25.380 INFO:tasks.workunit.client.0.smithi071.stderr: -162> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 10 monclient(hunting): _renew_subs 2024-09-14T11:30:25.380 INFO:tasks.workunit.client.0.smithi071.stderr: -161> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 10 monclient(hunting): authenticate will time out at 2237.097816s 2024-09-14T11:30:25.380 INFO:tasks.workunit.client.0.smithi071.stderr: -160> 2024-09-14T11:30:24.976+0000 7f2e5312d640 10 monclient(hunting): get_auth_request con 0x55cfc25bb870 auth_method 0 2024-09-14T11:30:25.380 INFO:tasks.workunit.client.0.smithi071.stderr: -159> 2024-09-14T11:30:24.976+0000 7f2e5312d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:25.380 INFO:tasks.workunit.client.0.smithi071.stderr: -158> 2024-09-14T11:30:24.976+0000 7f2e5312d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:25.380 INFO:tasks.workunit.client.0.smithi071.stderr: -157> 2024-09-14T11:30:24.976+0000 7f2e5312d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:25.380 INFO:tasks.workunit.client.0.smithi071.stderr: -156> 2024-09-14T11:30:24.976+0000 7f2e5412f640 10 monclient(hunting): get_auth_request con 0x55cfc25e70d0 auth_method 0 2024-09-14T11:30:25.380 INFO:tasks.workunit.client.0.smithi071.stderr: -155> 2024-09-14T11:30:24.976+0000 7f2e5412f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:25.380 INFO:tasks.workunit.client.0.smithi071.stderr: -154> 2024-09-14T11:30:24.976+0000 7f2e5412f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:25.380 INFO:tasks.workunit.client.0.smithi071.stderr: -153> 2024-09-14T11:30:24.976+0000 7f2e5412f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:25.380 INFO:tasks.workunit.client.0.smithi071.stderr: -152> 2024-09-14T11:30:24.976+0000 7f2e5312d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:25.380 INFO:tasks.workunit.client.0.smithi071.stderr: -151> 2024-09-14T11:30:24.976+0000 7f2e5312d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:25.380 INFO:tasks.workunit.client.0.smithi071.stderr: -150> 2024-09-14T11:30:24.976+0000 7f2e5312d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:25.381 INFO:tasks.workunit.client.0.smithi071.stderr: -149> 2024-09-14T11:30:24.976+0000 7f2e5412f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:25.381 INFO:tasks.workunit.client.0.smithi071.stderr: -148> 2024-09-14T11:30:24.976+0000 7f2e5412f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:25.381 INFO:tasks.workunit.client.0.smithi071.stderr: -147> 2024-09-14T11:30:24.976+0000 7f2e5412f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:25.381 INFO:tasks.workunit.client.0.smithi071.stderr: -146> 2024-09-14T11:30:24.976+0000 7f2e5312d640 10 monclient(hunting): handle_auth_done global_id 6834 payload 824 2024-09-14T11:30:25.381 INFO:tasks.workunit.client.0.smithi071.stderr: -145> 2024-09-14T11:30:24.976+0000 7f2e5312d640 10 monclient: _finish_hunting 0 2024-09-14T11:30:25.381 INFO:tasks.workunit.client.0.smithi071.stderr: -144> 2024-09-14T11:30:24.976+0000 7f2e5312d640 1 monclient: found mon.noname-a 2024-09-14T11:30:25.381 INFO:tasks.workunit.client.0.smithi071.stderr: -143> 2024-09-14T11:30:24.976+0000 7f2e5312d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:30:25.381 INFO:tasks.workunit.client.0.smithi071.stderr: -142> 2024-09-14T11:30:24.976+0000 7f2d317fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:25.381 INFO:tasks.workunit.client.0.smithi071.stderr: -141> 2024-09-14T11:30:24.976+0000 7f2d317fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:30:25.381 INFO:tasks.workunit.client.0.smithi071.stderr: -140> 2024-09-14T11:30:24.976+0000 7f2d317fa640 10 monclient: dump: 2024-09-14T11:30:25.381 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:30:25.381 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:30:25.381 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.381 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.381 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:25.382 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:30:25.382 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:30:25.382 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:30:25.382 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:30:25.382 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.382 INFO:tasks.workunit.client.0.smithi071.stderr: -139> 2024-09-14T11:30:24.976+0000 7f2d317fa640 10 monclient: _finish_auth 0 2024-09-14T11:30:25.382 INFO:tasks.workunit.client.0.smithi071.stderr: -138> 2024-09-14T11:30:24.976+0000 7f2d317fa640 10 monclient: _check_auth_tickets 2024-09-14T11:30:25.382 INFO:tasks.workunit.client.0.smithi071.stderr: -137> 2024-09-14T11:30:24.976+0000 7f2d317fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:25.382 INFO:tasks.workunit.client.0.smithi071.stderr: -136> 2024-09-14T11:30:24.976+0000 7f2d317fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:25.382 INFO:tasks.workunit.client.0.smithi071.stderr: -135> 2024-09-14T11:30:24.976+0000 7f2d317fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:30:25.382 INFO:tasks.workunit.client.0.smithi071.stderr: -134> 2024-09-14T11:30:24.976+0000 7f2d317fa640 10 monclient: dump: 2024-09-14T11:30:25.382 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:30:25.382 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:30:25.382 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.383 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:30:25.383 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:25.383 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:30:25.383 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:30:25.383 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:30:25.383 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:30:25.383 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.383 INFO:tasks.workunit.client.0.smithi071.stderr: -133> 2024-09-14T11:30:24.976+0000 7f2d32ffd640 4 set_mon_vals no callback set 2024-09-14T11:30:25.383 INFO:tasks.workunit.client.0.smithi071.stderr: -132> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 monclient: authenticate success, global_id 6834 2024-09-14T11:30:25.383 INFO:tasks.workunit.client.0.smithi071.stderr: -131> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 10 monclient: _renew_subs 2024-09-14T11:30:25.383 INFO:tasks.workunit.client.0.smithi071.stderr: -130> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:30:25.383 INFO:tasks.workunit.client.0.smithi071.stderr: -129> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 10 monclient: _renew_subs 2024-09-14T11:30:25.383 INFO:tasks.workunit.client.0.smithi071.stderr: -128> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:30:25.383 INFO:tasks.workunit.client.0.smithi071.stderr: -127> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 1 librados: init done 2024-09-14T11:30:25.383 INFO:tasks.workunit.client.0.smithi071.stderr: -126> 2024-09-14T11:30:24.976+0000 7f2e55e289c0 5 asok(0x55cfc230dd90) register_command cr dump hook 0x7f2e4805dd28 2024-09-14T11:30:25.384 INFO:tasks.workunit.client.0.smithi071.stderr: -125> 2024-09-14T11:30:24.980+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.384 INFO:tasks.workunit.client.0.smithi071.stderr: -124> 2024-09-14T11:30:24.980+0000 7f2d317fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:30:25.384 INFO:tasks.workunit.client.0.smithi071.stderr: -123> 2024-09-14T11:30:24.980+0000 7f2d317fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:30:25.384 INFO:tasks.workunit.client.0.smithi071.stderr: -122> 2024-09-14T11:30:24.980+0000 7f2d317fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:30:25.384 INFO:tasks.workunit.client.0.smithi071.stderr: -121> 2024-09-14T11:30:24.980+0000 7f2e5412f640 10 monclient: get_auth_request con 0x7f2d1c0718a0 auth_method 0 2024-09-14T11:30:25.384 INFO:tasks.workunit.client.0.smithi071.stderr: -120> 2024-09-14T11:30:24.980+0000 7f2e5392e640 10 monclient: get_auth_request con 0x55cfc2604f40 auth_method 0 2024-09-14T11:30:25.384 INFO:tasks.workunit.client.0.smithi071.stderr: -119> 2024-09-14T11:30:24.980+0000 7f2e55e289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:25.384 INFO:tasks.workunit.client.0.smithi071.stderr: -118> 2024-09-14T11:30:24.980+0000 7f2e55e289c0 20 realm 2024-09-14T11:30:25.384 INFO:tasks.workunit.client.0.smithi071.stderr: -117> 2024-09-14T11:30:24.980+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.384 INFO:tasks.workunit.client.0.smithi071.stderr: -116> 2024-09-14T11:30:24.980+0000 7f2e55e289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:25.384 INFO:tasks.workunit.client.0.smithi071.stderr: -115> 2024-09-14T11:30:24.980+0000 7f2e55e289c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:25.384 INFO:tasks.workunit.client.0.smithi071.stderr: -114> 2024-09-14T11:30:24.980+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.384 INFO:tasks.workunit.client.0.smithi071.stderr: -113> 2024-09-14T11:30:24.980+0000 7f2e55e289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:25.384 INFO:tasks.workunit.client.0.smithi071.stderr: -112> 2024-09-14T11:30:24.980+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.384 INFO:tasks.workunit.client.0.smithi071.stderr: -111> 2024-09-14T11:30:24.980+0000 7f2e5312d640 10 monclient: get_auth_request con 0x55cfc26091b0 auth_method 0 2024-09-14T11:30:25.385 INFO:tasks.workunit.client.0.smithi071.stderr: -110> 2024-09-14T11:30:24.984+0000 7f2e55e289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:25.385 INFO:tasks.workunit.client.0.smithi071.stderr: -109> 2024-09-14T11:30:24.984+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.385 INFO:tasks.workunit.client.0.smithi071.stderr: -108> 2024-09-14T11:30:24.984+0000 7f2e5412f640 10 monclient: get_auth_request con 0x55cfc260c9f0 auth_method 0 2024-09-14T11:30:25.385 INFO:tasks.workunit.client.0.smithi071.stderr: -107> 2024-09-14T11:30:24.984+0000 7f2e55e289c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:25.385 INFO:tasks.workunit.client.0.smithi071.stderr: -106> 2024-09-14T11:30:24.984+0000 7f2e55e289c0 20 searching for the correct realm 2024-09-14T11:30:25.385 INFO:tasks.workunit.client.0.smithi071.stderr: -105> 2024-09-14T11:30:24.984+0000 7f2e5392e640 10 monclient: get_auth_request con 0x55cfc26117d0 auth_method 0 2024-09-14T11:30:25.385 INFO:tasks.workunit.client.0.smithi071.stderr: -104> 2024-09-14T11:30:24.984+0000 7f2e5312d640 10 monclient: get_auth_request con 0x7f2e440b9b40 auth_method 0 2024-09-14T11:30:25.385 INFO:tasks.workunit.client.0.smithi071.stderr: -103> 2024-09-14T11:30:24.988+0000 7f2e5412f640 10 monclient: get_auth_request con 0x7f2e48008050 auth_method 0 2024-09-14T11:30:25.385 INFO:tasks.workunit.client.0.smithi071.stderr: -102> 2024-09-14T11:30:24.988+0000 7f2e5412f640 0 -- 172.21.15.71:0/869225631 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f2e48008050 msgr2=0x7f2e480507e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:25.385 INFO:tasks.workunit.client.0.smithi071.stderr: -101> 2024-09-14T11:30:25.192+0000 7f2e5412f640 10 monclient: get_auth_request con 0x7f2e48008050 auth_method 0 2024-09-14T11:30:25.385 INFO:tasks.workunit.client.0.smithi071.stderr: -100> 2024-09-14T11:30:25.192+0000 7f2e5392e640 10 monclient: get_auth_request con 0x7f2e440d4910 auth_method 0 2024-09-14T11:30:25.385 INFO:tasks.workunit.client.0.smithi071.stderr: -99> 2024-09-14T11:30:25.200+0000 7f2e5312d640 10 monclient: get_auth_request con 0x7f2e48052670 auth_method 0 2024-09-14T11:30:25.385 INFO:tasks.workunit.client.0.smithi071.stderr: -98> 2024-09-14T11:30:25.200+0000 7f2e5412f640 0 -- 172.21.15.71:0/869225631 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55cfc260c9f0 msgr2=0x55cfc260ee00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:25.385 INFO:tasks.workunit.client.0.smithi071.stderr: -97> 2024-09-14T11:30:25.200+0000 7f2d317fa640 1 client.6834.objecter ms_handle_reset 0x55cfc260c9f0 session 0x55cfc2608540 osd.3 2024-09-14T11:30:25.386 INFO:tasks.workunit.client.0.smithi071.stderr: -96> 2024-09-14T11:30:25.204+0000 7f2d317fa640 10 monclient: _renew_subs 2024-09-14T11:30:25.386 INFO:tasks.workunit.client.0.smithi071.stderr: -95> 2024-09-14T11:30:25.204+0000 7f2d317fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:30:25.386 INFO:tasks.workunit.client.0.smithi071.stderr: -94> 2024-09-14T11:30:25.204+0000 7f2e5412f640 10 monclient: get_auth_request con 0x7f2d1c0813c0 auth_method 0 2024-09-14T11:30:25.386 INFO:tasks.workunit.client.0.smithi071.stderr: -93> 2024-09-14T11:30:25.216+0000 7f2e55e289c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:25.386 INFO:tasks.workunit.client.0.smithi071.stderr: -92> 2024-09-14T11:30:25.216+0000 7f2e55e289c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:30:25.386 INFO:tasks.workunit.client.0.smithi071.stderr: -91> 2024-09-14T11:30:25.216+0000 7f2e55e289c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:25.386 INFO:tasks.workunit.client.0.smithi071.stderr: -90> 2024-09-14T11:30:25.216+0000 7f2e55e289c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:30:25.386 INFO:tasks.workunit.client.0.smithi071.stderr: -89> 2024-09-14T11:30:25.216+0000 7f2e55e289c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:25.386 INFO:tasks.workunit.client.0.smithi071.stderr: -88> 2024-09-14T11:30:25.216+0000 7f2e55e289c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:25.386 INFO:tasks.workunit.client.0.smithi071.stderr: -87> 2024-09-14T11:30:25.216+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.386 INFO:tasks.workunit.client.0.smithi071.stderr: -86> 2024-09-14T11:30:25.216+0000 7f2e55e289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:25.386 INFO:tasks.workunit.client.0.smithi071.stderr: -85> 2024-09-14T11:30:25.216+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.386 INFO:tasks.workunit.client.0.smithi071.stderr: -84> 2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:25.386 INFO:tasks.workunit.client.0.smithi071.stderr: -83> 2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.386 INFO:tasks.workunit.client.0.smithi071.stderr: -82> 2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:25.387 INFO:tasks.workunit.client.0.smithi071.stderr: -81> 2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 zone default found 2024-09-14T11:30:25.387 INFO:tasks.workunit.client.0.smithi071.stderr: -80> 2024-09-14T11:30:25.220+0000 7f2e55e289c0 4 Realm: () 2024-09-14T11:30:25.387 INFO:tasks.workunit.client.0.smithi071.stderr: -79> 2024-09-14T11:30:25.220+0000 7f2e55e289c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:30:25.387 INFO:tasks.workunit.client.0.smithi071.stderr: -78> 2024-09-14T11:30:25.220+0000 7f2e55e289c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:30:25.387 INFO:tasks.workunit.client.0.smithi071.stderr: -77> 2024-09-14T11:30:25.220+0000 7f2e55e289c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:25.387 INFO:tasks.workunit.client.0.smithi071.stderr: -76> 2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 zonegroup default 2024-09-14T11:30:25.387 INFO:tasks.workunit.client.0.smithi071.stderr: -75> 2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.387 INFO:tasks.workunit.client.0.smithi071.stderr: -74> 2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:25.387 INFO:tasks.workunit.client.0.smithi071.stderr: -73> 2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.387 INFO:tasks.workunit.client.0.smithi071.stderr: -72> 2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:25.387 INFO:tasks.workunit.client.0.smithi071.stderr: -71> 2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.387 INFO:tasks.workunit.client.0.smithi071.stderr: -70> 2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:25.387 INFO:tasks.workunit.client.0.smithi071.stderr: -69> 2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 started sync module instance, tier type = 2024-09-14T11:30:25.387 INFO:tasks.workunit.client.0.smithi071.stderr: -68> 2024-09-14T11:30:25.220+0000 7f2e55e289c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:30:25.387 INFO:tasks.workunit.client.0.smithi071.stderr: -67> 2024-09-14T11:30:25.248+0000 7f2e55e289c0 20 add_watcher() i=0 2024-09-14T11:30:25.388 INFO:tasks.workunit.client.0.smithi071.stderr: -66> 2024-09-14T11:30:25.248+0000 7f2e55e289c0 20 add_watcher() i=1 2024-09-14T11:30:25.388 INFO:tasks.workunit.client.0.smithi071.stderr: -65> 2024-09-14T11:30:25.248+0000 7f2e55e289c0 20 add_watcher() i=2 2024-09-14T11:30:25.388 INFO:tasks.workunit.client.0.smithi071.stderr: -64> 2024-09-14T11:30:25.248+0000 7f2e55e289c0 20 add_watcher() i=3 2024-09-14T11:30:25.388 INFO:tasks.workunit.client.0.smithi071.stderr: -63> 2024-09-14T11:30:25.248+0000 7f2e55e289c0 20 add_watcher() i=4 2024-09-14T11:30:25.388 INFO:tasks.workunit.client.0.smithi071.stderr: -62> 2024-09-14T11:30:25.248+0000 7f2e55e289c0 20 add_watcher() i=5 2024-09-14T11:30:25.388 INFO:tasks.workunit.client.0.smithi071.stderr: -61> 2024-09-14T11:30:25.248+0000 7f2e55e289c0 20 add_watcher() i=6 2024-09-14T11:30:25.388 INFO:tasks.workunit.client.0.smithi071.stderr: -60> 2024-09-14T11:30:25.252+0000 7f2e55e289c0 20 add_watcher() i=7 2024-09-14T11:30:25.388 INFO:tasks.workunit.client.0.smithi071.stderr: -59> 2024-09-14T11:30:25.252+0000 7f2e55e289c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:25.388 INFO:tasks.workunit.client.0.smithi071.stderr: -58> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27424280) adding auth protocol: cephx 2024-09-14T11:30:25.388 INFO:tasks.workunit.client.0.smithi071.stderr: -57> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27424280) adding auth protocol: cephx 2024-09-14T11:30:25.388 INFO:tasks.workunit.client.0.smithi071.stderr: -56> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27424280) adding auth protocol: cephx 2024-09-14T11:30:25.388 INFO:tasks.workunit.client.0.smithi071.stderr: -55> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27424280) adding con mode: secure 2024-09-14T11:30:25.388 INFO:tasks.workunit.client.0.smithi071.stderr: -54> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27424280) adding con mode: crc 2024-09-14T11:30:25.389 INFO:tasks.workunit.client.0.smithi071.stderr: -53> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27424280) adding con mode: secure 2024-09-14T11:30:25.389 INFO:tasks.workunit.client.0.smithi071.stderr: -52> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27424280) adding con mode: crc 2024-09-14T11:30:25.389 INFO:tasks.workunit.client.0.smithi071.stderr: -51> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27424280) adding con mode: secure 2024-09-14T11:30:25.389 INFO:tasks.workunit.client.0.smithi071.stderr: -50> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27424280) adding con mode: crc 2024-09-14T11:30:25.389 INFO:tasks.workunit.client.0.smithi071.stderr: -49> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27424280) adding con mode: crc 2024-09-14T11:30:25.389 INFO:tasks.workunit.client.0.smithi071.stderr: -48> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27424280) adding con mode: secure 2024-09-14T11:30:25.389 INFO:tasks.workunit.client.0.smithi071.stderr: -47> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27424280) adding con mode: crc 2024-09-14T11:30:25.389 INFO:tasks.workunit.client.0.smithi071.stderr: -46> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27424280) adding con mode: secure 2024-09-14T11:30:25.389 INFO:tasks.workunit.client.0.smithi071.stderr: -45> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27424280) adding con mode: crc 2024-09-14T11:30:25.389 INFO:tasks.workunit.client.0.smithi071.stderr: -44> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 AuthRegistry(0x7ffe27424280) adding con mode: secure 2024-09-14T11:30:25.389 INFO:tasks.workunit.client.0.smithi071.stderr: -43> 2024-09-14T11:30:25.256+0000 7f2d09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:25.389 INFO:tasks.workunit.client.0.smithi071.stderr: -42> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:25.389 INFO:tasks.workunit.client.0.smithi071.stderr: -41> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:25.390 INFO:tasks.workunit.client.0.smithi071.stderr: -40> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:25.390 INFO:tasks.workunit.client.0.smithi071.stderr: -39> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 asok(0x55cfc230dd90) register_command cache list hook 0x55cfc25e3310 2024-09-14T11:30:25.390 INFO:tasks.workunit.client.0.smithi071.stderr: -38> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 asok(0x55cfc230dd90) register_command cache inspect hook 0x55cfc25e3310 2024-09-14T11:30:25.390 INFO:tasks.workunit.client.0.smithi071.stderr: -37> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 asok(0x55cfc230dd90) register_command cache erase hook 0x55cfc25e3310 2024-09-14T11:30:25.390 INFO:tasks.workunit.client.0.smithi071.stderr: -36> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 asok(0x55cfc230dd90) register_command cache zap hook 0x55cfc25e3310 2024-09-14T11:30:25.390 INFO:tasks.workunit.client.0.smithi071.stderr: -35> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 note: GC not initialized 2024-09-14T11:30:25.390 INFO:tasks.workunit.client.0.smithi071.stderr: -34> 2024-09-14T11:30:25.256+0000 7f2d08fe1640 20 reqs_thread_entry: start 2024-09-14T11:30:25.390 INFO:tasks.workunit.client.0.smithi071.stderr: -33> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 asok(0x55cfc230dd90) register_command sync trace show hook 0x7f2e440ab430 2024-09-14T11:30:25.390 INFO:tasks.workunit.client.0.smithi071.stderr: -32> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 asok(0x55cfc230dd90) register_command sync trace history hook 0x7f2e440ab430 2024-09-14T11:30:25.390 INFO:tasks.workunit.client.0.smithi071.stderr: -31> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 asok(0x55cfc230dd90) register_command sync trace active hook 0x7f2e440ab430 2024-09-14T11:30:25.390 INFO:tasks.workunit.client.0.smithi071.stderr: -30> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 5 asok(0x55cfc230dd90) register_command sync trace active_short hook 0x7f2e440ab430 2024-09-14T11:30:25.390 INFO:tasks.workunit.client.0.smithi071.stderr: -29> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 20 init_complete bucket index max shards: 11 2024-09-14T11:30:25.390 INFO:tasks.workunit.client.0.smithi071.stderr: -28> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 20 Filter name: none 2024-09-14T11:30:25.390 INFO:tasks.workunit.client.0.smithi071.stderr: -27> 2024-09-14T11:30:25.256+0000 7f2c827fc640 20 reqs_thread_entry: start 2024-09-14T11:30:25.391 INFO:tasks.workunit.client.0.smithi071.stderr: -26> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:30:25.391 INFO:tasks.workunit.client.0.smithi071.stderr: -25> 2024-09-14T11:30:25.256+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.391 INFO:tasks.workunit.client.0.smithi071.stderr: -24> 2024-09-14T11:30:25.260+0000 7f2e55e289c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:25.391 INFO:tasks.workunit.client.0.smithi071.stderr: -23> 2024-09-14T11:30:25.260+0000 7f2e55e289c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:30:25.391 INFO:tasks.workunit.client.0.smithi071.stderr: -22> 2024-09-14T11:30:25.260+0000 7f2e55e289c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:30:25.391 INFO:tasks.workunit.client.0.smithi071.stderr: -21> 2024-09-14T11:30:25.260+0000 7f2e55e289c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 : miss 2024-09-14T11:30:25.391 INFO:tasks.workunit.client.0.smithi071.stderr: -20> 2024-09-14T11:30:25.260+0000 7f2e55e289c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.391 INFO:tasks.workunit.client.0.smithi071.stderr: -19> 2024-09-14T11:30:25.260+0000 7f2e55e289c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:30:25.391 INFO:tasks.workunit.client.0.smithi071.stderr: -18> 2024-09-14T11:30:25.260+0000 7f2e55e289c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 info.flags=0x17 2024-09-14T11:30:25.391 INFO:tasks.workunit.client.0.smithi071.stderr: -17> 2024-09-14T11:30:25.260+0000 7f2e55e289c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 to cache LRU end 2024-09-14T11:30:25.391 INFO:tasks.workunit.client.0.smithi071.stderr: -16> 2024-09-14T11:30:25.260+0000 7f2e55e289c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:25.391 INFO:tasks.workunit.client.0.smithi071.stderr: -15> 2024-09-14T11:30:25.260+0000 7f2e55e289c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:25.391 INFO:tasks.workunit.client.0.smithi071.stderr: -14> 2024-09-14T11:30:25.260+0000 7f2e55e289c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 2024-09-14T11:30:25.391 INFO:tasks.workunit.client.0.smithi071.stderr: -13> 2024-09-14T11:30:25.268+0000 7f2e55e289c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 info.flags=0x17 2024-09-14T11:30:25.392 INFO:tasks.workunit.client.0.smithi071.stderr: -12> 2024-09-14T11:30:25.268+0000 7f2e55e289c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 to cache LRU end 2024-09-14T11:30:25.392 INFO:tasks.workunit.client.0.smithi071.stderr: -11> 2024-09-14T11:30:25.268+0000 7f2e55e289c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:25.392 INFO:tasks.workunit.client.0.smithi071.stderr: -10> 2024-09-14T11:30:25.268+0000 7f2e55e289c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28, ofs0, ns] 2024-09-14T11:30:25.392 INFO:tasks.workunit.client.0.smithi071.stderr: -9> 2024-09-14T11:30:25.268+0000 7f2d327fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464366 cookie 94350807721360 notifier 6834 bl.length()=1023 2024-09-14T11:30:25.392 INFO:tasks.workunit.client.0.smithi071.stderr: -8> 2024-09-14T11:30:25.268+0000 7f2d327fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 info.flags=0x17 2024-09-14T11:30:25.392 INFO:tasks.workunit.client.0.smithi071.stderr: -7> 2024-09-14T11:30:25.268+0000 7f2d327fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 to cache LRU end 2024-09-14T11:30:25.392 INFO:tasks.workunit.client.0.smithi071.stderr: -6> 2024-09-14T11:30:25.268+0000 7f2d327fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:25.392 INFO:tasks.workunit.client.0.smithi071.stderr: -5> 2024-09-14T11:30:25.268+0000 7f2e55e289c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.28]): orig_sources= new_sources= 2024-09-14T11:30:25.392 INFO:tasks.workunit.client.0.smithi071.stderr: -4> 2024-09-14T11:30:25.268+0000 7f2e55e289c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.28]): potential sources added=[] removed=[] 2024-09-14T11:30:25.392 INFO:tasks.workunit.client.0.smithi071.stderr: -3> 2024-09-14T11:30:25.268+0000 7f2e55e289c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.28]): orig_dests= new_dests= 2024-09-14T11:30:25.392 INFO:tasks.workunit.client.0.smithi071.stderr: -2> 2024-09-14T11:30:25.268+0000 7f2e55e289c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.28]): potential dests added=[] removed=[] 2024-09-14T11:30:25.392 INFO:tasks.workunit.client.0.smithi071.stderr: -1> 2024-09-14T11:30:25.272+0000 7f2e55e289c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2e55e289c0 time 2024-09-14T11:30:25.273928+0000 2024-09-14T11:30:25.392 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:30:25.392 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.393 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:25.393 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2e597022eb] 2024-09-14T11:30:25.393 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2e5970249f] 2024-09-14T11:30:25.393 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cfc0096c01] 2024-09-14T11:30:25.393 INFO:tasks.workunit.client.0.smithi071.stderr: 4: radosgw-admin(+0x14231ee) [0x55cfc0af51ee] 2024-09-14T11:30:25.393 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55cfc00abecd] 2024-09-14T11:30:25.393 INFO:tasks.workunit.client.0.smithi071.stderr: 6: main() 2024-09-14T11:30:25.393 INFO:tasks.workunit.client.0.smithi071.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2e58568d90] 2024-09-14T11:30:25.393 INFO:tasks.workunit.client.0.smithi071.stderr: 8: __libc_start_main() 2024-09-14T11:30:25.393 INFO:tasks.workunit.client.0.smithi071.stderr: 9: _start() 2024-09-14T11:30:25.393 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.393 INFO:tasks.workunit.client.0.smithi071.stderr: 0> 2024-09-14T11:30:25.272+0000 7f2e55e289c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:30:25.393 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f2e55e289c0 thread_name:radosgw-admin 2024-09-14T11:30:25.393 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.393 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:25.394 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2e58581520] 2024-09-14T11:30:25.394 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:30:25.394 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:30:25.394 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:30:25.394 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2e59702345] 2024-09-14T11:30:25.394 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2e5970249f] 2024-09-14T11:30:25.394 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cfc0096c01] 2024-09-14T11:30:25.394 INFO:tasks.workunit.client.0.smithi071.stderr: 8: radosgw-admin(+0x14231ee) [0x55cfc0af51ee] 2024-09-14T11:30:25.394 INFO:tasks.workunit.client.0.smithi071.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55cfc00abecd] 2024-09-14T11:30:25.394 INFO:tasks.workunit.client.0.smithi071.stderr: 10: main() 2024-09-14T11:30:25.394 INFO:tasks.workunit.client.0.smithi071.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2e58568d90] 2024-09-14T11:30:25.394 INFO:tasks.workunit.client.0.smithi071.stderr: 12: __libc_start_main() 2024-09-14T11:30:25.394 INFO:tasks.workunit.client.0.smithi071.stderr: 13: _start() 2024-09-14T11:30:25.394 INFO:tasks.workunit.client.0.smithi071.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:30:25.394 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.395 INFO:tasks.workunit.client.0.smithi071.stderr:--- logging levels --- 2024-09-14T11:30:25.395 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 none 2024-09-14T11:30:25.395 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 lockdep 2024-09-14T11:30:25.395 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 context 2024-09-14T11:30:25.395 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 crush 2024-09-14T11:30:25.395 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds 2024-09-14T11:30:25.395 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_balancer 2024-09-14T11:30:25.395 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_locker 2024-09-14T11:30:25.395 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log 2024-09-14T11:30:25.395 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log_expire 2024-09-14T11:30:25.395 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_migrator 2024-09-14T11:30:25.395 INFO:tasks.workunit.client.0.smithi071.stderr: 3/ 5 mds_quiesce 2024-09-14T11:30:25.395 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 buffer 2024-09-14T11:30:25.395 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 timer 2024-09-14T11:30:25.395 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 filer 2024-09-14T11:30:25.396 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 striper 2024-09-14T11:30:25.396 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 objecter 2024-09-14T11:30:25.396 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rados 2024-09-14T11:30:25.396 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd 2024-09-14T11:30:25.396 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_mirror 2024-09-14T11:30:25.396 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_replay 2024-09-14T11:30:25.396 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_pwl 2024-09-14T11:30:25.396 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 journaler 2024-09-14T11:30:25.396 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objectcacher 2024-09-14T11:30:25.396 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:30:25.396 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 client 2024-09-14T11:30:25.396 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 osd 2024-09-14T11:30:25.396 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 optracker 2024-09-14T11:30:25.396 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objclass 2024-09-14T11:30:25.396 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 filestore 2024-09-14T11:30:25.397 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 journal 2024-09-14T11:30:25.397 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 ms 2024-09-14T11:30:25.397 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mon 2024-09-14T11:30:25.397 INFO:tasks.workunit.client.0.smithi071.stderr: 0/10 monc 2024-09-14T11:30:25.397 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 paxos 2024-09-14T11:30:25.397 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 tp 2024-09-14T11:30:25.397 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 auth 2024-09-14T11:30:25.397 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 crypto 2024-09-14T11:30:25.397 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 finisher 2024-09-14T11:30:25.397 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 reserver 2024-09-14T11:30:25.397 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 heartbeatmap 2024-09-14T11:30:25.397 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 perfcounter 2024-09-14T11:30:25.397 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw 2024-09-14T11:30:25.397 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_sync 2024-09-14T11:30:25.397 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_datacache 2024-09-14T11:30:25.397 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_access 2024-09-14T11:30:25.398 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:30:25.398 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_flight 2024-09-14T11:30:25.398 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:30:25.398 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw_notification 2024-09-14T11:30:25.398 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 javaclient 2024-09-14T11:30:25.398 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 asok 2024-09-14T11:30:25.398 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 throttle 2024-09-14T11:30:25.398 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 refs 2024-09-14T11:30:25.398 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 compressor 2024-09-14T11:30:25.398 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluestore 2024-09-14T11:30:25.398 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluefs 2024-09-14T11:30:25.398 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 bdev 2024-09-14T11:30:25.398 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 kstore 2024-09-14T11:30:25.398 INFO:tasks.workunit.client.0.smithi071.stderr: 4/ 5 rocksdb 2024-09-14T11:30:25.398 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 fuse 2024-09-14T11:30:25.399 INFO:tasks.workunit.client.0.smithi071.stderr: 2/ 5 mgr 2024-09-14T11:30:25.399 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mgrc 2024-09-14T11:30:25.399 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 dpdk 2024-09-14T11:30:25.399 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 eventtrace 2024-09-14T11:30:25.399 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 prioritycache 2024-09-14T11:30:25.399 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 test 2024-09-14T11:30:25.399 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:30:25.399 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephsqlite 2024-09-14T11:30:25.399 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:30:25.399 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore 2024-09-14T11:30:25.399 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_onode 2024-09-14T11:30:25.399 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_odata 2024-09-14T11:30:25.399 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_omap 2024-09-14T11:30:25.399 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_tm 2024-09-14T11:30:25.399 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_t 2024-09-14T11:30:25.400 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:30:25.400 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_epm 2024-09-14T11:30:25.400 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_lba 2024-09-14T11:30:25.400 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:30:25.400 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cache 2024-09-14T11:30:25.400 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_journal 2024-09-14T11:30:25.400 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_device 2024-09-14T11:30:25.400 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_backref 2024-09-14T11:30:25.400 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 alienstore 2024-09-14T11:30:25.400 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mclock 2024-09-14T11:30:25.400 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cyanstore 2024-09-14T11:30:25.400 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 ceph_exporter 2024-09-14T11:30:25.400 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 memstore 2024-09-14T11:30:25.400 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 trace 2024-09-14T11:30:25.400 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 ceph_dedup 2024-09-14T11:30:25.401 INFO:tasks.workunit.client.0.smithi071.stderr: -2/-2 (syslog threshold) 2024-09-14T11:30:25.401 INFO:tasks.workunit.client.0.smithi071.stderr: 99/99 (stderr threshold) 2024-09-14T11:30:25.401 INFO:tasks.workunit.client.0.smithi071.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:30:25.401 INFO:tasks.workunit.client.0.smithi071.stderr: 7f2c827fc640 / http_manager 2024-09-14T11:30:25.401 INFO:tasks.workunit.client.0.smithi071.stderr: 7f2d08fe1640 / http_manager 2024-09-14T11:30:25.401 INFO:tasks.workunit.client.0.smithi071.stderr: 7f2d09fe3640 / rgw_dt_lg_renew 2024-09-14T11:30:25.401 INFO:tasks.workunit.client.0.smithi071.stderr: 7f2d317fa640 / ms_dispatch 2024-09-14T11:30:25.401 INFO:tasks.workunit.client.0.smithi071.stderr: 7f2d327fc640 / io_context_pool 2024-09-14T11:30:25.401 INFO:tasks.workunit.client.0.smithi071.stderr: 7f2d32ffd640 / io_context_pool 2024-09-14T11:30:25.401 INFO:tasks.workunit.client.0.smithi071.stderr: 7f2d397fa640 / ms_dispatch 2024-09-14T11:30:25.401 INFO:tasks.workunit.client.0.smithi071.stderr: 7f2d3bfff640 / ms_dispatch 2024-09-14T11:30:25.401 INFO:tasks.workunit.client.0.smithi071.stderr: 7f2d41e0b640 / io_context_pool 2024-09-14T11:30:25.401 INFO:tasks.workunit.client.0.smithi071.stderr: 7f2e5312d640 / msgr-worker-2 2024-09-14T11:30:25.402 INFO:tasks.workunit.client.0.smithi071.stderr: 7f2e5392e640 / msgr-worker-1 2024-09-14T11:30:25.402 INFO:tasks.workunit.client.0.smithi071.stderr: 7f2e5412f640 / msgr-worker-0 2024-09-14T11:30:25.402 INFO:tasks.workunit.client.0.smithi071.stderr: 7f2e54930640 / io_context_pool 2024-09-14T11:30:25.402 INFO:tasks.workunit.client.0.smithi071.stderr: 7f2e55e289c0 / radosgw-admin 2024-09-14T11:30:25.402 INFO:tasks.workunit.client.0.smithi071.stderr: max_recent 500 2024-09-14T11:30:25.402 INFO:tasks.workunit.client.0.smithi071.stderr: max_new 1000 2024-09-14T11:30:25.402 INFO:tasks.workunit.client.0.smithi071.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:30:25.276437Z_e7a619eb-fd27-488a-aa5c-6241d7c9ee15/log 2024-09-14T11:30:25.402 INFO:tasks.workunit.client.0.smithi071.stderr:--- end dump of recent events --- 2024-09-14T11:30:25.402 INFO:tasks.workunit.client.0.smithi071.stderr:Aborted 2024-09-14T11:30:25.402 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:30:25.404 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:25.405 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:25.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.356+0000 7f79797b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.356+0000 7f79797b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:25.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.356+0000 7f79797b29c0 20 realm 2024-09-14T11:30:25.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.356+0000 7f79797b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.360+0000 7f79797b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:25.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.360+0000 7f79797b29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:25.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.360+0000 7f79797b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.360+0000 7f79797b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:25.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.360+0000 7f79797b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.360+0000 7f79797b29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:25.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.360+0000 7f79797b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.360+0000 7f79797b29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:25.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.360+0000 7f79797b29c0 20 searching for the correct realm 2024-09-14T11:30:25.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.364+0000 7f7977ab9640 0 -- 172.21.15.71:0/1575670916 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f7960029070 msgr2=0x7f7960045950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:25.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.372+0000 7f7977ab9640 0 -- 172.21.15.71:0/1575670916 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55ee744c2c80 msgr2=0x55ee744c5070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:25.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.380+0000 7f79797b29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:25.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.380+0000 7f79797b29c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:30:25.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.380+0000 7f79797b29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:25.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.380+0000 7f79797b29c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:30:25.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.380+0000 7f79797b29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:25.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.380+0000 7f79797b29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:25.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.380+0000 7f79797b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.380+0000 7f79797b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:25.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.380+0000 7f79797b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.380+0000 7f79797b29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:25.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.380+0000 7f79797b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.380+0000 7f79797b29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:25.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.380+0000 7f79797b29c0 20 zone default found 2024-09-14T11:30:25.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.380+0000 7f79797b29c0 4 Realm: () 2024-09-14T11:30:25.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.380+0000 7f79797b29c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:30:25.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.380+0000 7f79797b29c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:30:25.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.380+0000 7f79797b29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:25.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.380+0000 7f79797b29c0 20 zonegroup default 2024-09-14T11:30:25.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.380+0000 7f79797b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.380+0000 7f79797b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:25.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.380+0000 7f79797b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.380+0000 7f79797b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:25.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.380+0000 7f79797b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.384+0000 7f79797b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:25.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.384+0000 7f79797b29c0 20 started sync module instance, tier type = 2024-09-14T11:30:25.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.384+0000 7f79797b29c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:30:25.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.404+0000 7f79797b29c0 20 add_watcher() i=0 2024-09-14T11:30:25.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.404+0000 7f79797b29c0 20 add_watcher() i=1 2024-09-14T11:30:25.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.404+0000 7f79797b29c0 20 add_watcher() i=2 2024-09-14T11:30:25.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.404+0000 7f79797b29c0 20 add_watcher() i=3 2024-09-14T11:30:25.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.404+0000 7f79797b29c0 20 add_watcher() i=4 2024-09-14T11:30:25.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.404+0000 7f79797b29c0 20 add_watcher() i=5 2024-09-14T11:30:25.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.404+0000 7f79797b29c0 20 add_watcher() i=6 2024-09-14T11:30:25.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.404+0000 7f79797b29c0 20 add_watcher() i=7 2024-09-14T11:30:25.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.404+0000 7f79797b29c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:25.411 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.408+0000 7f782dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:25.411 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.408+0000 7f79797b29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:25.411 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.408+0000 7f79797b29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:25.411 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.408+0000 7f79797b29c0 5 note: GC not initialized 2024-09-14T11:30:25.411 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.408+0000 7f782cfe1640 20 reqs_thread_entry: start 2024-09-14T11:30:25.411 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.408+0000 7f79797b29c0 20 init_complete bucket index max shards: 11 2024-09-14T11:30:25.411 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.408+0000 7f79797b29c0 20 Filter name: none 2024-09-14T11:30:25.411 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.408+0000 7f77a67fc640 20 reqs_thread_entry: start 2024-09-14T11:30:25.412 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.408+0000 7f79797b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.412 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.408+0000 7f79797b29c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:25.412 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.408+0000 7f79797b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.412 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.412+0000 7f79797b29c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:30:25.412 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.412+0000 7f79797b29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:25.412 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.412+0000 7f79797b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.412 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.412+0000 7f79797b29c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:25.412 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.412+0000 7f79797b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.412 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.412+0000 7f79797b29c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:30:25.413 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.412+0000 7f79797b29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:25.413 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.412+0000 7f782dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:25.419 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.420+0000 7f79797b29c0 20 remove_watcher() i=0 2024-09-14T11:30:25.419 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.420+0000 7f79797b29c0 2 removed watcher, disabling cache 2024-09-14T11:30:25.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.424+0000 7f79797b29c0 20 remove_watcher() i=1 2024-09-14T11:30:25.425 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.428+0000 7f79797b29c0 20 remove_watcher() i=2 2024-09-14T11:30:25.427 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.428+0000 7f79797b29c0 20 remove_watcher() i=3 2024-09-14T11:30:25.429 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.432+0000 7f79797b29c0 20 remove_watcher() i=4 2024-09-14T11:30:25.431 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.432+0000 7f79797b29c0 20 remove_watcher() i=5 2024-09-14T11:30:25.434 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.436+0000 7f79797b29c0 20 remove_watcher() i=6 2024-09-14T11:30:25.436 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.436+0000 7f79797b29c0 20 remove_watcher() i=7 2024-09-14T11:30:25.450 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.450 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:30:25.450 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: abort-at-trim-reshard-log-entries id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:30:25.450 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:25.505 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:30:25.541 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:25.541 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:25.587 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.588+0000 7f3b0bbbb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.589 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.592+0000 7f3b0bbbb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:25.589 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.592+0000 7f3b0bbbb9c0 20 realm 2024-09-14T11:30:25.590 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.592+0000 7f3b0bbbb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.590 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.592+0000 7f3b0bbbb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:25.590 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.592+0000 7f3b0bbbb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:25.590 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.592+0000 7f3b0bbbb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.591 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.592+0000 7f3b0bbbb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:25.591 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.592+0000 7f3b0bbbb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.591 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.592+0000 7f3b0bbbb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:25.591 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.592+0000 7f3b0bbbb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.592 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.592+0000 7f3b0bbbb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:25.592 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.592+0000 7f3b0bbbb9c0 20 searching for the correct realm 2024-09-14T11:30:25.596 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.596+0000 7f3b09ec2640 0 -- 172.21.15.71:0/2722294812 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f3b00027040 msgr2=0x7f3b00018410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:25.809 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.812+0000 7f3b09ec2640 0 -- 172.21.15.71:0/2722294812 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x564409f44600 msgr2=0x564409f469f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:25.823 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.824+0000 7f3b0bbbb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:25.823 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.824+0000 7f3b0bbbb9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:30:25.823 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.824+0000 7f3b0bbbb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:25.823 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.824+0000 7f3b0bbbb9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:30:25.823 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.824+0000 7f3b0bbbb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:25.823 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.824+0000 7f3b0bbbb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:25.824 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.824+0000 7f3b0bbbb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.824 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.824+0000 7f3b0bbbb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:25.824 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.824+0000 7f3b0bbbb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.825 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.828+0000 7f3b0bbbb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:25.825 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.828+0000 7f3b0bbbb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.826 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.828+0000 7f3b0bbbb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:25.826 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.828+0000 7f3b0bbbb9c0 20 zone default found 2024-09-14T11:30:25.826 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.828+0000 7f3b0bbbb9c0 4 Realm: () 2024-09-14T11:30:25.826 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.828+0000 7f3b0bbbb9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:30:25.826 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.828+0000 7f3b0bbbb9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:30:25.826 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.828+0000 7f3b0bbbb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:25.826 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.828+0000 7f3b0bbbb9c0 20 zonegroup default 2024-09-14T11:30:25.827 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.828+0000 7f3b0bbbb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.827 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.828+0000 7f3b0bbbb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:25.827 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.828+0000 7f3b0bbbb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.827 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.828+0000 7f3b0bbbb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:25.827 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.828+0000 7f3b0bbbb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.829 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.828+0000 7f3b0bbbb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:25.829 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.828+0000 7f3b0bbbb9c0 20 started sync module instance, tier type = 2024-09-14T11:30:25.829 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.828+0000 7f3b0bbbb9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:30:25.850 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.852+0000 7f3b0bbbb9c0 20 add_watcher() i=0 2024-09-14T11:30:25.850 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.852+0000 7f3b0bbbb9c0 20 add_watcher() i=1 2024-09-14T11:30:25.850 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.852+0000 7f3b0bbbb9c0 20 add_watcher() i=2 2024-09-14T11:30:25.850 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.852+0000 7f3b0bbbb9c0 20 add_watcher() i=3 2024-09-14T11:30:25.850 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.852+0000 7f3b0bbbb9c0 20 add_watcher() i=4 2024-09-14T11:30:25.850 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.852+0000 7f3b0bbbb9c0 20 add_watcher() i=5 2024-09-14T11:30:25.850 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.852+0000 7f3b0bbbb9c0 20 add_watcher() i=6 2024-09-14T11:30:25.852 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.852+0000 7f3b0bbbb9c0 20 add_watcher() i=7 2024-09-14T11:30:25.852 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.852+0000 7f3b0bbbb9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:25.856 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.856+0000 7f39bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:25.857 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.860+0000 7f3b0bbbb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:25.857 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.860+0000 7f3b0bbbb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:25.857 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.860+0000 7f3b0bbbb9c0 5 note: GC not initialized 2024-09-14T11:30:25.858 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.860+0000 7f39be7e4640 20 reqs_thread_entry: start 2024-09-14T11:30:25.858 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.860+0000 7f3b0bbbb9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:30:25.858 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.860+0000 7f3b0bbbb9c0 20 Filter name: none 2024-09-14T11:30:25.858 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.860+0000 7f392ffff640 20 reqs_thread_entry: start 2024-09-14T11:30:25.858 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.860+0000 7f3b0bbbb9c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:30:25.858 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.860+0000 7f3b0bbbb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.859 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.860+0000 7f3b0bbbb9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:25.859 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.860+0000 7f3b0bbbb9c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:30:25.859 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.860+0000 7f3b0bbbb9c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:30:25.859 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.860+0000 7f3b0bbbb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 : miss 2024-09-14T11:30:25.859 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.860+0000 7f3b0bbbb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:25.859 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.860+0000 7f3b0bbbb9c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:30:25.859 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.860+0000 7f3b0bbbb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 info.flags=0x17 2024-09-14T11:30:25.859 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.860+0000 7f3b0bbbb9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 to cache LRU end 2024-09-14T11:30:25.860 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.860+0000 7f3b0bbbb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:25.860 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.860+0000 7f3b0bbbb9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:25.860 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.860+0000 7f3b0bbbb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 2024-09-14T11:30:25.860 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.860+0000 7f3b0bbbb9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 to be held by another RGW process; skipping for now 2024-09-14T11:30:25.861 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.864+0000 7f39bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:25.866 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.868+0000 7f3b0bbbb9c0 20 remove_watcher() i=0 2024-09-14T11:30:25.866 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.868+0000 7f3b0bbbb9c0 2 removed watcher, disabling cache 2024-09-14T11:30:25.868 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.868+0000 7f3b0bbbb9c0 20 remove_watcher() i=1 2024-09-14T11:30:25.869 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.872+0000 7f3b0bbbb9c0 20 remove_watcher() i=2 2024-09-14T11:30:25.872 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.872+0000 7f3b0bbbb9c0 20 remove_watcher() i=3 2024-09-14T11:30:25.874 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.876+0000 7f3b0bbbb9c0 20 remove_watcher() i=4 2024-09-14T11:30:25.876 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.876+0000 7f3b0bbbb9c0 20 remove_watcher() i=5 2024-09-14T11:30:25.879 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.880+0000 7f3b0bbbb9c0 20 remove_watcher() i=6 2024-09-14T11:30:25.881 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:25.884+0000 7f3b0bbbb9c0 20 remove_watcher() i=7 2024-09-14T11:30:25.896 INFO:tasks.workunit.client.0.smithi071.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:30:55.918 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:30:55.954 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:55.955 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:56.000 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:55.999+0000 7f000ac0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.003 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.003+0000 7f000ac0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.003 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.003+0000 7f000ac0b9c0 20 realm 2024-09-14T11:30:56.003 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.003+0000 7f000ac0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.003 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.003+0000 7f000ac0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.004 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.003+0000 7f000ac0b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:56.004 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.003+0000 7f000ac0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.004 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.003+0000 7f000ac0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.004 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.003+0000 7f000ac0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.005 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.007+0000 7f000ac0b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:56.005 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.007+0000 7f000ac0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.005 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.007+0000 7f000ac0b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:56.005 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.007+0000 7f000ac0b9c0 20 searching for the correct realm 2024-09-14T11:30:56.009 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.011+0000 7f0008f12640 0 -- 172.21.15.71:0/3091062338 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7efffc018070 msgr2=0x7efffc03cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:56.223 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.223+0000 7f0008f12640 0 -- 172.21.15.71:0/3091062338 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x559c42ac3190 msgr2=0x559c42ac5580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:56.238 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.239+0000 7f000ac0b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:56.238 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.239+0000 7f000ac0b9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:30:56.238 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.239+0000 7f000ac0b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:56.238 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.239+0000 7f000ac0b9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:30:56.238 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.239+0000 7f000ac0b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:56.238 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.239+0000 7f000ac0b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:56.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.239+0000 7f000ac0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.239+0000 7f000ac0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.239+0000 7f000ac0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.240 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.239+0000 7f000ac0b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:56.240 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.239+0000 7f000ac0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.241 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.243+0000 7f000ac0b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:56.241 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.243+0000 7f000ac0b9c0 20 zone default found 2024-09-14T11:30:56.241 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.243+0000 7f000ac0b9c0 4 Realm: () 2024-09-14T11:30:56.241 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.243+0000 7f000ac0b9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:30:56.241 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.243+0000 7f000ac0b9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:30:56.241 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.243+0000 7f000ac0b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:56.241 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.243+0000 7f000ac0b9c0 20 zonegroup default 2024-09-14T11:30:56.241 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.243+0000 7f000ac0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.242 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.243+0000 7f000ac0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.242 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.243+0000 7f000ac0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.242 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.243+0000 7f000ac0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.242 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.243+0000 7f000ac0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.243+0000 7f000ac0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.243+0000 7f000ac0b9c0 20 started sync module instance, tier type = 2024-09-14T11:30:56.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.243+0000 7f000ac0b9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:30:56.267 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.267+0000 7f000ac0b9c0 20 add_watcher() i=0 2024-09-14T11:30:56.267 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.267+0000 7f000ac0b9c0 20 add_watcher() i=1 2024-09-14T11:30:56.267 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.267+0000 7f000ac0b9c0 20 add_watcher() i=2 2024-09-14T11:30:56.267 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.267+0000 7f000ac0b9c0 20 add_watcher() i=3 2024-09-14T11:30:56.267 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.267+0000 7f000ac0b9c0 20 add_watcher() i=4 2024-09-14T11:30:56.267 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.267+0000 7f000ac0b9c0 20 add_watcher() i=5 2024-09-14T11:30:56.267 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.267+0000 7f000ac0b9c0 20 add_watcher() i=6 2024-09-14T11:30:56.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.271+0000 7f000ac0b9c0 20 add_watcher() i=7 2024-09-14T11:30:56.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.271+0000 7f000ac0b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:56.273 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.275+0000 7efebefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:56.274 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.275+0000 7f000ac0b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:56.274 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.275+0000 7f000ac0b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:56.274 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.275+0000 7f000ac0b9c0 5 note: GC not initialized 2024-09-14T11:30:56.275 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.275+0000 7efebdfdb640 20 reqs_thread_entry: start 2024-09-14T11:30:56.275 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.275+0000 7f000ac0b9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:30:56.275 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.275+0000 7f000ac0b9c0 20 Filter name: none 2024-09-14T11:30:56.276 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.275+0000 7efe2f7fe640 20 reqs_thread_entry: start 2024-09-14T11:30:56.276 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.275+0000 7f000ac0b9c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:30:56.276 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.275+0000 7f000ac0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.276 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.275+0000 7f000ac0b9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:56.276 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.275+0000 7f000ac0b9c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:30:56.277 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.275+0000 7f000ac0b9c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:30:56.277 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.275+0000 7f000ac0b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 : miss 2024-09-14T11:30:56.277 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.275+0000 7f000ac0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.277 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.279+0000 7f000ac0b9c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:30:56.277 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.279+0000 7f000ac0b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 info.flags=0x17 2024-09-14T11:30:56.277 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.279+0000 7f000ac0b9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 to cache LRU end 2024-09-14T11:30:56.278 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.279+0000 7f000ac0b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:56.278 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.279+0000 7f000ac0b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:56.278 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.279+0000 7f000ac0b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 2024-09-14T11:30:56.279 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.279+0000 7f000ac0b9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:30:56.294 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.295+0000 7f000ac0b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 info.flags=0x17 2024-09-14T11:30:56.294 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.295+0000 7f000ac0b9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 to cache LRU end 2024-09-14T11:30:56.294 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.295+0000 7f000ac0b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:56.295 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.295+0000 7f000ac0b9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28, ofs0, ns] 2024-09-14T11:30:56.295 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.295+0000 7efedeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464367 cookie 94129621874272 notifier 6566 bl.length()=1023 2024-09-14T11:30:56.295 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.295+0000 7efedeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 info.flags=0x17 2024-09-14T11:30:56.295 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.295+0000 7efedeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 to cache LRU end 2024-09-14T11:30:56.295 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.295+0000 7efedeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:56.295 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.295+0000 7f000ac0b9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.28]): orig_sources= new_sources= 2024-09-14T11:30:56.296 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.295+0000 7f000ac0b9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.28]): potential sources added=[] removed=[] 2024-09-14T11:30:56.296 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.295+0000 7f000ac0b9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.28]): orig_dests= new_dests= 2024-09-14T11:30:56.296 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.295+0000 7f000ac0b9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.28]): potential dests added=[] removed=[] 2024-09-14T11:30:56.305 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.307+0000 7f000ac0b9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.2.0 2024-09-14T11:30:56.305 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.307+0000 7f000ac0b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.2.0 2024-09-14T11:30:56.305 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.307+0000 7f000ac0b9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.2.1 2024-09-14T11:30:56.305 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.307+0000 7f000ac0b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.2.1 2024-09-14T11:30:56.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.307+0000 7f000ac0b9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.2.2 2024-09-14T11:30:56.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.307+0000 7f000ac0b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.2.2 2024-09-14T11:30:56.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.307+0000 7f000ac0b9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.2.3 2024-09-14T11:30:56.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.307+0000 7f000ac0b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.2.3 2024-09-14T11:30:56.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.307+0000 7f000ac0b9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.2.4 2024-09-14T11:30:56.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.307+0000 7f000ac0b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.2.4 2024-09-14T11:30:56.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.307+0000 7f000ac0b9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.2.5 2024-09-14T11:30:56.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.307+0000 7f000ac0b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.2.5 2024-09-14T11:30:56.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.307+0000 7f000ac0b9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.2.6 2024-09-14T11:30:56.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.307+0000 7f000ac0b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.2.6 2024-09-14T11:30:56.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.307+0000 7f000ac0b9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.2.7 2024-09-14T11:30:56.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.307+0000 7f000ac0b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.2.7 2024-09-14T11:30:56.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.307+0000 7f000ac0b9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.2.8 2024-09-14T11:30:56.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.307+0000 7f000ac0b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.2.8 2024-09-14T11:30:56.307 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.307+0000 7f000ac0b9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.2.9 2024-09-14T11:30:56.307 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.307+0000 7f000ac0b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.2.9 2024-09-14T11:30:56.307 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.307+0000 7f000ac0b9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.2.10 2024-09-14T11:30:56.307 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.307+0000 7f000ac0b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.2.10 2024-09-14T11:30:56.307 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.307+0000 7f000ac0b9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.2.11 2024-09-14T11:30:56.307 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.307+0000 7f000ac0b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.2.11 2024-09-14T11:30:56.307 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.307+0000 7f000ac0b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.0 2024-09-14T11:30:56.308 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.307+0000 7f000ac0b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.1 2024-09-14T11:30:56.308 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.307+0000 7f000ac0b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.2 2024-09-14T11:30:56.308 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.307+0000 7f000ac0b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.3 2024-09-14T11:30:56.308 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.307+0000 7f000ac0b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.4 2024-09-14T11:30:56.309 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.311+0000 7f000ac0b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.5 2024-09-14T11:30:56.311 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.311+0000 7f000ac0b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.6 2024-09-14T11:30:56.311 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.311+0000 7f000ac0b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.7 2024-09-14T11:30:56.312 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.311+0000 7f000ac0b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.8 2024-09-14T11:30:56.313 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.315+0000 7f000ac0b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.9 2024-09-14T11:30:56.314 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.315+0000 7f000ac0b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.10 2024-09-14T11:30:56.322 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.323+0000 7f000ac0b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:30:56.322 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.323+0000 7f000ac0b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 2024-09-14T11:30:56.323 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.323+0000 7f000ac0b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 info.flags=0x17 2024-09-14T11:30:56.323 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.323+0000 7f000ac0b9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 to cache LRU end 2024-09-14T11:30:56.324 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.323+0000 7f000ac0b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:56.324 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.323+0000 7f000ac0b9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28, ofs0, ns] 2024-09-14T11:30:56.324 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.323+0000 7efedf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464368 cookie 94129621874272 notifier 6566 bl.length()=1023 2024-09-14T11:30:56.324 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.323+0000 7efedf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 info.flags=0x17 2024-09-14T11:30:56.324 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.323+0000 7efedf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 to cache LRU end 2024-09-14T11:30:56.325 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.323+0000 7efedf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:56.325 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.323+0000 7f000ac0b9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.28]): orig_sources= new_sources= 2024-09-14T11:30:56.325 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.323+0000 7f000ac0b9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.28]): potential sources added=[] removed=[] 2024-09-14T11:30:56.325 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.323+0000 7f000ac0b9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.28]): orig_dests= new_dests= 2024-09-14T11:30:56.325 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.323+0000 7f000ac0b9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.28]): potential dests added=[] removed=[] 2024-09-14T11:30:56.329 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.331+0000 7f000ac0b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.0 2024-09-14T11:30:56.329 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.331+0000 7f000ac0b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.1 2024-09-14T11:30:56.330 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.331+0000 7f000ac0b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.2 2024-09-14T11:30:56.331 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.331+0000 7f000ac0b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.3 2024-09-14T11:30:56.331 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.331+0000 7f000ac0b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.4 2024-09-14T11:30:56.332 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.331+0000 7f000ac0b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.5 2024-09-14T11:30:56.333 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.335+0000 7f000ac0b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.6 2024-09-14T11:30:56.333 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.335+0000 7f000ac0b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.7 2024-09-14T11:30:56.334 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.335+0000 7f000ac0b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.8 2024-09-14T11:30:56.334 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.335+0000 7f000ac0b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.9 2024-09-14T11:30:56.335 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.335+0000 7f000ac0b9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.28.10 2024-09-14T11:30:56.336 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.335+0000 7f000ac0b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:30:56.336 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.335+0000 7f000ac0b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 2024-09-14T11:30:56.338 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.339+0000 7f000ac0b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 info.flags=0x17 2024-09-14T11:30:56.338 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.339+0000 7f000ac0b9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 to cache LRU end 2024-09-14T11:30:56.338 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.339+0000 7f000ac0b9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:56.338 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.339+0000 7f000ac0b9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28, ofs0, ns] 2024-09-14T11:30:56.339 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.339+0000 7efedeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464369 cookie 94129621874272 notifier 6566 bl.length()=991 2024-09-14T11:30:56.339 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.339+0000 7efedeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 info.flags=0x17 2024-09-14T11:30:56.339 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.339+0000 7efedeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:4444f441-0c56-48df-a905-d49e7e44d629.4596.28 to cache LRU end 2024-09-14T11:30:56.339 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.339+0000 7efedeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:56.339 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.339+0000 7f000ac0b9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.28]): orig_sources= new_sources= 2024-09-14T11:30:56.339 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.339+0000 7f000ac0b9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.28]): potential sources added=[] removed=[] 2024-09-14T11:30:56.339 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.339+0000 7f000ac0b9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.28]): orig_dests= new_dests= 2024-09-14T11:30:56.339 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.339+0000 7f000ac0b9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[4444f441-0c56-48df-a905-d49e7e44d629.4596.28]): potential dests added=[] removed=[] 2024-09-14T11:30:56.343 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.343+0000 7f000ac0b9c0 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-14T11:30:56.346 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.347+0000 7efebefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:56.350 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.351+0000 7f000ac0b9c0 20 remove_watcher() i=0 2024-09-14T11:30:56.350 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.351+0000 7f000ac0b9c0 2 removed watcher, disabling cache 2024-09-14T11:30:56.352 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.351+0000 7f000ac0b9c0 20 remove_watcher() i=1 2024-09-14T11:30:56.354 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.355+0000 7f000ac0b9c0 20 remove_watcher() i=2 2024-09-14T11:30:56.356 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.355+0000 7f000ac0b9c0 20 remove_watcher() i=3 2024-09-14T11:30:56.358 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.359+0000 7f000ac0b9c0 20 remove_watcher() i=4 2024-09-14T11:30:56.360 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.363+0000 7f000ac0b9c0 20 remove_watcher() i=5 2024-09-14T11:30:56.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.363+0000 7f000ac0b9c0 20 remove_watcher() i=6 2024-09-14T11:30:56.366 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.367+0000 7f000ac0b9c0 20 remove_watcher() i=7 2024-09-14T11:30:56.386 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:30:56.415 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:56.415 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:56.458 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.459+0000 7fb3176059c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.459+0000 7fb3176059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.459+0000 7fb3176059c0 20 realm 2024-09-14T11:30:56.461 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.459+0000 7fb3176059c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.461 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.463+0000 7fb3176059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.461 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.463+0000 7fb3176059c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:56.461 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.463+0000 7fb3176059c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.463+0000 7fb3176059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.463+0000 7fb3176059c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.463+0000 7fb3176059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:56.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.463+0000 7fb3176059c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.463+0000 7fb3176059c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:56.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.463+0000 7fb3176059c0 20 searching for the correct realm 2024-09-14T11:30:56.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.467+0000 7fb31590c640 0 -- 172.21.15.71:0/1379340088 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fb308008040 msgr2=0x7fb3080560b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:56.681 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.683+0000 7fb31590c640 0 -- 172.21.15.71:0/1379340088 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x561d37bb54e0 msgr2=0x561d37bb78d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:56.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.695+0000 7fb3176059c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:56.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.695+0000 7fb3176059c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:30:56.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.695+0000 7fb3176059c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:56.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.695+0000 7fb3176059c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:30:56.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.695+0000 7fb3176059c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:56.696 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.695+0000 7fb3176059c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:56.696 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.695+0000 7fb3176059c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.696 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.695+0000 7fb3176059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.696 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.695+0000 7fb3176059c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.696 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.695+0000 7fb3176059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:56.696 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.695+0000 7fb3176059c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.697 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.699+0000 7fb3176059c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:56.697 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.699+0000 7fb3176059c0 20 zone default found 2024-09-14T11:30:56.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.699+0000 7fb3176059c0 4 Realm: () 2024-09-14T11:30:56.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.699+0000 7fb3176059c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:30:56.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.699+0000 7fb3176059c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:30:56.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.699+0000 7fb3176059c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:56.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.699+0000 7fb3176059c0 20 zonegroup default 2024-09-14T11:30:56.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.699+0000 7fb3176059c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.699+0000 7fb3176059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.699+0000 7fb3176059c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.699+0000 7fb3176059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.699+0000 7fb3176059c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.699+0000 7fb3176059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.699+0000 7fb3176059c0 20 started sync module instance, tier type = 2024-09-14T11:30:56.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.699+0000 7fb3176059c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:30:56.721 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.723+0000 7fb3176059c0 20 add_watcher() i=0 2024-09-14T11:30:56.721 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.723+0000 7fb3176059c0 20 add_watcher() i=1 2024-09-14T11:30:56.721 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.723+0000 7fb3176059c0 20 add_watcher() i=2 2024-09-14T11:30:56.721 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.723+0000 7fb3176059c0 20 add_watcher() i=3 2024-09-14T11:30:56.721 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.723+0000 7fb3176059c0 20 add_watcher() i=4 2024-09-14T11:30:56.721 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.723+0000 7fb3176059c0 20 add_watcher() i=5 2024-09-14T11:30:56.722 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.723+0000 7fb3176059c0 20 add_watcher() i=6 2024-09-14T11:30:56.723 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.723+0000 7fb3176059c0 20 add_watcher() i=7 2024-09-14T11:30:56.723 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.723+0000 7fb3176059c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:56.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.727+0000 7fb1cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:56.728 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.727+0000 7fb3176059c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:56.728 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.727+0000 7fb3176059c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:56.728 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.727+0000 7fb3176059c0 5 note: GC not initialized 2024-09-14T11:30:56.728 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.727+0000 7fb1ca7e4640 20 reqs_thread_entry: start 2024-09-14T11:30:56.728 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.727+0000 7fb3176059c0 20 init_complete bucket index max shards: 11 2024-09-14T11:30:56.728 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.727+0000 7fb3176059c0 20 Filter name: none 2024-09-14T11:30:56.729 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.727+0000 7fb3176059c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.729 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.727+0000 7fb13bfff640 20 reqs_thread_entry: start 2024-09-14T11:30:56.729 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.731+0000 7fb3176059c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:56.729 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.731+0000 7fb3176059c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.730 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.731+0000 7fb3176059c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:30:56.730 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.731+0000 7fb3176059c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:56.730 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.731+0000 7fb3176059c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.730 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.731+0000 7fb3176059c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:56.730 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.731+0000 7fb3176059c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.731 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.731+0000 7fb3176059c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:30:56.731 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.731+0000 7fb3176059c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:56.734 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.735+0000 7fb1cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:56.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.739+0000 7fb3176059c0 20 remove_watcher() i=0 2024-09-14T11:30:56.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.739+0000 7fb3176059c0 2 removed watcher, disabling cache 2024-09-14T11:30:56.740 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.739+0000 7fb3176059c0 20 remove_watcher() i=1 2024-09-14T11:30:56.742 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.743+0000 7fb3176059c0 20 remove_watcher() i=2 2024-09-14T11:30:56.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.743+0000 7fb3176059c0 20 remove_watcher() i=3 2024-09-14T11:30:56.746 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.747+0000 7fb3176059c0 20 remove_watcher() i=4 2024-09-14T11:30:56.748 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.747+0000 7fb3176059c0 20 remove_watcher() i=5 2024-09-14T11:30:56.751 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.751+0000 7fb3176059c0 20 remove_watcher() i=6 2024-09-14T11:30:56.753 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:56.755+0000 7fb3176059c0 20 remove_watcher() i=7 2024-09-14T11:30:56.768 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:56.768 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:30:56.768 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: abort-at-trim-reshard-log-entries id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:30:56.769 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:56.888 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-14T11:30:56.888 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:57.297 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:30:57.330 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:57.330 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:57.581 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.583+0000 7f1bdb0929c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.584 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.583+0000 7f1bdb0929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:57.584 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.583+0000 7f1bdb0929c0 20 realm 2024-09-14T11:30:57.584 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.583+0000 7f1bdb0929c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.585 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.587+0000 7f1bdb0929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:57.585 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.587+0000 7f1bdb0929c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:57.585 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.587+0000 7f1bdb0929c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.585 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.587+0000 7f1bdb0929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:57.585 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.587+0000 7f1bdb0929c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.586 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.587+0000 7f1bdb0929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:57.586 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.587+0000 7f1bdb0929c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.587 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.587+0000 7f1bdb0929c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:57.587 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.587+0000 7f1bdb0929c0 20 searching for the correct realm 2024-09-14T11:30:57.588 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.587+0000 7f1bd8b98640 0 -- 172.21.15.71:0/1621455219 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x5579e6ef2230 msgr2=0x5579e6ef46f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:57.594 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.595+0000 7f1bd8b98640 0 -- 172.21.15.71:0/1621455219 >> [v2:172.21.15.157:6808/527702018,v1:172.21.15.157:6809/527702018] conn(0x7f1bc80c2900 msgr2=0x7f1bc80ad420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:57.821 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.823+0000 7f1bdb0929c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:57.821 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.823+0000 7f1bdb0929c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:30:57.821 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.823+0000 7f1bdb0929c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:57.821 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.823+0000 7f1bdb0929c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:30:57.821 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.823+0000 7f1bdb0929c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:57.821 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.823+0000 7f1bdb0929c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:57.821 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.823+0000 7f1bdb0929c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.822 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.823+0000 7f1bdb0929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:57.822 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.823+0000 7f1bdb0929c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.823 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.823+0000 7f1bdb0929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:57.823 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.823+0000 7f1bdb0929c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.824 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.823+0000 7f1bdb0929c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:57.824 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.823+0000 7f1bdb0929c0 20 zone default found 2024-09-14T11:30:57.824 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.823+0000 7f1bdb0929c0 4 Realm: () 2024-09-14T11:30:57.824 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.823+0000 7f1bdb0929c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:30:57.824 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.823+0000 7f1bdb0929c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:30:57.824 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.823+0000 7f1bdb0929c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:57.824 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.823+0000 7f1bdb0929c0 20 zonegroup default 2024-09-14T11:30:57.824 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.823+0000 7f1bdb0929c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.825 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.827+0000 7f1bdb0929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:57.825 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.827+0000 7f1bdb0929c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.826 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.827+0000 7f1bdb0929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:57.826 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.827+0000 7f1bdb0929c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.827 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.827+0000 7f1bdb0929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:57.827 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.827+0000 7f1bdb0929c0 20 started sync module instance, tier type = 2024-09-14T11:30:57.827 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.827+0000 7f1bdb0929c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:30:57.850 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.851+0000 7f1bdb0929c0 20 add_watcher() i=0 2024-09-14T11:30:57.850 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.851+0000 7f1bdb0929c0 20 add_watcher() i=1 2024-09-14T11:30:57.850 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.851+0000 7f1bdb0929c0 20 add_watcher() i=2 2024-09-14T11:30:57.850 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.851+0000 7f1bdb0929c0 20 add_watcher() i=3 2024-09-14T11:30:57.850 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.851+0000 7f1bdb0929c0 20 add_watcher() i=4 2024-09-14T11:30:57.850 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.851+0000 7f1bdb0929c0 20 add_watcher() i=5 2024-09-14T11:30:57.850 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.851+0000 7f1bdb0929c0 20 add_watcher() i=6 2024-09-14T11:30:57.852 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.851+0000 7f1bdb0929c0 20 add_watcher() i=7 2024-09-14T11:30:57.852 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.851+0000 7f1bdb0929c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:57.857 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.859+0000 7f1a8efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:57.858 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.859+0000 7f1bdb0929c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:57.858 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.859+0000 7f1bdb0929c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:57.858 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.859+0000 7f1bdb0929c0 5 note: GC not initialized 2024-09-14T11:30:57.859 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.859+0000 7f1a8dfe3640 20 reqs_thread_entry: start 2024-09-14T11:30:57.859 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.859+0000 7f1bdb0929c0 20 init_complete bucket index max shards: 11 2024-09-14T11:30:57.859 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.859+0000 7f1bdb0929c0 20 Filter name: none 2024-09-14T11:30:57.859 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.859+0000 7f19ff7fe640 20 reqs_thread_entry: start 2024-09-14T11:30:57.859 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.859+0000 7f1bdb0929c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.860 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.859+0000 7f1bdb0929c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:30:57.860 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.859+0000 7f1bdb0929c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.861 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.863+0000 7f1bdb0929c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:30:57.861 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.863+0000 7f1bdb0929c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:57.861 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.863+0000 7f1bdb0929c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.863+0000 7f1bdb0929c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:30:57.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.863+0000 7f1bdb0929c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.863+0000 7f1bdb0929c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:30:57.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.863+0000 7f1bdb0929c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:57.866 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.867+0000 7f1a8efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:57.870 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.871+0000 7f1bdb0929c0 20 remove_watcher() i=0 2024-09-14T11:30:57.870 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.871+0000 7f1bdb0929c0 2 removed watcher, disabling cache 2024-09-14T11:30:57.872 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.871+0000 7f1bdb0929c0 20 remove_watcher() i=1 2024-09-14T11:30:57.874 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.875+0000 7f1bdb0929c0 20 remove_watcher() i=2 2024-09-14T11:30:57.877 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.879+0000 7f1bdb0929c0 20 remove_watcher() i=3 2024-09-14T11:30:57.879 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.879+0000 7f1bdb0929c0 20 remove_watcher() i=4 2024-09-14T11:30:57.881 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.883+0000 7f1bdb0929c0 20 remove_watcher() i=5 2024-09-14T11:30:57.884 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.883+0000 7f1bdb0929c0 20 remove_watcher() i=6 2024-09-14T11:30:57.887 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.887+0000 7f1bdb0929c0 20 remove_watcher() i=7 2024-09-14T11:30:57.904 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:57.904 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:30:57.904 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: error-at-block-writes id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:30:57.904 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:57.904 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-14T11:30:57.941 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:57.941 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:57.984 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.983+0000 7f6ec5ae69c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.987+0000 7f6ec5ae69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:57.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.987+0000 7f6ec5ae69c0 20 realm 2024-09-14T11:30:57.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.987+0000 7f6ec5ae69c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.987+0000 7f6ec5ae69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:57.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.987+0000 7f6ec5ae69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:57.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.987+0000 7f6ec5ae69c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.987+0000 7f6ec5ae69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:57.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.987+0000 7f6ec5ae69c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.987+0000 7f6ec5ae69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:57.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.987+0000 7f6ec5ae69c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:57.989 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.991+0000 7f6ec5ae69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:57.989 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.991+0000 7f6ec5ae69c0 20 searching for the correct realm 2024-09-14T11:30:57.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:57.995+0000 7f6ec3ded640 0 -- 172.21.15.71:0/1096121907 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f6eb80f1060 msgr2=0x7f6eb8124ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:58.208 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.207+0000 7f6ec3ded640 0 -- 172.21.15.71:0/1096121907 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x558ae2e63cf0 msgr2=0x558ae2e66100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:58.223 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.223+0000 7f6ec5ae69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:58.223 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.223+0000 7f6ec5ae69c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:30:58.223 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.223+0000 7f6ec5ae69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:58.223 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.223+0000 7f6ec5ae69c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:30:58.223 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.223+0000 7f6ec5ae69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:58.223 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.223+0000 7f6ec5ae69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:58.223 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.223+0000 7f6ec5ae69c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.223 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.223+0000 7f6ec5ae69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.224 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.223+0000 7f6ec5ae69c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.224 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.223+0000 7f6ec5ae69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:58.224 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.223+0000 7f6ec5ae69c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.225 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.227+0000 7f6ec5ae69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:58.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.227+0000 7f6ec5ae69c0 20 zone default found 2024-09-14T11:30:58.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.227+0000 7f6ec5ae69c0 4 Realm: () 2024-09-14T11:30:58.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.227+0000 7f6ec5ae69c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:30:58.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.227+0000 7f6ec5ae69c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:30:58.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.227+0000 7f6ec5ae69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:58.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.227+0000 7f6ec5ae69c0 20 zonegroup default 2024-09-14T11:30:58.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.227+0000 7f6ec5ae69c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.227+0000 7f6ec5ae69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.227+0000 7f6ec5ae69c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.227+0000 7f6ec5ae69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.227+0000 7f6ec5ae69c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.227+0000 7f6ec5ae69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.227+0000 7f6ec5ae69c0 20 started sync module instance, tier type = 2024-09-14T11:30:58.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.227+0000 7f6ec5ae69c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:30:58.250 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.251+0000 7f6ec5ae69c0 20 add_watcher() i=0 2024-09-14T11:30:58.250 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.251+0000 7f6ec5ae69c0 20 add_watcher() i=1 2024-09-14T11:30:58.250 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.251+0000 7f6ec5ae69c0 20 add_watcher() i=2 2024-09-14T11:30:58.250 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.251+0000 7f6ec5ae69c0 20 add_watcher() i=3 2024-09-14T11:30:58.250 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.251+0000 7f6ec5ae69c0 20 add_watcher() i=4 2024-09-14T11:30:58.250 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.251+0000 7f6ec5ae69c0 20 add_watcher() i=5 2024-09-14T11:30:58.250 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.251+0000 7f6ec5ae69c0 20 add_watcher() i=6 2024-09-14T11:30:58.252 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.251+0000 7f6ec5ae69c0 20 add_watcher() i=7 2024-09-14T11:30:58.253 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.251+0000 7f6ec5ae69c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:58.256 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.255+0000 7f6d79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:58.257 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.259+0000 7f6ec5ae69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:58.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.259+0000 7f6ec5ae69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:58.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.259+0000 7f6ec5ae69c0 5 note: GC not initialized 2024-09-14T11:30:58.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.259+0000 7f6d78fe1640 20 reqs_thread_entry: start 2024-09-14T11:30:58.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.259+0000 7f6ec5ae69c0 20 init_complete bucket index max shards: 11 2024-09-14T11:30:58.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.259+0000 7f6ec5ae69c0 20 Filter name: none 2024-09-14T11:30:58.259 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.259+0000 7f6cf27fc640 20 reqs_thread_entry: start 2024-09-14T11:30:58.259 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.259+0000 7f6ec5ae69c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-14T11:30:58.259 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.259+0000 7f6ec5ae69c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.259 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.259+0000 7f6ec5ae69c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:30:58.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.259+0000 7f6ec5ae69c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-14T11:30:58.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.259+0000 7f6ec5ae69c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-14T11:30:58.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.259+0000 7f6ec5ae69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 : miss 2024-09-14T11:30:58.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.259+0000 7f6ec5ae69c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.261 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.263+0000 7f6ec5ae69c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:30:58.261 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.263+0000 7f6ec5ae69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 info.flags=0x17 2024-09-14T11:30:58.261 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.263+0000 7f6ec5ae69c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 to cache LRU end 2024-09-14T11:30:58.261 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.263+0000 7f6ec5ae69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:58.261 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.263+0000 7f6ec5ae69c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:58.261 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.263+0000 7f6ec5ae69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 2024-09-14T11:30:58.272 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.271+0000 7f6ec5ae69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 info.flags=0x17 2024-09-14T11:30:58.272 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.271+0000 7f6ec5ae69c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 to cache LRU end 2024-09-14T11:30:58.272 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.271+0000 7f6ec5ae69c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:58.272 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.271+0000 7f6ec5ae69c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29, ofs0, ns] 2024-09-14T11:30:58.272 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.271+0000 7f6da67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464296 cookie 94055000627104 notifier 6942 bl.length()=999 2024-09-14T11:30:58.272 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.271+0000 7f6da67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 info.flags=0x17 2024-09-14T11:30:58.273 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.271+0000 7f6da67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 to cache LRU end 2024-09-14T11:30:58.273 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.271+0000 7f6da67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:58.273 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.275+0000 7f6ec5ae69c0 20 handle_bi_update(): bucket=:error-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.29]): orig_sources= new_sources= 2024-09-14T11:30:58.273 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.275+0000 7f6ec5ae69c0 20 handle_bi_update(): bucket=:error-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.29]): potential sources added=[] removed=[] 2024-09-14T11:30:58.273 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.275+0000 7f6ec5ae69c0 20 handle_bi_update(): bucket=:error-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.29]): orig_dests= new_dests= 2024-09-14T11:30:58.273 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.275+0000 7f6ec5ae69c0 20 handle_bi_update(): bucket=:error-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.29]): potential dests added=[] removed=[] 2024-09-14T11:30:58.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.283+0000 7f6ec5ae69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.0 2024-09-14T11:30:58.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.283+0000 7f6ec5ae69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.0 2024-09-14T11:30:58.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.283+0000 7f6ec5ae69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.1 2024-09-14T11:30:58.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.283+0000 7f6ec5ae69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.1 2024-09-14T11:30:58.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.283+0000 7f6ec5ae69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.2 2024-09-14T11:30:58.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.283+0000 7f6ec5ae69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.2 2024-09-14T11:30:58.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.283+0000 7f6ec5ae69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.3 2024-09-14T11:30:58.284 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.283+0000 7f6ec5ae69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.3 2024-09-14T11:30:58.284 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.283+0000 7f6ec5ae69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.4 2024-09-14T11:30:58.284 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.283+0000 7f6ec5ae69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.4 2024-09-14T11:30:58.284 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.283+0000 7f6ec5ae69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.5 2024-09-14T11:30:58.284 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.283+0000 7f6ec5ae69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.5 2024-09-14T11:30:58.284 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.283+0000 7f6ec5ae69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.6 2024-09-14T11:30:58.284 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.283+0000 7f6ec5ae69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.6 2024-09-14T11:30:58.284 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.283+0000 7f6ec5ae69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.7 2024-09-14T11:30:58.284 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.283+0000 7f6ec5ae69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.7 2024-09-14T11:30:58.284 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.283+0000 7f6ec5ae69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.8 2024-09-14T11:30:58.284 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.283+0000 7f6ec5ae69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.8 2024-09-14T11:30:58.284 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.283+0000 7f6ec5ae69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.9 2024-09-14T11:30:58.284 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.283+0000 7f6ec5ae69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.9 2024-09-14T11:30:58.285 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.283+0000 7f6ec5ae69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.10 2024-09-14T11:30:58.285 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.283+0000 7f6ec5ae69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.10 2024-09-14T11:30:58.285 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.283+0000 7f6ec5ae69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.11 2024-09-14T11:30:58.285 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.283+0000 7f6ec5ae69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.11 2024-09-14T11:30:58.285 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.283+0000 7f6ec5ae69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.0 2024-09-14T11:30:58.285 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.283+0000 7f6ec5ae69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1 2024-09-14T11:30:58.285 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.283+0000 7f6ec5ae69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.2 2024-09-14T11:30:58.286 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.287+0000 7f6ec5ae69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.3 2024-09-14T11:30:58.286 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.287+0000 7f6ec5ae69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.4 2024-09-14T11:30:58.286 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.287+0000 7f6ec5ae69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.5 2024-09-14T11:30:58.286 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.287+0000 7f6ec5ae69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.6 2024-09-14T11:30:58.287 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.287+0000 7f6ec5ae69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.7 2024-09-14T11:30:58.288 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.291+0000 7f6ec5ae69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.8 2024-09-14T11:30:58.289 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.291+0000 7f6ec5ae69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.9 2024-09-14T11:30:58.290 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.291+0000 7f6ec5ae69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.10 2024-09-14T11:30:58.297 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.299+0000 7f6ec5ae69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:30:58.297 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.299+0000 7f6ec5ae69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 2024-09-14T11:30:58.300 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.299+0000 7f6ec5ae69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 info.flags=0x17 2024-09-14T11:30:58.300 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.299+0000 7f6ec5ae69c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 to cache LRU end 2024-09-14T11:30:58.300 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.299+0000 7f6ec5ae69c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:58.300 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.299+0000 7f6ec5ae69c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29, ofs0, ns] 2024-09-14T11:30:58.301 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.303+0000 7f6da6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464297 cookie 94055000627104 notifier 6942 bl.length()=999 2024-09-14T11:30:58.301 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.303+0000 7f6da6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 info.flags=0x17 2024-09-14T11:30:58.301 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.303+0000 7f6da6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 to cache LRU end 2024-09-14T11:30:58.301 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.303+0000 7f6da6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:58.302 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.303+0000 7f6ec5ae69c0 20 handle_bi_update(): bucket=:error-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.29]): orig_sources= new_sources= 2024-09-14T11:30:58.302 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.303+0000 7f6ec5ae69c0 20 handle_bi_update(): bucket=:error-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.29]): potential sources added=[] removed=[] 2024-09-14T11:30:58.302 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.303+0000 7f6ec5ae69c0 20 handle_bi_update(): bucket=:error-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.29]): orig_dests= new_dests= 2024-09-14T11:30:58.302 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.303+0000 7f6ec5ae69c0 20 handle_bi_update(): bucket=:error-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.29]): potential dests added=[] removed=[] 2024-09-14T11:30:58.302 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.303+0000 7f6ec5ae69c0 -1 Injecting error=-5 at location=block_writes 2024-09-14T11:30:58.302 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.303+0000 7f6ec5ae69c0 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-14T11:30:58.312 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.311+0000 7f6ec5ae69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:30:58.312 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.311+0000 7f6ec5ae69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 2024-09-14T11:30:58.315 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.315+0000 7f6ec5ae69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 info.flags=0x17 2024-09-14T11:30:58.315 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.315+0000 7f6ec5ae69c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 to cache LRU end 2024-09-14T11:30:58.315 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.315+0000 7f6ec5ae69c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:58.315 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.315+0000 7f6ec5ae69c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29, ofs0, ns] 2024-09-14T11:30:58.316 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.315+0000 7f6da6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464298 cookie 94055000627104 notifier 6942 bl.length()=967 2024-09-14T11:30:58.316 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.315+0000 7f6da6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 info.flags=0x17 2024-09-14T11:30:58.316 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.315+0000 7f6da6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 to cache LRU end 2024-09-14T11:30:58.316 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.315+0000 7f6da6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:58.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.315+0000 7f6ec5ae69c0 20 handle_bi_update(): bucket=:error-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.29]): orig_sources= new_sources= 2024-09-14T11:30:58.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.315+0000 7f6ec5ae69c0 20 handle_bi_update(): bucket=:error-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.29]): potential sources added=[] removed=[] 2024-09-14T11:30:58.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.315+0000 7f6ec5ae69c0 20 handle_bi_update(): bucket=:error-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.29]): orig_dests= new_dests= 2024-09-14T11:30:58.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.315+0000 7f6ec5ae69c0 20 handle_bi_update(): bucket=:error-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.29]): potential dests added=[] removed=[] 2024-09-14T11:30:58.322 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.323+0000 7f6ec5ae69c0 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-14T11:30:58.325 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.327+0000 7f6d79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:58.330 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.331+0000 7f6ec5ae69c0 20 remove_watcher() i=0 2024-09-14T11:30:58.330 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.331+0000 7f6ec5ae69c0 2 removed watcher, disabling cache 2024-09-14T11:30:58.332 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.331+0000 7f6ec5ae69c0 20 remove_watcher() i=1 2024-09-14T11:30:58.334 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.335+0000 7f6ec5ae69c0 20 remove_watcher() i=2 2024-09-14T11:30:58.336 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.335+0000 7f6ec5ae69c0 20 remove_watcher() i=3 2024-09-14T11:30:58.338 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.339+0000 7f6ec5ae69c0 20 remove_watcher() i=4 2024-09-14T11:30:58.341 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.343+0000 7f6ec5ae69c0 20 remove_watcher() i=5 2024-09-14T11:30:58.343 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.343+0000 7f6ec5ae69c0 20 remove_watcher() i=6 2024-09-14T11:30:58.346 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.347+0000 7f6ec5ae69c0 20 remove_watcher() i=7 2024-09-14T11:30:58.363 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:30:58.391 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:58.391 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:58.436 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.435+0000 7fa49fb9b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.439 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.439+0000 7fa49fb9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.439 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.439+0000 7fa49fb9b9c0 20 realm 2024-09-14T11:30:58.439 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.439+0000 7fa49fb9b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.440 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.439+0000 7fa49fb9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.440 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.439+0000 7fa49fb9b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:58.440 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.439+0000 7fa49fb9b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.440 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.439+0000 7fa49fb9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.440 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.439+0000 7fa49fb9b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.441 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.443+0000 7fa49fb9b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:58.441 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.443+0000 7fa49fb9b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.442 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.443+0000 7fa49fb9b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:58.442 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.443+0000 7fa49fb9b9c0 20 searching for the correct realm 2024-09-14T11:30:58.445 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.447+0000 7fa49dea2640 0 -- 172.21.15.71:0/2582127189 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fa494031020 msgr2=0x7fa494064290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:58.660 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.659+0000 7fa49dea2640 0 -- 172.21.15.71:0/2582127189 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x563229d3dc50 msgr2=0x563229d40040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:58.676 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.675+0000 7fa49fb9b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:58.676 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.675+0000 7fa49fb9b9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:30:58.676 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.675+0000 7fa49fb9b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:58.676 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.675+0000 7fa49fb9b9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:30:58.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.675+0000 7fa49fb9b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:58.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.675+0000 7fa49fb9b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:58.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.675+0000 7fa49fb9b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.679+0000 7fa49fb9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.679+0000 7fa49fb9b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.678 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.679+0000 7fa49fb9b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:58.678 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.679+0000 7fa49fb9b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.679 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.679+0000 7fa49fb9b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:58.679 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.679+0000 7fa49fb9b9c0 20 zone default found 2024-09-14T11:30:58.680 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.679+0000 7fa49fb9b9c0 4 Realm: () 2024-09-14T11:30:58.680 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.679+0000 7fa49fb9b9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:30:58.680 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.679+0000 7fa49fb9b9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:30:58.680 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.679+0000 7fa49fb9b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:58.680 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.679+0000 7fa49fb9b9c0 20 zonegroup default 2024-09-14T11:30:58.680 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.679+0000 7fa49fb9b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.680 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.679+0000 7fa49fb9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.681 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.679+0000 7fa49fb9b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.681 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.683+0000 7fa49fb9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.681 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.683+0000 7fa49fb9b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.681 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.683+0000 7fa49fb9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.681 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.683+0000 7fa49fb9b9c0 20 started sync module instance, tier type = 2024-09-14T11:30:58.682 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.683+0000 7fa49fb9b9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:30:58.703 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.703+0000 7fa49fb9b9c0 20 add_watcher() i=0 2024-09-14T11:30:58.703 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.703+0000 7fa49fb9b9c0 20 add_watcher() i=1 2024-09-14T11:30:58.703 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.703+0000 7fa49fb9b9c0 20 add_watcher() i=2 2024-09-14T11:30:58.703 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.703+0000 7fa49fb9b9c0 20 add_watcher() i=3 2024-09-14T11:30:58.703 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.703+0000 7fa49fb9b9c0 20 add_watcher() i=4 2024-09-14T11:30:58.703 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.703+0000 7fa49fb9b9c0 20 add_watcher() i=5 2024-09-14T11:30:58.703 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.703+0000 7fa49fb9b9c0 20 add_watcher() i=6 2024-09-14T11:30:58.705 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.707+0000 7fa49fb9b9c0 20 add_watcher() i=7 2024-09-14T11:30:58.705 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.707+0000 7fa49fb9b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:58.709 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.711+0000 7fa3537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:58.710 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.711+0000 7fa49fb9b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:58.711 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.711+0000 7fa49fb9b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:58.711 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.711+0000 7fa49fb9b9c0 5 note: GC not initialized 2024-09-14T11:30:58.711 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.711+0000 7fa3527e4640 20 reqs_thread_entry: start 2024-09-14T11:30:58.711 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.711+0000 7fa49fb9b9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:30:58.711 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.711+0000 7fa49fb9b9c0 20 Filter name: none 2024-09-14T11:30:58.712 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.711+0000 7fa2c3fff640 20 reqs_thread_entry: start 2024-09-14T11:30:58.712 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.711+0000 7fa49fb9b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.713 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.715+0000 7fa49fb9b9c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:30:58.713 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.715+0000 7fa49fb9b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.714 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.715+0000 7fa49fb9b9c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:30:58.714 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.715+0000 7fa49fb9b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:58.714 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.715+0000 7fa49fb9b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.715 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.715+0000 7fa49fb9b9c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:30:58.715 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.715+0000 7fa49fb9b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.716 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.715+0000 7fa49fb9b9c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:30:58.716 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.715+0000 7fa49fb9b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:58.720 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.719+0000 7fa3537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:58.723 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.723+0000 7fa49fb9b9c0 20 remove_watcher() i=0 2024-09-14T11:30:58.723 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.723+0000 7fa49fb9b9c0 2 removed watcher, disabling cache 2024-09-14T11:30:58.725 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.727+0000 7fa49fb9b9c0 20 remove_watcher() i=1 2024-09-14T11:30:58.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.727+0000 7fa49fb9b9c0 20 remove_watcher() i=2 2024-09-14T11:30:58.729 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.731+0000 7fa49fb9b9c0 20 remove_watcher() i=3 2024-09-14T11:30:58.731 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.731+0000 7fa49fb9b9c0 20 remove_watcher() i=4 2024-09-14T11:30:58.733 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.735+0000 7fa49fb9b9c0 20 remove_watcher() i=5 2024-09-14T11:30:58.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.735+0000 7fa49fb9b9c0 20 remove_watcher() i=6 2024-09-14T11:30:58.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.739+0000 7fa49fb9b9c0 20 remove_watcher() i=7 2024-09-14T11:30:58.754 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:58.754 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:30:58.754 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: error-at-block-writes id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:30:58.754 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:58.810 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:30:58.846 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:58.846 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:58.892 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.891+0000 7fd1add949c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.895 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.895+0000 7fd1add949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.895 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.895+0000 7fd1add949c0 20 realm 2024-09-14T11:30:58.895 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.895+0000 7fd1add949c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.896 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.895+0000 7fd1add949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.896 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.895+0000 7fd1add949c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:58.896 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.895+0000 7fd1add949c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.896 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.895+0000 7fd1add949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.896 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.895+0000 7fd1add949c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.897 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.899+0000 7fd1add949c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:58.897 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.899+0000 7fd1add949c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.898 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.899+0000 7fd1add949c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:58.898 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.899+0000 7fd1add949c0 20 searching for the correct realm 2024-09-14T11:30:58.902 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.903+0000 7fd1ac09b640 0 -- 172.21.15.71:0/4037671305 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fd1a00bc040 msgr2=0x7fd1a00fcae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:58.908 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.911+0000 7fd1ac09b640 0 -- 172.21.15.71:0/4037671305 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55fae3abf6a0 msgr2=0x55fae3ac1a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:58.917 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.915+0000 7fd1add949c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:58.917 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.915+0000 7fd1add949c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:30:58.917 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.915+0000 7fd1add949c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:58.917 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.915+0000 7fd1add949c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:30:58.917 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.915+0000 7fd1add949c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:58.917 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.915+0000 7fd1add949c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:58.917 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.915+0000 7fd1add949c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.918 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.919+0000 7fd1add949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.918 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.919+0000 7fd1add949c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.918 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.919+0000 7fd1add949c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:58.918 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.919+0000 7fd1add949c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.918 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.919+0000 7fd1add949c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:58.919 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.919+0000 7fd1add949c0 20 zone default found 2024-09-14T11:30:58.919 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.919+0000 7fd1add949c0 4 Realm: () 2024-09-14T11:30:58.919 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.919+0000 7fd1add949c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:30:58.919 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.919+0000 7fd1add949c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:30:58.919 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.919+0000 7fd1add949c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:58.919 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.919+0000 7fd1add949c0 20 zonegroup default 2024-09-14T11:30:58.919 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.919+0000 7fd1add949c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.920 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.919+0000 7fd1add949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.920 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.919+0000 7fd1add949c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.920 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.919+0000 7fd1add949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.920 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.919+0000 7fd1add949c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.920 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.919+0000 7fd1add949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.920 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.919+0000 7fd1add949c0 20 started sync module instance, tier type = 2024-09-14T11:30:58.920 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.919+0000 7fd1add949c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:30:58.938 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.939+0000 7fd1add949c0 20 add_watcher() i=0 2024-09-14T11:30:58.938 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.939+0000 7fd1add949c0 20 add_watcher() i=1 2024-09-14T11:30:58.938 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.939+0000 7fd1add949c0 20 add_watcher() i=2 2024-09-14T11:30:58.938 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.939+0000 7fd1add949c0 20 add_watcher() i=3 2024-09-14T11:30:58.938 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.939+0000 7fd1add949c0 20 add_watcher() i=4 2024-09-14T11:30:58.938 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.939+0000 7fd1add949c0 20 add_watcher() i=5 2024-09-14T11:30:58.938 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.939+0000 7fd1add949c0 20 add_watcher() i=6 2024-09-14T11:30:58.940 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.939+0000 7fd1add949c0 20 add_watcher() i=7 2024-09-14T11:30:58.940 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.939+0000 7fd1add949c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:58.944 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.943+0000 7fd061fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:58.945 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.943+0000 7fd1add949c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:58.945 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.943+0000 7fd1add949c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:58.945 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.943+0000 7fd1add949c0 5 note: GC not initialized 2024-09-14T11:30:58.945 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.943+0000 7fd060fe1640 20 reqs_thread_entry: start 2024-09-14T11:30:58.945 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.947+0000 7fd1add949c0 20 init_complete bucket index max shards: 11 2024-09-14T11:30:58.945 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.947+0000 7fd1add949c0 20 Filter name: none 2024-09-14T11:30:58.945 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.947+0000 7fcfda7fc640 20 reqs_thread_entry: start 2024-09-14T11:30:58.945 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.947+0000 7fd1add949c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-14T11:30:58.945 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.947+0000 7fd1add949c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.946 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.947+0000 7fd1add949c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:30:58.946 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.947+0000 7fd1add949c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-14T11:30:58.946 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.947+0000 7fd1add949c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-14T11:30:58.946 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.947+0000 7fd1add949c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 : miss 2024-09-14T11:30:58.947 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.947+0000 7fd1add949c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.947 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.947+0000 7fd1add949c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:30:58.947 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.947+0000 7fd1add949c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 info.flags=0x17 2024-09-14T11:30:58.947 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.947+0000 7fd1add949c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 to cache LRU end 2024-09-14T11:30:58.947 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.947+0000 7fd1add949c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:58.947 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.947+0000 7fd1add949c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:58.947 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.947+0000 7fd1add949c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 2024-09-14T11:30:58.957 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.959+0000 7fd1add949c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 info.flags=0x17 2024-09-14T11:30:58.957 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.959+0000 7fd1add949c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 to cache LRU end 2024-09-14T11:30:58.957 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.959+0000 7fd1add949c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:58.957 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.959+0000 7fd1add949c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29, ofs0, ns] 2024-09-14T11:30:58.958 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.959+0000 7fd08a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464299 cookie 94536049917904 notifier 6647 bl.length()=999 2024-09-14T11:30:58.958 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.959+0000 7fd08a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 info.flags=0x17 2024-09-14T11:30:58.958 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.959+0000 7fd08a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 to cache LRU end 2024-09-14T11:30:58.958 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.959+0000 7fd08a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:58.958 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.959+0000 7fd1add949c0 20 handle_bi_update(): bucket=:error-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.29]): orig_sources= new_sources= 2024-09-14T11:30:58.958 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.959+0000 7fd1add949c0 20 handle_bi_update(): bucket=:error-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.29]): potential sources added=[] removed=[] 2024-09-14T11:30:58.958 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.959+0000 7fd1add949c0 20 handle_bi_update(): bucket=:error-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.29]): orig_dests= new_dests= 2024-09-14T11:30:58.958 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.959+0000 7fd1add949c0 20 handle_bi_update(): bucket=:error-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.29]): potential dests added=[] removed=[] 2024-09-14T11:30:58.968 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.967+0000 7fd1add949c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.0 2024-09-14T11:30:58.968 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.967+0000 7fd1add949c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.0 2024-09-14T11:30:58.968 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.967+0000 7fd1add949c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.1 2024-09-14T11:30:58.968 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.967+0000 7fd1add949c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.1 2024-09-14T11:30:58.968 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.967+0000 7fd1add949c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.2 2024-09-14T11:30:58.968 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.967+0000 7fd1add949c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.2 2024-09-14T11:30:58.968 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.967+0000 7fd1add949c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.3 2024-09-14T11:30:58.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.967+0000 7fd1add949c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.3 2024-09-14T11:30:58.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.967+0000 7fd1add949c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.4 2024-09-14T11:30:58.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.967+0000 7fd1add949c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.4 2024-09-14T11:30:58.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.967+0000 7fd1add949c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.5 2024-09-14T11:30:58.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.967+0000 7fd1add949c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.5 2024-09-14T11:30:58.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.967+0000 7fd1add949c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.6 2024-09-14T11:30:58.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.967+0000 7fd1add949c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.6 2024-09-14T11:30:58.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.967+0000 7fd1add949c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.7 2024-09-14T11:30:58.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.967+0000 7fd1add949c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.7 2024-09-14T11:30:58.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.967+0000 7fd1add949c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.8 2024-09-14T11:30:58.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.967+0000 7fd1add949c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.8 2024-09-14T11:30:58.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.967+0000 7fd1add949c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.9 2024-09-14T11:30:58.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.967+0000 7fd1add949c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.9 2024-09-14T11:30:58.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.967+0000 7fd1add949c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.10 2024-09-14T11:30:58.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.967+0000 7fd1add949c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.10 2024-09-14T11:30:58.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.967+0000 7fd1add949c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.11 2024-09-14T11:30:58.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.967+0000 7fd1add949c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1.11 2024-09-14T11:30:58.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.967+0000 7fd1add949c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.0 2024-09-14T11:30:58.971 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.967+0000 7fd1add949c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1 2024-09-14T11:30:58.971 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.971+0000 7fd1add949c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.2 2024-09-14T11:30:58.971 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.971+0000 7fd1add949c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.3 2024-09-14T11:30:58.971 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.971+0000 7fd1add949c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.4 2024-09-14T11:30:58.971 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.971+0000 7fd1add949c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.5 2024-09-14T11:30:58.971 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.971+0000 7fd1add949c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.6 2024-09-14T11:30:58.972 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.971+0000 7fd1add949c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.7 2024-09-14T11:30:58.973 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.975+0000 7fd1add949c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.8 2024-09-14T11:30:58.974 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.975+0000 7fd1add949c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.9 2024-09-14T11:30:58.975 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.975+0000 7fd1add949c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.10 2024-09-14T11:30:58.983 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.983+0000 7fd1add949c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:30:58.983 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.983+0000 7fd1add949c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 2024-09-14T11:30:58.986 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.987+0000 7fd1add949c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 info.flags=0x17 2024-09-14T11:30:58.986 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.987+0000 7fd1add949c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 to cache LRU end 2024-09-14T11:30:58.986 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.987+0000 7fd1add949c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:58.986 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.987+0000 7fd1add949c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29, ofs0, ns] 2024-09-14T11:30:58.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.987+0000 7fd08a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464300 cookie 94536049917904 notifier 6647 bl.length()=999 2024-09-14T11:30:58.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.987+0000 7fd08a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 info.flags=0x17 2024-09-14T11:30:58.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.987+0000 7fd08a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 to cache LRU end 2024-09-14T11:30:58.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.987+0000 7fd08a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:58.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.987+0000 7fd1add949c0 20 handle_bi_update(): bucket=:error-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.29]): orig_sources= new_sources= 2024-09-14T11:30:58.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.987+0000 7fd1add949c0 20 handle_bi_update(): bucket=:error-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.29]): potential sources added=[] removed=[] 2024-09-14T11:30:58.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.987+0000 7fd1add949c0 20 handle_bi_update(): bucket=:error-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.29]): orig_dests= new_dests= 2024-09-14T11:30:58.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.987+0000 7fd1add949c0 20 handle_bi_update(): bucket=:error-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.29]): potential dests added=[] removed=[] 2024-09-14T11:30:58.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.991+0000 7fd1add949c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.0 2024-09-14T11:30:58.992 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.995+0000 7fd1add949c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.1 2024-09-14T11:30:58.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.995+0000 7fd1add949c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.2 2024-09-14T11:30:58.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.995+0000 7fd1add949c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.3 2024-09-14T11:30:58.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.995+0000 7fd1add949c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.4 2024-09-14T11:30:58.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.995+0000 7fd1add949c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.5 2024-09-14T11:30:58.995 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.995+0000 7fd1add949c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.6 2024-09-14T11:30:58.995 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.995+0000 7fd1add949c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.7 2024-09-14T11:30:58.996 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.995+0000 7fd1add949c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.8 2024-09-14T11:30:58.997 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.999+0000 7fd1add949c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.9 2024-09-14T11:30:58.997 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.999+0000 7fd1add949c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.29.10 2024-09-14T11:30:58.998 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.999+0000 7fd1add949c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:30:58.998 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:58.999+0000 7fd1add949c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 2024-09-14T11:30:59.001 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.003+0000 7fd1add949c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 info.flags=0x17 2024-09-14T11:30:59.002 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.003+0000 7fd1add949c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 to cache LRU end 2024-09-14T11:30:59.002 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.003+0000 7fd1add949c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:59.002 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.003+0000 7fd1add949c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29, ofs0, ns] 2024-09-14T11:30:59.002 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.003+0000 7fd08affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464301 cookie 94536049917904 notifier 6647 bl.length()=967 2024-09-14T11:30:59.002 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.003+0000 7fd08affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 info.flags=0x17 2024-09-14T11:30:59.002 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.003+0000 7fd08affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.29 to cache LRU end 2024-09-14T11:30:59.002 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.003+0000 7fd08affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:59.002 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.003+0000 7fd1add949c0 20 handle_bi_update(): bucket=:error-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.29]): orig_sources= new_sources= 2024-09-14T11:30:59.003 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.003+0000 7fd1add949c0 20 handle_bi_update(): bucket=:error-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.29]): potential sources added=[] removed=[] 2024-09-14T11:30:59.003 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.003+0000 7fd1add949c0 20 handle_bi_update(): bucket=:error-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.29]): orig_dests= new_dests= 2024-09-14T11:30:59.003 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.003+0000 7fd1add949c0 20 handle_bi_update(): bucket=:error-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.29]): potential dests added=[] removed=[] 2024-09-14T11:30:59.007 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.007+0000 7fd1add949c0 1 execute INFO: reshard of bucket "error-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:30:59.010 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.011+0000 7fd061fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:59.014 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.015+0000 7fd1add949c0 20 remove_watcher() i=0 2024-09-14T11:30:59.014 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.015+0000 7fd1add949c0 2 removed watcher, disabling cache 2024-09-14T11:30:59.016 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.015+0000 7fd1add949c0 20 remove_watcher() i=1 2024-09-14T11:30:59.018 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.019+0000 7fd1add949c0 20 remove_watcher() i=2 2024-09-14T11:30:59.020 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.019+0000 7fd1add949c0 20 remove_watcher() i=3 2024-09-14T11:30:59.022 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.023+0000 7fd1add949c0 20 remove_watcher() i=4 2024-09-14T11:30:59.024 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.023+0000 7fd1add949c0 20 remove_watcher() i=5 2024-09-14T11:30:59.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.027+0000 7fd1add949c0 20 remove_watcher() i=6 2024-09-14T11:30:59.030 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.031+0000 7fd1add949c0 20 remove_watcher() i=7 2024-09-14T11:30:59.045 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:30:59.073 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:59.073 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:59.117 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.119+0000 7f5ab910b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:59.120 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.119+0000 7f5ab910b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:59.120 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.119+0000 7f5ab910b9c0 20 realm 2024-09-14T11:30:59.120 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.119+0000 7f5ab910b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:59.121 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.119+0000 7f5ab910b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:59.121 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.119+0000 7f5ab910b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:59.121 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.119+0000 7f5ab910b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:59.121 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.123+0000 7f5ab910b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:59.121 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.123+0000 7f5ab910b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:59.121 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.123+0000 7f5ab910b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:59.122 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.123+0000 7f5ab910b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:59.122 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.123+0000 7f5ab910b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:59.123 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.123+0000 7f5ab910b9c0 20 searching for the correct realm 2024-09-14T11:30:59.126 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.127+0000 7f5ab7412640 0 -- 172.21.15.71:0/2169106810 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f5aac08a460 msgr2=0x7f5aac039fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:59.340 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.339+0000 7f5ab7412640 0 -- 172.21.15.71:0/2169106810 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55d672b97ae0 msgr2=0x55d672b99ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:59.354 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.355+0000 7f5ab910b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:59.354 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.355+0000 7f5ab910b9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:30:59.354 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.355+0000 7f5ab910b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:59.355 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.355+0000 7f5ab910b9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:30:59.355 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.355+0000 7f5ab910b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:59.355 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.355+0000 7f5ab910b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:59.355 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.355+0000 7f5ab910b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:59.355 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.355+0000 7f5ab910b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:59.355 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.355+0000 7f5ab910b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:59.356 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.355+0000 7f5ab910b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:59.356 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.355+0000 7f5ab910b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:59.357 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.359+0000 7f5ab910b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:59.357 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.359+0000 7f5ab910b9c0 20 zone default found 2024-09-14T11:30:59.357 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.359+0000 7f5ab910b9c0 4 Realm: () 2024-09-14T11:30:59.358 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.359+0000 7f5ab910b9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:30:59.358 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.359+0000 7f5ab910b9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:30:59.358 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.359+0000 7f5ab910b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:59.358 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.359+0000 7f5ab910b9c0 20 zonegroup default 2024-09-14T11:30:59.358 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.359+0000 7f5ab910b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:59.358 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.359+0000 7f5ab910b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:59.358 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.359+0000 7f5ab910b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:59.358 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.359+0000 7f5ab910b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:59.359 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.359+0000 7f5ab910b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:59.359 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.359+0000 7f5ab910b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:59.359 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.359+0000 7f5ab910b9c0 20 started sync module instance, tier type = 2024-09-14T11:30:59.360 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.359+0000 7f5ab910b9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:30:59.383 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.383+0000 7f5ab910b9c0 20 add_watcher() i=0 2024-09-14T11:30:59.383 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.383+0000 7f5ab910b9c0 20 add_watcher() i=1 2024-09-14T11:30:59.383 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.383+0000 7f5ab910b9c0 20 add_watcher() i=2 2024-09-14T11:30:59.384 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.383+0000 7f5ab910b9c0 20 add_watcher() i=3 2024-09-14T11:30:59.384 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.383+0000 7f5ab910b9c0 20 add_watcher() i=4 2024-09-14T11:30:59.384 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.383+0000 7f5ab910b9c0 20 add_watcher() i=5 2024-09-14T11:30:59.384 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.383+0000 7f5ab910b9c0 20 add_watcher() i=6 2024-09-14T11:30:59.386 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.387+0000 7f5ab910b9c0 20 add_watcher() i=7 2024-09-14T11:30:59.386 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.387+0000 7f5ab910b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:59.390 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.391+0000 7f596d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:59.391 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.391+0000 7f5ab910b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:59.391 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.391+0000 7f5ab910b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:59.391 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.391+0000 7f5ab910b9c0 5 note: GC not initialized 2024-09-14T11:30:59.392 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.391+0000 7f58e7fff640 20 reqs_thread_entry: start 2024-09-14T11:30:59.392 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.391+0000 7f5ab910b9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:30:59.392 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.391+0000 7f5ab910b9c0 20 Filter name: none 2024-09-14T11:30:59.392 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.391+0000 7f58e5ffb640 20 reqs_thread_entry: start 2024-09-14T11:30:59.392 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.391+0000 7f5ab910b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:59.393 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.395+0000 7f5ab910b9c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:30:59.393 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.395+0000 7f5ab910b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:59.395 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.395+0000 7f5ab910b9c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:30:59.395 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.395+0000 7f5ab910b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:59.395 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.395+0000 7f5ab910b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:59.395 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.395+0000 7f5ab910b9c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:30:59.395 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.395+0000 7f5ab910b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:30:59.396 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.395+0000 7f5ab910b9c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:30:59.396 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.395+0000 7f5ab910b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:59.398 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.399+0000 7f596d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:59.403 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.403+0000 7f5ab910b9c0 20 remove_watcher() i=0 2024-09-14T11:30:59.403 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.403+0000 7f5ab910b9c0 2 removed watcher, disabling cache 2024-09-14T11:30:59.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.407+0000 7f5ab910b9c0 20 remove_watcher() i=1 2024-09-14T11:30:59.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.407+0000 7f5ab910b9c0 20 remove_watcher() i=2 2024-09-14T11:30:59.409 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.411+0000 7f5ab910b9c0 20 remove_watcher() i=3 2024-09-14T11:30:59.411 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.411+0000 7f5ab910b9c0 20 remove_watcher() i=4 2024-09-14T11:30:59.413 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.415+0000 7f5ab910b9c0 20 remove_watcher() i=5 2024-09-14T11:30:59.415 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.415+0000 7f5ab910b9c0 20 remove_watcher() i=6 2024-09-14T11:30:59.418 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:30:59.419+0000 7f5ab910b9c0 20 remove_watcher() i=7 2024-09-14T11:30:59.434 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:59.434 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:30:59.434 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: error-at-block-writes id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.29 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:30:59.434 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:59.540 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: reshard bucket with abort at block_writes 2024-09-14T11:30:59.540 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:30:59.933 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:30:59.966 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:59.966 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:00.012 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.011+0000 7fba41fb89c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.014 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.015+0000 7fba41fb89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:00.014 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.015+0000 7fba41fb89c0 20 realm 2024-09-14T11:31:00.014 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.015+0000 7fba41fb89c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.015 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.015+0000 7fba41fb89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:00.015 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.015+0000 7fba41fb89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:00.015 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.015+0000 7fba41fb89c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.015 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.015+0000 7fba41fb89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:00.015 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.015+0000 7fba41fb89c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.016 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.015+0000 7fba41fb89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:00.016 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.015+0000 7fba41fb89c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.017 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.019+0000 7fba41fb89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:00.017 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.019+0000 7fba41fb89c0 20 searching for the correct realm 2024-09-14T11:31:00.021 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.023+0000 7fba402bf640 0 -- 172.21.15.71:0/706428721 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fba34100b90 msgr2=0x7fba340f7a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:00.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.027+0000 7fba402bf640 0 -- 172.21.15.71:0/706428721 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x5576678b0f80 msgr2=0x5576678b3370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:31:00.036 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.035+0000 7fba41fb89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:00.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.035+0000 7fba41fb89c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:31:00.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.035+0000 7fba41fb89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:00.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.035+0000 7fba41fb89c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:31:00.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.035+0000 7fba41fb89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:00.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.035+0000 7fba41fb89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:00.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.035+0000 7fba41fb89c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.039+0000 7fba41fb89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:00.038 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.039+0000 7fba41fb89c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.038 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.039+0000 7fba41fb89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:00.038 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.039+0000 7fba41fb89c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.039 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.039+0000 7fba41fb89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:00.039 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.039+0000 7fba41fb89c0 20 zone default found 2024-09-14T11:31:00.039 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.039+0000 7fba41fb89c0 4 Realm: () 2024-09-14T11:31:00.039 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.039+0000 7fba41fb89c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:31:00.039 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.039+0000 7fba41fb89c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:31:00.039 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.039+0000 7fba41fb89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:00.039 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.039+0000 7fba41fb89c0 20 zonegroup default 2024-09-14T11:31:00.039 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.039+0000 7fba41fb89c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.039 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.039+0000 7fba41fb89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:00.039 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.039+0000 7fba41fb89c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.040 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.039+0000 7fba41fb89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:00.040 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.039+0000 7fba41fb89c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.040 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.039+0000 7fba41fb89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:00.040 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.039+0000 7fba41fb89c0 20 started sync module instance, tier type = 2024-09-14T11:31:00.040 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.039+0000 7fba41fb89c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:31:00.058 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.059+0000 7fba41fb89c0 20 add_watcher() i=0 2024-09-14T11:31:00.058 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.059+0000 7fba41fb89c0 20 add_watcher() i=1 2024-09-14T11:31:00.058 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.059+0000 7fba41fb89c0 20 add_watcher() i=2 2024-09-14T11:31:00.058 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.059+0000 7fba41fb89c0 20 add_watcher() i=3 2024-09-14T11:31:00.058 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.059+0000 7fba41fb89c0 20 add_watcher() i=4 2024-09-14T11:31:00.058 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.059+0000 7fba41fb89c0 20 add_watcher() i=5 2024-09-14T11:31:00.058 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.059+0000 7fba41fb89c0 20 add_watcher() i=6 2024-09-14T11:31:00.060 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.059+0000 7fba41fb89c0 20 add_watcher() i=7 2024-09-14T11:31:00.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.059+0000 7fba41fb89c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:00.065 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.067+0000 7fb8f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:00.065 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.067+0000 7fba41fb89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:00.066 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.067+0000 7fba41fb89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:00.066 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.067+0000 7fba41fb89c0 5 note: GC not initialized 2024-09-14T11:31:00.066 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.067+0000 7fb8f4fe1640 20 reqs_thread_entry: start 2024-09-14T11:31:00.066 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.067+0000 7fba41fb89c0 20 init_complete bucket index max shards: 11 2024-09-14T11:31:00.066 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.067+0000 7fba41fb89c0 20 Filter name: none 2024-09-14T11:31:00.066 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.067+0000 7fb86e7fc640 20 reqs_thread_entry: start 2024-09-14T11:31:00.066 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.067+0000 7fba41fb89c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.067 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.067+0000 7fba41fb89c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:31:00.067 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.067+0000 7fba41fb89c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.068 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.067+0000 7fba41fb89c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:31:00.068 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.067+0000 7fba41fb89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:00.068 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.067+0000 7fba41fb89c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.068 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.071+0000 7fba41fb89c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:31:00.069 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.071+0000 7fba41fb89c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.069 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.071+0000 7fba41fb89c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:31:00.069 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.071+0000 7fba41fb89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:00.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.071+0000 7fb8f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:00.076 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.075+0000 7fba41fb89c0 20 remove_watcher() i=0 2024-09-14T11:31:00.076 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.075+0000 7fba41fb89c0 2 removed watcher, disabling cache 2024-09-14T11:31:00.077 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.079+0000 7fba41fb89c0 20 remove_watcher() i=1 2024-09-14T11:31:00.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.079+0000 7fba41fb89c0 20 remove_watcher() i=2 2024-09-14T11:31:00.081 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.083+0000 7fba41fb89c0 20 remove_watcher() i=3 2024-09-14T11:31:00.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.083+0000 7fba41fb89c0 20 remove_watcher() i=4 2024-09-14T11:31:00.085 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.087+0000 7fba41fb89c0 20 remove_watcher() i=5 2024-09-14T11:31:00.088 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.087+0000 7fba41fb89c0 20 remove_watcher() i=6 2024-09-14T11:31:00.091 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.091+0000 7fba41fb89c0 20 remove_watcher() i=7 2024-09-14T11:31:00.105 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.105 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:31:00.105 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: abort-at-block-writes id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:31:00.105 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.105 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-14T11:31:00.138 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:00.138 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:00.181 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.183+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.184 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.183+0000 7fb9aed079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:00.184 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.183+0000 7fb9aed079c0 20 realm 2024-09-14T11:31:00.184 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.183+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.184 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.183+0000 7fb9aed079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:00.184 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.183+0000 7fb9aed079c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:00.184 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.183+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.185 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.183+0000 7fb9aed079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:00.185 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.183+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.185 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.187+0000 7fb9aed079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:00.185 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.187+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.186 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.187+0000 7fb9aed079c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:00.186 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.187+0000 7fb9aed079c0 20 searching for the correct realm 2024-09-14T11:31:00.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.191+0000 7fb9ad00e640 0 -- 172.21.15.71:0/29309657 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fb9a0034b60 msgr2=0x7fb9a001f450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:00.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.403+0000 7fb9ad00e640 0 -- 172.21.15.71:0/29309657 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55e0f77ae0c0 msgr2=0x55e0f77b04d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:00.419 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.419+0000 7fb9aed079c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:00.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.419+0000 7fb9aed079c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:31:00.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.419+0000 7fb9aed079c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:00.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.419+0000 7fb9aed079c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:31:00.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.419+0000 7fb9aed079c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:00.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.419+0000 7fb9aed079c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:00.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.419+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.419+0000 7fb9aed079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:00.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.419+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.421 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:00.421 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.422 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:00.422 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 zone default found 2024-09-14T11:31:00.422 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.423+0000 7fb9aed079c0 4 Realm: () 2024-09-14T11:31:00.422 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.423+0000 7fb9aed079c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:31:00.422 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.423+0000 7fb9aed079c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:31:00.422 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.423+0000 7fb9aed079c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:00.422 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 zonegroup default 2024-09-14T11:31:00.422 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.423 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:00.423 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.423 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:00.424 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.424 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:00.424 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 started sync module instance, tier type = 2024-09-14T11:31:00.424 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:31:00.446 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.447+0000 7fb9aed079c0 20 add_watcher() i=0 2024-09-14T11:31:00.446 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.447+0000 7fb9aed079c0 20 add_watcher() i=1 2024-09-14T11:31:00.447 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.447+0000 7fb9aed079c0 20 add_watcher() i=2 2024-09-14T11:31:00.447 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.447+0000 7fb9aed079c0 20 add_watcher() i=3 2024-09-14T11:31:00.447 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.447+0000 7fb9aed079c0 20 add_watcher() i=4 2024-09-14T11:31:00.447 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.447+0000 7fb9aed079c0 20 add_watcher() i=5 2024-09-14T11:31:00.447 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.447+0000 7fb9aed079c0 20 add_watcher() i=6 2024-09-14T11:31:00.449 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.451+0000 7fb9aed079c0 20 add_watcher() i=7 2024-09-14T11:31:00.449 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.451+0000 7fb9aed079c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:00.453 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.455+0000 7fb862fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:00.454 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.455+0000 7fb9aed079c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:00.454 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.455+0000 7fb9aed079c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:00.454 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 note: GC not initialized 2024-09-14T11:31:00.455 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.455+0000 7fb861fe3640 20 reqs_thread_entry: start 2024-09-14T11:31:00.455 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.455+0000 7fb9aed079c0 20 init_complete bucket index max shards: 11 2024-09-14T11:31:00.455 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.455+0000 7fb9aed079c0 20 Filter name: none 2024-09-14T11:31:00.455 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.455+0000 7fb7d37fe640 20 reqs_thread_entry: start 2024-09-14T11:31:00.455 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.455+0000 7fb9aed079c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:31:00.455 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.455+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.455+0000 7fb9aed079c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:31:00.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.455+0000 7fb9aed079c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:31:00.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.455+0000 7fb9aed079c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:31:00.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.455+0000 7fb9aed079c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 : miss 2024-09-14T11:31:00.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.455+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.455+0000 7fb9aed079c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:31:00.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.455+0000 7fb9aed079c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 info.flags=0x17 2024-09-14T11:31:00.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.455+0000 7fb9aed079c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 to cache LRU end 2024-09-14T11:31:00.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.455+0000 7fb9aed079c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:31:00.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.455+0000 7fb9aed079c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:00.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.459+0000 7fb9aed079c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 2024-09-14T11:31:00.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.467+0000 7fb9aed079c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 info.flags=0x17 2024-09-14T11:31:00.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.467+0000 7fb9aed079c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 to cache LRU end 2024-09-14T11:31:00.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.467+0000 7fb9aed079c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:00.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.467+0000 7fb9aed079c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30, ofs0, ns] 2024-09-14T11:31:00.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.467+0000 7fb883fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464372 cookie 94424713093536 notifier 7035 bl.length()=999 2024-09-14T11:31:00.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.467+0000 7fb883fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 info.flags=0x17 2024-09-14T11:31:00.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.467+0000 7fb883fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 to cache LRU end 2024-09-14T11:31:00.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.467+0000 7fb883fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:00.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.467+0000 7fb9aed079c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.30]): orig_sources= new_sources= 2024-09-14T11:31:00.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.467+0000 7fb9aed079c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.30]): potential sources added=[] removed=[] 2024-09-14T11:31:00.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.467+0000 7fb9aed079c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.30]): orig_dests= new_dests= 2024-09-14T11:31:00.468 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.467+0000 7fb9aed079c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.30]): potential dests added=[] removed=[] 2024-09-14T11:31:00.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.475+0000 7fb9aed079c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.0 2024-09-14T11:31:00.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.0 2024-09-14T11:31:00.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.475+0000 7fb9aed079c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.1 2024-09-14T11:31:00.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.1 2024-09-14T11:31:00.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.475+0000 7fb9aed079c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.2 2024-09-14T11:31:00.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.2 2024-09-14T11:31:00.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.475+0000 7fb9aed079c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.3 2024-09-14T11:31:00.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.3 2024-09-14T11:31:00.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.475+0000 7fb9aed079c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.4 2024-09-14T11:31:00.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.4 2024-09-14T11:31:00.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.475+0000 7fb9aed079c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.5 2024-09-14T11:31:00.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.5 2024-09-14T11:31:00.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.475+0000 7fb9aed079c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.6 2024-09-14T11:31:00.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.6 2024-09-14T11:31:00.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.475+0000 7fb9aed079c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.7 2024-09-14T11:31:00.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.7 2024-09-14T11:31:00.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.475+0000 7fb9aed079c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.8 2024-09-14T11:31:00.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.8 2024-09-14T11:31:00.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.475+0000 7fb9aed079c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.9 2024-09-14T11:31:00.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.9 2024-09-14T11:31:00.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.475+0000 7fb9aed079c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.10 2024-09-14T11:31:00.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.10 2024-09-14T11:31:00.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.475+0000 7fb9aed079c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.11 2024-09-14T11:31:00.478 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.11 2024-09-14T11:31:00.478 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.0 2024-09-14T11:31:00.478 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1 2024-09-14T11:31:00.478 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.479+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.2 2024-09-14T11:31:00.478 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.479+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.3 2024-09-14T11:31:00.479 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.479+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.4 2024-09-14T11:31:00.479 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.479+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.5 2024-09-14T11:31:00.480 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.479+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.6 2024-09-14T11:31:00.481 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.483+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.7 2024-09-14T11:31:00.483 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.483+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.8 2024-09-14T11:31:00.483 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.483+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.9 2024-09-14T11:31:00.483 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.483+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.10 2024-09-14T11:31:00.491 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.491+0000 7fb9aed079c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:00.491 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.491+0000 7fb9aed079c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 2024-09-14T11:31:00.493 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.495+0000 7fb9aed079c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 info.flags=0x17 2024-09-14T11:31:00.493 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.495+0000 7fb9aed079c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 to cache LRU end 2024-09-14T11:31:00.493 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.495+0000 7fb9aed079c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:00.493 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.495+0000 7fb9aed079c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30, ofs0, ns] 2024-09-14T11:31:00.493 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.495+0000 7fb8837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464373 cookie 94424713093536 notifier 7035 bl.length()=999 2024-09-14T11:31:00.493 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.495+0000 7fb8837fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 info.flags=0x17 2024-09-14T11:31:00.493 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.495+0000 7fb8837fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 to cache LRU end 2024-09-14T11:31:00.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.495+0000 7fb8837fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:00.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.495+0000 7fb9aed079c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.30]): orig_sources= new_sources= 2024-09-14T11:31:00.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.495+0000 7fb9aed079c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.30]): potential sources added=[] removed=[] 2024-09-14T11:31:00.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.495+0000 7fb9aed079c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.30]): orig_dests= new_dests= 2024-09-14T11:31:00.494 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb9aed079c0 time 2024-09-14T11:31:00.499531+0000 2024-09-14T11:31:00.494 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:31:00.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.495+0000 7fb9aed079c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.30]): potential dests added=[] removed=[] 2024-09-14T11:31:00.495 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:00.495 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fb9b25e12eb] 2024-09-14T11:31:00.495 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb9b25e149f] 2024-09-14T11:31:00.495 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e0f4752c01] 2024-09-14T11:31:00.495 INFO:tasks.workunit.client.0.smithi071.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55e0f476729b] 2024-09-14T11:31:00.495 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55e0f4768884] 2024-09-14T11:31:00.495 INFO:tasks.workunit.client.0.smithi071.stderr: 6: main() 2024-09-14T11:31:00.495 INFO:tasks.workunit.client.0.smithi071.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb9b1447d90] 2024-09-14T11:31:00.496 INFO:tasks.workunit.client.0.smithi071.stderr: 8: __libc_start_main() 2024-09-14T11:31:00.496 INFO:tasks.workunit.client.0.smithi071.stderr: 9: _start() 2024-09-14T11:31:00.496 INFO:tasks.workunit.client.0.smithi071.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:31:00.496 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7fb9aed079c0 thread_name:radosgw-admin 2024-09-14T11:31:00.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.495+0000 7fb9aed079c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb9aed079c0 time 2024-09-14T11:31:00.499531+0000 2024-09-14T11:31:00.496 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:31:00.496 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.496 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:00.496 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fb9b25e12eb] 2024-09-14T11:31:00.496 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb9b25e149f] 2024-09-14T11:31:00.496 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e0f4752c01] 2024-09-14T11:31:00.496 INFO:tasks.workunit.client.0.smithi071.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55e0f476729b] 2024-09-14T11:31:00.496 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55e0f4768884] 2024-09-14T11:31:00.497 INFO:tasks.workunit.client.0.smithi071.stderr: 6: main() 2024-09-14T11:31:00.497 INFO:tasks.workunit.client.0.smithi071.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb9b1447d90] 2024-09-14T11:31:00.497 INFO:tasks.workunit.client.0.smithi071.stderr: 8: __libc_start_main() 2024-09-14T11:31:00.497 INFO:tasks.workunit.client.0.smithi071.stderr: 9: _start() 2024-09-14T11:31:00.497 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.514 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:00.514 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fb9b1460520] 2024-09-14T11:31:00.514 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:31:00.514 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:31:00.514 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:31:00.514 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fb9b25e1345] 2024-09-14T11:31:00.514 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb9b25e149f] 2024-09-14T11:31:00.514 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e0f4752c01] 2024-09-14T11:31:00.514 INFO:tasks.workunit.client.0.smithi071.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55e0f476729b] 2024-09-14T11:31:00.515 INFO:tasks.workunit.client.0.smithi071.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55e0f4768884] 2024-09-14T11:31:00.515 INFO:tasks.workunit.client.0.smithi071.stderr: 10: main() 2024-09-14T11:31:00.515 INFO:tasks.workunit.client.0.smithi071.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb9b1447d90] 2024-09-14T11:31:00.515 INFO:tasks.workunit.client.0.smithi071.stderr: 12: __libc_start_main() 2024-09-14T11:31:00.515 INFO:tasks.workunit.client.0.smithi071.stderr: 13: _start() 2024-09-14T11:31:00.515 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.495+0000 7fb9aed079c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:31:00.515 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7fb9aed079c0 thread_name:radosgw-admin 2024-09-14T11:31:00.515 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.515 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:00.515 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fb9b1460520] 2024-09-14T11:31:00.515 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:31:00.515 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:31:00.515 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:31:00.515 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fb9b25e1345] 2024-09-14T11:31:00.515 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb9b25e149f] 2024-09-14T11:31:00.516 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e0f4752c01] 2024-09-14T11:31:00.516 INFO:tasks.workunit.client.0.smithi071.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55e0f476729b] 2024-09-14T11:31:00.516 INFO:tasks.workunit.client.0.smithi071.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55e0f4768884] 2024-09-14T11:31:00.516 INFO:tasks.workunit.client.0.smithi071.stderr: 10: main() 2024-09-14T11:31:00.516 INFO:tasks.workunit.client.0.smithi071.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb9b1447d90] 2024-09-14T11:31:00.516 INFO:tasks.workunit.client.0.smithi071.stderr: 12: __libc_start_main() 2024-09-14T11:31:00.516 INFO:tasks.workunit.client.0.smithi071.stderr: 13: _start() 2024-09-14T11:31:00.516 INFO:tasks.workunit.client.0.smithi071.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:31:00.516 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.516 INFO:tasks.workunit.client.0.smithi071.stderr:--- begin dump of recent events --- 2024-09-14T11:31:00.516 INFO:tasks.workunit.client.0.smithi071.stderr: -499> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f76ba070) adding con mode: crc 2024-09-14T11:31:00.516 INFO:tasks.workunit.client.0.smithi071.stderr: -498> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f76ba070) adding con mode: secure 2024-09-14T11:31:00.516 INFO:tasks.workunit.client.0.smithi071.stderr: -497> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f76ba070) adding con mode: crc 2024-09-14T11:31:00.516 INFO:tasks.workunit.client.0.smithi071.stderr: -496> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f76ba070) adding con mode: secure 2024-09-14T11:31:00.516 INFO:tasks.workunit.client.0.smithi071.stderr: -495> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f76ba070) adding con mode: crc 2024-09-14T11:31:00.517 INFO:tasks.workunit.client.0.smithi071.stderr: -494> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f76ba070) adding con mode: crc 2024-09-14T11:31:00.517 INFO:tasks.workunit.client.0.smithi071.stderr: -493> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f76ba070) adding con mode: secure 2024-09-14T11:31:00.517 INFO:tasks.workunit.client.0.smithi071.stderr: -492> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f76ba070) adding con mode: crc 2024-09-14T11:31:00.517 INFO:tasks.workunit.client.0.smithi071.stderr: -491> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f76ba070) adding con mode: secure 2024-09-14T11:31:00.517 INFO:tasks.workunit.client.0.smithi071.stderr: -490> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f76ba070) adding con mode: crc 2024-09-14T11:31:00.517 INFO:tasks.workunit.client.0.smithi071.stderr: -489> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f76ba070) adding con mode: secure 2024-09-14T11:31:00.517 INFO:tasks.workunit.client.0.smithi071.stderr: -488> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:00.517 INFO:tasks.workunit.client.0.smithi071.stderr: -487> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:00.517 INFO:tasks.workunit.client.0.smithi071.stderr: -486> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 5 asok(0x55e0f74aed90) register_command rotate-key hook 0x55e0f76ba1b8 2024-09-14T11:31:00.517 INFO:tasks.workunit.client.0.smithi071.stderr: -485> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 10 monclient: _reopen_session rank -1 2024-09-14T11:31:00.517 INFO:tasks.workunit.client.0.smithi071.stderr: -484> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:31:00.517 INFO:tasks.workunit.client.0.smithi071.stderr: -483> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 10 monclient(hunting): picked mon.noname-a con 0x55e0f7573370 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:31:00.517 INFO:tasks.workunit.client.0.smithi071.stderr: -482> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 10 monclient(hunting): picked mon.noname-c con 0x55e0f7602d00 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:31:00.517 INFO:tasks.workunit.client.0.smithi071.stderr: -481> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 10 monclient(hunting): picked mon.noname-b con 0x55e0f76bcf10 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:31:00.517 INFO:tasks.workunit.client.0.smithi071.stderr: -480> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:00.518 INFO:tasks.workunit.client.0.smithi071.stderr: -479> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:00.518 INFO:tasks.workunit.client.0.smithi071.stderr: -478> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:00.518 INFO:tasks.workunit.client.0.smithi071.stderr: -477> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 10 monclient(hunting): _renew_subs 2024-09-14T11:31:00.518 INFO:tasks.workunit.client.0.smithi071.stderr: -476> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 10 monclient(hunting): authenticate will time out at 2272.285481s 2024-09-14T11:31:00.518 INFO:tasks.workunit.client.0.smithi071.stderr: -475> 2024-09-14T11:31:00.163+0000 7fb9ac00c640 10 monclient(hunting): get_auth_request con 0x55e0f7602d00 auth_method 0 2024-09-14T11:31:00.518 INFO:tasks.workunit.client.0.smithi071.stderr: -474> 2024-09-14T11:31:00.163+0000 7fb9ac00c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:00.518 INFO:tasks.workunit.client.0.smithi071.stderr: -473> 2024-09-14T11:31:00.163+0000 7fb9ac00c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:00.518 INFO:tasks.workunit.client.0.smithi071.stderr: -472> 2024-09-14T11:31:00.163+0000 7fb9ac00c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:00.518 INFO:tasks.workunit.client.0.smithi071.stderr: -471> 2024-09-14T11:31:00.163+0000 7fb9ac80d640 10 monclient(hunting): get_auth_request con 0x55e0f7573370 auth_method 0 2024-09-14T11:31:00.518 INFO:tasks.workunit.client.0.smithi071.stderr: -470> 2024-09-14T11:31:00.163+0000 7fb9ac80d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:00.518 INFO:tasks.workunit.client.0.smithi071.stderr: -469> 2024-09-14T11:31:00.163+0000 7fb9ac80d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:00.518 INFO:tasks.workunit.client.0.smithi071.stderr: -468> 2024-09-14T11:31:00.163+0000 7fb9ac80d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:00.518 INFO:tasks.workunit.client.0.smithi071.stderr: -467> 2024-09-14T11:31:00.163+0000 7fb9ac80d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:00.518 INFO:tasks.workunit.client.0.smithi071.stderr: -466> 2024-09-14T11:31:00.163+0000 7fb9ac80d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:00.518 INFO:tasks.workunit.client.0.smithi071.stderr: -465> 2024-09-14T11:31:00.163+0000 7fb9ac80d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:00.518 INFO:tasks.workunit.client.0.smithi071.stderr: -464> 2024-09-14T11:31:00.163+0000 7fb9ac00c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:00.519 INFO:tasks.workunit.client.0.smithi071.stderr: -463> 2024-09-14T11:31:00.163+0000 7fb9ac00c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:00.519 INFO:tasks.workunit.client.0.smithi071.stderr: -462> 2024-09-14T11:31:00.163+0000 7fb9ac00c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:00.519 INFO:tasks.workunit.client.0.smithi071.stderr: -461> 2024-09-14T11:31:00.163+0000 7fb9ac80d640 10 monclient(hunting): handle_auth_done global_id 7026 payload 824 2024-09-14T11:31:00.519 INFO:tasks.workunit.client.0.smithi071.stderr: -460> 2024-09-14T11:31:00.163+0000 7fb9ac80d640 10 monclient: _finish_hunting 0 2024-09-14T11:31:00.519 INFO:tasks.workunit.client.0.smithi071.stderr: -459> 2024-09-14T11:31:00.163+0000 7fb9ac80d640 1 monclient: found mon.noname-a 2024-09-14T11:31:00.519 INFO:tasks.workunit.client.0.smithi071.stderr: -458> 2024-09-14T11:31:00.163+0000 7fb9ac80d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:31:00.519 INFO:tasks.workunit.client.0.smithi071.stderr: -457> 2024-09-14T11:31:00.163+0000 7fb89960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:00.519 INFO:tasks.workunit.client.0.smithi071.stderr: -456> 2024-09-14T11:31:00.163+0000 7fb89960a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:31:00.519 INFO:tasks.workunit.client.0.smithi071.stderr: -455> 2024-09-14T11:31:00.163+0000 7fb89960a640 10 monclient: dump: 2024-09-14T11:31:00.519 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:31:00.519 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:31:00.519 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:00.519 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:00.519 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:00.519 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:00.520 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:31:00.520 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:31:00.520 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:31:00.520 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.520 INFO:tasks.workunit.client.0.smithi071.stderr: -454> 2024-09-14T11:31:00.163+0000 7fb89960a640 10 monclient: _finish_auth 0 2024-09-14T11:31:00.520 INFO:tasks.workunit.client.0.smithi071.stderr: -453> 2024-09-14T11:31:00.163+0000 7fb89960a640 10 monclient: _check_auth_tickets 2024-09-14T11:31:00.520 INFO:tasks.workunit.client.0.smithi071.stderr: -452> 2024-09-14T11:31:00.163+0000 7fb89960a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:00.520 INFO:tasks.workunit.client.0.smithi071.stderr: -451> 2024-09-14T11:31:00.163+0000 7fb89960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:00.520 INFO:tasks.workunit.client.0.smithi071.stderr: -450> 2024-09-14T11:31:00.163+0000 7fb89960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:31:00.520 INFO:tasks.workunit.client.0.smithi071.stderr: -449> 2024-09-14T11:31:00.163+0000 7fb89960a640 10 monclient: dump: 2024-09-14T11:31:00.520 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:31:00.520 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:31:00.520 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:00.520 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:00.520 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:00.521 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:00.521 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:31:00.521 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:31:00.521 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:31:00.521 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.521 INFO:tasks.workunit.client.0.smithi071.stderr: -448> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 5 monclient: authenticate success, global_id 7026 2024-09-14T11:31:00.521 INFO:tasks.workunit.client.0.smithi071.stderr: -447> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 10 monclient: _renew_subs 2024-09-14T11:31:00.521 INFO:tasks.workunit.client.0.smithi071.stderr: -446> 2024-09-14T11:31:00.163+0000 7fb89ae0d640 4 set_mon_vals no callback set 2024-09-14T11:31:00.521 INFO:tasks.workunit.client.0.smithi071.stderr: -445> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:31:00.521 INFO:tasks.workunit.client.0.smithi071.stderr: -444> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 10 monclient: _renew_subs 2024-09-14T11:31:00.521 INFO:tasks.workunit.client.0.smithi071.stderr: -443> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:31:00.521 INFO:tasks.workunit.client.0.smithi071.stderr: -442> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 1 librados: init done 2024-09-14T11:31:00.521 INFO:tasks.workunit.client.0.smithi071.stderr: -441> 2024-09-14T11:31:00.167+0000 7fb89960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:31:00.521 INFO:tasks.workunit.client.0.smithi071.stderr: -440> 2024-09-14T11:31:00.167+0000 7fb89960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:31:00.521 INFO:tasks.workunit.client.0.smithi071.stderr: -439> 2024-09-14T11:31:00.167+0000 7fb89960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:31:00.522 INFO:tasks.workunit.client.0.smithi071.stderr: -438> 2024-09-14T11:31:00.167+0000 7fb9ac00c640 10 monclient: get_auth_request con 0x7fb8940718a0 auth_method 0 2024-09-14T11:31:00.522 INFO:tasks.workunit.client.0.smithi071.stderr: -437> 2024-09-14T11:31:00.167+0000 7fb9ad00e640 10 monclient: get_auth_request con 0x55e0f76e2110 auth_method 0 2024-09-14T11:31:00.522 INFO:tasks.workunit.client.0.smithi071.stderr: -436> 2024-09-14T11:31:00.167+0000 7fb9ac80d640 10 monclient: get_auth_request con 0x55e0f7704f10 auth_method 0 2024-09-14T11:31:00.522 INFO:tasks.workunit.client.0.smithi071.stderr: -435> 2024-09-14T11:31:00.167+0000 7fb9ac00c640 10 monclient: get_auth_request con 0x55e0f7709100 auth_method 0 2024-09-14T11:31:00.522 INFO:tasks.workunit.client.0.smithi071.stderr: -434> 2024-09-14T11:31:00.171+0000 7fb9ad00e640 10 monclient: get_auth_request con 0x55e0f77087c0 auth_method 0 2024-09-14T11:31:00.522 INFO:tasks.workunit.client.0.smithi071.stderr: -433> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 10 monclient: build_initial_monmap 2024-09-14T11:31:00.522 INFO:tasks.workunit.client.0.smithi071.stderr: -432> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 1 build_initial for_mkfs: 0 2024-09-14T11:31:00.522 INFO:tasks.workunit.client.0.smithi071.stderr: -431> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 10 monclient: monmap: 2024-09-14T11:31:00.522 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:31:00.522 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:31:00.522 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:31:00.522 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:31:00.522 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:31:00.522 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:00.522 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:31:00.523 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:31:00.523 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:31:00.523 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.523 INFO:tasks.workunit.client.0.smithi071.stderr: -430> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77112e0) adding auth protocol: cephx 2024-09-14T11:31:00.523 INFO:tasks.workunit.client.0.smithi071.stderr: -429> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77112e0) adding auth protocol: cephx 2024-09-14T11:31:00.523 INFO:tasks.workunit.client.0.smithi071.stderr: -428> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77112e0) adding auth protocol: cephx 2024-09-14T11:31:00.523 INFO:tasks.workunit.client.0.smithi071.stderr: -427> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77112e0) adding con mode: secure 2024-09-14T11:31:00.523 INFO:tasks.workunit.client.0.smithi071.stderr: -426> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77112e0) adding con mode: crc 2024-09-14T11:31:00.523 INFO:tasks.workunit.client.0.smithi071.stderr: -425> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77112e0) adding con mode: secure 2024-09-14T11:31:00.523 INFO:tasks.workunit.client.0.smithi071.stderr: -424> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77112e0) adding con mode: crc 2024-09-14T11:31:00.523 INFO:tasks.workunit.client.0.smithi071.stderr: -423> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77112e0) adding con mode: secure 2024-09-14T11:31:00.523 INFO:tasks.workunit.client.0.smithi071.stderr: -422> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77112e0) adding con mode: crc 2024-09-14T11:31:00.523 INFO:tasks.workunit.client.0.smithi071.stderr: -421> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77112e0) adding con mode: crc 2024-09-14T11:31:00.523 INFO:tasks.workunit.client.0.smithi071.stderr: -420> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77112e0) adding con mode: secure 2024-09-14T11:31:00.523 INFO:tasks.workunit.client.0.smithi071.stderr: -419> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77112e0) adding con mode: crc 2024-09-14T11:31:00.524 INFO:tasks.workunit.client.0.smithi071.stderr: -418> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77112e0) adding con mode: secure 2024-09-14T11:31:00.524 INFO:tasks.workunit.client.0.smithi071.stderr: -417> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77112e0) adding con mode: crc 2024-09-14T11:31:00.524 INFO:tasks.workunit.client.0.smithi071.stderr: -416> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77112e0) adding con mode: secure 2024-09-14T11:31:00.524 INFO:tasks.workunit.client.0.smithi071.stderr: -415> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:00.524 INFO:tasks.workunit.client.0.smithi071.stderr: -414> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 asok(0x55e0f74aed90) register_command objecter_requests cmddesc objecter_requests hook 0x55e0f7714c70 EEXIST 2024-09-14T11:31:00.524 INFO:tasks.workunit.client.0.smithi071.stderr: -413> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 10 monclient: init 2024-09-14T11:31:00.524 INFO:tasks.workunit.client.0.smithi071.stderr: -412> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77101d8) adding auth protocol: cephx 2024-09-14T11:31:00.524 INFO:tasks.workunit.client.0.smithi071.stderr: -411> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77101d8) adding auth protocol: cephx 2024-09-14T11:31:00.524 INFO:tasks.workunit.client.0.smithi071.stderr: -410> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77101d8) adding auth protocol: cephx 2024-09-14T11:31:00.524 INFO:tasks.workunit.client.0.smithi071.stderr: -409> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77101d8) adding con mode: secure 2024-09-14T11:31:00.524 INFO:tasks.workunit.client.0.smithi071.stderr: -408> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77101d8) adding con mode: crc 2024-09-14T11:31:00.524 INFO:tasks.workunit.client.0.smithi071.stderr: -407> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77101d8) adding con mode: secure 2024-09-14T11:31:00.524 INFO:tasks.workunit.client.0.smithi071.stderr: -406> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77101d8) adding con mode: crc 2024-09-14T11:31:00.524 INFO:tasks.workunit.client.0.smithi071.stderr: -405> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77101d8) adding con mode: secure 2024-09-14T11:31:00.524 INFO:tasks.workunit.client.0.smithi071.stderr: -404> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77101d8) adding con mode: crc 2024-09-14T11:31:00.525 INFO:tasks.workunit.client.0.smithi071.stderr: -403> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77101d8) adding con mode: crc 2024-09-14T11:31:00.525 INFO:tasks.workunit.client.0.smithi071.stderr: -402> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77101d8) adding con mode: secure 2024-09-14T11:31:00.525 INFO:tasks.workunit.client.0.smithi071.stderr: -401> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77101d8) adding con mode: crc 2024-09-14T11:31:00.525 INFO:tasks.workunit.client.0.smithi071.stderr: -400> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77101d8) adding con mode: secure 2024-09-14T11:31:00.525 INFO:tasks.workunit.client.0.smithi071.stderr: -399> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77101d8) adding con mode: crc 2024-09-14T11:31:00.525 INFO:tasks.workunit.client.0.smithi071.stderr: -398> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77101d8) adding con mode: secure 2024-09-14T11:31:00.525 INFO:tasks.workunit.client.0.smithi071.stderr: -397> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:00.525 INFO:tasks.workunit.client.0.smithi071.stderr: -396> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:00.525 INFO:tasks.workunit.client.0.smithi071.stderr: -395> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 asok(0x55e0f74aed90) register_command rotate-key cmddesc rotate-key hook 0x55e0f7710320 EEXIST 2024-09-14T11:31:00.525 INFO:tasks.workunit.client.0.smithi071.stderr: -394> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 10 monclient: _reopen_session rank -1 2024-09-14T11:31:00.525 INFO:tasks.workunit.client.0.smithi071.stderr: -393> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:31:00.525 INFO:tasks.workunit.client.0.smithi071.stderr: -392> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 10 monclient(hunting): picked mon.noname-c con 0x55e0f7738e20 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:31:00.526 INFO:tasks.workunit.client.0.smithi071.stderr: -391> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 10 monclient(hunting): picked mon.noname-b con 0x55e0f7738750 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:31:00.526 INFO:tasks.workunit.client.0.smithi071.stderr: -390> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 10 monclient(hunting): picked mon.noname-a con 0x55e0f7737130 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:31:00.526 INFO:tasks.workunit.client.0.smithi071.stderr: -389> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:00.526 INFO:tasks.workunit.client.0.smithi071.stderr: -388> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:00.526 INFO:tasks.workunit.client.0.smithi071.stderr: -387> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:00.526 INFO:tasks.workunit.client.0.smithi071.stderr: -386> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 10 monclient(hunting): _renew_subs 2024-09-14T11:31:00.526 INFO:tasks.workunit.client.0.smithi071.stderr: -385> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 10 monclient(hunting): authenticate will time out at 2272.295388s 2024-09-14T11:31:00.526 INFO:tasks.workunit.client.0.smithi071.stderr: -384> 2024-09-14T11:31:00.171+0000 7fb9ac00c640 10 monclient(hunting): get_auth_request con 0x55e0f7738e20 auth_method 0 2024-09-14T11:31:00.526 INFO:tasks.workunit.client.0.smithi071.stderr: -383> 2024-09-14T11:31:00.171+0000 7fb9ac00c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:00.526 INFO:tasks.workunit.client.0.smithi071.stderr: -382> 2024-09-14T11:31:00.171+0000 7fb9ac00c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:00.526 INFO:tasks.workunit.client.0.smithi071.stderr: -381> 2024-09-14T11:31:00.171+0000 7fb9ac00c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:00.526 INFO:tasks.workunit.client.0.smithi071.stderr: -380> 2024-09-14T11:31:00.171+0000 7fb9ac80d640 10 monclient(hunting): get_auth_request con 0x55e0f7737130 auth_method 0 2024-09-14T11:31:00.527 INFO:tasks.workunit.client.0.smithi071.stderr: -379> 2024-09-14T11:31:00.171+0000 7fb9ac80d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:00.527 INFO:tasks.workunit.client.0.smithi071.stderr: -378> 2024-09-14T11:31:00.171+0000 7fb9ac80d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:00.527 INFO:tasks.workunit.client.0.smithi071.stderr: -377> 2024-09-14T11:31:00.171+0000 7fb9ac80d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:00.527 INFO:tasks.workunit.client.0.smithi071.stderr: -376> 2024-09-14T11:31:00.171+0000 7fb9ac80d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:00.527 INFO:tasks.workunit.client.0.smithi071.stderr: -375> 2024-09-14T11:31:00.171+0000 7fb9ac80d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:00.527 INFO:tasks.workunit.client.0.smithi071.stderr: -374> 2024-09-14T11:31:00.171+0000 7fb9ac80d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:00.527 INFO:tasks.workunit.client.0.smithi071.stderr: -373> 2024-09-14T11:31:00.171+0000 7fb9ac00c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:00.527 INFO:tasks.workunit.client.0.smithi071.stderr: -372> 2024-09-14T11:31:00.171+0000 7fb9ac00c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:00.527 INFO:tasks.workunit.client.0.smithi071.stderr: -371> 2024-09-14T11:31:00.171+0000 7fb9ac00c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:00.527 INFO:tasks.workunit.client.0.smithi071.stderr: -370> 2024-09-14T11:31:00.171+0000 7fb9ad00e640 10 monclient(hunting): get_auth_request con 0x55e0f7738750 auth_method 0 2024-09-14T11:31:00.527 INFO:tasks.workunit.client.0.smithi071.stderr: -369> 2024-09-14T11:31:00.171+0000 7fb9ad00e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:00.527 INFO:tasks.workunit.client.0.smithi071.stderr: -368> 2024-09-14T11:31:00.171+0000 7fb9ad00e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:00.527 INFO:tasks.workunit.client.0.smithi071.stderr: -367> 2024-09-14T11:31:00.171+0000 7fb9ad00e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:00.527 INFO:tasks.workunit.client.0.smithi071.stderr: -366> 2024-09-14T11:31:00.171+0000 7fb9ac00c640 10 monclient(hunting): handle_auth_done global_id 6689 payload 824 2024-09-14T11:31:00.528 INFO:tasks.workunit.client.0.smithi071.stderr: -365> 2024-09-14T11:31:00.171+0000 7fb9ac00c640 10 monclient: _finish_hunting 0 2024-09-14T11:31:00.528 INFO:tasks.workunit.client.0.smithi071.stderr: -364> 2024-09-14T11:31:00.171+0000 7fb9ac00c640 1 monclient: found mon.noname-c 2024-09-14T11:31:00.528 INFO:tasks.workunit.client.0.smithi071.stderr: -363> 2024-09-14T11:31:00.171+0000 7fb9ac00c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:31:00.528 INFO:tasks.workunit.client.0.smithi071.stderr: -362> 2024-09-14T11:31:00.175+0000 7fb8927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:00.528 INFO:tasks.workunit.client.0.smithi071.stderr: -361> 2024-09-14T11:31:00.175+0000 7fb8927fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:31:00.528 INFO:tasks.workunit.client.0.smithi071.stderr: -360> 2024-09-14T11:31:00.175+0000 7fb8927fc640 10 monclient: dump: 2024-09-14T11:31:00.528 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:31:00.528 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:31:00.528 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:00.528 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:00.528 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:00.528 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:00.528 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:31:00.528 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:31:00.529 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:31:00.529 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.529 INFO:tasks.workunit.client.0.smithi071.stderr: -359> 2024-09-14T11:31:00.175+0000 7fb8927fc640 10 monclient: _finish_auth 0 2024-09-14T11:31:00.529 INFO:tasks.workunit.client.0.smithi071.stderr: -358> 2024-09-14T11:31:00.175+0000 7fb8927fc640 10 monclient: _check_auth_tickets 2024-09-14T11:31:00.529 INFO:tasks.workunit.client.0.smithi071.stderr: -357> 2024-09-14T11:31:00.175+0000 7fb8927fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:00.529 INFO:tasks.workunit.client.0.smithi071.stderr: -356> 2024-09-14T11:31:00.175+0000 7fb8927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:00.529 INFO:tasks.workunit.client.0.smithi071.stderr: -355> 2024-09-14T11:31:00.175+0000 7fb8927fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:31:00.529 INFO:tasks.workunit.client.0.smithi071.stderr: -354> 2024-09-14T11:31:00.175+0000 7fb8927fc640 10 monclient: dump: 2024-09-14T11:31:00.529 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:31:00.529 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:31:00.529 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:00.529 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:00.529 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:00.529 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:00.530 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:31:00.530 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:31:00.530 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:31:00.530 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.530 INFO:tasks.workunit.client.0.smithi071.stderr: -353> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 monclient: authenticate success, global_id 6689 2024-09-14T11:31:00.530 INFO:tasks.workunit.client.0.smithi071.stderr: -352> 2024-09-14T11:31:00.175+0000 7fb9ad80f640 4 set_mon_vals no callback set 2024-09-14T11:31:00.530 INFO:tasks.workunit.client.0.smithi071.stderr: -351> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 10 monclient: _renew_subs 2024-09-14T11:31:00.530 INFO:tasks.workunit.client.0.smithi071.stderr: -350> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:31:00.530 INFO:tasks.workunit.client.0.smithi071.stderr: -349> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 10 monclient: _renew_subs 2024-09-14T11:31:00.530 INFO:tasks.workunit.client.0.smithi071.stderr: -348> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:31:00.530 INFO:tasks.workunit.client.0.smithi071.stderr: -347> 2024-09-14T11:31:00.175+0000 7fb8927fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:31:00.530 INFO:tasks.workunit.client.0.smithi071.stderr: -346> 2024-09-14T11:31:00.175+0000 7fb8927fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:31:00.530 INFO:tasks.workunit.client.0.smithi071.stderr: -345> 2024-09-14T11:31:00.175+0000 7fb8927fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:31:00.530 INFO:tasks.workunit.client.0.smithi071.stderr: -344> 2024-09-14T11:31:00.175+0000 7fb9ad00e640 10 monclient: get_auth_request con 0x7fb8840717e0 auth_method 0 2024-09-14T11:31:00.531 INFO:tasks.workunit.client.0.smithi071.stderr: -343> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 10 monclient: get_monmap_and_config 2024-09-14T11:31:00.531 INFO:tasks.workunit.client.0.smithi071.stderr: -342> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 10 monclient: build_initial_monmap 2024-09-14T11:31:00.531 INFO:tasks.workunit.client.0.smithi071.stderr: -341> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 1 build_initial for_mkfs: 0 2024-09-14T11:31:00.531 INFO:tasks.workunit.client.0.smithi071.stderr: -340> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 10 monclient: monmap: 2024-09-14T11:31:00.531 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:31:00.531 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:31:00.531 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:31:00.531 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:31:00.531 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:31:00.531 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:00.531 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:31:00.531 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:31:00.531 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:31:00.531 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.531 INFO:tasks.workunit.client.0.smithi071.stderr: -339> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f7758770) adding auth protocol: cephx 2024-09-14T11:31:00.532 INFO:tasks.workunit.client.0.smithi071.stderr: -338> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f7758770) adding auth protocol: cephx 2024-09-14T11:31:00.532 INFO:tasks.workunit.client.0.smithi071.stderr: -337> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f7758770) adding auth protocol: cephx 2024-09-14T11:31:00.532 INFO:tasks.workunit.client.0.smithi071.stderr: -336> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f7758770) adding con mode: secure 2024-09-14T11:31:00.532 INFO:tasks.workunit.client.0.smithi071.stderr: -335> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f7758770) adding con mode: crc 2024-09-14T11:31:00.532 INFO:tasks.workunit.client.0.smithi071.stderr: -334> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f7758770) adding con mode: secure 2024-09-14T11:31:00.532 INFO:tasks.workunit.client.0.smithi071.stderr: -333> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f7758770) adding con mode: crc 2024-09-14T11:31:00.532 INFO:tasks.workunit.client.0.smithi071.stderr: -332> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f7758770) adding con mode: secure 2024-09-14T11:31:00.532 INFO:tasks.workunit.client.0.smithi071.stderr: -331> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f7758770) adding con mode: crc 2024-09-14T11:31:00.532 INFO:tasks.workunit.client.0.smithi071.stderr: -330> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f7758770) adding con mode: crc 2024-09-14T11:31:00.532 INFO:tasks.workunit.client.0.smithi071.stderr: -329> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f7758770) adding con mode: secure 2024-09-14T11:31:00.532 INFO:tasks.workunit.client.0.smithi071.stderr: -328> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f7758770) adding con mode: crc 2024-09-14T11:31:00.532 INFO:tasks.workunit.client.0.smithi071.stderr: -327> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f7758770) adding con mode: secure 2024-09-14T11:31:00.532 INFO:tasks.workunit.client.0.smithi071.stderr: -326> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f7758770) adding con mode: crc 2024-09-14T11:31:00.532 INFO:tasks.workunit.client.0.smithi071.stderr: -325> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f7758770) adding con mode: secure 2024-09-14T11:31:00.533 INFO:tasks.workunit.client.0.smithi071.stderr: -324> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:00.533 INFO:tasks.workunit.client.0.smithi071.stderr: -323> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 10 monclient: init 2024-09-14T11:31:00.533 INFO:tasks.workunit.client.0.smithi071.stderr: -322> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2abb0) adding auth protocol: cephx 2024-09-14T11:31:00.533 INFO:tasks.workunit.client.0.smithi071.stderr: -321> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2abb0) adding auth protocol: cephx 2024-09-14T11:31:00.533 INFO:tasks.workunit.client.0.smithi071.stderr: -320> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2abb0) adding auth protocol: cephx 2024-09-14T11:31:00.533 INFO:tasks.workunit.client.0.smithi071.stderr: -319> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2abb0) adding con mode: secure 2024-09-14T11:31:00.533 INFO:tasks.workunit.client.0.smithi071.stderr: -318> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2abb0) adding con mode: crc 2024-09-14T11:31:00.533 INFO:tasks.workunit.client.0.smithi071.stderr: -317> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2abb0) adding con mode: secure 2024-09-14T11:31:00.533 INFO:tasks.workunit.client.0.smithi071.stderr: -316> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2abb0) adding con mode: crc 2024-09-14T11:31:00.533 INFO:tasks.workunit.client.0.smithi071.stderr: -315> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2abb0) adding con mode: secure 2024-09-14T11:31:00.533 INFO:tasks.workunit.client.0.smithi071.stderr: -314> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2abb0) adding con mode: crc 2024-09-14T11:31:00.533 INFO:tasks.workunit.client.0.smithi071.stderr: -313> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2abb0) adding con mode: crc 2024-09-14T11:31:00.533 INFO:tasks.workunit.client.0.smithi071.stderr: -312> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2abb0) adding con mode: secure 2024-09-14T11:31:00.534 INFO:tasks.workunit.client.0.smithi071.stderr: -311> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2abb0) adding con mode: crc 2024-09-14T11:31:00.534 INFO:tasks.workunit.client.0.smithi071.stderr: -310> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2abb0) adding con mode: secure 2024-09-14T11:31:00.534 INFO:tasks.workunit.client.0.smithi071.stderr: -309> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2abb0) adding con mode: crc 2024-09-14T11:31:00.534 INFO:tasks.workunit.client.0.smithi071.stderr: -308> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2abb0) adding con mode: secure 2024-09-14T11:31:00.534 INFO:tasks.workunit.client.0.smithi071.stderr: -307> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:00.534 INFO:tasks.workunit.client.0.smithi071.stderr: -306> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:00.534 INFO:tasks.workunit.client.0.smithi071.stderr: -305> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 asok(0x55e0f74aed90) register_command rotate-key cmddesc rotate-key hook 0x7ffd4db2acf8 EEXIST 2024-09-14T11:31:00.534 INFO:tasks.workunit.client.0.smithi071.stderr: -304> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 10 monclient: _reopen_session rank -1 2024-09-14T11:31:00.534 INFO:tasks.workunit.client.0.smithi071.stderr: -303> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:31:00.534 INFO:tasks.workunit.client.0.smithi071.stderr: -302> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 10 monclient(hunting): picked mon.noname-c con 0x55e0f778cc70 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:31:00.534 INFO:tasks.workunit.client.0.smithi071.stderr: -301> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 10 monclient(hunting): picked mon.noname-b con 0x55e0f7788060 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:31:00.534 INFO:tasks.workunit.client.0.smithi071.stderr: -300> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 10 monclient(hunting): picked mon.noname-a con 0x55e0f77889e0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:31:00.534 INFO:tasks.workunit.client.0.smithi071.stderr: -299> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:00.534 INFO:tasks.workunit.client.0.smithi071.stderr: -298> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:00.534 INFO:tasks.workunit.client.0.smithi071.stderr: -297> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:00.535 INFO:tasks.workunit.client.0.smithi071.stderr: -296> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 10 monclient(hunting): _renew_subs 2024-09-14T11:31:00.535 INFO:tasks.workunit.client.0.smithi071.stderr: -295> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 10 monclient(hunting): authenticate will time out at 2272.299561s 2024-09-14T11:31:00.535 INFO:tasks.workunit.client.0.smithi071.stderr: -294> 2024-09-14T11:31:00.175+0000 7fb9ac00c640 10 monclient(hunting): get_auth_request con 0x55e0f778cc70 auth_method 0 2024-09-14T11:31:00.535 INFO:tasks.workunit.client.0.smithi071.stderr: -293> 2024-09-14T11:31:00.175+0000 7fb9ac00c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:00.535 INFO:tasks.workunit.client.0.smithi071.stderr: -292> 2024-09-14T11:31:00.175+0000 7fb9ac00c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:00.535 INFO:tasks.workunit.client.0.smithi071.stderr: -291> 2024-09-14T11:31:00.175+0000 7fb9ac00c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:00.535 INFO:tasks.workunit.client.0.smithi071.stderr: -290> 2024-09-14T11:31:00.175+0000 7fb9ac80d640 10 monclient(hunting): get_auth_request con 0x55e0f77889e0 auth_method 0 2024-09-14T11:31:00.535 INFO:tasks.workunit.client.0.smithi071.stderr: -289> 2024-09-14T11:31:00.175+0000 7fb9ac80d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:00.535 INFO:tasks.workunit.client.0.smithi071.stderr: -288> 2024-09-14T11:31:00.175+0000 7fb9ac80d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:00.535 INFO:tasks.workunit.client.0.smithi071.stderr: -287> 2024-09-14T11:31:00.175+0000 7fb9ac80d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:00.535 INFO:tasks.workunit.client.0.smithi071.stderr: -286> 2024-09-14T11:31:00.175+0000 7fb9ac00c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:00.535 INFO:tasks.workunit.client.0.smithi071.stderr: -285> 2024-09-14T11:31:00.175+0000 7fb9ac00c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:00.535 INFO:tasks.workunit.client.0.smithi071.stderr: -284> 2024-09-14T11:31:00.175+0000 7fb9ac00c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:00.535 INFO:tasks.workunit.client.0.smithi071.stderr: -283> 2024-09-14T11:31:00.175+0000 7fb9ac80d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:00.536 INFO:tasks.workunit.client.0.smithi071.stderr: -282> 2024-09-14T11:31:00.175+0000 7fb9ac80d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:00.536 INFO:tasks.workunit.client.0.smithi071.stderr: -281> 2024-09-14T11:31:00.175+0000 7fb9ac80d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:00.536 INFO:tasks.workunit.client.0.smithi071.stderr: -280> 2024-09-14T11:31:00.175+0000 7fb9ac00c640 10 monclient(hunting): handle_auth_done global_id 6692 payload 274 2024-09-14T11:31:00.536 INFO:tasks.workunit.client.0.smithi071.stderr: -279> 2024-09-14T11:31:00.175+0000 7fb9ac00c640 10 monclient: _finish_hunting 0 2024-09-14T11:31:00.536 INFO:tasks.workunit.client.0.smithi071.stderr: -278> 2024-09-14T11:31:00.175+0000 7fb9ac00c640 1 monclient: found mon.noname-c 2024-09-14T11:31:00.536 INFO:tasks.workunit.client.0.smithi071.stderr: -277> 2024-09-14T11:31:00.175+0000 7fb9ac00c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:31:00.536 INFO:tasks.workunit.client.0.smithi071.stderr: -276> 2024-09-14T11:31:00.179+0000 7fb883fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:00.536 INFO:tasks.workunit.client.0.smithi071.stderr: -275> 2024-09-14T11:31:00.179+0000 7fb883fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:31:00.536 INFO:tasks.workunit.client.0.smithi071.stderr: -274> 2024-09-14T11:31:00.179+0000 7fb883fff640 10 monclient: dump: 2024-09-14T11:31:00.536 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:31:00.536 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:31:00.536 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:00.536 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:00.536 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:00.537 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:00.537 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:31:00.537 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:31:00.537 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:31:00.537 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.537 INFO:tasks.workunit.client.0.smithi071.stderr: -273> 2024-09-14T11:31:00.179+0000 7fb883fff640 10 monclient: _finish_auth 0 2024-09-14T11:31:00.537 INFO:tasks.workunit.client.0.smithi071.stderr: -272> 2024-09-14T11:31:00.179+0000 7fb883fff640 10 monclient: _check_auth_tickets 2024-09-14T11:31:00.537 INFO:tasks.workunit.client.0.smithi071.stderr: -271> 2024-09-14T11:31:00.179+0000 7fb883fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:00.537 INFO:tasks.workunit.client.0.smithi071.stderr: -270> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 monclient: authenticate success, global_id 6692 2024-09-14T11:31:00.537 INFO:tasks.workunit.client.0.smithi071.stderr: -269> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient: get_monmap_and_config success 2024-09-14T11:31:00.537 INFO:tasks.workunit.client.0.smithi071.stderr: -268> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 4 set_mon_vals no callback set 2024-09-14T11:31:00.537 INFO:tasks.workunit.client.0.smithi071.stderr: -267> 2024-09-14T11:31:00.179+0000 7fb883fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:00.537 INFO:tasks.workunit.client.0.smithi071.stderr: -266> 2024-09-14T11:31:00.179+0000 7fb883fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:31:00.537 INFO:tasks.workunit.client.0.smithi071.stderr: -265> 2024-09-14T11:31:00.179+0000 7fb883fff640 10 monclient: dump: 2024-09-14T11:31:00.537 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:31:00.538 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:31:00.538 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:00.538 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:00.538 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:00.538 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:00.538 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:31:00.538 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:31:00.538 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:31:00.538 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.538 INFO:tasks.workunit.client.0.smithi071.stderr: -264> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient: shutdown 2024-09-14T11:31:00.538 INFO:tasks.workunit.client.0.smithi071.stderr: -263> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient: build_initial_monmap 2024-09-14T11:31:00.538 INFO:tasks.workunit.client.0.smithi071.stderr: -262> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 1 build_initial for_mkfs: 0 2024-09-14T11:31:00.538 INFO:tasks.workunit.client.0.smithi071.stderr: -261> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient: monmap: 2024-09-14T11:31:00.538 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:31:00.538 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:31:00.538 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:31:00.539 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:31:00.539 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:31:00.539 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:00.539 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:31:00.539 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:31:00.539 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:31:00.539 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.539 INFO:tasks.workunit.client.0.smithi071.stderr: -260> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f777f260) adding auth protocol: cephx 2024-09-14T11:31:00.539 INFO:tasks.workunit.client.0.smithi071.stderr: -259> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f777f260) adding auth protocol: cephx 2024-09-14T11:31:00.539 INFO:tasks.workunit.client.0.smithi071.stderr: -258> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f777f260) adding auth protocol: cephx 2024-09-14T11:31:00.539 INFO:tasks.workunit.client.0.smithi071.stderr: -257> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f777f260) adding con mode: secure 2024-09-14T11:31:00.539 INFO:tasks.workunit.client.0.smithi071.stderr: -256> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f777f260) adding con mode: crc 2024-09-14T11:31:00.539 INFO:tasks.workunit.client.0.smithi071.stderr: -255> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f777f260) adding con mode: secure 2024-09-14T11:31:00.540 INFO:tasks.workunit.client.0.smithi071.stderr: -254> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f777f260) adding con mode: crc 2024-09-14T11:31:00.540 INFO:tasks.workunit.client.0.smithi071.stderr: -253> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f777f260) adding con mode: secure 2024-09-14T11:31:00.540 INFO:tasks.workunit.client.0.smithi071.stderr: -252> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f777f260) adding con mode: crc 2024-09-14T11:31:00.540 INFO:tasks.workunit.client.0.smithi071.stderr: -251> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f777f260) adding con mode: crc 2024-09-14T11:31:00.540 INFO:tasks.workunit.client.0.smithi071.stderr: -250> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f777f260) adding con mode: secure 2024-09-14T11:31:00.540 INFO:tasks.workunit.client.0.smithi071.stderr: -249> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f777f260) adding con mode: crc 2024-09-14T11:31:00.540 INFO:tasks.workunit.client.0.smithi071.stderr: -248> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f777f260) adding con mode: secure 2024-09-14T11:31:00.540 INFO:tasks.workunit.client.0.smithi071.stderr: -247> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f777f260) adding con mode: crc 2024-09-14T11:31:00.540 INFO:tasks.workunit.client.0.smithi071.stderr: -246> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f777f260) adding con mode: secure 2024-09-14T11:31:00.540 INFO:tasks.workunit.client.0.smithi071.stderr: -245> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:00.540 INFO:tasks.workunit.client.0.smithi071.stderr: -244> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 1 librados: starting msgr at 2024-09-14T11:31:00.540 INFO:tasks.workunit.client.0.smithi071.stderr: -243> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 1 librados: starting objecter 2024-09-14T11:31:00.540 INFO:tasks.workunit.client.0.smithi071.stderr: -242> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 asok(0x55e0f74aed90) register_command objecter_requests cmddesc objecter_requests hook 0x55e0f7786bb0 EEXIST 2024-09-14T11:31:00.540 INFO:tasks.workunit.client.0.smithi071.stderr: -241> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 1 librados: setting wanted keys 2024-09-14T11:31:00.541 INFO:tasks.workunit.client.0.smithi071.stderr: -240> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 1 librados: calling monclient init 2024-09-14T11:31:00.541 INFO:tasks.workunit.client.0.smithi071.stderr: -239> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient: init 2024-09-14T11:31:00.541 INFO:tasks.workunit.client.0.smithi071.stderr: -238> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f773ac40) adding auth protocol: cephx 2024-09-14T11:31:00.541 INFO:tasks.workunit.client.0.smithi071.stderr: -237> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f773ac40) adding auth protocol: cephx 2024-09-14T11:31:00.541 INFO:tasks.workunit.client.0.smithi071.stderr: -236> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f773ac40) adding auth protocol: cephx 2024-09-14T11:31:00.541 INFO:tasks.workunit.client.0.smithi071.stderr: -235> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f773ac40) adding con mode: secure 2024-09-14T11:31:00.541 INFO:tasks.workunit.client.0.smithi071.stderr: -234> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f773ac40) adding con mode: crc 2024-09-14T11:31:00.541 INFO:tasks.workunit.client.0.smithi071.stderr: -233> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f773ac40) adding con mode: secure 2024-09-14T11:31:00.541 INFO:tasks.workunit.client.0.smithi071.stderr: -232> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f773ac40) adding con mode: crc 2024-09-14T11:31:00.541 INFO:tasks.workunit.client.0.smithi071.stderr: -231> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f773ac40) adding con mode: secure 2024-09-14T11:31:00.541 INFO:tasks.workunit.client.0.smithi071.stderr: -230> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f773ac40) adding con mode: crc 2024-09-14T11:31:00.541 INFO:tasks.workunit.client.0.smithi071.stderr: -229> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f773ac40) adding con mode: crc 2024-09-14T11:31:00.541 INFO:tasks.workunit.client.0.smithi071.stderr: -228> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f773ac40) adding con mode: secure 2024-09-14T11:31:00.541 INFO:tasks.workunit.client.0.smithi071.stderr: -227> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f773ac40) adding con mode: crc 2024-09-14T11:31:00.541 INFO:tasks.workunit.client.0.smithi071.stderr: -226> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f773ac40) adding con mode: secure 2024-09-14T11:31:00.542 INFO:tasks.workunit.client.0.smithi071.stderr: -225> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f773ac40) adding con mode: crc 2024-09-14T11:31:00.542 INFO:tasks.workunit.client.0.smithi071.stderr: -224> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f773ac40) adding con mode: secure 2024-09-14T11:31:00.542 INFO:tasks.workunit.client.0.smithi071.stderr: -223> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:00.542 INFO:tasks.workunit.client.0.smithi071.stderr: -222> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:00.542 INFO:tasks.workunit.client.0.smithi071.stderr: -221> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 asok(0x55e0f74aed90) register_command rotate-key cmddesc rotate-key hook 0x55e0f773ad88 EEXIST 2024-09-14T11:31:00.542 INFO:tasks.workunit.client.0.smithi071.stderr: -220> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient: _reopen_session rank -1 2024-09-14T11:31:00.542 INFO:tasks.workunit.client.0.smithi071.stderr: -219> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:31:00.542 INFO:tasks.workunit.client.0.smithi071.stderr: -218> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient(hunting): picked mon.noname-a con 0x55e0f7788060 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:31:00.542 INFO:tasks.workunit.client.0.smithi071.stderr: -217> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient(hunting): picked mon.noname-c con 0x55e0f77889e0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:31:00.542 INFO:tasks.workunit.client.0.smithi071.stderr: -216> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient(hunting): picked mon.noname-b con 0x55e0f778cc70 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:31:00.542 INFO:tasks.workunit.client.0.smithi071.stderr: -215> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:00.542 INFO:tasks.workunit.client.0.smithi071.stderr: -214> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:00.542 INFO:tasks.workunit.client.0.smithi071.stderr: -213> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:00.542 INFO:tasks.workunit.client.0.smithi071.stderr: -212> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient(hunting): _renew_subs 2024-09-14T11:31:00.542 INFO:tasks.workunit.client.0.smithi071.stderr: -211> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient(hunting): authenticate will time out at 2272.302038s 2024-09-14T11:31:00.543 INFO:tasks.workunit.client.0.smithi071.stderr: -210> 2024-09-14T11:31:00.179+0000 7fb9ac00c640 10 monclient(hunting): get_auth_request con 0x55e0f7788060 auth_method 0 2024-09-14T11:31:00.543 INFO:tasks.workunit.client.0.smithi071.stderr: -209> 2024-09-14T11:31:00.179+0000 7fb9ac00c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:00.543 INFO:tasks.workunit.client.0.smithi071.stderr: -208> 2024-09-14T11:31:00.179+0000 7fb9ac00c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:00.543 INFO:tasks.workunit.client.0.smithi071.stderr: -207> 2024-09-14T11:31:00.179+0000 7fb9ac00c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:00.543 INFO:tasks.workunit.client.0.smithi071.stderr: -206> 2024-09-14T11:31:00.179+0000 7fb9ad00e640 10 monclient(hunting): get_auth_request con 0x55e0f77889e0 auth_method 0 2024-09-14T11:31:00.543 INFO:tasks.workunit.client.0.smithi071.stderr: -205> 2024-09-14T11:31:00.179+0000 7fb9ad00e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:00.543 INFO:tasks.workunit.client.0.smithi071.stderr: -204> 2024-09-14T11:31:00.179+0000 7fb9ad00e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:00.543 INFO:tasks.workunit.client.0.smithi071.stderr: -203> 2024-09-14T11:31:00.179+0000 7fb9ad00e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:00.543 INFO:tasks.workunit.client.0.smithi071.stderr: -202> 2024-09-14T11:31:00.179+0000 7fb9ac00c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:00.543 INFO:tasks.workunit.client.0.smithi071.stderr: -201> 2024-09-14T11:31:00.179+0000 7fb9ac00c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:00.543 INFO:tasks.workunit.client.0.smithi071.stderr: -200> 2024-09-14T11:31:00.179+0000 7fb9ac00c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:00.543 INFO:tasks.workunit.client.0.smithi071.stderr: -199> 2024-09-14T11:31:00.179+0000 7fb9ad00e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:00.543 INFO:tasks.workunit.client.0.smithi071.stderr: -198> 2024-09-14T11:31:00.179+0000 7fb9ad00e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:00.543 INFO:tasks.workunit.client.0.smithi071.stderr: -197> 2024-09-14T11:31:00.179+0000 7fb9ad00e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:00.543 INFO:tasks.workunit.client.0.smithi071.stderr: -196> 2024-09-14T11:31:00.179+0000 7fb9ac00c640 10 monclient(hunting): handle_auth_done global_id 7035 payload 824 2024-09-14T11:31:00.544 INFO:tasks.workunit.client.0.smithi071.stderr: -195> 2024-09-14T11:31:00.179+0000 7fb9ac00c640 10 monclient: _finish_hunting 0 2024-09-14T11:31:00.544 INFO:tasks.workunit.client.0.smithi071.stderr: -194> 2024-09-14T11:31:00.179+0000 7fb9ac00c640 1 monclient: found mon.noname-a 2024-09-14T11:31:00.544 INFO:tasks.workunit.client.0.smithi071.stderr: -193> 2024-09-14T11:31:00.179+0000 7fb9ac00c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:31:00.544 INFO:tasks.workunit.client.0.smithi071.stderr: -192> 2024-09-14T11:31:00.179+0000 7fb9ac80d640 10 monclient: get_auth_request con 0x55e0f778cc70 auth_method 0 2024-09-14T11:31:00.544 INFO:tasks.workunit.client.0.smithi071.stderr: -191> 2024-09-14T11:31:00.179+0000 7fb8827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:00.544 INFO:tasks.workunit.client.0.smithi071.stderr: -190> 2024-09-14T11:31:00.179+0000 7fb8827fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:31:00.544 INFO:tasks.workunit.client.0.smithi071.stderr: -189> 2024-09-14T11:31:00.179+0000 7fb8827fc640 10 monclient: dump: 2024-09-14T11:31:00.544 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:31:00.544 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:31:00.544 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:00.544 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:00.544 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:00.544 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:00.544 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:31:00.545 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:31:00.545 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:31:00.545 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.545 INFO:tasks.workunit.client.0.smithi071.stderr: -188> 2024-09-14T11:31:00.179+0000 7fb8827fc640 10 monclient: _finish_auth 0 2024-09-14T11:31:00.545 INFO:tasks.workunit.client.0.smithi071.stderr: -187> 2024-09-14T11:31:00.179+0000 7fb8827fc640 10 monclient: _check_auth_tickets 2024-09-14T11:31:00.545 INFO:tasks.workunit.client.0.smithi071.stderr: -186> 2024-09-14T11:31:00.179+0000 7fb8827fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:00.545 INFO:tasks.workunit.client.0.smithi071.stderr: -185> 2024-09-14T11:31:00.179+0000 7fb8827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:00.545 INFO:tasks.workunit.client.0.smithi071.stderr: -184> 2024-09-14T11:31:00.179+0000 7fb8827fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:31:00.545 INFO:tasks.workunit.client.0.smithi071.stderr: -183> 2024-09-14T11:31:00.179+0000 7fb8827fc640 10 monclient: dump: 2024-09-14T11:31:00.545 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:31:00.545 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:31:00.545 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:00.545 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:00.545 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:00.545 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:00.546 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:31:00.546 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:31:00.546 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:31:00.546 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.546 INFO:tasks.workunit.client.0.smithi071.stderr: -182> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 monclient: authenticate success, global_id 7035 2024-09-14T11:31:00.546 INFO:tasks.workunit.client.0.smithi071.stderr: -181> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient: _renew_subs 2024-09-14T11:31:00.546 INFO:tasks.workunit.client.0.smithi071.stderr: -180> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:31:00.546 INFO:tasks.workunit.client.0.smithi071.stderr: -179> 2024-09-14T11:31:00.179+0000 7fb883fff640 4 set_mon_vals no callback set 2024-09-14T11:31:00.546 INFO:tasks.workunit.client.0.smithi071.stderr: -178> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient: _renew_subs 2024-09-14T11:31:00.546 INFO:tasks.workunit.client.0.smithi071.stderr: -177> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:31:00.546 INFO:tasks.workunit.client.0.smithi071.stderr: -176> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 1 librados: init done 2024-09-14T11:31:00.546 INFO:tasks.workunit.client.0.smithi071.stderr: -175> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 asok(0x55e0f74aed90) register_command cr dump hook 0x55e0f7786308 2024-09-14T11:31:00.546 INFO:tasks.workunit.client.0.smithi071.stderr: -174> 2024-09-14T11:31:00.183+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.546 INFO:tasks.workunit.client.0.smithi071.stderr: -173> 2024-09-14T11:31:00.183+0000 7fb8827fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:31:00.547 INFO:tasks.workunit.client.0.smithi071.stderr: -172> 2024-09-14T11:31:00.183+0000 7fb8827fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:31:00.547 INFO:tasks.workunit.client.0.smithi071.stderr: -171> 2024-09-14T11:31:00.183+0000 7fb8827fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:31:00.547 INFO:tasks.workunit.client.0.smithi071.stderr: -170> 2024-09-14T11:31:00.183+0000 7fb9ad00e640 10 monclient: get_auth_request con 0x7fb8780718a0 auth_method 0 2024-09-14T11:31:00.547 INFO:tasks.workunit.client.0.smithi071.stderr: -169> 2024-09-14T11:31:00.183+0000 7fb9ac80d640 10 monclient: get_auth_request con 0x55e0f77a6650 auth_method 0 2024-09-14T11:31:00.547 INFO:tasks.workunit.client.0.smithi071.stderr: -168> 2024-09-14T11:31:00.183+0000 7fb9aed079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:00.547 INFO:tasks.workunit.client.0.smithi071.stderr: -167> 2024-09-14T11:31:00.183+0000 7fb9aed079c0 20 realm 2024-09-14T11:31:00.547 INFO:tasks.workunit.client.0.smithi071.stderr: -166> 2024-09-14T11:31:00.183+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.547 INFO:tasks.workunit.client.0.smithi071.stderr: -165> 2024-09-14T11:31:00.183+0000 7fb9aed079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:00.547 INFO:tasks.workunit.client.0.smithi071.stderr: -164> 2024-09-14T11:31:00.183+0000 7fb9aed079c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:00.547 INFO:tasks.workunit.client.0.smithi071.stderr: -163> 2024-09-14T11:31:00.183+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.547 INFO:tasks.workunit.client.0.smithi071.stderr: -162> 2024-09-14T11:31:00.183+0000 7fb9aed079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:00.547 INFO:tasks.workunit.client.0.smithi071.stderr: -161> 2024-09-14T11:31:00.183+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.547 INFO:tasks.workunit.client.0.smithi071.stderr: -160> 2024-09-14T11:31:00.183+0000 7fb9ac00c640 10 monclient: get_auth_request con 0x55e0f77aa9a0 auth_method 0 2024-09-14T11:31:00.547 INFO:tasks.workunit.client.0.smithi071.stderr: -159> 2024-09-14T11:31:00.187+0000 7fb9aed079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:00.548 INFO:tasks.workunit.client.0.smithi071.stderr: -158> 2024-09-14T11:31:00.187+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.548 INFO:tasks.workunit.client.0.smithi071.stderr: -157> 2024-09-14T11:31:00.187+0000 7fb9ad00e640 10 monclient: get_auth_request con 0x55e0f77ae0c0 auth_method 0 2024-09-14T11:31:00.548 INFO:tasks.workunit.client.0.smithi071.stderr: -156> 2024-09-14T11:31:00.187+0000 7fb9aed079c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:00.548 INFO:tasks.workunit.client.0.smithi071.stderr: -155> 2024-09-14T11:31:00.187+0000 7fb9aed079c0 20 searching for the correct realm 2024-09-14T11:31:00.548 INFO:tasks.workunit.client.0.smithi071.stderr: -154> 2024-09-14T11:31:00.187+0000 7fb9ac80d640 10 monclient: get_auth_request con 0x55e0f77b2e80 auth_method 0 2024-09-14T11:31:00.548 INFO:tasks.workunit.client.0.smithi071.stderr: -153> 2024-09-14T11:31:00.187+0000 7fb9ac00c640 10 monclient: get_auth_request con 0x7fb99c0c0020 auth_method 0 2024-09-14T11:31:00.548 INFO:tasks.workunit.client.0.smithi071.stderr: -152> 2024-09-14T11:31:00.191+0000 7fb9ad00e640 10 monclient: get_auth_request con 0x7fb9a0034b60 auth_method 0 2024-09-14T11:31:00.548 INFO:tasks.workunit.client.0.smithi071.stderr: -151> 2024-09-14T11:31:00.191+0000 7fb9ad00e640 0 -- 172.21.15.71:0/29309657 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fb9a0034b60 msgr2=0x7fb9a001f450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:00.548 INFO:tasks.workunit.client.0.smithi071.stderr: -150> 2024-09-14T11:31:00.395+0000 7fb9ad00e640 10 monclient: get_auth_request con 0x7fb9a0034b60 auth_method 0 2024-09-14T11:31:00.548 INFO:tasks.workunit.client.0.smithi071.stderr: -149> 2024-09-14T11:31:00.395+0000 7fb9ac80d640 10 monclient: get_auth_request con 0x7fb99c102560 auth_method 0 2024-09-14T11:31:00.548 INFO:tasks.workunit.client.0.smithi071.stderr: -148> 2024-09-14T11:31:00.403+0000 7fb9ac00c640 10 monclient: get_auth_request con 0x7fb9a002cc20 auth_method 0 2024-09-14T11:31:00.548 INFO:tasks.workunit.client.0.smithi071.stderr: -147> 2024-09-14T11:31:00.403+0000 7fb9ad00e640 0 -- 172.21.15.71:0/29309657 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55e0f77ae0c0 msgr2=0x55e0f77b04d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:00.548 INFO:tasks.workunit.client.0.smithi071.stderr: -146> 2024-09-14T11:31:00.403+0000 7fb8827fc640 1 client.7035.objecter ms_handle_reset 0x55e0f77ae0c0 session 0x55e0f77aa240 osd.3 2024-09-14T11:31:00.548 INFO:tasks.workunit.client.0.smithi071.stderr: -145> 2024-09-14T11:31:00.403+0000 7fb8827fc640 10 monclient: _renew_subs 2024-09-14T11:31:00.549 INFO:tasks.workunit.client.0.smithi071.stderr: -144> 2024-09-14T11:31:00.403+0000 7fb8827fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:31:00.549 INFO:tasks.workunit.client.0.smithi071.stderr: -143> 2024-09-14T11:31:00.403+0000 7fb9ad00e640 10 monclient: get_auth_request con 0x7fb8780813c0 auth_method 0 2024-09-14T11:31:00.549 INFO:tasks.workunit.client.0.smithi071.stderr: -142> 2024-09-14T11:31:00.419+0000 7fb9aed079c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:00.549 INFO:tasks.workunit.client.0.smithi071.stderr: -141> 2024-09-14T11:31:00.419+0000 7fb9aed079c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:31:00.549 INFO:tasks.workunit.client.0.smithi071.stderr: -140> 2024-09-14T11:31:00.419+0000 7fb9aed079c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:00.549 INFO:tasks.workunit.client.0.smithi071.stderr: -139> 2024-09-14T11:31:00.419+0000 7fb9aed079c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:31:00.549 INFO:tasks.workunit.client.0.smithi071.stderr: -138> 2024-09-14T11:31:00.419+0000 7fb9aed079c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:00.549 INFO:tasks.workunit.client.0.smithi071.stderr: -137> 2024-09-14T11:31:00.419+0000 7fb9aed079c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:00.549 INFO:tasks.workunit.client.0.smithi071.stderr: -136> 2024-09-14T11:31:00.419+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.549 INFO:tasks.workunit.client.0.smithi071.stderr: -135> 2024-09-14T11:31:00.419+0000 7fb9aed079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:00.549 INFO:tasks.workunit.client.0.smithi071.stderr: -134> 2024-09-14T11:31:00.419+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.549 INFO:tasks.workunit.client.0.smithi071.stderr: -133> 2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:00.549 INFO:tasks.workunit.client.0.smithi071.stderr: -132> 2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.549 INFO:tasks.workunit.client.0.smithi071.stderr: -131> 2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:00.549 INFO:tasks.workunit.client.0.smithi071.stderr: -130> 2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 zone default found 2024-09-14T11:31:00.550 INFO:tasks.workunit.client.0.smithi071.stderr: -129> 2024-09-14T11:31:00.423+0000 7fb9aed079c0 4 Realm: () 2024-09-14T11:31:00.550 INFO:tasks.workunit.client.0.smithi071.stderr: -128> 2024-09-14T11:31:00.423+0000 7fb9aed079c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:31:00.550 INFO:tasks.workunit.client.0.smithi071.stderr: -127> 2024-09-14T11:31:00.423+0000 7fb9aed079c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:31:00.550 INFO:tasks.workunit.client.0.smithi071.stderr: -126> 2024-09-14T11:31:00.423+0000 7fb9aed079c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:00.550 INFO:tasks.workunit.client.0.smithi071.stderr: -125> 2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 zonegroup default 2024-09-14T11:31:00.550 INFO:tasks.workunit.client.0.smithi071.stderr: -124> 2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.550 INFO:tasks.workunit.client.0.smithi071.stderr: -123> 2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:00.550 INFO:tasks.workunit.client.0.smithi071.stderr: -122> 2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.550 INFO:tasks.workunit.client.0.smithi071.stderr: -121> 2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:00.550 INFO:tasks.workunit.client.0.smithi071.stderr: -120> 2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.550 INFO:tasks.workunit.client.0.smithi071.stderr: -119> 2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:00.550 INFO:tasks.workunit.client.0.smithi071.stderr: -118> 2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 started sync module instance, tier type = 2024-09-14T11:31:00.550 INFO:tasks.workunit.client.0.smithi071.stderr: -117> 2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:31:00.550 INFO:tasks.workunit.client.0.smithi071.stderr: -116> 2024-09-14T11:31:00.447+0000 7fb9aed079c0 20 add_watcher() i=0 2024-09-14T11:31:00.550 INFO:tasks.workunit.client.0.smithi071.stderr: -115> 2024-09-14T11:31:00.447+0000 7fb9aed079c0 20 add_watcher() i=1 2024-09-14T11:31:00.550 INFO:tasks.workunit.client.0.smithi071.stderr: -114> 2024-09-14T11:31:00.447+0000 7fb9aed079c0 20 add_watcher() i=2 2024-09-14T11:31:00.551 INFO:tasks.workunit.client.0.smithi071.stderr: -113> 2024-09-14T11:31:00.447+0000 7fb9aed079c0 20 add_watcher() i=3 2024-09-14T11:31:00.551 INFO:tasks.workunit.client.0.smithi071.stderr: -112> 2024-09-14T11:31:00.447+0000 7fb9aed079c0 20 add_watcher() i=4 2024-09-14T11:31:00.551 INFO:tasks.workunit.client.0.smithi071.stderr: -111> 2024-09-14T11:31:00.447+0000 7fb9aed079c0 20 add_watcher() i=5 2024-09-14T11:31:00.551 INFO:tasks.workunit.client.0.smithi071.stderr: -110> 2024-09-14T11:31:00.447+0000 7fb9aed079c0 20 add_watcher() i=6 2024-09-14T11:31:00.551 INFO:tasks.workunit.client.0.smithi071.stderr: -109> 2024-09-14T11:31:00.451+0000 7fb9aed079c0 20 add_watcher() i=7 2024-09-14T11:31:00.551 INFO:tasks.workunit.client.0.smithi071.stderr: -108> 2024-09-14T11:31:00.451+0000 7fb9aed079c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:00.551 INFO:tasks.workunit.client.0.smithi071.stderr: -107> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2b090) adding auth protocol: cephx 2024-09-14T11:31:00.551 INFO:tasks.workunit.client.0.smithi071.stderr: -106> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2b090) adding auth protocol: cephx 2024-09-14T11:31:00.551 INFO:tasks.workunit.client.0.smithi071.stderr: -105> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2b090) adding auth protocol: cephx 2024-09-14T11:31:00.551 INFO:tasks.workunit.client.0.smithi071.stderr: -104> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2b090) adding con mode: secure 2024-09-14T11:31:00.551 INFO:tasks.workunit.client.0.smithi071.stderr: -103> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2b090) adding con mode: crc 2024-09-14T11:31:00.551 INFO:tasks.workunit.client.0.smithi071.stderr: -102> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2b090) adding con mode: secure 2024-09-14T11:31:00.551 INFO:tasks.workunit.client.0.smithi071.stderr: -101> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2b090) adding con mode: crc 2024-09-14T11:31:00.551 INFO:tasks.workunit.client.0.smithi071.stderr: -100> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2b090) adding con mode: secure 2024-09-14T11:31:00.551 INFO:tasks.workunit.client.0.smithi071.stderr: -99> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2b090) adding con mode: crc 2024-09-14T11:31:00.552 INFO:tasks.workunit.client.0.smithi071.stderr: -98> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2b090) adding con mode: crc 2024-09-14T11:31:00.552 INFO:tasks.workunit.client.0.smithi071.stderr: -97> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2b090) adding con mode: secure 2024-09-14T11:31:00.552 INFO:tasks.workunit.client.0.smithi071.stderr: -96> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2b090) adding con mode: crc 2024-09-14T11:31:00.552 INFO:tasks.workunit.client.0.smithi071.stderr: -95> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2b090) adding con mode: secure 2024-09-14T11:31:00.552 INFO:tasks.workunit.client.0.smithi071.stderr: -94> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2b090) adding con mode: crc 2024-09-14T11:31:00.552 INFO:tasks.workunit.client.0.smithi071.stderr: -93> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2b090) adding con mode: secure 2024-09-14T11:31:00.552 INFO:tasks.workunit.client.0.smithi071.stderr: -92> 2024-09-14T11:31:00.455+0000 7fb862fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:00.552 INFO:tasks.workunit.client.0.smithi071.stderr: -91> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:00.552 INFO:tasks.workunit.client.0.smithi071.stderr: -90> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:00.552 INFO:tasks.workunit.client.0.smithi071.stderr: -89> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:00.552 INFO:tasks.workunit.client.0.smithi071.stderr: -88> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 asok(0x55e0f74aed90) register_command cache list hook 0x55e0f7782f80 2024-09-14T11:31:00.552 INFO:tasks.workunit.client.0.smithi071.stderr: -87> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 asok(0x55e0f74aed90) register_command cache inspect hook 0x55e0f7782f80 2024-09-14T11:31:00.552 INFO:tasks.workunit.client.0.smithi071.stderr: -86> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 asok(0x55e0f74aed90) register_command cache erase hook 0x55e0f7782f80 2024-09-14T11:31:00.552 INFO:tasks.workunit.client.0.smithi071.stderr: -85> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 asok(0x55e0f74aed90) register_command cache zap hook 0x55e0f7782f80 2024-09-14T11:31:00.552 INFO:tasks.workunit.client.0.smithi071.stderr: -84> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 note: GC not initialized 2024-09-14T11:31:00.553 INFO:tasks.workunit.client.0.smithi071.stderr: -83> 2024-09-14T11:31:00.455+0000 7fb861fe3640 20 reqs_thread_entry: start 2024-09-14T11:31:00.553 INFO:tasks.workunit.client.0.smithi071.stderr: -82> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 asok(0x55e0f74aed90) register_command sync trace show hook 0x7fb9a0001480 2024-09-14T11:31:00.553 INFO:tasks.workunit.client.0.smithi071.stderr: -81> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 asok(0x55e0f74aed90) register_command sync trace history hook 0x7fb9a0001480 2024-09-14T11:31:00.553 INFO:tasks.workunit.client.0.smithi071.stderr: -80> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 asok(0x55e0f74aed90) register_command sync trace active hook 0x7fb9a0001480 2024-09-14T11:31:00.553 INFO:tasks.workunit.client.0.smithi071.stderr: -79> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 asok(0x55e0f74aed90) register_command sync trace active_short hook 0x7fb9a0001480 2024-09-14T11:31:00.553 INFO:tasks.workunit.client.0.smithi071.stderr: -78> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 20 init_complete bucket index max shards: 11 2024-09-14T11:31:00.553 INFO:tasks.workunit.client.0.smithi071.stderr: -77> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 20 Filter name: none 2024-09-14T11:31:00.553 INFO:tasks.workunit.client.0.smithi071.stderr: -76> 2024-09-14T11:31:00.455+0000 7fb7d37fe640 20 reqs_thread_entry: start 2024-09-14T11:31:00.553 INFO:tasks.workunit.client.0.smithi071.stderr: -75> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:31:00.553 INFO:tasks.workunit.client.0.smithi071.stderr: -74> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.553 INFO:tasks.workunit.client.0.smithi071.stderr: -73> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:31:00.553 INFO:tasks.workunit.client.0.smithi071.stderr: -72> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:31:00.553 INFO:tasks.workunit.client.0.smithi071.stderr: -71> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:31:00.553 INFO:tasks.workunit.client.0.smithi071.stderr: -70> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 : miss 2024-09-14T11:31:00.554 INFO:tasks.workunit.client.0.smithi071.stderr: -69> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.554 INFO:tasks.workunit.client.0.smithi071.stderr: -68> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:31:00.554 INFO:tasks.workunit.client.0.smithi071.stderr: -67> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 info.flags=0x17 2024-09-14T11:31:00.554 INFO:tasks.workunit.client.0.smithi071.stderr: -66> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 to cache LRU end 2024-09-14T11:31:00.554 INFO:tasks.workunit.client.0.smithi071.stderr: -65> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:31:00.554 INFO:tasks.workunit.client.0.smithi071.stderr: -64> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:00.554 INFO:tasks.workunit.client.0.smithi071.stderr: -63> 2024-09-14T11:31:00.459+0000 7fb9aed079c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 2024-09-14T11:31:00.554 INFO:tasks.workunit.client.0.smithi071.stderr: -62> 2024-09-14T11:31:00.467+0000 7fb9aed079c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 info.flags=0x17 2024-09-14T11:31:00.554 INFO:tasks.workunit.client.0.smithi071.stderr: -61> 2024-09-14T11:31:00.467+0000 7fb9aed079c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 to cache LRU end 2024-09-14T11:31:00.554 INFO:tasks.workunit.client.0.smithi071.stderr: -60> 2024-09-14T11:31:00.467+0000 7fb9aed079c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:00.554 INFO:tasks.workunit.client.0.smithi071.stderr: -59> 2024-09-14T11:31:00.467+0000 7fb9aed079c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30, ofs0, ns] 2024-09-14T11:31:00.554 INFO:tasks.workunit.client.0.smithi071.stderr: -58> 2024-09-14T11:31:00.467+0000 7fb883fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464372 cookie 94424713093536 notifier 7035 bl.length()=999 2024-09-14T11:31:00.554 INFO:tasks.workunit.client.0.smithi071.stderr: -57> 2024-09-14T11:31:00.467+0000 7fb883fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 info.flags=0x17 2024-09-14T11:31:00.554 INFO:tasks.workunit.client.0.smithi071.stderr: -56> 2024-09-14T11:31:00.467+0000 7fb883fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 to cache LRU end 2024-09-14T11:31:00.554 INFO:tasks.workunit.client.0.smithi071.stderr: -55> 2024-09-14T11:31:00.467+0000 7fb883fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:00.555 INFO:tasks.workunit.client.0.smithi071.stderr: -54> 2024-09-14T11:31:00.467+0000 7fb9aed079c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.30]): orig_sources= new_sources= 2024-09-14T11:31:00.555 INFO:tasks.workunit.client.0.smithi071.stderr: -53> 2024-09-14T11:31:00.467+0000 7fb9aed079c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.30]): potential sources added=[] removed=[] 2024-09-14T11:31:00.555 INFO:tasks.workunit.client.0.smithi071.stderr: -52> 2024-09-14T11:31:00.467+0000 7fb9aed079c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.30]): orig_dests= new_dests= 2024-09-14T11:31:00.555 INFO:tasks.workunit.client.0.smithi071.stderr: -51> 2024-09-14T11:31:00.467+0000 7fb9aed079c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.30]): potential dests added=[] removed=[] 2024-09-14T11:31:00.555 INFO:tasks.workunit.client.0.smithi071.stderr: -50> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.0 2024-09-14T11:31:00.555 INFO:tasks.workunit.client.0.smithi071.stderr: -49> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.0 2024-09-14T11:31:00.555 INFO:tasks.workunit.client.0.smithi071.stderr: -48> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.1 2024-09-14T11:31:00.555 INFO:tasks.workunit.client.0.smithi071.stderr: -47> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.1 2024-09-14T11:31:00.555 INFO:tasks.workunit.client.0.smithi071.stderr: -46> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.2 2024-09-14T11:31:00.555 INFO:tasks.workunit.client.0.smithi071.stderr: -45> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.2 2024-09-14T11:31:00.555 INFO:tasks.workunit.client.0.smithi071.stderr: -44> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.3 2024-09-14T11:31:00.555 INFO:tasks.workunit.client.0.smithi071.stderr: -43> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.3 2024-09-14T11:31:00.555 INFO:tasks.workunit.client.0.smithi071.stderr: -42> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.4 2024-09-14T11:31:00.555 INFO:tasks.workunit.client.0.smithi071.stderr: -41> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.4 2024-09-14T11:31:00.555 INFO:tasks.workunit.client.0.smithi071.stderr: -40> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.5 2024-09-14T11:31:00.556 INFO:tasks.workunit.client.0.smithi071.stderr: -39> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.5 2024-09-14T11:31:00.556 INFO:tasks.workunit.client.0.smithi071.stderr: -38> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.6 2024-09-14T11:31:00.556 INFO:tasks.workunit.client.0.smithi071.stderr: -37> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.6 2024-09-14T11:31:00.556 INFO:tasks.workunit.client.0.smithi071.stderr: -36> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.7 2024-09-14T11:31:00.556 INFO:tasks.workunit.client.0.smithi071.stderr: -35> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.7 2024-09-14T11:31:00.556 INFO:tasks.workunit.client.0.smithi071.stderr: -34> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.8 2024-09-14T11:31:00.556 INFO:tasks.workunit.client.0.smithi071.stderr: -33> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.8 2024-09-14T11:31:00.556 INFO:tasks.workunit.client.0.smithi071.stderr: -32> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.9 2024-09-14T11:31:00.556 INFO:tasks.workunit.client.0.smithi071.stderr: -31> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.9 2024-09-14T11:31:00.556 INFO:tasks.workunit.client.0.smithi071.stderr: -30> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.10 2024-09-14T11:31:00.556 INFO:tasks.workunit.client.0.smithi071.stderr: -29> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.10 2024-09-14T11:31:00.556 INFO:tasks.workunit.client.0.smithi071.stderr: -28> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.11 2024-09-14T11:31:00.556 INFO:tasks.workunit.client.0.smithi071.stderr: -27> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.11 2024-09-14T11:31:00.556 INFO:tasks.workunit.client.0.smithi071.stderr: -26> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.0 2024-09-14T11:31:00.557 INFO:tasks.workunit.client.0.smithi071.stderr: -25> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1 2024-09-14T11:31:00.557 INFO:tasks.workunit.client.0.smithi071.stderr: -24> 2024-09-14T11:31:00.479+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.2 2024-09-14T11:31:00.557 INFO:tasks.workunit.client.0.smithi071.stderr: -23> 2024-09-14T11:31:00.479+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.3 2024-09-14T11:31:00.557 INFO:tasks.workunit.client.0.smithi071.stderr: -22> 2024-09-14T11:31:00.479+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.4 2024-09-14T11:31:00.557 INFO:tasks.workunit.client.0.smithi071.stderr: -21> 2024-09-14T11:31:00.479+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.5 2024-09-14T11:31:00.557 INFO:tasks.workunit.client.0.smithi071.stderr: -20> 2024-09-14T11:31:00.479+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.6 2024-09-14T11:31:00.557 INFO:tasks.workunit.client.0.smithi071.stderr: -19> 2024-09-14T11:31:00.483+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.7 2024-09-14T11:31:00.557 INFO:tasks.workunit.client.0.smithi071.stderr: -18> 2024-09-14T11:31:00.483+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.8 2024-09-14T11:31:00.557 INFO:tasks.workunit.client.0.smithi071.stderr: -17> 2024-09-14T11:31:00.483+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.9 2024-09-14T11:31:00.557 INFO:tasks.workunit.client.0.smithi071.stderr: -16> 2024-09-14T11:31:00.483+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.10 2024-09-14T11:31:00.557 INFO:tasks.workunit.client.0.smithi071.stderr: -15> 2024-09-14T11:31:00.491+0000 7fb9aed079c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:00.557 INFO:tasks.workunit.client.0.smithi071.stderr: -14> 2024-09-14T11:31:00.491+0000 7fb9aed079c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 2024-09-14T11:31:00.557 INFO:tasks.workunit.client.0.smithi071.stderr: -13> 2024-09-14T11:31:00.495+0000 7fb9aed079c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 info.flags=0x17 2024-09-14T11:31:00.557 INFO:tasks.workunit.client.0.smithi071.stderr: -12> 2024-09-14T11:31:00.495+0000 7fb9aed079c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 to cache LRU end 2024-09-14T11:31:00.558 INFO:tasks.workunit.client.0.smithi071.stderr: -11> 2024-09-14T11:31:00.495+0000 7fb9aed079c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:00.558 INFO:tasks.workunit.client.0.smithi071.stderr: -10> 2024-09-14T11:31:00.495+0000 7fb9aed079c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30, ofs0, ns] 2024-09-14T11:31:00.558 INFO:tasks.workunit.client.0.smithi071.stderr: -9> 2024-09-14T11:31:00.495+0000 7fb8837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464373 cookie 94424713093536 notifier 7035 bl.length()=999 2024-09-14T11:31:00.558 INFO:tasks.workunit.client.0.smithi071.stderr: -8> 2024-09-14T11:31:00.495+0000 7fb8837fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 info.flags=0x17 2024-09-14T11:31:00.558 INFO:tasks.workunit.client.0.smithi071.stderr: -7> 2024-09-14T11:31:00.495+0000 7fb8837fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 to cache LRU end 2024-09-14T11:31:00.558 INFO:tasks.workunit.client.0.smithi071.stderr: -6> 2024-09-14T11:31:00.495+0000 7fb8837fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:00.558 INFO:tasks.workunit.client.0.smithi071.stderr: -5> 2024-09-14T11:31:00.495+0000 7fb9aed079c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.30]): orig_sources= new_sources= 2024-09-14T11:31:00.558 INFO:tasks.workunit.client.0.smithi071.stderr: -4> 2024-09-14T11:31:00.495+0000 7fb9aed079c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.30]): potential sources added=[] removed=[] 2024-09-14T11:31:00.558 INFO:tasks.workunit.client.0.smithi071.stderr: -3> 2024-09-14T11:31:00.495+0000 7fb9aed079c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.30]): orig_dests= new_dests= 2024-09-14T11:31:00.558 INFO:tasks.workunit.client.0.smithi071.stderr: -2> 2024-09-14T11:31:00.495+0000 7fb9aed079c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.30]): potential dests added=[] removed=[] 2024-09-14T11:31:00.558 INFO:tasks.workunit.client.0.smithi071.stderr: -1> 2024-09-14T11:31:00.495+0000 7fb9aed079c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb9aed079c0 time 2024-09-14T11:31:00.499531+0000 2024-09-14T11:31:00.558 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:31:00.558 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.558 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:00.559 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fb9b25e12eb] 2024-09-14T11:31:00.559 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb9b25e149f] 2024-09-14T11:31:00.559 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e0f4752c01] 2024-09-14T11:31:00.559 INFO:tasks.workunit.client.0.smithi071.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55e0f476729b] 2024-09-14T11:31:00.559 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55e0f4768884] 2024-09-14T11:31:00.559 INFO:tasks.workunit.client.0.smithi071.stderr: 6: main() 2024-09-14T11:31:00.559 INFO:tasks.workunit.client.0.smithi071.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb9b1447d90] 2024-09-14T11:31:00.559 INFO:tasks.workunit.client.0.smithi071.stderr: 8: __libc_start_main() 2024-09-14T11:31:00.559 INFO:tasks.workunit.client.0.smithi071.stderr: 9: _start() 2024-09-14T11:31:00.559 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.559 INFO:tasks.workunit.client.0.smithi071.stderr: 0> 2024-09-14T11:31:00.495+0000 7fb9aed079c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:31:00.559 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7fb9aed079c0 thread_name:radosgw-admin 2024-09-14T11:31:00.559 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.559 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:00.559 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fb9b1460520] 2024-09-14T11:31:00.559 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:31:00.560 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:31:00.560 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:31:00.560 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fb9b25e1345] 2024-09-14T11:31:00.560 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb9b25e149f] 2024-09-14T11:31:00.560 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e0f4752c01] 2024-09-14T11:31:00.560 INFO:tasks.workunit.client.0.smithi071.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55e0f476729b] 2024-09-14T11:31:00.560 INFO:tasks.workunit.client.0.smithi071.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55e0f4768884] 2024-09-14T11:31:00.560 INFO:tasks.workunit.client.0.smithi071.stderr: 10: main() 2024-09-14T11:31:00.560 INFO:tasks.workunit.client.0.smithi071.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb9b1447d90] 2024-09-14T11:31:00.560 INFO:tasks.workunit.client.0.smithi071.stderr: 12: __libc_start_main() 2024-09-14T11:31:00.560 INFO:tasks.workunit.client.0.smithi071.stderr: 13: _start() 2024-09-14T11:31:00.560 INFO:tasks.workunit.client.0.smithi071.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:31:00.560 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.560 INFO:tasks.workunit.client.0.smithi071.stderr:--- logging levels --- 2024-09-14T11:31:00.561 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 none 2024-09-14T11:31:00.561 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 lockdep 2024-09-14T11:31:00.561 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 context 2024-09-14T11:31:00.561 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 crush 2024-09-14T11:31:00.561 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds 2024-09-14T11:31:00.561 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_balancer 2024-09-14T11:31:00.561 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_locker 2024-09-14T11:31:00.561 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log 2024-09-14T11:31:00.561 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log_expire 2024-09-14T11:31:00.561 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_migrator 2024-09-14T11:31:00.561 INFO:tasks.workunit.client.0.smithi071.stderr: 3/ 5 mds_quiesce 2024-09-14T11:31:00.561 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 buffer 2024-09-14T11:31:00.561 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 timer 2024-09-14T11:31:00.561 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 filer 2024-09-14T11:31:00.561 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 striper 2024-09-14T11:31:00.562 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 objecter 2024-09-14T11:31:00.562 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rados 2024-09-14T11:31:00.562 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd 2024-09-14T11:31:00.562 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_mirror 2024-09-14T11:31:00.562 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_replay 2024-09-14T11:31:00.562 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_pwl 2024-09-14T11:31:00.562 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 journaler 2024-09-14T11:31:00.562 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objectcacher 2024-09-14T11:31:00.562 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:31:00.562 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 client 2024-09-14T11:31:00.562 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 osd 2024-09-14T11:31:00.562 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 optracker 2024-09-14T11:31:00.562 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objclass 2024-09-14T11:31:00.562 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 filestore 2024-09-14T11:31:00.562 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 journal 2024-09-14T11:31:00.563 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 ms 2024-09-14T11:31:00.563 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mon 2024-09-14T11:31:00.563 INFO:tasks.workunit.client.0.smithi071.stderr: 0/10 monc 2024-09-14T11:31:00.563 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 paxos 2024-09-14T11:31:00.563 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 tp 2024-09-14T11:31:00.563 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 auth 2024-09-14T11:31:00.563 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 crypto 2024-09-14T11:31:00.563 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 finisher 2024-09-14T11:31:00.563 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 reserver 2024-09-14T11:31:00.563 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 heartbeatmap 2024-09-14T11:31:00.563 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 perfcounter 2024-09-14T11:31:00.563 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw 2024-09-14T11:31:00.563 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_sync 2024-09-14T11:31:00.563 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_datacache 2024-09-14T11:31:00.563 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_access 2024-09-14T11:31:00.564 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:31:00.564 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_flight 2024-09-14T11:31:00.564 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:31:00.564 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw_notification 2024-09-14T11:31:00.564 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 javaclient 2024-09-14T11:31:00.564 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 asok 2024-09-14T11:31:00.564 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 throttle 2024-09-14T11:31:00.564 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 refs 2024-09-14T11:31:00.564 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 compressor 2024-09-14T11:31:00.564 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluestore 2024-09-14T11:31:00.564 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluefs 2024-09-14T11:31:00.564 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 bdev 2024-09-14T11:31:00.564 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 kstore 2024-09-14T11:31:00.564 INFO:tasks.workunit.client.0.smithi071.stderr: 4/ 5 rocksdb 2024-09-14T11:31:00.564 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 fuse 2024-09-14T11:31:00.565 INFO:tasks.workunit.client.0.smithi071.stderr: 2/ 5 mgr 2024-09-14T11:31:00.565 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mgrc 2024-09-14T11:31:00.565 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 dpdk 2024-09-14T11:31:00.565 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 eventtrace 2024-09-14T11:31:00.565 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 prioritycache 2024-09-14T11:31:00.565 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 test 2024-09-14T11:31:00.565 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:31:00.565 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephsqlite 2024-09-14T11:31:00.565 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:31:00.565 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore 2024-09-14T11:31:00.565 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_onode 2024-09-14T11:31:00.565 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_odata 2024-09-14T11:31:00.565 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_omap 2024-09-14T11:31:00.565 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_tm 2024-09-14T11:31:00.566 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_t 2024-09-14T11:31:00.566 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:31:00.566 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_epm 2024-09-14T11:31:00.566 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_lba 2024-09-14T11:31:00.566 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:31:00.566 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cache 2024-09-14T11:31:00.566 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_journal 2024-09-14T11:31:00.566 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_device 2024-09-14T11:31:00.566 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_backref 2024-09-14T11:31:00.566 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 alienstore 2024-09-14T11:31:00.566 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mclock 2024-09-14T11:31:00.566 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cyanstore 2024-09-14T11:31:00.566 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 ceph_exporter 2024-09-14T11:31:00.566 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 memstore 2024-09-14T11:31:00.566 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 trace 2024-09-14T11:31:00.567 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 ceph_dedup 2024-09-14T11:31:00.567 INFO:tasks.workunit.client.0.smithi071.stderr: -2/-2 (syslog threshold) 2024-09-14T11:31:00.567 INFO:tasks.workunit.client.0.smithi071.stderr: 99/99 (stderr threshold) 2024-09-14T11:31:00.567 INFO:tasks.workunit.client.0.smithi071.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:31:00.567 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb7d37fe640 / http_manager 2024-09-14T11:31:00.567 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb861fe3640 / http_manager 2024-09-14T11:31:00.567 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb862fe5640 / rgw_dt_lg_renew 2024-09-14T11:31:00.567 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb8827fc640 / ms_dispatch 2024-09-14T11:31:00.567 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb8837fe640 / io_context_pool 2024-09-14T11:31:00.567 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb883fff640 / io_context_pool 2024-09-14T11:31:00.567 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb8927fc640 / ms_dispatch 2024-09-14T11:31:00.567 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb89960a640 / ms_dispatch 2024-09-14T11:31:00.567 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb89ae0d640 / io_context_pool 2024-09-14T11:31:00.567 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb9ac00c640 / msgr-worker-2 2024-09-14T11:31:00.567 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb9ac80d640 / msgr-worker-1 2024-09-14T11:31:00.568 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb9ad00e640 / msgr-worker-0 2024-09-14T11:31:00.568 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb9ad80f640 / io_context_pool 2024-09-14T11:31:00.568 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb9aed079c0 / radosgw-admin 2024-09-14T11:31:00.568 INFO:tasks.workunit.client.0.smithi071.stderr: max_recent 500 2024-09-14T11:31:00.568 INFO:tasks.workunit.client.0.smithi071.stderr: max_new 1000 2024-09-14T11:31:00.568 INFO:tasks.workunit.client.0.smithi071.stderr: log_file /var/log/ceph/ceph-client.admin.104935.log 2024-09-14T11:31:00.568 INFO:tasks.workunit.client.0.smithi071.stderr:--- end dump of recent events --- 2024-09-14T11:31:00.568 INFO:tasks.workunit.client.0.smithi071.stderr:--- begin dump of recent events --- 2024-09-14T11:31:00.568 INFO:tasks.workunit.client.0.smithi071.stderr: -499> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f76ba070) adding con mode: crc 2024-09-14T11:31:00.568 INFO:tasks.workunit.client.0.smithi071.stderr: -498> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f76ba070) adding con mode: secure 2024-09-14T11:31:00.568 INFO:tasks.workunit.client.0.smithi071.stderr: -497> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f76ba070) adding con mode: crc 2024-09-14T11:31:00.568 INFO:tasks.workunit.client.0.smithi071.stderr: -496> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f76ba070) adding con mode: secure 2024-09-14T11:31:00.568 INFO:tasks.workunit.client.0.smithi071.stderr: -495> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f76ba070) adding con mode: crc 2024-09-14T11:31:00.569 INFO:tasks.workunit.client.0.smithi071.stderr: -494> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f76ba070) adding con mode: crc 2024-09-14T11:31:00.569 INFO:tasks.workunit.client.0.smithi071.stderr: -493> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f76ba070) adding con mode: secure 2024-09-14T11:31:00.569 INFO:tasks.workunit.client.0.smithi071.stderr: -492> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f76ba070) adding con mode: crc 2024-09-14T11:31:00.569 INFO:tasks.workunit.client.0.smithi071.stderr: -491> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f76ba070) adding con mode: secure 2024-09-14T11:31:00.569 INFO:tasks.workunit.client.0.smithi071.stderr: -490> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f76ba070) adding con mode: crc 2024-09-14T11:31:00.569 INFO:tasks.workunit.client.0.smithi071.stderr: -489> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f76ba070) adding con mode: secure 2024-09-14T11:31:00.569 INFO:tasks.workunit.client.0.smithi071.stderr: -488> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:00.569 INFO:tasks.workunit.client.0.smithi071.stderr: -487> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:00.569 INFO:tasks.workunit.client.0.smithi071.stderr: -486> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 5 asok(0x55e0f74aed90) register_command rotate-key hook 0x55e0f76ba1b8 2024-09-14T11:31:00.569 INFO:tasks.workunit.client.0.smithi071.stderr: -485> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 10 monclient: _reopen_session rank -1 2024-09-14T11:31:00.569 INFO:tasks.workunit.client.0.smithi071.stderr: -484> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:31:00.569 INFO:tasks.workunit.client.0.smithi071.stderr: -483> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 10 monclient(hunting): picked mon.noname-a con 0x55e0f7573370 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:31:00.569 INFO:tasks.workunit.client.0.smithi071.stderr: -482> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 10 monclient(hunting): picked mon.noname-c con 0x55e0f7602d00 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:31:00.569 INFO:tasks.workunit.client.0.smithi071.stderr: -481> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 10 monclient(hunting): picked mon.noname-b con 0x55e0f76bcf10 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:31:00.569 INFO:tasks.workunit.client.0.smithi071.stderr: -480> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:00.569 INFO:tasks.workunit.client.0.smithi071.stderr: -479> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:00.570 INFO:tasks.workunit.client.0.smithi071.stderr: -478> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:00.570 INFO:tasks.workunit.client.0.smithi071.stderr: -477> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 10 monclient(hunting): _renew_subs 2024-09-14T11:31:00.570 INFO:tasks.workunit.client.0.smithi071.stderr: -476> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 10 monclient(hunting): authenticate will time out at 2272.285481s 2024-09-14T11:31:00.570 INFO:tasks.workunit.client.0.smithi071.stderr: -475> 2024-09-14T11:31:00.163+0000 7fb9ac00c640 10 monclient(hunting): get_auth_request con 0x55e0f7602d00 auth_method 0 2024-09-14T11:31:00.570 INFO:tasks.workunit.client.0.smithi071.stderr: -474> 2024-09-14T11:31:00.163+0000 7fb9ac00c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:00.570 INFO:tasks.workunit.client.0.smithi071.stderr: -473> 2024-09-14T11:31:00.163+0000 7fb9ac00c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:00.570 INFO:tasks.workunit.client.0.smithi071.stderr: -472> 2024-09-14T11:31:00.163+0000 7fb9ac00c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:00.570 INFO:tasks.workunit.client.0.smithi071.stderr: -471> 2024-09-14T11:31:00.163+0000 7fb9ac80d640 10 monclient(hunting): get_auth_request con 0x55e0f7573370 auth_method 0 2024-09-14T11:31:00.570 INFO:tasks.workunit.client.0.smithi071.stderr: -470> 2024-09-14T11:31:00.163+0000 7fb9ac80d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:00.570 INFO:tasks.workunit.client.0.smithi071.stderr: -469> 2024-09-14T11:31:00.163+0000 7fb9ac80d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:00.570 INFO:tasks.workunit.client.0.smithi071.stderr: -468> 2024-09-14T11:31:00.163+0000 7fb9ac80d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:00.570 INFO:tasks.workunit.client.0.smithi071.stderr: -467> 2024-09-14T11:31:00.163+0000 7fb9ac80d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:00.570 INFO:tasks.workunit.client.0.smithi071.stderr: -466> 2024-09-14T11:31:00.163+0000 7fb9ac80d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:00.570 INFO:tasks.workunit.client.0.smithi071.stderr: -465> 2024-09-14T11:31:00.163+0000 7fb9ac80d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:00.570 INFO:tasks.workunit.client.0.smithi071.stderr: -464> 2024-09-14T11:31:00.163+0000 7fb9ac00c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:00.571 INFO:tasks.workunit.client.0.smithi071.stderr: -463> 2024-09-14T11:31:00.163+0000 7fb9ac00c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:00.571 INFO:tasks.workunit.client.0.smithi071.stderr: -462> 2024-09-14T11:31:00.163+0000 7fb9ac00c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:00.571 INFO:tasks.workunit.client.0.smithi071.stderr: -461> 2024-09-14T11:31:00.163+0000 7fb9ac80d640 10 monclient(hunting): handle_auth_done global_id 7026 payload 824 2024-09-14T11:31:00.571 INFO:tasks.workunit.client.0.smithi071.stderr: -460> 2024-09-14T11:31:00.163+0000 7fb9ac80d640 10 monclient: _finish_hunting 0 2024-09-14T11:31:00.571 INFO:tasks.workunit.client.0.smithi071.stderr: -459> 2024-09-14T11:31:00.163+0000 7fb9ac80d640 1 monclient: found mon.noname-a 2024-09-14T11:31:00.571 INFO:tasks.workunit.client.0.smithi071.stderr: -458> 2024-09-14T11:31:00.163+0000 7fb9ac80d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:31:00.571 INFO:tasks.workunit.client.0.smithi071.stderr: -457> 2024-09-14T11:31:00.163+0000 7fb89960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:00.571 INFO:tasks.workunit.client.0.smithi071.stderr: -456> 2024-09-14T11:31:00.163+0000 7fb89960a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:31:00.571 INFO:tasks.workunit.client.0.smithi071.stderr: -455> 2024-09-14T11:31:00.163+0000 7fb89960a640 10 monclient: dump: 2024-09-14T11:31:00.571 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:31:00.571 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:31:00.571 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:00.571 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:00.571 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:00.572 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:00.572 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:31:00.572 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:31:00.572 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:31:00.572 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.572 INFO:tasks.workunit.client.0.smithi071.stderr: -454> 2024-09-14T11:31:00.163+0000 7fb89960a640 10 monclient: _finish_auth 0 2024-09-14T11:31:00.572 INFO:tasks.workunit.client.0.smithi071.stderr: -453> 2024-09-14T11:31:00.163+0000 7fb89960a640 10 monclient: _check_auth_tickets 2024-09-14T11:31:00.572 INFO:tasks.workunit.client.0.smithi071.stderr: -452> 2024-09-14T11:31:00.163+0000 7fb89960a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:00.572 INFO:tasks.workunit.client.0.smithi071.stderr: -451> 2024-09-14T11:31:00.163+0000 7fb89960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:00.572 INFO:tasks.workunit.client.0.smithi071.stderr: -450> 2024-09-14T11:31:00.163+0000 7fb89960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:31:00.572 INFO:tasks.workunit.client.0.smithi071.stderr: -449> 2024-09-14T11:31:00.163+0000 7fb89960a640 10 monclient: dump: 2024-09-14T11:31:00.572 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:31:00.573 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:31:00.573 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:00.573 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:00.573 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:00.573 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:00.573 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:31:00.573 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:31:00.573 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:31:00.573 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.573 INFO:tasks.workunit.client.0.smithi071.stderr: -448> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 5 monclient: authenticate success, global_id 7026 2024-09-14T11:31:00.573 INFO:tasks.workunit.client.0.smithi071.stderr: -447> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 10 monclient: _renew_subs 2024-09-14T11:31:00.573 INFO:tasks.workunit.client.0.smithi071.stderr: -446> 2024-09-14T11:31:00.163+0000 7fb89ae0d640 4 set_mon_vals no callback set 2024-09-14T11:31:00.573 INFO:tasks.workunit.client.0.smithi071.stderr: -445> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:31:00.573 INFO:tasks.workunit.client.0.smithi071.stderr: -444> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 10 monclient: _renew_subs 2024-09-14T11:31:00.574 INFO:tasks.workunit.client.0.smithi071.stderr: -443> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:31:00.574 INFO:tasks.workunit.client.0.smithi071.stderr: -442> 2024-09-14T11:31:00.163+0000 7fb9aed079c0 1 librados: init done 2024-09-14T11:31:00.574 INFO:tasks.workunit.client.0.smithi071.stderr: -441> 2024-09-14T11:31:00.167+0000 7fb89960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:31:00.574 INFO:tasks.workunit.client.0.smithi071.stderr: -440> 2024-09-14T11:31:00.167+0000 7fb89960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:31:00.574 INFO:tasks.workunit.client.0.smithi071.stderr: -439> 2024-09-14T11:31:00.167+0000 7fb89960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:31:00.574 INFO:tasks.workunit.client.0.smithi071.stderr: -438> 2024-09-14T11:31:00.167+0000 7fb9ac00c640 10 monclient: get_auth_request con 0x7fb8940718a0 auth_method 0 2024-09-14T11:31:00.574 INFO:tasks.workunit.client.0.smithi071.stderr: -437> 2024-09-14T11:31:00.167+0000 7fb9ad00e640 10 monclient: get_auth_request con 0x55e0f76e2110 auth_method 0 2024-09-14T11:31:00.574 INFO:tasks.workunit.client.0.smithi071.stderr: -436> 2024-09-14T11:31:00.167+0000 7fb9ac80d640 10 monclient: get_auth_request con 0x55e0f7704f10 auth_method 0 2024-09-14T11:31:00.574 INFO:tasks.workunit.client.0.smithi071.stderr: -435> 2024-09-14T11:31:00.167+0000 7fb9ac00c640 10 monclient: get_auth_request con 0x55e0f7709100 auth_method 0 2024-09-14T11:31:00.574 INFO:tasks.workunit.client.0.smithi071.stderr: -434> 2024-09-14T11:31:00.171+0000 7fb9ad00e640 10 monclient: get_auth_request con 0x55e0f77087c0 auth_method 0 2024-09-14T11:31:00.574 INFO:tasks.workunit.client.0.smithi071.stderr: -433> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 10 monclient: build_initial_monmap 2024-09-14T11:31:00.574 INFO:tasks.workunit.client.0.smithi071.stderr: -432> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 1 build_initial for_mkfs: 0 2024-09-14T11:31:00.574 INFO:tasks.workunit.client.0.smithi071.stderr: -431> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 10 monclient: monmap: 2024-09-14T11:31:00.574 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:31:00.575 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:31:00.575 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:31:00.575 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:31:00.575 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:31:00.575 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:00.575 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:31:00.575 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:31:00.575 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:31:00.575 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.575 INFO:tasks.workunit.client.0.smithi071.stderr: -430> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77112e0) adding auth protocol: cephx 2024-09-14T11:31:00.575 INFO:tasks.workunit.client.0.smithi071.stderr: -429> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77112e0) adding auth protocol: cephx 2024-09-14T11:31:00.575 INFO:tasks.workunit.client.0.smithi071.stderr: -428> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77112e0) adding auth protocol: cephx 2024-09-14T11:31:00.575 INFO:tasks.workunit.client.0.smithi071.stderr: -427> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77112e0) adding con mode: secure 2024-09-14T11:31:00.575 INFO:tasks.workunit.client.0.smithi071.stderr: -426> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77112e0) adding con mode: crc 2024-09-14T11:31:00.576 INFO:tasks.workunit.client.0.smithi071.stderr: -425> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77112e0) adding con mode: secure 2024-09-14T11:31:00.576 INFO:tasks.workunit.client.0.smithi071.stderr: -424> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77112e0) adding con mode: crc 2024-09-14T11:31:00.576 INFO:tasks.workunit.client.0.smithi071.stderr: -423> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77112e0) adding con mode: secure 2024-09-14T11:31:00.576 INFO:tasks.workunit.client.0.smithi071.stderr: -422> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77112e0) adding con mode: crc 2024-09-14T11:31:00.576 INFO:tasks.workunit.client.0.smithi071.stderr: -421> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77112e0) adding con mode: crc 2024-09-14T11:31:00.576 INFO:tasks.workunit.client.0.smithi071.stderr: -420> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77112e0) adding con mode: secure 2024-09-14T11:31:00.576 INFO:tasks.workunit.client.0.smithi071.stderr: -419> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77112e0) adding con mode: crc 2024-09-14T11:31:00.576 INFO:tasks.workunit.client.0.smithi071.stderr: -418> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77112e0) adding con mode: secure 2024-09-14T11:31:00.576 INFO:tasks.workunit.client.0.smithi071.stderr: -417> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77112e0) adding con mode: crc 2024-09-14T11:31:00.576 INFO:tasks.workunit.client.0.smithi071.stderr: -416> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77112e0) adding con mode: secure 2024-09-14T11:31:00.576 INFO:tasks.workunit.client.0.smithi071.stderr: -415> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:00.576 INFO:tasks.workunit.client.0.smithi071.stderr: -414> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 asok(0x55e0f74aed90) register_command objecter_requests cmddesc objecter_requests hook 0x55e0f7714c70 EEXIST 2024-09-14T11:31:00.576 INFO:tasks.workunit.client.0.smithi071.stderr: -413> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 10 monclient: init 2024-09-14T11:31:00.576 INFO:tasks.workunit.client.0.smithi071.stderr: -412> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77101d8) adding auth protocol: cephx 2024-09-14T11:31:00.577 INFO:tasks.workunit.client.0.smithi071.stderr: -411> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77101d8) adding auth protocol: cephx 2024-09-14T11:31:00.577 INFO:tasks.workunit.client.0.smithi071.stderr: -410> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77101d8) adding auth protocol: cephx 2024-09-14T11:31:00.577 INFO:tasks.workunit.client.0.smithi071.stderr: -409> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77101d8) adding con mode: secure 2024-09-14T11:31:00.577 INFO:tasks.workunit.client.0.smithi071.stderr: -408> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77101d8) adding con mode: crc 2024-09-14T11:31:00.577 INFO:tasks.workunit.client.0.smithi071.stderr: -407> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77101d8) adding con mode: secure 2024-09-14T11:31:00.577 INFO:tasks.workunit.client.0.smithi071.stderr: -406> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77101d8) adding con mode: crc 2024-09-14T11:31:00.577 INFO:tasks.workunit.client.0.smithi071.stderr: -405> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77101d8) adding con mode: secure 2024-09-14T11:31:00.577 INFO:tasks.workunit.client.0.smithi071.stderr: -404> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77101d8) adding con mode: crc 2024-09-14T11:31:00.577 INFO:tasks.workunit.client.0.smithi071.stderr: -403> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77101d8) adding con mode: crc 2024-09-14T11:31:00.577 INFO:tasks.workunit.client.0.smithi071.stderr: -402> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77101d8) adding con mode: secure 2024-09-14T11:31:00.577 INFO:tasks.workunit.client.0.smithi071.stderr: -401> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77101d8) adding con mode: crc 2024-09-14T11:31:00.577 INFO:tasks.workunit.client.0.smithi071.stderr: -400> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77101d8) adding con mode: secure 2024-09-14T11:31:00.577 INFO:tasks.workunit.client.0.smithi071.stderr: -399> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77101d8) adding con mode: crc 2024-09-14T11:31:00.577 INFO:tasks.workunit.client.0.smithi071.stderr: -398> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f77101d8) adding con mode: secure 2024-09-14T11:31:00.578 INFO:tasks.workunit.client.0.smithi071.stderr: -397> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:00.578 INFO:tasks.workunit.client.0.smithi071.stderr: -396> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:00.578 INFO:tasks.workunit.client.0.smithi071.stderr: -395> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 5 asok(0x55e0f74aed90) register_command rotate-key cmddesc rotate-key hook 0x55e0f7710320 EEXIST 2024-09-14T11:31:00.578 INFO:tasks.workunit.client.0.smithi071.stderr: -394> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 10 monclient: _reopen_session rank -1 2024-09-14T11:31:00.578 INFO:tasks.workunit.client.0.smithi071.stderr: -393> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:31:00.578 INFO:tasks.workunit.client.0.smithi071.stderr: -392> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 10 monclient(hunting): picked mon.noname-c con 0x55e0f7738e20 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:31:00.578 INFO:tasks.workunit.client.0.smithi071.stderr: -391> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 10 monclient(hunting): picked mon.noname-b con 0x55e0f7738750 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:31:00.578 INFO:tasks.workunit.client.0.smithi071.stderr: -390> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 10 monclient(hunting): picked mon.noname-a con 0x55e0f7737130 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:31:00.578 INFO:tasks.workunit.client.0.smithi071.stderr: -389> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:00.578 INFO:tasks.workunit.client.0.smithi071.stderr: -388> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:00.578 INFO:tasks.workunit.client.0.smithi071.stderr: -387> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:00.578 INFO:tasks.workunit.client.0.smithi071.stderr: -386> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 10 monclient(hunting): _renew_subs 2024-09-14T11:31:00.578 INFO:tasks.workunit.client.0.smithi071.stderr: -385> 2024-09-14T11:31:00.171+0000 7fb9aed079c0 10 monclient(hunting): authenticate will time out at 2272.295388s 2024-09-14T11:31:00.579 INFO:tasks.workunit.client.0.smithi071.stderr: -384> 2024-09-14T11:31:00.171+0000 7fb9ac00c640 10 monclient(hunting): get_auth_request con 0x55e0f7738e20 auth_method 0 2024-09-14T11:31:00.579 INFO:tasks.workunit.client.0.smithi071.stderr: -383> 2024-09-14T11:31:00.171+0000 7fb9ac00c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:00.579 INFO:tasks.workunit.client.0.smithi071.stderr: -382> 2024-09-14T11:31:00.171+0000 7fb9ac00c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:00.579 INFO:tasks.workunit.client.0.smithi071.stderr: -381> 2024-09-14T11:31:00.171+0000 7fb9ac00c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:00.579 INFO:tasks.workunit.client.0.smithi071.stderr: -380> 2024-09-14T11:31:00.171+0000 7fb9ac80d640 10 monclient(hunting): get_auth_request con 0x55e0f7737130 auth_method 0 2024-09-14T11:31:00.579 INFO:tasks.workunit.client.0.smithi071.stderr: -379> 2024-09-14T11:31:00.171+0000 7fb9ac80d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:00.579 INFO:tasks.workunit.client.0.smithi071.stderr: -378> 2024-09-14T11:31:00.171+0000 7fb9ac80d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:00.579 INFO:tasks.workunit.client.0.smithi071.stderr: -377> 2024-09-14T11:31:00.171+0000 7fb9ac80d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:00.579 INFO:tasks.workunit.client.0.smithi071.stderr: -376> 2024-09-14T11:31:00.171+0000 7fb9ac80d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:00.579 INFO:tasks.workunit.client.0.smithi071.stderr: -375> 2024-09-14T11:31:00.171+0000 7fb9ac80d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:00.579 INFO:tasks.workunit.client.0.smithi071.stderr: -374> 2024-09-14T11:31:00.171+0000 7fb9ac80d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:00.579 INFO:tasks.workunit.client.0.smithi071.stderr: -373> 2024-09-14T11:31:00.171+0000 7fb9ac00c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:00.579 INFO:tasks.workunit.client.0.smithi071.stderr: -372> 2024-09-14T11:31:00.171+0000 7fb9ac00c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:00.579 INFO:tasks.workunit.client.0.smithi071.stderr: -371> 2024-09-14T11:31:00.171+0000 7fb9ac00c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:00.579 INFO:tasks.workunit.client.0.smithi071.stderr: -370> 2024-09-14T11:31:00.171+0000 7fb9ad00e640 10 monclient(hunting): get_auth_request con 0x55e0f7738750 auth_method 0 2024-09-14T11:31:00.580 INFO:tasks.workunit.client.0.smithi071.stderr: -369> 2024-09-14T11:31:00.171+0000 7fb9ad00e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:00.580 INFO:tasks.workunit.client.0.smithi071.stderr: -368> 2024-09-14T11:31:00.171+0000 7fb9ad00e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:00.580 INFO:tasks.workunit.client.0.smithi071.stderr: -367> 2024-09-14T11:31:00.171+0000 7fb9ad00e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:00.580 INFO:tasks.workunit.client.0.smithi071.stderr: -366> 2024-09-14T11:31:00.171+0000 7fb9ac00c640 10 monclient(hunting): handle_auth_done global_id 6689 payload 824 2024-09-14T11:31:00.580 INFO:tasks.workunit.client.0.smithi071.stderr: -365> 2024-09-14T11:31:00.171+0000 7fb9ac00c640 10 monclient: _finish_hunting 0 2024-09-14T11:31:00.580 INFO:tasks.workunit.client.0.smithi071.stderr: -364> 2024-09-14T11:31:00.171+0000 7fb9ac00c640 1 monclient: found mon.noname-c 2024-09-14T11:31:00.580 INFO:tasks.workunit.client.0.smithi071.stderr: -363> 2024-09-14T11:31:00.171+0000 7fb9ac00c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:31:00.580 INFO:tasks.workunit.client.0.smithi071.stderr: -362> 2024-09-14T11:31:00.175+0000 7fb8927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:00.580 INFO:tasks.workunit.client.0.smithi071.stderr: -361> 2024-09-14T11:31:00.175+0000 7fb8927fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:31:00.580 INFO:tasks.workunit.client.0.smithi071.stderr: -360> 2024-09-14T11:31:00.175+0000 7fb8927fc640 10 monclient: dump: 2024-09-14T11:31:00.580 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:31:00.580 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:31:00.580 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:00.580 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:00.580 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:00.581 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:00.581 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:31:00.581 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:31:00.581 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:31:00.581 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.581 INFO:tasks.workunit.client.0.smithi071.stderr: -359> 2024-09-14T11:31:00.175+0000 7fb8927fc640 10 monclient: _finish_auth 0 2024-09-14T11:31:00.581 INFO:tasks.workunit.client.0.smithi071.stderr: -358> 2024-09-14T11:31:00.175+0000 7fb8927fc640 10 monclient: _check_auth_tickets 2024-09-14T11:31:00.581 INFO:tasks.workunit.client.0.smithi071.stderr: -357> 2024-09-14T11:31:00.175+0000 7fb8927fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:00.581 INFO:tasks.workunit.client.0.smithi071.stderr: -356> 2024-09-14T11:31:00.175+0000 7fb8927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:00.581 INFO:tasks.workunit.client.0.smithi071.stderr: -355> 2024-09-14T11:31:00.175+0000 7fb8927fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:31:00.581 INFO:tasks.workunit.client.0.smithi071.stderr: -354> 2024-09-14T11:31:00.175+0000 7fb8927fc640 10 monclient: dump: 2024-09-14T11:31:00.581 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:31:00.581 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:31:00.581 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:00.582 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:00.582 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:00.582 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:00.582 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:31:00.582 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:31:00.582 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:31:00.582 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.582 INFO:tasks.workunit.client.0.smithi071.stderr: -353> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 monclient: authenticate success, global_id 6689 2024-09-14T11:31:00.582 INFO:tasks.workunit.client.0.smithi071.stderr: -352> 2024-09-14T11:31:00.175+0000 7fb9ad80f640 4 set_mon_vals no callback set 2024-09-14T11:31:00.582 INFO:tasks.workunit.client.0.smithi071.stderr: -351> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 10 monclient: _renew_subs 2024-09-14T11:31:00.582 INFO:tasks.workunit.client.0.smithi071.stderr: -350> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:31:00.582 INFO:tasks.workunit.client.0.smithi071.stderr: -349> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 10 monclient: _renew_subs 2024-09-14T11:31:00.582 INFO:tasks.workunit.client.0.smithi071.stderr: -348> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:31:00.582 INFO:tasks.workunit.client.0.smithi071.stderr: -347> 2024-09-14T11:31:00.175+0000 7fb8927fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:31:00.582 INFO:tasks.workunit.client.0.smithi071.stderr: -346> 2024-09-14T11:31:00.175+0000 7fb8927fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:31:00.583 INFO:tasks.workunit.client.0.smithi071.stderr: -345> 2024-09-14T11:31:00.175+0000 7fb8927fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:31:00.583 INFO:tasks.workunit.client.0.smithi071.stderr: -344> 2024-09-14T11:31:00.175+0000 7fb9ad00e640 10 monclient: get_auth_request con 0x7fb8840717e0 auth_method 0 2024-09-14T11:31:00.583 INFO:tasks.workunit.client.0.smithi071.stderr: -343> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 10 monclient: get_monmap_and_config 2024-09-14T11:31:00.583 INFO:tasks.workunit.client.0.smithi071.stderr: -342> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 10 monclient: build_initial_monmap 2024-09-14T11:31:00.583 INFO:tasks.workunit.client.0.smithi071.stderr: -341> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 1 build_initial for_mkfs: 0 2024-09-14T11:31:00.583 INFO:tasks.workunit.client.0.smithi071.stderr: -340> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 10 monclient: monmap: 2024-09-14T11:31:00.583 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:31:00.583 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:31:00.583 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:31:00.583 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:31:00.583 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:31:00.583 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:00.583 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:31:00.583 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:31:00.584 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:31:00.584 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.584 INFO:tasks.workunit.client.0.smithi071.stderr: -339> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f7758770) adding auth protocol: cephx 2024-09-14T11:31:00.584 INFO:tasks.workunit.client.0.smithi071.stderr: -338> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f7758770) adding auth protocol: cephx 2024-09-14T11:31:00.584 INFO:tasks.workunit.client.0.smithi071.stderr: -337> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f7758770) adding auth protocol: cephx 2024-09-14T11:31:00.584 INFO:tasks.workunit.client.0.smithi071.stderr: -336> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f7758770) adding con mode: secure 2024-09-14T11:31:00.584 INFO:tasks.workunit.client.0.smithi071.stderr: -335> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f7758770) adding con mode: crc 2024-09-14T11:31:00.584 INFO:tasks.workunit.client.0.smithi071.stderr: -334> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f7758770) adding con mode: secure 2024-09-14T11:31:00.584 INFO:tasks.workunit.client.0.smithi071.stderr: -333> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f7758770) adding con mode: crc 2024-09-14T11:31:00.584 INFO:tasks.workunit.client.0.smithi071.stderr: -332> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f7758770) adding con mode: secure 2024-09-14T11:31:00.584 INFO:tasks.workunit.client.0.smithi071.stderr: -331> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f7758770) adding con mode: crc 2024-09-14T11:31:00.584 INFO:tasks.workunit.client.0.smithi071.stderr: -330> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f7758770) adding con mode: crc 2024-09-14T11:31:00.584 INFO:tasks.workunit.client.0.smithi071.stderr: -329> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f7758770) adding con mode: secure 2024-09-14T11:31:00.584 INFO:tasks.workunit.client.0.smithi071.stderr: -328> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f7758770) adding con mode: crc 2024-09-14T11:31:00.585 INFO:tasks.workunit.client.0.smithi071.stderr: -327> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f7758770) adding con mode: secure 2024-09-14T11:31:00.585 INFO:tasks.workunit.client.0.smithi071.stderr: -326> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f7758770) adding con mode: crc 2024-09-14T11:31:00.585 INFO:tasks.workunit.client.0.smithi071.stderr: -325> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f7758770) adding con mode: secure 2024-09-14T11:31:00.585 INFO:tasks.workunit.client.0.smithi071.stderr: -324> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:00.585 INFO:tasks.workunit.client.0.smithi071.stderr: -323> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 10 monclient: init 2024-09-14T11:31:00.585 INFO:tasks.workunit.client.0.smithi071.stderr: -322> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2abb0) adding auth protocol: cephx 2024-09-14T11:31:00.585 INFO:tasks.workunit.client.0.smithi071.stderr: -321> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2abb0) adding auth protocol: cephx 2024-09-14T11:31:00.585 INFO:tasks.workunit.client.0.smithi071.stderr: -320> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2abb0) adding auth protocol: cephx 2024-09-14T11:31:00.585 INFO:tasks.workunit.client.0.smithi071.stderr: -319> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2abb0) adding con mode: secure 2024-09-14T11:31:00.585 INFO:tasks.workunit.client.0.smithi071.stderr: -318> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2abb0) adding con mode: crc 2024-09-14T11:31:00.585 INFO:tasks.workunit.client.0.smithi071.stderr: -317> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2abb0) adding con mode: secure 2024-09-14T11:31:00.585 INFO:tasks.workunit.client.0.smithi071.stderr: -316> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2abb0) adding con mode: crc 2024-09-14T11:31:00.585 INFO:tasks.workunit.client.0.smithi071.stderr: -315> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2abb0) adding con mode: secure 2024-09-14T11:31:00.585 INFO:tasks.workunit.client.0.smithi071.stderr: -314> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2abb0) adding con mode: crc 2024-09-14T11:31:00.585 INFO:tasks.workunit.client.0.smithi071.stderr: -313> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2abb0) adding con mode: crc 2024-09-14T11:31:00.586 INFO:tasks.workunit.client.0.smithi071.stderr: -312> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2abb0) adding con mode: secure 2024-09-14T11:31:00.586 INFO:tasks.workunit.client.0.smithi071.stderr: -311> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2abb0) adding con mode: crc 2024-09-14T11:31:00.586 INFO:tasks.workunit.client.0.smithi071.stderr: -310> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2abb0) adding con mode: secure 2024-09-14T11:31:00.586 INFO:tasks.workunit.client.0.smithi071.stderr: -309> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2abb0) adding con mode: crc 2024-09-14T11:31:00.586 INFO:tasks.workunit.client.0.smithi071.stderr: -308> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2abb0) adding con mode: secure 2024-09-14T11:31:00.586 INFO:tasks.workunit.client.0.smithi071.stderr: -307> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:00.586 INFO:tasks.workunit.client.0.smithi071.stderr: -306> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:00.586 INFO:tasks.workunit.client.0.smithi071.stderr: -305> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 5 asok(0x55e0f74aed90) register_command rotate-key cmddesc rotate-key hook 0x7ffd4db2acf8 EEXIST 2024-09-14T11:31:00.586 INFO:tasks.workunit.client.0.smithi071.stderr: -304> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 10 monclient: _reopen_session rank -1 2024-09-14T11:31:00.586 INFO:tasks.workunit.client.0.smithi071.stderr: -303> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:31:00.586 INFO:tasks.workunit.client.0.smithi071.stderr: -302> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 10 monclient(hunting): picked mon.noname-c con 0x55e0f778cc70 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:31:00.586 INFO:tasks.workunit.client.0.smithi071.stderr: -301> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 10 monclient(hunting): picked mon.noname-b con 0x55e0f7788060 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:31:00.586 INFO:tasks.workunit.client.0.smithi071.stderr: -300> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 10 monclient(hunting): picked mon.noname-a con 0x55e0f77889e0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:31:00.586 INFO:tasks.workunit.client.0.smithi071.stderr: -299> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:00.587 INFO:tasks.workunit.client.0.smithi071.stderr: -298> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:00.587 INFO:tasks.workunit.client.0.smithi071.stderr: -297> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:00.587 INFO:tasks.workunit.client.0.smithi071.stderr: -296> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 10 monclient(hunting): _renew_subs 2024-09-14T11:31:00.587 INFO:tasks.workunit.client.0.smithi071.stderr: -295> 2024-09-14T11:31:00.175+0000 7fb9aed079c0 10 monclient(hunting): authenticate will time out at 2272.299561s 2024-09-14T11:31:00.587 INFO:tasks.workunit.client.0.smithi071.stderr: -294> 2024-09-14T11:31:00.175+0000 7fb9ac00c640 10 monclient(hunting): get_auth_request con 0x55e0f778cc70 auth_method 0 2024-09-14T11:31:00.587 INFO:tasks.workunit.client.0.smithi071.stderr: -293> 2024-09-14T11:31:00.175+0000 7fb9ac00c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:00.587 INFO:tasks.workunit.client.0.smithi071.stderr: -292> 2024-09-14T11:31:00.175+0000 7fb9ac00c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:00.587 INFO:tasks.workunit.client.0.smithi071.stderr: -291> 2024-09-14T11:31:00.175+0000 7fb9ac00c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:00.587 INFO:tasks.workunit.client.0.smithi071.stderr: -290> 2024-09-14T11:31:00.175+0000 7fb9ac80d640 10 monclient(hunting): get_auth_request con 0x55e0f77889e0 auth_method 0 2024-09-14T11:31:00.587 INFO:tasks.workunit.client.0.smithi071.stderr: -289> 2024-09-14T11:31:00.175+0000 7fb9ac80d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:00.587 INFO:tasks.workunit.client.0.smithi071.stderr: -288> 2024-09-14T11:31:00.175+0000 7fb9ac80d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:00.587 INFO:tasks.workunit.client.0.smithi071.stderr: -287> 2024-09-14T11:31:00.175+0000 7fb9ac80d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:00.587 INFO:tasks.workunit.client.0.smithi071.stderr: -286> 2024-09-14T11:31:00.175+0000 7fb9ac00c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:00.587 INFO:tasks.workunit.client.0.smithi071.stderr: -285> 2024-09-14T11:31:00.175+0000 7fb9ac00c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:00.587 INFO:tasks.workunit.client.0.smithi071.stderr: -284> 2024-09-14T11:31:00.175+0000 7fb9ac00c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:00.588 INFO:tasks.workunit.client.0.smithi071.stderr: -283> 2024-09-14T11:31:00.175+0000 7fb9ac80d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:00.588 INFO:tasks.workunit.client.0.smithi071.stderr: -282> 2024-09-14T11:31:00.175+0000 7fb9ac80d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:00.588 INFO:tasks.workunit.client.0.smithi071.stderr: -281> 2024-09-14T11:31:00.175+0000 7fb9ac80d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:00.588 INFO:tasks.workunit.client.0.smithi071.stderr: -280> 2024-09-14T11:31:00.175+0000 7fb9ac00c640 10 monclient(hunting): handle_auth_done global_id 6692 payload 274 2024-09-14T11:31:00.588 INFO:tasks.workunit.client.0.smithi071.stderr: -279> 2024-09-14T11:31:00.175+0000 7fb9ac00c640 10 monclient: _finish_hunting 0 2024-09-14T11:31:00.588 INFO:tasks.workunit.client.0.smithi071.stderr: -278> 2024-09-14T11:31:00.175+0000 7fb9ac00c640 1 monclient: found mon.noname-c 2024-09-14T11:31:00.588 INFO:tasks.workunit.client.0.smithi071.stderr: -277> 2024-09-14T11:31:00.175+0000 7fb9ac00c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:31:00.588 INFO:tasks.workunit.client.0.smithi071.stderr: -276> 2024-09-14T11:31:00.179+0000 7fb883fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:00.588 INFO:tasks.workunit.client.0.smithi071.stderr: -275> 2024-09-14T11:31:00.179+0000 7fb883fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:31:00.588 INFO:tasks.workunit.client.0.smithi071.stderr: -274> 2024-09-14T11:31:00.179+0000 7fb883fff640 10 monclient: dump: 2024-09-14T11:31:00.588 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:31:00.588 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:31:00.588 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:00.588 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:00.588 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:00.589 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:00.589 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:31:00.589 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:31:00.589 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:31:00.589 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.589 INFO:tasks.workunit.client.0.smithi071.stderr: -273> 2024-09-14T11:31:00.179+0000 7fb883fff640 10 monclient: _finish_auth 0 2024-09-14T11:31:00.589 INFO:tasks.workunit.client.0.smithi071.stderr: -272> 2024-09-14T11:31:00.179+0000 7fb883fff640 10 monclient: _check_auth_tickets 2024-09-14T11:31:00.589 INFO:tasks.workunit.client.0.smithi071.stderr: -271> 2024-09-14T11:31:00.179+0000 7fb883fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:00.589 INFO:tasks.workunit.client.0.smithi071.stderr: -270> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 monclient: authenticate success, global_id 6692 2024-09-14T11:31:00.589 INFO:tasks.workunit.client.0.smithi071.stderr: -269> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient: get_monmap_and_config success 2024-09-14T11:31:00.589 INFO:tasks.workunit.client.0.smithi071.stderr: -268> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 4 set_mon_vals no callback set 2024-09-14T11:31:00.589 INFO:tasks.workunit.client.0.smithi071.stderr: -267> 2024-09-14T11:31:00.179+0000 7fb883fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:00.589 INFO:tasks.workunit.client.0.smithi071.stderr: -266> 2024-09-14T11:31:00.179+0000 7fb883fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:31:00.589 INFO:tasks.workunit.client.0.smithi071.stderr: -265> 2024-09-14T11:31:00.179+0000 7fb883fff640 10 monclient: dump: 2024-09-14T11:31:00.589 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:31:00.590 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:31:00.590 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:00.590 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:00.590 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:00.590 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:00.590 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:31:00.590 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:31:00.590 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:31:00.590 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.590 INFO:tasks.workunit.client.0.smithi071.stderr: -264> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient: shutdown 2024-09-14T11:31:00.590 INFO:tasks.workunit.client.0.smithi071.stderr: -263> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient: build_initial_monmap 2024-09-14T11:31:00.590 INFO:tasks.workunit.client.0.smithi071.stderr: -262> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 1 build_initial for_mkfs: 0 2024-09-14T11:31:00.590 INFO:tasks.workunit.client.0.smithi071.stderr: -261> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient: monmap: 2024-09-14T11:31:00.590 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:31:00.591 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:31:00.591 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:31:00.591 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:31:00.591 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:31:00.591 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:00.591 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:31:00.591 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:31:00.591 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:31:00.591 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.591 INFO:tasks.workunit.client.0.smithi071.stderr: -260> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f777f260) adding auth protocol: cephx 2024-09-14T11:31:00.591 INFO:tasks.workunit.client.0.smithi071.stderr: -259> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f777f260) adding auth protocol: cephx 2024-09-14T11:31:00.591 INFO:tasks.workunit.client.0.smithi071.stderr: -258> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f777f260) adding auth protocol: cephx 2024-09-14T11:31:00.591 INFO:tasks.workunit.client.0.smithi071.stderr: -257> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f777f260) adding con mode: secure 2024-09-14T11:31:00.591 INFO:tasks.workunit.client.0.smithi071.stderr: -256> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f777f260) adding con mode: crc 2024-09-14T11:31:00.591 INFO:tasks.workunit.client.0.smithi071.stderr: -255> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f777f260) adding con mode: secure 2024-09-14T11:31:00.592 INFO:tasks.workunit.client.0.smithi071.stderr: -254> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f777f260) adding con mode: crc 2024-09-14T11:31:00.592 INFO:tasks.workunit.client.0.smithi071.stderr: -253> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f777f260) adding con mode: secure 2024-09-14T11:31:00.592 INFO:tasks.workunit.client.0.smithi071.stderr: -252> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f777f260) adding con mode: crc 2024-09-14T11:31:00.592 INFO:tasks.workunit.client.0.smithi071.stderr: -251> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f777f260) adding con mode: crc 2024-09-14T11:31:00.592 INFO:tasks.workunit.client.0.smithi071.stderr: -250> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f777f260) adding con mode: secure 2024-09-14T11:31:00.592 INFO:tasks.workunit.client.0.smithi071.stderr: -249> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f777f260) adding con mode: crc 2024-09-14T11:31:00.592 INFO:tasks.workunit.client.0.smithi071.stderr: -248> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f777f260) adding con mode: secure 2024-09-14T11:31:00.592 INFO:tasks.workunit.client.0.smithi071.stderr: -247> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f777f260) adding con mode: crc 2024-09-14T11:31:00.592 INFO:tasks.workunit.client.0.smithi071.stderr: -246> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f777f260) adding con mode: secure 2024-09-14T11:31:00.592 INFO:tasks.workunit.client.0.smithi071.stderr: -245> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:00.592 INFO:tasks.workunit.client.0.smithi071.stderr: -244> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 1 librados: starting msgr at 2024-09-14T11:31:00.592 INFO:tasks.workunit.client.0.smithi071.stderr: -243> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 1 librados: starting objecter 2024-09-14T11:31:00.592 INFO:tasks.workunit.client.0.smithi071.stderr: -242> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 asok(0x55e0f74aed90) register_command objecter_requests cmddesc objecter_requests hook 0x55e0f7786bb0 EEXIST 2024-09-14T11:31:00.592 INFO:tasks.workunit.client.0.smithi071.stderr: -241> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 1 librados: setting wanted keys 2024-09-14T11:31:00.592 INFO:tasks.workunit.client.0.smithi071.stderr: -240> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 1 librados: calling monclient init 2024-09-14T11:31:00.593 INFO:tasks.workunit.client.0.smithi071.stderr: -239> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient: init 2024-09-14T11:31:00.593 INFO:tasks.workunit.client.0.smithi071.stderr: -238> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f773ac40) adding auth protocol: cephx 2024-09-14T11:31:00.593 INFO:tasks.workunit.client.0.smithi071.stderr: -237> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f773ac40) adding auth protocol: cephx 2024-09-14T11:31:00.593 INFO:tasks.workunit.client.0.smithi071.stderr: -236> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f773ac40) adding auth protocol: cephx 2024-09-14T11:31:00.593 INFO:tasks.workunit.client.0.smithi071.stderr: -235> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f773ac40) adding con mode: secure 2024-09-14T11:31:00.593 INFO:tasks.workunit.client.0.smithi071.stderr: -234> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f773ac40) adding con mode: crc 2024-09-14T11:31:00.593 INFO:tasks.workunit.client.0.smithi071.stderr: -233> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f773ac40) adding con mode: secure 2024-09-14T11:31:00.593 INFO:tasks.workunit.client.0.smithi071.stderr: -232> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f773ac40) adding con mode: crc 2024-09-14T11:31:00.593 INFO:tasks.workunit.client.0.smithi071.stderr: -231> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f773ac40) adding con mode: secure 2024-09-14T11:31:00.593 INFO:tasks.workunit.client.0.smithi071.stderr: -230> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f773ac40) adding con mode: crc 2024-09-14T11:31:00.593 INFO:tasks.workunit.client.0.smithi071.stderr: -229> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f773ac40) adding con mode: crc 2024-09-14T11:31:00.593 INFO:tasks.workunit.client.0.smithi071.stderr: -228> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f773ac40) adding con mode: secure 2024-09-14T11:31:00.593 INFO:tasks.workunit.client.0.smithi071.stderr: -227> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f773ac40) adding con mode: crc 2024-09-14T11:31:00.593 INFO:tasks.workunit.client.0.smithi071.stderr: -226> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f773ac40) adding con mode: secure 2024-09-14T11:31:00.593 INFO:tasks.workunit.client.0.smithi071.stderr: -225> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f773ac40) adding con mode: crc 2024-09-14T11:31:00.594 INFO:tasks.workunit.client.0.smithi071.stderr: -224> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 AuthRegistry(0x55e0f773ac40) adding con mode: secure 2024-09-14T11:31:00.594 INFO:tasks.workunit.client.0.smithi071.stderr: -223> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:00.594 INFO:tasks.workunit.client.0.smithi071.stderr: -222> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:00.594 INFO:tasks.workunit.client.0.smithi071.stderr: -221> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 asok(0x55e0f74aed90) register_command rotate-key cmddesc rotate-key hook 0x55e0f773ad88 EEXIST 2024-09-14T11:31:00.594 INFO:tasks.workunit.client.0.smithi071.stderr: -220> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient: _reopen_session rank -1 2024-09-14T11:31:00.594 INFO:tasks.workunit.client.0.smithi071.stderr: -219> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:31:00.594 INFO:tasks.workunit.client.0.smithi071.stderr: -218> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient(hunting): picked mon.noname-a con 0x55e0f7788060 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:31:00.594 INFO:tasks.workunit.client.0.smithi071.stderr: -217> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient(hunting): picked mon.noname-c con 0x55e0f77889e0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:31:00.594 INFO:tasks.workunit.client.0.smithi071.stderr: -216> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient(hunting): picked mon.noname-b con 0x55e0f778cc70 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:31:00.594 INFO:tasks.workunit.client.0.smithi071.stderr: -215> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:00.594 INFO:tasks.workunit.client.0.smithi071.stderr: -214> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:00.594 INFO:tasks.workunit.client.0.smithi071.stderr: -213> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:00.594 INFO:tasks.workunit.client.0.smithi071.stderr: -212> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient(hunting): _renew_subs 2024-09-14T11:31:00.594 INFO:tasks.workunit.client.0.smithi071.stderr: -211> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient(hunting): authenticate will time out at 2272.302038s 2024-09-14T11:31:00.594 INFO:tasks.workunit.client.0.smithi071.stderr: -210> 2024-09-14T11:31:00.179+0000 7fb9ac00c640 10 monclient(hunting): get_auth_request con 0x55e0f7788060 auth_method 0 2024-09-14T11:31:00.595 INFO:tasks.workunit.client.0.smithi071.stderr: -209> 2024-09-14T11:31:00.179+0000 7fb9ac00c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:00.595 INFO:tasks.workunit.client.0.smithi071.stderr: -208> 2024-09-14T11:31:00.179+0000 7fb9ac00c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:00.595 INFO:tasks.workunit.client.0.smithi071.stderr: -207> 2024-09-14T11:31:00.179+0000 7fb9ac00c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:00.595 INFO:tasks.workunit.client.0.smithi071.stderr: -206> 2024-09-14T11:31:00.179+0000 7fb9ad00e640 10 monclient(hunting): get_auth_request con 0x55e0f77889e0 auth_method 0 2024-09-14T11:31:00.595 INFO:tasks.workunit.client.0.smithi071.stderr: -205> 2024-09-14T11:31:00.179+0000 7fb9ad00e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:00.595 INFO:tasks.workunit.client.0.smithi071.stderr: -204> 2024-09-14T11:31:00.179+0000 7fb9ad00e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:00.595 INFO:tasks.workunit.client.0.smithi071.stderr: -203> 2024-09-14T11:31:00.179+0000 7fb9ad00e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:00.595 INFO:tasks.workunit.client.0.smithi071.stderr: -202> 2024-09-14T11:31:00.179+0000 7fb9ac00c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:00.595 INFO:tasks.workunit.client.0.smithi071.stderr: -201> 2024-09-14T11:31:00.179+0000 7fb9ac00c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:00.595 INFO:tasks.workunit.client.0.smithi071.stderr: -200> 2024-09-14T11:31:00.179+0000 7fb9ac00c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:00.595 INFO:tasks.workunit.client.0.smithi071.stderr: -199> 2024-09-14T11:31:00.179+0000 7fb9ad00e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:00.595 INFO:tasks.workunit.client.0.smithi071.stderr: -198> 2024-09-14T11:31:00.179+0000 7fb9ad00e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:00.595 INFO:tasks.workunit.client.0.smithi071.stderr: -197> 2024-09-14T11:31:00.179+0000 7fb9ad00e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:00.595 INFO:tasks.workunit.client.0.smithi071.stderr: -196> 2024-09-14T11:31:00.179+0000 7fb9ac00c640 10 monclient(hunting): handle_auth_done global_id 7035 payload 824 2024-09-14T11:31:00.595 INFO:tasks.workunit.client.0.smithi071.stderr: -195> 2024-09-14T11:31:00.179+0000 7fb9ac00c640 10 monclient: _finish_hunting 0 2024-09-14T11:31:00.595 INFO:tasks.workunit.client.0.smithi071.stderr: -194> 2024-09-14T11:31:00.179+0000 7fb9ac00c640 1 monclient: found mon.noname-a 2024-09-14T11:31:00.596 INFO:tasks.workunit.client.0.smithi071.stderr: -193> 2024-09-14T11:31:00.179+0000 7fb9ac00c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:31:00.596 INFO:tasks.workunit.client.0.smithi071.stderr: -192> 2024-09-14T11:31:00.179+0000 7fb9ac80d640 10 monclient: get_auth_request con 0x55e0f778cc70 auth_method 0 2024-09-14T11:31:00.596 INFO:tasks.workunit.client.0.smithi071.stderr: -191> 2024-09-14T11:31:00.179+0000 7fb8827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:00.596 INFO:tasks.workunit.client.0.smithi071.stderr: -190> 2024-09-14T11:31:00.179+0000 7fb8827fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:31:00.596 INFO:tasks.workunit.client.0.smithi071.stderr: -189> 2024-09-14T11:31:00.179+0000 7fb8827fc640 10 monclient: dump: 2024-09-14T11:31:00.596 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:31:00.596 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:31:00.596 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:00.596 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:00.596 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:00.596 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:00.596 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:31:00.596 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:31:00.596 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:31:00.596 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.597 INFO:tasks.workunit.client.0.smithi071.stderr: -188> 2024-09-14T11:31:00.179+0000 7fb8827fc640 10 monclient: _finish_auth 0 2024-09-14T11:31:00.597 INFO:tasks.workunit.client.0.smithi071.stderr: -187> 2024-09-14T11:31:00.179+0000 7fb8827fc640 10 monclient: _check_auth_tickets 2024-09-14T11:31:00.597 INFO:tasks.workunit.client.0.smithi071.stderr: -186> 2024-09-14T11:31:00.179+0000 7fb8827fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:00.597 INFO:tasks.workunit.client.0.smithi071.stderr: -185> 2024-09-14T11:31:00.179+0000 7fb8827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:00.597 INFO:tasks.workunit.client.0.smithi071.stderr: -184> 2024-09-14T11:31:00.179+0000 7fb8827fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:31:00.597 INFO:tasks.workunit.client.0.smithi071.stderr: -183> 2024-09-14T11:31:00.179+0000 7fb8827fc640 10 monclient: dump: 2024-09-14T11:31:00.597 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:31:00.597 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:31:00.597 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:00.597 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:00.597 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:00.597 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:00.597 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:31:00.597 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:31:00.597 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:31:00.598 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.598 INFO:tasks.workunit.client.0.smithi071.stderr: -182> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 monclient: authenticate success, global_id 7035 2024-09-14T11:31:00.598 INFO:tasks.workunit.client.0.smithi071.stderr: -181> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient: _renew_subs 2024-09-14T11:31:00.598 INFO:tasks.workunit.client.0.smithi071.stderr: -180> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:31:00.598 INFO:tasks.workunit.client.0.smithi071.stderr: -179> 2024-09-14T11:31:00.179+0000 7fb883fff640 4 set_mon_vals no callback set 2024-09-14T11:31:00.598 INFO:tasks.workunit.client.0.smithi071.stderr: -178> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient: _renew_subs 2024-09-14T11:31:00.598 INFO:tasks.workunit.client.0.smithi071.stderr: -177> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:31:00.598 INFO:tasks.workunit.client.0.smithi071.stderr: -176> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 1 librados: init done 2024-09-14T11:31:00.598 INFO:tasks.workunit.client.0.smithi071.stderr: -175> 2024-09-14T11:31:00.179+0000 7fb9aed079c0 5 asok(0x55e0f74aed90) register_command cr dump hook 0x55e0f7786308 2024-09-14T11:31:00.598 INFO:tasks.workunit.client.0.smithi071.stderr: -174> 2024-09-14T11:31:00.183+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.598 INFO:tasks.workunit.client.0.smithi071.stderr: -173> 2024-09-14T11:31:00.183+0000 7fb8827fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:31:00.598 INFO:tasks.workunit.client.0.smithi071.stderr: -172> 2024-09-14T11:31:00.183+0000 7fb8827fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:31:00.598 INFO:tasks.workunit.client.0.smithi071.stderr: -171> 2024-09-14T11:31:00.183+0000 7fb8827fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:31:00.598 INFO:tasks.workunit.client.0.smithi071.stderr: -170> 2024-09-14T11:31:00.183+0000 7fb9ad00e640 10 monclient: get_auth_request con 0x7fb8780718a0 auth_method 0 2024-09-14T11:31:00.598 INFO:tasks.workunit.client.0.smithi071.stderr: -169> 2024-09-14T11:31:00.183+0000 7fb9ac80d640 10 monclient: get_auth_request con 0x55e0f77a6650 auth_method 0 2024-09-14T11:31:00.599 INFO:tasks.workunit.client.0.smithi071.stderr: -168> 2024-09-14T11:31:00.183+0000 7fb9aed079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:00.599 INFO:tasks.workunit.client.0.smithi071.stderr: -167> 2024-09-14T11:31:00.183+0000 7fb9aed079c0 20 realm 2024-09-14T11:31:00.599 INFO:tasks.workunit.client.0.smithi071.stderr: -166> 2024-09-14T11:31:00.183+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.599 INFO:tasks.workunit.client.0.smithi071.stderr: -165> 2024-09-14T11:31:00.183+0000 7fb9aed079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:00.599 INFO:tasks.workunit.client.0.smithi071.stderr: -164> 2024-09-14T11:31:00.183+0000 7fb9aed079c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:00.599 INFO:tasks.workunit.client.0.smithi071.stderr: -163> 2024-09-14T11:31:00.183+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.599 INFO:tasks.workunit.client.0.smithi071.stderr: -162> 2024-09-14T11:31:00.183+0000 7fb9aed079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:00.599 INFO:tasks.workunit.client.0.smithi071.stderr: -161> 2024-09-14T11:31:00.183+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.599 INFO:tasks.workunit.client.0.smithi071.stderr: -160> 2024-09-14T11:31:00.183+0000 7fb9ac00c640 10 monclient: get_auth_request con 0x55e0f77aa9a0 auth_method 0 2024-09-14T11:31:00.599 INFO:tasks.workunit.client.0.smithi071.stderr: -159> 2024-09-14T11:31:00.187+0000 7fb9aed079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:00.599 INFO:tasks.workunit.client.0.smithi071.stderr: -158> 2024-09-14T11:31:00.187+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.599 INFO:tasks.workunit.client.0.smithi071.stderr: -157> 2024-09-14T11:31:00.187+0000 7fb9ad00e640 10 monclient: get_auth_request con 0x55e0f77ae0c0 auth_method 0 2024-09-14T11:31:00.599 INFO:tasks.workunit.client.0.smithi071.stderr: -156> 2024-09-14T11:31:00.187+0000 7fb9aed079c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:00.599 INFO:tasks.workunit.client.0.smithi071.stderr: -155> 2024-09-14T11:31:00.187+0000 7fb9aed079c0 20 searching for the correct realm 2024-09-14T11:31:00.599 INFO:tasks.workunit.client.0.smithi071.stderr: -154> 2024-09-14T11:31:00.187+0000 7fb9ac80d640 10 monclient: get_auth_request con 0x55e0f77b2e80 auth_method 0 2024-09-14T11:31:00.600 INFO:tasks.workunit.client.0.smithi071.stderr: -153> 2024-09-14T11:31:00.187+0000 7fb9ac00c640 10 monclient: get_auth_request con 0x7fb99c0c0020 auth_method 0 2024-09-14T11:31:00.600 INFO:tasks.workunit.client.0.smithi071.stderr: -152> 2024-09-14T11:31:00.191+0000 7fb9ad00e640 10 monclient: get_auth_request con 0x7fb9a0034b60 auth_method 0 2024-09-14T11:31:00.600 INFO:tasks.workunit.client.0.smithi071.stderr: -151> 2024-09-14T11:31:00.191+0000 7fb9ad00e640 0 -- 172.21.15.71:0/29309657 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fb9a0034b60 msgr2=0x7fb9a001f450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:00.600 INFO:tasks.workunit.client.0.smithi071.stderr: -150> 2024-09-14T11:31:00.395+0000 7fb9ad00e640 10 monclient: get_auth_request con 0x7fb9a0034b60 auth_method 0 2024-09-14T11:31:00.600 INFO:tasks.workunit.client.0.smithi071.stderr: -149> 2024-09-14T11:31:00.395+0000 7fb9ac80d640 10 monclient: get_auth_request con 0x7fb99c102560 auth_method 0 2024-09-14T11:31:00.600 INFO:tasks.workunit.client.0.smithi071.stderr: -148> 2024-09-14T11:31:00.403+0000 7fb9ac00c640 10 monclient: get_auth_request con 0x7fb9a002cc20 auth_method 0 2024-09-14T11:31:00.600 INFO:tasks.workunit.client.0.smithi071.stderr: -147> 2024-09-14T11:31:00.403+0000 7fb9ad00e640 0 -- 172.21.15.71:0/29309657 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55e0f77ae0c0 msgr2=0x55e0f77b04d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:00.600 INFO:tasks.workunit.client.0.smithi071.stderr: -146> 2024-09-14T11:31:00.403+0000 7fb8827fc640 1 client.7035.objecter ms_handle_reset 0x55e0f77ae0c0 session 0x55e0f77aa240 osd.3 2024-09-14T11:31:00.600 INFO:tasks.workunit.client.0.smithi071.stderr: -145> 2024-09-14T11:31:00.403+0000 7fb8827fc640 10 monclient: _renew_subs 2024-09-14T11:31:00.600 INFO:tasks.workunit.client.0.smithi071.stderr: -144> 2024-09-14T11:31:00.403+0000 7fb8827fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:31:00.600 INFO:tasks.workunit.client.0.smithi071.stderr: -143> 2024-09-14T11:31:00.403+0000 7fb9ad00e640 10 monclient: get_auth_request con 0x7fb8780813c0 auth_method 0 2024-09-14T11:31:00.600 INFO:tasks.workunit.client.0.smithi071.stderr: -142> 2024-09-14T11:31:00.419+0000 7fb9aed079c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:00.600 INFO:tasks.workunit.client.0.smithi071.stderr: -141> 2024-09-14T11:31:00.419+0000 7fb9aed079c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:31:00.600 INFO:tasks.workunit.client.0.smithi071.stderr: -140> 2024-09-14T11:31:00.419+0000 7fb9aed079c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:00.600 INFO:tasks.workunit.client.0.smithi071.stderr: -139> 2024-09-14T11:31:00.419+0000 7fb9aed079c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:31:00.601 INFO:tasks.workunit.client.0.smithi071.stderr: -138> 2024-09-14T11:31:00.419+0000 7fb9aed079c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:00.601 INFO:tasks.workunit.client.0.smithi071.stderr: -137> 2024-09-14T11:31:00.419+0000 7fb9aed079c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:00.601 INFO:tasks.workunit.client.0.smithi071.stderr: -136> 2024-09-14T11:31:00.419+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.601 INFO:tasks.workunit.client.0.smithi071.stderr: -135> 2024-09-14T11:31:00.419+0000 7fb9aed079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:00.601 INFO:tasks.workunit.client.0.smithi071.stderr: -134> 2024-09-14T11:31:00.419+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.601 INFO:tasks.workunit.client.0.smithi071.stderr: -133> 2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:00.601 INFO:tasks.workunit.client.0.smithi071.stderr: -132> 2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.601 INFO:tasks.workunit.client.0.smithi071.stderr: -131> 2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:00.601 INFO:tasks.workunit.client.0.smithi071.stderr: -130> 2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 zone default found 2024-09-14T11:31:00.601 INFO:tasks.workunit.client.0.smithi071.stderr: -129> 2024-09-14T11:31:00.423+0000 7fb9aed079c0 4 Realm: () 2024-09-14T11:31:00.601 INFO:tasks.workunit.client.0.smithi071.stderr: -128> 2024-09-14T11:31:00.423+0000 7fb9aed079c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:31:00.601 INFO:tasks.workunit.client.0.smithi071.stderr: -127> 2024-09-14T11:31:00.423+0000 7fb9aed079c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:31:00.601 INFO:tasks.workunit.client.0.smithi071.stderr: -126> 2024-09-14T11:31:00.423+0000 7fb9aed079c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:00.601 INFO:tasks.workunit.client.0.smithi071.stderr: -125> 2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 zonegroup default 2024-09-14T11:31:00.601 INFO:tasks.workunit.client.0.smithi071.stderr: -124> 2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.602 INFO:tasks.workunit.client.0.smithi071.stderr: -123> 2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:00.602 INFO:tasks.workunit.client.0.smithi071.stderr: -122> 2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.602 INFO:tasks.workunit.client.0.smithi071.stderr: -121> 2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:00.602 INFO:tasks.workunit.client.0.smithi071.stderr: -120> 2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.602 INFO:tasks.workunit.client.0.smithi071.stderr: -119> 2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:00.602 INFO:tasks.workunit.client.0.smithi071.stderr: -118> 2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 started sync module instance, tier type = 2024-09-14T11:31:00.602 INFO:tasks.workunit.client.0.smithi071.stderr: -117> 2024-09-14T11:31:00.423+0000 7fb9aed079c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:31:00.602 INFO:tasks.workunit.client.0.smithi071.stderr: -116> 2024-09-14T11:31:00.447+0000 7fb9aed079c0 20 add_watcher() i=0 2024-09-14T11:31:00.602 INFO:tasks.workunit.client.0.smithi071.stderr: -115> 2024-09-14T11:31:00.447+0000 7fb9aed079c0 20 add_watcher() i=1 2024-09-14T11:31:00.602 INFO:tasks.workunit.client.0.smithi071.stderr: -114> 2024-09-14T11:31:00.447+0000 7fb9aed079c0 20 add_watcher() i=2 2024-09-14T11:31:00.602 INFO:tasks.workunit.client.0.smithi071.stderr: -113> 2024-09-14T11:31:00.447+0000 7fb9aed079c0 20 add_watcher() i=3 2024-09-14T11:31:00.602 INFO:tasks.workunit.client.0.smithi071.stderr: -112> 2024-09-14T11:31:00.447+0000 7fb9aed079c0 20 add_watcher() i=4 2024-09-14T11:31:00.602 INFO:tasks.workunit.client.0.smithi071.stderr: -111> 2024-09-14T11:31:00.447+0000 7fb9aed079c0 20 add_watcher() i=5 2024-09-14T11:31:00.602 INFO:tasks.workunit.client.0.smithi071.stderr: -110> 2024-09-14T11:31:00.447+0000 7fb9aed079c0 20 add_watcher() i=6 2024-09-14T11:31:00.602 INFO:tasks.workunit.client.0.smithi071.stderr: -109> 2024-09-14T11:31:00.451+0000 7fb9aed079c0 20 add_watcher() i=7 2024-09-14T11:31:00.602 INFO:tasks.workunit.client.0.smithi071.stderr: -108> 2024-09-14T11:31:00.451+0000 7fb9aed079c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:00.603 INFO:tasks.workunit.client.0.smithi071.stderr: -107> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2b090) adding auth protocol: cephx 2024-09-14T11:31:00.603 INFO:tasks.workunit.client.0.smithi071.stderr: -106> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2b090) adding auth protocol: cephx 2024-09-14T11:31:00.603 INFO:tasks.workunit.client.0.smithi071.stderr: -105> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2b090) adding auth protocol: cephx 2024-09-14T11:31:00.603 INFO:tasks.workunit.client.0.smithi071.stderr: -104> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2b090) adding con mode: secure 2024-09-14T11:31:00.603 INFO:tasks.workunit.client.0.smithi071.stderr: -103> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2b090) adding con mode: crc 2024-09-14T11:31:00.603 INFO:tasks.workunit.client.0.smithi071.stderr: -102> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2b090) adding con mode: secure 2024-09-14T11:31:00.603 INFO:tasks.workunit.client.0.smithi071.stderr: -101> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2b090) adding con mode: crc 2024-09-14T11:31:00.603 INFO:tasks.workunit.client.0.smithi071.stderr: -100> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2b090) adding con mode: secure 2024-09-14T11:31:00.603 INFO:tasks.workunit.client.0.smithi071.stderr: -99> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2b090) adding con mode: crc 2024-09-14T11:31:00.603 INFO:tasks.workunit.client.0.smithi071.stderr: -98> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2b090) adding con mode: crc 2024-09-14T11:31:00.603 INFO:tasks.workunit.client.0.smithi071.stderr: -97> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2b090) adding con mode: secure 2024-09-14T11:31:00.603 INFO:tasks.workunit.client.0.smithi071.stderr: -96> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2b090) adding con mode: crc 2024-09-14T11:31:00.603 INFO:tasks.workunit.client.0.smithi071.stderr: -95> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2b090) adding con mode: secure 2024-09-14T11:31:00.603 INFO:tasks.workunit.client.0.smithi071.stderr: -94> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2b090) adding con mode: crc 2024-09-14T11:31:00.603 INFO:tasks.workunit.client.0.smithi071.stderr: -93> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 AuthRegistry(0x7ffd4db2b090) adding con mode: secure 2024-09-14T11:31:00.604 INFO:tasks.workunit.client.0.smithi071.stderr: -92> 2024-09-14T11:31:00.455+0000 7fb862fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:00.604 INFO:tasks.workunit.client.0.smithi071.stderr: -91> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:00.604 INFO:tasks.workunit.client.0.smithi071.stderr: -90> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:00.604 INFO:tasks.workunit.client.0.smithi071.stderr: -89> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:00.604 INFO:tasks.workunit.client.0.smithi071.stderr: -88> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 asok(0x55e0f74aed90) register_command cache list hook 0x55e0f7782f80 2024-09-14T11:31:00.604 INFO:tasks.workunit.client.0.smithi071.stderr: -87> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 asok(0x55e0f74aed90) register_command cache inspect hook 0x55e0f7782f80 2024-09-14T11:31:00.604 INFO:tasks.workunit.client.0.smithi071.stderr: -86> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 asok(0x55e0f74aed90) register_command cache erase hook 0x55e0f7782f80 2024-09-14T11:31:00.604 INFO:tasks.workunit.client.0.smithi071.stderr: -85> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 asok(0x55e0f74aed90) register_command cache zap hook 0x55e0f7782f80 2024-09-14T11:31:00.604 INFO:tasks.workunit.client.0.smithi071.stderr: -84> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 note: GC not initialized 2024-09-14T11:31:00.604 INFO:tasks.workunit.client.0.smithi071.stderr: -83> 2024-09-14T11:31:00.455+0000 7fb861fe3640 20 reqs_thread_entry: start 2024-09-14T11:31:00.604 INFO:tasks.workunit.client.0.smithi071.stderr: -82> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 asok(0x55e0f74aed90) register_command sync trace show hook 0x7fb9a0001480 2024-09-14T11:31:00.604 INFO:tasks.workunit.client.0.smithi071.stderr: -81> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 asok(0x55e0f74aed90) register_command sync trace history hook 0x7fb9a0001480 2024-09-14T11:31:00.604 INFO:tasks.workunit.client.0.smithi071.stderr: -80> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 asok(0x55e0f74aed90) register_command sync trace active hook 0x7fb9a0001480 2024-09-14T11:31:00.604 INFO:tasks.workunit.client.0.smithi071.stderr: -79> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 5 asok(0x55e0f74aed90) register_command sync trace active_short hook 0x7fb9a0001480 2024-09-14T11:31:00.605 INFO:tasks.workunit.client.0.smithi071.stderr: -78> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 20 init_complete bucket index max shards: 11 2024-09-14T11:31:00.605 INFO:tasks.workunit.client.0.smithi071.stderr: -77> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 20 Filter name: none 2024-09-14T11:31:00.605 INFO:tasks.workunit.client.0.smithi071.stderr: -76> 2024-09-14T11:31:00.455+0000 7fb7d37fe640 20 reqs_thread_entry: start 2024-09-14T11:31:00.605 INFO:tasks.workunit.client.0.smithi071.stderr: -75> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:31:00.605 INFO:tasks.workunit.client.0.smithi071.stderr: -74> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.605 INFO:tasks.workunit.client.0.smithi071.stderr: -73> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:31:00.605 INFO:tasks.workunit.client.0.smithi071.stderr: -72> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:31:00.605 INFO:tasks.workunit.client.0.smithi071.stderr: -71> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:31:00.605 INFO:tasks.workunit.client.0.smithi071.stderr: -70> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 : miss 2024-09-14T11:31:00.605 INFO:tasks.workunit.client.0.smithi071.stderr: -69> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.605 INFO:tasks.workunit.client.0.smithi071.stderr: -68> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:31:00.605 INFO:tasks.workunit.client.0.smithi071.stderr: -67> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 info.flags=0x17 2024-09-14T11:31:00.605 INFO:tasks.workunit.client.0.smithi071.stderr: -66> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 to cache LRU end 2024-09-14T11:31:00.605 INFO:tasks.workunit.client.0.smithi071.stderr: -65> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:31:00.605 INFO:tasks.workunit.client.0.smithi071.stderr: -64> 2024-09-14T11:31:00.455+0000 7fb9aed079c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:00.605 INFO:tasks.workunit.client.0.smithi071.stderr: -63> 2024-09-14T11:31:00.459+0000 7fb9aed079c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 2024-09-14T11:31:00.606 INFO:tasks.workunit.client.0.smithi071.stderr: -62> 2024-09-14T11:31:00.467+0000 7fb9aed079c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 info.flags=0x17 2024-09-14T11:31:00.606 INFO:tasks.workunit.client.0.smithi071.stderr: -61> 2024-09-14T11:31:00.467+0000 7fb9aed079c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 to cache LRU end 2024-09-14T11:31:00.606 INFO:tasks.workunit.client.0.smithi071.stderr: -60> 2024-09-14T11:31:00.467+0000 7fb9aed079c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:00.606 INFO:tasks.workunit.client.0.smithi071.stderr: -59> 2024-09-14T11:31:00.467+0000 7fb9aed079c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30, ofs0, ns] 2024-09-14T11:31:00.606 INFO:tasks.workunit.client.0.smithi071.stderr: -58> 2024-09-14T11:31:00.467+0000 7fb883fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464372 cookie 94424713093536 notifier 7035 bl.length()=999 2024-09-14T11:31:00.606 INFO:tasks.workunit.client.0.smithi071.stderr: -57> 2024-09-14T11:31:00.467+0000 7fb883fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 info.flags=0x17 2024-09-14T11:31:00.606 INFO:tasks.workunit.client.0.smithi071.stderr: -56> 2024-09-14T11:31:00.467+0000 7fb883fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 to cache LRU end 2024-09-14T11:31:00.606 INFO:tasks.workunit.client.0.smithi071.stderr: -55> 2024-09-14T11:31:00.467+0000 7fb883fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:00.606 INFO:tasks.workunit.client.0.smithi071.stderr: -54> 2024-09-14T11:31:00.467+0000 7fb9aed079c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.30]): orig_sources= new_sources= 2024-09-14T11:31:00.606 INFO:tasks.workunit.client.0.smithi071.stderr: -53> 2024-09-14T11:31:00.467+0000 7fb9aed079c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.30]): potential sources added=[] removed=[] 2024-09-14T11:31:00.606 INFO:tasks.workunit.client.0.smithi071.stderr: -52> 2024-09-14T11:31:00.467+0000 7fb9aed079c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.30]): orig_dests= new_dests= 2024-09-14T11:31:00.606 INFO:tasks.workunit.client.0.smithi071.stderr: -51> 2024-09-14T11:31:00.467+0000 7fb9aed079c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.30]): potential dests added=[] removed=[] 2024-09-14T11:31:00.606 INFO:tasks.workunit.client.0.smithi071.stderr: -50> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.0 2024-09-14T11:31:00.606 INFO:tasks.workunit.client.0.smithi071.stderr: -49> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.0 2024-09-14T11:31:00.606 INFO:tasks.workunit.client.0.smithi071.stderr: -48> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.1 2024-09-14T11:31:00.607 INFO:tasks.workunit.client.0.smithi071.stderr: -47> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.1 2024-09-14T11:31:00.607 INFO:tasks.workunit.client.0.smithi071.stderr: -46> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.2 2024-09-14T11:31:00.607 INFO:tasks.workunit.client.0.smithi071.stderr: -45> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.2 2024-09-14T11:31:00.607 INFO:tasks.workunit.client.0.smithi071.stderr: -44> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.3 2024-09-14T11:31:00.607 INFO:tasks.workunit.client.0.smithi071.stderr: -43> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.3 2024-09-14T11:31:00.607 INFO:tasks.workunit.client.0.smithi071.stderr: -42> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.4 2024-09-14T11:31:00.607 INFO:tasks.workunit.client.0.smithi071.stderr: -41> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.4 2024-09-14T11:31:00.607 INFO:tasks.workunit.client.0.smithi071.stderr: -40> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.5 2024-09-14T11:31:00.607 INFO:tasks.workunit.client.0.smithi071.stderr: -39> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.5 2024-09-14T11:31:00.607 INFO:tasks.workunit.client.0.smithi071.stderr: -38> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.6 2024-09-14T11:31:00.607 INFO:tasks.workunit.client.0.smithi071.stderr: -37> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.6 2024-09-14T11:31:00.607 INFO:tasks.workunit.client.0.smithi071.stderr: -36> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.7 2024-09-14T11:31:00.607 INFO:tasks.workunit.client.0.smithi071.stderr: -35> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.7 2024-09-14T11:31:00.607 INFO:tasks.workunit.client.0.smithi071.stderr: -34> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.8 2024-09-14T11:31:00.607 INFO:tasks.workunit.client.0.smithi071.stderr: -33> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.8 2024-09-14T11:31:00.608 INFO:tasks.workunit.client.0.smithi071.stderr: -32> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.9 2024-09-14T11:31:00.608 INFO:tasks.workunit.client.0.smithi071.stderr: -31> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.9 2024-09-14T11:31:00.608 INFO:tasks.workunit.client.0.smithi071.stderr: -30> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.10 2024-09-14T11:31:00.608 INFO:tasks.workunit.client.0.smithi071.stderr: -29> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.10 2024-09-14T11:31:00.608 INFO:tasks.workunit.client.0.smithi071.stderr: -28> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.11 2024-09-14T11:31:00.608 INFO:tasks.workunit.client.0.smithi071.stderr: -27> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1.11 2024-09-14T11:31:00.608 INFO:tasks.workunit.client.0.smithi071.stderr: -26> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.0 2024-09-14T11:31:00.608 INFO:tasks.workunit.client.0.smithi071.stderr: -25> 2024-09-14T11:31:00.475+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1 2024-09-14T11:31:00.608 INFO:tasks.workunit.client.0.smithi071.stderr: -24> 2024-09-14T11:31:00.479+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.2 2024-09-14T11:31:00.608 INFO:tasks.workunit.client.0.smithi071.stderr: -23> 2024-09-14T11:31:00.479+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.3 2024-09-14T11:31:00.608 INFO:tasks.workunit.client.0.smithi071.stderr: -22> 2024-09-14T11:31:00.479+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.4 2024-09-14T11:31:00.608 INFO:tasks.workunit.client.0.smithi071.stderr: -21> 2024-09-14T11:31:00.479+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.5 2024-09-14T11:31:00.608 INFO:tasks.workunit.client.0.smithi071.stderr: -20> 2024-09-14T11:31:00.479+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.6 2024-09-14T11:31:00.608 INFO:tasks.workunit.client.0.smithi071.stderr: -19> 2024-09-14T11:31:00.483+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.7 2024-09-14T11:31:00.608 INFO:tasks.workunit.client.0.smithi071.stderr: -18> 2024-09-14T11:31:00.483+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.8 2024-09-14T11:31:00.609 INFO:tasks.workunit.client.0.smithi071.stderr: -17> 2024-09-14T11:31:00.483+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.9 2024-09-14T11:31:00.609 INFO:tasks.workunit.client.0.smithi071.stderr: -16> 2024-09-14T11:31:00.483+0000 7fb9aed079c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.10 2024-09-14T11:31:00.609 INFO:tasks.workunit.client.0.smithi071.stderr: -15> 2024-09-14T11:31:00.491+0000 7fb9aed079c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:00.609 INFO:tasks.workunit.client.0.smithi071.stderr: -14> 2024-09-14T11:31:00.491+0000 7fb9aed079c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 2024-09-14T11:31:00.609 INFO:tasks.workunit.client.0.smithi071.stderr: -13> 2024-09-14T11:31:00.495+0000 7fb9aed079c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 info.flags=0x17 2024-09-14T11:31:00.609 INFO:tasks.workunit.client.0.smithi071.stderr: -12> 2024-09-14T11:31:00.495+0000 7fb9aed079c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 to cache LRU end 2024-09-14T11:31:00.609 INFO:tasks.workunit.client.0.smithi071.stderr: -11> 2024-09-14T11:31:00.495+0000 7fb9aed079c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:00.609 INFO:tasks.workunit.client.0.smithi071.stderr: -10> 2024-09-14T11:31:00.495+0000 7fb9aed079c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30, ofs0, ns] 2024-09-14T11:31:00.609 INFO:tasks.workunit.client.0.smithi071.stderr: -9> 2024-09-14T11:31:00.495+0000 7fb8837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464373 cookie 94424713093536 notifier 7035 bl.length()=999 2024-09-14T11:31:00.609 INFO:tasks.workunit.client.0.smithi071.stderr: -8> 2024-09-14T11:31:00.495+0000 7fb8837fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 info.flags=0x17 2024-09-14T11:31:00.609 INFO:tasks.workunit.client.0.smithi071.stderr: -7> 2024-09-14T11:31:00.495+0000 7fb8837fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 to cache LRU end 2024-09-14T11:31:00.609 INFO:tasks.workunit.client.0.smithi071.stderr: -6> 2024-09-14T11:31:00.495+0000 7fb8837fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:00.609 INFO:tasks.workunit.client.0.smithi071.stderr: -5> 2024-09-14T11:31:00.495+0000 7fb9aed079c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.30]): orig_sources= new_sources= 2024-09-14T11:31:00.609 INFO:tasks.workunit.client.0.smithi071.stderr: -4> 2024-09-14T11:31:00.495+0000 7fb9aed079c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.30]): potential sources added=[] removed=[] 2024-09-14T11:31:00.610 INFO:tasks.workunit.client.0.smithi071.stderr: -3> 2024-09-14T11:31:00.495+0000 7fb9aed079c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.30]): orig_dests= new_dests= 2024-09-14T11:31:00.610 INFO:tasks.workunit.client.0.smithi071.stderr: -2> 2024-09-14T11:31:00.495+0000 7fb9aed079c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.30]): potential dests added=[] removed=[] 2024-09-14T11:31:00.610 INFO:tasks.workunit.client.0.smithi071.stderr: -1> 2024-09-14T11:31:00.495+0000 7fb9aed079c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb9aed079c0 time 2024-09-14T11:31:00.499531+0000 2024-09-14T11:31:00.610 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:31:00.610 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.610 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:00.610 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fb9b25e12eb] 2024-09-14T11:31:00.610 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb9b25e149f] 2024-09-14T11:31:00.610 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e0f4752c01] 2024-09-14T11:31:00.610 INFO:tasks.workunit.client.0.smithi071.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55e0f476729b] 2024-09-14T11:31:00.610 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55e0f4768884] 2024-09-14T11:31:00.610 INFO:tasks.workunit.client.0.smithi071.stderr: 6: main() 2024-09-14T11:31:00.610 INFO:tasks.workunit.client.0.smithi071.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb9b1447d90] 2024-09-14T11:31:00.610 INFO:tasks.workunit.client.0.smithi071.stderr: 8: __libc_start_main() 2024-09-14T11:31:00.610 INFO:tasks.workunit.client.0.smithi071.stderr: 9: _start() 2024-09-14T11:31:00.611 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.611 INFO:tasks.workunit.client.0.smithi071.stderr: 0> 2024-09-14T11:31:00.495+0000 7fb9aed079c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:31:00.611 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7fb9aed079c0 thread_name:radosgw-admin 2024-09-14T11:31:00.611 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.611 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:00.611 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fb9b1460520] 2024-09-14T11:31:00.611 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:31:00.611 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:31:00.611 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:31:00.611 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fb9b25e1345] 2024-09-14T11:31:00.611 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb9b25e149f] 2024-09-14T11:31:00.611 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e0f4752c01] 2024-09-14T11:31:00.611 INFO:tasks.workunit.client.0.smithi071.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55e0f476729b] 2024-09-14T11:31:00.611 INFO:tasks.workunit.client.0.smithi071.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55e0f4768884] 2024-09-14T11:31:00.611 INFO:tasks.workunit.client.0.smithi071.stderr: 10: main() 2024-09-14T11:31:00.611 INFO:tasks.workunit.client.0.smithi071.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb9b1447d90] 2024-09-14T11:31:00.612 INFO:tasks.workunit.client.0.smithi071.stderr: 12: __libc_start_main() 2024-09-14T11:31:00.612 INFO:tasks.workunit.client.0.smithi071.stderr: 13: _start() 2024-09-14T11:31:00.612 INFO:tasks.workunit.client.0.smithi071.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:31:00.612 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.612 INFO:tasks.workunit.client.0.smithi071.stderr:--- logging levels --- 2024-09-14T11:31:00.612 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 none 2024-09-14T11:31:00.612 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 lockdep 2024-09-14T11:31:00.612 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 context 2024-09-14T11:31:00.612 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 crush 2024-09-14T11:31:00.612 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds 2024-09-14T11:31:00.612 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_balancer 2024-09-14T11:31:00.612 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_locker 2024-09-14T11:31:00.612 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log 2024-09-14T11:31:00.612 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log_expire 2024-09-14T11:31:00.612 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_migrator 2024-09-14T11:31:00.613 INFO:tasks.workunit.client.0.smithi071.stderr: 3/ 5 mds_quiesce 2024-09-14T11:31:00.613 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 buffer 2024-09-14T11:31:00.613 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 timer 2024-09-14T11:31:00.613 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 filer 2024-09-14T11:31:00.613 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 striper 2024-09-14T11:31:00.613 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 objecter 2024-09-14T11:31:00.613 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rados 2024-09-14T11:31:00.613 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd 2024-09-14T11:31:00.613 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_mirror 2024-09-14T11:31:00.613 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_replay 2024-09-14T11:31:00.613 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_pwl 2024-09-14T11:31:00.613 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 journaler 2024-09-14T11:31:00.613 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objectcacher 2024-09-14T11:31:00.613 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:31:00.613 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 client 2024-09-14T11:31:00.613 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 osd 2024-09-14T11:31:00.614 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 optracker 2024-09-14T11:31:00.614 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objclass 2024-09-14T11:31:00.614 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 filestore 2024-09-14T11:31:00.614 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 journal 2024-09-14T11:31:00.614 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 ms 2024-09-14T11:31:00.614 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mon 2024-09-14T11:31:00.614 INFO:tasks.workunit.client.0.smithi071.stderr: 0/10 monc 2024-09-14T11:31:00.614 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 paxos 2024-09-14T11:31:00.614 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 tp 2024-09-14T11:31:00.614 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 auth 2024-09-14T11:31:00.614 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 crypto 2024-09-14T11:31:00.614 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 finisher 2024-09-14T11:31:00.614 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 reserver 2024-09-14T11:31:00.614 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 heartbeatmap 2024-09-14T11:31:00.614 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 perfcounter 2024-09-14T11:31:00.614 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw 2024-09-14T11:31:00.615 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_sync 2024-09-14T11:31:00.615 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_datacache 2024-09-14T11:31:00.615 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_access 2024-09-14T11:31:00.615 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:31:00.615 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_flight 2024-09-14T11:31:00.615 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:31:00.615 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw_notification 2024-09-14T11:31:00.615 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 javaclient 2024-09-14T11:31:00.615 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 asok 2024-09-14T11:31:00.615 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 throttle 2024-09-14T11:31:00.615 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 refs 2024-09-14T11:31:00.615 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 compressor 2024-09-14T11:31:00.615 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluestore 2024-09-14T11:31:00.615 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluefs 2024-09-14T11:31:00.615 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 bdev 2024-09-14T11:31:00.616 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 kstore 2024-09-14T11:31:00.616 INFO:tasks.workunit.client.0.smithi071.stderr: 4/ 5 rocksdb 2024-09-14T11:31:00.616 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 fuse 2024-09-14T11:31:00.616 INFO:tasks.workunit.client.0.smithi071.stderr: 2/ 5 mgr 2024-09-14T11:31:00.616 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mgrc 2024-09-14T11:31:00.616 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 dpdk 2024-09-14T11:31:00.616 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 eventtrace 2024-09-14T11:31:00.616 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 prioritycache 2024-09-14T11:31:00.616 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 test 2024-09-14T11:31:00.616 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:31:00.616 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephsqlite 2024-09-14T11:31:00.616 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:31:00.616 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore 2024-09-14T11:31:00.616 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_onode 2024-09-14T11:31:00.616 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_odata 2024-09-14T11:31:00.616 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_omap 2024-09-14T11:31:00.617 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_tm 2024-09-14T11:31:00.617 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_t 2024-09-14T11:31:00.617 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:31:00.617 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_epm 2024-09-14T11:31:00.617 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_lba 2024-09-14T11:31:00.617 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:31:00.617 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cache 2024-09-14T11:31:00.617 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_journal 2024-09-14T11:31:00.617 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_device 2024-09-14T11:31:00.617 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_backref 2024-09-14T11:31:00.617 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 alienstore 2024-09-14T11:31:00.617 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mclock 2024-09-14T11:31:00.617 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cyanstore 2024-09-14T11:31:00.617 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 ceph_exporter 2024-09-14T11:31:00.617 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 memstore 2024-09-14T11:31:00.617 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 trace 2024-09-14T11:31:00.618 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 ceph_dedup 2024-09-14T11:31:00.618 INFO:tasks.workunit.client.0.smithi071.stderr: -2/-2 (syslog threshold) 2024-09-14T11:31:00.618 INFO:tasks.workunit.client.0.smithi071.stderr: 99/99 (stderr threshold) 2024-09-14T11:31:00.618 INFO:tasks.workunit.client.0.smithi071.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:31:00.618 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb7d37fe640 / http_manager 2024-09-14T11:31:00.618 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb861fe3640 / http_manager 2024-09-14T11:31:00.618 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb862fe5640 / rgw_dt_lg_renew 2024-09-14T11:31:00.618 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb8827fc640 / ms_dispatch 2024-09-14T11:31:00.618 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb8837fe640 / io_context_pool 2024-09-14T11:31:00.618 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb883fff640 / io_context_pool 2024-09-14T11:31:00.618 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb8927fc640 / ms_dispatch 2024-09-14T11:31:00.618 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb89960a640 / ms_dispatch 2024-09-14T11:31:00.618 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb89ae0d640 / io_context_pool 2024-09-14T11:31:00.618 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb9ac00c640 / msgr-worker-2 2024-09-14T11:31:00.618 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb9ac80d640 / msgr-worker-1 2024-09-14T11:31:00.619 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb9ad00e640 / msgr-worker-0 2024-09-14T11:31:00.619 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb9ad80f640 / io_context_pool 2024-09-14T11:31:00.619 INFO:tasks.workunit.client.0.smithi071.stderr: 7fb9aed079c0 / radosgw-admin 2024-09-14T11:31:00.619 INFO:tasks.workunit.client.0.smithi071.stderr: max_recent 500 2024-09-14T11:31:00.619 INFO:tasks.workunit.client.0.smithi071.stderr: max_new 1000 2024-09-14T11:31:00.619 INFO:tasks.workunit.client.0.smithi071.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:31:00.501918Z_e56e360a-7ad5-4bb8-a33a-00ce03cc5e24/log 2024-09-14T11:31:00.619 INFO:tasks.workunit.client.0.smithi071.stderr:--- end dump of recent events --- 2024-09-14T11:31:00.619 INFO:tasks.workunit.client.0.smithi071.stderr:Aborted 2024-09-14T11:31:00.619 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:31:00.620 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:00.620 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:00.620 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.579+0000 7fc5de0669c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.620 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.583+0000 7fc5de0669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:00.621 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.583+0000 7fc5de0669c0 20 realm 2024-09-14T11:31:00.621 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.583+0000 7fc5de0669c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.621 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.583+0000 7fc5de0669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:00.621 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.583+0000 7fc5de0669c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:00.621 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.583+0000 7fc5de0669c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.621 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.583+0000 7fc5de0669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:00.621 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.583+0000 7fc5de0669c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.621 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.583+0000 7fc5de0669c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:00.621 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.583+0000 7fc5de0669c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.621 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.583+0000 7fc5de0669c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:00.621 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.583+0000 7fc5de0669c0 20 searching for the correct realm 2024-09-14T11:31:00.621 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.587+0000 7fc5dc36d640 0 -- 172.21.15.71:0/2924342341 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fc5d00f0910 msgr2=0x7fc5d00aa3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:00.800 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.799+0000 7fc5dc36d640 0 -- 172.21.15.71:0/2924342341 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55a4aaa8c2a0 msgr2=0x55a4aaa8e690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:00.815 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.815+0000 7fc5de0669c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:00.815 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.815+0000 7fc5de0669c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:31:00.815 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.815+0000 7fc5de0669c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:00.815 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.815+0000 7fc5de0669c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:31:00.815 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.815+0000 7fc5de0669c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:00.815 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.815+0000 7fc5de0669c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:00.816 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.815+0000 7fc5de0669c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.816 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.815+0000 7fc5de0669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:00.816 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.815+0000 7fc5de0669c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.817 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.819+0000 7fc5de0669c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:00.817 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.819+0000 7fc5de0669c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.818 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.819+0000 7fc5de0669c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:00.818 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.819+0000 7fc5de0669c0 20 zone default found 2024-09-14T11:31:00.818 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.819+0000 7fc5de0669c0 4 Realm: () 2024-09-14T11:31:00.818 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.819+0000 7fc5de0669c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:31:00.818 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.819+0000 7fc5de0669c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:31:00.818 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.819+0000 7fc5de0669c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:00.818 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.819+0000 7fc5de0669c0 20 zonegroup default 2024-09-14T11:31:00.818 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.819+0000 7fc5de0669c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.818 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.819+0000 7fc5de0669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:00.819 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.819+0000 7fc5de0669c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.820 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.819+0000 7fc5de0669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:00.820 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.819+0000 7fc5de0669c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.821 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.823+0000 7fc5de0669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:00.821 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.823+0000 7fc5de0669c0 20 started sync module instance, tier type = 2024-09-14T11:31:00.821 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.823+0000 7fc5de0669c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:31:00.845 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.847+0000 7fc5de0669c0 20 add_watcher() i=0 2024-09-14T11:31:00.845 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.847+0000 7fc5de0669c0 20 add_watcher() i=1 2024-09-14T11:31:00.845 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.847+0000 7fc5de0669c0 20 add_watcher() i=2 2024-09-14T11:31:00.845 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.847+0000 7fc5de0669c0 20 add_watcher() i=3 2024-09-14T11:31:00.845 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.847+0000 7fc5de0669c0 20 add_watcher() i=4 2024-09-14T11:31:00.845 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.847+0000 7fc5de0669c0 20 add_watcher() i=5 2024-09-14T11:31:00.845 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.847+0000 7fc5de0669c0 20 add_watcher() i=6 2024-09-14T11:31:00.848 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.847+0000 7fc5de0669c0 20 add_watcher() i=7 2024-09-14T11:31:00.848 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.847+0000 7fc5de0669c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:00.852 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.851+0000 7fc491fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:00.853 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.855+0000 7fc5de0669c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:00.853 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.855+0000 7fc5de0669c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:00.853 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.855+0000 7fc5de0669c0 5 note: GC not initialized 2024-09-14T11:31:00.853 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.855+0000 7fc490fe1640 20 reqs_thread_entry: start 2024-09-14T11:31:00.854 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.855+0000 7fc5de0669c0 20 init_complete bucket index max shards: 11 2024-09-14T11:31:00.854 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.855+0000 7fc5de0669c0 20 Filter name: none 2024-09-14T11:31:00.854 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.855+0000 7fc40a7fc640 20 reqs_thread_entry: start 2024-09-14T11:31:00.854 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.855+0000 7fc5de0669c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.855 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.855+0000 7fc5de0669c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:31:00.855 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.855+0000 7fc5de0669c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.856 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.855+0000 7fc5de0669c0 20 rados_obj.operate() r=0 bl.length=467 2024-09-14T11:31:00.856 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.855+0000 7fc5de0669c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:00.856 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.855+0000 7fc5de0669c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.857 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.859+0000 7fc5de0669c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:31:00.857 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.859+0000 7fc5de0669c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:00.857 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.859+0000 7fc5de0669c0 20 rados_obj.operate() r=0 bl.length=467 2024-09-14T11:31:00.857 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.859+0000 7fc5de0669c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:00.861 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.863+0000 7fc491fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:00.865 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.867+0000 7fc5de0669c0 20 remove_watcher() i=0 2024-09-14T11:31:00.865 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.867+0000 7fc5de0669c0 2 removed watcher, disabling cache 2024-09-14T11:31:00.867 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.867+0000 7fc5de0669c0 20 remove_watcher() i=1 2024-09-14T11:31:00.869 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.871+0000 7fc5de0669c0 20 remove_watcher() i=2 2024-09-14T11:31:00.871 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.871+0000 7fc5de0669c0 20 remove_watcher() i=3 2024-09-14T11:31:00.874 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.875+0000 7fc5de0669c0 20 remove_watcher() i=4 2024-09-14T11:31:00.876 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.875+0000 7fc5de0669c0 20 remove_watcher() i=5 2024-09-14T11:31:00.879 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.879+0000 7fc5de0669c0 20 remove_watcher() i=6 2024-09-14T11:31:00.881 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:00.883+0000 7fc5de0669c0 20 remove_watcher() i=7 2024-09-14T11:31:00.898 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.898 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:31:00.898 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: abort-at-block-writes id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:31:00.898 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:00.958 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:31:00.994 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:00.994 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:01.041 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.043+0000 7f55dd36f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:01.044 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.043+0000 7f55dd36f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:01.044 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.043+0000 7f55dd36f9c0 20 realm 2024-09-14T11:31:01.044 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.043+0000 7f55dd36f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:01.044 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.043+0000 7f55dd36f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:01.045 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.043+0000 7f55dd36f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:01.045 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.043+0000 7f55dd36f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:01.045 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.043+0000 7f55dd36f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:01.045 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.043+0000 7f55dd36f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:01.045 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.047+0000 7f55dd36f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:01.045 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.047+0000 7f55dd36f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:01.046 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.047+0000 7f55dd36f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:01.046 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.047+0000 7f55dd36f9c0 20 searching for the correct realm 2024-09-14T11:31:01.050 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.051+0000 7f55db676640 0 -- 172.21.15.71:0/3951494856 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f55c4038040 msgr2=0x7f55c4039940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:01.265 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.267+0000 7f55db676640 0 -- 172.21.15.71:0/3951494856 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55e699889a00 msgr2=0x55e69988bdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:01.279 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.279+0000 7f55dd36f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:01.279 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.279+0000 7f55dd36f9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:31:01.279 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.279+0000 7f55dd36f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:01.280 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.279+0000 7f55dd36f9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:31:01.280 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.279+0000 7f55dd36f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:01.280 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.279+0000 7f55dd36f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:01.280 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.279+0000 7f55dd36f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:01.280 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.279+0000 7f55dd36f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:01.280 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.279+0000 7f55dd36f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:01.281 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.283+0000 7f55dd36f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:01.281 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.283+0000 7f55dd36f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:01.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.283+0000 7f55dd36f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:01.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.283+0000 7f55dd36f9c0 20 zone default found 2024-09-14T11:31:01.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.283+0000 7f55dd36f9c0 4 Realm: () 2024-09-14T11:31:01.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.283+0000 7f55dd36f9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:31:01.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.283+0000 7f55dd36f9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:31:01.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.283+0000 7f55dd36f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:01.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.283+0000 7f55dd36f9c0 20 zonegroup default 2024-09-14T11:31:01.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.283+0000 7f55dd36f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:01.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.283+0000 7f55dd36f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:01.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.283+0000 7f55dd36f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:01.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.283+0000 7f55dd36f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:01.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.283+0000 7f55dd36f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:01.284 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.283+0000 7f55dd36f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:01.284 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.283+0000 7f55dd36f9c0 20 started sync module instance, tier type = 2024-09-14T11:31:01.284 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.283+0000 7f55dd36f9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:31:01.305 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.307+0000 7f55dd36f9c0 20 add_watcher() i=0 2024-09-14T11:31:01.305 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.307+0000 7f55dd36f9c0 20 add_watcher() i=1 2024-09-14T11:31:01.305 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.307+0000 7f55dd36f9c0 20 add_watcher() i=2 2024-09-14T11:31:01.305 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.307+0000 7f55dd36f9c0 20 add_watcher() i=3 2024-09-14T11:31:01.305 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.307+0000 7f55dd36f9c0 20 add_watcher() i=4 2024-09-14T11:31:01.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.307+0000 7f55dd36f9c0 20 add_watcher() i=5 2024-09-14T11:31:01.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.307+0000 7f55dd36f9c0 20 add_watcher() i=6 2024-09-14T11:31:01.308 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.307+0000 7f55dd36f9c0 20 add_watcher() i=7 2024-09-14T11:31:01.308 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.307+0000 7f55dd36f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:01.312 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.311+0000 7f54917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:01.313 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.315+0000 7f55dd36f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:01.313 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.315+0000 7f55dd36f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:01.313 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.315+0000 7f55dd36f9c0 5 note: GC not initialized 2024-09-14T11:31:01.314 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.315+0000 7f540bfff640 20 reqs_thread_entry: start 2024-09-14T11:31:01.314 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.315+0000 7f55dd36f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:31:01.314 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.315+0000 7f55dd36f9c0 20 Filter name: none 2024-09-14T11:31:01.314 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.315+0000 7f5409ffb640 20 reqs_thread_entry: start 2024-09-14T11:31:01.314 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.315+0000 7f55dd36f9c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:31:01.314 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.315+0000 7f55dd36f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:01.316 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.315+0000 7f55dd36f9c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:31:01.316 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.315+0000 7f55dd36f9c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:31:01.316 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.315+0000 7f55dd36f9c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:31:01.316 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.315+0000 7f55dd36f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 : miss 2024-09-14T11:31:01.316 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.315+0000 7f55dd36f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:01.316 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.315+0000 7f55dd36f9c0 20 rados_obj.operate() r=0 bl.length=467 2024-09-14T11:31:01.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.315+0000 7f55dd36f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 info.flags=0x17 2024-09-14T11:31:01.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.315+0000 7f55dd36f9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 to cache LRU end 2024-09-14T11:31:01.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.315+0000 7f55dd36f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:31:01.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.315+0000 7f55dd36f9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:01.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.315+0000 7f55dd36f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 2024-09-14T11:31:01.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.319+0000 7f55dd36f9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 to be held by another RGW process; skipping for now 2024-09-14T11:31:01.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.319+0000 7f54917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:01.324 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.323+0000 7f55dd36f9c0 20 remove_watcher() i=0 2024-09-14T11:31:01.324 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.323+0000 7f55dd36f9c0 2 removed watcher, disabling cache 2024-09-14T11:31:01.326 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.327+0000 7f55dd36f9c0 20 remove_watcher() i=1 2024-09-14T11:31:01.328 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.327+0000 7f55dd36f9c0 20 remove_watcher() i=2 2024-09-14T11:31:01.331 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.331+0000 7f55dd36f9c0 20 remove_watcher() i=3 2024-09-14T11:31:01.333 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.335+0000 7f55dd36f9c0 20 remove_watcher() i=4 2024-09-14T11:31:01.335 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.335+0000 7f55dd36f9c0 20 remove_watcher() i=5 2024-09-14T11:31:01.338 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.339+0000 7f55dd36f9c0 20 remove_watcher() i=6 2024-09-14T11:31:01.341 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:01.343+0000 7f55dd36f9c0 20 remove_watcher() i=7 2024-09-14T11:31:01.359 INFO:tasks.workunit.client.0.smithi071.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:31:31.371 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:31:31.407 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:31.407 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:31.453 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.451+0000 7efc405299c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.455 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.455+0000 7efc405299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:31.455 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.455+0000 7efc405299c0 20 realm 2024-09-14T11:31:31.455 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.455+0000 7efc405299c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.455+0000 7efc405299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:31.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.455+0000 7efc405299c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:31.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.455+0000 7efc405299c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.455+0000 7efc405299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:31.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.455+0000 7efc405299c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.455+0000 7efc405299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:31.458 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.455+0000 7efc405299c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.458 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.459+0000 7efc405299c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:31.458 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.459+0000 7efc405299c0 20 searching for the correct realm 2024-09-14T11:31:31.461 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.463+0000 7efc3e830640 0 -- 172.21.15.71:0/1416330064 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7efc34058b30 msgr2=0x7efc34065f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:31.468 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.467+0000 7efc3e830640 0 -- 172.21.15.71:0/1416330064 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55be97d390e0 msgr2=0x55be97d3b4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:31.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.479+0000 7efc405299c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:31.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.479+0000 7efc405299c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:31:31.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.479+0000 7efc405299c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:31.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.479+0000 7efc405299c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:31:31.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.479+0000 7efc405299c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:31.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.479+0000 7efc405299c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:31.478 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.479+0000 7efc405299c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.479 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.479+0000 7efc405299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:31.479 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.479+0000 7efc405299c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.479 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.479+0000 7efc405299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:31.479 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.479+0000 7efc405299c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.479 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.479+0000 7efc405299c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:31.480 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.479+0000 7efc405299c0 20 zone default found 2024-09-14T11:31:31.480 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.479+0000 7efc405299c0 4 Realm: () 2024-09-14T11:31:31.480 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.479+0000 7efc405299c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:31:31.480 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.479+0000 7efc405299c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:31:31.480 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.479+0000 7efc405299c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:31.480 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.479+0000 7efc405299c0 20 zonegroup default 2024-09-14T11:31:31.480 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.479+0000 7efc405299c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.480 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.479+0000 7efc405299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:31.480 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.479+0000 7efc405299c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.481 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.479+0000 7efc405299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:31.481 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.479+0000 7efc405299c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.479+0000 7efc405299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:31.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.479+0000 7efc405299c0 20 started sync module instance, tier type = 2024-09-14T11:31:31.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.479+0000 7efc405299c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:31:31.498 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.499+0000 7efc405299c0 20 add_watcher() i=0 2024-09-14T11:31:31.499 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.499+0000 7efc405299c0 20 add_watcher() i=1 2024-09-14T11:31:31.499 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.499+0000 7efc405299c0 20 add_watcher() i=2 2024-09-14T11:31:31.499 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.499+0000 7efc405299c0 20 add_watcher() i=3 2024-09-14T11:31:31.499 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.499+0000 7efc405299c0 20 add_watcher() i=4 2024-09-14T11:31:31.499 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.499+0000 7efc405299c0 20 add_watcher() i=5 2024-09-14T11:31:31.499 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.499+0000 7efc405299c0 20 add_watcher() i=6 2024-09-14T11:31:31.501 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.503+0000 7efc405299c0 20 add_watcher() i=7 2024-09-14T11:31:31.501 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.503+0000 7efc405299c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:31.505 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.503+0000 7efaf4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:31.506 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.507+0000 7efc405299c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:31.506 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.507+0000 7efc405299c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:31.506 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.507+0000 7efc405299c0 5 note: GC not initialized 2024-09-14T11:31:31.506 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.507+0000 7efa6f7fe640 20 reqs_thread_entry: start 2024-09-14T11:31:31.506 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.507+0000 7efc405299c0 20 init_complete bucket index max shards: 11 2024-09-14T11:31:31.506 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.507+0000 7efc405299c0 20 Filter name: none 2024-09-14T11:31:31.506 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.507+0000 7efa6d7fa640 20 reqs_thread_entry: start 2024-09-14T11:31:31.507 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.507+0000 7efc405299c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:31:31.507 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.507+0000 7efc405299c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.508 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.507+0000 7efc405299c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:31:31.508 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.507+0000 7efc405299c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:31:31.508 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.507+0000 7efc405299c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:31:31.508 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.507+0000 7efc405299c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 : miss 2024-09-14T11:31:31.508 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.507+0000 7efc405299c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.508 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.507+0000 7efc405299c0 20 rados_obj.operate() r=0 bl.length=467 2024-09-14T11:31:31.508 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.507+0000 7efc405299c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 info.flags=0x17 2024-09-14T11:31:31.509 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.507+0000 7efc405299c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 to cache LRU end 2024-09-14T11:31:31.509 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.507+0000 7efc405299c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:31:31.509 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.507+0000 7efc405299c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:31.509 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.507+0000 7efc405299c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 2024-09-14T11:31:31.509 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.507+0000 7efc405299c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:31:31.521 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.523+0000 7efc405299c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 info.flags=0x17 2024-09-14T11:31:31.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.523+0000 7efc405299c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 to cache LRU end 2024-09-14T11:31:31.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.523+0000 7efc405299c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:31.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.523+0000 7efc405299c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30, ofs0, ns] 2024-09-14T11:31:31.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.523+0000 7efb217fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464374 cookie 94277079405200 notifier 6746 bl.length()=999 2024-09-14T11:31:31.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.523+0000 7efb217fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 info.flags=0x17 2024-09-14T11:31:31.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.523+0000 7efb217fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 to cache LRU end 2024-09-14T11:31:31.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.523+0000 7efb217fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:31.523 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.523+0000 7efc405299c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.30]): orig_sources= new_sources= 2024-09-14T11:31:31.523 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.523+0000 7efc405299c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.30]): potential sources added=[] removed=[] 2024-09-14T11:31:31.523 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.523+0000 7efc405299c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.30]): orig_dests= new_dests= 2024-09-14T11:31:31.523 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.523+0000 7efc405299c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.30]): potential dests added=[] removed=[] 2024-09-14T11:31:31.532 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.531+0000 7efc405299c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.2.0 2024-09-14T11:31:31.533 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.531+0000 7efc405299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.2.0 2024-09-14T11:31:31.533 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.531+0000 7efc405299c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.2.1 2024-09-14T11:31:31.533 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.531+0000 7efc405299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.2.1 2024-09-14T11:31:31.533 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.531+0000 7efc405299c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.2.2 2024-09-14T11:31:31.533 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.531+0000 7efc405299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.2.2 2024-09-14T11:31:31.533 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.531+0000 7efc405299c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.2.3 2024-09-14T11:31:31.533 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.531+0000 7efc405299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.2.3 2024-09-14T11:31:31.533 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.531+0000 7efc405299c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.2.4 2024-09-14T11:31:31.534 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.531+0000 7efc405299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.2.4 2024-09-14T11:31:31.534 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.531+0000 7efc405299c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.2.5 2024-09-14T11:31:31.534 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.531+0000 7efc405299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.2.5 2024-09-14T11:31:31.534 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.531+0000 7efc405299c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.2.6 2024-09-14T11:31:31.534 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.531+0000 7efc405299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.2.6 2024-09-14T11:31:31.534 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.531+0000 7efc405299c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.2.7 2024-09-14T11:31:31.534 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.531+0000 7efc405299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.2.7 2024-09-14T11:31:31.534 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.531+0000 7efc405299c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.2.8 2024-09-14T11:31:31.534 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.531+0000 7efc405299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.2.8 2024-09-14T11:31:31.535 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.531+0000 7efc405299c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.2.9 2024-09-14T11:31:31.535 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.531+0000 7efc405299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.2.9 2024-09-14T11:31:31.535 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.531+0000 7efc405299c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.2.10 2024-09-14T11:31:31.535 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.531+0000 7efc405299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.2.10 2024-09-14T11:31:31.535 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.531+0000 7efc405299c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.2.11 2024-09-14T11:31:31.535 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.531+0000 7efc405299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.2.11 2024-09-14T11:31:31.535 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.531+0000 7efc405299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.0 2024-09-14T11:31:31.535 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.531+0000 7efc405299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1 2024-09-14T11:31:31.536 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.535+0000 7efc405299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.2 2024-09-14T11:31:31.537 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.535+0000 7efc405299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.3 2024-09-14T11:31:31.537 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.535+0000 7efc405299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.4 2024-09-14T11:31:31.537 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.535+0000 7efc405299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.5 2024-09-14T11:31:31.537 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.535+0000 7efc405299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.6 2024-09-14T11:31:31.537 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.535+0000 7efc405299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.7 2024-09-14T11:31:31.538 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.539+0000 7efc405299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.8 2024-09-14T11:31:31.538 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.539+0000 7efc405299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.9 2024-09-14T11:31:31.539 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.539+0000 7efc405299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.10 2024-09-14T11:31:31.544 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.543+0000 7efc405299c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:31.545 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.543+0000 7efc405299c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 2024-09-14T11:31:31.546 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.547+0000 7efc405299c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 info.flags=0x17 2024-09-14T11:31:31.546 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.547+0000 7efc405299c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 to cache LRU end 2024-09-14T11:31:31.546 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.547+0000 7efc405299c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:31.547 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.547+0000 7efc405299c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30, ofs0, ns] 2024-09-14T11:31:31.547 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.547+0000 7efb21ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464375 cookie 94277079405200 notifier 6746 bl.length()=999 2024-09-14T11:31:31.547 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.547+0000 7efb21ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 info.flags=0x17 2024-09-14T11:31:31.547 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.547+0000 7efb21ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 to cache LRU end 2024-09-14T11:31:31.547 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.547+0000 7efb21ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:31.547 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.547+0000 7efc405299c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.30]): orig_sources= new_sources= 2024-09-14T11:31:31.548 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.547+0000 7efc405299c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.30]): potential sources added=[] removed=[] 2024-09-14T11:31:31.548 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.547+0000 7efc405299c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.30]): orig_dests= new_dests= 2024-09-14T11:31:31.548 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.547+0000 7efc405299c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.30]): potential dests added=[] removed=[] 2024-09-14T11:31:31.551 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.551+0000 7efc405299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.0 2024-09-14T11:31:31.551 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.551+0000 7efc405299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.1 2024-09-14T11:31:31.552 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.551+0000 7efc405299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.2 2024-09-14T11:31:31.553 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.551+0000 7efc405299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.3 2024-09-14T11:31:31.553 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.555+0000 7efc405299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.4 2024-09-14T11:31:31.554 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.555+0000 7efc405299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.5 2024-09-14T11:31:31.554 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.555+0000 7efc405299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.6 2024-09-14T11:31:31.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.555+0000 7efc405299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.7 2024-09-14T11:31:31.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.555+0000 7efc405299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.8 2024-09-14T11:31:31.556 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.555+0000 7efc405299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.9 2024-09-14T11:31:31.556 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.555+0000 7efc405299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.30.10 2024-09-14T11:31:31.557 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.559+0000 7efc405299c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:31.557 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.559+0000 7efc405299c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 2024-09-14T11:31:31.558 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.559+0000 7efc405299c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 info.flags=0x17 2024-09-14T11:31:31.559 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.559+0000 7efc405299c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 to cache LRU end 2024-09-14T11:31:31.559 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.559+0000 7efc405299c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:31.559 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.559+0000 7efc405299c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30, ofs0, ns] 2024-09-14T11:31:31.559 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.559+0000 7efb217fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464376 cookie 94277079405200 notifier 6746 bl.length()=967 2024-09-14T11:31:31.559 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.559+0000 7efb217fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 info.flags=0x17 2024-09-14T11:31:31.559 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.559+0000 7efb217fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.30 to cache LRU end 2024-09-14T11:31:31.559 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.559+0000 7efb217fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:31.560 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.559+0000 7efc405299c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.30]): orig_sources= new_sources= 2024-09-14T11:31:31.560 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.559+0000 7efc405299c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.30]): potential sources added=[] removed=[] 2024-09-14T11:31:31.560 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.559+0000 7efc405299c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.30]): orig_dests= new_dests= 2024-09-14T11:31:31.560 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.559+0000 7efc405299c0 20 handle_bi_update(): bucket=:abort-at-block-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.30]): potential dests added=[] removed=[] 2024-09-14T11:31:31.563 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.563+0000 7efc405299c0 1 execute INFO: reshard of bucket "abort-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:31:31.566 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.567+0000 7efaf4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:31.570 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.571+0000 7efc405299c0 20 remove_watcher() i=0 2024-09-14T11:31:31.570 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.571+0000 7efc405299c0 2 removed watcher, disabling cache 2024-09-14T11:31:31.571 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.571+0000 7efc405299c0 20 remove_watcher() i=1 2024-09-14T11:31:31.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.575+0000 7efc405299c0 20 remove_watcher() i=2 2024-09-14T11:31:31.576 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.575+0000 7efc405299c0 20 remove_watcher() i=3 2024-09-14T11:31:31.578 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.579+0000 7efc405299c0 20 remove_watcher() i=4 2024-09-14T11:31:31.580 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.579+0000 7efc405299c0 20 remove_watcher() i=5 2024-09-14T11:31:31.582 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.583+0000 7efc405299c0 20 remove_watcher() i=6 2024-09-14T11:31:31.585 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.587+0000 7efc405299c0 20 remove_watcher() i=7 2024-09-14T11:31:31.599 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:31:31.627 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:31.627 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:31.670 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.671+0000 7f895ea809c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.673 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.675+0000 7f895ea809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:31.673 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.675+0000 7f895ea809c0 20 realm 2024-09-14T11:31:31.673 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.675+0000 7f895ea809c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.675+0000 7f895ea809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:31.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.675+0000 7f895ea809c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:31.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.675+0000 7f895ea809c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.675+0000 7f895ea809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:31.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.675+0000 7f895ea809c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.675 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.675+0000 7f895ea809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:31.675 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.675+0000 7f895ea809c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.676 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.675+0000 7f895ea809c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:31.676 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.675+0000 7f895ea809c0 20 searching for the correct realm 2024-09-14T11:31:31.679 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.679+0000 7f895cd87640 0 -- 172.21.15.71:0/1305684660 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f8944008040 msgr2=0x7f8944063600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:31.892 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.891+0000 7f895cd87640 0 -- 172.21.15.71:0/1305684660 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55e87a7f5740 msgr2=0x55e87a7f7b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:31.907 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.907+0000 7f895ea809c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:31.907 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.907+0000 7f895ea809c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:31:31.907 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.907+0000 7f895ea809c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:31.908 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.907+0000 7f895ea809c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:31:31.908 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.907+0000 7f895ea809c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:31.908 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.907+0000 7f895ea809c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:31.908 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.907+0000 7f895ea809c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.908 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.907+0000 7f895ea809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:31.909 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.907+0000 7f895ea809c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.909 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.907+0000 7f895ea809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:31.909 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.907+0000 7f895ea809c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.909 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.911+0000 7f895ea809c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:31.909 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.911+0000 7f895ea809c0 20 zone default found 2024-09-14T11:31:31.909 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.911+0000 7f895ea809c0 4 Realm: () 2024-09-14T11:31:31.910 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.911+0000 7f895ea809c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:31:31.910 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.911+0000 7f895ea809c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:31:31.910 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.911+0000 7f895ea809c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:31.910 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.911+0000 7f895ea809c0 20 zonegroup default 2024-09-14T11:31:31.910 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.911+0000 7f895ea809c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.910 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.911+0000 7f895ea809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:31.911 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.911+0000 7f895ea809c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.911 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.911+0000 7f895ea809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:31.911 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.911+0000 7f895ea809c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.912 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.911+0000 7f895ea809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:31.912 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.911+0000 7f895ea809c0 20 started sync module instance, tier type = 2024-09-14T11:31:31.912 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.911+0000 7f895ea809c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:31:31.934 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.935+0000 7f895ea809c0 20 add_watcher() i=0 2024-09-14T11:31:31.935 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.935+0000 7f895ea809c0 20 add_watcher() i=1 2024-09-14T11:31:31.935 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.935+0000 7f895ea809c0 20 add_watcher() i=2 2024-09-14T11:31:31.935 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.935+0000 7f895ea809c0 20 add_watcher() i=3 2024-09-14T11:31:31.935 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.935+0000 7f895ea809c0 20 add_watcher() i=4 2024-09-14T11:31:31.935 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.935+0000 7f895ea809c0 20 add_watcher() i=5 2024-09-14T11:31:31.935 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.935+0000 7f895ea809c0 20 add_watcher() i=6 2024-09-14T11:31:31.937 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.939+0000 7f895ea809c0 20 add_watcher() i=7 2024-09-14T11:31:31.937 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.939+0000 7f895ea809c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:31.941 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.943+0000 7f8812fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:31.942 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.943+0000 7f895ea809c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:31.943 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.943+0000 7f895ea809c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:31.943 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.943+0000 7f895ea809c0 5 note: GC not initialized 2024-09-14T11:31:31.944 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.943+0000 7f8811fdb640 20 reqs_thread_entry: start 2024-09-14T11:31:31.944 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.943+0000 7f895ea809c0 20 init_complete bucket index max shards: 11 2024-09-14T11:31:31.944 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.943+0000 7f895ea809c0 20 Filter name: none 2024-09-14T11:31:31.944 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.943+0000 7f87837fe640 20 reqs_thread_entry: start 2024-09-14T11:31:31.944 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.943+0000 7f895ea809c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.945 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.947+0000 7f895ea809c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:31:31.945 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.947+0000 7f895ea809c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.946 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.947+0000 7f895ea809c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:31:31.946 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.947+0000 7f895ea809c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:31.946 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.947+0000 7f895ea809c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.947 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.947+0000 7f895ea809c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:31:31.947 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.947+0000 7f895ea809c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.948 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.947+0000 7f895ea809c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:31:31.948 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.947+0000 7f895ea809c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:31.950 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.951+0000 7f8812fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:31.954 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.955+0000 7f895ea809c0 20 remove_watcher() i=0 2024-09-14T11:31:31.955 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.955+0000 7f895ea809c0 2 removed watcher, disabling cache 2024-09-14T11:31:31.956 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.955+0000 7f895ea809c0 20 remove_watcher() i=1 2024-09-14T11:31:31.959 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.959+0000 7f895ea809c0 20 remove_watcher() i=2 2024-09-14T11:31:31.960 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.959+0000 7f895ea809c0 20 remove_watcher() i=3 2024-09-14T11:31:31.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.963+0000 7f895ea809c0 20 remove_watcher() i=4 2024-09-14T11:31:31.965 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.967+0000 7f895ea809c0 20 remove_watcher() i=5 2024-09-14T11:31:31.967 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.967+0000 7f895ea809c0 20 remove_watcher() i=6 2024-09-14T11:31:31.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:31.971+0000 7f895ea809c0 20 remove_watcher() i=7 2024-09-14T11:31:31.986 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:31.986 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:31:31.986 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: abort-at-block-writes id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.30 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:31:31.987 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:32.105 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-14T11:31:32.105 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:32.508 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:31:32.541 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:32.542 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:32.587 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.586+0000 7f5a67a479c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.590 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.590+0000 7f5a67a479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.590 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.590+0000 7f5a67a479c0 20 realm 2024-09-14T11:31:32.590 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.590+0000 7f5a67a479c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.591 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.590+0000 7f5a67a479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.591 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.590+0000 7f5a67a479c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:32.591 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.590+0000 7f5a67a479c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.591 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.590+0000 7f5a67a479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.591 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.590+0000 7f5a67a479c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.592 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.590+0000 7f5a67a479c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:32.592 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.590+0000 7f5a67a479c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.593 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.594+0000 7f5a67a479c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:32.593 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.594+0000 7f5a67a479c0 20 searching for the correct realm 2024-09-14T11:31:32.595 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.594+0000 7f5a64d4c640 0 -- 172.21.15.71:0/1006743230 >> [v2:172.21.15.71:6824/2436891866,v1:172.21.15.71:6825/2436891866] conn(0x7f5a58036060 msgr2=0x7f5a580642c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:31:32.808 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.806+0000 7f5a6554d640 0 -- 172.21.15.71:0/1006743230 >> [v2:172.21.15.157:6816/1231501119,v1:172.21.15.157:6817/1231501119] conn(0x55af34df7b50 msgr2=0x55af34df9f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:32.824 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.822+0000 7f5a67a479c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:32.824 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.822+0000 7f5a67a479c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:31:32.825 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.822+0000 7f5a67a479c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:32.825 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.822+0000 7f5a67a479c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:31:32.825 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.822+0000 7f5a67a479c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:32.825 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.822+0000 7f5a67a479c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:32.825 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.822+0000 7f5a67a479c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.825 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.826+0000 7f5a67a479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.825 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.826+0000 7f5a67a479c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.826 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.826+0000 7f5a67a479c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:32.826 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.826+0000 7f5a67a479c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.827 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.826+0000 7f5a67a479c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:32.827 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.826+0000 7f5a67a479c0 20 zone default found 2024-09-14T11:31:32.827 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.826+0000 7f5a67a479c0 4 Realm: () 2024-09-14T11:31:32.827 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.826+0000 7f5a67a479c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:31:32.827 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.826+0000 7f5a67a479c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:31:32.828 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.826+0000 7f5a67a479c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:32.828 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.826+0000 7f5a67a479c0 20 zonegroup default 2024-09-14T11:31:32.828 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.826+0000 7f5a67a479c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.828 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.826+0000 7f5a67a479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.828 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.826+0000 7f5a67a479c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.828 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.826+0000 7f5a67a479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.829 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.826+0000 7f5a67a479c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.829 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.830+0000 7f5a67a479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.829 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.830+0000 7f5a67a479c0 20 started sync module instance, tier type = 2024-09-14T11:31:32.829 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.830+0000 7f5a67a479c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:31:32.853 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.854+0000 7f5a67a479c0 20 add_watcher() i=0 2024-09-14T11:31:32.853 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.854+0000 7f5a67a479c0 20 add_watcher() i=1 2024-09-14T11:31:32.853 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.854+0000 7f5a67a479c0 20 add_watcher() i=2 2024-09-14T11:31:32.853 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.854+0000 7f5a67a479c0 20 add_watcher() i=3 2024-09-14T11:31:32.853 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.854+0000 7f5a67a479c0 20 add_watcher() i=4 2024-09-14T11:31:32.853 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.854+0000 7f5a67a479c0 20 add_watcher() i=5 2024-09-14T11:31:32.853 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.854+0000 7f5a67a479c0 20 add_watcher() i=6 2024-09-14T11:31:32.855 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.854+0000 7f5a67a479c0 20 add_watcher() i=7 2024-09-14T11:31:32.855 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.854+0000 7f5a67a479c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:32.860 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.858+0000 7f591b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:32.860 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.858+0000 7f5a67a479c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:32.861 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.858+0000 7f5a67a479c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:32.861 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.858+0000 7f5a67a479c0 5 note: GC not initialized 2024-09-14T11:31:32.861 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.862+0000 7f591a7e4640 20 reqs_thread_entry: start 2024-09-14T11:31:32.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.862+0000 7f5a67a479c0 20 init_complete bucket index max shards: 11 2024-09-14T11:31:32.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.862+0000 7f5a67a479c0 20 Filter name: none 2024-09-14T11:31:32.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.862+0000 7f588bfff640 20 reqs_thread_entry: start 2024-09-14T11:31:32.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.862+0000 7f5a67a479c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.862+0000 7f5a67a479c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:32.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.862+0000 7f5a67a479c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.864 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.862+0000 7f5a67a479c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:31:32.864 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.862+0000 7f5a67a479c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:32.864 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.862+0000 7f5a67a479c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.865 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.866+0000 7f5a67a479c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:32.865 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.866+0000 7f5a67a479c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.866 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.866+0000 7f5a67a479c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:31:32.867 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.866+0000 7f5a67a479c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:32.869 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.870+0000 7f591b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:32.874 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.874+0000 7f5a67a479c0 20 remove_watcher() i=0 2024-09-14T11:31:32.874 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.874+0000 7f5a67a479c0 2 removed watcher, disabling cache 2024-09-14T11:31:32.877 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.878+0000 7f5a67a479c0 20 remove_watcher() i=1 2024-09-14T11:31:32.879 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.878+0000 7f5a67a479c0 20 remove_watcher() i=2 2024-09-14T11:31:32.882 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.882+0000 7f5a67a479c0 20 remove_watcher() i=3 2024-09-14T11:31:32.884 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.882+0000 7f5a67a479c0 20 remove_watcher() i=4 2024-09-14T11:31:32.886 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.886+0000 7f5a67a479c0 20 remove_watcher() i=5 2024-09-14T11:31:32.888 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.886+0000 7f5a67a479c0 20 remove_watcher() i=6 2024-09-14T11:31:32.891 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.890+0000 7f5a67a479c0 20 remove_watcher() i=7 2024-09-14T11:31:32.906 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:32.906 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:31:32.906 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: error-at-commit-target-layout id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:31:32.906 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:32.906 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-14T11:31:32.939 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:32.939 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:32.983 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.982+0000 7fed3ddd39c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.985 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.986+0000 7fed3ddd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.985 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.986+0000 7fed3ddd39c0 20 realm 2024-09-14T11:31:32.986 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.986+0000 7fed3ddd39c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.986 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.986+0000 7fed3ddd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.986 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.986+0000 7fed3ddd39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:32.986 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.986+0000 7fed3ddd39c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.986 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.986+0000 7fed3ddd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.986+0000 7fed3ddd39c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.986+0000 7fed3ddd39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:32.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.986+0000 7fed3ddd39c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.986+0000 7fed3ddd39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:32.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.986+0000 7fed3ddd39c0 20 searching for the correct realm 2024-09-14T11:31:32.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:32.990+0000 7fed3c0da640 0 -- 172.21.15.71:0/2736154000 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fed240ef040 msgr2=0x7fed240ef930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:31:33.204 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.202+0000 7fed3c0da640 0 -- 172.21.15.71:0/2736154000 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55a2c7193290 msgr2=0x55a2c7195680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:33.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.218+0000 7fed3ddd39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:33.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.218+0000 7fed3ddd39c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:31:33.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.218+0000 7fed3ddd39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:33.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.218+0000 7fed3ddd39c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:31:33.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.218+0000 7fed3ddd39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:33.218 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.218+0000 7fed3ddd39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:33.218 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.218+0000 7fed3ddd39c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:33.218 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.218+0000 7fed3ddd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:33.218 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.218+0000 7fed3ddd39c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:33.219 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.218+0000 7fed3ddd39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:33.219 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.218+0000 7fed3ddd39c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:33.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.218+0000 7fed3ddd39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:33.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.218+0000 7fed3ddd39c0 20 zone default found 2024-09-14T11:31:33.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.218+0000 7fed3ddd39c0 4 Realm: () 2024-09-14T11:31:33.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.218+0000 7fed3ddd39c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:31:33.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.218+0000 7fed3ddd39c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:31:33.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.218+0000 7fed3ddd39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:33.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.218+0000 7fed3ddd39c0 20 zonegroup default 2024-09-14T11:31:33.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.218+0000 7fed3ddd39c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:33.221 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.218+0000 7fed3ddd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:33.221 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.218+0000 7fed3ddd39c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:33.221 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.222+0000 7fed3ddd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:33.221 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.222+0000 7fed3ddd39c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:33.222 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.222+0000 7fed3ddd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:33.222 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.222+0000 7fed3ddd39c0 20 started sync module instance, tier type = 2024-09-14T11:31:33.222 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.222+0000 7fed3ddd39c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:31:33.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.246+0000 7fed3ddd39c0 20 add_watcher() i=0 2024-09-14T11:31:33.246 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.246+0000 7fed3ddd39c0 20 add_watcher() i=1 2024-09-14T11:31:33.246 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.246+0000 7fed3ddd39c0 20 add_watcher() i=2 2024-09-14T11:31:33.246 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.246+0000 7fed3ddd39c0 20 add_watcher() i=3 2024-09-14T11:31:33.246 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.246+0000 7fed3ddd39c0 20 add_watcher() i=4 2024-09-14T11:31:33.246 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.246+0000 7fed3ddd39c0 20 add_watcher() i=5 2024-09-14T11:31:33.246 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.246+0000 7fed3ddd39c0 20 add_watcher() i=6 2024-09-14T11:31:33.248 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.246+0000 7fed3ddd39c0 20 add_watcher() i=7 2024-09-14T11:31:33.248 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.246+0000 7fed3ddd39c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:33.252 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.250+0000 7febf1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:33.253 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.254+0000 7fed3ddd39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:33.253 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.254+0000 7fed3ddd39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:33.253 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.254+0000 7fed3ddd39c0 5 note: GC not initialized 2024-09-14T11:31:33.254 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.254+0000 7febf0fe1640 20 reqs_thread_entry: start 2024-09-14T11:31:33.254 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.254+0000 7fed3ddd39c0 20 init_complete bucket index max shards: 11 2024-09-14T11:31:33.254 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.254+0000 7fed3ddd39c0 20 Filter name: none 2024-09-14T11:31:33.254 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.254+0000 7feb6a7fc640 20 reqs_thread_entry: start 2024-09-14T11:31:33.254 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.254+0000 7fed3ddd39c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:31:33.254 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.254+0000 7fed3ddd39c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:33.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.254+0000 7fed3ddd39c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:33.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.254+0000 7fed3ddd39c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:31:33.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.254+0000 7fed3ddd39c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:31:33.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.254+0000 7fed3ddd39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31 : miss 2024-09-14T11:31:33.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.254+0000 7fed3ddd39c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:33.256 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.254+0000 7fed3ddd39c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:31:33.256 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.254+0000 7fed3ddd39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31 info.flags=0x17 2024-09-14T11:31:33.256 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.254+0000 7fed3ddd39c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31 to cache LRU end 2024-09-14T11:31:33.256 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.254+0000 7fed3ddd39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:31:33.256 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.254+0000 7fed3ddd39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:33.256 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.254+0000 7fed3ddd39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31 2024-09-14T11:31:33.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.266+0000 7fed3ddd39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31 info.flags=0x17 2024-09-14T11:31:33.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.266+0000 7fed3ddd39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31 to cache LRU end 2024-09-14T11:31:33.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.266+0000 7fed3ddd39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:33.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.266+0000 7fed3ddd39c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31, ofs0, ns] 2024-09-14T11:31:33.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.270+0000 7fec1affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464365 cookie 94157613423168 notifier 6797 bl.length()=1015 2024-09-14T11:31:33.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.270+0000 7fec1affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31 info.flags=0x17 2024-09-14T11:31:33.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.270+0000 7fec1affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31 to cache LRU end 2024-09-14T11:31:33.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.270+0000 7fec1affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:33.270 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.270+0000 7fed3ddd39c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.31]): orig_sources= new_sources= 2024-09-14T11:31:33.270 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.270+0000 7fed3ddd39c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.31]): potential sources added=[] removed=[] 2024-09-14T11:31:33.271 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.270+0000 7fed3ddd39c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.31]): orig_dests= new_dests= 2024-09-14T11:31:33.271 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.270+0000 7fed3ddd39c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.31]): potential dests added=[] removed=[] 2024-09-14T11:31:33.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.282+0000 7fed3ddd39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.1.0 2024-09-14T11:31:33.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.282+0000 7fed3ddd39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.1.0 2024-09-14T11:31:33.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.282+0000 7fed3ddd39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.1.1 2024-09-14T11:31:33.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.282+0000 7fed3ddd39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.1.1 2024-09-14T11:31:33.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.282+0000 7fed3ddd39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.1.2 2024-09-14T11:31:33.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.282+0000 7fed3ddd39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.1.2 2024-09-14T11:31:33.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.282+0000 7fed3ddd39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.1.3 2024-09-14T11:31:33.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.282+0000 7fed3ddd39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.1.3 2024-09-14T11:31:33.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.282+0000 7fed3ddd39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.1.4 2024-09-14T11:31:33.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.282+0000 7fed3ddd39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.1.4 2024-09-14T11:31:33.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.282+0000 7fed3ddd39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.1.5 2024-09-14T11:31:33.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.282+0000 7fed3ddd39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.1.5 2024-09-14T11:31:33.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.282+0000 7fed3ddd39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.1.6 2024-09-14T11:31:33.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.282+0000 7fed3ddd39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.1.6 2024-09-14T11:31:33.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.282+0000 7fed3ddd39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.1.7 2024-09-14T11:31:33.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.282+0000 7fed3ddd39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.1.7 2024-09-14T11:31:33.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.282+0000 7fed3ddd39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.1.8 2024-09-14T11:31:33.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.282+0000 7fed3ddd39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.1.8 2024-09-14T11:31:33.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.282+0000 7fed3ddd39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.1.9 2024-09-14T11:31:33.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.282+0000 7fed3ddd39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.1.9 2024-09-14T11:31:33.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.282+0000 7fed3ddd39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.1.10 2024-09-14T11:31:33.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.282+0000 7fed3ddd39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.1.10 2024-09-14T11:31:33.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.282+0000 7fed3ddd39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.1.11 2024-09-14T11:31:33.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.282+0000 7fed3ddd39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.1.11 2024-09-14T11:31:33.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.282+0000 7fed3ddd39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.0 2024-09-14T11:31:33.284 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.282+0000 7fed3ddd39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.1 2024-09-14T11:31:33.284 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.282+0000 7fed3ddd39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.2 2024-09-14T11:31:33.284 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.282+0000 7fed3ddd39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.3 2024-09-14T11:31:33.285 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.286+0000 7fed3ddd39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.4 2024-09-14T11:31:33.286 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.286+0000 7fed3ddd39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.5 2024-09-14T11:31:33.287 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.286+0000 7fed3ddd39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.6 2024-09-14T11:31:33.288 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.286+0000 7fed3ddd39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.7 2024-09-14T11:31:33.289 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.290+0000 7fed3ddd39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.8 2024-09-14T11:31:33.290 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.290+0000 7fed3ddd39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.9 2024-09-14T11:31:33.292 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.290+0000 7fed3ddd39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.10 2024-09-14T11:31:33.299 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.298+0000 7fed3ddd39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:33.299 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.298+0000 7fed3ddd39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31 2024-09-14T11:31:33.302 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.302+0000 7fed3ddd39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31 info.flags=0x17 2024-09-14T11:31:33.302 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.302+0000 7fed3ddd39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31 to cache LRU end 2024-09-14T11:31:33.302 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.302+0000 7fed3ddd39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:33.302 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.302+0000 7fed3ddd39c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31, ofs0, ns] 2024-09-14T11:31:33.303 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.302+0000 7fec1affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464366 cookie 94157613423168 notifier 6797 bl.length()=1015 2024-09-14T11:31:33.303 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.302+0000 7fec1affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31 info.flags=0x17 2024-09-14T11:31:33.303 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.302+0000 7fec1affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31 to cache LRU end 2024-09-14T11:31:33.303 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.302+0000 7fec1affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:33.303 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.302+0000 7fed3ddd39c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.31]): orig_sources= new_sources= 2024-09-14T11:31:33.304 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.302+0000 7fed3ddd39c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.31]): potential sources added=[] removed=[] 2024-09-14T11:31:33.304 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.302+0000 7fed3ddd39c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.31]): orig_dests= new_dests= 2024-09-14T11:31:33.304 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.302+0000 7fed3ddd39c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.31]): potential dests added=[] removed=[] 2024-09-14T11:31:33.309 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.310+0000 7fed3ddd39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.0 2024-09-14T11:31:33.310 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.310+0000 7fed3ddd39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.1 2024-09-14T11:31:33.311 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.310+0000 7fed3ddd39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.2 2024-09-14T11:31:33.311 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.310+0000 7fed3ddd39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.3 2024-09-14T11:31:33.312 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.310+0000 7fed3ddd39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.4 2024-09-14T11:31:33.312 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.314+0000 7fed3ddd39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.5 2024-09-14T11:31:33.313 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.314+0000 7fed3ddd39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.6 2024-09-14T11:31:33.314 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.314+0000 7fed3ddd39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.7 2024-09-14T11:31:33.315 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.314+0000 7fed3ddd39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.8 2024-09-14T11:31:33.315 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.314+0000 7fed3ddd39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.9 2024-09-14T11:31:33.316 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.314+0000 7fed3ddd39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.10 2024-09-14T11:31:33.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.318+0000 7fed3ddd39c0 -1 Injecting error=-5 at location=commit_target_layout 2024-09-14T11:31:33.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.318+0000 7fed3ddd39c0 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-14T11:31:33.327 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.326+0000 7febf1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:33.332 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.330+0000 7fed3ddd39c0 20 remove_watcher() i=0 2024-09-14T11:31:33.332 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.330+0000 7fed3ddd39c0 2 removed watcher, disabling cache 2024-09-14T11:31:33.334 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.334+0000 7fed3ddd39c0 20 remove_watcher() i=1 2024-09-14T11:31:33.336 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.334+0000 7fed3ddd39c0 20 remove_watcher() i=2 2024-09-14T11:31:33.338 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.338+0000 7fed3ddd39c0 20 remove_watcher() i=3 2024-09-14T11:31:33.341 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.342+0000 7fed3ddd39c0 20 remove_watcher() i=4 2024-09-14T11:31:33.343 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.342+0000 7fed3ddd39c0 20 remove_watcher() i=5 2024-09-14T11:31:33.346 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.346+0000 7fed3ddd39c0 20 remove_watcher() i=6 2024-09-14T11:31:33.348 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.346+0000 7fed3ddd39c0 20 remove_watcher() i=7 2024-09-14T11:31:33.365 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:31:33.396 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:33.396 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:33.439 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.438+0000 7fc4a6c7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:33.442 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.442+0000 7fc4a6c7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:33.442 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.442+0000 7fc4a6c7b9c0 20 realm 2024-09-14T11:31:33.443 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.442+0000 7fc4a6c7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:33.443 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.442+0000 7fc4a6c7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:33.443 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.442+0000 7fc4a6c7b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:33.443 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.442+0000 7fc4a6c7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:33.444 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.442+0000 7fc4a6c7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:33.444 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.442+0000 7fc4a6c7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:33.444 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.442+0000 7fc4a6c7b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:33.444 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.442+0000 7fc4a6c7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:33.445 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.446+0000 7fc4a6c7b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:33.445 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.446+0000 7fc4a6c7b9c0 20 searching for the correct realm 2024-09-14T11:31:33.449 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.450+0000 7fc4a4f82640 0 -- 172.21.15.71:0/912879391 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fc498061040 msgr2=0x7fc498067f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:33.665 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.666+0000 7fc4a4f82640 0 -- 172.21.15.71:0/912879391 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x555b242067c0 msgr2=0x555b24208bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:33.679 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.678+0000 7fc4a6c7b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:33.679 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.678+0000 7fc4a6c7b9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:31:33.679 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.678+0000 7fc4a6c7b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:33.679 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.678+0000 7fc4a6c7b9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:31:33.679 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.678+0000 7fc4a6c7b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:33.679 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.678+0000 7fc4a6c7b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:33.679 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.678+0000 7fc4a6c7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:33.679 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.678+0000 7fc4a6c7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:33.680 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.678+0000 7fc4a6c7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:33.680 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.678+0000 7fc4a6c7b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:33.680 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.678+0000 7fc4a6c7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:33.681 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.682+0000 7fc4a6c7b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:33.681 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.682+0000 7fc4a6c7b9c0 20 zone default found 2024-09-14T11:31:33.681 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.682+0000 7fc4a6c7b9c0 4 Realm: () 2024-09-14T11:31:33.682 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.682+0000 7fc4a6c7b9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:31:33.682 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.682+0000 7fc4a6c7b9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:31:33.682 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.682+0000 7fc4a6c7b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:33.682 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.682+0000 7fc4a6c7b9c0 20 zonegroup default 2024-09-14T11:31:33.682 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.682+0000 7fc4a6c7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:33.682 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.682+0000 7fc4a6c7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:33.682 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.682+0000 7fc4a6c7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:33.683 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.682+0000 7fc4a6c7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:33.683 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.682+0000 7fc4a6c7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:33.684 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.682+0000 7fc4a6c7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:33.684 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.682+0000 7fc4a6c7b9c0 20 started sync module instance, tier type = 2024-09-14T11:31:33.684 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.682+0000 7fc4a6c7b9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:31:33.706 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.706+0000 7fc4a6c7b9c0 20 add_watcher() i=0 2024-09-14T11:31:33.706 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.706+0000 7fc4a6c7b9c0 20 add_watcher() i=1 2024-09-14T11:31:33.706 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.706+0000 7fc4a6c7b9c0 20 add_watcher() i=2 2024-09-14T11:31:33.707 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.706+0000 7fc4a6c7b9c0 20 add_watcher() i=3 2024-09-14T11:31:33.707 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.706+0000 7fc4a6c7b9c0 20 add_watcher() i=4 2024-09-14T11:31:33.707 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.706+0000 7fc4a6c7b9c0 20 add_watcher() i=5 2024-09-14T11:31:33.707 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.706+0000 7fc4a6c7b9c0 20 add_watcher() i=6 2024-09-14T11:31:33.709 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.710+0000 7fc4a6c7b9c0 20 add_watcher() i=7 2024-09-14T11:31:33.709 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.710+0000 7fc4a6c7b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:33.713 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.714+0000 7fc35afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:33.713 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.714+0000 7fc4a6c7b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:33.714 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.714+0000 7fc4a6c7b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:33.714 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.714+0000 7fc4a6c7b9c0 5 note: GC not initialized 2024-09-14T11:31:33.714 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.714+0000 7fc359fdb640 20 reqs_thread_entry: start 2024-09-14T11:31:33.714 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.714+0000 7fc4a6c7b9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:31:33.715 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.714+0000 7fc4a6c7b9c0 20 Filter name: none 2024-09-14T11:31:33.715 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.714+0000 7fc2cb7fe640 20 reqs_thread_entry: start 2024-09-14T11:31:33.715 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.714+0000 7fc4a6c7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:33.715 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.714+0000 7fc4a6c7b9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:33.715 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.714+0000 7fc4a6c7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:33.717 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.718+0000 7fc4a6c7b9c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:31:33.717 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.718+0000 7fc4a6c7b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:33.717 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.718+0000 7fc4a6c7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:33.717 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.718+0000 7fc4a6c7b9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:33.717 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.718+0000 7fc4a6c7b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:33.718 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.718+0000 7fc4a6c7b9c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:31:33.718 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.718+0000 7fc4a6c7b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:33.721 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.722+0000 7fc35afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:33.725 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.726+0000 7fc4a6c7b9c0 20 remove_watcher() i=0 2024-09-14T11:31:33.725 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.726+0000 7fc4a6c7b9c0 2 removed watcher, disabling cache 2024-09-14T11:31:33.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.726+0000 7fc4a6c7b9c0 20 remove_watcher() i=1 2024-09-14T11:31:33.729 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.730+0000 7fc4a6c7b9c0 20 remove_watcher() i=2 2024-09-14T11:31:33.732 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.730+0000 7fc4a6c7b9c0 20 remove_watcher() i=3 2024-09-14T11:31:33.734 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.734+0000 7fc4a6c7b9c0 20 remove_watcher() i=4 2024-09-14T11:31:33.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.734+0000 7fc4a6c7b9c0 20 remove_watcher() i=5 2024-09-14T11:31:33.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.738+0000 7fc4a6c7b9c0 20 remove_watcher() i=6 2024-09-14T11:31:33.741 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:33.742+0000 7fc4a6c7b9c0 20 remove_watcher() i=7 2024-09-14T11:31:33.757 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:33.757 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:31:33.757 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: error-at-commit-target-layout id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:31:33.758 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:33.814 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:31:33.851 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:33.851 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:34.107 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.106+0000 7f25dc5b59c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.109 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.110+0000 7f25dc5b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:34.109 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.110+0000 7f25dc5b59c0 20 realm 2024-09-14T11:31:34.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.110+0000 7f25dc5b59c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.110+0000 7f25dc5b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:34.111 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.110+0000 7f25dc5b59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:34.111 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.110+0000 7f25dc5b59c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.111 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.110+0000 7f25dc5b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:34.111 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.110+0000 7f25dc5b59c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.112 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.110+0000 7f25dc5b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:34.112 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.110+0000 7f25dc5b59c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.113 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.114+0000 7f25dc5b59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:34.113 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.114+0000 7f25dc5b59c0 20 searching for the correct realm 2024-09-14T11:31:34.117 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.118+0000 7f25da8bc640 0 -- 172.21.15.71:0/437906804 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f25d0015070 msgr2=0x7f25d0043970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:34.333 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.334+0000 7f25da8bc640 0 -- 172.21.15.71:0/437906804 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55a962b543f0 msgr2=0x55a962b567e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:34.347 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.346+0000 7f25dc5b59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:34.347 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.346+0000 7f25dc5b59c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:31:34.348 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.346+0000 7f25dc5b59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:34.348 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.346+0000 7f25dc5b59c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:31:34.348 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.346+0000 7f25dc5b59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:34.348 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.346+0000 7f25dc5b59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:34.348 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.346+0000 7f25dc5b59c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.348 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.346+0000 7f25dc5b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:34.348 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.346+0000 7f25dc5b59c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.349 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.350+0000 7f25dc5b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:34.349 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.350+0000 7f25dc5b59c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.351 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.350+0000 7f25dc5b59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:34.351 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.350+0000 7f25dc5b59c0 20 zone default found 2024-09-14T11:31:34.351 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.350+0000 7f25dc5b59c0 4 Realm: () 2024-09-14T11:31:34.351 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.350+0000 7f25dc5b59c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:31:34.351 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.350+0000 7f25dc5b59c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:31:34.351 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.350+0000 7f25dc5b59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:34.351 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.350+0000 7f25dc5b59c0 20 zonegroup default 2024-09-14T11:31:34.351 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.350+0000 7f25dc5b59c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.351 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.350+0000 7f25dc5b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:34.352 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.350+0000 7f25dc5b59c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.352 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.350+0000 7f25dc5b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:34.352 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.350+0000 7f25dc5b59c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.353 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.354+0000 7f25dc5b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:34.353 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.354+0000 7f25dc5b59c0 20 started sync module instance, tier type = 2024-09-14T11:31:34.353 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.354+0000 7f25dc5b59c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:31:34.376 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.374+0000 7f25dc5b59c0 20 add_watcher() i=0 2024-09-14T11:31:34.376 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.374+0000 7f25dc5b59c0 20 add_watcher() i=1 2024-09-14T11:31:34.376 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.374+0000 7f25dc5b59c0 20 add_watcher() i=2 2024-09-14T11:31:34.376 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.374+0000 7f25dc5b59c0 20 add_watcher() i=3 2024-09-14T11:31:34.376 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.374+0000 7f25dc5b59c0 20 add_watcher() i=4 2024-09-14T11:31:34.376 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.374+0000 7f25dc5b59c0 20 add_watcher() i=5 2024-09-14T11:31:34.377 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.374+0000 7f25dc5b59c0 20 add_watcher() i=6 2024-09-14T11:31:34.378 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.378+0000 7f25dc5b59c0 20 add_watcher() i=7 2024-09-14T11:31:34.379 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.378+0000 7f25dc5b59c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:34.382 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.382+0000 7f24917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:34.384 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.382+0000 7f25dc5b59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:34.384 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.382+0000 7f25dc5b59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:34.384 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.382+0000 7f25dc5b59c0 5 note: GC not initialized 2024-09-14T11:31:34.385 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.382+0000 7f248b7fe640 20 reqs_thread_entry: start 2024-09-14T11:31:34.385 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.382+0000 7f25dc5b59c0 20 init_complete bucket index max shards: 11 2024-09-14T11:31:34.385 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.382+0000 7f25dc5b59c0 20 Filter name: none 2024-09-14T11:31:34.385 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.386+0000 7f24897fa640 20 reqs_thread_entry: start 2024-09-14T11:31:34.385 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.386+0000 7f25dc5b59c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:31:34.385 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.386+0000 7f25dc5b59c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.386 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.386+0000 7f25dc5b59c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:34.386 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.386+0000 7f25dc5b59c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:31:34.386 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.386+0000 7f25dc5b59c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:31:34.386 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.386+0000 7f25dc5b59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31 : miss 2024-09-14T11:31:34.386 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.386+0000 7f25dc5b59c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.387 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.386+0000 7f25dc5b59c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:31:34.387 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.386+0000 7f25dc5b59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31 info.flags=0x17 2024-09-14T11:31:34.387 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.386+0000 7f25dc5b59c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31 to cache LRU end 2024-09-14T11:31:34.387 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.386+0000 7f25dc5b59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:31:34.387 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.386+0000 7f25dc5b59c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:34.387 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.386+0000 7f25dc5b59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31 2024-09-14T11:31:34.389 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.390+0000 7f25dc5b59c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:31:34.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.406+0000 7f25dc5b59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31 info.flags=0x17 2024-09-14T11:31:34.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.406+0000 7f25dc5b59c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31 to cache LRU end 2024-09-14T11:31:34.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.406+0000 7f25dc5b59c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:34.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.406+0000 7f25dc5b59c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31, ofs0, ns] 2024-09-14T11:31:34.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.406+0000 7f24bd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464367 cookie 94185993922528 notifier 7188 bl.length()=1015 2024-09-14T11:31:34.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.406+0000 7f24bd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31 info.flags=0x17 2024-09-14T11:31:34.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.406+0000 7f24bd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31 to cache LRU end 2024-09-14T11:31:34.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.406+0000 7f24bd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:34.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.406+0000 7f25dc5b59c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.31]): orig_sources= new_sources= 2024-09-14T11:31:34.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.406+0000 7f25dc5b59c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.31]): potential sources added=[] removed=[] 2024-09-14T11:31:34.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.406+0000 7f25dc5b59c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.31]): orig_dests= new_dests= 2024-09-14T11:31:34.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.406+0000 7f25dc5b59c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.31]): potential dests added=[] removed=[] 2024-09-14T11:31:34.419 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.418+0000 7f25dc5b59c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.2.0 2024-09-14T11:31:34.419 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.418+0000 7f25dc5b59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.2.0 2024-09-14T11:31:34.419 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.418+0000 7f25dc5b59c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.2.1 2024-09-14T11:31:34.419 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.418+0000 7f25dc5b59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.2.1 2024-09-14T11:31:34.419 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.418+0000 7f25dc5b59c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.2.2 2024-09-14T11:31:34.419 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.418+0000 7f25dc5b59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.2.2 2024-09-14T11:31:34.419 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.418+0000 7f25dc5b59c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.2.3 2024-09-14T11:31:34.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.418+0000 7f25dc5b59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.2.3 2024-09-14T11:31:34.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.418+0000 7f25dc5b59c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.2.4 2024-09-14T11:31:34.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.418+0000 7f25dc5b59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.2.4 2024-09-14T11:31:34.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.418+0000 7f25dc5b59c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.2.5 2024-09-14T11:31:34.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.418+0000 7f25dc5b59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.2.5 2024-09-14T11:31:34.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.418+0000 7f25dc5b59c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.2.6 2024-09-14T11:31:34.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.418+0000 7f25dc5b59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.2.6 2024-09-14T11:31:34.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.418+0000 7f25dc5b59c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.2.7 2024-09-14T11:31:34.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.418+0000 7f25dc5b59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.2.7 2024-09-14T11:31:34.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.418+0000 7f25dc5b59c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.2.8 2024-09-14T11:31:34.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.418+0000 7f25dc5b59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.2.8 2024-09-14T11:31:34.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.418+0000 7f25dc5b59c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.2.9 2024-09-14T11:31:34.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.418+0000 7f25dc5b59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.2.9 2024-09-14T11:31:34.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.418+0000 7f25dc5b59c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.2.10 2024-09-14T11:31:34.421 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.418+0000 7f25dc5b59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.2.10 2024-09-14T11:31:34.421 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.418+0000 7f25dc5b59c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.2.11 2024-09-14T11:31:34.421 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.418+0000 7f25dc5b59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.2.11 2024-09-14T11:31:34.421 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.418+0000 7f25dc5b59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.0 2024-09-14T11:31:34.421 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.418+0000 7f25dc5b59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.1 2024-09-14T11:31:34.421 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.422+0000 7f25dc5b59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.2 2024-09-14T11:31:34.422 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.422+0000 7f25dc5b59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.3 2024-09-14T11:31:34.422 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.422+0000 7f25dc5b59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.4 2024-09-14T11:31:34.423 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.422+0000 7f25dc5b59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.5 2024-09-14T11:31:34.423 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.422+0000 7f25dc5b59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.6 2024-09-14T11:31:34.425 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.426+0000 7f25dc5b59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.7 2024-09-14T11:31:34.425 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.426+0000 7f25dc5b59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.8 2024-09-14T11:31:34.427 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.426+0000 7f25dc5b59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.9 2024-09-14T11:31:34.427 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.426+0000 7f25dc5b59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.10 2024-09-14T11:31:34.433 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.434+0000 7f25dc5b59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:34.434 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.434+0000 7f25dc5b59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31 2024-09-14T11:31:34.437 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.438+0000 7f25dc5b59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31 info.flags=0x17 2024-09-14T11:31:34.437 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.438+0000 7f25dc5b59c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31 to cache LRU end 2024-09-14T11:31:34.437 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.438+0000 7f25dc5b59c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:34.437 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.438+0000 7f25dc5b59c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31, ofs0, ns] 2024-09-14T11:31:34.438 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.438+0000 7f24bd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464368 cookie 94185993922528 notifier 7188 bl.length()=1015 2024-09-14T11:31:34.438 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.438+0000 7f24bd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31 info.flags=0x17 2024-09-14T11:31:34.438 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.438+0000 7f24bd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31 to cache LRU end 2024-09-14T11:31:34.438 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.438+0000 7f24bd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:34.439 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.438+0000 7f25dc5b59c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.31]): orig_sources= new_sources= 2024-09-14T11:31:34.439 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.438+0000 7f25dc5b59c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.31]): potential sources added=[] removed=[] 2024-09-14T11:31:34.439 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.438+0000 7f25dc5b59c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.31]): orig_dests= new_dests= 2024-09-14T11:31:34.439 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.438+0000 7f25dc5b59c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.31]): potential dests added=[] removed=[] 2024-09-14T11:31:34.444 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.442+0000 7f25dc5b59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.0 2024-09-14T11:31:34.445 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.446+0000 7f25dc5b59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.1 2024-09-14T11:31:34.446 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.446+0000 7f25dc5b59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.2 2024-09-14T11:31:34.446 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.446+0000 7f25dc5b59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.3 2024-09-14T11:31:34.447 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.446+0000 7f25dc5b59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.4 2024-09-14T11:31:34.447 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.446+0000 7f25dc5b59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.5 2024-09-14T11:31:34.448 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.446+0000 7f25dc5b59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.6 2024-09-14T11:31:34.449 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.450+0000 7f25dc5b59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.7 2024-09-14T11:31:34.449 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.450+0000 7f25dc5b59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.8 2024-09-14T11:31:34.450 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.450+0000 7f25dc5b59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.9 2024-09-14T11:31:34.450 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.450+0000 7f25dc5b59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.31.10 2024-09-14T11:31:34.452 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.450+0000 7f25dc5b59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:34.452 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.450+0000 7f25dc5b59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31 2024-09-14T11:31:34.455 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.454+0000 7f25dc5b59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31 info.flags=0x17 2024-09-14T11:31:34.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.454+0000 7f25dc5b59c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31 to cache LRU end 2024-09-14T11:31:34.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.454+0000 7f25dc5b59c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:34.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.454+0000 7f25dc5b59c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31, ofs0, ns] 2024-09-14T11:31:34.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.454+0000 7f24bd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464369 cookie 94185993922528 notifier 7188 bl.length()=983 2024-09-14T11:31:34.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.454+0000 7f24bd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31 info.flags=0x17 2024-09-14T11:31:34.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.454+0000 7f24bd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.31 to cache LRU end 2024-09-14T11:31:34.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.454+0000 7f24bd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:34.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.458+0000 7f25dc5b59c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.31]): orig_sources= new_sources= 2024-09-14T11:31:34.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.458+0000 7f25dc5b59c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.31]): potential sources added=[] removed=[] 2024-09-14T11:31:34.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.458+0000 7f25dc5b59c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.31]): orig_dests= new_dests= 2024-09-14T11:31:34.458 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.458+0000 7f25dc5b59c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.31]): potential dests added=[] removed=[] 2024-09-14T11:31:34.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.462+0000 7f25dc5b59c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:31:34.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.466+0000 7f24917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:34.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.470+0000 7f25dc5b59c0 20 remove_watcher() i=0 2024-09-14T11:31:34.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.470+0000 7f25dc5b59c0 2 removed watcher, disabling cache 2024-09-14T11:31:34.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.474+0000 7f25dc5b59c0 20 remove_watcher() i=1 2024-09-14T11:31:34.475 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.474+0000 7f25dc5b59c0 20 remove_watcher() i=2 2024-09-14T11:31:34.478 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.478+0000 7f25dc5b59c0 20 remove_watcher() i=3 2024-09-14T11:31:34.479 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.478+0000 7f25dc5b59c0 20 remove_watcher() i=4 2024-09-14T11:31:34.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.482+0000 7f25dc5b59c0 20 remove_watcher() i=5 2024-09-14T11:31:34.484 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.486+0000 7f25dc5b59c0 20 remove_watcher() i=6 2024-09-14T11:31:34.488 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.486+0000 7f25dc5b59c0 20 remove_watcher() i=7 2024-09-14T11:31:34.504 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:31:34.534 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:34.534 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:34.580 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.578+0000 7fe2c97d89c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.582 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.582+0000 7fe2c97d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:34.582 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.582+0000 7fe2c97d89c0 20 realm 2024-09-14T11:31:34.583 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.582+0000 7fe2c97d89c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.583 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.582+0000 7fe2c97d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:34.583 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.582+0000 7fe2c97d89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:34.583 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.582+0000 7fe2c97d89c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.584 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.582+0000 7fe2c97d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:34.584 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.582+0000 7fe2c97d89c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.584 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.582+0000 7fe2c97d89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:34.584 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.582+0000 7fe2c97d89c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.585 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.586+0000 7fe2c97d89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:34.585 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.586+0000 7fe2c97d89c0 20 searching for the correct realm 2024-09-14T11:31:34.589 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.590+0000 7fe2c7adf640 0 -- 172.21.15.71:0/4146543854 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fe2bc085f80 msgr2=0x7fe2bc0849f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:34.596 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.594+0000 7fe2c7adf640 0 -- 172.21.15.71:0/4146543854 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x561228773850 msgr2=0x561228775c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:34.604 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.602+0000 7fe2c97d89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:34.604 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.602+0000 7fe2c97d89c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:31:34.604 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.602+0000 7fe2c97d89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:34.604 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.602+0000 7fe2c97d89c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:31:34.604 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.602+0000 7fe2c97d89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:34.604 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.602+0000 7fe2c97d89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:34.604 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.602+0000 7fe2c97d89c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.605 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.602+0000 7fe2c97d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:34.605 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.602+0000 7fe2c97d89c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.605 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.602+0000 7fe2c97d89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:34.605 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.602+0000 7fe2c97d89c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.605 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.606+0000 7fe2c97d89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:34.606 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.606+0000 7fe2c97d89c0 20 zone default found 2024-09-14T11:31:34.606 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.606+0000 7fe2c97d89c0 4 Realm: () 2024-09-14T11:31:34.606 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.606+0000 7fe2c97d89c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:31:34.606 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.606+0000 7fe2c97d89c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:31:34.606 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.606+0000 7fe2c97d89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:34.606 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.606+0000 7fe2c97d89c0 20 zonegroup default 2024-09-14T11:31:34.606 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.606+0000 7fe2c97d89c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.607 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.606+0000 7fe2c97d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:34.607 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.606+0000 7fe2c97d89c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.607 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.606+0000 7fe2c97d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:34.607 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.606+0000 7fe2c97d89c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.606+0000 7fe2c97d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:34.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.606+0000 7fe2c97d89c0 20 started sync module instance, tier type = 2024-09-14T11:31:34.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.606+0000 7fe2c97d89c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:31:34.626 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.626+0000 7fe2c97d89c0 20 add_watcher() i=0 2024-09-14T11:31:34.626 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.626+0000 7fe2c97d89c0 20 add_watcher() i=1 2024-09-14T11:31:34.626 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.626+0000 7fe2c97d89c0 20 add_watcher() i=2 2024-09-14T11:31:34.626 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.626+0000 7fe2c97d89c0 20 add_watcher() i=3 2024-09-14T11:31:34.626 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.626+0000 7fe2c97d89c0 20 add_watcher() i=4 2024-09-14T11:31:34.626 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.626+0000 7fe2c97d89c0 20 add_watcher() i=5 2024-09-14T11:31:34.626 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.626+0000 7fe2c97d89c0 20 add_watcher() i=6 2024-09-14T11:31:34.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.626+0000 7fe2c97d89c0 20 add_watcher() i=7 2024-09-14T11:31:34.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.626+0000 7fe2c97d89c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:34.633 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.634+0000 7fe17dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:34.633 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.634+0000 7fe2c97d89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:34.633 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.634+0000 7fe2c97d89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:34.633 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.634+0000 7fe2c97d89c0 5 note: GC not initialized 2024-09-14T11:31:34.634 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.634+0000 7fe17cfe1640 20 reqs_thread_entry: start 2024-09-14T11:31:34.634 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.634+0000 7fe2c97d89c0 20 init_complete bucket index max shards: 11 2024-09-14T11:31:34.634 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.634+0000 7fe2c97d89c0 20 Filter name: none 2024-09-14T11:31:34.634 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.634+0000 7fe0f67fc640 20 reqs_thread_entry: start 2024-09-14T11:31:34.634 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.634+0000 7fe2c97d89c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.634 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.634+0000 7fe2c97d89c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:34.634 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.634+0000 7fe2c97d89c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.635 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.634+0000 7fe2c97d89c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:31:34.635 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.634+0000 7fe2c97d89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:34.635 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.634+0000 7fe2c97d89c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.636 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.634+0000 7fe2c97d89c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:34.636 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.634+0000 7fe2c97d89c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.636 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.634+0000 7fe2c97d89c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:31:34.636 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.634+0000 7fe2c97d89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:34.639 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.638+0000 7fe17dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:34.643 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.642+0000 7fe2c97d89c0 20 remove_watcher() i=0 2024-09-14T11:31:34.643 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.642+0000 7fe2c97d89c0 2 removed watcher, disabling cache 2024-09-14T11:31:34.645 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.646+0000 7fe2c97d89c0 20 remove_watcher() i=1 2024-09-14T11:31:34.647 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.646+0000 7fe2c97d89c0 20 remove_watcher() i=2 2024-09-14T11:31:34.649 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.650+0000 7fe2c97d89c0 20 remove_watcher() i=3 2024-09-14T11:31:34.651 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.650+0000 7fe2c97d89c0 20 remove_watcher() i=4 2024-09-14T11:31:34.653 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.654+0000 7fe2c97d89c0 20 remove_watcher() i=5 2024-09-14T11:31:34.655 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.654+0000 7fe2c97d89c0 20 remove_watcher() i=6 2024-09-14T11:31:34.658 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:34.658+0000 7fe2c97d89c0 20 remove_watcher() i=7 2024-09-14T11:31:34.672 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:34.672 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:31:34.672 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: error-at-commit-target-layout id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.31 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:31:34.672 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:34.778 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-14T11:31:34.778 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:35.147 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:31:35.179 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:35.179 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:35.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.226+0000 7fcdcdbaf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.226+0000 7fcdcdbaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:35.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.226+0000 7fcdcdbaf9c0 20 realm 2024-09-14T11:31:35.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.226+0000 7fcdcdbaf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.229 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.230+0000 7fcdcdbaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:35.229 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.230+0000 7fcdcdbaf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:35.229 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.230+0000 7fcdcdbaf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.229 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.230+0000 7fcdcdbaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:35.229 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.230+0000 7fcdcdbaf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.230 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.230+0000 7fcdcdbaf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:35.230 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.230+0000 7fcdcdbaf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.231 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.230+0000 7fcdcdbaf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:35.231 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.230+0000 7fcdcdbaf9c0 20 searching for the correct realm 2024-09-14T11:31:35.236 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.234+0000 7fcdcbeb6640 0 -- 172.21.15.71:0/447133360 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fcdc00dc040 msgr2=0x7fcdc00dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:35.443 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.442+0000 7fcdcbeb6640 0 -- 172.21.15.71:0/447133360 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x555ffe1cd5d0 msgr2=0x555ffe1cf9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:31:35.458 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.458+0000 7fcdcdbaf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:35.458 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.458+0000 7fcdcdbaf9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:31:35.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.458+0000 7fcdcdbaf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:35.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.458+0000 7fcdcdbaf9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:31:35.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.458+0000 7fcdcdbaf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:35.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.458+0000 7fcdcdbaf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:35.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.458+0000 7fcdcdbaf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.458+0000 7fcdcdbaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:35.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.458+0000 7fcdcdbaf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.458+0000 7fcdcdbaf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:35.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.458+0000 7fcdcdbaf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.461 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.462+0000 7fcdcdbaf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:35.461 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.462+0000 7fcdcdbaf9c0 20 zone default found 2024-09-14T11:31:35.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.462+0000 7fcdcdbaf9c0 4 Realm: () 2024-09-14T11:31:35.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.462+0000 7fcdcdbaf9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:31:35.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.462+0000 7fcdcdbaf9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:31:35.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.462+0000 7fcdcdbaf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:35.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.462+0000 7fcdcdbaf9c0 20 zonegroup default 2024-09-14T11:31:35.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.462+0000 7fcdcdbaf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.462+0000 7fcdcdbaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:35.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.462+0000 7fcdcdbaf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.462+0000 7fcdcdbaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:35.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.462+0000 7fcdcdbaf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.462+0000 7fcdcdbaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:35.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.462+0000 7fcdcdbaf9c0 20 started sync module instance, tier type = 2024-09-14T11:31:35.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.462+0000 7fcdcdbaf9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:31:35.486 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.486+0000 7fcdcdbaf9c0 20 add_watcher() i=0 2024-09-14T11:31:35.487 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.486+0000 7fcdcdbaf9c0 20 add_watcher() i=1 2024-09-14T11:31:35.487 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.486+0000 7fcdcdbaf9c0 20 add_watcher() i=2 2024-09-14T11:31:35.487 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.486+0000 7fcdcdbaf9c0 20 add_watcher() i=3 2024-09-14T11:31:35.487 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.486+0000 7fcdcdbaf9c0 20 add_watcher() i=4 2024-09-14T11:31:35.487 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.486+0000 7fcdcdbaf9c0 20 add_watcher() i=5 2024-09-14T11:31:35.487 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.486+0000 7fcdcdbaf9c0 20 add_watcher() i=6 2024-09-14T11:31:35.489 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.490+0000 7fcdcdbaf9c0 20 add_watcher() i=7 2024-09-14T11:31:35.489 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.490+0000 7fcdcdbaf9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:35.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.494+0000 7fcc81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:35.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.494+0000 7fcdcdbaf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:35.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.494+0000 7fcdcdbaf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:35.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.494+0000 7fcdcdbaf9c0 5 note: GC not initialized 2024-09-14T11:31:35.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.494+0000 7fcc80fe1640 20 reqs_thread_entry: start 2024-09-14T11:31:35.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.494+0000 7fcdcdbaf9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:31:35.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.494+0000 7fcdcdbaf9c0 20 Filter name: none 2024-09-14T11:31:35.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.494+0000 7fcbfa7fc640 20 reqs_thread_entry: start 2024-09-14T11:31:35.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.494+0000 7fcdcdbaf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.497 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.494+0000 7fcdcdbaf9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:35.497 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.498+0000 7fcdcdbaf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.498 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.498+0000 7fcdcdbaf9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:31:35.498 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.498+0000 7fcdcdbaf9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:35.498 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.498+0000 7fcdcdbaf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.499 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.498+0000 7fcdcdbaf9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:35.499 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.498+0000 7fcdcdbaf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.500 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.498+0000 7fcdcdbaf9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:31:35.500 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.498+0000 7fcdcdbaf9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:35.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.502+0000 7fcc81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:35.507 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.506+0000 7fcdcdbaf9c0 20 remove_watcher() i=0 2024-09-14T11:31:35.507 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.506+0000 7fcdcdbaf9c0 2 removed watcher, disabling cache 2024-09-14T11:31:35.510 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.510+0000 7fcdcdbaf9c0 20 remove_watcher() i=1 2024-09-14T11:31:35.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.510+0000 7fcdcdbaf9c0 20 remove_watcher() i=2 2024-09-14T11:31:35.514 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.514+0000 7fcdcdbaf9c0 20 remove_watcher() i=3 2024-09-14T11:31:35.516 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.514+0000 7fcdcdbaf9c0 20 remove_watcher() i=4 2024-09-14T11:31:35.518 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.518+0000 7fcdcdbaf9c0 20 remove_watcher() i=5 2024-09-14T11:31:35.521 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.518+0000 7fcdcdbaf9c0 20 remove_watcher() i=6 2024-09-14T11:31:35.523 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.522+0000 7fcdcdbaf9c0 20 remove_watcher() i=7 2024-09-14T11:31:35.539 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:35.539 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:31:35.539 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: error-at-commit-target-layout id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:31:35.539 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:35.540 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-14T11:31:35.578 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:35.578 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:35.622 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.622+0000 7fc9dac109c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.624 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.622+0000 7fc9dac109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:35.624 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.622+0000 7fc9dac109c0 20 realm 2024-09-14T11:31:35.624 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.622+0000 7fc9dac109c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.625 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.626+0000 7fc9dac109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:35.625 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.626+0000 7fc9dac109c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:35.625 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.626+0000 7fc9dac109c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.625 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.626+0000 7fc9dac109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:35.625 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.626+0000 7fc9dac109c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.626 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.626+0000 7fc9dac109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:35.626 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.626+0000 7fc9dac109c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.627 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.626+0000 7fc9dac109c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:35.627 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.626+0000 7fc9dac109c0 20 searching for the correct realm 2024-09-14T11:31:35.631 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.630+0000 7fc9d8716640 0 -- 172.21.15.71:0/3980397901 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x559661041530 msgr2=0x5596610439f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:35.637 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.638+0000 7fc9d8f17640 0 -- 172.21.15.71:0/3980397901 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55966103c770 msgr2=0x55966103eb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:35.645 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.646+0000 7fc9dac109c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:35.645 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.646+0000 7fc9dac109c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:31:35.646 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.646+0000 7fc9dac109c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:35.646 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.646+0000 7fc9dac109c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:31:35.646 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.646+0000 7fc9dac109c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:35.646 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.646+0000 7fc9dac109c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:35.646 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.646+0000 7fc9dac109c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.646 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.646+0000 7fc9dac109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:35.646 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.646+0000 7fc9dac109c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.647 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.646+0000 7fc9dac109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:35.647 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.646+0000 7fc9dac109c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.647 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.646+0000 7fc9dac109c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:35.647 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.646+0000 7fc9dac109c0 20 zone default found 2024-09-14T11:31:35.648 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.646+0000 7fc9dac109c0 4 Realm: () 2024-09-14T11:31:35.648 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.646+0000 7fc9dac109c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:31:35.648 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.646+0000 7fc9dac109c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:31:35.648 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.646+0000 7fc9dac109c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:35.648 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.646+0000 7fc9dac109c0 20 zonegroup default 2024-09-14T11:31:35.648 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.646+0000 7fc9dac109c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.648 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.646+0000 7fc9dac109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:35.648 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.646+0000 7fc9dac109c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.649 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.646+0000 7fc9dac109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:35.649 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.646+0000 7fc9dac109c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.649 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.646+0000 7fc9dac109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:35.649 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.646+0000 7fc9dac109c0 20 started sync module instance, tier type = 2024-09-14T11:31:35.649 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.646+0000 7fc9dac109c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:31:35.666 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.666+0000 7fc9dac109c0 20 add_watcher() i=0 2024-09-14T11:31:35.666 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.666+0000 7fc9dac109c0 20 add_watcher() i=1 2024-09-14T11:31:35.667 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.666+0000 7fc9dac109c0 20 add_watcher() i=2 2024-09-14T11:31:35.667 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.666+0000 7fc9dac109c0 20 add_watcher() i=3 2024-09-14T11:31:35.667 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.666+0000 7fc9dac109c0 20 add_watcher() i=4 2024-09-14T11:31:35.667 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.666+0000 7fc9dac109c0 20 add_watcher() i=5 2024-09-14T11:31:35.667 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.666+0000 7fc9dac109c0 20 add_watcher() i=6 2024-09-14T11:31:35.669 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.670+0000 7fc9dac109c0 20 add_watcher() i=7 2024-09-14T11:31:35.669 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.670+0000 7fc9dac109c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:35.672 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.670+0000 7fc88efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:35.672 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.670+0000 7fc9dac109c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:35.672 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.670+0000 7fc9dac109c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:35.672 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.670+0000 7fc9dac109c0 5 note: GC not initialized 2024-09-14T11:31:35.673 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.670+0000 7fc88dfe3640 20 reqs_thread_entry: start 2024-09-14T11:31:35.673 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.670+0000 7fc9dac109c0 20 init_complete bucket index max shards: 11 2024-09-14T11:31:35.673 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.670+0000 7fc9dac109c0 20 Filter name: none 2024-09-14T11:31:35.673 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.674+0000 7fc886ffd640 20 reqs_thread_entry: start 2024-09-14T11:31:35.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.674+0000 7fc9dac109c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:31:35.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.674+0000 7fc9dac109c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.674+0000 7fc9dac109c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:35.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.674+0000 7fc9dac109c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:31:35.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.674+0000 7fc9dac109c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:31:35.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.674+0000 7fc9dac109c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.32 : miss 2024-09-14T11:31:35.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.674+0000 7fc9dac109c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.674+0000 7fc9dac109c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:31:35.675 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.674+0000 7fc9dac109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.32 info.flags=0x17 2024-09-14T11:31:35.675 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.674+0000 7fc9dac109c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.32 to cache LRU end 2024-09-14T11:31:35.675 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.674+0000 7fc9dac109c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:31:35.675 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.674+0000 7fc9dac109c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:35.675 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.674+0000 7fc9dac109c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.32 2024-09-14T11:31:35.685 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.686+0000 7fc9dac109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.32 info.flags=0x17 2024-09-14T11:31:35.685 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.686+0000 7fc9dac109c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.32 to cache LRU end 2024-09-14T11:31:35.685 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.686+0000 7fc9dac109c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:35.685 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.686+0000 7fc9dac109c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.32, ofs0, ns] 2024-09-14T11:31:35.686 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.686+0000 7fc8b77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464372 cookie 94104361129184 notifier 7236 bl.length()=1015 2024-09-14T11:31:35.686 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.686+0000 7fc8b77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.32 info.flags=0x17 2024-09-14T11:31:35.686 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.686+0000 7fc8b77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.32 to cache LRU end 2024-09-14T11:31:35.686 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.686+0000 7fc8b77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:35.686 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.686+0000 7fc9dac109c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.32]): orig_sources= new_sources= 2024-09-14T11:31:35.686 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.686+0000 7fc9dac109c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.32]): potential sources added=[] removed=[] 2024-09-14T11:31:35.687 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.686+0000 7fc9dac109c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.32]): orig_dests= new_dests= 2024-09-14T11:31:35.687 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.686+0000 7fc9dac109c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.32]): potential dests added=[] removed=[] 2024-09-14T11:31:35.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.698+0000 7fc9dac109c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.1.0 2024-09-14T11:31:35.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.698+0000 7fc9dac109c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.1.0 2024-09-14T11:31:35.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.698+0000 7fc9dac109c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.1.1 2024-09-14T11:31:35.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.698+0000 7fc9dac109c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.1.1 2024-09-14T11:31:35.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.698+0000 7fc9dac109c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.1.2 2024-09-14T11:31:35.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.698+0000 7fc9dac109c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.1.2 2024-09-14T11:31:35.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.698+0000 7fc9dac109c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.1.3 2024-09-14T11:31:35.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.698+0000 7fc9dac109c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.1.3 2024-09-14T11:31:35.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.698+0000 7fc9dac109c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.1.4 2024-09-14T11:31:35.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.698+0000 7fc9dac109c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.1.4 2024-09-14T11:31:35.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.698+0000 7fc9dac109c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.1.5 2024-09-14T11:31:35.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.698+0000 7fc9dac109c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.1.5 2024-09-14T11:31:35.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.698+0000 7fc9dac109c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.1.6 2024-09-14T11:31:35.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.698+0000 7fc9dac109c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.1.6 2024-09-14T11:31:35.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.698+0000 7fc9dac109c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.1.7 2024-09-14T11:31:35.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.698+0000 7fc9dac109c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.1.7 2024-09-14T11:31:35.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.698+0000 7fc9dac109c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.1.8 2024-09-14T11:31:35.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.698+0000 7fc9dac109c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.1.8 2024-09-14T11:31:35.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.698+0000 7fc9dac109c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.1.9 2024-09-14T11:31:35.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.698+0000 7fc9dac109c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.1.9 2024-09-14T11:31:35.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.698+0000 7fc9dac109c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.1.10 2024-09-14T11:31:35.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.698+0000 7fc9dac109c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.1.10 2024-09-14T11:31:35.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.698+0000 7fc9dac109c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.1.11 2024-09-14T11:31:35.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.698+0000 7fc9dac109c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.1.11 2024-09-14T11:31:35.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.698+0000 7fc9dac109c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.0 2024-09-14T11:31:35.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.698+0000 7fc9dac109c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.1 2024-09-14T11:31:35.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.698+0000 7fc9dac109c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.2 2024-09-14T11:31:35.701 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.698+0000 7fc9dac109c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.3 2024-09-14T11:31:35.701 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.702+0000 7fc9dac109c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.4 2024-09-14T11:31:35.701 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.702+0000 7fc9dac109c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.5 2024-09-14T11:31:35.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.702+0000 7fc9dac109c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.6 2024-09-14T11:31:35.703 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.702+0000 7fc9dac109c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.7 2024-09-14T11:31:35.704 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.702+0000 7fc9dac109c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.8 2024-09-14T11:31:35.705 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.706+0000 7fc9dac109c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.9 2024-09-14T11:31:35.706 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.706+0000 7fc9dac109c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.10 2024-09-14T11:31:35.713 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.714+0000 7fc9dac109c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:35.713 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.714+0000 7fc9dac109c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.32 2024-09-14T11:31:35.715 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.714+0000 7fc9dac109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.32 info.flags=0x17 2024-09-14T11:31:35.716 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.714+0000 7fc9dac109c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.32 to cache LRU end 2024-09-14T11:31:35.716 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.714+0000 7fc9dac109c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:35.716 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.714+0000 7fc9dac109c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.32, ofs0, ns] 2024-09-14T11:31:35.716 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.714+0000 7fc8b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464373 cookie 94104361129184 notifier 7236 bl.length()=1015 2024-09-14T11:31:35.716 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.714+0000 7fc8b6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.32 info.flags=0x17 2024-09-14T11:31:35.717 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.714+0000 7fc8b6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.32 to cache LRU end 2024-09-14T11:31:35.717 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.714+0000 7fc8b6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:35.717 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.718+0000 7fc9dac109c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.32]): orig_sources= new_sources= 2024-09-14T11:31:35.717 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.718+0000 7fc9dac109c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.32]): potential sources added=[] removed=[] 2024-09-14T11:31:35.717 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.718+0000 7fc9dac109c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.32]): orig_dests= new_dests= 2024-09-14T11:31:35.717 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.718+0000 7fc9dac109c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.32]): potential dests added=[] removed=[] 2024-09-14T11:31:35.722 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.722+0000 7fc9dac109c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.0 2024-09-14T11:31:35.722 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.722+0000 7fc9dac109c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.1 2024-09-14T11:31:35.723 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.722+0000 7fc9dac109c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.2 2024-09-14T11:31:35.723 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.722+0000 7fc9dac109c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.3 2024-09-14T11:31:35.724 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.722+0000 7fc9dac109c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.4 2024-09-14T11:31:35.724 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.722+0000 7fc9dac109c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.5 2024-09-14T11:31:35.725 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.726+0000 7fc9dac109c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.6 2024-09-14T11:31:35.725 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.726+0000 7fc9dac109c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.7 2024-09-14T11:31:35.726 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.726+0000 7fc9dac109c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.8 2024-09-14T11:31:35.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.726+0000 7fc9dac109c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.9 2024-09-14T11:31:35.728 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.726+0000 7fc9dac109c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.32.10 2024-09-14T11:31:35.728 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.726+0000 7fc9dac109c0 -1 Injecting error=-125 at location=commit_target_layout 2024-09-14T11:31:35.728 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.726+0000 7fc9dac109c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:35.728 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.726+0000 7fc9dac109c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.32 2024-09-14T11:31:35.732 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.730+0000 7fc9dac109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.32 info.flags=0x17 2024-09-14T11:31:35.732 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.730+0000 7fc9dac109c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.32 to cache LRU end 2024-09-14T11:31:35.732 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.730+0000 7fc9dac109c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:35.732 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.730+0000 7fc9dac109c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.32, ofs0, ns] 2024-09-14T11:31:35.733 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.730+0000 7fc8b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464374 cookie 94104361129184 notifier 7236 bl.length()=983 2024-09-14T11:31:35.733 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.730+0000 7fc8b6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.32 info.flags=0x17 2024-09-14T11:31:35.733 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.730+0000 7fc8b6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.32 to cache LRU end 2024-09-14T11:31:35.733 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.730+0000 7fc8b6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:35.733 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.734+0000 7fc9dac109c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.32]): orig_sources= new_sources= 2024-09-14T11:31:35.733 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.734+0000 7fc9dac109c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.32]): potential sources added=[] removed=[] 2024-09-14T11:31:35.733 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.734+0000 7fc9dac109c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.32]): orig_dests= new_dests= 2024-09-14T11:31:35.734 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.734+0000 7fc9dac109c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.32]): potential dests added=[] removed=[] 2024-09-14T11:31:35.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.738+0000 7fc9dac109c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:31:35.741 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.742+0000 7fc88efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:35.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.742+0000 7fc9dac109c0 20 remove_watcher() i=0 2024-09-14T11:31:35.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.742+0000 7fc9dac109c0 2 removed watcher, disabling cache 2024-09-14T11:31:35.746 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.746+0000 7fc9dac109c0 20 remove_watcher() i=1 2024-09-14T11:31:35.748 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.746+0000 7fc9dac109c0 20 remove_watcher() i=2 2024-09-14T11:31:35.750 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.750+0000 7fc9dac109c0 20 remove_watcher() i=3 2024-09-14T11:31:35.752 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.750+0000 7fc9dac109c0 20 remove_watcher() i=4 2024-09-14T11:31:35.754 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.754+0000 7fc9dac109c0 20 remove_watcher() i=5 2024-09-14T11:31:35.757 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.758+0000 7fc9dac109c0 20 remove_watcher() i=6 2024-09-14T11:31:35.759 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.758+0000 7fc9dac109c0 20 remove_watcher() i=7 2024-09-14T11:31:35.773 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:31:35.800 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:35.800 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:35.841 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.842+0000 7fc165c959c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.844 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.842+0000 7fc165c959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:35.844 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.842+0000 7fc165c959c0 20 realm 2024-09-14T11:31:35.844 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.842+0000 7fc165c959c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.844 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.842+0000 7fc165c959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:35.844 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.842+0000 7fc165c959c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:35.845 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.846+0000 7fc165c959c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.845 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.846+0000 7fc165c959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:35.845 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.846+0000 7fc165c959c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.846 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.846+0000 7fc165c959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:35.846 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.846+0000 7fc165c959c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.847 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.846+0000 7fc165c959c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:35.847 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.846+0000 7fc165c959c0 20 searching for the correct realm 2024-09-14T11:31:35.852 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:35.850+0000 7fc16379b640 0 -- 172.21.15.71:0/3340455112 >> [v2:172.21.15.157:6808/527702018,v1:172.21.15.157:6809/527702018] conn(0x7fc15411cbf0 msgr2=0x7fc1540f4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:31:36.067 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.066+0000 7fc16379b640 0 -- 172.21.15.71:0/3340455112 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x5577adf607b0 msgr2=0x5577adf62c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:36.076 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.074+0000 7fc165c959c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:36.076 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.074+0000 7fc165c959c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:31:36.076 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.074+0000 7fc165c959c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:36.077 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.074+0000 7fc165c959c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:31:36.077 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.074+0000 7fc165c959c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:36.077 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.074+0000 7fc165c959c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:36.077 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.074+0000 7fc165c959c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:36.077 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.078+0000 7fc165c959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:36.077 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.078+0000 7fc165c959c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:36.078 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.078+0000 7fc165c959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:36.078 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.078+0000 7fc165c959c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:36.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.078+0000 7fc165c959c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:36.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.078+0000 7fc165c959c0 20 zone default found 2024-09-14T11:31:36.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.078+0000 7fc165c959c0 4 Realm: () 2024-09-14T11:31:36.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.078+0000 7fc165c959c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:31:36.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.078+0000 7fc165c959c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:31:36.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.078+0000 7fc165c959c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:36.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.078+0000 7fc165c959c0 20 zonegroup default 2024-09-14T11:31:36.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.078+0000 7fc165c959c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:36.080 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.078+0000 7fc165c959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:36.080 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.078+0000 7fc165c959c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:36.080 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.078+0000 7fc165c959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:36.080 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.078+0000 7fc165c959c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:36.081 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.082+0000 7fc165c959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:36.081 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.082+0000 7fc165c959c0 20 started sync module instance, tier type = 2024-09-14T11:31:36.081 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.082+0000 7fc165c959c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:31:36.105 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.102+0000 7fc165c959c0 20 add_watcher() i=0 2024-09-14T11:31:36.105 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.102+0000 7fc165c959c0 20 add_watcher() i=1 2024-09-14T11:31:36.105 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.102+0000 7fc165c959c0 20 add_watcher() i=2 2024-09-14T11:31:36.105 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.102+0000 7fc165c959c0 20 add_watcher() i=3 2024-09-14T11:31:36.105 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.102+0000 7fc165c959c0 20 add_watcher() i=4 2024-09-14T11:31:36.105 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.102+0000 7fc165c959c0 20 add_watcher() i=5 2024-09-14T11:31:36.105 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.102+0000 7fc165c959c0 20 add_watcher() i=6 2024-09-14T11:31:36.107 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.106+0000 7fc165c959c0 20 add_watcher() i=7 2024-09-14T11:31:36.107 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.106+0000 7fc165c959c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:36.112 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.110+0000 7fc019fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:36.113 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.114+0000 7fc165c959c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:36.113 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.114+0000 7fc165c959c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:36.113 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.114+0000 7fc165c959c0 5 note: GC not initialized 2024-09-14T11:31:36.114 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.114+0000 7fc018fe1640 20 reqs_thread_entry: start 2024-09-14T11:31:36.114 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.114+0000 7fc165c959c0 20 init_complete bucket index max shards: 11 2024-09-14T11:31:36.114 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.114+0000 7fc165c959c0 20 Filter name: none 2024-09-14T11:31:36.115 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.114+0000 7fbf927fc640 20 reqs_thread_entry: start 2024-09-14T11:31:36.115 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.114+0000 7fc165c959c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:36.115 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.114+0000 7fc165c959c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:36.115 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.114+0000 7fc165c959c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:36.117 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.118+0000 7fc165c959c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:31:36.117 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.118+0000 7fc165c959c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:36.117 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.118+0000 7fc165c959c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:36.117 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.118+0000 7fc165c959c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:36.117 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.118+0000 7fc165c959c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:36.118 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.118+0000 7fc165c959c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:31:36.118 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.118+0000 7fc165c959c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:36.121 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.122+0000 7fc019fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:36.125 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.126+0000 7fc165c959c0 20 remove_watcher() i=0 2024-09-14T11:31:36.125 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.126+0000 7fc165c959c0 2 removed watcher, disabling cache 2024-09-14T11:31:36.127 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.126+0000 7fc165c959c0 20 remove_watcher() i=1 2024-09-14T11:31:36.129 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.130+0000 7fc165c959c0 20 remove_watcher() i=2 2024-09-14T11:31:36.131 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.130+0000 7fc165c959c0 20 remove_watcher() i=3 2024-09-14T11:31:36.133 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.134+0000 7fc165c959c0 20 remove_watcher() i=4 2024-09-14T11:31:36.136 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.134+0000 7fc165c959c0 20 remove_watcher() i=5 2024-09-14T11:31:36.139 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.138+0000 7fc165c959c0 20 remove_watcher() i=6 2024-09-14T11:31:36.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.142+0000 7fc165c959c0 20 remove_watcher() i=7 2024-09-14T11:31:36.156 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:36.156 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:31:36.157 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: error-at-commit-target-layout id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.32 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:31:36.157 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:36.261 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-14T11:31:36.262 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:36.655 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:31:36.687 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:36.687 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:36.917 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.918+0000 7f770778b640 0 --2- 172.21.15.71:0/1811073207 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x56487ea26b50 0x56487eb9b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:31:36.949 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.950+0000 7f7709c859c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:36.952 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.950+0000 7f7709c859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:36.952 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.950+0000 7f7709c859c0 20 realm 2024-09-14T11:31:36.952 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.950+0000 7f7709c859c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:36.953 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.954+0000 7f7709c859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:36.953 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.954+0000 7f7709c859c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:36.953 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.954+0000 7f7709c859c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:36.953 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.954+0000 7f7709c859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:36.953 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.954+0000 7f7709c859c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:36.954 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.954+0000 7f7709c859c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:36.954 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.954+0000 7f7709c859c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:36.955 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.954+0000 7f7709c859c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:36.955 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.954+0000 7f7709c859c0 20 searching for the correct realm 2024-09-14T11:31:36.957 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.958+0000 7f76fffff640 0 -- 172.21.15.71:0/1528873171 >> [v2:172.21.15.71:6824/2436891866,v1:172.21.15.71:6825/2436891866] conn(0x7f76f8106070 msgr2=0x7f76f80bd810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:36.964 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.966+0000 7f7707f8c640 0 -- 172.21.15.71:0/1528873171 >> [v2:172.21.15.157:6816/1231501119,v1:172.21.15.157:6817/1231501119] conn(0x56487ec7d6b0 msgr2=0x56487ec7fad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:36.976 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.974+0000 7f7709c859c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:36.976 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.974+0000 7f7709c859c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:31:36.976 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.974+0000 7f7709c859c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:36.976 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.974+0000 7f7709c859c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:31:36.976 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.974+0000 7f7709c859c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:36.976 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.974+0000 7f7709c859c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:36.976 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.974+0000 7f7709c859c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:36.977 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.974+0000 7f7709c859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:36.977 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.974+0000 7f7709c859c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:36.977 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.978+0000 7f7709c859c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:36.977 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.978+0000 7f7709c859c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:36.977 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.978+0000 7f7709c859c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:36.977 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.978+0000 7f7709c859c0 20 zone default found 2024-09-14T11:31:36.978 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.978+0000 7f7709c859c0 4 Realm: () 2024-09-14T11:31:36.978 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.978+0000 7f7709c859c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:31:36.978 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.978+0000 7f7709c859c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:31:36.978 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.978+0000 7f7709c859c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:36.978 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.978+0000 7f7709c859c0 20 zonegroup default 2024-09-14T11:31:36.978 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.978+0000 7f7709c859c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:36.978 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.978+0000 7f7709c859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:36.978 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.978+0000 7f7709c859c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:36.979 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.978+0000 7f7709c859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:36.979 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.978+0000 7f7709c859c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:36.979 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.978+0000 7f7709c859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:36.979 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.978+0000 7f7709c859c0 20 started sync module instance, tier type = 2024-09-14T11:31:36.979 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.978+0000 7f7709c859c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:31:36.998 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.998+0000 7f7709c859c0 20 add_watcher() i=0 2024-09-14T11:31:36.998 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.998+0000 7f7709c859c0 20 add_watcher() i=1 2024-09-14T11:31:36.998 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.998+0000 7f7709c859c0 20 add_watcher() i=2 2024-09-14T11:31:36.998 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.998+0000 7f7709c859c0 20 add_watcher() i=3 2024-09-14T11:31:36.998 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.998+0000 7f7709c859c0 20 add_watcher() i=4 2024-09-14T11:31:36.998 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.998+0000 7f7709c859c0 20 add_watcher() i=5 2024-09-14T11:31:36.998 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.998+0000 7f7709c859c0 20 add_watcher() i=6 2024-09-14T11:31:37.000 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.998+0000 7f7709c859c0 20 add_watcher() i=7 2024-09-14T11:31:37.000 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:36.998+0000 7f7709c859c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:37.003 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.002+0000 7f75bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:37.004 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.002+0000 7f7709c859c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:37.004 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.002+0000 7f7709c859c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:37.005 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.002+0000 7f7709c859c0 5 note: GC not initialized 2024-09-14T11:31:37.005 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.002+0000 7f75bcfe1640 20 reqs_thread_entry: start 2024-09-14T11:31:37.005 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.002+0000 7f7709c859c0 20 init_complete bucket index max shards: 11 2024-09-14T11:31:37.005 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.002+0000 7f7709c859c0 20 Filter name: none 2024-09-14T11:31:37.005 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.002+0000 7f75367fc640 20 reqs_thread_entry: start 2024-09-14T11:31:37.005 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.002+0000 7f7709c859c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.005 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.006+0000 7f7709c859c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:37.006 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.006+0000 7f7709c859c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.006 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.006+0000 7f7709c859c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:31:37.007 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.006+0000 7f7709c859c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:37.007 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.006+0000 7f7709c859c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.007 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.006+0000 7f7709c859c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:37.007 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.006+0000 7f7709c859c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.008 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.006+0000 7f7709c859c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:31:37.008 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.006+0000 7f7709c859c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:37.010 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.010+0000 7f75bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:37.014 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.014+0000 7f7709c859c0 20 remove_watcher() i=0 2024-09-14T11:31:37.014 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.014+0000 7f7709c859c0 2 removed watcher, disabling cache 2024-09-14T11:31:37.016 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.014+0000 7f7709c859c0 20 remove_watcher() i=1 2024-09-14T11:31:37.018 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.018+0000 7f7709c859c0 20 remove_watcher() i=2 2024-09-14T11:31:37.020 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.018+0000 7f7709c859c0 20 remove_watcher() i=3 2024-09-14T11:31:37.022 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.022+0000 7f7709c859c0 20 remove_watcher() i=4 2024-09-14T11:31:37.024 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.022+0000 7f7709c859c0 20 remove_watcher() i=5 2024-09-14T11:31:37.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.026+0000 7f7709c859c0 20 remove_watcher() i=6 2024-09-14T11:31:37.029 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.030+0000 7f7709c859c0 20 remove_watcher() i=7 2024-09-14T11:31:37.044 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.044 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:31:37.044 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: abort-at-commit-target-layout id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:31:37.045 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.045 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-14T11:31:37.079 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:37.079 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:37.123 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.122+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.126 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.126+0000 7f9d53bdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.126 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.126+0000 7f9d53bdd9c0 20 realm 2024-09-14T11:31:37.126 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.126+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.126 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.126+0000 7f9d53bdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.127 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.126+0000 7f9d53bdd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:37.127 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.126+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.127 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.126+0000 7f9d53bdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.127 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.126+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.128 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.126+0000 7f9d53bdd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:37.128 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.126+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.128 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.126+0000 7f9d53bdd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:37.128 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.126+0000 7f9d53bdd9c0 20 searching for the correct realm 2024-09-14T11:31:37.132 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.130+0000 7f9d51ee4640 0 -- 172.21.15.71:0/3470052274 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f9d3c0ee040 msgr2=0x7f9d3c0ee930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:37.139 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.138+0000 7f9d51ee4640 0 -- 172.21.15.71:0/3470052274 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x5575e75d88b0 msgr2=0x5575e75daca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:37.148 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.146+0000 7f9d53bdd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:37.148 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.146+0000 7f9d53bdd9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:31:37.148 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.146+0000 7f9d53bdd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:37.148 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.146+0000 7f9d53bdd9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:31:37.148 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.146+0000 7f9d53bdd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:37.148 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.146+0000 7f9d53bdd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:37.148 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.146+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.146+0000 7f9d53bdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.146+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:37.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:37.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 zone default found 2024-09-14T11:31:37.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 4 Realm: () 2024-09-14T11:31:37.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:31:37.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:31:37.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:37.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 zonegroup default 2024-09-14T11:31:37.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 started sync module instance, tier type = 2024-09-14T11:31:37.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:31:37.169 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.170+0000 7f9d53bdd9c0 20 add_watcher() i=0 2024-09-14T11:31:37.169 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.170+0000 7f9d53bdd9c0 20 add_watcher() i=1 2024-09-14T11:31:37.169 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.170+0000 7f9d53bdd9c0 20 add_watcher() i=2 2024-09-14T11:31:37.169 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.170+0000 7f9d53bdd9c0 20 add_watcher() i=3 2024-09-14T11:31:37.169 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.170+0000 7f9d53bdd9c0 20 add_watcher() i=4 2024-09-14T11:31:37.169 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.170+0000 7f9d53bdd9c0 20 add_watcher() i=5 2024-09-14T11:31:37.169 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.170+0000 7f9d53bdd9c0 20 add_watcher() i=6 2024-09-14T11:31:37.171 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.170+0000 7f9d53bdd9c0 20 add_watcher() i=7 2024-09-14T11:31:37.171 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.170+0000 7f9d53bdd9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:37.174 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.174+0000 7f9c077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:37.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:37.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:37.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 note: GC not initialized 2024-09-14T11:31:37.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.174+0000 7f9c067e4640 20 reqs_thread_entry: start 2024-09-14T11:31:37.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:31:37.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 20 Filter name: none 2024-09-14T11:31:37.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.174+0000 7f9b77fff640 20 reqs_thread_entry: start 2024-09-14T11:31:37.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:31:37.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.178+0000 7f9d53bdd9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:37.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.178+0000 7f9d53bdd9c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:31:37.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.178+0000 7f9d53bdd9c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:31:37.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.178+0000 7f9d53bdd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 : miss 2024-09-14T11:31:37.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.178+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.178+0000 7f9d53bdd9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:31:37.178 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.178+0000 7f9d53bdd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 info.flags=0x17 2024-09-14T11:31:37.178 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.178+0000 7f9d53bdd9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 to cache LRU end 2024-09-14T11:31:37.178 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.178+0000 7f9d53bdd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:31:37.178 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.178+0000 7f9d53bdd9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:37.178 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.178+0000 7f9d53bdd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 2024-09-14T11:31:37.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.186+0000 7f9d53bdd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 info.flags=0x17 2024-09-14T11:31:37.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.186+0000 7f9d53bdd9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 to cache LRU end 2024-09-14T11:31:37.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.186+0000 7f9d53bdd9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:37.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.186+0000 7f9d53bdd9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33, ofs0, ns] 2024-09-14T11:31:37.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.186+0000 7f9c34ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464384 cookie 93964881241472 notifier 7287 bl.length()=1015 2024-09-14T11:31:37.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.186+0000 7f9c34ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 info.flags=0x17 2024-09-14T11:31:37.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.186+0000 7f9c34ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 to cache LRU end 2024-09-14T11:31:37.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.186+0000 7f9c34ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:37.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.186+0000 7f9d53bdd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.33]): orig_sources= new_sources= 2024-09-14T11:31:37.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.186+0000 7f9d53bdd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.33]): potential sources added=[] removed=[] 2024-09-14T11:31:37.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.186+0000 7f9d53bdd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.33]): orig_dests= new_dests= 2024-09-14T11:31:37.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.186+0000 7f9d53bdd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.33]): potential dests added=[] removed=[] 2024-09-14T11:31:37.199 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.0 2024-09-14T11:31:37.199 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.0 2024-09-14T11:31:37.199 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.1 2024-09-14T11:31:37.199 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.1 2024-09-14T11:31:37.199 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.2 2024-09-14T11:31:37.199 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.2 2024-09-14T11:31:37.199 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.3 2024-09-14T11:31:37.199 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.3 2024-09-14T11:31:37.199 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.4 2024-09-14T11:31:37.199 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.4 2024-09-14T11:31:37.199 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.5 2024-09-14T11:31:37.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.5 2024-09-14T11:31:37.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.6 2024-09-14T11:31:37.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.6 2024-09-14T11:31:37.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.7 2024-09-14T11:31:37.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.7 2024-09-14T11:31:37.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.8 2024-09-14T11:31:37.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.8 2024-09-14T11:31:37.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.9 2024-09-14T11:31:37.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.9 2024-09-14T11:31:37.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.10 2024-09-14T11:31:37.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.10 2024-09-14T11:31:37.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.11 2024-09-14T11:31:37.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.11 2024-09-14T11:31:37.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.0 2024-09-14T11:31:37.201 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1 2024-09-14T11:31:37.201 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.2 2024-09-14T11:31:37.201 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.202+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.3 2024-09-14T11:31:37.202 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.202+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.4 2024-09-14T11:31:37.203 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.202+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.5 2024-09-14T11:31:37.204 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.202+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.6 2024-09-14T11:31:37.205 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.206+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.7 2024-09-14T11:31:37.206 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.206+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.8 2024-09-14T11:31:37.206 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.206+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.9 2024-09-14T11:31:37.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.206+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.10 2024-09-14T11:31:37.214 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.214+0000 7f9d53bdd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:37.214 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.214+0000 7f9d53bdd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 2024-09-14T11:31:37.216 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.214+0000 7f9d53bdd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 info.flags=0x17 2024-09-14T11:31:37.216 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.214+0000 7f9d53bdd9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 to cache LRU end 2024-09-14T11:31:37.216 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.214+0000 7f9d53bdd9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:37.216 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.214+0000 7f9d53bdd9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33, ofs0, ns] 2024-09-14T11:31:37.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.214+0000 7f9c34ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464385 cookie 93964881241472 notifier 7287 bl.length()=1015 2024-09-14T11:31:37.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.214+0000 7f9c34ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 info.flags=0x17 2024-09-14T11:31:37.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.214+0000 7f9c34ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 to cache LRU end 2024-09-14T11:31:37.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.214+0000 7f9c34ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:37.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.218+0000 7f9d53bdd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.33]): orig_sources= new_sources= 2024-09-14T11:31:37.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.218+0000 7f9d53bdd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.33]): potential sources added=[] removed=[] 2024-09-14T11:31:37.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.218+0000 7f9d53bdd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.33]): orig_dests= new_dests= 2024-09-14T11:31:37.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.218+0000 7f9d53bdd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.33]): potential dests added=[] removed=[] 2024-09-14T11:31:37.223 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.222+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.0 2024-09-14T11:31:37.223 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.222+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1 2024-09-14T11:31:37.224 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.222+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.2 2024-09-14T11:31:37.225 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.226+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.3 2024-09-14T11:31:37.225 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.226+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.4 2024-09-14T11:31:37.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.226+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.5 2024-09-14T11:31:37.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.226+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.6 2024-09-14T11:31:37.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.226+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.7 2024-09-14T11:31:37.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.226+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.8 2024-09-14T11:31:37.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.230+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.9 2024-09-14T11:31:37.229 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.230+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.10 2024-09-14T11:31:37.230 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9d53bdd9c0 time 2024-09-14T11:31:37.236051+0000 2024-09-14T11:31:37.230 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:31:37.231 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:37.231 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f9d574b72eb] 2024-09-14T11:31:37.231 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9d574b749f] 2024-09-14T11:31:37.231 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5575e602fc01] 2024-09-14T11:31:37.232 INFO:tasks.workunit.client.0.smithi071.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x5575e60451a7] 2024-09-14T11:31:37.232 INFO:tasks.workunit.client.0.smithi071.stderr: 5: main() 2024-09-14T11:31:37.232 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9d5631dd90] 2024-09-14T11:31:37.232 INFO:tasks.workunit.client.0.smithi071.stderr: 7: __libc_start_main() 2024-09-14T11:31:37.232 INFO:tasks.workunit.client.0.smithi071.stderr: 8: _start() 2024-09-14T11:31:37.232 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.230+0000 7f9d53bdd9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9d53bdd9c0 time 2024-09-14T11:31:37.236051+0000 2024-09-14T11:31:37.232 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:31:37.232 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.232 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:37.232 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f9d574b72eb] 2024-09-14T11:31:37.232 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9d574b749f] 2024-09-14T11:31:37.232 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5575e602fc01] 2024-09-14T11:31:37.233 INFO:tasks.workunit.client.0.smithi071.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x5575e60451a7] 2024-09-14T11:31:37.233 INFO:tasks.workunit.client.0.smithi071.stderr: 5: main() 2024-09-14T11:31:37.233 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9d5631dd90] 2024-09-14T11:31:37.233 INFO:tasks.workunit.client.0.smithi071.stderr: 7: __libc_start_main() 2024-09-14T11:31:37.233 INFO:tasks.workunit.client.0.smithi071.stderr: 8: _start() 2024-09-14T11:31:37.233 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.233 INFO:tasks.workunit.client.0.smithi071.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:31:37.233 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f9d53bdd9c0 thread_name:radosgw-admin 2024-09-14T11:31:37.251 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:37.251 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f9d56336520] 2024-09-14T11:31:37.251 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:31:37.251 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:31:37.251 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:31:37.252 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f9d574b7345] 2024-09-14T11:31:37.252 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9d574b749f] 2024-09-14T11:31:37.252 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5575e602fc01] 2024-09-14T11:31:37.252 INFO:tasks.workunit.client.0.smithi071.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x5575e60451a7] 2024-09-14T11:31:37.252 INFO:tasks.workunit.client.0.smithi071.stderr: 9: main() 2024-09-14T11:31:37.252 INFO:tasks.workunit.client.0.smithi071.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9d5631dd90] 2024-09-14T11:31:37.252 INFO:tasks.workunit.client.0.smithi071.stderr: 11: __libc_start_main() 2024-09-14T11:31:37.252 INFO:tasks.workunit.client.0.smithi071.stderr: 12: _start() 2024-09-14T11:31:37.252 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.230+0000 7f9d53bdd9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:31:37.252 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f9d53bdd9c0 thread_name:radosgw-admin 2024-09-14T11:31:37.252 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.252 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:37.252 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f9d56336520] 2024-09-14T11:31:37.252 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:31:37.253 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:31:37.253 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:31:37.253 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f9d574b7345] 2024-09-14T11:31:37.253 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9d574b749f] 2024-09-14T11:31:37.253 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5575e602fc01] 2024-09-14T11:31:37.253 INFO:tasks.workunit.client.0.smithi071.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x5575e60451a7] 2024-09-14T11:31:37.253 INFO:tasks.workunit.client.0.smithi071.stderr: 9: main() 2024-09-14T11:31:37.253 INFO:tasks.workunit.client.0.smithi071.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9d5631dd90] 2024-09-14T11:31:37.253 INFO:tasks.workunit.client.0.smithi071.stderr: 11: __libc_start_main() 2024-09-14T11:31:37.253 INFO:tasks.workunit.client.0.smithi071.stderr: 12: _start() 2024-09-14T11:31:37.253 INFO:tasks.workunit.client.0.smithi071.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:31:37.253 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.253 INFO:tasks.workunit.client.0.smithi071.stderr:--- begin dump of recent events --- 2024-09-14T11:31:37.253 INFO:tasks.workunit.client.0.smithi071.stderr: -499> 2024-09-14T11:31:37.102+0000 7f9d53bdd9c0 5 asok(0x5575e72d8d90) register_command rotate-key hook 0x5575e74e4718 2024-09-14T11:31:37.254 INFO:tasks.workunit.client.0.smithi071.stderr: -498> 2024-09-14T11:31:37.102+0000 7f9d53bdd9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:31:37.254 INFO:tasks.workunit.client.0.smithi071.stderr: -497> 2024-09-14T11:31:37.102+0000 7f9d53bdd9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:31:37.254 INFO:tasks.workunit.client.0.smithi071.stderr: -496> 2024-09-14T11:31:37.102+0000 7f9d53bdd9c0 10 monclient(hunting): picked mon.noname-b con 0x5575e7371c20 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:31:37.254 INFO:tasks.workunit.client.0.smithi071.stderr: -495> 2024-09-14T11:31:37.102+0000 7f9d53bdd9c0 10 monclient(hunting): picked mon.noname-c con 0x5575e742df90 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:31:37.254 INFO:tasks.workunit.client.0.smithi071.stderr: -494> 2024-09-14T11:31:37.102+0000 7f9d53bdd9c0 10 monclient(hunting): picked mon.noname-a con 0x5575e742e8b0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:31:37.254 INFO:tasks.workunit.client.0.smithi071.stderr: -493> 2024-09-14T11:31:37.102+0000 7f9d53bdd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.254 INFO:tasks.workunit.client.0.smithi071.stderr: -492> 2024-09-14T11:31:37.102+0000 7f9d53bdd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.254 INFO:tasks.workunit.client.0.smithi071.stderr: -491> 2024-09-14T11:31:37.102+0000 7f9d53bdd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.254 INFO:tasks.workunit.client.0.smithi071.stderr: -490> 2024-09-14T11:31:37.102+0000 7f9d53bdd9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:31:37.254 INFO:tasks.workunit.client.0.smithi071.stderr: -489> 2024-09-14T11:31:37.102+0000 7f9d53bdd9c0 10 monclient(hunting): authenticate will time out at 2309.226640s 2024-09-14T11:31:37.254 INFO:tasks.workunit.client.0.smithi071.stderr: -488> 2024-09-14T11:31:37.102+0000 7f9d51ee4640 10 monclient(hunting): get_auth_request con 0x5575e742e8b0 auth_method 0 2024-09-14T11:31:37.254 INFO:tasks.workunit.client.0.smithi071.stderr: -487> 2024-09-14T11:31:37.102+0000 7f9d51ee4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.254 INFO:tasks.workunit.client.0.smithi071.stderr: -486> 2024-09-14T11:31:37.102+0000 7f9d51ee4640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.254 INFO:tasks.workunit.client.0.smithi071.stderr: -485> 2024-09-14T11:31:37.102+0000 7f9d51ee4640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.255 INFO:tasks.workunit.client.0.smithi071.stderr: -484> 2024-09-14T11:31:37.102+0000 7f9d50ee2640 10 monclient(hunting): get_auth_request con 0x5575e742df90 auth_method 0 2024-09-14T11:31:37.255 INFO:tasks.workunit.client.0.smithi071.stderr: -483> 2024-09-14T11:31:37.102+0000 7f9d50ee2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.255 INFO:tasks.workunit.client.0.smithi071.stderr: -482> 2024-09-14T11:31:37.102+0000 7f9d50ee2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.255 INFO:tasks.workunit.client.0.smithi071.stderr: -481> 2024-09-14T11:31:37.102+0000 7f9d50ee2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.255 INFO:tasks.workunit.client.0.smithi071.stderr: -480> 2024-09-14T11:31:37.102+0000 7f9d51ee4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:37.255 INFO:tasks.workunit.client.0.smithi071.stderr: -479> 2024-09-14T11:31:37.102+0000 7f9d51ee4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:37.255 INFO:tasks.workunit.client.0.smithi071.stderr: -478> 2024-09-14T11:31:37.102+0000 7f9d51ee4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:37.255 INFO:tasks.workunit.client.0.smithi071.stderr: -477> 2024-09-14T11:31:37.102+0000 7f9d50ee2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:37.255 INFO:tasks.workunit.client.0.smithi071.stderr: -476> 2024-09-14T11:31:37.102+0000 7f9d50ee2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:37.255 INFO:tasks.workunit.client.0.smithi071.stderr: -475> 2024-09-14T11:31:37.102+0000 7f9d50ee2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:37.255 INFO:tasks.workunit.client.0.smithi071.stderr: -474> 2024-09-14T11:31:37.102+0000 7f9d51ee4640 10 monclient(hunting): handle_auth_done global_id 7278 payload 824 2024-09-14T11:31:37.255 INFO:tasks.workunit.client.0.smithi071.stderr: -473> 2024-09-14T11:31:37.102+0000 7f9d51ee4640 10 monclient: _finish_hunting 0 2024-09-14T11:31:37.255 INFO:tasks.workunit.client.0.smithi071.stderr: -472> 2024-09-14T11:31:37.102+0000 7f9d51ee4640 1 monclient: found mon.noname-a 2024-09-14T11:31:37.255 INFO:tasks.workunit.client.0.smithi071.stderr: -471> 2024-09-14T11:31:37.102+0000 7f9d51ee4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:31:37.255 INFO:tasks.workunit.client.0.smithi071.stderr: -470> 2024-09-14T11:31:37.102+0000 7f9d516e3640 10 monclient: get_auth_request con 0x5575e7371c20 auth_method 0 2024-09-14T11:31:37.256 INFO:tasks.workunit.client.0.smithi071.stderr: -469> 2024-09-14T11:31:37.102+0000 7f9c3de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:37.256 INFO:tasks.workunit.client.0.smithi071.stderr: -468> 2024-09-14T11:31:37.102+0000 7f9c3de03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:31:37.256 INFO:tasks.workunit.client.0.smithi071.stderr: -467> 2024-09-14T11:31:37.102+0000 7f9c3de03640 10 monclient: dump: 2024-09-14T11:31:37.256 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:31:37.256 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:31:37.256 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:37.256 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:37.256 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:37.256 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:37.256 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:31:37.256 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:31:37.256 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:31:37.256 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.256 INFO:tasks.workunit.client.0.smithi071.stderr: -466> 2024-09-14T11:31:37.102+0000 7f9c3de03640 10 monclient: _finish_auth 0 2024-09-14T11:31:37.257 INFO:tasks.workunit.client.0.smithi071.stderr: -465> 2024-09-14T11:31:37.102+0000 7f9c3de03640 10 monclient: _check_auth_tickets 2024-09-14T11:31:37.257 INFO:tasks.workunit.client.0.smithi071.stderr: -464> 2024-09-14T11:31:37.102+0000 7f9c3de03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:37.257 INFO:tasks.workunit.client.0.smithi071.stderr: -463> 2024-09-14T11:31:37.102+0000 7f9c3de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:37.257 INFO:tasks.workunit.client.0.smithi071.stderr: -462> 2024-09-14T11:31:37.102+0000 7f9c3de03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:31:37.257 INFO:tasks.workunit.client.0.smithi071.stderr: -461> 2024-09-14T11:31:37.102+0000 7f9c3de03640 10 monclient: dump: 2024-09-14T11:31:37.257 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:31:37.257 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:31:37.257 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:37.257 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:37.257 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:37.257 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:37.257 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:31:37.257 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:31:37.257 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:31:37.258 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.258 INFO:tasks.workunit.client.0.smithi071.stderr: -460> 2024-09-14T11:31:37.102+0000 7f9c3f606640 4 set_mon_vals no callback set 2024-09-14T11:31:37.258 INFO:tasks.workunit.client.0.smithi071.stderr: -459> 2024-09-14T11:31:37.106+0000 7f9d53bdd9c0 5 monclient: authenticate success, global_id 7278 2024-09-14T11:31:37.258 INFO:tasks.workunit.client.0.smithi071.stderr: -458> 2024-09-14T11:31:37.106+0000 7f9d53bdd9c0 10 monclient: _renew_subs 2024-09-14T11:31:37.258 INFO:tasks.workunit.client.0.smithi071.stderr: -457> 2024-09-14T11:31:37.106+0000 7f9d53bdd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:31:37.258 INFO:tasks.workunit.client.0.smithi071.stderr: -456> 2024-09-14T11:31:37.106+0000 7f9d53bdd9c0 10 monclient: _renew_subs 2024-09-14T11:31:37.258 INFO:tasks.workunit.client.0.smithi071.stderr: -455> 2024-09-14T11:31:37.106+0000 7f9d53bdd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:31:37.258 INFO:tasks.workunit.client.0.smithi071.stderr: -454> 2024-09-14T11:31:37.106+0000 7f9d53bdd9c0 1 librados: init done 2024-09-14T11:31:37.258 INFO:tasks.workunit.client.0.smithi071.stderr: -453> 2024-09-14T11:31:37.106+0000 7f9c3de03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:31:37.258 INFO:tasks.workunit.client.0.smithi071.stderr: -452> 2024-09-14T11:31:37.106+0000 7f9c3de03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:31:37.258 INFO:tasks.workunit.client.0.smithi071.stderr: -451> 2024-09-14T11:31:37.106+0000 7f9c3de03640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:31:37.258 INFO:tasks.workunit.client.0.smithi071.stderr: -450> 2024-09-14T11:31:37.106+0000 7f9d516e3640 10 monclient: get_auth_request con 0x7f9c380718d0 auth_method 0 2024-09-14T11:31:37.258 INFO:tasks.workunit.client.0.smithi071.stderr: -449> 2024-09-14T11:31:37.106+0000 7f9d50ee2640 10 monclient: get_auth_request con 0x5575e7522290 auth_method 0 2024-09-14T11:31:37.258 INFO:tasks.workunit.client.0.smithi071.stderr: -448> 2024-09-14T11:31:37.110+0000 7f9d516e3640 10 monclient: get_auth_request con 0x5575e752f100 auth_method 0 2024-09-14T11:31:37.259 INFO:tasks.workunit.client.0.smithi071.stderr: -447> 2024-09-14T11:31:37.110+0000 7f9d50ee2640 10 monclient: get_auth_request con 0x5575e7533460 auth_method 0 2024-09-14T11:31:37.259 INFO:tasks.workunit.client.0.smithi071.stderr: -446> 2024-09-14T11:31:37.110+0000 7f9d51ee4640 10 monclient: get_auth_request con 0x5575e7532980 auth_method 0 2024-09-14T11:31:37.259 INFO:tasks.workunit.client.0.smithi071.stderr: -445> 2024-09-14T11:31:37.110+0000 7f9d53bdd9c0 10 monclient: build_initial_monmap 2024-09-14T11:31:37.259 INFO:tasks.workunit.client.0.smithi071.stderr: -444> 2024-09-14T11:31:37.110+0000 7f9d53bdd9c0 1 build_initial for_mkfs: 0 2024-09-14T11:31:37.259 INFO:tasks.workunit.client.0.smithi071.stderr: -443> 2024-09-14T11:31:37.110+0000 7f9d53bdd9c0 10 monclient: monmap: 2024-09-14T11:31:37.259 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:31:37.259 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:31:37.259 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:31:37.259 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:31:37.259 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:31:37.259 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:37.259 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:31:37.259 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:31:37.259 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:31:37.260 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.260 INFO:tasks.workunit.client.0.smithi071.stderr: -442> 2024-09-14T11:31:37.110+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753b540) adding auth protocol: cephx 2024-09-14T11:31:37.260 INFO:tasks.workunit.client.0.smithi071.stderr: -441> 2024-09-14T11:31:37.110+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753b540) adding auth protocol: cephx 2024-09-14T11:31:37.260 INFO:tasks.workunit.client.0.smithi071.stderr: -440> 2024-09-14T11:31:37.110+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753b540) adding auth protocol: cephx 2024-09-14T11:31:37.260 INFO:tasks.workunit.client.0.smithi071.stderr: -439> 2024-09-14T11:31:37.110+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753b540) adding con mode: secure 2024-09-14T11:31:37.260 INFO:tasks.workunit.client.0.smithi071.stderr: -438> 2024-09-14T11:31:37.110+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753b540) adding con mode: crc 2024-09-14T11:31:37.260 INFO:tasks.workunit.client.0.smithi071.stderr: -437> 2024-09-14T11:31:37.110+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753b540) adding con mode: secure 2024-09-14T11:31:37.260 INFO:tasks.workunit.client.0.smithi071.stderr: -436> 2024-09-14T11:31:37.110+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753b540) adding con mode: crc 2024-09-14T11:31:37.260 INFO:tasks.workunit.client.0.smithi071.stderr: -435> 2024-09-14T11:31:37.110+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753b540) adding con mode: secure 2024-09-14T11:31:37.260 INFO:tasks.workunit.client.0.smithi071.stderr: -434> 2024-09-14T11:31:37.110+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753b540) adding con mode: crc 2024-09-14T11:31:37.260 INFO:tasks.workunit.client.0.smithi071.stderr: -433> 2024-09-14T11:31:37.110+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753b540) adding con mode: crc 2024-09-14T11:31:37.261 INFO:tasks.workunit.client.0.smithi071.stderr: -432> 2024-09-14T11:31:37.110+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753b540) adding con mode: secure 2024-09-14T11:31:37.261 INFO:tasks.workunit.client.0.smithi071.stderr: -431> 2024-09-14T11:31:37.110+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753b540) adding con mode: crc 2024-09-14T11:31:37.261 INFO:tasks.workunit.client.0.smithi071.stderr: -430> 2024-09-14T11:31:37.110+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753b540) adding con mode: secure 2024-09-14T11:31:37.261 INFO:tasks.workunit.client.0.smithi071.stderr: -429> 2024-09-14T11:31:37.110+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753b540) adding con mode: crc 2024-09-14T11:31:37.261 INFO:tasks.workunit.client.0.smithi071.stderr: -428> 2024-09-14T11:31:37.110+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753b540) adding con mode: secure 2024-09-14T11:31:37.261 INFO:tasks.workunit.client.0.smithi071.stderr: -427> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.261 INFO:tasks.workunit.client.0.smithi071.stderr: -426> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 5 asok(0x5575e72d8d90) register_command objecter_requests cmddesc objecter_requests hook 0x5575e753ef70 EEXIST 2024-09-14T11:31:37.261 INFO:tasks.workunit.client.0.smithi071.stderr: -425> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 10 monclient: init 2024-09-14T11:31:37.261 INFO:tasks.workunit.client.0.smithi071.stderr: -424> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753a438) adding auth protocol: cephx 2024-09-14T11:31:37.261 INFO:tasks.workunit.client.0.smithi071.stderr: -423> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753a438) adding auth protocol: cephx 2024-09-14T11:31:37.261 INFO:tasks.workunit.client.0.smithi071.stderr: -422> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753a438) adding auth protocol: cephx 2024-09-14T11:31:37.261 INFO:tasks.workunit.client.0.smithi071.stderr: -421> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753a438) adding con mode: secure 2024-09-14T11:31:37.261 INFO:tasks.workunit.client.0.smithi071.stderr: -420> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753a438) adding con mode: crc 2024-09-14T11:31:37.262 INFO:tasks.workunit.client.0.smithi071.stderr: -419> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753a438) adding con mode: secure 2024-09-14T11:31:37.262 INFO:tasks.workunit.client.0.smithi071.stderr: -418> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753a438) adding con mode: crc 2024-09-14T11:31:37.262 INFO:tasks.workunit.client.0.smithi071.stderr: -417> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753a438) adding con mode: secure 2024-09-14T11:31:37.262 INFO:tasks.workunit.client.0.smithi071.stderr: -416> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753a438) adding con mode: crc 2024-09-14T11:31:37.262 INFO:tasks.workunit.client.0.smithi071.stderr: -415> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753a438) adding con mode: crc 2024-09-14T11:31:37.262 INFO:tasks.workunit.client.0.smithi071.stderr: -414> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753a438) adding con mode: secure 2024-09-14T11:31:37.262 INFO:tasks.workunit.client.0.smithi071.stderr: -413> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753a438) adding con mode: crc 2024-09-14T11:31:37.262 INFO:tasks.workunit.client.0.smithi071.stderr: -412> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753a438) adding con mode: secure 2024-09-14T11:31:37.262 INFO:tasks.workunit.client.0.smithi071.stderr: -411> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753a438) adding con mode: crc 2024-09-14T11:31:37.262 INFO:tasks.workunit.client.0.smithi071.stderr: -410> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753a438) adding con mode: secure 2024-09-14T11:31:37.262 INFO:tasks.workunit.client.0.smithi071.stderr: -409> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.262 INFO:tasks.workunit.client.0.smithi071.stderr: -408> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.262 INFO:tasks.workunit.client.0.smithi071.stderr: -407> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 5 asok(0x5575e72d8d90) register_command rotate-key cmddesc rotate-key hook 0x5575e753a580 EEXIST 2024-09-14T11:31:37.262 INFO:tasks.workunit.client.0.smithi071.stderr: -406> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:31:37.263 INFO:tasks.workunit.client.0.smithi071.stderr: -405> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:31:37.263 INFO:tasks.workunit.client.0.smithi071.stderr: -404> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 10 monclient(hunting): picked mon.noname-b con 0x5575e7563120 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:31:37.263 INFO:tasks.workunit.client.0.smithi071.stderr: -403> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 10 monclient(hunting): picked mon.noname-a con 0x5575e7562a50 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:31:37.263 INFO:tasks.workunit.client.0.smithi071.stderr: -402> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 10 monclient(hunting): picked mon.noname-c con 0x5575e7561430 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:31:37.263 INFO:tasks.workunit.client.0.smithi071.stderr: -401> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.263 INFO:tasks.workunit.client.0.smithi071.stderr: -400> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.263 INFO:tasks.workunit.client.0.smithi071.stderr: -399> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.263 INFO:tasks.workunit.client.0.smithi071.stderr: -398> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:31:37.263 INFO:tasks.workunit.client.0.smithi071.stderr: -397> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 10 monclient(hunting): authenticate will time out at 2309.237008s 2024-09-14T11:31:37.263 INFO:tasks.workunit.client.0.smithi071.stderr: -396> 2024-09-14T11:31:37.114+0000 7f9d51ee4640 10 monclient(hunting): get_auth_request con 0x5575e7562a50 auth_method 0 2024-09-14T11:31:37.263 INFO:tasks.workunit.client.0.smithi071.stderr: -395> 2024-09-14T11:31:37.114+0000 7f9d51ee4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.263 INFO:tasks.workunit.client.0.smithi071.stderr: -394> 2024-09-14T11:31:37.114+0000 7f9d51ee4640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.263 INFO:tasks.workunit.client.0.smithi071.stderr: -393> 2024-09-14T11:31:37.114+0000 7f9d51ee4640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.263 INFO:tasks.workunit.client.0.smithi071.stderr: -392> 2024-09-14T11:31:37.114+0000 7f9d516e3640 10 monclient(hunting): get_auth_request con 0x5575e7561430 auth_method 0 2024-09-14T11:31:37.263 INFO:tasks.workunit.client.0.smithi071.stderr: -391> 2024-09-14T11:31:37.114+0000 7f9d516e3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.263 INFO:tasks.workunit.client.0.smithi071.stderr: -390> 2024-09-14T11:31:37.114+0000 7f9d516e3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.264 INFO:tasks.workunit.client.0.smithi071.stderr: -389> 2024-09-14T11:31:37.114+0000 7f9d516e3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.264 INFO:tasks.workunit.client.0.smithi071.stderr: -388> 2024-09-14T11:31:37.114+0000 7f9d51ee4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:37.264 INFO:tasks.workunit.client.0.smithi071.stderr: -387> 2024-09-14T11:31:37.114+0000 7f9d51ee4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:37.264 INFO:tasks.workunit.client.0.smithi071.stderr: -386> 2024-09-14T11:31:37.114+0000 7f9d51ee4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:37.264 INFO:tasks.workunit.client.0.smithi071.stderr: -385> 2024-09-14T11:31:37.114+0000 7f9d516e3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:37.264 INFO:tasks.workunit.client.0.smithi071.stderr: -384> 2024-09-14T11:31:37.114+0000 7f9d516e3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:37.264 INFO:tasks.workunit.client.0.smithi071.stderr: -383> 2024-09-14T11:31:37.114+0000 7f9d516e3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:37.264 INFO:tasks.workunit.client.0.smithi071.stderr: -382> 2024-09-14T11:31:37.114+0000 7f9d50ee2640 10 monclient(hunting): get_auth_request con 0x5575e7563120 auth_method 0 2024-09-14T11:31:37.264 INFO:tasks.workunit.client.0.smithi071.stderr: -381> 2024-09-14T11:31:37.114+0000 7f9d50ee2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.264 INFO:tasks.workunit.client.0.smithi071.stderr: -380> 2024-09-14T11:31:37.114+0000 7f9d50ee2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.264 INFO:tasks.workunit.client.0.smithi071.stderr: -379> 2024-09-14T11:31:37.114+0000 7f9d50ee2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.264 INFO:tasks.workunit.client.0.smithi071.stderr: -378> 2024-09-14T11:31:37.114+0000 7f9d51ee4640 10 monclient(hunting): handle_auth_done global_id 7281 payload 824 2024-09-14T11:31:37.265 INFO:tasks.workunit.client.0.smithi071.stderr: -377> 2024-09-14T11:31:37.114+0000 7f9d51ee4640 10 monclient: _finish_hunting 0 2024-09-14T11:31:37.265 INFO:tasks.workunit.client.0.smithi071.stderr: -376> 2024-09-14T11:31:37.114+0000 7f9d51ee4640 1 monclient: found mon.noname-a 2024-09-14T11:31:37.265 INFO:tasks.workunit.client.0.smithi071.stderr: -375> 2024-09-14T11:31:37.114+0000 7f9d51ee4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:31:37.265 INFO:tasks.workunit.client.0.smithi071.stderr: -374> 2024-09-14T11:31:37.114+0000 7f9c36ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:37.265 INFO:tasks.workunit.client.0.smithi071.stderr: -373> 2024-09-14T11:31:37.114+0000 7f9c36ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:31:37.265 INFO:tasks.workunit.client.0.smithi071.stderr: -372> 2024-09-14T11:31:37.114+0000 7f9c36ffd640 10 monclient: dump: 2024-09-14T11:31:37.265 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:31:37.265 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:31:37.265 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:37.265 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:37.265 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:37.265 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:37.265 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:31:37.265 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:31:37.266 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:31:37.266 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.266 INFO:tasks.workunit.client.0.smithi071.stderr: -371> 2024-09-14T11:31:37.114+0000 7f9c36ffd640 10 monclient: _finish_auth 0 2024-09-14T11:31:37.266 INFO:tasks.workunit.client.0.smithi071.stderr: -370> 2024-09-14T11:31:37.114+0000 7f9c36ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:31:37.266 INFO:tasks.workunit.client.0.smithi071.stderr: -369> 2024-09-14T11:31:37.114+0000 7f9c36ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:37.266 INFO:tasks.workunit.client.0.smithi071.stderr: -368> 2024-09-14T11:31:37.114+0000 7f9c36ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:37.266 INFO:tasks.workunit.client.0.smithi071.stderr: -367> 2024-09-14T11:31:37.114+0000 7f9c36ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:31:37.266 INFO:tasks.workunit.client.0.smithi071.stderr: -366> 2024-09-14T11:31:37.114+0000 7f9c36ffd640 10 monclient: dump: 2024-09-14T11:31:37.266 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:31:37.266 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:31:37.266 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:37.266 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:37.266 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:37.266 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:37.266 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:31:37.266 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:31:37.267 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:31:37.267 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.267 INFO:tasks.workunit.client.0.smithi071.stderr: -365> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 5 monclient: authenticate success, global_id 7281 2024-09-14T11:31:37.267 INFO:tasks.workunit.client.0.smithi071.stderr: -364> 2024-09-14T11:31:37.114+0000 7f9d526e5640 4 set_mon_vals no callback set 2024-09-14T11:31:37.267 INFO:tasks.workunit.client.0.smithi071.stderr: -363> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 10 monclient: _renew_subs 2024-09-14T11:31:37.267 INFO:tasks.workunit.client.0.smithi071.stderr: -362> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:31:37.267 INFO:tasks.workunit.client.0.smithi071.stderr: -361> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 10 monclient: _renew_subs 2024-09-14T11:31:37.267 INFO:tasks.workunit.client.0.smithi071.stderr: -360> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:31:37.267 INFO:tasks.workunit.client.0.smithi071.stderr: -359> 2024-09-14T11:31:37.114+0000 7f9c36ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:31:37.267 INFO:tasks.workunit.client.0.smithi071.stderr: -358> 2024-09-14T11:31:37.114+0000 7f9c36ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:31:37.267 INFO:tasks.workunit.client.0.smithi071.stderr: -357> 2024-09-14T11:31:37.114+0000 7f9c36ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:31:37.267 INFO:tasks.workunit.client.0.smithi071.stderr: -356> 2024-09-14T11:31:37.114+0000 7f9d50ee2640 10 monclient: get_auth_request con 0x7f9c2c0717e0 auth_method 0 2024-09-14T11:31:37.267 INFO:tasks.workunit.client.0.smithi071.stderr: -355> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient: get_monmap_and_config 2024-09-14T11:31:37.267 INFO:tasks.workunit.client.0.smithi071.stderr: -354> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient: build_initial_monmap 2024-09-14T11:31:37.267 INFO:tasks.workunit.client.0.smithi071.stderr: -353> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 1 build_initial for_mkfs: 0 2024-09-14T11:31:37.268 INFO:tasks.workunit.client.0.smithi071.stderr: -352> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient: monmap: 2024-09-14T11:31:37.268 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:31:37.268 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:31:37.268 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:31:37.268 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:31:37.268 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:31:37.268 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:37.268 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:31:37.268 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:31:37.268 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:31:37.268 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.268 INFO:tasks.workunit.client.0.smithi071.stderr: -351> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7582aa0) adding auth protocol: cephx 2024-09-14T11:31:37.268 INFO:tasks.workunit.client.0.smithi071.stderr: -350> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7582aa0) adding auth protocol: cephx 2024-09-14T11:31:37.268 INFO:tasks.workunit.client.0.smithi071.stderr: -349> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7582aa0) adding auth protocol: cephx 2024-09-14T11:31:37.269 INFO:tasks.workunit.client.0.smithi071.stderr: -348> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7582aa0) adding con mode: secure 2024-09-14T11:31:37.269 INFO:tasks.workunit.client.0.smithi071.stderr: -347> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7582aa0) adding con mode: crc 2024-09-14T11:31:37.269 INFO:tasks.workunit.client.0.smithi071.stderr: -346> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7582aa0) adding con mode: secure 2024-09-14T11:31:37.269 INFO:tasks.workunit.client.0.smithi071.stderr: -345> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7582aa0) adding con mode: crc 2024-09-14T11:31:37.269 INFO:tasks.workunit.client.0.smithi071.stderr: -344> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7582aa0) adding con mode: secure 2024-09-14T11:31:37.269 INFO:tasks.workunit.client.0.smithi071.stderr: -343> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7582aa0) adding con mode: crc 2024-09-14T11:31:37.269 INFO:tasks.workunit.client.0.smithi071.stderr: -342> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7582aa0) adding con mode: crc 2024-09-14T11:31:37.269 INFO:tasks.workunit.client.0.smithi071.stderr: -341> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7582aa0) adding con mode: secure 2024-09-14T11:31:37.269 INFO:tasks.workunit.client.0.smithi071.stderr: -340> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7582aa0) adding con mode: crc 2024-09-14T11:31:37.269 INFO:tasks.workunit.client.0.smithi071.stderr: -339> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7582aa0) adding con mode: secure 2024-09-14T11:31:37.269 INFO:tasks.workunit.client.0.smithi071.stderr: -338> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7582aa0) adding con mode: crc 2024-09-14T11:31:37.269 INFO:tasks.workunit.client.0.smithi071.stderr: -337> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7582aa0) adding con mode: secure 2024-09-14T11:31:37.270 INFO:tasks.workunit.client.0.smithi071.stderr: -336> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.270 INFO:tasks.workunit.client.0.smithi071.stderr: -335> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient: init 2024-09-14T11:31:37.270 INFO:tasks.workunit.client.0.smithi071.stderr: -334> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe760609a0) adding auth protocol: cephx 2024-09-14T11:31:37.270 INFO:tasks.workunit.client.0.smithi071.stderr: -333> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe760609a0) adding auth protocol: cephx 2024-09-14T11:31:37.270 INFO:tasks.workunit.client.0.smithi071.stderr: -332> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe760609a0) adding auth protocol: cephx 2024-09-14T11:31:37.270 INFO:tasks.workunit.client.0.smithi071.stderr: -331> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe760609a0) adding con mode: secure 2024-09-14T11:31:37.270 INFO:tasks.workunit.client.0.smithi071.stderr: -330> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe760609a0) adding con mode: crc 2024-09-14T11:31:37.270 INFO:tasks.workunit.client.0.smithi071.stderr: -329> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe760609a0) adding con mode: secure 2024-09-14T11:31:37.270 INFO:tasks.workunit.client.0.smithi071.stderr: -328> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe760609a0) adding con mode: crc 2024-09-14T11:31:37.270 INFO:tasks.workunit.client.0.smithi071.stderr: -327> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe760609a0) adding con mode: secure 2024-09-14T11:31:37.270 INFO:tasks.workunit.client.0.smithi071.stderr: -326> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe760609a0) adding con mode: crc 2024-09-14T11:31:37.270 INFO:tasks.workunit.client.0.smithi071.stderr: -325> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe760609a0) adding con mode: crc 2024-09-14T11:31:37.270 INFO:tasks.workunit.client.0.smithi071.stderr: -324> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe760609a0) adding con mode: secure 2024-09-14T11:31:37.270 INFO:tasks.workunit.client.0.smithi071.stderr: -323> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe760609a0) adding con mode: crc 2024-09-14T11:31:37.270 INFO:tasks.workunit.client.0.smithi071.stderr: -322> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe760609a0) adding con mode: secure 2024-09-14T11:31:37.271 INFO:tasks.workunit.client.0.smithi071.stderr: -321> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe760609a0) adding con mode: crc 2024-09-14T11:31:37.271 INFO:tasks.workunit.client.0.smithi071.stderr: -320> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe760609a0) adding con mode: secure 2024-09-14T11:31:37.271 INFO:tasks.workunit.client.0.smithi071.stderr: -319> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.271 INFO:tasks.workunit.client.0.smithi071.stderr: -318> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.271 INFO:tasks.workunit.client.0.smithi071.stderr: -317> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 asok(0x5575e72d8d90) register_command rotate-key cmddesc rotate-key hook 0x7ffe76060ae8 EEXIST 2024-09-14T11:31:37.271 INFO:tasks.workunit.client.0.smithi071.stderr: -316> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:31:37.271 INFO:tasks.workunit.client.0.smithi071.stderr: -315> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:31:37.271 INFO:tasks.workunit.client.0.smithi071.stderr: -314> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient(hunting): picked mon.noname-a con 0x5575e75b70f0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:31:37.271 INFO:tasks.workunit.client.0.smithi071.stderr: -313> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient(hunting): picked mon.noname-c con 0x5575e7586b10 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:31:37.271 INFO:tasks.workunit.client.0.smithi071.stderr: -312> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient(hunting): picked mon.noname-b con 0x5575e75b28c0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:31:37.271 INFO:tasks.workunit.client.0.smithi071.stderr: -311> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.271 INFO:tasks.workunit.client.0.smithi071.stderr: -310> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.271 INFO:tasks.workunit.client.0.smithi071.stderr: -309> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.271 INFO:tasks.workunit.client.0.smithi071.stderr: -308> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:31:37.271 INFO:tasks.workunit.client.0.smithi071.stderr: -307> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient(hunting): authenticate will time out at 2309.241260s 2024-09-14T11:31:37.272 INFO:tasks.workunit.client.0.smithi071.stderr: -306> 2024-09-14T11:31:37.118+0000 7f9d51ee4640 10 monclient(hunting): get_auth_request con 0x5575e7586b10 auth_method 0 2024-09-14T11:31:37.272 INFO:tasks.workunit.client.0.smithi071.stderr: -305> 2024-09-14T11:31:37.118+0000 7f9d51ee4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.272 INFO:tasks.workunit.client.0.smithi071.stderr: -304> 2024-09-14T11:31:37.118+0000 7f9d51ee4640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.272 INFO:tasks.workunit.client.0.smithi071.stderr: -303> 2024-09-14T11:31:37.118+0000 7f9d51ee4640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.272 INFO:tasks.workunit.client.0.smithi071.stderr: -302> 2024-09-14T11:31:37.118+0000 7f9d50ee2640 10 monclient(hunting): get_auth_request con 0x5575e75b70f0 auth_method 0 2024-09-14T11:31:37.272 INFO:tasks.workunit.client.0.smithi071.stderr: -301> 2024-09-14T11:31:37.118+0000 7f9d50ee2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.272 INFO:tasks.workunit.client.0.smithi071.stderr: -300> 2024-09-14T11:31:37.118+0000 7f9d50ee2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.272 INFO:tasks.workunit.client.0.smithi071.stderr: -299> 2024-09-14T11:31:37.118+0000 7f9d50ee2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.272 INFO:tasks.workunit.client.0.smithi071.stderr: -298> 2024-09-14T11:31:37.118+0000 7f9d51ee4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:37.272 INFO:tasks.workunit.client.0.smithi071.stderr: -297> 2024-09-14T11:31:37.118+0000 7f9d51ee4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:37.272 INFO:tasks.workunit.client.0.smithi071.stderr: -296> 2024-09-14T11:31:37.118+0000 7f9d51ee4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:37.272 INFO:tasks.workunit.client.0.smithi071.stderr: -295> 2024-09-14T11:31:37.118+0000 7f9d50ee2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:37.272 INFO:tasks.workunit.client.0.smithi071.stderr: -294> 2024-09-14T11:31:37.118+0000 7f9d50ee2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:37.272 INFO:tasks.workunit.client.0.smithi071.stderr: -293> 2024-09-14T11:31:37.118+0000 7f9d50ee2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:37.273 INFO:tasks.workunit.client.0.smithi071.stderr: -292> 2024-09-14T11:31:37.118+0000 7f9d51ee4640 10 monclient(hunting): handle_auth_done global_id 6932 payload 274 2024-09-14T11:31:37.273 INFO:tasks.workunit.client.0.smithi071.stderr: -291> 2024-09-14T11:31:37.118+0000 7f9d51ee4640 10 monclient: _finish_hunting 0 2024-09-14T11:31:37.273 INFO:tasks.workunit.client.0.smithi071.stderr: -290> 2024-09-14T11:31:37.118+0000 7f9d51ee4640 1 monclient: found mon.noname-c 2024-09-14T11:31:37.273 INFO:tasks.workunit.client.0.smithi071.stderr: -289> 2024-09-14T11:31:37.118+0000 7f9d51ee4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:31:37.273 INFO:tasks.workunit.client.0.smithi071.stderr: -288> 2024-09-14T11:31:37.118+0000 7f9c34ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:37.273 INFO:tasks.workunit.client.0.smithi071.stderr: -287> 2024-09-14T11:31:37.118+0000 7f9c34ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:31:37.273 INFO:tasks.workunit.client.0.smithi071.stderr: -286> 2024-09-14T11:31:37.118+0000 7f9c34ff9640 10 monclient: dump: 2024-09-14T11:31:37.273 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:31:37.273 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:31:37.273 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:37.273 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:37.273 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:37.273 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:37.273 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:31:37.273 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:31:37.274 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:31:37.274 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.274 INFO:tasks.workunit.client.0.smithi071.stderr: -285> 2024-09-14T11:31:37.118+0000 7f9c34ff9640 10 monclient: _finish_auth 0 2024-09-14T11:31:37.274 INFO:tasks.workunit.client.0.smithi071.stderr: -284> 2024-09-14T11:31:37.118+0000 7f9c34ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:31:37.274 INFO:tasks.workunit.client.0.smithi071.stderr: -283> 2024-09-14T11:31:37.118+0000 7f9c34ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:37.274 INFO:tasks.workunit.client.0.smithi071.stderr: -282> 2024-09-14T11:31:37.118+0000 7f9c34ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:37.274 INFO:tasks.workunit.client.0.smithi071.stderr: -281> 2024-09-14T11:31:37.118+0000 7f9c34ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:31:37.274 INFO:tasks.workunit.client.0.smithi071.stderr: -280> 2024-09-14T11:31:37.118+0000 7f9c34ff9640 10 monclient: dump: 2024-09-14T11:31:37.274 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:31:37.274 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:31:37.274 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:37.274 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:37.274 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:37.274 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:37.274 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:31:37.275 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:31:37.275 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:31:37.275 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.275 INFO:tasks.workunit.client.0.smithi071.stderr: -279> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 monclient: authenticate success, global_id 6932 2024-09-14T11:31:37.275 INFO:tasks.workunit.client.0.smithi071.stderr: -278> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:31:37.275 INFO:tasks.workunit.client.0.smithi071.stderr: -277> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 4 set_mon_vals no callback set 2024-09-14T11:31:37.275 INFO:tasks.workunit.client.0.smithi071.stderr: -276> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient: shutdown 2024-09-14T11:31:37.275 INFO:tasks.workunit.client.0.smithi071.stderr: -275> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient: build_initial_monmap 2024-09-14T11:31:37.275 INFO:tasks.workunit.client.0.smithi071.stderr: -274> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 1 build_initial for_mkfs: 0 2024-09-14T11:31:37.275 INFO:tasks.workunit.client.0.smithi071.stderr: -273> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient: monmap: 2024-09-14T11:31:37.275 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:31:37.275 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:31:37.275 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:31:37.276 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:31:37.276 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:31:37.276 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:37.276 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:31:37.276 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:31:37.276 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:31:37.276 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.276 INFO:tasks.workunit.client.0.smithi071.stderr: -272> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e75a7b10) adding auth protocol: cephx 2024-09-14T11:31:37.276 INFO:tasks.workunit.client.0.smithi071.stderr: -271> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e75a7b10) adding auth protocol: cephx 2024-09-14T11:31:37.276 INFO:tasks.workunit.client.0.smithi071.stderr: -270> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e75a7b10) adding auth protocol: cephx 2024-09-14T11:31:37.276 INFO:tasks.workunit.client.0.smithi071.stderr: -269> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e75a7b10) adding con mode: secure 2024-09-14T11:31:37.276 INFO:tasks.workunit.client.0.smithi071.stderr: -268> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e75a7b10) adding con mode: crc 2024-09-14T11:31:37.276 INFO:tasks.workunit.client.0.smithi071.stderr: -267> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e75a7b10) adding con mode: secure 2024-09-14T11:31:37.277 INFO:tasks.workunit.client.0.smithi071.stderr: -266> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e75a7b10) adding con mode: crc 2024-09-14T11:31:37.277 INFO:tasks.workunit.client.0.smithi071.stderr: -265> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e75a7b10) adding con mode: secure 2024-09-14T11:31:37.277 INFO:tasks.workunit.client.0.smithi071.stderr: -264> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e75a7b10) adding con mode: crc 2024-09-14T11:31:37.277 INFO:tasks.workunit.client.0.smithi071.stderr: -263> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e75a7b10) adding con mode: crc 2024-09-14T11:31:37.277 INFO:tasks.workunit.client.0.smithi071.stderr: -262> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e75a7b10) adding con mode: secure 2024-09-14T11:31:37.277 INFO:tasks.workunit.client.0.smithi071.stderr: -261> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e75a7b10) adding con mode: crc 2024-09-14T11:31:37.277 INFO:tasks.workunit.client.0.smithi071.stderr: -260> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e75a7b10) adding con mode: secure 2024-09-14T11:31:37.277 INFO:tasks.workunit.client.0.smithi071.stderr: -259> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e75a7b10) adding con mode: crc 2024-09-14T11:31:37.277 INFO:tasks.workunit.client.0.smithi071.stderr: -258> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e75a7b10) adding con mode: secure 2024-09-14T11:31:37.277 INFO:tasks.workunit.client.0.smithi071.stderr: -257> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.277 INFO:tasks.workunit.client.0.smithi071.stderr: -256> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 1 librados: starting msgr at 2024-09-14T11:31:37.277 INFO:tasks.workunit.client.0.smithi071.stderr: -255> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 1 librados: starting objecter 2024-09-14T11:31:37.277 INFO:tasks.workunit.client.0.smithi071.stderr: -254> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 asok(0x5575e72d8d90) register_command objecter_requests cmddesc objecter_requests hook 0x5575e7586af0 EEXIST 2024-09-14T11:31:37.277 INFO:tasks.workunit.client.0.smithi071.stderr: -253> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 1 librados: setting wanted keys 2024-09-14T11:31:37.277 INFO:tasks.workunit.client.0.smithi071.stderr: -252> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 1 librados: calling monclient init 2024-09-14T11:31:37.278 INFO:tasks.workunit.client.0.smithi071.stderr: -251> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient: init 2024-09-14T11:31:37.278 INFO:tasks.workunit.client.0.smithi071.stderr: -250> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7564f40) adding auth protocol: cephx 2024-09-14T11:31:37.278 INFO:tasks.workunit.client.0.smithi071.stderr: -249> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7564f40) adding auth protocol: cephx 2024-09-14T11:31:37.278 INFO:tasks.workunit.client.0.smithi071.stderr: -248> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7564f40) adding auth protocol: cephx 2024-09-14T11:31:37.278 INFO:tasks.workunit.client.0.smithi071.stderr: -247> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7564f40) adding con mode: secure 2024-09-14T11:31:37.278 INFO:tasks.workunit.client.0.smithi071.stderr: -246> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7564f40) adding con mode: crc 2024-09-14T11:31:37.278 INFO:tasks.workunit.client.0.smithi071.stderr: -245> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7564f40) adding con mode: secure 2024-09-14T11:31:37.278 INFO:tasks.workunit.client.0.smithi071.stderr: -244> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7564f40) adding con mode: crc 2024-09-14T11:31:37.278 INFO:tasks.workunit.client.0.smithi071.stderr: -243> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7564f40) adding con mode: secure 2024-09-14T11:31:37.278 INFO:tasks.workunit.client.0.smithi071.stderr: -242> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7564f40) adding con mode: crc 2024-09-14T11:31:37.278 INFO:tasks.workunit.client.0.smithi071.stderr: -241> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7564f40) adding con mode: crc 2024-09-14T11:31:37.278 INFO:tasks.workunit.client.0.smithi071.stderr: -240> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7564f40) adding con mode: secure 2024-09-14T11:31:37.278 INFO:tasks.workunit.client.0.smithi071.stderr: -239> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7564f40) adding con mode: crc 2024-09-14T11:31:37.278 INFO:tasks.workunit.client.0.smithi071.stderr: -238> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7564f40) adding con mode: secure 2024-09-14T11:31:37.279 INFO:tasks.workunit.client.0.smithi071.stderr: -237> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7564f40) adding con mode: crc 2024-09-14T11:31:37.279 INFO:tasks.workunit.client.0.smithi071.stderr: -236> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7564f40) adding con mode: secure 2024-09-14T11:31:37.279 INFO:tasks.workunit.client.0.smithi071.stderr: -235> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.279 INFO:tasks.workunit.client.0.smithi071.stderr: -234> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.279 INFO:tasks.workunit.client.0.smithi071.stderr: -233> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 asok(0x5575e72d8d90) register_command rotate-key cmddesc rotate-key hook 0x5575e7565088 EEXIST 2024-09-14T11:31:37.279 INFO:tasks.workunit.client.0.smithi071.stderr: -232> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:31:37.279 INFO:tasks.workunit.client.0.smithi071.stderr: -231> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:31:37.279 INFO:tasks.workunit.client.0.smithi071.stderr: -230> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient(hunting): picked mon.noname-b con 0x5575e7586b10 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:31:37.279 INFO:tasks.workunit.client.0.smithi071.stderr: -229> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient(hunting): picked mon.noname-c con 0x5575e75b28c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:31:37.279 INFO:tasks.workunit.client.0.smithi071.stderr: -228> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient(hunting): picked mon.noname-a con 0x5575e75b70f0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:31:37.279 INFO:tasks.workunit.client.0.smithi071.stderr: -227> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.279 INFO:tasks.workunit.client.0.smithi071.stderr: -226> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.279 INFO:tasks.workunit.client.0.smithi071.stderr: -225> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.279 INFO:tasks.workunit.client.0.smithi071.stderr: -224> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:31:37.279 INFO:tasks.workunit.client.0.smithi071.stderr: -223> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient(hunting): authenticate will time out at 2309.243846s 2024-09-14T11:31:37.280 INFO:tasks.workunit.client.0.smithi071.stderr: -222> 2024-09-14T11:31:37.118+0000 7f9d516e3640 10 monclient(hunting): get_auth_request con 0x5575e75b70f0 auth_method 0 2024-09-14T11:31:37.280 INFO:tasks.workunit.client.0.smithi071.stderr: -221> 2024-09-14T11:31:37.118+0000 7f9d516e3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.280 INFO:tasks.workunit.client.0.smithi071.stderr: -220> 2024-09-14T11:31:37.118+0000 7f9d516e3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.280 INFO:tasks.workunit.client.0.smithi071.stderr: -219> 2024-09-14T11:31:37.118+0000 7f9d516e3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.280 INFO:tasks.workunit.client.0.smithi071.stderr: -218> 2024-09-14T11:31:37.118+0000 7f9d51ee4640 10 monclient(hunting): get_auth_request con 0x5575e75b28c0 auth_method 0 2024-09-14T11:31:37.280 INFO:tasks.workunit.client.0.smithi071.stderr: -217> 2024-09-14T11:31:37.122+0000 7f9d51ee4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.280 INFO:tasks.workunit.client.0.smithi071.stderr: -216> 2024-09-14T11:31:37.122+0000 7f9d51ee4640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.280 INFO:tasks.workunit.client.0.smithi071.stderr: -215> 2024-09-14T11:31:37.122+0000 7f9d51ee4640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.280 INFO:tasks.workunit.client.0.smithi071.stderr: -214> 2024-09-14T11:31:37.122+0000 7f9d516e3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:37.280 INFO:tasks.workunit.client.0.smithi071.stderr: -213> 2024-09-14T11:31:37.122+0000 7f9d516e3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:37.280 INFO:tasks.workunit.client.0.smithi071.stderr: -212> 2024-09-14T11:31:37.122+0000 7f9d516e3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:37.280 INFO:tasks.workunit.client.0.smithi071.stderr: -211> 2024-09-14T11:31:37.122+0000 7f9d51ee4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:37.280 INFO:tasks.workunit.client.0.smithi071.stderr: -210> 2024-09-14T11:31:37.122+0000 7f9d51ee4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:37.280 INFO:tasks.workunit.client.0.smithi071.stderr: -209> 2024-09-14T11:31:37.122+0000 7f9d51ee4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:37.280 INFO:tasks.workunit.client.0.smithi071.stderr: -208> 2024-09-14T11:31:37.122+0000 7f9d516e3640 10 monclient(hunting): handle_auth_done global_id 7287 payload 824 2024-09-14T11:31:37.281 INFO:tasks.workunit.client.0.smithi071.stderr: -207> 2024-09-14T11:31:37.122+0000 7f9d516e3640 10 monclient: _finish_hunting 0 2024-09-14T11:31:37.281 INFO:tasks.workunit.client.0.smithi071.stderr: -206> 2024-09-14T11:31:37.122+0000 7f9d516e3640 1 monclient: found mon.noname-a 2024-09-14T11:31:37.281 INFO:tasks.workunit.client.0.smithi071.stderr: -205> 2024-09-14T11:31:37.122+0000 7f9d516e3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:31:37.281 INFO:tasks.workunit.client.0.smithi071.stderr: -204> 2024-09-14T11:31:37.122+0000 7f9d50ee2640 10 monclient: get_auth_request con 0x5575e7586b10 auth_method 0 2024-09-14T11:31:37.281 INFO:tasks.workunit.client.0.smithi071.stderr: -203> 2024-09-14T11:31:37.122+0000 7f9c22ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:37.281 INFO:tasks.workunit.client.0.smithi071.stderr: -202> 2024-09-14T11:31:37.122+0000 7f9c22ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:31:37.281 INFO:tasks.workunit.client.0.smithi071.stderr: -201> 2024-09-14T11:31:37.122+0000 7f9c22ffd640 10 monclient: dump: 2024-09-14T11:31:37.281 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:31:37.281 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:31:37.281 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:37.281 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:37.281 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:37.281 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:37.281 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:31:37.281 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:31:37.281 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:31:37.282 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.282 INFO:tasks.workunit.client.0.smithi071.stderr: -200> 2024-09-14T11:31:37.122+0000 7f9c22ffd640 10 monclient: _finish_auth 0 2024-09-14T11:31:37.282 INFO:tasks.workunit.client.0.smithi071.stderr: -199> 2024-09-14T11:31:37.122+0000 7f9c22ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:31:37.282 INFO:tasks.workunit.client.0.smithi071.stderr: -198> 2024-09-14T11:31:37.122+0000 7f9c22ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:37.282 INFO:tasks.workunit.client.0.smithi071.stderr: -197> 2024-09-14T11:31:37.122+0000 7f9c22ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:37.282 INFO:tasks.workunit.client.0.smithi071.stderr: -196> 2024-09-14T11:31:37.122+0000 7f9c22ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:31:37.282 INFO:tasks.workunit.client.0.smithi071.stderr: -195> 2024-09-14T11:31:37.122+0000 7f9c22ffd640 10 monclient: dump: 2024-09-14T11:31:37.282 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:31:37.282 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:31:37.282 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:37.282 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:37.282 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:37.282 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:37.282 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:31:37.282 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:31:37.282 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:31:37.283 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.283 INFO:tasks.workunit.client.0.smithi071.stderr: -194> 2024-09-14T11:31:37.122+0000 7f9c34ff9640 4 set_mon_vals no callback set 2024-09-14T11:31:37.283 INFO:tasks.workunit.client.0.smithi071.stderr: -193> 2024-09-14T11:31:37.122+0000 7f9d53bdd9c0 5 monclient: authenticate success, global_id 7287 2024-09-14T11:31:37.283 INFO:tasks.workunit.client.0.smithi071.stderr: -192> 2024-09-14T11:31:37.122+0000 7f9d53bdd9c0 10 monclient: _renew_subs 2024-09-14T11:31:37.283 INFO:tasks.workunit.client.0.smithi071.stderr: -191> 2024-09-14T11:31:37.122+0000 7f9d53bdd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:31:37.283 INFO:tasks.workunit.client.0.smithi071.stderr: -190> 2024-09-14T11:31:37.122+0000 7f9d53bdd9c0 10 monclient: _renew_subs 2024-09-14T11:31:37.283 INFO:tasks.workunit.client.0.smithi071.stderr: -189> 2024-09-14T11:31:37.122+0000 7f9d53bdd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:31:37.283 INFO:tasks.workunit.client.0.smithi071.stderr: -188> 2024-09-14T11:31:37.122+0000 7f9d53bdd9c0 1 librados: init done 2024-09-14T11:31:37.283 INFO:tasks.workunit.client.0.smithi071.stderr: -187> 2024-09-14T11:31:37.122+0000 7f9d53bdd9c0 5 asok(0x5575e72d8d90) register_command cr dump hook 0x5575e75a4308 2024-09-14T11:31:37.283 INFO:tasks.workunit.client.0.smithi071.stderr: -186> 2024-09-14T11:31:37.122+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.283 INFO:tasks.workunit.client.0.smithi071.stderr: -185> 2024-09-14T11:31:37.122+0000 7f9c22ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:31:37.283 INFO:tasks.workunit.client.0.smithi071.stderr: -184> 2024-09-14T11:31:37.122+0000 7f9c22ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:31:37.283 INFO:tasks.workunit.client.0.smithi071.stderr: -183> 2024-09-14T11:31:37.122+0000 7f9c22ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:31:37.283 INFO:tasks.workunit.client.0.smithi071.stderr: -182> 2024-09-14T11:31:37.122+0000 7f9d50ee2640 10 monclient: get_auth_request con 0x7f9c1c0718a0 auth_method 0 2024-09-14T11:31:37.283 INFO:tasks.workunit.client.0.smithi071.stderr: -181> 2024-09-14T11:31:37.126+0000 7f9d51ee4640 10 monclient: get_auth_request con 0x5575e75d0de0 auth_method 0 2024-09-14T11:31:37.284 INFO:tasks.workunit.client.0.smithi071.stderr: -180> 2024-09-14T11:31:37.126+0000 7f9d53bdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.284 INFO:tasks.workunit.client.0.smithi071.stderr: -179> 2024-09-14T11:31:37.126+0000 7f9d53bdd9c0 20 realm 2024-09-14T11:31:37.284 INFO:tasks.workunit.client.0.smithi071.stderr: -178> 2024-09-14T11:31:37.126+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.284 INFO:tasks.workunit.client.0.smithi071.stderr: -177> 2024-09-14T11:31:37.126+0000 7f9d53bdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.284 INFO:tasks.workunit.client.0.smithi071.stderr: -176> 2024-09-14T11:31:37.126+0000 7f9d53bdd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:37.284 INFO:tasks.workunit.client.0.smithi071.stderr: -175> 2024-09-14T11:31:37.126+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.284 INFO:tasks.workunit.client.0.smithi071.stderr: -174> 2024-09-14T11:31:37.126+0000 7f9d53bdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.284 INFO:tasks.workunit.client.0.smithi071.stderr: -173> 2024-09-14T11:31:37.126+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.284 INFO:tasks.workunit.client.0.smithi071.stderr: -172> 2024-09-14T11:31:37.126+0000 7f9d50ee2640 10 monclient: get_auth_request con 0x5575e75d5050 auth_method 0 2024-09-14T11:31:37.284 INFO:tasks.workunit.client.0.smithi071.stderr: -171> 2024-09-14T11:31:37.126+0000 7f9d53bdd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:37.284 INFO:tasks.workunit.client.0.smithi071.stderr: -170> 2024-09-14T11:31:37.126+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.284 INFO:tasks.workunit.client.0.smithi071.stderr: -169> 2024-09-14T11:31:37.126+0000 7f9d51ee4640 10 monclient: get_auth_request con 0x5575e75d88b0 auth_method 0 2024-09-14T11:31:37.284 INFO:tasks.workunit.client.0.smithi071.stderr: -168> 2024-09-14T11:31:37.126+0000 7f9d53bdd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:37.284 INFO:tasks.workunit.client.0.smithi071.stderr: -167> 2024-09-14T11:31:37.126+0000 7f9d53bdd9c0 20 searching for the correct realm 2024-09-14T11:31:37.285 INFO:tasks.workunit.client.0.smithi071.stderr: -166> 2024-09-14T11:31:37.130+0000 7f9d516e3640 10 monclient: get_auth_request con 0x5575e75dd5b0 auth_method 0 2024-09-14T11:31:37.285 INFO:tasks.workunit.client.0.smithi071.stderr: -165> 2024-09-14T11:31:37.130+0000 7f9d50ee2640 10 monclient: get_auth_request con 0x7f9d44031070 auth_method 0 2024-09-14T11:31:37.285 INFO:tasks.workunit.client.0.smithi071.stderr: -164> 2024-09-14T11:31:37.130+0000 7f9d51ee4640 10 monclient: get_auth_request con 0x7f9d3c0ee040 auth_method 0 2024-09-14T11:31:37.285 INFO:tasks.workunit.client.0.smithi071.stderr: -163> 2024-09-14T11:31:37.130+0000 7f9d51ee4640 0 -- 172.21.15.71:0/3470052274 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f9d3c0ee040 msgr2=0x7f9d3c0ee930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:37.285 INFO:tasks.workunit.client.0.smithi071.stderr: -162> 2024-09-14T11:31:37.130+0000 7f9c22ffd640 1 client.7287.objecter ms_handle_reset 0x7f9d3c0ee040 session 0x7f9d3c0a6070 osd.0 2024-09-14T11:31:37.285 INFO:tasks.workunit.client.0.smithi071.stderr: -161> 2024-09-14T11:31:37.130+0000 7f9c22ffd640 10 monclient: _renew_subs 2024-09-14T11:31:37.285 INFO:tasks.workunit.client.0.smithi071.stderr: -160> 2024-09-14T11:31:37.130+0000 7f9c22ffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:31:37.285 INFO:tasks.workunit.client.0.smithi071.stderr: -159> 2024-09-14T11:31:37.130+0000 7f9d51ee4640 10 monclient: get_auth_request con 0x7f9c1c0813c0 auth_method 0 2024-09-14T11:31:37.285 INFO:tasks.workunit.client.0.smithi071.stderr: -158> 2024-09-14T11:31:37.134+0000 7f9d516e3640 10 monclient: get_auth_request con 0x7f9d44066070 auth_method 0 2024-09-14T11:31:37.285 INFO:tasks.workunit.client.0.smithi071.stderr: -157> 2024-09-14T11:31:37.138+0000 7f9d50ee2640 10 monclient: get_auth_request con 0x7f9d3c0df410 auth_method 0 2024-09-14T11:31:37.285 INFO:tasks.workunit.client.0.smithi071.stderr: -156> 2024-09-14T11:31:37.138+0000 7f9d51ee4640 0 -- 172.21.15.71:0/3470052274 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x5575e75d88b0 msgr2=0x5575e75daca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:37.285 INFO:tasks.workunit.client.0.smithi071.stderr: -155> 2024-09-14T11:31:37.138+0000 7f9c22ffd640 1 client.7287.objecter ms_handle_reset 0x5575e75d88b0 session 0x5575e75d43a0 osd.3 2024-09-14T11:31:37.285 INFO:tasks.workunit.client.0.smithi071.stderr: -154> 2024-09-14T11:31:37.138+0000 7f9d51ee4640 10 monclient: get_auth_request con 0x7f9d3c0ee040 auth_method 0 2024-09-14T11:31:37.285 INFO:tasks.workunit.client.0.smithi071.stderr: -153> 2024-09-14T11:31:37.146+0000 7f9d53bdd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:37.286 INFO:tasks.workunit.client.0.smithi071.stderr: -152> 2024-09-14T11:31:37.146+0000 7f9d53bdd9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:31:37.286 INFO:tasks.workunit.client.0.smithi071.stderr: -151> 2024-09-14T11:31:37.146+0000 7f9d53bdd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:37.286 INFO:tasks.workunit.client.0.smithi071.stderr: -150> 2024-09-14T11:31:37.146+0000 7f9d53bdd9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:31:37.286 INFO:tasks.workunit.client.0.smithi071.stderr: -149> 2024-09-14T11:31:37.146+0000 7f9d53bdd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:37.286 INFO:tasks.workunit.client.0.smithi071.stderr: -148> 2024-09-14T11:31:37.146+0000 7f9d53bdd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:37.286 INFO:tasks.workunit.client.0.smithi071.stderr: -147> 2024-09-14T11:31:37.146+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.286 INFO:tasks.workunit.client.0.smithi071.stderr: -146> 2024-09-14T11:31:37.146+0000 7f9d53bdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.286 INFO:tasks.workunit.client.0.smithi071.stderr: -145> 2024-09-14T11:31:37.146+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.286 INFO:tasks.workunit.client.0.smithi071.stderr: -144> 2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:37.286 INFO:tasks.workunit.client.0.smithi071.stderr: -143> 2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.286 INFO:tasks.workunit.client.0.smithi071.stderr: -142> 2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:37.286 INFO:tasks.workunit.client.0.smithi071.stderr: -141> 2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 zone default found 2024-09-14T11:31:37.286 INFO:tasks.workunit.client.0.smithi071.stderr: -140> 2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 4 Realm: () 2024-09-14T11:31:37.287 INFO:tasks.workunit.client.0.smithi071.stderr: -139> 2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:31:37.287 INFO:tasks.workunit.client.0.smithi071.stderr: -138> 2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:31:37.287 INFO:tasks.workunit.client.0.smithi071.stderr: -137> 2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:37.287 INFO:tasks.workunit.client.0.smithi071.stderr: -136> 2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 zonegroup default 2024-09-14T11:31:37.287 INFO:tasks.workunit.client.0.smithi071.stderr: -135> 2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.287 INFO:tasks.workunit.client.0.smithi071.stderr: -134> 2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.287 INFO:tasks.workunit.client.0.smithi071.stderr: -133> 2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.287 INFO:tasks.workunit.client.0.smithi071.stderr: -132> 2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.287 INFO:tasks.workunit.client.0.smithi071.stderr: -131> 2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.287 INFO:tasks.workunit.client.0.smithi071.stderr: -130> 2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.287 INFO:tasks.workunit.client.0.smithi071.stderr: -129> 2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 started sync module instance, tier type = 2024-09-14T11:31:37.287 INFO:tasks.workunit.client.0.smithi071.stderr: -128> 2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:31:37.287 INFO:tasks.workunit.client.0.smithi071.stderr: -127> 2024-09-14T11:31:37.170+0000 7f9d53bdd9c0 20 add_watcher() i=0 2024-09-14T11:31:37.287 INFO:tasks.workunit.client.0.smithi071.stderr: -126> 2024-09-14T11:31:37.170+0000 7f9d53bdd9c0 20 add_watcher() i=1 2024-09-14T11:31:37.288 INFO:tasks.workunit.client.0.smithi071.stderr: -125> 2024-09-14T11:31:37.170+0000 7f9d53bdd9c0 20 add_watcher() i=2 2024-09-14T11:31:37.288 INFO:tasks.workunit.client.0.smithi071.stderr: -124> 2024-09-14T11:31:37.170+0000 7f9d53bdd9c0 20 add_watcher() i=3 2024-09-14T11:31:37.288 INFO:tasks.workunit.client.0.smithi071.stderr: -123> 2024-09-14T11:31:37.170+0000 7f9d53bdd9c0 20 add_watcher() i=4 2024-09-14T11:31:37.288 INFO:tasks.workunit.client.0.smithi071.stderr: -122> 2024-09-14T11:31:37.170+0000 7f9d53bdd9c0 20 add_watcher() i=5 2024-09-14T11:31:37.288 INFO:tasks.workunit.client.0.smithi071.stderr: -121> 2024-09-14T11:31:37.170+0000 7f9d53bdd9c0 20 add_watcher() i=6 2024-09-14T11:31:37.288 INFO:tasks.workunit.client.0.smithi071.stderr: -120> 2024-09-14T11:31:37.170+0000 7f9d53bdd9c0 20 add_watcher() i=7 2024-09-14T11:31:37.288 INFO:tasks.workunit.client.0.smithi071.stderr: -119> 2024-09-14T11:31:37.170+0000 7f9d53bdd9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:37.288 INFO:tasks.workunit.client.0.smithi071.stderr: -118> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe76060e80) adding auth protocol: cephx 2024-09-14T11:31:37.288 INFO:tasks.workunit.client.0.smithi071.stderr: -117> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe76060e80) adding auth protocol: cephx 2024-09-14T11:31:37.288 INFO:tasks.workunit.client.0.smithi071.stderr: -116> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe76060e80) adding auth protocol: cephx 2024-09-14T11:31:37.288 INFO:tasks.workunit.client.0.smithi071.stderr: -115> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe76060e80) adding con mode: secure 2024-09-14T11:31:37.288 INFO:tasks.workunit.client.0.smithi071.stderr: -114> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe76060e80) adding con mode: crc 2024-09-14T11:31:37.288 INFO:tasks.workunit.client.0.smithi071.stderr: -113> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe76060e80) adding con mode: secure 2024-09-14T11:31:37.288 INFO:tasks.workunit.client.0.smithi071.stderr: -112> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe76060e80) adding con mode: crc 2024-09-14T11:31:37.288 INFO:tasks.workunit.client.0.smithi071.stderr: -111> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe76060e80) adding con mode: secure 2024-09-14T11:31:37.289 INFO:tasks.workunit.client.0.smithi071.stderr: -110> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe76060e80) adding con mode: crc 2024-09-14T11:31:37.289 INFO:tasks.workunit.client.0.smithi071.stderr: -109> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe76060e80) adding con mode: crc 2024-09-14T11:31:37.289 INFO:tasks.workunit.client.0.smithi071.stderr: -108> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe76060e80) adding con mode: secure 2024-09-14T11:31:37.289 INFO:tasks.workunit.client.0.smithi071.stderr: -107> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe76060e80) adding con mode: crc 2024-09-14T11:31:37.289 INFO:tasks.workunit.client.0.smithi071.stderr: -106> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe76060e80) adding con mode: secure 2024-09-14T11:31:37.289 INFO:tasks.workunit.client.0.smithi071.stderr: -105> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe76060e80) adding con mode: crc 2024-09-14T11:31:37.289 INFO:tasks.workunit.client.0.smithi071.stderr: -104> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe76060e80) adding con mode: secure 2024-09-14T11:31:37.289 INFO:tasks.workunit.client.0.smithi071.stderr: -103> 2024-09-14T11:31:37.174+0000 7f9c077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:37.289 INFO:tasks.workunit.client.0.smithi071.stderr: -102> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.289 INFO:tasks.workunit.client.0.smithi071.stderr: -101> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:37.289 INFO:tasks.workunit.client.0.smithi071.stderr: -100> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:37.289 INFO:tasks.workunit.client.0.smithi071.stderr: -99> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 asok(0x5575e72d8d90) register_command cache list hook 0x5575e75b51e0 2024-09-14T11:31:37.289 INFO:tasks.workunit.client.0.smithi071.stderr: -98> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 asok(0x5575e72d8d90) register_command cache inspect hook 0x5575e75b51e0 2024-09-14T11:31:37.289 INFO:tasks.workunit.client.0.smithi071.stderr: -97> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 asok(0x5575e72d8d90) register_command cache erase hook 0x5575e75b51e0 2024-09-14T11:31:37.289 INFO:tasks.workunit.client.0.smithi071.stderr: -96> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 asok(0x5575e72d8d90) register_command cache zap hook 0x5575e75b51e0 2024-09-14T11:31:37.290 INFO:tasks.workunit.client.0.smithi071.stderr: -95> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 note: GC not initialized 2024-09-14T11:31:37.290 INFO:tasks.workunit.client.0.smithi071.stderr: -94> 2024-09-14T11:31:37.174+0000 7f9c067e4640 20 reqs_thread_entry: start 2024-09-14T11:31:37.290 INFO:tasks.workunit.client.0.smithi071.stderr: -93> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 asok(0x5575e72d8d90) register_command sync trace show hook 0x7f9d3c0ab6d0 2024-09-14T11:31:37.290 INFO:tasks.workunit.client.0.smithi071.stderr: -92> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 asok(0x5575e72d8d90) register_command sync trace history hook 0x7f9d3c0ab6d0 2024-09-14T11:31:37.290 INFO:tasks.workunit.client.0.smithi071.stderr: -91> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 asok(0x5575e72d8d90) register_command sync trace active hook 0x7f9d3c0ab6d0 2024-09-14T11:31:37.290 INFO:tasks.workunit.client.0.smithi071.stderr: -90> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 asok(0x5575e72d8d90) register_command sync trace active_short hook 0x7f9d3c0ab6d0 2024-09-14T11:31:37.290 INFO:tasks.workunit.client.0.smithi071.stderr: -89> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:31:37.290 INFO:tasks.workunit.client.0.smithi071.stderr: -88> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 20 Filter name: none 2024-09-14T11:31:37.290 INFO:tasks.workunit.client.0.smithi071.stderr: -87> 2024-09-14T11:31:37.174+0000 7f9b77fff640 20 reqs_thread_entry: start 2024-09-14T11:31:37.290 INFO:tasks.workunit.client.0.smithi071.stderr: -86> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:31:37.290 INFO:tasks.workunit.client.0.smithi071.stderr: -85> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.290 INFO:tasks.workunit.client.0.smithi071.stderr: -84> 2024-09-14T11:31:37.178+0000 7f9d53bdd9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:37.290 INFO:tasks.workunit.client.0.smithi071.stderr: -83> 2024-09-14T11:31:37.178+0000 7f9d53bdd9c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:31:37.290 INFO:tasks.workunit.client.0.smithi071.stderr: -82> 2024-09-14T11:31:37.178+0000 7f9d53bdd9c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:31:37.290 INFO:tasks.workunit.client.0.smithi071.stderr: -81> 2024-09-14T11:31:37.178+0000 7f9d53bdd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 : miss 2024-09-14T11:31:37.291 INFO:tasks.workunit.client.0.smithi071.stderr: -80> 2024-09-14T11:31:37.178+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.291 INFO:tasks.workunit.client.0.smithi071.stderr: -79> 2024-09-14T11:31:37.178+0000 7f9d53bdd9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:31:37.291 INFO:tasks.workunit.client.0.smithi071.stderr: -78> 2024-09-14T11:31:37.178+0000 7f9d53bdd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 info.flags=0x17 2024-09-14T11:31:37.291 INFO:tasks.workunit.client.0.smithi071.stderr: -77> 2024-09-14T11:31:37.178+0000 7f9d53bdd9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 to cache LRU end 2024-09-14T11:31:37.291 INFO:tasks.workunit.client.0.smithi071.stderr: -76> 2024-09-14T11:31:37.178+0000 7f9d53bdd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:31:37.291 INFO:tasks.workunit.client.0.smithi071.stderr: -75> 2024-09-14T11:31:37.178+0000 7f9d53bdd9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:37.291 INFO:tasks.workunit.client.0.smithi071.stderr: -74> 2024-09-14T11:31:37.178+0000 7f9d53bdd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 2024-09-14T11:31:37.291 INFO:tasks.workunit.client.0.smithi071.stderr: -73> 2024-09-14T11:31:37.186+0000 7f9d53bdd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 info.flags=0x17 2024-09-14T11:31:37.291 INFO:tasks.workunit.client.0.smithi071.stderr: -72> 2024-09-14T11:31:37.186+0000 7f9d53bdd9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 to cache LRU end 2024-09-14T11:31:37.291 INFO:tasks.workunit.client.0.smithi071.stderr: -71> 2024-09-14T11:31:37.186+0000 7f9d53bdd9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:37.291 INFO:tasks.workunit.client.0.smithi071.stderr: -70> 2024-09-14T11:31:37.186+0000 7f9d53bdd9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33, ofs0, ns] 2024-09-14T11:31:37.291 INFO:tasks.workunit.client.0.smithi071.stderr: -69> 2024-09-14T11:31:37.186+0000 7f9c34ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464384 cookie 93964881241472 notifier 7287 bl.length()=1015 2024-09-14T11:31:37.291 INFO:tasks.workunit.client.0.smithi071.stderr: -68> 2024-09-14T11:31:37.186+0000 7f9c34ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 info.flags=0x17 2024-09-14T11:31:37.291 INFO:tasks.workunit.client.0.smithi071.stderr: -67> 2024-09-14T11:31:37.186+0000 7f9c34ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 to cache LRU end 2024-09-14T11:31:37.291 INFO:tasks.workunit.client.0.smithi071.stderr: -66> 2024-09-14T11:31:37.186+0000 7f9c34ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:37.292 INFO:tasks.workunit.client.0.smithi071.stderr: -65> 2024-09-14T11:31:37.186+0000 7f9d53bdd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.33]): orig_sources= new_sources= 2024-09-14T11:31:37.292 INFO:tasks.workunit.client.0.smithi071.stderr: -64> 2024-09-14T11:31:37.186+0000 7f9d53bdd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.33]): potential sources added=[] removed=[] 2024-09-14T11:31:37.292 INFO:tasks.workunit.client.0.smithi071.stderr: -63> 2024-09-14T11:31:37.186+0000 7f9d53bdd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.33]): orig_dests= new_dests= 2024-09-14T11:31:37.292 INFO:tasks.workunit.client.0.smithi071.stderr: -62> 2024-09-14T11:31:37.186+0000 7f9d53bdd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.33]): potential dests added=[] removed=[] 2024-09-14T11:31:37.292 INFO:tasks.workunit.client.0.smithi071.stderr: -61> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.0 2024-09-14T11:31:37.292 INFO:tasks.workunit.client.0.smithi071.stderr: -60> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.0 2024-09-14T11:31:37.292 INFO:tasks.workunit.client.0.smithi071.stderr: -59> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.1 2024-09-14T11:31:37.292 INFO:tasks.workunit.client.0.smithi071.stderr: -58> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.1 2024-09-14T11:31:37.292 INFO:tasks.workunit.client.0.smithi071.stderr: -57> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.2 2024-09-14T11:31:37.292 INFO:tasks.workunit.client.0.smithi071.stderr: -56> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.2 2024-09-14T11:31:37.292 INFO:tasks.workunit.client.0.smithi071.stderr: -55> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.3 2024-09-14T11:31:37.292 INFO:tasks.workunit.client.0.smithi071.stderr: -54> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.3 2024-09-14T11:31:37.292 INFO:tasks.workunit.client.0.smithi071.stderr: -53> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.4 2024-09-14T11:31:37.292 INFO:tasks.workunit.client.0.smithi071.stderr: -52> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.4 2024-09-14T11:31:37.292 INFO:tasks.workunit.client.0.smithi071.stderr: -51> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.5 2024-09-14T11:31:37.293 INFO:tasks.workunit.client.0.smithi071.stderr: -50> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.5 2024-09-14T11:31:37.293 INFO:tasks.workunit.client.0.smithi071.stderr: -49> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.6 2024-09-14T11:31:37.293 INFO:tasks.workunit.client.0.smithi071.stderr: -48> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.6 2024-09-14T11:31:37.293 INFO:tasks.workunit.client.0.smithi071.stderr: -47> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.7 2024-09-14T11:31:37.293 INFO:tasks.workunit.client.0.smithi071.stderr: -46> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.7 2024-09-14T11:31:37.293 INFO:tasks.workunit.client.0.smithi071.stderr: -45> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.8 2024-09-14T11:31:37.293 INFO:tasks.workunit.client.0.smithi071.stderr: -44> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.8 2024-09-14T11:31:37.293 INFO:tasks.workunit.client.0.smithi071.stderr: -43> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.9 2024-09-14T11:31:37.293 INFO:tasks.workunit.client.0.smithi071.stderr: -42> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.9 2024-09-14T11:31:37.293 INFO:tasks.workunit.client.0.smithi071.stderr: -41> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.10 2024-09-14T11:31:37.293 INFO:tasks.workunit.client.0.smithi071.stderr: -40> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.10 2024-09-14T11:31:37.293 INFO:tasks.workunit.client.0.smithi071.stderr: -39> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.11 2024-09-14T11:31:37.293 INFO:tasks.workunit.client.0.smithi071.stderr: -38> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.11 2024-09-14T11:31:37.293 INFO:tasks.workunit.client.0.smithi071.stderr: -37> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.0 2024-09-14T11:31:37.294 INFO:tasks.workunit.client.0.smithi071.stderr: -36> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1 2024-09-14T11:31:37.294 INFO:tasks.workunit.client.0.smithi071.stderr: -35> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.2 2024-09-14T11:31:37.294 INFO:tasks.workunit.client.0.smithi071.stderr: -34> 2024-09-14T11:31:37.202+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.3 2024-09-14T11:31:37.294 INFO:tasks.workunit.client.0.smithi071.stderr: -33> 2024-09-14T11:31:37.202+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.4 2024-09-14T11:31:37.294 INFO:tasks.workunit.client.0.smithi071.stderr: -32> 2024-09-14T11:31:37.202+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.5 2024-09-14T11:31:37.294 INFO:tasks.workunit.client.0.smithi071.stderr: -31> 2024-09-14T11:31:37.202+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.6 2024-09-14T11:31:37.294 INFO:tasks.workunit.client.0.smithi071.stderr: -30> 2024-09-14T11:31:37.206+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.7 2024-09-14T11:31:37.294 INFO:tasks.workunit.client.0.smithi071.stderr: -29> 2024-09-14T11:31:37.206+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.8 2024-09-14T11:31:37.294 INFO:tasks.workunit.client.0.smithi071.stderr: -28> 2024-09-14T11:31:37.206+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.9 2024-09-14T11:31:37.294 INFO:tasks.workunit.client.0.smithi071.stderr: -27> 2024-09-14T11:31:37.206+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.10 2024-09-14T11:31:37.294 INFO:tasks.workunit.client.0.smithi071.stderr: -26> 2024-09-14T11:31:37.214+0000 7f9d53bdd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:37.294 INFO:tasks.workunit.client.0.smithi071.stderr: -25> 2024-09-14T11:31:37.214+0000 7f9d53bdd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 2024-09-14T11:31:37.294 INFO:tasks.workunit.client.0.smithi071.stderr: -24> 2024-09-14T11:31:37.214+0000 7f9d53bdd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 info.flags=0x17 2024-09-14T11:31:37.294 INFO:tasks.workunit.client.0.smithi071.stderr: -23> 2024-09-14T11:31:37.214+0000 7f9d53bdd9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 to cache LRU end 2024-09-14T11:31:37.294 INFO:tasks.workunit.client.0.smithi071.stderr: -22> 2024-09-14T11:31:37.214+0000 7f9d53bdd9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:37.295 INFO:tasks.workunit.client.0.smithi071.stderr: -21> 2024-09-14T11:31:37.214+0000 7f9d53bdd9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33, ofs0, ns] 2024-09-14T11:31:37.295 INFO:tasks.workunit.client.0.smithi071.stderr: -20> 2024-09-14T11:31:37.214+0000 7f9c34ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464385 cookie 93964881241472 notifier 7287 bl.length()=1015 2024-09-14T11:31:37.295 INFO:tasks.workunit.client.0.smithi071.stderr: -19> 2024-09-14T11:31:37.214+0000 7f9c34ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 info.flags=0x17 2024-09-14T11:31:37.295 INFO:tasks.workunit.client.0.smithi071.stderr: -18> 2024-09-14T11:31:37.214+0000 7f9c34ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 to cache LRU end 2024-09-14T11:31:37.295 INFO:tasks.workunit.client.0.smithi071.stderr: -17> 2024-09-14T11:31:37.214+0000 7f9c34ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:37.295 INFO:tasks.workunit.client.0.smithi071.stderr: -16> 2024-09-14T11:31:37.218+0000 7f9d53bdd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.33]): orig_sources= new_sources= 2024-09-14T11:31:37.295 INFO:tasks.workunit.client.0.smithi071.stderr: -15> 2024-09-14T11:31:37.218+0000 7f9d53bdd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.33]): potential sources added=[] removed=[] 2024-09-14T11:31:37.295 INFO:tasks.workunit.client.0.smithi071.stderr: -14> 2024-09-14T11:31:37.218+0000 7f9d53bdd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.33]): orig_dests= new_dests= 2024-09-14T11:31:37.295 INFO:tasks.workunit.client.0.smithi071.stderr: -13> 2024-09-14T11:31:37.218+0000 7f9d53bdd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.33]): potential dests added=[] removed=[] 2024-09-14T11:31:37.295 INFO:tasks.workunit.client.0.smithi071.stderr: -12> 2024-09-14T11:31:37.222+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.0 2024-09-14T11:31:37.295 INFO:tasks.workunit.client.0.smithi071.stderr: -11> 2024-09-14T11:31:37.222+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1 2024-09-14T11:31:37.295 INFO:tasks.workunit.client.0.smithi071.stderr: -10> 2024-09-14T11:31:37.222+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.2 2024-09-14T11:31:37.295 INFO:tasks.workunit.client.0.smithi071.stderr: -9> 2024-09-14T11:31:37.226+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.3 2024-09-14T11:31:37.295 INFO:tasks.workunit.client.0.smithi071.stderr: -8> 2024-09-14T11:31:37.226+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.4 2024-09-14T11:31:37.295 INFO:tasks.workunit.client.0.smithi071.stderr: -7> 2024-09-14T11:31:37.226+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.5 2024-09-14T11:31:37.295 INFO:tasks.workunit.client.0.smithi071.stderr: -6> 2024-09-14T11:31:37.226+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.6 2024-09-14T11:31:37.296 INFO:tasks.workunit.client.0.smithi071.stderr: -5> 2024-09-14T11:31:37.226+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.7 2024-09-14T11:31:37.296 INFO:tasks.workunit.client.0.smithi071.stderr: -4> 2024-09-14T11:31:37.226+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.8 2024-09-14T11:31:37.296 INFO:tasks.workunit.client.0.smithi071.stderr: -3> 2024-09-14T11:31:37.230+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.9 2024-09-14T11:31:37.296 INFO:tasks.workunit.client.0.smithi071.stderr: -2> 2024-09-14T11:31:37.230+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.10 2024-09-14T11:31:37.296 INFO:tasks.workunit.client.0.smithi071.stderr: -1> 2024-09-14T11:31:37.230+0000 7f9d53bdd9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9d53bdd9c0 time 2024-09-14T11:31:37.236051+0000 2024-09-14T11:31:37.296 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:31:37.296 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.296 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:37.296 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f9d574b72eb] 2024-09-14T11:31:37.296 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9d574b749f] 2024-09-14T11:31:37.296 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5575e602fc01] 2024-09-14T11:31:37.296 INFO:tasks.workunit.client.0.smithi071.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x5575e60451a7] 2024-09-14T11:31:37.296 INFO:tasks.workunit.client.0.smithi071.stderr: 5: main() 2024-09-14T11:31:37.296 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9d5631dd90] 2024-09-14T11:31:37.297 INFO:tasks.workunit.client.0.smithi071.stderr: 7: __libc_start_main() 2024-09-14T11:31:37.297 INFO:tasks.workunit.client.0.smithi071.stderr: 8: _start() 2024-09-14T11:31:37.297 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.297 INFO:tasks.workunit.client.0.smithi071.stderr: 0> 2024-09-14T11:31:37.230+0000 7f9d53bdd9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:31:37.297 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f9d53bdd9c0 thread_name:radosgw-admin 2024-09-14T11:31:37.297 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.297 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:37.297 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f9d56336520] 2024-09-14T11:31:37.297 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:31:37.297 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:31:37.297 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:31:37.297 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f9d574b7345] 2024-09-14T11:31:37.297 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9d574b749f] 2024-09-14T11:31:37.297 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5575e602fc01] 2024-09-14T11:31:37.297 INFO:tasks.workunit.client.0.smithi071.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x5575e60451a7] 2024-09-14T11:31:37.297 INFO:tasks.workunit.client.0.smithi071.stderr: 9: main() 2024-09-14T11:31:37.298 INFO:tasks.workunit.client.0.smithi071.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9d5631dd90] 2024-09-14T11:31:37.298 INFO:tasks.workunit.client.0.smithi071.stderr: 11: __libc_start_main() 2024-09-14T11:31:37.298 INFO:tasks.workunit.client.0.smithi071.stderr: 12: _start() 2024-09-14T11:31:37.298 INFO:tasks.workunit.client.0.smithi071.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:31:37.298 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.298 INFO:tasks.workunit.client.0.smithi071.stderr:--- logging levels --- 2024-09-14T11:31:37.298 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 none 2024-09-14T11:31:37.298 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 lockdep 2024-09-14T11:31:37.298 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 context 2024-09-14T11:31:37.298 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 crush 2024-09-14T11:31:37.298 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds 2024-09-14T11:31:37.298 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_balancer 2024-09-14T11:31:37.298 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_locker 2024-09-14T11:31:37.298 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log 2024-09-14T11:31:37.298 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log_expire 2024-09-14T11:31:37.299 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_migrator 2024-09-14T11:31:37.299 INFO:tasks.workunit.client.0.smithi071.stderr: 3/ 5 mds_quiesce 2024-09-14T11:31:37.299 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 buffer 2024-09-14T11:31:37.299 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 timer 2024-09-14T11:31:37.299 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 filer 2024-09-14T11:31:37.299 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 striper 2024-09-14T11:31:37.299 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 objecter 2024-09-14T11:31:37.299 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rados 2024-09-14T11:31:37.299 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd 2024-09-14T11:31:37.299 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_mirror 2024-09-14T11:31:37.299 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_replay 2024-09-14T11:31:37.299 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_pwl 2024-09-14T11:31:37.299 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 journaler 2024-09-14T11:31:37.299 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objectcacher 2024-09-14T11:31:37.299 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:31:37.299 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 client 2024-09-14T11:31:37.300 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 osd 2024-09-14T11:31:37.300 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 optracker 2024-09-14T11:31:37.300 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objclass 2024-09-14T11:31:37.300 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 filestore 2024-09-14T11:31:37.300 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 journal 2024-09-14T11:31:37.300 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 ms 2024-09-14T11:31:37.300 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mon 2024-09-14T11:31:37.300 INFO:tasks.workunit.client.0.smithi071.stderr: 0/10 monc 2024-09-14T11:31:37.300 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 paxos 2024-09-14T11:31:37.300 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 tp 2024-09-14T11:31:37.300 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 auth 2024-09-14T11:31:37.300 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 crypto 2024-09-14T11:31:37.300 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 finisher 2024-09-14T11:31:37.300 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 reserver 2024-09-14T11:31:37.300 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 heartbeatmap 2024-09-14T11:31:37.301 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 perfcounter 2024-09-14T11:31:37.301 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw 2024-09-14T11:31:37.301 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_sync 2024-09-14T11:31:37.301 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_datacache 2024-09-14T11:31:37.301 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_access 2024-09-14T11:31:37.301 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:31:37.301 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_flight 2024-09-14T11:31:37.301 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:31:37.301 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw_notification 2024-09-14T11:31:37.301 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 javaclient 2024-09-14T11:31:37.301 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 asok 2024-09-14T11:31:37.301 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 throttle 2024-09-14T11:31:37.301 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 refs 2024-09-14T11:31:37.301 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 compressor 2024-09-14T11:31:37.301 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluestore 2024-09-14T11:31:37.302 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluefs 2024-09-14T11:31:37.302 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 bdev 2024-09-14T11:31:37.302 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 kstore 2024-09-14T11:31:37.302 INFO:tasks.workunit.client.0.smithi071.stderr: 4/ 5 rocksdb 2024-09-14T11:31:37.302 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 fuse 2024-09-14T11:31:37.302 INFO:tasks.workunit.client.0.smithi071.stderr: 2/ 5 mgr 2024-09-14T11:31:37.302 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mgrc 2024-09-14T11:31:37.302 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 dpdk 2024-09-14T11:31:37.302 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 eventtrace 2024-09-14T11:31:37.302 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 prioritycache 2024-09-14T11:31:37.302 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 test 2024-09-14T11:31:37.302 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:31:37.302 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephsqlite 2024-09-14T11:31:37.302 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:31:37.302 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore 2024-09-14T11:31:37.303 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_onode 2024-09-14T11:31:37.303 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_odata 2024-09-14T11:31:37.303 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_omap 2024-09-14T11:31:37.303 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_tm 2024-09-14T11:31:37.303 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_t 2024-09-14T11:31:37.303 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:31:37.303 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_epm 2024-09-14T11:31:37.303 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_lba 2024-09-14T11:31:37.303 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:31:37.303 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cache 2024-09-14T11:31:37.303 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_journal 2024-09-14T11:31:37.303 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_device 2024-09-14T11:31:37.303 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_backref 2024-09-14T11:31:37.303 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 alienstore 2024-09-14T11:31:37.303 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mclock 2024-09-14T11:31:37.303 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cyanstore 2024-09-14T11:31:37.304 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 ceph_exporter 2024-09-14T11:31:37.304 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 memstore 2024-09-14T11:31:37.304 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 trace 2024-09-14T11:31:37.304 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 ceph_dedup 2024-09-14T11:31:37.304 INFO:tasks.workunit.client.0.smithi071.stderr: -2/-2 (syslog threshold) 2024-09-14T11:31:37.304 INFO:tasks.workunit.client.0.smithi071.stderr: 99/99 (stderr threshold) 2024-09-14T11:31:37.304 INFO:tasks.workunit.client.0.smithi071.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:31:37.304 INFO:tasks.workunit.client.0.smithi071.stderr: 7f9b77fff640 / http_manager 2024-09-14T11:31:37.304 INFO:tasks.workunit.client.0.smithi071.stderr: 7f9c067e4640 / http_manager 2024-09-14T11:31:37.304 INFO:tasks.workunit.client.0.smithi071.stderr: 7f9c077e6640 / rgw_dt_lg_renew 2024-09-14T11:31:37.304 INFO:tasks.workunit.client.0.smithi071.stderr: 7f9c22ffd640 / ms_dispatch 2024-09-14T11:31:37.304 INFO:tasks.workunit.client.0.smithi071.stderr: 7f9c34ff9640 / io_context_pool 2024-09-14T11:31:37.304 INFO:tasks.workunit.client.0.smithi071.stderr: 7f9c36ffd640 / ms_dispatch 2024-09-14T11:31:37.304 INFO:tasks.workunit.client.0.smithi071.stderr: 7f9c3de03640 / ms_dispatch 2024-09-14T11:31:37.304 INFO:tasks.workunit.client.0.smithi071.stderr: 7f9c3f606640 / io_context_pool 2024-09-14T11:31:37.305 INFO:tasks.workunit.client.0.smithi071.stderr: 7f9d50ee2640 / msgr-worker-2 2024-09-14T11:31:37.305 INFO:tasks.workunit.client.0.smithi071.stderr: 7f9d516e3640 / msgr-worker-1 2024-09-14T11:31:37.305 INFO:tasks.workunit.client.0.smithi071.stderr: 7f9d51ee4640 / msgr-worker-0 2024-09-14T11:31:37.305 INFO:tasks.workunit.client.0.smithi071.stderr: 7f9d526e5640 / io_context_pool 2024-09-14T11:31:37.305 INFO:tasks.workunit.client.0.smithi071.stderr: 7f9d53bdd9c0 / radosgw-admin 2024-09-14T11:31:37.305 INFO:tasks.workunit.client.0.smithi071.stderr: max_recent 500 2024-09-14T11:31:37.305 INFO:tasks.workunit.client.0.smithi071.stderr: max_new 1000 2024-09-14T11:31:37.305 INFO:tasks.workunit.client.0.smithi071.stderr: log_file /var/log/ceph/ceph-client.admin.113196.log 2024-09-14T11:31:37.305 INFO:tasks.workunit.client.0.smithi071.stderr:--- end dump of recent events --- 2024-09-14T11:31:37.305 INFO:tasks.workunit.client.0.smithi071.stderr:--- begin dump of recent events --- 2024-09-14T11:31:37.305 INFO:tasks.workunit.client.0.smithi071.stderr: -499> 2024-09-14T11:31:37.102+0000 7f9d53bdd9c0 5 asok(0x5575e72d8d90) register_command rotate-key hook 0x5575e74e4718 2024-09-14T11:31:37.306 INFO:tasks.workunit.client.0.smithi071.stderr: -498> 2024-09-14T11:31:37.102+0000 7f9d53bdd9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:31:37.306 INFO:tasks.workunit.client.0.smithi071.stderr: -497> 2024-09-14T11:31:37.102+0000 7f9d53bdd9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:31:37.306 INFO:tasks.workunit.client.0.smithi071.stderr: -496> 2024-09-14T11:31:37.102+0000 7f9d53bdd9c0 10 monclient(hunting): picked mon.noname-b con 0x5575e7371c20 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:31:37.306 INFO:tasks.workunit.client.0.smithi071.stderr: -495> 2024-09-14T11:31:37.102+0000 7f9d53bdd9c0 10 monclient(hunting): picked mon.noname-c con 0x5575e742df90 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:31:37.306 INFO:tasks.workunit.client.0.smithi071.stderr: -494> 2024-09-14T11:31:37.102+0000 7f9d53bdd9c0 10 monclient(hunting): picked mon.noname-a con 0x5575e742e8b0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:31:37.306 INFO:tasks.workunit.client.0.smithi071.stderr: -493> 2024-09-14T11:31:37.102+0000 7f9d53bdd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.306 INFO:tasks.workunit.client.0.smithi071.stderr: -492> 2024-09-14T11:31:37.102+0000 7f9d53bdd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.306 INFO:tasks.workunit.client.0.smithi071.stderr: -491> 2024-09-14T11:31:37.102+0000 7f9d53bdd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.306 INFO:tasks.workunit.client.0.smithi071.stderr: -490> 2024-09-14T11:31:37.102+0000 7f9d53bdd9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:31:37.306 INFO:tasks.workunit.client.0.smithi071.stderr: -489> 2024-09-14T11:31:37.102+0000 7f9d53bdd9c0 10 monclient(hunting): authenticate will time out at 2309.226640s 2024-09-14T11:31:37.306 INFO:tasks.workunit.client.0.smithi071.stderr: -488> 2024-09-14T11:31:37.102+0000 7f9d51ee4640 10 monclient(hunting): get_auth_request con 0x5575e742e8b0 auth_method 0 2024-09-14T11:31:37.306 INFO:tasks.workunit.client.0.smithi071.stderr: -487> 2024-09-14T11:31:37.102+0000 7f9d51ee4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.306 INFO:tasks.workunit.client.0.smithi071.stderr: -486> 2024-09-14T11:31:37.102+0000 7f9d51ee4640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.306 INFO:tasks.workunit.client.0.smithi071.stderr: -485> 2024-09-14T11:31:37.102+0000 7f9d51ee4640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.306 INFO:tasks.workunit.client.0.smithi071.stderr: -484> 2024-09-14T11:31:37.102+0000 7f9d50ee2640 10 monclient(hunting): get_auth_request con 0x5575e742df90 auth_method 0 2024-09-14T11:31:37.307 INFO:tasks.workunit.client.0.smithi071.stderr: -483> 2024-09-14T11:31:37.102+0000 7f9d50ee2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.307 INFO:tasks.workunit.client.0.smithi071.stderr: -482> 2024-09-14T11:31:37.102+0000 7f9d50ee2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.307 INFO:tasks.workunit.client.0.smithi071.stderr: -481> 2024-09-14T11:31:37.102+0000 7f9d50ee2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.307 INFO:tasks.workunit.client.0.smithi071.stderr: -480> 2024-09-14T11:31:37.102+0000 7f9d51ee4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:37.307 INFO:tasks.workunit.client.0.smithi071.stderr: -479> 2024-09-14T11:31:37.102+0000 7f9d51ee4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:37.307 INFO:tasks.workunit.client.0.smithi071.stderr: -478> 2024-09-14T11:31:37.102+0000 7f9d51ee4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:37.307 INFO:tasks.workunit.client.0.smithi071.stderr: -477> 2024-09-14T11:31:37.102+0000 7f9d50ee2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:37.307 INFO:tasks.workunit.client.0.smithi071.stderr: -476> 2024-09-14T11:31:37.102+0000 7f9d50ee2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:37.307 INFO:tasks.workunit.client.0.smithi071.stderr: -475> 2024-09-14T11:31:37.102+0000 7f9d50ee2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:37.307 INFO:tasks.workunit.client.0.smithi071.stderr: -474> 2024-09-14T11:31:37.102+0000 7f9d51ee4640 10 monclient(hunting): handle_auth_done global_id 7278 payload 824 2024-09-14T11:31:37.307 INFO:tasks.workunit.client.0.smithi071.stderr: -473> 2024-09-14T11:31:37.102+0000 7f9d51ee4640 10 monclient: _finish_hunting 0 2024-09-14T11:31:37.307 INFO:tasks.workunit.client.0.smithi071.stderr: -472> 2024-09-14T11:31:37.102+0000 7f9d51ee4640 1 monclient: found mon.noname-a 2024-09-14T11:31:37.307 INFO:tasks.workunit.client.0.smithi071.stderr: -471> 2024-09-14T11:31:37.102+0000 7f9d51ee4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:31:37.307 INFO:tasks.workunit.client.0.smithi071.stderr: -470> 2024-09-14T11:31:37.102+0000 7f9d516e3640 10 monclient: get_auth_request con 0x5575e7371c20 auth_method 0 2024-09-14T11:31:37.307 INFO:tasks.workunit.client.0.smithi071.stderr: -469> 2024-09-14T11:31:37.102+0000 7f9c3de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:37.308 INFO:tasks.workunit.client.0.smithi071.stderr: -468> 2024-09-14T11:31:37.102+0000 7f9c3de03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:31:37.308 INFO:tasks.workunit.client.0.smithi071.stderr: -467> 2024-09-14T11:31:37.102+0000 7f9c3de03640 10 monclient: dump: 2024-09-14T11:31:37.308 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:31:37.308 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:31:37.308 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:37.308 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:37.308 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:37.308 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:37.308 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:31:37.308 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:31:37.308 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:31:37.308 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.308 INFO:tasks.workunit.client.0.smithi071.stderr: -466> 2024-09-14T11:31:37.102+0000 7f9c3de03640 10 monclient: _finish_auth 0 2024-09-14T11:31:37.308 INFO:tasks.workunit.client.0.smithi071.stderr: -465> 2024-09-14T11:31:37.102+0000 7f9c3de03640 10 monclient: _check_auth_tickets 2024-09-14T11:31:37.308 INFO:tasks.workunit.client.0.smithi071.stderr: -464> 2024-09-14T11:31:37.102+0000 7f9c3de03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:37.309 INFO:tasks.workunit.client.0.smithi071.stderr: -463> 2024-09-14T11:31:37.102+0000 7f9c3de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:37.309 INFO:tasks.workunit.client.0.smithi071.stderr: -462> 2024-09-14T11:31:37.102+0000 7f9c3de03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:31:37.309 INFO:tasks.workunit.client.0.smithi071.stderr: -461> 2024-09-14T11:31:37.102+0000 7f9c3de03640 10 monclient: dump: 2024-09-14T11:31:37.309 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:31:37.309 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:31:37.309 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:37.309 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:37.309 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:37.309 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:37.309 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:31:37.309 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:31:37.309 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:31:37.309 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.309 INFO:tasks.workunit.client.0.smithi071.stderr: -460> 2024-09-14T11:31:37.102+0000 7f9c3f606640 4 set_mon_vals no callback set 2024-09-14T11:31:37.309 INFO:tasks.workunit.client.0.smithi071.stderr: -459> 2024-09-14T11:31:37.106+0000 7f9d53bdd9c0 5 monclient: authenticate success, global_id 7278 2024-09-14T11:31:37.310 INFO:tasks.workunit.client.0.smithi071.stderr: -458> 2024-09-14T11:31:37.106+0000 7f9d53bdd9c0 10 monclient: _renew_subs 2024-09-14T11:31:37.310 INFO:tasks.workunit.client.0.smithi071.stderr: -457> 2024-09-14T11:31:37.106+0000 7f9d53bdd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:31:37.310 INFO:tasks.workunit.client.0.smithi071.stderr: -456> 2024-09-14T11:31:37.106+0000 7f9d53bdd9c0 10 monclient: _renew_subs 2024-09-14T11:31:37.310 INFO:tasks.workunit.client.0.smithi071.stderr: -455> 2024-09-14T11:31:37.106+0000 7f9d53bdd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:31:37.310 INFO:tasks.workunit.client.0.smithi071.stderr: -454> 2024-09-14T11:31:37.106+0000 7f9d53bdd9c0 1 librados: init done 2024-09-14T11:31:37.310 INFO:tasks.workunit.client.0.smithi071.stderr: -453> 2024-09-14T11:31:37.106+0000 7f9c3de03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:31:37.310 INFO:tasks.workunit.client.0.smithi071.stderr: -452> 2024-09-14T11:31:37.106+0000 7f9c3de03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:31:37.310 INFO:tasks.workunit.client.0.smithi071.stderr: -451> 2024-09-14T11:31:37.106+0000 7f9c3de03640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:31:37.310 INFO:tasks.workunit.client.0.smithi071.stderr: -450> 2024-09-14T11:31:37.106+0000 7f9d516e3640 10 monclient: get_auth_request con 0x7f9c380718d0 auth_method 0 2024-09-14T11:31:37.310 INFO:tasks.workunit.client.0.smithi071.stderr: -449> 2024-09-14T11:31:37.106+0000 7f9d50ee2640 10 monclient: get_auth_request con 0x5575e7522290 auth_method 0 2024-09-14T11:31:37.310 INFO:tasks.workunit.client.0.smithi071.stderr: -448> 2024-09-14T11:31:37.110+0000 7f9d516e3640 10 monclient: get_auth_request con 0x5575e752f100 auth_method 0 2024-09-14T11:31:37.310 INFO:tasks.workunit.client.0.smithi071.stderr: -447> 2024-09-14T11:31:37.110+0000 7f9d50ee2640 10 monclient: get_auth_request con 0x5575e7533460 auth_method 0 2024-09-14T11:31:37.310 INFO:tasks.workunit.client.0.smithi071.stderr: -446> 2024-09-14T11:31:37.110+0000 7f9d51ee4640 10 monclient: get_auth_request con 0x5575e7532980 auth_method 0 2024-09-14T11:31:37.310 INFO:tasks.workunit.client.0.smithi071.stderr: -445> 2024-09-14T11:31:37.110+0000 7f9d53bdd9c0 10 monclient: build_initial_monmap 2024-09-14T11:31:37.311 INFO:tasks.workunit.client.0.smithi071.stderr: -444> 2024-09-14T11:31:37.110+0000 7f9d53bdd9c0 1 build_initial for_mkfs: 0 2024-09-14T11:31:37.311 INFO:tasks.workunit.client.0.smithi071.stderr: -443> 2024-09-14T11:31:37.110+0000 7f9d53bdd9c0 10 monclient: monmap: 2024-09-14T11:31:37.311 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:31:37.311 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:31:37.311 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:31:37.311 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:31:37.311 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:31:37.311 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:37.311 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:31:37.311 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:31:37.311 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:31:37.311 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.311 INFO:tasks.workunit.client.0.smithi071.stderr: -442> 2024-09-14T11:31:37.110+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753b540) adding auth protocol: cephx 2024-09-14T11:31:37.311 INFO:tasks.workunit.client.0.smithi071.stderr: -441> 2024-09-14T11:31:37.110+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753b540) adding auth protocol: cephx 2024-09-14T11:31:37.311 INFO:tasks.workunit.client.0.smithi071.stderr: -440> 2024-09-14T11:31:37.110+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753b540) adding auth protocol: cephx 2024-09-14T11:31:37.312 INFO:tasks.workunit.client.0.smithi071.stderr: -439> 2024-09-14T11:31:37.110+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753b540) adding con mode: secure 2024-09-14T11:31:37.312 INFO:tasks.workunit.client.0.smithi071.stderr: -438> 2024-09-14T11:31:37.110+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753b540) adding con mode: crc 2024-09-14T11:31:37.312 INFO:tasks.workunit.client.0.smithi071.stderr: -437> 2024-09-14T11:31:37.110+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753b540) adding con mode: secure 2024-09-14T11:31:37.312 INFO:tasks.workunit.client.0.smithi071.stderr: -436> 2024-09-14T11:31:37.110+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753b540) adding con mode: crc 2024-09-14T11:31:37.312 INFO:tasks.workunit.client.0.smithi071.stderr: -435> 2024-09-14T11:31:37.110+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753b540) adding con mode: secure 2024-09-14T11:31:37.312 INFO:tasks.workunit.client.0.smithi071.stderr: -434> 2024-09-14T11:31:37.110+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753b540) adding con mode: crc 2024-09-14T11:31:37.312 INFO:tasks.workunit.client.0.smithi071.stderr: -433> 2024-09-14T11:31:37.110+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753b540) adding con mode: crc 2024-09-14T11:31:37.312 INFO:tasks.workunit.client.0.smithi071.stderr: -432> 2024-09-14T11:31:37.110+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753b540) adding con mode: secure 2024-09-14T11:31:37.312 INFO:tasks.workunit.client.0.smithi071.stderr: -431> 2024-09-14T11:31:37.110+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753b540) adding con mode: crc 2024-09-14T11:31:37.312 INFO:tasks.workunit.client.0.smithi071.stderr: -430> 2024-09-14T11:31:37.110+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753b540) adding con mode: secure 2024-09-14T11:31:37.312 INFO:tasks.workunit.client.0.smithi071.stderr: -429> 2024-09-14T11:31:37.110+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753b540) adding con mode: crc 2024-09-14T11:31:37.312 INFO:tasks.workunit.client.0.smithi071.stderr: -428> 2024-09-14T11:31:37.110+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753b540) adding con mode: secure 2024-09-14T11:31:37.312 INFO:tasks.workunit.client.0.smithi071.stderr: -427> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.312 INFO:tasks.workunit.client.0.smithi071.stderr: -426> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 5 asok(0x5575e72d8d90) register_command objecter_requests cmddesc objecter_requests hook 0x5575e753ef70 EEXIST 2024-09-14T11:31:37.312 INFO:tasks.workunit.client.0.smithi071.stderr: -425> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 10 monclient: init 2024-09-14T11:31:37.313 INFO:tasks.workunit.client.0.smithi071.stderr: -424> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753a438) adding auth protocol: cephx 2024-09-14T11:31:37.313 INFO:tasks.workunit.client.0.smithi071.stderr: -423> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753a438) adding auth protocol: cephx 2024-09-14T11:31:37.313 INFO:tasks.workunit.client.0.smithi071.stderr: -422> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753a438) adding auth protocol: cephx 2024-09-14T11:31:37.313 INFO:tasks.workunit.client.0.smithi071.stderr: -421> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753a438) adding con mode: secure 2024-09-14T11:31:37.313 INFO:tasks.workunit.client.0.smithi071.stderr: -420> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753a438) adding con mode: crc 2024-09-14T11:31:37.313 INFO:tasks.workunit.client.0.smithi071.stderr: -419> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753a438) adding con mode: secure 2024-09-14T11:31:37.313 INFO:tasks.workunit.client.0.smithi071.stderr: -418> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753a438) adding con mode: crc 2024-09-14T11:31:37.313 INFO:tasks.workunit.client.0.smithi071.stderr: -417> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753a438) adding con mode: secure 2024-09-14T11:31:37.313 INFO:tasks.workunit.client.0.smithi071.stderr: -416> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753a438) adding con mode: crc 2024-09-14T11:31:37.313 INFO:tasks.workunit.client.0.smithi071.stderr: -415> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753a438) adding con mode: crc 2024-09-14T11:31:37.313 INFO:tasks.workunit.client.0.smithi071.stderr: -414> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753a438) adding con mode: secure 2024-09-14T11:31:37.313 INFO:tasks.workunit.client.0.smithi071.stderr: -413> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753a438) adding con mode: crc 2024-09-14T11:31:37.313 INFO:tasks.workunit.client.0.smithi071.stderr: -412> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753a438) adding con mode: secure 2024-09-14T11:31:37.313 INFO:tasks.workunit.client.0.smithi071.stderr: -411> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753a438) adding con mode: crc 2024-09-14T11:31:37.313 INFO:tasks.workunit.client.0.smithi071.stderr: -410> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e753a438) adding con mode: secure 2024-09-14T11:31:37.313 INFO:tasks.workunit.client.0.smithi071.stderr: -409> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.314 INFO:tasks.workunit.client.0.smithi071.stderr: -408> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.314 INFO:tasks.workunit.client.0.smithi071.stderr: -407> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 5 asok(0x5575e72d8d90) register_command rotate-key cmddesc rotate-key hook 0x5575e753a580 EEXIST 2024-09-14T11:31:37.314 INFO:tasks.workunit.client.0.smithi071.stderr: -406> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:31:37.314 INFO:tasks.workunit.client.0.smithi071.stderr: -405> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:31:37.314 INFO:tasks.workunit.client.0.smithi071.stderr: -404> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 10 monclient(hunting): picked mon.noname-b con 0x5575e7563120 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:31:37.314 INFO:tasks.workunit.client.0.smithi071.stderr: -403> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 10 monclient(hunting): picked mon.noname-a con 0x5575e7562a50 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:31:37.314 INFO:tasks.workunit.client.0.smithi071.stderr: -402> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 10 monclient(hunting): picked mon.noname-c con 0x5575e7561430 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:31:37.314 INFO:tasks.workunit.client.0.smithi071.stderr: -401> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.314 INFO:tasks.workunit.client.0.smithi071.stderr: -400> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.314 INFO:tasks.workunit.client.0.smithi071.stderr: -399> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.314 INFO:tasks.workunit.client.0.smithi071.stderr: -398> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:31:37.314 INFO:tasks.workunit.client.0.smithi071.stderr: -397> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 10 monclient(hunting): authenticate will time out at 2309.237008s 2024-09-14T11:31:37.314 INFO:tasks.workunit.client.0.smithi071.stderr: -396> 2024-09-14T11:31:37.114+0000 7f9d51ee4640 10 monclient(hunting): get_auth_request con 0x5575e7562a50 auth_method 0 2024-09-14T11:31:37.314 INFO:tasks.workunit.client.0.smithi071.stderr: -395> 2024-09-14T11:31:37.114+0000 7f9d51ee4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.314 INFO:tasks.workunit.client.0.smithi071.stderr: -394> 2024-09-14T11:31:37.114+0000 7f9d51ee4640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.315 INFO:tasks.workunit.client.0.smithi071.stderr: -393> 2024-09-14T11:31:37.114+0000 7f9d51ee4640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.315 INFO:tasks.workunit.client.0.smithi071.stderr: -392> 2024-09-14T11:31:37.114+0000 7f9d516e3640 10 monclient(hunting): get_auth_request con 0x5575e7561430 auth_method 0 2024-09-14T11:31:37.315 INFO:tasks.workunit.client.0.smithi071.stderr: -391> 2024-09-14T11:31:37.114+0000 7f9d516e3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.315 INFO:tasks.workunit.client.0.smithi071.stderr: -390> 2024-09-14T11:31:37.114+0000 7f9d516e3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.315 INFO:tasks.workunit.client.0.smithi071.stderr: -389> 2024-09-14T11:31:37.114+0000 7f9d516e3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.315 INFO:tasks.workunit.client.0.smithi071.stderr: -388> 2024-09-14T11:31:37.114+0000 7f9d51ee4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:37.315 INFO:tasks.workunit.client.0.smithi071.stderr: -387> 2024-09-14T11:31:37.114+0000 7f9d51ee4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:37.315 INFO:tasks.workunit.client.0.smithi071.stderr: -386> 2024-09-14T11:31:37.114+0000 7f9d51ee4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:37.315 INFO:tasks.workunit.client.0.smithi071.stderr: -385> 2024-09-14T11:31:37.114+0000 7f9d516e3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:37.315 INFO:tasks.workunit.client.0.smithi071.stderr: -384> 2024-09-14T11:31:37.114+0000 7f9d516e3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:37.315 INFO:tasks.workunit.client.0.smithi071.stderr: -383> 2024-09-14T11:31:37.114+0000 7f9d516e3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:37.315 INFO:tasks.workunit.client.0.smithi071.stderr: -382> 2024-09-14T11:31:37.114+0000 7f9d50ee2640 10 monclient(hunting): get_auth_request con 0x5575e7563120 auth_method 0 2024-09-14T11:31:37.315 INFO:tasks.workunit.client.0.smithi071.stderr: -381> 2024-09-14T11:31:37.114+0000 7f9d50ee2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.315 INFO:tasks.workunit.client.0.smithi071.stderr: -380> 2024-09-14T11:31:37.114+0000 7f9d50ee2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.315 INFO:tasks.workunit.client.0.smithi071.stderr: -379> 2024-09-14T11:31:37.114+0000 7f9d50ee2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.316 INFO:tasks.workunit.client.0.smithi071.stderr: -378> 2024-09-14T11:31:37.114+0000 7f9d51ee4640 10 monclient(hunting): handle_auth_done global_id 7281 payload 824 2024-09-14T11:31:37.316 INFO:tasks.workunit.client.0.smithi071.stderr: -377> 2024-09-14T11:31:37.114+0000 7f9d51ee4640 10 monclient: _finish_hunting 0 2024-09-14T11:31:37.316 INFO:tasks.workunit.client.0.smithi071.stderr: -376> 2024-09-14T11:31:37.114+0000 7f9d51ee4640 1 monclient: found mon.noname-a 2024-09-14T11:31:37.316 INFO:tasks.workunit.client.0.smithi071.stderr: -375> 2024-09-14T11:31:37.114+0000 7f9d51ee4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:31:37.316 INFO:tasks.workunit.client.0.smithi071.stderr: -374> 2024-09-14T11:31:37.114+0000 7f9c36ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:37.316 INFO:tasks.workunit.client.0.smithi071.stderr: -373> 2024-09-14T11:31:37.114+0000 7f9c36ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:31:37.316 INFO:tasks.workunit.client.0.smithi071.stderr: -372> 2024-09-14T11:31:37.114+0000 7f9c36ffd640 10 monclient: dump: 2024-09-14T11:31:37.316 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:31:37.316 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:31:37.316 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:37.316 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:37.316 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:37.316 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:37.316 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:31:37.316 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:31:37.317 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:31:37.317 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.317 INFO:tasks.workunit.client.0.smithi071.stderr: -371> 2024-09-14T11:31:37.114+0000 7f9c36ffd640 10 monclient: _finish_auth 0 2024-09-14T11:31:37.317 INFO:tasks.workunit.client.0.smithi071.stderr: -370> 2024-09-14T11:31:37.114+0000 7f9c36ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:31:37.317 INFO:tasks.workunit.client.0.smithi071.stderr: -369> 2024-09-14T11:31:37.114+0000 7f9c36ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:37.317 INFO:tasks.workunit.client.0.smithi071.stderr: -368> 2024-09-14T11:31:37.114+0000 7f9c36ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:37.317 INFO:tasks.workunit.client.0.smithi071.stderr: -367> 2024-09-14T11:31:37.114+0000 7f9c36ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:31:37.317 INFO:tasks.workunit.client.0.smithi071.stderr: -366> 2024-09-14T11:31:37.114+0000 7f9c36ffd640 10 monclient: dump: 2024-09-14T11:31:37.317 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:31:37.317 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:31:37.317 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:37.317 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:37.317 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:37.317 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:37.317 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:31:37.317 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:31:37.318 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:31:37.318 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.318 INFO:tasks.workunit.client.0.smithi071.stderr: -365> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 5 monclient: authenticate success, global_id 7281 2024-09-14T11:31:37.318 INFO:tasks.workunit.client.0.smithi071.stderr: -364> 2024-09-14T11:31:37.114+0000 7f9d526e5640 4 set_mon_vals no callback set 2024-09-14T11:31:37.318 INFO:tasks.workunit.client.0.smithi071.stderr: -363> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 10 monclient: _renew_subs 2024-09-14T11:31:37.318 INFO:tasks.workunit.client.0.smithi071.stderr: -362> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:31:37.318 INFO:tasks.workunit.client.0.smithi071.stderr: -361> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 10 monclient: _renew_subs 2024-09-14T11:31:37.318 INFO:tasks.workunit.client.0.smithi071.stderr: -360> 2024-09-14T11:31:37.114+0000 7f9d53bdd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:31:37.318 INFO:tasks.workunit.client.0.smithi071.stderr: -359> 2024-09-14T11:31:37.114+0000 7f9c36ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:31:37.318 INFO:tasks.workunit.client.0.smithi071.stderr: -358> 2024-09-14T11:31:37.114+0000 7f9c36ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:31:37.318 INFO:tasks.workunit.client.0.smithi071.stderr: -357> 2024-09-14T11:31:37.114+0000 7f9c36ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:31:37.318 INFO:tasks.workunit.client.0.smithi071.stderr: -356> 2024-09-14T11:31:37.114+0000 7f9d50ee2640 10 monclient: get_auth_request con 0x7f9c2c0717e0 auth_method 0 2024-09-14T11:31:37.318 INFO:tasks.workunit.client.0.smithi071.stderr: -355> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient: get_monmap_and_config 2024-09-14T11:31:37.318 INFO:tasks.workunit.client.0.smithi071.stderr: -354> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient: build_initial_monmap 2024-09-14T11:31:37.318 INFO:tasks.workunit.client.0.smithi071.stderr: -353> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 1 build_initial for_mkfs: 0 2024-09-14T11:31:37.319 INFO:tasks.workunit.client.0.smithi071.stderr: -352> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient: monmap: 2024-09-14T11:31:37.319 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:31:37.319 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:31:37.319 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:31:37.319 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:31:37.319 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:31:37.319 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:37.319 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:31:37.319 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:31:37.319 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:31:37.319 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.319 INFO:tasks.workunit.client.0.smithi071.stderr: -351> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7582aa0) adding auth protocol: cephx 2024-09-14T11:31:37.319 INFO:tasks.workunit.client.0.smithi071.stderr: -350> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7582aa0) adding auth protocol: cephx 2024-09-14T11:31:37.319 INFO:tasks.workunit.client.0.smithi071.stderr: -349> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7582aa0) adding auth protocol: cephx 2024-09-14T11:31:37.319 INFO:tasks.workunit.client.0.smithi071.stderr: -348> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7582aa0) adding con mode: secure 2024-09-14T11:31:37.320 INFO:tasks.workunit.client.0.smithi071.stderr: -347> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7582aa0) adding con mode: crc 2024-09-14T11:31:37.320 INFO:tasks.workunit.client.0.smithi071.stderr: -346> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7582aa0) adding con mode: secure 2024-09-14T11:31:37.320 INFO:tasks.workunit.client.0.smithi071.stderr: -345> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7582aa0) adding con mode: crc 2024-09-14T11:31:37.320 INFO:tasks.workunit.client.0.smithi071.stderr: -344> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7582aa0) adding con mode: secure 2024-09-14T11:31:37.320 INFO:tasks.workunit.client.0.smithi071.stderr: -343> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7582aa0) adding con mode: crc 2024-09-14T11:31:37.320 INFO:tasks.workunit.client.0.smithi071.stderr: -342> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7582aa0) adding con mode: crc 2024-09-14T11:31:37.320 INFO:tasks.workunit.client.0.smithi071.stderr: -341> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7582aa0) adding con mode: secure 2024-09-14T11:31:37.320 INFO:tasks.workunit.client.0.smithi071.stderr: -340> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7582aa0) adding con mode: crc 2024-09-14T11:31:37.320 INFO:tasks.workunit.client.0.smithi071.stderr: -339> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7582aa0) adding con mode: secure 2024-09-14T11:31:37.320 INFO:tasks.workunit.client.0.smithi071.stderr: -338> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7582aa0) adding con mode: crc 2024-09-14T11:31:37.320 INFO:tasks.workunit.client.0.smithi071.stderr: -337> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7582aa0) adding con mode: secure 2024-09-14T11:31:37.320 INFO:tasks.workunit.client.0.smithi071.stderr: -336> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.320 INFO:tasks.workunit.client.0.smithi071.stderr: -335> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient: init 2024-09-14T11:31:37.320 INFO:tasks.workunit.client.0.smithi071.stderr: -334> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe760609a0) adding auth protocol: cephx 2024-09-14T11:31:37.320 INFO:tasks.workunit.client.0.smithi071.stderr: -333> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe760609a0) adding auth protocol: cephx 2024-09-14T11:31:37.321 INFO:tasks.workunit.client.0.smithi071.stderr: -332> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe760609a0) adding auth protocol: cephx 2024-09-14T11:31:37.321 INFO:tasks.workunit.client.0.smithi071.stderr: -331> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe760609a0) adding con mode: secure 2024-09-14T11:31:37.321 INFO:tasks.workunit.client.0.smithi071.stderr: -330> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe760609a0) adding con mode: crc 2024-09-14T11:31:37.321 INFO:tasks.workunit.client.0.smithi071.stderr: -329> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe760609a0) adding con mode: secure 2024-09-14T11:31:37.321 INFO:tasks.workunit.client.0.smithi071.stderr: -328> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe760609a0) adding con mode: crc 2024-09-14T11:31:37.321 INFO:tasks.workunit.client.0.smithi071.stderr: -327> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe760609a0) adding con mode: secure 2024-09-14T11:31:37.321 INFO:tasks.workunit.client.0.smithi071.stderr: -326> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe760609a0) adding con mode: crc 2024-09-14T11:31:37.321 INFO:tasks.workunit.client.0.smithi071.stderr: -325> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe760609a0) adding con mode: crc 2024-09-14T11:31:37.321 INFO:tasks.workunit.client.0.smithi071.stderr: -324> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe760609a0) adding con mode: secure 2024-09-14T11:31:37.321 INFO:tasks.workunit.client.0.smithi071.stderr: -323> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe760609a0) adding con mode: crc 2024-09-14T11:31:37.321 INFO:tasks.workunit.client.0.smithi071.stderr: -322> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe760609a0) adding con mode: secure 2024-09-14T11:31:37.321 INFO:tasks.workunit.client.0.smithi071.stderr: -321> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe760609a0) adding con mode: crc 2024-09-14T11:31:37.321 INFO:tasks.workunit.client.0.smithi071.stderr: -320> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe760609a0) adding con mode: secure 2024-09-14T11:31:37.321 INFO:tasks.workunit.client.0.smithi071.stderr: -319> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.321 INFO:tasks.workunit.client.0.smithi071.stderr: -318> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.322 INFO:tasks.workunit.client.0.smithi071.stderr: -317> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 asok(0x5575e72d8d90) register_command rotate-key cmddesc rotate-key hook 0x7ffe76060ae8 EEXIST 2024-09-14T11:31:37.322 INFO:tasks.workunit.client.0.smithi071.stderr: -316> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:31:37.322 INFO:tasks.workunit.client.0.smithi071.stderr: -315> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:31:37.322 INFO:tasks.workunit.client.0.smithi071.stderr: -314> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient(hunting): picked mon.noname-a con 0x5575e75b70f0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:31:37.322 INFO:tasks.workunit.client.0.smithi071.stderr: -313> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient(hunting): picked mon.noname-c con 0x5575e7586b10 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:31:37.322 INFO:tasks.workunit.client.0.smithi071.stderr: -312> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient(hunting): picked mon.noname-b con 0x5575e75b28c0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:31:37.322 INFO:tasks.workunit.client.0.smithi071.stderr: -311> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.322 INFO:tasks.workunit.client.0.smithi071.stderr: -310> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.322 INFO:tasks.workunit.client.0.smithi071.stderr: -309> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.322 INFO:tasks.workunit.client.0.smithi071.stderr: -308> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:31:37.322 INFO:tasks.workunit.client.0.smithi071.stderr: -307> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient(hunting): authenticate will time out at 2309.241260s 2024-09-14T11:31:37.322 INFO:tasks.workunit.client.0.smithi071.stderr: -306> 2024-09-14T11:31:37.118+0000 7f9d51ee4640 10 monclient(hunting): get_auth_request con 0x5575e7586b10 auth_method 0 2024-09-14T11:31:37.322 INFO:tasks.workunit.client.0.smithi071.stderr: -305> 2024-09-14T11:31:37.118+0000 7f9d51ee4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.322 INFO:tasks.workunit.client.0.smithi071.stderr: -304> 2024-09-14T11:31:37.118+0000 7f9d51ee4640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.323 INFO:tasks.workunit.client.0.smithi071.stderr: -303> 2024-09-14T11:31:37.118+0000 7f9d51ee4640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.323 INFO:tasks.workunit.client.0.smithi071.stderr: -302> 2024-09-14T11:31:37.118+0000 7f9d50ee2640 10 monclient(hunting): get_auth_request con 0x5575e75b70f0 auth_method 0 2024-09-14T11:31:37.323 INFO:tasks.workunit.client.0.smithi071.stderr: -301> 2024-09-14T11:31:37.118+0000 7f9d50ee2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.323 INFO:tasks.workunit.client.0.smithi071.stderr: -300> 2024-09-14T11:31:37.118+0000 7f9d50ee2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.323 INFO:tasks.workunit.client.0.smithi071.stderr: -299> 2024-09-14T11:31:37.118+0000 7f9d50ee2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.323 INFO:tasks.workunit.client.0.smithi071.stderr: -298> 2024-09-14T11:31:37.118+0000 7f9d51ee4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:37.323 INFO:tasks.workunit.client.0.smithi071.stderr: -297> 2024-09-14T11:31:37.118+0000 7f9d51ee4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:37.323 INFO:tasks.workunit.client.0.smithi071.stderr: -296> 2024-09-14T11:31:37.118+0000 7f9d51ee4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:37.323 INFO:tasks.workunit.client.0.smithi071.stderr: -295> 2024-09-14T11:31:37.118+0000 7f9d50ee2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:37.323 INFO:tasks.workunit.client.0.smithi071.stderr: -294> 2024-09-14T11:31:37.118+0000 7f9d50ee2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:37.323 INFO:tasks.workunit.client.0.smithi071.stderr: -293> 2024-09-14T11:31:37.118+0000 7f9d50ee2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:37.323 INFO:tasks.workunit.client.0.smithi071.stderr: -292> 2024-09-14T11:31:37.118+0000 7f9d51ee4640 10 monclient(hunting): handle_auth_done global_id 6932 payload 274 2024-09-14T11:31:37.323 INFO:tasks.workunit.client.0.smithi071.stderr: -291> 2024-09-14T11:31:37.118+0000 7f9d51ee4640 10 monclient: _finish_hunting 0 2024-09-14T11:31:37.323 INFO:tasks.workunit.client.0.smithi071.stderr: -290> 2024-09-14T11:31:37.118+0000 7f9d51ee4640 1 monclient: found mon.noname-c 2024-09-14T11:31:37.323 INFO:tasks.workunit.client.0.smithi071.stderr: -289> 2024-09-14T11:31:37.118+0000 7f9d51ee4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:31:37.323 INFO:tasks.workunit.client.0.smithi071.stderr: -288> 2024-09-14T11:31:37.118+0000 7f9c34ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:37.324 INFO:tasks.workunit.client.0.smithi071.stderr: -287> 2024-09-14T11:31:37.118+0000 7f9c34ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:31:37.324 INFO:tasks.workunit.client.0.smithi071.stderr: -286> 2024-09-14T11:31:37.118+0000 7f9c34ff9640 10 monclient: dump: 2024-09-14T11:31:37.324 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:31:37.324 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:31:37.324 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:37.324 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:37.324 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:37.324 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:37.324 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:31:37.324 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:31:37.324 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:31:37.324 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.324 INFO:tasks.workunit.client.0.smithi071.stderr: -285> 2024-09-14T11:31:37.118+0000 7f9c34ff9640 10 monclient: _finish_auth 0 2024-09-14T11:31:37.324 INFO:tasks.workunit.client.0.smithi071.stderr: -284> 2024-09-14T11:31:37.118+0000 7f9c34ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:31:37.325 INFO:tasks.workunit.client.0.smithi071.stderr: -283> 2024-09-14T11:31:37.118+0000 7f9c34ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:37.325 INFO:tasks.workunit.client.0.smithi071.stderr: -282> 2024-09-14T11:31:37.118+0000 7f9c34ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:37.325 INFO:tasks.workunit.client.0.smithi071.stderr: -281> 2024-09-14T11:31:37.118+0000 7f9c34ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:31:37.325 INFO:tasks.workunit.client.0.smithi071.stderr: -280> 2024-09-14T11:31:37.118+0000 7f9c34ff9640 10 monclient: dump: 2024-09-14T11:31:37.325 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:31:37.325 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:31:37.325 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:37.325 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:37.325 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:37.325 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:37.325 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:31:37.325 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:31:37.325 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:31:37.325 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.325 INFO:tasks.workunit.client.0.smithi071.stderr: -279> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 monclient: authenticate success, global_id 6932 2024-09-14T11:31:37.325 INFO:tasks.workunit.client.0.smithi071.stderr: -278> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:31:37.326 INFO:tasks.workunit.client.0.smithi071.stderr: -277> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 4 set_mon_vals no callback set 2024-09-14T11:31:37.326 INFO:tasks.workunit.client.0.smithi071.stderr: -276> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient: shutdown 2024-09-14T11:31:37.326 INFO:tasks.workunit.client.0.smithi071.stderr: -275> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient: build_initial_monmap 2024-09-14T11:31:37.326 INFO:tasks.workunit.client.0.smithi071.stderr: -274> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 1 build_initial for_mkfs: 0 2024-09-14T11:31:37.326 INFO:tasks.workunit.client.0.smithi071.stderr: -273> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient: monmap: 2024-09-14T11:31:37.326 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:31:37.326 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:31:37.326 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:31:37.326 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:31:37.326 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:31:37.326 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:37.326 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:31:37.326 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:31:37.326 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:31:37.326 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.326 INFO:tasks.workunit.client.0.smithi071.stderr: -272> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e75a7b10) adding auth protocol: cephx 2024-09-14T11:31:37.327 INFO:tasks.workunit.client.0.smithi071.stderr: -271> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e75a7b10) adding auth protocol: cephx 2024-09-14T11:31:37.327 INFO:tasks.workunit.client.0.smithi071.stderr: -270> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e75a7b10) adding auth protocol: cephx 2024-09-14T11:31:37.327 INFO:tasks.workunit.client.0.smithi071.stderr: -269> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e75a7b10) adding con mode: secure 2024-09-14T11:31:37.327 INFO:tasks.workunit.client.0.smithi071.stderr: -268> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e75a7b10) adding con mode: crc 2024-09-14T11:31:37.327 INFO:tasks.workunit.client.0.smithi071.stderr: -267> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e75a7b10) adding con mode: secure 2024-09-14T11:31:37.327 INFO:tasks.workunit.client.0.smithi071.stderr: -266> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e75a7b10) adding con mode: crc 2024-09-14T11:31:37.327 INFO:tasks.workunit.client.0.smithi071.stderr: -265> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e75a7b10) adding con mode: secure 2024-09-14T11:31:37.327 INFO:tasks.workunit.client.0.smithi071.stderr: -264> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e75a7b10) adding con mode: crc 2024-09-14T11:31:37.327 INFO:tasks.workunit.client.0.smithi071.stderr: -263> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e75a7b10) adding con mode: crc 2024-09-14T11:31:37.327 INFO:tasks.workunit.client.0.smithi071.stderr: -262> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e75a7b10) adding con mode: secure 2024-09-14T11:31:37.327 INFO:tasks.workunit.client.0.smithi071.stderr: -261> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e75a7b10) adding con mode: crc 2024-09-14T11:31:37.327 INFO:tasks.workunit.client.0.smithi071.stderr: -260> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e75a7b10) adding con mode: secure 2024-09-14T11:31:37.327 INFO:tasks.workunit.client.0.smithi071.stderr: -259> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e75a7b10) adding con mode: crc 2024-09-14T11:31:37.327 INFO:tasks.workunit.client.0.smithi071.stderr: -258> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e75a7b10) adding con mode: secure 2024-09-14T11:31:37.327 INFO:tasks.workunit.client.0.smithi071.stderr: -257> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.328 INFO:tasks.workunit.client.0.smithi071.stderr: -256> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 1 librados: starting msgr at 2024-09-14T11:31:37.328 INFO:tasks.workunit.client.0.smithi071.stderr: -255> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 1 librados: starting objecter 2024-09-14T11:31:37.328 INFO:tasks.workunit.client.0.smithi071.stderr: -254> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 asok(0x5575e72d8d90) register_command objecter_requests cmddesc objecter_requests hook 0x5575e7586af0 EEXIST 2024-09-14T11:31:37.328 INFO:tasks.workunit.client.0.smithi071.stderr: -253> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 1 librados: setting wanted keys 2024-09-14T11:31:37.328 INFO:tasks.workunit.client.0.smithi071.stderr: -252> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 1 librados: calling monclient init 2024-09-14T11:31:37.328 INFO:tasks.workunit.client.0.smithi071.stderr: -251> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient: init 2024-09-14T11:31:37.328 INFO:tasks.workunit.client.0.smithi071.stderr: -250> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7564f40) adding auth protocol: cephx 2024-09-14T11:31:37.328 INFO:tasks.workunit.client.0.smithi071.stderr: -249> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7564f40) adding auth protocol: cephx 2024-09-14T11:31:37.328 INFO:tasks.workunit.client.0.smithi071.stderr: -248> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7564f40) adding auth protocol: cephx 2024-09-14T11:31:37.328 INFO:tasks.workunit.client.0.smithi071.stderr: -247> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7564f40) adding con mode: secure 2024-09-14T11:31:37.328 INFO:tasks.workunit.client.0.smithi071.stderr: -246> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7564f40) adding con mode: crc 2024-09-14T11:31:37.328 INFO:tasks.workunit.client.0.smithi071.stderr: -245> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7564f40) adding con mode: secure 2024-09-14T11:31:37.328 INFO:tasks.workunit.client.0.smithi071.stderr: -244> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7564f40) adding con mode: crc 2024-09-14T11:31:37.328 INFO:tasks.workunit.client.0.smithi071.stderr: -243> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7564f40) adding con mode: secure 2024-09-14T11:31:37.328 INFO:tasks.workunit.client.0.smithi071.stderr: -242> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7564f40) adding con mode: crc 2024-09-14T11:31:37.329 INFO:tasks.workunit.client.0.smithi071.stderr: -241> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7564f40) adding con mode: crc 2024-09-14T11:31:37.329 INFO:tasks.workunit.client.0.smithi071.stderr: -240> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7564f40) adding con mode: secure 2024-09-14T11:31:37.329 INFO:tasks.workunit.client.0.smithi071.stderr: -239> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7564f40) adding con mode: crc 2024-09-14T11:31:37.329 INFO:tasks.workunit.client.0.smithi071.stderr: -238> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7564f40) adding con mode: secure 2024-09-14T11:31:37.329 INFO:tasks.workunit.client.0.smithi071.stderr: -237> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7564f40) adding con mode: crc 2024-09-14T11:31:37.329 INFO:tasks.workunit.client.0.smithi071.stderr: -236> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 AuthRegistry(0x5575e7564f40) adding con mode: secure 2024-09-14T11:31:37.329 INFO:tasks.workunit.client.0.smithi071.stderr: -235> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.329 INFO:tasks.workunit.client.0.smithi071.stderr: -234> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.329 INFO:tasks.workunit.client.0.smithi071.stderr: -233> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 5 asok(0x5575e72d8d90) register_command rotate-key cmddesc rotate-key hook 0x5575e7565088 EEXIST 2024-09-14T11:31:37.329 INFO:tasks.workunit.client.0.smithi071.stderr: -232> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:31:37.329 INFO:tasks.workunit.client.0.smithi071.stderr: -231> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:31:37.329 INFO:tasks.workunit.client.0.smithi071.stderr: -230> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient(hunting): picked mon.noname-b con 0x5575e7586b10 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:31:37.329 INFO:tasks.workunit.client.0.smithi071.stderr: -229> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient(hunting): picked mon.noname-c con 0x5575e75b28c0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:31:37.329 INFO:tasks.workunit.client.0.smithi071.stderr: -228> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient(hunting): picked mon.noname-a con 0x5575e75b70f0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:31:37.329 INFO:tasks.workunit.client.0.smithi071.stderr: -227> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.330 INFO:tasks.workunit.client.0.smithi071.stderr: -226> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.330 INFO:tasks.workunit.client.0.smithi071.stderr: -225> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.330 INFO:tasks.workunit.client.0.smithi071.stderr: -224> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:31:37.330 INFO:tasks.workunit.client.0.smithi071.stderr: -223> 2024-09-14T11:31:37.118+0000 7f9d53bdd9c0 10 monclient(hunting): authenticate will time out at 2309.243846s 2024-09-14T11:31:37.330 INFO:tasks.workunit.client.0.smithi071.stderr: -222> 2024-09-14T11:31:37.118+0000 7f9d516e3640 10 monclient(hunting): get_auth_request con 0x5575e75b70f0 auth_method 0 2024-09-14T11:31:37.330 INFO:tasks.workunit.client.0.smithi071.stderr: -221> 2024-09-14T11:31:37.118+0000 7f9d516e3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.330 INFO:tasks.workunit.client.0.smithi071.stderr: -220> 2024-09-14T11:31:37.118+0000 7f9d516e3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.330 INFO:tasks.workunit.client.0.smithi071.stderr: -219> 2024-09-14T11:31:37.118+0000 7f9d516e3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.330 INFO:tasks.workunit.client.0.smithi071.stderr: -218> 2024-09-14T11:31:37.118+0000 7f9d51ee4640 10 monclient(hunting): get_auth_request con 0x5575e75b28c0 auth_method 0 2024-09-14T11:31:37.330 INFO:tasks.workunit.client.0.smithi071.stderr: -217> 2024-09-14T11:31:37.122+0000 7f9d51ee4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.330 INFO:tasks.workunit.client.0.smithi071.stderr: -216> 2024-09-14T11:31:37.122+0000 7f9d51ee4640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.330 INFO:tasks.workunit.client.0.smithi071.stderr: -215> 2024-09-14T11:31:37.122+0000 7f9d51ee4640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.330 INFO:tasks.workunit.client.0.smithi071.stderr: -214> 2024-09-14T11:31:37.122+0000 7f9d516e3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:37.330 INFO:tasks.workunit.client.0.smithi071.stderr: -213> 2024-09-14T11:31:37.122+0000 7f9d516e3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:37.330 INFO:tasks.workunit.client.0.smithi071.stderr: -212> 2024-09-14T11:31:37.122+0000 7f9d516e3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:37.330 INFO:tasks.workunit.client.0.smithi071.stderr: -211> 2024-09-14T11:31:37.122+0000 7f9d51ee4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:37.331 INFO:tasks.workunit.client.0.smithi071.stderr: -210> 2024-09-14T11:31:37.122+0000 7f9d51ee4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:37.331 INFO:tasks.workunit.client.0.smithi071.stderr: -209> 2024-09-14T11:31:37.122+0000 7f9d51ee4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:37.331 INFO:tasks.workunit.client.0.smithi071.stderr: -208> 2024-09-14T11:31:37.122+0000 7f9d516e3640 10 monclient(hunting): handle_auth_done global_id 7287 payload 824 2024-09-14T11:31:37.331 INFO:tasks.workunit.client.0.smithi071.stderr: -207> 2024-09-14T11:31:37.122+0000 7f9d516e3640 10 monclient: _finish_hunting 0 2024-09-14T11:31:37.331 INFO:tasks.workunit.client.0.smithi071.stderr: -206> 2024-09-14T11:31:37.122+0000 7f9d516e3640 1 monclient: found mon.noname-a 2024-09-14T11:31:37.331 INFO:tasks.workunit.client.0.smithi071.stderr: -205> 2024-09-14T11:31:37.122+0000 7f9d516e3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:31:37.331 INFO:tasks.workunit.client.0.smithi071.stderr: -204> 2024-09-14T11:31:37.122+0000 7f9d50ee2640 10 monclient: get_auth_request con 0x5575e7586b10 auth_method 0 2024-09-14T11:31:37.331 INFO:tasks.workunit.client.0.smithi071.stderr: -203> 2024-09-14T11:31:37.122+0000 7f9c22ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:37.331 INFO:tasks.workunit.client.0.smithi071.stderr: -202> 2024-09-14T11:31:37.122+0000 7f9c22ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:31:37.331 INFO:tasks.workunit.client.0.smithi071.stderr: -201> 2024-09-14T11:31:37.122+0000 7f9c22ffd640 10 monclient: dump: 2024-09-14T11:31:37.331 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:31:37.331 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:31:37.331 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:37.331 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:37.331 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:37.332 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:37.332 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:31:37.332 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:31:37.332 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:31:37.332 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.332 INFO:tasks.workunit.client.0.smithi071.stderr: -200> 2024-09-14T11:31:37.122+0000 7f9c22ffd640 10 monclient: _finish_auth 0 2024-09-14T11:31:37.332 INFO:tasks.workunit.client.0.smithi071.stderr: -199> 2024-09-14T11:31:37.122+0000 7f9c22ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:31:37.332 INFO:tasks.workunit.client.0.smithi071.stderr: -198> 2024-09-14T11:31:37.122+0000 7f9c22ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:37.332 INFO:tasks.workunit.client.0.smithi071.stderr: -197> 2024-09-14T11:31:37.122+0000 7f9c22ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:37.332 INFO:tasks.workunit.client.0.smithi071.stderr: -196> 2024-09-14T11:31:37.122+0000 7f9c22ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:31:37.332 INFO:tasks.workunit.client.0.smithi071.stderr: -195> 2024-09-14T11:31:37.122+0000 7f9c22ffd640 10 monclient: dump: 2024-09-14T11:31:37.332 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:31:37.332 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:31:37.332 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:37.332 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:31:37.333 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:37.333 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:31:37.333 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:31:37.333 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:31:37.333 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:31:37.333 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.333 INFO:tasks.workunit.client.0.smithi071.stderr: -194> 2024-09-14T11:31:37.122+0000 7f9c34ff9640 4 set_mon_vals no callback set 2024-09-14T11:31:37.333 INFO:tasks.workunit.client.0.smithi071.stderr: -193> 2024-09-14T11:31:37.122+0000 7f9d53bdd9c0 5 monclient: authenticate success, global_id 7287 2024-09-14T11:31:37.333 INFO:tasks.workunit.client.0.smithi071.stderr: -192> 2024-09-14T11:31:37.122+0000 7f9d53bdd9c0 10 monclient: _renew_subs 2024-09-14T11:31:37.333 INFO:tasks.workunit.client.0.smithi071.stderr: -191> 2024-09-14T11:31:37.122+0000 7f9d53bdd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:31:37.333 INFO:tasks.workunit.client.0.smithi071.stderr: -190> 2024-09-14T11:31:37.122+0000 7f9d53bdd9c0 10 monclient: _renew_subs 2024-09-14T11:31:37.333 INFO:tasks.workunit.client.0.smithi071.stderr: -189> 2024-09-14T11:31:37.122+0000 7f9d53bdd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:31:37.333 INFO:tasks.workunit.client.0.smithi071.stderr: -188> 2024-09-14T11:31:37.122+0000 7f9d53bdd9c0 1 librados: init done 2024-09-14T11:31:37.333 INFO:tasks.workunit.client.0.smithi071.stderr: -187> 2024-09-14T11:31:37.122+0000 7f9d53bdd9c0 5 asok(0x5575e72d8d90) register_command cr dump hook 0x5575e75a4308 2024-09-14T11:31:37.333 INFO:tasks.workunit.client.0.smithi071.stderr: -186> 2024-09-14T11:31:37.122+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.333 INFO:tasks.workunit.client.0.smithi071.stderr: -185> 2024-09-14T11:31:37.122+0000 7f9c22ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:31:37.334 INFO:tasks.workunit.client.0.smithi071.stderr: -184> 2024-09-14T11:31:37.122+0000 7f9c22ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:31:37.334 INFO:tasks.workunit.client.0.smithi071.stderr: -183> 2024-09-14T11:31:37.122+0000 7f9c22ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:31:37.334 INFO:tasks.workunit.client.0.smithi071.stderr: -182> 2024-09-14T11:31:37.122+0000 7f9d50ee2640 10 monclient: get_auth_request con 0x7f9c1c0718a0 auth_method 0 2024-09-14T11:31:37.334 INFO:tasks.workunit.client.0.smithi071.stderr: -181> 2024-09-14T11:31:37.126+0000 7f9d51ee4640 10 monclient: get_auth_request con 0x5575e75d0de0 auth_method 0 2024-09-14T11:31:37.334 INFO:tasks.workunit.client.0.smithi071.stderr: -180> 2024-09-14T11:31:37.126+0000 7f9d53bdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.334 INFO:tasks.workunit.client.0.smithi071.stderr: -179> 2024-09-14T11:31:37.126+0000 7f9d53bdd9c0 20 realm 2024-09-14T11:31:37.334 INFO:tasks.workunit.client.0.smithi071.stderr: -178> 2024-09-14T11:31:37.126+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.334 INFO:tasks.workunit.client.0.smithi071.stderr: -177> 2024-09-14T11:31:37.126+0000 7f9d53bdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.334 INFO:tasks.workunit.client.0.smithi071.stderr: -176> 2024-09-14T11:31:37.126+0000 7f9d53bdd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:37.334 INFO:tasks.workunit.client.0.smithi071.stderr: -175> 2024-09-14T11:31:37.126+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.334 INFO:tasks.workunit.client.0.smithi071.stderr: -174> 2024-09-14T11:31:37.126+0000 7f9d53bdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.334 INFO:tasks.workunit.client.0.smithi071.stderr: -173> 2024-09-14T11:31:37.126+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.334 INFO:tasks.workunit.client.0.smithi071.stderr: -172> 2024-09-14T11:31:37.126+0000 7f9d50ee2640 10 monclient: get_auth_request con 0x5575e75d5050 auth_method 0 2024-09-14T11:31:37.334 INFO:tasks.workunit.client.0.smithi071.stderr: -171> 2024-09-14T11:31:37.126+0000 7f9d53bdd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:37.334 INFO:tasks.workunit.client.0.smithi071.stderr: -170> 2024-09-14T11:31:37.126+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.335 INFO:tasks.workunit.client.0.smithi071.stderr: -169> 2024-09-14T11:31:37.126+0000 7f9d51ee4640 10 monclient: get_auth_request con 0x5575e75d88b0 auth_method 0 2024-09-14T11:31:37.335 INFO:tasks.workunit.client.0.smithi071.stderr: -168> 2024-09-14T11:31:37.126+0000 7f9d53bdd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:37.335 INFO:tasks.workunit.client.0.smithi071.stderr: -167> 2024-09-14T11:31:37.126+0000 7f9d53bdd9c0 20 searching for the correct realm 2024-09-14T11:31:37.335 INFO:tasks.workunit.client.0.smithi071.stderr: -166> 2024-09-14T11:31:37.130+0000 7f9d516e3640 10 monclient: get_auth_request con 0x5575e75dd5b0 auth_method 0 2024-09-14T11:31:37.335 INFO:tasks.workunit.client.0.smithi071.stderr: -165> 2024-09-14T11:31:37.130+0000 7f9d50ee2640 10 monclient: get_auth_request con 0x7f9d44031070 auth_method 0 2024-09-14T11:31:37.335 INFO:tasks.workunit.client.0.smithi071.stderr: -164> 2024-09-14T11:31:37.130+0000 7f9d51ee4640 10 monclient: get_auth_request con 0x7f9d3c0ee040 auth_method 0 2024-09-14T11:31:37.335 INFO:tasks.workunit.client.0.smithi071.stderr: -163> 2024-09-14T11:31:37.130+0000 7f9d51ee4640 0 -- 172.21.15.71:0/3470052274 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f9d3c0ee040 msgr2=0x7f9d3c0ee930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:37.335 INFO:tasks.workunit.client.0.smithi071.stderr: -162> 2024-09-14T11:31:37.130+0000 7f9c22ffd640 1 client.7287.objecter ms_handle_reset 0x7f9d3c0ee040 session 0x7f9d3c0a6070 osd.0 2024-09-14T11:31:37.335 INFO:tasks.workunit.client.0.smithi071.stderr: -161> 2024-09-14T11:31:37.130+0000 7f9c22ffd640 10 monclient: _renew_subs 2024-09-14T11:31:37.335 INFO:tasks.workunit.client.0.smithi071.stderr: -160> 2024-09-14T11:31:37.130+0000 7f9c22ffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:31:37.335 INFO:tasks.workunit.client.0.smithi071.stderr: -159> 2024-09-14T11:31:37.130+0000 7f9d51ee4640 10 monclient: get_auth_request con 0x7f9c1c0813c0 auth_method 0 2024-09-14T11:31:37.335 INFO:tasks.workunit.client.0.smithi071.stderr: -158> 2024-09-14T11:31:37.134+0000 7f9d516e3640 10 monclient: get_auth_request con 0x7f9d44066070 auth_method 0 2024-09-14T11:31:37.335 INFO:tasks.workunit.client.0.smithi071.stderr: -157> 2024-09-14T11:31:37.138+0000 7f9d50ee2640 10 monclient: get_auth_request con 0x7f9d3c0df410 auth_method 0 2024-09-14T11:31:37.335 INFO:tasks.workunit.client.0.smithi071.stderr: -156> 2024-09-14T11:31:37.138+0000 7f9d51ee4640 0 -- 172.21.15.71:0/3470052274 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x5575e75d88b0 msgr2=0x5575e75daca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:37.335 INFO:tasks.workunit.client.0.smithi071.stderr: -155> 2024-09-14T11:31:37.138+0000 7f9c22ffd640 1 client.7287.objecter ms_handle_reset 0x5575e75d88b0 session 0x5575e75d43a0 osd.3 2024-09-14T11:31:37.336 INFO:tasks.workunit.client.0.smithi071.stderr: -154> 2024-09-14T11:31:37.138+0000 7f9d51ee4640 10 monclient: get_auth_request con 0x7f9d3c0ee040 auth_method 0 2024-09-14T11:31:37.336 INFO:tasks.workunit.client.0.smithi071.stderr: -153> 2024-09-14T11:31:37.146+0000 7f9d53bdd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:37.336 INFO:tasks.workunit.client.0.smithi071.stderr: -152> 2024-09-14T11:31:37.146+0000 7f9d53bdd9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:31:37.336 INFO:tasks.workunit.client.0.smithi071.stderr: -151> 2024-09-14T11:31:37.146+0000 7f9d53bdd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:37.336 INFO:tasks.workunit.client.0.smithi071.stderr: -150> 2024-09-14T11:31:37.146+0000 7f9d53bdd9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:31:37.336 INFO:tasks.workunit.client.0.smithi071.stderr: -149> 2024-09-14T11:31:37.146+0000 7f9d53bdd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:37.336 INFO:tasks.workunit.client.0.smithi071.stderr: -148> 2024-09-14T11:31:37.146+0000 7f9d53bdd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:37.336 INFO:tasks.workunit.client.0.smithi071.stderr: -147> 2024-09-14T11:31:37.146+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.336 INFO:tasks.workunit.client.0.smithi071.stderr: -146> 2024-09-14T11:31:37.146+0000 7f9d53bdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.336 INFO:tasks.workunit.client.0.smithi071.stderr: -145> 2024-09-14T11:31:37.146+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.336 INFO:tasks.workunit.client.0.smithi071.stderr: -144> 2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:37.336 INFO:tasks.workunit.client.0.smithi071.stderr: -143> 2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.336 INFO:tasks.workunit.client.0.smithi071.stderr: -142> 2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:37.336 INFO:tasks.workunit.client.0.smithi071.stderr: -141> 2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 zone default found 2024-09-14T11:31:37.336 INFO:tasks.workunit.client.0.smithi071.stderr: -140> 2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 4 Realm: () 2024-09-14T11:31:37.337 INFO:tasks.workunit.client.0.smithi071.stderr: -139> 2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:31:37.337 INFO:tasks.workunit.client.0.smithi071.stderr: -138> 2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:31:37.337 INFO:tasks.workunit.client.0.smithi071.stderr: -137> 2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:37.337 INFO:tasks.workunit.client.0.smithi071.stderr: -136> 2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 zonegroup default 2024-09-14T11:31:37.337 INFO:tasks.workunit.client.0.smithi071.stderr: -135> 2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.337 INFO:tasks.workunit.client.0.smithi071.stderr: -134> 2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.337 INFO:tasks.workunit.client.0.smithi071.stderr: -133> 2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.337 INFO:tasks.workunit.client.0.smithi071.stderr: -132> 2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.337 INFO:tasks.workunit.client.0.smithi071.stderr: -131> 2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.337 INFO:tasks.workunit.client.0.smithi071.stderr: -130> 2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.337 INFO:tasks.workunit.client.0.smithi071.stderr: -129> 2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 started sync module instance, tier type = 2024-09-14T11:31:37.337 INFO:tasks.workunit.client.0.smithi071.stderr: -128> 2024-09-14T11:31:37.150+0000 7f9d53bdd9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:31:37.337 INFO:tasks.workunit.client.0.smithi071.stderr: -127> 2024-09-14T11:31:37.170+0000 7f9d53bdd9c0 20 add_watcher() i=0 2024-09-14T11:31:37.337 INFO:tasks.workunit.client.0.smithi071.stderr: -126> 2024-09-14T11:31:37.170+0000 7f9d53bdd9c0 20 add_watcher() i=1 2024-09-14T11:31:37.338 INFO:tasks.workunit.client.0.smithi071.stderr: -125> 2024-09-14T11:31:37.170+0000 7f9d53bdd9c0 20 add_watcher() i=2 2024-09-14T11:31:37.338 INFO:tasks.workunit.client.0.smithi071.stderr: -124> 2024-09-14T11:31:37.170+0000 7f9d53bdd9c0 20 add_watcher() i=3 2024-09-14T11:31:37.338 INFO:tasks.workunit.client.0.smithi071.stderr: -123> 2024-09-14T11:31:37.170+0000 7f9d53bdd9c0 20 add_watcher() i=4 2024-09-14T11:31:37.338 INFO:tasks.workunit.client.0.smithi071.stderr: -122> 2024-09-14T11:31:37.170+0000 7f9d53bdd9c0 20 add_watcher() i=5 2024-09-14T11:31:37.338 INFO:tasks.workunit.client.0.smithi071.stderr: -121> 2024-09-14T11:31:37.170+0000 7f9d53bdd9c0 20 add_watcher() i=6 2024-09-14T11:31:37.338 INFO:tasks.workunit.client.0.smithi071.stderr: -120> 2024-09-14T11:31:37.170+0000 7f9d53bdd9c0 20 add_watcher() i=7 2024-09-14T11:31:37.338 INFO:tasks.workunit.client.0.smithi071.stderr: -119> 2024-09-14T11:31:37.170+0000 7f9d53bdd9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:37.338 INFO:tasks.workunit.client.0.smithi071.stderr: -118> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe76060e80) adding auth protocol: cephx 2024-09-14T11:31:37.338 INFO:tasks.workunit.client.0.smithi071.stderr: -117> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe76060e80) adding auth protocol: cephx 2024-09-14T11:31:37.338 INFO:tasks.workunit.client.0.smithi071.stderr: -116> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe76060e80) adding auth protocol: cephx 2024-09-14T11:31:37.338 INFO:tasks.workunit.client.0.smithi071.stderr: -115> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe76060e80) adding con mode: secure 2024-09-14T11:31:37.338 INFO:tasks.workunit.client.0.smithi071.stderr: -114> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe76060e80) adding con mode: crc 2024-09-14T11:31:37.338 INFO:tasks.workunit.client.0.smithi071.stderr: -113> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe76060e80) adding con mode: secure 2024-09-14T11:31:37.338 INFO:tasks.workunit.client.0.smithi071.stderr: -112> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe76060e80) adding con mode: crc 2024-09-14T11:31:37.338 INFO:tasks.workunit.client.0.smithi071.stderr: -111> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe76060e80) adding con mode: secure 2024-09-14T11:31:37.339 INFO:tasks.workunit.client.0.smithi071.stderr: -110> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe76060e80) adding con mode: crc 2024-09-14T11:31:37.339 INFO:tasks.workunit.client.0.smithi071.stderr: -109> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe76060e80) adding con mode: crc 2024-09-14T11:31:37.339 INFO:tasks.workunit.client.0.smithi071.stderr: -108> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe76060e80) adding con mode: secure 2024-09-14T11:31:37.339 INFO:tasks.workunit.client.0.smithi071.stderr: -107> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe76060e80) adding con mode: crc 2024-09-14T11:31:37.339 INFO:tasks.workunit.client.0.smithi071.stderr: -106> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe76060e80) adding con mode: secure 2024-09-14T11:31:37.339 INFO:tasks.workunit.client.0.smithi071.stderr: -105> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe76060e80) adding con mode: crc 2024-09-14T11:31:37.339 INFO:tasks.workunit.client.0.smithi071.stderr: -104> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 AuthRegistry(0x7ffe76060e80) adding con mode: secure 2024-09-14T11:31:37.339 INFO:tasks.workunit.client.0.smithi071.stderr: -103> 2024-09-14T11:31:37.174+0000 7f9c077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:37.339 INFO:tasks.workunit.client.0.smithi071.stderr: -102> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.339 INFO:tasks.workunit.client.0.smithi071.stderr: -101> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:37.339 INFO:tasks.workunit.client.0.smithi071.stderr: -100> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:37.339 INFO:tasks.workunit.client.0.smithi071.stderr: -99> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 asok(0x5575e72d8d90) register_command cache list hook 0x5575e75b51e0 2024-09-14T11:31:37.339 INFO:tasks.workunit.client.0.smithi071.stderr: -98> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 asok(0x5575e72d8d90) register_command cache inspect hook 0x5575e75b51e0 2024-09-14T11:31:37.339 INFO:tasks.workunit.client.0.smithi071.stderr: -97> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 asok(0x5575e72d8d90) register_command cache erase hook 0x5575e75b51e0 2024-09-14T11:31:37.339 INFO:tasks.workunit.client.0.smithi071.stderr: -96> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 asok(0x5575e72d8d90) register_command cache zap hook 0x5575e75b51e0 2024-09-14T11:31:37.340 INFO:tasks.workunit.client.0.smithi071.stderr: -95> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 note: GC not initialized 2024-09-14T11:31:37.340 INFO:tasks.workunit.client.0.smithi071.stderr: -94> 2024-09-14T11:31:37.174+0000 7f9c067e4640 20 reqs_thread_entry: start 2024-09-14T11:31:37.340 INFO:tasks.workunit.client.0.smithi071.stderr: -93> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 asok(0x5575e72d8d90) register_command sync trace show hook 0x7f9d3c0ab6d0 2024-09-14T11:31:37.340 INFO:tasks.workunit.client.0.smithi071.stderr: -92> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 asok(0x5575e72d8d90) register_command sync trace history hook 0x7f9d3c0ab6d0 2024-09-14T11:31:37.340 INFO:tasks.workunit.client.0.smithi071.stderr: -91> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 asok(0x5575e72d8d90) register_command sync trace active hook 0x7f9d3c0ab6d0 2024-09-14T11:31:37.340 INFO:tasks.workunit.client.0.smithi071.stderr: -90> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 5 asok(0x5575e72d8d90) register_command sync trace active_short hook 0x7f9d3c0ab6d0 2024-09-14T11:31:37.340 INFO:tasks.workunit.client.0.smithi071.stderr: -89> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:31:37.340 INFO:tasks.workunit.client.0.smithi071.stderr: -88> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 20 Filter name: none 2024-09-14T11:31:37.340 INFO:tasks.workunit.client.0.smithi071.stderr: -87> 2024-09-14T11:31:37.174+0000 7f9b77fff640 20 reqs_thread_entry: start 2024-09-14T11:31:37.340 INFO:tasks.workunit.client.0.smithi071.stderr: -86> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:31:37.340 INFO:tasks.workunit.client.0.smithi071.stderr: -85> 2024-09-14T11:31:37.174+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.340 INFO:tasks.workunit.client.0.smithi071.stderr: -84> 2024-09-14T11:31:37.178+0000 7f9d53bdd9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:37.340 INFO:tasks.workunit.client.0.smithi071.stderr: -83> 2024-09-14T11:31:37.178+0000 7f9d53bdd9c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:31:37.340 INFO:tasks.workunit.client.0.smithi071.stderr: -82> 2024-09-14T11:31:37.178+0000 7f9d53bdd9c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:31:37.340 INFO:tasks.workunit.client.0.smithi071.stderr: -81> 2024-09-14T11:31:37.178+0000 7f9d53bdd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 : miss 2024-09-14T11:31:37.341 INFO:tasks.workunit.client.0.smithi071.stderr: -80> 2024-09-14T11:31:37.178+0000 7f9d53bdd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.341 INFO:tasks.workunit.client.0.smithi071.stderr: -79> 2024-09-14T11:31:37.178+0000 7f9d53bdd9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:31:37.341 INFO:tasks.workunit.client.0.smithi071.stderr: -78> 2024-09-14T11:31:37.178+0000 7f9d53bdd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 info.flags=0x17 2024-09-14T11:31:37.341 INFO:tasks.workunit.client.0.smithi071.stderr: -77> 2024-09-14T11:31:37.178+0000 7f9d53bdd9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 to cache LRU end 2024-09-14T11:31:37.341 INFO:tasks.workunit.client.0.smithi071.stderr: -76> 2024-09-14T11:31:37.178+0000 7f9d53bdd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:31:37.341 INFO:tasks.workunit.client.0.smithi071.stderr: -75> 2024-09-14T11:31:37.178+0000 7f9d53bdd9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:37.341 INFO:tasks.workunit.client.0.smithi071.stderr: -74> 2024-09-14T11:31:37.178+0000 7f9d53bdd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 2024-09-14T11:31:37.341 INFO:tasks.workunit.client.0.smithi071.stderr: -73> 2024-09-14T11:31:37.186+0000 7f9d53bdd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 info.flags=0x17 2024-09-14T11:31:37.341 INFO:tasks.workunit.client.0.smithi071.stderr: -72> 2024-09-14T11:31:37.186+0000 7f9d53bdd9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 to cache LRU end 2024-09-14T11:31:37.341 INFO:tasks.workunit.client.0.smithi071.stderr: -71> 2024-09-14T11:31:37.186+0000 7f9d53bdd9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:37.341 INFO:tasks.workunit.client.0.smithi071.stderr: -70> 2024-09-14T11:31:37.186+0000 7f9d53bdd9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33, ofs0, ns] 2024-09-14T11:31:37.341 INFO:tasks.workunit.client.0.smithi071.stderr: -69> 2024-09-14T11:31:37.186+0000 7f9c34ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464384 cookie 93964881241472 notifier 7287 bl.length()=1015 2024-09-14T11:31:37.341 INFO:tasks.workunit.client.0.smithi071.stderr: -68> 2024-09-14T11:31:37.186+0000 7f9c34ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 info.flags=0x17 2024-09-14T11:31:37.341 INFO:tasks.workunit.client.0.smithi071.stderr: -67> 2024-09-14T11:31:37.186+0000 7f9c34ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 to cache LRU end 2024-09-14T11:31:37.342 INFO:tasks.workunit.client.0.smithi071.stderr: -66> 2024-09-14T11:31:37.186+0000 7f9c34ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:37.342 INFO:tasks.workunit.client.0.smithi071.stderr: -65> 2024-09-14T11:31:37.186+0000 7f9d53bdd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.33]): orig_sources= new_sources= 2024-09-14T11:31:37.342 INFO:tasks.workunit.client.0.smithi071.stderr: -64> 2024-09-14T11:31:37.186+0000 7f9d53bdd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.33]): potential sources added=[] removed=[] 2024-09-14T11:31:37.342 INFO:tasks.workunit.client.0.smithi071.stderr: -63> 2024-09-14T11:31:37.186+0000 7f9d53bdd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.33]): orig_dests= new_dests= 2024-09-14T11:31:37.342 INFO:tasks.workunit.client.0.smithi071.stderr: -62> 2024-09-14T11:31:37.186+0000 7f9d53bdd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.33]): potential dests added=[] removed=[] 2024-09-14T11:31:37.342 INFO:tasks.workunit.client.0.smithi071.stderr: -61> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.0 2024-09-14T11:31:37.342 INFO:tasks.workunit.client.0.smithi071.stderr: -60> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.0 2024-09-14T11:31:37.342 INFO:tasks.workunit.client.0.smithi071.stderr: -59> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.1 2024-09-14T11:31:37.342 INFO:tasks.workunit.client.0.smithi071.stderr: -58> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.1 2024-09-14T11:31:37.342 INFO:tasks.workunit.client.0.smithi071.stderr: -57> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.2 2024-09-14T11:31:37.342 INFO:tasks.workunit.client.0.smithi071.stderr: -56> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.2 2024-09-14T11:31:37.342 INFO:tasks.workunit.client.0.smithi071.stderr: -55> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.3 2024-09-14T11:31:37.342 INFO:tasks.workunit.client.0.smithi071.stderr: -54> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.3 2024-09-14T11:31:37.342 INFO:tasks.workunit.client.0.smithi071.stderr: -53> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.4 2024-09-14T11:31:37.342 INFO:tasks.workunit.client.0.smithi071.stderr: -52> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.4 2024-09-14T11:31:37.343 INFO:tasks.workunit.client.0.smithi071.stderr: -51> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.5 2024-09-14T11:31:37.343 INFO:tasks.workunit.client.0.smithi071.stderr: -50> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.5 2024-09-14T11:31:37.343 INFO:tasks.workunit.client.0.smithi071.stderr: -49> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.6 2024-09-14T11:31:37.343 INFO:tasks.workunit.client.0.smithi071.stderr: -48> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.6 2024-09-14T11:31:37.343 INFO:tasks.workunit.client.0.smithi071.stderr: -47> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.7 2024-09-14T11:31:37.343 INFO:tasks.workunit.client.0.smithi071.stderr: -46> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.7 2024-09-14T11:31:37.343 INFO:tasks.workunit.client.0.smithi071.stderr: -45> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.8 2024-09-14T11:31:37.343 INFO:tasks.workunit.client.0.smithi071.stderr: -44> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.8 2024-09-14T11:31:37.343 INFO:tasks.workunit.client.0.smithi071.stderr: -43> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.9 2024-09-14T11:31:37.343 INFO:tasks.workunit.client.0.smithi071.stderr: -42> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.9 2024-09-14T11:31:37.343 INFO:tasks.workunit.client.0.smithi071.stderr: -41> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.10 2024-09-14T11:31:37.343 INFO:tasks.workunit.client.0.smithi071.stderr: -40> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.10 2024-09-14T11:31:37.343 INFO:tasks.workunit.client.0.smithi071.stderr: -39> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.11 2024-09-14T11:31:37.343 INFO:tasks.workunit.client.0.smithi071.stderr: -38> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.11 2024-09-14T11:31:37.343 INFO:tasks.workunit.client.0.smithi071.stderr: -37> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.0 2024-09-14T11:31:37.343 INFO:tasks.workunit.client.0.smithi071.stderr: -36> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1 2024-09-14T11:31:37.344 INFO:tasks.workunit.client.0.smithi071.stderr: -35> 2024-09-14T11:31:37.198+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.2 2024-09-14T11:31:37.344 INFO:tasks.workunit.client.0.smithi071.stderr: -34> 2024-09-14T11:31:37.202+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.3 2024-09-14T11:31:37.344 INFO:tasks.workunit.client.0.smithi071.stderr: -33> 2024-09-14T11:31:37.202+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.4 2024-09-14T11:31:37.344 INFO:tasks.workunit.client.0.smithi071.stderr: -32> 2024-09-14T11:31:37.202+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.5 2024-09-14T11:31:37.344 INFO:tasks.workunit.client.0.smithi071.stderr: -31> 2024-09-14T11:31:37.202+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.6 2024-09-14T11:31:37.344 INFO:tasks.workunit.client.0.smithi071.stderr: -30> 2024-09-14T11:31:37.206+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.7 2024-09-14T11:31:37.344 INFO:tasks.workunit.client.0.smithi071.stderr: -29> 2024-09-14T11:31:37.206+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.8 2024-09-14T11:31:37.344 INFO:tasks.workunit.client.0.smithi071.stderr: -28> 2024-09-14T11:31:37.206+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.9 2024-09-14T11:31:37.344 INFO:tasks.workunit.client.0.smithi071.stderr: -27> 2024-09-14T11:31:37.206+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.10 2024-09-14T11:31:37.344 INFO:tasks.workunit.client.0.smithi071.stderr: -26> 2024-09-14T11:31:37.214+0000 7f9d53bdd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:37.344 INFO:tasks.workunit.client.0.smithi071.stderr: -25> 2024-09-14T11:31:37.214+0000 7f9d53bdd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 2024-09-14T11:31:37.344 INFO:tasks.workunit.client.0.smithi071.stderr: -24> 2024-09-14T11:31:37.214+0000 7f9d53bdd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 info.flags=0x17 2024-09-14T11:31:37.344 INFO:tasks.workunit.client.0.smithi071.stderr: -23> 2024-09-14T11:31:37.214+0000 7f9d53bdd9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 to cache LRU end 2024-09-14T11:31:37.344 INFO:tasks.workunit.client.0.smithi071.stderr: -22> 2024-09-14T11:31:37.214+0000 7f9d53bdd9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:37.345 INFO:tasks.workunit.client.0.smithi071.stderr: -21> 2024-09-14T11:31:37.214+0000 7f9d53bdd9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33, ofs0, ns] 2024-09-14T11:31:37.345 INFO:tasks.workunit.client.0.smithi071.stderr: -20> 2024-09-14T11:31:37.214+0000 7f9c34ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464385 cookie 93964881241472 notifier 7287 bl.length()=1015 2024-09-14T11:31:37.345 INFO:tasks.workunit.client.0.smithi071.stderr: -19> 2024-09-14T11:31:37.214+0000 7f9c34ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 info.flags=0x17 2024-09-14T11:31:37.345 INFO:tasks.workunit.client.0.smithi071.stderr: -18> 2024-09-14T11:31:37.214+0000 7f9c34ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 to cache LRU end 2024-09-14T11:31:37.345 INFO:tasks.workunit.client.0.smithi071.stderr: -17> 2024-09-14T11:31:37.214+0000 7f9c34ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:37.345 INFO:tasks.workunit.client.0.smithi071.stderr: -16> 2024-09-14T11:31:37.218+0000 7f9d53bdd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.33]): orig_sources= new_sources= 2024-09-14T11:31:37.345 INFO:tasks.workunit.client.0.smithi071.stderr: -15> 2024-09-14T11:31:37.218+0000 7f9d53bdd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.33]): potential sources added=[] removed=[] 2024-09-14T11:31:37.345 INFO:tasks.workunit.client.0.smithi071.stderr: -14> 2024-09-14T11:31:37.218+0000 7f9d53bdd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.33]): orig_dests= new_dests= 2024-09-14T11:31:37.345 INFO:tasks.workunit.client.0.smithi071.stderr: -13> 2024-09-14T11:31:37.218+0000 7f9d53bdd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.33]): potential dests added=[] removed=[] 2024-09-14T11:31:37.345 INFO:tasks.workunit.client.0.smithi071.stderr: -12> 2024-09-14T11:31:37.222+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.0 2024-09-14T11:31:37.345 INFO:tasks.workunit.client.0.smithi071.stderr: -11> 2024-09-14T11:31:37.222+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1 2024-09-14T11:31:37.345 INFO:tasks.workunit.client.0.smithi071.stderr: -10> 2024-09-14T11:31:37.222+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.2 2024-09-14T11:31:37.345 INFO:tasks.workunit.client.0.smithi071.stderr: -9> 2024-09-14T11:31:37.226+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.3 2024-09-14T11:31:37.345 INFO:tasks.workunit.client.0.smithi071.stderr: -8> 2024-09-14T11:31:37.226+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.4 2024-09-14T11:31:37.345 INFO:tasks.workunit.client.0.smithi071.stderr: -7> 2024-09-14T11:31:37.226+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.5 2024-09-14T11:31:37.346 INFO:tasks.workunit.client.0.smithi071.stderr: -6> 2024-09-14T11:31:37.226+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.6 2024-09-14T11:31:37.346 INFO:tasks.workunit.client.0.smithi071.stderr: -5> 2024-09-14T11:31:37.226+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.7 2024-09-14T11:31:37.346 INFO:tasks.workunit.client.0.smithi071.stderr: -4> 2024-09-14T11:31:37.226+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.8 2024-09-14T11:31:37.346 INFO:tasks.workunit.client.0.smithi071.stderr: -3> 2024-09-14T11:31:37.230+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.9 2024-09-14T11:31:37.346 INFO:tasks.workunit.client.0.smithi071.stderr: -2> 2024-09-14T11:31:37.230+0000 7f9d53bdd9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.10 2024-09-14T11:31:37.346 INFO:tasks.workunit.client.0.smithi071.stderr: -1> 2024-09-14T11:31:37.230+0000 7f9d53bdd9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9d53bdd9c0 time 2024-09-14T11:31:37.236051+0000 2024-09-14T11:31:37.346 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:31:37.346 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.346 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:37.346 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f9d574b72eb] 2024-09-14T11:31:37.346 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9d574b749f] 2024-09-14T11:31:37.346 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5575e602fc01] 2024-09-14T11:31:37.346 INFO:tasks.workunit.client.0.smithi071.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x5575e60451a7] 2024-09-14T11:31:37.346 INFO:tasks.workunit.client.0.smithi071.stderr: 5: main() 2024-09-14T11:31:37.346 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9d5631dd90] 2024-09-14T11:31:37.346 INFO:tasks.workunit.client.0.smithi071.stderr: 7: __libc_start_main() 2024-09-14T11:31:37.347 INFO:tasks.workunit.client.0.smithi071.stderr: 8: _start() 2024-09-14T11:31:37.347 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.347 INFO:tasks.workunit.client.0.smithi071.stderr: 0> 2024-09-14T11:31:37.230+0000 7f9d53bdd9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:31:37.347 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f9d53bdd9c0 thread_name:radosgw-admin 2024-09-14T11:31:37.347 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.347 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:37.347 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f9d56336520] 2024-09-14T11:31:37.347 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:31:37.347 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:31:37.347 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:31:37.347 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f9d574b7345] 2024-09-14T11:31:37.347 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9d574b749f] 2024-09-14T11:31:37.347 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5575e602fc01] 2024-09-14T11:31:37.347 INFO:tasks.workunit.client.0.smithi071.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x5575e60451a7] 2024-09-14T11:31:37.347 INFO:tasks.workunit.client.0.smithi071.stderr: 9: main() 2024-09-14T11:31:37.348 INFO:tasks.workunit.client.0.smithi071.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9d5631dd90] 2024-09-14T11:31:37.348 INFO:tasks.workunit.client.0.smithi071.stderr: 11: __libc_start_main() 2024-09-14T11:31:37.348 INFO:tasks.workunit.client.0.smithi071.stderr: 12: _start() 2024-09-14T11:31:37.348 INFO:tasks.workunit.client.0.smithi071.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:31:37.348 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.348 INFO:tasks.workunit.client.0.smithi071.stderr:--- logging levels --- 2024-09-14T11:31:37.348 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 none 2024-09-14T11:31:37.348 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 lockdep 2024-09-14T11:31:37.348 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 context 2024-09-14T11:31:37.348 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 crush 2024-09-14T11:31:37.348 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds 2024-09-14T11:31:37.348 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_balancer 2024-09-14T11:31:37.348 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_locker 2024-09-14T11:31:37.348 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log 2024-09-14T11:31:37.348 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log_expire 2024-09-14T11:31:37.349 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_migrator 2024-09-14T11:31:37.349 INFO:tasks.workunit.client.0.smithi071.stderr: 3/ 5 mds_quiesce 2024-09-14T11:31:37.349 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 buffer 2024-09-14T11:31:37.349 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 timer 2024-09-14T11:31:37.349 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 filer 2024-09-14T11:31:37.349 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 striper 2024-09-14T11:31:37.349 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 objecter 2024-09-14T11:31:37.349 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rados 2024-09-14T11:31:37.349 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd 2024-09-14T11:31:37.349 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_mirror 2024-09-14T11:31:37.349 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_replay 2024-09-14T11:31:37.349 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_pwl 2024-09-14T11:31:37.349 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 journaler 2024-09-14T11:31:37.349 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objectcacher 2024-09-14T11:31:37.349 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:31:37.349 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 client 2024-09-14T11:31:37.350 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 osd 2024-09-14T11:31:37.350 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 optracker 2024-09-14T11:31:37.350 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objclass 2024-09-14T11:31:37.350 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 filestore 2024-09-14T11:31:37.350 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 journal 2024-09-14T11:31:37.350 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 ms 2024-09-14T11:31:37.350 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mon 2024-09-14T11:31:37.350 INFO:tasks.workunit.client.0.smithi071.stderr: 0/10 monc 2024-09-14T11:31:37.350 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 paxos 2024-09-14T11:31:37.350 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 tp 2024-09-14T11:31:37.350 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 auth 2024-09-14T11:31:37.350 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 crypto 2024-09-14T11:31:37.350 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 finisher 2024-09-14T11:31:37.350 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 reserver 2024-09-14T11:31:37.350 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 heartbeatmap 2024-09-14T11:31:37.351 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 perfcounter 2024-09-14T11:31:37.351 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw 2024-09-14T11:31:37.351 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_sync 2024-09-14T11:31:37.351 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_datacache 2024-09-14T11:31:37.351 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_access 2024-09-14T11:31:37.351 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:31:37.351 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_flight 2024-09-14T11:31:37.351 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:31:37.351 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw_notification 2024-09-14T11:31:37.351 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 javaclient 2024-09-14T11:31:37.351 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 asok 2024-09-14T11:31:37.351 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 throttle 2024-09-14T11:31:37.351 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 refs 2024-09-14T11:31:37.351 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 compressor 2024-09-14T11:31:37.351 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluestore 2024-09-14T11:31:37.351 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluefs 2024-09-14T11:31:37.352 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 bdev 2024-09-14T11:31:37.352 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 kstore 2024-09-14T11:31:37.352 INFO:tasks.workunit.client.0.smithi071.stderr: 4/ 5 rocksdb 2024-09-14T11:31:37.352 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 fuse 2024-09-14T11:31:37.352 INFO:tasks.workunit.client.0.smithi071.stderr: 2/ 5 mgr 2024-09-14T11:31:37.352 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mgrc 2024-09-14T11:31:37.352 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 dpdk 2024-09-14T11:31:37.352 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 eventtrace 2024-09-14T11:31:37.352 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 prioritycache 2024-09-14T11:31:37.352 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 test 2024-09-14T11:31:37.352 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:31:37.352 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephsqlite 2024-09-14T11:31:37.352 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:31:37.352 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore 2024-09-14T11:31:37.352 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_onode 2024-09-14T11:31:37.353 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_odata 2024-09-14T11:31:37.353 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_omap 2024-09-14T11:31:37.353 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_tm 2024-09-14T11:31:37.353 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_t 2024-09-14T11:31:37.353 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:31:37.353 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_epm 2024-09-14T11:31:37.353 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_lba 2024-09-14T11:31:37.353 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:31:37.353 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cache 2024-09-14T11:31:37.353 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_journal 2024-09-14T11:31:37.353 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_device 2024-09-14T11:31:37.353 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_backref 2024-09-14T11:31:37.353 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 alienstore 2024-09-14T11:31:37.353 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mclock 2024-09-14T11:31:37.353 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cyanstore 2024-09-14T11:31:37.353 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 ceph_exporter 2024-09-14T11:31:37.354 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 memstore 2024-09-14T11:31:37.354 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 trace 2024-09-14T11:31:37.354 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 ceph_dedup 2024-09-14T11:31:37.354 INFO:tasks.workunit.client.0.smithi071.stderr: -2/-2 (syslog threshold) 2024-09-14T11:31:37.354 INFO:tasks.workunit.client.0.smithi071.stderr: 99/99 (stderr threshold) 2024-09-14T11:31:37.354 INFO:tasks.workunit.client.0.smithi071.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:31:37.354 INFO:tasks.workunit.client.0.smithi071.stderr: 7f9b77fff640 / http_manager 2024-09-14T11:31:37.354 INFO:tasks.workunit.client.0.smithi071.stderr: 7f9c067e4640 / http_manager 2024-09-14T11:31:37.354 INFO:tasks.workunit.client.0.smithi071.stderr: 7f9c077e6640 / rgw_dt_lg_renew 2024-09-14T11:31:37.354 INFO:tasks.workunit.client.0.smithi071.stderr: 7f9c22ffd640 / ms_dispatch 2024-09-14T11:31:37.354 INFO:tasks.workunit.client.0.smithi071.stderr: 7f9c34ff9640 / io_context_pool 2024-09-14T11:31:37.354 INFO:tasks.workunit.client.0.smithi071.stderr: 7f9c36ffd640 / ms_dispatch 2024-09-14T11:31:37.354 INFO:tasks.workunit.client.0.smithi071.stderr: 7f9c3de03640 / ms_dispatch 2024-09-14T11:31:37.354 INFO:tasks.workunit.client.0.smithi071.stderr: 7f9c3f606640 / io_context_pool 2024-09-14T11:31:37.354 INFO:tasks.workunit.client.0.smithi071.stderr: 7f9d50ee2640 / msgr-worker-2 2024-09-14T11:31:37.355 INFO:tasks.workunit.client.0.smithi071.stderr: 7f9d516e3640 / msgr-worker-1 2024-09-14T11:31:37.355 INFO:tasks.workunit.client.0.smithi071.stderr: 7f9d51ee4640 / msgr-worker-0 2024-09-14T11:31:37.355 INFO:tasks.workunit.client.0.smithi071.stderr: 7f9d526e5640 / io_context_pool 2024-09-14T11:31:37.355 INFO:tasks.workunit.client.0.smithi071.stderr: 7f9d53bdd9c0 / radosgw-admin 2024-09-14T11:31:37.355 INFO:tasks.workunit.client.0.smithi071.stderr: max_recent 500 2024-09-14T11:31:37.355 INFO:tasks.workunit.client.0.smithi071.stderr: max_new 1000 2024-09-14T11:31:37.355 INFO:tasks.workunit.client.0.smithi071.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:31:37.238279Z_e2ee905d-9027-4cd2-aa69-0038fecaa504/log 2024-09-14T11:31:37.355 INFO:tasks.workunit.client.0.smithi071.stderr:--- end dump of recent events --- 2024-09-14T11:31:37.355 INFO:tasks.workunit.client.0.smithi071.stderr:Aborted 2024-09-14T11:31:37.355 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:31:37.356 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:37.356 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:37.356 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.314+0000 7fbac713f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.357 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.318+0000 7fbac713f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.357 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.318+0000 7fbac713f9c0 20 realm 2024-09-14T11:31:37.357 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.318+0000 7fbac713f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.357 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.318+0000 7fbac713f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.357 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.318+0000 7fbac713f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:37.357 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.318+0000 7fbac713f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.357 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.318+0000 7fbac713f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.357 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.318+0000 7fbac713f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.357 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.318+0000 7fbac713f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:37.357 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.318+0000 7fbac713f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.357 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.318+0000 7fbac713f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:37.357 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.318+0000 7fbac713f9c0 20 searching for the correct realm 2024-09-14T11:31:37.357 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.322+0000 7fbac5446640 0 -- 172.21.15.71:0/1014151356 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fbab00dc020 msgr2=0x7fbab010c6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:31:37.537 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.538+0000 7fbac5446640 0 -- 172.21.15.71:0/1014151356 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55ec5cbca8e0 msgr2=0x55ec5cbcccd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:37.550 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.550+0000 7fbac713f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:37.551 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.550+0000 7fbac713f9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:31:37.551 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.550+0000 7fbac713f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:37.551 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.550+0000 7fbac713f9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:31:37.551 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.550+0000 7fbac713f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:37.551 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.550+0000 7fbac713f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:37.551 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.550+0000 7fbac713f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.551 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.550+0000 7fbac713f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.551 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.550+0000 7fbac713f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.552 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.550+0000 7fbac713f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:37.552 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.550+0000 7fbac713f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.553 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.554+0000 7fbac713f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:37.553 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.554+0000 7fbac713f9c0 20 zone default found 2024-09-14T11:31:37.553 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.554+0000 7fbac713f9c0 4 Realm: () 2024-09-14T11:31:37.553 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.554+0000 7fbac713f9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:31:37.554 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.554+0000 7fbac713f9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:31:37.554 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.554+0000 7fbac713f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:37.554 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.554+0000 7fbac713f9c0 20 zonegroup default 2024-09-14T11:31:37.554 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.554+0000 7fbac713f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.554 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.554+0000 7fbac713f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.554 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.554+0000 7fbac713f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.554+0000 7fbac713f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.554+0000 7fbac713f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.556 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.554+0000 7fbac713f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.556 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.554+0000 7fbac713f9c0 20 started sync module instance, tier type = 2024-09-14T11:31:37.556 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.554+0000 7fbac713f9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:31:37.579 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.578+0000 7fbac713f9c0 20 add_watcher() i=0 2024-09-14T11:31:37.579 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.578+0000 7fbac713f9c0 20 add_watcher() i=1 2024-09-14T11:31:37.579 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.578+0000 7fbac713f9c0 20 add_watcher() i=2 2024-09-14T11:31:37.580 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.578+0000 7fbac713f9c0 20 add_watcher() i=3 2024-09-14T11:31:37.580 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.578+0000 7fbac713f9c0 20 add_watcher() i=4 2024-09-14T11:31:37.580 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.578+0000 7fbac713f9c0 20 add_watcher() i=5 2024-09-14T11:31:37.580 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.578+0000 7fbac713f9c0 20 add_watcher() i=6 2024-09-14T11:31:37.582 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.582+0000 7fbac713f9c0 20 add_watcher() i=7 2024-09-14T11:31:37.582 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.582+0000 7fbac713f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:37.587 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.586+0000 7fb97afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:37.588 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.586+0000 7fbac713f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:37.588 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.586+0000 7fbac713f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:37.588 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.586+0000 7fbac713f9c0 5 note: GC not initialized 2024-09-14T11:31:37.589 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.586+0000 7fb979fe3640 20 reqs_thread_entry: start 2024-09-14T11:31:37.589 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.590+0000 7fbac713f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:31:37.589 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.590+0000 7fbac713f9c0 20 Filter name: none 2024-09-14T11:31:37.589 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.590+0000 7fb8eb7fe640 20 reqs_thread_entry: start 2024-09-14T11:31:37.589 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.590+0000 7fbac713f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.590 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.590+0000 7fbac713f9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:37.590 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.590+0000 7fbac713f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.591 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.590+0000 7fbac713f9c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:31:37.591 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.590+0000 7fbac713f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:37.591 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.590+0000 7fbac713f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.592 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.590+0000 7fbac713f9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:37.592 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.590+0000 7fbac713f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.593 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.594+0000 7fbac713f9c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:31:37.593 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.594+0000 7fbac713f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:37.596 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.594+0000 7fb97afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:37.601 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.602+0000 7fbac713f9c0 20 remove_watcher() i=0 2024-09-14T11:31:37.601 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.602+0000 7fbac713f9c0 2 removed watcher, disabling cache 2024-09-14T11:31:37.603 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.602+0000 7fbac713f9c0 20 remove_watcher() i=1 2024-09-14T11:31:37.605 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.606+0000 7fbac713f9c0 20 remove_watcher() i=2 2024-09-14T11:31:37.607 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.606+0000 7fbac713f9c0 20 remove_watcher() i=3 2024-09-14T11:31:37.609 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.610+0000 7fbac713f9c0 20 remove_watcher() i=4 2024-09-14T11:31:37.611 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.610+0000 7fbac713f9c0 20 remove_watcher() i=5 2024-09-14T11:31:37.614 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.614+0000 7fbac713f9c0 20 remove_watcher() i=6 2024-09-14T11:31:37.616 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:31:37.614+0000 7fbac713f9c0 20 remove_watcher() i=7 2024-09-14T11:31:37.633 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:31:37.633 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:31:37.633 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: abort-at-commit-target-layout id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:31:37.633 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:07.759 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:32:07.795 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:07.795 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:07.840 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:07.838+0000 7f13ad6f09c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:07.842 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:07.842+0000 7f13ad6f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:07.842 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:07.842+0000 7f13ad6f09c0 20 realm 2024-09-14T11:32:07.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:07.842+0000 7f13ad6f09c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:07.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:07.842+0000 7f13ad6f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:07.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:07.842+0000 7f13ad6f09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:07.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:07.842+0000 7f13ad6f09c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:07.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:07.842+0000 7f13ad6f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:07.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:07.842+0000 7f13ad6f09c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:07.844 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:07.842+0000 7f13ad6f09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:07.844 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:07.842+0000 7f13ad6f09c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:07.845 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:07.846+0000 7f13ad6f09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:07.845 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:07.846+0000 7f13ad6f09c0 20 searching for the correct realm 2024-09-14T11:32:07.849 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:07.850+0000 7f13ab9f7640 0 -- 172.21.15.71:0/3139813381 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f1394044070 msgr2=0x7f13940736e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:08.065 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.066+0000 7f13ab9f7640 0 -- 172.21.15.71:0/3139813381 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55a66a6f3b30 msgr2=0x55a66a6f5f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:08.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.078+0000 7f13ad6f09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:08.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.078+0000 7f13ad6f09c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:32:08.080 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.078+0000 7f13ad6f09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:08.080 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.078+0000 7f13ad6f09c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:32:08.080 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.078+0000 7f13ad6f09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:08.080 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.078+0000 7f13ad6f09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:08.080 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.078+0000 7f13ad6f09c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.080 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.078+0000 7f13ad6f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:08.080 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.078+0000 7f13ad6f09c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.081 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.082+0000 7f13ad6f09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:08.081 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.082+0000 7f13ad6f09c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.082 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.082+0000 7f13ad6f09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:08.082 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.082+0000 7f13ad6f09c0 20 zone default found 2024-09-14T11:32:08.082 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.082+0000 7f13ad6f09c0 4 Realm: () 2024-09-14T11:32:08.082 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.082+0000 7f13ad6f09c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:32:08.082 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.082+0000 7f13ad6f09c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:32:08.082 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.082+0000 7f13ad6f09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:08.082 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.082+0000 7f13ad6f09c0 20 zonegroup default 2024-09-14T11:32:08.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.082+0000 7f13ad6f09c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.084 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.082+0000 7f13ad6f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:08.084 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.082+0000 7f13ad6f09c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.084 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.082+0000 7f13ad6f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:08.084 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.082+0000 7f13ad6f09c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.085 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.082+0000 7f13ad6f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:08.085 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.082+0000 7f13ad6f09c0 20 started sync module instance, tier type = 2024-09-14T11:32:08.085 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.082+0000 7f13ad6f09c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:32:08.107 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.106+0000 7f13ad6f09c0 20 add_watcher() i=0 2024-09-14T11:32:08.107 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.106+0000 7f13ad6f09c0 20 add_watcher() i=1 2024-09-14T11:32:08.107 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.106+0000 7f13ad6f09c0 20 add_watcher() i=2 2024-09-14T11:32:08.107 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.106+0000 7f13ad6f09c0 20 add_watcher() i=3 2024-09-14T11:32:08.107 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.106+0000 7f13ad6f09c0 20 add_watcher() i=4 2024-09-14T11:32:08.108 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.106+0000 7f13ad6f09c0 20 add_watcher() i=5 2024-09-14T11:32:08.108 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.106+0000 7f13ad6f09c0 20 add_watcher() i=6 2024-09-14T11:32:08.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.110+0000 7f13ad6f09c0 20 add_watcher() i=7 2024-09-14T11:32:08.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.110+0000 7f13ad6f09c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:08.114 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.114+0000 7f1261fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:08.115 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.114+0000 7f13ad6f09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:08.115 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.114+0000 7f13ad6f09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:08.115 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.114+0000 7f13ad6f09c0 5 note: GC not initialized 2024-09-14T11:32:08.116 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.114+0000 7f1260fe1640 20 reqs_thread_entry: start 2024-09-14T11:32:08.116 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.114+0000 7f13ad6f09c0 20 init_complete bucket index max shards: 11 2024-09-14T11:32:08.117 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.114+0000 7f13ad6f09c0 20 Filter name: none 2024-09-14T11:32:08.117 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.118+0000 7f11da7fc640 20 reqs_thread_entry: start 2024-09-14T11:32:08.117 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.118+0000 7f13ad6f09c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:32:08.117 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.118+0000 7f13ad6f09c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.118 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.118+0000 7f13ad6f09c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:32:08.118 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.118+0000 7f13ad6f09c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:32:08.118 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.118+0000 7f13ad6f09c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:32:08.118 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.118+0000 7f13ad6f09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 : miss 2024-09-14T11:32:08.118 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.118+0000 7f13ad6f09c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.119 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.118+0000 7f13ad6f09c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:32:08.119 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.118+0000 7f13ad6f09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 info.flags=0x17 2024-09-14T11:32:08.119 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.118+0000 7f13ad6f09c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 to cache LRU end 2024-09-14T11:32:08.119 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.118+0000 7f13ad6f09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:08.119 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.118+0000 7f13ad6f09c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:08.119 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.118+0000 7f13ad6f09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 2024-09-14T11:32:08.130 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.130+0000 7f13ad6f09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 info.flags=0x17 2024-09-14T11:32:08.130 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.130+0000 7f13ad6f09c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 to cache LRU end 2024-09-14T11:32:08.130 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.130+0000 7f13ad6f09c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:08.130 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.130+0000 7f13ad6f09c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33, ofs0, ns] 2024-09-14T11:32:08.130 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.130+0000 7f128e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464387 cookie 94173238644432 notifier 7326 bl.length()=1015 2024-09-14T11:32:08.131 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.130+0000 7f128e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 info.flags=0x17 2024-09-14T11:32:08.131 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.130+0000 7f128e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 to cache LRU end 2024-09-14T11:32:08.131 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.130+0000 7f128e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:08.131 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.130+0000 7f13ad6f09c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.33]): orig_sources= new_sources= 2024-09-14T11:32:08.131 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.130+0000 7f13ad6f09c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.33]): potential sources added=[] removed=[] 2024-09-14T11:32:08.131 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.130+0000 7f13ad6f09c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.33]): orig_dests= new_dests= 2024-09-14T11:32:08.131 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.130+0000 7f13ad6f09c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.33]): potential dests added=[] removed=[] 2024-09-14T11:32:08.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.142+0000 7f13ad6f09c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.0 2024-09-14T11:32:08.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.142+0000 7f13ad6f09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.0 2024-09-14T11:32:08.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.142+0000 7f13ad6f09c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.1 2024-09-14T11:32:08.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.142+0000 7f13ad6f09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.1 2024-09-14T11:32:08.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.142+0000 7f13ad6f09c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.2 2024-09-14T11:32:08.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.142+0000 7f13ad6f09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.2 2024-09-14T11:32:08.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.142+0000 7f13ad6f09c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.3 2024-09-14T11:32:08.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.142+0000 7f13ad6f09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.3 2024-09-14T11:32:08.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.142+0000 7f13ad6f09c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.4 2024-09-14T11:32:08.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.142+0000 7f13ad6f09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.4 2024-09-14T11:32:08.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.142+0000 7f13ad6f09c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.5 2024-09-14T11:32:08.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.142+0000 7f13ad6f09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.5 2024-09-14T11:32:08.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.142+0000 7f13ad6f09c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.6 2024-09-14T11:32:08.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.142+0000 7f13ad6f09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.6 2024-09-14T11:32:08.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.142+0000 7f13ad6f09c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.7 2024-09-14T11:32:08.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.142+0000 7f13ad6f09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.7 2024-09-14T11:32:08.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.142+0000 7f13ad6f09c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.8 2024-09-14T11:32:08.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.142+0000 7f13ad6f09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.8 2024-09-14T11:32:08.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.142+0000 7f13ad6f09c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.9 2024-09-14T11:32:08.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.142+0000 7f13ad6f09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.9 2024-09-14T11:32:08.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.142+0000 7f13ad6f09c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.10 2024-09-14T11:32:08.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.142+0000 7f13ad6f09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.10 2024-09-14T11:32:08.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.142+0000 7f13ad6f09c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.11 2024-09-14T11:32:08.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.142+0000 7f13ad6f09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1.11 2024-09-14T11:32:08.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.142+0000 7f13ad6f09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.0 2024-09-14T11:32:08.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.142+0000 7f13ad6f09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1 2024-09-14T11:32:08.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.142+0000 7f13ad6f09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.2 2024-09-14T11:32:08.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.146+0000 7f13ad6f09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.3 2024-09-14T11:32:08.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.146+0000 7f13ad6f09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.4 2024-09-14T11:32:08.147 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.146+0000 7f13ad6f09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.5 2024-09-14T11:32:08.148 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.146+0000 7f13ad6f09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.6 2024-09-14T11:32:08.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.150+0000 7f13ad6f09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.7 2024-09-14T11:32:08.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.150+0000 7f13ad6f09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.8 2024-09-14T11:32:08.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.150+0000 7f13ad6f09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.9 2024-09-14T11:32:08.152 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.150+0000 7f13ad6f09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.10 2024-09-14T11:32:08.160 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.162+0000 7f13ad6f09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:08.161 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.162+0000 7f13ad6f09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 2024-09-14T11:32:08.162 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.162+0000 7f13ad6f09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 info.flags=0x17 2024-09-14T11:32:08.162 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.162+0000 7f13ad6f09c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 to cache LRU end 2024-09-14T11:32:08.162 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.162+0000 7f13ad6f09c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:08.163 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.162+0000 7f13ad6f09c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33, ofs0, ns] 2024-09-14T11:32:08.163 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.162+0000 7f128e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464388 cookie 94173238644432 notifier 7326 bl.length()=1015 2024-09-14T11:32:08.163 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.162+0000 7f128e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 info.flags=0x17 2024-09-14T11:32:08.164 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.162+0000 7f128e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 to cache LRU end 2024-09-14T11:32:08.164 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.162+0000 7f128e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:08.164 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.162+0000 7f13ad6f09c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.33]): orig_sources= new_sources= 2024-09-14T11:32:08.164 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.162+0000 7f13ad6f09c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.33]): potential sources added=[] removed=[] 2024-09-14T11:32:08.164 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.162+0000 7f13ad6f09c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.33]): orig_dests= new_dests= 2024-09-14T11:32:08.164 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.162+0000 7f13ad6f09c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.33]): potential dests added=[] removed=[] 2024-09-14T11:32:08.169 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.170+0000 7f13ad6f09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.0 2024-09-14T11:32:08.170 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.170+0000 7f13ad6f09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.1 2024-09-14T11:32:08.170 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.170+0000 7f13ad6f09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.2 2024-09-14T11:32:08.171 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.170+0000 7f13ad6f09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.3 2024-09-14T11:32:08.171 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.170+0000 7f13ad6f09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.4 2024-09-14T11:32:08.173 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.174+0000 7f13ad6f09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.5 2024-09-14T11:32:08.173 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.174+0000 7f13ad6f09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.6 2024-09-14T11:32:08.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.174+0000 7f13ad6f09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.7 2024-09-14T11:32:08.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.174+0000 7f13ad6f09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.8 2024-09-14T11:32:08.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.174+0000 7f13ad6f09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.9 2024-09-14T11:32:08.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.178+0000 7f13ad6f09c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.33.10 2024-09-14T11:32:08.178 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.178+0000 7f13ad6f09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:08.178 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.178+0000 7f13ad6f09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 2024-09-14T11:32:08.180 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.178+0000 7f13ad6f09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 info.flags=0x17 2024-09-14T11:32:08.180 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.178+0000 7f13ad6f09c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 to cache LRU end 2024-09-14T11:32:08.180 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.178+0000 7f13ad6f09c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:08.180 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.178+0000 7f13ad6f09c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33, ofs0, ns] 2024-09-14T11:32:08.181 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.178+0000 7f128effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464389 cookie 94173238644432 notifier 7326 bl.length()=983 2024-09-14T11:32:08.181 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.178+0000 7f128effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 info.flags=0x17 2024-09-14T11:32:08.181 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.178+0000 7f128effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:4444f441-0c56-48df-a905-d49e7e44d629.4596.33 to cache LRU end 2024-09-14T11:32:08.181 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.178+0000 7f128effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:08.181 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.182+0000 7f13ad6f09c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.33]): orig_sources= new_sources= 2024-09-14T11:32:08.181 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.182+0000 7f13ad6f09c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.33]): potential sources added=[] removed=[] 2024-09-14T11:32:08.181 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.182+0000 7f13ad6f09c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.33]): orig_dests= new_dests= 2024-09-14T11:32:08.182 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.182+0000 7f13ad6f09c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[4444f441-0c56-48df-a905-d49e7e44d629.4596.33]): potential dests added=[] removed=[] 2024-09-14T11:32:08.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.186+0000 7f13ad6f09c0 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:32:08.191 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.190+0000 7f1261fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:08.195 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.194+0000 7f13ad6f09c0 20 remove_watcher() i=0 2024-09-14T11:32:08.196 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.194+0000 7f13ad6f09c0 2 removed watcher, disabling cache 2024-09-14T11:32:08.198 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.198+0000 7f13ad6f09c0 20 remove_watcher() i=1 2024-09-14T11:32:08.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.198+0000 7f13ad6f09c0 20 remove_watcher() i=2 2024-09-14T11:32:08.202 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.202+0000 7f13ad6f09c0 20 remove_watcher() i=3 2024-09-14T11:32:08.204 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.202+0000 7f13ad6f09c0 20 remove_watcher() i=4 2024-09-14T11:32:08.206 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.206+0000 7f13ad6f09c0 20 remove_watcher() i=5 2024-09-14T11:32:08.209 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.210+0000 7f13ad6f09c0 20 remove_watcher() i=6 2024-09-14T11:32:08.211 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.210+0000 7f13ad6f09c0 20 remove_watcher() i=7 2024-09-14T11:32:08.229 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:32:08.261 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:08.261 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:08.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.306+0000 7fed9e91e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.309 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.310+0000 7fed9e91e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:08.309 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.310+0000 7fed9e91e9c0 20 realm 2024-09-14T11:32:08.309 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.310+0000 7fed9e91e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.309 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.310+0000 7fed9e91e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:08.310 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.310+0000 7fed9e91e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:08.310 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.310+0000 7fed9e91e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.310 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.310+0000 7fed9e91e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:08.310 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.310+0000 7fed9e91e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.310 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.310+0000 7fed9e91e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:08.310 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.310+0000 7fed9e91e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.311 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.310+0000 7fed9e91e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:08.311 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.310+0000 7fed9e91e9c0 20 searching for the correct realm 2024-09-14T11:32:08.315 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.314+0000 7fed9cc25640 0 -- 172.21.15.71:0/1317902945 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fed84008050 msgr2=0x7fed84069b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:08.529 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.530+0000 7fed9cc25640 0 -- 172.21.15.71:0/1317902945 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55f186ad5830 msgr2=0x55f186ad7c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:08.543 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.542+0000 7fed9e91e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:08.543 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.542+0000 7fed9e91e9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:32:08.543 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.542+0000 7fed9e91e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:08.544 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.542+0000 7fed9e91e9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:32:08.544 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.542+0000 7fed9e91e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:08.544 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.542+0000 7fed9e91e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:08.544 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.542+0000 7fed9e91e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.544 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.542+0000 7fed9e91e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:08.544 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.542+0000 7fed9e91e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.545 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.546+0000 7fed9e91e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:08.545 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.546+0000 7fed9e91e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.546 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.546+0000 7fed9e91e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:08.546 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.546+0000 7fed9e91e9c0 20 zone default found 2024-09-14T11:32:08.546 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.546+0000 7fed9e91e9c0 4 Realm: () 2024-09-14T11:32:08.546 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.546+0000 7fed9e91e9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:32:08.546 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.546+0000 7fed9e91e9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:32:08.546 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.546+0000 7fed9e91e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:08.546 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.546+0000 7fed9e91e9c0 20 zonegroup default 2024-09-14T11:32:08.546 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.546+0000 7fed9e91e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.547 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.546+0000 7fed9e91e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:08.547 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.546+0000 7fed9e91e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.547 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.546+0000 7fed9e91e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:08.547 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.546+0000 7fed9e91e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.548 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.546+0000 7fed9e91e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:08.548 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.546+0000 7fed9e91e9c0 20 started sync module instance, tier type = 2024-09-14T11:32:08.548 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.546+0000 7fed9e91e9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:32:08.570 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.570+0000 7fed9e91e9c0 20 add_watcher() i=0 2024-09-14T11:32:08.570 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.570+0000 7fed9e91e9c0 20 add_watcher() i=1 2024-09-14T11:32:08.570 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.570+0000 7fed9e91e9c0 20 add_watcher() i=2 2024-09-14T11:32:08.570 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.570+0000 7fed9e91e9c0 20 add_watcher() i=3 2024-09-14T11:32:08.570 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.570+0000 7fed9e91e9c0 20 add_watcher() i=4 2024-09-14T11:32:08.570 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.570+0000 7fed9e91e9c0 20 add_watcher() i=5 2024-09-14T11:32:08.570 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.570+0000 7fed9e91e9c0 20 add_watcher() i=6 2024-09-14T11:32:08.572 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.570+0000 7fed9e91e9c0 20 add_watcher() i=7 2024-09-14T11:32:08.572 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.570+0000 7fed9e91e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:08.576 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.574+0000 7fec537de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:08.577 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.574+0000 7fed9e91e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:08.577 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.574+0000 7fed9e91e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:08.577 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.578+0000 7fed9e91e9c0 5 note: GC not initialized 2024-09-14T11:32:08.578 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.578+0000 7fec527dc640 20 reqs_thread_entry: start 2024-09-14T11:32:08.578 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.578+0000 7fed9e91e9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:32:08.578 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.578+0000 7fed9e91e9c0 20 Filter name: none 2024-09-14T11:32:08.578 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.578+0000 7fec4b7fe640 20 reqs_thread_entry: start 2024-09-14T11:32:08.578 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.578+0000 7fed9e91e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.579 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.578+0000 7fed9e91e9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:32:08.579 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.578+0000 7fed9e91e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.580 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.578+0000 7fed9e91e9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:32:08.580 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.578+0000 7fed9e91e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:08.580 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.578+0000 7fed9e91e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.580 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.578+0000 7fed9e91e9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:32:08.581 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.578+0000 7fed9e91e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.581 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.582+0000 7fed9e91e9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:32:08.581 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.582+0000 7fed9e91e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:08.585 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.586+0000 7fec537de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:08.590 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.590+0000 7fed9e91e9c0 20 remove_watcher() i=0 2024-09-14T11:32:08.590 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.590+0000 7fed9e91e9c0 2 removed watcher, disabling cache 2024-09-14T11:32:08.592 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.590+0000 7fed9e91e9c0 20 remove_watcher() i=1 2024-09-14T11:32:08.594 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.594+0000 7fed9e91e9c0 20 remove_watcher() i=2 2024-09-14T11:32:08.596 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.594+0000 7fed9e91e9c0 20 remove_watcher() i=3 2024-09-14T11:32:08.598 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.598+0000 7fed9e91e9c0 20 remove_watcher() i=4 2024-09-14T11:32:08.601 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.602+0000 7fed9e91e9c0 20 remove_watcher() i=5 2024-09-14T11:32:08.604 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.602+0000 7fed9e91e9c0 20 remove_watcher() i=6 2024-09-14T11:32:08.606 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:08.606+0000 7fed9e91e9c0 20 remove_watcher() i=7 2024-09-14T11:32:08.630 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:08.630 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:32:08.630 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: abort-at-commit-target-layout id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.33 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:32:08.630 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:08.742 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-14T11:32:08.742 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:09.179 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:32:09.211 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:09.211 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:09.257 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.258+0000 7f5c9818d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.258+0000 7f5c9818d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:09.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.258+0000 7f5c9818d9c0 20 realm 2024-09-14T11:32:09.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.258+0000 7f5c9818d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.261 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.262+0000 7f5c9818d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:09.261 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.262+0000 7f5c9818d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:09.261 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.262+0000 7f5c9818d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.261 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.262+0000 7f5c9818d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:09.261 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.262+0000 7f5c9818d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.262 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.262+0000 7f5c9818d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:09.262 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.262+0000 7f5c9818d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.262 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.262+0000 7f5c9818d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:09.263 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.262+0000 7f5c9818d9c0 20 searching for the correct realm 2024-09-14T11:32:09.266 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.266+0000 7f5c96494640 0 -- 172.21.15.71:0/1238090433 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f5c88008050 msgr2=0x7f5c88047940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:09.479 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.478+0000 7f5c95492640 0 -- 172.21.15.71:0/1238090433 >> [v2:172.21.15.157:6800/3420822707,v1:172.21.15.157:6801/3420822707] conn(0x7f5c88055b50 msgr2=0x7f5c88053950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:09.697 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.698+0000 7f5c9818d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:09.697 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.698+0000 7f5c9818d9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:32:09.697 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.698+0000 7f5c9818d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:09.697 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.698+0000 7f5c9818d9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:32:09.697 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.698+0000 7f5c9818d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:09.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.698+0000 7f5c9818d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:09.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.698+0000 7f5c9818d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.698+0000 7f5c9818d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:09.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.698+0000 7f5c9818d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.698+0000 7f5c9818d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:09.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.698+0000 7f5c9818d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.698+0000 7f5c9818d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:09.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.698+0000 7f5c9818d9c0 20 zone default found 2024-09-14T11:32:09.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.698+0000 7f5c9818d9c0 4 Realm: () 2024-09-14T11:32:09.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.698+0000 7f5c9818d9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:32:09.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.698+0000 7f5c9818d9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:32:09.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.698+0000 7f5c9818d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:09.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.698+0000 7f5c9818d9c0 20 zonegroup default 2024-09-14T11:32:09.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.698+0000 7f5c9818d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.701 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.698+0000 7f5c9818d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:09.701 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.698+0000 7f5c9818d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.701 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.702+0000 7f5c9818d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:09.701 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.702+0000 7f5c9818d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.702+0000 7f5c9818d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:09.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.702+0000 7f5c9818d9c0 20 started sync module instance, tier type = 2024-09-14T11:32:09.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.702+0000 7f5c9818d9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:32:09.726 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.726+0000 7f5c9818d9c0 20 add_watcher() i=0 2024-09-14T11:32:09.726 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.726+0000 7f5c9818d9c0 20 add_watcher() i=1 2024-09-14T11:32:09.726 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.726+0000 7f5c9818d9c0 20 add_watcher() i=2 2024-09-14T11:32:09.726 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.726+0000 7f5c9818d9c0 20 add_watcher() i=3 2024-09-14T11:32:09.726 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.726+0000 7f5c9818d9c0 20 add_watcher() i=4 2024-09-14T11:32:09.726 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.726+0000 7f5c9818d9c0 20 add_watcher() i=5 2024-09-14T11:32:09.726 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.726+0000 7f5c9818d9c0 20 add_watcher() i=6 2024-09-14T11:32:09.728 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.726+0000 7f5c9818d9c0 20 add_watcher() i=7 2024-09-14T11:32:09.728 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.726+0000 7f5c9818d9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:09.733 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.730+0000 7f5b477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:09.733 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.734+0000 7f5c9818d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:09.734 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.734+0000 7f5c9818d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:09.734 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.734+0000 7f5c9818d9c0 5 note: GC not initialized 2024-09-14T11:32:09.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.734+0000 7f5b467fc640 20 reqs_thread_entry: start 2024-09-14T11:32:09.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.734+0000 7f5c9818d9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:32:09.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.734+0000 7f5c9818d9c0 20 Filter name: none 2024-09-14T11:32:09.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.734+0000 7f5ab7fff640 20 reqs_thread_entry: start 2024-09-14T11:32:09.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.734+0000 7f5c9818d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.734+0000 7f5c9818d9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:09.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.734+0000 7f5c9818d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.738+0000 7f5c9818d9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:09.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.738+0000 7f5c9818d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:09.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.738+0000 7f5c9818d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.738+0000 7f5c9818d9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:09.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.738+0000 7f5c9818d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.738+0000 7f5c9818d9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:09.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.738+0000 7f5c9818d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:09.741 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.742+0000 7f5b477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:09.746 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.746+0000 7f5c9818d9c0 20 remove_watcher() i=0 2024-09-14T11:32:09.746 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.746+0000 7f5c9818d9c0 2 removed watcher, disabling cache 2024-09-14T11:32:09.748 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.746+0000 7f5c9818d9c0 20 remove_watcher() i=1 2024-09-14T11:32:09.750 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.750+0000 7f5c9818d9c0 20 remove_watcher() i=2 2024-09-14T11:32:09.752 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.750+0000 7f5c9818d9c0 20 remove_watcher() i=3 2024-09-14T11:32:09.754 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.754+0000 7f5c9818d9c0 20 remove_watcher() i=4 2024-09-14T11:32:09.756 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.754+0000 7f5c9818d9c0 20 remove_watcher() i=5 2024-09-14T11:32:09.759 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.758+0000 7f5c9818d9c0 20 remove_watcher() i=6 2024-09-14T11:32:09.762 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.762+0000 7f5c9818d9c0 20 remove_watcher() i=7 2024-09-14T11:32:09.779 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:09.779 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:32:09.779 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: error-at-do-reshard id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:32:09.779 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:09.779 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-14T11:32:09.815 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:09.815 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:09.860 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.858+0000 7f69391869c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.862+0000 7f69391869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:09.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.862+0000 7f69391869c0 20 realm 2024-09-14T11:32:09.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.862+0000 7f69391869c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.862+0000 7f69391869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:09.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.862+0000 7f69391869c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:09.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.862+0000 7f69391869c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.862+0000 7f69391869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:09.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.862+0000 7f69391869c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.864 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.862+0000 7f69391869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:09.864 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.862+0000 7f69391869c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.864 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.862+0000 7f69391869c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:09.865 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.866+0000 7f69391869c0 20 searching for the correct realm 2024-09-14T11:32:09.867 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:09.866+0000 7f693648b640 0 -- 172.21.15.71:0/3008147141 >> [v2:172.21.15.71:6824/2436891866,v1:172.21.15.71:6825/2436891866] conn(0x7f6928029040 msgr2=0x7f6928019400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:10.078 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.078+0000 7f6936c8c640 0 -- 172.21.15.71:0/3008147141 >> [v2:172.21.15.157:6816/1231501119,v1:172.21.15.157:6817/1231501119] conn(0x557c0fdd6090 msgr2=0x557c0fdd8520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:10.094 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.094+0000 7f69391869c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:10.094 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.094+0000 7f69391869c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:32:10.094 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.094+0000 7f69391869c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:10.094 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.094+0000 7f69391869c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:32:10.094 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.094+0000 7f69391869c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:10.094 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.094+0000 7f69391869c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:10.094 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.094+0000 7f69391869c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.096 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.094+0000 7f69391869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.096 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.094+0000 7f69391869c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.097 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.098+0000 7f69391869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:10.097 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.098+0000 7f69391869c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.098 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.098+0000 7f69391869c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:10.098 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.098+0000 7f69391869c0 20 zone default found 2024-09-14T11:32:10.098 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.098+0000 7f69391869c0 4 Realm: () 2024-09-14T11:32:10.098 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.098+0000 7f69391869c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:32:10.098 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.098+0000 7f69391869c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:32:10.098 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.098+0000 7f69391869c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:10.098 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.098+0000 7f69391869c0 20 zonegroup default 2024-09-14T11:32:10.098 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.098+0000 7f69391869c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.098+0000 7f69391869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.098+0000 7f69391869c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.098+0000 7f69391869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.100 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.098+0000 7f69391869c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.100 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.098+0000 7f69391869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.100 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.098+0000 7f69391869c0 20 started sync module instance, tier type = 2024-09-14T11:32:10.100 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.098+0000 7f69391869c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:32:10.123 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.122+0000 7f69391869c0 20 add_watcher() i=0 2024-09-14T11:32:10.123 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.122+0000 7f69391869c0 20 add_watcher() i=1 2024-09-14T11:32:10.123 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.122+0000 7f69391869c0 20 add_watcher() i=2 2024-09-14T11:32:10.123 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.122+0000 7f69391869c0 20 add_watcher() i=3 2024-09-14T11:32:10.123 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.122+0000 7f69391869c0 20 add_watcher() i=4 2024-09-14T11:32:10.123 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.122+0000 7f69391869c0 20 add_watcher() i=5 2024-09-14T11:32:10.123 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.122+0000 7f69391869c0 20 add_watcher() i=6 2024-09-14T11:32:10.125 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.126+0000 7f69391869c0 20 add_watcher() i=7 2024-09-14T11:32:10.125 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.126+0000 7f69391869c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:10.129 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.130+0000 7f67ed7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:10.130 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.130+0000 7f69391869c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:10.130 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.130+0000 7f69391869c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:10.130 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.130+0000 7f69391869c0 5 note: GC not initialized 2024-09-14T11:32:10.131 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.130+0000 7f6767fff640 20 reqs_thread_entry: start 2024-09-14T11:32:10.131 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.130+0000 7f69391869c0 20 init_complete bucket index max shards: 11 2024-09-14T11:32:10.132 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.130+0000 7f69391869c0 20 Filter name: none 2024-09-14T11:32:10.132 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.130+0000 7f6765ffb640 20 reqs_thread_entry: start 2024-09-14T11:32:10.132 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.130+0000 7f69391869c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-14T11:32:10.132 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.130+0000 7f69391869c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.133 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.130+0000 7f69391869c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:10.133 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.130+0000 7f69391869c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-14T11:32:10.133 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.130+0000 7f69391869c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-14T11:32:10.133 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.134+0000 7f69391869c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34 : miss 2024-09-14T11:32:10.133 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.134+0000 7f69391869c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.134+0000 7f69391869c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:10.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.134+0000 7f69391869c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34 info.flags=0x17 2024-09-14T11:32:10.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.134+0000 7f69391869c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34 to cache LRU end 2024-09-14T11:32:10.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.134+0000 7f69391869c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:10.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.134+0000 7f69391869c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:10.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.134+0000 7f69391869c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34 2024-09-14T11:32:10.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.146+0000 7f69391869c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34 info.flags=0x17 2024-09-14T11:32:10.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.146+0000 7f69391869c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34 to cache LRU end 2024-09-14T11:32:10.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.146+0000 7f69391869c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:10.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.146+0000 7f69391869c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34, ofs0, ns] 2024-09-14T11:32:10.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.146+0000 7f681a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464393 cookie 93991330480080 notifier 7022 bl.length()=995 2024-09-14T11:32:10.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.146+0000 7f681a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34 info.flags=0x17 2024-09-14T11:32:10.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.146+0000 7f681a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34 to cache LRU end 2024-09-14T11:32:10.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.146+0000 7f681a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:10.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.146+0000 7f69391869c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.34]): orig_sources= new_sources= 2024-09-14T11:32:10.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.146+0000 7f69391869c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.34]): potential sources added=[] removed=[] 2024-09-14T11:32:10.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.146+0000 7f69391869c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.34]): orig_dests= new_dests= 2024-09-14T11:32:10.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.146+0000 7f69391869c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.34]): potential dests added=[] removed=[] 2024-09-14T11:32:10.156 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.154+0000 7f69391869c0 -1 Injecting error=-5 at location=do_reshard 2024-09-14T11:32:10.173 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.174+0000 7f69391869c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:10.173 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.174+0000 7f69391869c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34 2024-09-14T11:32:10.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.174+0000 7f69391869c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34 info.flags=0x17 2024-09-14T11:32:10.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.174+0000 7f69391869c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34 to cache LRU end 2024-09-14T11:32:10.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.174+0000 7f69391869c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:10.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.174+0000 7f69391869c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34, ofs0, ns] 2024-09-14T11:32:10.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.174+0000 7f681a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464394 cookie 93991330480080 notifier 7022 bl.length()=963 2024-09-14T11:32:10.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.174+0000 7f681a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34 info.flags=0x17 2024-09-14T11:32:10.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.174+0000 7f681a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34 to cache LRU end 2024-09-14T11:32:10.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.174+0000 7f681a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:10.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.174+0000 7f69391869c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.34]): orig_sources= new_sources= 2024-09-14T11:32:10.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.174+0000 7f69391869c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.34]): potential sources added=[] removed=[] 2024-09-14T11:32:10.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.174+0000 7f69391869c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.34]): orig_dests= new_dests= 2024-09-14T11:32:10.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.174+0000 7f69391869c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.34]): potential dests added=[] removed=[] 2024-09-14T11:32:10.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.174+0000 7f69391869c0 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-14T11:32:10.179 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.178+0000 7f67ed7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:10.183 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.182+0000 7f69391869c0 20 remove_watcher() i=0 2024-09-14T11:32:10.183 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.182+0000 7f69391869c0 2 removed watcher, disabling cache 2024-09-14T11:32:10.185 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.186+0000 7f69391869c0 20 remove_watcher() i=1 2024-09-14T11:32:10.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.186+0000 7f69391869c0 20 remove_watcher() i=2 2024-09-14T11:32:10.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.190+0000 7f69391869c0 20 remove_watcher() i=3 2024-09-14T11:32:10.191 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.190+0000 7f69391869c0 20 remove_watcher() i=4 2024-09-14T11:32:10.193 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.194+0000 7f69391869c0 20 remove_watcher() i=5 2024-09-14T11:32:10.196 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.194+0000 7f69391869c0 20 remove_watcher() i=6 2024-09-14T11:32:10.198 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.198+0000 7f69391869c0 20 remove_watcher() i=7 2024-09-14T11:32:10.215 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:32:10.245 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:10.245 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:10.291 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.290+0000 7fcc77e3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.294 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.294+0000 7fcc77e3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.294 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.294+0000 7fcc77e3b9c0 20 realm 2024-09-14T11:32:10.294 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.294+0000 7fcc77e3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.294 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.294+0000 7fcc77e3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.295 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.294+0000 7fcc77e3b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:10.295 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.294+0000 7fcc77e3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.295 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.294+0000 7fcc77e3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.295 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.294+0000 7fcc77e3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.296 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.294+0000 7fcc77e3b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:10.296 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.294+0000 7fcc77e3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.297 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.298+0000 7fcc77e3b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:10.297 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.298+0000 7fcc77e3b9c0 20 searching for the correct realm 2024-09-14T11:32:10.300 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.298+0000 7fcc76142640 0 -- 172.21.15.71:0/181054813 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fcc6c037070 msgr2=0x7fcc6c046920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:10.511 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.510+0000 7fcc76142640 0 -- 172.21.15.71:0/181054813 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x5574035445e0 msgr2=0x5574035469d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:10.528 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.526+0000 7fcc77e3b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:10.528 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.526+0000 7fcc77e3b9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:32:10.528 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.526+0000 7fcc77e3b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:10.528 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.526+0000 7fcc77e3b9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:32:10.528 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.526+0000 7fcc77e3b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:10.528 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.526+0000 7fcc77e3b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:10.528 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.526+0000 7fcc77e3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.529 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.526+0000 7fcc77e3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.529 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.526+0000 7fcc77e3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.529 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.530+0000 7fcc77e3b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:10.529 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.530+0000 7fcc77e3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.530 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.530+0000 7fcc77e3b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:10.530 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.530+0000 7fcc77e3b9c0 20 zone default found 2024-09-14T11:32:10.530 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.530+0000 7fcc77e3b9c0 4 Realm: () 2024-09-14T11:32:10.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.530+0000 7fcc77e3b9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:32:10.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.530+0000 7fcc77e3b9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:32:10.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.530+0000 7fcc77e3b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:10.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.530+0000 7fcc77e3b9c0 20 zonegroup default 2024-09-14T11:32:10.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.530+0000 7fcc77e3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.530+0000 7fcc77e3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.530+0000 7fcc77e3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.532 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.530+0000 7fcc77e3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.532 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.530+0000 7fcc77e3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.532 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.530+0000 7fcc77e3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.532 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.530+0000 7fcc77e3b9c0 20 started sync module instance, tier type = 2024-09-14T11:32:10.532 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.530+0000 7fcc77e3b9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:32:10.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.554+0000 7fcc77e3b9c0 20 add_watcher() i=0 2024-09-14T11:32:10.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.554+0000 7fcc77e3b9c0 20 add_watcher() i=1 2024-09-14T11:32:10.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.554+0000 7fcc77e3b9c0 20 add_watcher() i=2 2024-09-14T11:32:10.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.554+0000 7fcc77e3b9c0 20 add_watcher() i=3 2024-09-14T11:32:10.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.554+0000 7fcc77e3b9c0 20 add_watcher() i=4 2024-09-14T11:32:10.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.554+0000 7fcc77e3b9c0 20 add_watcher() i=5 2024-09-14T11:32:10.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.554+0000 7fcc77e3b9c0 20 add_watcher() i=6 2024-09-14T11:32:10.557 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.558+0000 7fcc77e3b9c0 20 add_watcher() i=7 2024-09-14T11:32:10.557 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.558+0000 7fcc77e3b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:10.562 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.566+0000 7fcb277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:10.563 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.566+0000 7fcc77e3b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:10.563 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.566+0000 7fcc77e3b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:10.563 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.566+0000 7fcc77e3b9c0 5 note: GC not initialized 2024-09-14T11:32:10.564 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.566+0000 7fcb267fc640 20 reqs_thread_entry: start 2024-09-14T11:32:10.564 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.566+0000 7fcc77e3b9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:32:10.564 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.566+0000 7fcc77e3b9c0 20 Filter name: none 2024-09-14T11:32:10.564 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.566+0000 7fca97fff640 20 reqs_thread_entry: start 2024-09-14T11:32:10.564 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.566+0000 7fcc77e3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.565 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.566+0000 7fcc77e3b9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:10.565 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.566+0000 7fcc77e3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.566 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.566+0000 7fcc77e3b9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:10.567 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.566+0000 7fcc77e3b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:10.567 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.566+0000 7fcc77e3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.567 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.566+0000 7fcc77e3b9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:10.568 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.566+0000 7fcc77e3b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.568 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.566+0000 7fcc77e3b9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:10.568 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.566+0000 7fcc77e3b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:10.571 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.570+0000 7fcb277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:10.576 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.574+0000 7fcc77e3b9c0 20 remove_watcher() i=0 2024-09-14T11:32:10.576 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.574+0000 7fcc77e3b9c0 2 removed watcher, disabling cache 2024-09-14T11:32:10.578 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.578+0000 7fcc77e3b9c0 20 remove_watcher() i=1 2024-09-14T11:32:10.580 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.578+0000 7fcc77e3b9c0 20 remove_watcher() i=2 2024-09-14T11:32:10.582 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.582+0000 7fcc77e3b9c0 20 remove_watcher() i=3 2024-09-14T11:32:10.584 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.582+0000 7fcc77e3b9c0 20 remove_watcher() i=4 2024-09-14T11:32:10.586 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.586+0000 7fcc77e3b9c0 20 remove_watcher() i=5 2024-09-14T11:32:10.589 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.590+0000 7fcc77e3b9c0 20 remove_watcher() i=6 2024-09-14T11:32:10.592 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.590+0000 7fcc77e3b9c0 20 remove_watcher() i=7 2024-09-14T11:32:10.609 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:10.609 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:32:10.609 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: error-at-do-reshard id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:32:10.609 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:10.666 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:32:10.702 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:10.702 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:10.748 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.746+0000 7fd40595e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.750 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.750+0000 7fd40595e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.751 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.750+0000 7fd40595e9c0 20 realm 2024-09-14T11:32:10.751 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.750+0000 7fd40595e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.751 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.750+0000 7fd40595e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.751 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.750+0000 7fd40595e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:10.751 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.750+0000 7fd40595e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.752 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.750+0000 7fd40595e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.752 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.750+0000 7fd40595e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.752 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.750+0000 7fd40595e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:10.752 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.750+0000 7fd40595e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.753 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.754+0000 7fd40595e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:10.753 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.754+0000 7fd40595e9c0 20 searching for the correct realm 2024-09-14T11:32:10.754 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.754+0000 7fd402c63640 0 -- 172.21.15.71:0/2531635236 >> [v2:172.21.15.71:6824/2436891866,v1:172.21.15.71:6825/2436891866] conn(0x7fd3f4073060 msgr2=0x7fd3f40173d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:10.966 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.966+0000 7fd403c65640 0 -- 172.21.15.71:0/2531635236 >> [v2:172.21.15.157:6816/1231501119,v1:172.21.15.157:6817/1231501119] conn(0x557acd9ce920 msgr2=0x557acd9d0da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:10.984 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.982+0000 7fd40595e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:10.984 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.982+0000 7fd40595e9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:32:10.984 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.982+0000 7fd40595e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:10.984 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.982+0000 7fd40595e9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:32:10.984 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.982+0000 7fd40595e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:10.984 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.982+0000 7fd40595e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:10.984 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.982+0000 7fd40595e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.985 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.982+0000 7fd40595e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.985 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.982+0000 7fd40595e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.985 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.986+0000 7fd40595e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:10.985 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.986+0000 7fd40595e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.986 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.986+0000 7fd40595e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:10.986 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.986+0000 7fd40595e9c0 20 zone default found 2024-09-14T11:32:10.986 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.986+0000 7fd40595e9c0 4 Realm: () 2024-09-14T11:32:10.986 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.986+0000 7fd40595e9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:32:10.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.986+0000 7fd40595e9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:32:10.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.986+0000 7fd40595e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:10.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.986+0000 7fd40595e9c0 20 zonegroup default 2024-09-14T11:32:10.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.986+0000 7fd40595e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.986+0000 7fd40595e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.986+0000 7fd40595e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.986+0000 7fd40595e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.986+0000 7fd40595e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.989 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.990+0000 7fd40595e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.989 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.990+0000 7fd40595e9c0 20 started sync module instance, tier type = 2024-09-14T11:32:10.989 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:10.990+0000 7fd40595e9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:32:11.013 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.010+0000 7fd40595e9c0 20 add_watcher() i=0 2024-09-14T11:32:11.013 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.010+0000 7fd40595e9c0 20 add_watcher() i=1 2024-09-14T11:32:11.013 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.010+0000 7fd40595e9c0 20 add_watcher() i=2 2024-09-14T11:32:11.013 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.010+0000 7fd40595e9c0 20 add_watcher() i=3 2024-09-14T11:32:11.013 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.010+0000 7fd40595e9c0 20 add_watcher() i=4 2024-09-14T11:32:11.013 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.010+0000 7fd40595e9c0 20 add_watcher() i=5 2024-09-14T11:32:11.014 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.010+0000 7fd40595e9c0 20 add_watcher() i=6 2024-09-14T11:32:11.015 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.014+0000 7fd40595e9c0 20 add_watcher() i=7 2024-09-14T11:32:11.015 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.014+0000 7fd40595e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:11.020 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.018+0000 7fd2b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:11.021 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.022+0000 7fd40595e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:11.021 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.022+0000 7fd40595e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:11.021 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.022+0000 7fd40595e9c0 5 note: GC not initialized 2024-09-14T11:32:11.022 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.022+0000 7fd2b8fe1640 20 reqs_thread_entry: start 2024-09-14T11:32:11.022 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.022+0000 7fd40595e9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:32:11.022 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.022+0000 7fd40595e9c0 20 Filter name: none 2024-09-14T11:32:11.022 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.022+0000 7fd2327fc640 20 reqs_thread_entry: start 2024-09-14T11:32:11.023 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.022+0000 7fd40595e9c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-14T11:32:11.023 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.022+0000 7fd40595e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.024 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.022+0000 7fd40595e9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:11.024 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.022+0000 7fd40595e9c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-14T11:32:11.024 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.022+0000 7fd40595e9c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-14T11:32:11.024 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.022+0000 7fd40595e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34 : miss 2024-09-14T11:32:11.024 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.022+0000 7fd40595e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.025 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.022+0000 7fd40595e9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:11.025 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.022+0000 7fd40595e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34 info.flags=0x17 2024-09-14T11:32:11.025 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.022+0000 7fd40595e9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34 to cache LRU end 2024-09-14T11:32:11.025 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.022+0000 7fd40595e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:11.025 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.022+0000 7fd40595e9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:11.025 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.022+0000 7fd40595e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34 2024-09-14T11:32:11.035 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.034+0000 7fd40595e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34 info.flags=0x17 2024-09-14T11:32:11.036 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.034+0000 7fd40595e9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34 to cache LRU end 2024-09-14T11:32:11.036 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.034+0000 7fd40595e9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:11.036 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.034+0000 7fd40595e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34, ofs0, ns] 2024-09-14T11:32:11.036 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.034+0000 7fd2e67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464395 cookie 93985924049216 notifier 7416 bl.length()=995 2024-09-14T11:32:11.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.034+0000 7fd2e67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34 info.flags=0x17 2024-09-14T11:32:11.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.034+0000 7fd2e67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34 to cache LRU end 2024-09-14T11:32:11.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.034+0000 7fd2e67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:11.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.038+0000 7fd40595e9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.34]): orig_sources= new_sources= 2024-09-14T11:32:11.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.038+0000 7fd40595e9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.34]): potential sources added=[] removed=[] 2024-09-14T11:32:11.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.038+0000 7fd40595e9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.34]): orig_dests= new_dests= 2024-09-14T11:32:11.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.038+0000 7fd40595e9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.34]): potential dests added=[] removed=[] 2024-09-14T11:32:11.048 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.046+0000 7fd40595e9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.1.0 2024-09-14T11:32:11.048 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.046+0000 7fd40595e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.1.0 2024-09-14T11:32:11.048 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.046+0000 7fd40595e9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.1.1 2024-09-14T11:32:11.048 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.046+0000 7fd40595e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.1.1 2024-09-14T11:32:11.048 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.046+0000 7fd40595e9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.1.2 2024-09-14T11:32:11.048 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.046+0000 7fd40595e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.1.2 2024-09-14T11:32:11.048 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.046+0000 7fd40595e9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.1.3 2024-09-14T11:32:11.048 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.046+0000 7fd40595e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.1.3 2024-09-14T11:32:11.049 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.046+0000 7fd40595e9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.1.4 2024-09-14T11:32:11.049 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.046+0000 7fd40595e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.1.4 2024-09-14T11:32:11.049 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.046+0000 7fd40595e9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.1.5 2024-09-14T11:32:11.049 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.046+0000 7fd40595e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.1.5 2024-09-14T11:32:11.049 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.046+0000 7fd40595e9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.1.6 2024-09-14T11:32:11.049 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.046+0000 7fd40595e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.1.6 2024-09-14T11:32:11.049 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.046+0000 7fd40595e9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.1.7 2024-09-14T11:32:11.049 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.046+0000 7fd40595e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.1.7 2024-09-14T11:32:11.049 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.046+0000 7fd40595e9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.1.8 2024-09-14T11:32:11.049 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.046+0000 7fd40595e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.1.8 2024-09-14T11:32:11.049 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.046+0000 7fd40595e9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.1.9 2024-09-14T11:32:11.049 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.046+0000 7fd40595e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.1.9 2024-09-14T11:32:11.049 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.046+0000 7fd40595e9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.1.10 2024-09-14T11:32:11.049 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.046+0000 7fd40595e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.1.10 2024-09-14T11:32:11.050 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.046+0000 7fd40595e9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.1.11 2024-09-14T11:32:11.050 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.046+0000 7fd40595e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.1.11 2024-09-14T11:32:11.050 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.046+0000 7fd40595e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.0 2024-09-14T11:32:11.050 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.050+0000 7fd40595e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.1 2024-09-14T11:32:11.050 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.050+0000 7fd40595e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.2 2024-09-14T11:32:11.051 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.050+0000 7fd40595e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.3 2024-09-14T11:32:11.051 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.050+0000 7fd40595e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.4 2024-09-14T11:32:11.053 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.054+0000 7fd40595e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.5 2024-09-14T11:32:11.054 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.054+0000 7fd40595e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.6 2024-09-14T11:32:11.054 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.054+0000 7fd40595e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.7 2024-09-14T11:32:11.056 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.054+0000 7fd40595e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.8 2024-09-14T11:32:11.057 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.058+0000 7fd40595e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.9 2024-09-14T11:32:11.058 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.058+0000 7fd40595e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.10 2024-09-14T11:32:11.069 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.070+0000 7fd40595e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:11.069 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.070+0000 7fd40595e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34 2024-09-14T11:32:11.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.070+0000 7fd40595e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34 info.flags=0x17 2024-09-14T11:32:11.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.070+0000 7fd40595e9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34 to cache LRU end 2024-09-14T11:32:11.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.070+0000 7fd40595e9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:11.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.070+0000 7fd40595e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34, ofs0, ns] 2024-09-14T11:32:11.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.070+0000 7fd2e67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464396 cookie 93985924049216 notifier 7416 bl.length()=995 2024-09-14T11:32:11.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.070+0000 7fd2e67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34 info.flags=0x17 2024-09-14T11:32:11.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.070+0000 7fd2e67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34 to cache LRU end 2024-09-14T11:32:11.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.070+0000 7fd2e67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:11.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.070+0000 7fd40595e9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.34]): orig_sources= new_sources= 2024-09-14T11:32:11.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.070+0000 7fd40595e9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.34]): potential sources added=[] removed=[] 2024-09-14T11:32:11.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.070+0000 7fd40595e9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.34]): orig_dests= new_dests= 2024-09-14T11:32:11.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.070+0000 7fd40595e9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.34]): potential dests added=[] removed=[] 2024-09-14T11:32:11.078 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.078+0000 7fd40595e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.0 2024-09-14T11:32:11.078 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.078+0000 7fd40595e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.1 2024-09-14T11:32:11.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.078+0000 7fd40595e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.2 2024-09-14T11:32:11.080 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.078+0000 7fd40595e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.3 2024-09-14T11:32:11.080 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.078+0000 7fd40595e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.4 2024-09-14T11:32:11.081 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.082+0000 7fd40595e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.5 2024-09-14T11:32:11.081 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.082+0000 7fd40595e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.6 2024-09-14T11:32:11.082 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.082+0000 7fd40595e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.7 2024-09-14T11:32:11.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.082+0000 7fd40595e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.8 2024-09-14T11:32:11.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.082+0000 7fd40595e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.9 2024-09-14T11:32:11.084 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.082+0000 7fd40595e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.34.10 2024-09-14T11:32:11.085 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.086+0000 7fd40595e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:11.085 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.086+0000 7fd40595e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34 2024-09-14T11:32:11.086 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.086+0000 7fd40595e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34 info.flags=0x17 2024-09-14T11:32:11.086 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.086+0000 7fd40595e9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34 to cache LRU end 2024-09-14T11:32:11.087 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.086+0000 7fd40595e9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:11.087 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.086+0000 7fd40595e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34, ofs0, ns] 2024-09-14T11:32:11.087 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.086+0000 7fd2e6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464397 cookie 93985924049216 notifier 7416 bl.length()=963 2024-09-14T11:32:11.087 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.086+0000 7fd2e6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34 info.flags=0x17 2024-09-14T11:32:11.087 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.086+0000 7fd2e6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.34 to cache LRU end 2024-09-14T11:32:11.087 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.086+0000 7fd2e6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:11.088 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.086+0000 7fd40595e9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.34]): orig_sources= new_sources= 2024-09-14T11:32:11.088 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.086+0000 7fd40595e9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.34]): potential sources added=[] removed=[] 2024-09-14T11:32:11.088 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.086+0000 7fd40595e9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.34]): orig_dests= new_dests= 2024-09-14T11:32:11.088 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.086+0000 7fd40595e9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.34]): potential dests added=[] removed=[] 2024-09-14T11:32:11.093 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.094+0000 7fd40595e9c0 1 execute INFO: reshard of bucket "error-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-14T11:32:11.095 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.094+0000 7fd2b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:11.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.098+0000 7fd40595e9c0 20 remove_watcher() i=0 2024-09-14T11:32:11.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.098+0000 7fd40595e9c0 2 removed watcher, disabling cache 2024-09-14T11:32:11.100 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.098+0000 7fd40595e9c0 20 remove_watcher() i=1 2024-09-14T11:32:11.102 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.102+0000 7fd40595e9c0 20 remove_watcher() i=2 2024-09-14T11:32:11.104 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.102+0000 7fd40595e9c0 20 remove_watcher() i=3 2024-09-14T11:32:11.106 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.106+0000 7fd40595e9c0 20 remove_watcher() i=4 2024-09-14T11:32:11.107 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.106+0000 7fd40595e9c0 20 remove_watcher() i=5 2024-09-14T11:32:11.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.110+0000 7fd40595e9c0 20 remove_watcher() i=6 2024-09-14T11:32:11.112 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.114+0000 7fd40595e9c0 20 remove_watcher() i=7 2024-09-14T11:32:11.127 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:32:11.155 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:11.155 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:11.199 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.198+0000 7f96b7d519c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.202 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.202+0000 7f96b7d519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.202 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.202+0000 7f96b7d519c0 20 realm 2024-09-14T11:32:11.202 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.202+0000 7f96b7d519c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.202 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.202+0000 7f96b7d519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.202 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.202+0000 7f96b7d519c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:11.202 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.202+0000 7f96b7d519c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.203 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.202+0000 7f96b7d519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.203 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.202+0000 7f96b7d519c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.204 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.202+0000 7f96b7d519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:11.204 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.202+0000 7f96b7d519c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.204 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.202+0000 7f96b7d519c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:11.204 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.202+0000 7f96b7d519c0 20 searching for the correct realm 2024-09-14T11:32:11.208 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.206+0000 7f96b6058640 0 -- 172.21.15.71:0/1118853084 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f96ac018070 msgr2=0x7f96ac05bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:11.419 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.418+0000 7f96b6058640 0 -- 172.21.15.71:0/1118853084 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x5575a74a3770 msgr2=0x5575a74a5b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:11.435 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.434+0000 7f96b7d519c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:11.435 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.434+0000 7f96b7d519c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:32:11.435 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.434+0000 7f96b7d519c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:11.435 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.434+0000 7f96b7d519c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:32:11.435 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.434+0000 7f96b7d519c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:11.435 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.434+0000 7f96b7d519c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:11.435 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.434+0000 7f96b7d519c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.436 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.434+0000 7f96b7d519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.436 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.434+0000 7f96b7d519c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.436 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.434+0000 7f96b7d519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:11.436 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.434+0000 7f96b7d519c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.438 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.438+0000 7f96b7d519c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:11.438 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.438+0000 7f96b7d519c0 20 zone default found 2024-09-14T11:32:11.438 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.438+0000 7f96b7d519c0 4 Realm: () 2024-09-14T11:32:11.438 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.438+0000 7f96b7d519c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:32:11.438 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.438+0000 7f96b7d519c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:32:11.438 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.438+0000 7f96b7d519c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:11.438 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.438+0000 7f96b7d519c0 20 zonegroup default 2024-09-14T11:32:11.438 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.438+0000 7f96b7d519c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.439 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.438+0000 7f96b7d519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.439 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.438+0000 7f96b7d519c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.439 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.438+0000 7f96b7d519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.439 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.438+0000 7f96b7d519c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.440 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.438+0000 7f96b7d519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.440 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.438+0000 7f96b7d519c0 20 started sync module instance, tier type = 2024-09-14T11:32:11.440 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.438+0000 7f96b7d519c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:32:11.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.462+0000 7f96b7d519c0 20 add_watcher() i=0 2024-09-14T11:32:11.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.462+0000 7f96b7d519c0 20 add_watcher() i=1 2024-09-14T11:32:11.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.462+0000 7f96b7d519c0 20 add_watcher() i=2 2024-09-14T11:32:11.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.462+0000 7f96b7d519c0 20 add_watcher() i=3 2024-09-14T11:32:11.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.462+0000 7f96b7d519c0 20 add_watcher() i=4 2024-09-14T11:32:11.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.462+0000 7f96b7d519c0 20 add_watcher() i=5 2024-09-14T11:32:11.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.462+0000 7f96b7d519c0 20 add_watcher() i=6 2024-09-14T11:32:11.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.470+0000 7f96b7d519c0 20 add_watcher() i=7 2024-09-14T11:32:11.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.470+0000 7f96b7d519c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:11.470 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.474+0000 7f95677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:11.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.474+0000 7f96b7d519c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:11.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.474+0000 7f96b7d519c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:11.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.474+0000 7f96b7d519c0 5 note: GC not initialized 2024-09-14T11:32:11.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.474+0000 7f95667fc640 20 reqs_thread_entry: start 2024-09-14T11:32:11.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.474+0000 7f96b7d519c0 20 init_complete bucket index max shards: 11 2024-09-14T11:32:11.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.474+0000 7f96b7d519c0 20 Filter name: none 2024-09-14T11:32:11.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.474+0000 7f94d7fff640 20 reqs_thread_entry: start 2024-09-14T11:32:11.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.474+0000 7f96b7d519c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.474+0000 7f96b7d519c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:11.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.474+0000 7f96b7d519c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.475 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.474+0000 7f96b7d519c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:11.475 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.474+0000 7f96b7d519c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:11.475 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.474+0000 7f96b7d519c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.474+0000 7f96b7d519c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:11.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.474+0000 7f96b7d519c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.474+0000 7f96b7d519c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:11.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.474+0000 7f96b7d519c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:11.480 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.478+0000 7f95677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:11.484 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.482+0000 7f96b7d519c0 20 remove_watcher() i=0 2024-09-14T11:32:11.484 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.482+0000 7f96b7d519c0 2 removed watcher, disabling cache 2024-09-14T11:32:11.489 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.490+0000 7f96b7d519c0 20 remove_watcher() i=1 2024-09-14T11:32:11.491 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.490+0000 7f96b7d519c0 20 remove_watcher() i=2 2024-09-14T11:32:11.493 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.494+0000 7f96b7d519c0 20 remove_watcher() i=3 2024-09-14T11:32:11.498 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.498+0000 7f96b7d519c0 20 remove_watcher() i=4 2024-09-14T11:32:11.504 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.502+0000 7f96b7d519c0 20 remove_watcher() i=5 2024-09-14T11:32:11.509 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.514+0000 7f96b7d519c0 20 remove_watcher() i=6 2024-09-14T11:32:11.514 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:11.518+0000 7f96b7d519c0 20 remove_watcher() i=7 2024-09-14T11:32:11.534 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:11.534 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:32:11.534 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: error-at-do-reshard id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.34 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:32:11.534 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:11.655 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-14T11:32:11.655 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.050 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:32:12.083 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:12.083 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:12.128 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.130+0000 7f3af671d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.131 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.134+0000 7f3af671d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.131 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.134+0000 7f3af671d9c0 20 realm 2024-09-14T11:32:12.131 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.134+0000 7f3af671d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.132 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.134+0000 7f3af671d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.132 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.134+0000 7f3af671d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:12.132 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.134+0000 7f3af671d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.132 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.134+0000 7f3af671d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.132 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.134+0000 7f3af671d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.133 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.138+0000 7f3af671d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:12.133 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.138+0000 7f3af671d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.138+0000 7f3af671d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:12.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.138+0000 7f3af671d9c0 20 searching for the correct realm 2024-09-14T11:32:12.138 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.142+0000 7f3af4a24640 0 -- 172.21.15.71:0/3767460499 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f3ae8028070 msgr2=0x7f3ae8073a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:12.352 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.354+0000 7f3af4a24640 0 -- 172.21.15.71:0/3767460499 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x5589c74e95b0 msgr2=0x5589c74eb9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:12.367 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.370+0000 7f3af671d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:12.367 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.370+0000 7f3af671d9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:32:12.367 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.370+0000 7f3af671d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:12.367 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.370+0000 7f3af671d9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:32:12.368 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.370+0000 7f3af671d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:12.368 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.370+0000 7f3af671d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:12.368 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.370+0000 7f3af671d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.368 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.370+0000 7f3af671d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.368 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.370+0000 7f3af671d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.368 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.370+0000 7f3af671d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:12.369 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.370+0000 7f3af671d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.370 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.374+0000 7f3af671d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:12.370 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.374+0000 7f3af671d9c0 20 zone default found 2024-09-14T11:32:12.370 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.374+0000 7f3af671d9c0 4 Realm: () 2024-09-14T11:32:12.370 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.374+0000 7f3af671d9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:32:12.370 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.374+0000 7f3af671d9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:32:12.370 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.374+0000 7f3af671d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:12.370 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.374+0000 7f3af671d9c0 20 zonegroup default 2024-09-14T11:32:12.370 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.374+0000 7f3af671d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.371 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.374+0000 7f3af671d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.371 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.374+0000 7f3af671d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.371 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.374+0000 7f3af671d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.371 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.374+0000 7f3af671d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.372 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.374+0000 7f3af671d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.372 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.374+0000 7f3af671d9c0 20 started sync module instance, tier type = 2024-09-14T11:32:12.372 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.374+0000 7f3af671d9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:32:12.400 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.402+0000 7f3af671d9c0 20 add_watcher() i=0 2024-09-14T11:32:12.400 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.402+0000 7f3af671d9c0 20 add_watcher() i=1 2024-09-14T11:32:12.400 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.402+0000 7f3af671d9c0 20 add_watcher() i=2 2024-09-14T11:32:12.400 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.402+0000 7f3af671d9c0 20 add_watcher() i=3 2024-09-14T11:32:12.400 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.402+0000 7f3af671d9c0 20 add_watcher() i=4 2024-09-14T11:32:12.400 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.402+0000 7f3af671d9c0 20 add_watcher() i=5 2024-09-14T11:32:12.400 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.402+0000 7f3af671d9c0 20 add_watcher() i=6 2024-09-14T11:32:12.403 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.406+0000 7f3af671d9c0 20 add_watcher() i=7 2024-09-14T11:32:12.403 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.406+0000 7f3af671d9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:12.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.410+0000 7f39aafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:12.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.410+0000 7f3af671d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:12.409 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.410+0000 7f3af671d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:12.409 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.414+0000 7f3af671d9c0 5 note: GC not initialized 2024-09-14T11:32:12.410 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.414+0000 7f39a9fdb640 20 reqs_thread_entry: start 2024-09-14T11:32:12.410 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.414+0000 7f3af671d9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:32:12.410 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.414+0000 7f3af671d9c0 20 Filter name: none 2024-09-14T11:32:12.410 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.414+0000 7f391b7fe640 20 reqs_thread_entry: start 2024-09-14T11:32:12.410 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.414+0000 7f3af671d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.410 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.414+0000 7f3af671d9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:12.410 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.414+0000 7f3af671d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.411 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.414+0000 7f3af671d9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:12.411 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.414+0000 7f3af671d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:12.411 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.414+0000 7f3af671d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.412 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.414+0000 7f3af671d9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:12.412 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.414+0000 7f3af671d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.412 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.414+0000 7f3af671d9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:12.412 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.414+0000 7f3af671d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:12.416 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.418+0000 7f39aafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:12.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.422+0000 7f3af671d9c0 20 remove_watcher() i=0 2024-09-14T11:32:12.421 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.422+0000 7f3af671d9c0 2 removed watcher, disabling cache 2024-09-14T11:32:12.422 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.426+0000 7f3af671d9c0 20 remove_watcher() i=1 2024-09-14T11:32:12.425 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.430+0000 7f3af671d9c0 20 remove_watcher() i=2 2024-09-14T11:32:12.427 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.430+0000 7f3af671d9c0 20 remove_watcher() i=3 2024-09-14T11:32:12.429 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.434+0000 7f3af671d9c0 20 remove_watcher() i=4 2024-09-14T11:32:12.432 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.434+0000 7f3af671d9c0 20 remove_watcher() i=5 2024-09-14T11:32:12.435 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.438+0000 7f3af671d9c0 20 remove_watcher() i=6 2024-09-14T11:32:12.437 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.442+0000 7f3af671d9c0 20 remove_watcher() i=7 2024-09-14T11:32:12.456 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.456 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:32:12.456 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: abort-at-do-reshard id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:32:12.456 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.456 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:32:12.489 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:12.489 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:12.533 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.538+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.535 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.538+0000 7f60f12109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.536 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.538+0000 7f60f12109c0 20 realm 2024-09-14T11:32:12.536 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.538+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.536 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.538+0000 7f60f12109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.536 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.538+0000 7f60f12109c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:12.536 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.538+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.537 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.542+0000 7f60f12109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.537 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.542+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.537 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.542+0000 7f60f12109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:12.537 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.542+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.538 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.542+0000 7f60f12109c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:12.538 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.542+0000 7f60f12109c0 20 searching for the correct realm 2024-09-14T11:32:12.543 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.546+0000 7f60eed16640 0 -- 172.21.15.71:0/1224989318 >> [v2:172.21.15.157:6808/527702018,v1:172.21.15.157:6809/527702018] conn(0x7f60e00656f0 msgr2=0x7f60e006e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:12.758 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.762+0000 7f60eed16640 0 -- 172.21.15.71:0/1224989318 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x55e9d286bdd0 msgr2=0x55e9d286e290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:12.768 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.770+0000 7f60f12109c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:12.768 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.770+0000 7f60f12109c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:32:12.768 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.770+0000 7f60f12109c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:12.768 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.770+0000 7f60f12109c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:32:12.768 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.770+0000 7f60f12109c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:12.768 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.770+0000 7f60f12109c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:12.769 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.770+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.769 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.770+0000 7f60f12109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.769 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.770+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.769 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.774+0000 7f60f12109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:12.769 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.774+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.770 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.774+0000 7f60f12109c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:12.770 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.774+0000 7f60f12109c0 20 zone default found 2024-09-14T11:32:12.771 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.774+0000 7f60f12109c0 4 Realm: () 2024-09-14T11:32:12.771 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.774+0000 7f60f12109c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:32:12.771 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.774+0000 7f60f12109c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:32:12.771 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.774+0000 7f60f12109c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:12.771 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.774+0000 7f60f12109c0 20 zonegroup default 2024-09-14T11:32:12.771 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.774+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.772 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.774+0000 7f60f12109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.772 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.774+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.772 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.774+0000 7f60f12109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.772 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.774+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.778+0000 7f60f12109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.778+0000 7f60f12109c0 20 started sync module instance, tier type = 2024-09-14T11:32:12.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.778+0000 7f60f12109c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:32:12.795 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.798+0000 7f60f12109c0 20 add_watcher() i=0 2024-09-14T11:32:12.795 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.798+0000 7f60f12109c0 20 add_watcher() i=1 2024-09-14T11:32:12.795 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.798+0000 7f60f12109c0 20 add_watcher() i=2 2024-09-14T11:32:12.795 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.798+0000 7f60f12109c0 20 add_watcher() i=3 2024-09-14T11:32:12.795 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.798+0000 7f60f12109c0 20 add_watcher() i=4 2024-09-14T11:32:12.795 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.798+0000 7f60f12109c0 20 add_watcher() i=5 2024-09-14T11:32:12.795 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.798+0000 7f60f12109c0 20 add_watcher() i=6 2024-09-14T11:32:12.797 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.802+0000 7f60f12109c0 20 add_watcher() i=7 2024-09-14T11:32:12.797 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.802+0000 7f60f12109c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:12.801 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.806+0000 7f5fa57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:12.802 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.806+0000 7f60f12109c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:12.802 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.806+0000 7f60f12109c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:12.803 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.806+0000 7f60f12109c0 5 note: GC not initialized 2024-09-14T11:32:12.803 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.806+0000 7f5f1ffff640 20 reqs_thread_entry: start 2024-09-14T11:32:12.803 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.806+0000 7f60f12109c0 20 init_complete bucket index max shards: 11 2024-09-14T11:32:12.803 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.806+0000 7f60f12109c0 20 Filter name: none 2024-09-14T11:32:12.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.806+0000 7f5f1dffb640 20 reqs_thread_entry: start 2024-09-14T11:32:12.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.806+0000 7f60f12109c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:32:12.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.806+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.806+0000 7f60f12109c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:12.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.806+0000 7f60f12109c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:32:12.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.806+0000 7f60f12109c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:32:12.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.806+0000 7f60f12109c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 : miss 2024-09-14T11:32:12.805 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.806+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.805 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.810+0000 7f60f12109c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:12.805 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.810+0000 7f60f12109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 info.flags=0x17 2024-09-14T11:32:12.805 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.810+0000 7f60f12109c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 to cache LRU end 2024-09-14T11:32:12.805 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.810+0000 7f60f12109c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:12.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.810+0000 7f60f12109c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:12.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.810+0000 7f60f12109c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 2024-09-14T11:32:12.815 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.818+0000 7f60f12109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 info.flags=0x17 2024-09-14T11:32:12.815 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.818+0000 7f60f12109c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 to cache LRU end 2024-09-14T11:32:12.815 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.818+0000 7f60f12109c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:12.815 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.818+0000 7f60f12109c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35, ofs0, ns] 2024-09-14T11:32:12.815 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.818+0000 7f5fd27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464281 cookie 94462747794768 notifier 7473 bl.length()=995 2024-09-14T11:32:12.816 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.818+0000 7f5fd27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 info.flags=0x17 2024-09-14T11:32:12.816 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.818+0000 7f5fd27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 to cache LRU end 2024-09-14T11:32:12.816 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.818+0000 7f5fd27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:12.816 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.818+0000 7f60f12109c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.35]): orig_sources= new_sources= 2024-09-14T11:32:12.816 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.818+0000 7f60f12109c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.35]): potential sources added=[] removed=[] 2024-09-14T11:32:12.816 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.818+0000 7f60f12109c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.35]): orig_dests= new_dests= 2024-09-14T11:32:12.816 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.818+0000 7f60f12109c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.35]): potential dests added=[] removed=[] 2024-09-14T11:32:12.828 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f60f12109c0 time 2024-09-14T11:32:12.834083+0000 2024-09-14T11:32:12.828 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:32:12.829 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:12.829 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f60f4aea2eb] 2024-09-14T11:32:12.829 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f60f4aea49f] 2024-09-14T11:32:12.829 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e9d10e8c01] 2024-09-14T11:32:12.830 INFO:tasks.workunit.client.0.smithi071.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e9d10fdf3a] 2024-09-14T11:32:12.830 INFO:tasks.workunit.client.0.smithi071.stderr: 5: main() 2024-09-14T11:32:12.830 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f60f3950d90] 2024-09-14T11:32:12.830 INFO:tasks.workunit.client.0.smithi071.stderr: 7: __libc_start_main() 2024-09-14T11:32:12.830 INFO:tasks.workunit.client.0.smithi071.stderr: 8: _start() 2024-09-14T11:32:12.830 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.834+0000 7f60f12109c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f60f12109c0 time 2024-09-14T11:32:12.834083+0000 2024-09-14T11:32:12.830 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:32:12.830 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.830 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:12.830 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f60f4aea2eb] 2024-09-14T11:32:12.830 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f60f4aea49f] 2024-09-14T11:32:12.830 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e9d10e8c01] 2024-09-14T11:32:12.830 INFO:tasks.workunit.client.0.smithi071.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e9d10fdf3a] 2024-09-14T11:32:12.831 INFO:tasks.workunit.client.0.smithi071.stderr: 5: main() 2024-09-14T11:32:12.831 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f60f3950d90] 2024-09-14T11:32:12.831 INFO:tasks.workunit.client.0.smithi071.stderr: 7: __libc_start_main() 2024-09-14T11:32:12.831 INFO:tasks.workunit.client.0.smithi071.stderr: 8: _start() 2024-09-14T11:32:12.831 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.831 INFO:tasks.workunit.client.0.smithi071.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:32:12.831 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f60f12109c0 thread_name:radosgw-admin 2024-09-14T11:32:12.837 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:12.837 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f60f3969520] 2024-09-14T11:32:12.837 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:32:12.837 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:32:12.837 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:32:12.837 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f60f4aea345] 2024-09-14T11:32:12.837 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f60f4aea49f] 2024-09-14T11:32:12.838 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e9d10e8c01] 2024-09-14T11:32:12.838 INFO:tasks.workunit.client.0.smithi071.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e9d10fdf3a] 2024-09-14T11:32:12.838 INFO:tasks.workunit.client.0.smithi071.stderr: 9: main() 2024-09-14T11:32:12.838 INFO:tasks.workunit.client.0.smithi071.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f60f3950d90] 2024-09-14T11:32:12.838 INFO:tasks.workunit.client.0.smithi071.stderr: 11: __libc_start_main() 2024-09-14T11:32:12.838 INFO:tasks.workunit.client.0.smithi071.stderr: 12: _start() 2024-09-14T11:32:12.838 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.834+0000 7f60f12109c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:32:12.838 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f60f12109c0 thread_name:radosgw-admin 2024-09-14T11:32:12.838 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.838 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:12.838 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f60f3969520] 2024-09-14T11:32:12.838 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:32:12.838 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:32:12.838 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:32:12.839 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f60f4aea345] 2024-09-14T11:32:12.839 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f60f4aea49f] 2024-09-14T11:32:12.839 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e9d10e8c01] 2024-09-14T11:32:12.839 INFO:tasks.workunit.client.0.smithi071.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e9d10fdf3a] 2024-09-14T11:32:12.839 INFO:tasks.workunit.client.0.smithi071.stderr: 9: main() 2024-09-14T11:32:12.839 INFO:tasks.workunit.client.0.smithi071.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f60f3950d90] 2024-09-14T11:32:12.839 INFO:tasks.workunit.client.0.smithi071.stderr: 11: __libc_start_main() 2024-09-14T11:32:12.839 INFO:tasks.workunit.client.0.smithi071.stderr: 12: _start() 2024-09-14T11:32:12.839 INFO:tasks.workunit.client.0.smithi071.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:32:12.839 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.839 INFO:tasks.workunit.client.0.smithi071.stderr:--- begin dump of recent events --- 2024-09-14T11:32:12.839 INFO:tasks.workunit.client.0.smithi071.stderr: -499> 2024-09-14T11:32:12.514+0000 7f60ef517640 10 monclient(hunting): get_auth_request con 0x55e9d26bbcb0 auth_method 0 2024-09-14T11:32:12.839 INFO:tasks.workunit.client.0.smithi071.stderr: -498> 2024-09-14T11:32:12.514+0000 7f60ef517640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:12.840 INFO:tasks.workunit.client.0.smithi071.stderr: -497> 2024-09-14T11:32:12.514+0000 7f60ef517640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:12.840 INFO:tasks.workunit.client.0.smithi071.stderr: -496> 2024-09-14T11:32:12.514+0000 7f60ef517640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:12.840 INFO:tasks.workunit.client.0.smithi071.stderr: -495> 2024-09-14T11:32:12.514+0000 7f60ee515640 10 monclient(hunting): handle_auth_done global_id 7091 payload 274 2024-09-14T11:32:12.840 INFO:tasks.workunit.client.0.smithi071.stderr: -494> 2024-09-14T11:32:12.514+0000 7f60ee515640 10 monclient: _finish_hunting 0 2024-09-14T11:32:12.840 INFO:tasks.workunit.client.0.smithi071.stderr: -493> 2024-09-14T11:32:12.514+0000 7f60ee515640 1 monclient: found mon.noname-c 2024-09-14T11:32:12.840 INFO:tasks.workunit.client.0.smithi071.stderr: -492> 2024-09-14T11:32:12.514+0000 7f60ee515640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:32:12.840 INFO:tasks.workunit.client.0.smithi071.stderr: -491> 2024-09-14T11:32:12.514+0000 7f5fdce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:12.840 INFO:tasks.workunit.client.0.smithi071.stderr: -490> 2024-09-14T11:32:12.514+0000 7f5fdce09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:32:12.840 INFO:tasks.workunit.client.0.smithi071.stderr: -489> 2024-09-14T11:32:12.514+0000 7f5fdce09640 10 monclient: dump: 2024-09-14T11:32:12.840 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:12.840 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:12.840 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.841 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.841 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:12.841 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:12.841 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:12.841 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:12.841 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:12.841 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.841 INFO:tasks.workunit.client.0.smithi071.stderr: -488> 2024-09-14T11:32:12.514+0000 7f5fdce09640 10 monclient: _finish_auth 0 2024-09-14T11:32:12.841 INFO:tasks.workunit.client.0.smithi071.stderr: -487> 2024-09-14T11:32:12.514+0000 7f5fdce09640 10 monclient: _check_auth_tickets 2024-09-14T11:32:12.841 INFO:tasks.workunit.client.0.smithi071.stderr: -486> 2024-09-14T11:32:12.514+0000 7f60f12109c0 5 monclient: authenticate success, global_id 7091 2024-09-14T11:32:12.841 INFO:tasks.workunit.client.0.smithi071.stderr: -485> 2024-09-14T11:32:12.514+0000 7f5fdce09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:12.841 INFO:tasks.workunit.client.0.smithi071.stderr: -484> 2024-09-14T11:32:12.514+0000 7f5fdce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:12.841 INFO:tasks.workunit.client.0.smithi071.stderr: -483> 2024-09-14T11:32:12.514+0000 7f5fdce09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:12.841 INFO:tasks.workunit.client.0.smithi071.stderr: -482> 2024-09-14T11:32:12.514+0000 7f5fdce09640 10 monclient: dump: 2024-09-14T11:32:12.842 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:12.842 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:12.842 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.842 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.842 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:12.842 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:12.842 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:12.842 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:12.842 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:12.842 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.842 INFO:tasks.workunit.client.0.smithi071.stderr: -481> 2024-09-14T11:32:12.514+0000 7f60f12109c0 10 monclient: get_monmap_and_config success 2024-09-14T11:32:12.842 INFO:tasks.workunit.client.0.smithi071.stderr: -480> 2024-09-14T11:32:12.514+0000 7f60f12109c0 4 set_mon_vals no callback set 2024-09-14T11:32:12.842 INFO:tasks.workunit.client.0.smithi071.stderr: -479> 2024-09-14T11:32:12.514+0000 7f60f12109c0 10 monclient: shutdown 2024-09-14T11:32:12.842 INFO:tasks.workunit.client.0.smithi071.stderr: -478> 2024-09-14T11:32:12.514+0000 7f60f12109c0 5 asok(0x55e9d2565d90) unregister_commands rotate-key 2024-09-14T11:32:12.843 INFO:tasks.workunit.client.0.smithi071.stderr: -477> 2024-09-14T11:32:12.514+0000 7f60f12109c0 10 monclient: build_initial_monmap 2024-09-14T11:32:12.843 INFO:tasks.workunit.client.0.smithi071.stderr: -476> 2024-09-14T11:32:12.514+0000 7f60f12109c0 1 build_initial for_mkfs: 0 2024-09-14T11:32:12.843 INFO:tasks.workunit.client.0.smithi071.stderr: -475> 2024-09-14T11:32:12.514+0000 7f60f12109c0 10 monclient: monmap: 2024-09-14T11:32:12.843 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:32:12.843 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:12.843 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:32:12.843 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:32:12.843 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:12.843 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:12.843 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:32:12.843 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:32:12.843 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:32:12.843 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.844 INFO:tasks.workunit.client.0.smithi071.stderr: -474> 2024-09-14T11:32:12.514+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2776380) adding auth protocol: cephx 2024-09-14T11:32:12.844 INFO:tasks.workunit.client.0.smithi071.stderr: -473> 2024-09-14T11:32:12.514+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2776380) adding auth protocol: cephx 2024-09-14T11:32:12.844 INFO:tasks.workunit.client.0.smithi071.stderr: -472> 2024-09-14T11:32:12.514+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2776380) adding auth protocol: cephx 2024-09-14T11:32:12.844 INFO:tasks.workunit.client.0.smithi071.stderr: -471> 2024-09-14T11:32:12.514+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2776380) adding con mode: secure 2024-09-14T11:32:12.844 INFO:tasks.workunit.client.0.smithi071.stderr: -470> 2024-09-14T11:32:12.514+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2776380) adding con mode: crc 2024-09-14T11:32:12.844 INFO:tasks.workunit.client.0.smithi071.stderr: -469> 2024-09-14T11:32:12.514+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2776380) adding con mode: secure 2024-09-14T11:32:12.844 INFO:tasks.workunit.client.0.smithi071.stderr: -468> 2024-09-14T11:32:12.514+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2776380) adding con mode: crc 2024-09-14T11:32:12.844 INFO:tasks.workunit.client.0.smithi071.stderr: -467> 2024-09-14T11:32:12.514+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2776380) adding con mode: secure 2024-09-14T11:32:12.844 INFO:tasks.workunit.client.0.smithi071.stderr: -466> 2024-09-14T11:32:12.514+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2776380) adding con mode: crc 2024-09-14T11:32:12.844 INFO:tasks.workunit.client.0.smithi071.stderr: -465> 2024-09-14T11:32:12.514+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2776380) adding con mode: crc 2024-09-14T11:32:12.844 INFO:tasks.workunit.client.0.smithi071.stderr: -464> 2024-09-14T11:32:12.514+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2776380) adding con mode: secure 2024-09-14T11:32:12.844 INFO:tasks.workunit.client.0.smithi071.stderr: -463> 2024-09-14T11:32:12.514+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2776380) adding con mode: crc 2024-09-14T11:32:12.844 INFO:tasks.workunit.client.0.smithi071.stderr: -462> 2024-09-14T11:32:12.514+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2776380) adding con mode: secure 2024-09-14T11:32:12.844 INFO:tasks.workunit.client.0.smithi071.stderr: -461> 2024-09-14T11:32:12.514+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2776380) adding con mode: crc 2024-09-14T11:32:12.845 INFO:tasks.workunit.client.0.smithi071.stderr: -460> 2024-09-14T11:32:12.514+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2776380) adding con mode: secure 2024-09-14T11:32:12.845 INFO:tasks.workunit.client.0.smithi071.stderr: -459> 2024-09-14T11:32:12.514+0000 7f60f12109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:12.845 INFO:tasks.workunit.client.0.smithi071.stderr: -458> 2024-09-14T11:32:12.514+0000 7f60f12109c0 1 librados: starting msgr at 2024-09-14T11:32:12.845 INFO:tasks.workunit.client.0.smithi071.stderr: -457> 2024-09-14T11:32:12.514+0000 7f60f12109c0 1 librados: starting objecter 2024-09-14T11:32:12.845 INFO:tasks.workunit.client.0.smithi071.stderr: -456> 2024-09-14T11:32:12.518+0000 7f60f12109c0 5 asok(0x55e9d2565d90) register_command objecter_requests hook 0x55e9d277a640 2024-09-14T11:32:12.845 INFO:tasks.workunit.client.0.smithi071.stderr: -455> 2024-09-14T11:32:12.518+0000 7f60f12109c0 1 librados: setting wanted keys 2024-09-14T11:32:12.845 INFO:tasks.workunit.client.0.smithi071.stderr: -454> 2024-09-14T11:32:12.518+0000 7f60f12109c0 1 librados: calling monclient init 2024-09-14T11:32:12.845 INFO:tasks.workunit.client.0.smithi071.stderr: -453> 2024-09-14T11:32:12.518+0000 7f60f12109c0 10 monclient: init 2024-09-14T11:32:12.845 INFO:tasks.workunit.client.0.smithi071.stderr: -452> 2024-09-14T11:32:12.518+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2773510) adding auth protocol: cephx 2024-09-14T11:32:12.845 INFO:tasks.workunit.client.0.smithi071.stderr: -451> 2024-09-14T11:32:12.518+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2773510) adding auth protocol: cephx 2024-09-14T11:32:12.845 INFO:tasks.workunit.client.0.smithi071.stderr: -450> 2024-09-14T11:32:12.518+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2773510) adding auth protocol: cephx 2024-09-14T11:32:12.845 INFO:tasks.workunit.client.0.smithi071.stderr: -449> 2024-09-14T11:32:12.518+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2773510) adding con mode: secure 2024-09-14T11:32:12.845 INFO:tasks.workunit.client.0.smithi071.stderr: -448> 2024-09-14T11:32:12.518+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2773510) adding con mode: crc 2024-09-14T11:32:12.846 INFO:tasks.workunit.client.0.smithi071.stderr: -447> 2024-09-14T11:32:12.518+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2773510) adding con mode: secure 2024-09-14T11:32:12.846 INFO:tasks.workunit.client.0.smithi071.stderr: -446> 2024-09-14T11:32:12.518+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2773510) adding con mode: crc 2024-09-14T11:32:12.846 INFO:tasks.workunit.client.0.smithi071.stderr: -445> 2024-09-14T11:32:12.518+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2773510) adding con mode: secure 2024-09-14T11:32:12.846 INFO:tasks.workunit.client.0.smithi071.stderr: -444> 2024-09-14T11:32:12.518+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2773510) adding con mode: crc 2024-09-14T11:32:12.846 INFO:tasks.workunit.client.0.smithi071.stderr: -443> 2024-09-14T11:32:12.518+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2773510) adding con mode: crc 2024-09-14T11:32:12.846 INFO:tasks.workunit.client.0.smithi071.stderr: -442> 2024-09-14T11:32:12.518+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2773510) adding con mode: secure 2024-09-14T11:32:12.846 INFO:tasks.workunit.client.0.smithi071.stderr: -441> 2024-09-14T11:32:12.518+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2773510) adding con mode: crc 2024-09-14T11:32:12.846 INFO:tasks.workunit.client.0.smithi071.stderr: -440> 2024-09-14T11:32:12.518+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2773510) adding con mode: secure 2024-09-14T11:32:12.846 INFO:tasks.workunit.client.0.smithi071.stderr: -439> 2024-09-14T11:32:12.518+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2773510) adding con mode: crc 2024-09-14T11:32:12.846 INFO:tasks.workunit.client.0.smithi071.stderr: -438> 2024-09-14T11:32:12.518+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2773510) adding con mode: secure 2024-09-14T11:32:12.846 INFO:tasks.workunit.client.0.smithi071.stderr: -437> 2024-09-14T11:32:12.518+0000 7f60f12109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:12.846 INFO:tasks.workunit.client.0.smithi071.stderr: -436> 2024-09-14T11:32:12.518+0000 7f60f12109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:12.846 INFO:tasks.workunit.client.0.smithi071.stderr: -435> 2024-09-14T11:32:12.518+0000 7f60f12109c0 5 asok(0x55e9d2565d90) register_command rotate-key hook 0x55e9d2773658 2024-09-14T11:32:12.847 INFO:tasks.workunit.client.0.smithi071.stderr: -434> 2024-09-14T11:32:12.518+0000 7f60f12109c0 10 monclient: _reopen_session rank -1 2024-09-14T11:32:12.847 INFO:tasks.workunit.client.0.smithi071.stderr: -433> 2024-09-14T11:32:12.518+0000 7f60f12109c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:32:12.847 INFO:tasks.workunit.client.0.smithi071.stderr: -432> 2024-09-14T11:32:12.518+0000 7f60f12109c0 10 monclient(hunting): picked mon.noname-a con 0x55e9d25fec20 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:32:12.847 INFO:tasks.workunit.client.0.smithi071.stderr: -431> 2024-09-14T11:32:12.518+0000 7f60f12109c0 10 monclient(hunting): picked mon.noname-c con 0x55e9d26b8900 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:32:12.847 INFO:tasks.workunit.client.0.smithi071.stderr: -430> 2024-09-14T11:32:12.518+0000 7f60f12109c0 10 monclient(hunting): picked mon.noname-b con 0x55e9d26bbcb0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:32:12.847 INFO:tasks.workunit.client.0.smithi071.stderr: -429> 2024-09-14T11:32:12.518+0000 7f60f12109c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:12.847 INFO:tasks.workunit.client.0.smithi071.stderr: -428> 2024-09-14T11:32:12.518+0000 7f60f12109c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:12.847 INFO:tasks.workunit.client.0.smithi071.stderr: -427> 2024-09-14T11:32:12.518+0000 7f60f12109c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:12.847 INFO:tasks.workunit.client.0.smithi071.stderr: -426> 2024-09-14T11:32:12.518+0000 7f60f12109c0 10 monclient(hunting): _renew_subs 2024-09-14T11:32:12.847 INFO:tasks.workunit.client.0.smithi071.stderr: -425> 2024-09-14T11:32:12.518+0000 7f60f12109c0 10 monclient(hunting): authenticate will time out at 2344.636843s 2024-09-14T11:32:12.847 INFO:tasks.workunit.client.0.smithi071.stderr: -424> 2024-09-14T11:32:12.518+0000 7f60ee515640 10 monclient(hunting): get_auth_request con 0x55e9d26b8900 auth_method 0 2024-09-14T11:32:12.847 INFO:tasks.workunit.client.0.smithi071.stderr: -423> 2024-09-14T11:32:12.518+0000 7f60ee515640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:12.847 INFO:tasks.workunit.client.0.smithi071.stderr: -422> 2024-09-14T11:32:12.518+0000 7f60ee515640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:12.848 INFO:tasks.workunit.client.0.smithi071.stderr: -421> 2024-09-14T11:32:12.518+0000 7f60ee515640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:12.848 INFO:tasks.workunit.client.0.smithi071.stderr: -420> 2024-09-14T11:32:12.518+0000 7f60eed16640 10 monclient(hunting): get_auth_request con 0x55e9d25fec20 auth_method 0 2024-09-14T11:32:12.848 INFO:tasks.workunit.client.0.smithi071.stderr: -419> 2024-09-14T11:32:12.518+0000 7f60eed16640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:12.848 INFO:tasks.workunit.client.0.smithi071.stderr: -418> 2024-09-14T11:32:12.518+0000 7f60eed16640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:12.848 INFO:tasks.workunit.client.0.smithi071.stderr: -417> 2024-09-14T11:32:12.518+0000 7f60eed16640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:12.848 INFO:tasks.workunit.client.0.smithi071.stderr: -416> 2024-09-14T11:32:12.518+0000 7f60ee515640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:12.848 INFO:tasks.workunit.client.0.smithi071.stderr: -415> 2024-09-14T11:32:12.518+0000 7f60ee515640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:12.848 INFO:tasks.workunit.client.0.smithi071.stderr: -414> 2024-09-14T11:32:12.518+0000 7f60ee515640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:12.848 INFO:tasks.workunit.client.0.smithi071.stderr: -413> 2024-09-14T11:32:12.518+0000 7f60eed16640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:12.848 INFO:tasks.workunit.client.0.smithi071.stderr: -412> 2024-09-14T11:32:12.518+0000 7f60eed16640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:12.848 INFO:tasks.workunit.client.0.smithi071.stderr: -411> 2024-09-14T11:32:12.518+0000 7f60eed16640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:12.848 INFO:tasks.workunit.client.0.smithi071.stderr: -410> 2024-09-14T11:32:12.518+0000 7f60ee515640 10 monclient(hunting): handle_auth_done global_id 7094 payload 824 2024-09-14T11:32:12.848 INFO:tasks.workunit.client.0.smithi071.stderr: -409> 2024-09-14T11:32:12.518+0000 7f60ee515640 10 monclient: _finish_hunting 0 2024-09-14T11:32:12.849 INFO:tasks.workunit.client.0.smithi071.stderr: -408> 2024-09-14T11:32:12.518+0000 7f60ee515640 1 monclient: found mon.noname-c 2024-09-14T11:32:12.849 INFO:tasks.workunit.client.0.smithi071.stderr: -407> 2024-09-14T11:32:12.518+0000 7f60ee515640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:32:12.849 INFO:tasks.workunit.client.0.smithi071.stderr: -406> 2024-09-14T11:32:12.518+0000 7f5fdb606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:12.849 INFO:tasks.workunit.client.0.smithi071.stderr: -405> 2024-09-14T11:32:12.518+0000 7f5fdb606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:32:12.849 INFO:tasks.workunit.client.0.smithi071.stderr: -404> 2024-09-14T11:32:12.518+0000 7f5fdb606640 10 monclient: dump: 2024-09-14T11:32:12.849 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:12.849 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:12.849 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.849 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.849 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:12.849 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:12.849 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:12.850 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:12.850 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:12.850 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.850 INFO:tasks.workunit.client.0.smithi071.stderr: -403> 2024-09-14T11:32:12.518+0000 7f5fdb606640 10 monclient: _finish_auth 0 2024-09-14T11:32:12.850 INFO:tasks.workunit.client.0.smithi071.stderr: -402> 2024-09-14T11:32:12.518+0000 7f5fdb606640 10 monclient: _check_auth_tickets 2024-09-14T11:32:12.850 INFO:tasks.workunit.client.0.smithi071.stderr: -401> 2024-09-14T11:32:12.518+0000 7f5fdb606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:12.850 INFO:tasks.workunit.client.0.smithi071.stderr: -400> 2024-09-14T11:32:12.518+0000 7f5fdb606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:12.850 INFO:tasks.workunit.client.0.smithi071.stderr: -399> 2024-09-14T11:32:12.518+0000 7f5fdb606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:12.850 INFO:tasks.workunit.client.0.smithi071.stderr: -398> 2024-09-14T11:32:12.518+0000 7f5fdb606640 10 monclient: dump: 2024-09-14T11:32:12.850 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:12.850 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:12.850 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.850 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.850 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:12.850 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:12.851 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:12.851 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:12.851 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:12.851 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.851 INFO:tasks.workunit.client.0.smithi071.stderr: -397> 2024-09-14T11:32:12.518+0000 7f5fdce09640 4 set_mon_vals no callback set 2024-09-14T11:32:12.851 INFO:tasks.workunit.client.0.smithi071.stderr: -396> 2024-09-14T11:32:12.518+0000 7f60f12109c0 5 monclient: authenticate success, global_id 7094 2024-09-14T11:32:12.851 INFO:tasks.workunit.client.0.smithi071.stderr: -395> 2024-09-14T11:32:12.518+0000 7f60f12109c0 10 monclient: _renew_subs 2024-09-14T11:32:12.851 INFO:tasks.workunit.client.0.smithi071.stderr: -394> 2024-09-14T11:32:12.518+0000 7f60f12109c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:32:12.851 INFO:tasks.workunit.client.0.smithi071.stderr: -393> 2024-09-14T11:32:12.518+0000 7f60f12109c0 10 monclient: _renew_subs 2024-09-14T11:32:12.851 INFO:tasks.workunit.client.0.smithi071.stderr: -392> 2024-09-14T11:32:12.518+0000 7f60f12109c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:32:12.851 INFO:tasks.workunit.client.0.smithi071.stderr: -391> 2024-09-14T11:32:12.518+0000 7f60f12109c0 1 librados: init done 2024-09-14T11:32:12.851 INFO:tasks.workunit.client.0.smithi071.stderr: -390> 2024-09-14T11:32:12.522+0000 7f5fdb606640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:12.851 INFO:tasks.workunit.client.0.smithi071.stderr: -389> 2024-09-14T11:32:12.522+0000 7f5fdb606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:32:12.852 INFO:tasks.workunit.client.0.smithi071.stderr: -388> 2024-09-14T11:32:12.522+0000 7f5fdb606640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:32:12.852 INFO:tasks.workunit.client.0.smithi071.stderr: -387> 2024-09-14T11:32:12.522+0000 7f60eed16640 10 monclient: get_auth_request con 0x7f5fd40718a0 auth_method 0 2024-09-14T11:32:12.852 INFO:tasks.workunit.client.0.smithi071.stderr: -386> 2024-09-14T11:32:12.522+0000 7f60ef517640 10 monclient: get_auth_request con 0x55e9d27b4bc0 auth_method 0 2024-09-14T11:32:12.852 INFO:tasks.workunit.client.0.smithi071.stderr: -385> 2024-09-14T11:32:12.522+0000 7f60eed16640 10 monclient: get_auth_request con 0x55e9d27be0a0 auth_method 0 2024-09-14T11:32:12.852 INFO:tasks.workunit.client.0.smithi071.stderr: -384> 2024-09-14T11:32:12.522+0000 7f60ee515640 10 monclient: get_auth_request con 0x55e9d27c2400 auth_method 0 2024-09-14T11:32:12.852 INFO:tasks.workunit.client.0.smithi071.stderr: -383> 2024-09-14T11:32:12.526+0000 7f60ef517640 10 monclient: get_auth_request con 0x55e9d27c1980 auth_method 0 2024-09-14T11:32:12.852 INFO:tasks.workunit.client.0.smithi071.stderr: -382> 2024-09-14T11:32:12.526+0000 7f60f12109c0 10 monclient: build_initial_monmap 2024-09-14T11:32:12.852 INFO:tasks.workunit.client.0.smithi071.stderr: -381> 2024-09-14T11:32:12.526+0000 7f60f12109c0 1 build_initial for_mkfs: 0 2024-09-14T11:32:12.852 INFO:tasks.workunit.client.0.smithi071.stderr: -380> 2024-09-14T11:32:12.526+0000 7f60f12109c0 10 monclient: monmap: 2024-09-14T11:32:12.852 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:32:12.852 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:12.852 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:32:12.852 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:32:12.853 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:12.853 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:12.853 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:32:12.853 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:32:12.853 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:32:12.853 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.853 INFO:tasks.workunit.client.0.smithi071.stderr: -379> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27ca660) adding auth protocol: cephx 2024-09-14T11:32:12.853 INFO:tasks.workunit.client.0.smithi071.stderr: -378> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27ca660) adding auth protocol: cephx 2024-09-14T11:32:12.853 INFO:tasks.workunit.client.0.smithi071.stderr: -377> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27ca660) adding auth protocol: cephx 2024-09-14T11:32:12.853 INFO:tasks.workunit.client.0.smithi071.stderr: -376> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27ca660) adding con mode: secure 2024-09-14T11:32:12.853 INFO:tasks.workunit.client.0.smithi071.stderr: -375> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27ca660) adding con mode: crc 2024-09-14T11:32:12.853 INFO:tasks.workunit.client.0.smithi071.stderr: -374> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27ca660) adding con mode: secure 2024-09-14T11:32:12.853 INFO:tasks.workunit.client.0.smithi071.stderr: -373> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27ca660) adding con mode: crc 2024-09-14T11:32:12.854 INFO:tasks.workunit.client.0.smithi071.stderr: -372> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27ca660) adding con mode: secure 2024-09-14T11:32:12.854 INFO:tasks.workunit.client.0.smithi071.stderr: -371> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27ca660) adding con mode: crc 2024-09-14T11:32:12.854 INFO:tasks.workunit.client.0.smithi071.stderr: -370> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27ca660) adding con mode: crc 2024-09-14T11:32:12.854 INFO:tasks.workunit.client.0.smithi071.stderr: -369> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27ca660) adding con mode: secure 2024-09-14T11:32:12.854 INFO:tasks.workunit.client.0.smithi071.stderr: -368> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27ca660) adding con mode: crc 2024-09-14T11:32:12.854 INFO:tasks.workunit.client.0.smithi071.stderr: -367> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27ca660) adding con mode: secure 2024-09-14T11:32:12.854 INFO:tasks.workunit.client.0.smithi071.stderr: -366> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27ca660) adding con mode: crc 2024-09-14T11:32:12.854 INFO:tasks.workunit.client.0.smithi071.stderr: -365> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27ca660) adding con mode: secure 2024-09-14T11:32:12.854 INFO:tasks.workunit.client.0.smithi071.stderr: -364> 2024-09-14T11:32:12.526+0000 7f60f12109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:12.854 INFO:tasks.workunit.client.0.smithi071.stderr: -363> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 asok(0x55e9d2565d90) register_command objecter_requests cmddesc objecter_requests hook 0x55e9d27ce010 EEXIST 2024-09-14T11:32:12.854 INFO:tasks.workunit.client.0.smithi071.stderr: -362> 2024-09-14T11:32:12.526+0000 7f60f12109c0 10 monclient: init 2024-09-14T11:32:12.854 INFO:tasks.workunit.client.0.smithi071.stderr: -361> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27c9558) adding auth protocol: cephx 2024-09-14T11:32:12.854 INFO:tasks.workunit.client.0.smithi071.stderr: -360> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27c9558) adding auth protocol: cephx 2024-09-14T11:32:12.854 INFO:tasks.workunit.client.0.smithi071.stderr: -359> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27c9558) adding auth protocol: cephx 2024-09-14T11:32:12.855 INFO:tasks.workunit.client.0.smithi071.stderr: -358> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27c9558) adding con mode: secure 2024-09-14T11:32:12.855 INFO:tasks.workunit.client.0.smithi071.stderr: -357> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27c9558) adding con mode: crc 2024-09-14T11:32:12.855 INFO:tasks.workunit.client.0.smithi071.stderr: -356> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27c9558) adding con mode: secure 2024-09-14T11:32:12.855 INFO:tasks.workunit.client.0.smithi071.stderr: -355> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27c9558) adding con mode: crc 2024-09-14T11:32:12.855 INFO:tasks.workunit.client.0.smithi071.stderr: -354> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27c9558) adding con mode: secure 2024-09-14T11:32:12.855 INFO:tasks.workunit.client.0.smithi071.stderr: -353> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27c9558) adding con mode: crc 2024-09-14T11:32:12.855 INFO:tasks.workunit.client.0.smithi071.stderr: -352> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27c9558) adding con mode: crc 2024-09-14T11:32:12.855 INFO:tasks.workunit.client.0.smithi071.stderr: -351> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27c9558) adding con mode: secure 2024-09-14T11:32:12.855 INFO:tasks.workunit.client.0.smithi071.stderr: -350> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27c9558) adding con mode: crc 2024-09-14T11:32:12.855 INFO:tasks.workunit.client.0.smithi071.stderr: -349> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27c9558) adding con mode: secure 2024-09-14T11:32:12.855 INFO:tasks.workunit.client.0.smithi071.stderr: -348> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27c9558) adding con mode: crc 2024-09-14T11:32:12.855 INFO:tasks.workunit.client.0.smithi071.stderr: -347> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27c9558) adding con mode: secure 2024-09-14T11:32:12.855 INFO:tasks.workunit.client.0.smithi071.stderr: -346> 2024-09-14T11:32:12.526+0000 7f60f12109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:12.855 INFO:tasks.workunit.client.0.smithi071.stderr: -345> 2024-09-14T11:32:12.526+0000 7f60f12109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:12.856 INFO:tasks.workunit.client.0.smithi071.stderr: -344> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 asok(0x55e9d2565d90) register_command rotate-key cmddesc rotate-key hook 0x55e9d27c96a0 EEXIST 2024-09-14T11:32:12.856 INFO:tasks.workunit.client.0.smithi071.stderr: -343> 2024-09-14T11:32:12.526+0000 7f60f12109c0 10 monclient: _reopen_session rank -1 2024-09-14T11:32:12.856 INFO:tasks.workunit.client.0.smithi071.stderr: -342> 2024-09-14T11:32:12.526+0000 7f60f12109c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:32:12.856 INFO:tasks.workunit.client.0.smithi071.stderr: -341> 2024-09-14T11:32:12.526+0000 7f60f12109c0 10 monclient(hunting): picked mon.noname-a con 0x55e9d27f21c0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:32:12.856 INFO:tasks.workunit.client.0.smithi071.stderr: -340> 2024-09-14T11:32:12.526+0000 7f60f12109c0 10 monclient(hunting): picked mon.noname-b con 0x55e9d27f1af0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:32:12.856 INFO:tasks.workunit.client.0.smithi071.stderr: -339> 2024-09-14T11:32:12.526+0000 7f60f12109c0 10 monclient(hunting): picked mon.noname-c con 0x55e9d27f04d0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:32:12.856 INFO:tasks.workunit.client.0.smithi071.stderr: -338> 2024-09-14T11:32:12.526+0000 7f60f12109c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:12.856 INFO:tasks.workunit.client.0.smithi071.stderr: -337> 2024-09-14T11:32:12.526+0000 7f60f12109c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:12.856 INFO:tasks.workunit.client.0.smithi071.stderr: -336> 2024-09-14T11:32:12.526+0000 7f60f12109c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:12.856 INFO:tasks.workunit.client.0.smithi071.stderr: -335> 2024-09-14T11:32:12.526+0000 7f60f12109c0 10 monclient(hunting): _renew_subs 2024-09-14T11:32:12.856 INFO:tasks.workunit.client.0.smithi071.stderr: -334> 2024-09-14T11:32:12.526+0000 7f60f12109c0 10 monclient(hunting): authenticate will time out at 2344.647072s 2024-09-14T11:32:12.856 INFO:tasks.workunit.client.0.smithi071.stderr: -333> 2024-09-14T11:32:12.526+0000 7f60ee515640 10 monclient(hunting): get_auth_request con 0x55e9d27f21c0 auth_method 0 2024-09-14T11:32:12.856 INFO:tasks.workunit.client.0.smithi071.stderr: -332> 2024-09-14T11:32:12.526+0000 7f60ee515640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:12.857 INFO:tasks.workunit.client.0.smithi071.stderr: -331> 2024-09-14T11:32:12.526+0000 7f60ee515640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:12.857 INFO:tasks.workunit.client.0.smithi071.stderr: -330> 2024-09-14T11:32:12.526+0000 7f60ee515640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:12.857 INFO:tasks.workunit.client.0.smithi071.stderr: -329> 2024-09-14T11:32:12.526+0000 7f60eed16640 10 monclient(hunting): get_auth_request con 0x55e9d27f04d0 auth_method 0 2024-09-14T11:32:12.857 INFO:tasks.workunit.client.0.smithi071.stderr: -328> 2024-09-14T11:32:12.526+0000 7f60eed16640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:12.857 INFO:tasks.workunit.client.0.smithi071.stderr: -327> 2024-09-14T11:32:12.526+0000 7f60eed16640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:12.857 INFO:tasks.workunit.client.0.smithi071.stderr: -326> 2024-09-14T11:32:12.526+0000 7f60eed16640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:12.857 INFO:tasks.workunit.client.0.smithi071.stderr: -325> 2024-09-14T11:32:12.526+0000 7f60ee515640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:12.857 INFO:tasks.workunit.client.0.smithi071.stderr: -324> 2024-09-14T11:32:12.526+0000 7f60ee515640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:12.857 INFO:tasks.workunit.client.0.smithi071.stderr: -323> 2024-09-14T11:32:12.526+0000 7f60ee515640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:12.857 INFO:tasks.workunit.client.0.smithi071.stderr: -322> 2024-09-14T11:32:12.526+0000 7f60eed16640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:12.857 INFO:tasks.workunit.client.0.smithi071.stderr: -321> 2024-09-14T11:32:12.526+0000 7f60eed16640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:12.857 INFO:tasks.workunit.client.0.smithi071.stderr: -320> 2024-09-14T11:32:12.526+0000 7f60eed16640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:12.857 INFO:tasks.workunit.client.0.smithi071.stderr: -319> 2024-09-14T11:32:12.526+0000 7f60ef517640 10 monclient(hunting): get_auth_request con 0x55e9d27f1af0 auth_method 0 2024-09-14T11:32:12.857 INFO:tasks.workunit.client.0.smithi071.stderr: -318> 2024-09-14T11:32:12.526+0000 7f60ef517640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:12.858 INFO:tasks.workunit.client.0.smithi071.stderr: -317> 2024-09-14T11:32:12.526+0000 7f60ef517640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:12.858 INFO:tasks.workunit.client.0.smithi071.stderr: -316> 2024-09-14T11:32:12.526+0000 7f60ef517640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:12.858 INFO:tasks.workunit.client.0.smithi071.stderr: -315> 2024-09-14T11:32:12.526+0000 7f60ee515640 10 monclient(hunting): handle_auth_done global_id 7467 payload 824 2024-09-14T11:32:12.858 INFO:tasks.workunit.client.0.smithi071.stderr: -314> 2024-09-14T11:32:12.526+0000 7f60ee515640 10 monclient: _finish_hunting 0 2024-09-14T11:32:12.858 INFO:tasks.workunit.client.0.smithi071.stderr: -313> 2024-09-14T11:32:12.526+0000 7f60ee515640 1 monclient: found mon.noname-a 2024-09-14T11:32:12.858 INFO:tasks.workunit.client.0.smithi071.stderr: -312> 2024-09-14T11:32:12.526+0000 7f60ee515640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:32:12.858 INFO:tasks.workunit.client.0.smithi071.stderr: -311> 2024-09-14T11:32:12.526+0000 7f5fd8e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:12.858 INFO:tasks.workunit.client.0.smithi071.stderr: -310> 2024-09-14T11:32:12.526+0000 7f5fd8e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:32:12.858 INFO:tasks.workunit.client.0.smithi071.stderr: -309> 2024-09-14T11:32:12.526+0000 7f5fd8e01640 10 monclient: dump: 2024-09-14T11:32:12.858 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:12.858 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:12.858 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.858 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.859 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:12.859 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:12.859 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:12.859 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:12.859 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:12.859 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.859 INFO:tasks.workunit.client.0.smithi071.stderr: -308> 2024-09-14T11:32:12.526+0000 7f5fd8e01640 10 monclient: _finish_auth 0 2024-09-14T11:32:12.859 INFO:tasks.workunit.client.0.smithi071.stderr: -307> 2024-09-14T11:32:12.526+0000 7f5fd8e01640 10 monclient: _check_auth_tickets 2024-09-14T11:32:12.859 INFO:tasks.workunit.client.0.smithi071.stderr: -306> 2024-09-14T11:32:12.526+0000 7f5fd8e01640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:12.859 INFO:tasks.workunit.client.0.smithi071.stderr: -305> 2024-09-14T11:32:12.526+0000 7f5fd8e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:12.859 INFO:tasks.workunit.client.0.smithi071.stderr: -304> 2024-09-14T11:32:12.526+0000 7f5fd8e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:32:12.859 INFO:tasks.workunit.client.0.smithi071.stderr: -303> 2024-09-14T11:32:12.526+0000 7f5fd8e01640 10 monclient: dump: 2024-09-14T11:32:12.859 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:12.859 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:12.860 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.860 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.860 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:12.860 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:12.860 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:12.860 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:12.860 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:12.860 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.860 INFO:tasks.workunit.client.0.smithi071.stderr: -302> 2024-09-14T11:32:12.526+0000 7f60efd18640 4 set_mon_vals no callback set 2024-09-14T11:32:12.860 INFO:tasks.workunit.client.0.smithi071.stderr: -301> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 monclient: authenticate success, global_id 7467 2024-09-14T11:32:12.860 INFO:tasks.workunit.client.0.smithi071.stderr: -300> 2024-09-14T11:32:12.530+0000 7f60f12109c0 10 monclient: _renew_subs 2024-09-14T11:32:12.860 INFO:tasks.workunit.client.0.smithi071.stderr: -299> 2024-09-14T11:32:12.530+0000 7f60f12109c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:32:12.860 INFO:tasks.workunit.client.0.smithi071.stderr: -298> 2024-09-14T11:32:12.530+0000 7f60f12109c0 10 monclient: _renew_subs 2024-09-14T11:32:12.860 INFO:tasks.workunit.client.0.smithi071.stderr: -297> 2024-09-14T11:32:12.530+0000 7f60f12109c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:32:12.861 INFO:tasks.workunit.client.0.smithi071.stderr: -296> 2024-09-14T11:32:12.530+0000 7f5fd8e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:12.861 INFO:tasks.workunit.client.0.smithi071.stderr: -295> 2024-09-14T11:32:12.530+0000 7f5fd8e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:32:12.861 INFO:tasks.workunit.client.0.smithi071.stderr: -294> 2024-09-14T11:32:12.530+0000 7f5fd8e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:32:12.861 INFO:tasks.workunit.client.0.smithi071.stderr: -293> 2024-09-14T11:32:12.530+0000 7f60ef517640 10 monclient: get_auth_request con 0x7f5fc80717e0 auth_method 0 2024-09-14T11:32:12.861 INFO:tasks.workunit.client.0.smithi071.stderr: -292> 2024-09-14T11:32:12.530+0000 7f60f12109c0 10 monclient: get_monmap_and_config 2024-09-14T11:32:12.861 INFO:tasks.workunit.client.0.smithi071.stderr: -291> 2024-09-14T11:32:12.530+0000 7f60f12109c0 10 monclient: build_initial_monmap 2024-09-14T11:32:12.861 INFO:tasks.workunit.client.0.smithi071.stderr: -290> 2024-09-14T11:32:12.530+0000 7f60f12109c0 1 build_initial for_mkfs: 0 2024-09-14T11:32:12.861 INFO:tasks.workunit.client.0.smithi071.stderr: -289> 2024-09-14T11:32:12.530+0000 7f60f12109c0 10 monclient: monmap: 2024-09-14T11:32:12.861 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:32:12.861 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:12.861 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:32:12.861 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:32:12.862 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:12.862 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:12.862 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:32:12.862 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:32:12.862 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:32:12.862 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.862 INFO:tasks.workunit.client.0.smithi071.stderr: -288> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x55e9d28117e0) adding auth protocol: cephx 2024-09-14T11:32:12.862 INFO:tasks.workunit.client.0.smithi071.stderr: -287> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x55e9d28117e0) adding auth protocol: cephx 2024-09-14T11:32:12.862 INFO:tasks.workunit.client.0.smithi071.stderr: -286> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x55e9d28117e0) adding auth protocol: cephx 2024-09-14T11:32:12.862 INFO:tasks.workunit.client.0.smithi071.stderr: -285> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x55e9d28117e0) adding con mode: secure 2024-09-14T11:32:12.862 INFO:tasks.workunit.client.0.smithi071.stderr: -284> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x55e9d28117e0) adding con mode: crc 2024-09-14T11:32:12.862 INFO:tasks.workunit.client.0.smithi071.stderr: -283> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x55e9d28117e0) adding con mode: secure 2024-09-14T11:32:12.862 INFO:tasks.workunit.client.0.smithi071.stderr: -282> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x55e9d28117e0) adding con mode: crc 2024-09-14T11:32:12.862 INFO:tasks.workunit.client.0.smithi071.stderr: -281> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x55e9d28117e0) adding con mode: secure 2024-09-14T11:32:12.862 INFO:tasks.workunit.client.0.smithi071.stderr: -280> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x55e9d28117e0) adding con mode: crc 2024-09-14T11:32:12.863 INFO:tasks.workunit.client.0.smithi071.stderr: -279> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x55e9d28117e0) adding con mode: crc 2024-09-14T11:32:12.863 INFO:tasks.workunit.client.0.smithi071.stderr: -278> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x55e9d28117e0) adding con mode: secure 2024-09-14T11:32:12.863 INFO:tasks.workunit.client.0.smithi071.stderr: -277> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x55e9d28117e0) adding con mode: crc 2024-09-14T11:32:12.863 INFO:tasks.workunit.client.0.smithi071.stderr: -276> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x55e9d28117e0) adding con mode: secure 2024-09-14T11:32:12.863 INFO:tasks.workunit.client.0.smithi071.stderr: -275> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x55e9d28117e0) adding con mode: crc 2024-09-14T11:32:12.863 INFO:tasks.workunit.client.0.smithi071.stderr: -274> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x55e9d28117e0) adding con mode: secure 2024-09-14T11:32:12.863 INFO:tasks.workunit.client.0.smithi071.stderr: -273> 2024-09-14T11:32:12.530+0000 7f60f12109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:12.863 INFO:tasks.workunit.client.0.smithi071.stderr: -272> 2024-09-14T11:32:12.530+0000 7f60f12109c0 10 monclient: init 2024-09-14T11:32:12.863 INFO:tasks.workunit.client.0.smithi071.stderr: -271> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x7fff07516e90) adding auth protocol: cephx 2024-09-14T11:32:12.863 INFO:tasks.workunit.client.0.smithi071.stderr: -270> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x7fff07516e90) adding auth protocol: cephx 2024-09-14T11:32:12.863 INFO:tasks.workunit.client.0.smithi071.stderr: -269> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x7fff07516e90) adding auth protocol: cephx 2024-09-14T11:32:12.863 INFO:tasks.workunit.client.0.smithi071.stderr: -268> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x7fff07516e90) adding con mode: secure 2024-09-14T11:32:12.863 INFO:tasks.workunit.client.0.smithi071.stderr: -267> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x7fff07516e90) adding con mode: crc 2024-09-14T11:32:12.863 INFO:tasks.workunit.client.0.smithi071.stderr: -266> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x7fff07516e90) adding con mode: secure 2024-09-14T11:32:12.864 INFO:tasks.workunit.client.0.smithi071.stderr: -265> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x7fff07516e90) adding con mode: crc 2024-09-14T11:32:12.864 INFO:tasks.workunit.client.0.smithi071.stderr: -264> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x7fff07516e90) adding con mode: secure 2024-09-14T11:32:12.864 INFO:tasks.workunit.client.0.smithi071.stderr: -263> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x7fff07516e90) adding con mode: crc 2024-09-14T11:32:12.864 INFO:tasks.workunit.client.0.smithi071.stderr: -262> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x7fff07516e90) adding con mode: crc 2024-09-14T11:32:12.864 INFO:tasks.workunit.client.0.smithi071.stderr: -261> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x7fff07516e90) adding con mode: secure 2024-09-14T11:32:12.864 INFO:tasks.workunit.client.0.smithi071.stderr: -260> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x7fff07516e90) adding con mode: crc 2024-09-14T11:32:12.864 INFO:tasks.workunit.client.0.smithi071.stderr: -259> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x7fff07516e90) adding con mode: secure 2024-09-14T11:32:12.864 INFO:tasks.workunit.client.0.smithi071.stderr: -258> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x7fff07516e90) adding con mode: crc 2024-09-14T11:32:12.864 INFO:tasks.workunit.client.0.smithi071.stderr: -257> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x7fff07516e90) adding con mode: secure 2024-09-14T11:32:12.864 INFO:tasks.workunit.client.0.smithi071.stderr: -256> 2024-09-14T11:32:12.530+0000 7f60f12109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:12.864 INFO:tasks.workunit.client.0.smithi071.stderr: -255> 2024-09-14T11:32:12.530+0000 7f60f12109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:12.864 INFO:tasks.workunit.client.0.smithi071.stderr: -254> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 asok(0x55e9d2565d90) register_command rotate-key cmddesc rotate-key hook 0x7fff07516fd8 EEXIST 2024-09-14T11:32:12.864 INFO:tasks.workunit.client.0.smithi071.stderr: -253> 2024-09-14T11:32:12.530+0000 7f60f12109c0 10 monclient: _reopen_session rank -1 2024-09-14T11:32:12.865 INFO:tasks.workunit.client.0.smithi071.stderr: -252> 2024-09-14T11:32:12.530+0000 7f60f12109c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:32:12.865 INFO:tasks.workunit.client.0.smithi071.stderr: -251> 2024-09-14T11:32:12.530+0000 7f60f12109c0 10 monclient(hunting): picked mon.noname-a con 0x55e9d2845df0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:32:12.865 INFO:tasks.workunit.client.0.smithi071.stderr: -250> 2024-09-14T11:32:12.530+0000 7f60f12109c0 10 monclient(hunting): picked mon.noname-c con 0x55e9d2815810 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:32:12.865 INFO:tasks.workunit.client.0.smithi071.stderr: -249> 2024-09-14T11:32:12.530+0000 7f60f12109c0 10 monclient(hunting): picked mon.noname-b con 0x55e9d28415c0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:32:12.865 INFO:tasks.workunit.client.0.smithi071.stderr: -248> 2024-09-14T11:32:12.530+0000 7f60f12109c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:12.865 INFO:tasks.workunit.client.0.smithi071.stderr: -247> 2024-09-14T11:32:12.530+0000 7f60f12109c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:12.865 INFO:tasks.workunit.client.0.smithi071.stderr: -246> 2024-09-14T11:32:12.530+0000 7f60f12109c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:12.865 INFO:tasks.workunit.client.0.smithi071.stderr: -245> 2024-09-14T11:32:12.530+0000 7f60f12109c0 10 monclient(hunting): _renew_subs 2024-09-14T11:32:12.865 INFO:tasks.workunit.client.0.smithi071.stderr: -244> 2024-09-14T11:32:12.530+0000 7f60f12109c0 10 monclient(hunting): authenticate will time out at 2344.651252s 2024-09-14T11:32:12.865 INFO:tasks.workunit.client.0.smithi071.stderr: -243> 2024-09-14T11:32:12.530+0000 7f60ee515640 10 monclient(hunting): get_auth_request con 0x55e9d2845df0 auth_method 0 2024-09-14T11:32:12.865 INFO:tasks.workunit.client.0.smithi071.stderr: -242> 2024-09-14T11:32:12.530+0000 7f60ee515640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:12.865 INFO:tasks.workunit.client.0.smithi071.stderr: -241> 2024-09-14T11:32:12.530+0000 7f60ee515640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:12.866 INFO:tasks.workunit.client.0.smithi071.stderr: -240> 2024-09-14T11:32:12.530+0000 7f60ee515640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:12.866 INFO:tasks.workunit.client.0.smithi071.stderr: -239> 2024-09-14T11:32:12.530+0000 7f60ef517640 10 monclient(hunting): get_auth_request con 0x55e9d2815810 auth_method 0 2024-09-14T11:32:12.866 INFO:tasks.workunit.client.0.smithi071.stderr: -238> 2024-09-14T11:32:12.530+0000 7f60ef517640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:12.866 INFO:tasks.workunit.client.0.smithi071.stderr: -237> 2024-09-14T11:32:12.530+0000 7f60ef517640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:12.866 INFO:tasks.workunit.client.0.smithi071.stderr: -236> 2024-09-14T11:32:12.530+0000 7f60ef517640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:12.866 INFO:tasks.workunit.client.0.smithi071.stderr: -235> 2024-09-14T11:32:12.530+0000 7f60ee515640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:12.866 INFO:tasks.workunit.client.0.smithi071.stderr: -234> 2024-09-14T11:32:12.530+0000 7f60ee515640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:12.866 INFO:tasks.workunit.client.0.smithi071.stderr: -233> 2024-09-14T11:32:12.530+0000 7f60ee515640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:12.866 INFO:tasks.workunit.client.0.smithi071.stderr: -232> 2024-09-14T11:32:12.530+0000 7f60ef517640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:12.866 INFO:tasks.workunit.client.0.smithi071.stderr: -231> 2024-09-14T11:32:12.530+0000 7f60ef517640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:12.866 INFO:tasks.workunit.client.0.smithi071.stderr: -230> 2024-09-14T11:32:12.530+0000 7f60ef517640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:12.866 INFO:tasks.workunit.client.0.smithi071.stderr: -229> 2024-09-14T11:32:12.530+0000 7f60ee515640 10 monclient(hunting): handle_auth_done global_id 7470 payload 274 2024-09-14T11:32:12.866 INFO:tasks.workunit.client.0.smithi071.stderr: -228> 2024-09-14T11:32:12.530+0000 7f60ee515640 10 monclient: _finish_hunting 0 2024-09-14T11:32:12.866 INFO:tasks.workunit.client.0.smithi071.stderr: -227> 2024-09-14T11:32:12.530+0000 7f60ee515640 1 monclient: found mon.noname-a 2024-09-14T11:32:12.867 INFO:tasks.workunit.client.0.smithi071.stderr: -226> 2024-09-14T11:32:12.530+0000 7f60ee515640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:32:12.867 INFO:tasks.workunit.client.0.smithi071.stderr: -225> 2024-09-14T11:32:12.530+0000 7f5fd27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:12.867 INFO:tasks.workunit.client.0.smithi071.stderr: -224> 2024-09-14T11:32:12.530+0000 7f5fd27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:32:12.867 INFO:tasks.workunit.client.0.smithi071.stderr: -223> 2024-09-14T11:32:12.530+0000 7f5fd27fc640 10 monclient: dump: 2024-09-14T11:32:12.867 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:12.867 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:12.867 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.867 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.867 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:12.867 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:12.867 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:12.867 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:12.867 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:12.867 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.868 INFO:tasks.workunit.client.0.smithi071.stderr: -222> 2024-09-14T11:32:12.530+0000 7f5fd27fc640 10 monclient: _finish_auth 0 2024-09-14T11:32:12.868 INFO:tasks.workunit.client.0.smithi071.stderr: -221> 2024-09-14T11:32:12.530+0000 7f5fd27fc640 10 monclient: _check_auth_tickets 2024-09-14T11:32:12.868 INFO:tasks.workunit.client.0.smithi071.stderr: -220> 2024-09-14T11:32:12.530+0000 7f5fd27fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:12.868 INFO:tasks.workunit.client.0.smithi071.stderr: -219> 2024-09-14T11:32:12.530+0000 7f5fd27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:12.868 INFO:tasks.workunit.client.0.smithi071.stderr: -218> 2024-09-14T11:32:12.530+0000 7f5fd27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:32:12.868 INFO:tasks.workunit.client.0.smithi071.stderr: -217> 2024-09-14T11:32:12.530+0000 7f5fd27fc640 10 monclient: dump: 2024-09-14T11:32:12.868 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:12.868 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:12.868 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.868 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.868 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:12.868 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:12.868 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:12.868 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:12.869 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:12.869 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.869 INFO:tasks.workunit.client.0.smithi071.stderr: -216> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 monclient: authenticate success, global_id 7470 2024-09-14T11:32:12.869 INFO:tasks.workunit.client.0.smithi071.stderr: -215> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient: get_monmap_and_config success 2024-09-14T11:32:12.869 INFO:tasks.workunit.client.0.smithi071.stderr: -214> 2024-09-14T11:32:12.534+0000 7f60f12109c0 4 set_mon_vals no callback set 2024-09-14T11:32:12.869 INFO:tasks.workunit.client.0.smithi071.stderr: -213> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient: shutdown 2024-09-14T11:32:12.869 INFO:tasks.workunit.client.0.smithi071.stderr: -212> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient: build_initial_monmap 2024-09-14T11:32:12.869 INFO:tasks.workunit.client.0.smithi071.stderr: -211> 2024-09-14T11:32:12.534+0000 7f60f12109c0 1 build_initial for_mkfs: 0 2024-09-14T11:32:12.869 INFO:tasks.workunit.client.0.smithi071.stderr: -210> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient: monmap: 2024-09-14T11:32:12.869 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:32:12.869 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:12.869 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:32:12.869 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:32:12.870 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:12.870 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:12.870 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:32:12.870 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:32:12.870 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:32:12.870 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.870 INFO:tasks.workunit.client.0.smithi071.stderr: -209> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2836810) adding auth protocol: cephx 2024-09-14T11:32:12.870 INFO:tasks.workunit.client.0.smithi071.stderr: -208> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2836810) adding auth protocol: cephx 2024-09-14T11:32:12.870 INFO:tasks.workunit.client.0.smithi071.stderr: -207> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2836810) adding auth protocol: cephx 2024-09-14T11:32:12.870 INFO:tasks.workunit.client.0.smithi071.stderr: -206> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2836810) adding con mode: secure 2024-09-14T11:32:12.870 INFO:tasks.workunit.client.0.smithi071.stderr: -205> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2836810) adding con mode: crc 2024-09-14T11:32:12.870 INFO:tasks.workunit.client.0.smithi071.stderr: -204> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2836810) adding con mode: secure 2024-09-14T11:32:12.870 INFO:tasks.workunit.client.0.smithi071.stderr: -203> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2836810) adding con mode: crc 2024-09-14T11:32:12.870 INFO:tasks.workunit.client.0.smithi071.stderr: -202> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2836810) adding con mode: secure 2024-09-14T11:32:12.871 INFO:tasks.workunit.client.0.smithi071.stderr: -201> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2836810) adding con mode: crc 2024-09-14T11:32:12.871 INFO:tasks.workunit.client.0.smithi071.stderr: -200> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2836810) adding con mode: crc 2024-09-14T11:32:12.871 INFO:tasks.workunit.client.0.smithi071.stderr: -199> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2836810) adding con mode: secure 2024-09-14T11:32:12.871 INFO:tasks.workunit.client.0.smithi071.stderr: -198> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2836810) adding con mode: crc 2024-09-14T11:32:12.871 INFO:tasks.workunit.client.0.smithi071.stderr: -197> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2836810) adding con mode: secure 2024-09-14T11:32:12.871 INFO:tasks.workunit.client.0.smithi071.stderr: -196> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2836810) adding con mode: crc 2024-09-14T11:32:12.871 INFO:tasks.workunit.client.0.smithi071.stderr: -195> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2836810) adding con mode: secure 2024-09-14T11:32:12.871 INFO:tasks.workunit.client.0.smithi071.stderr: -194> 2024-09-14T11:32:12.534+0000 7f60f12109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:12.871 INFO:tasks.workunit.client.0.smithi071.stderr: -193> 2024-09-14T11:32:12.534+0000 7f60f12109c0 1 librados: starting msgr at 2024-09-14T11:32:12.871 INFO:tasks.workunit.client.0.smithi071.stderr: -192> 2024-09-14T11:32:12.534+0000 7f60f12109c0 1 librados: starting objecter 2024-09-14T11:32:12.871 INFO:tasks.workunit.client.0.smithi071.stderr: -191> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 asok(0x55e9d2565d90) register_command objecter_requests cmddesc objecter_requests hook 0x55e9d27f4ef0 EEXIST 2024-09-14T11:32:12.871 INFO:tasks.workunit.client.0.smithi071.stderr: -190> 2024-09-14T11:32:12.534+0000 7f60f12109c0 1 librados: setting wanted keys 2024-09-14T11:32:12.871 INFO:tasks.workunit.client.0.smithi071.stderr: -189> 2024-09-14T11:32:12.534+0000 7f60f12109c0 1 librados: calling monclient init 2024-09-14T11:32:12.871 INFO:tasks.workunit.client.0.smithi071.stderr: -188> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient: init 2024-09-14T11:32:12.872 INFO:tasks.workunit.client.0.smithi071.stderr: -187> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27f3fe0) adding auth protocol: cephx 2024-09-14T11:32:12.872 INFO:tasks.workunit.client.0.smithi071.stderr: -186> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27f3fe0) adding auth protocol: cephx 2024-09-14T11:32:12.872 INFO:tasks.workunit.client.0.smithi071.stderr: -185> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27f3fe0) adding auth protocol: cephx 2024-09-14T11:32:12.872 INFO:tasks.workunit.client.0.smithi071.stderr: -184> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27f3fe0) adding con mode: secure 2024-09-14T11:32:12.872 INFO:tasks.workunit.client.0.smithi071.stderr: -183> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27f3fe0) adding con mode: crc 2024-09-14T11:32:12.872 INFO:tasks.workunit.client.0.smithi071.stderr: -182> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27f3fe0) adding con mode: secure 2024-09-14T11:32:12.872 INFO:tasks.workunit.client.0.smithi071.stderr: -181> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27f3fe0) adding con mode: crc 2024-09-14T11:32:12.872 INFO:tasks.workunit.client.0.smithi071.stderr: -180> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27f3fe0) adding con mode: secure 2024-09-14T11:32:12.872 INFO:tasks.workunit.client.0.smithi071.stderr: -179> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27f3fe0) adding con mode: crc 2024-09-14T11:32:12.872 INFO:tasks.workunit.client.0.smithi071.stderr: -178> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27f3fe0) adding con mode: crc 2024-09-14T11:32:12.872 INFO:tasks.workunit.client.0.smithi071.stderr: -177> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27f3fe0) adding con mode: secure 2024-09-14T11:32:12.872 INFO:tasks.workunit.client.0.smithi071.stderr: -176> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27f3fe0) adding con mode: crc 2024-09-14T11:32:12.872 INFO:tasks.workunit.client.0.smithi071.stderr: -175> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27f3fe0) adding con mode: secure 2024-09-14T11:32:12.872 INFO:tasks.workunit.client.0.smithi071.stderr: -174> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27f3fe0) adding con mode: crc 2024-09-14T11:32:12.873 INFO:tasks.workunit.client.0.smithi071.stderr: -173> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27f3fe0) adding con mode: secure 2024-09-14T11:32:12.873 INFO:tasks.workunit.client.0.smithi071.stderr: -172> 2024-09-14T11:32:12.534+0000 7f60f12109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:12.873 INFO:tasks.workunit.client.0.smithi071.stderr: -171> 2024-09-14T11:32:12.534+0000 7f60f12109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:12.873 INFO:tasks.workunit.client.0.smithi071.stderr: -170> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 asok(0x55e9d2565d90) register_command rotate-key cmddesc rotate-key hook 0x55e9d27f4128 EEXIST 2024-09-14T11:32:12.873 INFO:tasks.workunit.client.0.smithi071.stderr: -169> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient: _reopen_session rank -1 2024-09-14T11:32:12.873 INFO:tasks.workunit.client.0.smithi071.stderr: -168> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:32:12.873 INFO:tasks.workunit.client.0.smithi071.stderr: -167> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient(hunting): picked mon.noname-c con 0x55e9d2815810 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:32:12.873 INFO:tasks.workunit.client.0.smithi071.stderr: -166> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient(hunting): picked mon.noname-b con 0x55e9d28415c0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:32:12.873 INFO:tasks.workunit.client.0.smithi071.stderr: -165> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient(hunting): picked mon.noname-a con 0x55e9d2845df0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:32:12.873 INFO:tasks.workunit.client.0.smithi071.stderr: -164> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:12.873 INFO:tasks.workunit.client.0.smithi071.stderr: -163> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:12.873 INFO:tasks.workunit.client.0.smithi071.stderr: -162> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:12.873 INFO:tasks.workunit.client.0.smithi071.stderr: -161> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient(hunting): _renew_subs 2024-09-14T11:32:12.873 INFO:tasks.workunit.client.0.smithi071.stderr: -160> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient(hunting): authenticate will time out at 2344.653870s 2024-09-14T11:32:12.874 INFO:tasks.workunit.client.0.smithi071.stderr: -159> 2024-09-14T11:32:12.534+0000 7f60ee515640 10 monclient(hunting): get_auth_request con 0x55e9d2815810 auth_method 0 2024-09-14T11:32:12.874 INFO:tasks.workunit.client.0.smithi071.stderr: -158> 2024-09-14T11:32:12.534+0000 7f60ee515640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:12.874 INFO:tasks.workunit.client.0.smithi071.stderr: -157> 2024-09-14T11:32:12.534+0000 7f60ee515640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:12.874 INFO:tasks.workunit.client.0.smithi071.stderr: -156> 2024-09-14T11:32:12.534+0000 7f60ee515640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:12.874 INFO:tasks.workunit.client.0.smithi071.stderr: -155> 2024-09-14T11:32:12.534+0000 7f60eed16640 10 monclient(hunting): get_auth_request con 0x55e9d2845df0 auth_method 0 2024-09-14T11:32:12.874 INFO:tasks.workunit.client.0.smithi071.stderr: -154> 2024-09-14T11:32:12.534+0000 7f60eed16640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:12.874 INFO:tasks.workunit.client.0.smithi071.stderr: -153> 2024-09-14T11:32:12.534+0000 7f60eed16640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:12.874 INFO:tasks.workunit.client.0.smithi071.stderr: -152> 2024-09-14T11:32:12.534+0000 7f60eed16640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:12.874 INFO:tasks.workunit.client.0.smithi071.stderr: -151> 2024-09-14T11:32:12.534+0000 7f60ee515640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:12.874 INFO:tasks.workunit.client.0.smithi071.stderr: -150> 2024-09-14T11:32:12.534+0000 7f60ee515640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:12.874 INFO:tasks.workunit.client.0.smithi071.stderr: -149> 2024-09-14T11:32:12.534+0000 7f60ee515640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:12.874 INFO:tasks.workunit.client.0.smithi071.stderr: -148> 2024-09-14T11:32:12.534+0000 7f60eed16640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:12.874 INFO:tasks.workunit.client.0.smithi071.stderr: -147> 2024-09-14T11:32:12.534+0000 7f60eed16640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:12.874 INFO:tasks.workunit.client.0.smithi071.stderr: -146> 2024-09-14T11:32:12.534+0000 7f60eed16640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:12.875 INFO:tasks.workunit.client.0.smithi071.stderr: -145> 2024-09-14T11:32:12.534+0000 7f60eed16640 10 monclient(hunting): handle_auth_done global_id 7473 payload 824 2024-09-14T11:32:12.875 INFO:tasks.workunit.client.0.smithi071.stderr: -144> 2024-09-14T11:32:12.534+0000 7f60eed16640 10 monclient: _finish_hunting 0 2024-09-14T11:32:12.875 INFO:tasks.workunit.client.0.smithi071.stderr: -143> 2024-09-14T11:32:12.534+0000 7f60eed16640 1 monclient: found mon.noname-a 2024-09-14T11:32:12.875 INFO:tasks.workunit.client.0.smithi071.stderr: -142> 2024-09-14T11:32:12.534+0000 7f60eed16640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:32:12.875 INFO:tasks.workunit.client.0.smithi071.stderr: -141> 2024-09-14T11:32:12.534+0000 7f5fd0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:12.875 INFO:tasks.workunit.client.0.smithi071.stderr: -140> 2024-09-14T11:32:12.534+0000 7f5fd0ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:32:12.875 INFO:tasks.workunit.client.0.smithi071.stderr: -139> 2024-09-14T11:32:12.534+0000 7f5fd0ff9640 10 monclient: dump: 2024-09-14T11:32:12.875 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:12.875 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:12.875 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.875 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.875 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:12.875 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:12.875 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:12.876 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:12.876 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:12.876 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.876 INFO:tasks.workunit.client.0.smithi071.stderr: -138> 2024-09-14T11:32:12.534+0000 7f5fd0ff9640 10 monclient: _finish_auth 0 2024-09-14T11:32:12.876 INFO:tasks.workunit.client.0.smithi071.stderr: -137> 2024-09-14T11:32:12.534+0000 7f5fd0ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:32:12.876 INFO:tasks.workunit.client.0.smithi071.stderr: -136> 2024-09-14T11:32:12.534+0000 7f5fd0ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:12.876 INFO:tasks.workunit.client.0.smithi071.stderr: -135> 2024-09-14T11:32:12.534+0000 7f5fd0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:12.876 INFO:tasks.workunit.client.0.smithi071.stderr: -134> 2024-09-14T11:32:12.534+0000 7f5fd0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:32:12.876 INFO:tasks.workunit.client.0.smithi071.stderr: -133> 2024-09-14T11:32:12.534+0000 7f5fd0ff9640 10 monclient: dump: 2024-09-14T11:32:12.876 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:12.876 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:12.876 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.876 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.876 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:12.877 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:12.877 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:12.877 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:12.877 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:12.877 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.877 INFO:tasks.workunit.client.0.smithi071.stderr: -132> 2024-09-14T11:32:12.534+0000 7f5fd27fc640 4 set_mon_vals no callback set 2024-09-14T11:32:12.877 INFO:tasks.workunit.client.0.smithi071.stderr: -131> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 monclient: authenticate success, global_id 7473 2024-09-14T11:32:12.877 INFO:tasks.workunit.client.0.smithi071.stderr: -130> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient: _renew_subs 2024-09-14T11:32:12.877 INFO:tasks.workunit.client.0.smithi071.stderr: -129> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:32:12.877 INFO:tasks.workunit.client.0.smithi071.stderr: -128> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient: _renew_subs 2024-09-14T11:32:12.877 INFO:tasks.workunit.client.0.smithi071.stderr: -127> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:32:12.877 INFO:tasks.workunit.client.0.smithi071.stderr: -126> 2024-09-14T11:32:12.534+0000 7f60f12109c0 1 librados: init done 2024-09-14T11:32:12.877 INFO:tasks.workunit.client.0.smithi071.stderr: -125> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 asok(0x55e9d2565d90) register_command cr dump hook 0x55e9d283d5a8 2024-09-14T11:32:12.877 INFO:tasks.workunit.client.0.smithi071.stderr: -124> 2024-09-14T11:32:12.538+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.878 INFO:tasks.workunit.client.0.smithi071.stderr: -123> 2024-09-14T11:32:12.538+0000 7f5fd0ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:12.878 INFO:tasks.workunit.client.0.smithi071.stderr: -122> 2024-09-14T11:32:12.538+0000 7f5fd0ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:32:12.878 INFO:tasks.workunit.client.0.smithi071.stderr: -121> 2024-09-14T11:32:12.538+0000 7f5fd0ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:32:12.878 INFO:tasks.workunit.client.0.smithi071.stderr: -120> 2024-09-14T11:32:12.538+0000 7f60ee515640 10 monclient: get_auth_request con 0x7f5fb80718d0 auth_method 0 2024-09-14T11:32:12.878 INFO:tasks.workunit.client.0.smithi071.stderr: -119> 2024-09-14T11:32:12.538+0000 7f60ef517640 10 monclient: get_auth_request con 0x55e9d285f790 auth_method 0 2024-09-14T11:32:12.878 INFO:tasks.workunit.client.0.smithi071.stderr: -118> 2024-09-14T11:32:12.538+0000 7f60f12109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.878 INFO:tasks.workunit.client.0.smithi071.stderr: -117> 2024-09-14T11:32:12.538+0000 7f60f12109c0 20 realm 2024-09-14T11:32:12.878 INFO:tasks.workunit.client.0.smithi071.stderr: -116> 2024-09-14T11:32:12.538+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.878 INFO:tasks.workunit.client.0.smithi071.stderr: -115> 2024-09-14T11:32:12.538+0000 7f60f12109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.878 INFO:tasks.workunit.client.0.smithi071.stderr: -114> 2024-09-14T11:32:12.538+0000 7f60f12109c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:12.878 INFO:tasks.workunit.client.0.smithi071.stderr: -113> 2024-09-14T11:32:12.538+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.878 INFO:tasks.workunit.client.0.smithi071.stderr: -112> 2024-09-14T11:32:12.542+0000 7f60f12109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.878 INFO:tasks.workunit.client.0.smithi071.stderr: -111> 2024-09-14T11:32:12.542+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.878 INFO:tasks.workunit.client.0.smithi071.stderr: -110> 2024-09-14T11:32:12.542+0000 7f60ee515640 10 monclient: get_auth_request con 0x55e9d2863890 auth_method 0 2024-09-14T11:32:12.878 INFO:tasks.workunit.client.0.smithi071.stderr: -109> 2024-09-14T11:32:12.542+0000 7f60f12109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:12.879 INFO:tasks.workunit.client.0.smithi071.stderr: -108> 2024-09-14T11:32:12.542+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.879 INFO:tasks.workunit.client.0.smithi071.stderr: -107> 2024-09-14T11:32:12.542+0000 7f60ef517640 10 monclient: get_auth_request con 0x55e9d28670d0 auth_method 0 2024-09-14T11:32:12.879 INFO:tasks.workunit.client.0.smithi071.stderr: -106> 2024-09-14T11:32:12.542+0000 7f60f12109c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:12.879 INFO:tasks.workunit.client.0.smithi071.stderr: -105> 2024-09-14T11:32:12.542+0000 7f60f12109c0 20 searching for the correct realm 2024-09-14T11:32:12.879 INFO:tasks.workunit.client.0.smithi071.stderr: -104> 2024-09-14T11:32:12.542+0000 7f60eed16640 10 monclient: get_auth_request con 0x55e9d286bdd0 auth_method 0 2024-09-14T11:32:12.879 INFO:tasks.workunit.client.0.smithi071.stderr: -103> 2024-09-14T11:32:12.542+0000 7f60ee515640 10 monclient: get_auth_request con 0x7f60e0038020 auth_method 0 2024-09-14T11:32:12.879 INFO:tasks.workunit.client.0.smithi071.stderr: -102> 2024-09-14T11:32:12.546+0000 7f60ef517640 10 monclient: get_auth_request con 0x7f60d8048cc0 auth_method 0 2024-09-14T11:32:12.879 INFO:tasks.workunit.client.0.smithi071.stderr: -101> 2024-09-14T11:32:12.546+0000 7f60eed16640 0 -- 172.21.15.71:0/1224989318 >> [v2:172.21.15.157:6808/527702018,v1:172.21.15.157:6809/527702018] conn(0x7f60e00656f0 msgr2=0x7f60e006e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:12.879 INFO:tasks.workunit.client.0.smithi071.stderr: -100> 2024-09-14T11:32:12.750+0000 7f60eed16640 10 monclient: get_auth_request con 0x7f60e00656f0 auth_method 0 2024-09-14T11:32:12.879 INFO:tasks.workunit.client.0.smithi071.stderr: -99> 2024-09-14T11:32:12.754+0000 7f60ee515640 10 monclient: get_auth_request con 0x7f60d801a040 auth_method 0 2024-09-14T11:32:12.879 INFO:tasks.workunit.client.0.smithi071.stderr: -98> 2024-09-14T11:32:12.762+0000 7f60eed16640 0 -- 172.21.15.71:0/1224989318 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x55e9d286bdd0 msgr2=0x55e9d286e290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:12.879 INFO:tasks.workunit.client.0.smithi071.stderr: -97> 2024-09-14T11:32:12.762+0000 7f5fd0ff9640 1 client.7473.objecter ms_handle_reset 0x55e9d286bdd0 session 0x55e9d286b750 osd.4 2024-09-14T11:32:12.879 INFO:tasks.workunit.client.0.smithi071.stderr: -96> 2024-09-14T11:32:12.762+0000 7f5fd0ff9640 10 monclient: _renew_subs 2024-09-14T11:32:12.879 INFO:tasks.workunit.client.0.smithi071.stderr: -95> 2024-09-14T11:32:12.762+0000 7f5fd0ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:32:12.880 INFO:tasks.workunit.client.0.smithi071.stderr: -94> 2024-09-14T11:32:12.762+0000 7f60eed16640 10 monclient: get_auth_request con 0x7f5fb80813f0 auth_method 0 2024-09-14T11:32:12.880 INFO:tasks.workunit.client.0.smithi071.stderr: -93> 2024-09-14T11:32:12.770+0000 7f60f12109c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:12.880 INFO:tasks.workunit.client.0.smithi071.stderr: -92> 2024-09-14T11:32:12.770+0000 7f60f12109c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:32:12.880 INFO:tasks.workunit.client.0.smithi071.stderr: -91> 2024-09-14T11:32:12.770+0000 7f60f12109c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:12.880 INFO:tasks.workunit.client.0.smithi071.stderr: -90> 2024-09-14T11:32:12.770+0000 7f60f12109c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:32:12.880 INFO:tasks.workunit.client.0.smithi071.stderr: -89> 2024-09-14T11:32:12.770+0000 7f60f12109c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:12.880 INFO:tasks.workunit.client.0.smithi071.stderr: -88> 2024-09-14T11:32:12.770+0000 7f60f12109c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:12.880 INFO:tasks.workunit.client.0.smithi071.stderr: -87> 2024-09-14T11:32:12.770+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.880 INFO:tasks.workunit.client.0.smithi071.stderr: -86> 2024-09-14T11:32:12.770+0000 7f60f12109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.880 INFO:tasks.workunit.client.0.smithi071.stderr: -85> 2024-09-14T11:32:12.770+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.880 INFO:tasks.workunit.client.0.smithi071.stderr: -84> 2024-09-14T11:32:12.774+0000 7f60f12109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:12.880 INFO:tasks.workunit.client.0.smithi071.stderr: -83> 2024-09-14T11:32:12.774+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.880 INFO:tasks.workunit.client.0.smithi071.stderr: -82> 2024-09-14T11:32:12.774+0000 7f60f12109c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:12.880 INFO:tasks.workunit.client.0.smithi071.stderr: -81> 2024-09-14T11:32:12.774+0000 7f60f12109c0 20 zone default found 2024-09-14T11:32:12.881 INFO:tasks.workunit.client.0.smithi071.stderr: -80> 2024-09-14T11:32:12.774+0000 7f60f12109c0 4 Realm: () 2024-09-14T11:32:12.881 INFO:tasks.workunit.client.0.smithi071.stderr: -79> 2024-09-14T11:32:12.774+0000 7f60f12109c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:32:12.881 INFO:tasks.workunit.client.0.smithi071.stderr: -78> 2024-09-14T11:32:12.774+0000 7f60f12109c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:32:12.881 INFO:tasks.workunit.client.0.smithi071.stderr: -77> 2024-09-14T11:32:12.774+0000 7f60f12109c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:12.881 INFO:tasks.workunit.client.0.smithi071.stderr: -76> 2024-09-14T11:32:12.774+0000 7f60f12109c0 20 zonegroup default 2024-09-14T11:32:12.881 INFO:tasks.workunit.client.0.smithi071.stderr: -75> 2024-09-14T11:32:12.774+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.881 INFO:tasks.workunit.client.0.smithi071.stderr: -74> 2024-09-14T11:32:12.774+0000 7f60f12109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.881 INFO:tasks.workunit.client.0.smithi071.stderr: -73> 2024-09-14T11:32:12.774+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.881 INFO:tasks.workunit.client.0.smithi071.stderr: -72> 2024-09-14T11:32:12.774+0000 7f60f12109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.881 INFO:tasks.workunit.client.0.smithi071.stderr: -71> 2024-09-14T11:32:12.774+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.881 INFO:tasks.workunit.client.0.smithi071.stderr: -70> 2024-09-14T11:32:12.778+0000 7f60f12109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.881 INFO:tasks.workunit.client.0.smithi071.stderr: -69> 2024-09-14T11:32:12.778+0000 7f60f12109c0 20 started sync module instance, tier type = 2024-09-14T11:32:12.881 INFO:tasks.workunit.client.0.smithi071.stderr: -68> 2024-09-14T11:32:12.778+0000 7f60f12109c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:32:12.881 INFO:tasks.workunit.client.0.smithi071.stderr: -67> 2024-09-14T11:32:12.798+0000 7f60f12109c0 20 add_watcher() i=0 2024-09-14T11:32:12.882 INFO:tasks.workunit.client.0.smithi071.stderr: -66> 2024-09-14T11:32:12.798+0000 7f60f12109c0 20 add_watcher() i=1 2024-09-14T11:32:12.882 INFO:tasks.workunit.client.0.smithi071.stderr: -65> 2024-09-14T11:32:12.798+0000 7f60f12109c0 20 add_watcher() i=2 2024-09-14T11:32:12.882 INFO:tasks.workunit.client.0.smithi071.stderr: -64> 2024-09-14T11:32:12.798+0000 7f60f12109c0 20 add_watcher() i=3 2024-09-14T11:32:12.882 INFO:tasks.workunit.client.0.smithi071.stderr: -63> 2024-09-14T11:32:12.798+0000 7f60f12109c0 20 add_watcher() i=4 2024-09-14T11:32:12.882 INFO:tasks.workunit.client.0.smithi071.stderr: -62> 2024-09-14T11:32:12.798+0000 7f60f12109c0 20 add_watcher() i=5 2024-09-14T11:32:12.882 INFO:tasks.workunit.client.0.smithi071.stderr: -61> 2024-09-14T11:32:12.798+0000 7f60f12109c0 20 add_watcher() i=6 2024-09-14T11:32:12.882 INFO:tasks.workunit.client.0.smithi071.stderr: -60> 2024-09-14T11:32:12.802+0000 7f60f12109c0 20 add_watcher() i=7 2024-09-14T11:32:12.882 INFO:tasks.workunit.client.0.smithi071.stderr: -59> 2024-09-14T11:32:12.802+0000 7f60f12109c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:12.882 INFO:tasks.workunit.client.0.smithi071.stderr: -58> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 AuthRegistry(0x7fff07517370) adding auth protocol: cephx 2024-09-14T11:32:12.882 INFO:tasks.workunit.client.0.smithi071.stderr: -57> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 AuthRegistry(0x7fff07517370) adding auth protocol: cephx 2024-09-14T11:32:12.882 INFO:tasks.workunit.client.0.smithi071.stderr: -56> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 AuthRegistry(0x7fff07517370) adding auth protocol: cephx 2024-09-14T11:32:12.882 INFO:tasks.workunit.client.0.smithi071.stderr: -55> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 AuthRegistry(0x7fff07517370) adding con mode: secure 2024-09-14T11:32:12.882 INFO:tasks.workunit.client.0.smithi071.stderr: -54> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 AuthRegistry(0x7fff07517370) adding con mode: crc 2024-09-14T11:32:12.882 INFO:tasks.workunit.client.0.smithi071.stderr: -53> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 AuthRegistry(0x7fff07517370) adding con mode: secure 2024-09-14T11:32:12.882 INFO:tasks.workunit.client.0.smithi071.stderr: -52> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 AuthRegistry(0x7fff07517370) adding con mode: crc 2024-09-14T11:32:12.883 INFO:tasks.workunit.client.0.smithi071.stderr: -51> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 AuthRegistry(0x7fff07517370) adding con mode: secure 2024-09-14T11:32:12.883 INFO:tasks.workunit.client.0.smithi071.stderr: -50> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 AuthRegistry(0x7fff07517370) adding con mode: crc 2024-09-14T11:32:12.883 INFO:tasks.workunit.client.0.smithi071.stderr: -49> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 AuthRegistry(0x7fff07517370) adding con mode: crc 2024-09-14T11:32:12.883 INFO:tasks.workunit.client.0.smithi071.stderr: -48> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 AuthRegistry(0x7fff07517370) adding con mode: secure 2024-09-14T11:32:12.883 INFO:tasks.workunit.client.0.smithi071.stderr: -47> 2024-09-14T11:32:12.806+0000 7f5fa57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:12.883 INFO:tasks.workunit.client.0.smithi071.stderr: -46> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 AuthRegistry(0x7fff07517370) adding con mode: crc 2024-09-14T11:32:12.883 INFO:tasks.workunit.client.0.smithi071.stderr: -45> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 AuthRegistry(0x7fff07517370) adding con mode: secure 2024-09-14T11:32:12.883 INFO:tasks.workunit.client.0.smithi071.stderr: -44> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 AuthRegistry(0x7fff07517370) adding con mode: crc 2024-09-14T11:32:12.883 INFO:tasks.workunit.client.0.smithi071.stderr: -43> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 AuthRegistry(0x7fff07517370) adding con mode: secure 2024-09-14T11:32:12.883 INFO:tasks.workunit.client.0.smithi071.stderr: -42> 2024-09-14T11:32:12.806+0000 7f60f12109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:12.883 INFO:tasks.workunit.client.0.smithi071.stderr: -41> 2024-09-14T11:32:12.806+0000 7f60f12109c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:12.883 INFO:tasks.workunit.client.0.smithi071.stderr: -40> 2024-09-14T11:32:12.806+0000 7f60f12109c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:12.883 INFO:tasks.workunit.client.0.smithi071.stderr: -39> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 asok(0x55e9d2565d90) register_command cache list hook 0x55e9d2845370 2024-09-14T11:32:12.883 INFO:tasks.workunit.client.0.smithi071.stderr: -38> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 asok(0x55e9d2565d90) register_command cache inspect hook 0x55e9d2845370 2024-09-14T11:32:12.883 INFO:tasks.workunit.client.0.smithi071.stderr: -37> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 asok(0x55e9d2565d90) register_command cache erase hook 0x55e9d2845370 2024-09-14T11:32:12.884 INFO:tasks.workunit.client.0.smithi071.stderr: -36> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 asok(0x55e9d2565d90) register_command cache zap hook 0x55e9d2845370 2024-09-14T11:32:12.884 INFO:tasks.workunit.client.0.smithi071.stderr: -35> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 note: GC not initialized 2024-09-14T11:32:12.884 INFO:tasks.workunit.client.0.smithi071.stderr: -34> 2024-09-14T11:32:12.806+0000 7f5f1ffff640 20 reqs_thread_entry: start 2024-09-14T11:32:12.884 INFO:tasks.workunit.client.0.smithi071.stderr: -33> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 asok(0x55e9d2565d90) register_command sync trace show hook 0x7f60d8084070 2024-09-14T11:32:12.884 INFO:tasks.workunit.client.0.smithi071.stderr: -32> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 asok(0x55e9d2565d90) register_command sync trace history hook 0x7f60d8084070 2024-09-14T11:32:12.884 INFO:tasks.workunit.client.0.smithi071.stderr: -31> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 asok(0x55e9d2565d90) register_command sync trace active hook 0x7f60d8084070 2024-09-14T11:32:12.884 INFO:tasks.workunit.client.0.smithi071.stderr: -30> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 asok(0x55e9d2565d90) register_command sync trace active_short hook 0x7f60d8084070 2024-09-14T11:32:12.884 INFO:tasks.workunit.client.0.smithi071.stderr: -29> 2024-09-14T11:32:12.806+0000 7f60f12109c0 20 init_complete bucket index max shards: 11 2024-09-14T11:32:12.884 INFO:tasks.workunit.client.0.smithi071.stderr: -28> 2024-09-14T11:32:12.806+0000 7f60f12109c0 20 Filter name: none 2024-09-14T11:32:12.884 INFO:tasks.workunit.client.0.smithi071.stderr: -27> 2024-09-14T11:32:12.806+0000 7f5f1dffb640 20 reqs_thread_entry: start 2024-09-14T11:32:12.884 INFO:tasks.workunit.client.0.smithi071.stderr: -26> 2024-09-14T11:32:12.806+0000 7f60f12109c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:32:12.884 INFO:tasks.workunit.client.0.smithi071.stderr: -25> 2024-09-14T11:32:12.806+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.885 INFO:tasks.workunit.client.0.smithi071.stderr: -24> 2024-09-14T11:32:12.806+0000 7f60f12109c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:12.885 INFO:tasks.workunit.client.0.smithi071.stderr: -23> 2024-09-14T11:32:12.806+0000 7f60f12109c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:32:12.885 INFO:tasks.workunit.client.0.smithi071.stderr: -22> 2024-09-14T11:32:12.806+0000 7f60f12109c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:32:12.885 INFO:tasks.workunit.client.0.smithi071.stderr: -21> 2024-09-14T11:32:12.806+0000 7f60f12109c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 : miss 2024-09-14T11:32:12.885 INFO:tasks.workunit.client.0.smithi071.stderr: -20> 2024-09-14T11:32:12.806+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.885 INFO:tasks.workunit.client.0.smithi071.stderr: -19> 2024-09-14T11:32:12.810+0000 7f60f12109c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:12.885 INFO:tasks.workunit.client.0.smithi071.stderr: -18> 2024-09-14T11:32:12.810+0000 7f60f12109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 info.flags=0x17 2024-09-14T11:32:12.885 INFO:tasks.workunit.client.0.smithi071.stderr: -17> 2024-09-14T11:32:12.810+0000 7f60f12109c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 to cache LRU end 2024-09-14T11:32:12.885 INFO:tasks.workunit.client.0.smithi071.stderr: -16> 2024-09-14T11:32:12.810+0000 7f60f12109c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:12.885 INFO:tasks.workunit.client.0.smithi071.stderr: -15> 2024-09-14T11:32:12.810+0000 7f60f12109c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:12.885 INFO:tasks.workunit.client.0.smithi071.stderr: -14> 2024-09-14T11:32:12.810+0000 7f60f12109c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 2024-09-14T11:32:12.885 INFO:tasks.workunit.client.0.smithi071.stderr: -13> 2024-09-14T11:32:12.818+0000 7f60f12109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 info.flags=0x17 2024-09-14T11:32:12.886 INFO:tasks.workunit.client.0.smithi071.stderr: -12> 2024-09-14T11:32:12.818+0000 7f60f12109c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 to cache LRU end 2024-09-14T11:32:12.886 INFO:tasks.workunit.client.0.smithi071.stderr: -11> 2024-09-14T11:32:12.818+0000 7f60f12109c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:12.886 INFO:tasks.workunit.client.0.smithi071.stderr: -10> 2024-09-14T11:32:12.818+0000 7f60f12109c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35, ofs0, ns] 2024-09-14T11:32:12.886 INFO:tasks.workunit.client.0.smithi071.stderr: -9> 2024-09-14T11:32:12.818+0000 7f5fd27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464281 cookie 94462747794768 notifier 7473 bl.length()=995 2024-09-14T11:32:12.886 INFO:tasks.workunit.client.0.smithi071.stderr: -8> 2024-09-14T11:32:12.818+0000 7f5fd27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 info.flags=0x17 2024-09-14T11:32:12.886 INFO:tasks.workunit.client.0.smithi071.stderr: -7> 2024-09-14T11:32:12.818+0000 7f5fd27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 to cache LRU end 2024-09-14T11:32:12.886 INFO:tasks.workunit.client.0.smithi071.stderr: -6> 2024-09-14T11:32:12.818+0000 7f5fd27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:12.886 INFO:tasks.workunit.client.0.smithi071.stderr: -5> 2024-09-14T11:32:12.818+0000 7f60f12109c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.35]): orig_sources= new_sources= 2024-09-14T11:32:12.886 INFO:tasks.workunit.client.0.smithi071.stderr: -4> 2024-09-14T11:32:12.818+0000 7f60f12109c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.35]): potential sources added=[] removed=[] 2024-09-14T11:32:12.886 INFO:tasks.workunit.client.0.smithi071.stderr: -3> 2024-09-14T11:32:12.818+0000 7f60f12109c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.35]): orig_dests= new_dests= 2024-09-14T11:32:12.886 INFO:tasks.workunit.client.0.smithi071.stderr: -2> 2024-09-14T11:32:12.818+0000 7f60f12109c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.35]): potential dests added=[] removed=[] 2024-09-14T11:32:12.886 INFO:tasks.workunit.client.0.smithi071.stderr: -1> 2024-09-14T11:32:12.834+0000 7f60f12109c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f60f12109c0 time 2024-09-14T11:32:12.834083+0000 2024-09-14T11:32:12.886 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:32:12.887 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.887 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:12.887 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f60f4aea2eb] 2024-09-14T11:32:12.887 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f60f4aea49f] 2024-09-14T11:32:12.887 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e9d10e8c01] 2024-09-14T11:32:12.887 INFO:tasks.workunit.client.0.smithi071.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e9d10fdf3a] 2024-09-14T11:32:12.887 INFO:tasks.workunit.client.0.smithi071.stderr: 5: main() 2024-09-14T11:32:12.887 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f60f3950d90] 2024-09-14T11:32:12.887 INFO:tasks.workunit.client.0.smithi071.stderr: 7: __libc_start_main() 2024-09-14T11:32:12.887 INFO:tasks.workunit.client.0.smithi071.stderr: 8: _start() 2024-09-14T11:32:12.887 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.887 INFO:tasks.workunit.client.0.smithi071.stderr: 0> 2024-09-14T11:32:12.834+0000 7f60f12109c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:32:12.887 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f60f12109c0 thread_name:radosgw-admin 2024-09-14T11:32:12.887 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.888 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:12.888 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f60f3969520] 2024-09-14T11:32:12.888 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:32:12.888 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:32:12.888 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:32:12.888 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f60f4aea345] 2024-09-14T11:32:12.888 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f60f4aea49f] 2024-09-14T11:32:12.888 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e9d10e8c01] 2024-09-14T11:32:12.888 INFO:tasks.workunit.client.0.smithi071.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e9d10fdf3a] 2024-09-14T11:32:12.888 INFO:tasks.workunit.client.0.smithi071.stderr: 9: main() 2024-09-14T11:32:12.888 INFO:tasks.workunit.client.0.smithi071.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f60f3950d90] 2024-09-14T11:32:12.888 INFO:tasks.workunit.client.0.smithi071.stderr: 11: __libc_start_main() 2024-09-14T11:32:12.888 INFO:tasks.workunit.client.0.smithi071.stderr: 12: _start() 2024-09-14T11:32:12.889 INFO:tasks.workunit.client.0.smithi071.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:32:12.889 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.889 INFO:tasks.workunit.client.0.smithi071.stderr:--- logging levels --- 2024-09-14T11:32:12.889 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 none 2024-09-14T11:32:12.889 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 lockdep 2024-09-14T11:32:12.889 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 context 2024-09-14T11:32:12.889 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 crush 2024-09-14T11:32:12.889 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds 2024-09-14T11:32:12.889 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_balancer 2024-09-14T11:32:12.889 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_locker 2024-09-14T11:32:12.889 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log 2024-09-14T11:32:12.889 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log_expire 2024-09-14T11:32:12.889 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_migrator 2024-09-14T11:32:12.889 INFO:tasks.workunit.client.0.smithi071.stderr: 3/ 5 mds_quiesce 2024-09-14T11:32:12.889 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 buffer 2024-09-14T11:32:12.890 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 timer 2024-09-14T11:32:12.890 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 filer 2024-09-14T11:32:12.890 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 striper 2024-09-14T11:32:12.890 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 objecter 2024-09-14T11:32:12.890 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rados 2024-09-14T11:32:12.890 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd 2024-09-14T11:32:12.890 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_mirror 2024-09-14T11:32:12.890 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_replay 2024-09-14T11:32:12.890 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_pwl 2024-09-14T11:32:12.890 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 journaler 2024-09-14T11:32:12.890 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objectcacher 2024-09-14T11:32:12.890 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:32:12.890 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 client 2024-09-14T11:32:12.890 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 osd 2024-09-14T11:32:12.890 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 optracker 2024-09-14T11:32:12.891 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objclass 2024-09-14T11:32:12.891 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 filestore 2024-09-14T11:32:12.891 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 journal 2024-09-14T11:32:12.891 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 ms 2024-09-14T11:32:12.891 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mon 2024-09-14T11:32:12.891 INFO:tasks.workunit.client.0.smithi071.stderr: 0/10 monc 2024-09-14T11:32:12.891 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 paxos 2024-09-14T11:32:12.891 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 tp 2024-09-14T11:32:12.891 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 auth 2024-09-14T11:32:12.891 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 crypto 2024-09-14T11:32:12.891 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 finisher 2024-09-14T11:32:12.891 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 reserver 2024-09-14T11:32:12.891 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 heartbeatmap 2024-09-14T11:32:12.891 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 perfcounter 2024-09-14T11:32:12.892 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw 2024-09-14T11:32:12.892 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_sync 2024-09-14T11:32:12.892 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_datacache 2024-09-14T11:32:12.892 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_access 2024-09-14T11:32:12.892 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:32:12.892 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_flight 2024-09-14T11:32:12.892 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:32:12.892 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw_notification 2024-09-14T11:32:12.892 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 javaclient 2024-09-14T11:32:12.892 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 asok 2024-09-14T11:32:12.892 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 throttle 2024-09-14T11:32:12.892 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 refs 2024-09-14T11:32:12.892 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 compressor 2024-09-14T11:32:12.892 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluestore 2024-09-14T11:32:12.892 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluefs 2024-09-14T11:32:12.892 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 bdev 2024-09-14T11:32:12.893 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 kstore 2024-09-14T11:32:12.893 INFO:tasks.workunit.client.0.smithi071.stderr: 4/ 5 rocksdb 2024-09-14T11:32:12.893 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 fuse 2024-09-14T11:32:12.893 INFO:tasks.workunit.client.0.smithi071.stderr: 2/ 5 mgr 2024-09-14T11:32:12.893 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mgrc 2024-09-14T11:32:12.893 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 dpdk 2024-09-14T11:32:12.893 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 eventtrace 2024-09-14T11:32:12.893 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 prioritycache 2024-09-14T11:32:12.893 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 test 2024-09-14T11:32:12.893 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:32:12.893 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephsqlite 2024-09-14T11:32:12.893 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:32:12.893 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore 2024-09-14T11:32:12.893 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_onode 2024-09-14T11:32:12.894 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_odata 2024-09-14T11:32:12.894 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_omap 2024-09-14T11:32:12.894 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_tm 2024-09-14T11:32:12.894 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_t 2024-09-14T11:32:12.894 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:32:12.894 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_epm 2024-09-14T11:32:12.894 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_lba 2024-09-14T11:32:12.894 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:32:12.894 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cache 2024-09-14T11:32:12.894 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_journal 2024-09-14T11:32:12.894 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_device 2024-09-14T11:32:12.894 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_backref 2024-09-14T11:32:12.894 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 alienstore 2024-09-14T11:32:12.894 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mclock 2024-09-14T11:32:12.895 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cyanstore 2024-09-14T11:32:12.895 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 ceph_exporter 2024-09-14T11:32:12.895 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 memstore 2024-09-14T11:32:12.895 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 trace 2024-09-14T11:32:12.895 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 ceph_dedup 2024-09-14T11:32:12.895 INFO:tasks.workunit.client.0.smithi071.stderr: -2/-2 (syslog threshold) 2024-09-14T11:32:12.895 INFO:tasks.workunit.client.0.smithi071.stderr: 99/99 (stderr threshold) 2024-09-14T11:32:12.895 INFO:tasks.workunit.client.0.smithi071.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:32:12.895 INFO:tasks.workunit.client.0.smithi071.stderr: 7f5f1dffb640 / http_manager 2024-09-14T11:32:12.895 INFO:tasks.workunit.client.0.smithi071.stderr: 7f5f1ffff640 / http_manager 2024-09-14T11:32:12.895 INFO:tasks.workunit.client.0.smithi071.stderr: 7f5fa57e2640 / rgw_dt_lg_renew 2024-09-14T11:32:12.895 INFO:tasks.workunit.client.0.smithi071.stderr: 7f5fd0ff9640 / ms_dispatch 2024-09-14T11:32:12.895 INFO:tasks.workunit.client.0.smithi071.stderr: 7f5fd27fc640 / io_context_pool 2024-09-14T11:32:12.896 INFO:tasks.workunit.client.0.smithi071.stderr: 7f5fd8e01640 / ms_dispatch 2024-09-14T11:32:12.896 INFO:tasks.workunit.client.0.smithi071.stderr: 7f5fdb606640 / ms_dispatch 2024-09-14T11:32:12.896 INFO:tasks.workunit.client.0.smithi071.stderr: 7f5fdce09640 / io_context_pool 2024-09-14T11:32:12.896 INFO:tasks.workunit.client.0.smithi071.stderr: 7f60ee515640 / msgr-worker-2 2024-09-14T11:32:12.896 INFO:tasks.workunit.client.0.smithi071.stderr: 7f60eed16640 / msgr-worker-1 2024-09-14T11:32:12.896 INFO:tasks.workunit.client.0.smithi071.stderr: 7f60ef517640 / msgr-worker-0 2024-09-14T11:32:12.896 INFO:tasks.workunit.client.0.smithi071.stderr: 7f60efd18640 / io_context_pool 2024-09-14T11:32:12.896 INFO:tasks.workunit.client.0.smithi071.stderr: 7f60f12109c0 / radosgw-admin 2024-09-14T11:32:12.896 INFO:tasks.workunit.client.0.smithi071.stderr: max_recent 500 2024-09-14T11:32:12.896 INFO:tasks.workunit.client.0.smithi071.stderr: max_new 1000 2024-09-14T11:32:12.896 INFO:tasks.workunit.client.0.smithi071.stderr: log_file /var/log/ceph/ceph-client.admin.119096.log 2024-09-14T11:32:12.896 INFO:tasks.workunit.client.0.smithi071.stderr:--- end dump of recent events --- 2024-09-14T11:32:12.896 INFO:tasks.workunit.client.0.smithi071.stderr:--- begin dump of recent events --- 2024-09-14T11:32:12.896 INFO:tasks.workunit.client.0.smithi071.stderr: -499> 2024-09-14T11:32:12.514+0000 7f60ef517640 10 monclient(hunting): get_auth_request con 0x55e9d26bbcb0 auth_method 0 2024-09-14T11:32:12.897 INFO:tasks.workunit.client.0.smithi071.stderr: -498> 2024-09-14T11:32:12.514+0000 7f60ef517640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:12.897 INFO:tasks.workunit.client.0.smithi071.stderr: -497> 2024-09-14T11:32:12.514+0000 7f60ef517640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:12.897 INFO:tasks.workunit.client.0.smithi071.stderr: -496> 2024-09-14T11:32:12.514+0000 7f60ef517640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:12.897 INFO:tasks.workunit.client.0.smithi071.stderr: -495> 2024-09-14T11:32:12.514+0000 7f60ee515640 10 monclient(hunting): handle_auth_done global_id 7091 payload 274 2024-09-14T11:32:12.897 INFO:tasks.workunit.client.0.smithi071.stderr: -494> 2024-09-14T11:32:12.514+0000 7f60ee515640 10 monclient: _finish_hunting 0 2024-09-14T11:32:12.897 INFO:tasks.workunit.client.0.smithi071.stderr: -493> 2024-09-14T11:32:12.514+0000 7f60ee515640 1 monclient: found mon.noname-c 2024-09-14T11:32:12.897 INFO:tasks.workunit.client.0.smithi071.stderr: -492> 2024-09-14T11:32:12.514+0000 7f60ee515640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:32:12.897 INFO:tasks.workunit.client.0.smithi071.stderr: -491> 2024-09-14T11:32:12.514+0000 7f5fdce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:12.897 INFO:tasks.workunit.client.0.smithi071.stderr: -490> 2024-09-14T11:32:12.514+0000 7f5fdce09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:32:12.897 INFO:tasks.workunit.client.0.smithi071.stderr: -489> 2024-09-14T11:32:12.514+0000 7f5fdce09640 10 monclient: dump: 2024-09-14T11:32:12.897 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:12.897 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:12.897 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.897 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.898 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:12.898 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:12.898 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:12.898 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:12.898 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:12.898 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.898 INFO:tasks.workunit.client.0.smithi071.stderr: -488> 2024-09-14T11:32:12.514+0000 7f5fdce09640 10 monclient: _finish_auth 0 2024-09-14T11:32:12.898 INFO:tasks.workunit.client.0.smithi071.stderr: -487> 2024-09-14T11:32:12.514+0000 7f5fdce09640 10 monclient: _check_auth_tickets 2024-09-14T11:32:12.898 INFO:tasks.workunit.client.0.smithi071.stderr: -486> 2024-09-14T11:32:12.514+0000 7f60f12109c0 5 monclient: authenticate success, global_id 7091 2024-09-14T11:32:12.898 INFO:tasks.workunit.client.0.smithi071.stderr: -485> 2024-09-14T11:32:12.514+0000 7f5fdce09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:12.898 INFO:tasks.workunit.client.0.smithi071.stderr: -484> 2024-09-14T11:32:12.514+0000 7f5fdce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:12.898 INFO:tasks.workunit.client.0.smithi071.stderr: -483> 2024-09-14T11:32:12.514+0000 7f5fdce09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:12.898 INFO:tasks.workunit.client.0.smithi071.stderr: -482> 2024-09-14T11:32:12.514+0000 7f5fdce09640 10 monclient: dump: 2024-09-14T11:32:12.898 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:12.899 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:12.899 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.899 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.899 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:12.899 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:12.899 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:12.899 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:12.899 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:12.899 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.899 INFO:tasks.workunit.client.0.smithi071.stderr: -481> 2024-09-14T11:32:12.514+0000 7f60f12109c0 10 monclient: get_monmap_and_config success 2024-09-14T11:32:12.899 INFO:tasks.workunit.client.0.smithi071.stderr: -480> 2024-09-14T11:32:12.514+0000 7f60f12109c0 4 set_mon_vals no callback set 2024-09-14T11:32:12.899 INFO:tasks.workunit.client.0.smithi071.stderr: -479> 2024-09-14T11:32:12.514+0000 7f60f12109c0 10 monclient: shutdown 2024-09-14T11:32:12.899 INFO:tasks.workunit.client.0.smithi071.stderr: -478> 2024-09-14T11:32:12.514+0000 7f60f12109c0 5 asok(0x55e9d2565d90) unregister_commands rotate-key 2024-09-14T11:32:12.899 INFO:tasks.workunit.client.0.smithi071.stderr: -477> 2024-09-14T11:32:12.514+0000 7f60f12109c0 10 monclient: build_initial_monmap 2024-09-14T11:32:12.900 INFO:tasks.workunit.client.0.smithi071.stderr: -476> 2024-09-14T11:32:12.514+0000 7f60f12109c0 1 build_initial for_mkfs: 0 2024-09-14T11:32:12.900 INFO:tasks.workunit.client.0.smithi071.stderr: -475> 2024-09-14T11:32:12.514+0000 7f60f12109c0 10 monclient: monmap: 2024-09-14T11:32:12.900 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:32:12.900 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:12.900 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:32:12.900 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:32:12.900 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:12.900 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:12.900 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:32:12.900 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:32:12.900 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:32:12.900 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.900 INFO:tasks.workunit.client.0.smithi071.stderr: -474> 2024-09-14T11:32:12.514+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2776380) adding auth protocol: cephx 2024-09-14T11:32:12.900 INFO:tasks.workunit.client.0.smithi071.stderr: -473> 2024-09-14T11:32:12.514+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2776380) adding auth protocol: cephx 2024-09-14T11:32:12.901 INFO:tasks.workunit.client.0.smithi071.stderr: -472> 2024-09-14T11:32:12.514+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2776380) adding auth protocol: cephx 2024-09-14T11:32:12.901 INFO:tasks.workunit.client.0.smithi071.stderr: -471> 2024-09-14T11:32:12.514+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2776380) adding con mode: secure 2024-09-14T11:32:12.901 INFO:tasks.workunit.client.0.smithi071.stderr: -470> 2024-09-14T11:32:12.514+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2776380) adding con mode: crc 2024-09-14T11:32:12.901 INFO:tasks.workunit.client.0.smithi071.stderr: -469> 2024-09-14T11:32:12.514+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2776380) adding con mode: secure 2024-09-14T11:32:12.901 INFO:tasks.workunit.client.0.smithi071.stderr: -468> 2024-09-14T11:32:12.514+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2776380) adding con mode: crc 2024-09-14T11:32:12.901 INFO:tasks.workunit.client.0.smithi071.stderr: -467> 2024-09-14T11:32:12.514+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2776380) adding con mode: secure 2024-09-14T11:32:12.901 INFO:tasks.workunit.client.0.smithi071.stderr: -466> 2024-09-14T11:32:12.514+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2776380) adding con mode: crc 2024-09-14T11:32:12.901 INFO:tasks.workunit.client.0.smithi071.stderr: -465> 2024-09-14T11:32:12.514+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2776380) adding con mode: crc 2024-09-14T11:32:12.901 INFO:tasks.workunit.client.0.smithi071.stderr: -464> 2024-09-14T11:32:12.514+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2776380) adding con mode: secure 2024-09-14T11:32:12.901 INFO:tasks.workunit.client.0.smithi071.stderr: -463> 2024-09-14T11:32:12.514+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2776380) adding con mode: crc 2024-09-14T11:32:12.901 INFO:tasks.workunit.client.0.smithi071.stderr: -462> 2024-09-14T11:32:12.514+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2776380) adding con mode: secure 2024-09-14T11:32:12.901 INFO:tasks.workunit.client.0.smithi071.stderr: -461> 2024-09-14T11:32:12.514+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2776380) adding con mode: crc 2024-09-14T11:32:12.901 INFO:tasks.workunit.client.0.smithi071.stderr: -460> 2024-09-14T11:32:12.514+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2776380) adding con mode: secure 2024-09-14T11:32:12.901 INFO:tasks.workunit.client.0.smithi071.stderr: -459> 2024-09-14T11:32:12.514+0000 7f60f12109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:12.901 INFO:tasks.workunit.client.0.smithi071.stderr: -458> 2024-09-14T11:32:12.514+0000 7f60f12109c0 1 librados: starting msgr at 2024-09-14T11:32:12.902 INFO:tasks.workunit.client.0.smithi071.stderr: -457> 2024-09-14T11:32:12.514+0000 7f60f12109c0 1 librados: starting objecter 2024-09-14T11:32:12.902 INFO:tasks.workunit.client.0.smithi071.stderr: -456> 2024-09-14T11:32:12.518+0000 7f60f12109c0 5 asok(0x55e9d2565d90) register_command objecter_requests hook 0x55e9d277a640 2024-09-14T11:32:12.902 INFO:tasks.workunit.client.0.smithi071.stderr: -455> 2024-09-14T11:32:12.518+0000 7f60f12109c0 1 librados: setting wanted keys 2024-09-14T11:32:12.902 INFO:tasks.workunit.client.0.smithi071.stderr: -454> 2024-09-14T11:32:12.518+0000 7f60f12109c0 1 librados: calling monclient init 2024-09-14T11:32:12.902 INFO:tasks.workunit.client.0.smithi071.stderr: -453> 2024-09-14T11:32:12.518+0000 7f60f12109c0 10 monclient: init 2024-09-14T11:32:12.902 INFO:tasks.workunit.client.0.smithi071.stderr: -452> 2024-09-14T11:32:12.518+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2773510) adding auth protocol: cephx 2024-09-14T11:32:12.902 INFO:tasks.workunit.client.0.smithi071.stderr: -451> 2024-09-14T11:32:12.518+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2773510) adding auth protocol: cephx 2024-09-14T11:32:12.902 INFO:tasks.workunit.client.0.smithi071.stderr: -450> 2024-09-14T11:32:12.518+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2773510) adding auth protocol: cephx 2024-09-14T11:32:12.902 INFO:tasks.workunit.client.0.smithi071.stderr: -449> 2024-09-14T11:32:12.518+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2773510) adding con mode: secure 2024-09-14T11:32:12.902 INFO:tasks.workunit.client.0.smithi071.stderr: -448> 2024-09-14T11:32:12.518+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2773510) adding con mode: crc 2024-09-14T11:32:12.902 INFO:tasks.workunit.client.0.smithi071.stderr: -447> 2024-09-14T11:32:12.518+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2773510) adding con mode: secure 2024-09-14T11:32:12.902 INFO:tasks.workunit.client.0.smithi071.stderr: -446> 2024-09-14T11:32:12.518+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2773510) adding con mode: crc 2024-09-14T11:32:12.902 INFO:tasks.workunit.client.0.smithi071.stderr: -445> 2024-09-14T11:32:12.518+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2773510) adding con mode: secure 2024-09-14T11:32:12.902 INFO:tasks.workunit.client.0.smithi071.stderr: -444> 2024-09-14T11:32:12.518+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2773510) adding con mode: crc 2024-09-14T11:32:12.903 INFO:tasks.workunit.client.0.smithi071.stderr: -443> 2024-09-14T11:32:12.518+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2773510) adding con mode: crc 2024-09-14T11:32:12.903 INFO:tasks.workunit.client.0.smithi071.stderr: -442> 2024-09-14T11:32:12.518+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2773510) adding con mode: secure 2024-09-14T11:32:12.903 INFO:tasks.workunit.client.0.smithi071.stderr: -441> 2024-09-14T11:32:12.518+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2773510) adding con mode: crc 2024-09-14T11:32:12.903 INFO:tasks.workunit.client.0.smithi071.stderr: -440> 2024-09-14T11:32:12.518+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2773510) adding con mode: secure 2024-09-14T11:32:12.903 INFO:tasks.workunit.client.0.smithi071.stderr: -439> 2024-09-14T11:32:12.518+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2773510) adding con mode: crc 2024-09-14T11:32:12.903 INFO:tasks.workunit.client.0.smithi071.stderr: -438> 2024-09-14T11:32:12.518+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2773510) adding con mode: secure 2024-09-14T11:32:12.903 INFO:tasks.workunit.client.0.smithi071.stderr: -437> 2024-09-14T11:32:12.518+0000 7f60f12109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:12.903 INFO:tasks.workunit.client.0.smithi071.stderr: -436> 2024-09-14T11:32:12.518+0000 7f60f12109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:12.903 INFO:tasks.workunit.client.0.smithi071.stderr: -435> 2024-09-14T11:32:12.518+0000 7f60f12109c0 5 asok(0x55e9d2565d90) register_command rotate-key hook 0x55e9d2773658 2024-09-14T11:32:12.903 INFO:tasks.workunit.client.0.smithi071.stderr: -434> 2024-09-14T11:32:12.518+0000 7f60f12109c0 10 monclient: _reopen_session rank -1 2024-09-14T11:32:12.903 INFO:tasks.workunit.client.0.smithi071.stderr: -433> 2024-09-14T11:32:12.518+0000 7f60f12109c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:32:12.903 INFO:tasks.workunit.client.0.smithi071.stderr: -432> 2024-09-14T11:32:12.518+0000 7f60f12109c0 10 monclient(hunting): picked mon.noname-a con 0x55e9d25fec20 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:32:12.903 INFO:tasks.workunit.client.0.smithi071.stderr: -431> 2024-09-14T11:32:12.518+0000 7f60f12109c0 10 monclient(hunting): picked mon.noname-c con 0x55e9d26b8900 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:32:12.903 INFO:tasks.workunit.client.0.smithi071.stderr: -430> 2024-09-14T11:32:12.518+0000 7f60f12109c0 10 monclient(hunting): picked mon.noname-b con 0x55e9d26bbcb0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:32:12.903 INFO:tasks.workunit.client.0.smithi071.stderr: -429> 2024-09-14T11:32:12.518+0000 7f60f12109c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:12.904 INFO:tasks.workunit.client.0.smithi071.stderr: -428> 2024-09-14T11:32:12.518+0000 7f60f12109c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:12.904 INFO:tasks.workunit.client.0.smithi071.stderr: -427> 2024-09-14T11:32:12.518+0000 7f60f12109c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:12.904 INFO:tasks.workunit.client.0.smithi071.stderr: -426> 2024-09-14T11:32:12.518+0000 7f60f12109c0 10 monclient(hunting): _renew_subs 2024-09-14T11:32:12.904 INFO:tasks.workunit.client.0.smithi071.stderr: -425> 2024-09-14T11:32:12.518+0000 7f60f12109c0 10 monclient(hunting): authenticate will time out at 2344.636843s 2024-09-14T11:32:12.904 INFO:tasks.workunit.client.0.smithi071.stderr: -424> 2024-09-14T11:32:12.518+0000 7f60ee515640 10 monclient(hunting): get_auth_request con 0x55e9d26b8900 auth_method 0 2024-09-14T11:32:12.904 INFO:tasks.workunit.client.0.smithi071.stderr: -423> 2024-09-14T11:32:12.518+0000 7f60ee515640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:12.904 INFO:tasks.workunit.client.0.smithi071.stderr: -422> 2024-09-14T11:32:12.518+0000 7f60ee515640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:12.904 INFO:tasks.workunit.client.0.smithi071.stderr: -421> 2024-09-14T11:32:12.518+0000 7f60ee515640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:12.904 INFO:tasks.workunit.client.0.smithi071.stderr: -420> 2024-09-14T11:32:12.518+0000 7f60eed16640 10 monclient(hunting): get_auth_request con 0x55e9d25fec20 auth_method 0 2024-09-14T11:32:12.904 INFO:tasks.workunit.client.0.smithi071.stderr: -419> 2024-09-14T11:32:12.518+0000 7f60eed16640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:12.904 INFO:tasks.workunit.client.0.smithi071.stderr: -418> 2024-09-14T11:32:12.518+0000 7f60eed16640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:12.904 INFO:tasks.workunit.client.0.smithi071.stderr: -417> 2024-09-14T11:32:12.518+0000 7f60eed16640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:12.904 INFO:tasks.workunit.client.0.smithi071.stderr: -416> 2024-09-14T11:32:12.518+0000 7f60ee515640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:12.904 INFO:tasks.workunit.client.0.smithi071.stderr: -415> 2024-09-14T11:32:12.518+0000 7f60ee515640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:12.905 INFO:tasks.workunit.client.0.smithi071.stderr: -414> 2024-09-14T11:32:12.518+0000 7f60ee515640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:12.905 INFO:tasks.workunit.client.0.smithi071.stderr: -413> 2024-09-14T11:32:12.518+0000 7f60eed16640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:12.905 INFO:tasks.workunit.client.0.smithi071.stderr: -412> 2024-09-14T11:32:12.518+0000 7f60eed16640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:12.905 INFO:tasks.workunit.client.0.smithi071.stderr: -411> 2024-09-14T11:32:12.518+0000 7f60eed16640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:12.905 INFO:tasks.workunit.client.0.smithi071.stderr: -410> 2024-09-14T11:32:12.518+0000 7f60ee515640 10 monclient(hunting): handle_auth_done global_id 7094 payload 824 2024-09-14T11:32:12.905 INFO:tasks.workunit.client.0.smithi071.stderr: -409> 2024-09-14T11:32:12.518+0000 7f60ee515640 10 monclient: _finish_hunting 0 2024-09-14T11:32:12.905 INFO:tasks.workunit.client.0.smithi071.stderr: -408> 2024-09-14T11:32:12.518+0000 7f60ee515640 1 monclient: found mon.noname-c 2024-09-14T11:32:12.905 INFO:tasks.workunit.client.0.smithi071.stderr: -407> 2024-09-14T11:32:12.518+0000 7f60ee515640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:32:12.905 INFO:tasks.workunit.client.0.smithi071.stderr: -406> 2024-09-14T11:32:12.518+0000 7f5fdb606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:12.905 INFO:tasks.workunit.client.0.smithi071.stderr: -405> 2024-09-14T11:32:12.518+0000 7f5fdb606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:32:12.905 INFO:tasks.workunit.client.0.smithi071.stderr: -404> 2024-09-14T11:32:12.518+0000 7f5fdb606640 10 monclient: dump: 2024-09-14T11:32:12.905 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:12.905 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:12.905 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.906 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.906 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:12.906 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:12.906 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:12.906 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:12.906 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:12.906 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.906 INFO:tasks.workunit.client.0.smithi071.stderr: -403> 2024-09-14T11:32:12.518+0000 7f5fdb606640 10 monclient: _finish_auth 0 2024-09-14T11:32:12.906 INFO:tasks.workunit.client.0.smithi071.stderr: -402> 2024-09-14T11:32:12.518+0000 7f5fdb606640 10 monclient: _check_auth_tickets 2024-09-14T11:32:12.906 INFO:tasks.workunit.client.0.smithi071.stderr: -401> 2024-09-14T11:32:12.518+0000 7f5fdb606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:12.906 INFO:tasks.workunit.client.0.smithi071.stderr: -400> 2024-09-14T11:32:12.518+0000 7f5fdb606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:12.906 INFO:tasks.workunit.client.0.smithi071.stderr: -399> 2024-09-14T11:32:12.518+0000 7f5fdb606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:12.906 INFO:tasks.workunit.client.0.smithi071.stderr: -398> 2024-09-14T11:32:12.518+0000 7f5fdb606640 10 monclient: dump: 2024-09-14T11:32:12.906 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:12.906 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:12.907 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.907 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.907 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:12.907 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:12.907 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:12.907 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:12.907 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:12.907 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.907 INFO:tasks.workunit.client.0.smithi071.stderr: -397> 2024-09-14T11:32:12.518+0000 7f5fdce09640 4 set_mon_vals no callback set 2024-09-14T11:32:12.907 INFO:tasks.workunit.client.0.smithi071.stderr: -396> 2024-09-14T11:32:12.518+0000 7f60f12109c0 5 monclient: authenticate success, global_id 7094 2024-09-14T11:32:12.907 INFO:tasks.workunit.client.0.smithi071.stderr: -395> 2024-09-14T11:32:12.518+0000 7f60f12109c0 10 monclient: _renew_subs 2024-09-14T11:32:12.907 INFO:tasks.workunit.client.0.smithi071.stderr: -394> 2024-09-14T11:32:12.518+0000 7f60f12109c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:32:12.907 INFO:tasks.workunit.client.0.smithi071.stderr: -393> 2024-09-14T11:32:12.518+0000 7f60f12109c0 10 monclient: _renew_subs 2024-09-14T11:32:12.907 INFO:tasks.workunit.client.0.smithi071.stderr: -392> 2024-09-14T11:32:12.518+0000 7f60f12109c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:32:12.907 INFO:tasks.workunit.client.0.smithi071.stderr: -391> 2024-09-14T11:32:12.518+0000 7f60f12109c0 1 librados: init done 2024-09-14T11:32:12.908 INFO:tasks.workunit.client.0.smithi071.stderr: -390> 2024-09-14T11:32:12.522+0000 7f5fdb606640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:12.908 INFO:tasks.workunit.client.0.smithi071.stderr: -389> 2024-09-14T11:32:12.522+0000 7f5fdb606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:32:12.908 INFO:tasks.workunit.client.0.smithi071.stderr: -388> 2024-09-14T11:32:12.522+0000 7f5fdb606640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:32:12.908 INFO:tasks.workunit.client.0.smithi071.stderr: -387> 2024-09-14T11:32:12.522+0000 7f60eed16640 10 monclient: get_auth_request con 0x7f5fd40718a0 auth_method 0 2024-09-14T11:32:12.908 INFO:tasks.workunit.client.0.smithi071.stderr: -386> 2024-09-14T11:32:12.522+0000 7f60ef517640 10 monclient: get_auth_request con 0x55e9d27b4bc0 auth_method 0 2024-09-14T11:32:12.908 INFO:tasks.workunit.client.0.smithi071.stderr: -385> 2024-09-14T11:32:12.522+0000 7f60eed16640 10 monclient: get_auth_request con 0x55e9d27be0a0 auth_method 0 2024-09-14T11:32:12.908 INFO:tasks.workunit.client.0.smithi071.stderr: -384> 2024-09-14T11:32:12.522+0000 7f60ee515640 10 monclient: get_auth_request con 0x55e9d27c2400 auth_method 0 2024-09-14T11:32:12.908 INFO:tasks.workunit.client.0.smithi071.stderr: -383> 2024-09-14T11:32:12.526+0000 7f60ef517640 10 monclient: get_auth_request con 0x55e9d27c1980 auth_method 0 2024-09-14T11:32:12.908 INFO:tasks.workunit.client.0.smithi071.stderr: -382> 2024-09-14T11:32:12.526+0000 7f60f12109c0 10 monclient: build_initial_monmap 2024-09-14T11:32:12.908 INFO:tasks.workunit.client.0.smithi071.stderr: -381> 2024-09-14T11:32:12.526+0000 7f60f12109c0 1 build_initial for_mkfs: 0 2024-09-14T11:32:12.908 INFO:tasks.workunit.client.0.smithi071.stderr: -380> 2024-09-14T11:32:12.526+0000 7f60f12109c0 10 monclient: monmap: 2024-09-14T11:32:12.908 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:32:12.908 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:12.908 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:32:12.909 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:32:12.909 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:12.909 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:12.909 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:32:12.909 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:32:12.909 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:32:12.909 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.909 INFO:tasks.workunit.client.0.smithi071.stderr: -379> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27ca660) adding auth protocol: cephx 2024-09-14T11:32:12.909 INFO:tasks.workunit.client.0.smithi071.stderr: -378> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27ca660) adding auth protocol: cephx 2024-09-14T11:32:12.909 INFO:tasks.workunit.client.0.smithi071.stderr: -377> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27ca660) adding auth protocol: cephx 2024-09-14T11:32:12.909 INFO:tasks.workunit.client.0.smithi071.stderr: -376> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27ca660) adding con mode: secure 2024-09-14T11:32:12.909 INFO:tasks.workunit.client.0.smithi071.stderr: -375> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27ca660) adding con mode: crc 2024-09-14T11:32:12.909 INFO:tasks.workunit.client.0.smithi071.stderr: -374> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27ca660) adding con mode: secure 2024-09-14T11:32:12.909 INFO:tasks.workunit.client.0.smithi071.stderr: -373> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27ca660) adding con mode: crc 2024-09-14T11:32:12.909 INFO:tasks.workunit.client.0.smithi071.stderr: -372> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27ca660) adding con mode: secure 2024-09-14T11:32:12.910 INFO:tasks.workunit.client.0.smithi071.stderr: -371> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27ca660) adding con mode: crc 2024-09-14T11:32:12.910 INFO:tasks.workunit.client.0.smithi071.stderr: -370> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27ca660) adding con mode: crc 2024-09-14T11:32:12.910 INFO:tasks.workunit.client.0.smithi071.stderr: -369> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27ca660) adding con mode: secure 2024-09-14T11:32:12.910 INFO:tasks.workunit.client.0.smithi071.stderr: -368> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27ca660) adding con mode: crc 2024-09-14T11:32:12.910 INFO:tasks.workunit.client.0.smithi071.stderr: -367> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27ca660) adding con mode: secure 2024-09-14T11:32:12.910 INFO:tasks.workunit.client.0.smithi071.stderr: -366> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27ca660) adding con mode: crc 2024-09-14T11:32:12.910 INFO:tasks.workunit.client.0.smithi071.stderr: -365> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27ca660) adding con mode: secure 2024-09-14T11:32:12.910 INFO:tasks.workunit.client.0.smithi071.stderr: -364> 2024-09-14T11:32:12.526+0000 7f60f12109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:12.910 INFO:tasks.workunit.client.0.smithi071.stderr: -363> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 asok(0x55e9d2565d90) register_command objecter_requests cmddesc objecter_requests hook 0x55e9d27ce010 EEXIST 2024-09-14T11:32:12.910 INFO:tasks.workunit.client.0.smithi071.stderr: -362> 2024-09-14T11:32:12.526+0000 7f60f12109c0 10 monclient: init 2024-09-14T11:32:12.910 INFO:tasks.workunit.client.0.smithi071.stderr: -361> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27c9558) adding auth protocol: cephx 2024-09-14T11:32:12.910 INFO:tasks.workunit.client.0.smithi071.stderr: -360> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27c9558) adding auth protocol: cephx 2024-09-14T11:32:12.910 INFO:tasks.workunit.client.0.smithi071.stderr: -359> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27c9558) adding auth protocol: cephx 2024-09-14T11:32:12.910 INFO:tasks.workunit.client.0.smithi071.stderr: -358> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27c9558) adding con mode: secure 2024-09-14T11:32:12.910 INFO:tasks.workunit.client.0.smithi071.stderr: -357> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27c9558) adding con mode: crc 2024-09-14T11:32:12.911 INFO:tasks.workunit.client.0.smithi071.stderr: -356> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27c9558) adding con mode: secure 2024-09-14T11:32:12.911 INFO:tasks.workunit.client.0.smithi071.stderr: -355> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27c9558) adding con mode: crc 2024-09-14T11:32:12.911 INFO:tasks.workunit.client.0.smithi071.stderr: -354> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27c9558) adding con mode: secure 2024-09-14T11:32:12.911 INFO:tasks.workunit.client.0.smithi071.stderr: -353> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27c9558) adding con mode: crc 2024-09-14T11:32:12.911 INFO:tasks.workunit.client.0.smithi071.stderr: -352> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27c9558) adding con mode: crc 2024-09-14T11:32:12.911 INFO:tasks.workunit.client.0.smithi071.stderr: -351> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27c9558) adding con mode: secure 2024-09-14T11:32:12.911 INFO:tasks.workunit.client.0.smithi071.stderr: -350> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27c9558) adding con mode: crc 2024-09-14T11:32:12.911 INFO:tasks.workunit.client.0.smithi071.stderr: -349> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27c9558) adding con mode: secure 2024-09-14T11:32:12.911 INFO:tasks.workunit.client.0.smithi071.stderr: -348> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27c9558) adding con mode: crc 2024-09-14T11:32:12.911 INFO:tasks.workunit.client.0.smithi071.stderr: -347> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27c9558) adding con mode: secure 2024-09-14T11:32:12.911 INFO:tasks.workunit.client.0.smithi071.stderr: -346> 2024-09-14T11:32:12.526+0000 7f60f12109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:12.911 INFO:tasks.workunit.client.0.smithi071.stderr: -345> 2024-09-14T11:32:12.526+0000 7f60f12109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:12.912 INFO:tasks.workunit.client.0.smithi071.stderr: -344> 2024-09-14T11:32:12.526+0000 7f60f12109c0 5 asok(0x55e9d2565d90) register_command rotate-key cmddesc rotate-key hook 0x55e9d27c96a0 EEXIST 2024-09-14T11:32:12.912 INFO:tasks.workunit.client.0.smithi071.stderr: -343> 2024-09-14T11:32:12.526+0000 7f60f12109c0 10 monclient: _reopen_session rank -1 2024-09-14T11:32:12.912 INFO:tasks.workunit.client.0.smithi071.stderr: -342> 2024-09-14T11:32:12.526+0000 7f60f12109c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:32:12.912 INFO:tasks.workunit.client.0.smithi071.stderr: -341> 2024-09-14T11:32:12.526+0000 7f60f12109c0 10 monclient(hunting): picked mon.noname-a con 0x55e9d27f21c0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:32:12.912 INFO:tasks.workunit.client.0.smithi071.stderr: -340> 2024-09-14T11:32:12.526+0000 7f60f12109c0 10 monclient(hunting): picked mon.noname-b con 0x55e9d27f1af0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:32:12.912 INFO:tasks.workunit.client.0.smithi071.stderr: -339> 2024-09-14T11:32:12.526+0000 7f60f12109c0 10 monclient(hunting): picked mon.noname-c con 0x55e9d27f04d0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:32:12.912 INFO:tasks.workunit.client.0.smithi071.stderr: -338> 2024-09-14T11:32:12.526+0000 7f60f12109c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:12.912 INFO:tasks.workunit.client.0.smithi071.stderr: -337> 2024-09-14T11:32:12.526+0000 7f60f12109c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:12.912 INFO:tasks.workunit.client.0.smithi071.stderr: -336> 2024-09-14T11:32:12.526+0000 7f60f12109c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:12.912 INFO:tasks.workunit.client.0.smithi071.stderr: -335> 2024-09-14T11:32:12.526+0000 7f60f12109c0 10 monclient(hunting): _renew_subs 2024-09-14T11:32:12.912 INFO:tasks.workunit.client.0.smithi071.stderr: -334> 2024-09-14T11:32:12.526+0000 7f60f12109c0 10 monclient(hunting): authenticate will time out at 2344.647072s 2024-09-14T11:32:12.912 INFO:tasks.workunit.client.0.smithi071.stderr: -333> 2024-09-14T11:32:12.526+0000 7f60ee515640 10 monclient(hunting): get_auth_request con 0x55e9d27f21c0 auth_method 0 2024-09-14T11:32:12.912 INFO:tasks.workunit.client.0.smithi071.stderr: -332> 2024-09-14T11:32:12.526+0000 7f60ee515640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:12.912 INFO:tasks.workunit.client.0.smithi071.stderr: -331> 2024-09-14T11:32:12.526+0000 7f60ee515640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:12.913 INFO:tasks.workunit.client.0.smithi071.stderr: -330> 2024-09-14T11:32:12.526+0000 7f60ee515640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:12.913 INFO:tasks.workunit.client.0.smithi071.stderr: -329> 2024-09-14T11:32:12.526+0000 7f60eed16640 10 monclient(hunting): get_auth_request con 0x55e9d27f04d0 auth_method 0 2024-09-14T11:32:12.913 INFO:tasks.workunit.client.0.smithi071.stderr: -328> 2024-09-14T11:32:12.526+0000 7f60eed16640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:12.913 INFO:tasks.workunit.client.0.smithi071.stderr: -327> 2024-09-14T11:32:12.526+0000 7f60eed16640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:12.913 INFO:tasks.workunit.client.0.smithi071.stderr: -326> 2024-09-14T11:32:12.526+0000 7f60eed16640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:12.913 INFO:tasks.workunit.client.0.smithi071.stderr: -325> 2024-09-14T11:32:12.526+0000 7f60ee515640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:12.913 INFO:tasks.workunit.client.0.smithi071.stderr: -324> 2024-09-14T11:32:12.526+0000 7f60ee515640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:12.913 INFO:tasks.workunit.client.0.smithi071.stderr: -323> 2024-09-14T11:32:12.526+0000 7f60ee515640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:12.913 INFO:tasks.workunit.client.0.smithi071.stderr: -322> 2024-09-14T11:32:12.526+0000 7f60eed16640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:12.913 INFO:tasks.workunit.client.0.smithi071.stderr: -321> 2024-09-14T11:32:12.526+0000 7f60eed16640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:12.913 INFO:tasks.workunit.client.0.smithi071.stderr: -320> 2024-09-14T11:32:12.526+0000 7f60eed16640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:12.913 INFO:tasks.workunit.client.0.smithi071.stderr: -319> 2024-09-14T11:32:12.526+0000 7f60ef517640 10 monclient(hunting): get_auth_request con 0x55e9d27f1af0 auth_method 0 2024-09-14T11:32:12.913 INFO:tasks.workunit.client.0.smithi071.stderr: -318> 2024-09-14T11:32:12.526+0000 7f60ef517640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:12.913 INFO:tasks.workunit.client.0.smithi071.stderr: -317> 2024-09-14T11:32:12.526+0000 7f60ef517640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:12.913 INFO:tasks.workunit.client.0.smithi071.stderr: -316> 2024-09-14T11:32:12.526+0000 7f60ef517640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:12.914 INFO:tasks.workunit.client.0.smithi071.stderr: -315> 2024-09-14T11:32:12.526+0000 7f60ee515640 10 monclient(hunting): handle_auth_done global_id 7467 payload 824 2024-09-14T11:32:12.914 INFO:tasks.workunit.client.0.smithi071.stderr: -314> 2024-09-14T11:32:12.526+0000 7f60ee515640 10 monclient: _finish_hunting 0 2024-09-14T11:32:12.914 INFO:tasks.workunit.client.0.smithi071.stderr: -313> 2024-09-14T11:32:12.526+0000 7f60ee515640 1 monclient: found mon.noname-a 2024-09-14T11:32:12.914 INFO:tasks.workunit.client.0.smithi071.stderr: -312> 2024-09-14T11:32:12.526+0000 7f60ee515640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:32:12.914 INFO:tasks.workunit.client.0.smithi071.stderr: -311> 2024-09-14T11:32:12.526+0000 7f5fd8e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:12.914 INFO:tasks.workunit.client.0.smithi071.stderr: -310> 2024-09-14T11:32:12.526+0000 7f5fd8e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:32:12.914 INFO:tasks.workunit.client.0.smithi071.stderr: -309> 2024-09-14T11:32:12.526+0000 7f5fd8e01640 10 monclient: dump: 2024-09-14T11:32:12.914 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:12.914 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:12.914 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.914 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.914 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:12.914 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:12.914 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:12.914 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:12.915 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:12.915 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.915 INFO:tasks.workunit.client.0.smithi071.stderr: -308> 2024-09-14T11:32:12.526+0000 7f5fd8e01640 10 monclient: _finish_auth 0 2024-09-14T11:32:12.915 INFO:tasks.workunit.client.0.smithi071.stderr: -307> 2024-09-14T11:32:12.526+0000 7f5fd8e01640 10 monclient: _check_auth_tickets 2024-09-14T11:32:12.915 INFO:tasks.workunit.client.0.smithi071.stderr: -306> 2024-09-14T11:32:12.526+0000 7f5fd8e01640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:12.915 INFO:tasks.workunit.client.0.smithi071.stderr: -305> 2024-09-14T11:32:12.526+0000 7f5fd8e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:12.915 INFO:tasks.workunit.client.0.smithi071.stderr: -304> 2024-09-14T11:32:12.526+0000 7f5fd8e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:32:12.915 INFO:tasks.workunit.client.0.smithi071.stderr: -303> 2024-09-14T11:32:12.526+0000 7f5fd8e01640 10 monclient: dump: 2024-09-14T11:32:12.915 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:12.915 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:12.915 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.915 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.915 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:12.915 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:12.915 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:12.916 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:12.916 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:12.916 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.916 INFO:tasks.workunit.client.0.smithi071.stderr: -302> 2024-09-14T11:32:12.526+0000 7f60efd18640 4 set_mon_vals no callback set 2024-09-14T11:32:12.916 INFO:tasks.workunit.client.0.smithi071.stderr: -301> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 monclient: authenticate success, global_id 7467 2024-09-14T11:32:12.916 INFO:tasks.workunit.client.0.smithi071.stderr: -300> 2024-09-14T11:32:12.530+0000 7f60f12109c0 10 monclient: _renew_subs 2024-09-14T11:32:12.916 INFO:tasks.workunit.client.0.smithi071.stderr: -299> 2024-09-14T11:32:12.530+0000 7f60f12109c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:32:12.916 INFO:tasks.workunit.client.0.smithi071.stderr: -298> 2024-09-14T11:32:12.530+0000 7f60f12109c0 10 monclient: _renew_subs 2024-09-14T11:32:12.916 INFO:tasks.workunit.client.0.smithi071.stderr: -297> 2024-09-14T11:32:12.530+0000 7f60f12109c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:32:12.916 INFO:tasks.workunit.client.0.smithi071.stderr: -296> 2024-09-14T11:32:12.530+0000 7f5fd8e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:12.916 INFO:tasks.workunit.client.0.smithi071.stderr: -295> 2024-09-14T11:32:12.530+0000 7f5fd8e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:32:12.916 INFO:tasks.workunit.client.0.smithi071.stderr: -294> 2024-09-14T11:32:12.530+0000 7f5fd8e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:32:12.917 INFO:tasks.workunit.client.0.smithi071.stderr: -293> 2024-09-14T11:32:12.530+0000 7f60ef517640 10 monclient: get_auth_request con 0x7f5fc80717e0 auth_method 0 2024-09-14T11:32:12.917 INFO:tasks.workunit.client.0.smithi071.stderr: -292> 2024-09-14T11:32:12.530+0000 7f60f12109c0 10 monclient: get_monmap_and_config 2024-09-14T11:32:12.917 INFO:tasks.workunit.client.0.smithi071.stderr: -291> 2024-09-14T11:32:12.530+0000 7f60f12109c0 10 monclient: build_initial_monmap 2024-09-14T11:32:12.917 INFO:tasks.workunit.client.0.smithi071.stderr: -290> 2024-09-14T11:32:12.530+0000 7f60f12109c0 1 build_initial for_mkfs: 0 2024-09-14T11:32:12.917 INFO:tasks.workunit.client.0.smithi071.stderr: -289> 2024-09-14T11:32:12.530+0000 7f60f12109c0 10 monclient: monmap: 2024-09-14T11:32:12.917 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:32:12.917 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:12.917 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:32:12.917 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:32:12.917 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:12.917 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:12.917 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:32:12.917 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:32:12.917 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:32:12.918 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.918 INFO:tasks.workunit.client.0.smithi071.stderr: -288> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x55e9d28117e0) adding auth protocol: cephx 2024-09-14T11:32:12.918 INFO:tasks.workunit.client.0.smithi071.stderr: -287> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x55e9d28117e0) adding auth protocol: cephx 2024-09-14T11:32:12.918 INFO:tasks.workunit.client.0.smithi071.stderr: -286> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x55e9d28117e0) adding auth protocol: cephx 2024-09-14T11:32:12.918 INFO:tasks.workunit.client.0.smithi071.stderr: -285> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x55e9d28117e0) adding con mode: secure 2024-09-14T11:32:12.918 INFO:tasks.workunit.client.0.smithi071.stderr: -284> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x55e9d28117e0) adding con mode: crc 2024-09-14T11:32:12.918 INFO:tasks.workunit.client.0.smithi071.stderr: -283> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x55e9d28117e0) adding con mode: secure 2024-09-14T11:32:12.918 INFO:tasks.workunit.client.0.smithi071.stderr: -282> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x55e9d28117e0) adding con mode: crc 2024-09-14T11:32:12.918 INFO:tasks.workunit.client.0.smithi071.stderr: -281> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x55e9d28117e0) adding con mode: secure 2024-09-14T11:32:12.918 INFO:tasks.workunit.client.0.smithi071.stderr: -280> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x55e9d28117e0) adding con mode: crc 2024-09-14T11:32:12.918 INFO:tasks.workunit.client.0.smithi071.stderr: -279> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x55e9d28117e0) adding con mode: crc 2024-09-14T11:32:12.918 INFO:tasks.workunit.client.0.smithi071.stderr: -278> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x55e9d28117e0) adding con mode: secure 2024-09-14T11:32:12.918 INFO:tasks.workunit.client.0.smithi071.stderr: -277> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x55e9d28117e0) adding con mode: crc 2024-09-14T11:32:12.918 INFO:tasks.workunit.client.0.smithi071.stderr: -276> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x55e9d28117e0) adding con mode: secure 2024-09-14T11:32:12.919 INFO:tasks.workunit.client.0.smithi071.stderr: -275> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x55e9d28117e0) adding con mode: crc 2024-09-14T11:32:12.919 INFO:tasks.workunit.client.0.smithi071.stderr: -274> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x55e9d28117e0) adding con mode: secure 2024-09-14T11:32:12.919 INFO:tasks.workunit.client.0.smithi071.stderr: -273> 2024-09-14T11:32:12.530+0000 7f60f12109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:12.919 INFO:tasks.workunit.client.0.smithi071.stderr: -272> 2024-09-14T11:32:12.530+0000 7f60f12109c0 10 monclient: init 2024-09-14T11:32:12.919 INFO:tasks.workunit.client.0.smithi071.stderr: -271> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x7fff07516e90) adding auth protocol: cephx 2024-09-14T11:32:12.919 INFO:tasks.workunit.client.0.smithi071.stderr: -270> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x7fff07516e90) adding auth protocol: cephx 2024-09-14T11:32:12.919 INFO:tasks.workunit.client.0.smithi071.stderr: -269> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x7fff07516e90) adding auth protocol: cephx 2024-09-14T11:32:12.919 INFO:tasks.workunit.client.0.smithi071.stderr: -268> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x7fff07516e90) adding con mode: secure 2024-09-14T11:32:12.919 INFO:tasks.workunit.client.0.smithi071.stderr: -267> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x7fff07516e90) adding con mode: crc 2024-09-14T11:32:12.919 INFO:tasks.workunit.client.0.smithi071.stderr: -266> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x7fff07516e90) adding con mode: secure 2024-09-14T11:32:12.919 INFO:tasks.workunit.client.0.smithi071.stderr: -265> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x7fff07516e90) adding con mode: crc 2024-09-14T11:32:12.919 INFO:tasks.workunit.client.0.smithi071.stderr: -264> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x7fff07516e90) adding con mode: secure 2024-09-14T11:32:12.919 INFO:tasks.workunit.client.0.smithi071.stderr: -263> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x7fff07516e90) adding con mode: crc 2024-09-14T11:32:12.919 INFO:tasks.workunit.client.0.smithi071.stderr: -262> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x7fff07516e90) adding con mode: crc 2024-09-14T11:32:12.919 INFO:tasks.workunit.client.0.smithi071.stderr: -261> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x7fff07516e90) adding con mode: secure 2024-09-14T11:32:12.920 INFO:tasks.workunit.client.0.smithi071.stderr: -260> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x7fff07516e90) adding con mode: crc 2024-09-14T11:32:12.920 INFO:tasks.workunit.client.0.smithi071.stderr: -259> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x7fff07516e90) adding con mode: secure 2024-09-14T11:32:12.920 INFO:tasks.workunit.client.0.smithi071.stderr: -258> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x7fff07516e90) adding con mode: crc 2024-09-14T11:32:12.920 INFO:tasks.workunit.client.0.smithi071.stderr: -257> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 AuthRegistry(0x7fff07516e90) adding con mode: secure 2024-09-14T11:32:12.920 INFO:tasks.workunit.client.0.smithi071.stderr: -256> 2024-09-14T11:32:12.530+0000 7f60f12109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:12.920 INFO:tasks.workunit.client.0.smithi071.stderr: -255> 2024-09-14T11:32:12.530+0000 7f60f12109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:12.920 INFO:tasks.workunit.client.0.smithi071.stderr: -254> 2024-09-14T11:32:12.530+0000 7f60f12109c0 5 asok(0x55e9d2565d90) register_command rotate-key cmddesc rotate-key hook 0x7fff07516fd8 EEXIST 2024-09-14T11:32:12.920 INFO:tasks.workunit.client.0.smithi071.stderr: -253> 2024-09-14T11:32:12.530+0000 7f60f12109c0 10 monclient: _reopen_session rank -1 2024-09-14T11:32:12.920 INFO:tasks.workunit.client.0.smithi071.stderr: -252> 2024-09-14T11:32:12.530+0000 7f60f12109c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:32:12.920 INFO:tasks.workunit.client.0.smithi071.stderr: -251> 2024-09-14T11:32:12.530+0000 7f60f12109c0 10 monclient(hunting): picked mon.noname-a con 0x55e9d2845df0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:32:12.920 INFO:tasks.workunit.client.0.smithi071.stderr: -250> 2024-09-14T11:32:12.530+0000 7f60f12109c0 10 monclient(hunting): picked mon.noname-c con 0x55e9d2815810 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:32:12.920 INFO:tasks.workunit.client.0.smithi071.stderr: -249> 2024-09-14T11:32:12.530+0000 7f60f12109c0 10 monclient(hunting): picked mon.noname-b con 0x55e9d28415c0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:32:12.920 INFO:tasks.workunit.client.0.smithi071.stderr: -248> 2024-09-14T11:32:12.530+0000 7f60f12109c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:12.920 INFO:tasks.workunit.client.0.smithi071.stderr: -247> 2024-09-14T11:32:12.530+0000 7f60f12109c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:12.921 INFO:tasks.workunit.client.0.smithi071.stderr: -246> 2024-09-14T11:32:12.530+0000 7f60f12109c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:12.921 INFO:tasks.workunit.client.0.smithi071.stderr: -245> 2024-09-14T11:32:12.530+0000 7f60f12109c0 10 monclient(hunting): _renew_subs 2024-09-14T11:32:12.921 INFO:tasks.workunit.client.0.smithi071.stderr: -244> 2024-09-14T11:32:12.530+0000 7f60f12109c0 10 monclient(hunting): authenticate will time out at 2344.651252s 2024-09-14T11:32:12.921 INFO:tasks.workunit.client.0.smithi071.stderr: -243> 2024-09-14T11:32:12.530+0000 7f60ee515640 10 monclient(hunting): get_auth_request con 0x55e9d2845df0 auth_method 0 2024-09-14T11:32:12.921 INFO:tasks.workunit.client.0.smithi071.stderr: -242> 2024-09-14T11:32:12.530+0000 7f60ee515640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:12.921 INFO:tasks.workunit.client.0.smithi071.stderr: -241> 2024-09-14T11:32:12.530+0000 7f60ee515640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:12.921 INFO:tasks.workunit.client.0.smithi071.stderr: -240> 2024-09-14T11:32:12.530+0000 7f60ee515640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:12.921 INFO:tasks.workunit.client.0.smithi071.stderr: -239> 2024-09-14T11:32:12.530+0000 7f60ef517640 10 monclient(hunting): get_auth_request con 0x55e9d2815810 auth_method 0 2024-09-14T11:32:12.921 INFO:tasks.workunit.client.0.smithi071.stderr: -238> 2024-09-14T11:32:12.530+0000 7f60ef517640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:12.921 INFO:tasks.workunit.client.0.smithi071.stderr: -237> 2024-09-14T11:32:12.530+0000 7f60ef517640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:12.921 INFO:tasks.workunit.client.0.smithi071.stderr: -236> 2024-09-14T11:32:12.530+0000 7f60ef517640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:12.921 INFO:tasks.workunit.client.0.smithi071.stderr: -235> 2024-09-14T11:32:12.530+0000 7f60ee515640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:12.921 INFO:tasks.workunit.client.0.smithi071.stderr: -234> 2024-09-14T11:32:12.530+0000 7f60ee515640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:12.921 INFO:tasks.workunit.client.0.smithi071.stderr: -233> 2024-09-14T11:32:12.530+0000 7f60ee515640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:12.922 INFO:tasks.workunit.client.0.smithi071.stderr: -232> 2024-09-14T11:32:12.530+0000 7f60ef517640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:12.922 INFO:tasks.workunit.client.0.smithi071.stderr: -231> 2024-09-14T11:32:12.530+0000 7f60ef517640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:12.922 INFO:tasks.workunit.client.0.smithi071.stderr: -230> 2024-09-14T11:32:12.530+0000 7f60ef517640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:12.922 INFO:tasks.workunit.client.0.smithi071.stderr: -229> 2024-09-14T11:32:12.530+0000 7f60ee515640 10 monclient(hunting): handle_auth_done global_id 7470 payload 274 2024-09-14T11:32:12.922 INFO:tasks.workunit.client.0.smithi071.stderr: -228> 2024-09-14T11:32:12.530+0000 7f60ee515640 10 monclient: _finish_hunting 0 2024-09-14T11:32:12.922 INFO:tasks.workunit.client.0.smithi071.stderr: -227> 2024-09-14T11:32:12.530+0000 7f60ee515640 1 monclient: found mon.noname-a 2024-09-14T11:32:12.922 INFO:tasks.workunit.client.0.smithi071.stderr: -226> 2024-09-14T11:32:12.530+0000 7f60ee515640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:32:12.922 INFO:tasks.workunit.client.0.smithi071.stderr: -225> 2024-09-14T11:32:12.530+0000 7f5fd27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:12.922 INFO:tasks.workunit.client.0.smithi071.stderr: -224> 2024-09-14T11:32:12.530+0000 7f5fd27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:32:12.922 INFO:tasks.workunit.client.0.smithi071.stderr: -223> 2024-09-14T11:32:12.530+0000 7f5fd27fc640 10 monclient: dump: 2024-09-14T11:32:12.922 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:12.922 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:12.922 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.922 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.923 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:12.923 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:12.923 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:12.923 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:12.923 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:12.923 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.923 INFO:tasks.workunit.client.0.smithi071.stderr: -222> 2024-09-14T11:32:12.530+0000 7f5fd27fc640 10 monclient: _finish_auth 0 2024-09-14T11:32:12.923 INFO:tasks.workunit.client.0.smithi071.stderr: -221> 2024-09-14T11:32:12.530+0000 7f5fd27fc640 10 monclient: _check_auth_tickets 2024-09-14T11:32:12.923 INFO:tasks.workunit.client.0.smithi071.stderr: -220> 2024-09-14T11:32:12.530+0000 7f5fd27fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:12.923 INFO:tasks.workunit.client.0.smithi071.stderr: -219> 2024-09-14T11:32:12.530+0000 7f5fd27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:12.923 INFO:tasks.workunit.client.0.smithi071.stderr: -218> 2024-09-14T11:32:12.530+0000 7f5fd27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:32:12.923 INFO:tasks.workunit.client.0.smithi071.stderr: -217> 2024-09-14T11:32:12.530+0000 7f5fd27fc640 10 monclient: dump: 2024-09-14T11:32:12.923 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:12.923 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:12.924 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.924 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.924 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:12.924 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:12.924 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:12.924 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:12.924 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:12.924 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.924 INFO:tasks.workunit.client.0.smithi071.stderr: -216> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 monclient: authenticate success, global_id 7470 2024-09-14T11:32:12.924 INFO:tasks.workunit.client.0.smithi071.stderr: -215> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient: get_monmap_and_config success 2024-09-14T11:32:12.924 INFO:tasks.workunit.client.0.smithi071.stderr: -214> 2024-09-14T11:32:12.534+0000 7f60f12109c0 4 set_mon_vals no callback set 2024-09-14T11:32:12.924 INFO:tasks.workunit.client.0.smithi071.stderr: -213> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient: shutdown 2024-09-14T11:32:12.924 INFO:tasks.workunit.client.0.smithi071.stderr: -212> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient: build_initial_monmap 2024-09-14T11:32:12.925 INFO:tasks.workunit.client.0.smithi071.stderr: -211> 2024-09-14T11:32:12.534+0000 7f60f12109c0 1 build_initial for_mkfs: 0 2024-09-14T11:32:12.925 INFO:tasks.workunit.client.0.smithi071.stderr: -210> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient: monmap: 2024-09-14T11:32:12.925 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:32:12.925 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:12.925 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:32:12.925 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:32:12.925 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:12.925 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:12.925 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:32:12.925 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:32:12.925 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:32:12.925 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.925 INFO:tasks.workunit.client.0.smithi071.stderr: -209> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2836810) adding auth protocol: cephx 2024-09-14T11:32:12.925 INFO:tasks.workunit.client.0.smithi071.stderr: -208> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2836810) adding auth protocol: cephx 2024-09-14T11:32:12.926 INFO:tasks.workunit.client.0.smithi071.stderr: -207> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2836810) adding auth protocol: cephx 2024-09-14T11:32:12.926 INFO:tasks.workunit.client.0.smithi071.stderr: -206> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2836810) adding con mode: secure 2024-09-14T11:32:12.926 INFO:tasks.workunit.client.0.smithi071.stderr: -205> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2836810) adding con mode: crc 2024-09-14T11:32:12.926 INFO:tasks.workunit.client.0.smithi071.stderr: -204> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2836810) adding con mode: secure 2024-09-14T11:32:12.926 INFO:tasks.workunit.client.0.smithi071.stderr: -203> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2836810) adding con mode: crc 2024-09-14T11:32:12.926 INFO:tasks.workunit.client.0.smithi071.stderr: -202> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2836810) adding con mode: secure 2024-09-14T11:32:12.926 INFO:tasks.workunit.client.0.smithi071.stderr: -201> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2836810) adding con mode: crc 2024-09-14T11:32:12.926 INFO:tasks.workunit.client.0.smithi071.stderr: -200> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2836810) adding con mode: crc 2024-09-14T11:32:12.926 INFO:tasks.workunit.client.0.smithi071.stderr: -199> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2836810) adding con mode: secure 2024-09-14T11:32:12.926 INFO:tasks.workunit.client.0.smithi071.stderr: -198> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2836810) adding con mode: crc 2024-09-14T11:32:12.926 INFO:tasks.workunit.client.0.smithi071.stderr: -197> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2836810) adding con mode: secure 2024-09-14T11:32:12.926 INFO:tasks.workunit.client.0.smithi071.stderr: -196> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2836810) adding con mode: crc 2024-09-14T11:32:12.926 INFO:tasks.workunit.client.0.smithi071.stderr: -195> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d2836810) adding con mode: secure 2024-09-14T11:32:12.926 INFO:tasks.workunit.client.0.smithi071.stderr: -194> 2024-09-14T11:32:12.534+0000 7f60f12109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:12.927 INFO:tasks.workunit.client.0.smithi071.stderr: -193> 2024-09-14T11:32:12.534+0000 7f60f12109c0 1 librados: starting msgr at 2024-09-14T11:32:12.927 INFO:tasks.workunit.client.0.smithi071.stderr: -192> 2024-09-14T11:32:12.534+0000 7f60f12109c0 1 librados: starting objecter 2024-09-14T11:32:12.927 INFO:tasks.workunit.client.0.smithi071.stderr: -191> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 asok(0x55e9d2565d90) register_command objecter_requests cmddesc objecter_requests hook 0x55e9d27f4ef0 EEXIST 2024-09-14T11:32:12.927 INFO:tasks.workunit.client.0.smithi071.stderr: -190> 2024-09-14T11:32:12.534+0000 7f60f12109c0 1 librados: setting wanted keys 2024-09-14T11:32:12.927 INFO:tasks.workunit.client.0.smithi071.stderr: -189> 2024-09-14T11:32:12.534+0000 7f60f12109c0 1 librados: calling monclient init 2024-09-14T11:32:12.927 INFO:tasks.workunit.client.0.smithi071.stderr: -188> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient: init 2024-09-14T11:32:12.927 INFO:tasks.workunit.client.0.smithi071.stderr: -187> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27f3fe0) adding auth protocol: cephx 2024-09-14T11:32:12.927 INFO:tasks.workunit.client.0.smithi071.stderr: -186> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27f3fe0) adding auth protocol: cephx 2024-09-14T11:32:12.927 INFO:tasks.workunit.client.0.smithi071.stderr: -185> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27f3fe0) adding auth protocol: cephx 2024-09-14T11:32:12.927 INFO:tasks.workunit.client.0.smithi071.stderr: -184> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27f3fe0) adding con mode: secure 2024-09-14T11:32:12.927 INFO:tasks.workunit.client.0.smithi071.stderr: -183> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27f3fe0) adding con mode: crc 2024-09-14T11:32:12.927 INFO:tasks.workunit.client.0.smithi071.stderr: -182> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27f3fe0) adding con mode: secure 2024-09-14T11:32:12.927 INFO:tasks.workunit.client.0.smithi071.stderr: -181> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27f3fe0) adding con mode: crc 2024-09-14T11:32:12.927 INFO:tasks.workunit.client.0.smithi071.stderr: -180> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27f3fe0) adding con mode: secure 2024-09-14T11:32:12.928 INFO:tasks.workunit.client.0.smithi071.stderr: -179> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27f3fe0) adding con mode: crc 2024-09-14T11:32:12.928 INFO:tasks.workunit.client.0.smithi071.stderr: -178> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27f3fe0) adding con mode: crc 2024-09-14T11:32:12.928 INFO:tasks.workunit.client.0.smithi071.stderr: -177> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27f3fe0) adding con mode: secure 2024-09-14T11:32:12.928 INFO:tasks.workunit.client.0.smithi071.stderr: -176> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27f3fe0) adding con mode: crc 2024-09-14T11:32:12.928 INFO:tasks.workunit.client.0.smithi071.stderr: -175> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27f3fe0) adding con mode: secure 2024-09-14T11:32:12.928 INFO:tasks.workunit.client.0.smithi071.stderr: -174> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27f3fe0) adding con mode: crc 2024-09-14T11:32:12.928 INFO:tasks.workunit.client.0.smithi071.stderr: -173> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 AuthRegistry(0x55e9d27f3fe0) adding con mode: secure 2024-09-14T11:32:12.928 INFO:tasks.workunit.client.0.smithi071.stderr: -172> 2024-09-14T11:32:12.534+0000 7f60f12109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:12.928 INFO:tasks.workunit.client.0.smithi071.stderr: -171> 2024-09-14T11:32:12.534+0000 7f60f12109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:12.928 INFO:tasks.workunit.client.0.smithi071.stderr: -170> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 asok(0x55e9d2565d90) register_command rotate-key cmddesc rotate-key hook 0x55e9d27f4128 EEXIST 2024-09-14T11:32:12.928 INFO:tasks.workunit.client.0.smithi071.stderr: -169> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient: _reopen_session rank -1 2024-09-14T11:32:12.928 INFO:tasks.workunit.client.0.smithi071.stderr: -168> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:32:12.928 INFO:tasks.workunit.client.0.smithi071.stderr: -167> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient(hunting): picked mon.noname-c con 0x55e9d2815810 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:32:12.928 INFO:tasks.workunit.client.0.smithi071.stderr: -166> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient(hunting): picked mon.noname-b con 0x55e9d28415c0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:32:12.929 INFO:tasks.workunit.client.0.smithi071.stderr: -165> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient(hunting): picked mon.noname-a con 0x55e9d2845df0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:32:12.929 INFO:tasks.workunit.client.0.smithi071.stderr: -164> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:12.929 INFO:tasks.workunit.client.0.smithi071.stderr: -163> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:12.929 INFO:tasks.workunit.client.0.smithi071.stderr: -162> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:12.929 INFO:tasks.workunit.client.0.smithi071.stderr: -161> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient(hunting): _renew_subs 2024-09-14T11:32:12.929 INFO:tasks.workunit.client.0.smithi071.stderr: -160> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient(hunting): authenticate will time out at 2344.653870s 2024-09-14T11:32:12.929 INFO:tasks.workunit.client.0.smithi071.stderr: -159> 2024-09-14T11:32:12.534+0000 7f60ee515640 10 monclient(hunting): get_auth_request con 0x55e9d2815810 auth_method 0 2024-09-14T11:32:12.929 INFO:tasks.workunit.client.0.smithi071.stderr: -158> 2024-09-14T11:32:12.534+0000 7f60ee515640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:12.929 INFO:tasks.workunit.client.0.smithi071.stderr: -157> 2024-09-14T11:32:12.534+0000 7f60ee515640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:12.929 INFO:tasks.workunit.client.0.smithi071.stderr: -156> 2024-09-14T11:32:12.534+0000 7f60ee515640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:12.929 INFO:tasks.workunit.client.0.smithi071.stderr: -155> 2024-09-14T11:32:12.534+0000 7f60eed16640 10 monclient(hunting): get_auth_request con 0x55e9d2845df0 auth_method 0 2024-09-14T11:32:12.929 INFO:tasks.workunit.client.0.smithi071.stderr: -154> 2024-09-14T11:32:12.534+0000 7f60eed16640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:12.929 INFO:tasks.workunit.client.0.smithi071.stderr: -153> 2024-09-14T11:32:12.534+0000 7f60eed16640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:12.930 INFO:tasks.workunit.client.0.smithi071.stderr: -152> 2024-09-14T11:32:12.534+0000 7f60eed16640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:12.930 INFO:tasks.workunit.client.0.smithi071.stderr: -151> 2024-09-14T11:32:12.534+0000 7f60ee515640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:12.930 INFO:tasks.workunit.client.0.smithi071.stderr: -150> 2024-09-14T11:32:12.534+0000 7f60ee515640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:12.930 INFO:tasks.workunit.client.0.smithi071.stderr: -149> 2024-09-14T11:32:12.534+0000 7f60ee515640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:12.930 INFO:tasks.workunit.client.0.smithi071.stderr: -148> 2024-09-14T11:32:12.534+0000 7f60eed16640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:12.930 INFO:tasks.workunit.client.0.smithi071.stderr: -147> 2024-09-14T11:32:12.534+0000 7f60eed16640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:12.930 INFO:tasks.workunit.client.0.smithi071.stderr: -146> 2024-09-14T11:32:12.534+0000 7f60eed16640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:12.930 INFO:tasks.workunit.client.0.smithi071.stderr: -145> 2024-09-14T11:32:12.534+0000 7f60eed16640 10 monclient(hunting): handle_auth_done global_id 7473 payload 824 2024-09-14T11:32:12.930 INFO:tasks.workunit.client.0.smithi071.stderr: -144> 2024-09-14T11:32:12.534+0000 7f60eed16640 10 monclient: _finish_hunting 0 2024-09-14T11:32:12.930 INFO:tasks.workunit.client.0.smithi071.stderr: -143> 2024-09-14T11:32:12.534+0000 7f60eed16640 1 monclient: found mon.noname-a 2024-09-14T11:32:12.930 INFO:tasks.workunit.client.0.smithi071.stderr: -142> 2024-09-14T11:32:12.534+0000 7f60eed16640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:32:12.930 INFO:tasks.workunit.client.0.smithi071.stderr: -141> 2024-09-14T11:32:12.534+0000 7f5fd0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:12.930 INFO:tasks.workunit.client.0.smithi071.stderr: -140> 2024-09-14T11:32:12.534+0000 7f5fd0ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:32:12.930 INFO:tasks.workunit.client.0.smithi071.stderr: -139> 2024-09-14T11:32:12.534+0000 7f5fd0ff9640 10 monclient: dump: 2024-09-14T11:32:12.930 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:12.931 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:12.931 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.931 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.931 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:12.931 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:12.931 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:12.931 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:12.931 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:12.931 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.931 INFO:tasks.workunit.client.0.smithi071.stderr: -138> 2024-09-14T11:32:12.534+0000 7f5fd0ff9640 10 monclient: _finish_auth 0 2024-09-14T11:32:12.931 INFO:tasks.workunit.client.0.smithi071.stderr: -137> 2024-09-14T11:32:12.534+0000 7f5fd0ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:32:12.931 INFO:tasks.workunit.client.0.smithi071.stderr: -136> 2024-09-14T11:32:12.534+0000 7f5fd0ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:12.931 INFO:tasks.workunit.client.0.smithi071.stderr: -135> 2024-09-14T11:32:12.534+0000 7f5fd0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:12.932 INFO:tasks.workunit.client.0.smithi071.stderr: -134> 2024-09-14T11:32:12.534+0000 7f5fd0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:32:12.932 INFO:tasks.workunit.client.0.smithi071.stderr: -133> 2024-09-14T11:32:12.534+0000 7f5fd0ff9640 10 monclient: dump: 2024-09-14T11:32:12.932 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:12.932 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:12.932 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.932 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:12.932 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:12.932 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:12.932 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:12.932 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:12.932 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:12.932 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.932 INFO:tasks.workunit.client.0.smithi071.stderr: -132> 2024-09-14T11:32:12.534+0000 7f5fd27fc640 4 set_mon_vals no callback set 2024-09-14T11:32:12.933 INFO:tasks.workunit.client.0.smithi071.stderr: -131> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 monclient: authenticate success, global_id 7473 2024-09-14T11:32:12.933 INFO:tasks.workunit.client.0.smithi071.stderr: -130> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient: _renew_subs 2024-09-14T11:32:12.933 INFO:tasks.workunit.client.0.smithi071.stderr: -129> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:32:12.933 INFO:tasks.workunit.client.0.smithi071.stderr: -128> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient: _renew_subs 2024-09-14T11:32:12.933 INFO:tasks.workunit.client.0.smithi071.stderr: -127> 2024-09-14T11:32:12.534+0000 7f60f12109c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:32:12.933 INFO:tasks.workunit.client.0.smithi071.stderr: -126> 2024-09-14T11:32:12.534+0000 7f60f12109c0 1 librados: init done 2024-09-14T11:32:12.933 INFO:tasks.workunit.client.0.smithi071.stderr: -125> 2024-09-14T11:32:12.534+0000 7f60f12109c0 5 asok(0x55e9d2565d90) register_command cr dump hook 0x55e9d283d5a8 2024-09-14T11:32:12.933 INFO:tasks.workunit.client.0.smithi071.stderr: -124> 2024-09-14T11:32:12.538+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.933 INFO:tasks.workunit.client.0.smithi071.stderr: -123> 2024-09-14T11:32:12.538+0000 7f5fd0ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:12.933 INFO:tasks.workunit.client.0.smithi071.stderr: -122> 2024-09-14T11:32:12.538+0000 7f5fd0ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:32:12.933 INFO:tasks.workunit.client.0.smithi071.stderr: -121> 2024-09-14T11:32:12.538+0000 7f5fd0ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:32:12.933 INFO:tasks.workunit.client.0.smithi071.stderr: -120> 2024-09-14T11:32:12.538+0000 7f60ee515640 10 monclient: get_auth_request con 0x7f5fb80718d0 auth_method 0 2024-09-14T11:32:12.933 INFO:tasks.workunit.client.0.smithi071.stderr: -119> 2024-09-14T11:32:12.538+0000 7f60ef517640 10 monclient: get_auth_request con 0x55e9d285f790 auth_method 0 2024-09-14T11:32:12.933 INFO:tasks.workunit.client.0.smithi071.stderr: -118> 2024-09-14T11:32:12.538+0000 7f60f12109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.933 INFO:tasks.workunit.client.0.smithi071.stderr: -117> 2024-09-14T11:32:12.538+0000 7f60f12109c0 20 realm 2024-09-14T11:32:12.934 INFO:tasks.workunit.client.0.smithi071.stderr: -116> 2024-09-14T11:32:12.538+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.934 INFO:tasks.workunit.client.0.smithi071.stderr: -115> 2024-09-14T11:32:12.538+0000 7f60f12109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.934 INFO:tasks.workunit.client.0.smithi071.stderr: -114> 2024-09-14T11:32:12.538+0000 7f60f12109c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:12.934 INFO:tasks.workunit.client.0.smithi071.stderr: -113> 2024-09-14T11:32:12.538+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.934 INFO:tasks.workunit.client.0.smithi071.stderr: -112> 2024-09-14T11:32:12.542+0000 7f60f12109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.934 INFO:tasks.workunit.client.0.smithi071.stderr: -111> 2024-09-14T11:32:12.542+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.934 INFO:tasks.workunit.client.0.smithi071.stderr: -110> 2024-09-14T11:32:12.542+0000 7f60ee515640 10 monclient: get_auth_request con 0x55e9d2863890 auth_method 0 2024-09-14T11:32:12.934 INFO:tasks.workunit.client.0.smithi071.stderr: -109> 2024-09-14T11:32:12.542+0000 7f60f12109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:12.934 INFO:tasks.workunit.client.0.smithi071.stderr: -108> 2024-09-14T11:32:12.542+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.934 INFO:tasks.workunit.client.0.smithi071.stderr: -107> 2024-09-14T11:32:12.542+0000 7f60ef517640 10 monclient: get_auth_request con 0x55e9d28670d0 auth_method 0 2024-09-14T11:32:12.934 INFO:tasks.workunit.client.0.smithi071.stderr: -106> 2024-09-14T11:32:12.542+0000 7f60f12109c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:12.934 INFO:tasks.workunit.client.0.smithi071.stderr: -105> 2024-09-14T11:32:12.542+0000 7f60f12109c0 20 searching for the correct realm 2024-09-14T11:32:12.934 INFO:tasks.workunit.client.0.smithi071.stderr: -104> 2024-09-14T11:32:12.542+0000 7f60eed16640 10 monclient: get_auth_request con 0x55e9d286bdd0 auth_method 0 2024-09-14T11:32:12.935 INFO:tasks.workunit.client.0.smithi071.stderr: -103> 2024-09-14T11:32:12.542+0000 7f60ee515640 10 monclient: get_auth_request con 0x7f60e0038020 auth_method 0 2024-09-14T11:32:12.935 INFO:tasks.workunit.client.0.smithi071.stderr: -102> 2024-09-14T11:32:12.546+0000 7f60ef517640 10 monclient: get_auth_request con 0x7f60d8048cc0 auth_method 0 2024-09-14T11:32:12.935 INFO:tasks.workunit.client.0.smithi071.stderr: -101> 2024-09-14T11:32:12.546+0000 7f60eed16640 0 -- 172.21.15.71:0/1224989318 >> [v2:172.21.15.157:6808/527702018,v1:172.21.15.157:6809/527702018] conn(0x7f60e00656f0 msgr2=0x7f60e006e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:12.935 INFO:tasks.workunit.client.0.smithi071.stderr: -100> 2024-09-14T11:32:12.750+0000 7f60eed16640 10 monclient: get_auth_request con 0x7f60e00656f0 auth_method 0 2024-09-14T11:32:12.935 INFO:tasks.workunit.client.0.smithi071.stderr: -99> 2024-09-14T11:32:12.754+0000 7f60ee515640 10 monclient: get_auth_request con 0x7f60d801a040 auth_method 0 2024-09-14T11:32:12.935 INFO:tasks.workunit.client.0.smithi071.stderr: -98> 2024-09-14T11:32:12.762+0000 7f60eed16640 0 -- 172.21.15.71:0/1224989318 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x55e9d286bdd0 msgr2=0x55e9d286e290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:12.935 INFO:tasks.workunit.client.0.smithi071.stderr: -97> 2024-09-14T11:32:12.762+0000 7f5fd0ff9640 1 client.7473.objecter ms_handle_reset 0x55e9d286bdd0 session 0x55e9d286b750 osd.4 2024-09-14T11:32:12.935 INFO:tasks.workunit.client.0.smithi071.stderr: -96> 2024-09-14T11:32:12.762+0000 7f5fd0ff9640 10 monclient: _renew_subs 2024-09-14T11:32:12.935 INFO:tasks.workunit.client.0.smithi071.stderr: -95> 2024-09-14T11:32:12.762+0000 7f5fd0ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:32:12.935 INFO:tasks.workunit.client.0.smithi071.stderr: -94> 2024-09-14T11:32:12.762+0000 7f60eed16640 10 monclient: get_auth_request con 0x7f5fb80813f0 auth_method 0 2024-09-14T11:32:12.935 INFO:tasks.workunit.client.0.smithi071.stderr: -93> 2024-09-14T11:32:12.770+0000 7f60f12109c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:12.935 INFO:tasks.workunit.client.0.smithi071.stderr: -92> 2024-09-14T11:32:12.770+0000 7f60f12109c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:32:12.935 INFO:tasks.workunit.client.0.smithi071.stderr: -91> 2024-09-14T11:32:12.770+0000 7f60f12109c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:12.936 INFO:tasks.workunit.client.0.smithi071.stderr: -90> 2024-09-14T11:32:12.770+0000 7f60f12109c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:32:12.936 INFO:tasks.workunit.client.0.smithi071.stderr: -89> 2024-09-14T11:32:12.770+0000 7f60f12109c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:12.936 INFO:tasks.workunit.client.0.smithi071.stderr: -88> 2024-09-14T11:32:12.770+0000 7f60f12109c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:12.936 INFO:tasks.workunit.client.0.smithi071.stderr: -87> 2024-09-14T11:32:12.770+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.936 INFO:tasks.workunit.client.0.smithi071.stderr: -86> 2024-09-14T11:32:12.770+0000 7f60f12109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.936 INFO:tasks.workunit.client.0.smithi071.stderr: -85> 2024-09-14T11:32:12.770+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.936 INFO:tasks.workunit.client.0.smithi071.stderr: -84> 2024-09-14T11:32:12.774+0000 7f60f12109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:12.936 INFO:tasks.workunit.client.0.smithi071.stderr: -83> 2024-09-14T11:32:12.774+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.936 INFO:tasks.workunit.client.0.smithi071.stderr: -82> 2024-09-14T11:32:12.774+0000 7f60f12109c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:12.936 INFO:tasks.workunit.client.0.smithi071.stderr: -81> 2024-09-14T11:32:12.774+0000 7f60f12109c0 20 zone default found 2024-09-14T11:32:12.936 INFO:tasks.workunit.client.0.smithi071.stderr: -80> 2024-09-14T11:32:12.774+0000 7f60f12109c0 4 Realm: () 2024-09-14T11:32:12.936 INFO:tasks.workunit.client.0.smithi071.stderr: -79> 2024-09-14T11:32:12.774+0000 7f60f12109c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:32:12.936 INFO:tasks.workunit.client.0.smithi071.stderr: -78> 2024-09-14T11:32:12.774+0000 7f60f12109c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:32:12.937 INFO:tasks.workunit.client.0.smithi071.stderr: -77> 2024-09-14T11:32:12.774+0000 7f60f12109c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:12.937 INFO:tasks.workunit.client.0.smithi071.stderr: -76> 2024-09-14T11:32:12.774+0000 7f60f12109c0 20 zonegroup default 2024-09-14T11:32:12.937 INFO:tasks.workunit.client.0.smithi071.stderr: -75> 2024-09-14T11:32:12.774+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.937 INFO:tasks.workunit.client.0.smithi071.stderr: -74> 2024-09-14T11:32:12.774+0000 7f60f12109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.937 INFO:tasks.workunit.client.0.smithi071.stderr: -73> 2024-09-14T11:32:12.774+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.937 INFO:tasks.workunit.client.0.smithi071.stderr: -72> 2024-09-14T11:32:12.774+0000 7f60f12109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.937 INFO:tasks.workunit.client.0.smithi071.stderr: -71> 2024-09-14T11:32:12.774+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.937 INFO:tasks.workunit.client.0.smithi071.stderr: -70> 2024-09-14T11:32:12.778+0000 7f60f12109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.937 INFO:tasks.workunit.client.0.smithi071.stderr: -69> 2024-09-14T11:32:12.778+0000 7f60f12109c0 20 started sync module instance, tier type = 2024-09-14T11:32:12.937 INFO:tasks.workunit.client.0.smithi071.stderr: -68> 2024-09-14T11:32:12.778+0000 7f60f12109c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:32:12.937 INFO:tasks.workunit.client.0.smithi071.stderr: -67> 2024-09-14T11:32:12.798+0000 7f60f12109c0 20 add_watcher() i=0 2024-09-14T11:32:12.937 INFO:tasks.workunit.client.0.smithi071.stderr: -66> 2024-09-14T11:32:12.798+0000 7f60f12109c0 20 add_watcher() i=1 2024-09-14T11:32:12.937 INFO:tasks.workunit.client.0.smithi071.stderr: -65> 2024-09-14T11:32:12.798+0000 7f60f12109c0 20 add_watcher() i=2 2024-09-14T11:32:12.937 INFO:tasks.workunit.client.0.smithi071.stderr: -64> 2024-09-14T11:32:12.798+0000 7f60f12109c0 20 add_watcher() i=3 2024-09-14T11:32:12.938 INFO:tasks.workunit.client.0.smithi071.stderr: -63> 2024-09-14T11:32:12.798+0000 7f60f12109c0 20 add_watcher() i=4 2024-09-14T11:32:12.938 INFO:tasks.workunit.client.0.smithi071.stderr: -62> 2024-09-14T11:32:12.798+0000 7f60f12109c0 20 add_watcher() i=5 2024-09-14T11:32:12.938 INFO:tasks.workunit.client.0.smithi071.stderr: -61> 2024-09-14T11:32:12.798+0000 7f60f12109c0 20 add_watcher() i=6 2024-09-14T11:32:12.938 INFO:tasks.workunit.client.0.smithi071.stderr: -60> 2024-09-14T11:32:12.802+0000 7f60f12109c0 20 add_watcher() i=7 2024-09-14T11:32:12.938 INFO:tasks.workunit.client.0.smithi071.stderr: -59> 2024-09-14T11:32:12.802+0000 7f60f12109c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:12.938 INFO:tasks.workunit.client.0.smithi071.stderr: -58> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 AuthRegistry(0x7fff07517370) adding auth protocol: cephx 2024-09-14T11:32:12.938 INFO:tasks.workunit.client.0.smithi071.stderr: -57> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 AuthRegistry(0x7fff07517370) adding auth protocol: cephx 2024-09-14T11:32:12.938 INFO:tasks.workunit.client.0.smithi071.stderr: -56> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 AuthRegistry(0x7fff07517370) adding auth protocol: cephx 2024-09-14T11:32:12.938 INFO:tasks.workunit.client.0.smithi071.stderr: -55> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 AuthRegistry(0x7fff07517370) adding con mode: secure 2024-09-14T11:32:12.938 INFO:tasks.workunit.client.0.smithi071.stderr: -54> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 AuthRegistry(0x7fff07517370) adding con mode: crc 2024-09-14T11:32:12.938 INFO:tasks.workunit.client.0.smithi071.stderr: -53> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 AuthRegistry(0x7fff07517370) adding con mode: secure 2024-09-14T11:32:12.938 INFO:tasks.workunit.client.0.smithi071.stderr: -52> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 AuthRegistry(0x7fff07517370) adding con mode: crc 2024-09-14T11:32:12.938 INFO:tasks.workunit.client.0.smithi071.stderr: -51> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 AuthRegistry(0x7fff07517370) adding con mode: secure 2024-09-14T11:32:12.938 INFO:tasks.workunit.client.0.smithi071.stderr: -50> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 AuthRegistry(0x7fff07517370) adding con mode: crc 2024-09-14T11:32:12.938 INFO:tasks.workunit.client.0.smithi071.stderr: -49> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 AuthRegistry(0x7fff07517370) adding con mode: crc 2024-09-14T11:32:12.939 INFO:tasks.workunit.client.0.smithi071.stderr: -48> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 AuthRegistry(0x7fff07517370) adding con mode: secure 2024-09-14T11:32:12.939 INFO:tasks.workunit.client.0.smithi071.stderr: -47> 2024-09-14T11:32:12.806+0000 7f5fa57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:12.939 INFO:tasks.workunit.client.0.smithi071.stderr: -46> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 AuthRegistry(0x7fff07517370) adding con mode: crc 2024-09-14T11:32:12.939 INFO:tasks.workunit.client.0.smithi071.stderr: -45> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 AuthRegistry(0x7fff07517370) adding con mode: secure 2024-09-14T11:32:12.939 INFO:tasks.workunit.client.0.smithi071.stderr: -44> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 AuthRegistry(0x7fff07517370) adding con mode: crc 2024-09-14T11:32:12.939 INFO:tasks.workunit.client.0.smithi071.stderr: -43> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 AuthRegistry(0x7fff07517370) adding con mode: secure 2024-09-14T11:32:12.939 INFO:tasks.workunit.client.0.smithi071.stderr: -42> 2024-09-14T11:32:12.806+0000 7f60f12109c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:12.939 INFO:tasks.workunit.client.0.smithi071.stderr: -41> 2024-09-14T11:32:12.806+0000 7f60f12109c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:12.939 INFO:tasks.workunit.client.0.smithi071.stderr: -40> 2024-09-14T11:32:12.806+0000 7f60f12109c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:12.939 INFO:tasks.workunit.client.0.smithi071.stderr: -39> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 asok(0x55e9d2565d90) register_command cache list hook 0x55e9d2845370 2024-09-14T11:32:12.939 INFO:tasks.workunit.client.0.smithi071.stderr: -38> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 asok(0x55e9d2565d90) register_command cache inspect hook 0x55e9d2845370 2024-09-14T11:32:12.939 INFO:tasks.workunit.client.0.smithi071.stderr: -37> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 asok(0x55e9d2565d90) register_command cache erase hook 0x55e9d2845370 2024-09-14T11:32:12.939 INFO:tasks.workunit.client.0.smithi071.stderr: -36> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 asok(0x55e9d2565d90) register_command cache zap hook 0x55e9d2845370 2024-09-14T11:32:12.939 INFO:tasks.workunit.client.0.smithi071.stderr: -35> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 note: GC not initialized 2024-09-14T11:32:12.940 INFO:tasks.workunit.client.0.smithi071.stderr: -34> 2024-09-14T11:32:12.806+0000 7f5f1ffff640 20 reqs_thread_entry: start 2024-09-14T11:32:12.940 INFO:tasks.workunit.client.0.smithi071.stderr: -33> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 asok(0x55e9d2565d90) register_command sync trace show hook 0x7f60d8084070 2024-09-14T11:32:12.940 INFO:tasks.workunit.client.0.smithi071.stderr: -32> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 asok(0x55e9d2565d90) register_command sync trace history hook 0x7f60d8084070 2024-09-14T11:32:12.940 INFO:tasks.workunit.client.0.smithi071.stderr: -31> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 asok(0x55e9d2565d90) register_command sync trace active hook 0x7f60d8084070 2024-09-14T11:32:12.940 INFO:tasks.workunit.client.0.smithi071.stderr: -30> 2024-09-14T11:32:12.806+0000 7f60f12109c0 5 asok(0x55e9d2565d90) register_command sync trace active_short hook 0x7f60d8084070 2024-09-14T11:32:12.940 INFO:tasks.workunit.client.0.smithi071.stderr: -29> 2024-09-14T11:32:12.806+0000 7f60f12109c0 20 init_complete bucket index max shards: 11 2024-09-14T11:32:12.940 INFO:tasks.workunit.client.0.smithi071.stderr: -28> 2024-09-14T11:32:12.806+0000 7f60f12109c0 20 Filter name: none 2024-09-14T11:32:12.940 INFO:tasks.workunit.client.0.smithi071.stderr: -27> 2024-09-14T11:32:12.806+0000 7f5f1dffb640 20 reqs_thread_entry: start 2024-09-14T11:32:12.940 INFO:tasks.workunit.client.0.smithi071.stderr: -26> 2024-09-14T11:32:12.806+0000 7f60f12109c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:32:12.940 INFO:tasks.workunit.client.0.smithi071.stderr: -25> 2024-09-14T11:32:12.806+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.940 INFO:tasks.workunit.client.0.smithi071.stderr: -24> 2024-09-14T11:32:12.806+0000 7f60f12109c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:12.940 INFO:tasks.workunit.client.0.smithi071.stderr: -23> 2024-09-14T11:32:12.806+0000 7f60f12109c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:32:12.940 INFO:tasks.workunit.client.0.smithi071.stderr: -22> 2024-09-14T11:32:12.806+0000 7f60f12109c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:32:12.941 INFO:tasks.workunit.client.0.smithi071.stderr: -21> 2024-09-14T11:32:12.806+0000 7f60f12109c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 : miss 2024-09-14T11:32:12.941 INFO:tasks.workunit.client.0.smithi071.stderr: -20> 2024-09-14T11:32:12.806+0000 7f60f12109c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.941 INFO:tasks.workunit.client.0.smithi071.stderr: -19> 2024-09-14T11:32:12.810+0000 7f60f12109c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:12.941 INFO:tasks.workunit.client.0.smithi071.stderr: -18> 2024-09-14T11:32:12.810+0000 7f60f12109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 info.flags=0x17 2024-09-14T11:32:12.941 INFO:tasks.workunit.client.0.smithi071.stderr: -17> 2024-09-14T11:32:12.810+0000 7f60f12109c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 to cache LRU end 2024-09-14T11:32:12.941 INFO:tasks.workunit.client.0.smithi071.stderr: -16> 2024-09-14T11:32:12.810+0000 7f60f12109c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:12.941 INFO:tasks.workunit.client.0.smithi071.stderr: -15> 2024-09-14T11:32:12.810+0000 7f60f12109c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:12.941 INFO:tasks.workunit.client.0.smithi071.stderr: -14> 2024-09-14T11:32:12.810+0000 7f60f12109c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 2024-09-14T11:32:12.941 INFO:tasks.workunit.client.0.smithi071.stderr: -13> 2024-09-14T11:32:12.818+0000 7f60f12109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 info.flags=0x17 2024-09-14T11:32:12.941 INFO:tasks.workunit.client.0.smithi071.stderr: -12> 2024-09-14T11:32:12.818+0000 7f60f12109c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 to cache LRU end 2024-09-14T11:32:12.941 INFO:tasks.workunit.client.0.smithi071.stderr: -11> 2024-09-14T11:32:12.818+0000 7f60f12109c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:12.941 INFO:tasks.workunit.client.0.smithi071.stderr: -10> 2024-09-14T11:32:12.818+0000 7f60f12109c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35, ofs0, ns] 2024-09-14T11:32:12.941 INFO:tasks.workunit.client.0.smithi071.stderr: -9> 2024-09-14T11:32:12.818+0000 7f5fd27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464281 cookie 94462747794768 notifier 7473 bl.length()=995 2024-09-14T11:32:12.941 INFO:tasks.workunit.client.0.smithi071.stderr: -8> 2024-09-14T11:32:12.818+0000 7f5fd27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 info.flags=0x17 2024-09-14T11:32:12.942 INFO:tasks.workunit.client.0.smithi071.stderr: -7> 2024-09-14T11:32:12.818+0000 7f5fd27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 to cache LRU end 2024-09-14T11:32:12.942 INFO:tasks.workunit.client.0.smithi071.stderr: -6> 2024-09-14T11:32:12.818+0000 7f5fd27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:12.942 INFO:tasks.workunit.client.0.smithi071.stderr: -5> 2024-09-14T11:32:12.818+0000 7f60f12109c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.35]): orig_sources= new_sources= 2024-09-14T11:32:12.942 INFO:tasks.workunit.client.0.smithi071.stderr: -4> 2024-09-14T11:32:12.818+0000 7f60f12109c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.35]): potential sources added=[] removed=[] 2024-09-14T11:32:12.942 INFO:tasks.workunit.client.0.smithi071.stderr: -3> 2024-09-14T11:32:12.818+0000 7f60f12109c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.35]): orig_dests= new_dests= 2024-09-14T11:32:12.942 INFO:tasks.workunit.client.0.smithi071.stderr: -2> 2024-09-14T11:32:12.818+0000 7f60f12109c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.35]): potential dests added=[] removed=[] 2024-09-14T11:32:12.942 INFO:tasks.workunit.client.0.smithi071.stderr: -1> 2024-09-14T11:32:12.834+0000 7f60f12109c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f60f12109c0 time 2024-09-14T11:32:12.834083+0000 2024-09-14T11:32:12.942 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:32:12.942 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.942 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:12.942 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f60f4aea2eb] 2024-09-14T11:32:12.942 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f60f4aea49f] 2024-09-14T11:32:12.942 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e9d10e8c01] 2024-09-14T11:32:12.942 INFO:tasks.workunit.client.0.smithi071.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e9d10fdf3a] 2024-09-14T11:32:12.942 INFO:tasks.workunit.client.0.smithi071.stderr: 5: main() 2024-09-14T11:32:12.943 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f60f3950d90] 2024-09-14T11:32:12.943 INFO:tasks.workunit.client.0.smithi071.stderr: 7: __libc_start_main() 2024-09-14T11:32:12.943 INFO:tasks.workunit.client.0.smithi071.stderr: 8: _start() 2024-09-14T11:32:12.943 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.943 INFO:tasks.workunit.client.0.smithi071.stderr: 0> 2024-09-14T11:32:12.834+0000 7f60f12109c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:32:12.943 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f60f12109c0 thread_name:radosgw-admin 2024-09-14T11:32:12.943 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.943 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:12.943 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f60f3969520] 2024-09-14T11:32:12.943 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:32:12.943 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:32:12.943 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:32:12.943 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f60f4aea345] 2024-09-14T11:32:12.943 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f60f4aea49f] 2024-09-14T11:32:12.944 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e9d10e8c01] 2024-09-14T11:32:12.944 INFO:tasks.workunit.client.0.smithi071.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e9d10fdf3a] 2024-09-14T11:32:12.944 INFO:tasks.workunit.client.0.smithi071.stderr: 9: main() 2024-09-14T11:32:12.944 INFO:tasks.workunit.client.0.smithi071.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f60f3950d90] 2024-09-14T11:32:12.944 INFO:tasks.workunit.client.0.smithi071.stderr: 11: __libc_start_main() 2024-09-14T11:32:12.944 INFO:tasks.workunit.client.0.smithi071.stderr: 12: _start() 2024-09-14T11:32:12.944 INFO:tasks.workunit.client.0.smithi071.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:32:12.944 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:12.944 INFO:tasks.workunit.client.0.smithi071.stderr:--- logging levels --- 2024-09-14T11:32:12.944 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 none 2024-09-14T11:32:12.944 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 lockdep 2024-09-14T11:32:12.944 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 context 2024-09-14T11:32:12.944 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 crush 2024-09-14T11:32:12.944 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds 2024-09-14T11:32:12.945 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_balancer 2024-09-14T11:32:12.945 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_locker 2024-09-14T11:32:12.945 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log 2024-09-14T11:32:12.945 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log_expire 2024-09-14T11:32:12.945 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_migrator 2024-09-14T11:32:12.945 INFO:tasks.workunit.client.0.smithi071.stderr: 3/ 5 mds_quiesce 2024-09-14T11:32:12.945 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 buffer 2024-09-14T11:32:12.945 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 timer 2024-09-14T11:32:12.945 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 filer 2024-09-14T11:32:12.945 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 striper 2024-09-14T11:32:12.945 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 objecter 2024-09-14T11:32:12.945 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rados 2024-09-14T11:32:12.945 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd 2024-09-14T11:32:12.945 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_mirror 2024-09-14T11:32:12.946 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_replay 2024-09-14T11:32:12.946 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_pwl 2024-09-14T11:32:12.946 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 journaler 2024-09-14T11:32:12.946 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objectcacher 2024-09-14T11:32:12.946 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:32:12.946 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 client 2024-09-14T11:32:12.946 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 osd 2024-09-14T11:32:12.946 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 optracker 2024-09-14T11:32:12.946 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objclass 2024-09-14T11:32:12.946 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 filestore 2024-09-14T11:32:12.946 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 journal 2024-09-14T11:32:12.946 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 ms 2024-09-14T11:32:12.946 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mon 2024-09-14T11:32:12.946 INFO:tasks.workunit.client.0.smithi071.stderr: 0/10 monc 2024-09-14T11:32:12.946 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 paxos 2024-09-14T11:32:12.947 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 tp 2024-09-14T11:32:12.947 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 auth 2024-09-14T11:32:12.947 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 crypto 2024-09-14T11:32:12.947 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 finisher 2024-09-14T11:32:12.947 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 reserver 2024-09-14T11:32:12.947 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 heartbeatmap 2024-09-14T11:32:12.947 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 perfcounter 2024-09-14T11:32:12.947 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw 2024-09-14T11:32:12.947 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_sync 2024-09-14T11:32:12.947 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_datacache 2024-09-14T11:32:12.947 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_access 2024-09-14T11:32:12.947 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:32:12.947 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_flight 2024-09-14T11:32:12.948 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:32:12.948 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw_notification 2024-09-14T11:32:12.948 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 javaclient 2024-09-14T11:32:12.948 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 asok 2024-09-14T11:32:12.948 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 throttle 2024-09-14T11:32:12.948 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 refs 2024-09-14T11:32:12.948 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 compressor 2024-09-14T11:32:12.948 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluestore 2024-09-14T11:32:12.948 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluefs 2024-09-14T11:32:12.948 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 bdev 2024-09-14T11:32:12.948 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 kstore 2024-09-14T11:32:12.948 INFO:tasks.workunit.client.0.smithi071.stderr: 4/ 5 rocksdb 2024-09-14T11:32:12.948 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 fuse 2024-09-14T11:32:12.948 INFO:tasks.workunit.client.0.smithi071.stderr: 2/ 5 mgr 2024-09-14T11:32:12.949 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mgrc 2024-09-14T11:32:12.949 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 dpdk 2024-09-14T11:32:12.949 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 eventtrace 2024-09-14T11:32:12.949 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 prioritycache 2024-09-14T11:32:12.949 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 test 2024-09-14T11:32:12.949 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:32:12.949 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephsqlite 2024-09-14T11:32:12.949 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:32:12.949 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore 2024-09-14T11:32:12.949 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_onode 2024-09-14T11:32:12.949 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_odata 2024-09-14T11:32:12.949 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_omap 2024-09-14T11:32:12.949 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_tm 2024-09-14T11:32:12.949 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_t 2024-09-14T11:32:12.949 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:32:12.950 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_epm 2024-09-14T11:32:12.950 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_lba 2024-09-14T11:32:12.950 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:32:12.950 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cache 2024-09-14T11:32:12.950 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_journal 2024-09-14T11:32:12.950 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_device 2024-09-14T11:32:12.950 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_backref 2024-09-14T11:32:12.950 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 alienstore 2024-09-14T11:32:12.950 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mclock 2024-09-14T11:32:12.950 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cyanstore 2024-09-14T11:32:12.950 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 ceph_exporter 2024-09-14T11:32:12.950 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 memstore 2024-09-14T11:32:12.950 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 trace 2024-09-14T11:32:12.950 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 ceph_dedup 2024-09-14T11:32:12.950 INFO:tasks.workunit.client.0.smithi071.stderr: -2/-2 (syslog threshold) 2024-09-14T11:32:12.951 INFO:tasks.workunit.client.0.smithi071.stderr: 99/99 (stderr threshold) 2024-09-14T11:32:12.951 INFO:tasks.workunit.client.0.smithi071.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:32:12.951 INFO:tasks.workunit.client.0.smithi071.stderr: 7f5f1dffb640 / http_manager 2024-09-14T11:32:12.951 INFO:tasks.workunit.client.0.smithi071.stderr: 7f5f1ffff640 / http_manager 2024-09-14T11:32:12.951 INFO:tasks.workunit.client.0.smithi071.stderr: 7f5fa57e2640 / rgw_dt_lg_renew 2024-09-14T11:32:12.951 INFO:tasks.workunit.client.0.smithi071.stderr: 7f5fd0ff9640 / ms_dispatch 2024-09-14T11:32:12.951 INFO:tasks.workunit.client.0.smithi071.stderr: 7f5fd27fc640 / io_context_pool 2024-09-14T11:32:12.951 INFO:tasks.workunit.client.0.smithi071.stderr: 7f5fd8e01640 / ms_dispatch 2024-09-14T11:32:12.951 INFO:tasks.workunit.client.0.smithi071.stderr: 7f5fdb606640 / ms_dispatch 2024-09-14T11:32:12.951 INFO:tasks.workunit.client.0.smithi071.stderr: 7f5fdce09640 / io_context_pool 2024-09-14T11:32:12.951 INFO:tasks.workunit.client.0.smithi071.stderr: 7f60ee515640 / msgr-worker-2 2024-09-14T11:32:12.951 INFO:tasks.workunit.client.0.smithi071.stderr: 7f60eed16640 / msgr-worker-1 2024-09-14T11:32:12.951 INFO:tasks.workunit.client.0.smithi071.stderr: 7f60ef517640 / msgr-worker-0 2024-09-14T11:32:12.951 INFO:tasks.workunit.client.0.smithi071.stderr: 7f60efd18640 / io_context_pool 2024-09-14T11:32:12.952 INFO:tasks.workunit.client.0.smithi071.stderr: 7f60f12109c0 / radosgw-admin 2024-09-14T11:32:12.952 INFO:tasks.workunit.client.0.smithi071.stderr: max_recent 500 2024-09-14T11:32:12.952 INFO:tasks.workunit.client.0.smithi071.stderr: max_new 1000 2024-09-14T11:32:12.952 INFO:tasks.workunit.client.0.smithi071.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:32:12.836126Z_4202252f-c0e9-4756-9af3-19f57f509421/log 2024-09-14T11:32:12.952 INFO:tasks.workunit.client.0.smithi071.stderr:--- end dump of recent events --- 2024-09-14T11:32:12.953 INFO:tasks.workunit.client.0.smithi071.stderr:Aborted 2024-09-14T11:32:12.953 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:32:12.953 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:12.954 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:12.954 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.918+0000 7f8c38d459c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.954 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.918+0000 7f8c38d459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.954 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.918+0000 7f8c38d459c0 20 realm 2024-09-14T11:32:12.954 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.918+0000 7f8c38d459c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.954 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.918+0000 7f8c38d459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.954 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.922+0000 7f8c38d459c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:12.954 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.922+0000 7f8c38d459c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.954 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.922+0000 7f8c38d459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.954 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.922+0000 7f8c38d459c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.954 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.922+0000 7f8c38d459c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:12.954 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.922+0000 7f8c38d459c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.954 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.922+0000 7f8c38d459c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:12.955 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.922+0000 7f8c38d459c0 20 searching for the correct realm 2024-09-14T11:32:12.955 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:12.926+0000 7f8c3704c640 0 -- 172.21.15.71:0/2315361607 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f8c2c03f070 msgr2=0x7f8c2c01b950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:13.137 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.142+0000 7f8c3704c640 0 -- 172.21.15.71:0/2315361607 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55a61a313910 msgr2=0x55a61a315d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:13.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.154+0000 7f8c38d459c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:13.152 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.154+0000 7f8c38d459c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:32:13.152 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.154+0000 7f8c38d459c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:13.152 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.154+0000 7f8c38d459c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:32:13.152 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.154+0000 7f8c38d459c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:13.152 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.154+0000 7f8c38d459c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:13.152 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.154+0000 7f8c38d459c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.152 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.154+0000 7f8c38d459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.152 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.154+0000 7f8c38d459c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.153 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.158+0000 7f8c38d459c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:13.153 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.158+0000 7f8c38d459c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.154 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.158+0000 7f8c38d459c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:13.154 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.158+0000 7f8c38d459c0 20 zone default found 2024-09-14T11:32:13.154 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.158+0000 7f8c38d459c0 4 Realm: () 2024-09-14T11:32:13.154 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.158+0000 7f8c38d459c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:32:13.154 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.158+0000 7f8c38d459c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:32:13.154 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.158+0000 7f8c38d459c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:13.154 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.158+0000 7f8c38d459c0 20 zonegroup default 2024-09-14T11:32:13.155 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.158+0000 7f8c38d459c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.155 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.158+0000 7f8c38d459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.155 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.158+0000 7f8c38d459c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.155 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.158+0000 7f8c38d459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.155 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.158+0000 7f8c38d459c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.156 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.158+0000 7f8c38d459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.157 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.158+0000 7f8c38d459c0 20 started sync module instance, tier type = 2024-09-14T11:32:13.157 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.158+0000 7f8c38d459c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:32:13.179 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.182+0000 7f8c38d459c0 20 add_watcher() i=0 2024-09-14T11:32:13.179 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.182+0000 7f8c38d459c0 20 add_watcher() i=1 2024-09-14T11:32:13.179 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.182+0000 7f8c38d459c0 20 add_watcher() i=2 2024-09-14T11:32:13.179 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.182+0000 7f8c38d459c0 20 add_watcher() i=3 2024-09-14T11:32:13.179 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.182+0000 7f8c38d459c0 20 add_watcher() i=4 2024-09-14T11:32:13.179 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.182+0000 7f8c38d459c0 20 add_watcher() i=5 2024-09-14T11:32:13.179 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.182+0000 7f8c38d459c0 20 add_watcher() i=6 2024-09-14T11:32:13.181 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.186+0000 7f8c38d459c0 20 add_watcher() i=7 2024-09-14T11:32:13.181 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.186+0000 7f8c38d459c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:13.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.190+0000 7f8aed7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:13.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.190+0000 7f8c38d459c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:13.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.190+0000 7f8c38d459c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:13.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.190+0000 7f8c38d459c0 5 note: GC not initialized 2024-09-14T11:32:13.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.190+0000 7f8a67fff640 20 reqs_thread_entry: start 2024-09-14T11:32:13.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.190+0000 7f8c38d459c0 20 init_complete bucket index max shards: 11 2024-09-14T11:32:13.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.190+0000 7f8c38d459c0 20 Filter name: none 2024-09-14T11:32:13.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.190+0000 7f8a65ffb640 20 reqs_thread_entry: start 2024-09-14T11:32:13.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.190+0000 7f8c38d459c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.194+0000 7f8c38d459c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:13.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.194+0000 7f8c38d459c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.194+0000 7f8c38d459c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:32:13.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.194+0000 7f8c38d459c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:13.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.194+0000 7f8c38d459c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.194+0000 7f8c38d459c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:13.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.194+0000 7f8c38d459c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.191 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.194+0000 7f8c38d459c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:32:13.191 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.194+0000 7f8c38d459c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:13.194 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.198+0000 7f8aed7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:13.198 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.202+0000 7f8c38d459c0 20 remove_watcher() i=0 2024-09-14T11:32:13.198 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.202+0000 7f8c38d459c0 2 removed watcher, disabling cache 2024-09-14T11:32:13.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.202+0000 7f8c38d459c0 20 remove_watcher() i=1 2024-09-14T11:32:13.202 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.206+0000 7f8c38d459c0 20 remove_watcher() i=2 2024-09-14T11:32:13.204 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.206+0000 7f8c38d459c0 20 remove_watcher() i=3 2024-09-14T11:32:13.206 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.210+0000 7f8c38d459c0 20 remove_watcher() i=4 2024-09-14T11:32:13.208 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.210+0000 7f8c38d459c0 20 remove_watcher() i=5 2024-09-14T11:32:13.210 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.214+0000 7f8c38d459c0 20 remove_watcher() i=6 2024-09-14T11:32:13.213 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.218+0000 7f8c38d459c0 20 remove_watcher() i=7 2024-09-14T11:32:13.229 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:13.229 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:32:13.229 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: abort-at-do-reshard id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:32:13.229 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:13.282 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:32:13.318 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:13.318 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:13.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.366+0000 7f45e5a309c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.365 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.370+0000 7f45e5a309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.365 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.370+0000 7f45e5a309c0 20 realm 2024-09-14T11:32:13.365 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.370+0000 7f45e5a309c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.366 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.370+0000 7f45e5a309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.366 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.370+0000 7f45e5a309c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:13.366 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.370+0000 7f45e5a309c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.366 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.370+0000 7f45e5a309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.366 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.370+0000 7f45e5a309c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.367 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.370+0000 7f45e5a309c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:13.367 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.370+0000 7f45e5a309c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.368 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.370+0000 7f45e5a309c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:13.368 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.370+0000 7f45e5a309c0 20 searching for the correct realm 2024-09-14T11:32:13.372 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.374+0000 7f45e3d37640 0 -- 172.21.15.71:0/3697349961 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f45d410d070 msgr2=0x7f45d4007bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:13.378 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.382+0000 7f45e3d37640 0 -- 172.21.15.71:0/3697349961 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x5607f7381470 msgr2=0x5607f7383880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:13.388 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.390+0000 7f45e5a309c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:13.388 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.390+0000 7f45e5a309c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:32:13.388 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.390+0000 7f45e5a309c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:13.388 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.390+0000 7f45e5a309c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:32:13.388 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.390+0000 7f45e5a309c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:13.388 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.390+0000 7f45e5a309c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:13.388 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.390+0000 7f45e5a309c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.389 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.390+0000 7f45e5a309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.389 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.390+0000 7f45e5a309c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.389 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.390+0000 7f45e5a309c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:13.389 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.390+0000 7f45e5a309c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.389 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.394+0000 7f45e5a309c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:13.389 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.394+0000 7f45e5a309c0 20 zone default found 2024-09-14T11:32:13.389 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.394+0000 7f45e5a309c0 4 Realm: () 2024-09-14T11:32:13.389 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.394+0000 7f45e5a309c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:32:13.389 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.394+0000 7f45e5a309c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:32:13.390 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.394+0000 7f45e5a309c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:13.390 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.394+0000 7f45e5a309c0 20 zonegroup default 2024-09-14T11:32:13.390 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.394+0000 7f45e5a309c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.391 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.394+0000 7f45e5a309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.391 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.394+0000 7f45e5a309c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.391 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.394+0000 7f45e5a309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.391 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.394+0000 7f45e5a309c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.391 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.394+0000 7f45e5a309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.391 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.394+0000 7f45e5a309c0 20 started sync module instance, tier type = 2024-09-14T11:32:13.391 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.394+0000 7f45e5a309c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:32:13.409 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.414+0000 7f45e5a309c0 20 add_watcher() i=0 2024-09-14T11:32:13.409 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.414+0000 7f45e5a309c0 20 add_watcher() i=1 2024-09-14T11:32:13.409 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.414+0000 7f45e5a309c0 20 add_watcher() i=2 2024-09-14T11:32:13.409 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.414+0000 7f45e5a309c0 20 add_watcher() i=3 2024-09-14T11:32:13.409 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.414+0000 7f45e5a309c0 20 add_watcher() i=4 2024-09-14T11:32:13.409 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.414+0000 7f45e5a309c0 20 add_watcher() i=5 2024-09-14T11:32:13.409 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.414+0000 7f45e5a309c0 20 add_watcher() i=6 2024-09-14T11:32:13.411 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.414+0000 7f45e5a309c0 20 add_watcher() i=7 2024-09-14T11:32:13.411 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.414+0000 7f45e5a309c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:13.415 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.418+0000 7f4499fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:13.416 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.418+0000 7f45e5a309c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:13.416 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.418+0000 7f45e5a309c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:13.416 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.418+0000 7f45e5a309c0 5 note: GC not initialized 2024-09-14T11:32:13.416 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.418+0000 7f4498fe1640 20 reqs_thread_entry: start 2024-09-14T11:32:13.417 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.418+0000 7f45e5a309c0 20 init_complete bucket index max shards: 11 2024-09-14T11:32:13.417 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.418+0000 7f45e5a309c0 20 Filter name: none 2024-09-14T11:32:13.417 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.418+0000 7f44127fc640 20 reqs_thread_entry: start 2024-09-14T11:32:13.417 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.418+0000 7f45e5a309c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:32:13.417 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.418+0000 7f45e5a309c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.418 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.422+0000 7f45e5a309c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:13.418 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.422+0000 7f45e5a309c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:32:13.418 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.422+0000 7f45e5a309c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:32:13.418 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.422+0000 7f45e5a309c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 : miss 2024-09-14T11:32:13.418 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.422+0000 7f45e5a309c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.418 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.422+0000 7f45e5a309c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:32:13.418 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.422+0000 7f45e5a309c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 info.flags=0x17 2024-09-14T11:32:13.418 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.422+0000 7f45e5a309c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 to cache LRU end 2024-09-14T11:32:13.418 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.422+0000 7f45e5a309c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:13.418 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.422+0000 7f45e5a309c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:13.418 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.422+0000 7f45e5a309c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 2024-09-14T11:32:13.419 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.422+0000 7f45e5a309c0 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 to be held by another RGW process; skipping for now 2024-09-14T11:32:13.419 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.422+0000 7f4499fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:13.424 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.426+0000 7f45e5a309c0 20 remove_watcher() i=0 2024-09-14T11:32:13.424 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.426+0000 7f45e5a309c0 2 removed watcher, disabling cache 2024-09-14T11:32:13.426 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.430+0000 7f45e5a309c0 20 remove_watcher() i=1 2024-09-14T11:32:13.428 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.430+0000 7f45e5a309c0 20 remove_watcher() i=2 2024-09-14T11:32:13.430 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.434+0000 7f45e5a309c0 20 remove_watcher() i=3 2024-09-14T11:32:13.432 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.434+0000 7f45e5a309c0 20 remove_watcher() i=4 2024-09-14T11:32:13.434 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.438+0000 7f45e5a309c0 20 remove_watcher() i=5 2024-09-14T11:32:13.437 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.442+0000 7f45e5a309c0 20 remove_watcher() i=6 2024-09-14T11:32:13.440 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:13.442+0000 7f45e5a309c0 20 remove_watcher() i=7 2024-09-14T11:32:13.454 INFO:tasks.workunit.client.0.smithi071.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:32:43.485 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:32:43.523 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:43.523 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:43.569 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.573+0000 7f3aeee8e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:43.572 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.573+0000 7f3aeee8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:43.572 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.573+0000 7f3aeee8e9c0 20 realm 2024-09-14T11:32:43.572 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.573+0000 7f3aeee8e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:43.572 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.573+0000 7f3aeee8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:43.572 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.573+0000 7f3aeee8e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:43.572 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.573+0000 7f3aeee8e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:43.572 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.573+0000 7f3aeee8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:43.572 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.573+0000 7f3aeee8e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:43.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.577+0000 7f3aeee8e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:43.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.577+0000 7f3aeee8e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:43.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.577+0000 7f3aeee8e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:43.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.577+0000 7f3aeee8e9c0 20 searching for the correct realm 2024-09-14T11:32:43.577 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.581+0000 7f3aed195640 0 -- 172.21.15.71:0/2355286932 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f3ae0062640 msgr2=0x7f3ae006c840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:43.792 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.793+0000 7f3aed195640 0 -- 172.21.15.71:0/2355286932 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55e9f046c270 msgr2=0x55e9f046e660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:43.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.809+0000 7f3aeee8e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:43.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.809+0000 7f3aeee8e9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:32:43.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.809+0000 7f3aeee8e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:43.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.809+0000 7f3aeee8e9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:32:43.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.809+0000 7f3aeee8e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:43.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.809+0000 7f3aeee8e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:43.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.809+0000 7f3aeee8e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:43.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.809+0000 7f3aeee8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:43.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.809+0000 7f3aeee8e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:43.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.809+0000 7f3aeee8e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:43.808 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.809+0000 7f3aeee8e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:43.809 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.809+0000 7f3aeee8e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:43.809 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.809+0000 7f3aeee8e9c0 20 zone default found 2024-09-14T11:32:43.809 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.809+0000 7f3aeee8e9c0 4 Realm: () 2024-09-14T11:32:43.809 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.809+0000 7f3aeee8e9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:32:43.809 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.809+0000 7f3aeee8e9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:32:43.809 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.809+0000 7f3aeee8e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:43.809 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.809+0000 7f3aeee8e9c0 20 zonegroup default 2024-09-14T11:32:43.809 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.809+0000 7f3aeee8e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:43.809 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.813+0000 7f3aeee8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:43.810 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.813+0000 7f3aeee8e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:43.810 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.813+0000 7f3aeee8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:43.810 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.813+0000 7f3aeee8e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:43.811 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.813+0000 7f3aeee8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:43.811 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.813+0000 7f3aeee8e9c0 20 started sync module instance, tier type = 2024-09-14T11:32:43.811 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.813+0000 7f3aeee8e9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:32:43.835 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.837+0000 7f3aeee8e9c0 20 add_watcher() i=0 2024-09-14T11:32:43.835 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.837+0000 7f3aeee8e9c0 20 add_watcher() i=1 2024-09-14T11:32:43.835 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.837+0000 7f3aeee8e9c0 20 add_watcher() i=2 2024-09-14T11:32:43.835 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.837+0000 7f3aeee8e9c0 20 add_watcher() i=3 2024-09-14T11:32:43.835 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.837+0000 7f3aeee8e9c0 20 add_watcher() i=4 2024-09-14T11:32:43.835 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.837+0000 7f3aeee8e9c0 20 add_watcher() i=5 2024-09-14T11:32:43.835 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.837+0000 7f3aeee8e9c0 20 add_watcher() i=6 2024-09-14T11:32:43.837 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.841+0000 7f3aeee8e9c0 20 add_watcher() i=7 2024-09-14T11:32:43.837 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.841+0000 7f3aeee8e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:43.841 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.845+0000 7f39a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:43.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.845+0000 7f3aeee8e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:43.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.845+0000 7f3aeee8e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:43.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.845+0000 7f3aeee8e9c0 5 note: GC not initialized 2024-09-14T11:32:43.844 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.845+0000 7f39a1fe3640 20 reqs_thread_entry: start 2024-09-14T11:32:43.844 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.845+0000 7f3aeee8e9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:32:43.844 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.845+0000 7f3aeee8e9c0 20 Filter name: none 2024-09-14T11:32:43.844 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.845+0000 7f39137fe640 20 reqs_thread_entry: start 2024-09-14T11:32:43.845 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.849+0000 7f3aeee8e9c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:32:43.845 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.849+0000 7f3aeee8e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:43.845 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.849+0000 7f3aeee8e9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:43.846 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.849+0000 7f3aeee8e9c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:32:43.846 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.849+0000 7f3aeee8e9c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:32:43.846 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.849+0000 7f3aeee8e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 : miss 2024-09-14T11:32:43.846 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.849+0000 7f3aeee8e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:43.846 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.849+0000 7f3aeee8e9c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:32:43.846 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.849+0000 7f3aeee8e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 info.flags=0x17 2024-09-14T11:32:43.846 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.849+0000 7f3aeee8e9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 to cache LRU end 2024-09-14T11:32:43.847 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.849+0000 7f3aeee8e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:43.847 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.849+0000 7f3aeee8e9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:43.847 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.849+0000 7f3aeee8e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 2024-09-14T11:32:43.848 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.849+0000 7f3aeee8e9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:32:43.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.865+0000 7f3aeee8e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 info.flags=0x17 2024-09-14T11:32:43.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.865+0000 7f3aeee8e9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 to cache LRU end 2024-09-14T11:32:43.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.865+0000 7f3aeee8e9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:43.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.865+0000 7f3aeee8e9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35, ofs0, ns] 2024-09-14T11:32:43.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.865+0000 7f39c37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464282 cookie 94463246918032 notifier 7154 bl.length()=995 2024-09-14T11:32:43.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.865+0000 7f39c37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 info.flags=0x17 2024-09-14T11:32:43.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.865+0000 7f39c37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 to cache LRU end 2024-09-14T11:32:43.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.865+0000 7f39c37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:43.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.865+0000 7f3aeee8e9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.35]): orig_sources= new_sources= 2024-09-14T11:32:43.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.865+0000 7f3aeee8e9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.35]): potential sources added=[] removed=[] 2024-09-14T11:32:43.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.865+0000 7f3aeee8e9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.35]): orig_dests= new_dests= 2024-09-14T11:32:43.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.865+0000 7f3aeee8e9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.35]): potential dests added=[] removed=[] 2024-09-14T11:32:43.876 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.877+0000 7f3aeee8e9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.2.0 2024-09-14T11:32:43.876 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.877+0000 7f3aeee8e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.2.0 2024-09-14T11:32:43.876 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.877+0000 7f3aeee8e9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.2.1 2024-09-14T11:32:43.876 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.877+0000 7f3aeee8e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.2.1 2024-09-14T11:32:43.876 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.877+0000 7f3aeee8e9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.2.2 2024-09-14T11:32:43.876 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.877+0000 7f3aeee8e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.2.2 2024-09-14T11:32:43.876 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.877+0000 7f3aeee8e9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.2.3 2024-09-14T11:32:43.877 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.877+0000 7f3aeee8e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.2.3 2024-09-14T11:32:43.877 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.877+0000 7f3aeee8e9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.2.4 2024-09-14T11:32:43.877 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.877+0000 7f3aeee8e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.2.4 2024-09-14T11:32:43.877 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.877+0000 7f3aeee8e9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.2.5 2024-09-14T11:32:43.877 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.877+0000 7f3aeee8e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.2.5 2024-09-14T11:32:43.877 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.877+0000 7f3aeee8e9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.2.6 2024-09-14T11:32:43.877 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.877+0000 7f3aeee8e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.2.6 2024-09-14T11:32:43.877 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.877+0000 7f3aeee8e9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.2.7 2024-09-14T11:32:43.877 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.877+0000 7f3aeee8e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.2.7 2024-09-14T11:32:43.877 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.877+0000 7f3aeee8e9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.2.8 2024-09-14T11:32:43.877 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.877+0000 7f3aeee8e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.2.8 2024-09-14T11:32:43.877 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.877+0000 7f3aeee8e9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.2.9 2024-09-14T11:32:43.877 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.877+0000 7f3aeee8e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.2.9 2024-09-14T11:32:43.878 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.877+0000 7f3aeee8e9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.2.10 2024-09-14T11:32:43.878 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.877+0000 7f3aeee8e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.2.10 2024-09-14T11:32:43.878 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.877+0000 7f3aeee8e9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.2.11 2024-09-14T11:32:43.878 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.877+0000 7f3aeee8e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.2.11 2024-09-14T11:32:43.878 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.877+0000 7f3aeee8e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.0 2024-09-14T11:32:43.878 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.881+0000 7f3aeee8e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.1 2024-09-14T11:32:43.878 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.881+0000 7f3aeee8e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.2 2024-09-14T11:32:43.879 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.881+0000 7f3aeee8e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.3 2024-09-14T11:32:43.880 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.881+0000 7f3aeee8e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.4 2024-09-14T11:32:43.881 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.885+0000 7f3aeee8e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.5 2024-09-14T11:32:43.883 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.885+0000 7f3aeee8e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.6 2024-09-14T11:32:43.883 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.885+0000 7f3aeee8e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.7 2024-09-14T11:32:43.884 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.885+0000 7f3aeee8e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.8 2024-09-14T11:32:43.886 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.889+0000 7f3aeee8e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.9 2024-09-14T11:32:43.886 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.889+0000 7f3aeee8e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.10 2024-09-14T11:32:43.893 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.897+0000 7f3aeee8e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:43.893 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.897+0000 7f3aeee8e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 2024-09-14T11:32:43.895 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.897+0000 7f3aeee8e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 info.flags=0x17 2024-09-14T11:32:43.895 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.897+0000 7f3aeee8e9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 to cache LRU end 2024-09-14T11:32:43.895 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.897+0000 7f3aeee8e9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:43.895 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.897+0000 7f3aeee8e9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35, ofs0, ns] 2024-09-14T11:32:43.896 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.897+0000 7f39c3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464283 cookie 94463246918032 notifier 7154 bl.length()=995 2024-09-14T11:32:43.896 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.897+0000 7f39c3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 info.flags=0x17 2024-09-14T11:32:43.896 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.897+0000 7f39c3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 to cache LRU end 2024-09-14T11:32:43.896 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.897+0000 7f39c3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:43.896 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.897+0000 7f3aeee8e9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.35]): orig_sources= new_sources= 2024-09-14T11:32:43.896 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.897+0000 7f3aeee8e9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.35]): potential sources added=[] removed=[] 2024-09-14T11:32:43.896 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.897+0000 7f3aeee8e9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.35]): orig_dests= new_dests= 2024-09-14T11:32:43.896 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.897+0000 7f3aeee8e9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.35]): potential dests added=[] removed=[] 2024-09-14T11:32:43.902 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.905+0000 7f3aeee8e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.0 2024-09-14T11:32:43.903 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.905+0000 7f3aeee8e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.1 2024-09-14T11:32:43.903 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.905+0000 7f3aeee8e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.2 2024-09-14T11:32:43.904 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.905+0000 7f3aeee8e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.3 2024-09-14T11:32:43.905 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.909+0000 7f3aeee8e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.4 2024-09-14T11:32:43.906 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.909+0000 7f3aeee8e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.5 2024-09-14T11:32:43.907 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.909+0000 7f3aeee8e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.6 2024-09-14T11:32:43.907 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.909+0000 7f3aeee8e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.7 2024-09-14T11:32:43.908 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.909+0000 7f3aeee8e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.8 2024-09-14T11:32:43.909 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.913+0000 7f3aeee8e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.9 2024-09-14T11:32:43.909 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.913+0000 7f3aeee8e9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.35.10 2024-09-14T11:32:43.910 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.913+0000 7f3aeee8e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:43.911 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.913+0000 7f3aeee8e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 2024-09-14T11:32:43.912 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.913+0000 7f3aeee8e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 info.flags=0x17 2024-09-14T11:32:43.912 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.913+0000 7f3aeee8e9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 to cache LRU end 2024-09-14T11:32:43.912 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.913+0000 7f3aeee8e9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:43.913 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.913+0000 7f3aeee8e9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35, ofs0, ns] 2024-09-14T11:32:43.913 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.917+0000 7f39c37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464284 cookie 94463246918032 notifier 7154 bl.length()=963 2024-09-14T11:32:43.913 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.917+0000 7f39c37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 info.flags=0x17 2024-09-14T11:32:43.913 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.917+0000 7f39c37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:4444f441-0c56-48df-a905-d49e7e44d629.4596.35 to cache LRU end 2024-09-14T11:32:43.913 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.917+0000 7f39c37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:43.913 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.917+0000 7f3aeee8e9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.35]): orig_sources= new_sources= 2024-09-14T11:32:43.914 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.917+0000 7f3aeee8e9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.35]): potential sources added=[] removed=[] 2024-09-14T11:32:43.914 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.917+0000 7f3aeee8e9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.35]): orig_dests= new_dests= 2024-09-14T11:32:43.914 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.917+0000 7f3aeee8e9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[4444f441-0c56-48df-a905-d49e7e44d629.4596.35]): potential dests added=[] removed=[] 2024-09-14T11:32:43.920 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.921+0000 7f3aeee8e9c0 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-14T11:32:43.922 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.925+0000 7f39a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:43.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.929+0000 7f3aeee8e9c0 20 remove_watcher() i=0 2024-09-14T11:32:43.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.929+0000 7f3aeee8e9c0 2 removed watcher, disabling cache 2024-09-14T11:32:43.929 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.933+0000 7f3aeee8e9c0 20 remove_watcher() i=1 2024-09-14T11:32:43.931 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.933+0000 7f3aeee8e9c0 20 remove_watcher() i=2 2024-09-14T11:32:43.934 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.937+0000 7f3aeee8e9c0 20 remove_watcher() i=3 2024-09-14T11:32:43.936 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.937+0000 7f3aeee8e9c0 20 remove_watcher() i=4 2024-09-14T11:32:43.938 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.941+0000 7f3aeee8e9c0 20 remove_watcher() i=5 2024-09-14T11:32:43.940 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.941+0000 7f3aeee8e9c0 20 remove_watcher() i=6 2024-09-14T11:32:43.943 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:43.945+0000 7f3aeee8e9c0 20 remove_watcher() i=7 2024-09-14T11:32:43.958 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:32:43.989 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:43.989 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:44.033 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.037+0000 7f79f48899c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:44.035 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.037+0000 7f79f48899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:44.035 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.037+0000 7f79f48899c0 20 realm 2024-09-14T11:32:44.035 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.037+0000 7f79f48899c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:44.036 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.037+0000 7f79f48899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:44.036 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.037+0000 7f79f48899c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:44.036 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.037+0000 7f79f48899c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:44.036 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.037+0000 7f79f48899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:44.036 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.037+0000 7f79f48899c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:44.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.041+0000 7f79f48899c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:44.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.041+0000 7f79f48899c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:44.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.041+0000 7f79f48899c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:44.038 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.041+0000 7f79f48899c0 20 searching for the correct realm 2024-09-14T11:32:44.041 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.045+0000 7f79f2b90640 0 -- 172.21.15.71:0/1495935058 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f79e8113070 msgr2=0x7f79e80b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:44.256 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.257+0000 7f79f2b90640 0 -- 172.21.15.71:0/1495935058 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x5595fdbd9410 msgr2=0x5595fdbdb800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:44.271 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.273+0000 7f79f48899c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:44.271 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.273+0000 7f79f48899c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:32:44.272 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.273+0000 7f79f48899c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:44.272 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.273+0000 7f79f48899c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:32:44.272 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.273+0000 7f79f48899c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:44.272 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.273+0000 7f79f48899c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:44.272 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.273+0000 7f79f48899c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:44.272 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.273+0000 7f79f48899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:44.272 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.273+0000 7f79f48899c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:44.273 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.277+0000 7f79f48899c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:44.273 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.277+0000 7f79f48899c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:44.274 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.277+0000 7f79f48899c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:44.274 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.277+0000 7f79f48899c0 20 zone default found 2024-09-14T11:32:44.274 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.277+0000 7f79f48899c0 4 Realm: () 2024-09-14T11:32:44.274 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.277+0000 7f79f48899c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:32:44.274 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.277+0000 7f79f48899c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:32:44.274 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.277+0000 7f79f48899c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:44.274 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.277+0000 7f79f48899c0 20 zonegroup default 2024-09-14T11:32:44.274 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.277+0000 7f79f48899c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:44.275 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.277+0000 7f79f48899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:44.275 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.277+0000 7f79f48899c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:44.275 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.277+0000 7f79f48899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:44.275 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.277+0000 7f79f48899c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:44.276 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.277+0000 7f79f48899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:44.276 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.277+0000 7f79f48899c0 20 started sync module instance, tier type = 2024-09-14T11:32:44.276 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.277+0000 7f79f48899c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:32:44.299 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.301+0000 7f79f48899c0 20 add_watcher() i=0 2024-09-14T11:32:44.299 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.301+0000 7f79f48899c0 20 add_watcher() i=1 2024-09-14T11:32:44.299 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.301+0000 7f79f48899c0 20 add_watcher() i=2 2024-09-14T11:32:44.299 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.301+0000 7f79f48899c0 20 add_watcher() i=3 2024-09-14T11:32:44.299 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.301+0000 7f79f48899c0 20 add_watcher() i=4 2024-09-14T11:32:44.299 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.301+0000 7f79f48899c0 20 add_watcher() i=5 2024-09-14T11:32:44.300 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.301+0000 7f79f48899c0 20 add_watcher() i=6 2024-09-14T11:32:44.301 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.305+0000 7f79f48899c0 20 add_watcher() i=7 2024-09-14T11:32:44.301 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.305+0000 7f79f48899c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:44.307 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.309+0000 7f78a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:44.308 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.309+0000 7f79f48899c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:44.308 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.309+0000 7f79f48899c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:44.308 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.309+0000 7f79f48899c0 5 note: GC not initialized 2024-09-14T11:32:44.309 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.309+0000 7f78237fe640 20 reqs_thread_entry: start 2024-09-14T11:32:44.309 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.313+0000 7f79f48899c0 20 init_complete bucket index max shards: 11 2024-09-14T11:32:44.309 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.313+0000 7f79f48899c0 20 Filter name: none 2024-09-14T11:32:44.309 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.313+0000 7f78217fa640 20 reqs_thread_entry: start 2024-09-14T11:32:44.309 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.313+0000 7f79f48899c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:44.310 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.313+0000 7f79f48899c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:44.310 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.313+0000 7f79f48899c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:44.311 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.313+0000 7f79f48899c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:44.311 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.313+0000 7f79f48899c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:44.311 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.313+0000 7f79f48899c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:44.312 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.313+0000 7f79f48899c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:44.312 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.313+0000 7f79f48899c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:44.312 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.313+0000 7f79f48899c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:44.312 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.313+0000 7f79f48899c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:44.316 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.317+0000 7f78a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:44.320 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.321+0000 7f79f48899c0 20 remove_watcher() i=0 2024-09-14T11:32:44.320 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.321+0000 7f79f48899c0 2 removed watcher, disabling cache 2024-09-14T11:32:44.322 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.325+0000 7f79f48899c0 20 remove_watcher() i=1 2024-09-14T11:32:44.324 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.325+0000 7f79f48899c0 20 remove_watcher() i=2 2024-09-14T11:32:44.326 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.329+0000 7f79f48899c0 20 remove_watcher() i=3 2024-09-14T11:32:44.328 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.329+0000 7f79f48899c0 20 remove_watcher() i=4 2024-09-14T11:32:44.330 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.333+0000 7f79f48899c0 20 remove_watcher() i=5 2024-09-14T11:32:44.333 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.337+0000 7f79f48899c0 20 remove_watcher() i=6 2024-09-14T11:32:44.336 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.337+0000 7f79f48899c0 20 remove_watcher() i=7 2024-09-14T11:32:44.351 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:44.351 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:32:44.351 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: abort-at-do-reshard id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.35 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:32:44.351 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:44.467 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-14T11:32:44.468 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:44.871 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:32:44.903 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:44.903 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:44.948 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.949+0000 7fe73c8949c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:44.951 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.953+0000 7fe73c8949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:44.951 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.953+0000 7fe73c8949c0 20 realm 2024-09-14T11:32:44.951 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.953+0000 7fe73c8949c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:44.952 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.953+0000 7fe73c8949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:44.952 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.953+0000 7fe73c8949c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:44.952 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.953+0000 7fe73c8949c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:44.952 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.953+0000 7fe73c8949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:44.952 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.953+0000 7fe73c8949c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:44.953 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.957+0000 7fe73c8949c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:44.953 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.957+0000 7fe73c8949c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:44.954 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.957+0000 7fe73c8949c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:44.954 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.957+0000 7fe73c8949c0 20 searching for the correct realm 2024-09-14T11:32:44.957 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:44.961+0000 7fe73ab9b640 0 -- 172.21.15.71:0/3831970544 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fe730107320 msgr2=0x7fe7300fd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:45.173 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.177+0000 7fe73ab9b640 0 -- 172.21.15.71:0/3831970544 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55d73c1e88a0 msgr2=0x55d73c1eac90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:45.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.189+0000 7fe73c8949c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:45.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.189+0000 7fe73c8949c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:32:45.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.189+0000 7fe73c8949c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:45.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.189+0000 7fe73c8949c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:32:45.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.189+0000 7fe73c8949c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:45.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.189+0000 7fe73c8949c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:45.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.189+0000 7fe73c8949c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.189+0000 7fe73c8949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.189+0000 7fe73c8949c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.189+0000 7fe73c8949c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:45.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.189+0000 7fe73c8949c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.193+0000 7fe73c8949c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:45.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.193+0000 7fe73c8949c0 20 zone default found 2024-09-14T11:32:45.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.193+0000 7fe73c8949c0 4 Realm: () 2024-09-14T11:32:45.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.193+0000 7fe73c8949c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:32:45.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.193+0000 7fe73c8949c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:32:45.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.193+0000 7fe73c8949c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:45.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.193+0000 7fe73c8949c0 20 zonegroup default 2024-09-14T11:32:45.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.193+0000 7fe73c8949c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.191 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.193+0000 7fe73c8949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.191 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.193+0000 7fe73c8949c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.191 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.193+0000 7fe73c8949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.191 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.193+0000 7fe73c8949c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.192 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.193+0000 7fe73c8949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.192 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.193+0000 7fe73c8949c0 20 started sync module instance, tier type = 2024-09-14T11:32:45.192 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.193+0000 7fe73c8949c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:32:45.214 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.217+0000 7fe73c8949c0 20 add_watcher() i=0 2024-09-14T11:32:45.215 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.217+0000 7fe73c8949c0 20 add_watcher() i=1 2024-09-14T11:32:45.215 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.217+0000 7fe73c8949c0 20 add_watcher() i=2 2024-09-14T11:32:45.215 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.217+0000 7fe73c8949c0 20 add_watcher() i=3 2024-09-14T11:32:45.215 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.217+0000 7fe73c8949c0 20 add_watcher() i=4 2024-09-14T11:32:45.215 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.217+0000 7fe73c8949c0 20 add_watcher() i=5 2024-09-14T11:32:45.215 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.217+0000 7fe73c8949c0 20 add_watcher() i=6 2024-09-14T11:32:45.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.221+0000 7fe73c8949c0 20 add_watcher() i=7 2024-09-14T11:32:45.218 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.221+0000 7fe73c8949c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:45.222 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.225+0000 7fe5f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:45.222 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.225+0000 7fe73c8949c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:45.223 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.225+0000 7fe73c8949c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:45.223 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.225+0000 7fe73c8949c0 5 note: GC not initialized 2024-09-14T11:32:45.224 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.225+0000 7fe56b7fe640 20 reqs_thread_entry: start 2024-09-14T11:32:45.224 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.225+0000 7fe73c8949c0 20 init_complete bucket index max shards: 11 2024-09-14T11:32:45.224 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.225+0000 7fe73c8949c0 20 Filter name: none 2024-09-14T11:32:45.224 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.225+0000 7fe5697fa640 20 reqs_thread_entry: start 2024-09-14T11:32:45.224 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.225+0000 7fe73c8949c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.225 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.225+0000 7fe73c8949c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:32:45.225 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.225+0000 7fe73c8949c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.229+0000 7fe73c8949c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:32:45.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.229+0000 7fe73c8949c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:45.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.229+0000 7fe73c8949c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.229+0000 7fe73c8949c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:32:45.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.229+0000 7fe73c8949c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.229+0000 7fe73c8949c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:32:45.227 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.229+0000 7fe73c8949c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:45.232 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.233+0000 7fe5f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:45.234 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.237+0000 7fe73c8949c0 20 remove_watcher() i=0 2024-09-14T11:32:45.235 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.237+0000 7fe73c8949c0 2 removed watcher, disabling cache 2024-09-14T11:32:45.236 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.237+0000 7fe73c8949c0 20 remove_watcher() i=1 2024-09-14T11:32:45.238 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.241+0000 7fe73c8949c0 20 remove_watcher() i=2 2024-09-14T11:32:45.241 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.245+0000 7fe73c8949c0 20 remove_watcher() i=3 2024-09-14T11:32:45.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.245+0000 7fe73c8949c0 20 remove_watcher() i=4 2024-09-14T11:32:45.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.249+0000 7fe73c8949c0 20 remove_watcher() i=5 2024-09-14T11:32:45.248 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.249+0000 7fe73c8949c0 20 remove_watcher() i=6 2024-09-14T11:32:45.251 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.253+0000 7fe73c8949c0 20 remove_watcher() i=7 2024-09-14T11:32:45.268 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:45.268 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:32:45.268 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: error-at-logrecord-writes id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:32:45.268 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:45.269 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-14T11:32:45.302 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:45.302 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:45.346 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.349+0000 7f97279719c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.348 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.349+0000 7f97279719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.349 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.349+0000 7f97279719c0 20 realm 2024-09-14T11:32:45.349 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.349+0000 7f97279719c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.350 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.353+0000 7f97279719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.350 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.353+0000 7f97279719c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:45.350 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.353+0000 7f97279719c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.350 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.353+0000 7f97279719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.350 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.353+0000 7f97279719c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.351 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.353+0000 7f97279719c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:45.351 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.353+0000 7f97279719c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.351 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.353+0000 7f97279719c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:45.352 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.353+0000 7f97279719c0 20 searching for the correct realm 2024-09-14T11:32:45.356 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.357+0000 7f9725477640 0 -- 172.21.15.71:0/2749824482 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x5624cfd68eb0 msgr2=0x5624cfd6b370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:45.362 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.365+0000 7f9725477640 0 -- 172.21.15.71:0/2749824482 >> [v2:172.21.15.157:6816/1231501119,v1:172.21.15.157:6817/1231501119] conn(0x5624cfd5c6c0 msgr2=0x5624cfd5eab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:45.371 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.373+0000 7f97279719c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:45.372 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.373+0000 7f97279719c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:32:45.372 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.373+0000 7f97279719c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:45.372 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.373+0000 7f97279719c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:32:45.372 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.373+0000 7f97279719c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:45.372 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.373+0000 7f97279719c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:45.372 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.373+0000 7f97279719c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.373 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.373+0000 7f97279719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.373 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.373+0000 7f97279719c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.374 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.373+0000 7f97279719c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:45.374 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.373+0000 7f97279719c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.374 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.377+0000 7f97279719c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:45.374 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.377+0000 7f97279719c0 20 zone default found 2024-09-14T11:32:45.374 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.377+0000 7f97279719c0 4 Realm: () 2024-09-14T11:32:45.374 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.377+0000 7f97279719c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:32:45.374 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.377+0000 7f97279719c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:32:45.374 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.377+0000 7f97279719c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:45.374 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.377+0000 7f97279719c0 20 zonegroup default 2024-09-14T11:32:45.374 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.377+0000 7f97279719c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.376 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.377+0000 7f97279719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.376 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.377+0000 7f97279719c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.376 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.377+0000 7f97279719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.376 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.377+0000 7f97279719c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.376 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.377+0000 7f97279719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.376 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.377+0000 7f97279719c0 20 started sync module instance, tier type = 2024-09-14T11:32:45.376 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.377+0000 7f97279719c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:32:45.393 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.397+0000 7f97279719c0 20 add_watcher() i=0 2024-09-14T11:32:45.394 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.397+0000 7f97279719c0 20 add_watcher() i=1 2024-09-14T11:32:45.394 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.397+0000 7f97279719c0 20 add_watcher() i=2 2024-09-14T11:32:45.394 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.397+0000 7f97279719c0 20 add_watcher() i=3 2024-09-14T11:32:45.394 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.397+0000 7f97279719c0 20 add_watcher() i=4 2024-09-14T11:32:45.394 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.397+0000 7f97279719c0 20 add_watcher() i=5 2024-09-14T11:32:45.394 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.397+0000 7f97279719c0 20 add_watcher() i=6 2024-09-14T11:32:45.396 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.397+0000 7f97279719c0 20 add_watcher() i=7 2024-09-14T11:32:45.396 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.397+0000 7f97279719c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:45.401 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.401+0000 7f95db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:45.402 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.401+0000 7f97279719c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:45.402 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.401+0000 7f97279719c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:45.402 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.401+0000 7f97279719c0 5 note: GC not initialized 2024-09-14T11:32:45.402 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.401+0000 7f95da7e4640 20 reqs_thread_entry: start 2024-09-14T11:32:45.402 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.401+0000 7f97279719c0 20 init_complete bucket index max shards: 11 2024-09-14T11:32:45.402 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.401+0000 7f97279719c0 20 Filter name: none 2024-09-14T11:32:45.402 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.401+0000 7f954bfff640 20 reqs_thread_entry: start 2024-09-14T11:32:45.402 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.401+0000 7f97279719c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-14T11:32:45.402 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.401+0000 7f97279719c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.402 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.405+0000 7f97279719c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:32:45.403 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.405+0000 7f97279719c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-14T11:32:45.403 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.405+0000 7f97279719c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-14T11:32:45.403 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.405+0000 7f97279719c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36 : miss 2024-09-14T11:32:45.403 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.405+0000 7f97279719c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.403 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.405+0000 7f97279719c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:32:45.403 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.405+0000 7f97279719c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36 info.flags=0x17 2024-09-14T11:32:45.403 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.405+0000 7f97279719c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36 to cache LRU end 2024-09-14T11:32:45.403 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.405+0000 7f97279719c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:45.403 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.405+0000 7f97279719c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:45.403 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.405+0000 7f97279719c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36 2024-09-14T11:32:45.412 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.413+0000 7f97279719c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36 info.flags=0x17 2024-09-14T11:32:45.412 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.413+0000 7f97279719c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36 to cache LRU end 2024-09-14T11:32:45.412 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.413+0000 7f97279719c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:45.412 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.413+0000 7f97279719c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36, ofs0, ns] 2024-09-14T11:32:45.412 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.413+0000 7f9608ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464401 cookie 94716105768496 notifier 7587 bl.length()=1007 2024-09-14T11:32:45.413 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.413+0000 7f9608ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36 info.flags=0x17 2024-09-14T11:32:45.413 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.413+0000 7f9608ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36 to cache LRU end 2024-09-14T11:32:45.413 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.413+0000 7f9608ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:45.413 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.413+0000 7f97279719c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.36]): orig_sources= new_sources= 2024-09-14T11:32:45.413 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.413+0000 7f97279719c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.36]): potential sources added=[] removed=[] 2024-09-14T11:32:45.413 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.413+0000 7f97279719c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.36]): orig_dests= new_dests= 2024-09-14T11:32:45.413 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.413+0000 7f97279719c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.36]): potential dests added=[] removed=[] 2024-09-14T11:32:45.417 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.421+0000 7f97279719c0 -1 Injecting error=-5 at location=logrecord_writes 2024-09-14T11:32:45.417 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.421+0000 7f97279719c0 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-14T11:32:45.427 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.429+0000 7f97279719c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:45.428 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.429+0000 7f97279719c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36 2024-09-14T11:32:45.430 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.433+0000 7f97279719c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36 info.flags=0x17 2024-09-14T11:32:45.430 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.433+0000 7f97279719c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36 to cache LRU end 2024-09-14T11:32:45.431 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.433+0000 7f97279719c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:45.431 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.433+0000 7f97279719c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36, ofs0, ns] 2024-09-14T11:32:45.431 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.433+0000 7f95f7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464402 cookie 94716105768496 notifier 7587 bl.length()=975 2024-09-14T11:32:45.431 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.433+0000 7f95f7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36 info.flags=0x17 2024-09-14T11:32:45.431 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.433+0000 7f95f7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36 to cache LRU end 2024-09-14T11:32:45.431 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.433+0000 7f95f7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:45.431 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.433+0000 7f97279719c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.36]): orig_sources= new_sources= 2024-09-14T11:32:45.432 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.433+0000 7f97279719c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.36]): potential sources added=[] removed=[] 2024-09-14T11:32:45.432 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.433+0000 7f97279719c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.36]): orig_dests= new_dests= 2024-09-14T11:32:45.432 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.433+0000 7f97279719c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.36]): potential dests added=[] removed=[] 2024-09-14T11:32:45.433 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.437+0000 7f95db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:45.437 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.441+0000 7f97279719c0 20 remove_watcher() i=0 2024-09-14T11:32:45.437 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.441+0000 7f97279719c0 2 removed watcher, disabling cache 2024-09-14T11:32:45.439 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.441+0000 7f97279719c0 20 remove_watcher() i=1 2024-09-14T11:32:45.441 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.445+0000 7f97279719c0 20 remove_watcher() i=2 2024-09-14T11:32:45.444 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.445+0000 7f97279719c0 20 remove_watcher() i=3 2024-09-14T11:32:45.446 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.449+0000 7f97279719c0 20 remove_watcher() i=4 2024-09-14T11:32:45.448 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.449+0000 7f97279719c0 20 remove_watcher() i=5 2024-09-14T11:32:45.450 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.453+0000 7f97279719c0 20 remove_watcher() i=6 2024-09-14T11:32:45.453 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.457+0000 7f97279719c0 20 remove_watcher() i=7 2024-09-14T11:32:45.467 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:32:45.494 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:45.494 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:45.538 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.541+0000 7f7e4e4179c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.540 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.541+0000 7f7e4e4179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.540 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.541+0000 7f7e4e4179c0 20 realm 2024-09-14T11:32:45.541 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.541+0000 7f7e4e4179c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.542 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.545+0000 7f7e4e4179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.542 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.545+0000 7f7e4e4179c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:45.542 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.545+0000 7f7e4e4179c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.542 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.545+0000 7f7e4e4179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.542 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.545+0000 7f7e4e4179c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.543 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.545+0000 7f7e4e4179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:45.543 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.545+0000 7f7e4e4179c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.543 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.545+0000 7f7e4e4179c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:45.543 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.545+0000 7f7e4e4179c0 20 searching for the correct realm 2024-09-14T11:32:45.545 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.549+0000 7f7e4b71c640 0 -- 172.21.15.71:0/1645560634 >> [v2:172.21.15.71:6824/2436891866,v1:172.21.15.71:6825/2436891866] conn(0x7f7e44010040 msgr2=0x7f7e44011400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:45.551 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.553+0000 7f7e4c71e640 0 -- 172.21.15.71:0/1645560634 >> [v2:172.21.15.157:6816/1231501119,v1:172.21.15.157:6817/1231501119] conn(0x557d4084ce80 msgr2=0x557d4084f270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:45.562 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.565+0000 7f7e4e4179c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:45.562 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.565+0000 7f7e4e4179c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:32:45.562 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.565+0000 7f7e4e4179c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:45.562 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.565+0000 7f7e4e4179c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:32:45.563 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.565+0000 7f7e4e4179c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:45.563 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.565+0000 7f7e4e4179c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:45.563 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.565+0000 7f7e4e4179c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.563 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.565+0000 7f7e4e4179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.563 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.565+0000 7f7e4e4179c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.564 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.565+0000 7f7e4e4179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:45.565 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.565+0000 7f7e4e4179c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.565 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.565+0000 7f7e4e4179c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:45.565 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.565+0000 7f7e4e4179c0 20 zone default found 2024-09-14T11:32:45.565 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.565+0000 7f7e4e4179c0 4 Realm: () 2024-09-14T11:32:45.565 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.565+0000 7f7e4e4179c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:32:45.565 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.565+0000 7f7e4e4179c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:32:45.565 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.565+0000 7f7e4e4179c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:45.565 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.565+0000 7f7e4e4179c0 20 zonegroup default 2024-09-14T11:32:45.566 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.565+0000 7f7e4e4179c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.566 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.565+0000 7f7e4e4179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.566 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.565+0000 7f7e4e4179c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.566 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.569+0000 7f7e4e4179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.566 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.569+0000 7f7e4e4179c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.566 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.569+0000 7f7e4e4179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.566 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.569+0000 7f7e4e4179c0 20 started sync module instance, tier type = 2024-09-14T11:32:45.567 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.569+0000 7f7e4e4179c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:32:45.583 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.585+0000 7f7e4e4179c0 20 add_watcher() i=0 2024-09-14T11:32:45.583 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.585+0000 7f7e4e4179c0 20 add_watcher() i=1 2024-09-14T11:32:45.583 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.585+0000 7f7e4e4179c0 20 add_watcher() i=2 2024-09-14T11:32:45.583 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.585+0000 7f7e4e4179c0 20 add_watcher() i=3 2024-09-14T11:32:45.583 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.585+0000 7f7e4e4179c0 20 add_watcher() i=4 2024-09-14T11:32:45.583 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.585+0000 7f7e4e4179c0 20 add_watcher() i=5 2024-09-14T11:32:45.583 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.585+0000 7f7e4e4179c0 20 add_watcher() i=6 2024-09-14T11:32:45.586 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.589+0000 7f7e4e4179c0 20 add_watcher() i=7 2024-09-14T11:32:45.586 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.589+0000 7f7e4e4179c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:45.590 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.593+0000 7f7d01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:45.590 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.593+0000 7f7e4e4179c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:45.590 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.593+0000 7f7e4e4179c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:45.590 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.593+0000 7f7e4e4179c0 5 note: GC not initialized 2024-09-14T11:32:45.590 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.593+0000 7f7d00fe1640 20 reqs_thread_entry: start 2024-09-14T11:32:45.590 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.593+0000 7f7e4e4179c0 20 init_complete bucket index max shards: 11 2024-09-14T11:32:45.590 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.593+0000 7f7e4e4179c0 20 Filter name: none 2024-09-14T11:32:45.590 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.593+0000 7f7c7a7fc640 20 reqs_thread_entry: start 2024-09-14T11:32:45.591 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.593+0000 7f7e4e4179c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.592 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.593+0000 7f7e4e4179c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:32:45.592 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.593+0000 7f7e4e4179c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.592 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.593+0000 7f7e4e4179c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:32:45.592 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.593+0000 7f7e4e4179c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:45.592 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.593+0000 7f7e4e4179c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.592 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.593+0000 7f7e4e4179c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:32:45.592 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.593+0000 7f7e4e4179c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.593 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.593+0000 7f7e4e4179c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:32:45.593 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.593+0000 7f7e4e4179c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:45.593 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.597+0000 7f7d01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:45.598 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.601+0000 7f7e4e4179c0 20 remove_watcher() i=0 2024-09-14T11:32:45.598 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.601+0000 7f7e4e4179c0 2 removed watcher, disabling cache 2024-09-14T11:32:45.600 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.601+0000 7f7e4e4179c0 20 remove_watcher() i=1 2024-09-14T11:32:45.602 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.605+0000 7f7e4e4179c0 20 remove_watcher() i=2 2024-09-14T11:32:45.604 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.605+0000 7f7e4e4179c0 20 remove_watcher() i=3 2024-09-14T11:32:45.606 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.609+0000 7f7e4e4179c0 20 remove_watcher() i=4 2024-09-14T11:32:45.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.609+0000 7f7e4e4179c0 20 remove_watcher() i=5 2024-09-14T11:32:45.610 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.613+0000 7f7e4e4179c0 20 remove_watcher() i=6 2024-09-14T11:32:45.613 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.617+0000 7f7e4e4179c0 20 remove_watcher() i=7 2024-09-14T11:32:45.626 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:45.626 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:32:45.626 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: error-at-logrecord-writes id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:32:45.626 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:45.681 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:32:45.713 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:45.713 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:45.758 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.761+0000 7f23444a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.760 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.761+0000 7f23444a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.760 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.761+0000 7f23444a59c0 20 realm 2024-09-14T11:32:45.760 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.761+0000 7f23444a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.761 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.765+0000 7f23444a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.761 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.765+0000 7f23444a59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:45.761 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.765+0000 7f23444a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.761 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.765+0000 7f23444a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.762 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.765+0000 7f23444a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.762 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.765+0000 7f23444a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:45.762 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.765+0000 7f23444a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.763 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.765+0000 7f23444a59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:45.763 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.765+0000 7f23444a59c0 20 searching for the correct realm 2024-09-14T11:32:45.768 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.769+0000 7f2341fab640 0 -- 172.21.15.71:0/781551835 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x560827f27280 msgr2=0x560827f29740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:45.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.777+0000 7f23427ac640 0 -- 172.21.15.71:0/781551835 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x560827f224c0 msgr2=0x560827f248d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:45.782 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.785+0000 7f23444a59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:45.782 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.785+0000 7f23444a59c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:32:45.782 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.785+0000 7f23444a59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:45.783 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.785+0000 7f23444a59c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:32:45.783 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.785+0000 7f23444a59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:45.783 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.785+0000 7f23444a59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:45.783 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.785+0000 7f23444a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.783 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.785+0000 7f23444a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.783 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.785+0000 7f23444a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.784 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.785+0000 7f23444a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:45.784 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.785+0000 7f23444a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.784 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.785+0000 7f23444a59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:45.784 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.785+0000 7f23444a59c0 20 zone default found 2024-09-14T11:32:45.784 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.785+0000 7f23444a59c0 4 Realm: () 2024-09-14T11:32:45.785 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.785+0000 7f23444a59c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:32:45.785 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.785+0000 7f23444a59c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:32:45.785 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.785+0000 7f23444a59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:45.785 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.785+0000 7f23444a59c0 20 zonegroup default 2024-09-14T11:32:45.785 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.785+0000 7f23444a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.785 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.785+0000 7f23444a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.785 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.785+0000 7f23444a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.786 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.789+0000 7f23444a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.786 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.789+0000 7f23444a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.786 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.789+0000 7f23444a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.786 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.789+0000 7f23444a59c0 20 started sync module instance, tier type = 2024-09-14T11:32:45.786 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.789+0000 7f23444a59c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:32:45.803 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.805+0000 7f23444a59c0 20 add_watcher() i=0 2024-09-14T11:32:45.803 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.805+0000 7f23444a59c0 20 add_watcher() i=1 2024-09-14T11:32:45.803 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.805+0000 7f23444a59c0 20 add_watcher() i=2 2024-09-14T11:32:45.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.805+0000 7f23444a59c0 20 add_watcher() i=3 2024-09-14T11:32:45.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.805+0000 7f23444a59c0 20 add_watcher() i=4 2024-09-14T11:32:45.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.805+0000 7f23444a59c0 20 add_watcher() i=5 2024-09-14T11:32:45.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.805+0000 7f23444a59c0 20 add_watcher() i=6 2024-09-14T11:32:45.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.809+0000 7f23444a59c0 20 add_watcher() i=7 2024-09-14T11:32:45.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.809+0000 7f23444a59c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:45.809 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.813+0000 7f21f7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:45.809 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.813+0000 7f23444a59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:45.810 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.813+0000 7f23444a59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:45.810 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.813+0000 7f23444a59c0 5 note: GC not initialized 2024-09-14T11:32:45.811 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.813+0000 7f21f6fe5640 20 reqs_thread_entry: start 2024-09-14T11:32:45.811 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.813+0000 7f23444a59c0 20 init_complete bucket index max shards: 11 2024-09-14T11:32:45.811 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.813+0000 7f23444a59c0 20 Filter name: none 2024-09-14T11:32:45.811 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.813+0000 7f21f4fe1640 20 reqs_thread_entry: start 2024-09-14T11:32:45.811 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.813+0000 7f23444a59c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-14T11:32:45.811 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.813+0000 7f23444a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.812 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.813+0000 7f23444a59c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:32:45.812 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.813+0000 7f23444a59c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-14T11:32:45.812 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.813+0000 7f23444a59c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-14T11:32:45.812 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.813+0000 7f23444a59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36 : miss 2024-09-14T11:32:45.812 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.813+0000 7f23444a59c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.812 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.813+0000 7f23444a59c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:32:45.812 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.813+0000 7f23444a59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36 info.flags=0x17 2024-09-14T11:32:45.812 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.813+0000 7f23444a59c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36 to cache LRU end 2024-09-14T11:32:45.812 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.813+0000 7f23444a59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:45.812 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.813+0000 7f23444a59c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:45.812 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.813+0000 7f23444a59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36 2024-09-14T11:32:45.820 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.821+0000 7f23444a59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36 info.flags=0x17 2024-09-14T11:32:45.820 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.821+0000 7f23444a59c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36 to cache LRU end 2024-09-14T11:32:45.820 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.821+0000 7f23444a59c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:45.820 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.821+0000 7f23444a59c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36, ofs0, ns] 2024-09-14T11:32:45.821 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.825+0000 7f22257fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464403 cookie 94593029941376 notifier 7623 bl.length()=1007 2024-09-14T11:32:45.821 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.825+0000 7f22257fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36 info.flags=0x17 2024-09-14T11:32:45.821 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.825+0000 7f22257fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36 to cache LRU end 2024-09-14T11:32:45.821 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.825+0000 7f22257fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:45.822 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.825+0000 7f23444a59c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.36]): orig_sources= new_sources= 2024-09-14T11:32:45.822 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.825+0000 7f23444a59c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.36]): potential sources added=[] removed=[] 2024-09-14T11:32:45.822 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.825+0000 7f23444a59c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.36]): orig_dests= new_dests= 2024-09-14T11:32:45.822 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.825+0000 7f23444a59c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.36]): potential dests added=[] removed=[] 2024-09-14T11:32:45.831 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.833+0000 7f23444a59c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.1.0 2024-09-14T11:32:45.831 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.833+0000 7f23444a59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.1.0 2024-09-14T11:32:45.831 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.833+0000 7f23444a59c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.1.1 2024-09-14T11:32:45.832 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.833+0000 7f23444a59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.1.1 2024-09-14T11:32:45.832 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.833+0000 7f23444a59c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.1.2 2024-09-14T11:32:45.832 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.833+0000 7f23444a59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.1.2 2024-09-14T11:32:45.832 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.833+0000 7f23444a59c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.1.3 2024-09-14T11:32:45.832 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.833+0000 7f23444a59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.1.3 2024-09-14T11:32:45.832 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.833+0000 7f23444a59c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.1.4 2024-09-14T11:32:45.832 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.833+0000 7f23444a59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.1.4 2024-09-14T11:32:45.832 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.833+0000 7f23444a59c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.1.5 2024-09-14T11:32:45.832 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.833+0000 7f23444a59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.1.5 2024-09-14T11:32:45.832 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.833+0000 7f23444a59c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.1.6 2024-09-14T11:32:45.832 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.833+0000 7f23444a59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.1.6 2024-09-14T11:32:45.833 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.833+0000 7f23444a59c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.1.7 2024-09-14T11:32:45.833 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.833+0000 7f23444a59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.1.7 2024-09-14T11:32:45.833 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.833+0000 7f23444a59c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.1.8 2024-09-14T11:32:45.833 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.833+0000 7f23444a59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.1.8 2024-09-14T11:32:45.833 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.833+0000 7f23444a59c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.1.9 2024-09-14T11:32:45.833 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.833+0000 7f23444a59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.1.9 2024-09-14T11:32:45.833 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.833+0000 7f23444a59c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.1.10 2024-09-14T11:32:45.833 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.833+0000 7f23444a59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.1.10 2024-09-14T11:32:45.833 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.833+0000 7f23444a59c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.1.11 2024-09-14T11:32:45.833 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.833+0000 7f23444a59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.1.11 2024-09-14T11:32:45.833 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.833+0000 7f23444a59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.0 2024-09-14T11:32:45.834 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.833+0000 7f23444a59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.1 2024-09-14T11:32:45.834 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.837+0000 7f23444a59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.2 2024-09-14T11:32:45.834 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.837+0000 7f23444a59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.3 2024-09-14T11:32:45.835 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.837+0000 7f23444a59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.4 2024-09-14T11:32:45.835 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.837+0000 7f23444a59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.5 2024-09-14T11:32:45.836 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.837+0000 7f23444a59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.6 2024-09-14T11:32:45.836 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.837+0000 7f23444a59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.7 2024-09-14T11:32:45.837 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.841+0000 7f23444a59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.8 2024-09-14T11:32:45.838 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.841+0000 7f23444a59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.9 2024-09-14T11:32:45.838 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.841+0000 7f23444a59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.10 2024-09-14T11:32:45.846 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.849+0000 7f23444a59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:45.846 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.849+0000 7f23444a59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36 2024-09-14T11:32:45.848 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.849+0000 7f23444a59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36 info.flags=0x17 2024-09-14T11:32:45.848 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.849+0000 7f23444a59c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36 to cache LRU end 2024-09-14T11:32:45.848 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.849+0000 7f23444a59c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:45.848 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.849+0000 7f23444a59c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36, ofs0, ns] 2024-09-14T11:32:45.849 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.849+0000 7f2224ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464404 cookie 94593029941376 notifier 7623 bl.length()=1007 2024-09-14T11:32:45.849 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.853+0000 7f2224ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36 info.flags=0x17 2024-09-14T11:32:45.849 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.853+0000 7f2224ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36 to cache LRU end 2024-09-14T11:32:45.849 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.853+0000 7f2224ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:45.849 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.853+0000 7f23444a59c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.36]): orig_sources= new_sources= 2024-09-14T11:32:45.849 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.853+0000 7f23444a59c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.36]): potential sources added=[] removed=[] 2024-09-14T11:32:45.849 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.853+0000 7f23444a59c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.36]): orig_dests= new_dests= 2024-09-14T11:32:45.850 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.853+0000 7f23444a59c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.36]): potential dests added=[] removed=[] 2024-09-14T11:32:45.854 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.857+0000 7f23444a59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.0 2024-09-14T11:32:45.855 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.857+0000 7f23444a59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.1 2024-09-14T11:32:45.856 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.857+0000 7f23444a59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.2 2024-09-14T11:32:45.856 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.857+0000 7f23444a59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.3 2024-09-14T11:32:45.857 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.861+0000 7f23444a59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.4 2024-09-14T11:32:45.857 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.861+0000 7f23444a59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.5 2024-09-14T11:32:45.857 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.861+0000 7f23444a59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.6 2024-09-14T11:32:45.857 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.861+0000 7f23444a59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.7 2024-09-14T11:32:45.858 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.861+0000 7f23444a59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.8 2024-09-14T11:32:45.859 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.861+0000 7f23444a59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.9 2024-09-14T11:32:45.859 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.861+0000 7f23444a59c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.36.10 2024-09-14T11:32:45.859 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.861+0000 7f23444a59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:45.860 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.861+0000 7f23444a59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36 2024-09-14T11:32:45.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.865+0000 7f23444a59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36 info.flags=0x17 2024-09-14T11:32:45.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.865+0000 7f23444a59c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36 to cache LRU end 2024-09-14T11:32:45.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.865+0000 7f23444a59c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:45.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.865+0000 7f23444a59c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36, ofs0, ns] 2024-09-14T11:32:45.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.865+0000 7f22257fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464405 cookie 94593029941376 notifier 7623 bl.length()=975 2024-09-14T11:32:45.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.865+0000 7f22257fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36 info.flags=0x17 2024-09-14T11:32:45.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.865+0000 7f22257fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.36 to cache LRU end 2024-09-14T11:32:45.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.865+0000 7f22257fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:45.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.865+0000 7f23444a59c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.36]): orig_sources= new_sources= 2024-09-14T11:32:45.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.865+0000 7f23444a59c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.36]): potential sources added=[] removed=[] 2024-09-14T11:32:45.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.865+0000 7f23444a59c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.36]): orig_dests= new_dests= 2024-09-14T11:32:45.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.865+0000 7f23444a59c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.36]): potential dests added=[] removed=[] 2024-09-14T11:32:45.868 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.869+0000 7f23444a59c0 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:32:45.870 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.873+0000 7f21f7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:45.876 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.877+0000 7f23444a59c0 20 remove_watcher() i=0 2024-09-14T11:32:45.876 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.877+0000 7f23444a59c0 2 removed watcher, disabling cache 2024-09-14T11:32:45.878 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.881+0000 7f23444a59c0 20 remove_watcher() i=1 2024-09-14T11:32:45.880 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.881+0000 7f23444a59c0 20 remove_watcher() i=2 2024-09-14T11:32:45.882 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.885+0000 7f23444a59c0 20 remove_watcher() i=3 2024-09-14T11:32:45.884 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.885+0000 7f23444a59c0 20 remove_watcher() i=4 2024-09-14T11:32:45.885 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.889+0000 7f23444a59c0 20 remove_watcher() i=5 2024-09-14T11:32:45.888 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.889+0000 7f23444a59c0 20 remove_watcher() i=6 2024-09-14T11:32:45.891 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.893+0000 7f23444a59c0 20 remove_watcher() i=7 2024-09-14T11:32:45.905 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:32:45.932 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:45.932 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:45.975 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.977+0000 7f7a44e539c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.978 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.981+0000 7f7a44e539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.978 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.981+0000 7f7a44e539c0 20 realm 2024-09-14T11:32:45.978 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.981+0000 7f7a44e539c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.979 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.981+0000 7f7a44e539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.979 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.981+0000 7f7a44e539c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:45.979 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.981+0000 7f7a44e539c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.979 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.981+0000 7f7a44e539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.979 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.981+0000 7f7a44e539c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.980 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.981+0000 7f7a44e539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:45.980 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.981+0000 7f7a44e539c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.980 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.985+0000 7f7a44e539c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:45.980 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.985+0000 7f7a44e539c0 20 searching for the correct realm 2024-09-14T11:32:45.984 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:45.985+0000 7f7a4315a640 0 -- 172.21.15.71:0/1156529651 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f7a3801f060 msgr2=0x7f7a3806f0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:46.196 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.197+0000 7f7a4315a640 0 -- 172.21.15.71:0/1156529651 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x5610d0c4e580 msgr2=0x5610d0c50970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:46.210 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.213+0000 7f7a44e539c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:46.211 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.213+0000 7f7a44e539c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:32:46.211 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.213+0000 7f7a44e539c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:46.211 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.213+0000 7f7a44e539c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:32:46.211 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.213+0000 7f7a44e539c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:46.211 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.213+0000 7f7a44e539c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:46.211 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.213+0000 7f7a44e539c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:46.212 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.213+0000 7f7a44e539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:46.212 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.213+0000 7f7a44e539c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:46.212 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.213+0000 7f7a44e539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:46.212 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.213+0000 7f7a44e539c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:46.213 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.217+0000 7f7a44e539c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:46.213 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.217+0000 7f7a44e539c0 20 zone default found 2024-09-14T11:32:46.213 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.217+0000 7f7a44e539c0 4 Realm: () 2024-09-14T11:32:46.213 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.217+0000 7f7a44e539c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:32:46.213 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.217+0000 7f7a44e539c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:32:46.213 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.217+0000 7f7a44e539c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:46.214 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.217+0000 7f7a44e539c0 20 zonegroup default 2024-09-14T11:32:46.214 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.217+0000 7f7a44e539c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:46.214 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.217+0000 7f7a44e539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:46.214 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.217+0000 7f7a44e539c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:46.214 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.217+0000 7f7a44e539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:46.215 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.217+0000 7f7a44e539c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:46.215 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.217+0000 7f7a44e539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:46.215 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.217+0000 7f7a44e539c0 20 started sync module instance, tier type = 2024-09-14T11:32:46.215 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.217+0000 7f7a44e539c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:32:46.236 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.237+0000 7f7a44e539c0 20 add_watcher() i=0 2024-09-14T11:32:46.236 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.237+0000 7f7a44e539c0 20 add_watcher() i=1 2024-09-14T11:32:46.237 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.237+0000 7f7a44e539c0 20 add_watcher() i=2 2024-09-14T11:32:46.237 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.237+0000 7f7a44e539c0 20 add_watcher() i=3 2024-09-14T11:32:46.237 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.237+0000 7f7a44e539c0 20 add_watcher() i=4 2024-09-14T11:32:46.237 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.237+0000 7f7a44e539c0 20 add_watcher() i=5 2024-09-14T11:32:46.237 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.237+0000 7f7a44e539c0 20 add_watcher() i=6 2024-09-14T11:32:46.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.241+0000 7f7a44e539c0 20 add_watcher() i=7 2024-09-14T11:32:46.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.241+0000 7f7a44e539c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:46.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.245+0000 7f78f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:46.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.245+0000 7f7a44e539c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:46.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.245+0000 7f7a44e539c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:46.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.245+0000 7f7a44e539c0 5 note: GC not initialized 2024-09-14T11:32:46.244 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.245+0000 7f7873fff640 20 reqs_thread_entry: start 2024-09-14T11:32:46.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.245+0000 7f7a44e539c0 20 init_complete bucket index max shards: 11 2024-09-14T11:32:46.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.245+0000 7f7a44e539c0 20 Filter name: none 2024-09-14T11:32:46.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.245+0000 7f7871ffb640 20 reqs_thread_entry: start 2024-09-14T11:32:46.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.245+0000 7f7a44e539c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:46.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.249+0000 7f7a44e539c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:32:46.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.249+0000 7f7a44e539c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:46.246 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.249+0000 7f7a44e539c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:32:46.246 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.249+0000 7f7a44e539c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:46.246 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.249+0000 7f7a44e539c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:46.247 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.249+0000 7f7a44e539c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:32:46.247 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.249+0000 7f7a44e539c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:46.247 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.249+0000 7f7a44e539c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:32:46.247 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.249+0000 7f7a44e539c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:46.249 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.253+0000 7f78f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:46.253 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.257+0000 7f7a44e539c0 20 remove_watcher() i=0 2024-09-14T11:32:46.253 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.257+0000 7f7a44e539c0 2 removed watcher, disabling cache 2024-09-14T11:32:46.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.257+0000 7f7a44e539c0 20 remove_watcher() i=1 2024-09-14T11:32:46.257 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.261+0000 7f7a44e539c0 20 remove_watcher() i=2 2024-09-14T11:32:46.259 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.261+0000 7f7a44e539c0 20 remove_watcher() i=3 2024-09-14T11:32:46.261 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.265+0000 7f7a44e539c0 20 remove_watcher() i=4 2024-09-14T11:32:46.264 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.265+0000 7f7a44e539c0 20 remove_watcher() i=5 2024-09-14T11:32:46.266 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.269+0000 7f7a44e539c0 20 remove_watcher() i=6 2024-09-14T11:32:46.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.273+0000 7f7a44e539c0 20 remove_watcher() i=7 2024-09-14T11:32:46.285 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:46.285 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:32:46.285 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: error-at-logrecord-writes id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.36 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:32:46.286 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:46.394 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-14T11:32:46.394 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:46.790 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:32:46.824 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:46.824 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:46.871 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.873+0000 7fd47fadc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:46.874 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.877+0000 7fd47fadc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:46.874 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.877+0000 7fd47fadc9c0 20 realm 2024-09-14T11:32:46.874 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.877+0000 7fd47fadc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:46.875 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.877+0000 7fd47fadc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:46.875 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.877+0000 7fd47fadc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:46.875 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.877+0000 7fd47fadc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:46.875 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.877+0000 7fd47fadc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:46.875 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.877+0000 7fd47fadc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:46.875 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.877+0000 7fd47fadc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:46.876 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.877+0000 7fd47fadc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:46.877 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.881+0000 7fd47fadc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:46.877 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.881+0000 7fd47fadc9c0 20 searching for the correct realm 2024-09-14T11:32:46.880 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:46.881+0000 7fd47dde3640 0 -- 172.21.15.71:0/2146398690 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fd4740831d0 msgr2=0x7fd47407f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:47.093 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.093+0000 7fd47dde3640 0 -- 172.21.15.71:0/2146398690 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x561ad11784b0 msgr2=0x561ad117a8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:47.108 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.109+0000 7fd47fadc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:47.108 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.109+0000 7fd47fadc9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:32:47.108 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.109+0000 7fd47fadc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:47.108 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.109+0000 7fd47fadc9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:32:47.108 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.109+0000 7fd47fadc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:47.108 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.109+0000 7fd47fadc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:47.108 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.109+0000 7fd47fadc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.108 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.109+0000 7fd47fadc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.109 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.109+0000 7fd47fadc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.109 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.113+0000 7fd47fadc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:47.109 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.113+0000 7fd47fadc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.113+0000 7fd47fadc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:47.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.113+0000 7fd47fadc9c0 20 zone default found 2024-09-14T11:32:47.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.113+0000 7fd47fadc9c0 4 Realm: () 2024-09-14T11:32:47.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.113+0000 7fd47fadc9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:32:47.111 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.113+0000 7fd47fadc9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:32:47.111 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.113+0000 7fd47fadc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:47.111 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.113+0000 7fd47fadc9c0 20 zonegroup default 2024-09-14T11:32:47.111 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.113+0000 7fd47fadc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.111 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.113+0000 7fd47fadc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.111 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.113+0000 7fd47fadc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.112 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.113+0000 7fd47fadc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.112 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.113+0000 7fd47fadc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.112 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.113+0000 7fd47fadc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.113 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.113+0000 7fd47fadc9c0 20 started sync module instance, tier type = 2024-09-14T11:32:47.113 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.113+0000 7fd47fadc9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:32:47.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.137+0000 7fd47fadc9c0 20 add_watcher() i=0 2024-09-14T11:32:47.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.137+0000 7fd47fadc9c0 20 add_watcher() i=1 2024-09-14T11:32:47.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.137+0000 7fd47fadc9c0 20 add_watcher() i=2 2024-09-14T11:32:47.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.137+0000 7fd47fadc9c0 20 add_watcher() i=3 2024-09-14T11:32:47.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.137+0000 7fd47fadc9c0 20 add_watcher() i=4 2024-09-14T11:32:47.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.137+0000 7fd47fadc9c0 20 add_watcher() i=5 2024-09-14T11:32:47.135 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.137+0000 7fd47fadc9c0 20 add_watcher() i=6 2024-09-14T11:32:47.136 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.137+0000 7fd47fadc9c0 20 add_watcher() i=7 2024-09-14T11:32:47.136 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.137+0000 7fd47fadc9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:47.140 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.141+0000 7fd3337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:47.141 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.145+0000 7fd47fadc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:47.141 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.145+0000 7fd47fadc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:47.141 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.145+0000 7fd47fadc9c0 5 note: GC not initialized 2024-09-14T11:32:47.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.145+0000 7fd3327e4640 20 reqs_thread_entry: start 2024-09-14T11:32:47.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.145+0000 7fd47fadc9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:32:47.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.145+0000 7fd47fadc9c0 20 Filter name: none 2024-09-14T11:32:47.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.145+0000 7fd2a3fff640 20 reqs_thread_entry: start 2024-09-14T11:32:47.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.145+0000 7fd47fadc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.145+0000 7fd47fadc9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:32:47.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.145+0000 7fd47fadc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.145+0000 7fd47fadc9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:32:47.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.145+0000 7fd47fadc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:47.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.149+0000 7fd47fadc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.149+0000 7fd47fadc9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:32:47.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.149+0000 7fd47fadc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.147 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.149+0000 7fd47fadc9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:32:47.147 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.149+0000 7fd47fadc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:47.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.153+0000 7fd3337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:47.154 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.157+0000 7fd47fadc9c0 20 remove_watcher() i=0 2024-09-14T11:32:47.154 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.157+0000 7fd47fadc9c0 2 removed watcher, disabling cache 2024-09-14T11:32:47.156 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.157+0000 7fd47fadc9c0 20 remove_watcher() i=1 2024-09-14T11:32:47.158 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.161+0000 7fd47fadc9c0 20 remove_watcher() i=2 2024-09-14T11:32:47.160 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.161+0000 7fd47fadc9c0 20 remove_watcher() i=3 2024-09-14T11:32:47.162 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.165+0000 7fd47fadc9c0 20 remove_watcher() i=4 2024-09-14T11:32:47.164 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.169+0000 7fd47fadc9c0 20 remove_watcher() i=5 2024-09-14T11:32:47.167 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.169+0000 7fd47fadc9c0 20 remove_watcher() i=6 2024-09-14T11:32:47.170 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.173+0000 7fd47fadc9c0 20 remove_watcher() i=7 2024-09-14T11:32:47.184 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.185 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:32:47.185 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: abort-at-logrecord-writes id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:32:47.185 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.185 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-14T11:32:47.222 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:47.222 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:47.267 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.269+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.273+0000 7f075c6ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.273+0000 7f075c6ce9c0 20 realm 2024-09-14T11:32:47.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.273+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.270 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.273+0000 7f075c6ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.270 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.273+0000 7f075c6ce9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:47.270 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.273+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.270 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.273+0000 7f075c6ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.270 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.273+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.271 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.273+0000 7f075c6ce9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:47.271 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.273+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.272 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.273+0000 7f075c6ce9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:47.272 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.273+0000 7f075c6ce9c0 20 searching for the correct realm 2024-09-14T11:32:47.276 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.277+0000 7f075a9d5640 0 -- 172.21.15.71:0/262669837 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f0750073430 msgr2=0x7f0750028030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:47.282 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.285+0000 7f075a9d5640 0 -- 172.21.15.71:0/262669837 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55f58a215b40 msgr2=0x55f58a217f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:47.290 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:47.290 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:32:47.290 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:47.290 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:32:47.290 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:47.290 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:47.290 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.291 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.291 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.291 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:47.291 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.292 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:47.292 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 zone default found 2024-09-14T11:32:47.292 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.293+0000 7f075c6ce9c0 4 Realm: () 2024-09-14T11:32:47.292 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.293+0000 7f075c6ce9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:32:47.293 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.293+0000 7f075c6ce9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:32:47.293 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.293+0000 7f075c6ce9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:47.293 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 zonegroup default 2024-09-14T11:32:47.293 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.293 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.293 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.293 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.293 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.294 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.297+0000 7f075c6ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.294 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.297+0000 7f075c6ce9c0 20 started sync module instance, tier type = 2024-09-14T11:32:47.294 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.297+0000 7f075c6ce9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:32:47.310 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.313+0000 7f075c6ce9c0 20 add_watcher() i=0 2024-09-14T11:32:47.310 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.313+0000 7f075c6ce9c0 20 add_watcher() i=1 2024-09-14T11:32:47.310 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.313+0000 7f075c6ce9c0 20 add_watcher() i=2 2024-09-14T11:32:47.310 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.313+0000 7f075c6ce9c0 20 add_watcher() i=3 2024-09-14T11:32:47.311 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.313+0000 7f075c6ce9c0 20 add_watcher() i=4 2024-09-14T11:32:47.311 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.313+0000 7f075c6ce9c0 20 add_watcher() i=5 2024-09-14T11:32:47.311 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.313+0000 7f075c6ce9c0 20 add_watcher() i=6 2024-09-14T11:32:47.313 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.317+0000 7f075c6ce9c0 20 add_watcher() i=7 2024-09-14T11:32:47.313 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.317+0000 7f075c6ce9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:47.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.317+0000 7f0610fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:47.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.321+0000 7f075c6ce9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:47.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.321+0000 7f075c6ce9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:47.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.321+0000 7f075c6ce9c0 5 note: GC not initialized 2024-09-14T11:32:47.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.321+0000 7f058b7fe640 20 reqs_thread_entry: start 2024-09-14T11:32:47.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.321+0000 7f075c6ce9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:32:47.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.321+0000 7f075c6ce9c0 20 Filter name: none 2024-09-14T11:32:47.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.321+0000 7f05897fa640 20 reqs_thread_entry: start 2024-09-14T11:32:47.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.321+0000 7f075c6ce9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:32:47.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.321+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.321+0000 7f075c6ce9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:32:47.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.321+0000 7f075c6ce9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:32:47.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.321+0000 7f075c6ce9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:32:47.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.321+0000 7f075c6ce9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 : miss 2024-09-14T11:32:47.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.321+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.321+0000 7f075c6ce9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:32:47.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.321+0000 7f075c6ce9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 info.flags=0x17 2024-09-14T11:32:47.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.321+0000 7f075c6ce9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 to cache LRU end 2024-09-14T11:32:47.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.321+0000 7f075c6ce9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:47.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.321+0000 7f075c6ce9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:47.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.321+0000 7f075c6ce9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 2024-09-14T11:32:47.330 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.333+0000 7f075c6ce9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 info.flags=0x17 2024-09-14T11:32:47.330 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.333+0000 7f075c6ce9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 to cache LRU end 2024-09-14T11:32:47.330 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.333+0000 7f075c6ce9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:47.330 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.333+0000 7f075c6ce9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37, ofs0, ns] 2024-09-14T11:32:47.330 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.333+0000 7f063d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464280 cookie 94513072826384 notifier 7283 bl.length()=1007 2024-09-14T11:32:47.331 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.333+0000 7f063d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 info.flags=0x17 2024-09-14T11:32:47.331 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.333+0000 7f063d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 to cache LRU end 2024-09-14T11:32:47.331 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.333+0000 7f063d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:47.331 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.333+0000 7f075c6ce9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.37]): orig_sources= new_sources= 2024-09-14T11:32:47.332 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.333+0000 7f075c6ce9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.37]): potential sources added=[] removed=[] 2024-09-14T11:32:47.332 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.333+0000 7f075c6ce9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.37]): orig_dests= new_dests= 2024-09-14T11:32:47.332 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.333+0000 7f075c6ce9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.37]): potential dests added=[] removed=[] 2024-09-14T11:32:47.338 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f075c6ce9c0 time 2024-09-14T11:32:47.343438+0000 2024-09-14T11:32:47.338 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:32:47.339 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:47.339 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f075ffa82eb] 2024-09-14T11:32:47.339 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f075ffa849f] 2024-09-14T11:32:47.339 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f587055c01] 2024-09-14T11:32:47.339 INFO:tasks.workunit.client.0.smithi071.stderr: 4: radosgw-admin(+0x142325c) [0x55f587ab425c] 2024-09-14T11:32:47.339 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f58706aecd] 2024-09-14T11:32:47.339 INFO:tasks.workunit.client.0.smithi071.stderr: 6: main() 2024-09-14T11:32:47.339 INFO:tasks.workunit.client.0.smithi071.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f075ee0ed90] 2024-09-14T11:32:47.339 INFO:tasks.workunit.client.0.smithi071.stderr: 8: __libc_start_main() 2024-09-14T11:32:47.339 INFO:tasks.workunit.client.0.smithi071.stderr: 9: _start() 2024-09-14T11:32:47.340 INFO:tasks.workunit.client.0.smithi071.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:32:47.340 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f075c6ce9c0 thread_name:radosgw-admin 2024-09-14T11:32:47.340 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.341+0000 7f075c6ce9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f075c6ce9c0 time 2024-09-14T11:32:47.343438+0000 2024-09-14T11:32:47.340 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:32:47.340 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.340 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:47.340 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f075ffa82eb] 2024-09-14T11:32:47.340 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f075ffa849f] 2024-09-14T11:32:47.340 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f587055c01] 2024-09-14T11:32:47.340 INFO:tasks.workunit.client.0.smithi071.stderr: 4: radosgw-admin(+0x142325c) [0x55f587ab425c] 2024-09-14T11:32:47.340 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f58706aecd] 2024-09-14T11:32:47.340 INFO:tasks.workunit.client.0.smithi071.stderr: 6: main() 2024-09-14T11:32:47.340 INFO:tasks.workunit.client.0.smithi071.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f075ee0ed90] 2024-09-14T11:32:47.341 INFO:tasks.workunit.client.0.smithi071.stderr: 8: __libc_start_main() 2024-09-14T11:32:47.341 INFO:tasks.workunit.client.0.smithi071.stderr: 9: _start() 2024-09-14T11:32:47.341 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.358 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:47.358 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f075ee27520] 2024-09-14T11:32:47.358 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:32:47.358 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:32:47.358 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:32:47.358 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f075ffa8345] 2024-09-14T11:32:47.358 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f075ffa849f] 2024-09-14T11:32:47.358 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f587055c01] 2024-09-14T11:32:47.358 INFO:tasks.workunit.client.0.smithi071.stderr: 8: radosgw-admin(+0x142325c) [0x55f587ab425c] 2024-09-14T11:32:47.358 INFO:tasks.workunit.client.0.smithi071.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f58706aecd] 2024-09-14T11:32:47.358 INFO:tasks.workunit.client.0.smithi071.stderr: 10: main() 2024-09-14T11:32:47.358 INFO:tasks.workunit.client.0.smithi071.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f075ee0ed90] 2024-09-14T11:32:47.358 INFO:tasks.workunit.client.0.smithi071.stderr: 12: __libc_start_main() 2024-09-14T11:32:47.359 INFO:tasks.workunit.client.0.smithi071.stderr: 13: _start() 2024-09-14T11:32:47.359 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.341+0000 7f075c6ce9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:32:47.359 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f075c6ce9c0 thread_name:radosgw-admin 2024-09-14T11:32:47.359 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.359 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:47.359 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f075ee27520] 2024-09-14T11:32:47.359 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:32:47.359 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:32:47.359 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:32:47.359 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f075ffa8345] 2024-09-14T11:32:47.359 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f075ffa849f] 2024-09-14T11:32:47.359 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f587055c01] 2024-09-14T11:32:47.359 INFO:tasks.workunit.client.0.smithi071.stderr: 8: radosgw-admin(+0x142325c) [0x55f587ab425c] 2024-09-14T11:32:47.359 INFO:tasks.workunit.client.0.smithi071.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f58706aecd] 2024-09-14T11:32:47.359 INFO:tasks.workunit.client.0.smithi071.stderr: 10: main() 2024-09-14T11:32:47.360 INFO:tasks.workunit.client.0.smithi071.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f075ee0ed90] 2024-09-14T11:32:47.360 INFO:tasks.workunit.client.0.smithi071.stderr: 12: __libc_start_main() 2024-09-14T11:32:47.360 INFO:tasks.workunit.client.0.smithi071.stderr: 13: _start() 2024-09-14T11:32:47.360 INFO:tasks.workunit.client.0.smithi071.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:32:47.360 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.360 INFO:tasks.workunit.client.0.smithi071.stderr:--- begin dump of recent events --- 2024-09-14T11:32:47.360 INFO:tasks.workunit.client.0.smithi071.stderr: -499> 2024-09-14T11:32:47.245+0000 7f075a9d5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:47.360 INFO:tasks.workunit.client.0.smithi071.stderr: -498> 2024-09-14T11:32:47.245+0000 7f075a9d5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:47.360 INFO:tasks.workunit.client.0.smithi071.stderr: -497> 2024-09-14T11:32:47.245+0000 7f07599d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:47.360 INFO:tasks.workunit.client.0.smithi071.stderr: -496> 2024-09-14T11:32:47.245+0000 7f07599d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:47.360 INFO:tasks.workunit.client.0.smithi071.stderr: -495> 2024-09-14T11:32:47.245+0000 7f07599d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:47.360 INFO:tasks.workunit.client.0.smithi071.stderr: -494> 2024-09-14T11:32:47.245+0000 7f07599d3640 10 monclient(hunting): handle_auth_done global_id 7271 payload 274 2024-09-14T11:32:47.360 INFO:tasks.workunit.client.0.smithi071.stderr: -493> 2024-09-14T11:32:47.245+0000 7f07599d3640 10 monclient: _finish_hunting 0 2024-09-14T11:32:47.360 INFO:tasks.workunit.client.0.smithi071.stderr: -492> 2024-09-14T11:32:47.245+0000 7f07599d3640 1 monclient: found mon.noname-c 2024-09-14T11:32:47.360 INFO:tasks.workunit.client.0.smithi071.stderr: -491> 2024-09-14T11:32:47.245+0000 7f07599d3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:32:47.361 INFO:tasks.workunit.client.0.smithi071.stderr: -490> 2024-09-14T11:32:47.245+0000 7f075a1d4640 10 monclient: get_auth_request con 0x55f589fadc20 auth_method 0 2024-09-14T11:32:47.361 INFO:tasks.workunit.client.0.smithi071.stderr: -489> 2024-09-14T11:32:47.245+0000 7f0648608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:47.361 INFO:tasks.workunit.client.0.smithi071.stderr: -488> 2024-09-14T11:32:47.245+0000 7f0648608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:32:47.361 INFO:tasks.workunit.client.0.smithi071.stderr: -487> 2024-09-14T11:32:47.245+0000 7f0648608640 10 monclient: dump: 2024-09-14T11:32:47.361 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:47.361 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:47.361 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.361 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.361 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:47.361 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:47.361 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:47.361 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:47.361 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:47.361 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.362 INFO:tasks.workunit.client.0.smithi071.stderr: -486> 2024-09-14T11:32:47.245+0000 7f0648608640 10 monclient: _finish_auth 0 2024-09-14T11:32:47.362 INFO:tasks.workunit.client.0.smithi071.stderr: -485> 2024-09-14T11:32:47.245+0000 7f0648608640 10 monclient: _check_auth_tickets 2024-09-14T11:32:47.362 INFO:tasks.workunit.client.0.smithi071.stderr: -484> 2024-09-14T11:32:47.245+0000 7f0648608640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:47.362 INFO:tasks.workunit.client.0.smithi071.stderr: -483> 2024-09-14T11:32:47.245+0000 7f0648608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:47.362 INFO:tasks.workunit.client.0.smithi071.stderr: -482> 2024-09-14T11:32:47.245+0000 7f0648608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:47.362 INFO:tasks.workunit.client.0.smithi071.stderr: -481> 2024-09-14T11:32:47.245+0000 7f0648608640 10 monclient: dump: 2024-09-14T11:32:47.362 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:47.362 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:47.362 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.362 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.362 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:47.362 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:47.362 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:47.362 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:47.362 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:47.363 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.363 INFO:tasks.workunit.client.0.smithi071.stderr: -480> 2024-09-14T11:32:47.245+0000 7f075c6ce9c0 5 monclient: authenticate success, global_id 7271 2024-09-14T11:32:47.363 INFO:tasks.workunit.client.0.smithi071.stderr: -479> 2024-09-14T11:32:47.245+0000 7f075c6ce9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:32:47.363 INFO:tasks.workunit.client.0.smithi071.stderr: -478> 2024-09-14T11:32:47.245+0000 7f075c6ce9c0 4 set_mon_vals no callback set 2024-09-14T11:32:47.363 INFO:tasks.workunit.client.0.smithi071.stderr: -477> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 10 monclient: shutdown 2024-09-14T11:32:47.363 INFO:tasks.workunit.client.0.smithi071.stderr: -476> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 asok(0x55f589f14d90) unregister_commands rotate-key 2024-09-14T11:32:47.363 INFO:tasks.workunit.client.0.smithi071.stderr: -475> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 10 monclient: build_initial_monmap 2024-09-14T11:32:47.363 INFO:tasks.workunit.client.0.smithi071.stderr: -474> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 1 build_initial for_mkfs: 0 2024-09-14T11:32:47.363 INFO:tasks.workunit.client.0.smithi071.stderr: -473> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 10 monclient: monmap: 2024-09-14T11:32:47.363 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:32:47.363 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:47.363 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:32:47.363 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:32:47.363 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:47.363 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:47.364 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:32:47.364 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:32:47.364 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:32:47.364 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.364 INFO:tasks.workunit.client.0.smithi071.stderr: -472> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1287a0) adding auth protocol: cephx 2024-09-14T11:32:47.364 INFO:tasks.workunit.client.0.smithi071.stderr: -471> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1287a0) adding auth protocol: cephx 2024-09-14T11:32:47.364 INFO:tasks.workunit.client.0.smithi071.stderr: -470> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1287a0) adding auth protocol: cephx 2024-09-14T11:32:47.364 INFO:tasks.workunit.client.0.smithi071.stderr: -469> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1287a0) adding con mode: secure 2024-09-14T11:32:47.364 INFO:tasks.workunit.client.0.smithi071.stderr: -468> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1287a0) adding con mode: crc 2024-09-14T11:32:47.364 INFO:tasks.workunit.client.0.smithi071.stderr: -467> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1287a0) adding con mode: secure 2024-09-14T11:32:47.364 INFO:tasks.workunit.client.0.smithi071.stderr: -466> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1287a0) adding con mode: crc 2024-09-14T11:32:47.364 INFO:tasks.workunit.client.0.smithi071.stderr: -465> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1287a0) adding con mode: secure 2024-09-14T11:32:47.364 INFO:tasks.workunit.client.0.smithi071.stderr: -464> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1287a0) adding con mode: crc 2024-09-14T11:32:47.364 INFO:tasks.workunit.client.0.smithi071.stderr: -463> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1287a0) adding con mode: crc 2024-09-14T11:32:47.364 INFO:tasks.workunit.client.0.smithi071.stderr: -462> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1287a0) adding con mode: secure 2024-09-14T11:32:47.364 INFO:tasks.workunit.client.0.smithi071.stderr: -461> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1287a0) adding con mode: crc 2024-09-14T11:32:47.365 INFO:tasks.workunit.client.0.smithi071.stderr: -460> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1287a0) adding con mode: secure 2024-09-14T11:32:47.365 INFO:tasks.workunit.client.0.smithi071.stderr: -459> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1287a0) adding con mode: crc 2024-09-14T11:32:47.365 INFO:tasks.workunit.client.0.smithi071.stderr: -458> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1287a0) adding con mode: secure 2024-09-14T11:32:47.365 INFO:tasks.workunit.client.0.smithi071.stderr: -457> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:47.365 INFO:tasks.workunit.client.0.smithi071.stderr: -456> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 1 librados: starting msgr at 2024-09-14T11:32:47.365 INFO:tasks.workunit.client.0.smithi071.stderr: -455> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 1 librados: starting objecter 2024-09-14T11:32:47.365 INFO:tasks.workunit.client.0.smithi071.stderr: -454> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 asok(0x55f589f14d90) register_command objecter_requests hook 0x55f58a127460 2024-09-14T11:32:47.365 INFO:tasks.workunit.client.0.smithi071.stderr: -453> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 1 librados: setting wanted keys 2024-09-14T11:32:47.365 INFO:tasks.workunit.client.0.smithi071.stderr: -452> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 1 librados: calling monclient init 2024-09-14T11:32:47.365 INFO:tasks.workunit.client.0.smithi071.stderr: -451> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 10 monclient: init 2024-09-14T11:32:47.365 INFO:tasks.workunit.client.0.smithi071.stderr: -450> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a122280) adding auth protocol: cephx 2024-09-14T11:32:47.365 INFO:tasks.workunit.client.0.smithi071.stderr: -449> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a122280) adding auth protocol: cephx 2024-09-14T11:32:47.365 INFO:tasks.workunit.client.0.smithi071.stderr: -448> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a122280) adding auth protocol: cephx 2024-09-14T11:32:47.365 INFO:tasks.workunit.client.0.smithi071.stderr: -447> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a122280) adding con mode: secure 2024-09-14T11:32:47.365 INFO:tasks.workunit.client.0.smithi071.stderr: -446> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a122280) adding con mode: crc 2024-09-14T11:32:47.366 INFO:tasks.workunit.client.0.smithi071.stderr: -445> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a122280) adding con mode: secure 2024-09-14T11:32:47.366 INFO:tasks.workunit.client.0.smithi071.stderr: -444> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a122280) adding con mode: crc 2024-09-14T11:32:47.366 INFO:tasks.workunit.client.0.smithi071.stderr: -443> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a122280) adding con mode: secure 2024-09-14T11:32:47.366 INFO:tasks.workunit.client.0.smithi071.stderr: -442> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a122280) adding con mode: crc 2024-09-14T11:32:47.366 INFO:tasks.workunit.client.0.smithi071.stderr: -441> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a122280) adding con mode: crc 2024-09-14T11:32:47.366 INFO:tasks.workunit.client.0.smithi071.stderr: -440> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a122280) adding con mode: secure 2024-09-14T11:32:47.366 INFO:tasks.workunit.client.0.smithi071.stderr: -439> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a122280) adding con mode: crc 2024-09-14T11:32:47.366 INFO:tasks.workunit.client.0.smithi071.stderr: -438> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a122280) adding con mode: secure 2024-09-14T11:32:47.366 INFO:tasks.workunit.client.0.smithi071.stderr: -437> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a122280) adding con mode: crc 2024-09-14T11:32:47.366 INFO:tasks.workunit.client.0.smithi071.stderr: -436> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a122280) adding con mode: secure 2024-09-14T11:32:47.366 INFO:tasks.workunit.client.0.smithi071.stderr: -435> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:47.366 INFO:tasks.workunit.client.0.smithi071.stderr: -434> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:47.366 INFO:tasks.workunit.client.0.smithi071.stderr: -433> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 asok(0x55f589f14d90) register_command rotate-key hook 0x55f58a1223c8 2024-09-14T11:32:47.366 INFO:tasks.workunit.client.0.smithi071.stderr: -432> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:32:47.366 INFO:tasks.workunit.client.0.smithi071.stderr: -431> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:32:47.367 INFO:tasks.workunit.client.0.smithi071.stderr: -430> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 10 monclient(hunting): picked mon.noname-c con 0x55f589fadc20 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:32:47.367 INFO:tasks.workunit.client.0.smithi071.stderr: -429> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 10 monclient(hunting): picked mon.noname-b con 0x55f58a067900 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:32:47.367 INFO:tasks.workunit.client.0.smithi071.stderr: -428> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 10 monclient(hunting): picked mon.noname-a con 0x55f58a06acb0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:32:47.367 INFO:tasks.workunit.client.0.smithi071.stderr: -427> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:47.367 INFO:tasks.workunit.client.0.smithi071.stderr: -426> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:47.367 INFO:tasks.workunit.client.0.smithi071.stderr: -425> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:47.367 INFO:tasks.workunit.client.0.smithi071.stderr: -424> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:32:47.367 INFO:tasks.workunit.client.0.smithi071.stderr: -423> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 10 monclient(hunting): authenticate will time out at 2379.370035s 2024-09-14T11:32:47.367 INFO:tasks.workunit.client.0.smithi071.stderr: -422> 2024-09-14T11:32:47.249+0000 7f075a1d4640 10 monclient(hunting): get_auth_request con 0x55f589fadc20 auth_method 0 2024-09-14T11:32:47.367 INFO:tasks.workunit.client.0.smithi071.stderr: -421> 2024-09-14T11:32:47.249+0000 7f075a1d4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:47.367 INFO:tasks.workunit.client.0.smithi071.stderr: -420> 2024-09-14T11:32:47.249+0000 7f075a1d4640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:47.367 INFO:tasks.workunit.client.0.smithi071.stderr: -419> 2024-09-14T11:32:47.249+0000 7f075a1d4640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:47.367 INFO:tasks.workunit.client.0.smithi071.stderr: -418> 2024-09-14T11:32:47.249+0000 7f075a9d5640 10 monclient(hunting): get_auth_request con 0x55f58a06acb0 auth_method 0 2024-09-14T11:32:47.367 INFO:tasks.workunit.client.0.smithi071.stderr: -417> 2024-09-14T11:32:47.249+0000 7f075a9d5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:47.367 INFO:tasks.workunit.client.0.smithi071.stderr: -416> 2024-09-14T11:32:47.249+0000 7f075a9d5640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:47.367 INFO:tasks.workunit.client.0.smithi071.stderr: -415> 2024-09-14T11:32:47.249+0000 7f075a9d5640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:47.368 INFO:tasks.workunit.client.0.smithi071.stderr: -414> 2024-09-14T11:32:47.249+0000 7f075a1d4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:47.368 INFO:tasks.workunit.client.0.smithi071.stderr: -413> 2024-09-14T11:32:47.249+0000 7f075a1d4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:47.368 INFO:tasks.workunit.client.0.smithi071.stderr: -412> 2024-09-14T11:32:47.249+0000 7f075a1d4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:47.368 INFO:tasks.workunit.client.0.smithi071.stderr: -411> 2024-09-14T11:32:47.249+0000 7f075a9d5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:47.368 INFO:tasks.workunit.client.0.smithi071.stderr: -410> 2024-09-14T11:32:47.249+0000 7f075a9d5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:47.368 INFO:tasks.workunit.client.0.smithi071.stderr: -409> 2024-09-14T11:32:47.249+0000 7f075a9d5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:47.368 INFO:tasks.workunit.client.0.smithi071.stderr: -408> 2024-09-14T11:32:47.249+0000 7f075a1d4640 10 monclient(hunting): handle_auth_done global_id 7274 payload 824 2024-09-14T11:32:47.368 INFO:tasks.workunit.client.0.smithi071.stderr: -407> 2024-09-14T11:32:47.249+0000 7f075a1d4640 10 monclient: _finish_hunting 0 2024-09-14T11:32:47.368 INFO:tasks.workunit.client.0.smithi071.stderr: -406> 2024-09-14T11:32:47.249+0000 7f075a1d4640 1 monclient: found mon.noname-c 2024-09-14T11:32:47.368 INFO:tasks.workunit.client.0.smithi071.stderr: -405> 2024-09-14T11:32:47.249+0000 7f075a1d4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:32:47.368 INFO:tasks.workunit.client.0.smithi071.stderr: -404> 2024-09-14T11:32:47.249+0000 7f0646e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:47.368 INFO:tasks.workunit.client.0.smithi071.stderr: -403> 2024-09-14T11:32:47.249+0000 7f0646e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:32:47.368 INFO:tasks.workunit.client.0.smithi071.stderr: -402> 2024-09-14T11:32:47.249+0000 7f0646e05640 10 monclient: dump: 2024-09-14T11:32:47.368 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:47.368 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:47.369 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.369 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.369 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:47.369 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:47.369 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:47.369 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:47.369 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:47.369 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.369 INFO:tasks.workunit.client.0.smithi071.stderr: -401> 2024-09-14T11:32:47.249+0000 7f0646e05640 10 monclient: _finish_auth 0 2024-09-14T11:32:47.369 INFO:tasks.workunit.client.0.smithi071.stderr: -400> 2024-09-14T11:32:47.249+0000 7f0646e05640 10 monclient: _check_auth_tickets 2024-09-14T11:32:47.369 INFO:tasks.workunit.client.0.smithi071.stderr: -399> 2024-09-14T11:32:47.249+0000 7f0646e05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:47.369 INFO:tasks.workunit.client.0.smithi071.stderr: -398> 2024-09-14T11:32:47.249+0000 7f0646e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:47.369 INFO:tasks.workunit.client.0.smithi071.stderr: -397> 2024-09-14T11:32:47.249+0000 7f0646e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:47.369 INFO:tasks.workunit.client.0.smithi071.stderr: -396> 2024-09-14T11:32:47.249+0000 7f0646e05640 10 monclient: dump: 2024-09-14T11:32:47.369 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:47.370 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:47.370 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.370 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.370 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:47.370 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:47.370 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:47.370 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:47.370 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:47.370 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.370 INFO:tasks.workunit.client.0.smithi071.stderr: -395> 2024-09-14T11:32:47.249+0000 7f0648608640 4 set_mon_vals no callback set 2024-09-14T11:32:47.370 INFO:tasks.workunit.client.0.smithi071.stderr: -394> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 monclient: authenticate success, global_id 7274 2024-09-14T11:32:47.370 INFO:tasks.workunit.client.0.smithi071.stderr: -393> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 10 monclient: _renew_subs 2024-09-14T11:32:47.370 INFO:tasks.workunit.client.0.smithi071.stderr: -392> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:32:47.370 INFO:tasks.workunit.client.0.smithi071.stderr: -391> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 10 monclient: _renew_subs 2024-09-14T11:32:47.370 INFO:tasks.workunit.client.0.smithi071.stderr: -390> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:32:47.370 INFO:tasks.workunit.client.0.smithi071.stderr: -389> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 1 librados: init done 2024-09-14T11:32:47.371 INFO:tasks.workunit.client.0.smithi071.stderr: -388> 2024-09-14T11:32:47.253+0000 7f0646e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:47.371 INFO:tasks.workunit.client.0.smithi071.stderr: -387> 2024-09-14T11:32:47.253+0000 7f0646e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:32:47.371 INFO:tasks.workunit.client.0.smithi071.stderr: -386> 2024-09-14T11:32:47.253+0000 7f0646e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:32:47.371 INFO:tasks.workunit.client.0.smithi071.stderr: -385> 2024-09-14T11:32:47.253+0000 7f07599d3640 10 monclient: get_auth_request con 0x7f06400718d0 auth_method 0 2024-09-14T11:32:47.371 INFO:tasks.workunit.client.0.smithi071.stderr: -384> 2024-09-14T11:32:47.253+0000 7f075a9d5640 10 monclient: get_auth_request con 0x55f58a14a320 auth_method 0 2024-09-14T11:32:47.371 INFO:tasks.workunit.client.0.smithi071.stderr: -383> 2024-09-14T11:32:47.253+0000 7f075a1d4640 10 monclient: get_auth_request con 0x55f58a16d3d0 auth_method 0 2024-09-14T11:32:47.371 INFO:tasks.workunit.client.0.smithi071.stderr: -382> 2024-09-14T11:32:47.257+0000 7f07599d3640 10 monclient: get_auth_request con 0x55f58a1715c0 auth_method 0 2024-09-14T11:32:47.371 INFO:tasks.workunit.client.0.smithi071.stderr: -381> 2024-09-14T11:32:47.257+0000 7f075a9d5640 10 monclient: get_auth_request con 0x55f58a1752f0 auth_method 0 2024-09-14T11:32:47.371 INFO:tasks.workunit.client.0.smithi071.stderr: -380> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 10 monclient: build_initial_monmap 2024-09-14T11:32:47.371 INFO:tasks.workunit.client.0.smithi071.stderr: -379> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 1 build_initial for_mkfs: 0 2024-09-14T11:32:47.371 INFO:tasks.workunit.client.0.smithi071.stderr: -378> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 10 monclient: monmap: 2024-09-14T11:32:47.371 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:32:47.371 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:47.371 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:32:47.372 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:32:47.372 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:47.372 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:47.372 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:32:47.372 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:32:47.372 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:32:47.372 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.372 INFO:tasks.workunit.client.0.smithi071.stderr: -377> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1794a0) adding auth protocol: cephx 2024-09-14T11:32:47.372 INFO:tasks.workunit.client.0.smithi071.stderr: -376> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1794a0) adding auth protocol: cephx 2024-09-14T11:32:47.372 INFO:tasks.workunit.client.0.smithi071.stderr: -375> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1794a0) adding auth protocol: cephx 2024-09-14T11:32:47.372 INFO:tasks.workunit.client.0.smithi071.stderr: -374> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1794a0) adding con mode: secure 2024-09-14T11:32:47.372 INFO:tasks.workunit.client.0.smithi071.stderr: -373> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1794a0) adding con mode: crc 2024-09-14T11:32:47.372 INFO:tasks.workunit.client.0.smithi071.stderr: -372> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1794a0) adding con mode: secure 2024-09-14T11:32:47.372 INFO:tasks.workunit.client.0.smithi071.stderr: -371> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1794a0) adding con mode: crc 2024-09-14T11:32:47.372 INFO:tasks.workunit.client.0.smithi071.stderr: -370> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1794a0) adding con mode: secure 2024-09-14T11:32:47.373 INFO:tasks.workunit.client.0.smithi071.stderr: -369> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1794a0) adding con mode: crc 2024-09-14T11:32:47.373 INFO:tasks.workunit.client.0.smithi071.stderr: -368> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1794a0) adding con mode: crc 2024-09-14T11:32:47.373 INFO:tasks.workunit.client.0.smithi071.stderr: -367> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1794a0) adding con mode: secure 2024-09-14T11:32:47.373 INFO:tasks.workunit.client.0.smithi071.stderr: -366> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1794a0) adding con mode: crc 2024-09-14T11:32:47.373 INFO:tasks.workunit.client.0.smithi071.stderr: -365> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1794a0) adding con mode: secure 2024-09-14T11:32:47.373 INFO:tasks.workunit.client.0.smithi071.stderr: -364> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1794a0) adding con mode: crc 2024-09-14T11:32:47.373 INFO:tasks.workunit.client.0.smithi071.stderr: -363> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1794a0) adding con mode: secure 2024-09-14T11:32:47.373 INFO:tasks.workunit.client.0.smithi071.stderr: -362> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:47.373 INFO:tasks.workunit.client.0.smithi071.stderr: -361> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 asok(0x55f589f14d90) register_command objecter_requests cmddesc objecter_requests hook 0x55f58a17cda0 EEXIST 2024-09-14T11:32:47.373 INFO:tasks.workunit.client.0.smithi071.stderr: -360> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 10 monclient: init 2024-09-14T11:32:47.373 INFO:tasks.workunit.client.0.smithi071.stderr: -359> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1782f8) adding auth protocol: cephx 2024-09-14T11:32:47.373 INFO:tasks.workunit.client.0.smithi071.stderr: -358> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1782f8) adding auth protocol: cephx 2024-09-14T11:32:47.373 INFO:tasks.workunit.client.0.smithi071.stderr: -357> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1782f8) adding auth protocol: cephx 2024-09-14T11:32:47.373 INFO:tasks.workunit.client.0.smithi071.stderr: -356> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1782f8) adding con mode: secure 2024-09-14T11:32:47.373 INFO:tasks.workunit.client.0.smithi071.stderr: -355> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1782f8) adding con mode: crc 2024-09-14T11:32:47.374 INFO:tasks.workunit.client.0.smithi071.stderr: -354> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1782f8) adding con mode: secure 2024-09-14T11:32:47.374 INFO:tasks.workunit.client.0.smithi071.stderr: -353> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1782f8) adding con mode: crc 2024-09-14T11:32:47.374 INFO:tasks.workunit.client.0.smithi071.stderr: -352> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1782f8) adding con mode: secure 2024-09-14T11:32:47.374 INFO:tasks.workunit.client.0.smithi071.stderr: -351> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1782f8) adding con mode: crc 2024-09-14T11:32:47.374 INFO:tasks.workunit.client.0.smithi071.stderr: -350> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1782f8) adding con mode: crc 2024-09-14T11:32:47.374 INFO:tasks.workunit.client.0.smithi071.stderr: -349> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1782f8) adding con mode: secure 2024-09-14T11:32:47.374 INFO:tasks.workunit.client.0.smithi071.stderr: -348> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1782f8) adding con mode: crc 2024-09-14T11:32:47.374 INFO:tasks.workunit.client.0.smithi071.stderr: -347> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1782f8) adding con mode: secure 2024-09-14T11:32:47.374 INFO:tasks.workunit.client.0.smithi071.stderr: -346> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1782f8) adding con mode: crc 2024-09-14T11:32:47.374 INFO:tasks.workunit.client.0.smithi071.stderr: -345> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1782f8) adding con mode: secure 2024-09-14T11:32:47.374 INFO:tasks.workunit.client.0.smithi071.stderr: -344> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:47.374 INFO:tasks.workunit.client.0.smithi071.stderr: -343> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:47.374 INFO:tasks.workunit.client.0.smithi071.stderr: -342> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 5 asok(0x55f589f14d90) register_command rotate-key cmddesc rotate-key hook 0x55f58a178440 EEXIST 2024-09-14T11:32:47.374 INFO:tasks.workunit.client.0.smithi071.stderr: -341> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:32:47.374 INFO:tasks.workunit.client.0.smithi071.stderr: -340> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:32:47.374 INFO:tasks.workunit.client.0.smithi071.stderr: -339> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 10 monclient(hunting): picked mon.noname-a con 0x55f58a1a0f50 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:32:47.375 INFO:tasks.workunit.client.0.smithi071.stderr: -338> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 10 monclient(hunting): picked mon.noname-b con 0x55f58a1a0880 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:32:47.375 INFO:tasks.workunit.client.0.smithi071.stderr: -337> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 10 monclient(hunting): picked mon.noname-c con 0x55f58a19f260 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:32:47.375 INFO:tasks.workunit.client.0.smithi071.stderr: -336> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:47.375 INFO:tasks.workunit.client.0.smithi071.stderr: -335> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:47.375 INFO:tasks.workunit.client.0.smithi071.stderr: -334> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:47.375 INFO:tasks.workunit.client.0.smithi071.stderr: -333> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:32:47.375 INFO:tasks.workunit.client.0.smithi071.stderr: -332> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 10 monclient(hunting): authenticate will time out at 2379.380277s 2024-09-14T11:32:47.375 INFO:tasks.workunit.client.0.smithi071.stderr: -331> 2024-09-14T11:32:47.261+0000 7f075a1d4640 10 monclient(hunting): get_auth_request con 0x55f58a19f260 auth_method 0 2024-09-14T11:32:47.375 INFO:tasks.workunit.client.0.smithi071.stderr: -330> 2024-09-14T11:32:47.261+0000 7f075a1d4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:47.375 INFO:tasks.workunit.client.0.smithi071.stderr: -329> 2024-09-14T11:32:47.261+0000 7f075a1d4640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:47.375 INFO:tasks.workunit.client.0.smithi071.stderr: -328> 2024-09-14T11:32:47.261+0000 7f075a1d4640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:47.375 INFO:tasks.workunit.client.0.smithi071.stderr: -327> 2024-09-14T11:32:47.261+0000 7f07599d3640 10 monclient(hunting): get_auth_request con 0x55f58a1a0f50 auth_method 0 2024-09-14T11:32:47.375 INFO:tasks.workunit.client.0.smithi071.stderr: -326> 2024-09-14T11:32:47.261+0000 7f07599d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:47.375 INFO:tasks.workunit.client.0.smithi071.stderr: -325> 2024-09-14T11:32:47.261+0000 7f07599d3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:47.375 INFO:tasks.workunit.client.0.smithi071.stderr: -324> 2024-09-14T11:32:47.261+0000 7f07599d3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:47.376 INFO:tasks.workunit.client.0.smithi071.stderr: -323> 2024-09-14T11:32:47.261+0000 7f075a1d4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:47.376 INFO:tasks.workunit.client.0.smithi071.stderr: -322> 2024-09-14T11:32:47.261+0000 7f075a1d4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:47.376 INFO:tasks.workunit.client.0.smithi071.stderr: -321> 2024-09-14T11:32:47.261+0000 7f075a1d4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:47.376 INFO:tasks.workunit.client.0.smithi071.stderr: -320> 2024-09-14T11:32:47.261+0000 7f07599d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:47.376 INFO:tasks.workunit.client.0.smithi071.stderr: -319> 2024-09-14T11:32:47.261+0000 7f07599d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:47.376 INFO:tasks.workunit.client.0.smithi071.stderr: -318> 2024-09-14T11:32:47.261+0000 7f07599d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:47.376 INFO:tasks.workunit.client.0.smithi071.stderr: -317> 2024-09-14T11:32:47.261+0000 7f075a1d4640 10 monclient(hunting): handle_auth_done global_id 7277 payload 824 2024-09-14T11:32:47.376 INFO:tasks.workunit.client.0.smithi071.stderr: -316> 2024-09-14T11:32:47.261+0000 7f075a1d4640 10 monclient: _finish_hunting 0 2024-09-14T11:32:47.376 INFO:tasks.workunit.client.0.smithi071.stderr: -315> 2024-09-14T11:32:47.261+0000 7f075a1d4640 1 monclient: found mon.noname-c 2024-09-14T11:32:47.376 INFO:tasks.workunit.client.0.smithi071.stderr: -314> 2024-09-14T11:32:47.261+0000 7f075a1d4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:32:47.376 INFO:tasks.workunit.client.0.smithi071.stderr: -313> 2024-09-14T11:32:47.261+0000 7f063ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:47.376 INFO:tasks.workunit.client.0.smithi071.stderr: -312> 2024-09-14T11:32:47.261+0000 7f063ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:32:47.376 INFO:tasks.workunit.client.0.smithi071.stderr: -311> 2024-09-14T11:32:47.261+0000 7f063ffff640 10 monclient: dump: 2024-09-14T11:32:47.376 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:47.376 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:47.377 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.377 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.377 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:47.377 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:47.377 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:47.377 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:47.377 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:47.377 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.377 INFO:tasks.workunit.client.0.smithi071.stderr: -310> 2024-09-14T11:32:47.261+0000 7f063ffff640 10 monclient: _finish_auth 0 2024-09-14T11:32:47.377 INFO:tasks.workunit.client.0.smithi071.stderr: -309> 2024-09-14T11:32:47.261+0000 7f063ffff640 10 monclient: _check_auth_tickets 2024-09-14T11:32:47.377 INFO:tasks.workunit.client.0.smithi071.stderr: -308> 2024-09-14T11:32:47.261+0000 7f063ffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:47.377 INFO:tasks.workunit.client.0.smithi071.stderr: -307> 2024-09-14T11:32:47.261+0000 7f063ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:47.377 INFO:tasks.workunit.client.0.smithi071.stderr: -306> 2024-09-14T11:32:47.261+0000 7f063ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:47.377 INFO:tasks.workunit.client.0.smithi071.stderr: -305> 2024-09-14T11:32:47.261+0000 7f063ffff640 10 monclient: dump: 2024-09-14T11:32:47.377 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:47.378 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:47.378 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.378 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.378 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:47.378 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:47.378 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:47.378 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:47.378 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:47.378 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.378 INFO:tasks.workunit.client.0.smithi071.stderr: -304> 2024-09-14T11:32:47.261+0000 7f075b1d6640 4 set_mon_vals no callback set 2024-09-14T11:32:47.378 INFO:tasks.workunit.client.0.smithi071.stderr: -303> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 5 monclient: authenticate success, global_id 7277 2024-09-14T11:32:47.378 INFO:tasks.workunit.client.0.smithi071.stderr: -302> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 10 monclient: _renew_subs 2024-09-14T11:32:47.378 INFO:tasks.workunit.client.0.smithi071.stderr: -301> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:32:47.378 INFO:tasks.workunit.client.0.smithi071.stderr: -300> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 10 monclient: _renew_subs 2024-09-14T11:32:47.378 INFO:tasks.workunit.client.0.smithi071.stderr: -299> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:32:47.379 INFO:tasks.workunit.client.0.smithi071.stderr: -298> 2024-09-14T11:32:47.261+0000 7f063ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:47.379 INFO:tasks.workunit.client.0.smithi071.stderr: -297> 2024-09-14T11:32:47.261+0000 7f063ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:32:47.379 INFO:tasks.workunit.client.0.smithi071.stderr: -296> 2024-09-14T11:32:47.261+0000 7f063ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:32:47.379 INFO:tasks.workunit.client.0.smithi071.stderr: -295> 2024-09-14T11:32:47.261+0000 7f07599d3640 10 monclient: get_auth_request con 0x7f06340717e0 auth_method 0 2024-09-14T11:32:47.379 INFO:tasks.workunit.client.0.smithi071.stderr: -294> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 10 monclient: get_monmap_and_config 2024-09-14T11:32:47.379 INFO:tasks.workunit.client.0.smithi071.stderr: -293> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 10 monclient: build_initial_monmap 2024-09-14T11:32:47.379 INFO:tasks.workunit.client.0.smithi071.stderr: -292> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 1 build_initial for_mkfs: 0 2024-09-14T11:32:47.379 INFO:tasks.workunit.client.0.smithi071.stderr: -291> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 10 monclient: monmap: 2024-09-14T11:32:47.379 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:32:47.379 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:47.379 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:32:47.379 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:32:47.379 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:47.379 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:47.379 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:32:47.380 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:32:47.380 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:32:47.380 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.380 INFO:tasks.workunit.client.0.smithi071.stderr: -290> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c0410) adding auth protocol: cephx 2024-09-14T11:32:47.380 INFO:tasks.workunit.client.0.smithi071.stderr: -289> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c0410) adding auth protocol: cephx 2024-09-14T11:32:47.380 INFO:tasks.workunit.client.0.smithi071.stderr: -288> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c0410) adding auth protocol: cephx 2024-09-14T11:32:47.380 INFO:tasks.workunit.client.0.smithi071.stderr: -287> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c0410) adding con mode: secure 2024-09-14T11:32:47.380 INFO:tasks.workunit.client.0.smithi071.stderr: -286> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c0410) adding con mode: crc 2024-09-14T11:32:47.380 INFO:tasks.workunit.client.0.smithi071.stderr: -285> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c0410) adding con mode: secure 2024-09-14T11:32:47.380 INFO:tasks.workunit.client.0.smithi071.stderr: -284> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c0410) adding con mode: crc 2024-09-14T11:32:47.380 INFO:tasks.workunit.client.0.smithi071.stderr: -283> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c0410) adding con mode: secure 2024-09-14T11:32:47.380 INFO:tasks.workunit.client.0.smithi071.stderr: -282> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c0410) adding con mode: crc 2024-09-14T11:32:47.380 INFO:tasks.workunit.client.0.smithi071.stderr: -281> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c0410) adding con mode: crc 2024-09-14T11:32:47.380 INFO:tasks.workunit.client.0.smithi071.stderr: -280> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c0410) adding con mode: secure 2024-09-14T11:32:47.380 INFO:tasks.workunit.client.0.smithi071.stderr: -279> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c0410) adding con mode: crc 2024-09-14T11:32:47.381 INFO:tasks.workunit.client.0.smithi071.stderr: -278> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c0410) adding con mode: secure 2024-09-14T11:32:47.381 INFO:tasks.workunit.client.0.smithi071.stderr: -277> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c0410) adding con mode: crc 2024-09-14T11:32:47.381 INFO:tasks.workunit.client.0.smithi071.stderr: -276> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c0410) adding con mode: secure 2024-09-14T11:32:47.381 INFO:tasks.workunit.client.0.smithi071.stderr: -275> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:47.381 INFO:tasks.workunit.client.0.smithi071.stderr: -274> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient: init 2024-09-14T11:32:47.381 INFO:tasks.workunit.client.0.smithi071.stderr: -273> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67330) adding auth protocol: cephx 2024-09-14T11:32:47.381 INFO:tasks.workunit.client.0.smithi071.stderr: -272> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67330) adding auth protocol: cephx 2024-09-14T11:32:47.381 INFO:tasks.workunit.client.0.smithi071.stderr: -271> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67330) adding auth protocol: cephx 2024-09-14T11:32:47.381 INFO:tasks.workunit.client.0.smithi071.stderr: -270> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67330) adding con mode: secure 2024-09-14T11:32:47.381 INFO:tasks.workunit.client.0.smithi071.stderr: -269> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67330) adding con mode: crc 2024-09-14T11:32:47.381 INFO:tasks.workunit.client.0.smithi071.stderr: -268> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67330) adding con mode: secure 2024-09-14T11:32:47.381 INFO:tasks.workunit.client.0.smithi071.stderr: -267> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67330) adding con mode: crc 2024-09-14T11:32:47.381 INFO:tasks.workunit.client.0.smithi071.stderr: -266> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67330) adding con mode: secure 2024-09-14T11:32:47.381 INFO:tasks.workunit.client.0.smithi071.stderr: -265> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67330) adding con mode: crc 2024-09-14T11:32:47.382 INFO:tasks.workunit.client.0.smithi071.stderr: -264> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67330) adding con mode: crc 2024-09-14T11:32:47.382 INFO:tasks.workunit.client.0.smithi071.stderr: -263> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67330) adding con mode: secure 2024-09-14T11:32:47.382 INFO:tasks.workunit.client.0.smithi071.stderr: -262> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67330) adding con mode: crc 2024-09-14T11:32:47.382 INFO:tasks.workunit.client.0.smithi071.stderr: -261> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67330) adding con mode: secure 2024-09-14T11:32:47.382 INFO:tasks.workunit.client.0.smithi071.stderr: -260> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67330) adding con mode: crc 2024-09-14T11:32:47.382 INFO:tasks.workunit.client.0.smithi071.stderr: -259> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67330) adding con mode: secure 2024-09-14T11:32:47.382 INFO:tasks.workunit.client.0.smithi071.stderr: -258> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:47.382 INFO:tasks.workunit.client.0.smithi071.stderr: -257> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:47.382 INFO:tasks.workunit.client.0.smithi071.stderr: -256> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 asok(0x55f589f14d90) register_command rotate-key cmddesc rotate-key hook 0x7ffc33f67478 EEXIST 2024-09-14T11:32:47.382 INFO:tasks.workunit.client.0.smithi071.stderr: -255> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:32:47.382 INFO:tasks.workunit.client.0.smithi071.stderr: -254> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:32:47.382 INFO:tasks.workunit.client.0.smithi071.stderr: -253> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient(hunting): picked mon.noname-c con 0x55f58a1eea20 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:32:47.382 INFO:tasks.workunit.client.0.smithi071.stderr: -252> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient(hunting): picked mon.noname-b con 0x55f58a1eee00 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:32:47.382 INFO:tasks.workunit.client.0.smithi071.stderr: -251> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient(hunting): picked mon.noname-a con 0x55f58a1f02c0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:32:47.382 INFO:tasks.workunit.client.0.smithi071.stderr: -250> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:47.382 INFO:tasks.workunit.client.0.smithi071.stderr: -249> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:47.383 INFO:tasks.workunit.client.0.smithi071.stderr: -248> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:47.383 INFO:tasks.workunit.client.0.smithi071.stderr: -247> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:32:47.383 INFO:tasks.workunit.client.0.smithi071.stderr: -246> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient(hunting): authenticate will time out at 2379.384845s 2024-09-14T11:32:47.383 INFO:tasks.workunit.client.0.smithi071.stderr: -245> 2024-09-14T11:32:47.265+0000 7f075a1d4640 10 monclient(hunting): get_auth_request con 0x55f58a1f02c0 auth_method 0 2024-09-14T11:32:47.383 INFO:tasks.workunit.client.0.smithi071.stderr: -244> 2024-09-14T11:32:47.265+0000 7f075a1d4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:47.383 INFO:tasks.workunit.client.0.smithi071.stderr: -243> 2024-09-14T11:32:47.265+0000 7f075a1d4640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:47.383 INFO:tasks.workunit.client.0.smithi071.stderr: -242> 2024-09-14T11:32:47.265+0000 7f075a1d4640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:47.383 INFO:tasks.workunit.client.0.smithi071.stderr: -241> 2024-09-14T11:32:47.265+0000 7f07599d3640 10 monclient(hunting): get_auth_request con 0x55f58a1eea20 auth_method 0 2024-09-14T11:32:47.383 INFO:tasks.workunit.client.0.smithi071.stderr: -240> 2024-09-14T11:32:47.265+0000 7f07599d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:47.383 INFO:tasks.workunit.client.0.smithi071.stderr: -239> 2024-09-14T11:32:47.265+0000 7f07599d3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:47.383 INFO:tasks.workunit.client.0.smithi071.stderr: -238> 2024-09-14T11:32:47.265+0000 7f07599d3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:47.383 INFO:tasks.workunit.client.0.smithi071.stderr: -237> 2024-09-14T11:32:47.265+0000 7f075a1d4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:47.383 INFO:tasks.workunit.client.0.smithi071.stderr: -236> 2024-09-14T11:32:47.265+0000 7f075a1d4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:47.383 INFO:tasks.workunit.client.0.smithi071.stderr: -235> 2024-09-14T11:32:47.265+0000 7f075a1d4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:47.383 INFO:tasks.workunit.client.0.smithi071.stderr: -234> 2024-09-14T11:32:47.265+0000 7f07599d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:47.384 INFO:tasks.workunit.client.0.smithi071.stderr: -233> 2024-09-14T11:32:47.265+0000 7f07599d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:47.384 INFO:tasks.workunit.client.0.smithi071.stderr: -232> 2024-09-14T11:32:47.265+0000 7f07599d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:47.384 INFO:tasks.workunit.client.0.smithi071.stderr: -231> 2024-09-14T11:32:47.265+0000 7f075a1d4640 10 monclient(hunting): handle_auth_done global_id 7683 payload 274 2024-09-14T11:32:47.384 INFO:tasks.workunit.client.0.smithi071.stderr: -230> 2024-09-14T11:32:47.265+0000 7f075a1d4640 10 monclient: _finish_hunting 0 2024-09-14T11:32:47.384 INFO:tasks.workunit.client.0.smithi071.stderr: -229> 2024-09-14T11:32:47.265+0000 7f075a1d4640 1 monclient: found mon.noname-a 2024-09-14T11:32:47.384 INFO:tasks.workunit.client.0.smithi071.stderr: -228> 2024-09-14T11:32:47.265+0000 7f075a1d4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:32:47.384 INFO:tasks.workunit.client.0.smithi071.stderr: -227> 2024-09-14T11:32:47.265+0000 7f063dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:47.384 INFO:tasks.workunit.client.0.smithi071.stderr: -226> 2024-09-14T11:32:47.265+0000 7f063dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:32:47.384 INFO:tasks.workunit.client.0.smithi071.stderr: -225> 2024-09-14T11:32:47.265+0000 7f063dffb640 10 monclient: dump: 2024-09-14T11:32:47.384 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:47.384 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:47.384 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.384 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.384 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:47.384 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:47.385 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:47.385 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:47.385 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:47.385 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.385 INFO:tasks.workunit.client.0.smithi071.stderr: -224> 2024-09-14T11:32:47.265+0000 7f063dffb640 10 monclient: _finish_auth 0 2024-09-14T11:32:47.385 INFO:tasks.workunit.client.0.smithi071.stderr: -223> 2024-09-14T11:32:47.265+0000 7f063dffb640 10 monclient: _check_auth_tickets 2024-09-14T11:32:47.385 INFO:tasks.workunit.client.0.smithi071.stderr: -222> 2024-09-14T11:32:47.265+0000 7f063dffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:47.385 INFO:tasks.workunit.client.0.smithi071.stderr: -221> 2024-09-14T11:32:47.265+0000 7f063dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:47.385 INFO:tasks.workunit.client.0.smithi071.stderr: -220> 2024-09-14T11:32:47.265+0000 7f063dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:32:47.385 INFO:tasks.workunit.client.0.smithi071.stderr: -219> 2024-09-14T11:32:47.265+0000 7f063dffb640 10 monclient: dump: 2024-09-14T11:32:47.385 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:47.385 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:47.385 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.385 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.386 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:47.386 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:47.386 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:47.386 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:47.386 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:47.386 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.386 INFO:tasks.workunit.client.0.smithi071.stderr: -218> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 monclient: authenticate success, global_id 7683 2024-09-14T11:32:47.386 INFO:tasks.workunit.client.0.smithi071.stderr: -217> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:32:47.386 INFO:tasks.workunit.client.0.smithi071.stderr: -216> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 4 set_mon_vals no callback set 2024-09-14T11:32:47.386 INFO:tasks.workunit.client.0.smithi071.stderr: -215> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient: shutdown 2024-09-14T11:32:47.386 INFO:tasks.workunit.client.0.smithi071.stderr: -214> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient: build_initial_monmap 2024-09-14T11:32:47.386 INFO:tasks.workunit.client.0.smithi071.stderr: -213> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 1 build_initial for_mkfs: 0 2024-09-14T11:32:47.386 INFO:tasks.workunit.client.0.smithi071.stderr: -212> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient: monmap: 2024-09-14T11:32:47.386 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:32:47.387 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:47.387 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:32:47.387 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:32:47.387 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:47.387 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:47.387 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:32:47.387 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:32:47.387 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:32:47.387 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.387 INFO:tasks.workunit.client.0.smithi071.stderr: -211> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c03c0) adding auth protocol: cephx 2024-09-14T11:32:47.387 INFO:tasks.workunit.client.0.smithi071.stderr: -210> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c03c0) adding auth protocol: cephx 2024-09-14T11:32:47.387 INFO:tasks.workunit.client.0.smithi071.stderr: -209> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c03c0) adding auth protocol: cephx 2024-09-14T11:32:47.387 INFO:tasks.workunit.client.0.smithi071.stderr: -208> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c03c0) adding con mode: secure 2024-09-14T11:32:47.387 INFO:tasks.workunit.client.0.smithi071.stderr: -207> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c03c0) adding con mode: crc 2024-09-14T11:32:47.387 INFO:tasks.workunit.client.0.smithi071.stderr: -206> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c03c0) adding con mode: secure 2024-09-14T11:32:47.388 INFO:tasks.workunit.client.0.smithi071.stderr: -205> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c03c0) adding con mode: crc 2024-09-14T11:32:47.388 INFO:tasks.workunit.client.0.smithi071.stderr: -204> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c03c0) adding con mode: secure 2024-09-14T11:32:47.388 INFO:tasks.workunit.client.0.smithi071.stderr: -203> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c03c0) adding con mode: crc 2024-09-14T11:32:47.388 INFO:tasks.workunit.client.0.smithi071.stderr: -202> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c03c0) adding con mode: crc 2024-09-14T11:32:47.388 INFO:tasks.workunit.client.0.smithi071.stderr: -201> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c03c0) adding con mode: secure 2024-09-14T11:32:47.388 INFO:tasks.workunit.client.0.smithi071.stderr: -200> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c03c0) adding con mode: crc 2024-09-14T11:32:47.388 INFO:tasks.workunit.client.0.smithi071.stderr: -199> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c03c0) adding con mode: secure 2024-09-14T11:32:47.388 INFO:tasks.workunit.client.0.smithi071.stderr: -198> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c03c0) adding con mode: crc 2024-09-14T11:32:47.388 INFO:tasks.workunit.client.0.smithi071.stderr: -197> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c03c0) adding con mode: secure 2024-09-14T11:32:47.388 INFO:tasks.workunit.client.0.smithi071.stderr: -196> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:47.388 INFO:tasks.workunit.client.0.smithi071.stderr: -195> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 1 librados: starting msgr at 2024-09-14T11:32:47.388 INFO:tasks.workunit.client.0.smithi071.stderr: -194> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 1 librados: starting objecter 2024-09-14T11:32:47.388 INFO:tasks.workunit.client.0.smithi071.stderr: -193> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 asok(0x55f589f14d90) register_command objecter_requests cmddesc objecter_requests hook 0x55f58a1eb0a0 EEXIST 2024-09-14T11:32:47.388 INFO:tasks.workunit.client.0.smithi071.stderr: -192> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 1 librados: setting wanted keys 2024-09-14T11:32:47.388 INFO:tasks.workunit.client.0.smithi071.stderr: -191> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 1 librados: calling monclient init 2024-09-14T11:32:47.389 INFO:tasks.workunit.client.0.smithi071.stderr: -190> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient: init 2024-09-14T11:32:47.389 INFO:tasks.workunit.client.0.smithi071.stderr: -189> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1a2d70) adding auth protocol: cephx 2024-09-14T11:32:47.389 INFO:tasks.workunit.client.0.smithi071.stderr: -188> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1a2d70) adding auth protocol: cephx 2024-09-14T11:32:47.389 INFO:tasks.workunit.client.0.smithi071.stderr: -187> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1a2d70) adding auth protocol: cephx 2024-09-14T11:32:47.389 INFO:tasks.workunit.client.0.smithi071.stderr: -186> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1a2d70) adding con mode: secure 2024-09-14T11:32:47.389 INFO:tasks.workunit.client.0.smithi071.stderr: -185> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1a2d70) adding con mode: crc 2024-09-14T11:32:47.389 INFO:tasks.workunit.client.0.smithi071.stderr: -184> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1a2d70) adding con mode: secure 2024-09-14T11:32:47.389 INFO:tasks.workunit.client.0.smithi071.stderr: -183> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1a2d70) adding con mode: crc 2024-09-14T11:32:47.389 INFO:tasks.workunit.client.0.smithi071.stderr: -182> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1a2d70) adding con mode: secure 2024-09-14T11:32:47.389 INFO:tasks.workunit.client.0.smithi071.stderr: -181> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1a2d70) adding con mode: crc 2024-09-14T11:32:47.389 INFO:tasks.workunit.client.0.smithi071.stderr: -180> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1a2d70) adding con mode: crc 2024-09-14T11:32:47.389 INFO:tasks.workunit.client.0.smithi071.stderr: -179> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1a2d70) adding con mode: secure 2024-09-14T11:32:47.389 INFO:tasks.workunit.client.0.smithi071.stderr: -178> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1a2d70) adding con mode: crc 2024-09-14T11:32:47.390 INFO:tasks.workunit.client.0.smithi071.stderr: -177> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1a2d70) adding con mode: secure 2024-09-14T11:32:47.390 INFO:tasks.workunit.client.0.smithi071.stderr: -176> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1a2d70) adding con mode: crc 2024-09-14T11:32:47.390 INFO:tasks.workunit.client.0.smithi071.stderr: -175> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1a2d70) adding con mode: secure 2024-09-14T11:32:47.390 INFO:tasks.workunit.client.0.smithi071.stderr: -174> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:47.390 INFO:tasks.workunit.client.0.smithi071.stderr: -173> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:47.390 INFO:tasks.workunit.client.0.smithi071.stderr: -172> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 asok(0x55f589f14d90) register_command rotate-key cmddesc rotate-key hook 0x55f58a1a2eb8 EEXIST 2024-09-14T11:32:47.390 INFO:tasks.workunit.client.0.smithi071.stderr: -171> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:32:47.390 INFO:tasks.workunit.client.0.smithi071.stderr: -170> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:32:47.390 INFO:tasks.workunit.client.0.smithi071.stderr: -169> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient(hunting): picked mon.noname-c con 0x55f58a1eea20 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:32:47.390 INFO:tasks.workunit.client.0.smithi071.stderr: -168> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient(hunting): picked mon.noname-a con 0x55f58a1f02c0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:32:47.390 INFO:tasks.workunit.client.0.smithi071.stderr: -167> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient(hunting): picked mon.noname-b con 0x55f58a1fa820 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:32:47.390 INFO:tasks.workunit.client.0.smithi071.stderr: -166> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:47.390 INFO:tasks.workunit.client.0.smithi071.stderr: -165> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:47.390 INFO:tasks.workunit.client.0.smithi071.stderr: -164> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:47.390 INFO:tasks.workunit.client.0.smithi071.stderr: -163> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:32:47.391 INFO:tasks.workunit.client.0.smithi071.stderr: -162> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient(hunting): authenticate will time out at 2379.387552s 2024-09-14T11:32:47.391 INFO:tasks.workunit.client.0.smithi071.stderr: -161> 2024-09-14T11:32:47.265+0000 7f07599d3640 10 monclient(hunting): get_auth_request con 0x55f58a1eea20 auth_method 0 2024-09-14T11:32:47.391 INFO:tasks.workunit.client.0.smithi071.stderr: -160> 2024-09-14T11:32:47.265+0000 7f07599d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:47.391 INFO:tasks.workunit.client.0.smithi071.stderr: -159> 2024-09-14T11:32:47.265+0000 7f07599d3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:47.391 INFO:tasks.workunit.client.0.smithi071.stderr: -158> 2024-09-14T11:32:47.265+0000 7f07599d3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:47.391 INFO:tasks.workunit.client.0.smithi071.stderr: -157> 2024-09-14T11:32:47.265+0000 7f075a9d5640 10 monclient(hunting): get_auth_request con 0x55f58a1f02c0 auth_method 0 2024-09-14T11:32:47.391 INFO:tasks.workunit.client.0.smithi071.stderr: -156> 2024-09-14T11:32:47.265+0000 7f075a9d5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:47.391 INFO:tasks.workunit.client.0.smithi071.stderr: -155> 2024-09-14T11:32:47.265+0000 7f075a9d5640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:47.391 INFO:tasks.workunit.client.0.smithi071.stderr: -154> 2024-09-14T11:32:47.265+0000 7f075a9d5640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:47.391 INFO:tasks.workunit.client.0.smithi071.stderr: -153> 2024-09-14T11:32:47.265+0000 7f07599d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:47.391 INFO:tasks.workunit.client.0.smithi071.stderr: -152> 2024-09-14T11:32:47.265+0000 7f07599d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:47.391 INFO:tasks.workunit.client.0.smithi071.stderr: -151> 2024-09-14T11:32:47.265+0000 7f07599d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:47.391 INFO:tasks.workunit.client.0.smithi071.stderr: -150> 2024-09-14T11:32:47.265+0000 7f075a9d5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:47.391 INFO:tasks.workunit.client.0.smithi071.stderr: -149> 2024-09-14T11:32:47.265+0000 7f075a9d5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:47.391 INFO:tasks.workunit.client.0.smithi071.stderr: -148> 2024-09-14T11:32:47.265+0000 7f075a9d5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:47.392 INFO:tasks.workunit.client.0.smithi071.stderr: -147> 2024-09-14T11:32:47.265+0000 7f07599d3640 10 monclient(hunting): handle_auth_done global_id 7283 payload 824 2024-09-14T11:32:47.392 INFO:tasks.workunit.client.0.smithi071.stderr: -146> 2024-09-14T11:32:47.265+0000 7f07599d3640 10 monclient: _finish_hunting 0 2024-09-14T11:32:47.392 INFO:tasks.workunit.client.0.smithi071.stderr: -145> 2024-09-14T11:32:47.269+0000 7f07599d3640 1 monclient: found mon.noname-c 2024-09-14T11:32:47.392 INFO:tasks.workunit.client.0.smithi071.stderr: -144> 2024-09-14T11:32:47.269+0000 7f07599d3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:32:47.392 INFO:tasks.workunit.client.0.smithi071.stderr: -143> 2024-09-14T11:32:47.269+0000 7f062bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:47.392 INFO:tasks.workunit.client.0.smithi071.stderr: -142> 2024-09-14T11:32:47.269+0000 7f062bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:32:47.392 INFO:tasks.workunit.client.0.smithi071.stderr: -141> 2024-09-14T11:32:47.269+0000 7f062bfff640 10 monclient: dump: 2024-09-14T11:32:47.392 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:47.392 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:47.392 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.392 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.392 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:47.392 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:47.392 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:47.392 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:47.393 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:47.393 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.393 INFO:tasks.workunit.client.0.smithi071.stderr: -140> 2024-09-14T11:32:47.269+0000 7f062bfff640 10 monclient: _finish_auth 0 2024-09-14T11:32:47.393 INFO:tasks.workunit.client.0.smithi071.stderr: -139> 2024-09-14T11:32:47.269+0000 7f062bfff640 10 monclient: _check_auth_tickets 2024-09-14T11:32:47.393 INFO:tasks.workunit.client.0.smithi071.stderr: -138> 2024-09-14T11:32:47.269+0000 7f062bfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:47.393 INFO:tasks.workunit.client.0.smithi071.stderr: -137> 2024-09-14T11:32:47.269+0000 7f062bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:47.393 INFO:tasks.workunit.client.0.smithi071.stderr: -136> 2024-09-14T11:32:47.269+0000 7f062bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:47.393 INFO:tasks.workunit.client.0.smithi071.stderr: -135> 2024-09-14T11:32:47.269+0000 7f062bfff640 10 monclient: dump: 2024-09-14T11:32:47.393 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:47.393 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:47.393 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.393 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.393 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:47.393 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:47.393 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:47.394 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:47.394 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:47.394 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.394 INFO:tasks.workunit.client.0.smithi071.stderr: -134> 2024-09-14T11:32:47.269+0000 7f063dffb640 4 set_mon_vals no callback set 2024-09-14T11:32:47.394 INFO:tasks.workunit.client.0.smithi071.stderr: -133> 2024-09-14T11:32:47.269+0000 7f075c6ce9c0 5 monclient: authenticate success, global_id 7283 2024-09-14T11:32:47.394 INFO:tasks.workunit.client.0.smithi071.stderr: -132> 2024-09-14T11:32:47.269+0000 7f075c6ce9c0 10 monclient: _renew_subs 2024-09-14T11:32:47.394 INFO:tasks.workunit.client.0.smithi071.stderr: -131> 2024-09-14T11:32:47.269+0000 7f075c6ce9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:32:47.394 INFO:tasks.workunit.client.0.smithi071.stderr: -130> 2024-09-14T11:32:47.269+0000 7f075c6ce9c0 10 monclient: _renew_subs 2024-09-14T11:32:47.394 INFO:tasks.workunit.client.0.smithi071.stderr: -129> 2024-09-14T11:32:47.269+0000 7f075c6ce9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:32:47.394 INFO:tasks.workunit.client.0.smithi071.stderr: -128> 2024-09-14T11:32:47.269+0000 7f075c6ce9c0 1 librados: init done 2024-09-14T11:32:47.394 INFO:tasks.workunit.client.0.smithi071.stderr: -127> 2024-09-14T11:32:47.269+0000 7f075c6ce9c0 5 asok(0x55f589f14d90) register_command cr dump hook 0x55f58a1fe0d8 2024-09-14T11:32:47.394 INFO:tasks.workunit.client.0.smithi071.stderr: -126> 2024-09-14T11:32:47.269+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.394 INFO:tasks.workunit.client.0.smithi071.stderr: -125> 2024-09-14T11:32:47.269+0000 7f062bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:47.394 INFO:tasks.workunit.client.0.smithi071.stderr: -124> 2024-09-14T11:32:47.269+0000 7f062bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:32:47.394 INFO:tasks.workunit.client.0.smithi071.stderr: -123> 2024-09-14T11:32:47.269+0000 7f062bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:32:47.394 INFO:tasks.workunit.client.0.smithi071.stderr: -122> 2024-09-14T11:32:47.269+0000 7f075a9d5640 10 monclient: get_auth_request con 0x7f06240718a0 auth_method 0 2024-09-14T11:32:47.395 INFO:tasks.workunit.client.0.smithi071.stderr: -121> 2024-09-14T11:32:47.269+0000 7f075a1d4640 10 monclient: get_auth_request con 0x55f58a20e0e0 auth_method 0 2024-09-14T11:32:47.395 INFO:tasks.workunit.client.0.smithi071.stderr: -120> 2024-09-14T11:32:47.273+0000 7f075c6ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.395 INFO:tasks.workunit.client.0.smithi071.stderr: -119> 2024-09-14T11:32:47.273+0000 7f075c6ce9c0 20 realm 2024-09-14T11:32:47.395 INFO:tasks.workunit.client.0.smithi071.stderr: -118> 2024-09-14T11:32:47.273+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.395 INFO:tasks.workunit.client.0.smithi071.stderr: -117> 2024-09-14T11:32:47.273+0000 7f075c6ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.395 INFO:tasks.workunit.client.0.smithi071.stderr: -116> 2024-09-14T11:32:47.273+0000 7f075c6ce9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:47.395 INFO:tasks.workunit.client.0.smithi071.stderr: -115> 2024-09-14T11:32:47.273+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.395 INFO:tasks.workunit.client.0.smithi071.stderr: -114> 2024-09-14T11:32:47.273+0000 7f075c6ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.395 INFO:tasks.workunit.client.0.smithi071.stderr: -113> 2024-09-14T11:32:47.273+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.395 INFO:tasks.workunit.client.0.smithi071.stderr: -112> 2024-09-14T11:32:47.273+0000 7f07599d3640 10 monclient: get_auth_request con 0x55f58a2122e0 auth_method 0 2024-09-14T11:32:47.395 INFO:tasks.workunit.client.0.smithi071.stderr: -111> 2024-09-14T11:32:47.273+0000 7f075c6ce9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:47.395 INFO:tasks.workunit.client.0.smithi071.stderr: -110> 2024-09-14T11:32:47.273+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.395 INFO:tasks.workunit.client.0.smithi071.stderr: -109> 2024-09-14T11:32:47.273+0000 7f075a9d5640 10 monclient: get_auth_request con 0x55f58a215b40 auth_method 0 2024-09-14T11:32:47.395 INFO:tasks.workunit.client.0.smithi071.stderr: -108> 2024-09-14T11:32:47.273+0000 7f075c6ce9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:47.396 INFO:tasks.workunit.client.0.smithi071.stderr: -107> 2024-09-14T11:32:47.273+0000 7f075c6ce9c0 20 searching for the correct realm 2024-09-14T11:32:47.396 INFO:tasks.workunit.client.0.smithi071.stderr: -106> 2024-09-14T11:32:47.273+0000 7f075a1d4640 10 monclient: get_auth_request con 0x55f58a21a900 auth_method 0 2024-09-14T11:32:47.396 INFO:tasks.workunit.client.0.smithi071.stderr: -105> 2024-09-14T11:32:47.277+0000 7f07599d3640 10 monclient: get_auth_request con 0x7f074c12d940 auth_method 0 2024-09-14T11:32:47.396 INFO:tasks.workunit.client.0.smithi071.stderr: -104> 2024-09-14T11:32:47.277+0000 7f075a9d5640 10 monclient: get_auth_request con 0x7f0750073430 auth_method 0 2024-09-14T11:32:47.396 INFO:tasks.workunit.client.0.smithi071.stderr: -103> 2024-09-14T11:32:47.277+0000 7f075a9d5640 0 -- 172.21.15.71:0/262669837 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f0750073430 msgr2=0x7f0750028030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:47.396 INFO:tasks.workunit.client.0.smithi071.stderr: -102> 2024-09-14T11:32:47.277+0000 7f062bfff640 1 client.7283.objecter ms_handle_reset 0x7f0750073430 session 0x7f0750073910 osd.0 2024-09-14T11:32:47.396 INFO:tasks.workunit.client.0.smithi071.stderr: -101> 2024-09-14T11:32:47.277+0000 7f062bfff640 10 monclient: _renew_subs 2024-09-14T11:32:47.396 INFO:tasks.workunit.client.0.smithi071.stderr: -100> 2024-09-14T11:32:47.277+0000 7f062bfff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:32:47.396 INFO:tasks.workunit.client.0.smithi071.stderr: -99> 2024-09-14T11:32:47.277+0000 7f075a9d5640 10 monclient: get_auth_request con 0x7f06240813c0 auth_method 0 2024-09-14T11:32:47.396 INFO:tasks.workunit.client.0.smithi071.stderr: -98> 2024-09-14T11:32:47.281+0000 7f075a1d4640 10 monclient: get_auth_request con 0x7f074c100ee0 auth_method 0 2024-09-14T11:32:47.396 INFO:tasks.workunit.client.0.smithi071.stderr: -97> 2024-09-14T11:32:47.281+0000 7f07599d3640 10 monclient: get_auth_request con 0x7f075006fba0 auth_method 0 2024-09-14T11:32:47.396 INFO:tasks.workunit.client.0.smithi071.stderr: -96> 2024-09-14T11:32:47.285+0000 7f075a9d5640 0 -- 172.21.15.71:0/262669837 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55f58a215b40 msgr2=0x55f58a217f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:47.396 INFO:tasks.workunit.client.0.smithi071.stderr: -95> 2024-09-14T11:32:47.285+0000 7f062bfff640 1 client.7283.objecter ms_handle_reset 0x55f58a215b40 session 0x55f58a211670 osd.3 2024-09-14T11:32:47.396 INFO:tasks.workunit.client.0.smithi071.stderr: -94> 2024-09-14T11:32:47.285+0000 7f075a9d5640 10 monclient: get_auth_request con 0x7f0750073430 auth_method 0 2024-09-14T11:32:47.397 INFO:tasks.workunit.client.0.smithi071.stderr: -93> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:47.397 INFO:tasks.workunit.client.0.smithi071.stderr: -92> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:32:47.397 INFO:tasks.workunit.client.0.smithi071.stderr: -91> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:47.397 INFO:tasks.workunit.client.0.smithi071.stderr: -90> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:32:47.397 INFO:tasks.workunit.client.0.smithi071.stderr: -89> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:47.397 INFO:tasks.workunit.client.0.smithi071.stderr: -88> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:47.397 INFO:tasks.workunit.client.0.smithi071.stderr: -87> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.397 INFO:tasks.workunit.client.0.smithi071.stderr: -86> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.397 INFO:tasks.workunit.client.0.smithi071.stderr: -85> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.397 INFO:tasks.workunit.client.0.smithi071.stderr: -84> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:47.397 INFO:tasks.workunit.client.0.smithi071.stderr: -83> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.397 INFO:tasks.workunit.client.0.smithi071.stderr: -82> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:47.397 INFO:tasks.workunit.client.0.smithi071.stderr: -81> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 zone default found 2024-09-14T11:32:47.397 INFO:tasks.workunit.client.0.smithi071.stderr: -80> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 4 Realm: () 2024-09-14T11:32:47.397 INFO:tasks.workunit.client.0.smithi071.stderr: -79> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:32:47.398 INFO:tasks.workunit.client.0.smithi071.stderr: -78> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:32:47.398 INFO:tasks.workunit.client.0.smithi071.stderr: -77> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:47.398 INFO:tasks.workunit.client.0.smithi071.stderr: -76> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 zonegroup default 2024-09-14T11:32:47.398 INFO:tasks.workunit.client.0.smithi071.stderr: -75> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.398 INFO:tasks.workunit.client.0.smithi071.stderr: -74> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.398 INFO:tasks.workunit.client.0.smithi071.stderr: -73> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.398 INFO:tasks.workunit.client.0.smithi071.stderr: -72> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.398 INFO:tasks.workunit.client.0.smithi071.stderr: -71> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.398 INFO:tasks.workunit.client.0.smithi071.stderr: -70> 2024-09-14T11:32:47.297+0000 7f075c6ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.398 INFO:tasks.workunit.client.0.smithi071.stderr: -69> 2024-09-14T11:32:47.297+0000 7f075c6ce9c0 20 started sync module instance, tier type = 2024-09-14T11:32:47.398 INFO:tasks.workunit.client.0.smithi071.stderr: -68> 2024-09-14T11:32:47.297+0000 7f075c6ce9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:32:47.398 INFO:tasks.workunit.client.0.smithi071.stderr: -67> 2024-09-14T11:32:47.313+0000 7f075c6ce9c0 20 add_watcher() i=0 2024-09-14T11:32:47.398 INFO:tasks.workunit.client.0.smithi071.stderr: -66> 2024-09-14T11:32:47.313+0000 7f075c6ce9c0 20 add_watcher() i=1 2024-09-14T11:32:47.398 INFO:tasks.workunit.client.0.smithi071.stderr: -65> 2024-09-14T11:32:47.313+0000 7f075c6ce9c0 20 add_watcher() i=2 2024-09-14T11:32:47.398 INFO:tasks.workunit.client.0.smithi071.stderr: -64> 2024-09-14T11:32:47.313+0000 7f075c6ce9c0 20 add_watcher() i=3 2024-09-14T11:32:47.398 INFO:tasks.workunit.client.0.smithi071.stderr: -63> 2024-09-14T11:32:47.313+0000 7f075c6ce9c0 20 add_watcher() i=4 2024-09-14T11:32:47.399 INFO:tasks.workunit.client.0.smithi071.stderr: -62> 2024-09-14T11:32:47.313+0000 7f075c6ce9c0 20 add_watcher() i=5 2024-09-14T11:32:47.399 INFO:tasks.workunit.client.0.smithi071.stderr: -61> 2024-09-14T11:32:47.313+0000 7f075c6ce9c0 20 add_watcher() i=6 2024-09-14T11:32:47.399 INFO:tasks.workunit.client.0.smithi071.stderr: -60> 2024-09-14T11:32:47.317+0000 7f075c6ce9c0 20 add_watcher() i=7 2024-09-14T11:32:47.399 INFO:tasks.workunit.client.0.smithi071.stderr: -59> 2024-09-14T11:32:47.317+0000 7f075c6ce9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:47.399 INFO:tasks.workunit.client.0.smithi071.stderr: -58> 2024-09-14T11:32:47.317+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67810) adding auth protocol: cephx 2024-09-14T11:32:47.399 INFO:tasks.workunit.client.0.smithi071.stderr: -57> 2024-09-14T11:32:47.317+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67810) adding auth protocol: cephx 2024-09-14T11:32:47.399 INFO:tasks.workunit.client.0.smithi071.stderr: -56> 2024-09-14T11:32:47.317+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67810) adding auth protocol: cephx 2024-09-14T11:32:47.399 INFO:tasks.workunit.client.0.smithi071.stderr: -55> 2024-09-14T11:32:47.317+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67810) adding con mode: secure 2024-09-14T11:32:47.399 INFO:tasks.workunit.client.0.smithi071.stderr: -54> 2024-09-14T11:32:47.317+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67810) adding con mode: crc 2024-09-14T11:32:47.399 INFO:tasks.workunit.client.0.smithi071.stderr: -53> 2024-09-14T11:32:47.317+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67810) adding con mode: secure 2024-09-14T11:32:47.399 INFO:tasks.workunit.client.0.smithi071.stderr: -52> 2024-09-14T11:32:47.317+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67810) adding con mode: crc 2024-09-14T11:32:47.399 INFO:tasks.workunit.client.0.smithi071.stderr: -51> 2024-09-14T11:32:47.317+0000 7f0610fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:47.399 INFO:tasks.workunit.client.0.smithi071.stderr: -50> 2024-09-14T11:32:47.317+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67810) adding con mode: secure 2024-09-14T11:32:47.399 INFO:tasks.workunit.client.0.smithi071.stderr: -49> 2024-09-14T11:32:47.317+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67810) adding con mode: crc 2024-09-14T11:32:47.399 INFO:tasks.workunit.client.0.smithi071.stderr: -48> 2024-09-14T11:32:47.317+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67810) adding con mode: crc 2024-09-14T11:32:47.400 INFO:tasks.workunit.client.0.smithi071.stderr: -47> 2024-09-14T11:32:47.317+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67810) adding con mode: secure 2024-09-14T11:32:47.400 INFO:tasks.workunit.client.0.smithi071.stderr: -46> 2024-09-14T11:32:47.317+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67810) adding con mode: crc 2024-09-14T11:32:47.400 INFO:tasks.workunit.client.0.smithi071.stderr: -45> 2024-09-14T11:32:47.317+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67810) adding con mode: secure 2024-09-14T11:32:47.400 INFO:tasks.workunit.client.0.smithi071.stderr: -44> 2024-09-14T11:32:47.317+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67810) adding con mode: crc 2024-09-14T11:32:47.400 INFO:tasks.workunit.client.0.smithi071.stderr: -43> 2024-09-14T11:32:47.317+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67810) adding con mode: secure 2024-09-14T11:32:47.400 INFO:tasks.workunit.client.0.smithi071.stderr: -42> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:47.400 INFO:tasks.workunit.client.0.smithi071.stderr: -41> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:47.400 INFO:tasks.workunit.client.0.smithi071.stderr: -40> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:47.400 INFO:tasks.workunit.client.0.smithi071.stderr: -39> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 5 asok(0x55f589f14d90) register_command cache list hook 0x55f58a1ecb00 2024-09-14T11:32:47.400 INFO:tasks.workunit.client.0.smithi071.stderr: -38> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 5 asok(0x55f589f14d90) register_command cache inspect hook 0x55f58a1ecb00 2024-09-14T11:32:47.400 INFO:tasks.workunit.client.0.smithi071.stderr: -37> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 5 asok(0x55f589f14d90) register_command cache erase hook 0x55f58a1ecb00 2024-09-14T11:32:47.400 INFO:tasks.workunit.client.0.smithi071.stderr: -36> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 5 asok(0x55f589f14d90) register_command cache zap hook 0x55f58a1ecb00 2024-09-14T11:32:47.400 INFO:tasks.workunit.client.0.smithi071.stderr: -35> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 5 note: GC not initialized 2024-09-14T11:32:47.400 INFO:tasks.workunit.client.0.smithi071.stderr: -34> 2024-09-14T11:32:47.321+0000 7f058b7fe640 20 reqs_thread_entry: start 2024-09-14T11:32:47.400 INFO:tasks.workunit.client.0.smithi071.stderr: -33> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 5 asok(0x55f589f14d90) register_command sync trace show hook 0x7f074c0fc070 2024-09-14T11:32:47.401 INFO:tasks.workunit.client.0.smithi071.stderr: -32> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 5 asok(0x55f589f14d90) register_command sync trace history hook 0x7f074c0fc070 2024-09-14T11:32:47.401 INFO:tasks.workunit.client.0.smithi071.stderr: -31> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 5 asok(0x55f589f14d90) register_command sync trace active hook 0x7f074c0fc070 2024-09-14T11:32:47.401 INFO:tasks.workunit.client.0.smithi071.stderr: -30> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 5 asok(0x55f589f14d90) register_command sync trace active_short hook 0x7f074c0fc070 2024-09-14T11:32:47.401 INFO:tasks.workunit.client.0.smithi071.stderr: -29> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:32:47.401 INFO:tasks.workunit.client.0.smithi071.stderr: -28> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 20 Filter name: none 2024-09-14T11:32:47.401 INFO:tasks.workunit.client.0.smithi071.stderr: -27> 2024-09-14T11:32:47.321+0000 7f05897fa640 20 reqs_thread_entry: start 2024-09-14T11:32:47.401 INFO:tasks.workunit.client.0.smithi071.stderr: -26> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:32:47.401 INFO:tasks.workunit.client.0.smithi071.stderr: -25> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.401 INFO:tasks.workunit.client.0.smithi071.stderr: -24> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:32:47.401 INFO:tasks.workunit.client.0.smithi071.stderr: -23> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:32:47.401 INFO:tasks.workunit.client.0.smithi071.stderr: -22> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:32:47.401 INFO:tasks.workunit.client.0.smithi071.stderr: -21> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 : miss 2024-09-14T11:32:47.401 INFO:tasks.workunit.client.0.smithi071.stderr: -20> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.402 INFO:tasks.workunit.client.0.smithi071.stderr: -19> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:32:47.402 INFO:tasks.workunit.client.0.smithi071.stderr: -18> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 info.flags=0x17 2024-09-14T11:32:47.402 INFO:tasks.workunit.client.0.smithi071.stderr: -17> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 to cache LRU end 2024-09-14T11:32:47.402 INFO:tasks.workunit.client.0.smithi071.stderr: -16> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:47.402 INFO:tasks.workunit.client.0.smithi071.stderr: -15> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:47.402 INFO:tasks.workunit.client.0.smithi071.stderr: -14> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 2024-09-14T11:32:47.402 INFO:tasks.workunit.client.0.smithi071.stderr: -13> 2024-09-14T11:32:47.333+0000 7f075c6ce9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 info.flags=0x17 2024-09-14T11:32:47.402 INFO:tasks.workunit.client.0.smithi071.stderr: -12> 2024-09-14T11:32:47.333+0000 7f075c6ce9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 to cache LRU end 2024-09-14T11:32:47.402 INFO:tasks.workunit.client.0.smithi071.stderr: -11> 2024-09-14T11:32:47.333+0000 7f075c6ce9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:47.402 INFO:tasks.workunit.client.0.smithi071.stderr: -10> 2024-09-14T11:32:47.333+0000 7f075c6ce9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37, ofs0, ns] 2024-09-14T11:32:47.402 INFO:tasks.workunit.client.0.smithi071.stderr: -9> 2024-09-14T11:32:47.333+0000 7f063d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464280 cookie 94513072826384 notifier 7283 bl.length()=1007 2024-09-14T11:32:47.402 INFO:tasks.workunit.client.0.smithi071.stderr: -8> 2024-09-14T11:32:47.333+0000 7f063d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 info.flags=0x17 2024-09-14T11:32:47.402 INFO:tasks.workunit.client.0.smithi071.stderr: -7> 2024-09-14T11:32:47.333+0000 7f063d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 to cache LRU end 2024-09-14T11:32:47.402 INFO:tasks.workunit.client.0.smithi071.stderr: -6> 2024-09-14T11:32:47.333+0000 7f063d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:47.402 INFO:tasks.workunit.client.0.smithi071.stderr: -5> 2024-09-14T11:32:47.333+0000 7f075c6ce9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.37]): orig_sources= new_sources= 2024-09-14T11:32:47.403 INFO:tasks.workunit.client.0.smithi071.stderr: -4> 2024-09-14T11:32:47.333+0000 7f075c6ce9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.37]): potential sources added=[] removed=[] 2024-09-14T11:32:47.403 INFO:tasks.workunit.client.0.smithi071.stderr: -3> 2024-09-14T11:32:47.333+0000 7f075c6ce9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.37]): orig_dests= new_dests= 2024-09-14T11:32:47.403 INFO:tasks.workunit.client.0.smithi071.stderr: -2> 2024-09-14T11:32:47.333+0000 7f075c6ce9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.37]): potential dests added=[] removed=[] 2024-09-14T11:32:47.403 INFO:tasks.workunit.client.0.smithi071.stderr: -1> 2024-09-14T11:32:47.341+0000 7f075c6ce9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f075c6ce9c0 time 2024-09-14T11:32:47.343438+0000 2024-09-14T11:32:47.403 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:32:47.403 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.403 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:47.403 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f075ffa82eb] 2024-09-14T11:32:47.403 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f075ffa849f] 2024-09-14T11:32:47.403 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f587055c01] 2024-09-14T11:32:47.403 INFO:tasks.workunit.client.0.smithi071.stderr: 4: radosgw-admin(+0x142325c) [0x55f587ab425c] 2024-09-14T11:32:47.403 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f58706aecd] 2024-09-14T11:32:47.403 INFO:tasks.workunit.client.0.smithi071.stderr: 6: main() 2024-09-14T11:32:47.403 INFO:tasks.workunit.client.0.smithi071.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f075ee0ed90] 2024-09-14T11:32:47.403 INFO:tasks.workunit.client.0.smithi071.stderr: 8: __libc_start_main() 2024-09-14T11:32:47.404 INFO:tasks.workunit.client.0.smithi071.stderr: 9: _start() 2024-09-14T11:32:47.404 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.404 INFO:tasks.workunit.client.0.smithi071.stderr: 0> 2024-09-14T11:32:47.341+0000 7f075c6ce9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:32:47.404 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f075c6ce9c0 thread_name:radosgw-admin 2024-09-14T11:32:47.404 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.404 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:47.404 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f075ee27520] 2024-09-14T11:32:47.404 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:32:47.404 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:32:47.404 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:32:47.404 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f075ffa8345] 2024-09-14T11:32:47.404 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f075ffa849f] 2024-09-14T11:32:47.404 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f587055c01] 2024-09-14T11:32:47.404 INFO:tasks.workunit.client.0.smithi071.stderr: 8: radosgw-admin(+0x142325c) [0x55f587ab425c] 2024-09-14T11:32:47.405 INFO:tasks.workunit.client.0.smithi071.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f58706aecd] 2024-09-14T11:32:47.405 INFO:tasks.workunit.client.0.smithi071.stderr: 10: main() 2024-09-14T11:32:47.405 INFO:tasks.workunit.client.0.smithi071.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f075ee0ed90] 2024-09-14T11:32:47.405 INFO:tasks.workunit.client.0.smithi071.stderr: 12: __libc_start_main() 2024-09-14T11:32:47.405 INFO:tasks.workunit.client.0.smithi071.stderr: 13: _start() 2024-09-14T11:32:47.405 INFO:tasks.workunit.client.0.smithi071.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:32:47.405 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.405 INFO:tasks.workunit.client.0.smithi071.stderr:--- logging levels --- 2024-09-14T11:32:47.405 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 none 2024-09-14T11:32:47.405 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 lockdep 2024-09-14T11:32:47.405 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 context 2024-09-14T11:32:47.405 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 crush 2024-09-14T11:32:47.405 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds 2024-09-14T11:32:47.406 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_balancer 2024-09-14T11:32:47.406 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_locker 2024-09-14T11:32:47.406 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log 2024-09-14T11:32:47.406 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log_expire 2024-09-14T11:32:47.406 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_migrator 2024-09-14T11:32:47.406 INFO:tasks.workunit.client.0.smithi071.stderr: 3/ 5 mds_quiesce 2024-09-14T11:32:47.406 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 buffer 2024-09-14T11:32:47.406 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 timer 2024-09-14T11:32:47.406 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 filer 2024-09-14T11:32:47.406 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 striper 2024-09-14T11:32:47.406 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 objecter 2024-09-14T11:32:47.406 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rados 2024-09-14T11:32:47.406 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd 2024-09-14T11:32:47.406 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_mirror 2024-09-14T11:32:47.407 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_replay 2024-09-14T11:32:47.407 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_pwl 2024-09-14T11:32:47.407 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 journaler 2024-09-14T11:32:47.407 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objectcacher 2024-09-14T11:32:47.407 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:32:47.407 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 client 2024-09-14T11:32:47.407 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 osd 2024-09-14T11:32:47.407 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 optracker 2024-09-14T11:32:47.407 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objclass 2024-09-14T11:32:47.407 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 filestore 2024-09-14T11:32:47.407 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 journal 2024-09-14T11:32:47.407 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 ms 2024-09-14T11:32:47.407 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mon 2024-09-14T11:32:47.407 INFO:tasks.workunit.client.0.smithi071.stderr: 0/10 monc 2024-09-14T11:32:47.407 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 paxos 2024-09-14T11:32:47.408 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 tp 2024-09-14T11:32:47.408 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 auth 2024-09-14T11:32:47.408 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 crypto 2024-09-14T11:32:47.408 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 finisher 2024-09-14T11:32:47.408 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 reserver 2024-09-14T11:32:47.408 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 heartbeatmap 2024-09-14T11:32:47.408 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 perfcounter 2024-09-14T11:32:47.408 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw 2024-09-14T11:32:47.408 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_sync 2024-09-14T11:32:47.408 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_datacache 2024-09-14T11:32:47.408 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_access 2024-09-14T11:32:47.408 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:32:47.408 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_flight 2024-09-14T11:32:47.408 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:32:47.409 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw_notification 2024-09-14T11:32:47.409 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 javaclient 2024-09-14T11:32:47.409 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 asok 2024-09-14T11:32:47.409 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 throttle 2024-09-14T11:32:47.409 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 refs 2024-09-14T11:32:47.409 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 compressor 2024-09-14T11:32:47.409 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluestore 2024-09-14T11:32:47.409 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluefs 2024-09-14T11:32:47.409 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 bdev 2024-09-14T11:32:47.409 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 kstore 2024-09-14T11:32:47.409 INFO:tasks.workunit.client.0.smithi071.stderr: 4/ 5 rocksdb 2024-09-14T11:32:47.409 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 fuse 2024-09-14T11:32:47.409 INFO:tasks.workunit.client.0.smithi071.stderr: 2/ 5 mgr 2024-09-14T11:32:47.409 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mgrc 2024-09-14T11:32:47.409 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 dpdk 2024-09-14T11:32:47.409 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 eventtrace 2024-09-14T11:32:47.410 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 prioritycache 2024-09-14T11:32:47.410 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 test 2024-09-14T11:32:47.410 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:32:47.410 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephsqlite 2024-09-14T11:32:47.410 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:32:47.410 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore 2024-09-14T11:32:47.410 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_onode 2024-09-14T11:32:47.410 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_odata 2024-09-14T11:32:47.410 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_omap 2024-09-14T11:32:47.410 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_tm 2024-09-14T11:32:47.410 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_t 2024-09-14T11:32:47.410 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:32:47.410 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_epm 2024-09-14T11:32:47.410 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_lba 2024-09-14T11:32:47.410 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:32:47.411 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cache 2024-09-14T11:32:47.411 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_journal 2024-09-14T11:32:47.411 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_device 2024-09-14T11:32:47.411 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_backref 2024-09-14T11:32:47.411 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 alienstore 2024-09-14T11:32:47.411 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mclock 2024-09-14T11:32:47.411 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cyanstore 2024-09-14T11:32:47.411 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 ceph_exporter 2024-09-14T11:32:47.411 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 memstore 2024-09-14T11:32:47.411 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 trace 2024-09-14T11:32:47.411 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 ceph_dedup 2024-09-14T11:32:47.411 INFO:tasks.workunit.client.0.smithi071.stderr: -2/-2 (syslog threshold) 2024-09-14T11:32:47.411 INFO:tasks.workunit.client.0.smithi071.stderr: 99/99 (stderr threshold) 2024-09-14T11:32:47.411 INFO:tasks.workunit.client.0.smithi071.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:32:47.411 INFO:tasks.workunit.client.0.smithi071.stderr: 7f05897fa640 / http_manager 2024-09-14T11:32:47.412 INFO:tasks.workunit.client.0.smithi071.stderr: 7f058b7fe640 / http_manager 2024-09-14T11:32:47.412 INFO:tasks.workunit.client.0.smithi071.stderr: 7f0610fe1640 / rgw_dt_lg_renew 2024-09-14T11:32:47.412 INFO:tasks.workunit.client.0.smithi071.stderr: 7f062bfff640 / ms_dispatch 2024-09-14T11:32:47.412 INFO:tasks.workunit.client.0.smithi071.stderr: 7f063d7fa640 / io_context_pool 2024-09-14T11:32:47.412 INFO:tasks.workunit.client.0.smithi071.stderr: 7f063dffb640 / io_context_pool 2024-09-14T11:32:47.412 INFO:tasks.workunit.client.0.smithi071.stderr: 7f063ffff640 / ms_dispatch 2024-09-14T11:32:47.412 INFO:tasks.workunit.client.0.smithi071.stderr: 7f0646e05640 / ms_dispatch 2024-09-14T11:32:47.412 INFO:tasks.workunit.client.0.smithi071.stderr: 7f0648608640 / io_context_pool 2024-09-14T11:32:47.412 INFO:tasks.workunit.client.0.smithi071.stderr: 7f07599d3640 / msgr-worker-2 2024-09-14T11:32:47.412 INFO:tasks.workunit.client.0.smithi071.stderr: 7f075a1d4640 / msgr-worker-1 2024-09-14T11:32:47.412 INFO:tasks.workunit.client.0.smithi071.stderr: 7f075a9d5640 / msgr-worker-0 2024-09-14T11:32:47.412 INFO:tasks.workunit.client.0.smithi071.stderr: 7f075b1d6640 / io_context_pool 2024-09-14T11:32:47.412 INFO:tasks.workunit.client.0.smithi071.stderr: 7f075c6ce9c0 / radosgw-admin 2024-09-14T11:32:47.412 INFO:tasks.workunit.client.0.smithi071.stderr: max_recent 500 2024-09-14T11:32:47.412 INFO:tasks.workunit.client.0.smithi071.stderr: max_new 1000 2024-09-14T11:32:47.413 INFO:tasks.workunit.client.0.smithi071.stderr: log_file /var/log/ceph/ceph-client.admin.125586.log 2024-09-14T11:32:47.413 INFO:tasks.workunit.client.0.smithi071.stderr:--- end dump of recent events --- 2024-09-14T11:32:47.413 INFO:tasks.workunit.client.0.smithi071.stderr:--- begin dump of recent events --- 2024-09-14T11:32:47.413 INFO:tasks.workunit.client.0.smithi071.stderr: -499> 2024-09-14T11:32:47.245+0000 7f075a9d5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:47.413 INFO:tasks.workunit.client.0.smithi071.stderr: -498> 2024-09-14T11:32:47.245+0000 7f075a9d5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:47.413 INFO:tasks.workunit.client.0.smithi071.stderr: -497> 2024-09-14T11:32:47.245+0000 7f07599d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:47.413 INFO:tasks.workunit.client.0.smithi071.stderr: -496> 2024-09-14T11:32:47.245+0000 7f07599d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:47.413 INFO:tasks.workunit.client.0.smithi071.stderr: -495> 2024-09-14T11:32:47.245+0000 7f07599d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:47.413 INFO:tasks.workunit.client.0.smithi071.stderr: -494> 2024-09-14T11:32:47.245+0000 7f07599d3640 10 monclient(hunting): handle_auth_done global_id 7271 payload 274 2024-09-14T11:32:47.413 INFO:tasks.workunit.client.0.smithi071.stderr: -493> 2024-09-14T11:32:47.245+0000 7f07599d3640 10 monclient: _finish_hunting 0 2024-09-14T11:32:47.413 INFO:tasks.workunit.client.0.smithi071.stderr: -492> 2024-09-14T11:32:47.245+0000 7f07599d3640 1 monclient: found mon.noname-c 2024-09-14T11:32:47.413 INFO:tasks.workunit.client.0.smithi071.stderr: -491> 2024-09-14T11:32:47.245+0000 7f07599d3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:32:47.413 INFO:tasks.workunit.client.0.smithi071.stderr: -490> 2024-09-14T11:32:47.245+0000 7f075a1d4640 10 monclient: get_auth_request con 0x55f589fadc20 auth_method 0 2024-09-14T11:32:47.413 INFO:tasks.workunit.client.0.smithi071.stderr: -489> 2024-09-14T11:32:47.245+0000 7f0648608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:47.413 INFO:tasks.workunit.client.0.smithi071.stderr: -488> 2024-09-14T11:32:47.245+0000 7f0648608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:32:47.414 INFO:tasks.workunit.client.0.smithi071.stderr: -487> 2024-09-14T11:32:47.245+0000 7f0648608640 10 monclient: dump: 2024-09-14T11:32:47.414 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:47.414 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:47.414 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.414 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.414 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:47.414 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:47.414 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:47.414 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:47.414 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:47.414 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.414 INFO:tasks.workunit.client.0.smithi071.stderr: -486> 2024-09-14T11:32:47.245+0000 7f0648608640 10 monclient: _finish_auth 0 2024-09-14T11:32:47.414 INFO:tasks.workunit.client.0.smithi071.stderr: -485> 2024-09-14T11:32:47.245+0000 7f0648608640 10 monclient: _check_auth_tickets 2024-09-14T11:32:47.414 INFO:tasks.workunit.client.0.smithi071.stderr: -484> 2024-09-14T11:32:47.245+0000 7f0648608640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:47.414 INFO:tasks.workunit.client.0.smithi071.stderr: -483> 2024-09-14T11:32:47.245+0000 7f0648608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:47.415 INFO:tasks.workunit.client.0.smithi071.stderr: -482> 2024-09-14T11:32:47.245+0000 7f0648608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:47.415 INFO:tasks.workunit.client.0.smithi071.stderr: -481> 2024-09-14T11:32:47.245+0000 7f0648608640 10 monclient: dump: 2024-09-14T11:32:47.415 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:47.415 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:47.415 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.415 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.415 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:47.415 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:47.415 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:47.415 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:47.415 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:47.415 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.415 INFO:tasks.workunit.client.0.smithi071.stderr: -480> 2024-09-14T11:32:47.245+0000 7f075c6ce9c0 5 monclient: authenticate success, global_id 7271 2024-09-14T11:32:47.415 INFO:tasks.workunit.client.0.smithi071.stderr: -479> 2024-09-14T11:32:47.245+0000 7f075c6ce9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:32:47.415 INFO:tasks.workunit.client.0.smithi071.stderr: -478> 2024-09-14T11:32:47.245+0000 7f075c6ce9c0 4 set_mon_vals no callback set 2024-09-14T11:32:47.416 INFO:tasks.workunit.client.0.smithi071.stderr: -477> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 10 monclient: shutdown 2024-09-14T11:32:47.416 INFO:tasks.workunit.client.0.smithi071.stderr: -476> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 asok(0x55f589f14d90) unregister_commands rotate-key 2024-09-14T11:32:47.416 INFO:tasks.workunit.client.0.smithi071.stderr: -475> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 10 monclient: build_initial_monmap 2024-09-14T11:32:47.416 INFO:tasks.workunit.client.0.smithi071.stderr: -474> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 1 build_initial for_mkfs: 0 2024-09-14T11:32:47.416 INFO:tasks.workunit.client.0.smithi071.stderr: -473> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 10 monclient: monmap: 2024-09-14T11:32:47.416 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:32:47.416 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:47.416 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:32:47.416 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:32:47.416 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:47.416 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:47.416 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:32:47.416 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:32:47.417 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:32:47.417 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.417 INFO:tasks.workunit.client.0.smithi071.stderr: -472> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1287a0) adding auth protocol: cephx 2024-09-14T11:32:47.417 INFO:tasks.workunit.client.0.smithi071.stderr: -471> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1287a0) adding auth protocol: cephx 2024-09-14T11:32:47.417 INFO:tasks.workunit.client.0.smithi071.stderr: -470> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1287a0) adding auth protocol: cephx 2024-09-14T11:32:47.417 INFO:tasks.workunit.client.0.smithi071.stderr: -469> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1287a0) adding con mode: secure 2024-09-14T11:32:47.417 INFO:tasks.workunit.client.0.smithi071.stderr: -468> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1287a0) adding con mode: crc 2024-09-14T11:32:47.417 INFO:tasks.workunit.client.0.smithi071.stderr: -467> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1287a0) adding con mode: secure 2024-09-14T11:32:47.417 INFO:tasks.workunit.client.0.smithi071.stderr: -466> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1287a0) adding con mode: crc 2024-09-14T11:32:47.417 INFO:tasks.workunit.client.0.smithi071.stderr: -465> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1287a0) adding con mode: secure 2024-09-14T11:32:47.417 INFO:tasks.workunit.client.0.smithi071.stderr: -464> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1287a0) adding con mode: crc 2024-09-14T11:32:47.417 INFO:tasks.workunit.client.0.smithi071.stderr: -463> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1287a0) adding con mode: crc 2024-09-14T11:32:47.417 INFO:tasks.workunit.client.0.smithi071.stderr: -462> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1287a0) adding con mode: secure 2024-09-14T11:32:47.417 INFO:tasks.workunit.client.0.smithi071.stderr: -461> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1287a0) adding con mode: crc 2024-09-14T11:32:47.417 INFO:tasks.workunit.client.0.smithi071.stderr: -460> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1287a0) adding con mode: secure 2024-09-14T11:32:47.418 INFO:tasks.workunit.client.0.smithi071.stderr: -459> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1287a0) adding con mode: crc 2024-09-14T11:32:47.418 INFO:tasks.workunit.client.0.smithi071.stderr: -458> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1287a0) adding con mode: secure 2024-09-14T11:32:47.418 INFO:tasks.workunit.client.0.smithi071.stderr: -457> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:47.418 INFO:tasks.workunit.client.0.smithi071.stderr: -456> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 1 librados: starting msgr at 2024-09-14T11:32:47.418 INFO:tasks.workunit.client.0.smithi071.stderr: -455> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 1 librados: starting objecter 2024-09-14T11:32:47.418 INFO:tasks.workunit.client.0.smithi071.stderr: -454> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 asok(0x55f589f14d90) register_command objecter_requests hook 0x55f58a127460 2024-09-14T11:32:47.418 INFO:tasks.workunit.client.0.smithi071.stderr: -453> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 1 librados: setting wanted keys 2024-09-14T11:32:47.418 INFO:tasks.workunit.client.0.smithi071.stderr: -452> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 1 librados: calling monclient init 2024-09-14T11:32:47.418 INFO:tasks.workunit.client.0.smithi071.stderr: -451> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 10 monclient: init 2024-09-14T11:32:47.418 INFO:tasks.workunit.client.0.smithi071.stderr: -450> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a122280) adding auth protocol: cephx 2024-09-14T11:32:47.418 INFO:tasks.workunit.client.0.smithi071.stderr: -449> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a122280) adding auth protocol: cephx 2024-09-14T11:32:47.418 INFO:tasks.workunit.client.0.smithi071.stderr: -448> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a122280) adding auth protocol: cephx 2024-09-14T11:32:47.418 INFO:tasks.workunit.client.0.smithi071.stderr: -447> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a122280) adding con mode: secure 2024-09-14T11:32:47.418 INFO:tasks.workunit.client.0.smithi071.stderr: -446> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a122280) adding con mode: crc 2024-09-14T11:32:47.418 INFO:tasks.workunit.client.0.smithi071.stderr: -445> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a122280) adding con mode: secure 2024-09-14T11:32:47.419 INFO:tasks.workunit.client.0.smithi071.stderr: -444> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a122280) adding con mode: crc 2024-09-14T11:32:47.419 INFO:tasks.workunit.client.0.smithi071.stderr: -443> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a122280) adding con mode: secure 2024-09-14T11:32:47.419 INFO:tasks.workunit.client.0.smithi071.stderr: -442> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a122280) adding con mode: crc 2024-09-14T11:32:47.419 INFO:tasks.workunit.client.0.smithi071.stderr: -441> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a122280) adding con mode: crc 2024-09-14T11:32:47.419 INFO:tasks.workunit.client.0.smithi071.stderr: -440> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a122280) adding con mode: secure 2024-09-14T11:32:47.419 INFO:tasks.workunit.client.0.smithi071.stderr: -439> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a122280) adding con mode: crc 2024-09-14T11:32:47.419 INFO:tasks.workunit.client.0.smithi071.stderr: -438> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a122280) adding con mode: secure 2024-09-14T11:32:47.419 INFO:tasks.workunit.client.0.smithi071.stderr: -437> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a122280) adding con mode: crc 2024-09-14T11:32:47.419 INFO:tasks.workunit.client.0.smithi071.stderr: -436> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a122280) adding con mode: secure 2024-09-14T11:32:47.419 INFO:tasks.workunit.client.0.smithi071.stderr: -435> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:47.419 INFO:tasks.workunit.client.0.smithi071.stderr: -434> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:47.419 INFO:tasks.workunit.client.0.smithi071.stderr: -433> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 asok(0x55f589f14d90) register_command rotate-key hook 0x55f58a1223c8 2024-09-14T11:32:47.419 INFO:tasks.workunit.client.0.smithi071.stderr: -432> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:32:47.419 INFO:tasks.workunit.client.0.smithi071.stderr: -431> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:32:47.420 INFO:tasks.workunit.client.0.smithi071.stderr: -430> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 10 monclient(hunting): picked mon.noname-c con 0x55f589fadc20 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:32:47.420 INFO:tasks.workunit.client.0.smithi071.stderr: -429> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 10 monclient(hunting): picked mon.noname-b con 0x55f58a067900 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:32:47.420 INFO:tasks.workunit.client.0.smithi071.stderr: -428> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 10 monclient(hunting): picked mon.noname-a con 0x55f58a06acb0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:32:47.420 INFO:tasks.workunit.client.0.smithi071.stderr: -427> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:47.420 INFO:tasks.workunit.client.0.smithi071.stderr: -426> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:47.420 INFO:tasks.workunit.client.0.smithi071.stderr: -425> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:47.420 INFO:tasks.workunit.client.0.smithi071.stderr: -424> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:32:47.420 INFO:tasks.workunit.client.0.smithi071.stderr: -423> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 10 monclient(hunting): authenticate will time out at 2379.370035s 2024-09-14T11:32:47.420 INFO:tasks.workunit.client.0.smithi071.stderr: -422> 2024-09-14T11:32:47.249+0000 7f075a1d4640 10 monclient(hunting): get_auth_request con 0x55f589fadc20 auth_method 0 2024-09-14T11:32:47.420 INFO:tasks.workunit.client.0.smithi071.stderr: -421> 2024-09-14T11:32:47.249+0000 7f075a1d4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:47.420 INFO:tasks.workunit.client.0.smithi071.stderr: -420> 2024-09-14T11:32:47.249+0000 7f075a1d4640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:47.420 INFO:tasks.workunit.client.0.smithi071.stderr: -419> 2024-09-14T11:32:47.249+0000 7f075a1d4640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:47.420 INFO:tasks.workunit.client.0.smithi071.stderr: -418> 2024-09-14T11:32:47.249+0000 7f075a9d5640 10 monclient(hunting): get_auth_request con 0x55f58a06acb0 auth_method 0 2024-09-14T11:32:47.420 INFO:tasks.workunit.client.0.smithi071.stderr: -417> 2024-09-14T11:32:47.249+0000 7f075a9d5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:47.421 INFO:tasks.workunit.client.0.smithi071.stderr: -416> 2024-09-14T11:32:47.249+0000 7f075a9d5640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:47.421 INFO:tasks.workunit.client.0.smithi071.stderr: -415> 2024-09-14T11:32:47.249+0000 7f075a9d5640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:47.421 INFO:tasks.workunit.client.0.smithi071.stderr: -414> 2024-09-14T11:32:47.249+0000 7f075a1d4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:47.421 INFO:tasks.workunit.client.0.smithi071.stderr: -413> 2024-09-14T11:32:47.249+0000 7f075a1d4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:47.421 INFO:tasks.workunit.client.0.smithi071.stderr: -412> 2024-09-14T11:32:47.249+0000 7f075a1d4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:47.421 INFO:tasks.workunit.client.0.smithi071.stderr: -411> 2024-09-14T11:32:47.249+0000 7f075a9d5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:47.421 INFO:tasks.workunit.client.0.smithi071.stderr: -410> 2024-09-14T11:32:47.249+0000 7f075a9d5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:47.421 INFO:tasks.workunit.client.0.smithi071.stderr: -409> 2024-09-14T11:32:47.249+0000 7f075a9d5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:47.421 INFO:tasks.workunit.client.0.smithi071.stderr: -408> 2024-09-14T11:32:47.249+0000 7f075a1d4640 10 monclient(hunting): handle_auth_done global_id 7274 payload 824 2024-09-14T11:32:47.421 INFO:tasks.workunit.client.0.smithi071.stderr: -407> 2024-09-14T11:32:47.249+0000 7f075a1d4640 10 monclient: _finish_hunting 0 2024-09-14T11:32:47.421 INFO:tasks.workunit.client.0.smithi071.stderr: -406> 2024-09-14T11:32:47.249+0000 7f075a1d4640 1 monclient: found mon.noname-c 2024-09-14T11:32:47.421 INFO:tasks.workunit.client.0.smithi071.stderr: -405> 2024-09-14T11:32:47.249+0000 7f075a1d4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:32:47.421 INFO:tasks.workunit.client.0.smithi071.stderr: -404> 2024-09-14T11:32:47.249+0000 7f0646e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:47.422 INFO:tasks.workunit.client.0.smithi071.stderr: -403> 2024-09-14T11:32:47.249+0000 7f0646e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:32:47.422 INFO:tasks.workunit.client.0.smithi071.stderr: -402> 2024-09-14T11:32:47.249+0000 7f0646e05640 10 monclient: dump: 2024-09-14T11:32:47.422 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:47.422 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:47.422 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.422 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.422 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:47.422 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:47.422 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:47.422 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:47.422 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:47.422 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.422 INFO:tasks.workunit.client.0.smithi071.stderr: -401> 2024-09-14T11:32:47.249+0000 7f0646e05640 10 monclient: _finish_auth 0 2024-09-14T11:32:47.422 INFO:tasks.workunit.client.0.smithi071.stderr: -400> 2024-09-14T11:32:47.249+0000 7f0646e05640 10 monclient: _check_auth_tickets 2024-09-14T11:32:47.423 INFO:tasks.workunit.client.0.smithi071.stderr: -399> 2024-09-14T11:32:47.249+0000 7f0646e05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:47.423 INFO:tasks.workunit.client.0.smithi071.stderr: -398> 2024-09-14T11:32:47.249+0000 7f0646e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:47.423 INFO:tasks.workunit.client.0.smithi071.stderr: -397> 2024-09-14T11:32:47.249+0000 7f0646e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:47.423 INFO:tasks.workunit.client.0.smithi071.stderr: -396> 2024-09-14T11:32:47.249+0000 7f0646e05640 10 monclient: dump: 2024-09-14T11:32:47.423 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:47.423 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:47.423 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.423 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.423 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:47.423 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:47.423 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:47.423 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:47.423 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:47.423 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.424 INFO:tasks.workunit.client.0.smithi071.stderr: -395> 2024-09-14T11:32:47.249+0000 7f0648608640 4 set_mon_vals no callback set 2024-09-14T11:32:47.424 INFO:tasks.workunit.client.0.smithi071.stderr: -394> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 5 monclient: authenticate success, global_id 7274 2024-09-14T11:32:47.424 INFO:tasks.workunit.client.0.smithi071.stderr: -393> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 10 monclient: _renew_subs 2024-09-14T11:32:47.424 INFO:tasks.workunit.client.0.smithi071.stderr: -392> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:32:47.424 INFO:tasks.workunit.client.0.smithi071.stderr: -391> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 10 monclient: _renew_subs 2024-09-14T11:32:47.424 INFO:tasks.workunit.client.0.smithi071.stderr: -390> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:32:47.424 INFO:tasks.workunit.client.0.smithi071.stderr: -389> 2024-09-14T11:32:47.249+0000 7f075c6ce9c0 1 librados: init done 2024-09-14T11:32:47.424 INFO:tasks.workunit.client.0.smithi071.stderr: -388> 2024-09-14T11:32:47.253+0000 7f0646e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:47.424 INFO:tasks.workunit.client.0.smithi071.stderr: -387> 2024-09-14T11:32:47.253+0000 7f0646e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:32:47.424 INFO:tasks.workunit.client.0.smithi071.stderr: -386> 2024-09-14T11:32:47.253+0000 7f0646e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:32:47.424 INFO:tasks.workunit.client.0.smithi071.stderr: -385> 2024-09-14T11:32:47.253+0000 7f07599d3640 10 monclient: get_auth_request con 0x7f06400718d0 auth_method 0 2024-09-14T11:32:47.424 INFO:tasks.workunit.client.0.smithi071.stderr: -384> 2024-09-14T11:32:47.253+0000 7f075a9d5640 10 monclient: get_auth_request con 0x55f58a14a320 auth_method 0 2024-09-14T11:32:47.424 INFO:tasks.workunit.client.0.smithi071.stderr: -383> 2024-09-14T11:32:47.253+0000 7f075a1d4640 10 monclient: get_auth_request con 0x55f58a16d3d0 auth_method 0 2024-09-14T11:32:47.425 INFO:tasks.workunit.client.0.smithi071.stderr: -382> 2024-09-14T11:32:47.257+0000 7f07599d3640 10 monclient: get_auth_request con 0x55f58a1715c0 auth_method 0 2024-09-14T11:32:47.425 INFO:tasks.workunit.client.0.smithi071.stderr: -381> 2024-09-14T11:32:47.257+0000 7f075a9d5640 10 monclient: get_auth_request con 0x55f58a1752f0 auth_method 0 2024-09-14T11:32:47.425 INFO:tasks.workunit.client.0.smithi071.stderr: -380> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 10 monclient: build_initial_monmap 2024-09-14T11:32:47.425 INFO:tasks.workunit.client.0.smithi071.stderr: -379> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 1 build_initial for_mkfs: 0 2024-09-14T11:32:47.425 INFO:tasks.workunit.client.0.smithi071.stderr: -378> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 10 monclient: monmap: 2024-09-14T11:32:47.425 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:32:47.425 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:47.425 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:32:47.425 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:32:47.425 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:47.425 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:47.425 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:32:47.425 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:32:47.426 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:32:47.426 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.426 INFO:tasks.workunit.client.0.smithi071.stderr: -377> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1794a0) adding auth protocol: cephx 2024-09-14T11:32:47.426 INFO:tasks.workunit.client.0.smithi071.stderr: -376> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1794a0) adding auth protocol: cephx 2024-09-14T11:32:47.426 INFO:tasks.workunit.client.0.smithi071.stderr: -375> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1794a0) adding auth protocol: cephx 2024-09-14T11:32:47.426 INFO:tasks.workunit.client.0.smithi071.stderr: -374> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1794a0) adding con mode: secure 2024-09-14T11:32:47.426 INFO:tasks.workunit.client.0.smithi071.stderr: -373> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1794a0) adding con mode: crc 2024-09-14T11:32:47.426 INFO:tasks.workunit.client.0.smithi071.stderr: -372> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1794a0) adding con mode: secure 2024-09-14T11:32:47.426 INFO:tasks.workunit.client.0.smithi071.stderr: -371> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1794a0) adding con mode: crc 2024-09-14T11:32:47.426 INFO:tasks.workunit.client.0.smithi071.stderr: -370> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1794a0) adding con mode: secure 2024-09-14T11:32:47.426 INFO:tasks.workunit.client.0.smithi071.stderr: -369> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1794a0) adding con mode: crc 2024-09-14T11:32:47.426 INFO:tasks.workunit.client.0.smithi071.stderr: -368> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1794a0) adding con mode: crc 2024-09-14T11:32:47.426 INFO:tasks.workunit.client.0.smithi071.stderr: -367> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1794a0) adding con mode: secure 2024-09-14T11:32:47.427 INFO:tasks.workunit.client.0.smithi071.stderr: -366> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1794a0) adding con mode: crc 2024-09-14T11:32:47.427 INFO:tasks.workunit.client.0.smithi071.stderr: -365> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1794a0) adding con mode: secure 2024-09-14T11:32:47.427 INFO:tasks.workunit.client.0.smithi071.stderr: -364> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1794a0) adding con mode: crc 2024-09-14T11:32:47.427 INFO:tasks.workunit.client.0.smithi071.stderr: -363> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1794a0) adding con mode: secure 2024-09-14T11:32:47.427 INFO:tasks.workunit.client.0.smithi071.stderr: -362> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:47.427 INFO:tasks.workunit.client.0.smithi071.stderr: -361> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 asok(0x55f589f14d90) register_command objecter_requests cmddesc objecter_requests hook 0x55f58a17cda0 EEXIST 2024-09-14T11:32:47.427 INFO:tasks.workunit.client.0.smithi071.stderr: -360> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 10 monclient: init 2024-09-14T11:32:47.427 INFO:tasks.workunit.client.0.smithi071.stderr: -359> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1782f8) adding auth protocol: cephx 2024-09-14T11:32:47.427 INFO:tasks.workunit.client.0.smithi071.stderr: -358> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1782f8) adding auth protocol: cephx 2024-09-14T11:32:47.427 INFO:tasks.workunit.client.0.smithi071.stderr: -357> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1782f8) adding auth protocol: cephx 2024-09-14T11:32:47.427 INFO:tasks.workunit.client.0.smithi071.stderr: -356> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1782f8) adding con mode: secure 2024-09-14T11:32:47.427 INFO:tasks.workunit.client.0.smithi071.stderr: -355> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1782f8) adding con mode: crc 2024-09-14T11:32:47.427 INFO:tasks.workunit.client.0.smithi071.stderr: -354> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1782f8) adding con mode: secure 2024-09-14T11:32:47.428 INFO:tasks.workunit.client.0.smithi071.stderr: -353> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1782f8) adding con mode: crc 2024-09-14T11:32:47.428 INFO:tasks.workunit.client.0.smithi071.stderr: -352> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1782f8) adding con mode: secure 2024-09-14T11:32:47.428 INFO:tasks.workunit.client.0.smithi071.stderr: -351> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1782f8) adding con mode: crc 2024-09-14T11:32:47.428 INFO:tasks.workunit.client.0.smithi071.stderr: -350> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1782f8) adding con mode: crc 2024-09-14T11:32:47.428 INFO:tasks.workunit.client.0.smithi071.stderr: -349> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1782f8) adding con mode: secure 2024-09-14T11:32:47.428 INFO:tasks.workunit.client.0.smithi071.stderr: -348> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1782f8) adding con mode: crc 2024-09-14T11:32:47.428 INFO:tasks.workunit.client.0.smithi071.stderr: -347> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1782f8) adding con mode: secure 2024-09-14T11:32:47.428 INFO:tasks.workunit.client.0.smithi071.stderr: -346> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1782f8) adding con mode: crc 2024-09-14T11:32:47.428 INFO:tasks.workunit.client.0.smithi071.stderr: -345> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1782f8) adding con mode: secure 2024-09-14T11:32:47.428 INFO:tasks.workunit.client.0.smithi071.stderr: -344> 2024-09-14T11:32:47.257+0000 7f075c6ce9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:47.428 INFO:tasks.workunit.client.0.smithi071.stderr: -343> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:47.428 INFO:tasks.workunit.client.0.smithi071.stderr: -342> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 5 asok(0x55f589f14d90) register_command rotate-key cmddesc rotate-key hook 0x55f58a178440 EEXIST 2024-09-14T11:32:47.429 INFO:tasks.workunit.client.0.smithi071.stderr: -341> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:32:47.429 INFO:tasks.workunit.client.0.smithi071.stderr: -340> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:32:47.429 INFO:tasks.workunit.client.0.smithi071.stderr: -339> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 10 monclient(hunting): picked mon.noname-a con 0x55f58a1a0f50 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:32:47.429 INFO:tasks.workunit.client.0.smithi071.stderr: -338> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 10 monclient(hunting): picked mon.noname-b con 0x55f58a1a0880 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:32:47.429 INFO:tasks.workunit.client.0.smithi071.stderr: -337> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 10 monclient(hunting): picked mon.noname-c con 0x55f58a19f260 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:32:47.429 INFO:tasks.workunit.client.0.smithi071.stderr: -336> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:47.429 INFO:tasks.workunit.client.0.smithi071.stderr: -335> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:47.429 INFO:tasks.workunit.client.0.smithi071.stderr: -334> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:47.429 INFO:tasks.workunit.client.0.smithi071.stderr: -333> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:32:47.429 INFO:tasks.workunit.client.0.smithi071.stderr: -332> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 10 monclient(hunting): authenticate will time out at 2379.380277s 2024-09-14T11:32:47.429 INFO:tasks.workunit.client.0.smithi071.stderr: -331> 2024-09-14T11:32:47.261+0000 7f075a1d4640 10 monclient(hunting): get_auth_request con 0x55f58a19f260 auth_method 0 2024-09-14T11:32:47.429 INFO:tasks.workunit.client.0.smithi071.stderr: -330> 2024-09-14T11:32:47.261+0000 7f075a1d4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:47.429 INFO:tasks.workunit.client.0.smithi071.stderr: -329> 2024-09-14T11:32:47.261+0000 7f075a1d4640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:47.430 INFO:tasks.workunit.client.0.smithi071.stderr: -328> 2024-09-14T11:32:47.261+0000 7f075a1d4640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:47.430 INFO:tasks.workunit.client.0.smithi071.stderr: -327> 2024-09-14T11:32:47.261+0000 7f07599d3640 10 monclient(hunting): get_auth_request con 0x55f58a1a0f50 auth_method 0 2024-09-14T11:32:47.430 INFO:tasks.workunit.client.0.smithi071.stderr: -326> 2024-09-14T11:32:47.261+0000 7f07599d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:47.430 INFO:tasks.workunit.client.0.smithi071.stderr: -325> 2024-09-14T11:32:47.261+0000 7f07599d3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:47.430 INFO:tasks.workunit.client.0.smithi071.stderr: -324> 2024-09-14T11:32:47.261+0000 7f07599d3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:47.430 INFO:tasks.workunit.client.0.smithi071.stderr: -323> 2024-09-14T11:32:47.261+0000 7f075a1d4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:47.430 INFO:tasks.workunit.client.0.smithi071.stderr: -322> 2024-09-14T11:32:47.261+0000 7f075a1d4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:47.430 INFO:tasks.workunit.client.0.smithi071.stderr: -321> 2024-09-14T11:32:47.261+0000 7f075a1d4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:47.430 INFO:tasks.workunit.client.0.smithi071.stderr: -320> 2024-09-14T11:32:47.261+0000 7f07599d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:47.430 INFO:tasks.workunit.client.0.smithi071.stderr: -319> 2024-09-14T11:32:47.261+0000 7f07599d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:47.430 INFO:tasks.workunit.client.0.smithi071.stderr: -318> 2024-09-14T11:32:47.261+0000 7f07599d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:47.430 INFO:tasks.workunit.client.0.smithi071.stderr: -317> 2024-09-14T11:32:47.261+0000 7f075a1d4640 10 monclient(hunting): handle_auth_done global_id 7277 payload 824 2024-09-14T11:32:47.430 INFO:tasks.workunit.client.0.smithi071.stderr: -316> 2024-09-14T11:32:47.261+0000 7f075a1d4640 10 monclient: _finish_hunting 0 2024-09-14T11:32:47.430 INFO:tasks.workunit.client.0.smithi071.stderr: -315> 2024-09-14T11:32:47.261+0000 7f075a1d4640 1 monclient: found mon.noname-c 2024-09-14T11:32:47.431 INFO:tasks.workunit.client.0.smithi071.stderr: -314> 2024-09-14T11:32:47.261+0000 7f075a1d4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:32:47.431 INFO:tasks.workunit.client.0.smithi071.stderr: -313> 2024-09-14T11:32:47.261+0000 7f063ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:47.431 INFO:tasks.workunit.client.0.smithi071.stderr: -312> 2024-09-14T11:32:47.261+0000 7f063ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:32:47.431 INFO:tasks.workunit.client.0.smithi071.stderr: -311> 2024-09-14T11:32:47.261+0000 7f063ffff640 10 monclient: dump: 2024-09-14T11:32:47.431 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:47.431 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:47.431 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.431 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.431 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:47.431 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:47.431 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:47.431 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:47.431 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:47.432 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.432 INFO:tasks.workunit.client.0.smithi071.stderr: -310> 2024-09-14T11:32:47.261+0000 7f063ffff640 10 monclient: _finish_auth 0 2024-09-14T11:32:47.432 INFO:tasks.workunit.client.0.smithi071.stderr: -309> 2024-09-14T11:32:47.261+0000 7f063ffff640 10 monclient: _check_auth_tickets 2024-09-14T11:32:47.432 INFO:tasks.workunit.client.0.smithi071.stderr: -308> 2024-09-14T11:32:47.261+0000 7f063ffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:47.432 INFO:tasks.workunit.client.0.smithi071.stderr: -307> 2024-09-14T11:32:47.261+0000 7f063ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:47.432 INFO:tasks.workunit.client.0.smithi071.stderr: -306> 2024-09-14T11:32:47.261+0000 7f063ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:47.432 INFO:tasks.workunit.client.0.smithi071.stderr: -305> 2024-09-14T11:32:47.261+0000 7f063ffff640 10 monclient: dump: 2024-09-14T11:32:47.432 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:47.432 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:47.432 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.433 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.433 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:47.433 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:47.433 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:47.433 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:47.433 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:47.433 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.433 INFO:tasks.workunit.client.0.smithi071.stderr: -304> 2024-09-14T11:32:47.261+0000 7f075b1d6640 4 set_mon_vals no callback set 2024-09-14T11:32:47.433 INFO:tasks.workunit.client.0.smithi071.stderr: -303> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 5 monclient: authenticate success, global_id 7277 2024-09-14T11:32:47.433 INFO:tasks.workunit.client.0.smithi071.stderr: -302> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 10 monclient: _renew_subs 2024-09-14T11:32:47.433 INFO:tasks.workunit.client.0.smithi071.stderr: -301> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:32:47.433 INFO:tasks.workunit.client.0.smithi071.stderr: -300> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 10 monclient: _renew_subs 2024-09-14T11:32:47.433 INFO:tasks.workunit.client.0.smithi071.stderr: -299> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:32:47.434 INFO:tasks.workunit.client.0.smithi071.stderr: -298> 2024-09-14T11:32:47.261+0000 7f063ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:47.434 INFO:tasks.workunit.client.0.smithi071.stderr: -297> 2024-09-14T11:32:47.261+0000 7f063ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:32:47.434 INFO:tasks.workunit.client.0.smithi071.stderr: -296> 2024-09-14T11:32:47.261+0000 7f063ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:32:47.434 INFO:tasks.workunit.client.0.smithi071.stderr: -295> 2024-09-14T11:32:47.261+0000 7f07599d3640 10 monclient: get_auth_request con 0x7f06340717e0 auth_method 0 2024-09-14T11:32:47.434 INFO:tasks.workunit.client.0.smithi071.stderr: -294> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 10 monclient: get_monmap_and_config 2024-09-14T11:32:47.434 INFO:tasks.workunit.client.0.smithi071.stderr: -293> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 10 monclient: build_initial_monmap 2024-09-14T11:32:47.434 INFO:tasks.workunit.client.0.smithi071.stderr: -292> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 1 build_initial for_mkfs: 0 2024-09-14T11:32:47.434 INFO:tasks.workunit.client.0.smithi071.stderr: -291> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 10 monclient: monmap: 2024-09-14T11:32:47.434 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:32:47.434 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:47.434 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:32:47.434 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:32:47.434 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:47.435 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:47.435 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:32:47.435 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:32:47.435 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:32:47.435 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.435 INFO:tasks.workunit.client.0.smithi071.stderr: -290> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c0410) adding auth protocol: cephx 2024-09-14T11:32:47.435 INFO:tasks.workunit.client.0.smithi071.stderr: -289> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c0410) adding auth protocol: cephx 2024-09-14T11:32:47.435 INFO:tasks.workunit.client.0.smithi071.stderr: -288> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c0410) adding auth protocol: cephx 2024-09-14T11:32:47.435 INFO:tasks.workunit.client.0.smithi071.stderr: -287> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c0410) adding con mode: secure 2024-09-14T11:32:47.435 INFO:tasks.workunit.client.0.smithi071.stderr: -286> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c0410) adding con mode: crc 2024-09-14T11:32:47.435 INFO:tasks.workunit.client.0.smithi071.stderr: -285> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c0410) adding con mode: secure 2024-09-14T11:32:47.435 INFO:tasks.workunit.client.0.smithi071.stderr: -284> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c0410) adding con mode: crc 2024-09-14T11:32:47.435 INFO:tasks.workunit.client.0.smithi071.stderr: -283> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c0410) adding con mode: secure 2024-09-14T11:32:47.435 INFO:tasks.workunit.client.0.smithi071.stderr: -282> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c0410) adding con mode: crc 2024-09-14T11:32:47.435 INFO:tasks.workunit.client.0.smithi071.stderr: -281> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c0410) adding con mode: crc 2024-09-14T11:32:47.436 INFO:tasks.workunit.client.0.smithi071.stderr: -280> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c0410) adding con mode: secure 2024-09-14T11:32:47.436 INFO:tasks.workunit.client.0.smithi071.stderr: -279> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c0410) adding con mode: crc 2024-09-14T11:32:47.436 INFO:tasks.workunit.client.0.smithi071.stderr: -278> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c0410) adding con mode: secure 2024-09-14T11:32:47.436 INFO:tasks.workunit.client.0.smithi071.stderr: -277> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c0410) adding con mode: crc 2024-09-14T11:32:47.436 INFO:tasks.workunit.client.0.smithi071.stderr: -276> 2024-09-14T11:32:47.261+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c0410) adding con mode: secure 2024-09-14T11:32:47.436 INFO:tasks.workunit.client.0.smithi071.stderr: -275> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:47.436 INFO:tasks.workunit.client.0.smithi071.stderr: -274> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient: init 2024-09-14T11:32:47.436 INFO:tasks.workunit.client.0.smithi071.stderr: -273> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67330) adding auth protocol: cephx 2024-09-14T11:32:47.436 INFO:tasks.workunit.client.0.smithi071.stderr: -272> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67330) adding auth protocol: cephx 2024-09-14T11:32:47.436 INFO:tasks.workunit.client.0.smithi071.stderr: -271> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67330) adding auth protocol: cephx 2024-09-14T11:32:47.436 INFO:tasks.workunit.client.0.smithi071.stderr: -270> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67330) adding con mode: secure 2024-09-14T11:32:47.436 INFO:tasks.workunit.client.0.smithi071.stderr: -269> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67330) adding con mode: crc 2024-09-14T11:32:47.436 INFO:tasks.workunit.client.0.smithi071.stderr: -268> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67330) adding con mode: secure 2024-09-14T11:32:47.436 INFO:tasks.workunit.client.0.smithi071.stderr: -267> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67330) adding con mode: crc 2024-09-14T11:32:47.437 INFO:tasks.workunit.client.0.smithi071.stderr: -266> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67330) adding con mode: secure 2024-09-14T11:32:47.437 INFO:tasks.workunit.client.0.smithi071.stderr: -265> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67330) adding con mode: crc 2024-09-14T11:32:47.437 INFO:tasks.workunit.client.0.smithi071.stderr: -264> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67330) adding con mode: crc 2024-09-14T11:32:47.437 INFO:tasks.workunit.client.0.smithi071.stderr: -263> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67330) adding con mode: secure 2024-09-14T11:32:47.437 INFO:tasks.workunit.client.0.smithi071.stderr: -262> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67330) adding con mode: crc 2024-09-14T11:32:47.437 INFO:tasks.workunit.client.0.smithi071.stderr: -261> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67330) adding con mode: secure 2024-09-14T11:32:47.437 INFO:tasks.workunit.client.0.smithi071.stderr: -260> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67330) adding con mode: crc 2024-09-14T11:32:47.437 INFO:tasks.workunit.client.0.smithi071.stderr: -259> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67330) adding con mode: secure 2024-09-14T11:32:47.437 INFO:tasks.workunit.client.0.smithi071.stderr: -258> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:47.437 INFO:tasks.workunit.client.0.smithi071.stderr: -257> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:47.437 INFO:tasks.workunit.client.0.smithi071.stderr: -256> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 asok(0x55f589f14d90) register_command rotate-key cmddesc rotate-key hook 0x7ffc33f67478 EEXIST 2024-09-14T11:32:47.437 INFO:tasks.workunit.client.0.smithi071.stderr: -255> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:32:47.437 INFO:tasks.workunit.client.0.smithi071.stderr: -254> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:32:47.437 INFO:tasks.workunit.client.0.smithi071.stderr: -253> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient(hunting): picked mon.noname-c con 0x55f58a1eea20 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:32:47.438 INFO:tasks.workunit.client.0.smithi071.stderr: -252> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient(hunting): picked mon.noname-b con 0x55f58a1eee00 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:32:47.438 INFO:tasks.workunit.client.0.smithi071.stderr: -251> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient(hunting): picked mon.noname-a con 0x55f58a1f02c0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:32:47.438 INFO:tasks.workunit.client.0.smithi071.stderr: -250> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:47.438 INFO:tasks.workunit.client.0.smithi071.stderr: -249> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:47.438 INFO:tasks.workunit.client.0.smithi071.stderr: -248> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:47.438 INFO:tasks.workunit.client.0.smithi071.stderr: -247> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:32:47.438 INFO:tasks.workunit.client.0.smithi071.stderr: -246> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient(hunting): authenticate will time out at 2379.384845s 2024-09-14T11:32:47.438 INFO:tasks.workunit.client.0.smithi071.stderr: -245> 2024-09-14T11:32:47.265+0000 7f075a1d4640 10 monclient(hunting): get_auth_request con 0x55f58a1f02c0 auth_method 0 2024-09-14T11:32:47.438 INFO:tasks.workunit.client.0.smithi071.stderr: -244> 2024-09-14T11:32:47.265+0000 7f075a1d4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:47.438 INFO:tasks.workunit.client.0.smithi071.stderr: -243> 2024-09-14T11:32:47.265+0000 7f075a1d4640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:47.438 INFO:tasks.workunit.client.0.smithi071.stderr: -242> 2024-09-14T11:32:47.265+0000 7f075a1d4640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:47.438 INFO:tasks.workunit.client.0.smithi071.stderr: -241> 2024-09-14T11:32:47.265+0000 7f07599d3640 10 monclient(hunting): get_auth_request con 0x55f58a1eea20 auth_method 0 2024-09-14T11:32:47.438 INFO:tasks.workunit.client.0.smithi071.stderr: -240> 2024-09-14T11:32:47.265+0000 7f07599d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:47.438 INFO:tasks.workunit.client.0.smithi071.stderr: -239> 2024-09-14T11:32:47.265+0000 7f07599d3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:47.439 INFO:tasks.workunit.client.0.smithi071.stderr: -238> 2024-09-14T11:32:47.265+0000 7f07599d3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:47.439 INFO:tasks.workunit.client.0.smithi071.stderr: -237> 2024-09-14T11:32:47.265+0000 7f075a1d4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:47.439 INFO:tasks.workunit.client.0.smithi071.stderr: -236> 2024-09-14T11:32:47.265+0000 7f075a1d4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:47.439 INFO:tasks.workunit.client.0.smithi071.stderr: -235> 2024-09-14T11:32:47.265+0000 7f075a1d4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:47.439 INFO:tasks.workunit.client.0.smithi071.stderr: -234> 2024-09-14T11:32:47.265+0000 7f07599d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:47.439 INFO:tasks.workunit.client.0.smithi071.stderr: -233> 2024-09-14T11:32:47.265+0000 7f07599d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:47.439 INFO:tasks.workunit.client.0.smithi071.stderr: -232> 2024-09-14T11:32:47.265+0000 7f07599d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:47.439 INFO:tasks.workunit.client.0.smithi071.stderr: -231> 2024-09-14T11:32:47.265+0000 7f075a1d4640 10 monclient(hunting): handle_auth_done global_id 7683 payload 274 2024-09-14T11:32:47.439 INFO:tasks.workunit.client.0.smithi071.stderr: -230> 2024-09-14T11:32:47.265+0000 7f075a1d4640 10 monclient: _finish_hunting 0 2024-09-14T11:32:47.439 INFO:tasks.workunit.client.0.smithi071.stderr: -229> 2024-09-14T11:32:47.265+0000 7f075a1d4640 1 monclient: found mon.noname-a 2024-09-14T11:32:47.439 INFO:tasks.workunit.client.0.smithi071.stderr: -228> 2024-09-14T11:32:47.265+0000 7f075a1d4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:32:47.439 INFO:tasks.workunit.client.0.smithi071.stderr: -227> 2024-09-14T11:32:47.265+0000 7f063dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:47.439 INFO:tasks.workunit.client.0.smithi071.stderr: -226> 2024-09-14T11:32:47.265+0000 7f063dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:32:47.439 INFO:tasks.workunit.client.0.smithi071.stderr: -225> 2024-09-14T11:32:47.265+0000 7f063dffb640 10 monclient: dump: 2024-09-14T11:32:47.439 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:47.440 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:47.440 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.440 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.440 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:47.440 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:47.440 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:47.440 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:47.440 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:47.440 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.440 INFO:tasks.workunit.client.0.smithi071.stderr: -224> 2024-09-14T11:32:47.265+0000 7f063dffb640 10 monclient: _finish_auth 0 2024-09-14T11:32:47.440 INFO:tasks.workunit.client.0.smithi071.stderr: -223> 2024-09-14T11:32:47.265+0000 7f063dffb640 10 monclient: _check_auth_tickets 2024-09-14T11:32:47.440 INFO:tasks.workunit.client.0.smithi071.stderr: -222> 2024-09-14T11:32:47.265+0000 7f063dffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:47.440 INFO:tasks.workunit.client.0.smithi071.stderr: -221> 2024-09-14T11:32:47.265+0000 7f063dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:47.440 INFO:tasks.workunit.client.0.smithi071.stderr: -220> 2024-09-14T11:32:47.265+0000 7f063dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:32:47.440 INFO:tasks.workunit.client.0.smithi071.stderr: -219> 2024-09-14T11:32:47.265+0000 7f063dffb640 10 monclient: dump: 2024-09-14T11:32:47.441 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:47.441 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:47.441 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.441 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.441 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:47.441 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:47.441 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:47.441 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:47.441 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:47.441 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.441 INFO:tasks.workunit.client.0.smithi071.stderr: -218> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 monclient: authenticate success, global_id 7683 2024-09-14T11:32:47.441 INFO:tasks.workunit.client.0.smithi071.stderr: -217> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:32:47.441 INFO:tasks.workunit.client.0.smithi071.stderr: -216> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 4 set_mon_vals no callback set 2024-09-14T11:32:47.441 INFO:tasks.workunit.client.0.smithi071.stderr: -215> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient: shutdown 2024-09-14T11:32:47.441 INFO:tasks.workunit.client.0.smithi071.stderr: -214> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient: build_initial_monmap 2024-09-14T11:32:47.442 INFO:tasks.workunit.client.0.smithi071.stderr: -213> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 1 build_initial for_mkfs: 0 2024-09-14T11:32:47.442 INFO:tasks.workunit.client.0.smithi071.stderr: -212> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient: monmap: 2024-09-14T11:32:47.442 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:32:47.442 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:47.442 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:32:47.442 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:32:47.442 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:47.442 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:47.442 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:32:47.442 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:32:47.442 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:32:47.442 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.442 INFO:tasks.workunit.client.0.smithi071.stderr: -211> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c03c0) adding auth protocol: cephx 2024-09-14T11:32:47.442 INFO:tasks.workunit.client.0.smithi071.stderr: -210> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c03c0) adding auth protocol: cephx 2024-09-14T11:32:47.443 INFO:tasks.workunit.client.0.smithi071.stderr: -209> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c03c0) adding auth protocol: cephx 2024-09-14T11:32:47.443 INFO:tasks.workunit.client.0.smithi071.stderr: -208> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c03c0) adding con mode: secure 2024-09-14T11:32:47.443 INFO:tasks.workunit.client.0.smithi071.stderr: -207> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c03c0) adding con mode: crc 2024-09-14T11:32:47.443 INFO:tasks.workunit.client.0.smithi071.stderr: -206> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c03c0) adding con mode: secure 2024-09-14T11:32:47.443 INFO:tasks.workunit.client.0.smithi071.stderr: -205> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c03c0) adding con mode: crc 2024-09-14T11:32:47.443 INFO:tasks.workunit.client.0.smithi071.stderr: -204> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c03c0) adding con mode: secure 2024-09-14T11:32:47.443 INFO:tasks.workunit.client.0.smithi071.stderr: -203> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c03c0) adding con mode: crc 2024-09-14T11:32:47.443 INFO:tasks.workunit.client.0.smithi071.stderr: -202> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c03c0) adding con mode: crc 2024-09-14T11:32:47.443 INFO:tasks.workunit.client.0.smithi071.stderr: -201> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c03c0) adding con mode: secure 2024-09-14T11:32:47.443 INFO:tasks.workunit.client.0.smithi071.stderr: -200> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c03c0) adding con mode: crc 2024-09-14T11:32:47.443 INFO:tasks.workunit.client.0.smithi071.stderr: -199> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c03c0) adding con mode: secure 2024-09-14T11:32:47.443 INFO:tasks.workunit.client.0.smithi071.stderr: -198> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c03c0) adding con mode: crc 2024-09-14T11:32:47.443 INFO:tasks.workunit.client.0.smithi071.stderr: -197> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1c03c0) adding con mode: secure 2024-09-14T11:32:47.443 INFO:tasks.workunit.client.0.smithi071.stderr: -196> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:47.443 INFO:tasks.workunit.client.0.smithi071.stderr: -195> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 1 librados: starting msgr at 2024-09-14T11:32:47.444 INFO:tasks.workunit.client.0.smithi071.stderr: -194> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 1 librados: starting objecter 2024-09-14T11:32:47.444 INFO:tasks.workunit.client.0.smithi071.stderr: -193> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 asok(0x55f589f14d90) register_command objecter_requests cmddesc objecter_requests hook 0x55f58a1eb0a0 EEXIST 2024-09-14T11:32:47.444 INFO:tasks.workunit.client.0.smithi071.stderr: -192> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 1 librados: setting wanted keys 2024-09-14T11:32:47.444 INFO:tasks.workunit.client.0.smithi071.stderr: -191> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 1 librados: calling monclient init 2024-09-14T11:32:47.444 INFO:tasks.workunit.client.0.smithi071.stderr: -190> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient: init 2024-09-14T11:32:47.444 INFO:tasks.workunit.client.0.smithi071.stderr: -189> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1a2d70) adding auth protocol: cephx 2024-09-14T11:32:47.444 INFO:tasks.workunit.client.0.smithi071.stderr: -188> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1a2d70) adding auth protocol: cephx 2024-09-14T11:32:47.444 INFO:tasks.workunit.client.0.smithi071.stderr: -187> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1a2d70) adding auth protocol: cephx 2024-09-14T11:32:47.444 INFO:tasks.workunit.client.0.smithi071.stderr: -186> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1a2d70) adding con mode: secure 2024-09-14T11:32:47.444 INFO:tasks.workunit.client.0.smithi071.stderr: -185> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1a2d70) adding con mode: crc 2024-09-14T11:32:47.444 INFO:tasks.workunit.client.0.smithi071.stderr: -184> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1a2d70) adding con mode: secure 2024-09-14T11:32:47.444 INFO:tasks.workunit.client.0.smithi071.stderr: -183> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1a2d70) adding con mode: crc 2024-09-14T11:32:47.444 INFO:tasks.workunit.client.0.smithi071.stderr: -182> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1a2d70) adding con mode: secure 2024-09-14T11:32:47.444 INFO:tasks.workunit.client.0.smithi071.stderr: -181> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1a2d70) adding con mode: crc 2024-09-14T11:32:47.444 INFO:tasks.workunit.client.0.smithi071.stderr: -180> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1a2d70) adding con mode: crc 2024-09-14T11:32:47.445 INFO:tasks.workunit.client.0.smithi071.stderr: -179> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1a2d70) adding con mode: secure 2024-09-14T11:32:47.445 INFO:tasks.workunit.client.0.smithi071.stderr: -178> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1a2d70) adding con mode: crc 2024-09-14T11:32:47.445 INFO:tasks.workunit.client.0.smithi071.stderr: -177> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1a2d70) adding con mode: secure 2024-09-14T11:32:47.445 INFO:tasks.workunit.client.0.smithi071.stderr: -176> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1a2d70) adding con mode: crc 2024-09-14T11:32:47.445 INFO:tasks.workunit.client.0.smithi071.stderr: -175> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 AuthRegistry(0x55f58a1a2d70) adding con mode: secure 2024-09-14T11:32:47.445 INFO:tasks.workunit.client.0.smithi071.stderr: -174> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:47.445 INFO:tasks.workunit.client.0.smithi071.stderr: -173> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:47.445 INFO:tasks.workunit.client.0.smithi071.stderr: -172> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 5 asok(0x55f589f14d90) register_command rotate-key cmddesc rotate-key hook 0x55f58a1a2eb8 EEXIST 2024-09-14T11:32:47.445 INFO:tasks.workunit.client.0.smithi071.stderr: -171> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:32:47.445 INFO:tasks.workunit.client.0.smithi071.stderr: -170> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:32:47.445 INFO:tasks.workunit.client.0.smithi071.stderr: -169> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient(hunting): picked mon.noname-c con 0x55f58a1eea20 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:32:47.445 INFO:tasks.workunit.client.0.smithi071.stderr: -168> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient(hunting): picked mon.noname-a con 0x55f58a1f02c0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:32:47.445 INFO:tasks.workunit.client.0.smithi071.stderr: -167> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient(hunting): picked mon.noname-b con 0x55f58a1fa820 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:32:47.445 INFO:tasks.workunit.client.0.smithi071.stderr: -166> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:47.446 INFO:tasks.workunit.client.0.smithi071.stderr: -165> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:47.446 INFO:tasks.workunit.client.0.smithi071.stderr: -164> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:47.446 INFO:tasks.workunit.client.0.smithi071.stderr: -163> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:32:47.446 INFO:tasks.workunit.client.0.smithi071.stderr: -162> 2024-09-14T11:32:47.265+0000 7f075c6ce9c0 10 monclient(hunting): authenticate will time out at 2379.387552s 2024-09-14T11:32:47.446 INFO:tasks.workunit.client.0.smithi071.stderr: -161> 2024-09-14T11:32:47.265+0000 7f07599d3640 10 monclient(hunting): get_auth_request con 0x55f58a1eea20 auth_method 0 2024-09-14T11:32:47.446 INFO:tasks.workunit.client.0.smithi071.stderr: -160> 2024-09-14T11:32:47.265+0000 7f07599d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:47.446 INFO:tasks.workunit.client.0.smithi071.stderr: -159> 2024-09-14T11:32:47.265+0000 7f07599d3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:47.446 INFO:tasks.workunit.client.0.smithi071.stderr: -158> 2024-09-14T11:32:47.265+0000 7f07599d3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:47.446 INFO:tasks.workunit.client.0.smithi071.stderr: -157> 2024-09-14T11:32:47.265+0000 7f075a9d5640 10 monclient(hunting): get_auth_request con 0x55f58a1f02c0 auth_method 0 2024-09-14T11:32:47.446 INFO:tasks.workunit.client.0.smithi071.stderr: -156> 2024-09-14T11:32:47.265+0000 7f075a9d5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:47.446 INFO:tasks.workunit.client.0.smithi071.stderr: -155> 2024-09-14T11:32:47.265+0000 7f075a9d5640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:47.446 INFO:tasks.workunit.client.0.smithi071.stderr: -154> 2024-09-14T11:32:47.265+0000 7f075a9d5640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:47.446 INFO:tasks.workunit.client.0.smithi071.stderr: -153> 2024-09-14T11:32:47.265+0000 7f07599d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:47.447 INFO:tasks.workunit.client.0.smithi071.stderr: -152> 2024-09-14T11:32:47.265+0000 7f07599d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:47.447 INFO:tasks.workunit.client.0.smithi071.stderr: -151> 2024-09-14T11:32:47.265+0000 7f07599d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:47.447 INFO:tasks.workunit.client.0.smithi071.stderr: -150> 2024-09-14T11:32:47.265+0000 7f075a9d5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:47.447 INFO:tasks.workunit.client.0.smithi071.stderr: -149> 2024-09-14T11:32:47.265+0000 7f075a9d5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:47.447 INFO:tasks.workunit.client.0.smithi071.stderr: -148> 2024-09-14T11:32:47.265+0000 7f075a9d5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:47.447 INFO:tasks.workunit.client.0.smithi071.stderr: -147> 2024-09-14T11:32:47.265+0000 7f07599d3640 10 monclient(hunting): handle_auth_done global_id 7283 payload 824 2024-09-14T11:32:47.447 INFO:tasks.workunit.client.0.smithi071.stderr: -146> 2024-09-14T11:32:47.265+0000 7f07599d3640 10 monclient: _finish_hunting 0 2024-09-14T11:32:47.447 INFO:tasks.workunit.client.0.smithi071.stderr: -145> 2024-09-14T11:32:47.269+0000 7f07599d3640 1 monclient: found mon.noname-c 2024-09-14T11:32:47.447 INFO:tasks.workunit.client.0.smithi071.stderr: -144> 2024-09-14T11:32:47.269+0000 7f07599d3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:32:47.447 INFO:tasks.workunit.client.0.smithi071.stderr: -143> 2024-09-14T11:32:47.269+0000 7f062bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:47.447 INFO:tasks.workunit.client.0.smithi071.stderr: -142> 2024-09-14T11:32:47.269+0000 7f062bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:32:47.447 INFO:tasks.workunit.client.0.smithi071.stderr: -141> 2024-09-14T11:32:47.269+0000 7f062bfff640 10 monclient: dump: 2024-09-14T11:32:47.448 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:47.448 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:47.448 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.448 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.448 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:47.448 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:47.448 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:47.448 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:47.448 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:47.448 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.448 INFO:tasks.workunit.client.0.smithi071.stderr: -140> 2024-09-14T11:32:47.269+0000 7f062bfff640 10 monclient: _finish_auth 0 2024-09-14T11:32:47.448 INFO:tasks.workunit.client.0.smithi071.stderr: -139> 2024-09-14T11:32:47.269+0000 7f062bfff640 10 monclient: _check_auth_tickets 2024-09-14T11:32:47.448 INFO:tasks.workunit.client.0.smithi071.stderr: -138> 2024-09-14T11:32:47.269+0000 7f062bfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:47.448 INFO:tasks.workunit.client.0.smithi071.stderr: -137> 2024-09-14T11:32:47.269+0000 7f062bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:47.449 INFO:tasks.workunit.client.0.smithi071.stderr: -136> 2024-09-14T11:32:47.269+0000 7f062bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:47.449 INFO:tasks.workunit.client.0.smithi071.stderr: -135> 2024-09-14T11:32:47.269+0000 7f062bfff640 10 monclient: dump: 2024-09-14T11:32:47.449 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:32:47.449 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:32:47.449 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.449 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:32:47.449 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:47.449 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:32:47.449 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:32:47.449 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:32:47.449 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:32:47.449 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.449 INFO:tasks.workunit.client.0.smithi071.stderr: -134> 2024-09-14T11:32:47.269+0000 7f063dffb640 4 set_mon_vals no callback set 2024-09-14T11:32:47.449 INFO:tasks.workunit.client.0.smithi071.stderr: -133> 2024-09-14T11:32:47.269+0000 7f075c6ce9c0 5 monclient: authenticate success, global_id 7283 2024-09-14T11:32:47.450 INFO:tasks.workunit.client.0.smithi071.stderr: -132> 2024-09-14T11:32:47.269+0000 7f075c6ce9c0 10 monclient: _renew_subs 2024-09-14T11:32:47.450 INFO:tasks.workunit.client.0.smithi071.stderr: -131> 2024-09-14T11:32:47.269+0000 7f075c6ce9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:32:47.450 INFO:tasks.workunit.client.0.smithi071.stderr: -130> 2024-09-14T11:32:47.269+0000 7f075c6ce9c0 10 monclient: _renew_subs 2024-09-14T11:32:47.450 INFO:tasks.workunit.client.0.smithi071.stderr: -129> 2024-09-14T11:32:47.269+0000 7f075c6ce9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:32:47.450 INFO:tasks.workunit.client.0.smithi071.stderr: -128> 2024-09-14T11:32:47.269+0000 7f075c6ce9c0 1 librados: init done 2024-09-14T11:32:47.450 INFO:tasks.workunit.client.0.smithi071.stderr: -127> 2024-09-14T11:32:47.269+0000 7f075c6ce9c0 5 asok(0x55f589f14d90) register_command cr dump hook 0x55f58a1fe0d8 2024-09-14T11:32:47.450 INFO:tasks.workunit.client.0.smithi071.stderr: -126> 2024-09-14T11:32:47.269+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.450 INFO:tasks.workunit.client.0.smithi071.stderr: -125> 2024-09-14T11:32:47.269+0000 7f062bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:47.450 INFO:tasks.workunit.client.0.smithi071.stderr: -124> 2024-09-14T11:32:47.269+0000 7f062bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:32:47.450 INFO:tasks.workunit.client.0.smithi071.stderr: -123> 2024-09-14T11:32:47.269+0000 7f062bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:32:47.450 INFO:tasks.workunit.client.0.smithi071.stderr: -122> 2024-09-14T11:32:47.269+0000 7f075a9d5640 10 monclient: get_auth_request con 0x7f06240718a0 auth_method 0 2024-09-14T11:32:47.450 INFO:tasks.workunit.client.0.smithi071.stderr: -121> 2024-09-14T11:32:47.269+0000 7f075a1d4640 10 monclient: get_auth_request con 0x55f58a20e0e0 auth_method 0 2024-09-14T11:32:47.450 INFO:tasks.workunit.client.0.smithi071.stderr: -120> 2024-09-14T11:32:47.273+0000 7f075c6ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.450 INFO:tasks.workunit.client.0.smithi071.stderr: -119> 2024-09-14T11:32:47.273+0000 7f075c6ce9c0 20 realm 2024-09-14T11:32:47.450 INFO:tasks.workunit.client.0.smithi071.stderr: -118> 2024-09-14T11:32:47.273+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.451 INFO:tasks.workunit.client.0.smithi071.stderr: -117> 2024-09-14T11:32:47.273+0000 7f075c6ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.451 INFO:tasks.workunit.client.0.smithi071.stderr: -116> 2024-09-14T11:32:47.273+0000 7f075c6ce9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:47.451 INFO:tasks.workunit.client.0.smithi071.stderr: -115> 2024-09-14T11:32:47.273+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.451 INFO:tasks.workunit.client.0.smithi071.stderr: -114> 2024-09-14T11:32:47.273+0000 7f075c6ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.451 INFO:tasks.workunit.client.0.smithi071.stderr: -113> 2024-09-14T11:32:47.273+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.451 INFO:tasks.workunit.client.0.smithi071.stderr: -112> 2024-09-14T11:32:47.273+0000 7f07599d3640 10 monclient: get_auth_request con 0x55f58a2122e0 auth_method 0 2024-09-14T11:32:47.451 INFO:tasks.workunit.client.0.smithi071.stderr: -111> 2024-09-14T11:32:47.273+0000 7f075c6ce9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:47.451 INFO:tasks.workunit.client.0.smithi071.stderr: -110> 2024-09-14T11:32:47.273+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.451 INFO:tasks.workunit.client.0.smithi071.stderr: -109> 2024-09-14T11:32:47.273+0000 7f075a9d5640 10 monclient: get_auth_request con 0x55f58a215b40 auth_method 0 2024-09-14T11:32:47.451 INFO:tasks.workunit.client.0.smithi071.stderr: -108> 2024-09-14T11:32:47.273+0000 7f075c6ce9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:47.451 INFO:tasks.workunit.client.0.smithi071.stderr: -107> 2024-09-14T11:32:47.273+0000 7f075c6ce9c0 20 searching for the correct realm 2024-09-14T11:32:47.451 INFO:tasks.workunit.client.0.smithi071.stderr: -106> 2024-09-14T11:32:47.273+0000 7f075a1d4640 10 monclient: get_auth_request con 0x55f58a21a900 auth_method 0 2024-09-14T11:32:47.451 INFO:tasks.workunit.client.0.smithi071.stderr: -105> 2024-09-14T11:32:47.277+0000 7f07599d3640 10 monclient: get_auth_request con 0x7f074c12d940 auth_method 0 2024-09-14T11:32:47.451 INFO:tasks.workunit.client.0.smithi071.stderr: -104> 2024-09-14T11:32:47.277+0000 7f075a9d5640 10 monclient: get_auth_request con 0x7f0750073430 auth_method 0 2024-09-14T11:32:47.451 INFO:tasks.workunit.client.0.smithi071.stderr: -103> 2024-09-14T11:32:47.277+0000 7f075a9d5640 0 -- 172.21.15.71:0/262669837 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f0750073430 msgr2=0x7f0750028030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:47.452 INFO:tasks.workunit.client.0.smithi071.stderr: -102> 2024-09-14T11:32:47.277+0000 7f062bfff640 1 client.7283.objecter ms_handle_reset 0x7f0750073430 session 0x7f0750073910 osd.0 2024-09-14T11:32:47.452 INFO:tasks.workunit.client.0.smithi071.stderr: -101> 2024-09-14T11:32:47.277+0000 7f062bfff640 10 monclient: _renew_subs 2024-09-14T11:32:47.452 INFO:tasks.workunit.client.0.smithi071.stderr: -100> 2024-09-14T11:32:47.277+0000 7f062bfff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:32:47.452 INFO:tasks.workunit.client.0.smithi071.stderr: -99> 2024-09-14T11:32:47.277+0000 7f075a9d5640 10 monclient: get_auth_request con 0x7f06240813c0 auth_method 0 2024-09-14T11:32:47.452 INFO:tasks.workunit.client.0.smithi071.stderr: -98> 2024-09-14T11:32:47.281+0000 7f075a1d4640 10 monclient: get_auth_request con 0x7f074c100ee0 auth_method 0 2024-09-14T11:32:47.452 INFO:tasks.workunit.client.0.smithi071.stderr: -97> 2024-09-14T11:32:47.281+0000 7f07599d3640 10 monclient: get_auth_request con 0x7f075006fba0 auth_method 0 2024-09-14T11:32:47.452 INFO:tasks.workunit.client.0.smithi071.stderr: -96> 2024-09-14T11:32:47.285+0000 7f075a9d5640 0 -- 172.21.15.71:0/262669837 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55f58a215b40 msgr2=0x55f58a217f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:47.452 INFO:tasks.workunit.client.0.smithi071.stderr: -95> 2024-09-14T11:32:47.285+0000 7f062bfff640 1 client.7283.objecter ms_handle_reset 0x55f58a215b40 session 0x55f58a211670 osd.3 2024-09-14T11:32:47.452 INFO:tasks.workunit.client.0.smithi071.stderr: -94> 2024-09-14T11:32:47.285+0000 7f075a9d5640 10 monclient: get_auth_request con 0x7f0750073430 auth_method 0 2024-09-14T11:32:47.452 INFO:tasks.workunit.client.0.smithi071.stderr: -93> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:47.452 INFO:tasks.workunit.client.0.smithi071.stderr: -92> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:32:47.452 INFO:tasks.workunit.client.0.smithi071.stderr: -91> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:47.452 INFO:tasks.workunit.client.0.smithi071.stderr: -90> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:32:47.452 INFO:tasks.workunit.client.0.smithi071.stderr: -89> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:47.452 INFO:tasks.workunit.client.0.smithi071.stderr: -88> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:47.453 INFO:tasks.workunit.client.0.smithi071.stderr: -87> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.453 INFO:tasks.workunit.client.0.smithi071.stderr: -86> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.453 INFO:tasks.workunit.client.0.smithi071.stderr: -85> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.453 INFO:tasks.workunit.client.0.smithi071.stderr: -84> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:47.453 INFO:tasks.workunit.client.0.smithi071.stderr: -83> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.453 INFO:tasks.workunit.client.0.smithi071.stderr: -82> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:47.453 INFO:tasks.workunit.client.0.smithi071.stderr: -81> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 zone default found 2024-09-14T11:32:47.453 INFO:tasks.workunit.client.0.smithi071.stderr: -80> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 4 Realm: () 2024-09-14T11:32:47.453 INFO:tasks.workunit.client.0.smithi071.stderr: -79> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:32:47.453 INFO:tasks.workunit.client.0.smithi071.stderr: -78> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:32:47.453 INFO:tasks.workunit.client.0.smithi071.stderr: -77> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:47.453 INFO:tasks.workunit.client.0.smithi071.stderr: -76> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 zonegroup default 2024-09-14T11:32:47.453 INFO:tasks.workunit.client.0.smithi071.stderr: -75> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.453 INFO:tasks.workunit.client.0.smithi071.stderr: -74> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.453 INFO:tasks.workunit.client.0.smithi071.stderr: -73> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.454 INFO:tasks.workunit.client.0.smithi071.stderr: -72> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.454 INFO:tasks.workunit.client.0.smithi071.stderr: -71> 2024-09-14T11:32:47.293+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.454 INFO:tasks.workunit.client.0.smithi071.stderr: -70> 2024-09-14T11:32:47.297+0000 7f075c6ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.454 INFO:tasks.workunit.client.0.smithi071.stderr: -69> 2024-09-14T11:32:47.297+0000 7f075c6ce9c0 20 started sync module instance, tier type = 2024-09-14T11:32:47.454 INFO:tasks.workunit.client.0.smithi071.stderr: -68> 2024-09-14T11:32:47.297+0000 7f075c6ce9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:32:47.454 INFO:tasks.workunit.client.0.smithi071.stderr: -67> 2024-09-14T11:32:47.313+0000 7f075c6ce9c0 20 add_watcher() i=0 2024-09-14T11:32:47.454 INFO:tasks.workunit.client.0.smithi071.stderr: -66> 2024-09-14T11:32:47.313+0000 7f075c6ce9c0 20 add_watcher() i=1 2024-09-14T11:32:47.454 INFO:tasks.workunit.client.0.smithi071.stderr: -65> 2024-09-14T11:32:47.313+0000 7f075c6ce9c0 20 add_watcher() i=2 2024-09-14T11:32:47.454 INFO:tasks.workunit.client.0.smithi071.stderr: -64> 2024-09-14T11:32:47.313+0000 7f075c6ce9c0 20 add_watcher() i=3 2024-09-14T11:32:47.454 INFO:tasks.workunit.client.0.smithi071.stderr: -63> 2024-09-14T11:32:47.313+0000 7f075c6ce9c0 20 add_watcher() i=4 2024-09-14T11:32:47.454 INFO:tasks.workunit.client.0.smithi071.stderr: -62> 2024-09-14T11:32:47.313+0000 7f075c6ce9c0 20 add_watcher() i=5 2024-09-14T11:32:47.454 INFO:tasks.workunit.client.0.smithi071.stderr: -61> 2024-09-14T11:32:47.313+0000 7f075c6ce9c0 20 add_watcher() i=6 2024-09-14T11:32:47.454 INFO:tasks.workunit.client.0.smithi071.stderr: -60> 2024-09-14T11:32:47.317+0000 7f075c6ce9c0 20 add_watcher() i=7 2024-09-14T11:32:47.454 INFO:tasks.workunit.client.0.smithi071.stderr: -59> 2024-09-14T11:32:47.317+0000 7f075c6ce9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:47.455 INFO:tasks.workunit.client.0.smithi071.stderr: -58> 2024-09-14T11:32:47.317+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67810) adding auth protocol: cephx 2024-09-14T11:32:47.455 INFO:tasks.workunit.client.0.smithi071.stderr: -57> 2024-09-14T11:32:47.317+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67810) adding auth protocol: cephx 2024-09-14T11:32:47.455 INFO:tasks.workunit.client.0.smithi071.stderr: -56> 2024-09-14T11:32:47.317+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67810) adding auth protocol: cephx 2024-09-14T11:32:47.455 INFO:tasks.workunit.client.0.smithi071.stderr: -55> 2024-09-14T11:32:47.317+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67810) adding con mode: secure 2024-09-14T11:32:47.455 INFO:tasks.workunit.client.0.smithi071.stderr: -54> 2024-09-14T11:32:47.317+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67810) adding con mode: crc 2024-09-14T11:32:47.455 INFO:tasks.workunit.client.0.smithi071.stderr: -53> 2024-09-14T11:32:47.317+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67810) adding con mode: secure 2024-09-14T11:32:47.455 INFO:tasks.workunit.client.0.smithi071.stderr: -52> 2024-09-14T11:32:47.317+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67810) adding con mode: crc 2024-09-14T11:32:47.455 INFO:tasks.workunit.client.0.smithi071.stderr: -51> 2024-09-14T11:32:47.317+0000 7f0610fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:47.455 INFO:tasks.workunit.client.0.smithi071.stderr: -50> 2024-09-14T11:32:47.317+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67810) adding con mode: secure 2024-09-14T11:32:47.455 INFO:tasks.workunit.client.0.smithi071.stderr: -49> 2024-09-14T11:32:47.317+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67810) adding con mode: crc 2024-09-14T11:32:47.455 INFO:tasks.workunit.client.0.smithi071.stderr: -48> 2024-09-14T11:32:47.317+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67810) adding con mode: crc 2024-09-14T11:32:47.455 INFO:tasks.workunit.client.0.smithi071.stderr: -47> 2024-09-14T11:32:47.317+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67810) adding con mode: secure 2024-09-14T11:32:47.456 INFO:tasks.workunit.client.0.smithi071.stderr: -46> 2024-09-14T11:32:47.317+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67810) adding con mode: crc 2024-09-14T11:32:47.456 INFO:tasks.workunit.client.0.smithi071.stderr: -45> 2024-09-14T11:32:47.317+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67810) adding con mode: secure 2024-09-14T11:32:47.456 INFO:tasks.workunit.client.0.smithi071.stderr: -44> 2024-09-14T11:32:47.317+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67810) adding con mode: crc 2024-09-14T11:32:47.456 INFO:tasks.workunit.client.0.smithi071.stderr: -43> 2024-09-14T11:32:47.317+0000 7f075c6ce9c0 5 AuthRegistry(0x7ffc33f67810) adding con mode: secure 2024-09-14T11:32:47.456 INFO:tasks.workunit.client.0.smithi071.stderr: -42> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:47.456 INFO:tasks.workunit.client.0.smithi071.stderr: -41> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:47.456 INFO:tasks.workunit.client.0.smithi071.stderr: -40> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:47.456 INFO:tasks.workunit.client.0.smithi071.stderr: -39> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 5 asok(0x55f589f14d90) register_command cache list hook 0x55f58a1ecb00 2024-09-14T11:32:47.456 INFO:tasks.workunit.client.0.smithi071.stderr: -38> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 5 asok(0x55f589f14d90) register_command cache inspect hook 0x55f58a1ecb00 2024-09-14T11:32:47.456 INFO:tasks.workunit.client.0.smithi071.stderr: -37> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 5 asok(0x55f589f14d90) register_command cache erase hook 0x55f58a1ecb00 2024-09-14T11:32:47.456 INFO:tasks.workunit.client.0.smithi071.stderr: -36> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 5 asok(0x55f589f14d90) register_command cache zap hook 0x55f58a1ecb00 2024-09-14T11:32:47.456 INFO:tasks.workunit.client.0.smithi071.stderr: -35> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 5 note: GC not initialized 2024-09-14T11:32:47.456 INFO:tasks.workunit.client.0.smithi071.stderr: -34> 2024-09-14T11:32:47.321+0000 7f058b7fe640 20 reqs_thread_entry: start 2024-09-14T11:32:47.456 INFO:tasks.workunit.client.0.smithi071.stderr: -33> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 5 asok(0x55f589f14d90) register_command sync trace show hook 0x7f074c0fc070 2024-09-14T11:32:47.456 INFO:tasks.workunit.client.0.smithi071.stderr: -32> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 5 asok(0x55f589f14d90) register_command sync trace history hook 0x7f074c0fc070 2024-09-14T11:32:47.457 INFO:tasks.workunit.client.0.smithi071.stderr: -31> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 5 asok(0x55f589f14d90) register_command sync trace active hook 0x7f074c0fc070 2024-09-14T11:32:47.457 INFO:tasks.workunit.client.0.smithi071.stderr: -30> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 5 asok(0x55f589f14d90) register_command sync trace active_short hook 0x7f074c0fc070 2024-09-14T11:32:47.457 INFO:tasks.workunit.client.0.smithi071.stderr: -29> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:32:47.457 INFO:tasks.workunit.client.0.smithi071.stderr: -28> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 20 Filter name: none 2024-09-14T11:32:47.457 INFO:tasks.workunit.client.0.smithi071.stderr: -27> 2024-09-14T11:32:47.321+0000 7f05897fa640 20 reqs_thread_entry: start 2024-09-14T11:32:47.457 INFO:tasks.workunit.client.0.smithi071.stderr: -26> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:32:47.457 INFO:tasks.workunit.client.0.smithi071.stderr: -25> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.457 INFO:tasks.workunit.client.0.smithi071.stderr: -24> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:32:47.457 INFO:tasks.workunit.client.0.smithi071.stderr: -23> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:32:47.457 INFO:tasks.workunit.client.0.smithi071.stderr: -22> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:32:47.457 INFO:tasks.workunit.client.0.smithi071.stderr: -21> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 : miss 2024-09-14T11:32:47.457 INFO:tasks.workunit.client.0.smithi071.stderr: -20> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.457 INFO:tasks.workunit.client.0.smithi071.stderr: -19> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:32:47.457 INFO:tasks.workunit.client.0.smithi071.stderr: -18> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 info.flags=0x17 2024-09-14T11:32:47.457 INFO:tasks.workunit.client.0.smithi071.stderr: -17> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 to cache LRU end 2024-09-14T11:32:47.457 INFO:tasks.workunit.client.0.smithi071.stderr: -16> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:47.458 INFO:tasks.workunit.client.0.smithi071.stderr: -15> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:47.458 INFO:tasks.workunit.client.0.smithi071.stderr: -14> 2024-09-14T11:32:47.321+0000 7f075c6ce9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 2024-09-14T11:32:47.458 INFO:tasks.workunit.client.0.smithi071.stderr: -13> 2024-09-14T11:32:47.333+0000 7f075c6ce9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 info.flags=0x17 2024-09-14T11:32:47.458 INFO:tasks.workunit.client.0.smithi071.stderr: -12> 2024-09-14T11:32:47.333+0000 7f075c6ce9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 to cache LRU end 2024-09-14T11:32:47.458 INFO:tasks.workunit.client.0.smithi071.stderr: -11> 2024-09-14T11:32:47.333+0000 7f075c6ce9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:47.458 INFO:tasks.workunit.client.0.smithi071.stderr: -10> 2024-09-14T11:32:47.333+0000 7f075c6ce9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37, ofs0, ns] 2024-09-14T11:32:47.458 INFO:tasks.workunit.client.0.smithi071.stderr: -9> 2024-09-14T11:32:47.333+0000 7f063d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464280 cookie 94513072826384 notifier 7283 bl.length()=1007 2024-09-14T11:32:47.458 INFO:tasks.workunit.client.0.smithi071.stderr: -8> 2024-09-14T11:32:47.333+0000 7f063d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 info.flags=0x17 2024-09-14T11:32:47.458 INFO:tasks.workunit.client.0.smithi071.stderr: -7> 2024-09-14T11:32:47.333+0000 7f063d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 to cache LRU end 2024-09-14T11:32:47.458 INFO:tasks.workunit.client.0.smithi071.stderr: -6> 2024-09-14T11:32:47.333+0000 7f063d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:47.458 INFO:tasks.workunit.client.0.smithi071.stderr: -5> 2024-09-14T11:32:47.333+0000 7f075c6ce9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.37]): orig_sources= new_sources= 2024-09-14T11:32:47.458 INFO:tasks.workunit.client.0.smithi071.stderr: -4> 2024-09-14T11:32:47.333+0000 7f075c6ce9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.37]): potential sources added=[] removed=[] 2024-09-14T11:32:47.458 INFO:tasks.workunit.client.0.smithi071.stderr: -3> 2024-09-14T11:32:47.333+0000 7f075c6ce9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.37]): orig_dests= new_dests= 2024-09-14T11:32:47.458 INFO:tasks.workunit.client.0.smithi071.stderr: -2> 2024-09-14T11:32:47.333+0000 7f075c6ce9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.37]): potential dests added=[] removed=[] 2024-09-14T11:32:47.459 INFO:tasks.workunit.client.0.smithi071.stderr: -1> 2024-09-14T11:32:47.341+0000 7f075c6ce9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f075c6ce9c0 time 2024-09-14T11:32:47.343438+0000 2024-09-14T11:32:47.459 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:32:47.459 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.459 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:47.459 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f075ffa82eb] 2024-09-14T11:32:47.459 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f075ffa849f] 2024-09-14T11:32:47.459 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f587055c01] 2024-09-14T11:32:47.459 INFO:tasks.workunit.client.0.smithi071.stderr: 4: radosgw-admin(+0x142325c) [0x55f587ab425c] 2024-09-14T11:32:47.459 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f58706aecd] 2024-09-14T11:32:47.459 INFO:tasks.workunit.client.0.smithi071.stderr: 6: main() 2024-09-14T11:32:47.459 INFO:tasks.workunit.client.0.smithi071.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f075ee0ed90] 2024-09-14T11:32:47.459 INFO:tasks.workunit.client.0.smithi071.stderr: 8: __libc_start_main() 2024-09-14T11:32:47.459 INFO:tasks.workunit.client.0.smithi071.stderr: 9: _start() 2024-09-14T11:32:47.459 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.459 INFO:tasks.workunit.client.0.smithi071.stderr: 0> 2024-09-14T11:32:47.341+0000 7f075c6ce9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:32:47.460 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f075c6ce9c0 thread_name:radosgw-admin 2024-09-14T11:32:47.460 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.460 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:47.460 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f075ee27520] 2024-09-14T11:32:47.460 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:32:47.460 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:32:47.460 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:32:47.460 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f075ffa8345] 2024-09-14T11:32:47.460 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f075ffa849f] 2024-09-14T11:32:47.460 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f587055c01] 2024-09-14T11:32:47.460 INFO:tasks.workunit.client.0.smithi071.stderr: 8: radosgw-admin(+0x142325c) [0x55f587ab425c] 2024-09-14T11:32:47.460 INFO:tasks.workunit.client.0.smithi071.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f58706aecd] 2024-09-14T11:32:47.460 INFO:tasks.workunit.client.0.smithi071.stderr: 10: main() 2024-09-14T11:32:47.460 INFO:tasks.workunit.client.0.smithi071.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f075ee0ed90] 2024-09-14T11:32:47.460 INFO:tasks.workunit.client.0.smithi071.stderr: 12: __libc_start_main() 2024-09-14T11:32:47.461 INFO:tasks.workunit.client.0.smithi071.stderr: 13: _start() 2024-09-14T11:32:47.461 INFO:tasks.workunit.client.0.smithi071.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:32:47.461 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.461 INFO:tasks.workunit.client.0.smithi071.stderr:--- logging levels --- 2024-09-14T11:32:47.461 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 none 2024-09-14T11:32:47.461 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 lockdep 2024-09-14T11:32:47.461 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 context 2024-09-14T11:32:47.461 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 crush 2024-09-14T11:32:47.461 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds 2024-09-14T11:32:47.461 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_balancer 2024-09-14T11:32:47.461 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_locker 2024-09-14T11:32:47.461 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log 2024-09-14T11:32:47.461 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log_expire 2024-09-14T11:32:47.461 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_migrator 2024-09-14T11:32:47.462 INFO:tasks.workunit.client.0.smithi071.stderr: 3/ 5 mds_quiesce 2024-09-14T11:32:47.462 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 buffer 2024-09-14T11:32:47.462 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 timer 2024-09-14T11:32:47.462 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 filer 2024-09-14T11:32:47.462 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 striper 2024-09-14T11:32:47.462 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 objecter 2024-09-14T11:32:47.462 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rados 2024-09-14T11:32:47.462 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd 2024-09-14T11:32:47.462 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_mirror 2024-09-14T11:32:47.462 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_replay 2024-09-14T11:32:47.462 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_pwl 2024-09-14T11:32:47.462 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 journaler 2024-09-14T11:32:47.462 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objectcacher 2024-09-14T11:32:47.462 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:32:47.462 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 client 2024-09-14T11:32:47.463 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 osd 2024-09-14T11:32:47.463 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 optracker 2024-09-14T11:32:47.463 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objclass 2024-09-14T11:32:47.463 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 filestore 2024-09-14T11:32:47.463 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 journal 2024-09-14T11:32:47.463 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 ms 2024-09-14T11:32:47.463 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mon 2024-09-14T11:32:47.463 INFO:tasks.workunit.client.0.smithi071.stderr: 0/10 monc 2024-09-14T11:32:47.463 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 paxos 2024-09-14T11:32:47.463 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 tp 2024-09-14T11:32:47.463 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 auth 2024-09-14T11:32:47.463 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 crypto 2024-09-14T11:32:47.463 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 finisher 2024-09-14T11:32:47.463 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 reserver 2024-09-14T11:32:47.463 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 heartbeatmap 2024-09-14T11:32:47.463 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 perfcounter 2024-09-14T11:32:47.464 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw 2024-09-14T11:32:47.464 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_sync 2024-09-14T11:32:47.464 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_datacache 2024-09-14T11:32:47.464 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_access 2024-09-14T11:32:47.464 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:32:47.464 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_flight 2024-09-14T11:32:47.464 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:32:47.464 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw_notification 2024-09-14T11:32:47.464 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 javaclient 2024-09-14T11:32:47.464 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 asok 2024-09-14T11:32:47.464 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 throttle 2024-09-14T11:32:47.464 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 refs 2024-09-14T11:32:47.464 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 compressor 2024-09-14T11:32:47.464 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluestore 2024-09-14T11:32:47.464 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluefs 2024-09-14T11:32:47.465 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 bdev 2024-09-14T11:32:47.465 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 kstore 2024-09-14T11:32:47.465 INFO:tasks.workunit.client.0.smithi071.stderr: 4/ 5 rocksdb 2024-09-14T11:32:47.465 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 fuse 2024-09-14T11:32:47.465 INFO:tasks.workunit.client.0.smithi071.stderr: 2/ 5 mgr 2024-09-14T11:32:47.465 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mgrc 2024-09-14T11:32:47.465 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 dpdk 2024-09-14T11:32:47.465 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 eventtrace 2024-09-14T11:32:47.465 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 prioritycache 2024-09-14T11:32:47.465 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 test 2024-09-14T11:32:47.465 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:32:47.465 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephsqlite 2024-09-14T11:32:47.465 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:32:47.465 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore 2024-09-14T11:32:47.465 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_onode 2024-09-14T11:32:47.465 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_odata 2024-09-14T11:32:47.466 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_omap 2024-09-14T11:32:47.466 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_tm 2024-09-14T11:32:47.466 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_t 2024-09-14T11:32:47.466 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:32:47.466 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_epm 2024-09-14T11:32:47.466 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_lba 2024-09-14T11:32:47.466 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:32:47.466 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cache 2024-09-14T11:32:47.466 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_journal 2024-09-14T11:32:47.466 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_device 2024-09-14T11:32:47.466 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_backref 2024-09-14T11:32:47.466 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 alienstore 2024-09-14T11:32:47.466 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mclock 2024-09-14T11:32:47.466 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cyanstore 2024-09-14T11:32:47.466 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 ceph_exporter 2024-09-14T11:32:47.467 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 memstore 2024-09-14T11:32:47.467 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 trace 2024-09-14T11:32:47.467 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 ceph_dedup 2024-09-14T11:32:47.467 INFO:tasks.workunit.client.0.smithi071.stderr: -2/-2 (syslog threshold) 2024-09-14T11:32:47.467 INFO:tasks.workunit.client.0.smithi071.stderr: 99/99 (stderr threshold) 2024-09-14T11:32:47.467 INFO:tasks.workunit.client.0.smithi071.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:32:47.467 INFO:tasks.workunit.client.0.smithi071.stderr: 7f05897fa640 / http_manager 2024-09-14T11:32:47.467 INFO:tasks.workunit.client.0.smithi071.stderr: 7f058b7fe640 / http_manager 2024-09-14T11:32:47.467 INFO:tasks.workunit.client.0.smithi071.stderr: 7f0610fe1640 / rgw_dt_lg_renew 2024-09-14T11:32:47.467 INFO:tasks.workunit.client.0.smithi071.stderr: 7f062bfff640 / ms_dispatch 2024-09-14T11:32:47.467 INFO:tasks.workunit.client.0.smithi071.stderr: 7f063d7fa640 / io_context_pool 2024-09-14T11:32:47.467 INFO:tasks.workunit.client.0.smithi071.stderr: 7f063dffb640 / io_context_pool 2024-09-14T11:32:47.467 INFO:tasks.workunit.client.0.smithi071.stderr: 7f063ffff640 / ms_dispatch 2024-09-14T11:32:47.467 INFO:tasks.workunit.client.0.smithi071.stderr: 7f0646e05640 / ms_dispatch 2024-09-14T11:32:47.467 INFO:tasks.workunit.client.0.smithi071.stderr: 7f0648608640 / io_context_pool 2024-09-14T11:32:47.468 INFO:tasks.workunit.client.0.smithi071.stderr: 7f07599d3640 / msgr-worker-2 2024-09-14T11:32:47.468 INFO:tasks.workunit.client.0.smithi071.stderr: 7f075a1d4640 / msgr-worker-1 2024-09-14T11:32:47.468 INFO:tasks.workunit.client.0.smithi071.stderr: 7f075a9d5640 / msgr-worker-0 2024-09-14T11:32:47.468 INFO:tasks.workunit.client.0.smithi071.stderr: 7f075b1d6640 / io_context_pool 2024-09-14T11:32:47.468 INFO:tasks.workunit.client.0.smithi071.stderr: 7f075c6ce9c0 / radosgw-admin 2024-09-14T11:32:47.468 INFO:tasks.workunit.client.0.smithi071.stderr: max_recent 500 2024-09-14T11:32:47.468 INFO:tasks.workunit.client.0.smithi071.stderr: max_new 1000 2024-09-14T11:32:47.468 INFO:tasks.workunit.client.0.smithi071.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:32:47.345940Z_1c1c011d-2feb-4944-b2c8-480d04708e8a/log 2024-09-14T11:32:47.468 INFO:tasks.workunit.client.0.smithi071.stderr:--- end dump of recent events --- 2024-09-14T11:32:47.468 INFO:tasks.workunit.client.0.smithi071.stderr:Aborted 2024-09-14T11:32:47.468 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:32:47.471 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:47.471 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:47.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.425+0000 7f6ef06b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.429+0000 7f6ef06b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.429+0000 7f6ef06b49c0 20 realm 2024-09-14T11:32:47.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.429+0000 7f6ef06b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.429+0000 7f6ef06b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.429+0000 7f6ef06b49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:47.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.429+0000 7f6ef06b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.429+0000 7f6ef06b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.429+0000 7f6ef06b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.429+0000 7f6ef06b49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:47.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.429+0000 7f6ef06b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.429+0000 7f6ef06b49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:47.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.429+0000 7f6ef06b49c0 20 searching for the correct realm 2024-09-14T11:32:47.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.433+0000 7f6eee9bb640 0 -- 172.21.15.71:0/339208848 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f6ee401e060 msgr2=0x7f6ee40900a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:47.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.441+0000 7f6eee9bb640 0 -- 172.21.15.71:0/339208848 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x558a671e79a0 msgr2=0x558a671e9d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:47.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.449+0000 7f6ef06b49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:47.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.449+0000 7f6ef06b49c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:32:47.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.449+0000 7f6ef06b49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:47.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.449+0000 7f6ef06b49c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:32:47.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.449+0000 7f6ef06b49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:47.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.449+0000 7f6ef06b49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:47.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.449+0000 7f6ef06b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.449+0000 7f6ef06b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.449+0000 7f6ef06b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.449+0000 7f6ef06b49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:47.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.449+0000 7f6ef06b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.449+0000 7f6ef06b49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:47.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.449+0000 7f6ef06b49c0 20 zone default found 2024-09-14T11:32:47.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.449+0000 7f6ef06b49c0 4 Realm: () 2024-09-14T11:32:47.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.449+0000 7f6ef06b49c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:32:47.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.449+0000 7f6ef06b49c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:32:47.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.449+0000 7f6ef06b49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:47.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.449+0000 7f6ef06b49c0 20 zonegroup default 2024-09-14T11:32:47.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.449+0000 7f6ef06b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.449+0000 7f6ef06b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.449+0000 7f6ef06b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.449+0000 7f6ef06b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.449+0000 7f6ef06b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.453+0000 7f6ef06b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.453+0000 7f6ef06b49c0 20 started sync module instance, tier type = 2024-09-14T11:32:47.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.453+0000 7f6ef06b49c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:32:47.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.469+0000 7f6ef06b49c0 20 add_watcher() i=0 2024-09-14T11:32:47.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.469+0000 7f6ef06b49c0 20 add_watcher() i=1 2024-09-14T11:32:47.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.469+0000 7f6ef06b49c0 20 add_watcher() i=2 2024-09-14T11:32:47.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.469+0000 7f6ef06b49c0 20 add_watcher() i=3 2024-09-14T11:32:47.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.469+0000 7f6ef06b49c0 20 add_watcher() i=4 2024-09-14T11:32:47.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.469+0000 7f6ef06b49c0 20 add_watcher() i=5 2024-09-14T11:32:47.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.469+0000 7f6ef06b49c0 20 add_watcher() i=6 2024-09-14T11:32:47.475 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.473+0000 7f6ef06b49c0 20 add_watcher() i=7 2024-09-14T11:32:47.475 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.473+0000 7f6ef06b49c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:47.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.477+0000 7f6da4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:47.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.477+0000 7f6ef06b49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:47.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.477+0000 7f6ef06b49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:47.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.477+0000 7f6ef06b49c0 5 note: GC not initialized 2024-09-14T11:32:47.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.477+0000 7f6d1f7fe640 20 reqs_thread_entry: start 2024-09-14T11:32:47.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.477+0000 7f6ef06b49c0 20 init_complete bucket index max shards: 11 2024-09-14T11:32:47.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.477+0000 7f6ef06b49c0 20 Filter name: none 2024-09-14T11:32:47.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.477+0000 7f6d1d7fa640 20 reqs_thread_entry: start 2024-09-14T11:32:47.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.477+0000 7f6ef06b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.477+0000 7f6ef06b49c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:32:47.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.477+0000 7f6ef06b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.477+0000 7f6ef06b49c0 20 rados_obj.operate() r=0 bl.length=471 2024-09-14T11:32:47.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.477+0000 7f6ef06b49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:47.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.477+0000 7f6ef06b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.477+0000 7f6ef06b49c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:32:47.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.477+0000 7f6ef06b49c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.481+0000 7f6ef06b49c0 20 rados_obj.operate() r=0 bl.length=471 2024-09-14T11:32:47.478 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.481+0000 7f6ef06b49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:47.480 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.481+0000 7f6da4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:47.484 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.485+0000 7f6ef06b49c0 20 remove_watcher() i=0 2024-09-14T11:32:47.484 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.485+0000 7f6ef06b49c0 2 removed watcher, disabling cache 2024-09-14T11:32:47.486 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.489+0000 7f6ef06b49c0 20 remove_watcher() i=1 2024-09-14T11:32:47.487 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.489+0000 7f6ef06b49c0 20 remove_watcher() i=2 2024-09-14T11:32:47.490 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.493+0000 7f6ef06b49c0 20 remove_watcher() i=3 2024-09-14T11:32:47.492 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.493+0000 7f6ef06b49c0 20 remove_watcher() i=4 2024-09-14T11:32:47.493 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.497+0000 7f6ef06b49c0 20 remove_watcher() i=5 2024-09-14T11:32:47.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.497+0000 7f6ef06b49c0 20 remove_watcher() i=6 2024-09-14T11:32:47.499 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.501+0000 7f6ef06b49c0 20 remove_watcher() i=7 2024-09-14T11:32:47.513 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.513 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:32:47.513 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: abort-at-logrecord-writes id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:32:47.513 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:32:47.566 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:32:47.600 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:47.600 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:47.645 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.649+0000 7f65828499c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.647 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.649+0000 7f65828499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.648 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.649+0000 7f65828499c0 20 realm 2024-09-14T11:32:47.648 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.649+0000 7f65828499c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.648 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.649+0000 7f65828499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.648 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.649+0000 7f65828499c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:47.648 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.649+0000 7f65828499c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.649 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.653+0000 7f65828499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.649 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.653+0000 7f65828499c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.649 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.653+0000 7f65828499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:47.650 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.653+0000 7f65828499c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.650 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.653+0000 7f65828499c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:47.650 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.653+0000 7f65828499c0 20 searching for the correct realm 2024-09-14T11:32:47.654 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.657+0000 7f6580b50640 0 -- 172.21.15.71:0/1235564620 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f6568008040 msgr2=0x7f656802f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:47.868 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.869+0000 7f6580b50640 0 -- 172.21.15.71:0/1235564620 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55e715c00750 msgr2=0x55e715c02b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:47.882 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.885+0000 7f65828499c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:47.882 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.885+0000 7f65828499c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:32:47.882 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.885+0000 7f65828499c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:47.882 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.885+0000 7f65828499c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:32:47.882 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.885+0000 7f65828499c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:47.882 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.885+0000 7f65828499c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:47.882 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.885+0000 7f65828499c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.883 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.885+0000 7f65828499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.883 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.885+0000 7f65828499c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.883 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.885+0000 7f65828499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:47.883 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.885+0000 7f65828499c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.884 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.885+0000 7f65828499c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:47.884 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.885+0000 7f65828499c0 20 zone default found 2024-09-14T11:32:47.885 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.885+0000 7f65828499c0 4 Realm: () 2024-09-14T11:32:47.885 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.885+0000 7f65828499c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:32:47.885 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.885+0000 7f65828499c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:32:47.885 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.885+0000 7f65828499c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:47.885 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.885+0000 7f65828499c0 20 zonegroup default 2024-09-14T11:32:47.885 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.885+0000 7f65828499c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.885 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.889+0000 7f65828499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.885 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.889+0000 7f65828499c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.886 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.889+0000 7f65828499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.886 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.889+0000 7f65828499c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.886 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.889+0000 7f65828499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.887 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.889+0000 7f65828499c0 20 started sync module instance, tier type = 2024-09-14T11:32:47.887 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.889+0000 7f65828499c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:32:47.909 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.913+0000 7f65828499c0 20 add_watcher() i=0 2024-09-14T11:32:47.909 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.913+0000 7f65828499c0 20 add_watcher() i=1 2024-09-14T11:32:47.910 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.913+0000 7f65828499c0 20 add_watcher() i=2 2024-09-14T11:32:47.910 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.913+0000 7f65828499c0 20 add_watcher() i=3 2024-09-14T11:32:47.910 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.913+0000 7f65828499c0 20 add_watcher() i=4 2024-09-14T11:32:47.910 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.913+0000 7f65828499c0 20 add_watcher() i=5 2024-09-14T11:32:47.910 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.913+0000 7f65828499c0 20 add_watcher() i=6 2024-09-14T11:32:47.912 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.913+0000 7f65828499c0 20 add_watcher() i=7 2024-09-14T11:32:47.912 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.913+0000 7f65828499c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:47.916 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.917+0000 7f64377de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:47.917 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.921+0000 7f65828499c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:47.917 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.921+0000 7f65828499c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:47.917 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.921+0000 7f65828499c0 5 note: GC not initialized 2024-09-14T11:32:47.918 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.921+0000 7f64367dc640 20 reqs_thread_entry: start 2024-09-14T11:32:47.918 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.921+0000 7f65828499c0 20 init_complete bucket index max shards: 11 2024-09-14T11:32:47.918 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.921+0000 7f65828499c0 20 Filter name: none 2024-09-14T11:32:47.918 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.921+0000 7f642f7fe640 20 reqs_thread_entry: start 2024-09-14T11:32:47.918 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.921+0000 7f65828499c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:32:47.918 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.921+0000 7f65828499c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.919 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.921+0000 7f65828499c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:32:47.919 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.921+0000 7f65828499c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:32:47.919 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.921+0000 7f65828499c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:32:47.919 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.921+0000 7f65828499c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 : miss 2024-09-14T11:32:47.919 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.921+0000 7f65828499c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.921 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.921+0000 7f65828499c0 20 rados_obj.operate() r=0 bl.length=471 2024-09-14T11:32:47.921 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.921+0000 7f65828499c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 info.flags=0x17 2024-09-14T11:32:47.921 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.921+0000 7f65828499c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 to cache LRU end 2024-09-14T11:32:47.921 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.921+0000 7f65828499c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:47.921 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.921+0000 7f65828499c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:47.921 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.925+0000 7f65828499c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 2024-09-14T11:32:47.922 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.925+0000 7f65828499c0 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 to be held by another RGW process; skipping for now 2024-09-14T11:32:47.923 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.925+0000 7f64377de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:47.928 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.929+0000 7f65828499c0 20 remove_watcher() i=0 2024-09-14T11:32:47.928 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.929+0000 7f65828499c0 2 removed watcher, disabling cache 2024-09-14T11:32:47.930 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.933+0000 7f65828499c0 20 remove_watcher() i=1 2024-09-14T11:32:47.932 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.933+0000 7f65828499c0 20 remove_watcher() i=2 2024-09-14T11:32:47.934 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.937+0000 7f65828499c0 20 remove_watcher() i=3 2024-09-14T11:32:47.936 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.937+0000 7f65828499c0 20 remove_watcher() i=4 2024-09-14T11:32:47.938 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.941+0000 7f65828499c0 20 remove_watcher() i=5 2024-09-14T11:32:47.940 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.941+0000 7f65828499c0 20 remove_watcher() i=6 2024-09-14T11:32:47.943 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:32:47.945+0000 7f65828499c0 20 remove_watcher() i=7 2024-09-14T11:32:47.957 INFO:tasks.workunit.client.0.smithi071.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:33:17.986 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:33:18.023 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:18.023 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:18.069 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.073+0000 7fcdfd1d49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:18.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.073+0000 7fcdfd1d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:18.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.073+0000 7fcdfd1d49c0 20 realm 2024-09-14T11:33:18.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.073+0000 7fcdfd1d49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:18.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.073+0000 7fcdfd1d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:18.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.073+0000 7fcdfd1d49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:18.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.073+0000 7fcdfd1d49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:18.073 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.077+0000 7fcdfd1d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:18.073 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.077+0000 7fcdfd1d49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:18.073 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.077+0000 7fcdfd1d49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:18.074 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.077+0000 7fcdfd1d49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:18.074 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.077+0000 7fcdfd1d49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:18.074 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.077+0000 7fcdfd1d49c0 20 searching for the correct realm 2024-09-14T11:33:18.078 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.081+0000 7fcdfb4db640 0 -- 172.21.15.71:0/2239126782 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fcde4069b70 msgr2=0x7fcde4072290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:18.292 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.293+0000 7fcdfb4db640 0 -- 172.21.15.71:0/2239126782 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x5618a5f725f0 msgr2=0x5618a5f749e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:18.307 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.309+0000 7fcdfd1d49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:18.308 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.309+0000 7fcdfd1d49c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:33:18.308 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.309+0000 7fcdfd1d49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:18.308 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.309+0000 7fcdfd1d49c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:33:18.308 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.309+0000 7fcdfd1d49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:18.308 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.309+0000 7fcdfd1d49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:18.308 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.309+0000 7fcdfd1d49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:18.309 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.309+0000 7fcdfd1d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:18.309 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.309+0000 7fcdfd1d49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:18.309 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.313+0000 7fcdfd1d49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:18.309 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.313+0000 7fcdfd1d49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:18.310 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.313+0000 7fcdfd1d49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:18.310 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.313+0000 7fcdfd1d49c0 20 zone default found 2024-09-14T11:33:18.310 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.313+0000 7fcdfd1d49c0 4 Realm: () 2024-09-14T11:33:18.310 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.313+0000 7fcdfd1d49c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:33:18.310 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.313+0000 7fcdfd1d49c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:33:18.310 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.313+0000 7fcdfd1d49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:18.311 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.313+0000 7fcdfd1d49c0 20 zonegroup default 2024-09-14T11:33:18.311 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.313+0000 7fcdfd1d49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:18.311 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.313+0000 7fcdfd1d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:18.311 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.313+0000 7fcdfd1d49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:18.312 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.313+0000 7fcdfd1d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:18.312 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.313+0000 7fcdfd1d49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:18.313 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.317+0000 7fcdfd1d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:18.313 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.317+0000 7fcdfd1d49c0 20 started sync module instance, tier type = 2024-09-14T11:33:18.313 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.317+0000 7fcdfd1d49c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:33:18.335 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.337+0000 7fcdfd1d49c0 20 add_watcher() i=0 2024-09-14T11:33:18.335 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.337+0000 7fcdfd1d49c0 20 add_watcher() i=1 2024-09-14T11:33:18.336 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.337+0000 7fcdfd1d49c0 20 add_watcher() i=2 2024-09-14T11:33:18.336 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.337+0000 7fcdfd1d49c0 20 add_watcher() i=3 2024-09-14T11:33:18.336 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.337+0000 7fcdfd1d49c0 20 add_watcher() i=4 2024-09-14T11:33:18.336 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.337+0000 7fcdfd1d49c0 20 add_watcher() i=5 2024-09-14T11:33:18.336 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.337+0000 7fcdfd1d49c0 20 add_watcher() i=6 2024-09-14T11:33:18.338 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.341+0000 7fcdfd1d49c0 20 add_watcher() i=7 2024-09-14T11:33:18.338 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.341+0000 7fcdfd1d49c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:18.342 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.345+0000 7fccb17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:18.343 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.345+0000 7fcdfd1d49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:18.343 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.345+0000 7fcdfd1d49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:18.344 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.345+0000 7fcdfd1d49c0 5 note: GC not initialized 2024-09-14T11:33:18.344 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.345+0000 7fcc2bfff640 20 reqs_thread_entry: start 2024-09-14T11:33:18.344 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.345+0000 7fcdfd1d49c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:18.344 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.345+0000 7fcdfd1d49c0 20 Filter name: none 2024-09-14T11:33:18.345 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.349+0000 7fcc29ffb640 20 reqs_thread_entry: start 2024-09-14T11:33:18.345 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.349+0000 7fcdfd1d49c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:33:18.345 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.349+0000 7fcdfd1d49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:18.346 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.349+0000 7fcdfd1d49c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:33:18.346 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.349+0000 7fcdfd1d49c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:33:18.346 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.349+0000 7fcdfd1d49c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:33:18.346 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.349+0000 7fcdfd1d49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 : miss 2024-09-14T11:33:18.346 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.349+0000 7fcdfd1d49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:18.347 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.349+0000 7fcdfd1d49c0 20 rados_obj.operate() r=0 bl.length=471 2024-09-14T11:33:18.347 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.349+0000 7fcdfd1d49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 info.flags=0x17 2024-09-14T11:33:18.347 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.349+0000 7fcdfd1d49c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 to cache LRU end 2024-09-14T11:33:18.347 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.349+0000 7fcdfd1d49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:18.347 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.349+0000 7fcdfd1d49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:18.347 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.349+0000 7fcdfd1d49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 2024-09-14T11:33:18.349 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.353+0000 7fcdfd1d49c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:33:18.366 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.369+0000 7fcdfd1d49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 info.flags=0x17 2024-09-14T11:33:18.366 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.369+0000 7fcdfd1d49c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 to cache LRU end 2024-09-14T11:33:18.366 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.369+0000 7fcdfd1d49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:18.366 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.369+0000 7fcdfd1d49c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37, ofs0, ns] 2024-09-14T11:33:18.367 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.369+0000 7fccde7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464281 cookie 94663863682128 notifier 7740 bl.length()=1007 2024-09-14T11:33:18.367 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.369+0000 7fccde7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 info.flags=0x17 2024-09-14T11:33:18.367 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.369+0000 7fccde7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 to cache LRU end 2024-09-14T11:33:18.367 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.369+0000 7fccde7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:18.368 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.369+0000 7fcdfd1d49c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.37]): orig_sources= new_sources= 2024-09-14T11:33:18.368 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.369+0000 7fcdfd1d49c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.37]): potential sources added=[] removed=[] 2024-09-14T11:33:18.368 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.369+0000 7fcdfd1d49c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.37]): orig_dests= new_dests= 2024-09-14T11:33:18.368 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.369+0000 7fcdfd1d49c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.37]): potential dests added=[] removed=[] 2024-09-14T11:33:18.382 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.385+0000 7fcdfd1d49c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.2.0 2024-09-14T11:33:18.382 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.385+0000 7fcdfd1d49c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.2.0 2024-09-14T11:33:18.382 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.385+0000 7fcdfd1d49c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.2.1 2024-09-14T11:33:18.382 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.385+0000 7fcdfd1d49c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.2.1 2024-09-14T11:33:18.382 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.385+0000 7fcdfd1d49c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.2.2 2024-09-14T11:33:18.382 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.385+0000 7fcdfd1d49c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.2.2 2024-09-14T11:33:18.382 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.385+0000 7fcdfd1d49c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.2.3 2024-09-14T11:33:18.382 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.385+0000 7fcdfd1d49c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.2.3 2024-09-14T11:33:18.382 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.385+0000 7fcdfd1d49c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.2.4 2024-09-14T11:33:18.382 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.385+0000 7fcdfd1d49c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.2.4 2024-09-14T11:33:18.383 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.385+0000 7fcdfd1d49c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.2.5 2024-09-14T11:33:18.383 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.385+0000 7fcdfd1d49c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.2.5 2024-09-14T11:33:18.383 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.385+0000 7fcdfd1d49c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.2.6 2024-09-14T11:33:18.383 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.385+0000 7fcdfd1d49c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.2.6 2024-09-14T11:33:18.383 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.385+0000 7fcdfd1d49c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.2.7 2024-09-14T11:33:18.383 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.385+0000 7fcdfd1d49c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.2.7 2024-09-14T11:33:18.383 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.385+0000 7fcdfd1d49c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.2.8 2024-09-14T11:33:18.383 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.385+0000 7fcdfd1d49c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.2.8 2024-09-14T11:33:18.383 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.385+0000 7fcdfd1d49c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.2.9 2024-09-14T11:33:18.383 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.385+0000 7fcdfd1d49c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.2.9 2024-09-14T11:33:18.383 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.385+0000 7fcdfd1d49c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.2.10 2024-09-14T11:33:18.383 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.385+0000 7fcdfd1d49c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.2.10 2024-09-14T11:33:18.383 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.385+0000 7fcdfd1d49c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.2.11 2024-09-14T11:33:18.383 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.385+0000 7fcdfd1d49c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.2.11 2024-09-14T11:33:18.384 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.385+0000 7fcdfd1d49c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.0 2024-09-14T11:33:18.384 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.385+0000 7fcdfd1d49c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.1 2024-09-14T11:33:18.384 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.389+0000 7fcdfd1d49c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.2 2024-09-14T11:33:18.386 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.389+0000 7fcdfd1d49c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.3 2024-09-14T11:33:18.387 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.389+0000 7fcdfd1d49c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.4 2024-09-14T11:33:18.387 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.389+0000 7fcdfd1d49c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.5 2024-09-14T11:33:18.388 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.393+0000 7fcdfd1d49c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.6 2024-09-14T11:33:18.389 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.393+0000 7fcdfd1d49c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.7 2024-09-14T11:33:18.390 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.393+0000 7fcdfd1d49c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.8 2024-09-14T11:33:18.391 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.393+0000 7fcdfd1d49c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.9 2024-09-14T11:33:18.392 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.393+0000 7fcdfd1d49c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.10 2024-09-14T11:33:18.400 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.401+0000 7fcdfd1d49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 : hit (requested=0x17, cached=0x17) 2024-09-14T11:33:18.400 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.401+0000 7fcdfd1d49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 2024-09-14T11:33:18.403 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.405+0000 7fcdfd1d49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 info.flags=0x17 2024-09-14T11:33:18.403 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.405+0000 7fcdfd1d49c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 to cache LRU end 2024-09-14T11:33:18.403 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.405+0000 7fcdfd1d49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:18.403 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.405+0000 7fcdfd1d49c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37, ofs0, ns] 2024-09-14T11:33:18.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.405+0000 7fccddffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464282 cookie 94663863682128 notifier 7740 bl.length()=1007 2024-09-14T11:33:18.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.405+0000 7fccddffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 info.flags=0x17 2024-09-14T11:33:18.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.405+0000 7fccddffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 to cache LRU end 2024-09-14T11:33:18.404 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.405+0000 7fccddffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:18.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.409+0000 7fcdfd1d49c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.37]): orig_sources= new_sources= 2024-09-14T11:33:18.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.409+0000 7fcdfd1d49c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.37]): potential sources added=[] removed=[] 2024-09-14T11:33:18.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.409+0000 7fcdfd1d49c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.37]): orig_dests= new_dests= 2024-09-14T11:33:18.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.409+0000 7fcdfd1d49c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.37]): potential dests added=[] removed=[] 2024-09-14T11:33:18.411 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.413+0000 7fcdfd1d49c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.0 2024-09-14T11:33:18.412 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.413+0000 7fcdfd1d49c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.1 2024-09-14T11:33:18.413 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.417+0000 7fcdfd1d49c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.2 2024-09-14T11:33:18.414 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.417+0000 7fcdfd1d49c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.3 2024-09-14T11:33:18.414 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.417+0000 7fcdfd1d49c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.4 2024-09-14T11:33:18.415 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.417+0000 7fcdfd1d49c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.5 2024-09-14T11:33:18.415 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.417+0000 7fcdfd1d49c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.6 2024-09-14T11:33:18.416 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.417+0000 7fcdfd1d49c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.7 2024-09-14T11:33:18.417 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.421+0000 7fcdfd1d49c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.8 2024-09-14T11:33:18.418 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.421+0000 7fcdfd1d49c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.9 2024-09-14T11:33:18.419 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.421+0000 7fcdfd1d49c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.37.10 2024-09-14T11:33:18.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.425+0000 7fcdfd1d49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 : hit (requested=0x17, cached=0x17) 2024-09-14T11:33:18.421 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.425+0000 7fcdfd1d49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 2024-09-14T11:33:18.425 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.429+0000 7fcdfd1d49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 info.flags=0x17 2024-09-14T11:33:18.425 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.429+0000 7fcdfd1d49c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 to cache LRU end 2024-09-14T11:33:18.425 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.429+0000 7fcdfd1d49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:18.425 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.429+0000 7fcdfd1d49c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37, ofs0, ns] 2024-09-14T11:33:18.425 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.429+0000 7fccddffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464283 cookie 94663863682128 notifier 7740 bl.length()=975 2024-09-14T11:33:18.425 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.429+0000 7fccddffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 info.flags=0x17 2024-09-14T11:33:18.425 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.429+0000 7fccddffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:4444f441-0c56-48df-a905-d49e7e44d629.4596.37 to cache LRU end 2024-09-14T11:33:18.425 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.429+0000 7fccddffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:18.426 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.429+0000 7fcdfd1d49c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.37]): orig_sources= new_sources= 2024-09-14T11:33:18.426 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.429+0000 7fcdfd1d49c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.37]): potential sources added=[] removed=[] 2024-09-14T11:33:18.426 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.429+0000 7fcdfd1d49c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.37]): orig_dests= new_dests= 2024-09-14T11:33:18.427 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.429+0000 7fcdfd1d49c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[4444f441-0c56-48df-a905-d49e7e44d629.4596.37]): potential dests added=[] removed=[] 2024-09-14T11:33:18.433 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.437+0000 7fcdfd1d49c0 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:33:18.436 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.441+0000 7fccb17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:18.441 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.445+0000 7fcdfd1d49c0 20 remove_watcher() i=0 2024-09-14T11:33:18.441 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.445+0000 7fcdfd1d49c0 2 removed watcher, disabling cache 2024-09-14T11:33:18.443 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.445+0000 7fcdfd1d49c0 20 remove_watcher() i=1 2024-09-14T11:33:18.445 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.449+0000 7fcdfd1d49c0 20 remove_watcher() i=2 2024-09-14T11:33:18.447 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.449+0000 7fcdfd1d49c0 20 remove_watcher() i=3 2024-09-14T11:33:18.449 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.453+0000 7fcdfd1d49c0 20 remove_watcher() i=4 2024-09-14T11:33:18.451 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.453+0000 7fcdfd1d49c0 20 remove_watcher() i=5 2024-09-14T11:33:18.454 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.457+0000 7fcdfd1d49c0 20 remove_watcher() i=6 2024-09-14T11:33:18.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.461+0000 7fcdfd1d49c0 20 remove_watcher() i=7 2024-09-14T11:33:18.474 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:33:18.504 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:18.504 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:18.548 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.549+0000 7f1b2457f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:18.550 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.553+0000 7f1b2457f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:18.550 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.553+0000 7f1b2457f9c0 20 realm 2024-09-14T11:33:18.551 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.553+0000 7f1b2457f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:18.551 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.553+0000 7f1b2457f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:18.551 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.553+0000 7f1b2457f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:18.551 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.553+0000 7f1b2457f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:18.552 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.553+0000 7f1b2457f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:18.552 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.553+0000 7f1b2457f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:18.552 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.553+0000 7f1b2457f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:18.552 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.553+0000 7f1b2457f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:18.553 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.557+0000 7f1b2457f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:18.553 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.557+0000 7f1b2457f9c0 20 searching for the correct realm 2024-09-14T11:33:18.558 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.561+0000 7f1b22085640 0 -- 172.21.15.71:0/3847504685 >> [v2:172.21.15.157:6808/527702018,v1:172.21.15.157:6809/527702018] conn(0x7f1b141230b0 msgr2=0x7f1b14101190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:18.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.777+0000 7f1b22085640 0 -- 172.21.15.71:0/3847504685 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x5636563b0f50 msgr2=0x5636563b3410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:18.782 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.785+0000 7f1b2457f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:18.783 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.785+0000 7f1b2457f9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:33:18.783 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.785+0000 7f1b2457f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:18.783 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.785+0000 7f1b2457f9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:33:18.783 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.785+0000 7f1b2457f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:18.783 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.785+0000 7f1b2457f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:18.783 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.785+0000 7f1b2457f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:18.783 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.785+0000 7f1b2457f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:18.783 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.785+0000 7f1b2457f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:18.784 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.785+0000 7f1b2457f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:18.784 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.785+0000 7f1b2457f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:18.785 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.789+0000 7f1b2457f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:18.785 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.789+0000 7f1b2457f9c0 20 zone default found 2024-09-14T11:33:18.785 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.789+0000 7f1b2457f9c0 4 Realm: () 2024-09-14T11:33:18.785 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.789+0000 7f1b2457f9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:33:18.785 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.789+0000 7f1b2457f9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:33:18.785 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.789+0000 7f1b2457f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:18.786 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.789+0000 7f1b2457f9c0 20 zonegroup default 2024-09-14T11:33:18.786 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.789+0000 7f1b2457f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:18.786 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.789+0000 7f1b2457f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:18.786 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.789+0000 7f1b2457f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:18.786 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.789+0000 7f1b2457f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:18.787 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.789+0000 7f1b2457f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:18.787 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.789+0000 7f1b2457f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:18.787 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.789+0000 7f1b2457f9c0 20 started sync module instance, tier type = 2024-09-14T11:33:18.787 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.789+0000 7f1b2457f9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:33:18.810 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.813+0000 7f1b2457f9c0 20 add_watcher() i=0 2024-09-14T11:33:18.810 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.813+0000 7f1b2457f9c0 20 add_watcher() i=1 2024-09-14T11:33:18.810 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.813+0000 7f1b2457f9c0 20 add_watcher() i=2 2024-09-14T11:33:18.810 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.813+0000 7f1b2457f9c0 20 add_watcher() i=3 2024-09-14T11:33:18.810 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.813+0000 7f1b2457f9c0 20 add_watcher() i=4 2024-09-14T11:33:18.810 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.813+0000 7f1b2457f9c0 20 add_watcher() i=5 2024-09-14T11:33:18.810 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.813+0000 7f1b2457f9c0 20 add_watcher() i=6 2024-09-14T11:33:18.812 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.813+0000 7f1b2457f9c0 20 add_watcher() i=7 2024-09-14T11:33:18.812 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.813+0000 7f1b2457f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:18.817 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.821+0000 7f19d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:18.818 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.821+0000 7f1b2457f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:18.818 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.821+0000 7f1b2457f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:18.818 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.821+0000 7f1b2457f9c0 5 note: GC not initialized 2024-09-14T11:33:18.819 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.821+0000 7f19537fe640 20 reqs_thread_entry: start 2024-09-14T11:33:18.819 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.821+0000 7f1b2457f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:18.819 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.821+0000 7f1b2457f9c0 20 Filter name: none 2024-09-14T11:33:18.819 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.821+0000 7f19517fa640 20 reqs_thread_entry: start 2024-09-14T11:33:18.819 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.821+0000 7f1b2457f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:18.819 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.821+0000 7f1b2457f9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:33:18.820 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.821+0000 7f1b2457f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:18.821 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.825+0000 7f1b2457f9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:33:18.821 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.825+0000 7f1b2457f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:18.821 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.825+0000 7f1b2457f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:18.822 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.825+0000 7f1b2457f9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:33:18.822 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.825+0000 7f1b2457f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:18.823 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.825+0000 7f1b2457f9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:33:18.823 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.825+0000 7f1b2457f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:18.827 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.829+0000 7f19d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:18.831 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.833+0000 7f1b2457f9c0 20 remove_watcher() i=0 2024-09-14T11:33:18.831 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.833+0000 7f1b2457f9c0 2 removed watcher, disabling cache 2024-09-14T11:33:18.833 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.837+0000 7f1b2457f9c0 20 remove_watcher() i=1 2024-09-14T11:33:18.834 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.837+0000 7f1b2457f9c0 20 remove_watcher() i=2 2024-09-14T11:33:18.836 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.841+0000 7f1b2457f9c0 20 remove_watcher() i=3 2024-09-14T11:33:18.838 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.841+0000 7f1b2457f9c0 20 remove_watcher() i=4 2024-09-14T11:33:18.840 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.841+0000 7f1b2457f9c0 20 remove_watcher() i=5 2024-09-14T11:33:18.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.845+0000 7f1b2457f9c0 20 remove_watcher() i=6 2024-09-14T11:33:18.845 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:18.849+0000 7f1b2457f9c0 20 remove_watcher() i=7 2024-09-14T11:33:18.860 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:18.860 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:33:18.860 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: abort-at-logrecord-writes id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.37 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:33:18.860 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:18.976 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-14T11:33:18.977 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:19.379 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:33:19.411 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:19.411 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:19.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.461+0000 7f4ae3bb39c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:19.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.461+0000 7f4ae3bb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:19.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.461+0000 7f4ae3bb39c0 20 realm 2024-09-14T11:33:19.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.461+0000 7f4ae3bb39c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:19.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.461+0000 7f4ae3bb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:19.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.461+0000 7f4ae3bb39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:19.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.461+0000 7f4ae3bb39c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:19.461 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.461+0000 7f4ae3bb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:19.461 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.461+0000 7f4ae3bb39c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:19.461 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.465+0000 7f4ae3bb39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:19.461 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.465+0000 7f4ae3bb39c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:19.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.465+0000 7f4ae3bb39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:19.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.465+0000 7f4ae3bb39c0 20 searching for the correct realm 2024-09-14T11:33:19.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.465+0000 7f4ae0eb8640 0 -- 172.21.15.71:0/127181737 >> [v2:172.21.15.71:6824/2436891866,v1:172.21.15.71:6825/2436891866] conn(0x7f4adc090040 msgr2=0x7f4adc04f1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:19.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.473+0000 7f4ae0eb8640 0 -- 172.21.15.71:0/127181737 >> [v2:172.21.15.71:6808/1268087573,v1:172.21.15.71:6809/1268087573] conn(0x5626b430b280 msgr2=0x5626b430d670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:19.481 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.485+0000 7f4ae3bb39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:19.481 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.485+0000 7f4ae3bb39c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:33:19.481 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.485+0000 7f4ae3bb39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:19.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.485+0000 7f4ae3bb39c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:33:19.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.485+0000 7f4ae3bb39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:19.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.485+0000 7f4ae3bb39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:19.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.485+0000 7f4ae3bb39c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:19.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.485+0000 7f4ae3bb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:19.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.485+0000 7f4ae3bb39c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:19.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.485+0000 7f4ae3bb39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:19.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.485+0000 7f4ae3bb39c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:19.483 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.485+0000 7f4ae3bb39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:19.483 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.485+0000 7f4ae3bb39c0 20 zone default found 2024-09-14T11:33:19.483 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.485+0000 7f4ae3bb39c0 4 Realm: () 2024-09-14T11:33:19.483 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.485+0000 7f4ae3bb39c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:33:19.483 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.485+0000 7f4ae3bb39c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:33:19.483 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.485+0000 7f4ae3bb39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:19.483 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.485+0000 7f4ae3bb39c0 20 zonegroup default 2024-09-14T11:33:19.483 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.485+0000 7f4ae3bb39c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:19.484 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.485+0000 7f4ae3bb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:19.484 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.485+0000 7f4ae3bb39c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:19.484 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.485+0000 7f4ae3bb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:19.484 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.485+0000 7f4ae3bb39c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:19.485 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.489+0000 7f4ae3bb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:19.485 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.489+0000 7f4ae3bb39c0 20 started sync module instance, tier type = 2024-09-14T11:33:19.485 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.489+0000 7f4ae3bb39c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:33:19.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.505+0000 7f4ae3bb39c0 20 add_watcher() i=0 2024-09-14T11:33:19.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.505+0000 7f4ae3bb39c0 20 add_watcher() i=1 2024-09-14T11:33:19.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.505+0000 7f4ae3bb39c0 20 add_watcher() i=2 2024-09-14T11:33:19.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.505+0000 7f4ae3bb39c0 20 add_watcher() i=3 2024-09-14T11:33:19.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.505+0000 7f4ae3bb39c0 20 add_watcher() i=4 2024-09-14T11:33:19.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.505+0000 7f4ae3bb39c0 20 add_watcher() i=5 2024-09-14T11:33:19.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.505+0000 7f4ae3bb39c0 20 add_watcher() i=6 2024-09-14T11:33:19.506 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.509+0000 7f4ae3bb39c0 20 add_watcher() i=7 2024-09-14T11:33:19.506 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.509+0000 7f4ae3bb39c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:19.509 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.513+0000 7f49937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:19.510 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.513+0000 7f4ae3bb39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:19.510 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.513+0000 7f4ae3bb39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:19.510 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.513+0000 7f4ae3bb39c0 5 note: GC not initialized 2024-09-14T11:33:19.510 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.513+0000 7f49927e4640 20 reqs_thread_entry: start 2024-09-14T11:33:19.510 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.513+0000 7f4ae3bb39c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:19.510 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.513+0000 7f4ae3bb39c0 20 Filter name: none 2024-09-14T11:33:19.510 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.513+0000 7f4903fff640 20 reqs_thread_entry: start 2024-09-14T11:33:19.510 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.513+0000 7f4ae3bb39c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:19.511 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.513+0000 7f4ae3bb39c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:19.511 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.513+0000 7f4ae3bb39c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:19.511 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.513+0000 7f4ae3bb39c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:19.511 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.513+0000 7f4ae3bb39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:19.511 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.513+0000 7f4ae3bb39c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:19.511 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.513+0000 7f4ae3bb39c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:19.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.513+0000 7f4ae3bb39c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:19.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.513+0000 7f4ae3bb39c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:19.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.513+0000 7f4ae3bb39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:19.514 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.517+0000 7f49937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:19.518 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.521+0000 7f4ae3bb39c0 20 remove_watcher() i=0 2024-09-14T11:33:19.518 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.521+0000 7f4ae3bb39c0 2 removed watcher, disabling cache 2024-09-14T11:33:19.520 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.521+0000 7f4ae3bb39c0 20 remove_watcher() i=1 2024-09-14T11:33:19.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.525+0000 7f4ae3bb39c0 20 remove_watcher() i=2 2024-09-14T11:33:19.524 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.525+0000 7f4ae3bb39c0 20 remove_watcher() i=3 2024-09-14T11:33:19.526 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.529+0000 7f4ae3bb39c0 20 remove_watcher() i=4 2024-09-14T11:33:19.528 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.529+0000 7f4ae3bb39c0 20 remove_watcher() i=5 2024-09-14T11:33:19.530 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.533+0000 7f4ae3bb39c0 20 remove_watcher() i=6 2024-09-14T11:33:19.534 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.537+0000 7f4ae3bb39c0 20 remove_watcher() i=7 2024-09-14T11:33:19.547 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:19.547 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:33:19.547 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: error-at-change-reshard-state id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:33:19.547 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:19.548 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-14T11:33:19.580 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:19.580 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:19.625 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.629+0000 7f841119d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:19.627 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.629+0000 7f841119d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:19.627 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.629+0000 7f841119d9c0 20 realm 2024-09-14T11:33:19.627 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.629+0000 7f841119d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:19.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.629+0000 7f841119d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:19.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.629+0000 7f841119d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:19.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.629+0000 7f841119d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:19.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.629+0000 7f841119d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:19.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.629+0000 7f841119d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:19.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.633+0000 7f841119d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:19.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.633+0000 7f841119d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:19.630 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.633+0000 7f841119d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:19.630 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.633+0000 7f841119d9c0 20 searching for the correct realm 2024-09-14T11:33:19.632 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.633+0000 7f840e4a2640 0 -- 172.21.15.71:0/3838141631 >> [v2:172.21.15.71:6824/2436891866,v1:172.21.15.71:6825/2436891866] conn(0x7f84000b0070 msgr2=0x7f84000d2940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:19.844 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.845+0000 7f840f4a4640 0 -- 172.21.15.71:0/3838141631 >> [v2:172.21.15.157:6816/1231501119,v1:172.21.15.157:6817/1231501119] conn(0x562b48256910 msgr2=0x562b48258dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:19.861 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.865+0000 7f841119d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:19.861 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.865+0000 7f841119d9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:33:19.861 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.865+0000 7f841119d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:19.861 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.865+0000 7f841119d9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:33:19.861 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.865+0000 7f841119d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:19.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.865+0000 7f841119d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:19.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.865+0000 7f841119d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:19.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.865+0000 7f841119d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:19.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.865+0000 7f841119d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:19.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.865+0000 7f841119d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:19.863 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.865+0000 7f841119d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:19.864 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.865+0000 7f841119d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:19.864 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.865+0000 7f841119d9c0 20 zone default found 2024-09-14T11:33:19.864 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.865+0000 7f841119d9c0 4 Realm: () 2024-09-14T11:33:19.864 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.865+0000 7f841119d9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:33:19.864 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.865+0000 7f841119d9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:33:19.864 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.865+0000 7f841119d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:19.864 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.865+0000 7f841119d9c0 20 zonegroup default 2024-09-14T11:33:19.865 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.865+0000 7f841119d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:19.865 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.869+0000 7f841119d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:19.865 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.869+0000 7f841119d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:19.865 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.869+0000 7f841119d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:19.865 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.869+0000 7f841119d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:19.866 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.869+0000 7f841119d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:19.866 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.869+0000 7f841119d9c0 20 started sync module instance, tier type = 2024-09-14T11:33:19.866 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.869+0000 7f841119d9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:33:19.889 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.893+0000 7f841119d9c0 20 add_watcher() i=0 2024-09-14T11:33:19.889 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.893+0000 7f841119d9c0 20 add_watcher() i=1 2024-09-14T11:33:19.889 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.893+0000 7f841119d9c0 20 add_watcher() i=2 2024-09-14T11:33:19.889 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.893+0000 7f841119d9c0 20 add_watcher() i=3 2024-09-14T11:33:19.889 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.893+0000 7f841119d9c0 20 add_watcher() i=4 2024-09-14T11:33:19.889 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.893+0000 7f841119d9c0 20 add_watcher() i=5 2024-09-14T11:33:19.889 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.893+0000 7f841119d9c0 20 add_watcher() i=6 2024-09-14T11:33:19.891 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.893+0000 7f841119d9c0 20 add_watcher() i=7 2024-09-14T11:33:19.891 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.893+0000 7f841119d9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:19.896 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.897+0000 7f82c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:19.897 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.901+0000 7f841119d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:19.897 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.901+0000 7f841119d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:19.897 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.901+0000 7f841119d9c0 5 note: GC not initialized 2024-09-14T11:33:19.898 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.901+0000 7f823ffff640 20 reqs_thread_entry: start 2024-09-14T11:33:19.898 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.901+0000 7f841119d9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:19.898 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.901+0000 7f841119d9c0 20 Filter name: none 2024-09-14T11:33:19.898 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.901+0000 7f823dffb640 20 reqs_thread_entry: start 2024-09-14T11:33:19.898 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.901+0000 7f841119d9c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:33:19.898 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.901+0000 7f841119d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:19.899 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.901+0000 7f841119d9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:19.899 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.901+0000 7f841119d9c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:33:19.899 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.901+0000 7f841119d9c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:33:19.899 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.901+0000 7f841119d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38 : miss 2024-09-14T11:33:19.899 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.901+0000 7f841119d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:19.899 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.901+0000 7f841119d9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:19.900 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.901+0000 7f841119d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38 info.flags=0x17 2024-09-14T11:33:19.900 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.901+0000 7f841119d9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38 to cache LRU end 2024-09-14T11:33:19.900 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.901+0000 7f841119d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:19.900 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.901+0000 7f841119d9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:19.900 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.901+0000 7f841119d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38 2024-09-14T11:33:19.911 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.913+0000 7f841119d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38 info.flags=0x17 2024-09-14T11:33:19.911 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.913+0000 7f841119d9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38 to cache LRU end 2024-09-14T11:33:19.911 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.913+0000 7f841119d9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:19.911 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.913+0000 7f841119d9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38, ofs0, ns] 2024-09-14T11:33:19.911 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.913+0000 7f82f1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464410 cookie 94743894063264 notifier 7788 bl.length()=1015 2024-09-14T11:33:19.911 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.913+0000 7f82f1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38 info.flags=0x17 2024-09-14T11:33:19.911 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.913+0000 7f82f1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38 to cache LRU end 2024-09-14T11:33:19.912 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.913+0000 7f82f1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:19.912 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.913+0000 7f841119d9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.38]): orig_sources= new_sources= 2024-09-14T11:33:19.912 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.913+0000 7f841119d9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.38]): potential sources added=[] removed=[] 2024-09-14T11:33:19.912 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.913+0000 7f841119d9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.38]): orig_dests= new_dests= 2024-09-14T11:33:19.912 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.913+0000 7f841119d9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.38]): potential dests added=[] removed=[] 2024-09-14T11:33:19.923 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.925+0000 7f841119d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.0 2024-09-14T11:33:19.923 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.925+0000 7f841119d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.0 2024-09-14T11:33:19.924 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.925+0000 7f841119d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.1 2024-09-14T11:33:19.924 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.925+0000 7f841119d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.1 2024-09-14T11:33:19.924 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.925+0000 7f841119d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.2 2024-09-14T11:33:19.924 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.925+0000 7f841119d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.2 2024-09-14T11:33:19.924 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.925+0000 7f841119d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.3 2024-09-14T11:33:19.924 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.925+0000 7f841119d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.3 2024-09-14T11:33:19.924 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.925+0000 7f841119d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.4 2024-09-14T11:33:19.924 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.925+0000 7f841119d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.4 2024-09-14T11:33:19.924 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.925+0000 7f841119d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.5 2024-09-14T11:33:19.924 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.925+0000 7f841119d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.5 2024-09-14T11:33:19.924 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.925+0000 7f841119d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.6 2024-09-14T11:33:19.924 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.925+0000 7f841119d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.6 2024-09-14T11:33:19.924 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.925+0000 7f841119d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.7 2024-09-14T11:33:19.925 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.925+0000 7f841119d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.7 2024-09-14T11:33:19.925 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.925+0000 7f841119d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.8 2024-09-14T11:33:19.925 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.925+0000 7f841119d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.8 2024-09-14T11:33:19.925 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.925+0000 7f841119d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.9 2024-09-14T11:33:19.925 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.925+0000 7f841119d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.9 2024-09-14T11:33:19.925 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.925+0000 7f841119d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.10 2024-09-14T11:33:19.925 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.925+0000 7f841119d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.10 2024-09-14T11:33:19.925 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.925+0000 7f841119d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.11 2024-09-14T11:33:19.925 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.925+0000 7f841119d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.11 2024-09-14T11:33:19.925 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.925+0000 7f841119d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.0 2024-09-14T11:33:19.926 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.925+0000 7f841119d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1 2024-09-14T11:33:19.926 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.929+0000 7f841119d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.2 2024-09-14T11:33:19.926 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.929+0000 7f841119d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.3 2024-09-14T11:33:19.926 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.929+0000 7f841119d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.4 2024-09-14T11:33:19.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.929+0000 7f841119d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.5 2024-09-14T11:33:19.928 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.929+0000 7f841119d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.6 2024-09-14T11:33:19.929 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.933+0000 7f841119d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.7 2024-09-14T11:33:19.929 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.933+0000 7f841119d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.8 2024-09-14T11:33:19.931 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.933+0000 7f841119d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.9 2024-09-14T11:33:19.931 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.933+0000 7f841119d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.10 2024-09-14T11:33:19.941 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.945+0000 7f841119d9c0 -1 Injecting error=-5 at location=change_reshard_state 2024-09-14T11:33:19.941 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.945+0000 7f841119d9c0 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-14T11:33:19.959 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.961+0000 7f841119d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38 : hit (requested=0x17, cached=0x17) 2024-09-14T11:33:19.959 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.961+0000 7f841119d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38 2024-09-14T11:33:19.962 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.965+0000 7f841119d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38 info.flags=0x17 2024-09-14T11:33:19.962 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.965+0000 7f841119d9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38 to cache LRU end 2024-09-14T11:33:19.962 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.965+0000 7f841119d9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:19.962 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.965+0000 7f841119d9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38, ofs0, ns] 2024-09-14T11:33:19.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.965+0000 7f82f1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464411 cookie 94743894063264 notifier 7788 bl.length()=983 2024-09-14T11:33:19.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.965+0000 7f82f1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38 info.flags=0x17 2024-09-14T11:33:19.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.965+0000 7f82f1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38 to cache LRU end 2024-09-14T11:33:19.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.965+0000 7f82f1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:19.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.965+0000 7f841119d9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.38]): orig_sources= new_sources= 2024-09-14T11:33:19.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.965+0000 7f841119d9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.38]): potential sources added=[] removed=[] 2024-09-14T11:33:19.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.965+0000 7f841119d9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.38]): orig_dests= new_dests= 2024-09-14T11:33:19.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.965+0000 7f841119d9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.38]): potential dests added=[] removed=[] 2024-09-14T11:33:19.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.965+0000 7f841119d9c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-14T11:33:19.966 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.969+0000 7f82c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:19.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.973+0000 7f841119d9c0 20 remove_watcher() i=0 2024-09-14T11:33:19.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.973+0000 7f841119d9c0 2 removed watcher, disabling cache 2024-09-14T11:33:19.972 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.973+0000 7f841119d9c0 20 remove_watcher() i=1 2024-09-14T11:33:19.974 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.977+0000 7f841119d9c0 20 remove_watcher() i=2 2024-09-14T11:33:19.976 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.977+0000 7f841119d9c0 20 remove_watcher() i=3 2024-09-14T11:33:19.978 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.981+0000 7f841119d9c0 20 remove_watcher() i=4 2024-09-14T11:33:19.979 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.981+0000 7f841119d9c0 20 remove_watcher() i=5 2024-09-14T11:33:19.982 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.985+0000 7f841119d9c0 20 remove_watcher() i=6 2024-09-14T11:33:19.985 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:19.989+0000 7f841119d9c0 20 remove_watcher() i=7 2024-09-14T11:33:20.003 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:33:20.032 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:20.033 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:20.076 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.077+0000 7f0ed78529c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:20.078 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.081+0000 7f0ed78529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:20.078 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.081+0000 7f0ed78529c0 20 realm 2024-09-14T11:33:20.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.081+0000 7f0ed78529c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:20.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.081+0000 7f0ed78529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:20.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.081+0000 7f0ed78529c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:20.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.081+0000 7f0ed78529c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:20.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.081+0000 7f0ed78529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:20.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.081+0000 7f0ed78529c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:20.080 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.081+0000 7f0ed78529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:20.080 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.081+0000 7f0ed78529c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:20.081 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.085+0000 7f0ed78529c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:20.081 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.085+0000 7f0ed78529c0 20 searching for the correct realm 2024-09-14T11:33:20.086 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.089+0000 7f0ed5358640 0 -- 172.21.15.71:0/2562242488 >> [v2:172.21.15.157:6808/527702018,v1:172.21.15.157:6809/527702018] conn(0x7f0ec8071b00 msgr2=0x7f0ec80867d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:20.302 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.305+0000 7f0ed5358640 0 -- 172.21.15.71:0/2562242488 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x55f9ecf5c390 msgr2=0x55f9ecf5e830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:20.513 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.513+0000 7f0ed78529c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:20.513 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.513+0000 7f0ed78529c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:33:20.513 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.513+0000 7f0ed78529c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:20.513 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.517+0000 7f0ed78529c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:33:20.513 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.517+0000 7f0ed78529c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:20.513 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.517+0000 7f0ed78529c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:20.513 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.517+0000 7f0ed78529c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:20.514 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.517+0000 7f0ed78529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:20.514 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.517+0000 7f0ed78529c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:20.514 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.517+0000 7f0ed78529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:20.514 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.517+0000 7f0ed78529c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:20.515 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.517+0000 7f0ed78529c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:20.515 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.517+0000 7f0ed78529c0 20 zone default found 2024-09-14T11:33:20.515 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.517+0000 7f0ed78529c0 4 Realm: () 2024-09-14T11:33:20.515 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.517+0000 7f0ed78529c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:33:20.515 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.517+0000 7f0ed78529c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:33:20.516 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.517+0000 7f0ed78529c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:20.516 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.517+0000 7f0ed78529c0 20 zonegroup default 2024-09-14T11:33:20.516 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.517+0000 7f0ed78529c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:20.516 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.517+0000 7f0ed78529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:20.516 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.517+0000 7f0ed78529c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:20.517 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.521+0000 7f0ed78529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:20.517 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.521+0000 7f0ed78529c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:20.517 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.521+0000 7f0ed78529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:20.518 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.521+0000 7f0ed78529c0 20 started sync module instance, tier type = 2024-09-14T11:33:20.518 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.521+0000 7f0ed78529c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:33:20.540 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.541+0000 7f0ed78529c0 20 add_watcher() i=0 2024-09-14T11:33:20.540 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.541+0000 7f0ed78529c0 20 add_watcher() i=1 2024-09-14T11:33:20.540 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.541+0000 7f0ed78529c0 20 add_watcher() i=2 2024-09-14T11:33:20.540 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.541+0000 7f0ed78529c0 20 add_watcher() i=3 2024-09-14T11:33:20.540 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.541+0000 7f0ed78529c0 20 add_watcher() i=4 2024-09-14T11:33:20.540 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.541+0000 7f0ed78529c0 20 add_watcher() i=5 2024-09-14T11:33:20.540 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.541+0000 7f0ed78529c0 20 add_watcher() i=6 2024-09-14T11:33:20.542 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.545+0000 7f0ed78529c0 20 add_watcher() i=7 2024-09-14T11:33:20.542 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.545+0000 7f0ed78529c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:20.546 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.549+0000 7f0d8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:20.547 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.549+0000 7f0ed78529c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:20.547 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.549+0000 7f0ed78529c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:20.547 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.549+0000 7f0ed78529c0 5 note: GC not initialized 2024-09-14T11:33:20.548 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.549+0000 7f0d8a7e4640 20 reqs_thread_entry: start 2024-09-14T11:33:20.548 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.549+0000 7f0ed78529c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:20.549 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.549+0000 7f0ed78529c0 20 Filter name: none 2024-09-14T11:33:20.549 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.553+0000 7f0cfbfff640 20 reqs_thread_entry: start 2024-09-14T11:33:20.549 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.553+0000 7f0ed78529c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:20.549 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.553+0000 7f0ed78529c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:20.549 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.553+0000 7f0ed78529c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:20.550 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.553+0000 7f0ed78529c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:20.550 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.553+0000 7f0ed78529c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:20.551 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.553+0000 7f0ed78529c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:20.551 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.553+0000 7f0ed78529c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:20.551 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.553+0000 7f0ed78529c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:20.551 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.553+0000 7f0ed78529c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:20.551 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.553+0000 7f0ed78529c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:20.556 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.557+0000 7f0d8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:20.558 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.561+0000 7f0ed78529c0 20 remove_watcher() i=0 2024-09-14T11:33:20.558 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.561+0000 7f0ed78529c0 2 removed watcher, disabling cache 2024-09-14T11:33:20.560 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.561+0000 7f0ed78529c0 20 remove_watcher() i=1 2024-09-14T11:33:20.563 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.565+0000 7f0ed78529c0 20 remove_watcher() i=2 2024-09-14T11:33:20.565 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.569+0000 7f0ed78529c0 20 remove_watcher() i=3 2024-09-14T11:33:20.567 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.569+0000 7f0ed78529c0 20 remove_watcher() i=4 2024-09-14T11:33:20.569 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.573+0000 7f0ed78529c0 20 remove_watcher() i=5 2024-09-14T11:33:20.572 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.573+0000 7f0ed78529c0 20 remove_watcher() i=6 2024-09-14T11:33:20.575 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.577+0000 7f0ed78529c0 20 remove_watcher() i=7 2024-09-14T11:33:20.589 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:20.590 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:33:20.590 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: error-at-change-reshard-state id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:33:20.590 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:20.646 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:33:20.682 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:20.682 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:20.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.729+0000 7f89c744f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:20.730 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.733+0000 7f89c744f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:20.730 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.733+0000 7f89c744f9c0 20 realm 2024-09-14T11:33:20.730 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.733+0000 7f89c744f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:20.731 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.733+0000 7f89c744f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:20.731 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.733+0000 7f89c744f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:20.731 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.733+0000 7f89c744f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:20.731 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.733+0000 7f89c744f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:20.731 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.733+0000 7f89c744f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:20.732 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.737+0000 7f89c744f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:20.732 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.737+0000 7f89c744f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:20.733 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.737+0000 7f89c744f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:20.733 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.737+0000 7f89c744f9c0 20 searching for the correct realm 2024-09-14T11:33:20.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.741+0000 7f89c5756640 0 -- 172.21.15.71:0/2526302894 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f89ac0e83f0 msgr2=0x7f89ac0e8850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:20.952 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.953+0000 7f89c5756640 0 -- 172.21.15.71:0/2526302894 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55f119042900 msgr2=0x55f119044cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:20.966 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.969+0000 7f89c744f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:20.966 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.969+0000 7f89c744f9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:33:20.966 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.969+0000 7f89c744f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:20.967 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.969+0000 7f89c744f9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:33:20.967 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.969+0000 7f89c744f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:20.967 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.969+0000 7f89c744f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:20.967 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.969+0000 7f89c744f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:20.967 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.969+0000 7f89c744f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:20.967 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.969+0000 7f89c744f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:20.968 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.969+0000 7f89c744f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:20.968 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.969+0000 7f89c744f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:20.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.973+0000 7f89c744f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:20.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.973+0000 7f89c744f9c0 20 zone default found 2024-09-14T11:33:20.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.973+0000 7f89c744f9c0 4 Realm: () 2024-09-14T11:33:20.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.973+0000 7f89c744f9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:33:20.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.973+0000 7f89c744f9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:33:20.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.973+0000 7f89c744f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:20.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.973+0000 7f89c744f9c0 20 zonegroup default 2024-09-14T11:33:20.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.973+0000 7f89c744f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:20.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.973+0000 7f89c744f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:20.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.973+0000 7f89c744f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:20.971 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.973+0000 7f89c744f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:20.971 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.973+0000 7f89c744f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:20.972 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.973+0000 7f89c744f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:20.972 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.973+0000 7f89c744f9c0 20 started sync module instance, tier type = 2024-09-14T11:33:20.972 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.973+0000 7f89c744f9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:33:20.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.997+0000 7f89c744f9c0 20 add_watcher() i=0 2024-09-14T11:33:20.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.997+0000 7f89c744f9c0 20 add_watcher() i=1 2024-09-14T11:33:20.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.997+0000 7f89c744f9c0 20 add_watcher() i=2 2024-09-14T11:33:20.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.997+0000 7f89c744f9c0 20 add_watcher() i=3 2024-09-14T11:33:20.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.997+0000 7f89c744f9c0 20 add_watcher() i=4 2024-09-14T11:33:20.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.997+0000 7f89c744f9c0 20 add_watcher() i=5 2024-09-14T11:33:20.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.997+0000 7f89c744f9c0 20 add_watcher() i=6 2024-09-14T11:33:20.996 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.997+0000 7f89c744f9c0 20 add_watcher() i=7 2024-09-14T11:33:20.996 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:20.997+0000 7f89c744f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:21.000 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.005+0000 7f887b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:21.002 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.005+0000 7f89c744f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:21.002 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.005+0000 7f89c744f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:21.002 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.005+0000 7f89c744f9c0 5 note: GC not initialized 2024-09-14T11:33:21.002 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.005+0000 7f887a7e4640 20 reqs_thread_entry: start 2024-09-14T11:33:21.002 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.005+0000 7f89c744f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:21.003 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.005+0000 7f89c744f9c0 20 Filter name: none 2024-09-14T11:33:21.003 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.005+0000 7f88737fe640 20 reqs_thread_entry: start 2024-09-14T11:33:21.003 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.005+0000 7f89c744f9c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:33:21.003 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.005+0000 7f89c744f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:21.004 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.005+0000 7f89c744f9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:21.004 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.005+0000 7f89c744f9c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:33:21.004 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.005+0000 7f89c744f9c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:33:21.004 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.005+0000 7f89c744f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38 : miss 2024-09-14T11:33:21.004 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.005+0000 7f89c744f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:21.005 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.009+0000 7f89c744f9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:21.005 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.009+0000 7f89c744f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38 info.flags=0x17 2024-09-14T11:33:21.005 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.009+0000 7f89c744f9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38 to cache LRU end 2024-09-14T11:33:21.005 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.009+0000 7f89c744f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:21.005 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.009+0000 7f89c744f9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:21.005 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.009+0000 7f89c744f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38 2024-09-14T11:33:21.016 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.017+0000 7f89c744f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38 info.flags=0x17 2024-09-14T11:33:21.016 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.017+0000 7f89c744f9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38 to cache LRU end 2024-09-14T11:33:21.016 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.017+0000 7f89c744f9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:21.016 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.017+0000 7f89c744f9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38, ofs0, ns] 2024-09-14T11:33:21.017 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.017+0000 7f889b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464412 cookie 94493995188368 notifier 7821 bl.length()=1015 2024-09-14T11:33:21.017 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.017+0000 7f889b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38 info.flags=0x17 2024-09-14T11:33:21.017 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.017+0000 7f889b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38 to cache LRU end 2024-09-14T11:33:21.017 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.017+0000 7f889b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:21.017 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.021+0000 7f89c744f9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.38]): orig_sources= new_sources= 2024-09-14T11:33:21.017 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.021+0000 7f89c744f9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.38]): potential sources added=[] removed=[] 2024-09-14T11:33:21.017 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.021+0000 7f89c744f9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.38]): orig_dests= new_dests= 2024-09-14T11:33:21.017 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.021+0000 7f89c744f9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.38]): potential dests added=[] removed=[] 2024-09-14T11:33:21.026 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.029+0000 7f89c744f9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.0 2024-09-14T11:33:21.026 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.029+0000 7f89c744f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.0 2024-09-14T11:33:21.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.029+0000 7f89c744f9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.1 2024-09-14T11:33:21.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.029+0000 7f89c744f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.1 2024-09-14T11:33:21.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.029+0000 7f89c744f9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.2 2024-09-14T11:33:21.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.029+0000 7f89c744f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.2 2024-09-14T11:33:21.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.029+0000 7f89c744f9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.3 2024-09-14T11:33:21.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.029+0000 7f89c744f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.3 2024-09-14T11:33:21.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.029+0000 7f89c744f9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.4 2024-09-14T11:33:21.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.029+0000 7f89c744f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.4 2024-09-14T11:33:21.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.029+0000 7f89c744f9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.5 2024-09-14T11:33:21.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.029+0000 7f89c744f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.5 2024-09-14T11:33:21.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.029+0000 7f89c744f9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.6 2024-09-14T11:33:21.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.029+0000 7f89c744f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.6 2024-09-14T11:33:21.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.029+0000 7f89c744f9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.7 2024-09-14T11:33:21.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.029+0000 7f89c744f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.7 2024-09-14T11:33:21.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.029+0000 7f89c744f9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.8 2024-09-14T11:33:21.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.029+0000 7f89c744f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.8 2024-09-14T11:33:21.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.029+0000 7f89c744f9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.9 2024-09-14T11:33:21.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.029+0000 7f89c744f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.9 2024-09-14T11:33:21.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.029+0000 7f89c744f9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.10 2024-09-14T11:33:21.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.029+0000 7f89c744f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.10 2024-09-14T11:33:21.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.029+0000 7f89c744f9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.11 2024-09-14T11:33:21.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.029+0000 7f89c744f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1.11 2024-09-14T11:33:21.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.029+0000 7f89c744f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.0 2024-09-14T11:33:21.029 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.029+0000 7f89c744f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1 2024-09-14T11:33:21.029 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.029+0000 7f89c744f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.2 2024-09-14T11:33:21.029 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.033+0000 7f89c744f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.3 2024-09-14T11:33:21.029 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.033+0000 7f89c744f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.4 2024-09-14T11:33:21.030 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.033+0000 7f89c744f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.5 2024-09-14T11:33:21.031 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.033+0000 7f89c744f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.6 2024-09-14T11:33:21.032 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.033+0000 7f89c744f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.7 2024-09-14T11:33:21.032 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.033+0000 7f89c744f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.8 2024-09-14T11:33:21.034 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.037+0000 7f89c744f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.9 2024-09-14T11:33:21.034 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.037+0000 7f89c744f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.10 2024-09-14T11:33:21.041 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.045+0000 7f89c744f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38 : hit (requested=0x17, cached=0x17) 2024-09-14T11:33:21.041 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.045+0000 7f89c744f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38 2024-09-14T11:33:21.044 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.045+0000 7f89c744f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38 info.flags=0x17 2024-09-14T11:33:21.044 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.045+0000 7f89c744f9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38 to cache LRU end 2024-09-14T11:33:21.044 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.045+0000 7f89c744f9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:21.045 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.045+0000 7f89c744f9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38, ofs0, ns] 2024-09-14T11:33:21.045 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.045+0000 7f889b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464413 cookie 94493995188368 notifier 7821 bl.length()=1015 2024-09-14T11:33:21.045 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.045+0000 7f889b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38 info.flags=0x17 2024-09-14T11:33:21.045 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.045+0000 7f889b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38 to cache LRU end 2024-09-14T11:33:21.045 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.045+0000 7f889b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:21.045 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.049+0000 7f89c744f9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.38]): orig_sources= new_sources= 2024-09-14T11:33:21.045 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.049+0000 7f89c744f9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.38]): potential sources added=[] removed=[] 2024-09-14T11:33:21.045 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.049+0000 7f89c744f9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.38]): orig_dests= new_dests= 2024-09-14T11:33:21.045 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.049+0000 7f89c744f9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.38]): potential dests added=[] removed=[] 2024-09-14T11:33:21.049 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.053+0000 7f89c744f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.0 2024-09-14T11:33:21.050 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.053+0000 7f89c744f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.1 2024-09-14T11:33:21.050 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.053+0000 7f89c744f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.2 2024-09-14T11:33:21.052 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.053+0000 7f89c744f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.3 2024-09-14T11:33:21.052 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.057+0000 7f89c744f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.4 2024-09-14T11:33:21.054 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.057+0000 7f89c744f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.5 2024-09-14T11:33:21.054 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.057+0000 7f89c744f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.6 2024-09-14T11:33:21.055 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.057+0000 7f89c744f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.7 2024-09-14T11:33:21.055 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.057+0000 7f89c744f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.8 2024-09-14T11:33:21.057 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.061+0000 7f89c744f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.9 2024-09-14T11:33:21.057 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.061+0000 7f89c744f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.38.10 2024-09-14T11:33:21.058 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.061+0000 7f89c744f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38 : hit (requested=0x17, cached=0x17) 2024-09-14T11:33:21.058 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.061+0000 7f89c744f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38 2024-09-14T11:33:21.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.065+0000 7f89c744f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38 info.flags=0x17 2024-09-14T11:33:21.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.065+0000 7f89c744f9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38 to cache LRU end 2024-09-14T11:33:21.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.065+0000 7f89c744f9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:21.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.065+0000 7f89c744f9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38, ofs0, ns] 2024-09-14T11:33:21.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.065+0000 7f889b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464414 cookie 94493995188368 notifier 7821 bl.length()=983 2024-09-14T11:33:21.062 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.065+0000 7f889b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38 info.flags=0x17 2024-09-14T11:33:21.062 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.065+0000 7f889b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.38 to cache LRU end 2024-09-14T11:33:21.062 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.065+0000 7f889b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:21.062 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.065+0000 7f89c744f9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.38]): orig_sources= new_sources= 2024-09-14T11:33:21.062 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.065+0000 7f89c744f9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.38]): potential sources added=[] removed=[] 2024-09-14T11:33:21.062 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.065+0000 7f89c744f9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.38]): orig_dests= new_dests= 2024-09-14T11:33:21.062 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.065+0000 7f89c744f9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.38]): potential dests added=[] removed=[] 2024-09-14T11:33:21.069 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.073+0000 7f89c744f9c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-14T11:33:21.073 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.077+0000 7f887b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:21.077 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.081+0000 7f89c744f9c0 20 remove_watcher() i=0 2024-09-14T11:33:21.077 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.081+0000 7f89c744f9c0 2 removed watcher, disabling cache 2024-09-14T11:33:21.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.081+0000 7f89c744f9c0 20 remove_watcher() i=1 2024-09-14T11:33:21.081 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.085+0000 7f89c744f9c0 20 remove_watcher() i=2 2024-09-14T11:33:21.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.085+0000 7f89c744f9c0 20 remove_watcher() i=3 2024-09-14T11:33:21.085 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.089+0000 7f89c744f9c0 20 remove_watcher() i=4 2024-09-14T11:33:21.088 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.089+0000 7f89c744f9c0 20 remove_watcher() i=5 2024-09-14T11:33:21.091 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.093+0000 7f89c744f9c0 20 remove_watcher() i=6 2024-09-14T11:33:21.094 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.097+0000 7f89c744f9c0 20 remove_watcher() i=7 2024-09-14T11:33:21.111 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:33:21.141 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:21.141 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:21.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.189+0000 7fc2f83e69c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:21.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.193+0000 7fc2f83e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:21.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.193+0000 7fc2f83e69c0 20 realm 2024-09-14T11:33:21.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.193+0000 7fc2f83e69c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:21.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.193+0000 7fc2f83e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:21.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.193+0000 7fc2f83e69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:21.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.193+0000 7fc2f83e69c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:21.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.193+0000 7fc2f83e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:21.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.193+0000 7fc2f83e69c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:21.191 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.193+0000 7fc2f83e69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:21.191 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.193+0000 7fc2f83e69c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:21.192 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.193+0000 7fc2f83e69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:21.192 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.193+0000 7fc2f83e69c0 20 searching for the correct realm 2024-09-14T11:33:21.196 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.197+0000 7fc2f66ed640 0 -- 172.21.15.71:0/2001702041 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fc2ec02a070 msgr2=0x7fc2ec04f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:21.409 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.413+0000 7fc2f66ed640 0 -- 172.21.15.71:0/2001702041 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x560ee3e038e0 msgr2=0x560ee3e05cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:21.424 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.425+0000 7fc2f83e69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:21.425 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.425+0000 7fc2f83e69c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:33:21.425 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.425+0000 7fc2f83e69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:21.425 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.425+0000 7fc2f83e69c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:33:21.425 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.425+0000 7fc2f83e69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:21.425 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.425+0000 7fc2f83e69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:21.425 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.429+0000 7fc2f83e69c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:21.425 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.429+0000 7fc2f83e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:21.425 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.429+0000 7fc2f83e69c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:21.426 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.429+0000 7fc2f83e69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:21.426 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.429+0000 7fc2f83e69c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:21.427 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.429+0000 7fc2f83e69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:21.428 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.429+0000 7fc2f83e69c0 20 zone default found 2024-09-14T11:33:21.428 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.429+0000 7fc2f83e69c0 4 Realm: () 2024-09-14T11:33:21.428 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.429+0000 7fc2f83e69c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:33:21.428 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.429+0000 7fc2f83e69c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:33:21.428 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.429+0000 7fc2f83e69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:21.428 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.429+0000 7fc2f83e69c0 20 zonegroup default 2024-09-14T11:33:21.428 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.429+0000 7fc2f83e69c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:21.428 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.429+0000 7fc2f83e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:21.429 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.429+0000 7fc2f83e69c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:21.429 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.433+0000 7fc2f83e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:21.429 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.433+0000 7fc2f83e69c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:21.429 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.433+0000 7fc2f83e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:21.430 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.433+0000 7fc2f83e69c0 20 started sync module instance, tier type = 2024-09-14T11:33:21.430 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.433+0000 7fc2f83e69c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:33:21.453 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.457+0000 7fc2f83e69c0 20 add_watcher() i=0 2024-09-14T11:33:21.453 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.457+0000 7fc2f83e69c0 20 add_watcher() i=1 2024-09-14T11:33:21.453 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.457+0000 7fc2f83e69c0 20 add_watcher() i=2 2024-09-14T11:33:21.453 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.457+0000 7fc2f83e69c0 20 add_watcher() i=3 2024-09-14T11:33:21.453 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.457+0000 7fc2f83e69c0 20 add_watcher() i=4 2024-09-14T11:33:21.454 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.457+0000 7fc2f83e69c0 20 add_watcher() i=5 2024-09-14T11:33:21.454 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.457+0000 7fc2f83e69c0 20 add_watcher() i=6 2024-09-14T11:33:21.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.457+0000 7fc2f83e69c0 20 add_watcher() i=7 2024-09-14T11:33:21.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.457+0000 7fc2f83e69c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:21.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.461+0000 7fc1a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:21.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.465+0000 7fc2f83e69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:21.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.465+0000 7fc2f83e69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:21.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.465+0000 7fc2f83e69c0 5 note: GC not initialized 2024-09-14T11:33:21.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.465+0000 7fc1a67fc640 20 reqs_thread_entry: start 2024-09-14T11:33:21.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.465+0000 7fc2f83e69c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:21.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.465+0000 7fc2f83e69c0 20 Filter name: none 2024-09-14T11:33:21.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.465+0000 7fc117fff640 20 reqs_thread_entry: start 2024-09-14T11:33:21.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.465+0000 7fc2f83e69c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:21.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.465+0000 7fc2f83e69c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:21.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.465+0000 7fc2f83e69c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:21.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.465+0000 7fc2f83e69c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:21.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.465+0000 7fc2f83e69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:21.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.465+0000 7fc2f83e69c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:21.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.465+0000 7fc2f83e69c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:21.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.465+0000 7fc2f83e69c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:21.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.469+0000 7fc2f83e69c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:21.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.469+0000 7fc2f83e69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:21.468 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.469+0000 7fc1a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:21.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.477+0000 7fc2f83e69c0 20 remove_watcher() i=0 2024-09-14T11:33:21.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.477+0000 7fc2f83e69c0 2 removed watcher, disabling cache 2024-09-14T11:33:21.475 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.477+0000 7fc2f83e69c0 20 remove_watcher() i=1 2024-09-14T11:33:21.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.481+0000 7fc2f83e69c0 20 remove_watcher() i=2 2024-09-14T11:33:21.479 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.481+0000 7fc2f83e69c0 20 remove_watcher() i=3 2024-09-14T11:33:21.481 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.485+0000 7fc2f83e69c0 20 remove_watcher() i=4 2024-09-14T11:33:21.484 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.485+0000 7fc2f83e69c0 20 remove_watcher() i=5 2024-09-14T11:33:21.487 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.489+0000 7fc2f83e69c0 20 remove_watcher() i=6 2024-09-14T11:33:21.490 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:21.493+0000 7fc2f83e69c0 20 remove_watcher() i=7 2024-09-14T11:33:21.511 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:21.511 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:33:21.511 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: error-at-change-reshard-state id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.38 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:33:21.511 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:21.631 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-14T11:33:21.631 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:22.001 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:33:22.034 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:22.034 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:22.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.081+0000 7fad6f6e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.085+0000 7fad6f6e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:22.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.085+0000 7fad6f6e09c0 20 realm 2024-09-14T11:33:22.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.085+0000 7fad6f6e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.085+0000 7fad6f6e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:22.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.085+0000 7fad6f6e09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:22.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.085+0000 7fad6f6e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.084 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.085+0000 7fad6f6e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:22.084 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.085+0000 7fad6f6e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.084 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.085+0000 7fad6f6e09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:22.084 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.085+0000 7fad6f6e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.085 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.089+0000 7fad6f6e09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:22.085 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.089+0000 7fad6f6e09c0 20 searching for the correct realm 2024-09-14T11:33:22.087 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.089+0000 7fad6c9e5640 0 -- 172.21.15.71:0/1788676863 >> [v2:172.21.15.71:6824/2436891866,v1:172.21.15.71:6825/2436891866] conn(0x7fad60008050 msgr2=0x7fad6003a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:22.301 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.305+0000 7fad6d1e6640 0 -- 172.21.15.71:0/1788676863 >> [v2:172.21.15.157:6816/1231501119,v1:172.21.15.157:6817/1231501119] conn(0x563678d766e0 msgr2=0x563678d78b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:22.320 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.321+0000 7fad6f6e09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:22.320 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.321+0000 7fad6f6e09c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:33:22.320 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.321+0000 7fad6f6e09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:22.320 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.321+0000 7fad6f6e09c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:33:22.320 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.321+0000 7fad6f6e09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:22.320 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.321+0000 7fad6f6e09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:22.321 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.321+0000 7fad6f6e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.321 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.325+0000 7fad6f6e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:22.321 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.325+0000 7fad6f6e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.321 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.325+0000 7fad6f6e09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:22.321 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.325+0000 7fad6f6e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.323 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.325+0000 7fad6f6e09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:22.323 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.325+0000 7fad6f6e09c0 20 zone default found 2024-09-14T11:33:22.323 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.325+0000 7fad6f6e09c0 4 Realm: () 2024-09-14T11:33:22.323 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.325+0000 7fad6f6e09c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:33:22.323 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.325+0000 7fad6f6e09c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:33:22.323 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.325+0000 7fad6f6e09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:22.323 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.325+0000 7fad6f6e09c0 20 zonegroup default 2024-09-14T11:33:22.323 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.325+0000 7fad6f6e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.324 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.325+0000 7fad6f6e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:22.324 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.325+0000 7fad6f6e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.324 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.325+0000 7fad6f6e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:22.324 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.325+0000 7fad6f6e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.325 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.329+0000 7fad6f6e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:22.325 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.329+0000 7fad6f6e09c0 20 started sync module instance, tier type = 2024-09-14T11:33:22.325 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.329+0000 7fad6f6e09c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:33:22.347 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.349+0000 7fad6f6e09c0 20 add_watcher() i=0 2024-09-14T11:33:22.348 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.349+0000 7fad6f6e09c0 20 add_watcher() i=1 2024-09-14T11:33:22.348 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.349+0000 7fad6f6e09c0 20 add_watcher() i=2 2024-09-14T11:33:22.348 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.349+0000 7fad6f6e09c0 20 add_watcher() i=3 2024-09-14T11:33:22.348 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.349+0000 7fad6f6e09c0 20 add_watcher() i=4 2024-09-14T11:33:22.348 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.349+0000 7fad6f6e09c0 20 add_watcher() i=5 2024-09-14T11:33:22.348 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.349+0000 7fad6f6e09c0 20 add_watcher() i=6 2024-09-14T11:33:22.350 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.353+0000 7fad6f6e09c0 20 add_watcher() i=7 2024-09-14T11:33:22.350 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.353+0000 7fad6f6e09c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:22.354 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.357+0000 7fac1f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:22.355 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.357+0000 7fad6f6e09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:22.355 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.357+0000 7fad6f6e09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:22.355 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.357+0000 7fad6f6e09c0 5 note: GC not initialized 2024-09-14T11:33:22.355 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.357+0000 7fac1e7e4640 20 reqs_thread_entry: start 2024-09-14T11:33:22.356 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.357+0000 7fad6f6e09c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:22.356 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.357+0000 7fad6f6e09c0 20 Filter name: none 2024-09-14T11:33:22.356 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.357+0000 7fab8ffff640 20 reqs_thread_entry: start 2024-09-14T11:33:22.356 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.357+0000 7fad6f6e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.356 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.357+0000 7fad6f6e09c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:22.356 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.357+0000 7fad6f6e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.357 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.361+0000 7fad6f6e09c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:22.357 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.361+0000 7fad6f6e09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:22.358 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.361+0000 7fad6f6e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.358 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.361+0000 7fad6f6e09c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:22.358 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.361+0000 7fad6f6e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.359 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.361+0000 7fad6f6e09c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:22.359 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.361+0000 7fad6f6e09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:22.362 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.365+0000 7fac1f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:22.366 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.369+0000 7fad6f6e09c0 20 remove_watcher() i=0 2024-09-14T11:33:22.366 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.369+0000 7fad6f6e09c0 2 removed watcher, disabling cache 2024-09-14T11:33:22.368 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.373+0000 7fad6f6e09c0 20 remove_watcher() i=1 2024-09-14T11:33:22.371 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.373+0000 7fad6f6e09c0 20 remove_watcher() i=2 2024-09-14T11:33:22.373 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.377+0000 7fad6f6e09c0 20 remove_watcher() i=3 2024-09-14T11:33:22.375 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.377+0000 7fad6f6e09c0 20 remove_watcher() i=4 2024-09-14T11:33:22.377 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.381+0000 7fad6f6e09c0 20 remove_watcher() i=5 2024-09-14T11:33:22.380 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.381+0000 7fad6f6e09c0 20 remove_watcher() i=6 2024-09-14T11:33:22.382 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.385+0000 7fad6f6e09c0 20 remove_watcher() i=7 2024-09-14T11:33:22.397 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:22.397 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:33:22.397 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: error-at-change-reshard-state id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:33:22.397 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:22.397 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-14T11:33:22.432 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:22.433 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:22.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.481+0000 7f63968e69c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.479 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.481+0000 7f63968e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:22.479 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.481+0000 7f63968e69c0 20 realm 2024-09-14T11:33:22.480 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.481+0000 7f63968e69c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.480 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.481+0000 7f63968e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:22.480 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.481+0000 7f63968e69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:22.480 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.481+0000 7f63968e69c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.481 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.485+0000 7f63968e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:22.481 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.485+0000 7f63968e69c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.481 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.485+0000 7f63968e69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:22.481 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.485+0000 7f63968e69c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.485+0000 7f63968e69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:22.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.485+0000 7f63968e69c0 20 searching for the correct realm 2024-09-14T11:33:22.484 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.485+0000 7f6393beb640 0 -- 172.21.15.71:0/1132701124 >> [v2:172.21.15.71:6824/2436891866,v1:172.21.15.71:6825/2436891866] conn(0x7f6384064fa0 msgr2=0x7f6384063a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:22.490 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.493+0000 7f6393beb640 0 -- 172.21.15.71:0/1132701124 >> [v2:172.21.15.71:6808/1268087573,v1:172.21.15.71:6809/1268087573] conn(0x563ffc5dfa20 msgr2=0x563ffc5e1e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:22.500 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.501+0000 7f63968e69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:22.500 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.501+0000 7f63968e69c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:33:22.500 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.501+0000 7f63968e69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:22.500 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.501+0000 7f63968e69c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:33:22.501 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.501+0000 7f63968e69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:22.501 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.501+0000 7f63968e69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:22.501 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.501+0000 7f63968e69c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.501 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.505+0000 7f63968e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:22.501 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.505+0000 7f63968e69c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.501 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.505+0000 7f63968e69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:22.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.505+0000 7f63968e69c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.505+0000 7f63968e69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:22.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.505+0000 7f63968e69c0 20 zone default found 2024-09-14T11:33:22.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.505+0000 7f63968e69c0 4 Realm: () 2024-09-14T11:33:22.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.505+0000 7f63968e69c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:33:22.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.505+0000 7f63968e69c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:33:22.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.505+0000 7f63968e69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:22.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.505+0000 7f63968e69c0 20 zonegroup default 2024-09-14T11:33:22.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.505+0000 7f63968e69c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.505+0000 7f63968e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:22.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.505+0000 7f63968e69c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.505+0000 7f63968e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:22.504 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.505+0000 7f63968e69c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.504 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.505+0000 7f63968e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:22.504 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.505+0000 7f63968e69c0 20 started sync module instance, tier type = 2024-09-14T11:33:22.504 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.505+0000 7f63968e69c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:33:22.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.525+0000 7f63968e69c0 20 add_watcher() i=0 2024-09-14T11:33:22.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.525+0000 7f63968e69c0 20 add_watcher() i=1 2024-09-14T11:33:22.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.525+0000 7f63968e69c0 20 add_watcher() i=2 2024-09-14T11:33:22.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.525+0000 7f63968e69c0 20 add_watcher() i=3 2024-09-14T11:33:22.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.525+0000 7f63968e69c0 20 add_watcher() i=4 2024-09-14T11:33:22.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.525+0000 7f63968e69c0 20 add_watcher() i=5 2024-09-14T11:33:22.523 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.525+0000 7f63968e69c0 20 add_watcher() i=6 2024-09-14T11:33:22.524 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.529+0000 7f63968e69c0 20 add_watcher() i=7 2024-09-14T11:33:22.524 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.529+0000 7f63968e69c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:22.528 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.529+0000 7f624afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:22.529 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.529+0000 7f63968e69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:22.529 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.529+0000 7f63968e69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:22.529 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.529+0000 7f63968e69c0 5 note: GC not initialized 2024-09-14T11:33:22.529 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.529+0000 7f6249fdb640 20 reqs_thread_entry: start 2024-09-14T11:33:22.529 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.533+0000 7f63968e69c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:22.529 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.533+0000 7f63968e69c0 20 Filter name: none 2024-09-14T11:33:22.529 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.533+0000 7f61bb7fe640 20 reqs_thread_entry: start 2024-09-14T11:33:22.529 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.533+0000 7f63968e69c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:33:22.529 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.533+0000 7f63968e69c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.530 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.533+0000 7f63968e69c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:22.530 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.533+0000 7f63968e69c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:33:22.530 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.533+0000 7f63968e69c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:33:22.530 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.533+0000 7f63968e69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.39 : miss 2024-09-14T11:33:22.530 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.533+0000 7f63968e69c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.533+0000 7f63968e69c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:22.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.533+0000 7f63968e69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.39 info.flags=0x17 2024-09-14T11:33:22.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.533+0000 7f63968e69c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.39 to cache LRU end 2024-09-14T11:33:22.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.533+0000 7f63968e69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:22.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.533+0000 7f63968e69c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:22.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.533+0000 7f63968e69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.39 2024-09-14T11:33:22.541 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.545+0000 7f63968e69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.39 info.flags=0x17 2024-09-14T11:33:22.541 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.545+0000 7f63968e69c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.39 to cache LRU end 2024-09-14T11:33:22.541 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.545+0000 7f63968e69c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:22.541 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.545+0000 7f63968e69c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.39, ofs0, ns] 2024-09-14T11:33:22.542 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.545+0000 7f626affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464419 cookie 94832816998944 notifier 7875 bl.length()=1015 2024-09-14T11:33:22.542 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.545+0000 7f626affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.39 info.flags=0x17 2024-09-14T11:33:22.542 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.545+0000 7f626affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.39 to cache LRU end 2024-09-14T11:33:22.542 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.545+0000 7f626affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:22.542 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.545+0000 7f63968e69c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.39]): orig_sources= new_sources= 2024-09-14T11:33:22.542 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.545+0000 7f63968e69c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.39]): potential sources added=[] removed=[] 2024-09-14T11:33:22.542 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.545+0000 7f63968e69c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.39]): orig_dests= new_dests= 2024-09-14T11:33:22.542 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.545+0000 7f63968e69c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.39]): potential dests added=[] removed=[] 2024-09-14T11:33:22.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.557+0000 7f63968e69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.1.0 2024-09-14T11:33:22.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.557+0000 7f63968e69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.1.0 2024-09-14T11:33:22.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.557+0000 7f63968e69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.1.1 2024-09-14T11:33:22.556 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.557+0000 7f63968e69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.1.1 2024-09-14T11:33:22.556 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.557+0000 7f63968e69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.1.2 2024-09-14T11:33:22.556 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.557+0000 7f63968e69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.1.2 2024-09-14T11:33:22.556 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.557+0000 7f63968e69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.1.3 2024-09-14T11:33:22.556 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.557+0000 7f63968e69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.1.3 2024-09-14T11:33:22.556 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.557+0000 7f63968e69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.1.4 2024-09-14T11:33:22.556 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.557+0000 7f63968e69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.1.4 2024-09-14T11:33:22.556 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.557+0000 7f63968e69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.1.5 2024-09-14T11:33:22.556 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.557+0000 7f63968e69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.1.5 2024-09-14T11:33:22.556 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.557+0000 7f63968e69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.1.6 2024-09-14T11:33:22.556 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.557+0000 7f63968e69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.1.6 2024-09-14T11:33:22.556 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.557+0000 7f63968e69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.1.7 2024-09-14T11:33:22.556 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.557+0000 7f63968e69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.1.7 2024-09-14T11:33:22.556 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.557+0000 7f63968e69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.1.8 2024-09-14T11:33:22.557 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.557+0000 7f63968e69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.1.8 2024-09-14T11:33:22.557 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.557+0000 7f63968e69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.1.9 2024-09-14T11:33:22.557 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.557+0000 7f63968e69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.1.9 2024-09-14T11:33:22.557 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.557+0000 7f63968e69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.1.10 2024-09-14T11:33:22.557 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.557+0000 7f63968e69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.1.10 2024-09-14T11:33:22.557 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.557+0000 7f63968e69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.1.11 2024-09-14T11:33:22.557 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.557+0000 7f63968e69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.1.11 2024-09-14T11:33:22.557 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.557+0000 7f63968e69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.0 2024-09-14T11:33:22.557 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.557+0000 7f63968e69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.1 2024-09-14T11:33:22.558 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.561+0000 7f63968e69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.2 2024-09-14T11:33:22.559 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.561+0000 7f63968e69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.3 2024-09-14T11:33:22.559 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.561+0000 7f63968e69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.4 2024-09-14T11:33:22.560 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.565+0000 7f63968e69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.5 2024-09-14T11:33:22.561 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.565+0000 7f63968e69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.6 2024-09-14T11:33:22.563 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.565+0000 7f63968e69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.7 2024-09-14T11:33:22.564 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.565+0000 7f63968e69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.8 2024-09-14T11:33:22.565 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.569+0000 7f63968e69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.9 2024-09-14T11:33:22.566 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.569+0000 7f63968e69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.10 2024-09-14T11:33:22.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.577+0000 7f63968e69c0 -1 Injecting error=-125 at location=change_reshard_state 2024-09-14T11:33:22.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.577+0000 7f63968e69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.39 : hit (requested=0x17, cached=0x17) 2024-09-14T11:33:22.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.577+0000 7f63968e69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.39 2024-09-14T11:33:22.576 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.577+0000 7f63968e69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.39 info.flags=0x17 2024-09-14T11:33:22.576 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.577+0000 7f63968e69c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.39 to cache LRU end 2024-09-14T11:33:22.576 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.577+0000 7f63968e69c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:22.576 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.577+0000 7f63968e69c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.39, ofs0, ns] 2024-09-14T11:33:22.577 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.581+0000 7f626affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464420 cookie 94832816998944 notifier 7875 bl.length()=1015 2024-09-14T11:33:22.577 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.581+0000 7f626affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.39 info.flags=0x17 2024-09-14T11:33:22.577 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.581+0000 7f626affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.39 to cache LRU end 2024-09-14T11:33:22.577 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.581+0000 7f626affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:22.577 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.581+0000 7f63968e69c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.39]): orig_sources= new_sources= 2024-09-14T11:33:22.577 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.581+0000 7f63968e69c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.39]): potential sources added=[] removed=[] 2024-09-14T11:33:22.577 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.581+0000 7f63968e69c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.39]): orig_dests= new_dests= 2024-09-14T11:33:22.577 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.581+0000 7f63968e69c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.39]): potential dests added=[] removed=[] 2024-09-14T11:33:22.584 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.585+0000 7f63968e69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.0 2024-09-14T11:33:22.584 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.589+0000 7f63968e69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.1 2024-09-14T11:33:22.585 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.589+0000 7f63968e69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.2 2024-09-14T11:33:22.586 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.589+0000 7f63968e69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.3 2024-09-14T11:33:22.586 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.589+0000 7f63968e69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.4 2024-09-14T11:33:22.587 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.589+0000 7f63968e69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.5 2024-09-14T11:33:22.588 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.589+0000 7f63968e69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.6 2024-09-14T11:33:22.588 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.593+0000 7f63968e69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.7 2024-09-14T11:33:22.589 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.593+0000 7f63968e69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.8 2024-09-14T11:33:22.590 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.593+0000 7f63968e69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.9 2024-09-14T11:33:22.591 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.593+0000 7f63968e69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.39.10 2024-09-14T11:33:22.591 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.593+0000 7f63968e69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.39 : hit (requested=0x17, cached=0x17) 2024-09-14T11:33:22.591 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.593+0000 7f63968e69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.39 2024-09-14T11:33:22.595 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.597+0000 7f63968e69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.39 info.flags=0x17 2024-09-14T11:33:22.595 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.597+0000 7f63968e69c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.39 to cache LRU end 2024-09-14T11:33:22.595 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.597+0000 7f63968e69c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:22.595 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.597+0000 7f63968e69c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.39, ofs0, ns] 2024-09-14T11:33:22.595 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.597+0000 7f626affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464421 cookie 94832816998944 notifier 7875 bl.length()=983 2024-09-14T11:33:22.596 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.597+0000 7f626affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.39 info.flags=0x17 2024-09-14T11:33:22.596 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.597+0000 7f626affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.39 to cache LRU end 2024-09-14T11:33:22.596 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.597+0000 7f626affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:22.596 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.597+0000 7f63968e69c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.39]): orig_sources= new_sources= 2024-09-14T11:33:22.596 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.597+0000 7f63968e69c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.39]): potential sources added=[] removed=[] 2024-09-14T11:33:22.596 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.597+0000 7f63968e69c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.39]): orig_dests= new_dests= 2024-09-14T11:33:22.596 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.597+0000 7f63968e69c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.39]): potential dests added=[] removed=[] 2024-09-14T11:33:22.602 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.605+0000 7f63968e69c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-14T11:33:22.605 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.609+0000 7f624afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:22.609 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.613+0000 7f63968e69c0 20 remove_watcher() i=0 2024-09-14T11:33:22.609 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.613+0000 7f63968e69c0 2 removed watcher, disabling cache 2024-09-14T11:33:22.611 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.613+0000 7f63968e69c0 20 remove_watcher() i=1 2024-09-14T11:33:22.613 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.617+0000 7f63968e69c0 20 remove_watcher() i=2 2024-09-14T11:33:22.616 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.617+0000 7f63968e69c0 20 remove_watcher() i=3 2024-09-14T11:33:22.618 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.621+0000 7f63968e69c0 20 remove_watcher() i=4 2024-09-14T11:33:22.619 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.621+0000 7f63968e69c0 20 remove_watcher() i=5 2024-09-14T11:33:22.622 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.625+0000 7f63968e69c0 20 remove_watcher() i=6 2024-09-14T11:33:22.625 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.629+0000 7f63968e69c0 20 remove_watcher() i=7 2024-09-14T11:33:22.641 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:33:22.668 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:22.668 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:22.711 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.713+0000 7fc5ccc619c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.714 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.717+0000 7fc5ccc619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:22.714 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.717+0000 7fc5ccc619c0 20 realm 2024-09-14T11:33:22.714 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.717+0000 7fc5ccc619c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.714 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.717+0000 7fc5ccc619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:22.714 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.717+0000 7fc5ccc619c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:22.714 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.717+0000 7fc5ccc619c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.715 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.717+0000 7fc5ccc619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:22.715 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.717+0000 7fc5ccc619c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.715 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.717+0000 7fc5ccc619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:22.716 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.717+0000 7fc5ccc619c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.716 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.721+0000 7fc5ccc619c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:22.717 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.721+0000 7fc5ccc619c0 20 searching for the correct realm 2024-09-14T11:33:22.720 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.725+0000 7fc5ca767640 0 -- 172.21.15.71:0/10257624 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x56537aaa9a50 msgr2=0x56537aaabf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:22.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.729+0000 7fc5caf68640 0 -- 172.21.15.71:0/10257624 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x56537aaa4ce0 msgr2=0x56537aaa70d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:22.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.737+0000 7fc5ccc619c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:22.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.737+0000 7fc5ccc619c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:33:22.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.737+0000 7fc5ccc619c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:22.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.737+0000 7fc5ccc619c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:33:22.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.737+0000 7fc5ccc619c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:22.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.737+0000 7fc5ccc619c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:22.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.737+0000 7fc5ccc619c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.741+0000 7fc5ccc619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:22.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.741+0000 7fc5ccc619c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.741+0000 7fc5ccc619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:22.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.741+0000 7fc5ccc619c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.741+0000 7fc5ccc619c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:22.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.741+0000 7fc5ccc619c0 20 zone default found 2024-09-14T11:33:22.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.741+0000 7fc5ccc619c0 4 Realm: () 2024-09-14T11:33:22.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.741+0000 7fc5ccc619c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:33:22.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.741+0000 7fc5ccc619c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:33:22.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.741+0000 7fc5ccc619c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:22.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.741+0000 7fc5ccc619c0 20 zonegroup default 2024-09-14T11:33:22.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.741+0000 7fc5ccc619c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.739 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.741+0000 7fc5ccc619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:22.739 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.741+0000 7fc5ccc619c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.739 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.741+0000 7fc5ccc619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:22.739 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.741+0000 7fc5ccc619c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.740 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.741+0000 7fc5ccc619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:22.740 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.741+0000 7fc5ccc619c0 20 started sync module instance, tier type = 2024-09-14T11:33:22.740 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.741+0000 7fc5ccc619c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:33:22.756 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.761+0000 7fc5ccc619c0 20 add_watcher() i=0 2024-09-14T11:33:22.757 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.761+0000 7fc5ccc619c0 20 add_watcher() i=1 2024-09-14T11:33:22.757 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.761+0000 7fc5ccc619c0 20 add_watcher() i=2 2024-09-14T11:33:22.757 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.761+0000 7fc5ccc619c0 20 add_watcher() i=3 2024-09-14T11:33:22.757 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.761+0000 7fc5ccc619c0 20 add_watcher() i=4 2024-09-14T11:33:22.757 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.761+0000 7fc5ccc619c0 20 add_watcher() i=5 2024-09-14T11:33:22.757 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.761+0000 7fc5ccc619c0 20 add_watcher() i=6 2024-09-14T11:33:22.759 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.761+0000 7fc5ccc619c0 20 add_watcher() i=7 2024-09-14T11:33:22.759 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.761+0000 7fc5ccc619c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:22.763 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.765+0000 7fc480fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:22.764 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.765+0000 7fc5ccc619c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:22.764 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.765+0000 7fc5ccc619c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:22.764 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.765+0000 7fc5ccc619c0 5 note: GC not initialized 2024-09-14T11:33:22.764 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.765+0000 7fc3fb7fe640 20 reqs_thread_entry: start 2024-09-14T11:33:22.764 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.765+0000 7fc5ccc619c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:22.764 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.765+0000 7fc5ccc619c0 20 Filter name: none 2024-09-14T11:33:22.764 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.765+0000 7fc3f97fa640 20 reqs_thread_entry: start 2024-09-14T11:33:22.764 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.765+0000 7fc5ccc619c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.765 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.765+0000 7fc5ccc619c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:22.765 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.765+0000 7fc5ccc619c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.765 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.769+0000 7fc5ccc619c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:22.766 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.769+0000 7fc5ccc619c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:22.766 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.769+0000 7fc5ccc619c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.766 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.769+0000 7fc5ccc619c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:22.766 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.769+0000 7fc5ccc619c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:22.767 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.769+0000 7fc5ccc619c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:22.767 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.769+0000 7fc5ccc619c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:22.770 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.773+0000 7fc480fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:22.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.777+0000 7fc5ccc619c0 20 remove_watcher() i=0 2024-09-14T11:33:22.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.777+0000 7fc5ccc619c0 2 removed watcher, disabling cache 2024-09-14T11:33:22.776 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.777+0000 7fc5ccc619c0 20 remove_watcher() i=1 2024-09-14T11:33:22.778 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.781+0000 7fc5ccc619c0 20 remove_watcher() i=2 2024-09-14T11:33:22.780 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.781+0000 7fc5ccc619c0 20 remove_watcher() i=3 2024-09-14T11:33:22.782 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.785+0000 7fc5ccc619c0 20 remove_watcher() i=4 2024-09-14T11:33:22.784 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.785+0000 7fc5ccc619c0 20 remove_watcher() i=5 2024-09-14T11:33:22.787 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.789+0000 7fc5ccc619c0 20 remove_watcher() i=6 2024-09-14T11:33:22.790 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:22.793+0000 7fc5ccc619c0 20 remove_watcher() i=7 2024-09-14T11:33:22.804 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:22.805 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:33:22.805 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: error-at-change-reshard-state id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.39 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:33:22.805 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:22.918 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-14T11:33:22.918 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:23.325 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:33:23.358 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:23.358 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:23.402 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.405+0000 7f8d29dab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.409+0000 7f8d29dab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:23.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.409+0000 7f8d29dab9c0 20 realm 2024-09-14T11:33:23.405 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.409+0000 7f8d29dab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.409+0000 7f8d29dab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:23.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.409+0000 7f8d29dab9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:23.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.409+0000 7f8d29dab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.409+0000 7f8d29dab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:23.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.409+0000 7f8d29dab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.409+0000 7f8d29dab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:23.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.409+0000 7f8d29dab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.409+0000 7f8d29dab9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:23.408 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.409+0000 7f8d29dab9c0 20 searching for the correct realm 2024-09-14T11:33:23.411 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.413+0000 7f8d280b2640 0 -- 172.21.15.71:0/2077811308 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f8d1c034070 msgr2=0x7f8d1c052920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:23.625 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.629+0000 7f8d280b2640 0 -- 172.21.15.71:0/2077811308 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x557a1cd251f0 msgr2=0x557a1cd275e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:23.640 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.641+0000 7f8d29dab9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:23.640 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.641+0000 7f8d29dab9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:33:23.640 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.641+0000 7f8d29dab9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:23.640 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.641+0000 7f8d29dab9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:33:23.640 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.641+0000 7f8d29dab9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:23.640 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.641+0000 7f8d29dab9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:23.641 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.641+0000 7f8d29dab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.641 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.645+0000 7f8d29dab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:23.641 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.645+0000 7f8d29dab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.642 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.645+0000 7f8d29dab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:23.642 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.645+0000 7f8d29dab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.643 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.645+0000 7f8d29dab9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:23.643 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.645+0000 7f8d29dab9c0 20 zone default found 2024-09-14T11:33:23.643 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.645+0000 7f8d29dab9c0 4 Realm: () 2024-09-14T11:33:23.643 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.645+0000 7f8d29dab9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:33:23.644 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.645+0000 7f8d29dab9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:33:23.644 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.645+0000 7f8d29dab9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:23.644 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.645+0000 7f8d29dab9c0 20 zonegroup default 2024-09-14T11:33:23.644 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.645+0000 7f8d29dab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.644 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.645+0000 7f8d29dab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:23.644 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.645+0000 7f8d29dab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.645 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.649+0000 7f8d29dab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:23.645 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.649+0000 7f8d29dab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.646 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.649+0000 7f8d29dab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:23.646 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.649+0000 7f8d29dab9c0 20 started sync module instance, tier type = 2024-09-14T11:33:23.646 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.649+0000 7f8d29dab9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:33:23.670 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.673+0000 7f8d29dab9c0 20 add_watcher() i=0 2024-09-14T11:33:23.670 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.673+0000 7f8d29dab9c0 20 add_watcher() i=1 2024-09-14T11:33:23.670 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.673+0000 7f8d29dab9c0 20 add_watcher() i=2 2024-09-14T11:33:23.670 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.673+0000 7f8d29dab9c0 20 add_watcher() i=3 2024-09-14T11:33:23.670 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.673+0000 7f8d29dab9c0 20 add_watcher() i=4 2024-09-14T11:33:23.670 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.673+0000 7f8d29dab9c0 20 add_watcher() i=5 2024-09-14T11:33:23.670 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.673+0000 7f8d29dab9c0 20 add_watcher() i=6 2024-09-14T11:33:23.672 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.673+0000 7f8d29dab9c0 20 add_watcher() i=7 2024-09-14T11:33:23.672 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.673+0000 7f8d29dab9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:23.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.681+0000 7f8bddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:23.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.681+0000 7f8d29dab9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:23.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.681+0000 7f8d29dab9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:23.678 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.681+0000 7f8d29dab9c0 5 note: GC not initialized 2024-09-14T11:33:23.678 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.681+0000 7f8bdcfe1640 20 reqs_thread_entry: start 2024-09-14T11:33:23.678 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.681+0000 7f8d29dab9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:23.678 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.681+0000 7f8d29dab9c0 20 Filter name: none 2024-09-14T11:33:23.679 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.681+0000 7f8b567fc640 20 reqs_thread_entry: start 2024-09-14T11:33:23.679 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.681+0000 7f8d29dab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.680 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.681+0000 7f8d29dab9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:23.680 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.681+0000 7f8d29dab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.681 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.685+0000 7f8d29dab9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:23.681 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.685+0000 7f8d29dab9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:23.681 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.685+0000 7f8d29dab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.682 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.685+0000 7f8d29dab9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:23.682 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.685+0000 7f8d29dab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.683 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.685+0000 7f8d29dab9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:23.683 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.685+0000 7f8d29dab9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:23.687 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.689+0000 7f8bddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:23.691 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.693+0000 7f8d29dab9c0 20 remove_watcher() i=0 2024-09-14T11:33:23.691 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.693+0000 7f8d29dab9c0 2 removed watcher, disabling cache 2024-09-14T11:33:23.693 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.697+0000 7f8d29dab9c0 20 remove_watcher() i=1 2024-09-14T11:33:23.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.697+0000 7f8d29dab9c0 20 remove_watcher() i=2 2024-09-14T11:33:23.697 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.701+0000 7f8d29dab9c0 20 remove_watcher() i=3 2024-09-14T11:33:23.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.701+0000 7f8d29dab9c0 20 remove_watcher() i=4 2024-09-14T11:33:23.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.705+0000 7f8d29dab9c0 20 remove_watcher() i=5 2024-09-14T11:33:23.704 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.709+0000 7f8d29dab9c0 20 remove_watcher() i=6 2024-09-14T11:33:23.707 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.709+0000 7f8d29dab9c0 20 remove_watcher() i=7 2024-09-14T11:33:23.722 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:23.722 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:33:23.722 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: abort-at-change-reshard-state id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.40 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:33:23.722 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:23.723 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-14T11:33:23.756 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:23.756 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:23.800 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.801+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.802 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.805+0000 7f3e1f1569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:23.802 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.805+0000 7f3e1f1569c0 20 realm 2024-09-14T11:33:23.802 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.805+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.802 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.805+0000 7f3e1f1569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:23.802 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.805+0000 7f3e1f1569c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:23.802 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.805+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.803 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.805+0000 7f3e1f1569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:23.803 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.805+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.803 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.805+0000 7f3e1f1569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:23.803 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.805+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.805+0000 7f3e1f1569c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:23.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.809+0000 7f3e1f1569c0 20 searching for the correct realm 2024-09-14T11:33:23.808 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:23.809+0000 7f3e1d45d640 0 -- 172.21.15.71:0/1780958168 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f3e1000e070 msgr2=0x7f3e10053e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:24.020 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.021+0000 7f3e1d45d640 0 -- 172.21.15.71:0/1780958168 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x559a481ce060 msgr2=0x559a481d0450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:24.034 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:24.034 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:33:24.034 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:24.034 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:33:24.034 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:24.034 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:24.034 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.035 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:24.035 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.035 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:24.035 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.036 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:24.036 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 zone default found 2024-09-14T11:33:24.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.037+0000 7f3e1f1569c0 4 Realm: () 2024-09-14T11:33:24.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.037+0000 7f3e1f1569c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:33:24.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.037+0000 7f3e1f1569c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:33:24.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.037+0000 7f3e1f1569c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:24.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 zonegroup default 2024-09-14T11:33:24.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.041+0000 7f3e1f1569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:24.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.041+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.038 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.041+0000 7f3e1f1569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:24.038 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.041+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.038 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.041+0000 7f3e1f1569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:24.039 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.041+0000 7f3e1f1569c0 20 started sync module instance, tier type = 2024-09-14T11:33:24.039 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.041+0000 7f3e1f1569c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:33:24.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.065+0000 7f3e1f1569c0 20 add_watcher() i=0 2024-09-14T11:33:24.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.065+0000 7f3e1f1569c0 20 add_watcher() i=1 2024-09-14T11:33:24.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.065+0000 7f3e1f1569c0 20 add_watcher() i=2 2024-09-14T11:33:24.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.065+0000 7f3e1f1569c0 20 add_watcher() i=3 2024-09-14T11:33:24.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.065+0000 7f3e1f1569c0 20 add_watcher() i=4 2024-09-14T11:33:24.062 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.065+0000 7f3e1f1569c0 20 add_watcher() i=5 2024-09-14T11:33:24.062 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.065+0000 7f3e1f1569c0 20 add_watcher() i=6 2024-09-14T11:33:24.064 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.065+0000 7f3e1f1569c0 20 add_watcher() i=7 2024-09-14T11:33:24.064 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.065+0000 7f3e1f1569c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:24.069 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.073+0000 7f3cd37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:24.070 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.073+0000 7f3e1f1569c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:24.070 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.073+0000 7f3e1f1569c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:24.070 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 note: GC not initialized 2024-09-14T11:33:24.070 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.073+0000 7f3cd27e4640 20 reqs_thread_entry: start 2024-09-14T11:33:24.070 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.073+0000 7f3e1f1569c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:24.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.073+0000 7f3e1f1569c0 20 Filter name: none 2024-09-14T11:33:24.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.073+0000 7f3ccb7fe640 20 reqs_thread_entry: start 2024-09-14T11:33:24.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.073+0000 7f3e1f1569c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:33:24.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.073+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.073+0000 7f3e1f1569c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:24.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.073+0000 7f3e1f1569c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:33:24.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.073+0000 7f3e1f1569c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:33:24.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.073+0000 7f3e1f1569c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 : miss 2024-09-14T11:33:24.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.073+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.073 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.077+0000 7f3e1f1569c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:24.073 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.077+0000 7f3e1f1569c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 info.flags=0x17 2024-09-14T11:33:24.073 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.077+0000 7f3e1f1569c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 to cache LRU end 2024-09-14T11:33:24.074 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.077+0000 7f3e1f1569c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:24.074 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.077+0000 7f3e1f1569c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:24.074 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.077+0000 7f3e1f1569c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 2024-09-14T11:33:24.085 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.089+0000 7f3e1f1569c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 info.flags=0x17 2024-09-14T11:33:24.085 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.089+0000 7f3e1f1569c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 to cache LRU end 2024-09-14T11:33:24.085 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.089+0000 7f3e1f1569c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:24.085 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.089+0000 7f3e1f1569c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40, ofs0, ns] 2024-09-14T11:33:24.085 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.089+0000 7f3cf3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464286 cookie 94121123218736 notifier 7529 bl.length()=1015 2024-09-14T11:33:24.086 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.089+0000 7f3cf3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 info.flags=0x17 2024-09-14T11:33:24.086 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.089+0000 7f3cf3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 to cache LRU end 2024-09-14T11:33:24.086 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.089+0000 7f3cf3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:24.087 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.089+0000 7f3e1f1569c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.40]): orig_sources= new_sources= 2024-09-14T11:33:24.087 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.089+0000 7f3e1f1569c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.40]): potential sources added=[] removed=[] 2024-09-14T11:33:24.087 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.089+0000 7f3e1f1569c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.40]): orig_dests= new_dests= 2024-09-14T11:33:24.087 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.089+0000 7f3e1f1569c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.40]): potential dests added=[] removed=[] 2024-09-14T11:33:24.102 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.105+0000 7f3e1f1569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.0 2024-09-14T11:33:24.102 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.0 2024-09-14T11:33:24.103 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.105+0000 7f3e1f1569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.1 2024-09-14T11:33:24.103 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.1 2024-09-14T11:33:24.103 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.105+0000 7f3e1f1569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.2 2024-09-14T11:33:24.103 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.2 2024-09-14T11:33:24.103 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.105+0000 7f3e1f1569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.3 2024-09-14T11:33:24.103 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.3 2024-09-14T11:33:24.103 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.105+0000 7f3e1f1569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.4 2024-09-14T11:33:24.103 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.4 2024-09-14T11:33:24.103 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.105+0000 7f3e1f1569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.5 2024-09-14T11:33:24.103 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.5 2024-09-14T11:33:24.103 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.105+0000 7f3e1f1569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.6 2024-09-14T11:33:24.103 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.6 2024-09-14T11:33:24.103 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.105+0000 7f3e1f1569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.7 2024-09-14T11:33:24.103 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.7 2024-09-14T11:33:24.104 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.105+0000 7f3e1f1569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.8 2024-09-14T11:33:24.104 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.8 2024-09-14T11:33:24.104 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.105+0000 7f3e1f1569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.9 2024-09-14T11:33:24.104 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.9 2024-09-14T11:33:24.104 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.105+0000 7f3e1f1569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.10 2024-09-14T11:33:24.104 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.10 2024-09-14T11:33:24.104 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.105+0000 7f3e1f1569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.11 2024-09-14T11:33:24.104 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.11 2024-09-14T11:33:24.104 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.0 2024-09-14T11:33:24.105 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1 2024-09-14T11:33:24.105 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.2 2024-09-14T11:33:24.105 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.3 2024-09-14T11:33:24.105 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.109+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.4 2024-09-14T11:33:24.106 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.109+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.5 2024-09-14T11:33:24.107 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.109+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.6 2024-09-14T11:33:24.108 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.113+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.7 2024-09-14T11:33:24.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.113+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.8 2024-09-14T11:33:24.112 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.113+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.9 2024-09-14T11:33:24.112 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.117+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.10 2024-09-14T11:33:24.119 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3e1f1569c0 time 2024-09-14T11:33:24.125484+0000 2024-09-14T11:33:24.120 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:33:24.121 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:24.121 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f3e22a302eb] 2024-09-14T11:33:24.121 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3e22a3049f] 2024-09-14T11:33:24.121 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559a45e97c01] 2024-09-14T11:33:24.121 INFO:tasks.workunit.client.0.smithi071.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x559a45eac231] 2024-09-14T11:33:24.121 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x559a45ead884] 2024-09-14T11:33:24.121 INFO:tasks.workunit.client.0.smithi071.stderr: 6: main() 2024-09-14T11:33:24.121 INFO:tasks.workunit.client.0.smithi071.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3e21896d90] 2024-09-14T11:33:24.121 INFO:tasks.workunit.client.0.smithi071.stderr: 8: __libc_start_main() 2024-09-14T11:33:24.121 INFO:tasks.workunit.client.0.smithi071.stderr: 9: _start() 2024-09-14T11:33:24.122 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.125+0000 7f3e1f1569c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3e1f1569c0 time 2024-09-14T11:33:24.125484+0000 2024-09-14T11:33:24.122 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:33:24.122 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:24.122 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:24.122 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f3e22a302eb] 2024-09-14T11:33:24.122 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3e22a3049f] 2024-09-14T11:33:24.122 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559a45e97c01] 2024-09-14T11:33:24.122 INFO:tasks.workunit.client.0.smithi071.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x559a45eac231] 2024-09-14T11:33:24.122 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x559a45ead884] 2024-09-14T11:33:24.122 INFO:tasks.workunit.client.0.smithi071.stderr: 6: main() 2024-09-14T11:33:24.122 INFO:tasks.workunit.client.0.smithi071.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3e21896d90] 2024-09-14T11:33:24.122 INFO:tasks.workunit.client.0.smithi071.stderr: 8: __libc_start_main() 2024-09-14T11:33:24.122 INFO:tasks.workunit.client.0.smithi071.stderr: 9: _start() 2024-09-14T11:33:24.123 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:24.123 INFO:tasks.workunit.client.0.smithi071.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:33:24.123 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f3e1f1569c0 thread_name:radosgw-admin 2024-09-14T11:33:24.140 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:24.140 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3e218af520] 2024-09-14T11:33:24.140 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:33:24.140 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:33:24.140 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:33:24.140 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3e22a30345] 2024-09-14T11:33:24.140 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3e22a3049f] 2024-09-14T11:33:24.141 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559a45e97c01] 2024-09-14T11:33:24.141 INFO:tasks.workunit.client.0.smithi071.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x559a45eac231] 2024-09-14T11:33:24.141 INFO:tasks.workunit.client.0.smithi071.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x559a45ead884] 2024-09-14T11:33:24.141 INFO:tasks.workunit.client.0.smithi071.stderr: 10: main() 2024-09-14T11:33:24.141 INFO:tasks.workunit.client.0.smithi071.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3e21896d90] 2024-09-14T11:33:24.141 INFO:tasks.workunit.client.0.smithi071.stderr: 12: __libc_start_main() 2024-09-14T11:33:24.141 INFO:tasks.workunit.client.0.smithi071.stderr: 13: _start() 2024-09-14T11:33:24.141 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.125+0000 7f3e1f1569c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:33:24.141 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f3e1f1569c0 thread_name:radosgw-admin 2024-09-14T11:33:24.141 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:24.141 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:24.141 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3e218af520] 2024-09-14T11:33:24.142 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:33:24.142 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:33:24.142 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:33:24.142 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3e22a30345] 2024-09-14T11:33:24.142 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3e22a3049f] 2024-09-14T11:33:24.142 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559a45e97c01] 2024-09-14T11:33:24.142 INFO:tasks.workunit.client.0.smithi071.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x559a45eac231] 2024-09-14T11:33:24.142 INFO:tasks.workunit.client.0.smithi071.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x559a45ead884] 2024-09-14T11:33:24.142 INFO:tasks.workunit.client.0.smithi071.stderr: 10: main() 2024-09-14T11:33:24.142 INFO:tasks.workunit.client.0.smithi071.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3e21896d90] 2024-09-14T11:33:24.142 INFO:tasks.workunit.client.0.smithi071.stderr: 12: __libc_start_main() 2024-09-14T11:33:24.142 INFO:tasks.workunit.client.0.smithi071.stderr: 13: _start() 2024-09-14T11:33:24.142 INFO:tasks.workunit.client.0.smithi071.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:33:24.142 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:24.143 INFO:tasks.workunit.client.0.smithi071.stderr:--- begin dump of recent events --- 2024-09-14T11:33:24.143 INFO:tasks.workunit.client.0.smithi071.stderr: -499> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:24.143 INFO:tasks.workunit.client.0.smithi071.stderr: -498> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 1 librados: starting msgr at 2024-09-14T11:33:24.143 INFO:tasks.workunit.client.0.smithi071.stderr: -497> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 1 librados: starting objecter 2024-09-14T11:33:24.143 INFO:tasks.workunit.client.0.smithi071.stderr: -496> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 5 asok(0x559a47eced90) register_command objecter_requests hook 0x559a480dff40 2024-09-14T11:33:24.143 INFO:tasks.workunit.client.0.smithi071.stderr: -495> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 1 librados: setting wanted keys 2024-09-14T11:33:24.143 INFO:tasks.workunit.client.0.smithi071.stderr: -494> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 1 librados: calling monclient init 2024-09-14T11:33:24.143 INFO:tasks.workunit.client.0.smithi071.stderr: -493> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 10 monclient: init 2024-09-14T11:33:24.143 INFO:tasks.workunit.client.0.smithi071.stderr: -492> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 5 AuthRegistry(0x559a480d8d30) adding auth protocol: cephx 2024-09-14T11:33:24.143 INFO:tasks.workunit.client.0.smithi071.stderr: -491> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 5 AuthRegistry(0x559a480d8d30) adding auth protocol: cephx 2024-09-14T11:33:24.143 INFO:tasks.workunit.client.0.smithi071.stderr: -490> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 5 AuthRegistry(0x559a480d8d30) adding auth protocol: cephx 2024-09-14T11:33:24.143 INFO:tasks.workunit.client.0.smithi071.stderr: -489> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 5 AuthRegistry(0x559a480d8d30) adding con mode: secure 2024-09-14T11:33:24.143 INFO:tasks.workunit.client.0.smithi071.stderr: -488> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 5 AuthRegistry(0x559a480d8d30) adding con mode: crc 2024-09-14T11:33:24.143 INFO:tasks.workunit.client.0.smithi071.stderr: -487> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 5 AuthRegistry(0x559a480d8d30) adding con mode: secure 2024-09-14T11:33:24.144 INFO:tasks.workunit.client.0.smithi071.stderr: -486> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 5 AuthRegistry(0x559a480d8d30) adding con mode: crc 2024-09-14T11:33:24.144 INFO:tasks.workunit.client.0.smithi071.stderr: -485> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 5 AuthRegistry(0x559a480d8d30) adding con mode: secure 2024-09-14T11:33:24.144 INFO:tasks.workunit.client.0.smithi071.stderr: -484> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 5 AuthRegistry(0x559a480d8d30) adding con mode: crc 2024-09-14T11:33:24.144 INFO:tasks.workunit.client.0.smithi071.stderr: -483> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 5 AuthRegistry(0x559a480d8d30) adding con mode: crc 2024-09-14T11:33:24.144 INFO:tasks.workunit.client.0.smithi071.stderr: -482> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 5 AuthRegistry(0x559a480d8d30) adding con mode: secure 2024-09-14T11:33:24.144 INFO:tasks.workunit.client.0.smithi071.stderr: -481> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 5 AuthRegistry(0x559a480d8d30) adding con mode: crc 2024-09-14T11:33:24.144 INFO:tasks.workunit.client.0.smithi071.stderr: -480> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 5 AuthRegistry(0x559a480d8d30) adding con mode: secure 2024-09-14T11:33:24.144 INFO:tasks.workunit.client.0.smithi071.stderr: -479> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 5 AuthRegistry(0x559a480d8d30) adding con mode: crc 2024-09-14T11:33:24.144 INFO:tasks.workunit.client.0.smithi071.stderr: -478> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 5 AuthRegistry(0x559a480d8d30) adding con mode: secure 2024-09-14T11:33:24.144 INFO:tasks.workunit.client.0.smithi071.stderr: -477> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:24.144 INFO:tasks.workunit.client.0.smithi071.stderr: -476> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:24.144 INFO:tasks.workunit.client.0.smithi071.stderr: -475> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 5 asok(0x559a47eced90) register_command rotate-key hook 0x559a480d8e78 2024-09-14T11:33:24.144 INFO:tasks.workunit.client.0.smithi071.stderr: -474> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 10 monclient: _reopen_session rank -1 2024-09-14T11:33:24.145 INFO:tasks.workunit.client.0.smithi071.stderr: -473> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:33:24.145 INFO:tasks.workunit.client.0.smithi071.stderr: -472> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 10 monclient(hunting): picked mon.noname-b con 0x559a47f89070 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:33:24.145 INFO:tasks.workunit.client.0.smithi071.stderr: -471> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 10 monclient(hunting): picked mon.noname-c con 0x559a47f92b00 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:33:24.145 INFO:tasks.workunit.client.0.smithi071.stderr: -470> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 10 monclient(hunting): picked mon.noname-a con 0x559a4801f000 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:33:24.145 INFO:tasks.workunit.client.0.smithi071.stderr: -469> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:24.145 INFO:tasks.workunit.client.0.smithi071.stderr: -468> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:24.145 INFO:tasks.workunit.client.0.smithi071.stderr: -467> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:24.145 INFO:tasks.workunit.client.0.smithi071.stderr: -466> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 10 monclient(hunting): _renew_subs 2024-09-14T11:33:24.145 INFO:tasks.workunit.client.0.smithi071.stderr: -465> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 10 monclient(hunting): authenticate will time out at 2415.903861s 2024-09-14T11:33:24.145 INFO:tasks.workunit.client.0.smithi071.stderr: -464> 2024-09-14T11:33:23.785+0000 7f3e1d45d640 10 monclient(hunting): get_auth_request con 0x559a4801f000 auth_method 0 2024-09-14T11:33:24.145 INFO:tasks.workunit.client.0.smithi071.stderr: -463> 2024-09-14T11:33:23.785+0000 7f3e1d45d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:24.145 INFO:tasks.workunit.client.0.smithi071.stderr: -462> 2024-09-14T11:33:23.785+0000 7f3e1d45d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:24.145 INFO:tasks.workunit.client.0.smithi071.stderr: -461> 2024-09-14T11:33:23.785+0000 7f3e1d45d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:24.145 INFO:tasks.workunit.client.0.smithi071.stderr: -460> 2024-09-14T11:33:23.785+0000 7f3e1c45b640 10 monclient(hunting): get_auth_request con 0x559a47f92b00 auth_method 0 2024-09-14T11:33:24.146 INFO:tasks.workunit.client.0.smithi071.stderr: -459> 2024-09-14T11:33:23.785+0000 7f3e1c45b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:24.146 INFO:tasks.workunit.client.0.smithi071.stderr: -458> 2024-09-14T11:33:23.785+0000 7f3e1c45b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:24.146 INFO:tasks.workunit.client.0.smithi071.stderr: -457> 2024-09-14T11:33:23.785+0000 7f3e1c45b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:24.146 INFO:tasks.workunit.client.0.smithi071.stderr: -456> 2024-09-14T11:33:23.785+0000 7f3e1d45d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:24.146 INFO:tasks.workunit.client.0.smithi071.stderr: -455> 2024-09-14T11:33:23.785+0000 7f3e1d45d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:24.146 INFO:tasks.workunit.client.0.smithi071.stderr: -454> 2024-09-14T11:33:23.785+0000 7f3e1d45d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:24.146 INFO:tasks.workunit.client.0.smithi071.stderr: -453> 2024-09-14T11:33:23.785+0000 7f3e1c45b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:24.146 INFO:tasks.workunit.client.0.smithi071.stderr: -452> 2024-09-14T11:33:23.785+0000 7f3e1c45b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:24.146 INFO:tasks.workunit.client.0.smithi071.stderr: -451> 2024-09-14T11:33:23.785+0000 7f3e1c45b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:24.146 INFO:tasks.workunit.client.0.smithi071.stderr: -450> 2024-09-14T11:33:23.785+0000 7f3e1cc5c640 10 monclient(hunting): get_auth_request con 0x559a47f89070 auth_method 0 2024-09-14T11:33:24.146 INFO:tasks.workunit.client.0.smithi071.stderr: -449> 2024-09-14T11:33:23.785+0000 7f3e1cc5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:24.146 INFO:tasks.workunit.client.0.smithi071.stderr: -448> 2024-09-14T11:33:23.785+0000 7f3e1cc5c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:24.146 INFO:tasks.workunit.client.0.smithi071.stderr: -447> 2024-09-14T11:33:23.785+0000 7f3e1cc5c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:24.146 INFO:tasks.workunit.client.0.smithi071.stderr: -446> 2024-09-14T11:33:23.785+0000 7f3e1c45b640 10 monclient(hunting): handle_auth_done global_id 7520 payload 824 2024-09-14T11:33:24.147 INFO:tasks.workunit.client.0.smithi071.stderr: -445> 2024-09-14T11:33:23.785+0000 7f3e1c45b640 10 monclient: _finish_hunting 0 2024-09-14T11:33:24.147 INFO:tasks.workunit.client.0.smithi071.stderr: -444> 2024-09-14T11:33:23.785+0000 7f3e1c45b640 1 monclient: found mon.noname-c 2024-09-14T11:33:24.147 INFO:tasks.workunit.client.0.smithi071.stderr: -443> 2024-09-14T11:33:23.785+0000 7f3e1c45b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:33:24.147 INFO:tasks.workunit.client.0.smithi071.stderr: -442> 2024-09-14T11:33:23.785+0000 7f3d0960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:24.147 INFO:tasks.workunit.client.0.smithi071.stderr: -441> 2024-09-14T11:33:23.785+0000 7f3d0960a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:24.147 INFO:tasks.workunit.client.0.smithi071.stderr: -440> 2024-09-14T11:33:23.785+0000 7f3d0960a640 10 monclient: dump: 2024-09-14T11:33:24.147 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:33:24.147 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:33:24.147 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:24.147 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:24.147 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:24.147 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:24.147 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:33:24.147 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:33:24.148 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:33:24.148 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:24.148 INFO:tasks.workunit.client.0.smithi071.stderr: -439> 2024-09-14T11:33:23.785+0000 7f3d0960a640 10 monclient: _finish_auth 0 2024-09-14T11:33:24.148 INFO:tasks.workunit.client.0.smithi071.stderr: -438> 2024-09-14T11:33:23.785+0000 7f3d0960a640 10 monclient: _check_auth_tickets 2024-09-14T11:33:24.148 INFO:tasks.workunit.client.0.smithi071.stderr: -437> 2024-09-14T11:33:23.785+0000 7f3d0960a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:24.148 INFO:tasks.workunit.client.0.smithi071.stderr: -436> 2024-09-14T11:33:23.785+0000 7f3d0960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:24.148 INFO:tasks.workunit.client.0.smithi071.stderr: -435> 2024-09-14T11:33:23.785+0000 7f3d0960a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:24.148 INFO:tasks.workunit.client.0.smithi071.stderr: -434> 2024-09-14T11:33:23.785+0000 7f3d0960a640 10 monclient: dump: 2024-09-14T11:33:24.148 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:33:24.148 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:33:24.148 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:24.148 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:24.148 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:24.148 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:24.149 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:33:24.149 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:33:24.149 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:33:24.149 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:24.149 INFO:tasks.workunit.client.0.smithi071.stderr: -433> 2024-09-14T11:33:23.785+0000 7f3e1f1569c0 5 monclient: authenticate success, global_id 7520 2024-09-14T11:33:24.149 INFO:tasks.workunit.client.0.smithi071.stderr: -432> 2024-09-14T11:33:23.785+0000 7f3e1f1569c0 10 monclient: _renew_subs 2024-09-14T11:33:24.149 INFO:tasks.workunit.client.0.smithi071.stderr: -431> 2024-09-14T11:33:23.785+0000 7f3e1f1569c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:33:24.149 INFO:tasks.workunit.client.0.smithi071.stderr: -430> 2024-09-14T11:33:23.785+0000 7f3d0ae0d640 4 set_mon_vals no callback set 2024-09-14T11:33:24.149 INFO:tasks.workunit.client.0.smithi071.stderr: -429> 2024-09-14T11:33:23.785+0000 7f3e1f1569c0 10 monclient: _renew_subs 2024-09-14T11:33:24.149 INFO:tasks.workunit.client.0.smithi071.stderr: -428> 2024-09-14T11:33:23.785+0000 7f3e1f1569c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:33:24.149 INFO:tasks.workunit.client.0.smithi071.stderr: -427> 2024-09-14T11:33:23.785+0000 7f3e1f1569c0 1 librados: init done 2024-09-14T11:33:24.149 INFO:tasks.workunit.client.0.smithi071.stderr: -426> 2024-09-14T11:33:23.785+0000 7f3d0960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:24.149 INFO:tasks.workunit.client.0.smithi071.stderr: -425> 2024-09-14T11:33:23.785+0000 7f3d0960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:33:24.150 INFO:tasks.workunit.client.0.smithi071.stderr: -424> 2024-09-14T11:33:23.785+0000 7f3d0960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:33:24.150 INFO:tasks.workunit.client.0.smithi071.stderr: -423> 2024-09-14T11:33:23.785+0000 7f3e1cc5c640 10 monclient: get_auth_request con 0x7f3d040718d0 auth_method 0 2024-09-14T11:33:24.150 INFO:tasks.workunit.client.0.smithi071.stderr: -422> 2024-09-14T11:33:23.785+0000 7f3e1d45d640 10 monclient: get_auth_request con 0x559a48101d60 auth_method 0 2024-09-14T11:33:24.150 INFO:tasks.workunit.client.0.smithi071.stderr: -421> 2024-09-14T11:33:23.789+0000 7f3e1cc5c640 10 monclient: get_auth_request con 0x559a48124960 auth_method 0 2024-09-14T11:33:24.150 INFO:tasks.workunit.client.0.smithi071.stderr: -420> 2024-09-14T11:33:23.789+0000 7f3e1c45b640 10 monclient: get_auth_request con 0x559a48128dd0 auth_method 0 2024-09-14T11:33:24.150 INFO:tasks.workunit.client.0.smithi071.stderr: -419> 2024-09-14T11:33:23.789+0000 7f3e1d45d640 10 monclient: get_auth_request con 0x559a48128270 auth_method 0 2024-09-14T11:33:24.150 INFO:tasks.workunit.client.0.smithi071.stderr: -418> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 10 monclient: build_initial_monmap 2024-09-14T11:33:24.150 INFO:tasks.workunit.client.0.smithi071.stderr: -417> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 1 build_initial for_mkfs: 0 2024-09-14T11:33:24.150 INFO:tasks.workunit.client.0.smithi071.stderr: -416> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 10 monclient: monmap: 2024-09-14T11:33:24.150 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:33:24.150 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:24.150 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:33:24.150 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:33:24.150 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:24.151 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:24.151 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:33:24.151 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:33:24.151 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:33:24.151 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:24.151 INFO:tasks.workunit.client.0.smithi071.stderr: -415> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48130fe0) adding auth protocol: cephx 2024-09-14T11:33:24.151 INFO:tasks.workunit.client.0.smithi071.stderr: -414> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48130fe0) adding auth protocol: cephx 2024-09-14T11:33:24.151 INFO:tasks.workunit.client.0.smithi071.stderr: -413> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48130fe0) adding auth protocol: cephx 2024-09-14T11:33:24.151 INFO:tasks.workunit.client.0.smithi071.stderr: -412> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48130fe0) adding con mode: secure 2024-09-14T11:33:24.151 INFO:tasks.workunit.client.0.smithi071.stderr: -411> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48130fe0) adding con mode: crc 2024-09-14T11:33:24.151 INFO:tasks.workunit.client.0.smithi071.stderr: -410> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48130fe0) adding con mode: secure 2024-09-14T11:33:24.151 INFO:tasks.workunit.client.0.smithi071.stderr: -409> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48130fe0) adding con mode: crc 2024-09-14T11:33:24.151 INFO:tasks.workunit.client.0.smithi071.stderr: -408> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48130fe0) adding con mode: secure 2024-09-14T11:33:24.151 INFO:tasks.workunit.client.0.smithi071.stderr: -407> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48130fe0) adding con mode: crc 2024-09-14T11:33:24.151 INFO:tasks.workunit.client.0.smithi071.stderr: -406> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48130fe0) adding con mode: crc 2024-09-14T11:33:24.152 INFO:tasks.workunit.client.0.smithi071.stderr: -405> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48130fe0) adding con mode: secure 2024-09-14T11:33:24.152 INFO:tasks.workunit.client.0.smithi071.stderr: -404> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48130fe0) adding con mode: crc 2024-09-14T11:33:24.152 INFO:tasks.workunit.client.0.smithi071.stderr: -403> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48130fe0) adding con mode: secure 2024-09-14T11:33:24.152 INFO:tasks.workunit.client.0.smithi071.stderr: -402> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48130fe0) adding con mode: crc 2024-09-14T11:33:24.152 INFO:tasks.workunit.client.0.smithi071.stderr: -401> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48130fe0) adding con mode: secure 2024-09-14T11:33:24.152 INFO:tasks.workunit.client.0.smithi071.stderr: -400> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:24.152 INFO:tasks.workunit.client.0.smithi071.stderr: -399> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 asok(0x559a47eced90) register_command objecter_requests cmddesc objecter_requests hook 0x559a481349d0 EEXIST 2024-09-14T11:33:24.152 INFO:tasks.workunit.client.0.smithi071.stderr: -398> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 10 monclient: init 2024-09-14T11:33:24.152 INFO:tasks.workunit.client.0.smithi071.stderr: -397> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4812fed8) adding auth protocol: cephx 2024-09-14T11:33:24.152 INFO:tasks.workunit.client.0.smithi071.stderr: -396> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4812fed8) adding auth protocol: cephx 2024-09-14T11:33:24.152 INFO:tasks.workunit.client.0.smithi071.stderr: -395> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4812fed8) adding auth protocol: cephx 2024-09-14T11:33:24.152 INFO:tasks.workunit.client.0.smithi071.stderr: -394> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4812fed8) adding con mode: secure 2024-09-14T11:33:24.152 INFO:tasks.workunit.client.0.smithi071.stderr: -393> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4812fed8) adding con mode: crc 2024-09-14T11:33:24.153 INFO:tasks.workunit.client.0.smithi071.stderr: -392> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4812fed8) adding con mode: secure 2024-09-14T11:33:24.153 INFO:tasks.workunit.client.0.smithi071.stderr: -391> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4812fed8) adding con mode: crc 2024-09-14T11:33:24.153 INFO:tasks.workunit.client.0.smithi071.stderr: -390> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4812fed8) adding con mode: secure 2024-09-14T11:33:24.153 INFO:tasks.workunit.client.0.smithi071.stderr: -389> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4812fed8) adding con mode: crc 2024-09-14T11:33:24.153 INFO:tasks.workunit.client.0.smithi071.stderr: -388> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4812fed8) adding con mode: crc 2024-09-14T11:33:24.153 INFO:tasks.workunit.client.0.smithi071.stderr: -387> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4812fed8) adding con mode: secure 2024-09-14T11:33:24.153 INFO:tasks.workunit.client.0.smithi071.stderr: -386> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4812fed8) adding con mode: crc 2024-09-14T11:33:24.153 INFO:tasks.workunit.client.0.smithi071.stderr: -385> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4812fed8) adding con mode: secure 2024-09-14T11:33:24.153 INFO:tasks.workunit.client.0.smithi071.stderr: -384> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4812fed8) adding con mode: crc 2024-09-14T11:33:24.153 INFO:tasks.workunit.client.0.smithi071.stderr: -383> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4812fed8) adding con mode: secure 2024-09-14T11:33:24.154 INFO:tasks.workunit.client.0.smithi071.stderr: -382> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:24.154 INFO:tasks.workunit.client.0.smithi071.stderr: -381> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:24.154 INFO:tasks.workunit.client.0.smithi071.stderr: -380> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 asok(0x559a47eced90) register_command rotate-key cmddesc rotate-key hook 0x559a48130020 EEXIST 2024-09-14T11:33:24.154 INFO:tasks.workunit.client.0.smithi071.stderr: -379> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 10 monclient: _reopen_session rank -1 2024-09-14T11:33:24.154 INFO:tasks.workunit.client.0.smithi071.stderr: -378> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:33:24.154 INFO:tasks.workunit.client.0.smithi071.stderr: -377> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 10 monclient(hunting): picked mon.noname-b con 0x559a48158b80 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:33:24.154 INFO:tasks.workunit.client.0.smithi071.stderr: -376> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 10 monclient(hunting): picked mon.noname-a con 0x559a481584b0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:33:24.154 INFO:tasks.workunit.client.0.smithi071.stderr: -375> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 10 monclient(hunting): picked mon.noname-c con 0x559a48156e90 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:33:24.154 INFO:tasks.workunit.client.0.smithi071.stderr: -374> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:24.154 INFO:tasks.workunit.client.0.smithi071.stderr: -373> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:24.154 INFO:tasks.workunit.client.0.smithi071.stderr: -372> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:24.154 INFO:tasks.workunit.client.0.smithi071.stderr: -371> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 10 monclient(hunting): _renew_subs 2024-09-14T11:33:24.154 INFO:tasks.workunit.client.0.smithi071.stderr: -370> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 10 monclient(hunting): authenticate will time out at 2415.913966s 2024-09-14T11:33:24.154 INFO:tasks.workunit.client.0.smithi071.stderr: -369> 2024-09-14T11:33:23.793+0000 7f3e1d45d640 10 monclient(hunting): get_auth_request con 0x559a481584b0 auth_method 0 2024-09-14T11:33:24.155 INFO:tasks.workunit.client.0.smithi071.stderr: -368> 2024-09-14T11:33:23.793+0000 7f3e1d45d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:24.155 INFO:tasks.workunit.client.0.smithi071.stderr: -367> 2024-09-14T11:33:23.793+0000 7f3e1d45d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:24.155 INFO:tasks.workunit.client.0.smithi071.stderr: -366> 2024-09-14T11:33:23.793+0000 7f3e1d45d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:24.155 INFO:tasks.workunit.client.0.smithi071.stderr: -365> 2024-09-14T11:33:23.793+0000 7f3e1cc5c640 10 monclient(hunting): get_auth_request con 0x559a48156e90 auth_method 0 2024-09-14T11:33:24.155 INFO:tasks.workunit.client.0.smithi071.stderr: -364> 2024-09-14T11:33:23.793+0000 7f3e1cc5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:24.155 INFO:tasks.workunit.client.0.smithi071.stderr: -363> 2024-09-14T11:33:23.793+0000 7f3e1cc5c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:24.155 INFO:tasks.workunit.client.0.smithi071.stderr: -362> 2024-09-14T11:33:23.793+0000 7f3e1cc5c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:24.155 INFO:tasks.workunit.client.0.smithi071.stderr: -361> 2024-09-14T11:33:23.793+0000 7f3e1d45d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:24.155 INFO:tasks.workunit.client.0.smithi071.stderr: -360> 2024-09-14T11:33:23.793+0000 7f3e1d45d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:24.155 INFO:tasks.workunit.client.0.smithi071.stderr: -359> 2024-09-14T11:33:23.793+0000 7f3e1d45d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:24.155 INFO:tasks.workunit.client.0.smithi071.stderr: -358> 2024-09-14T11:33:23.793+0000 7f3e1cc5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:24.155 INFO:tasks.workunit.client.0.smithi071.stderr: -357> 2024-09-14T11:33:23.793+0000 7f3e1cc5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:24.155 INFO:tasks.workunit.client.0.smithi071.stderr: -356> 2024-09-14T11:33:23.793+0000 7f3e1cc5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:24.155 INFO:tasks.workunit.client.0.smithi071.stderr: -355> 2024-09-14T11:33:23.793+0000 7f3e1c45b640 10 monclient(hunting): get_auth_request con 0x559a48158b80 auth_method 0 2024-09-14T11:33:24.156 INFO:tasks.workunit.client.0.smithi071.stderr: -354> 2024-09-14T11:33:23.793+0000 7f3e1c45b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:24.156 INFO:tasks.workunit.client.0.smithi071.stderr: -353> 2024-09-14T11:33:23.793+0000 7f3e1c45b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:24.156 INFO:tasks.workunit.client.0.smithi071.stderr: -352> 2024-09-14T11:33:23.793+0000 7f3e1c45b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:24.156 INFO:tasks.workunit.client.0.smithi071.stderr: -351> 2024-09-14T11:33:23.793+0000 7f3e1d45d640 10 monclient(hunting): handle_auth_done global_id 7920 payload 824 2024-09-14T11:33:24.156 INFO:tasks.workunit.client.0.smithi071.stderr: -350> 2024-09-14T11:33:23.793+0000 7f3e1d45d640 10 monclient: _finish_hunting 0 2024-09-14T11:33:24.156 INFO:tasks.workunit.client.0.smithi071.stderr: -349> 2024-09-14T11:33:23.793+0000 7f3e1d45d640 1 monclient: found mon.noname-a 2024-09-14T11:33:24.156 INFO:tasks.workunit.client.0.smithi071.stderr: -348> 2024-09-14T11:33:23.793+0000 7f3e1d45d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:33:24.156 INFO:tasks.workunit.client.0.smithi071.stderr: -347> 2024-09-14T11:33:23.793+0000 7f3d027fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:24.156 INFO:tasks.workunit.client.0.smithi071.stderr: -346> 2024-09-14T11:33:23.793+0000 7f3d027fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:33:24.156 INFO:tasks.workunit.client.0.smithi071.stderr: -345> 2024-09-14T11:33:23.793+0000 7f3d027fc640 10 monclient: dump: 2024-09-14T11:33:24.156 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:33:24.156 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:33:24.156 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:24.157 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:24.157 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:24.157 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:24.157 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:33:24.157 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:33:24.157 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:33:24.157 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:24.157 INFO:tasks.workunit.client.0.smithi071.stderr: -344> 2024-09-14T11:33:23.793+0000 7f3d027fc640 10 monclient: _finish_auth 0 2024-09-14T11:33:24.157 INFO:tasks.workunit.client.0.smithi071.stderr: -343> 2024-09-14T11:33:23.793+0000 7f3d027fc640 10 monclient: _check_auth_tickets 2024-09-14T11:33:24.157 INFO:tasks.workunit.client.0.smithi071.stderr: -342> 2024-09-14T11:33:23.793+0000 7f3d027fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:24.157 INFO:tasks.workunit.client.0.smithi071.stderr: -341> 2024-09-14T11:33:23.793+0000 7f3d027fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:24.157 INFO:tasks.workunit.client.0.smithi071.stderr: -340> 2024-09-14T11:33:23.793+0000 7f3d027fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:33:24.157 INFO:tasks.workunit.client.0.smithi071.stderr: -339> 2024-09-14T11:33:23.793+0000 7f3d027fc640 10 monclient: dump: 2024-09-14T11:33:24.158 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:33:24.158 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:33:24.158 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:24.158 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:24.158 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:24.158 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:24.158 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:33:24.158 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:33:24.158 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:33:24.158 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:24.158 INFO:tasks.workunit.client.0.smithi071.stderr: -338> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 monclient: authenticate success, global_id 7920 2024-09-14T11:33:24.158 INFO:tasks.workunit.client.0.smithi071.stderr: -337> 2024-09-14T11:33:23.793+0000 7f3e1bc5a640 4 set_mon_vals no callback set 2024-09-14T11:33:24.158 INFO:tasks.workunit.client.0.smithi071.stderr: -336> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 10 monclient: _renew_subs 2024-09-14T11:33:24.158 INFO:tasks.workunit.client.0.smithi071.stderr: -335> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:33:24.159 INFO:tasks.workunit.client.0.smithi071.stderr: -334> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 10 monclient: _renew_subs 2024-09-14T11:33:24.159 INFO:tasks.workunit.client.0.smithi071.stderr: -333> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:33:24.159 INFO:tasks.workunit.client.0.smithi071.stderr: -332> 2024-09-14T11:33:23.797+0000 7f3d027fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:24.159 INFO:tasks.workunit.client.0.smithi071.stderr: -331> 2024-09-14T11:33:23.797+0000 7f3d027fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:33:24.159 INFO:tasks.workunit.client.0.smithi071.stderr: -330> 2024-09-14T11:33:23.797+0000 7f3d027fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:33:24.159 INFO:tasks.workunit.client.0.smithi071.stderr: -329> 2024-09-14T11:33:23.797+0000 7f3e1c45b640 10 monclient: get_auth_request con 0x7f3cf40717e0 auth_method 0 2024-09-14T11:33:24.159 INFO:tasks.workunit.client.0.smithi071.stderr: -328> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 10 monclient: get_monmap_and_config 2024-09-14T11:33:24.159 INFO:tasks.workunit.client.0.smithi071.stderr: -327> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 10 monclient: build_initial_monmap 2024-09-14T11:33:24.159 INFO:tasks.workunit.client.0.smithi071.stderr: -326> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 1 build_initial for_mkfs: 0 2024-09-14T11:33:24.159 INFO:tasks.workunit.client.0.smithi071.stderr: -325> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 10 monclient: monmap: 2024-09-14T11:33:24.159 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:33:24.159 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:24.159 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:33:24.159 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:33:24.160 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:24.160 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:24.160 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:33:24.160 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:33:24.160 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:33:24.160 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:24.160 INFO:tasks.workunit.client.0.smithi071.stderr: -324> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48178260) adding auth protocol: cephx 2024-09-14T11:33:24.160 INFO:tasks.workunit.client.0.smithi071.stderr: -323> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48178260) adding auth protocol: cephx 2024-09-14T11:33:24.160 INFO:tasks.workunit.client.0.smithi071.stderr: -322> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48178260) adding auth protocol: cephx 2024-09-14T11:33:24.160 INFO:tasks.workunit.client.0.smithi071.stderr: -321> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48178260) adding con mode: secure 2024-09-14T11:33:24.160 INFO:tasks.workunit.client.0.smithi071.stderr: -320> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48178260) adding con mode: crc 2024-09-14T11:33:24.160 INFO:tasks.workunit.client.0.smithi071.stderr: -319> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48178260) adding con mode: secure 2024-09-14T11:33:24.161 INFO:tasks.workunit.client.0.smithi071.stderr: -318> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48178260) adding con mode: crc 2024-09-14T11:33:24.161 INFO:tasks.workunit.client.0.smithi071.stderr: -317> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48178260) adding con mode: secure 2024-09-14T11:33:24.161 INFO:tasks.workunit.client.0.smithi071.stderr: -316> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48178260) adding con mode: crc 2024-09-14T11:33:24.161 INFO:tasks.workunit.client.0.smithi071.stderr: -315> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48178260) adding con mode: crc 2024-09-14T11:33:24.161 INFO:tasks.workunit.client.0.smithi071.stderr: -314> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48178260) adding con mode: secure 2024-09-14T11:33:24.161 INFO:tasks.workunit.client.0.smithi071.stderr: -313> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48178260) adding con mode: crc 2024-09-14T11:33:24.161 INFO:tasks.workunit.client.0.smithi071.stderr: -312> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48178260) adding con mode: secure 2024-09-14T11:33:24.161 INFO:tasks.workunit.client.0.smithi071.stderr: -311> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48178260) adding con mode: crc 2024-09-14T11:33:24.161 INFO:tasks.workunit.client.0.smithi071.stderr: -310> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48178260) adding con mode: secure 2024-09-14T11:33:24.161 INFO:tasks.workunit.client.0.smithi071.stderr: -309> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:24.161 INFO:tasks.workunit.client.0.smithi071.stderr: -308> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 10 monclient: init 2024-09-14T11:33:24.161 INFO:tasks.workunit.client.0.smithi071.stderr: -307> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8be50) adding auth protocol: cephx 2024-09-14T11:33:24.161 INFO:tasks.workunit.client.0.smithi071.stderr: -306> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8be50) adding auth protocol: cephx 2024-09-14T11:33:24.162 INFO:tasks.workunit.client.0.smithi071.stderr: -305> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8be50) adding auth protocol: cephx 2024-09-14T11:33:24.162 INFO:tasks.workunit.client.0.smithi071.stderr: -304> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8be50) adding con mode: secure 2024-09-14T11:33:24.162 INFO:tasks.workunit.client.0.smithi071.stderr: -303> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8be50) adding con mode: crc 2024-09-14T11:33:24.162 INFO:tasks.workunit.client.0.smithi071.stderr: -302> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8be50) adding con mode: secure 2024-09-14T11:33:24.162 INFO:tasks.workunit.client.0.smithi071.stderr: -301> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8be50) adding con mode: crc 2024-09-14T11:33:24.162 INFO:tasks.workunit.client.0.smithi071.stderr: -300> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8be50) adding con mode: secure 2024-09-14T11:33:24.162 INFO:tasks.workunit.client.0.smithi071.stderr: -299> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8be50) adding con mode: crc 2024-09-14T11:33:24.162 INFO:tasks.workunit.client.0.smithi071.stderr: -298> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8be50) adding con mode: crc 2024-09-14T11:33:24.162 INFO:tasks.workunit.client.0.smithi071.stderr: -297> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8be50) adding con mode: secure 2024-09-14T11:33:24.162 INFO:tasks.workunit.client.0.smithi071.stderr: -296> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8be50) adding con mode: crc 2024-09-14T11:33:24.162 INFO:tasks.workunit.client.0.smithi071.stderr: -295> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8be50) adding con mode: secure 2024-09-14T11:33:24.162 INFO:tasks.workunit.client.0.smithi071.stderr: -294> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8be50) adding con mode: crc 2024-09-14T11:33:24.162 INFO:tasks.workunit.client.0.smithi071.stderr: -293> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8be50) adding con mode: secure 2024-09-14T11:33:24.162 INFO:tasks.workunit.client.0.smithi071.stderr: -292> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:24.163 INFO:tasks.workunit.client.0.smithi071.stderr: -291> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:24.163 INFO:tasks.workunit.client.0.smithi071.stderr: -290> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 asok(0x559a47eced90) register_command rotate-key cmddesc rotate-key hook 0x7fff0fe8bf98 EEXIST 2024-09-14T11:33:24.163 INFO:tasks.workunit.client.0.smithi071.stderr: -289> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 10 monclient: _reopen_session rank -1 2024-09-14T11:33:24.163 INFO:tasks.workunit.client.0.smithi071.stderr: -288> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:33:24.163 INFO:tasks.workunit.client.0.smithi071.stderr: -287> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 10 monclient(hunting): picked mon.noname-c con 0x559a481a6850 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:33:24.163 INFO:tasks.workunit.client.0.smithi071.stderr: -286> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 10 monclient(hunting): picked mon.noname-b con 0x559a481a6c30 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:33:24.163 INFO:tasks.workunit.client.0.smithi071.stderr: -285> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 10 monclient(hunting): picked mon.noname-a con 0x559a481a80f0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:33:24.163 INFO:tasks.workunit.client.0.smithi071.stderr: -284> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:24.163 INFO:tasks.workunit.client.0.smithi071.stderr: -283> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:24.163 INFO:tasks.workunit.client.0.smithi071.stderr: -282> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:24.163 INFO:tasks.workunit.client.0.smithi071.stderr: -281> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 10 monclient(hunting): _renew_subs 2024-09-14T11:33:24.163 INFO:tasks.workunit.client.0.smithi071.stderr: -280> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 10 monclient(hunting): authenticate will time out at 2415.918411s 2024-09-14T11:33:24.163 INFO:tasks.workunit.client.0.smithi071.stderr: -279> 2024-09-14T11:33:23.797+0000 7f3e1c45b640 10 monclient(hunting): get_auth_request con 0x559a481a6850 auth_method 0 2024-09-14T11:33:24.164 INFO:tasks.workunit.client.0.smithi071.stderr: -278> 2024-09-14T11:33:23.797+0000 7f3e1c45b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:24.164 INFO:tasks.workunit.client.0.smithi071.stderr: -277> 2024-09-14T11:33:23.797+0000 7f3e1c45b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:24.164 INFO:tasks.workunit.client.0.smithi071.stderr: -276> 2024-09-14T11:33:23.797+0000 7f3e1c45b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:24.164 INFO:tasks.workunit.client.0.smithi071.stderr: -275> 2024-09-14T11:33:23.797+0000 7f3e1cc5c640 10 monclient(hunting): get_auth_request con 0x559a481a80f0 auth_method 0 2024-09-14T11:33:24.164 INFO:tasks.workunit.client.0.smithi071.stderr: -274> 2024-09-14T11:33:23.797+0000 7f3e1cc5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:24.164 INFO:tasks.workunit.client.0.smithi071.stderr: -273> 2024-09-14T11:33:23.797+0000 7f3e1cc5c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:24.164 INFO:tasks.workunit.client.0.smithi071.stderr: -272> 2024-09-14T11:33:23.797+0000 7f3e1cc5c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:24.164 INFO:tasks.workunit.client.0.smithi071.stderr: -271> 2024-09-14T11:33:23.797+0000 7f3e1c45b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:24.164 INFO:tasks.workunit.client.0.smithi071.stderr: -270> 2024-09-14T11:33:23.797+0000 7f3e1c45b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:24.164 INFO:tasks.workunit.client.0.smithi071.stderr: -269> 2024-09-14T11:33:23.797+0000 7f3e1c45b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:24.164 INFO:tasks.workunit.client.0.smithi071.stderr: -268> 2024-09-14T11:33:23.797+0000 7f3e1cc5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:24.164 INFO:tasks.workunit.client.0.smithi071.stderr: -267> 2024-09-14T11:33:23.797+0000 7f3e1cc5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:24.164 INFO:tasks.workunit.client.0.smithi071.stderr: -266> 2024-09-14T11:33:23.797+0000 7f3e1cc5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:24.164 INFO:tasks.workunit.client.0.smithi071.stderr: -265> 2024-09-14T11:33:23.797+0000 7f3e1c45b640 10 monclient(hunting): handle_auth_done global_id 7526 payload 274 2024-09-14T11:33:24.164 INFO:tasks.workunit.client.0.smithi071.stderr: -264> 2024-09-14T11:33:23.797+0000 7f3e1c45b640 10 monclient: _finish_hunting 0 2024-09-14T11:33:24.165 INFO:tasks.workunit.client.0.smithi071.stderr: -263> 2024-09-14T11:33:23.797+0000 7f3e1c45b640 1 monclient: found mon.noname-c 2024-09-14T11:33:24.165 INFO:tasks.workunit.client.0.smithi071.stderr: -262> 2024-09-14T11:33:23.797+0000 7f3e1c45b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:33:24.165 INFO:tasks.workunit.client.0.smithi071.stderr: -261> 2024-09-14T11:33:23.797+0000 7f3cf3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:24.165 INFO:tasks.workunit.client.0.smithi071.stderr: -260> 2024-09-14T11:33:23.797+0000 7f3cf3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:24.165 INFO:tasks.workunit.client.0.smithi071.stderr: -259> 2024-09-14T11:33:23.797+0000 7f3cf3fff640 10 monclient: dump: 2024-09-14T11:33:24.165 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:33:24.165 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:33:24.165 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:24.165 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:24.165 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:24.165 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:24.165 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:33:24.165 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:33:24.166 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:33:24.166 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:24.166 INFO:tasks.workunit.client.0.smithi071.stderr: -258> 2024-09-14T11:33:23.797+0000 7f3cf3fff640 10 monclient: _finish_auth 0 2024-09-14T11:33:24.166 INFO:tasks.workunit.client.0.smithi071.stderr: -257> 2024-09-14T11:33:23.797+0000 7f3cf3fff640 10 monclient: _check_auth_tickets 2024-09-14T11:33:24.166 INFO:tasks.workunit.client.0.smithi071.stderr: -256> 2024-09-14T11:33:23.797+0000 7f3cf3fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:24.166 INFO:tasks.workunit.client.0.smithi071.stderr: -255> 2024-09-14T11:33:23.797+0000 7f3cf3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:24.166 INFO:tasks.workunit.client.0.smithi071.stderr: -254> 2024-09-14T11:33:23.797+0000 7f3cf3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:24.166 INFO:tasks.workunit.client.0.smithi071.stderr: -253> 2024-09-14T11:33:23.797+0000 7f3cf3fff640 10 monclient: dump: 2024-09-14T11:33:24.166 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:33:24.166 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:33:24.166 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:24.166 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:24.166 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:24.166 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:24.167 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:33:24.167 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:33:24.167 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:33:24.167 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:24.167 INFO:tasks.workunit.client.0.smithi071.stderr: -252> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 monclient: authenticate success, global_id 7526 2024-09-14T11:33:24.167 INFO:tasks.workunit.client.0.smithi071.stderr: -251> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 10 monclient: get_monmap_and_config success 2024-09-14T11:33:24.167 INFO:tasks.workunit.client.0.smithi071.stderr: -250> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 4 set_mon_vals no callback set 2024-09-14T11:33:24.167 INFO:tasks.workunit.client.0.smithi071.stderr: -249> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 10 monclient: shutdown 2024-09-14T11:33:24.167 INFO:tasks.workunit.client.0.smithi071.stderr: -248> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 10 monclient: build_initial_monmap 2024-09-14T11:33:24.167 INFO:tasks.workunit.client.0.smithi071.stderr: -247> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 1 build_initial for_mkfs: 0 2024-09-14T11:33:24.167 INFO:tasks.workunit.client.0.smithi071.stderr: -246> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 10 monclient: monmap: 2024-09-14T11:33:24.167 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:33:24.167 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:24.167 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:33:24.168 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:33:24.168 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:24.168 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:24.168 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:33:24.168 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:33:24.168 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:33:24.168 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:24.168 INFO:tasks.workunit.client.0.smithi071.stderr: -245> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4819edd0) adding auth protocol: cephx 2024-09-14T11:33:24.168 INFO:tasks.workunit.client.0.smithi071.stderr: -244> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4819edd0) adding auth protocol: cephx 2024-09-14T11:33:24.168 INFO:tasks.workunit.client.0.smithi071.stderr: -243> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4819edd0) adding auth protocol: cephx 2024-09-14T11:33:24.168 INFO:tasks.workunit.client.0.smithi071.stderr: -242> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4819edd0) adding con mode: secure 2024-09-14T11:33:24.168 INFO:tasks.workunit.client.0.smithi071.stderr: -241> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4819edd0) adding con mode: crc 2024-09-14T11:33:24.168 INFO:tasks.workunit.client.0.smithi071.stderr: -240> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4819edd0) adding con mode: secure 2024-09-14T11:33:24.168 INFO:tasks.workunit.client.0.smithi071.stderr: -239> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4819edd0) adding con mode: crc 2024-09-14T11:33:24.169 INFO:tasks.workunit.client.0.smithi071.stderr: -238> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4819edd0) adding con mode: secure 2024-09-14T11:33:24.169 INFO:tasks.workunit.client.0.smithi071.stderr: -237> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4819edd0) adding con mode: crc 2024-09-14T11:33:24.169 INFO:tasks.workunit.client.0.smithi071.stderr: -236> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4819edd0) adding con mode: crc 2024-09-14T11:33:24.169 INFO:tasks.workunit.client.0.smithi071.stderr: -235> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4819edd0) adding con mode: secure 2024-09-14T11:33:24.169 INFO:tasks.workunit.client.0.smithi071.stderr: -234> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4819edd0) adding con mode: crc 2024-09-14T11:33:24.169 INFO:tasks.workunit.client.0.smithi071.stderr: -233> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4819edd0) adding con mode: secure 2024-09-14T11:33:24.169 INFO:tasks.workunit.client.0.smithi071.stderr: -232> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4819edd0) adding con mode: crc 2024-09-14T11:33:24.169 INFO:tasks.workunit.client.0.smithi071.stderr: -231> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4819edd0) adding con mode: secure 2024-09-14T11:33:24.169 INFO:tasks.workunit.client.0.smithi071.stderr: -230> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:24.169 INFO:tasks.workunit.client.0.smithi071.stderr: -229> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 1 librados: starting msgr at 2024-09-14T11:33:24.169 INFO:tasks.workunit.client.0.smithi071.stderr: -228> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 1 librados: starting objecter 2024-09-14T11:33:24.169 INFO:tasks.workunit.client.0.smithi071.stderr: -227> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 asok(0x559a47eced90) register_command objecter_requests cmddesc objecter_requests hook 0x559a4815a7f0 EEXIST 2024-09-14T11:33:24.169 INFO:tasks.workunit.client.0.smithi071.stderr: -226> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 1 librados: setting wanted keys 2024-09-14T11:33:24.170 INFO:tasks.workunit.client.0.smithi071.stderr: -225> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 1 librados: calling monclient init 2024-09-14T11:33:24.170 INFO:tasks.workunit.client.0.smithi071.stderr: -224> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 10 monclient: init 2024-09-14T11:33:24.170 INFO:tasks.workunit.client.0.smithi071.stderr: -223> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4815a9a0) adding auth protocol: cephx 2024-09-14T11:33:24.170 INFO:tasks.workunit.client.0.smithi071.stderr: -222> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4815a9a0) adding auth protocol: cephx 2024-09-14T11:33:24.170 INFO:tasks.workunit.client.0.smithi071.stderr: -221> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4815a9a0) adding auth protocol: cephx 2024-09-14T11:33:24.170 INFO:tasks.workunit.client.0.smithi071.stderr: -220> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4815a9a0) adding con mode: secure 2024-09-14T11:33:24.170 INFO:tasks.workunit.client.0.smithi071.stderr: -219> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4815a9a0) adding con mode: crc 2024-09-14T11:33:24.170 INFO:tasks.workunit.client.0.smithi071.stderr: -218> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4815a9a0) adding con mode: secure 2024-09-14T11:33:24.170 INFO:tasks.workunit.client.0.smithi071.stderr: -217> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4815a9a0) adding con mode: crc 2024-09-14T11:33:24.170 INFO:tasks.workunit.client.0.smithi071.stderr: -216> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4815a9a0) adding con mode: secure 2024-09-14T11:33:24.170 INFO:tasks.workunit.client.0.smithi071.stderr: -215> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4815a9a0) adding con mode: crc 2024-09-14T11:33:24.170 INFO:tasks.workunit.client.0.smithi071.stderr: -214> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4815a9a0) adding con mode: crc 2024-09-14T11:33:24.170 INFO:tasks.workunit.client.0.smithi071.stderr: -213> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4815a9a0) adding con mode: secure 2024-09-14T11:33:24.170 INFO:tasks.workunit.client.0.smithi071.stderr: -212> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4815a9a0) adding con mode: crc 2024-09-14T11:33:24.170 INFO:tasks.workunit.client.0.smithi071.stderr: -211> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4815a9a0) adding con mode: secure 2024-09-14T11:33:24.171 INFO:tasks.workunit.client.0.smithi071.stderr: -210> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4815a9a0) adding con mode: crc 2024-09-14T11:33:24.171 INFO:tasks.workunit.client.0.smithi071.stderr: -209> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4815a9a0) adding con mode: secure 2024-09-14T11:33:24.171 INFO:tasks.workunit.client.0.smithi071.stderr: -208> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:24.171 INFO:tasks.workunit.client.0.smithi071.stderr: -207> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:24.171 INFO:tasks.workunit.client.0.smithi071.stderr: -206> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 asok(0x559a47eced90) register_command rotate-key cmddesc rotate-key hook 0x559a4815aae8 EEXIST 2024-09-14T11:33:24.171 INFO:tasks.workunit.client.0.smithi071.stderr: -205> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 10 monclient: _reopen_session rank -1 2024-09-14T11:33:24.171 INFO:tasks.workunit.client.0.smithi071.stderr: -204> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:33:24.171 INFO:tasks.workunit.client.0.smithi071.stderr: -203> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 10 monclient(hunting): picked mon.noname-c con 0x559a481a6850 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:33:24.171 INFO:tasks.workunit.client.0.smithi071.stderr: -202> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 10 monclient(hunting): picked mon.noname-b con 0x559a481a80f0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:33:24.171 INFO:tasks.workunit.client.0.smithi071.stderr: -201> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 10 monclient(hunting): picked mon.noname-a con 0x559a4819ac50 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:33:24.171 INFO:tasks.workunit.client.0.smithi071.stderr: -200> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:24.171 INFO:tasks.workunit.client.0.smithi071.stderr: -199> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:24.171 INFO:tasks.workunit.client.0.smithi071.stderr: -198> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:24.171 INFO:tasks.workunit.client.0.smithi071.stderr: -197> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 10 monclient(hunting): _renew_subs 2024-09-14T11:33:24.172 INFO:tasks.workunit.client.0.smithi071.stderr: -196> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 10 monclient(hunting): authenticate will time out at 2415.920962s 2024-09-14T11:33:24.172 INFO:tasks.workunit.client.0.smithi071.stderr: -195> 2024-09-14T11:33:23.801+0000 7f3e1c45b640 10 monclient(hunting): get_auth_request con 0x559a481a6850 auth_method 0 2024-09-14T11:33:24.172 INFO:tasks.workunit.client.0.smithi071.stderr: -194> 2024-09-14T11:33:23.801+0000 7f3e1c45b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:24.172 INFO:tasks.workunit.client.0.smithi071.stderr: -193> 2024-09-14T11:33:23.801+0000 7f3e1c45b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:24.172 INFO:tasks.workunit.client.0.smithi071.stderr: -192> 2024-09-14T11:33:23.801+0000 7f3e1c45b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:24.172 INFO:tasks.workunit.client.0.smithi071.stderr: -191> 2024-09-14T11:33:23.801+0000 7f3e1cc5c640 10 monclient(hunting): get_auth_request con 0x559a4819ac50 auth_method 0 2024-09-14T11:33:24.172 INFO:tasks.workunit.client.0.smithi071.stderr: -190> 2024-09-14T11:33:23.801+0000 7f3e1cc5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:24.172 INFO:tasks.workunit.client.0.smithi071.stderr: -189> 2024-09-14T11:33:23.801+0000 7f3e1cc5c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:24.172 INFO:tasks.workunit.client.0.smithi071.stderr: -188> 2024-09-14T11:33:23.801+0000 7f3e1cc5c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:24.172 INFO:tasks.workunit.client.0.smithi071.stderr: -187> 2024-09-14T11:33:23.801+0000 7f3e1c45b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:24.172 INFO:tasks.workunit.client.0.smithi071.stderr: -186> 2024-09-14T11:33:23.801+0000 7f3e1c45b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:24.172 INFO:tasks.workunit.client.0.smithi071.stderr: -185> 2024-09-14T11:33:23.801+0000 7f3e1c45b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:24.172 INFO:tasks.workunit.client.0.smithi071.stderr: -184> 2024-09-14T11:33:23.801+0000 7f3e1cc5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:24.172 INFO:tasks.workunit.client.0.smithi071.stderr: -183> 2024-09-14T11:33:23.801+0000 7f3e1cc5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:24.172 INFO:tasks.workunit.client.0.smithi071.stderr: -182> 2024-09-14T11:33:23.801+0000 7f3e1cc5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:24.173 INFO:tasks.workunit.client.0.smithi071.stderr: -181> 2024-09-14T11:33:23.801+0000 7f3e1c45b640 10 monclient(hunting): handle_auth_done global_id 7529 payload 824 2024-09-14T11:33:24.173 INFO:tasks.workunit.client.0.smithi071.stderr: -180> 2024-09-14T11:33:23.801+0000 7f3e1c45b640 10 monclient: _finish_hunting 0 2024-09-14T11:33:24.173 INFO:tasks.workunit.client.0.smithi071.stderr: -179> 2024-09-14T11:33:23.801+0000 7f3e1c45b640 1 monclient: found mon.noname-c 2024-09-14T11:33:24.173 INFO:tasks.workunit.client.0.smithi071.stderr: -178> 2024-09-14T11:33:23.801+0000 7f3e1c45b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:33:24.173 INFO:tasks.workunit.client.0.smithi071.stderr: -177> 2024-09-14T11:33:23.801+0000 7f3cf27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:24.173 INFO:tasks.workunit.client.0.smithi071.stderr: -176> 2024-09-14T11:33:23.801+0000 7f3cf27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:24.173 INFO:tasks.workunit.client.0.smithi071.stderr: -175> 2024-09-14T11:33:23.801+0000 7f3cf27fc640 10 monclient: dump: 2024-09-14T11:33:24.173 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:33:24.173 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:33:24.173 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:24.173 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:24.173 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:24.173 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:24.173 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:33:24.173 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:33:24.174 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:33:24.174 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:24.174 INFO:tasks.workunit.client.0.smithi071.stderr: -174> 2024-09-14T11:33:23.801+0000 7f3cf27fc640 10 monclient: _finish_auth 0 2024-09-14T11:33:24.174 INFO:tasks.workunit.client.0.smithi071.stderr: -173> 2024-09-14T11:33:23.801+0000 7f3cf27fc640 10 monclient: _check_auth_tickets 2024-09-14T11:33:24.174 INFO:tasks.workunit.client.0.smithi071.stderr: -172> 2024-09-14T11:33:23.801+0000 7f3cf27fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:24.174 INFO:tasks.workunit.client.0.smithi071.stderr: -171> 2024-09-14T11:33:23.801+0000 7f3cf27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:24.174 INFO:tasks.workunit.client.0.smithi071.stderr: -170> 2024-09-14T11:33:23.801+0000 7f3cf27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:24.174 INFO:tasks.workunit.client.0.smithi071.stderr: -169> 2024-09-14T11:33:23.801+0000 7f3cf27fc640 10 monclient: dump: 2024-09-14T11:33:24.174 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:33:24.174 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:33:24.174 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:24.174 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:24.174 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:24.174 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:24.175 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:33:24.175 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:33:24.175 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:33:24.175 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:24.175 INFO:tasks.workunit.client.0.smithi071.stderr: -168> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 monclient: authenticate success, global_id 7529 2024-09-14T11:33:24.175 INFO:tasks.workunit.client.0.smithi071.stderr: -167> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 10 monclient: _renew_subs 2024-09-14T11:33:24.175 INFO:tasks.workunit.client.0.smithi071.stderr: -166> 2024-09-14T11:33:23.801+0000 7f3cf3fff640 4 set_mon_vals no callback set 2024-09-14T11:33:24.175 INFO:tasks.workunit.client.0.smithi071.stderr: -165> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:33:24.175 INFO:tasks.workunit.client.0.smithi071.stderr: -164> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 10 monclient: _renew_subs 2024-09-14T11:33:24.175 INFO:tasks.workunit.client.0.smithi071.stderr: -163> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:33:24.175 INFO:tasks.workunit.client.0.smithi071.stderr: -162> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 1 librados: init done 2024-09-14T11:33:24.175 INFO:tasks.workunit.client.0.smithi071.stderr: -161> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 asok(0x559a47eced90) register_command cr dump hook 0x559a4819c4e8 2024-09-14T11:33:24.175 INFO:tasks.workunit.client.0.smithi071.stderr: -160> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.175 INFO:tasks.workunit.client.0.smithi071.stderr: -159> 2024-09-14T11:33:23.801+0000 7f3cf27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:24.176 INFO:tasks.workunit.client.0.smithi071.stderr: -158> 2024-09-14T11:33:23.801+0000 7f3cf27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:33:24.176 INFO:tasks.workunit.client.0.smithi071.stderr: -157> 2024-09-14T11:33:23.801+0000 7f3cf27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:33:24.176 INFO:tasks.workunit.client.0.smithi071.stderr: -156> 2024-09-14T11:33:23.801+0000 7f3e1d45d640 10 monclient: get_auth_request con 0x7f3ce8071a40 auth_method 0 2024-09-14T11:33:24.176 INFO:tasks.workunit.client.0.smithi071.stderr: -155> 2024-09-14T11:33:23.805+0000 7f3e1cc5c640 10 monclient: get_auth_request con 0x559a481c65d0 auth_method 0 2024-09-14T11:33:24.176 INFO:tasks.workunit.client.0.smithi071.stderr: -154> 2024-09-14T11:33:23.805+0000 7f3e1f1569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:24.176 INFO:tasks.workunit.client.0.smithi071.stderr: -153> 2024-09-14T11:33:23.805+0000 7f3e1f1569c0 20 realm 2024-09-14T11:33:24.176 INFO:tasks.workunit.client.0.smithi071.stderr: -152> 2024-09-14T11:33:23.805+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.176 INFO:tasks.workunit.client.0.smithi071.stderr: -151> 2024-09-14T11:33:23.805+0000 7f3e1f1569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:24.176 INFO:tasks.workunit.client.0.smithi071.stderr: -150> 2024-09-14T11:33:23.805+0000 7f3e1f1569c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:24.176 INFO:tasks.workunit.client.0.smithi071.stderr: -149> 2024-09-14T11:33:23.805+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.176 INFO:tasks.workunit.client.0.smithi071.stderr: -148> 2024-09-14T11:33:23.805+0000 7f3e1f1569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:24.176 INFO:tasks.workunit.client.0.smithi071.stderr: -147> 2024-09-14T11:33:23.805+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.176 INFO:tasks.workunit.client.0.smithi071.stderr: -146> 2024-09-14T11:33:23.805+0000 7f3e1c45b640 10 monclient: get_auth_request con 0x559a481ca770 auth_method 0 2024-09-14T11:33:24.176 INFO:tasks.workunit.client.0.smithi071.stderr: -145> 2024-09-14T11:33:23.805+0000 7f3e1f1569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:24.176 INFO:tasks.workunit.client.0.smithi071.stderr: -144> 2024-09-14T11:33:23.805+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.177 INFO:tasks.workunit.client.0.smithi071.stderr: -143> 2024-09-14T11:33:23.805+0000 7f3e1d45d640 10 monclient: get_auth_request con 0x559a481ce060 auth_method 0 2024-09-14T11:33:24.177 INFO:tasks.workunit.client.0.smithi071.stderr: -142> 2024-09-14T11:33:23.805+0000 7f3e1f1569c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:24.177 INFO:tasks.workunit.client.0.smithi071.stderr: -141> 2024-09-14T11:33:23.809+0000 7f3e1f1569c0 20 searching for the correct realm 2024-09-14T11:33:24.177 INFO:tasks.workunit.client.0.smithi071.stderr: -140> 2024-09-14T11:33:23.809+0000 7f3e1cc5c640 10 monclient: get_auth_request con 0x559a481d2e00 auth_method 0 2024-09-14T11:33:24.177 INFO:tasks.workunit.client.0.smithi071.stderr: -139> 2024-09-14T11:33:23.809+0000 7f3e1c45b640 10 monclient: get_auth_request con 0x7f3e0c0193a0 auth_method 0 2024-09-14T11:33:24.177 INFO:tasks.workunit.client.0.smithi071.stderr: -138> 2024-09-14T11:33:23.809+0000 7f3e1d45d640 10 monclient: get_auth_request con 0x7f3e1000e070 auth_method 0 2024-09-14T11:33:24.177 INFO:tasks.workunit.client.0.smithi071.stderr: -137> 2024-09-14T11:33:23.809+0000 7f3e1d45d640 0 -- 172.21.15.71:0/1780958168 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f3e1000e070 msgr2=0x7f3e10053e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:24.177 INFO:tasks.workunit.client.0.smithi071.stderr: -136> 2024-09-14T11:33:24.013+0000 7f3e1d45d640 10 monclient: get_auth_request con 0x7f3e1000e070 auth_method 0 2024-09-14T11:33:24.177 INFO:tasks.workunit.client.0.smithi071.stderr: -135> 2024-09-14T11:33:24.013+0000 7f3e1cc5c640 10 monclient: get_auth_request con 0x7f3e0c02d8e0 auth_method 0 2024-09-14T11:33:24.177 INFO:tasks.workunit.client.0.smithi071.stderr: -134> 2024-09-14T11:33:24.021+0000 7f3e1c45b640 10 monclient: get_auth_request con 0x7f3e1004e110 auth_method 0 2024-09-14T11:33:24.177 INFO:tasks.workunit.client.0.smithi071.stderr: -133> 2024-09-14T11:33:24.021+0000 7f3e1d45d640 0 -- 172.21.15.71:0/1780958168 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x559a481ce060 msgr2=0x559a481d0450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:24.177 INFO:tasks.workunit.client.0.smithi071.stderr: -132> 2024-09-14T11:33:24.021+0000 7f3cf27fc640 1 client.7529.objecter ms_handle_reset 0x559a481ce060 session 0x559a481c9be0 osd.3 2024-09-14T11:33:24.177 INFO:tasks.workunit.client.0.smithi071.stderr: -131> 2024-09-14T11:33:24.021+0000 7f3cf27fc640 10 monclient: _renew_subs 2024-09-14T11:33:24.178 INFO:tasks.workunit.client.0.smithi071.stderr: -130> 2024-09-14T11:33:24.021+0000 7f3cf27fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:33:24.178 INFO:tasks.workunit.client.0.smithi071.stderr: -129> 2024-09-14T11:33:24.021+0000 7f3e1d45d640 10 monclient: get_auth_request con 0x7f3ce8081560 auth_method 0 2024-09-14T11:33:24.178 INFO:tasks.workunit.client.0.smithi071.stderr: -128> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:24.178 INFO:tasks.workunit.client.0.smithi071.stderr: -127> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:33:24.178 INFO:tasks.workunit.client.0.smithi071.stderr: -126> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:24.178 INFO:tasks.workunit.client.0.smithi071.stderr: -125> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:33:24.178 INFO:tasks.workunit.client.0.smithi071.stderr: -124> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:24.178 INFO:tasks.workunit.client.0.smithi071.stderr: -123> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:24.178 INFO:tasks.workunit.client.0.smithi071.stderr: -122> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.178 INFO:tasks.workunit.client.0.smithi071.stderr: -121> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:24.178 INFO:tasks.workunit.client.0.smithi071.stderr: -120> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.178 INFO:tasks.workunit.client.0.smithi071.stderr: -119> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:24.178 INFO:tasks.workunit.client.0.smithi071.stderr: -118> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.178 INFO:tasks.workunit.client.0.smithi071.stderr: -117> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:24.179 INFO:tasks.workunit.client.0.smithi071.stderr: -116> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 zone default found 2024-09-14T11:33:24.179 INFO:tasks.workunit.client.0.smithi071.stderr: -115> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 4 Realm: () 2024-09-14T11:33:24.179 INFO:tasks.workunit.client.0.smithi071.stderr: -114> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:33:24.179 INFO:tasks.workunit.client.0.smithi071.stderr: -113> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:33:24.179 INFO:tasks.workunit.client.0.smithi071.stderr: -112> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:24.179 INFO:tasks.workunit.client.0.smithi071.stderr: -111> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 zonegroup default 2024-09-14T11:33:24.179 INFO:tasks.workunit.client.0.smithi071.stderr: -110> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.179 INFO:tasks.workunit.client.0.smithi071.stderr: -109> 2024-09-14T11:33:24.041+0000 7f3e1f1569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:24.179 INFO:tasks.workunit.client.0.smithi071.stderr: -108> 2024-09-14T11:33:24.041+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.179 INFO:tasks.workunit.client.0.smithi071.stderr: -107> 2024-09-14T11:33:24.041+0000 7f3e1f1569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:24.179 INFO:tasks.workunit.client.0.smithi071.stderr: -106> 2024-09-14T11:33:24.041+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.179 INFO:tasks.workunit.client.0.smithi071.stderr: -105> 2024-09-14T11:33:24.041+0000 7f3e1f1569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:24.179 INFO:tasks.workunit.client.0.smithi071.stderr: -104> 2024-09-14T11:33:24.041+0000 7f3e1f1569c0 20 started sync module instance, tier type = 2024-09-14T11:33:24.180 INFO:tasks.workunit.client.0.smithi071.stderr: -103> 2024-09-14T11:33:24.041+0000 7f3e1f1569c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:33:24.180 INFO:tasks.workunit.client.0.smithi071.stderr: -102> 2024-09-14T11:33:24.065+0000 7f3e1f1569c0 20 add_watcher() i=0 2024-09-14T11:33:24.180 INFO:tasks.workunit.client.0.smithi071.stderr: -101> 2024-09-14T11:33:24.065+0000 7f3e1f1569c0 20 add_watcher() i=1 2024-09-14T11:33:24.180 INFO:tasks.workunit.client.0.smithi071.stderr: -100> 2024-09-14T11:33:24.065+0000 7f3e1f1569c0 20 add_watcher() i=2 2024-09-14T11:33:24.180 INFO:tasks.workunit.client.0.smithi071.stderr: -99> 2024-09-14T11:33:24.065+0000 7f3e1f1569c0 20 add_watcher() i=3 2024-09-14T11:33:24.180 INFO:tasks.workunit.client.0.smithi071.stderr: -98> 2024-09-14T11:33:24.065+0000 7f3e1f1569c0 20 add_watcher() i=4 2024-09-14T11:33:24.180 INFO:tasks.workunit.client.0.smithi071.stderr: -97> 2024-09-14T11:33:24.065+0000 7f3e1f1569c0 20 add_watcher() i=5 2024-09-14T11:33:24.180 INFO:tasks.workunit.client.0.smithi071.stderr: -96> 2024-09-14T11:33:24.065+0000 7f3e1f1569c0 20 add_watcher() i=6 2024-09-14T11:33:24.180 INFO:tasks.workunit.client.0.smithi071.stderr: -95> 2024-09-14T11:33:24.065+0000 7f3e1f1569c0 20 add_watcher() i=7 2024-09-14T11:33:24.180 INFO:tasks.workunit.client.0.smithi071.stderr: -94> 2024-09-14T11:33:24.065+0000 7f3e1f1569c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:24.180 INFO:tasks.workunit.client.0.smithi071.stderr: -93> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8c330) adding auth protocol: cephx 2024-09-14T11:33:24.180 INFO:tasks.workunit.client.0.smithi071.stderr: -92> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8c330) adding auth protocol: cephx 2024-09-14T11:33:24.180 INFO:tasks.workunit.client.0.smithi071.stderr: -91> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8c330) adding auth protocol: cephx 2024-09-14T11:33:24.180 INFO:tasks.workunit.client.0.smithi071.stderr: -90> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8c330) adding con mode: secure 2024-09-14T11:33:24.181 INFO:tasks.workunit.client.0.smithi071.stderr: -89> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8c330) adding con mode: crc 2024-09-14T11:33:24.181 INFO:tasks.workunit.client.0.smithi071.stderr: -88> 2024-09-14T11:33:24.073+0000 7f3cd37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:24.181 INFO:tasks.workunit.client.0.smithi071.stderr: -87> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8c330) adding con mode: secure 2024-09-14T11:33:24.181 INFO:tasks.workunit.client.0.smithi071.stderr: -86> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8c330) adding con mode: crc 2024-09-14T11:33:24.181 INFO:tasks.workunit.client.0.smithi071.stderr: -85> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8c330) adding con mode: secure 2024-09-14T11:33:24.181 INFO:tasks.workunit.client.0.smithi071.stderr: -84> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8c330) adding con mode: crc 2024-09-14T11:33:24.181 INFO:tasks.workunit.client.0.smithi071.stderr: -83> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8c330) adding con mode: crc 2024-09-14T11:33:24.181 INFO:tasks.workunit.client.0.smithi071.stderr: -82> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8c330) adding con mode: secure 2024-09-14T11:33:24.181 INFO:tasks.workunit.client.0.smithi071.stderr: -81> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8c330) adding con mode: crc 2024-09-14T11:33:24.181 INFO:tasks.workunit.client.0.smithi071.stderr: -80> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8c330) adding con mode: secure 2024-09-14T11:33:24.181 INFO:tasks.workunit.client.0.smithi071.stderr: -79> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8c330) adding con mode: crc 2024-09-14T11:33:24.181 INFO:tasks.workunit.client.0.smithi071.stderr: -78> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8c330) adding con mode: secure 2024-09-14T11:33:24.181 INFO:tasks.workunit.client.0.smithi071.stderr: -77> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:24.182 INFO:tasks.workunit.client.0.smithi071.stderr: -76> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:24.182 INFO:tasks.workunit.client.0.smithi071.stderr: -75> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:24.182 INFO:tasks.workunit.client.0.smithi071.stderr: -74> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 asok(0x559a47eced90) register_command cache list hook 0x559a4819b070 2024-09-14T11:33:24.182 INFO:tasks.workunit.client.0.smithi071.stderr: -73> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 asok(0x559a47eced90) register_command cache inspect hook 0x559a4819b070 2024-09-14T11:33:24.182 INFO:tasks.workunit.client.0.smithi071.stderr: -72> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 asok(0x559a47eced90) register_command cache erase hook 0x559a4819b070 2024-09-14T11:33:24.182 INFO:tasks.workunit.client.0.smithi071.stderr: -71> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 asok(0x559a47eced90) register_command cache zap hook 0x559a4819b070 2024-09-14T11:33:24.182 INFO:tasks.workunit.client.0.smithi071.stderr: -70> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 note: GC not initialized 2024-09-14T11:33:24.182 INFO:tasks.workunit.client.0.smithi071.stderr: -69> 2024-09-14T11:33:24.073+0000 7f3cd27e4640 20 reqs_thread_entry: start 2024-09-14T11:33:24.182 INFO:tasks.workunit.client.0.smithi071.stderr: -68> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 asok(0x559a47eced90) register_command sync trace show hook 0x7f3e0c002a10 2024-09-14T11:33:24.182 INFO:tasks.workunit.client.0.smithi071.stderr: -67> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 asok(0x559a47eced90) register_command sync trace history hook 0x7f3e0c002a10 2024-09-14T11:33:24.182 INFO:tasks.workunit.client.0.smithi071.stderr: -66> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 asok(0x559a47eced90) register_command sync trace active hook 0x7f3e0c002a10 2024-09-14T11:33:24.182 INFO:tasks.workunit.client.0.smithi071.stderr: -65> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 asok(0x559a47eced90) register_command sync trace active_short hook 0x7f3e0c002a10 2024-09-14T11:33:24.182 INFO:tasks.workunit.client.0.smithi071.stderr: -64> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:24.183 INFO:tasks.workunit.client.0.smithi071.stderr: -63> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 20 Filter name: none 2024-09-14T11:33:24.183 INFO:tasks.workunit.client.0.smithi071.stderr: -62> 2024-09-14T11:33:24.073+0000 7f3ccb7fe640 20 reqs_thread_entry: start 2024-09-14T11:33:24.183 INFO:tasks.workunit.client.0.smithi071.stderr: -61> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:33:24.183 INFO:tasks.workunit.client.0.smithi071.stderr: -60> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.183 INFO:tasks.workunit.client.0.smithi071.stderr: -59> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:24.183 INFO:tasks.workunit.client.0.smithi071.stderr: -58> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:33:24.183 INFO:tasks.workunit.client.0.smithi071.stderr: -57> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:33:24.183 INFO:tasks.workunit.client.0.smithi071.stderr: -56> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 : miss 2024-09-14T11:33:24.183 INFO:tasks.workunit.client.0.smithi071.stderr: -55> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.183 INFO:tasks.workunit.client.0.smithi071.stderr: -54> 2024-09-14T11:33:24.077+0000 7f3e1f1569c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:24.183 INFO:tasks.workunit.client.0.smithi071.stderr: -53> 2024-09-14T11:33:24.077+0000 7f3e1f1569c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 info.flags=0x17 2024-09-14T11:33:24.183 INFO:tasks.workunit.client.0.smithi071.stderr: -52> 2024-09-14T11:33:24.077+0000 7f3e1f1569c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 to cache LRU end 2024-09-14T11:33:24.183 INFO:tasks.workunit.client.0.smithi071.stderr: -51> 2024-09-14T11:33:24.077+0000 7f3e1f1569c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:24.183 INFO:tasks.workunit.client.0.smithi071.stderr: -50> 2024-09-14T11:33:24.077+0000 7f3e1f1569c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:24.184 INFO:tasks.workunit.client.0.smithi071.stderr: -49> 2024-09-14T11:33:24.077+0000 7f3e1f1569c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 2024-09-14T11:33:24.184 INFO:tasks.workunit.client.0.smithi071.stderr: -48> 2024-09-14T11:33:24.089+0000 7f3e1f1569c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 info.flags=0x17 2024-09-14T11:33:24.184 INFO:tasks.workunit.client.0.smithi071.stderr: -47> 2024-09-14T11:33:24.089+0000 7f3e1f1569c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 to cache LRU end 2024-09-14T11:33:24.184 INFO:tasks.workunit.client.0.smithi071.stderr: -46> 2024-09-14T11:33:24.089+0000 7f3e1f1569c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:24.184 INFO:tasks.workunit.client.0.smithi071.stderr: -45> 2024-09-14T11:33:24.089+0000 7f3e1f1569c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40, ofs0, ns] 2024-09-14T11:33:24.184 INFO:tasks.workunit.client.0.smithi071.stderr: -44> 2024-09-14T11:33:24.089+0000 7f3cf3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464286 cookie 94121123218736 notifier 7529 bl.length()=1015 2024-09-14T11:33:24.184 INFO:tasks.workunit.client.0.smithi071.stderr: -43> 2024-09-14T11:33:24.089+0000 7f3cf3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 info.flags=0x17 2024-09-14T11:33:24.184 INFO:tasks.workunit.client.0.smithi071.stderr: -42> 2024-09-14T11:33:24.089+0000 7f3cf3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 to cache LRU end 2024-09-14T11:33:24.184 INFO:tasks.workunit.client.0.smithi071.stderr: -41> 2024-09-14T11:33:24.089+0000 7f3cf3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:24.184 INFO:tasks.workunit.client.0.smithi071.stderr: -40> 2024-09-14T11:33:24.089+0000 7f3e1f1569c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.40]): orig_sources= new_sources= 2024-09-14T11:33:24.184 INFO:tasks.workunit.client.0.smithi071.stderr: -39> 2024-09-14T11:33:24.089+0000 7f3e1f1569c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.40]): potential sources added=[] removed=[] 2024-09-14T11:33:24.184 INFO:tasks.workunit.client.0.smithi071.stderr: -38> 2024-09-14T11:33:24.089+0000 7f3e1f1569c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.40]): orig_dests= new_dests= 2024-09-14T11:33:24.184 INFO:tasks.workunit.client.0.smithi071.stderr: -37> 2024-09-14T11:33:24.089+0000 7f3e1f1569c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.40]): potential dests added=[] removed=[] 2024-09-14T11:33:24.184 INFO:tasks.workunit.client.0.smithi071.stderr: -36> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.0 2024-09-14T11:33:24.185 INFO:tasks.workunit.client.0.smithi071.stderr: -35> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.0 2024-09-14T11:33:24.185 INFO:tasks.workunit.client.0.smithi071.stderr: -34> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.1 2024-09-14T11:33:24.185 INFO:tasks.workunit.client.0.smithi071.stderr: -33> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.1 2024-09-14T11:33:24.185 INFO:tasks.workunit.client.0.smithi071.stderr: -32> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.2 2024-09-14T11:33:24.185 INFO:tasks.workunit.client.0.smithi071.stderr: -31> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.2 2024-09-14T11:33:24.185 INFO:tasks.workunit.client.0.smithi071.stderr: -30> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.3 2024-09-14T11:33:24.185 INFO:tasks.workunit.client.0.smithi071.stderr: -29> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.3 2024-09-14T11:33:24.185 INFO:tasks.workunit.client.0.smithi071.stderr: -28> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.4 2024-09-14T11:33:24.185 INFO:tasks.workunit.client.0.smithi071.stderr: -27> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.4 2024-09-14T11:33:24.185 INFO:tasks.workunit.client.0.smithi071.stderr: -26> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.5 2024-09-14T11:33:24.185 INFO:tasks.workunit.client.0.smithi071.stderr: -25> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.5 2024-09-14T11:33:24.185 INFO:tasks.workunit.client.0.smithi071.stderr: -24> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.6 2024-09-14T11:33:24.185 INFO:tasks.workunit.client.0.smithi071.stderr: -23> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.6 2024-09-14T11:33:24.185 INFO:tasks.workunit.client.0.smithi071.stderr: -22> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.7 2024-09-14T11:33:24.186 INFO:tasks.workunit.client.0.smithi071.stderr: -21> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.7 2024-09-14T11:33:24.186 INFO:tasks.workunit.client.0.smithi071.stderr: -20> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.8 2024-09-14T11:33:24.186 INFO:tasks.workunit.client.0.smithi071.stderr: -19> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.8 2024-09-14T11:33:24.186 INFO:tasks.workunit.client.0.smithi071.stderr: -18> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.9 2024-09-14T11:33:24.186 INFO:tasks.workunit.client.0.smithi071.stderr: -17> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.9 2024-09-14T11:33:24.186 INFO:tasks.workunit.client.0.smithi071.stderr: -16> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.10 2024-09-14T11:33:24.186 INFO:tasks.workunit.client.0.smithi071.stderr: -15> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.10 2024-09-14T11:33:24.186 INFO:tasks.workunit.client.0.smithi071.stderr: -14> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.11 2024-09-14T11:33:24.186 INFO:tasks.workunit.client.0.smithi071.stderr: -13> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.11 2024-09-14T11:33:24.186 INFO:tasks.workunit.client.0.smithi071.stderr: -12> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.0 2024-09-14T11:33:24.186 INFO:tasks.workunit.client.0.smithi071.stderr: -11> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1 2024-09-14T11:33:24.186 INFO:tasks.workunit.client.0.smithi071.stderr: -10> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.2 2024-09-14T11:33:24.186 INFO:tasks.workunit.client.0.smithi071.stderr: -9> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.3 2024-09-14T11:33:24.186 INFO:tasks.workunit.client.0.smithi071.stderr: -8> 2024-09-14T11:33:24.109+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.4 2024-09-14T11:33:24.187 INFO:tasks.workunit.client.0.smithi071.stderr: -7> 2024-09-14T11:33:24.109+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.5 2024-09-14T11:33:24.187 INFO:tasks.workunit.client.0.smithi071.stderr: -6> 2024-09-14T11:33:24.109+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.6 2024-09-14T11:33:24.187 INFO:tasks.workunit.client.0.smithi071.stderr: -5> 2024-09-14T11:33:24.113+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.7 2024-09-14T11:33:24.187 INFO:tasks.workunit.client.0.smithi071.stderr: -4> 2024-09-14T11:33:24.113+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.8 2024-09-14T11:33:24.187 INFO:tasks.workunit.client.0.smithi071.stderr: -3> 2024-09-14T11:33:24.113+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.9 2024-09-14T11:33:24.187 INFO:tasks.workunit.client.0.smithi071.stderr: -2> 2024-09-14T11:33:24.117+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.10 2024-09-14T11:33:24.187 INFO:tasks.workunit.client.0.smithi071.stderr: -1> 2024-09-14T11:33:24.125+0000 7f3e1f1569c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3e1f1569c0 time 2024-09-14T11:33:24.125484+0000 2024-09-14T11:33:24.187 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:33:24.187 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:24.187 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:24.187 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f3e22a302eb] 2024-09-14T11:33:24.187 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3e22a3049f] 2024-09-14T11:33:24.187 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559a45e97c01] 2024-09-14T11:33:24.187 INFO:tasks.workunit.client.0.smithi071.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x559a45eac231] 2024-09-14T11:33:24.188 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x559a45ead884] 2024-09-14T11:33:24.188 INFO:tasks.workunit.client.0.smithi071.stderr: 6: main() 2024-09-14T11:33:24.188 INFO:tasks.workunit.client.0.smithi071.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3e21896d90] 2024-09-14T11:33:24.188 INFO:tasks.workunit.client.0.smithi071.stderr: 8: __libc_start_main() 2024-09-14T11:33:24.188 INFO:tasks.workunit.client.0.smithi071.stderr: 9: _start() 2024-09-14T11:33:24.188 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:24.188 INFO:tasks.workunit.client.0.smithi071.stderr: 0> 2024-09-14T11:33:24.125+0000 7f3e1f1569c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:33:24.188 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f3e1f1569c0 thread_name:radosgw-admin 2024-09-14T11:33:24.188 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:24.188 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:24.188 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3e218af520] 2024-09-14T11:33:24.188 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:33:24.188 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:33:24.189 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:33:24.189 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3e22a30345] 2024-09-14T11:33:24.189 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3e22a3049f] 2024-09-14T11:33:24.189 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559a45e97c01] 2024-09-14T11:33:24.189 INFO:tasks.workunit.client.0.smithi071.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x559a45eac231] 2024-09-14T11:33:24.189 INFO:tasks.workunit.client.0.smithi071.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x559a45ead884] 2024-09-14T11:33:24.189 INFO:tasks.workunit.client.0.smithi071.stderr: 10: main() 2024-09-14T11:33:24.189 INFO:tasks.workunit.client.0.smithi071.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3e21896d90] 2024-09-14T11:33:24.189 INFO:tasks.workunit.client.0.smithi071.stderr: 12: __libc_start_main() 2024-09-14T11:33:24.189 INFO:tasks.workunit.client.0.smithi071.stderr: 13: _start() 2024-09-14T11:33:24.189 INFO:tasks.workunit.client.0.smithi071.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:33:24.189 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:24.190 INFO:tasks.workunit.client.0.smithi071.stderr:--- logging levels --- 2024-09-14T11:33:24.190 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 none 2024-09-14T11:33:24.190 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 lockdep 2024-09-14T11:33:24.190 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 context 2024-09-14T11:33:24.190 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 crush 2024-09-14T11:33:24.190 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds 2024-09-14T11:33:24.190 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_balancer 2024-09-14T11:33:24.190 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_locker 2024-09-14T11:33:24.190 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log 2024-09-14T11:33:24.190 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log_expire 2024-09-14T11:33:24.190 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_migrator 2024-09-14T11:33:24.190 INFO:tasks.workunit.client.0.smithi071.stderr: 3/ 5 mds_quiesce 2024-09-14T11:33:24.190 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 buffer 2024-09-14T11:33:24.190 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 timer 2024-09-14T11:33:24.191 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 filer 2024-09-14T11:33:24.191 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 striper 2024-09-14T11:33:24.191 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 objecter 2024-09-14T11:33:24.191 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rados 2024-09-14T11:33:24.191 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd 2024-09-14T11:33:24.191 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_mirror 2024-09-14T11:33:24.191 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_replay 2024-09-14T11:33:24.191 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_pwl 2024-09-14T11:33:24.191 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 journaler 2024-09-14T11:33:24.191 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objectcacher 2024-09-14T11:33:24.191 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:33:24.191 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 client 2024-09-14T11:33:24.191 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 osd 2024-09-14T11:33:24.192 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 optracker 2024-09-14T11:33:24.192 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objclass 2024-09-14T11:33:24.192 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 filestore 2024-09-14T11:33:24.192 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 journal 2024-09-14T11:33:24.192 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 ms 2024-09-14T11:33:24.192 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mon 2024-09-14T11:33:24.192 INFO:tasks.workunit.client.0.smithi071.stderr: 0/10 monc 2024-09-14T11:33:24.192 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 paxos 2024-09-14T11:33:24.192 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 tp 2024-09-14T11:33:24.192 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 auth 2024-09-14T11:33:24.192 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 crypto 2024-09-14T11:33:24.192 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 finisher 2024-09-14T11:33:24.192 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 reserver 2024-09-14T11:33:24.192 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 heartbeatmap 2024-09-14T11:33:24.193 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 perfcounter 2024-09-14T11:33:24.193 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw 2024-09-14T11:33:24.193 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_sync 2024-09-14T11:33:24.193 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_datacache 2024-09-14T11:33:24.193 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_access 2024-09-14T11:33:24.193 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:33:24.193 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_flight 2024-09-14T11:33:24.193 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:33:24.193 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw_notification 2024-09-14T11:33:24.193 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 javaclient 2024-09-14T11:33:24.193 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 asok 2024-09-14T11:33:24.193 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 throttle 2024-09-14T11:33:24.193 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 refs 2024-09-14T11:33:24.193 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 compressor 2024-09-14T11:33:24.193 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluestore 2024-09-14T11:33:24.194 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluefs 2024-09-14T11:33:24.194 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 bdev 2024-09-14T11:33:24.194 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 kstore 2024-09-14T11:33:24.194 INFO:tasks.workunit.client.0.smithi071.stderr: 4/ 5 rocksdb 2024-09-14T11:33:24.194 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 fuse 2024-09-14T11:33:24.194 INFO:tasks.workunit.client.0.smithi071.stderr: 2/ 5 mgr 2024-09-14T11:33:24.194 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mgrc 2024-09-14T11:33:24.194 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 dpdk 2024-09-14T11:33:24.194 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 eventtrace 2024-09-14T11:33:24.194 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 prioritycache 2024-09-14T11:33:24.194 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 test 2024-09-14T11:33:24.194 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:33:24.194 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephsqlite 2024-09-14T11:33:24.195 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:33:24.195 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore 2024-09-14T11:33:24.195 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_onode 2024-09-14T11:33:24.195 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_odata 2024-09-14T11:33:24.195 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_omap 2024-09-14T11:33:24.195 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_tm 2024-09-14T11:33:24.195 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_t 2024-09-14T11:33:24.195 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:33:24.195 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_epm 2024-09-14T11:33:24.195 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_lba 2024-09-14T11:33:24.195 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:33:24.195 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cache 2024-09-14T11:33:24.195 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_journal 2024-09-14T11:33:24.195 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_device 2024-09-14T11:33:24.196 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_backref 2024-09-14T11:33:24.196 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 alienstore 2024-09-14T11:33:24.196 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mclock 2024-09-14T11:33:24.196 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cyanstore 2024-09-14T11:33:24.196 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 ceph_exporter 2024-09-14T11:33:24.196 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 memstore 2024-09-14T11:33:24.196 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 trace 2024-09-14T11:33:24.196 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 ceph_dedup 2024-09-14T11:33:24.196 INFO:tasks.workunit.client.0.smithi071.stderr: -2/-2 (syslog threshold) 2024-09-14T11:33:24.196 INFO:tasks.workunit.client.0.smithi071.stderr: 99/99 (stderr threshold) 2024-09-14T11:33:24.196 INFO:tasks.workunit.client.0.smithi071.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:33:24.196 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3ccb7fe640 / http_manager 2024-09-14T11:33:24.196 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3cd27e4640 / http_manager 2024-09-14T11:33:24.196 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3cd37e6640 / rgw_dt_lg_renew 2024-09-14T11:33:24.197 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3cf27fc640 / ms_dispatch 2024-09-14T11:33:24.197 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3cf3fff640 / io_context_pool 2024-09-14T11:33:24.197 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3d027fc640 / ms_dispatch 2024-09-14T11:33:24.197 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3d0960a640 / ms_dispatch 2024-09-14T11:33:24.197 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3d0ae0d640 / io_context_pool 2024-09-14T11:33:24.197 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3e1bc5a640 / io_context_pool 2024-09-14T11:33:24.197 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3e1c45b640 / msgr-worker-2 2024-09-14T11:33:24.197 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3e1cc5c640 / msgr-worker-1 2024-09-14T11:33:24.197 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3e1d45d640 / msgr-worker-0 2024-09-14T11:33:24.197 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3e1f1569c0 / radosgw-admin 2024-09-14T11:33:24.197 INFO:tasks.workunit.client.0.smithi071.stderr: max_recent 500 2024-09-14T11:33:24.197 INFO:tasks.workunit.client.0.smithi071.stderr: max_new 1000 2024-09-14T11:33:24.197 INFO:tasks.workunit.client.0.smithi071.stderr: log_file /var/log/ceph/ceph-client.admin.133847.log 2024-09-14T11:33:24.197 INFO:tasks.workunit.client.0.smithi071.stderr:--- end dump of recent events --- 2024-09-14T11:33:24.198 INFO:tasks.workunit.client.0.smithi071.stderr:--- begin dump of recent events --- 2024-09-14T11:33:24.198 INFO:tasks.workunit.client.0.smithi071.stderr: -499> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:24.198 INFO:tasks.workunit.client.0.smithi071.stderr: -498> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 1 librados: starting msgr at 2024-09-14T11:33:24.198 INFO:tasks.workunit.client.0.smithi071.stderr: -497> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 1 librados: starting objecter 2024-09-14T11:33:24.198 INFO:tasks.workunit.client.0.smithi071.stderr: -496> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 5 asok(0x559a47eced90) register_command objecter_requests hook 0x559a480dff40 2024-09-14T11:33:24.198 INFO:tasks.workunit.client.0.smithi071.stderr: -495> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 1 librados: setting wanted keys 2024-09-14T11:33:24.198 INFO:tasks.workunit.client.0.smithi071.stderr: -494> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 1 librados: calling monclient init 2024-09-14T11:33:24.198 INFO:tasks.workunit.client.0.smithi071.stderr: -493> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 10 monclient: init 2024-09-14T11:33:24.198 INFO:tasks.workunit.client.0.smithi071.stderr: -492> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 5 AuthRegistry(0x559a480d8d30) adding auth protocol: cephx 2024-09-14T11:33:24.198 INFO:tasks.workunit.client.0.smithi071.stderr: -491> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 5 AuthRegistry(0x559a480d8d30) adding auth protocol: cephx 2024-09-14T11:33:24.198 INFO:tasks.workunit.client.0.smithi071.stderr: -490> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 5 AuthRegistry(0x559a480d8d30) adding auth protocol: cephx 2024-09-14T11:33:24.198 INFO:tasks.workunit.client.0.smithi071.stderr: -489> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 5 AuthRegistry(0x559a480d8d30) adding con mode: secure 2024-09-14T11:33:24.198 INFO:tasks.workunit.client.0.smithi071.stderr: -488> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 5 AuthRegistry(0x559a480d8d30) adding con mode: crc 2024-09-14T11:33:24.198 INFO:tasks.workunit.client.0.smithi071.stderr: -487> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 5 AuthRegistry(0x559a480d8d30) adding con mode: secure 2024-09-14T11:33:24.198 INFO:tasks.workunit.client.0.smithi071.stderr: -486> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 5 AuthRegistry(0x559a480d8d30) adding con mode: crc 2024-09-14T11:33:24.199 INFO:tasks.workunit.client.0.smithi071.stderr: -485> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 5 AuthRegistry(0x559a480d8d30) adding con mode: secure 2024-09-14T11:33:24.199 INFO:tasks.workunit.client.0.smithi071.stderr: -484> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 5 AuthRegistry(0x559a480d8d30) adding con mode: crc 2024-09-14T11:33:24.199 INFO:tasks.workunit.client.0.smithi071.stderr: -483> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 5 AuthRegistry(0x559a480d8d30) adding con mode: crc 2024-09-14T11:33:24.199 INFO:tasks.workunit.client.0.smithi071.stderr: -482> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 5 AuthRegistry(0x559a480d8d30) adding con mode: secure 2024-09-14T11:33:24.199 INFO:tasks.workunit.client.0.smithi071.stderr: -481> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 5 AuthRegistry(0x559a480d8d30) adding con mode: crc 2024-09-14T11:33:24.199 INFO:tasks.workunit.client.0.smithi071.stderr: -480> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 5 AuthRegistry(0x559a480d8d30) adding con mode: secure 2024-09-14T11:33:24.199 INFO:tasks.workunit.client.0.smithi071.stderr: -479> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 5 AuthRegistry(0x559a480d8d30) adding con mode: crc 2024-09-14T11:33:24.199 INFO:tasks.workunit.client.0.smithi071.stderr: -478> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 5 AuthRegistry(0x559a480d8d30) adding con mode: secure 2024-09-14T11:33:24.199 INFO:tasks.workunit.client.0.smithi071.stderr: -477> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:24.199 INFO:tasks.workunit.client.0.smithi071.stderr: -476> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:24.199 INFO:tasks.workunit.client.0.smithi071.stderr: -475> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 5 asok(0x559a47eced90) register_command rotate-key hook 0x559a480d8e78 2024-09-14T11:33:24.199 INFO:tasks.workunit.client.0.smithi071.stderr: -474> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 10 monclient: _reopen_session rank -1 2024-09-14T11:33:24.199 INFO:tasks.workunit.client.0.smithi071.stderr: -473> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:33:24.199 INFO:tasks.workunit.client.0.smithi071.stderr: -472> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 10 monclient(hunting): picked mon.noname-b con 0x559a47f89070 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:33:24.199 INFO:tasks.workunit.client.0.smithi071.stderr: -471> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 10 monclient(hunting): picked mon.noname-c con 0x559a47f92b00 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:33:24.200 INFO:tasks.workunit.client.0.smithi071.stderr: -470> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 10 monclient(hunting): picked mon.noname-a con 0x559a4801f000 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:33:24.200 INFO:tasks.workunit.client.0.smithi071.stderr: -469> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:24.200 INFO:tasks.workunit.client.0.smithi071.stderr: -468> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:24.200 INFO:tasks.workunit.client.0.smithi071.stderr: -467> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:24.200 INFO:tasks.workunit.client.0.smithi071.stderr: -466> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 10 monclient(hunting): _renew_subs 2024-09-14T11:33:24.200 INFO:tasks.workunit.client.0.smithi071.stderr: -465> 2024-09-14T11:33:23.781+0000 7f3e1f1569c0 10 monclient(hunting): authenticate will time out at 2415.903861s 2024-09-14T11:33:24.200 INFO:tasks.workunit.client.0.smithi071.stderr: -464> 2024-09-14T11:33:23.785+0000 7f3e1d45d640 10 monclient(hunting): get_auth_request con 0x559a4801f000 auth_method 0 2024-09-14T11:33:24.200 INFO:tasks.workunit.client.0.smithi071.stderr: -463> 2024-09-14T11:33:23.785+0000 7f3e1d45d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:24.200 INFO:tasks.workunit.client.0.smithi071.stderr: -462> 2024-09-14T11:33:23.785+0000 7f3e1d45d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:24.200 INFO:tasks.workunit.client.0.smithi071.stderr: -461> 2024-09-14T11:33:23.785+0000 7f3e1d45d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:24.200 INFO:tasks.workunit.client.0.smithi071.stderr: -460> 2024-09-14T11:33:23.785+0000 7f3e1c45b640 10 monclient(hunting): get_auth_request con 0x559a47f92b00 auth_method 0 2024-09-14T11:33:24.200 INFO:tasks.workunit.client.0.smithi071.stderr: -459> 2024-09-14T11:33:23.785+0000 7f3e1c45b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:24.200 INFO:tasks.workunit.client.0.smithi071.stderr: -458> 2024-09-14T11:33:23.785+0000 7f3e1c45b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:24.200 INFO:tasks.workunit.client.0.smithi071.stderr: -457> 2024-09-14T11:33:23.785+0000 7f3e1c45b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:24.201 INFO:tasks.workunit.client.0.smithi071.stderr: -456> 2024-09-14T11:33:23.785+0000 7f3e1d45d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:24.201 INFO:tasks.workunit.client.0.smithi071.stderr: -455> 2024-09-14T11:33:23.785+0000 7f3e1d45d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:24.201 INFO:tasks.workunit.client.0.smithi071.stderr: -454> 2024-09-14T11:33:23.785+0000 7f3e1d45d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:24.201 INFO:tasks.workunit.client.0.smithi071.stderr: -453> 2024-09-14T11:33:23.785+0000 7f3e1c45b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:24.201 INFO:tasks.workunit.client.0.smithi071.stderr: -452> 2024-09-14T11:33:23.785+0000 7f3e1c45b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:24.201 INFO:tasks.workunit.client.0.smithi071.stderr: -451> 2024-09-14T11:33:23.785+0000 7f3e1c45b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:24.201 INFO:tasks.workunit.client.0.smithi071.stderr: -450> 2024-09-14T11:33:23.785+0000 7f3e1cc5c640 10 monclient(hunting): get_auth_request con 0x559a47f89070 auth_method 0 2024-09-14T11:33:24.201 INFO:tasks.workunit.client.0.smithi071.stderr: -449> 2024-09-14T11:33:23.785+0000 7f3e1cc5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:24.201 INFO:tasks.workunit.client.0.smithi071.stderr: -448> 2024-09-14T11:33:23.785+0000 7f3e1cc5c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:24.201 INFO:tasks.workunit.client.0.smithi071.stderr: -447> 2024-09-14T11:33:23.785+0000 7f3e1cc5c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:24.201 INFO:tasks.workunit.client.0.smithi071.stderr: -446> 2024-09-14T11:33:23.785+0000 7f3e1c45b640 10 monclient(hunting): handle_auth_done global_id 7520 payload 824 2024-09-14T11:33:24.201 INFO:tasks.workunit.client.0.smithi071.stderr: -445> 2024-09-14T11:33:23.785+0000 7f3e1c45b640 10 monclient: _finish_hunting 0 2024-09-14T11:33:24.201 INFO:tasks.workunit.client.0.smithi071.stderr: -444> 2024-09-14T11:33:23.785+0000 7f3e1c45b640 1 monclient: found mon.noname-c 2024-09-14T11:33:24.201 INFO:tasks.workunit.client.0.smithi071.stderr: -443> 2024-09-14T11:33:23.785+0000 7f3e1c45b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:33:24.201 INFO:tasks.workunit.client.0.smithi071.stderr: -442> 2024-09-14T11:33:23.785+0000 7f3d0960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:24.202 INFO:tasks.workunit.client.0.smithi071.stderr: -441> 2024-09-14T11:33:23.785+0000 7f3d0960a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:24.202 INFO:tasks.workunit.client.0.smithi071.stderr: -440> 2024-09-14T11:33:23.785+0000 7f3d0960a640 10 monclient: dump: 2024-09-14T11:33:24.202 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:33:24.202 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:33:24.202 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:24.202 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:24.202 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:24.202 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:24.202 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:33:24.202 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:33:24.202 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:33:24.202 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:24.202 INFO:tasks.workunit.client.0.smithi071.stderr: -439> 2024-09-14T11:33:23.785+0000 7f3d0960a640 10 monclient: _finish_auth 0 2024-09-14T11:33:24.202 INFO:tasks.workunit.client.0.smithi071.stderr: -438> 2024-09-14T11:33:23.785+0000 7f3d0960a640 10 monclient: _check_auth_tickets 2024-09-14T11:33:24.203 INFO:tasks.workunit.client.0.smithi071.stderr: -437> 2024-09-14T11:33:23.785+0000 7f3d0960a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:24.203 INFO:tasks.workunit.client.0.smithi071.stderr: -436> 2024-09-14T11:33:23.785+0000 7f3d0960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:24.203 INFO:tasks.workunit.client.0.smithi071.stderr: -435> 2024-09-14T11:33:23.785+0000 7f3d0960a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:24.203 INFO:tasks.workunit.client.0.smithi071.stderr: -434> 2024-09-14T11:33:23.785+0000 7f3d0960a640 10 monclient: dump: 2024-09-14T11:33:24.203 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:33:24.203 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:33:24.203 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:24.203 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:24.203 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:24.203 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:24.203 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:33:24.203 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:33:24.203 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:33:24.203 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:24.204 INFO:tasks.workunit.client.0.smithi071.stderr: -433> 2024-09-14T11:33:23.785+0000 7f3e1f1569c0 5 monclient: authenticate success, global_id 7520 2024-09-14T11:33:24.204 INFO:tasks.workunit.client.0.smithi071.stderr: -432> 2024-09-14T11:33:23.785+0000 7f3e1f1569c0 10 monclient: _renew_subs 2024-09-14T11:33:24.204 INFO:tasks.workunit.client.0.smithi071.stderr: -431> 2024-09-14T11:33:23.785+0000 7f3e1f1569c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:33:24.204 INFO:tasks.workunit.client.0.smithi071.stderr: -430> 2024-09-14T11:33:23.785+0000 7f3d0ae0d640 4 set_mon_vals no callback set 2024-09-14T11:33:24.204 INFO:tasks.workunit.client.0.smithi071.stderr: -429> 2024-09-14T11:33:23.785+0000 7f3e1f1569c0 10 monclient: _renew_subs 2024-09-14T11:33:24.204 INFO:tasks.workunit.client.0.smithi071.stderr: -428> 2024-09-14T11:33:23.785+0000 7f3e1f1569c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:33:24.204 INFO:tasks.workunit.client.0.smithi071.stderr: -427> 2024-09-14T11:33:23.785+0000 7f3e1f1569c0 1 librados: init done 2024-09-14T11:33:24.204 INFO:tasks.workunit.client.0.smithi071.stderr: -426> 2024-09-14T11:33:23.785+0000 7f3d0960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:24.204 INFO:tasks.workunit.client.0.smithi071.stderr: -425> 2024-09-14T11:33:23.785+0000 7f3d0960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:33:24.204 INFO:tasks.workunit.client.0.smithi071.stderr: -424> 2024-09-14T11:33:23.785+0000 7f3d0960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:33:24.204 INFO:tasks.workunit.client.0.smithi071.stderr: -423> 2024-09-14T11:33:23.785+0000 7f3e1cc5c640 10 monclient: get_auth_request con 0x7f3d040718d0 auth_method 0 2024-09-14T11:33:24.204 INFO:tasks.workunit.client.0.smithi071.stderr: -422> 2024-09-14T11:33:23.785+0000 7f3e1d45d640 10 monclient: get_auth_request con 0x559a48101d60 auth_method 0 2024-09-14T11:33:24.204 INFO:tasks.workunit.client.0.smithi071.stderr: -421> 2024-09-14T11:33:23.789+0000 7f3e1cc5c640 10 monclient: get_auth_request con 0x559a48124960 auth_method 0 2024-09-14T11:33:24.205 INFO:tasks.workunit.client.0.smithi071.stderr: -420> 2024-09-14T11:33:23.789+0000 7f3e1c45b640 10 monclient: get_auth_request con 0x559a48128dd0 auth_method 0 2024-09-14T11:33:24.205 INFO:tasks.workunit.client.0.smithi071.stderr: -419> 2024-09-14T11:33:23.789+0000 7f3e1d45d640 10 monclient: get_auth_request con 0x559a48128270 auth_method 0 2024-09-14T11:33:24.205 INFO:tasks.workunit.client.0.smithi071.stderr: -418> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 10 monclient: build_initial_monmap 2024-09-14T11:33:24.205 INFO:tasks.workunit.client.0.smithi071.stderr: -417> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 1 build_initial for_mkfs: 0 2024-09-14T11:33:24.205 INFO:tasks.workunit.client.0.smithi071.stderr: -416> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 10 monclient: monmap: 2024-09-14T11:33:24.205 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:33:24.205 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:24.205 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:33:24.205 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:33:24.205 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:24.205 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:24.205 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:33:24.205 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:33:24.205 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:33:24.205 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:24.206 INFO:tasks.workunit.client.0.smithi071.stderr: -415> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48130fe0) adding auth protocol: cephx 2024-09-14T11:33:24.206 INFO:tasks.workunit.client.0.smithi071.stderr: -414> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48130fe0) adding auth protocol: cephx 2024-09-14T11:33:24.206 INFO:tasks.workunit.client.0.smithi071.stderr: -413> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48130fe0) adding auth protocol: cephx 2024-09-14T11:33:24.206 INFO:tasks.workunit.client.0.smithi071.stderr: -412> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48130fe0) adding con mode: secure 2024-09-14T11:33:24.206 INFO:tasks.workunit.client.0.smithi071.stderr: -411> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48130fe0) adding con mode: crc 2024-09-14T11:33:24.206 INFO:tasks.workunit.client.0.smithi071.stderr: -410> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48130fe0) adding con mode: secure 2024-09-14T11:33:24.206 INFO:tasks.workunit.client.0.smithi071.stderr: -409> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48130fe0) adding con mode: crc 2024-09-14T11:33:24.206 INFO:tasks.workunit.client.0.smithi071.stderr: -408> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48130fe0) adding con mode: secure 2024-09-14T11:33:24.206 INFO:tasks.workunit.client.0.smithi071.stderr: -407> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48130fe0) adding con mode: crc 2024-09-14T11:33:24.206 INFO:tasks.workunit.client.0.smithi071.stderr: -406> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48130fe0) adding con mode: crc 2024-09-14T11:33:24.206 INFO:tasks.workunit.client.0.smithi071.stderr: -405> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48130fe0) adding con mode: secure 2024-09-14T11:33:24.206 INFO:tasks.workunit.client.0.smithi071.stderr: -404> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48130fe0) adding con mode: crc 2024-09-14T11:33:24.206 INFO:tasks.workunit.client.0.smithi071.stderr: -403> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48130fe0) adding con mode: secure 2024-09-14T11:33:24.207 INFO:tasks.workunit.client.0.smithi071.stderr: -402> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48130fe0) adding con mode: crc 2024-09-14T11:33:24.207 INFO:tasks.workunit.client.0.smithi071.stderr: -401> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48130fe0) adding con mode: secure 2024-09-14T11:33:24.207 INFO:tasks.workunit.client.0.smithi071.stderr: -400> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:24.207 INFO:tasks.workunit.client.0.smithi071.stderr: -399> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 asok(0x559a47eced90) register_command objecter_requests cmddesc objecter_requests hook 0x559a481349d0 EEXIST 2024-09-14T11:33:24.207 INFO:tasks.workunit.client.0.smithi071.stderr: -398> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 10 monclient: init 2024-09-14T11:33:24.207 INFO:tasks.workunit.client.0.smithi071.stderr: -397> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4812fed8) adding auth protocol: cephx 2024-09-14T11:33:24.207 INFO:tasks.workunit.client.0.smithi071.stderr: -396> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4812fed8) adding auth protocol: cephx 2024-09-14T11:33:24.207 INFO:tasks.workunit.client.0.smithi071.stderr: -395> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4812fed8) adding auth protocol: cephx 2024-09-14T11:33:24.207 INFO:tasks.workunit.client.0.smithi071.stderr: -394> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4812fed8) adding con mode: secure 2024-09-14T11:33:24.207 INFO:tasks.workunit.client.0.smithi071.stderr: -393> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4812fed8) adding con mode: crc 2024-09-14T11:33:24.207 INFO:tasks.workunit.client.0.smithi071.stderr: -392> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4812fed8) adding con mode: secure 2024-09-14T11:33:24.207 INFO:tasks.workunit.client.0.smithi071.stderr: -391> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4812fed8) adding con mode: crc 2024-09-14T11:33:24.207 INFO:tasks.workunit.client.0.smithi071.stderr: -390> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4812fed8) adding con mode: secure 2024-09-14T11:33:24.208 INFO:tasks.workunit.client.0.smithi071.stderr: -389> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4812fed8) adding con mode: crc 2024-09-14T11:33:24.208 INFO:tasks.workunit.client.0.smithi071.stderr: -388> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4812fed8) adding con mode: crc 2024-09-14T11:33:24.208 INFO:tasks.workunit.client.0.smithi071.stderr: -387> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4812fed8) adding con mode: secure 2024-09-14T11:33:24.208 INFO:tasks.workunit.client.0.smithi071.stderr: -386> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4812fed8) adding con mode: crc 2024-09-14T11:33:24.208 INFO:tasks.workunit.client.0.smithi071.stderr: -385> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4812fed8) adding con mode: secure 2024-09-14T11:33:24.208 INFO:tasks.workunit.client.0.smithi071.stderr: -384> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4812fed8) adding con mode: crc 2024-09-14T11:33:24.208 INFO:tasks.workunit.client.0.smithi071.stderr: -383> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4812fed8) adding con mode: secure 2024-09-14T11:33:24.208 INFO:tasks.workunit.client.0.smithi071.stderr: -382> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:24.208 INFO:tasks.workunit.client.0.smithi071.stderr: -381> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:24.208 INFO:tasks.workunit.client.0.smithi071.stderr: -380> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 asok(0x559a47eced90) register_command rotate-key cmddesc rotate-key hook 0x559a48130020 EEXIST 2024-09-14T11:33:24.208 INFO:tasks.workunit.client.0.smithi071.stderr: -379> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 10 monclient: _reopen_session rank -1 2024-09-14T11:33:24.208 INFO:tasks.workunit.client.0.smithi071.stderr: -378> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:33:24.208 INFO:tasks.workunit.client.0.smithi071.stderr: -377> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 10 monclient(hunting): picked mon.noname-b con 0x559a48158b80 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:33:24.209 INFO:tasks.workunit.client.0.smithi071.stderr: -376> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 10 monclient(hunting): picked mon.noname-a con 0x559a481584b0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:33:24.209 INFO:tasks.workunit.client.0.smithi071.stderr: -375> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 10 monclient(hunting): picked mon.noname-c con 0x559a48156e90 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:33:24.209 INFO:tasks.workunit.client.0.smithi071.stderr: -374> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:24.209 INFO:tasks.workunit.client.0.smithi071.stderr: -373> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:24.209 INFO:tasks.workunit.client.0.smithi071.stderr: -372> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:24.209 INFO:tasks.workunit.client.0.smithi071.stderr: -371> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 10 monclient(hunting): _renew_subs 2024-09-14T11:33:24.209 INFO:tasks.workunit.client.0.smithi071.stderr: -370> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 10 monclient(hunting): authenticate will time out at 2415.913966s 2024-09-14T11:33:24.209 INFO:tasks.workunit.client.0.smithi071.stderr: -369> 2024-09-14T11:33:23.793+0000 7f3e1d45d640 10 monclient(hunting): get_auth_request con 0x559a481584b0 auth_method 0 2024-09-14T11:33:24.209 INFO:tasks.workunit.client.0.smithi071.stderr: -368> 2024-09-14T11:33:23.793+0000 7f3e1d45d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:24.209 INFO:tasks.workunit.client.0.smithi071.stderr: -367> 2024-09-14T11:33:23.793+0000 7f3e1d45d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:24.209 INFO:tasks.workunit.client.0.smithi071.stderr: -366> 2024-09-14T11:33:23.793+0000 7f3e1d45d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:24.209 INFO:tasks.workunit.client.0.smithi071.stderr: -365> 2024-09-14T11:33:23.793+0000 7f3e1cc5c640 10 monclient(hunting): get_auth_request con 0x559a48156e90 auth_method 0 2024-09-14T11:33:24.209 INFO:tasks.workunit.client.0.smithi071.stderr: -364> 2024-09-14T11:33:23.793+0000 7f3e1cc5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:24.210 INFO:tasks.workunit.client.0.smithi071.stderr: -363> 2024-09-14T11:33:23.793+0000 7f3e1cc5c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:24.210 INFO:tasks.workunit.client.0.smithi071.stderr: -362> 2024-09-14T11:33:23.793+0000 7f3e1cc5c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:24.210 INFO:tasks.workunit.client.0.smithi071.stderr: -361> 2024-09-14T11:33:23.793+0000 7f3e1d45d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:24.210 INFO:tasks.workunit.client.0.smithi071.stderr: -360> 2024-09-14T11:33:23.793+0000 7f3e1d45d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:24.210 INFO:tasks.workunit.client.0.smithi071.stderr: -359> 2024-09-14T11:33:23.793+0000 7f3e1d45d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:24.210 INFO:tasks.workunit.client.0.smithi071.stderr: -358> 2024-09-14T11:33:23.793+0000 7f3e1cc5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:24.210 INFO:tasks.workunit.client.0.smithi071.stderr: -357> 2024-09-14T11:33:23.793+0000 7f3e1cc5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:24.210 INFO:tasks.workunit.client.0.smithi071.stderr: -356> 2024-09-14T11:33:23.793+0000 7f3e1cc5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:24.210 INFO:tasks.workunit.client.0.smithi071.stderr: -355> 2024-09-14T11:33:23.793+0000 7f3e1c45b640 10 monclient(hunting): get_auth_request con 0x559a48158b80 auth_method 0 2024-09-14T11:33:24.210 INFO:tasks.workunit.client.0.smithi071.stderr: -354> 2024-09-14T11:33:23.793+0000 7f3e1c45b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:24.210 INFO:tasks.workunit.client.0.smithi071.stderr: -353> 2024-09-14T11:33:23.793+0000 7f3e1c45b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:24.210 INFO:tasks.workunit.client.0.smithi071.stderr: -352> 2024-09-14T11:33:23.793+0000 7f3e1c45b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:24.210 INFO:tasks.workunit.client.0.smithi071.stderr: -351> 2024-09-14T11:33:23.793+0000 7f3e1d45d640 10 monclient(hunting): handle_auth_done global_id 7920 payload 824 2024-09-14T11:33:24.211 INFO:tasks.workunit.client.0.smithi071.stderr: -350> 2024-09-14T11:33:23.793+0000 7f3e1d45d640 10 monclient: _finish_hunting 0 2024-09-14T11:33:24.211 INFO:tasks.workunit.client.0.smithi071.stderr: -349> 2024-09-14T11:33:23.793+0000 7f3e1d45d640 1 monclient: found mon.noname-a 2024-09-14T11:33:24.211 INFO:tasks.workunit.client.0.smithi071.stderr: -348> 2024-09-14T11:33:23.793+0000 7f3e1d45d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:33:24.211 INFO:tasks.workunit.client.0.smithi071.stderr: -347> 2024-09-14T11:33:23.793+0000 7f3d027fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:24.211 INFO:tasks.workunit.client.0.smithi071.stderr: -346> 2024-09-14T11:33:23.793+0000 7f3d027fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:33:24.211 INFO:tasks.workunit.client.0.smithi071.stderr: -345> 2024-09-14T11:33:23.793+0000 7f3d027fc640 10 monclient: dump: 2024-09-14T11:33:24.211 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:33:24.211 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:33:24.211 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:24.211 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:24.211 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:24.211 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:24.211 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:33:24.211 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:33:24.212 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:33:24.212 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:24.212 INFO:tasks.workunit.client.0.smithi071.stderr: -344> 2024-09-14T11:33:23.793+0000 7f3d027fc640 10 monclient: _finish_auth 0 2024-09-14T11:33:24.212 INFO:tasks.workunit.client.0.smithi071.stderr: -343> 2024-09-14T11:33:23.793+0000 7f3d027fc640 10 monclient: _check_auth_tickets 2024-09-14T11:33:24.212 INFO:tasks.workunit.client.0.smithi071.stderr: -342> 2024-09-14T11:33:23.793+0000 7f3d027fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:24.212 INFO:tasks.workunit.client.0.smithi071.stderr: -341> 2024-09-14T11:33:23.793+0000 7f3d027fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:24.212 INFO:tasks.workunit.client.0.smithi071.stderr: -340> 2024-09-14T11:33:23.793+0000 7f3d027fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:33:24.212 INFO:tasks.workunit.client.0.smithi071.stderr: -339> 2024-09-14T11:33:23.793+0000 7f3d027fc640 10 monclient: dump: 2024-09-14T11:33:24.212 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:33:24.212 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:33:24.212 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:24.212 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:24.212 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:24.212 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:24.213 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:33:24.213 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:33:24.213 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:33:24.213 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:24.213 INFO:tasks.workunit.client.0.smithi071.stderr: -338> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 5 monclient: authenticate success, global_id 7920 2024-09-14T11:33:24.213 INFO:tasks.workunit.client.0.smithi071.stderr: -337> 2024-09-14T11:33:23.793+0000 7f3e1bc5a640 4 set_mon_vals no callback set 2024-09-14T11:33:24.213 INFO:tasks.workunit.client.0.smithi071.stderr: -336> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 10 monclient: _renew_subs 2024-09-14T11:33:24.213 INFO:tasks.workunit.client.0.smithi071.stderr: -335> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:33:24.213 INFO:tasks.workunit.client.0.smithi071.stderr: -334> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 10 monclient: _renew_subs 2024-09-14T11:33:24.213 INFO:tasks.workunit.client.0.smithi071.stderr: -333> 2024-09-14T11:33:23.793+0000 7f3e1f1569c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:33:24.213 INFO:tasks.workunit.client.0.smithi071.stderr: -332> 2024-09-14T11:33:23.797+0000 7f3d027fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:24.213 INFO:tasks.workunit.client.0.smithi071.stderr: -331> 2024-09-14T11:33:23.797+0000 7f3d027fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:33:24.213 INFO:tasks.workunit.client.0.smithi071.stderr: -330> 2024-09-14T11:33:23.797+0000 7f3d027fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:33:24.213 INFO:tasks.workunit.client.0.smithi071.stderr: -329> 2024-09-14T11:33:23.797+0000 7f3e1c45b640 10 monclient: get_auth_request con 0x7f3cf40717e0 auth_method 0 2024-09-14T11:33:24.214 INFO:tasks.workunit.client.0.smithi071.stderr: -328> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 10 monclient: get_monmap_and_config 2024-09-14T11:33:24.214 INFO:tasks.workunit.client.0.smithi071.stderr: -327> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 10 monclient: build_initial_monmap 2024-09-14T11:33:24.214 INFO:tasks.workunit.client.0.smithi071.stderr: -326> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 1 build_initial for_mkfs: 0 2024-09-14T11:33:24.214 INFO:tasks.workunit.client.0.smithi071.stderr: -325> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 10 monclient: monmap: 2024-09-14T11:33:24.214 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:33:24.214 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:24.214 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:33:24.214 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:33:24.214 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:24.214 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:24.214 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:33:24.214 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:33:24.214 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:33:24.214 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:24.215 INFO:tasks.workunit.client.0.smithi071.stderr: -324> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48178260) adding auth protocol: cephx 2024-09-14T11:33:24.215 INFO:tasks.workunit.client.0.smithi071.stderr: -323> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48178260) adding auth protocol: cephx 2024-09-14T11:33:24.215 INFO:tasks.workunit.client.0.smithi071.stderr: -322> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48178260) adding auth protocol: cephx 2024-09-14T11:33:24.215 INFO:tasks.workunit.client.0.smithi071.stderr: -321> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48178260) adding con mode: secure 2024-09-14T11:33:24.215 INFO:tasks.workunit.client.0.smithi071.stderr: -320> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48178260) adding con mode: crc 2024-09-14T11:33:24.215 INFO:tasks.workunit.client.0.smithi071.stderr: -319> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48178260) adding con mode: secure 2024-09-14T11:33:24.215 INFO:tasks.workunit.client.0.smithi071.stderr: -318> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48178260) adding con mode: crc 2024-09-14T11:33:24.215 INFO:tasks.workunit.client.0.smithi071.stderr: -317> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48178260) adding con mode: secure 2024-09-14T11:33:24.215 INFO:tasks.workunit.client.0.smithi071.stderr: -316> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48178260) adding con mode: crc 2024-09-14T11:33:24.215 INFO:tasks.workunit.client.0.smithi071.stderr: -315> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48178260) adding con mode: crc 2024-09-14T11:33:24.215 INFO:tasks.workunit.client.0.smithi071.stderr: -314> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48178260) adding con mode: secure 2024-09-14T11:33:24.215 INFO:tasks.workunit.client.0.smithi071.stderr: -313> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48178260) adding con mode: crc 2024-09-14T11:33:24.215 INFO:tasks.workunit.client.0.smithi071.stderr: -312> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48178260) adding con mode: secure 2024-09-14T11:33:24.215 INFO:tasks.workunit.client.0.smithi071.stderr: -311> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48178260) adding con mode: crc 2024-09-14T11:33:24.216 INFO:tasks.workunit.client.0.smithi071.stderr: -310> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a48178260) adding con mode: secure 2024-09-14T11:33:24.216 INFO:tasks.workunit.client.0.smithi071.stderr: -309> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:24.216 INFO:tasks.workunit.client.0.smithi071.stderr: -308> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 10 monclient: init 2024-09-14T11:33:24.216 INFO:tasks.workunit.client.0.smithi071.stderr: -307> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8be50) adding auth protocol: cephx 2024-09-14T11:33:24.216 INFO:tasks.workunit.client.0.smithi071.stderr: -306> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8be50) adding auth protocol: cephx 2024-09-14T11:33:24.216 INFO:tasks.workunit.client.0.smithi071.stderr: -305> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8be50) adding auth protocol: cephx 2024-09-14T11:33:24.216 INFO:tasks.workunit.client.0.smithi071.stderr: -304> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8be50) adding con mode: secure 2024-09-14T11:33:24.216 INFO:tasks.workunit.client.0.smithi071.stderr: -303> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8be50) adding con mode: crc 2024-09-14T11:33:24.216 INFO:tasks.workunit.client.0.smithi071.stderr: -302> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8be50) adding con mode: secure 2024-09-14T11:33:24.216 INFO:tasks.workunit.client.0.smithi071.stderr: -301> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8be50) adding con mode: crc 2024-09-14T11:33:24.216 INFO:tasks.workunit.client.0.smithi071.stderr: -300> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8be50) adding con mode: secure 2024-09-14T11:33:24.216 INFO:tasks.workunit.client.0.smithi071.stderr: -299> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8be50) adding con mode: crc 2024-09-14T11:33:24.216 INFO:tasks.workunit.client.0.smithi071.stderr: -298> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8be50) adding con mode: crc 2024-09-14T11:33:24.217 INFO:tasks.workunit.client.0.smithi071.stderr: -297> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8be50) adding con mode: secure 2024-09-14T11:33:24.217 INFO:tasks.workunit.client.0.smithi071.stderr: -296> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8be50) adding con mode: crc 2024-09-14T11:33:24.217 INFO:tasks.workunit.client.0.smithi071.stderr: -295> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8be50) adding con mode: secure 2024-09-14T11:33:24.217 INFO:tasks.workunit.client.0.smithi071.stderr: -294> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8be50) adding con mode: crc 2024-09-14T11:33:24.217 INFO:tasks.workunit.client.0.smithi071.stderr: -293> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8be50) adding con mode: secure 2024-09-14T11:33:24.217 INFO:tasks.workunit.client.0.smithi071.stderr: -292> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:24.217 INFO:tasks.workunit.client.0.smithi071.stderr: -291> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:24.217 INFO:tasks.workunit.client.0.smithi071.stderr: -290> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 asok(0x559a47eced90) register_command rotate-key cmddesc rotate-key hook 0x7fff0fe8bf98 EEXIST 2024-09-14T11:33:24.217 INFO:tasks.workunit.client.0.smithi071.stderr: -289> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 10 monclient: _reopen_session rank -1 2024-09-14T11:33:24.217 INFO:tasks.workunit.client.0.smithi071.stderr: -288> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:33:24.217 INFO:tasks.workunit.client.0.smithi071.stderr: -287> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 10 monclient(hunting): picked mon.noname-c con 0x559a481a6850 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:33:24.217 INFO:tasks.workunit.client.0.smithi071.stderr: -286> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 10 monclient(hunting): picked mon.noname-b con 0x559a481a6c30 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:33:24.217 INFO:tasks.workunit.client.0.smithi071.stderr: -285> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 10 monclient(hunting): picked mon.noname-a con 0x559a481a80f0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:33:24.218 INFO:tasks.workunit.client.0.smithi071.stderr: -284> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:24.218 INFO:tasks.workunit.client.0.smithi071.stderr: -283> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:24.218 INFO:tasks.workunit.client.0.smithi071.stderr: -282> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:24.218 INFO:tasks.workunit.client.0.smithi071.stderr: -281> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 10 monclient(hunting): _renew_subs 2024-09-14T11:33:24.218 INFO:tasks.workunit.client.0.smithi071.stderr: -280> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 10 monclient(hunting): authenticate will time out at 2415.918411s 2024-09-14T11:33:24.218 INFO:tasks.workunit.client.0.smithi071.stderr: -279> 2024-09-14T11:33:23.797+0000 7f3e1c45b640 10 monclient(hunting): get_auth_request con 0x559a481a6850 auth_method 0 2024-09-14T11:33:24.218 INFO:tasks.workunit.client.0.smithi071.stderr: -278> 2024-09-14T11:33:23.797+0000 7f3e1c45b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:24.218 INFO:tasks.workunit.client.0.smithi071.stderr: -277> 2024-09-14T11:33:23.797+0000 7f3e1c45b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:24.218 INFO:tasks.workunit.client.0.smithi071.stderr: -276> 2024-09-14T11:33:23.797+0000 7f3e1c45b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:24.218 INFO:tasks.workunit.client.0.smithi071.stderr: -275> 2024-09-14T11:33:23.797+0000 7f3e1cc5c640 10 monclient(hunting): get_auth_request con 0x559a481a80f0 auth_method 0 2024-09-14T11:33:24.218 INFO:tasks.workunit.client.0.smithi071.stderr: -274> 2024-09-14T11:33:23.797+0000 7f3e1cc5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:24.218 INFO:tasks.workunit.client.0.smithi071.stderr: -273> 2024-09-14T11:33:23.797+0000 7f3e1cc5c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:24.218 INFO:tasks.workunit.client.0.smithi071.stderr: -272> 2024-09-14T11:33:23.797+0000 7f3e1cc5c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:24.218 INFO:tasks.workunit.client.0.smithi071.stderr: -271> 2024-09-14T11:33:23.797+0000 7f3e1c45b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:24.219 INFO:tasks.workunit.client.0.smithi071.stderr: -270> 2024-09-14T11:33:23.797+0000 7f3e1c45b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:24.219 INFO:tasks.workunit.client.0.smithi071.stderr: -269> 2024-09-14T11:33:23.797+0000 7f3e1c45b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:24.219 INFO:tasks.workunit.client.0.smithi071.stderr: -268> 2024-09-14T11:33:23.797+0000 7f3e1cc5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:24.219 INFO:tasks.workunit.client.0.smithi071.stderr: -267> 2024-09-14T11:33:23.797+0000 7f3e1cc5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:24.219 INFO:tasks.workunit.client.0.smithi071.stderr: -266> 2024-09-14T11:33:23.797+0000 7f3e1cc5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:24.219 INFO:tasks.workunit.client.0.smithi071.stderr: -265> 2024-09-14T11:33:23.797+0000 7f3e1c45b640 10 monclient(hunting): handle_auth_done global_id 7526 payload 274 2024-09-14T11:33:24.219 INFO:tasks.workunit.client.0.smithi071.stderr: -264> 2024-09-14T11:33:23.797+0000 7f3e1c45b640 10 monclient: _finish_hunting 0 2024-09-14T11:33:24.219 INFO:tasks.workunit.client.0.smithi071.stderr: -263> 2024-09-14T11:33:23.797+0000 7f3e1c45b640 1 monclient: found mon.noname-c 2024-09-14T11:33:24.219 INFO:tasks.workunit.client.0.smithi071.stderr: -262> 2024-09-14T11:33:23.797+0000 7f3e1c45b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:33:24.219 INFO:tasks.workunit.client.0.smithi071.stderr: -261> 2024-09-14T11:33:23.797+0000 7f3cf3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:24.219 INFO:tasks.workunit.client.0.smithi071.stderr: -260> 2024-09-14T11:33:23.797+0000 7f3cf3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:24.219 INFO:tasks.workunit.client.0.smithi071.stderr: -259> 2024-09-14T11:33:23.797+0000 7f3cf3fff640 10 monclient: dump: 2024-09-14T11:33:24.219 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:33:24.219 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:33:24.220 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:24.220 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:24.220 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:24.220 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:24.220 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:33:24.220 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:33:24.220 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:33:24.220 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:24.220 INFO:tasks.workunit.client.0.smithi071.stderr: -258> 2024-09-14T11:33:23.797+0000 7f3cf3fff640 10 monclient: _finish_auth 0 2024-09-14T11:33:24.220 INFO:tasks.workunit.client.0.smithi071.stderr: -257> 2024-09-14T11:33:23.797+0000 7f3cf3fff640 10 monclient: _check_auth_tickets 2024-09-14T11:33:24.220 INFO:tasks.workunit.client.0.smithi071.stderr: -256> 2024-09-14T11:33:23.797+0000 7f3cf3fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:24.220 INFO:tasks.workunit.client.0.smithi071.stderr: -255> 2024-09-14T11:33:23.797+0000 7f3cf3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:24.220 INFO:tasks.workunit.client.0.smithi071.stderr: -254> 2024-09-14T11:33:23.797+0000 7f3cf3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:24.221 INFO:tasks.workunit.client.0.smithi071.stderr: -253> 2024-09-14T11:33:23.797+0000 7f3cf3fff640 10 monclient: dump: 2024-09-14T11:33:24.221 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:33:24.221 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:33:24.221 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:24.221 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:24.221 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:24.221 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:24.221 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:33:24.221 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:33:24.221 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:33:24.221 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:24.221 INFO:tasks.workunit.client.0.smithi071.stderr: -252> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 monclient: authenticate success, global_id 7526 2024-09-14T11:33:24.221 INFO:tasks.workunit.client.0.smithi071.stderr: -251> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 10 monclient: get_monmap_and_config success 2024-09-14T11:33:24.221 INFO:tasks.workunit.client.0.smithi071.stderr: -250> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 4 set_mon_vals no callback set 2024-09-14T11:33:24.221 INFO:tasks.workunit.client.0.smithi071.stderr: -249> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 10 monclient: shutdown 2024-09-14T11:33:24.222 INFO:tasks.workunit.client.0.smithi071.stderr: -248> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 10 monclient: build_initial_monmap 2024-09-14T11:33:24.222 INFO:tasks.workunit.client.0.smithi071.stderr: -247> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 1 build_initial for_mkfs: 0 2024-09-14T11:33:24.222 INFO:tasks.workunit.client.0.smithi071.stderr: -246> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 10 monclient: monmap: 2024-09-14T11:33:24.222 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:33:24.222 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:24.222 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:33:24.222 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:33:24.222 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:24.222 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:24.222 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:33:24.222 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:33:24.222 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:33:24.222 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:24.222 INFO:tasks.workunit.client.0.smithi071.stderr: -245> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4819edd0) adding auth protocol: cephx 2024-09-14T11:33:24.223 INFO:tasks.workunit.client.0.smithi071.stderr: -244> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4819edd0) adding auth protocol: cephx 2024-09-14T11:33:24.223 INFO:tasks.workunit.client.0.smithi071.stderr: -243> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4819edd0) adding auth protocol: cephx 2024-09-14T11:33:24.223 INFO:tasks.workunit.client.0.smithi071.stderr: -242> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4819edd0) adding con mode: secure 2024-09-14T11:33:24.223 INFO:tasks.workunit.client.0.smithi071.stderr: -241> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4819edd0) adding con mode: crc 2024-09-14T11:33:24.223 INFO:tasks.workunit.client.0.smithi071.stderr: -240> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4819edd0) adding con mode: secure 2024-09-14T11:33:24.223 INFO:tasks.workunit.client.0.smithi071.stderr: -239> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4819edd0) adding con mode: crc 2024-09-14T11:33:24.223 INFO:tasks.workunit.client.0.smithi071.stderr: -238> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4819edd0) adding con mode: secure 2024-09-14T11:33:24.223 INFO:tasks.workunit.client.0.smithi071.stderr: -237> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4819edd0) adding con mode: crc 2024-09-14T11:33:24.223 INFO:tasks.workunit.client.0.smithi071.stderr: -236> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4819edd0) adding con mode: crc 2024-09-14T11:33:24.223 INFO:tasks.workunit.client.0.smithi071.stderr: -235> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4819edd0) adding con mode: secure 2024-09-14T11:33:24.223 INFO:tasks.workunit.client.0.smithi071.stderr: -234> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4819edd0) adding con mode: crc 2024-09-14T11:33:24.223 INFO:tasks.workunit.client.0.smithi071.stderr: -233> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4819edd0) adding con mode: secure 2024-09-14T11:33:24.224 INFO:tasks.workunit.client.0.smithi071.stderr: -232> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4819edd0) adding con mode: crc 2024-09-14T11:33:24.224 INFO:tasks.workunit.client.0.smithi071.stderr: -231> 2024-09-14T11:33:23.797+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4819edd0) adding con mode: secure 2024-09-14T11:33:24.224 INFO:tasks.workunit.client.0.smithi071.stderr: -230> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:24.224 INFO:tasks.workunit.client.0.smithi071.stderr: -229> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 1 librados: starting msgr at 2024-09-14T11:33:24.224 INFO:tasks.workunit.client.0.smithi071.stderr: -228> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 1 librados: starting objecter 2024-09-14T11:33:24.224 INFO:tasks.workunit.client.0.smithi071.stderr: -227> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 asok(0x559a47eced90) register_command objecter_requests cmddesc objecter_requests hook 0x559a4815a7f0 EEXIST 2024-09-14T11:33:24.224 INFO:tasks.workunit.client.0.smithi071.stderr: -226> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 1 librados: setting wanted keys 2024-09-14T11:33:24.224 INFO:tasks.workunit.client.0.smithi071.stderr: -225> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 1 librados: calling monclient init 2024-09-14T11:33:24.224 INFO:tasks.workunit.client.0.smithi071.stderr: -224> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 10 monclient: init 2024-09-14T11:33:24.224 INFO:tasks.workunit.client.0.smithi071.stderr: -223> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4815a9a0) adding auth protocol: cephx 2024-09-14T11:33:24.224 INFO:tasks.workunit.client.0.smithi071.stderr: -222> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4815a9a0) adding auth protocol: cephx 2024-09-14T11:33:24.224 INFO:tasks.workunit.client.0.smithi071.stderr: -221> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4815a9a0) adding auth protocol: cephx 2024-09-14T11:33:24.224 INFO:tasks.workunit.client.0.smithi071.stderr: -220> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4815a9a0) adding con mode: secure 2024-09-14T11:33:24.224 INFO:tasks.workunit.client.0.smithi071.stderr: -219> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4815a9a0) adding con mode: crc 2024-09-14T11:33:24.225 INFO:tasks.workunit.client.0.smithi071.stderr: -218> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4815a9a0) adding con mode: secure 2024-09-14T11:33:24.225 INFO:tasks.workunit.client.0.smithi071.stderr: -217> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4815a9a0) adding con mode: crc 2024-09-14T11:33:24.225 INFO:tasks.workunit.client.0.smithi071.stderr: -216> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4815a9a0) adding con mode: secure 2024-09-14T11:33:24.225 INFO:tasks.workunit.client.0.smithi071.stderr: -215> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4815a9a0) adding con mode: crc 2024-09-14T11:33:24.225 INFO:tasks.workunit.client.0.smithi071.stderr: -214> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4815a9a0) adding con mode: crc 2024-09-14T11:33:24.225 INFO:tasks.workunit.client.0.smithi071.stderr: -213> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4815a9a0) adding con mode: secure 2024-09-14T11:33:24.225 INFO:tasks.workunit.client.0.smithi071.stderr: -212> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4815a9a0) adding con mode: crc 2024-09-14T11:33:24.225 INFO:tasks.workunit.client.0.smithi071.stderr: -211> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4815a9a0) adding con mode: secure 2024-09-14T11:33:24.225 INFO:tasks.workunit.client.0.smithi071.stderr: -210> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4815a9a0) adding con mode: crc 2024-09-14T11:33:24.225 INFO:tasks.workunit.client.0.smithi071.stderr: -209> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 AuthRegistry(0x559a4815a9a0) adding con mode: secure 2024-09-14T11:33:24.225 INFO:tasks.workunit.client.0.smithi071.stderr: -208> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:24.225 INFO:tasks.workunit.client.0.smithi071.stderr: -207> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:24.225 INFO:tasks.workunit.client.0.smithi071.stderr: -206> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 asok(0x559a47eced90) register_command rotate-key cmddesc rotate-key hook 0x559a4815aae8 EEXIST 2024-09-14T11:33:24.226 INFO:tasks.workunit.client.0.smithi071.stderr: -205> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 10 monclient: _reopen_session rank -1 2024-09-14T11:33:24.226 INFO:tasks.workunit.client.0.smithi071.stderr: -204> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:33:24.226 INFO:tasks.workunit.client.0.smithi071.stderr: -203> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 10 monclient(hunting): picked mon.noname-c con 0x559a481a6850 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:33:24.226 INFO:tasks.workunit.client.0.smithi071.stderr: -202> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 10 monclient(hunting): picked mon.noname-b con 0x559a481a80f0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:33:24.226 INFO:tasks.workunit.client.0.smithi071.stderr: -201> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 10 monclient(hunting): picked mon.noname-a con 0x559a4819ac50 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:33:24.226 INFO:tasks.workunit.client.0.smithi071.stderr: -200> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:24.226 INFO:tasks.workunit.client.0.smithi071.stderr: -199> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:24.226 INFO:tasks.workunit.client.0.smithi071.stderr: -198> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:24.226 INFO:tasks.workunit.client.0.smithi071.stderr: -197> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 10 monclient(hunting): _renew_subs 2024-09-14T11:33:24.226 INFO:tasks.workunit.client.0.smithi071.stderr: -196> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 10 monclient(hunting): authenticate will time out at 2415.920962s 2024-09-14T11:33:24.226 INFO:tasks.workunit.client.0.smithi071.stderr: -195> 2024-09-14T11:33:23.801+0000 7f3e1c45b640 10 monclient(hunting): get_auth_request con 0x559a481a6850 auth_method 0 2024-09-14T11:33:24.226 INFO:tasks.workunit.client.0.smithi071.stderr: -194> 2024-09-14T11:33:23.801+0000 7f3e1c45b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:24.226 INFO:tasks.workunit.client.0.smithi071.stderr: -193> 2024-09-14T11:33:23.801+0000 7f3e1c45b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:24.226 INFO:tasks.workunit.client.0.smithi071.stderr: -192> 2024-09-14T11:33:23.801+0000 7f3e1c45b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:24.227 INFO:tasks.workunit.client.0.smithi071.stderr: -191> 2024-09-14T11:33:23.801+0000 7f3e1cc5c640 10 monclient(hunting): get_auth_request con 0x559a4819ac50 auth_method 0 2024-09-14T11:33:24.227 INFO:tasks.workunit.client.0.smithi071.stderr: -190> 2024-09-14T11:33:23.801+0000 7f3e1cc5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:24.227 INFO:tasks.workunit.client.0.smithi071.stderr: -189> 2024-09-14T11:33:23.801+0000 7f3e1cc5c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:24.227 INFO:tasks.workunit.client.0.smithi071.stderr: -188> 2024-09-14T11:33:23.801+0000 7f3e1cc5c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:24.227 INFO:tasks.workunit.client.0.smithi071.stderr: -187> 2024-09-14T11:33:23.801+0000 7f3e1c45b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:24.227 INFO:tasks.workunit.client.0.smithi071.stderr: -186> 2024-09-14T11:33:23.801+0000 7f3e1c45b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:24.227 INFO:tasks.workunit.client.0.smithi071.stderr: -185> 2024-09-14T11:33:23.801+0000 7f3e1c45b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:24.227 INFO:tasks.workunit.client.0.smithi071.stderr: -184> 2024-09-14T11:33:23.801+0000 7f3e1cc5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:24.227 INFO:tasks.workunit.client.0.smithi071.stderr: -183> 2024-09-14T11:33:23.801+0000 7f3e1cc5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:24.227 INFO:tasks.workunit.client.0.smithi071.stderr: -182> 2024-09-14T11:33:23.801+0000 7f3e1cc5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:24.227 INFO:tasks.workunit.client.0.smithi071.stderr: -181> 2024-09-14T11:33:23.801+0000 7f3e1c45b640 10 monclient(hunting): handle_auth_done global_id 7529 payload 824 2024-09-14T11:33:24.227 INFO:tasks.workunit.client.0.smithi071.stderr: -180> 2024-09-14T11:33:23.801+0000 7f3e1c45b640 10 monclient: _finish_hunting 0 2024-09-14T11:33:24.227 INFO:tasks.workunit.client.0.smithi071.stderr: -179> 2024-09-14T11:33:23.801+0000 7f3e1c45b640 1 monclient: found mon.noname-c 2024-09-14T11:33:24.227 INFO:tasks.workunit.client.0.smithi071.stderr: -178> 2024-09-14T11:33:23.801+0000 7f3e1c45b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:33:24.228 INFO:tasks.workunit.client.0.smithi071.stderr: -177> 2024-09-14T11:33:23.801+0000 7f3cf27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:24.228 INFO:tasks.workunit.client.0.smithi071.stderr: -176> 2024-09-14T11:33:23.801+0000 7f3cf27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:24.228 INFO:tasks.workunit.client.0.smithi071.stderr: -175> 2024-09-14T11:33:23.801+0000 7f3cf27fc640 10 monclient: dump: 2024-09-14T11:33:24.228 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:33:24.228 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:33:24.228 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:24.228 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:24.228 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:24.228 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:24.228 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:33:24.228 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:33:24.228 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:33:24.228 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:24.228 INFO:tasks.workunit.client.0.smithi071.stderr: -174> 2024-09-14T11:33:23.801+0000 7f3cf27fc640 10 monclient: _finish_auth 0 2024-09-14T11:33:24.229 INFO:tasks.workunit.client.0.smithi071.stderr: -173> 2024-09-14T11:33:23.801+0000 7f3cf27fc640 10 monclient: _check_auth_tickets 2024-09-14T11:33:24.229 INFO:tasks.workunit.client.0.smithi071.stderr: -172> 2024-09-14T11:33:23.801+0000 7f3cf27fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:24.229 INFO:tasks.workunit.client.0.smithi071.stderr: -171> 2024-09-14T11:33:23.801+0000 7f3cf27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:24.229 INFO:tasks.workunit.client.0.smithi071.stderr: -170> 2024-09-14T11:33:23.801+0000 7f3cf27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:24.229 INFO:tasks.workunit.client.0.smithi071.stderr: -169> 2024-09-14T11:33:23.801+0000 7f3cf27fc640 10 monclient: dump: 2024-09-14T11:33:24.229 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:33:24.229 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:33:24.229 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:24.229 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:24.229 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:24.229 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:24.229 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:33:24.229 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:33:24.230 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:33:24.230 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:24.230 INFO:tasks.workunit.client.0.smithi071.stderr: -168> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 monclient: authenticate success, global_id 7529 2024-09-14T11:33:24.230 INFO:tasks.workunit.client.0.smithi071.stderr: -167> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 10 monclient: _renew_subs 2024-09-14T11:33:24.230 INFO:tasks.workunit.client.0.smithi071.stderr: -166> 2024-09-14T11:33:23.801+0000 7f3cf3fff640 4 set_mon_vals no callback set 2024-09-14T11:33:24.230 INFO:tasks.workunit.client.0.smithi071.stderr: -165> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:33:24.230 INFO:tasks.workunit.client.0.smithi071.stderr: -164> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 10 monclient: _renew_subs 2024-09-14T11:33:24.230 INFO:tasks.workunit.client.0.smithi071.stderr: -163> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:33:24.230 INFO:tasks.workunit.client.0.smithi071.stderr: -162> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 1 librados: init done 2024-09-14T11:33:24.230 INFO:tasks.workunit.client.0.smithi071.stderr: -161> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 5 asok(0x559a47eced90) register_command cr dump hook 0x559a4819c4e8 2024-09-14T11:33:24.230 INFO:tasks.workunit.client.0.smithi071.stderr: -160> 2024-09-14T11:33:23.801+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.230 INFO:tasks.workunit.client.0.smithi071.stderr: -159> 2024-09-14T11:33:23.801+0000 7f3cf27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:24.230 INFO:tasks.workunit.client.0.smithi071.stderr: -158> 2024-09-14T11:33:23.801+0000 7f3cf27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:33:24.231 INFO:tasks.workunit.client.0.smithi071.stderr: -157> 2024-09-14T11:33:23.801+0000 7f3cf27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:33:24.231 INFO:tasks.workunit.client.0.smithi071.stderr: -156> 2024-09-14T11:33:23.801+0000 7f3e1d45d640 10 monclient: get_auth_request con 0x7f3ce8071a40 auth_method 0 2024-09-14T11:33:24.231 INFO:tasks.workunit.client.0.smithi071.stderr: -155> 2024-09-14T11:33:23.805+0000 7f3e1cc5c640 10 monclient: get_auth_request con 0x559a481c65d0 auth_method 0 2024-09-14T11:33:24.231 INFO:tasks.workunit.client.0.smithi071.stderr: -154> 2024-09-14T11:33:23.805+0000 7f3e1f1569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:24.231 INFO:tasks.workunit.client.0.smithi071.stderr: -153> 2024-09-14T11:33:23.805+0000 7f3e1f1569c0 20 realm 2024-09-14T11:33:24.231 INFO:tasks.workunit.client.0.smithi071.stderr: -152> 2024-09-14T11:33:23.805+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.231 INFO:tasks.workunit.client.0.smithi071.stderr: -151> 2024-09-14T11:33:23.805+0000 7f3e1f1569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:24.231 INFO:tasks.workunit.client.0.smithi071.stderr: -150> 2024-09-14T11:33:23.805+0000 7f3e1f1569c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:24.231 INFO:tasks.workunit.client.0.smithi071.stderr: -149> 2024-09-14T11:33:23.805+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.231 INFO:tasks.workunit.client.0.smithi071.stderr: -148> 2024-09-14T11:33:23.805+0000 7f3e1f1569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:24.231 INFO:tasks.workunit.client.0.smithi071.stderr: -147> 2024-09-14T11:33:23.805+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.231 INFO:tasks.workunit.client.0.smithi071.stderr: -146> 2024-09-14T11:33:23.805+0000 7f3e1c45b640 10 monclient: get_auth_request con 0x559a481ca770 auth_method 0 2024-09-14T11:33:24.232 INFO:tasks.workunit.client.0.smithi071.stderr: -145> 2024-09-14T11:33:23.805+0000 7f3e1f1569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:24.232 INFO:tasks.workunit.client.0.smithi071.stderr: -144> 2024-09-14T11:33:23.805+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.232 INFO:tasks.workunit.client.0.smithi071.stderr: -143> 2024-09-14T11:33:23.805+0000 7f3e1d45d640 10 monclient: get_auth_request con 0x559a481ce060 auth_method 0 2024-09-14T11:33:24.232 INFO:tasks.workunit.client.0.smithi071.stderr: -142> 2024-09-14T11:33:23.805+0000 7f3e1f1569c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:24.232 INFO:tasks.workunit.client.0.smithi071.stderr: -141> 2024-09-14T11:33:23.809+0000 7f3e1f1569c0 20 searching for the correct realm 2024-09-14T11:33:24.232 INFO:tasks.workunit.client.0.smithi071.stderr: -140> 2024-09-14T11:33:23.809+0000 7f3e1cc5c640 10 monclient: get_auth_request con 0x559a481d2e00 auth_method 0 2024-09-14T11:33:24.232 INFO:tasks.workunit.client.0.smithi071.stderr: -139> 2024-09-14T11:33:23.809+0000 7f3e1c45b640 10 monclient: get_auth_request con 0x7f3e0c0193a0 auth_method 0 2024-09-14T11:33:24.232 INFO:tasks.workunit.client.0.smithi071.stderr: -138> 2024-09-14T11:33:23.809+0000 7f3e1d45d640 10 monclient: get_auth_request con 0x7f3e1000e070 auth_method 0 2024-09-14T11:33:24.232 INFO:tasks.workunit.client.0.smithi071.stderr: -137> 2024-09-14T11:33:23.809+0000 7f3e1d45d640 0 -- 172.21.15.71:0/1780958168 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f3e1000e070 msgr2=0x7f3e10053e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:24.232 INFO:tasks.workunit.client.0.smithi071.stderr: -136> 2024-09-14T11:33:24.013+0000 7f3e1d45d640 10 monclient: get_auth_request con 0x7f3e1000e070 auth_method 0 2024-09-14T11:33:24.232 INFO:tasks.workunit.client.0.smithi071.stderr: -135> 2024-09-14T11:33:24.013+0000 7f3e1cc5c640 10 monclient: get_auth_request con 0x7f3e0c02d8e0 auth_method 0 2024-09-14T11:33:24.232 INFO:tasks.workunit.client.0.smithi071.stderr: -134> 2024-09-14T11:33:24.021+0000 7f3e1c45b640 10 monclient: get_auth_request con 0x7f3e1004e110 auth_method 0 2024-09-14T11:33:24.232 INFO:tasks.workunit.client.0.smithi071.stderr: -133> 2024-09-14T11:33:24.021+0000 7f3e1d45d640 0 -- 172.21.15.71:0/1780958168 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x559a481ce060 msgr2=0x559a481d0450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:24.232 INFO:tasks.workunit.client.0.smithi071.stderr: -132> 2024-09-14T11:33:24.021+0000 7f3cf27fc640 1 client.7529.objecter ms_handle_reset 0x559a481ce060 session 0x559a481c9be0 osd.3 2024-09-14T11:33:24.232 INFO:tasks.workunit.client.0.smithi071.stderr: -131> 2024-09-14T11:33:24.021+0000 7f3cf27fc640 10 monclient: _renew_subs 2024-09-14T11:33:24.233 INFO:tasks.workunit.client.0.smithi071.stderr: -130> 2024-09-14T11:33:24.021+0000 7f3cf27fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:33:24.233 INFO:tasks.workunit.client.0.smithi071.stderr: -129> 2024-09-14T11:33:24.021+0000 7f3e1d45d640 10 monclient: get_auth_request con 0x7f3ce8081560 auth_method 0 2024-09-14T11:33:24.233 INFO:tasks.workunit.client.0.smithi071.stderr: -128> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:24.233 INFO:tasks.workunit.client.0.smithi071.stderr: -127> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:33:24.233 INFO:tasks.workunit.client.0.smithi071.stderr: -126> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:24.233 INFO:tasks.workunit.client.0.smithi071.stderr: -125> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:33:24.233 INFO:tasks.workunit.client.0.smithi071.stderr: -124> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:24.233 INFO:tasks.workunit.client.0.smithi071.stderr: -123> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:24.233 INFO:tasks.workunit.client.0.smithi071.stderr: -122> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.233 INFO:tasks.workunit.client.0.smithi071.stderr: -121> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:24.233 INFO:tasks.workunit.client.0.smithi071.stderr: -120> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.233 INFO:tasks.workunit.client.0.smithi071.stderr: -119> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:24.233 INFO:tasks.workunit.client.0.smithi071.stderr: -118> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.233 INFO:tasks.workunit.client.0.smithi071.stderr: -117> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:24.234 INFO:tasks.workunit.client.0.smithi071.stderr: -116> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 zone default found 2024-09-14T11:33:24.234 INFO:tasks.workunit.client.0.smithi071.stderr: -115> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 4 Realm: () 2024-09-14T11:33:24.234 INFO:tasks.workunit.client.0.smithi071.stderr: -114> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:33:24.234 INFO:tasks.workunit.client.0.smithi071.stderr: -113> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:33:24.234 INFO:tasks.workunit.client.0.smithi071.stderr: -112> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:24.234 INFO:tasks.workunit.client.0.smithi071.stderr: -111> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 zonegroup default 2024-09-14T11:33:24.234 INFO:tasks.workunit.client.0.smithi071.stderr: -110> 2024-09-14T11:33:24.037+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.234 INFO:tasks.workunit.client.0.smithi071.stderr: -109> 2024-09-14T11:33:24.041+0000 7f3e1f1569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:24.234 INFO:tasks.workunit.client.0.smithi071.stderr: -108> 2024-09-14T11:33:24.041+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.234 INFO:tasks.workunit.client.0.smithi071.stderr: -107> 2024-09-14T11:33:24.041+0000 7f3e1f1569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:24.234 INFO:tasks.workunit.client.0.smithi071.stderr: -106> 2024-09-14T11:33:24.041+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.234 INFO:tasks.workunit.client.0.smithi071.stderr: -105> 2024-09-14T11:33:24.041+0000 7f3e1f1569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:24.234 INFO:tasks.workunit.client.0.smithi071.stderr: -104> 2024-09-14T11:33:24.041+0000 7f3e1f1569c0 20 started sync module instance, tier type = 2024-09-14T11:33:24.234 INFO:tasks.workunit.client.0.smithi071.stderr: -103> 2024-09-14T11:33:24.041+0000 7f3e1f1569c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:33:24.235 INFO:tasks.workunit.client.0.smithi071.stderr: -102> 2024-09-14T11:33:24.065+0000 7f3e1f1569c0 20 add_watcher() i=0 2024-09-14T11:33:24.235 INFO:tasks.workunit.client.0.smithi071.stderr: -101> 2024-09-14T11:33:24.065+0000 7f3e1f1569c0 20 add_watcher() i=1 2024-09-14T11:33:24.235 INFO:tasks.workunit.client.0.smithi071.stderr: -100> 2024-09-14T11:33:24.065+0000 7f3e1f1569c0 20 add_watcher() i=2 2024-09-14T11:33:24.235 INFO:tasks.workunit.client.0.smithi071.stderr: -99> 2024-09-14T11:33:24.065+0000 7f3e1f1569c0 20 add_watcher() i=3 2024-09-14T11:33:24.235 INFO:tasks.workunit.client.0.smithi071.stderr: -98> 2024-09-14T11:33:24.065+0000 7f3e1f1569c0 20 add_watcher() i=4 2024-09-14T11:33:24.235 INFO:tasks.workunit.client.0.smithi071.stderr: -97> 2024-09-14T11:33:24.065+0000 7f3e1f1569c0 20 add_watcher() i=5 2024-09-14T11:33:24.235 INFO:tasks.workunit.client.0.smithi071.stderr: -96> 2024-09-14T11:33:24.065+0000 7f3e1f1569c0 20 add_watcher() i=6 2024-09-14T11:33:24.235 INFO:tasks.workunit.client.0.smithi071.stderr: -95> 2024-09-14T11:33:24.065+0000 7f3e1f1569c0 20 add_watcher() i=7 2024-09-14T11:33:24.235 INFO:tasks.workunit.client.0.smithi071.stderr: -94> 2024-09-14T11:33:24.065+0000 7f3e1f1569c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:24.235 INFO:tasks.workunit.client.0.smithi071.stderr: -93> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8c330) adding auth protocol: cephx 2024-09-14T11:33:24.235 INFO:tasks.workunit.client.0.smithi071.stderr: -92> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8c330) adding auth protocol: cephx 2024-09-14T11:33:24.235 INFO:tasks.workunit.client.0.smithi071.stderr: -91> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8c330) adding auth protocol: cephx 2024-09-14T11:33:24.235 INFO:tasks.workunit.client.0.smithi071.stderr: -90> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8c330) adding con mode: secure 2024-09-14T11:33:24.235 INFO:tasks.workunit.client.0.smithi071.stderr: -89> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8c330) adding con mode: crc 2024-09-14T11:33:24.236 INFO:tasks.workunit.client.0.smithi071.stderr: -88> 2024-09-14T11:33:24.073+0000 7f3cd37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:24.236 INFO:tasks.workunit.client.0.smithi071.stderr: -87> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8c330) adding con mode: secure 2024-09-14T11:33:24.236 INFO:tasks.workunit.client.0.smithi071.stderr: -86> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8c330) adding con mode: crc 2024-09-14T11:33:24.236 INFO:tasks.workunit.client.0.smithi071.stderr: -85> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8c330) adding con mode: secure 2024-09-14T11:33:24.236 INFO:tasks.workunit.client.0.smithi071.stderr: -84> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8c330) adding con mode: crc 2024-09-14T11:33:24.236 INFO:tasks.workunit.client.0.smithi071.stderr: -83> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8c330) adding con mode: crc 2024-09-14T11:33:24.236 INFO:tasks.workunit.client.0.smithi071.stderr: -82> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8c330) adding con mode: secure 2024-09-14T11:33:24.236 INFO:tasks.workunit.client.0.smithi071.stderr: -81> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8c330) adding con mode: crc 2024-09-14T11:33:24.236 INFO:tasks.workunit.client.0.smithi071.stderr: -80> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8c330) adding con mode: secure 2024-09-14T11:33:24.236 INFO:tasks.workunit.client.0.smithi071.stderr: -79> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8c330) adding con mode: crc 2024-09-14T11:33:24.236 INFO:tasks.workunit.client.0.smithi071.stderr: -78> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 AuthRegistry(0x7fff0fe8c330) adding con mode: secure 2024-09-14T11:33:24.236 INFO:tasks.workunit.client.0.smithi071.stderr: -77> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:24.236 INFO:tasks.workunit.client.0.smithi071.stderr: -76> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:24.236 INFO:tasks.workunit.client.0.smithi071.stderr: -75> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:24.237 INFO:tasks.workunit.client.0.smithi071.stderr: -74> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 asok(0x559a47eced90) register_command cache list hook 0x559a4819b070 2024-09-14T11:33:24.237 INFO:tasks.workunit.client.0.smithi071.stderr: -73> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 asok(0x559a47eced90) register_command cache inspect hook 0x559a4819b070 2024-09-14T11:33:24.237 INFO:tasks.workunit.client.0.smithi071.stderr: -72> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 asok(0x559a47eced90) register_command cache erase hook 0x559a4819b070 2024-09-14T11:33:24.237 INFO:tasks.workunit.client.0.smithi071.stderr: -71> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 asok(0x559a47eced90) register_command cache zap hook 0x559a4819b070 2024-09-14T11:33:24.237 INFO:tasks.workunit.client.0.smithi071.stderr: -70> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 note: GC not initialized 2024-09-14T11:33:24.237 INFO:tasks.workunit.client.0.smithi071.stderr: -69> 2024-09-14T11:33:24.073+0000 7f3cd27e4640 20 reqs_thread_entry: start 2024-09-14T11:33:24.237 INFO:tasks.workunit.client.0.smithi071.stderr: -68> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 asok(0x559a47eced90) register_command sync trace show hook 0x7f3e0c002a10 2024-09-14T11:33:24.237 INFO:tasks.workunit.client.0.smithi071.stderr: -67> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 asok(0x559a47eced90) register_command sync trace history hook 0x7f3e0c002a10 2024-09-14T11:33:24.237 INFO:tasks.workunit.client.0.smithi071.stderr: -66> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 asok(0x559a47eced90) register_command sync trace active hook 0x7f3e0c002a10 2024-09-14T11:33:24.237 INFO:tasks.workunit.client.0.smithi071.stderr: -65> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 5 asok(0x559a47eced90) register_command sync trace active_short hook 0x7f3e0c002a10 2024-09-14T11:33:24.237 INFO:tasks.workunit.client.0.smithi071.stderr: -64> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:24.237 INFO:tasks.workunit.client.0.smithi071.stderr: -63> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 20 Filter name: none 2024-09-14T11:33:24.237 INFO:tasks.workunit.client.0.smithi071.stderr: -62> 2024-09-14T11:33:24.073+0000 7f3ccb7fe640 20 reqs_thread_entry: start 2024-09-14T11:33:24.238 INFO:tasks.workunit.client.0.smithi071.stderr: -61> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:33:24.238 INFO:tasks.workunit.client.0.smithi071.stderr: -60> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.238 INFO:tasks.workunit.client.0.smithi071.stderr: -59> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:24.238 INFO:tasks.workunit.client.0.smithi071.stderr: -58> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:33:24.238 INFO:tasks.workunit.client.0.smithi071.stderr: -57> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:33:24.238 INFO:tasks.workunit.client.0.smithi071.stderr: -56> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 : miss 2024-09-14T11:33:24.238 INFO:tasks.workunit.client.0.smithi071.stderr: -55> 2024-09-14T11:33:24.073+0000 7f3e1f1569c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.238 INFO:tasks.workunit.client.0.smithi071.stderr: -54> 2024-09-14T11:33:24.077+0000 7f3e1f1569c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:24.238 INFO:tasks.workunit.client.0.smithi071.stderr: -53> 2024-09-14T11:33:24.077+0000 7f3e1f1569c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 info.flags=0x17 2024-09-14T11:33:24.238 INFO:tasks.workunit.client.0.smithi071.stderr: -52> 2024-09-14T11:33:24.077+0000 7f3e1f1569c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 to cache LRU end 2024-09-14T11:33:24.238 INFO:tasks.workunit.client.0.smithi071.stderr: -51> 2024-09-14T11:33:24.077+0000 7f3e1f1569c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:24.238 INFO:tasks.workunit.client.0.smithi071.stderr: -50> 2024-09-14T11:33:24.077+0000 7f3e1f1569c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:24.238 INFO:tasks.workunit.client.0.smithi071.stderr: -49> 2024-09-14T11:33:24.077+0000 7f3e1f1569c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 2024-09-14T11:33:24.239 INFO:tasks.workunit.client.0.smithi071.stderr: -48> 2024-09-14T11:33:24.089+0000 7f3e1f1569c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 info.flags=0x17 2024-09-14T11:33:24.239 INFO:tasks.workunit.client.0.smithi071.stderr: -47> 2024-09-14T11:33:24.089+0000 7f3e1f1569c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 to cache LRU end 2024-09-14T11:33:24.239 INFO:tasks.workunit.client.0.smithi071.stderr: -46> 2024-09-14T11:33:24.089+0000 7f3e1f1569c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:24.239 INFO:tasks.workunit.client.0.smithi071.stderr: -45> 2024-09-14T11:33:24.089+0000 7f3e1f1569c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40, ofs0, ns] 2024-09-14T11:33:24.239 INFO:tasks.workunit.client.0.smithi071.stderr: -44> 2024-09-14T11:33:24.089+0000 7f3cf3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464286 cookie 94121123218736 notifier 7529 bl.length()=1015 2024-09-14T11:33:24.239 INFO:tasks.workunit.client.0.smithi071.stderr: -43> 2024-09-14T11:33:24.089+0000 7f3cf3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 info.flags=0x17 2024-09-14T11:33:24.239 INFO:tasks.workunit.client.0.smithi071.stderr: -42> 2024-09-14T11:33:24.089+0000 7f3cf3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 to cache LRU end 2024-09-14T11:33:24.239 INFO:tasks.workunit.client.0.smithi071.stderr: -41> 2024-09-14T11:33:24.089+0000 7f3cf3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:24.239 INFO:tasks.workunit.client.0.smithi071.stderr: -40> 2024-09-14T11:33:24.089+0000 7f3e1f1569c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.40]): orig_sources= new_sources= 2024-09-14T11:33:24.239 INFO:tasks.workunit.client.0.smithi071.stderr: -39> 2024-09-14T11:33:24.089+0000 7f3e1f1569c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.40]): potential sources added=[] removed=[] 2024-09-14T11:33:24.239 INFO:tasks.workunit.client.0.smithi071.stderr: -38> 2024-09-14T11:33:24.089+0000 7f3e1f1569c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.40]): orig_dests= new_dests= 2024-09-14T11:33:24.239 INFO:tasks.workunit.client.0.smithi071.stderr: -37> 2024-09-14T11:33:24.089+0000 7f3e1f1569c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.40]): potential dests added=[] removed=[] 2024-09-14T11:33:24.239 INFO:tasks.workunit.client.0.smithi071.stderr: -36> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.0 2024-09-14T11:33:24.239 INFO:tasks.workunit.client.0.smithi071.stderr: -35> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.0 2024-09-14T11:33:24.240 INFO:tasks.workunit.client.0.smithi071.stderr: -34> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.1 2024-09-14T11:33:24.240 INFO:tasks.workunit.client.0.smithi071.stderr: -33> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.1 2024-09-14T11:33:24.240 INFO:tasks.workunit.client.0.smithi071.stderr: -32> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.2 2024-09-14T11:33:24.240 INFO:tasks.workunit.client.0.smithi071.stderr: -31> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.2 2024-09-14T11:33:24.240 INFO:tasks.workunit.client.0.smithi071.stderr: -30> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.3 2024-09-14T11:33:24.240 INFO:tasks.workunit.client.0.smithi071.stderr: -29> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.3 2024-09-14T11:33:24.240 INFO:tasks.workunit.client.0.smithi071.stderr: -28> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.4 2024-09-14T11:33:24.240 INFO:tasks.workunit.client.0.smithi071.stderr: -27> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.4 2024-09-14T11:33:24.240 INFO:tasks.workunit.client.0.smithi071.stderr: -26> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.5 2024-09-14T11:33:24.240 INFO:tasks.workunit.client.0.smithi071.stderr: -25> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.5 2024-09-14T11:33:24.240 INFO:tasks.workunit.client.0.smithi071.stderr: -24> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.6 2024-09-14T11:33:24.240 INFO:tasks.workunit.client.0.smithi071.stderr: -23> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.6 2024-09-14T11:33:24.240 INFO:tasks.workunit.client.0.smithi071.stderr: -22> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.7 2024-09-14T11:33:24.241 INFO:tasks.workunit.client.0.smithi071.stderr: -21> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.7 2024-09-14T11:33:24.241 INFO:tasks.workunit.client.0.smithi071.stderr: -20> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.8 2024-09-14T11:33:24.241 INFO:tasks.workunit.client.0.smithi071.stderr: -19> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.8 2024-09-14T11:33:24.241 INFO:tasks.workunit.client.0.smithi071.stderr: -18> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.9 2024-09-14T11:33:24.241 INFO:tasks.workunit.client.0.smithi071.stderr: -17> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.9 2024-09-14T11:33:24.241 INFO:tasks.workunit.client.0.smithi071.stderr: -16> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.10 2024-09-14T11:33:24.241 INFO:tasks.workunit.client.0.smithi071.stderr: -15> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.10 2024-09-14T11:33:24.241 INFO:tasks.workunit.client.0.smithi071.stderr: -14> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.11 2024-09-14T11:33:24.241 INFO:tasks.workunit.client.0.smithi071.stderr: -13> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1.11 2024-09-14T11:33:24.241 INFO:tasks.workunit.client.0.smithi071.stderr: -12> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.0 2024-09-14T11:33:24.241 INFO:tasks.workunit.client.0.smithi071.stderr: -11> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1 2024-09-14T11:33:24.241 INFO:tasks.workunit.client.0.smithi071.stderr: -10> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.2 2024-09-14T11:33:24.241 INFO:tasks.workunit.client.0.smithi071.stderr: -9> 2024-09-14T11:33:24.105+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.3 2024-09-14T11:33:24.241 INFO:tasks.workunit.client.0.smithi071.stderr: -8> 2024-09-14T11:33:24.109+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.4 2024-09-14T11:33:24.242 INFO:tasks.workunit.client.0.smithi071.stderr: -7> 2024-09-14T11:33:24.109+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.5 2024-09-14T11:33:24.242 INFO:tasks.workunit.client.0.smithi071.stderr: -6> 2024-09-14T11:33:24.109+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.6 2024-09-14T11:33:24.242 INFO:tasks.workunit.client.0.smithi071.stderr: -5> 2024-09-14T11:33:24.113+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.7 2024-09-14T11:33:24.242 INFO:tasks.workunit.client.0.smithi071.stderr: -4> 2024-09-14T11:33:24.113+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.8 2024-09-14T11:33:24.242 INFO:tasks.workunit.client.0.smithi071.stderr: -3> 2024-09-14T11:33:24.113+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.9 2024-09-14T11:33:24.242 INFO:tasks.workunit.client.0.smithi071.stderr: -2> 2024-09-14T11:33:24.117+0000 7f3e1f1569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.10 2024-09-14T11:33:24.242 INFO:tasks.workunit.client.0.smithi071.stderr: -1> 2024-09-14T11:33:24.125+0000 7f3e1f1569c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3e1f1569c0 time 2024-09-14T11:33:24.125484+0000 2024-09-14T11:33:24.242 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:33:24.242 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:24.242 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:24.242 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f3e22a302eb] 2024-09-14T11:33:24.242 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3e22a3049f] 2024-09-14T11:33:24.242 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559a45e97c01] 2024-09-14T11:33:24.242 INFO:tasks.workunit.client.0.smithi071.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x559a45eac231] 2024-09-14T11:33:24.243 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x559a45ead884] 2024-09-14T11:33:24.243 INFO:tasks.workunit.client.0.smithi071.stderr: 6: main() 2024-09-14T11:33:24.243 INFO:tasks.workunit.client.0.smithi071.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3e21896d90] 2024-09-14T11:33:24.243 INFO:tasks.workunit.client.0.smithi071.stderr: 8: __libc_start_main() 2024-09-14T11:33:24.243 INFO:tasks.workunit.client.0.smithi071.stderr: 9: _start() 2024-09-14T11:33:24.243 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:24.243 INFO:tasks.workunit.client.0.smithi071.stderr: 0> 2024-09-14T11:33:24.125+0000 7f3e1f1569c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:33:24.243 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f3e1f1569c0 thread_name:radosgw-admin 2024-09-14T11:33:24.243 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:24.243 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:24.243 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3e218af520] 2024-09-14T11:33:24.243 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:33:24.243 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:33:24.243 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:33:24.244 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3e22a30345] 2024-09-14T11:33:24.244 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3e22a3049f] 2024-09-14T11:33:24.244 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559a45e97c01] 2024-09-14T11:33:24.244 INFO:tasks.workunit.client.0.smithi071.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x559a45eac231] 2024-09-14T11:33:24.244 INFO:tasks.workunit.client.0.smithi071.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x559a45ead884] 2024-09-14T11:33:24.244 INFO:tasks.workunit.client.0.smithi071.stderr: 10: main() 2024-09-14T11:33:24.244 INFO:tasks.workunit.client.0.smithi071.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3e21896d90] 2024-09-14T11:33:24.244 INFO:tasks.workunit.client.0.smithi071.stderr: 12: __libc_start_main() 2024-09-14T11:33:24.244 INFO:tasks.workunit.client.0.smithi071.stderr: 13: _start() 2024-09-14T11:33:24.244 INFO:tasks.workunit.client.0.smithi071.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:33:24.244 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:24.244 INFO:tasks.workunit.client.0.smithi071.stderr:--- logging levels --- 2024-09-14T11:33:24.244 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 none 2024-09-14T11:33:24.245 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 lockdep 2024-09-14T11:33:24.245 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 context 2024-09-14T11:33:24.245 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 crush 2024-09-14T11:33:24.245 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds 2024-09-14T11:33:24.245 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_balancer 2024-09-14T11:33:24.245 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_locker 2024-09-14T11:33:24.245 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log 2024-09-14T11:33:24.245 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log_expire 2024-09-14T11:33:24.245 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_migrator 2024-09-14T11:33:24.245 INFO:tasks.workunit.client.0.smithi071.stderr: 3/ 5 mds_quiesce 2024-09-14T11:33:24.245 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 buffer 2024-09-14T11:33:24.245 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 timer 2024-09-14T11:33:24.245 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 filer 2024-09-14T11:33:24.246 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 striper 2024-09-14T11:33:24.246 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 objecter 2024-09-14T11:33:24.246 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rados 2024-09-14T11:33:24.246 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd 2024-09-14T11:33:24.246 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_mirror 2024-09-14T11:33:24.246 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_replay 2024-09-14T11:33:24.246 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_pwl 2024-09-14T11:33:24.246 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 journaler 2024-09-14T11:33:24.246 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objectcacher 2024-09-14T11:33:24.246 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:33:24.246 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 client 2024-09-14T11:33:24.246 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 osd 2024-09-14T11:33:24.246 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 optracker 2024-09-14T11:33:24.246 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objclass 2024-09-14T11:33:24.246 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 filestore 2024-09-14T11:33:24.247 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 journal 2024-09-14T11:33:24.247 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 ms 2024-09-14T11:33:24.247 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mon 2024-09-14T11:33:24.247 INFO:tasks.workunit.client.0.smithi071.stderr: 0/10 monc 2024-09-14T11:33:24.247 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 paxos 2024-09-14T11:33:24.247 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 tp 2024-09-14T11:33:24.247 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 auth 2024-09-14T11:33:24.247 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 crypto 2024-09-14T11:33:24.247 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 finisher 2024-09-14T11:33:24.247 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 reserver 2024-09-14T11:33:24.247 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 heartbeatmap 2024-09-14T11:33:24.247 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 perfcounter 2024-09-14T11:33:24.247 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw 2024-09-14T11:33:24.247 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_sync 2024-09-14T11:33:24.248 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_datacache 2024-09-14T11:33:24.248 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_access 2024-09-14T11:33:24.248 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:33:24.248 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_flight 2024-09-14T11:33:24.248 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:33:24.248 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw_notification 2024-09-14T11:33:24.248 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 javaclient 2024-09-14T11:33:24.248 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 asok 2024-09-14T11:33:24.248 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 throttle 2024-09-14T11:33:24.248 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 refs 2024-09-14T11:33:24.248 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 compressor 2024-09-14T11:33:24.248 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluestore 2024-09-14T11:33:24.248 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluefs 2024-09-14T11:33:24.248 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 bdev 2024-09-14T11:33:24.248 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 kstore 2024-09-14T11:33:24.249 INFO:tasks.workunit.client.0.smithi071.stderr: 4/ 5 rocksdb 2024-09-14T11:33:24.249 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 fuse 2024-09-14T11:33:24.249 INFO:tasks.workunit.client.0.smithi071.stderr: 2/ 5 mgr 2024-09-14T11:33:24.249 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mgrc 2024-09-14T11:33:24.249 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 dpdk 2024-09-14T11:33:24.249 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 eventtrace 2024-09-14T11:33:24.249 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 prioritycache 2024-09-14T11:33:24.249 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 test 2024-09-14T11:33:24.249 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:33:24.249 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephsqlite 2024-09-14T11:33:24.249 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:33:24.249 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore 2024-09-14T11:33:24.249 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_onode 2024-09-14T11:33:24.249 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_odata 2024-09-14T11:33:24.250 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_omap 2024-09-14T11:33:24.250 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_tm 2024-09-14T11:33:24.250 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_t 2024-09-14T11:33:24.250 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:33:24.250 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_epm 2024-09-14T11:33:24.250 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_lba 2024-09-14T11:33:24.250 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:33:24.250 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cache 2024-09-14T11:33:24.250 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_journal 2024-09-14T11:33:24.250 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_device 2024-09-14T11:33:24.250 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_backref 2024-09-14T11:33:24.250 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 alienstore 2024-09-14T11:33:24.250 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mclock 2024-09-14T11:33:24.251 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cyanstore 2024-09-14T11:33:24.251 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 ceph_exporter 2024-09-14T11:33:24.251 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 memstore 2024-09-14T11:33:24.251 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 trace 2024-09-14T11:33:24.251 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 ceph_dedup 2024-09-14T11:33:24.251 INFO:tasks.workunit.client.0.smithi071.stderr: -2/-2 (syslog threshold) 2024-09-14T11:33:24.251 INFO:tasks.workunit.client.0.smithi071.stderr: 99/99 (stderr threshold) 2024-09-14T11:33:24.251 INFO:tasks.workunit.client.0.smithi071.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:33:24.251 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3ccb7fe640 / http_manager 2024-09-14T11:33:24.251 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3cd27e4640 / http_manager 2024-09-14T11:33:24.251 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3cd37e6640 / rgw_dt_lg_renew 2024-09-14T11:33:24.251 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3cf27fc640 / ms_dispatch 2024-09-14T11:33:24.251 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3cf3fff640 / io_context_pool 2024-09-14T11:33:24.251 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3d027fc640 / ms_dispatch 2024-09-14T11:33:24.252 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3d0960a640 / ms_dispatch 2024-09-14T11:33:24.252 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3d0ae0d640 / io_context_pool 2024-09-14T11:33:24.252 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3e1bc5a640 / io_context_pool 2024-09-14T11:33:24.252 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3e1c45b640 / msgr-worker-2 2024-09-14T11:33:24.252 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3e1cc5c640 / msgr-worker-1 2024-09-14T11:33:24.252 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3e1d45d640 / msgr-worker-0 2024-09-14T11:33:24.252 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3e1f1569c0 / radosgw-admin 2024-09-14T11:33:24.252 INFO:tasks.workunit.client.0.smithi071.stderr: max_recent 500 2024-09-14T11:33:24.252 INFO:tasks.workunit.client.0.smithi071.stderr: max_new 1000 2024-09-14T11:33:24.252 INFO:tasks.workunit.client.0.smithi071.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:33:24.127909Z_5e838fd5-b921-481c-9d32-9fc1ac0e870a/log 2024-09-14T11:33:24.252 INFO:tasks.workunit.client.0.smithi071.stderr:--- end dump of recent events --- 2024-09-14T11:33:24.252 INFO:tasks.workunit.client.0.smithi071.stderr:Aborted 2024-09-14T11:33:24.252 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:33:24.254 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:24.254 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:24.254 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.209+0000 7ff7335d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.254 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.213+0000 7ff7335d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:24.254 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.213+0000 7ff7335d39c0 20 realm 2024-09-14T11:33:24.254 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.213+0000 7ff7335d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.254 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.213+0000 7ff7335d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:24.254 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.213+0000 7ff7335d39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:24.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.213+0000 7ff7335d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.213+0000 7ff7335d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:24.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.213+0000 7ff7335d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.213+0000 7ff7335d39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:24.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.213+0000 7ff7335d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.213+0000 7ff7335d39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:24.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.213+0000 7ff7335d39c0 20 searching for the correct realm 2024-09-14T11:33:24.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.217+0000 7ff7318da640 0 -- 172.21.15.71:0/2228675495 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7ff72802f060 msgr2=0x7ff728062a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:24.428 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.429+0000 7ff7318da640 0 -- 172.21.15.71:0/2228675495 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55e22c777f40 msgr2=0x55e22c77a330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:24.443 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.445+0000 7ff7335d39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:24.443 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.445+0000 7ff7335d39c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:33:24.444 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.445+0000 7ff7335d39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:24.444 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.445+0000 7ff7335d39c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:33:24.444 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.445+0000 7ff7335d39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:24.444 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.445+0000 7ff7335d39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:24.444 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.445+0000 7ff7335d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.444 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.445+0000 7ff7335d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:24.444 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.445+0000 7ff7335d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.445 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.449+0000 7ff7335d39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:24.445 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.449+0000 7ff7335d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.446 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.449+0000 7ff7335d39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:24.446 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.449+0000 7ff7335d39c0 20 zone default found 2024-09-14T11:33:24.446 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.449+0000 7ff7335d39c0 4 Realm: () 2024-09-14T11:33:24.446 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.449+0000 7ff7335d39c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:33:24.446 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.449+0000 7ff7335d39c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:33:24.446 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.449+0000 7ff7335d39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:24.446 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.449+0000 7ff7335d39c0 20 zonegroup default 2024-09-14T11:33:24.446 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.449+0000 7ff7335d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.447 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.449+0000 7ff7335d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:24.447 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.449+0000 7ff7335d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.447 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.449+0000 7ff7335d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:24.447 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.449+0000 7ff7335d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.448 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.449+0000 7ff7335d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:24.448 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.449+0000 7ff7335d39c0 20 started sync module instance, tier type = 2024-09-14T11:33:24.448 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.449+0000 7ff7335d39c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:33:24.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.473+0000 7ff7335d39c0 20 add_watcher() i=0 2024-09-14T11:33:24.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.473+0000 7ff7335d39c0 20 add_watcher() i=1 2024-09-14T11:33:24.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.473+0000 7ff7335d39c0 20 add_watcher() i=2 2024-09-14T11:33:24.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.473+0000 7ff7335d39c0 20 add_watcher() i=3 2024-09-14T11:33:24.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.473+0000 7ff7335d39c0 20 add_watcher() i=4 2024-09-14T11:33:24.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.473+0000 7ff7335d39c0 20 add_watcher() i=5 2024-09-14T11:33:24.471 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.473+0000 7ff7335d39c0 20 add_watcher() i=6 2024-09-14T11:33:24.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.477+0000 7ff7335d39c0 20 add_watcher() i=7 2024-09-14T11:33:24.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.477+0000 7ff7335d39c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:24.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.481+0000 7ff5e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:24.478 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.481+0000 7ff7335d39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:24.478 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.481+0000 7ff7335d39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:24.478 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.481+0000 7ff7335d39c0 5 note: GC not initialized 2024-09-14T11:33:24.478 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.481+0000 7ff5e67e4640 20 reqs_thread_entry: start 2024-09-14T11:33:24.478 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.481+0000 7ff7335d39c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:24.478 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.481+0000 7ff7335d39c0 20 Filter name: none 2024-09-14T11:33:24.478 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.481+0000 7ff7335d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.478 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.481+0000 7ff557fff640 20 reqs_thread_entry: start 2024-09-14T11:33:24.479 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.481+0000 7ff7335d39c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:24.479 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.481+0000 7ff7335d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.480 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.481+0000 7ff7335d39c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:33:24.480 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.481+0000 7ff7335d39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:24.480 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.481+0000 7ff7335d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.481 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.485+0000 7ff7335d39c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:24.481 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.485+0000 7ff7335d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.485+0000 7ff7335d39c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:33:24.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.485+0000 7ff7335d39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:24.485 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.489+0000 7ff5e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:24.489 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.493+0000 7ff7335d39c0 20 remove_watcher() i=0 2024-09-14T11:33:24.489 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.493+0000 7ff7335d39c0 2 removed watcher, disabling cache 2024-09-14T11:33:24.491 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.493+0000 7ff7335d39c0 20 remove_watcher() i=1 2024-09-14T11:33:24.493 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.497+0000 7ff7335d39c0 20 remove_watcher() i=2 2024-09-14T11:33:24.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.497+0000 7ff7335d39c0 20 remove_watcher() i=3 2024-09-14T11:33:24.497 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.501+0000 7ff7335d39c0 20 remove_watcher() i=4 2024-09-14T11:33:24.499 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.501+0000 7ff7335d39c0 20 remove_watcher() i=5 2024-09-14T11:33:24.502 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.505+0000 7ff7335d39c0 20 remove_watcher() i=6 2024-09-14T11:33:24.505 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.509+0000 7ff7335d39c0 20 remove_watcher() i=7 2024-09-14T11:33:24.519 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:24.520 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:33:24.520 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: abort-at-change-reshard-state id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.40 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:33:24.520 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:24.573 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:33:24.610 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:24.610 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:24.656 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.657+0000 7fd3978209c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.658 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.661+0000 7fd3978209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:24.658 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.661+0000 7fd3978209c0 20 realm 2024-09-14T11:33:24.658 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.661+0000 7fd3978209c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.659 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.661+0000 7fd3978209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:24.659 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.661+0000 7fd3978209c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:24.659 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.661+0000 7fd3978209c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.659 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.661+0000 7fd3978209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:24.659 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.661+0000 7fd3978209c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.660 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.661+0000 7fd3978209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:24.660 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.661+0000 7fd3978209c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.661 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.665+0000 7fd3978209c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:24.661 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.665+0000 7fd3978209c0 20 searching for the correct realm 2024-09-14T11:33:24.871 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:24.873+0000 7fd395b27640 0 -- 172.21.15.71:0/1318200839 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fd380111040 msgr2=0x7fd38010c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:25.084 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.085+0000 7fd395b27640 0 -- 172.21.15.71:0/1318200839 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x5609fbc93430 msgr2=0x5609fbc95820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:25.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.101+0000 7fd3978209c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:25.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.101+0000 7fd3978209c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:33:25.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.101+0000 7fd3978209c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:25.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.101+0000 7fd3978209c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:33:25.100 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.101+0000 7fd3978209c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:25.100 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.101+0000 7fd3978209c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:25.100 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.101+0000 7fd3978209c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:25.100 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.101+0000 7fd3978209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:25.100 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.101+0000 7fd3978209c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:25.101 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.105+0000 7fd3978209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:25.101 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.105+0000 7fd3978209c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:25.102 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.105+0000 7fd3978209c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:25.102 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.105+0000 7fd3978209c0 20 zone default found 2024-09-14T11:33:25.102 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.105+0000 7fd3978209c0 4 Realm: () 2024-09-14T11:33:25.102 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.105+0000 7fd3978209c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:33:25.102 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.105+0000 7fd3978209c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:33:25.103 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.105+0000 7fd3978209c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:25.103 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.105+0000 7fd3978209c0 20 zonegroup default 2024-09-14T11:33:25.103 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.105+0000 7fd3978209c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:25.103 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.105+0000 7fd3978209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:25.103 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.105+0000 7fd3978209c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:25.104 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.105+0000 7fd3978209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:25.104 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.105+0000 7fd3978209c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:25.104 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.109+0000 7fd3978209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:25.104 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.109+0000 7fd3978209c0 20 started sync module instance, tier type = 2024-09-14T11:33:25.105 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.109+0000 7fd3978209c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:33:25.129 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.133+0000 7fd3978209c0 20 add_watcher() i=0 2024-09-14T11:33:25.129 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.133+0000 7fd3978209c0 20 add_watcher() i=1 2024-09-14T11:33:25.129 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.133+0000 7fd3978209c0 20 add_watcher() i=2 2024-09-14T11:33:25.129 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.133+0000 7fd3978209c0 20 add_watcher() i=3 2024-09-14T11:33:25.129 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.133+0000 7fd3978209c0 20 add_watcher() i=4 2024-09-14T11:33:25.129 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.133+0000 7fd3978209c0 20 add_watcher() i=5 2024-09-14T11:33:25.129 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.133+0000 7fd3978209c0 20 add_watcher() i=6 2024-09-14T11:33:25.131 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.133+0000 7fd3978209c0 20 add_watcher() i=7 2024-09-14T11:33:25.131 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.133+0000 7fd3978209c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:25.136 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.137+0000 7fd24b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:25.136 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.141+0000 7fd3978209c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:25.137 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.141+0000 7fd3978209c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:25.137 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.141+0000 7fd3978209c0 5 note: GC not initialized 2024-09-14T11:33:25.137 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.141+0000 7fd24a7e4640 20 reqs_thread_entry: start 2024-09-14T11:33:25.137 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.141+0000 7fd3978209c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:25.137 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.141+0000 7fd3978209c0 20 Filter name: none 2024-09-14T11:33:25.138 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.141+0000 7fd1bbfff640 20 reqs_thread_entry: start 2024-09-14T11:33:25.138 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.141+0000 7fd3978209c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:33:25.138 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.141+0000 7fd3978209c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:25.139 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.141+0000 7fd3978209c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:25.139 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.141+0000 7fd3978209c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:33:25.139 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.141+0000 7fd3978209c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:33:25.139 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.141+0000 7fd3978209c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 : miss 2024-09-14T11:33:25.140 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.141+0000 7fd3978209c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:25.140 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.141+0000 7fd3978209c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:33:25.140 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.141+0000 7fd3978209c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 info.flags=0x17 2024-09-14T11:33:25.140 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.141+0000 7fd3978209c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 to cache LRU end 2024-09-14T11:33:25.140 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.141+0000 7fd3978209c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:25.141 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.141+0000 7fd3978209c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:25.141 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.141+0000 7fd3978209c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 2024-09-14T11:33:25.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.145+0000 7fd3978209c0 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 to be held by another RGW process; skipping for now 2024-09-14T11:33:25.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.145+0000 7fd24b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:25.148 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.153+0000 7fd3978209c0 20 remove_watcher() i=0 2024-09-14T11:33:25.148 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.153+0000 7fd3978209c0 2 removed watcher, disabling cache 2024-09-14T11:33:25.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.153+0000 7fd3978209c0 20 remove_watcher() i=1 2024-09-14T11:33:25.153 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.157+0000 7fd3978209c0 20 remove_watcher() i=2 2024-09-14T11:33:25.156 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.157+0000 7fd3978209c0 20 remove_watcher() i=3 2024-09-14T11:33:25.158 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.161+0000 7fd3978209c0 20 remove_watcher() i=4 2024-09-14T11:33:25.160 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.161+0000 7fd3978209c0 20 remove_watcher() i=5 2024-09-14T11:33:25.163 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.165+0000 7fd3978209c0 20 remove_watcher() i=6 2024-09-14T11:33:25.166 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:25.169+0000 7fd3978209c0 20 remove_watcher() i=7 2024-09-14T11:33:25.183 INFO:tasks.workunit.client.0.smithi071.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:33:55.215 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:33:55.250 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:55.250 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:55.493 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.496+0000 7f9e54343640 0 --2- 172.21.15.71:0/1030844520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b4eee5660 0x562b4eee5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:33:55.501 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.504+0000 7f9e5683d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:55.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.504+0000 7f9e5683d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:55.504 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.504+0000 7f9e5683d9c0 20 realm 2024-09-14T11:33:55.504 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.504+0000 7f9e5683d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:55.504 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.504+0000 7f9e5683d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:55.504 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.504+0000 7f9e5683d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:55.504 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.504+0000 7f9e5683d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:55.505 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.508+0000 7f9e5683d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:55.505 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.508+0000 7f9e5683d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:55.506 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.508+0000 7f9e5683d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:55.506 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.508+0000 7f9e5683d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:55.507 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.508+0000 7f9e5683d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:55.507 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.508+0000 7f9e5683d9c0 20 searching for the correct realm 2024-09-14T11:33:55.507 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.508+0000 7f9e54343640 0 -- 172.21.15.71:0/2386994985 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x562b4ef0f9b0 msgr2=0x562b4ef11e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:55.716 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.716+0000 7f9e54343640 0 -- 172.21.15.71:0/2386994985 >> [v2:172.21.15.157:6808/527702018,v1:172.21.15.157:6809/527702018] conn(0x7f9e44008050 msgr2=0x7f9e4400c850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:55.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.736+0000 7f9e5683d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:55.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.736+0000 7f9e5683d9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:33:55.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.736+0000 7f9e5683d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:55.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.736+0000 7f9e5683d9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:33:55.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.736+0000 7f9e5683d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:55.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.736+0000 7f9e5683d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:55.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.736+0000 7f9e5683d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:55.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.740+0000 7f9e5683d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:55.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.740+0000 7f9e5683d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:55.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.740+0000 7f9e5683d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:55.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.740+0000 7f9e5683d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:55.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.740+0000 7f9e5683d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:55.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.740+0000 7f9e5683d9c0 20 zone default found 2024-09-14T11:33:55.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.740+0000 7f9e5683d9c0 4 Realm: () 2024-09-14T11:33:55.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.740+0000 7f9e5683d9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:33:55.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.740+0000 7f9e5683d9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:33:55.739 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.740+0000 7f9e5683d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:55.739 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.740+0000 7f9e5683d9c0 20 zonegroup default 2024-09-14T11:33:55.739 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.740+0000 7f9e5683d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:55.739 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.740+0000 7f9e5683d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:55.739 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.740+0000 7f9e5683d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:55.740 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.740+0000 7f9e5683d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:55.740 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.740+0000 7f9e5683d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:55.741 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.744+0000 7f9e5683d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:55.741 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.744+0000 7f9e5683d9c0 20 started sync module instance, tier type = 2024-09-14T11:33:55.741 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.744+0000 7f9e5683d9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:33:55.762 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.764+0000 7f9e5683d9c0 20 add_watcher() i=0 2024-09-14T11:33:55.762 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.764+0000 7f9e5683d9c0 20 add_watcher() i=1 2024-09-14T11:33:55.762 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.764+0000 7f9e5683d9c0 20 add_watcher() i=2 2024-09-14T11:33:55.762 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.764+0000 7f9e5683d9c0 20 add_watcher() i=3 2024-09-14T11:33:55.762 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.764+0000 7f9e5683d9c0 20 add_watcher() i=4 2024-09-14T11:33:55.762 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.764+0000 7f9e5683d9c0 20 add_watcher() i=5 2024-09-14T11:33:55.762 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.764+0000 7f9e5683d9c0 20 add_watcher() i=6 2024-09-14T11:33:55.764 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.764+0000 7f9e5683d9c0 20 add_watcher() i=7 2024-09-14T11:33:55.764 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.764+0000 7f9e5683d9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:55.768 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.772+0000 7f9d0afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:55.769 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.772+0000 7f9e5683d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:55.769 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.772+0000 7f9e5683d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:55.769 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.772+0000 7f9e5683d9c0 5 note: GC not initialized 2024-09-14T11:33:55.770 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.772+0000 7f9d09fdb640 20 reqs_thread_entry: start 2024-09-14T11:33:55.770 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.772+0000 7f9e5683d9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:55.770 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.772+0000 7f9e5683d9c0 20 Filter name: none 2024-09-14T11:33:55.770 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.772+0000 7f9c7b7fe640 20 reqs_thread_entry: start 2024-09-14T11:33:55.770 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.772+0000 7f9e5683d9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:33:55.770 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.772+0000 7f9e5683d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:55.771 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.772+0000 7f9e5683d9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:55.771 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.772+0000 7f9e5683d9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:33:55.771 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.772+0000 7f9e5683d9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:33:55.771 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.772+0000 7f9e5683d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 : miss 2024-09-14T11:33:55.772 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.772+0000 7f9e5683d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:55.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.776+0000 7f9e5683d9c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:33:55.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.776+0000 7f9e5683d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 info.flags=0x17 2024-09-14T11:33:55.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.776+0000 7f9e5683d9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 to cache LRU end 2024-09-14T11:33:55.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.776+0000 7f9e5683d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:55.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.776+0000 7f9e5683d9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:55.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.776+0000 7f9e5683d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 2024-09-14T11:33:55.775 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.776+0000 7f9e5683d9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:33:55.788 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.792+0000 7f9e5683d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 info.flags=0x17 2024-09-14T11:33:55.788 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.792+0000 7f9e5683d9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 to cache LRU end 2024-09-14T11:33:55.789 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.792+0000 7f9e5683d9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:55.789 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.792+0000 7f9e5683d9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40, ofs0, ns] 2024-09-14T11:33:55.789 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.792+0000 7f9d2b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464287 cookie 94744008016656 notifier 7980 bl.length()=1015 2024-09-14T11:33:55.789 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.792+0000 7f9d2b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 info.flags=0x17 2024-09-14T11:33:55.789 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.792+0000 7f9d2b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 to cache LRU end 2024-09-14T11:33:55.789 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.792+0000 7f9d2b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:55.790 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.792+0000 7f9e5683d9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.40]): orig_sources= new_sources= 2024-09-14T11:33:55.790 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.792+0000 7f9e5683d9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.40]): potential sources added=[] removed=[] 2024-09-14T11:33:55.790 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.792+0000 7f9e5683d9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.40]): orig_dests= new_dests= 2024-09-14T11:33:55.790 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.792+0000 7f9e5683d9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.40]): potential dests added=[] removed=[] 2024-09-14T11:33:55.805 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.808+0000 7f9e5683d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.2.0 2024-09-14T11:33:55.805 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.808+0000 7f9e5683d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.2.0 2024-09-14T11:33:55.805 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.808+0000 7f9e5683d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.2.1 2024-09-14T11:33:55.805 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.808+0000 7f9e5683d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.2.1 2024-09-14T11:33:55.805 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.808+0000 7f9e5683d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.2.2 2024-09-14T11:33:55.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.808+0000 7f9e5683d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.2.2 2024-09-14T11:33:55.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.808+0000 7f9e5683d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.2.3 2024-09-14T11:33:55.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.808+0000 7f9e5683d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.2.3 2024-09-14T11:33:55.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.808+0000 7f9e5683d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.2.4 2024-09-14T11:33:55.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.808+0000 7f9e5683d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.2.4 2024-09-14T11:33:55.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.808+0000 7f9e5683d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.2.5 2024-09-14T11:33:55.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.808+0000 7f9e5683d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.2.5 2024-09-14T11:33:55.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.808+0000 7f9e5683d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.2.6 2024-09-14T11:33:55.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.808+0000 7f9e5683d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.2.6 2024-09-14T11:33:55.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.808+0000 7f9e5683d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.2.7 2024-09-14T11:33:55.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.808+0000 7f9e5683d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.2.7 2024-09-14T11:33:55.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.808+0000 7f9e5683d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.2.8 2024-09-14T11:33:55.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.808+0000 7f9e5683d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.2.8 2024-09-14T11:33:55.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.808+0000 7f9e5683d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.2.9 2024-09-14T11:33:55.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.808+0000 7f9e5683d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.2.9 2024-09-14T11:33:55.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.808+0000 7f9e5683d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.2.10 2024-09-14T11:33:55.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.808+0000 7f9e5683d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.2.10 2024-09-14T11:33:55.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.808+0000 7f9e5683d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.2.11 2024-09-14T11:33:55.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.808+0000 7f9e5683d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.2.11 2024-09-14T11:33:55.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.808+0000 7f9e5683d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.0 2024-09-14T11:33:55.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.808+0000 7f9e5683d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1 2024-09-14T11:33:55.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.808+0000 7f9e5683d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.2 2024-09-14T11:33:55.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.808+0000 7f9e5683d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.3 2024-09-14T11:33:55.808 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.808+0000 7f9e5683d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.4 2024-09-14T11:33:55.809 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.812+0000 7f9e5683d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.5 2024-09-14T11:33:55.809 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.812+0000 7f9e5683d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.6 2024-09-14T11:33:55.811 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.812+0000 7f9e5683d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.7 2024-09-14T11:33:55.813 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.816+0000 7f9e5683d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.8 2024-09-14T11:33:55.815 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.816+0000 7f9e5683d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.9 2024-09-14T11:33:55.815 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.816+0000 7f9e5683d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.10 2024-09-14T11:33:55.822 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.824+0000 7f9e5683d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 : hit (requested=0x17, cached=0x17) 2024-09-14T11:33:55.822 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.824+0000 7f9e5683d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 2024-09-14T11:33:55.825 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.828+0000 7f9e5683d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 info.flags=0x17 2024-09-14T11:33:55.825 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.828+0000 7f9e5683d9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 to cache LRU end 2024-09-14T11:33:55.825 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.828+0000 7f9e5683d9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:55.825 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.828+0000 7f9e5683d9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40, ofs0, ns] 2024-09-14T11:33:55.826 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.828+0000 7f9d2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464288 cookie 94744008016656 notifier 7980 bl.length()=1015 2024-09-14T11:33:55.826 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.828+0000 7f9d2affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 info.flags=0x17 2024-09-14T11:33:55.826 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.828+0000 7f9d2affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 to cache LRU end 2024-09-14T11:33:55.826 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.828+0000 7f9d2affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:55.827 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.828+0000 7f9e5683d9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.40]): orig_sources= new_sources= 2024-09-14T11:33:55.827 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.828+0000 7f9e5683d9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.40]): potential sources added=[] removed=[] 2024-09-14T11:33:55.828 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.828+0000 7f9e5683d9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.40]): orig_dests= new_dests= 2024-09-14T11:33:55.828 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.828+0000 7f9e5683d9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.40]): potential dests added=[] removed=[] 2024-09-14T11:33:55.834 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.836+0000 7f9e5683d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.0 2024-09-14T11:33:55.834 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.836+0000 7f9e5683d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.1 2024-09-14T11:33:55.834 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.836+0000 7f9e5683d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.2 2024-09-14T11:33:55.835 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.836+0000 7f9e5683d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.3 2024-09-14T11:33:55.836 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.836+0000 7f9e5683d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.4 2024-09-14T11:33:55.837 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.840+0000 7f9e5683d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.5 2024-09-14T11:33:55.837 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.840+0000 7f9e5683d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.6 2024-09-14T11:33:55.838 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.840+0000 7f9e5683d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.7 2024-09-14T11:33:55.839 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.840+0000 7f9e5683d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.8 2024-09-14T11:33:55.840 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.840+0000 7f9e5683d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.9 2024-09-14T11:33:55.841 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.844+0000 7f9e5683d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.40.10 2024-09-14T11:33:55.842 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.844+0000 7f9e5683d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 : hit (requested=0x17, cached=0x17) 2024-09-14T11:33:55.842 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.844+0000 7f9e5683d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 2024-09-14T11:33:55.845 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.848+0000 7f9e5683d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 info.flags=0x17 2024-09-14T11:33:55.845 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.848+0000 7f9e5683d9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 to cache LRU end 2024-09-14T11:33:55.845 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.848+0000 7f9e5683d9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:55.845 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.848+0000 7f9e5683d9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40, ofs0, ns] 2024-09-14T11:33:55.846 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.848+0000 7f9d2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464289 cookie 94744008016656 notifier 7980 bl.length()=983 2024-09-14T11:33:55.846 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.848+0000 7f9d2affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 info.flags=0x17 2024-09-14T11:33:55.846 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.848+0000 7f9d2affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:4444f441-0c56-48df-a905-d49e7e44d629.4596.40 to cache LRU end 2024-09-14T11:33:55.846 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.848+0000 7f9d2affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:55.847 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.848+0000 7f9e5683d9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.40]): orig_sources= new_sources= 2024-09-14T11:33:55.847 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.848+0000 7f9e5683d9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.40]): potential sources added=[] removed=[] 2024-09-14T11:33:55.847 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.848+0000 7f9e5683d9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.40]): orig_dests= new_dests= 2024-09-14T11:33:55.847 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.848+0000 7f9e5683d9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[4444f441-0c56-48df-a905-d49e7e44d629.4596.40]): potential dests added=[] removed=[] 2024-09-14T11:33:55.853 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.856+0000 7f9e5683d9c0 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-14T11:33:55.857 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.860+0000 7f9d0afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:55.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.864+0000 7f9e5683d9c0 20 remove_watcher() i=0 2024-09-14T11:33:55.862 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.864+0000 7f9e5683d9c0 2 removed watcher, disabling cache 2024-09-14T11:33:55.864 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.864+0000 7f9e5683d9c0 20 remove_watcher() i=1 2024-09-14T11:33:55.866 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.868+0000 7f9e5683d9c0 20 remove_watcher() i=2 2024-09-14T11:33:55.868 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.868+0000 7f9e5683d9c0 20 remove_watcher() i=3 2024-09-14T11:33:55.870 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.872+0000 7f9e5683d9c0 20 remove_watcher() i=4 2024-09-14T11:33:55.873 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.876+0000 7f9e5683d9c0 20 remove_watcher() i=5 2024-09-14T11:33:55.876 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.876+0000 7f9e5683d9c0 20 remove_watcher() i=6 2024-09-14T11:33:55.879 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.880+0000 7f9e5683d9c0 20 remove_watcher() i=7 2024-09-14T11:33:55.896 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:33:55.928 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:55.928 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:55.971 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.972+0000 7f6b50e609c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:55.973 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.976+0000 7f6b50e609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:55.973 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.976+0000 7f6b50e609c0 20 realm 2024-09-14T11:33:55.973 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.976+0000 7f6b50e609c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:55.974 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.976+0000 7f6b50e609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:55.974 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.976+0000 7f6b50e609c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:55.974 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.976+0000 7f6b50e609c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:55.974 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.976+0000 7f6b50e609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:55.975 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.976+0000 7f6b50e609c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:55.976 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.976+0000 7f6b50e609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:55.976 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.976+0000 7f6b50e609c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:55.976 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.980+0000 7f6b50e609c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:55.977 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.980+0000 7f6b50e609c0 20 searching for the correct realm 2024-09-14T11:33:55.982 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:55.984+0000 7f6b4e966640 0 -- 172.21.15.71:0/1200928925 >> [v2:172.21.15.157:6808/527702018,v1:172.21.15.157:6809/527702018] conn(0x7f6b4006ef10 msgr2=0x7f6b40099820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:56.198 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.200+0000 7f6b4e966640 0 -- 172.21.15.71:0/1200928925 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x559c71b33a10 msgr2=0x559c71b35eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:56.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.208+0000 7f6b50e609c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:56.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.208+0000 7f6b50e609c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:33:56.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.208+0000 7f6b50e609c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:56.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.208+0000 7f6b50e609c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:33:56.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.208+0000 7f6b50e609c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:56.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.208+0000 7f6b50e609c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:56.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.208+0000 7f6b50e609c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:56.208 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.208+0000 7f6b50e609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:56.208 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.208+0000 7f6b50e609c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:56.209 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.212+0000 7f6b50e609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:56.209 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.212+0000 7f6b50e609c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:56.210 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.212+0000 7f6b50e609c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:56.210 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.212+0000 7f6b50e609c0 20 zone default found 2024-09-14T11:33:56.210 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.212+0000 7f6b50e609c0 4 Realm: () 2024-09-14T11:33:56.210 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.212+0000 7f6b50e609c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:33:56.210 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.212+0000 7f6b50e609c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:33:56.210 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.212+0000 7f6b50e609c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:56.210 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.212+0000 7f6b50e609c0 20 zonegroup default 2024-09-14T11:33:56.210 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.212+0000 7f6b50e609c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:56.211 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.212+0000 7f6b50e609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:56.211 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.212+0000 7f6b50e609c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:56.212 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.212+0000 7f6b50e609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:56.212 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.212+0000 7f6b50e609c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:56.212 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.216+0000 7f6b50e609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:56.212 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.216+0000 7f6b50e609c0 20 started sync module instance, tier type = 2024-09-14T11:33:56.213 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.216+0000 7f6b50e609c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:33:56.234 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.236+0000 7f6b50e609c0 20 add_watcher() i=0 2024-09-14T11:33:56.234 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.236+0000 7f6b50e609c0 20 add_watcher() i=1 2024-09-14T11:33:56.234 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.236+0000 7f6b50e609c0 20 add_watcher() i=2 2024-09-14T11:33:56.235 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.236+0000 7f6b50e609c0 20 add_watcher() i=3 2024-09-14T11:33:56.235 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.236+0000 7f6b50e609c0 20 add_watcher() i=4 2024-09-14T11:33:56.235 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.236+0000 7f6b50e609c0 20 add_watcher() i=5 2024-09-14T11:33:56.235 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.236+0000 7f6b50e609c0 20 add_watcher() i=6 2024-09-14T11:33:56.237 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.240+0000 7f6b50e609c0 20 add_watcher() i=7 2024-09-14T11:33:56.237 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.240+0000 7f6b50e609c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:56.241 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.244+0000 7f6a057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:56.242 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.244+0000 7f6b50e609c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:56.242 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.244+0000 7f6b50e609c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:56.242 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.244+0000 7f6b50e609c0 5 note: GC not initialized 2024-09-14T11:33:56.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.244+0000 7f697ffff640 20 reqs_thread_entry: start 2024-09-14T11:33:56.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.244+0000 7f6b50e609c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:56.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.244+0000 7f6b50e609c0 20 Filter name: none 2024-09-14T11:33:56.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.244+0000 7f697dffb640 20 reqs_thread_entry: start 2024-09-14T11:33:56.244 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.244+0000 7f6b50e609c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:56.244 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.248+0000 7f6b50e609c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:56.245 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.248+0000 7f6b50e609c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:56.246 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.248+0000 7f6b50e609c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:56.246 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.248+0000 7f6b50e609c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:56.246 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.248+0000 7f6b50e609c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:56.247 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.248+0000 7f6b50e609c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:56.247 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.248+0000 7f6b50e609c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:56.248 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.248+0000 7f6b50e609c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:56.248 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.248+0000 7f6b50e609c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:56.251 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.252+0000 7f6a057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:56.255 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.256+0000 7f6b50e609c0 20 remove_watcher() i=0 2024-09-14T11:33:56.256 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.256+0000 7f6b50e609c0 2 removed watcher, disabling cache 2024-09-14T11:33:56.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.260+0000 7f6b50e609c0 20 remove_watcher() i=1 2024-09-14T11:33:56.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.260+0000 7f6b50e609c0 20 remove_watcher() i=2 2024-09-14T11:33:56.262 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.264+0000 7f6b50e609c0 20 remove_watcher() i=3 2024-09-14T11:33:56.264 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.264+0000 7f6b50e609c0 20 remove_watcher() i=4 2024-09-14T11:33:56.266 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.268+0000 7f6b50e609c0 20 remove_watcher() i=5 2024-09-14T11:33:56.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.272+0000 7f6b50e609c0 20 remove_watcher() i=6 2024-09-14T11:33:56.272 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.276+0000 7f6b50e609c0 20 remove_watcher() i=7 2024-09-14T11:33:56.289 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:56.289 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:33:56.289 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: abort-at-change-reshard-state id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.40 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:33:56.289 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:56.393 INFO:tasks.workunit.client.0.smithi071.stderr: test: logrecord could be stopped after reshard failed 2024-09-14T11:33:56.393 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:33:56.424 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:56.424 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:56.469 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.472+0000 7fc63a2f99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:56.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.472+0000 7fc63a2f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:56.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.472+0000 7fc63a2f99c0 20 realm 2024-09-14T11:33:56.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.472+0000 7fc63a2f99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:56.472 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.476+0000 7fc63a2f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:56.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.476+0000 7fc63a2f99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:56.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.476+0000 7fc63a2f99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:56.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.476+0000 7fc63a2f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:56.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.476+0000 7fc63a2f99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:56.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.476+0000 7fc63a2f99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:56.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.476+0000 7fc63a2f99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:56.475 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.476+0000 7fc63a2f99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:56.475 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.476+0000 7fc63a2f99c0 20 searching for the correct realm 2024-09-14T11:33:56.480 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.480+0000 7fc637dff640 0 -- 172.21.15.71:0/4231730703 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x5616e2332d90 msgr2=0x5616e2335250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:56.486 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.488+0000 7fc638600640 0 -- 172.21.15.71:0/4231730703 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x5616e232df80 msgr2=0x5616e2330370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:56.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.496+0000 7fc63a2f99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:56.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.496+0000 7fc63a2f99c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:33:56.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.496+0000 7fc63a2f99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:56.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.496+0000 7fc63a2f99c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:33:56.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.496+0000 7fc63a2f99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:56.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.496+0000 7fc63a2f99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:56.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.496+0000 7fc63a2f99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:56.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.496+0000 7fc63a2f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:56.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.496+0000 7fc63a2f99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:56.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.496+0000 7fc63a2f99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:56.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.496+0000 7fc63a2f99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:56.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.496+0000 7fc63a2f99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:56.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.496+0000 7fc63a2f99c0 20 zone default found 2024-09-14T11:33:56.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.496+0000 7fc63a2f99c0 4 Realm: () 2024-09-14T11:33:56.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.496+0000 7fc63a2f99c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:33:56.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.496+0000 7fc63a2f99c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:33:56.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.496+0000 7fc63a2f99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:56.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.496+0000 7fc63a2f99c0 20 zonegroup default 2024-09-14T11:33:56.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.496+0000 7fc63a2f99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:56.497 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.496+0000 7fc63a2f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:56.497 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.496+0000 7fc63a2f99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:56.497 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.500+0000 7fc63a2f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:56.497 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.500+0000 7fc63a2f99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:56.497 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.500+0000 7fc63a2f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:56.497 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.500+0000 7fc63a2f99c0 20 started sync module instance, tier type = 2024-09-14T11:33:56.497 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.500+0000 7fc63a2f99c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:33:56.515 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.516+0000 7fc63a2f99c0 20 add_watcher() i=0 2024-09-14T11:33:56.515 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.516+0000 7fc63a2f99c0 20 add_watcher() i=1 2024-09-14T11:33:56.515 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.516+0000 7fc63a2f99c0 20 add_watcher() i=2 2024-09-14T11:33:56.515 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.516+0000 7fc63a2f99c0 20 add_watcher() i=3 2024-09-14T11:33:56.515 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.516+0000 7fc63a2f99c0 20 add_watcher() i=4 2024-09-14T11:33:56.515 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.516+0000 7fc63a2f99c0 20 add_watcher() i=5 2024-09-14T11:33:56.515 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.516+0000 7fc63a2f99c0 20 add_watcher() i=6 2024-09-14T11:33:56.518 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.520+0000 7fc63a2f99c0 20 add_watcher() i=7 2024-09-14T11:33:56.518 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.520+0000 7fc63a2f99c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:56.521 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.524+0000 7fc4edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:56.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.524+0000 7fc63a2f99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:56.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.524+0000 7fc63a2f99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:56.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.524+0000 7fc63a2f99c0 5 note: GC not initialized 2024-09-14T11:33:56.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.524+0000 7fc4ecfe1640 20 reqs_thread_entry: start 2024-09-14T11:33:56.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.524+0000 7fc63a2f99c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:56.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.524+0000 7fc63a2f99c0 20 Filter name: none 2024-09-14T11:33:56.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.524+0000 7fc4667fc640 20 reqs_thread_entry: start 2024-09-14T11:33:56.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.524+0000 7fc63a2f99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:56.523 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.524+0000 7fc63a2f99c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:33:56.523 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.524+0000 7fc63a2f99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:56.523 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.524+0000 7fc63a2f99c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:33:56.523 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.524+0000 7fc63a2f99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:56.524 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.524+0000 7fc63a2f99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:56.524 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.524+0000 7fc63a2f99c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:33:56.524 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.524+0000 7fc63a2f99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:56.524 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.524+0000 7fc63a2f99c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:33:56.524 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.524+0000 7fc63a2f99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:56.526 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.528+0000 7fc4edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:56.530 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.532+0000 7fc63a2f99c0 20 remove_watcher() i=0 2024-09-14T11:33:56.530 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.532+0000 7fc63a2f99c0 2 removed watcher, disabling cache 2024-09-14T11:33:56.532 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.532+0000 7fc63a2f99c0 20 remove_watcher() i=1 2024-09-14T11:33:56.534 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.536+0000 7fc63a2f99c0 20 remove_watcher() i=2 2024-09-14T11:33:56.536 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.536+0000 7fc63a2f99c0 20 remove_watcher() i=3 2024-09-14T11:33:56.538 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.540+0000 7fc63a2f99c0 20 remove_watcher() i=4 2024-09-14T11:33:56.539 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.540+0000 7fc63a2f99c0 20 remove_watcher() i=5 2024-09-14T11:33:56.542 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.544+0000 7fc63a2f99c0 20 remove_watcher() i=6 2024-09-14T11:33:56.545 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.548+0000 7fc63a2f99c0 20 remove_watcher() i=7 2024-09-14T11:33:56.559 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:56.559 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:33:56.559 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: a-bucket id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.18 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-14T11:33:56.559 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:56.559 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:33:56.586 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:56.586 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:56.631 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.632+0000 7fbadb4219c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:56.633 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.636+0000 7fbadb4219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:56.633 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.636+0000 7fbadb4219c0 20 realm 2024-09-14T11:33:56.633 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.636+0000 7fbadb4219c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:56.634 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.636+0000 7fbadb4219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:56.634 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.636+0000 7fbadb4219c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:56.634 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.636+0000 7fbadb4219c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:56.634 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.636+0000 7fbadb4219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:56.634 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.636+0000 7fbadb4219c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:56.635 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.636+0000 7fbadb4219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:56.635 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.636+0000 7fbadb4219c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:56.636 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.636+0000 7fbadb4219c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:56.636 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.636+0000 7fbadb4219c0 20 searching for the correct realm 2024-09-14T11:33:56.639 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.640+0000 7fbad9728640 0 -- 172.21.15.71:0/757441595 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fbacc0c1040 msgr2=0x7fbacc0fdce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:56.852 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:56.852+0000 7fbad9728640 0 -- 172.21.15.71:0/757441595 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x560ff986df40 msgr2=0x560ff9870330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:57.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.072+0000 7fbadb4219c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:57.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.072+0000 7fbadb4219c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:33:57.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.072+0000 7fbadb4219c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:57.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.072+0000 7fbadb4219c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:33:57.073 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.072+0000 7fbadb4219c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:57.073 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.072+0000 7fbadb4219c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:57.073 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.072+0000 7fbadb4219c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.073 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.076+0000 7fbadb4219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.073 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.076+0000 7fbadb4219c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.074 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.076+0000 7fbadb4219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:57.074 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.076+0000 7fbadb4219c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.074 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.076+0000 7fbadb4219c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:57.074 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.076+0000 7fbadb4219c0 20 zone default found 2024-09-14T11:33:57.075 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.076+0000 7fbadb4219c0 4 Realm: () 2024-09-14T11:33:57.075 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.076+0000 7fbadb4219c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:33:57.075 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.076+0000 7fbadb4219c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:33:57.075 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.076+0000 7fbadb4219c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:57.075 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.076+0000 7fbadb4219c0 20 zonegroup default 2024-09-14T11:33:57.075 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.076+0000 7fbadb4219c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.075 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.076+0000 7fbadb4219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.075 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.076+0000 7fbadb4219c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.076 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.076+0000 7fbadb4219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.076 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.076+0000 7fbadb4219c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.077 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.080+0000 7fbadb4219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.077 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.080+0000 7fbadb4219c0 20 started sync module instance, tier type = 2024-09-14T11:33:57.077 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.080+0000 7fbadb4219c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:33:57.100 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.100+0000 7fbadb4219c0 20 add_watcher() i=0 2024-09-14T11:33:57.100 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.100+0000 7fbadb4219c0 20 add_watcher() i=1 2024-09-14T11:33:57.101 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.100+0000 7fbadb4219c0 20 add_watcher() i=2 2024-09-14T11:33:57.101 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.100+0000 7fbadb4219c0 20 add_watcher() i=3 2024-09-14T11:33:57.101 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.100+0000 7fbadb4219c0 20 add_watcher() i=4 2024-09-14T11:33:57.101 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.104+0000 7fbadb4219c0 20 add_watcher() i=5 2024-09-14T11:33:57.104 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.104+0000 7fbadb4219c0 20 add_watcher() i=6 2024-09-14T11:33:57.106 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.108+0000 7fbadb4219c0 20 add_watcher() i=7 2024-09-14T11:33:57.106 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.108+0000 7fbadb4219c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:57.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.112+0000 7fb98efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:57.111 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.112+0000 7fbadb4219c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:57.111 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.112+0000 7fbadb4219c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:57.111 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.112+0000 7fbadb4219c0 5 note: GC not initialized 2024-09-14T11:33:57.112 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.112+0000 7fb98dfe3640 20 reqs_thread_entry: start 2024-09-14T11:33:57.112 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.112+0000 7fbadb4219c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:57.113 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.116+0000 7fbadb4219c0 20 Filter name: none 2024-09-14T11:33:57.113 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.116+0000 7fb8ff7fe640 20 reqs_thread_entry: start 2024-09-14T11:33:57.113 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.116+0000 7fbadb4219c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.113 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.116+0000 7fbadb4219c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:33:57.113 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.116+0000 7fbadb4219c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.114 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.116+0000 7fbadb4219c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:33:57.114 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.116+0000 7fbadb4219c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:57.114 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.116+0000 7fbadb4219c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.115 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.116+0000 7fbadb4219c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:33:57.115 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.116+0000 7fbadb4219c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.115 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.116+0000 7fbadb4219c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:33:57.116 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.116+0000 7fbadb4219c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:57.119 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.120+0000 7fb98efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:57.124 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.124+0000 7fbadb4219c0 20 remove_watcher() i=0 2024-09-14T11:33:57.124 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.124+0000 7fbadb4219c0 2 removed watcher, disabling cache 2024-09-14T11:33:57.128 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.132+0000 7fbadb4219c0 20 remove_watcher() i=1 2024-09-14T11:33:57.130 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.132+0000 7fbadb4219c0 20 remove_watcher() i=2 2024-09-14T11:33:57.133 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.136+0000 7fbadb4219c0 20 remove_watcher() i=3 2024-09-14T11:33:57.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.136+0000 7fbadb4219c0 20 remove_watcher() i=4 2024-09-14T11:33:57.137 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.140+0000 7fbadb4219c0 20 remove_watcher() i=5 2024-09-14T11:33:57.140 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.140+0000 7fbadb4219c0 20 remove_watcher() i=6 2024-09-14T11:33:57.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.144+0000 7fbadb4219c0 20 remove_watcher() i=7 2024-09-14T11:33:57.158 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-14T11:33:57.190 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:57.190 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:57.233 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.236+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.236 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.236+0000 7f85ce9089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.236 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.236+0000 7f85ce9089c0 20 realm 2024-09-14T11:33:57.236 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.236+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.236 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.236+0000 7f85ce9089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.236 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.236+0000 7f85ce9089c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:57.237 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.236+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.237 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.240+0000 7f85ce9089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.237 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.240+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.238 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.240+0000 7f85ce9089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:57.238 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.240+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.238 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.240+0000 7f85ce9089c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:57.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.240+0000 7f85ce9089c0 20 searching for the correct realm 2024-09-14T11:33:57.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.244+0000 7f85cc40e640 0 -- 172.21.15.71:0/3711081096 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x55750e2b01c0 msgr2=0x55750e2b2680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:57.249 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.252+0000 7f85ccc0f640 0 -- 172.21.15.71:0/3711081096 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55750e2ab420 msgr2=0x55750e2ad810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:57.257 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:57.257 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:33:57.257 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:57.257 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:33:57.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:57.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:57.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.258 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:57.259 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.259 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:57.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 zone default found 2024-09-14T11:33:57.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.260+0000 7f85ce9089c0 4 Realm: () 2024-09-14T11:33:57.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.260+0000 7f85ce9089c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:33:57.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.260+0000 7f85ce9089c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:33:57.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.260+0000 7f85ce9089c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:57.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 zonegroup default 2024-09-14T11:33:57.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.260 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.261 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.264+0000 7f85ce9089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.261 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.264+0000 7f85ce9089c0 20 started sync module instance, tier type = 2024-09-14T11:33:57.261 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.264+0000 7f85ce9089c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:33:57.286 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.288+0000 7f85ce9089c0 20 add_watcher() i=0 2024-09-14T11:33:57.286 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.288+0000 7f85ce9089c0 20 add_watcher() i=1 2024-09-14T11:33:57.287 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.288+0000 7f85ce9089c0 20 add_watcher() i=2 2024-09-14T11:33:57.287 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.288+0000 7f85ce9089c0 20 add_watcher() i=3 2024-09-14T11:33:57.287 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.288+0000 7f85ce9089c0 20 add_watcher() i=4 2024-09-14T11:33:57.287 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.288+0000 7f85ce9089c0 20 add_watcher() i=5 2024-09-14T11:33:57.287 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.288+0000 7f85ce9089c0 20 add_watcher() i=6 2024-09-14T11:33:57.289 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.292+0000 7f85ce9089c0 20 add_watcher() i=7 2024-09-14T11:33:57.289 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.292+0000 7f85ce9089c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:57.293 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.296+0000 7f8482fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:57.294 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.296+0000 7f85ce9089c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:57.294 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.296+0000 7f85ce9089c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:57.294 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 note: GC not initialized 2024-09-14T11:33:57.294 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.296+0000 7f8481fe3640 20 reqs_thread_entry: start 2024-09-14T11:33:57.294 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.296+0000 7f85ce9089c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:57.294 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.296+0000 7f85ce9089c0 20 Filter name: none 2024-09-14T11:33:57.294 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.296+0000 7f847affd640 20 reqs_thread_entry: start 2024-09-14T11:33:57.294 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.296+0000 7f85ce9089c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:33:57.294 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.296+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.295 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.296+0000 7f85ce9089c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:33:57.295 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.296+0000 7f85ce9089c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:33:57.295 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.296+0000 7f85ce9089c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:33:57.295 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.296+0000 7f85ce9089c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 : miss 2024-09-14T11:33:57.295 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.296+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.295 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.296+0000 7f85ce9089c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:33:57.295 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.296+0000 7f85ce9089c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:33:57.295 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.296+0000 7f85ce9089c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:33:57.295 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.296+0000 7f85ce9089c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:57.295 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.296+0000 7f85ce9089c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:33:57.296 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.296+0000 7f85ce9089c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 2024-09-14T11:33:57.305 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.308+0000 7f85ce9089c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:33:57.305 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.308+0000 7f85ce9089c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:33:57.305 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.308+0000 7f85ce9089c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:33:57.305 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.308+0000 7f85ce9089c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18, ofs0, ns] 2024-09-14T11:33:57.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.308+0000 7f84aaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464424 cookie 93961237241296 notifier 7649 bl.length()=911 2024-09-14T11:33:57.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.308+0000 7f84aaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:33:57.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.308+0000 7f84aaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:33:57.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.308+0000 7f84aaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:33:57.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.308+0000 7f85ce9089c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_sources= new_sources= 2024-09-14T11:33:57.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.308+0000 7f85ce9089c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential sources added=[] removed=[] 2024-09-14T11:33:57.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.308+0000 7f85ce9089c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_dests= new_dests= 2024-09-14T11:33:57.306 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.308+0000 7f85ce9089c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential dests added=[] removed=[] 2024-09-14T11:33:57.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.0 2024-09-14T11:33:57.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.0 2024-09-14T11:33:57.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.1 2024-09-14T11:33:57.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.1 2024-09-14T11:33:57.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.2 2024-09-14T11:33:57.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.2 2024-09-14T11:33:57.317 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.3 2024-09-14T11:33:57.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.3 2024-09-14T11:33:57.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.4 2024-09-14T11:33:57.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.4 2024-09-14T11:33:57.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.5 2024-09-14T11:33:57.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.5 2024-09-14T11:33:57.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.6 2024-09-14T11:33:57.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.6 2024-09-14T11:33:57.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.7 2024-09-14T11:33:57.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.7 2024-09-14T11:33:57.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.8 2024-09-14T11:33:57.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.8 2024-09-14T11:33:57.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.9 2024-09-14T11:33:57.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.9 2024-09-14T11:33:57.318 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.10 2024-09-14T11:33:57.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.10 2024-09-14T11:33:57.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.11 2024-09-14T11:33:57.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.11 2024-09-14T11:33:57.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.12 2024-09-14T11:33:57.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.12 2024-09-14T11:33:57.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.13 2024-09-14T11:33:57.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.13 2024-09-14T11:33:57.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.0 2024-09-14T11:33:57.319 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.0 2024-09-14T11:33:57.320 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.1 2024-09-14T11:33:57.320 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.1 2024-09-14T11:33:57.320 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.2 2024-09-14T11:33:57.320 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.2 2024-09-14T11:33:57.320 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.3 2024-09-14T11:33:57.320 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.3 2024-09-14T11:33:57.320 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.4 2024-09-14T11:33:57.321 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.4 2024-09-14T11:33:57.321 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.5 2024-09-14T11:33:57.321 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.5 2024-09-14T11:33:57.321 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.324+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.6 2024-09-14T11:33:57.321 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.324+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.6 2024-09-14T11:33:57.322 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.324+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.7 2024-09-14T11:33:57.322 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.324+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.7 2024-09-14T11:33:57.322 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.324+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.8 2024-09-14T11:33:57.322 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.324+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.8 2024-09-14T11:33:57.323 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.324+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.9 2024-09-14T11:33:57.323 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.324+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.9 2024-09-14T11:33:57.324 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.324+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.10 2024-09-14T11:33:57.324 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.324+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.10 2024-09-14T11:33:57.325 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.328+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.11 2024-09-14T11:33:57.325 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.328+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.11 2024-09-14T11:33:57.326 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.328+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.12 2024-09-14T11:33:57.326 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.328+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.12 2024-09-14T11:33:57.331 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f85ce9089c0 time 2024-09-14T11:33:57.336638+0000 2024-09-14T11:33:57.331 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:33:57.332 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:57.332 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f85d21e22eb] 2024-09-14T11:33:57.332 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f85d21e249f] 2024-09-14T11:33:57.332 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55750cc76c01] 2024-09-14T11:33:57.332 INFO:tasks.workunit.client.0.smithi071.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55750cc8b231] 2024-09-14T11:33:57.332 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55750cc8c884] 2024-09-14T11:33:57.332 INFO:tasks.workunit.client.0.smithi071.stderr: 6: main() 2024-09-14T11:33:57.332 INFO:tasks.workunit.client.0.smithi071.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f85d1048d90] 2024-09-14T11:33:57.332 INFO:tasks.workunit.client.0.smithi071.stderr: 8: __libc_start_main() 2024-09-14T11:33:57.333 INFO:tasks.workunit.client.0.smithi071.stderr: 9: _start() 2024-09-14T11:33:57.333 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.332+0000 7f85ce9089c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f85ce9089c0 time 2024-09-14T11:33:57.336638+0000 2024-09-14T11:33:57.333 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:33:57.333 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:57.333 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:57.333 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f85d21e22eb] 2024-09-14T11:33:57.333 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f85d21e249f] 2024-09-14T11:33:57.333 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55750cc76c01] 2024-09-14T11:33:57.333 INFO:tasks.workunit.client.0.smithi071.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55750cc8b231] 2024-09-14T11:33:57.333 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55750cc8c884] 2024-09-14T11:33:57.333 INFO:tasks.workunit.client.0.smithi071.stderr: 6: main() 2024-09-14T11:33:57.333 INFO:tasks.workunit.client.0.smithi071.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f85d1048d90] 2024-09-14T11:33:57.333 INFO:tasks.workunit.client.0.smithi071.stderr: 8: __libc_start_main() 2024-09-14T11:33:57.334 INFO:tasks.workunit.client.0.smithi071.stderr: 9: _start() 2024-09-14T11:33:57.334 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:57.334 INFO:tasks.workunit.client.0.smithi071.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:33:57.334 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f85ce9089c0 thread_name:radosgw-admin 2024-09-14T11:33:57.350 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:57.350 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f85d1061520] 2024-09-14T11:33:57.350 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:33:57.351 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:33:57.351 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:33:57.351 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f85d21e2345] 2024-09-14T11:33:57.351 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f85d21e249f] 2024-09-14T11:33:57.351 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55750cc76c01] 2024-09-14T11:33:57.351 INFO:tasks.workunit.client.0.smithi071.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55750cc8b231] 2024-09-14T11:33:57.351 INFO:tasks.workunit.client.0.smithi071.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55750cc8c884] 2024-09-14T11:33:57.351 INFO:tasks.workunit.client.0.smithi071.stderr: 10: main() 2024-09-14T11:33:57.351 INFO:tasks.workunit.client.0.smithi071.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f85d1048d90] 2024-09-14T11:33:57.351 INFO:tasks.workunit.client.0.smithi071.stderr: 12: __libc_start_main() 2024-09-14T11:33:57.351 INFO:tasks.workunit.client.0.smithi071.stderr: 13: _start() 2024-09-14T11:33:57.351 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.336+0000 7f85ce9089c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:33:57.351 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f85ce9089c0 thread_name:radosgw-admin 2024-09-14T11:33:57.352 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:57.352 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:57.352 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f85d1061520] 2024-09-14T11:33:57.352 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:33:57.352 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:33:57.352 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:33:57.352 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f85d21e2345] 2024-09-14T11:33:57.352 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f85d21e249f] 2024-09-14T11:33:57.352 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55750cc76c01] 2024-09-14T11:33:57.352 INFO:tasks.workunit.client.0.smithi071.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55750cc8b231] 2024-09-14T11:33:57.352 INFO:tasks.workunit.client.0.smithi071.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55750cc8c884] 2024-09-14T11:33:57.353 INFO:tasks.workunit.client.0.smithi071.stderr: 10: main() 2024-09-14T11:33:57.353 INFO:tasks.workunit.client.0.smithi071.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f85d1048d90] 2024-09-14T11:33:57.353 INFO:tasks.workunit.client.0.smithi071.stderr: 12: __libc_start_main() 2024-09-14T11:33:57.353 INFO:tasks.workunit.client.0.smithi071.stderr: 13: _start() 2024-09-14T11:33:57.353 INFO:tasks.workunit.client.0.smithi071.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:33:57.353 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:57.353 INFO:tasks.workunit.client.0.smithi071.stderr:--- begin dump of recent events --- 2024-09-14T11:33:57.353 INFO:tasks.workunit.client.0.smithi071.stderr: -499> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 5 AuthRegistry(0x55750e1b71b0) adding con mode: crc 2024-09-14T11:33:57.353 INFO:tasks.workunit.client.0.smithi071.stderr: -498> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 5 AuthRegistry(0x55750e1b71b0) adding con mode: secure 2024-09-14T11:33:57.353 INFO:tasks.workunit.client.0.smithi071.stderr: -497> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:57.353 INFO:tasks.workunit.client.0.smithi071.stderr: -496> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:57.353 INFO:tasks.workunit.client.0.smithi071.stderr: -495> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 5 asok(0x55750dfa9d90) register_command rotate-key hook 0x55750e1b72f8 2024-09-14T11:33:57.353 INFO:tasks.workunit.client.0.smithi071.stderr: -494> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 10 monclient: _reopen_session rank -1 2024-09-14T11:33:57.354 INFO:tasks.workunit.client.0.smithi071.stderr: -493> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:33:57.354 INFO:tasks.workunit.client.0.smithi071.stderr: -492> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 10 monclient(hunting): picked mon.noname-a con 0x55750e043ac0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:33:57.354 INFO:tasks.workunit.client.0.smithi071.stderr: -491> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 10 monclient(hunting): picked mon.noname-c con 0x55750e044870 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:33:57.354 INFO:tasks.workunit.client.0.smithi071.stderr: -490> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 10 monclient(hunting): picked mon.noname-b con 0x55750e0fd6b0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:33:57.354 INFO:tasks.workunit.client.0.smithi071.stderr: -489> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:57.354 INFO:tasks.workunit.client.0.smithi071.stderr: -488> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:57.354 INFO:tasks.workunit.client.0.smithi071.stderr: -487> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:57.354 INFO:tasks.workunit.client.0.smithi071.stderr: -486> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 10 monclient(hunting): _renew_subs 2024-09-14T11:33:57.354 INFO:tasks.workunit.client.0.smithi071.stderr: -485> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 10 monclient(hunting): authenticate will time out at 2449.337179s 2024-09-14T11:33:57.354 INFO:tasks.workunit.client.0.smithi071.stderr: -484> 2024-09-14T11:33:57.216+0000 7f85cc40e640 10 monclient(hunting): get_auth_request con 0x55750e043ac0 auth_method 0 2024-09-14T11:33:57.354 INFO:tasks.workunit.client.0.smithi071.stderr: -483> 2024-09-14T11:33:57.216+0000 7f85cc40e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:57.354 INFO:tasks.workunit.client.0.smithi071.stderr: -482> 2024-09-14T11:33:57.216+0000 7f85cc40e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:57.354 INFO:tasks.workunit.client.0.smithi071.stderr: -481> 2024-09-14T11:33:57.216+0000 7f85cc40e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:57.354 INFO:tasks.workunit.client.0.smithi071.stderr: -480> 2024-09-14T11:33:57.216+0000 7f85cbc0d640 10 monclient(hunting): get_auth_request con 0x55750e044870 auth_method 0 2024-09-14T11:33:57.354 INFO:tasks.workunit.client.0.smithi071.stderr: -479> 2024-09-14T11:33:57.216+0000 7f85cbc0d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:57.355 INFO:tasks.workunit.client.0.smithi071.stderr: -478> 2024-09-14T11:33:57.216+0000 7f85cbc0d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:57.355 INFO:tasks.workunit.client.0.smithi071.stderr: -477> 2024-09-14T11:33:57.216+0000 7f85cbc0d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:57.355 INFO:tasks.workunit.client.0.smithi071.stderr: -476> 2024-09-14T11:33:57.216+0000 7f85cbc0d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:57.355 INFO:tasks.workunit.client.0.smithi071.stderr: -475> 2024-09-14T11:33:57.216+0000 7f85cbc0d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:57.355 INFO:tasks.workunit.client.0.smithi071.stderr: -474> 2024-09-14T11:33:57.216+0000 7f85cbc0d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:57.355 INFO:tasks.workunit.client.0.smithi071.stderr: -473> 2024-09-14T11:33:57.216+0000 7f85cc40e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:57.355 INFO:tasks.workunit.client.0.smithi071.stderr: -472> 2024-09-14T11:33:57.216+0000 7f85cc40e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:57.355 INFO:tasks.workunit.client.0.smithi071.stderr: -471> 2024-09-14T11:33:57.216+0000 7f85cc40e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:57.355 INFO:tasks.workunit.client.0.smithi071.stderr: -470> 2024-09-14T11:33:57.216+0000 7f85cbc0d640 10 monclient(hunting): handle_auth_done global_id 7640 payload 824 2024-09-14T11:33:57.355 INFO:tasks.workunit.client.0.smithi071.stderr: -469> 2024-09-14T11:33:57.216+0000 7f85cbc0d640 10 monclient: _finish_hunting 0 2024-09-14T11:33:57.355 INFO:tasks.workunit.client.0.smithi071.stderr: -468> 2024-09-14T11:33:57.216+0000 7f85cbc0d640 1 monclient: found mon.noname-c 2024-09-14T11:33:57.355 INFO:tasks.workunit.client.0.smithi071.stderr: -467> 2024-09-14T11:33:57.216+0000 7f85cbc0d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:33:57.355 INFO:tasks.workunit.client.0.smithi071.stderr: -466> 2024-09-14T11:33:57.216+0000 7f84b8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:57.355 INFO:tasks.workunit.client.0.smithi071.stderr: -465> 2024-09-14T11:33:57.216+0000 7f84b8e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:57.355 INFO:tasks.workunit.client.0.smithi071.stderr: -464> 2024-09-14T11:33:57.216+0000 7f84b8e09640 10 monclient: dump: 2024-09-14T11:33:57.355 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:33:57.356 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:33:57.356 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:57.356 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:57.356 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:57.356 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:57.356 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:33:57.356 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:33:57.356 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:33:57.356 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:57.356 INFO:tasks.workunit.client.0.smithi071.stderr: -463> 2024-09-14T11:33:57.216+0000 7f84b8e09640 10 monclient: _finish_auth 0 2024-09-14T11:33:57.356 INFO:tasks.workunit.client.0.smithi071.stderr: -462> 2024-09-14T11:33:57.216+0000 7f84b8e09640 10 monclient: _check_auth_tickets 2024-09-14T11:33:57.356 INFO:tasks.workunit.client.0.smithi071.stderr: -461> 2024-09-14T11:33:57.216+0000 7f84b8e09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:57.356 INFO:tasks.workunit.client.0.smithi071.stderr: -460> 2024-09-14T11:33:57.216+0000 7f84b8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:57.357 INFO:tasks.workunit.client.0.smithi071.stderr: -459> 2024-09-14T11:33:57.216+0000 7f84b8e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:57.357 INFO:tasks.workunit.client.0.smithi071.stderr: -458> 2024-09-14T11:33:57.216+0000 7f84b8e09640 10 monclient: dump: 2024-09-14T11:33:57.357 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:33:57.357 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:33:57.357 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:57.357 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:57.357 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:57.357 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:57.357 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:33:57.357 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:33:57.357 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:33:57.357 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:57.357 INFO:tasks.workunit.client.0.smithi071.stderr: -457> 2024-09-14T11:33:57.216+0000 7f84ba60c640 4 set_mon_vals no callback set 2024-09-14T11:33:57.357 INFO:tasks.workunit.client.0.smithi071.stderr: -456> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 5 monclient: authenticate success, global_id 7640 2024-09-14T11:33:57.357 INFO:tasks.workunit.client.0.smithi071.stderr: -455> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 10 monclient: _renew_subs 2024-09-14T11:33:57.358 INFO:tasks.workunit.client.0.smithi071.stderr: -454> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:33:57.358 INFO:tasks.workunit.client.0.smithi071.stderr: -453> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 10 monclient: _renew_subs 2024-09-14T11:33:57.358 INFO:tasks.workunit.client.0.smithi071.stderr: -452> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:33:57.358 INFO:tasks.workunit.client.0.smithi071.stderr: -451> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 1 librados: init done 2024-09-14T11:33:57.358 INFO:tasks.workunit.client.0.smithi071.stderr: -450> 2024-09-14T11:33:57.220+0000 7f84b8e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:57.358 INFO:tasks.workunit.client.0.smithi071.stderr: -449> 2024-09-14T11:33:57.220+0000 7f84b8e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:33:57.358 INFO:tasks.workunit.client.0.smithi071.stderr: -448> 2024-09-14T11:33:57.220+0000 7f84b8e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:33:57.358 INFO:tasks.workunit.client.0.smithi071.stderr: -447> 2024-09-14T11:33:57.220+0000 7f85cc40e640 10 monclient: get_auth_request con 0x7f84b40718d0 auth_method 0 2024-09-14T11:33:57.358 INFO:tasks.workunit.client.0.smithi071.stderr: -446> 2024-09-14T11:33:57.220+0000 7f85ccc0f640 10 monclient: get_auth_request con 0x55750e1f71d0 auth_method 0 2024-09-14T11:33:57.358 INFO:tasks.workunit.client.0.smithi071.stderr: -445> 2024-09-14T11:33:57.220+0000 7f85cc40e640 10 monclient: get_auth_request con 0x55750e201a70 auth_method 0 2024-09-14T11:33:57.358 INFO:tasks.workunit.client.0.smithi071.stderr: -444> 2024-09-14T11:33:57.220+0000 7f85cbc0d640 10 monclient: get_auth_request con 0x55750e206140 auth_method 0 2024-09-14T11:33:57.358 INFO:tasks.workunit.client.0.smithi071.stderr: -443> 2024-09-14T11:33:57.224+0000 7f85ccc0f640 10 monclient: get_auth_request con 0x55750e205850 auth_method 0 2024-09-14T11:33:57.358 INFO:tasks.workunit.client.0.smithi071.stderr: -442> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 10 monclient: build_initial_monmap 2024-09-14T11:33:57.358 INFO:tasks.workunit.client.0.smithi071.stderr: -441> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 1 build_initial for_mkfs: 0 2024-09-14T11:33:57.358 INFO:tasks.workunit.client.0.smithi071.stderr: -440> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 10 monclient: monmap: 2024-09-14T11:33:57.359 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:33:57.359 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:57.359 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:33:57.359 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:33:57.359 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:57.359 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:57.359 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:33:57.359 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:33:57.359 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:33:57.359 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:57.359 INFO:tasks.workunit.client.0.smithi071.stderr: -439> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20e1a0) adding auth protocol: cephx 2024-09-14T11:33:57.359 INFO:tasks.workunit.client.0.smithi071.stderr: -438> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20e1a0) adding auth protocol: cephx 2024-09-14T11:33:57.359 INFO:tasks.workunit.client.0.smithi071.stderr: -437> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20e1a0) adding auth protocol: cephx 2024-09-14T11:33:57.359 INFO:tasks.workunit.client.0.smithi071.stderr: -436> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20e1a0) adding con mode: secure 2024-09-14T11:33:57.359 INFO:tasks.workunit.client.0.smithi071.stderr: -435> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20e1a0) adding con mode: crc 2024-09-14T11:33:57.360 INFO:tasks.workunit.client.0.smithi071.stderr: -434> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20e1a0) adding con mode: secure 2024-09-14T11:33:57.360 INFO:tasks.workunit.client.0.smithi071.stderr: -433> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20e1a0) adding con mode: crc 2024-09-14T11:33:57.360 INFO:tasks.workunit.client.0.smithi071.stderr: -432> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20e1a0) adding con mode: secure 2024-09-14T11:33:57.360 INFO:tasks.workunit.client.0.smithi071.stderr: -431> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20e1a0) adding con mode: crc 2024-09-14T11:33:57.360 INFO:tasks.workunit.client.0.smithi071.stderr: -430> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20e1a0) adding con mode: crc 2024-09-14T11:33:57.360 INFO:tasks.workunit.client.0.smithi071.stderr: -429> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20e1a0) adding con mode: secure 2024-09-14T11:33:57.360 INFO:tasks.workunit.client.0.smithi071.stderr: -428> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20e1a0) adding con mode: crc 2024-09-14T11:33:57.360 INFO:tasks.workunit.client.0.smithi071.stderr: -427> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20e1a0) adding con mode: secure 2024-09-14T11:33:57.360 INFO:tasks.workunit.client.0.smithi071.stderr: -426> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20e1a0) adding con mode: crc 2024-09-14T11:33:57.360 INFO:tasks.workunit.client.0.smithi071.stderr: -425> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20e1a0) adding con mode: secure 2024-09-14T11:33:57.360 INFO:tasks.workunit.client.0.smithi071.stderr: -424> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:57.360 INFO:tasks.workunit.client.0.smithi071.stderr: -423> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 asok(0x55750dfa9d90) register_command objecter_requests cmddesc objecter_requests hook 0x55750e211b30 EEXIST 2024-09-14T11:33:57.360 INFO:tasks.workunit.client.0.smithi071.stderr: -422> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 10 monclient: init 2024-09-14T11:33:57.360 INFO:tasks.workunit.client.0.smithi071.stderr: -421> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20d098) adding auth protocol: cephx 2024-09-14T11:33:57.361 INFO:tasks.workunit.client.0.smithi071.stderr: -420> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20d098) adding auth protocol: cephx 2024-09-14T11:33:57.361 INFO:tasks.workunit.client.0.smithi071.stderr: -419> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20d098) adding auth protocol: cephx 2024-09-14T11:33:57.361 INFO:tasks.workunit.client.0.smithi071.stderr: -418> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20d098) adding con mode: secure 2024-09-14T11:33:57.361 INFO:tasks.workunit.client.0.smithi071.stderr: -417> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20d098) adding con mode: crc 2024-09-14T11:33:57.361 INFO:tasks.workunit.client.0.smithi071.stderr: -416> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20d098) adding con mode: secure 2024-09-14T11:33:57.361 INFO:tasks.workunit.client.0.smithi071.stderr: -415> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20d098) adding con mode: crc 2024-09-14T11:33:57.361 INFO:tasks.workunit.client.0.smithi071.stderr: -414> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20d098) adding con mode: secure 2024-09-14T11:33:57.361 INFO:tasks.workunit.client.0.smithi071.stderr: -413> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20d098) adding con mode: crc 2024-09-14T11:33:57.361 INFO:tasks.workunit.client.0.smithi071.stderr: -412> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20d098) adding con mode: crc 2024-09-14T11:33:57.361 INFO:tasks.workunit.client.0.smithi071.stderr: -411> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20d098) adding con mode: secure 2024-09-14T11:33:57.361 INFO:tasks.workunit.client.0.smithi071.stderr: -410> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20d098) adding con mode: crc 2024-09-14T11:33:57.361 INFO:tasks.workunit.client.0.smithi071.stderr: -409> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20d098) adding con mode: secure 2024-09-14T11:33:57.361 INFO:tasks.workunit.client.0.smithi071.stderr: -408> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20d098) adding con mode: crc 2024-09-14T11:33:57.361 INFO:tasks.workunit.client.0.smithi071.stderr: -407> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20d098) adding con mode: secure 2024-09-14T11:33:57.362 INFO:tasks.workunit.client.0.smithi071.stderr: -406> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:57.362 INFO:tasks.workunit.client.0.smithi071.stderr: -405> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:57.362 INFO:tasks.workunit.client.0.smithi071.stderr: -404> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 asok(0x55750dfa9d90) register_command rotate-key cmddesc rotate-key hook 0x55750e20d1e0 EEXIST 2024-09-14T11:33:57.362 INFO:tasks.workunit.client.0.smithi071.stderr: -403> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 10 monclient: _reopen_session rank -1 2024-09-14T11:33:57.362 INFO:tasks.workunit.client.0.smithi071.stderr: -402> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:33:57.362 INFO:tasks.workunit.client.0.smithi071.stderr: -401> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 10 monclient(hunting): picked mon.noname-b con 0x55750e235ce0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:33:57.362 INFO:tasks.workunit.client.0.smithi071.stderr: -400> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 10 monclient(hunting): picked mon.noname-a con 0x55750e235610 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:33:57.362 INFO:tasks.workunit.client.0.smithi071.stderr: -399> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 10 monclient(hunting): picked mon.noname-c con 0x55750e233ff0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:33:57.362 INFO:tasks.workunit.client.0.smithi071.stderr: -398> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:57.362 INFO:tasks.workunit.client.0.smithi071.stderr: -397> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:57.362 INFO:tasks.workunit.client.0.smithi071.stderr: -396> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:57.362 INFO:tasks.workunit.client.0.smithi071.stderr: -395> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 10 monclient(hunting): _renew_subs 2024-09-14T11:33:57.362 INFO:tasks.workunit.client.0.smithi071.stderr: -394> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 10 monclient(hunting): authenticate will time out at 2449.347742s 2024-09-14T11:33:57.362 INFO:tasks.workunit.client.0.smithi071.stderr: -393> 2024-09-14T11:33:57.224+0000 7f85cc40e640 10 monclient(hunting): get_auth_request con 0x55750e233ff0 auth_method 0 2024-09-14T11:33:57.363 INFO:tasks.workunit.client.0.smithi071.stderr: -392> 2024-09-14T11:33:57.224+0000 7f85cc40e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:57.363 INFO:tasks.workunit.client.0.smithi071.stderr: -391> 2024-09-14T11:33:57.224+0000 7f85cc40e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:57.363 INFO:tasks.workunit.client.0.smithi071.stderr: -390> 2024-09-14T11:33:57.224+0000 7f85cc40e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:57.363 INFO:tasks.workunit.client.0.smithi071.stderr: -389> 2024-09-14T11:33:57.224+0000 7f85ccc0f640 10 monclient(hunting): get_auth_request con 0x55750e235610 auth_method 0 2024-09-14T11:33:57.363 INFO:tasks.workunit.client.0.smithi071.stderr: -388> 2024-09-14T11:33:57.224+0000 7f85ccc0f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:57.363 INFO:tasks.workunit.client.0.smithi071.stderr: -387> 2024-09-14T11:33:57.224+0000 7f85ccc0f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:57.363 INFO:tasks.workunit.client.0.smithi071.stderr: -386> 2024-09-14T11:33:57.224+0000 7f85ccc0f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:57.363 INFO:tasks.workunit.client.0.smithi071.stderr: -385> 2024-09-14T11:33:57.228+0000 7f85cc40e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:57.363 INFO:tasks.workunit.client.0.smithi071.stderr: -384> 2024-09-14T11:33:57.228+0000 7f85cc40e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:57.363 INFO:tasks.workunit.client.0.smithi071.stderr: -383> 2024-09-14T11:33:57.228+0000 7f85cc40e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:57.363 INFO:tasks.workunit.client.0.smithi071.stderr: -382> 2024-09-14T11:33:57.228+0000 7f85cbc0d640 10 monclient(hunting): get_auth_request con 0x55750e235ce0 auth_method 0 2024-09-14T11:33:57.363 INFO:tasks.workunit.client.0.smithi071.stderr: -381> 2024-09-14T11:33:57.228+0000 7f85cbc0d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:57.363 INFO:tasks.workunit.client.0.smithi071.stderr: -380> 2024-09-14T11:33:57.228+0000 7f85cbc0d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:57.363 INFO:tasks.workunit.client.0.smithi071.stderr: -379> 2024-09-14T11:33:57.228+0000 7f85cbc0d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:57.364 INFO:tasks.workunit.client.0.smithi071.stderr: -378> 2024-09-14T11:33:57.228+0000 7f85ccc0f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:57.364 INFO:tasks.workunit.client.0.smithi071.stderr: -377> 2024-09-14T11:33:57.228+0000 7f85ccc0f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:57.364 INFO:tasks.workunit.client.0.smithi071.stderr: -376> 2024-09-14T11:33:57.228+0000 7f85ccc0f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:57.364 INFO:tasks.workunit.client.0.smithi071.stderr: -375> 2024-09-14T11:33:57.228+0000 7f85cc40e640 10 monclient(hunting): handle_auth_done global_id 7643 payload 824 2024-09-14T11:33:57.364 INFO:tasks.workunit.client.0.smithi071.stderr: -374> 2024-09-14T11:33:57.228+0000 7f85cc40e640 10 monclient: _finish_hunting 0 2024-09-14T11:33:57.364 INFO:tasks.workunit.client.0.smithi071.stderr: -373> 2024-09-14T11:33:57.228+0000 7f85cc40e640 1 monclient: found mon.noname-c 2024-09-14T11:33:57.364 INFO:tasks.workunit.client.0.smithi071.stderr: -372> 2024-09-14T11:33:57.228+0000 7f85cc40e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:33:57.364 INFO:tasks.workunit.client.0.smithi071.stderr: -371> 2024-09-14T11:33:57.228+0000 7f84b1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:57.364 INFO:tasks.workunit.client.0.smithi071.stderr: -370> 2024-09-14T11:33:57.228+0000 7f84b1ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:57.364 INFO:tasks.workunit.client.0.smithi071.stderr: -369> 2024-09-14T11:33:57.228+0000 7f84b1ffb640 10 monclient: dump: 2024-09-14T11:33:57.364 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:33:57.364 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:33:57.364 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:57.365 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:57.365 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:57.365 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:57.365 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:33:57.365 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:33:57.365 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:33:57.365 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:57.365 INFO:tasks.workunit.client.0.smithi071.stderr: -368> 2024-09-14T11:33:57.228+0000 7f84b1ffb640 10 monclient: _finish_auth 0 2024-09-14T11:33:57.365 INFO:tasks.workunit.client.0.smithi071.stderr: -367> 2024-09-14T11:33:57.228+0000 7f84b1ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:33:57.365 INFO:tasks.workunit.client.0.smithi071.stderr: -366> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 monclient: authenticate success, global_id 7643 2024-09-14T11:33:57.365 INFO:tasks.workunit.client.0.smithi071.stderr: -365> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 10 monclient: _renew_subs 2024-09-14T11:33:57.365 INFO:tasks.workunit.client.0.smithi071.stderr: -364> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:33:57.365 INFO:tasks.workunit.client.0.smithi071.stderr: -363> 2024-09-14T11:33:57.228+0000 7f84b1ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:57.365 INFO:tasks.workunit.client.0.smithi071.stderr: -362> 2024-09-14T11:33:57.228+0000 7f84b1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:57.365 INFO:tasks.workunit.client.0.smithi071.stderr: -361> 2024-09-14T11:33:57.228+0000 7f84b1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:57.366 INFO:tasks.workunit.client.0.smithi071.stderr: -360> 2024-09-14T11:33:57.228+0000 7f84b1ffb640 10 monclient: dump: 2024-09-14T11:33:57.366 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:33:57.366 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:33:57.366 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:57.366 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:57.366 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:57.366 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:57.366 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:33:57.366 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:33:57.366 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:33:57.366 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:57.366 INFO:tasks.workunit.client.0.smithi071.stderr: -359> 2024-09-14T11:33:57.228+0000 7f85cd410640 4 set_mon_vals no callback set 2024-09-14T11:33:57.366 INFO:tasks.workunit.client.0.smithi071.stderr: -358> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 10 monclient: _renew_subs 2024-09-14T11:33:57.366 INFO:tasks.workunit.client.0.smithi071.stderr: -357> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:33:57.367 INFO:tasks.workunit.client.0.smithi071.stderr: -356> 2024-09-14T11:33:57.228+0000 7f84b1ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:57.367 INFO:tasks.workunit.client.0.smithi071.stderr: -355> 2024-09-14T11:33:57.228+0000 7f84b1ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:33:57.367 INFO:tasks.workunit.client.0.smithi071.stderr: -354> 2024-09-14T11:33:57.228+0000 7f84b1ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:33:57.367 INFO:tasks.workunit.client.0.smithi071.stderr: -353> 2024-09-14T11:33:57.228+0000 7f85cbc0d640 10 monclient: get_auth_request con 0x7f84a40717e0 auth_method 0 2024-09-14T11:33:57.367 INFO:tasks.workunit.client.0.smithi071.stderr: -352> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 10 monclient: get_monmap_and_config 2024-09-14T11:33:57.367 INFO:tasks.workunit.client.0.smithi071.stderr: -351> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 10 monclient: build_initial_monmap 2024-09-14T11:33:57.367 INFO:tasks.workunit.client.0.smithi071.stderr: -350> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 1 build_initial for_mkfs: 0 2024-09-14T11:33:57.367 INFO:tasks.workunit.client.0.smithi071.stderr: -349> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 10 monclient: monmap: 2024-09-14T11:33:57.367 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:33:57.367 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:57.367 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:33:57.367 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:33:57.367 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:57.367 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:57.368 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:33:57.368 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:33:57.368 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:33:57.368 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:57.368 INFO:tasks.workunit.client.0.smithi071.stderr: -348> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x55750e2555c0) adding auth protocol: cephx 2024-09-14T11:33:57.368 INFO:tasks.workunit.client.0.smithi071.stderr: -347> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x55750e2555c0) adding auth protocol: cephx 2024-09-14T11:33:57.368 INFO:tasks.workunit.client.0.smithi071.stderr: -346> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x55750e2555c0) adding auth protocol: cephx 2024-09-14T11:33:57.368 INFO:tasks.workunit.client.0.smithi071.stderr: -345> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x55750e2555c0) adding con mode: secure 2024-09-14T11:33:57.368 INFO:tasks.workunit.client.0.smithi071.stderr: -344> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x55750e2555c0) adding con mode: crc 2024-09-14T11:33:57.368 INFO:tasks.workunit.client.0.smithi071.stderr: -343> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x55750e2555c0) adding con mode: secure 2024-09-14T11:33:57.368 INFO:tasks.workunit.client.0.smithi071.stderr: -342> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x55750e2555c0) adding con mode: crc 2024-09-14T11:33:57.368 INFO:tasks.workunit.client.0.smithi071.stderr: -341> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x55750e2555c0) adding con mode: secure 2024-09-14T11:33:57.368 INFO:tasks.workunit.client.0.smithi071.stderr: -340> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x55750e2555c0) adding con mode: crc 2024-09-14T11:33:57.368 INFO:tasks.workunit.client.0.smithi071.stderr: -339> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x55750e2555c0) adding con mode: crc 2024-09-14T11:33:57.369 INFO:tasks.workunit.client.0.smithi071.stderr: -338> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x55750e2555c0) adding con mode: secure 2024-09-14T11:33:57.369 INFO:tasks.workunit.client.0.smithi071.stderr: -337> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x55750e2555c0) adding con mode: crc 2024-09-14T11:33:57.369 INFO:tasks.workunit.client.0.smithi071.stderr: -336> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x55750e2555c0) adding con mode: secure 2024-09-14T11:33:57.369 INFO:tasks.workunit.client.0.smithi071.stderr: -335> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x55750e2555c0) adding con mode: crc 2024-09-14T11:33:57.369 INFO:tasks.workunit.client.0.smithi071.stderr: -334> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x55750e2555c0) adding con mode: secure 2024-09-14T11:33:57.369 INFO:tasks.workunit.client.0.smithi071.stderr: -333> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:57.369 INFO:tasks.workunit.client.0.smithi071.stderr: -332> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 10 monclient: init 2024-09-14T11:33:57.369 INFO:tasks.workunit.client.0.smithi071.stderr: -331> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f41e0) adding auth protocol: cephx 2024-09-14T11:33:57.369 INFO:tasks.workunit.client.0.smithi071.stderr: -330> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f41e0) adding auth protocol: cephx 2024-09-14T11:33:57.369 INFO:tasks.workunit.client.0.smithi071.stderr: -329> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f41e0) adding auth protocol: cephx 2024-09-14T11:33:57.369 INFO:tasks.workunit.client.0.smithi071.stderr: -328> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f41e0) adding con mode: secure 2024-09-14T11:33:57.369 INFO:tasks.workunit.client.0.smithi071.stderr: -327> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f41e0) adding con mode: crc 2024-09-14T11:33:57.369 INFO:tasks.workunit.client.0.smithi071.stderr: -326> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f41e0) adding con mode: secure 2024-09-14T11:33:57.369 INFO:tasks.workunit.client.0.smithi071.stderr: -325> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f41e0) adding con mode: crc 2024-09-14T11:33:57.370 INFO:tasks.workunit.client.0.smithi071.stderr: -324> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f41e0) adding con mode: secure 2024-09-14T11:33:57.370 INFO:tasks.workunit.client.0.smithi071.stderr: -323> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f41e0) adding con mode: crc 2024-09-14T11:33:57.370 INFO:tasks.workunit.client.0.smithi071.stderr: -322> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f41e0) adding con mode: crc 2024-09-14T11:33:57.370 INFO:tasks.workunit.client.0.smithi071.stderr: -321> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f41e0) adding con mode: secure 2024-09-14T11:33:57.370 INFO:tasks.workunit.client.0.smithi071.stderr: -320> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f41e0) adding con mode: crc 2024-09-14T11:33:57.370 INFO:tasks.workunit.client.0.smithi071.stderr: -319> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f41e0) adding con mode: secure 2024-09-14T11:33:57.370 INFO:tasks.workunit.client.0.smithi071.stderr: -318> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f41e0) adding con mode: crc 2024-09-14T11:33:57.370 INFO:tasks.workunit.client.0.smithi071.stderr: -317> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f41e0) adding con mode: secure 2024-09-14T11:33:57.370 INFO:tasks.workunit.client.0.smithi071.stderr: -316> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:57.370 INFO:tasks.workunit.client.0.smithi071.stderr: -315> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:57.371 INFO:tasks.workunit.client.0.smithi071.stderr: -314> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 asok(0x55750dfa9d90) register_command rotate-key cmddesc rotate-key hook 0x7ffc591f4328 EEXIST 2024-09-14T11:33:57.371 INFO:tasks.workunit.client.0.smithi071.stderr: -313> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 10 monclient: _reopen_session rank -1 2024-09-14T11:33:57.371 INFO:tasks.workunit.client.0.smithi071.stderr: -312> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:33:57.371 INFO:tasks.workunit.client.0.smithi071.stderr: -311> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 10 monclient(hunting): picked mon.noname-b con 0x55750e283b60 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:33:57.371 INFO:tasks.workunit.client.0.smithi071.stderr: -310> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 10 monclient(hunting): picked mon.noname-c con 0x55750e283f40 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:33:57.371 INFO:tasks.workunit.client.0.smithi071.stderr: -309> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 10 monclient(hunting): picked mon.noname-a con 0x55750e285400 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:33:57.371 INFO:tasks.workunit.client.0.smithi071.stderr: -308> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:57.371 INFO:tasks.workunit.client.0.smithi071.stderr: -307> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:57.371 INFO:tasks.workunit.client.0.smithi071.stderr: -306> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:57.371 INFO:tasks.workunit.client.0.smithi071.stderr: -305> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 10 monclient(hunting): _renew_subs 2024-09-14T11:33:57.371 INFO:tasks.workunit.client.0.smithi071.stderr: -304> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient(hunting): authenticate will time out at 2449.352010s 2024-09-14T11:33:57.371 INFO:tasks.workunit.client.0.smithi071.stderr: -303> 2024-09-14T11:33:57.232+0000 7f85ccc0f640 10 monclient(hunting): get_auth_request con 0x55750e283f40 auth_method 0 2024-09-14T11:33:57.371 INFO:tasks.workunit.client.0.smithi071.stderr: -302> 2024-09-14T11:33:57.232+0000 7f85ccc0f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:57.372 INFO:tasks.workunit.client.0.smithi071.stderr: -301> 2024-09-14T11:33:57.232+0000 7f85ccc0f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:57.372 INFO:tasks.workunit.client.0.smithi071.stderr: -300> 2024-09-14T11:33:57.232+0000 7f85ccc0f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:57.372 INFO:tasks.workunit.client.0.smithi071.stderr: -299> 2024-09-14T11:33:57.232+0000 7f85cc40e640 10 monclient(hunting): get_auth_request con 0x55750e285400 auth_method 0 2024-09-14T11:33:57.372 INFO:tasks.workunit.client.0.smithi071.stderr: -298> 2024-09-14T11:33:57.232+0000 7f85cc40e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:57.372 INFO:tasks.workunit.client.0.smithi071.stderr: -297> 2024-09-14T11:33:57.232+0000 7f85cc40e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:57.372 INFO:tasks.workunit.client.0.smithi071.stderr: -296> 2024-09-14T11:33:57.232+0000 7f85cc40e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:57.372 INFO:tasks.workunit.client.0.smithi071.stderr: -295> 2024-09-14T11:33:57.232+0000 7f85ccc0f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:57.372 INFO:tasks.workunit.client.0.smithi071.stderr: -294> 2024-09-14T11:33:57.232+0000 7f85ccc0f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:57.372 INFO:tasks.workunit.client.0.smithi071.stderr: -293> 2024-09-14T11:33:57.232+0000 7f85ccc0f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:57.372 INFO:tasks.workunit.client.0.smithi071.stderr: -292> 2024-09-14T11:33:57.232+0000 7f85cc40e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:57.372 INFO:tasks.workunit.client.0.smithi071.stderr: -291> 2024-09-14T11:33:57.232+0000 7f85cc40e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:57.372 INFO:tasks.workunit.client.0.smithi071.stderr: -290> 2024-09-14T11:33:57.232+0000 7f85cc40e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:57.372 INFO:tasks.workunit.client.0.smithi071.stderr: -289> 2024-09-14T11:33:57.232+0000 7f85ccc0f640 10 monclient(hunting): handle_auth_done global_id 7646 payload 274 2024-09-14T11:33:57.372 INFO:tasks.workunit.client.0.smithi071.stderr: -288> 2024-09-14T11:33:57.232+0000 7f85ccc0f640 10 monclient: _finish_hunting 0 2024-09-14T11:33:57.372 INFO:tasks.workunit.client.0.smithi071.stderr: -287> 2024-09-14T11:33:57.232+0000 7f85ccc0f640 1 monclient: found mon.noname-c 2024-09-14T11:33:57.373 INFO:tasks.workunit.client.0.smithi071.stderr: -286> 2024-09-14T11:33:57.232+0000 7f85ccc0f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:33:57.373 INFO:tasks.workunit.client.0.smithi071.stderr: -285> 2024-09-14T11:33:57.232+0000 7f84ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:57.373 INFO:tasks.workunit.client.0.smithi071.stderr: -284> 2024-09-14T11:33:57.232+0000 7f84ab7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:57.373 INFO:tasks.workunit.client.0.smithi071.stderr: -283> 2024-09-14T11:33:57.232+0000 7f84ab7fe640 10 monclient: dump: 2024-09-14T11:33:57.373 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:33:57.373 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:33:57.373 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:57.373 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:57.373 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:57.373 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:57.373 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:33:57.373 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:33:57.373 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:33:57.373 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:57.374 INFO:tasks.workunit.client.0.smithi071.stderr: -282> 2024-09-14T11:33:57.232+0000 7f84ab7fe640 10 monclient: _finish_auth 0 2024-09-14T11:33:57.374 INFO:tasks.workunit.client.0.smithi071.stderr: -281> 2024-09-14T11:33:57.232+0000 7f84ab7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:33:57.374 INFO:tasks.workunit.client.0.smithi071.stderr: -280> 2024-09-14T11:33:57.232+0000 7f84ab7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:57.374 INFO:tasks.workunit.client.0.smithi071.stderr: -279> 2024-09-14T11:33:57.232+0000 7f84ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:57.374 INFO:tasks.workunit.client.0.smithi071.stderr: -278> 2024-09-14T11:33:57.232+0000 7f84ab7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:57.374 INFO:tasks.workunit.client.0.smithi071.stderr: -277> 2024-09-14T11:33:57.232+0000 7f84ab7fe640 10 monclient: dump: 2024-09-14T11:33:57.374 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:33:57.374 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:33:57.374 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:57.374 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:57.374 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:57.374 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:57.374 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:33:57.374 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:33:57.374 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:33:57.374 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:57.375 INFO:tasks.workunit.client.0.smithi071.stderr: -276> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 monclient: authenticate success, global_id 7646 2024-09-14T11:33:57.375 INFO:tasks.workunit.client.0.smithi071.stderr: -275> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient: get_monmap_and_config success 2024-09-14T11:33:57.375 INFO:tasks.workunit.client.0.smithi071.stderr: -274> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 4 set_mon_vals no callback set 2024-09-14T11:33:57.375 INFO:tasks.workunit.client.0.smithi071.stderr: -273> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient: shutdown 2024-09-14T11:33:57.375 INFO:tasks.workunit.client.0.smithi071.stderr: -272> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient: build_initial_monmap 2024-09-14T11:33:57.375 INFO:tasks.workunit.client.0.smithi071.stderr: -271> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 1 build_initial for_mkfs: 0 2024-09-14T11:33:57.375 INFO:tasks.workunit.client.0.smithi071.stderr: -270> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient: monmap: 2024-09-14T11:33:57.375 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:33:57.375 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:57.375 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:33:57.375 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:33:57.375 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:57.375 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:57.375 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:33:57.375 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:33:57.376 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:33:57.376 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:57.376 INFO:tasks.workunit.client.0.smithi071.stderr: -269> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e27c0e0) adding auth protocol: cephx 2024-09-14T11:33:57.376 INFO:tasks.workunit.client.0.smithi071.stderr: -268> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e27c0e0) adding auth protocol: cephx 2024-09-14T11:33:57.376 INFO:tasks.workunit.client.0.smithi071.stderr: -267> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e27c0e0) adding auth protocol: cephx 2024-09-14T11:33:57.376 INFO:tasks.workunit.client.0.smithi071.stderr: -266> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e27c0e0) adding con mode: secure 2024-09-14T11:33:57.376 INFO:tasks.workunit.client.0.smithi071.stderr: -265> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e27c0e0) adding con mode: crc 2024-09-14T11:33:57.376 INFO:tasks.workunit.client.0.smithi071.stderr: -264> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e27c0e0) adding con mode: secure 2024-09-14T11:33:57.376 INFO:tasks.workunit.client.0.smithi071.stderr: -263> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e27c0e0) adding con mode: crc 2024-09-14T11:33:57.376 INFO:tasks.workunit.client.0.smithi071.stderr: -262> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e27c0e0) adding con mode: secure 2024-09-14T11:33:57.376 INFO:tasks.workunit.client.0.smithi071.stderr: -261> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e27c0e0) adding con mode: crc 2024-09-14T11:33:57.376 INFO:tasks.workunit.client.0.smithi071.stderr: -260> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e27c0e0) adding con mode: crc 2024-09-14T11:33:57.376 INFO:tasks.workunit.client.0.smithi071.stderr: -259> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e27c0e0) adding con mode: secure 2024-09-14T11:33:57.376 INFO:tasks.workunit.client.0.smithi071.stderr: -258> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e27c0e0) adding con mode: crc 2024-09-14T11:33:57.376 INFO:tasks.workunit.client.0.smithi071.stderr: -257> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e27c0e0) adding con mode: secure 2024-09-14T11:33:57.377 INFO:tasks.workunit.client.0.smithi071.stderr: -256> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e27c0e0) adding con mode: crc 2024-09-14T11:33:57.377 INFO:tasks.workunit.client.0.smithi071.stderr: -255> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e27c0e0) adding con mode: secure 2024-09-14T11:33:57.377 INFO:tasks.workunit.client.0.smithi071.stderr: -254> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:57.377 INFO:tasks.workunit.client.0.smithi071.stderr: -253> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 1 librados: starting msgr at 2024-09-14T11:33:57.377 INFO:tasks.workunit.client.0.smithi071.stderr: -252> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 1 librados: starting objecter 2024-09-14T11:33:57.377 INFO:tasks.workunit.client.0.smithi071.stderr: -251> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 asok(0x55750dfa9d90) register_command objecter_requests cmddesc objecter_requests hook 0x55750e2552b0 EEXIST 2024-09-14T11:33:57.377 INFO:tasks.workunit.client.0.smithi071.stderr: -250> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 1 librados: setting wanted keys 2024-09-14T11:33:57.377 INFO:tasks.workunit.client.0.smithi071.stderr: -249> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 1 librados: calling monclient init 2024-09-14T11:33:57.377 INFO:tasks.workunit.client.0.smithi071.stderr: -248> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient: init 2024-09-14T11:33:57.377 INFO:tasks.workunit.client.0.smithi071.stderr: -247> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e237b00) adding auth protocol: cephx 2024-09-14T11:33:57.377 INFO:tasks.workunit.client.0.smithi071.stderr: -246> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e237b00) adding auth protocol: cephx 2024-09-14T11:33:57.377 INFO:tasks.workunit.client.0.smithi071.stderr: -245> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e237b00) adding auth protocol: cephx 2024-09-14T11:33:57.377 INFO:tasks.workunit.client.0.smithi071.stderr: -244> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e237b00) adding con mode: secure 2024-09-14T11:33:57.377 INFO:tasks.workunit.client.0.smithi071.stderr: -243> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e237b00) adding con mode: crc 2024-09-14T11:33:57.378 INFO:tasks.workunit.client.0.smithi071.stderr: -242> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e237b00) adding con mode: secure 2024-09-14T11:33:57.378 INFO:tasks.workunit.client.0.smithi071.stderr: -241> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e237b00) adding con mode: crc 2024-09-14T11:33:57.378 INFO:tasks.workunit.client.0.smithi071.stderr: -240> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e237b00) adding con mode: secure 2024-09-14T11:33:57.378 INFO:tasks.workunit.client.0.smithi071.stderr: -239> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e237b00) adding con mode: crc 2024-09-14T11:33:57.378 INFO:tasks.workunit.client.0.smithi071.stderr: -238> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e237b00) adding con mode: crc 2024-09-14T11:33:57.378 INFO:tasks.workunit.client.0.smithi071.stderr: -237> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e237b00) adding con mode: secure 2024-09-14T11:33:57.378 INFO:tasks.workunit.client.0.smithi071.stderr: -236> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e237b00) adding con mode: crc 2024-09-14T11:33:57.378 INFO:tasks.workunit.client.0.smithi071.stderr: -235> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e237b00) adding con mode: secure 2024-09-14T11:33:57.378 INFO:tasks.workunit.client.0.smithi071.stderr: -234> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e237b00) adding con mode: crc 2024-09-14T11:33:57.378 INFO:tasks.workunit.client.0.smithi071.stderr: -233> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e237b00) adding con mode: secure 2024-09-14T11:33:57.378 INFO:tasks.workunit.client.0.smithi071.stderr: -232> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:57.378 INFO:tasks.workunit.client.0.smithi071.stderr: -231> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:57.378 INFO:tasks.workunit.client.0.smithi071.stderr: -230> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 asok(0x55750dfa9d90) register_command rotate-key cmddesc rotate-key hook 0x55750e237c48 EEXIST 2024-09-14T11:33:57.378 INFO:tasks.workunit.client.0.smithi071.stderr: -229> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient: _reopen_session rank -1 2024-09-14T11:33:57.378 INFO:tasks.workunit.client.0.smithi071.stderr: -228> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:33:57.379 INFO:tasks.workunit.client.0.smithi071.stderr: -227> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient(hunting): picked mon.noname-c con 0x55750e283b60 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:33:57.379 INFO:tasks.workunit.client.0.smithi071.stderr: -226> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient(hunting): picked mon.noname-b con 0x55750e285400 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:33:57.379 INFO:tasks.workunit.client.0.smithi071.stderr: -225> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient(hunting): picked mon.noname-a con 0x55750e294050 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:33:57.379 INFO:tasks.workunit.client.0.smithi071.stderr: -224> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:57.379 INFO:tasks.workunit.client.0.smithi071.stderr: -223> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:57.379 INFO:tasks.workunit.client.0.smithi071.stderr: -222> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:57.379 INFO:tasks.workunit.client.0.smithi071.stderr: -221> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient(hunting): _renew_subs 2024-09-14T11:33:57.379 INFO:tasks.workunit.client.0.smithi071.stderr: -220> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient(hunting): authenticate will time out at 2449.354493s 2024-09-14T11:33:57.379 INFO:tasks.workunit.client.0.smithi071.stderr: -219> 2024-09-14T11:33:57.232+0000 7f85cbc0d640 10 monclient(hunting): get_auth_request con 0x55750e283b60 auth_method 0 2024-09-14T11:33:57.379 INFO:tasks.workunit.client.0.smithi071.stderr: -218> 2024-09-14T11:33:57.232+0000 7f85cbc0d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:57.379 INFO:tasks.workunit.client.0.smithi071.stderr: -217> 2024-09-14T11:33:57.232+0000 7f85cbc0d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:57.379 INFO:tasks.workunit.client.0.smithi071.stderr: -216> 2024-09-14T11:33:57.232+0000 7f85cbc0d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:57.379 INFO:tasks.workunit.client.0.smithi071.stderr: -215> 2024-09-14T11:33:57.232+0000 7f85cc40e640 10 monclient(hunting): get_auth_request con 0x55750e294050 auth_method 0 2024-09-14T11:33:57.379 INFO:tasks.workunit.client.0.smithi071.stderr: -214> 2024-09-14T11:33:57.232+0000 7f85cc40e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:57.379 INFO:tasks.workunit.client.0.smithi071.stderr: -213> 2024-09-14T11:33:57.232+0000 7f85cc40e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:57.380 INFO:tasks.workunit.client.0.smithi071.stderr: -212> 2024-09-14T11:33:57.232+0000 7f85cc40e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:57.380 INFO:tasks.workunit.client.0.smithi071.stderr: -211> 2024-09-14T11:33:57.232+0000 7f85cbc0d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:57.380 INFO:tasks.workunit.client.0.smithi071.stderr: -210> 2024-09-14T11:33:57.232+0000 7f85cbc0d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:57.380 INFO:tasks.workunit.client.0.smithi071.stderr: -209> 2024-09-14T11:33:57.232+0000 7f85cbc0d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:57.380 INFO:tasks.workunit.client.0.smithi071.stderr: -208> 2024-09-14T11:33:57.232+0000 7f85cc40e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:57.380 INFO:tasks.workunit.client.0.smithi071.stderr: -207> 2024-09-14T11:33:57.232+0000 7f85cc40e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:57.380 INFO:tasks.workunit.client.0.smithi071.stderr: -206> 2024-09-14T11:33:57.232+0000 7f85cc40e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:57.380 INFO:tasks.workunit.client.0.smithi071.stderr: -205> 2024-09-14T11:33:57.232+0000 7f85ccc0f640 10 monclient(hunting): get_auth_request con 0x55750e285400 auth_method 0 2024-09-14T11:33:57.380 INFO:tasks.workunit.client.0.smithi071.stderr: -204> 2024-09-14T11:33:57.232+0000 7f85ccc0f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:57.380 INFO:tasks.workunit.client.0.smithi071.stderr: -203> 2024-09-14T11:33:57.232+0000 7f85ccc0f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:57.380 INFO:tasks.workunit.client.0.smithi071.stderr: -202> 2024-09-14T11:33:57.232+0000 7f85ccc0f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:57.380 INFO:tasks.workunit.client.0.smithi071.stderr: -201> 2024-09-14T11:33:57.232+0000 7f85cbc0d640 10 monclient(hunting): handle_auth_done global_id 7649 payload 824 2024-09-14T11:33:57.380 INFO:tasks.workunit.client.0.smithi071.stderr: -200> 2024-09-14T11:33:57.232+0000 7f85cbc0d640 10 monclient: _finish_hunting 0 2024-09-14T11:33:57.380 INFO:tasks.workunit.client.0.smithi071.stderr: -199> 2024-09-14T11:33:57.232+0000 7f85cbc0d640 1 monclient: found mon.noname-c 2024-09-14T11:33:57.380 INFO:tasks.workunit.client.0.smithi071.stderr: -198> 2024-09-14T11:33:57.232+0000 7f85cbc0d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:33:57.381 INFO:tasks.workunit.client.0.smithi071.stderr: -197> 2024-09-14T11:33:57.232+0000 7f84a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:57.381 INFO:tasks.workunit.client.0.smithi071.stderr: -196> 2024-09-14T11:33:57.232+0000 7f84a9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:57.381 INFO:tasks.workunit.client.0.smithi071.stderr: -195> 2024-09-14T11:33:57.232+0000 7f84a9ffb640 10 monclient: dump: 2024-09-14T11:33:57.381 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:33:57.381 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:33:57.381 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:57.381 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:57.381 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:57.381 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:57.381 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:33:57.381 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:33:57.381 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:33:57.381 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:57.382 INFO:tasks.workunit.client.0.smithi071.stderr: -194> 2024-09-14T11:33:57.232+0000 7f84a9ffb640 10 monclient: _finish_auth 0 2024-09-14T11:33:57.382 INFO:tasks.workunit.client.0.smithi071.stderr: -193> 2024-09-14T11:33:57.232+0000 7f84a9ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:33:57.382 INFO:tasks.workunit.client.0.smithi071.stderr: -192> 2024-09-14T11:33:57.232+0000 7f84a9ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:57.382 INFO:tasks.workunit.client.0.smithi071.stderr: -191> 2024-09-14T11:33:57.232+0000 7f84a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:57.382 INFO:tasks.workunit.client.0.smithi071.stderr: -190> 2024-09-14T11:33:57.232+0000 7f84a9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:57.382 INFO:tasks.workunit.client.0.smithi071.stderr: -189> 2024-09-14T11:33:57.232+0000 7f84a9ffb640 10 monclient: dump: 2024-09-14T11:33:57.382 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:33:57.382 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:33:57.382 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:57.382 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:57.382 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:57.382 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:57.382 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:33:57.382 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:33:57.382 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:33:57.383 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:57.383 INFO:tasks.workunit.client.0.smithi071.stderr: -188> 2024-09-14T11:33:57.232+0000 7f84ab7fe640 4 set_mon_vals no callback set 2024-09-14T11:33:57.383 INFO:tasks.workunit.client.0.smithi071.stderr: -187> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 monclient: authenticate success, global_id 7649 2024-09-14T11:33:57.383 INFO:tasks.workunit.client.0.smithi071.stderr: -186> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient: _renew_subs 2024-09-14T11:33:57.383 INFO:tasks.workunit.client.0.smithi071.stderr: -185> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:33:57.383 INFO:tasks.workunit.client.0.smithi071.stderr: -184> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient: _renew_subs 2024-09-14T11:33:57.383 INFO:tasks.workunit.client.0.smithi071.stderr: -183> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:33:57.383 INFO:tasks.workunit.client.0.smithi071.stderr: -182> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 1 librados: init done 2024-09-14T11:33:57.383 INFO:tasks.workunit.client.0.smithi071.stderr: -181> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 asok(0x55750dfa9d90) register_command cr dump hook 0x55750e27bc48 2024-09-14T11:33:57.383 INFO:tasks.workunit.client.0.smithi071.stderr: -180> 2024-09-14T11:33:57.236+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.383 INFO:tasks.workunit.client.0.smithi071.stderr: -179> 2024-09-14T11:33:57.236+0000 7f84a9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:57.383 INFO:tasks.workunit.client.0.smithi071.stderr: -178> 2024-09-14T11:33:57.236+0000 7f84a9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:33:57.383 INFO:tasks.workunit.client.0.smithi071.stderr: -177> 2024-09-14T11:33:57.236+0000 7f84a9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:33:57.383 INFO:tasks.workunit.client.0.smithi071.stderr: -176> 2024-09-14T11:33:57.236+0000 7f85ccc0f640 10 monclient: get_auth_request con 0x7f849c0718a0 auth_method 0 2024-09-14T11:33:57.383 INFO:tasks.workunit.client.0.smithi071.stderr: -175> 2024-09-14T11:33:57.236+0000 7f85cc40e640 10 monclient: get_auth_request con 0x55750e2a39f0 auth_method 0 2024-09-14T11:33:57.384 INFO:tasks.workunit.client.0.smithi071.stderr: -174> 2024-09-14T11:33:57.236+0000 7f85ce9089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.384 INFO:tasks.workunit.client.0.smithi071.stderr: -173> 2024-09-14T11:33:57.236+0000 7f85ce9089c0 20 realm 2024-09-14T11:33:57.384 INFO:tasks.workunit.client.0.smithi071.stderr: -172> 2024-09-14T11:33:57.236+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.384 INFO:tasks.workunit.client.0.smithi071.stderr: -171> 2024-09-14T11:33:57.236+0000 7f85ce9089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.384 INFO:tasks.workunit.client.0.smithi071.stderr: -170> 2024-09-14T11:33:57.236+0000 7f85ce9089c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:57.384 INFO:tasks.workunit.client.0.smithi071.stderr: -169> 2024-09-14T11:33:57.236+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.384 INFO:tasks.workunit.client.0.smithi071.stderr: -168> 2024-09-14T11:33:57.240+0000 7f85ce9089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.384 INFO:tasks.workunit.client.0.smithi071.stderr: -167> 2024-09-14T11:33:57.240+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.384 INFO:tasks.workunit.client.0.smithi071.stderr: -166> 2024-09-14T11:33:57.240+0000 7f85cbc0d640 10 monclient: get_auth_request con 0x55750e2a7ce0 auth_method 0 2024-09-14T11:33:57.384 INFO:tasks.workunit.client.0.smithi071.stderr: -165> 2024-09-14T11:33:57.240+0000 7f85ce9089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:57.384 INFO:tasks.workunit.client.0.smithi071.stderr: -164> 2024-09-14T11:33:57.240+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.384 INFO:tasks.workunit.client.0.smithi071.stderr: -163> 2024-09-14T11:33:57.240+0000 7f85ccc0f640 10 monclient: get_auth_request con 0x55750e2ab420 auth_method 0 2024-09-14T11:33:57.384 INFO:tasks.workunit.client.0.smithi071.stderr: -162> 2024-09-14T11:33:57.240+0000 7f85ce9089c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:57.385 INFO:tasks.workunit.client.0.smithi071.stderr: -161> 2024-09-14T11:33:57.240+0000 7f85ce9089c0 20 searching for the correct realm 2024-09-14T11:33:57.385 INFO:tasks.workunit.client.0.smithi071.stderr: -160> 2024-09-14T11:33:57.240+0000 7f85cc40e640 10 monclient: get_auth_request con 0x55750e2b01c0 auth_method 0 2024-09-14T11:33:57.385 INFO:tasks.workunit.client.0.smithi071.stderr: -159> 2024-09-14T11:33:57.244+0000 7f85cbc0d640 10 monclient: get_auth_request con 0x7f85bc034060 auth_method 0 2024-09-14T11:33:57.385 INFO:tasks.workunit.client.0.smithi071.stderr: -158> 2024-09-14T11:33:57.244+0000 7f85ccc0f640 10 monclient: get_auth_request con 0x7f85c0054060 auth_method 0 2024-09-14T11:33:57.385 INFO:tasks.workunit.client.0.smithi071.stderr: -157> 2024-09-14T11:33:57.244+0000 7f85cc40e640 0 -- 172.21.15.71:0/3711081096 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x55750e2b01c0 msgr2=0x55750e2b2680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:57.385 INFO:tasks.workunit.client.0.smithi071.stderr: -156> 2024-09-14T11:33:57.244+0000 7f84a9ffb640 1 client.7649.objecter ms_handle_reset 0x55750e2b01c0 session 0x55750e2afb40 osd.4 2024-09-14T11:33:57.385 INFO:tasks.workunit.client.0.smithi071.stderr: -155> 2024-09-14T11:33:57.244+0000 7f84a9ffb640 10 monclient: _renew_subs 2024-09-14T11:33:57.385 INFO:tasks.workunit.client.0.smithi071.stderr: -154> 2024-09-14T11:33:57.244+0000 7f84a9ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:33:57.385 INFO:tasks.workunit.client.0.smithi071.stderr: -153> 2024-09-14T11:33:57.244+0000 7f85cc40e640 10 monclient: get_auth_request con 0x7f85bc01c040 auth_method 0 2024-09-14T11:33:57.385 INFO:tasks.workunit.client.0.smithi071.stderr: -152> 2024-09-14T11:33:57.244+0000 7f85cc40e640 10 monclient: get_auth_request con 0x7f849c0813c0 auth_method 0 2024-09-14T11:33:57.385 INFO:tasks.workunit.client.0.smithi071.stderr: -151> 2024-09-14T11:33:57.248+0000 7f85cbc0d640 10 monclient: get_auth_request con 0x7f85c0089020 auth_method 0 2024-09-14T11:33:57.385 INFO:tasks.workunit.client.0.smithi071.stderr: -150> 2024-09-14T11:33:57.252+0000 7f85ccc0f640 0 -- 172.21.15.71:0/3711081096 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55750e2ab420 msgr2=0x55750e2ad810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:57.385 INFO:tasks.workunit.client.0.smithi071.stderr: -149> 2024-09-14T11:33:57.252+0000 7f84a9ffb640 1 client.7649.objecter ms_handle_reset 0x55750e2ab420 session 0x55750e2a7540 osd.3 2024-09-14T11:33:57.385 INFO:tasks.workunit.client.0.smithi071.stderr: -148> 2024-09-14T11:33:57.252+0000 7f85ccc0f640 10 monclient: get_auth_request con 0x55750e2b01c0 auth_method 0 2024-09-14T11:33:57.386 INFO:tasks.workunit.client.0.smithi071.stderr: -147> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:57.386 INFO:tasks.workunit.client.0.smithi071.stderr: -146> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:33:57.386 INFO:tasks.workunit.client.0.smithi071.stderr: -145> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:57.386 INFO:tasks.workunit.client.0.smithi071.stderr: -144> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:33:57.386 INFO:tasks.workunit.client.0.smithi071.stderr: -143> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:57.386 INFO:tasks.workunit.client.0.smithi071.stderr: -142> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:57.386 INFO:tasks.workunit.client.0.smithi071.stderr: -141> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.386 INFO:tasks.workunit.client.0.smithi071.stderr: -140> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.386 INFO:tasks.workunit.client.0.smithi071.stderr: -139> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.386 INFO:tasks.workunit.client.0.smithi071.stderr: -138> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:57.386 INFO:tasks.workunit.client.0.smithi071.stderr: -137> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.386 INFO:tasks.workunit.client.0.smithi071.stderr: -136> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:57.386 INFO:tasks.workunit.client.0.smithi071.stderr: -135> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 zone default found 2024-09-14T11:33:57.386 INFO:tasks.workunit.client.0.smithi071.stderr: -134> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 4 Realm: () 2024-09-14T11:33:57.386 INFO:tasks.workunit.client.0.smithi071.stderr: -133> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:33:57.387 INFO:tasks.workunit.client.0.smithi071.stderr: -132> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:33:57.387 INFO:tasks.workunit.client.0.smithi071.stderr: -131> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:57.387 INFO:tasks.workunit.client.0.smithi071.stderr: -130> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 zonegroup default 2024-09-14T11:33:57.387 INFO:tasks.workunit.client.0.smithi071.stderr: -129> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.387 INFO:tasks.workunit.client.0.smithi071.stderr: -128> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.387 INFO:tasks.workunit.client.0.smithi071.stderr: -127> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.387 INFO:tasks.workunit.client.0.smithi071.stderr: -126> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.387 INFO:tasks.workunit.client.0.smithi071.stderr: -125> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.387 INFO:tasks.workunit.client.0.smithi071.stderr: -124> 2024-09-14T11:33:57.264+0000 7f85ce9089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.387 INFO:tasks.workunit.client.0.smithi071.stderr: -123> 2024-09-14T11:33:57.264+0000 7f85ce9089c0 20 started sync module instance, tier type = 2024-09-14T11:33:57.387 INFO:tasks.workunit.client.0.smithi071.stderr: -122> 2024-09-14T11:33:57.264+0000 7f85ce9089c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:33:57.387 INFO:tasks.workunit.client.0.smithi071.stderr: -121> 2024-09-14T11:33:57.288+0000 7f85ce9089c0 20 add_watcher() i=0 2024-09-14T11:33:57.387 INFO:tasks.workunit.client.0.smithi071.stderr: -120> 2024-09-14T11:33:57.288+0000 7f85ce9089c0 20 add_watcher() i=1 2024-09-14T11:33:57.387 INFO:tasks.workunit.client.0.smithi071.stderr: -119> 2024-09-14T11:33:57.288+0000 7f85ce9089c0 20 add_watcher() i=2 2024-09-14T11:33:57.388 INFO:tasks.workunit.client.0.smithi071.stderr: -118> 2024-09-14T11:33:57.288+0000 7f85ce9089c0 20 add_watcher() i=3 2024-09-14T11:33:57.388 INFO:tasks.workunit.client.0.smithi071.stderr: -117> 2024-09-14T11:33:57.288+0000 7f85ce9089c0 20 add_watcher() i=4 2024-09-14T11:33:57.388 INFO:tasks.workunit.client.0.smithi071.stderr: -116> 2024-09-14T11:33:57.288+0000 7f85ce9089c0 20 add_watcher() i=5 2024-09-14T11:33:57.388 INFO:tasks.workunit.client.0.smithi071.stderr: -115> 2024-09-14T11:33:57.288+0000 7f85ce9089c0 20 add_watcher() i=6 2024-09-14T11:33:57.388 INFO:tasks.workunit.client.0.smithi071.stderr: -114> 2024-09-14T11:33:57.292+0000 7f85ce9089c0 20 add_watcher() i=7 2024-09-14T11:33:57.388 INFO:tasks.workunit.client.0.smithi071.stderr: -113> 2024-09-14T11:33:57.292+0000 7f85ce9089c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:57.388 INFO:tasks.workunit.client.0.smithi071.stderr: -112> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f46c0) adding auth protocol: cephx 2024-09-14T11:33:57.388 INFO:tasks.workunit.client.0.smithi071.stderr: -111> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f46c0) adding auth protocol: cephx 2024-09-14T11:33:57.388 INFO:tasks.workunit.client.0.smithi071.stderr: -110> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f46c0) adding auth protocol: cephx 2024-09-14T11:33:57.388 INFO:tasks.workunit.client.0.smithi071.stderr: -109> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f46c0) adding con mode: secure 2024-09-14T11:33:57.388 INFO:tasks.workunit.client.0.smithi071.stderr: -108> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f46c0) adding con mode: crc 2024-09-14T11:33:57.388 INFO:tasks.workunit.client.0.smithi071.stderr: -107> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f46c0) adding con mode: secure 2024-09-14T11:33:57.388 INFO:tasks.workunit.client.0.smithi071.stderr: -106> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f46c0) adding con mode: crc 2024-09-14T11:33:57.388 INFO:tasks.workunit.client.0.smithi071.stderr: -105> 2024-09-14T11:33:57.296+0000 7f8482fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:57.389 INFO:tasks.workunit.client.0.smithi071.stderr: -104> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f46c0) adding con mode: secure 2024-09-14T11:33:57.389 INFO:tasks.workunit.client.0.smithi071.stderr: -103> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f46c0) adding con mode: crc 2024-09-14T11:33:57.389 INFO:tasks.workunit.client.0.smithi071.stderr: -102> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f46c0) adding con mode: crc 2024-09-14T11:33:57.389 INFO:tasks.workunit.client.0.smithi071.stderr: -101> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f46c0) adding con mode: secure 2024-09-14T11:33:57.389 INFO:tasks.workunit.client.0.smithi071.stderr: -100> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f46c0) adding con mode: crc 2024-09-14T11:33:57.389 INFO:tasks.workunit.client.0.smithi071.stderr: -99> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f46c0) adding con mode: secure 2024-09-14T11:33:57.389 INFO:tasks.workunit.client.0.smithi071.stderr: -98> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f46c0) adding con mode: crc 2024-09-14T11:33:57.389 INFO:tasks.workunit.client.0.smithi071.stderr: -97> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f46c0) adding con mode: secure 2024-09-14T11:33:57.389 INFO:tasks.workunit.client.0.smithi071.stderr: -96> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:57.389 INFO:tasks.workunit.client.0.smithi071.stderr: -95> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:57.389 INFO:tasks.workunit.client.0.smithi071.stderr: -94> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:57.389 INFO:tasks.workunit.client.0.smithi071.stderr: -93> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 asok(0x55750dfa9d90) register_command cache list hook 0x55750e294470 2024-09-14T11:33:57.389 INFO:tasks.workunit.client.0.smithi071.stderr: -92> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 asok(0x55750dfa9d90) register_command cache inspect hook 0x55750e294470 2024-09-14T11:33:57.390 INFO:tasks.workunit.client.0.smithi071.stderr: -91> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 asok(0x55750dfa9d90) register_command cache erase hook 0x55750e294470 2024-09-14T11:33:57.390 INFO:tasks.workunit.client.0.smithi071.stderr: -90> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 asok(0x55750dfa9d90) register_command cache zap hook 0x55750e294470 2024-09-14T11:33:57.390 INFO:tasks.workunit.client.0.smithi071.stderr: -89> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 note: GC not initialized 2024-09-14T11:33:57.390 INFO:tasks.workunit.client.0.smithi071.stderr: -88> 2024-09-14T11:33:57.296+0000 7f8481fe3640 20 reqs_thread_entry: start 2024-09-14T11:33:57.390 INFO:tasks.workunit.client.0.smithi071.stderr: -87> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 asok(0x55750dfa9d90) register_command sync trace show hook 0x7f85c4004680 2024-09-14T11:33:57.390 INFO:tasks.workunit.client.0.smithi071.stderr: -86> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 asok(0x55750dfa9d90) register_command sync trace history hook 0x7f85c4004680 2024-09-14T11:33:57.390 INFO:tasks.workunit.client.0.smithi071.stderr: -85> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 asok(0x55750dfa9d90) register_command sync trace active hook 0x7f85c4004680 2024-09-14T11:33:57.390 INFO:tasks.workunit.client.0.smithi071.stderr: -84> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 asok(0x55750dfa9d90) register_command sync trace active_short hook 0x7f85c4004680 2024-09-14T11:33:57.390 INFO:tasks.workunit.client.0.smithi071.stderr: -83> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:57.390 INFO:tasks.workunit.client.0.smithi071.stderr: -82> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 20 Filter name: none 2024-09-14T11:33:57.390 INFO:tasks.workunit.client.0.smithi071.stderr: -81> 2024-09-14T11:33:57.296+0000 7f847affd640 20 reqs_thread_entry: start 2024-09-14T11:33:57.390 INFO:tasks.workunit.client.0.smithi071.stderr: -80> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:33:57.390 INFO:tasks.workunit.client.0.smithi071.stderr: -79> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.390 INFO:tasks.workunit.client.0.smithi071.stderr: -78> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:33:57.391 INFO:tasks.workunit.client.0.smithi071.stderr: -77> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:33:57.391 INFO:tasks.workunit.client.0.smithi071.stderr: -76> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:33:57.391 INFO:tasks.workunit.client.0.smithi071.stderr: -75> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 : miss 2024-09-14T11:33:57.391 INFO:tasks.workunit.client.0.smithi071.stderr: -74> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.391 INFO:tasks.workunit.client.0.smithi071.stderr: -73> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:33:57.391 INFO:tasks.workunit.client.0.smithi071.stderr: -72> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:33:57.391 INFO:tasks.workunit.client.0.smithi071.stderr: -71> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:33:57.391 INFO:tasks.workunit.client.0.smithi071.stderr: -70> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:57.391 INFO:tasks.workunit.client.0.smithi071.stderr: -69> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:33:57.391 INFO:tasks.workunit.client.0.smithi071.stderr: -68> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 2024-09-14T11:33:57.391 INFO:tasks.workunit.client.0.smithi071.stderr: -67> 2024-09-14T11:33:57.308+0000 7f85ce9089c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:33:57.391 INFO:tasks.workunit.client.0.smithi071.stderr: -66> 2024-09-14T11:33:57.308+0000 7f85ce9089c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:33:57.391 INFO:tasks.workunit.client.0.smithi071.stderr: -65> 2024-09-14T11:33:57.308+0000 7f85ce9089c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:33:57.391 INFO:tasks.workunit.client.0.smithi071.stderr: -64> 2024-09-14T11:33:57.308+0000 7f85ce9089c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18, ofs0, ns] 2024-09-14T11:33:57.392 INFO:tasks.workunit.client.0.smithi071.stderr: -63> 2024-09-14T11:33:57.308+0000 7f84aaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464424 cookie 93961237241296 notifier 7649 bl.length()=911 2024-09-14T11:33:57.392 INFO:tasks.workunit.client.0.smithi071.stderr: -62> 2024-09-14T11:33:57.308+0000 7f84aaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:33:57.392 INFO:tasks.workunit.client.0.smithi071.stderr: -61> 2024-09-14T11:33:57.308+0000 7f84aaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:33:57.392 INFO:tasks.workunit.client.0.smithi071.stderr: -60> 2024-09-14T11:33:57.308+0000 7f84aaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:33:57.392 INFO:tasks.workunit.client.0.smithi071.stderr: -59> 2024-09-14T11:33:57.308+0000 7f85ce9089c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_sources= new_sources= 2024-09-14T11:33:57.392 INFO:tasks.workunit.client.0.smithi071.stderr: -58> 2024-09-14T11:33:57.308+0000 7f85ce9089c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential sources added=[] removed=[] 2024-09-14T11:33:57.392 INFO:tasks.workunit.client.0.smithi071.stderr: -57> 2024-09-14T11:33:57.308+0000 7f85ce9089c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_dests= new_dests= 2024-09-14T11:33:57.392 INFO:tasks.workunit.client.0.smithi071.stderr: -56> 2024-09-14T11:33:57.308+0000 7f85ce9089c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential dests added=[] removed=[] 2024-09-14T11:33:57.392 INFO:tasks.workunit.client.0.smithi071.stderr: -55> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.0 2024-09-14T11:33:57.392 INFO:tasks.workunit.client.0.smithi071.stderr: -54> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.0 2024-09-14T11:33:57.392 INFO:tasks.workunit.client.0.smithi071.stderr: -53> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.1 2024-09-14T11:33:57.392 INFO:tasks.workunit.client.0.smithi071.stderr: -52> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.1 2024-09-14T11:33:57.392 INFO:tasks.workunit.client.0.smithi071.stderr: -51> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.2 2024-09-14T11:33:57.392 INFO:tasks.workunit.client.0.smithi071.stderr: -50> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.2 2024-09-14T11:33:57.393 INFO:tasks.workunit.client.0.smithi071.stderr: -49> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.3 2024-09-14T11:33:57.393 INFO:tasks.workunit.client.0.smithi071.stderr: -48> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.3 2024-09-14T11:33:57.393 INFO:tasks.workunit.client.0.smithi071.stderr: -47> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.4 2024-09-14T11:33:57.393 INFO:tasks.workunit.client.0.smithi071.stderr: -46> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.4 2024-09-14T11:33:57.393 INFO:tasks.workunit.client.0.smithi071.stderr: -45> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.5 2024-09-14T11:33:57.393 INFO:tasks.workunit.client.0.smithi071.stderr: -44> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.5 2024-09-14T11:33:57.393 INFO:tasks.workunit.client.0.smithi071.stderr: -43> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.6 2024-09-14T11:33:57.393 INFO:tasks.workunit.client.0.smithi071.stderr: -42> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.6 2024-09-14T11:33:57.393 INFO:tasks.workunit.client.0.smithi071.stderr: -41> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.7 2024-09-14T11:33:57.393 INFO:tasks.workunit.client.0.smithi071.stderr: -40> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.7 2024-09-14T11:33:57.393 INFO:tasks.workunit.client.0.smithi071.stderr: -39> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.8 2024-09-14T11:33:57.393 INFO:tasks.workunit.client.0.smithi071.stderr: -38> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.8 2024-09-14T11:33:57.393 INFO:tasks.workunit.client.0.smithi071.stderr: -37> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.9 2024-09-14T11:33:57.393 INFO:tasks.workunit.client.0.smithi071.stderr: -36> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.9 2024-09-14T11:33:57.393 INFO:tasks.workunit.client.0.smithi071.stderr: -35> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.10 2024-09-14T11:33:57.394 INFO:tasks.workunit.client.0.smithi071.stderr: -34> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.10 2024-09-14T11:33:57.394 INFO:tasks.workunit.client.0.smithi071.stderr: -33> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.11 2024-09-14T11:33:57.394 INFO:tasks.workunit.client.0.smithi071.stderr: -32> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.11 2024-09-14T11:33:57.394 INFO:tasks.workunit.client.0.smithi071.stderr: -31> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.12 2024-09-14T11:33:57.394 INFO:tasks.workunit.client.0.smithi071.stderr: -30> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.12 2024-09-14T11:33:57.394 INFO:tasks.workunit.client.0.smithi071.stderr: -29> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.13 2024-09-14T11:33:57.394 INFO:tasks.workunit.client.0.smithi071.stderr: -28> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.13 2024-09-14T11:33:57.394 INFO:tasks.workunit.client.0.smithi071.stderr: -27> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.0 2024-09-14T11:33:57.394 INFO:tasks.workunit.client.0.smithi071.stderr: -26> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.0 2024-09-14T11:33:57.394 INFO:tasks.workunit.client.0.smithi071.stderr: -25> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.1 2024-09-14T11:33:57.394 INFO:tasks.workunit.client.0.smithi071.stderr: -24> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.1 2024-09-14T11:33:57.394 INFO:tasks.workunit.client.0.smithi071.stderr: -23> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.2 2024-09-14T11:33:57.394 INFO:tasks.workunit.client.0.smithi071.stderr: -22> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.2 2024-09-14T11:33:57.394 INFO:tasks.workunit.client.0.smithi071.stderr: -21> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.3 2024-09-14T11:33:57.394 INFO:tasks.workunit.client.0.smithi071.stderr: -20> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.3 2024-09-14T11:33:57.395 INFO:tasks.workunit.client.0.smithi071.stderr: -19> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.4 2024-09-14T11:33:57.395 INFO:tasks.workunit.client.0.smithi071.stderr: -18> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.4 2024-09-14T11:33:57.395 INFO:tasks.workunit.client.0.smithi071.stderr: -17> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.5 2024-09-14T11:33:57.395 INFO:tasks.workunit.client.0.smithi071.stderr: -16> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.5 2024-09-14T11:33:57.395 INFO:tasks.workunit.client.0.smithi071.stderr: -15> 2024-09-14T11:33:57.324+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.6 2024-09-14T11:33:57.395 INFO:tasks.workunit.client.0.smithi071.stderr: -14> 2024-09-14T11:33:57.324+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.6 2024-09-14T11:33:57.395 INFO:tasks.workunit.client.0.smithi071.stderr: -13> 2024-09-14T11:33:57.324+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.7 2024-09-14T11:33:57.395 INFO:tasks.workunit.client.0.smithi071.stderr: -12> 2024-09-14T11:33:57.324+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.7 2024-09-14T11:33:57.395 INFO:tasks.workunit.client.0.smithi071.stderr: -11> 2024-09-14T11:33:57.324+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.8 2024-09-14T11:33:57.395 INFO:tasks.workunit.client.0.smithi071.stderr: -10> 2024-09-14T11:33:57.324+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.8 2024-09-14T11:33:57.395 INFO:tasks.workunit.client.0.smithi071.stderr: -9> 2024-09-14T11:33:57.324+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.9 2024-09-14T11:33:57.395 INFO:tasks.workunit.client.0.smithi071.stderr: -8> 2024-09-14T11:33:57.324+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.9 2024-09-14T11:33:57.395 INFO:tasks.workunit.client.0.smithi071.stderr: -7> 2024-09-14T11:33:57.324+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.10 2024-09-14T11:33:57.395 INFO:tasks.workunit.client.0.smithi071.stderr: -6> 2024-09-14T11:33:57.324+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.10 2024-09-14T11:33:57.395 INFO:tasks.workunit.client.0.smithi071.stderr: -5> 2024-09-14T11:33:57.328+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.11 2024-09-14T11:33:57.396 INFO:tasks.workunit.client.0.smithi071.stderr: -4> 2024-09-14T11:33:57.328+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.11 2024-09-14T11:33:57.396 INFO:tasks.workunit.client.0.smithi071.stderr: -3> 2024-09-14T11:33:57.328+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.12 2024-09-14T11:33:57.396 INFO:tasks.workunit.client.0.smithi071.stderr: -2> 2024-09-14T11:33:57.328+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.12 2024-09-14T11:33:57.396 INFO:tasks.workunit.client.0.smithi071.stderr: -1> 2024-09-14T11:33:57.332+0000 7f85ce9089c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f85ce9089c0 time 2024-09-14T11:33:57.336638+0000 2024-09-14T11:33:57.396 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:33:57.396 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:57.396 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:57.396 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f85d21e22eb] 2024-09-14T11:33:57.396 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f85d21e249f] 2024-09-14T11:33:57.396 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55750cc76c01] 2024-09-14T11:33:57.396 INFO:tasks.workunit.client.0.smithi071.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55750cc8b231] 2024-09-14T11:33:57.396 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55750cc8c884] 2024-09-14T11:33:57.396 INFO:tasks.workunit.client.0.smithi071.stderr: 6: main() 2024-09-14T11:33:57.396 INFO:tasks.workunit.client.0.smithi071.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f85d1048d90] 2024-09-14T11:33:57.397 INFO:tasks.workunit.client.0.smithi071.stderr: 8: __libc_start_main() 2024-09-14T11:33:57.397 INFO:tasks.workunit.client.0.smithi071.stderr: 9: _start() 2024-09-14T11:33:57.397 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:57.397 INFO:tasks.workunit.client.0.smithi071.stderr: 0> 2024-09-14T11:33:57.336+0000 7f85ce9089c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:33:57.397 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f85ce9089c0 thread_name:radosgw-admin 2024-09-14T11:33:57.397 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:57.397 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:57.397 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f85d1061520] 2024-09-14T11:33:57.397 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:33:57.397 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:33:57.397 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:33:57.397 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f85d21e2345] 2024-09-14T11:33:57.397 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f85d21e249f] 2024-09-14T11:33:57.397 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55750cc76c01] 2024-09-14T11:33:57.397 INFO:tasks.workunit.client.0.smithi071.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55750cc8b231] 2024-09-14T11:33:57.398 INFO:tasks.workunit.client.0.smithi071.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55750cc8c884] 2024-09-14T11:33:57.398 INFO:tasks.workunit.client.0.smithi071.stderr: 10: main() 2024-09-14T11:33:57.398 INFO:tasks.workunit.client.0.smithi071.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f85d1048d90] 2024-09-14T11:33:57.398 INFO:tasks.workunit.client.0.smithi071.stderr: 12: __libc_start_main() 2024-09-14T11:33:57.398 INFO:tasks.workunit.client.0.smithi071.stderr: 13: _start() 2024-09-14T11:33:57.398 INFO:tasks.workunit.client.0.smithi071.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:33:57.398 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:57.398 INFO:tasks.workunit.client.0.smithi071.stderr:--- logging levels --- 2024-09-14T11:33:57.398 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 none 2024-09-14T11:33:57.398 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 lockdep 2024-09-14T11:33:57.398 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 context 2024-09-14T11:33:57.398 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 crush 2024-09-14T11:33:57.398 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds 2024-09-14T11:33:57.398 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_balancer 2024-09-14T11:33:57.399 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_locker 2024-09-14T11:33:57.399 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log 2024-09-14T11:33:57.399 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log_expire 2024-09-14T11:33:57.399 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_migrator 2024-09-14T11:33:57.399 INFO:tasks.workunit.client.0.smithi071.stderr: 3/ 5 mds_quiesce 2024-09-14T11:33:57.399 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 buffer 2024-09-14T11:33:57.399 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 timer 2024-09-14T11:33:57.399 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 filer 2024-09-14T11:33:57.399 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 striper 2024-09-14T11:33:57.399 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 objecter 2024-09-14T11:33:57.399 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rados 2024-09-14T11:33:57.399 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd 2024-09-14T11:33:57.399 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_mirror 2024-09-14T11:33:57.399 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_replay 2024-09-14T11:33:57.400 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_pwl 2024-09-14T11:33:57.400 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 journaler 2024-09-14T11:33:57.400 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objectcacher 2024-09-14T11:33:57.400 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:33:57.400 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 client 2024-09-14T11:33:57.400 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 osd 2024-09-14T11:33:57.400 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 optracker 2024-09-14T11:33:57.400 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objclass 2024-09-14T11:33:57.400 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 filestore 2024-09-14T11:33:57.400 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 journal 2024-09-14T11:33:57.400 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 ms 2024-09-14T11:33:57.400 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mon 2024-09-14T11:33:57.400 INFO:tasks.workunit.client.0.smithi071.stderr: 0/10 monc 2024-09-14T11:33:57.400 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 paxos 2024-09-14T11:33:57.401 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 tp 2024-09-14T11:33:57.401 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 auth 2024-09-14T11:33:57.401 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 crypto 2024-09-14T11:33:57.401 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 finisher 2024-09-14T11:33:57.401 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 reserver 2024-09-14T11:33:57.401 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 heartbeatmap 2024-09-14T11:33:57.401 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 perfcounter 2024-09-14T11:33:57.401 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw 2024-09-14T11:33:57.401 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_sync 2024-09-14T11:33:57.401 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_datacache 2024-09-14T11:33:57.401 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_access 2024-09-14T11:33:57.401 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:33:57.401 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_flight 2024-09-14T11:33:57.401 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:33:57.402 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw_notification 2024-09-14T11:33:57.402 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 javaclient 2024-09-14T11:33:57.402 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 asok 2024-09-14T11:33:57.402 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 throttle 2024-09-14T11:33:57.402 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 refs 2024-09-14T11:33:57.402 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 compressor 2024-09-14T11:33:57.402 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluestore 2024-09-14T11:33:57.402 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluefs 2024-09-14T11:33:57.402 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 bdev 2024-09-14T11:33:57.402 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 kstore 2024-09-14T11:33:57.402 INFO:tasks.workunit.client.0.smithi071.stderr: 4/ 5 rocksdb 2024-09-14T11:33:57.402 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 fuse 2024-09-14T11:33:57.402 INFO:tasks.workunit.client.0.smithi071.stderr: 2/ 5 mgr 2024-09-14T11:33:57.402 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mgrc 2024-09-14T11:33:57.403 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 dpdk 2024-09-14T11:33:57.403 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 eventtrace 2024-09-14T11:33:57.403 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 prioritycache 2024-09-14T11:33:57.403 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 test 2024-09-14T11:33:57.403 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:33:57.403 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephsqlite 2024-09-14T11:33:57.403 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:33:57.403 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore 2024-09-14T11:33:57.403 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_onode 2024-09-14T11:33:57.403 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_odata 2024-09-14T11:33:57.403 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_omap 2024-09-14T11:33:57.403 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_tm 2024-09-14T11:33:57.403 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_t 2024-09-14T11:33:57.403 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:33:57.404 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_epm 2024-09-14T11:33:57.404 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_lba 2024-09-14T11:33:57.404 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:33:57.404 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cache 2024-09-14T11:33:57.404 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_journal 2024-09-14T11:33:57.404 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_device 2024-09-14T11:33:57.404 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_backref 2024-09-14T11:33:57.404 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 alienstore 2024-09-14T11:33:57.404 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mclock 2024-09-14T11:33:57.404 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cyanstore 2024-09-14T11:33:57.404 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 ceph_exporter 2024-09-14T11:33:57.404 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 memstore 2024-09-14T11:33:57.404 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 trace 2024-09-14T11:33:57.404 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 ceph_dedup 2024-09-14T11:33:57.405 INFO:tasks.workunit.client.0.smithi071.stderr: -2/-2 (syslog threshold) 2024-09-14T11:33:57.405 INFO:tasks.workunit.client.0.smithi071.stderr: 99/99 (stderr threshold) 2024-09-14T11:33:57.405 INFO:tasks.workunit.client.0.smithi071.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:33:57.405 INFO:tasks.workunit.client.0.smithi071.stderr: 7f847affd640 / http_manager 2024-09-14T11:33:57.405 INFO:tasks.workunit.client.0.smithi071.stderr: 7f8481fe3640 / http_manager 2024-09-14T11:33:57.405 INFO:tasks.workunit.client.0.smithi071.stderr: 7f8482fe5640 / rgw_dt_lg_renew 2024-09-14T11:33:57.405 INFO:tasks.workunit.client.0.smithi071.stderr: 7f84a9ffb640 / ms_dispatch 2024-09-14T11:33:57.405 INFO:tasks.workunit.client.0.smithi071.stderr: 7f84aaffd640 / io_context_pool 2024-09-14T11:33:57.405 INFO:tasks.workunit.client.0.smithi071.stderr: 7f84ab7fe640 / io_context_pool 2024-09-14T11:33:57.405 INFO:tasks.workunit.client.0.smithi071.stderr: 7f84b1ffb640 / ms_dispatch 2024-09-14T11:33:57.405 INFO:tasks.workunit.client.0.smithi071.stderr: 7f84b8e09640 / ms_dispatch 2024-09-14T11:33:57.405 INFO:tasks.workunit.client.0.smithi071.stderr: 7f84ba60c640 / io_context_pool 2024-09-14T11:33:57.405 INFO:tasks.workunit.client.0.smithi071.stderr: 7f85cbc0d640 / msgr-worker-2 2024-09-14T11:33:57.405 INFO:tasks.workunit.client.0.smithi071.stderr: 7f85cc40e640 / msgr-worker-1 2024-09-14T11:33:57.406 INFO:tasks.workunit.client.0.smithi071.stderr: 7f85ccc0f640 / msgr-worker-0 2024-09-14T11:33:57.406 INFO:tasks.workunit.client.0.smithi071.stderr: 7f85cd410640 / io_context_pool 2024-09-14T11:33:57.406 INFO:tasks.workunit.client.0.smithi071.stderr: 7f85ce9089c0 / radosgw-admin 2024-09-14T11:33:57.406 INFO:tasks.workunit.client.0.smithi071.stderr: max_recent 500 2024-09-14T11:33:57.406 INFO:tasks.workunit.client.0.smithi071.stderr: max_new 1000 2024-09-14T11:33:57.406 INFO:tasks.workunit.client.0.smithi071.stderr: log_file /var/log/ceph/ceph-client.admin.137977.log 2024-09-14T11:33:57.406 INFO:tasks.workunit.client.0.smithi071.stderr:--- end dump of recent events --- 2024-09-14T11:33:57.406 INFO:tasks.workunit.client.0.smithi071.stderr:--- begin dump of recent events --- 2024-09-14T11:33:57.406 INFO:tasks.workunit.client.0.smithi071.stderr: -499> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 5 AuthRegistry(0x55750e1b71b0) adding con mode: crc 2024-09-14T11:33:57.406 INFO:tasks.workunit.client.0.smithi071.stderr: -498> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 5 AuthRegistry(0x55750e1b71b0) adding con mode: secure 2024-09-14T11:33:57.406 INFO:tasks.workunit.client.0.smithi071.stderr: -497> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:57.406 INFO:tasks.workunit.client.0.smithi071.stderr: -496> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:57.406 INFO:tasks.workunit.client.0.smithi071.stderr: -495> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 5 asok(0x55750dfa9d90) register_command rotate-key hook 0x55750e1b72f8 2024-09-14T11:33:57.406 INFO:tasks.workunit.client.0.smithi071.stderr: -494> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 10 monclient: _reopen_session rank -1 2024-09-14T11:33:57.406 INFO:tasks.workunit.client.0.smithi071.stderr: -493> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:33:57.407 INFO:tasks.workunit.client.0.smithi071.stderr: -492> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 10 monclient(hunting): picked mon.noname-a con 0x55750e043ac0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:33:57.407 INFO:tasks.workunit.client.0.smithi071.stderr: -491> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 10 monclient(hunting): picked mon.noname-c con 0x55750e044870 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:33:57.407 INFO:tasks.workunit.client.0.smithi071.stderr: -490> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 10 monclient(hunting): picked mon.noname-b con 0x55750e0fd6b0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:33:57.407 INFO:tasks.workunit.client.0.smithi071.stderr: -489> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:57.407 INFO:tasks.workunit.client.0.smithi071.stderr: -488> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:57.407 INFO:tasks.workunit.client.0.smithi071.stderr: -487> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:57.407 INFO:tasks.workunit.client.0.smithi071.stderr: -486> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 10 monclient(hunting): _renew_subs 2024-09-14T11:33:57.407 INFO:tasks.workunit.client.0.smithi071.stderr: -485> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 10 monclient(hunting): authenticate will time out at 2449.337179s 2024-09-14T11:33:57.407 INFO:tasks.workunit.client.0.smithi071.stderr: -484> 2024-09-14T11:33:57.216+0000 7f85cc40e640 10 monclient(hunting): get_auth_request con 0x55750e043ac0 auth_method 0 2024-09-14T11:33:57.407 INFO:tasks.workunit.client.0.smithi071.stderr: -483> 2024-09-14T11:33:57.216+0000 7f85cc40e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:57.407 INFO:tasks.workunit.client.0.smithi071.stderr: -482> 2024-09-14T11:33:57.216+0000 7f85cc40e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:57.407 INFO:tasks.workunit.client.0.smithi071.stderr: -481> 2024-09-14T11:33:57.216+0000 7f85cc40e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:57.407 INFO:tasks.workunit.client.0.smithi071.stderr: -480> 2024-09-14T11:33:57.216+0000 7f85cbc0d640 10 monclient(hunting): get_auth_request con 0x55750e044870 auth_method 0 2024-09-14T11:33:57.407 INFO:tasks.workunit.client.0.smithi071.stderr: -479> 2024-09-14T11:33:57.216+0000 7f85cbc0d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:57.407 INFO:tasks.workunit.client.0.smithi071.stderr: -478> 2024-09-14T11:33:57.216+0000 7f85cbc0d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:57.408 INFO:tasks.workunit.client.0.smithi071.stderr: -477> 2024-09-14T11:33:57.216+0000 7f85cbc0d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:57.408 INFO:tasks.workunit.client.0.smithi071.stderr: -476> 2024-09-14T11:33:57.216+0000 7f85cbc0d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:57.408 INFO:tasks.workunit.client.0.smithi071.stderr: -475> 2024-09-14T11:33:57.216+0000 7f85cbc0d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:57.408 INFO:tasks.workunit.client.0.smithi071.stderr: -474> 2024-09-14T11:33:57.216+0000 7f85cbc0d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:57.408 INFO:tasks.workunit.client.0.smithi071.stderr: -473> 2024-09-14T11:33:57.216+0000 7f85cc40e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:57.408 INFO:tasks.workunit.client.0.smithi071.stderr: -472> 2024-09-14T11:33:57.216+0000 7f85cc40e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:57.408 INFO:tasks.workunit.client.0.smithi071.stderr: -471> 2024-09-14T11:33:57.216+0000 7f85cc40e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:57.408 INFO:tasks.workunit.client.0.smithi071.stderr: -470> 2024-09-14T11:33:57.216+0000 7f85cbc0d640 10 monclient(hunting): handle_auth_done global_id 7640 payload 824 2024-09-14T11:33:57.408 INFO:tasks.workunit.client.0.smithi071.stderr: -469> 2024-09-14T11:33:57.216+0000 7f85cbc0d640 10 monclient: _finish_hunting 0 2024-09-14T11:33:57.408 INFO:tasks.workunit.client.0.smithi071.stderr: -468> 2024-09-14T11:33:57.216+0000 7f85cbc0d640 1 monclient: found mon.noname-c 2024-09-14T11:33:57.408 INFO:tasks.workunit.client.0.smithi071.stderr: -467> 2024-09-14T11:33:57.216+0000 7f85cbc0d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:33:57.408 INFO:tasks.workunit.client.0.smithi071.stderr: -466> 2024-09-14T11:33:57.216+0000 7f84b8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:57.408 INFO:tasks.workunit.client.0.smithi071.stderr: -465> 2024-09-14T11:33:57.216+0000 7f84b8e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:57.408 INFO:tasks.workunit.client.0.smithi071.stderr: -464> 2024-09-14T11:33:57.216+0000 7f84b8e09640 10 monclient: dump: 2024-09-14T11:33:57.409 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:33:57.409 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:33:57.409 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:57.409 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:57.409 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:57.409 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:57.409 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:33:57.409 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:33:57.409 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:33:57.409 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:57.409 INFO:tasks.workunit.client.0.smithi071.stderr: -463> 2024-09-14T11:33:57.216+0000 7f84b8e09640 10 monclient: _finish_auth 0 2024-09-14T11:33:57.409 INFO:tasks.workunit.client.0.smithi071.stderr: -462> 2024-09-14T11:33:57.216+0000 7f84b8e09640 10 monclient: _check_auth_tickets 2024-09-14T11:33:57.409 INFO:tasks.workunit.client.0.smithi071.stderr: -461> 2024-09-14T11:33:57.216+0000 7f84b8e09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:57.410 INFO:tasks.workunit.client.0.smithi071.stderr: -460> 2024-09-14T11:33:57.216+0000 7f84b8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:57.410 INFO:tasks.workunit.client.0.smithi071.stderr: -459> 2024-09-14T11:33:57.216+0000 7f84b8e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:57.410 INFO:tasks.workunit.client.0.smithi071.stderr: -458> 2024-09-14T11:33:57.216+0000 7f84b8e09640 10 monclient: dump: 2024-09-14T11:33:57.410 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:33:57.410 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:33:57.410 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:57.410 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:57.410 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:57.410 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:57.410 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:33:57.410 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:33:57.410 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:33:57.410 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:57.410 INFO:tasks.workunit.client.0.smithi071.stderr: -457> 2024-09-14T11:33:57.216+0000 7f84ba60c640 4 set_mon_vals no callback set 2024-09-14T11:33:57.410 INFO:tasks.workunit.client.0.smithi071.stderr: -456> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 5 monclient: authenticate success, global_id 7640 2024-09-14T11:33:57.411 INFO:tasks.workunit.client.0.smithi071.stderr: -455> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 10 monclient: _renew_subs 2024-09-14T11:33:57.411 INFO:tasks.workunit.client.0.smithi071.stderr: -454> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:33:57.411 INFO:tasks.workunit.client.0.smithi071.stderr: -453> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 10 monclient: _renew_subs 2024-09-14T11:33:57.411 INFO:tasks.workunit.client.0.smithi071.stderr: -452> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:33:57.411 INFO:tasks.workunit.client.0.smithi071.stderr: -451> 2024-09-14T11:33:57.216+0000 7f85ce9089c0 1 librados: init done 2024-09-14T11:33:57.411 INFO:tasks.workunit.client.0.smithi071.stderr: -450> 2024-09-14T11:33:57.220+0000 7f84b8e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:57.411 INFO:tasks.workunit.client.0.smithi071.stderr: -449> 2024-09-14T11:33:57.220+0000 7f84b8e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:33:57.411 INFO:tasks.workunit.client.0.smithi071.stderr: -448> 2024-09-14T11:33:57.220+0000 7f84b8e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:33:57.411 INFO:tasks.workunit.client.0.smithi071.stderr: -447> 2024-09-14T11:33:57.220+0000 7f85cc40e640 10 monclient: get_auth_request con 0x7f84b40718d0 auth_method 0 2024-09-14T11:33:57.411 INFO:tasks.workunit.client.0.smithi071.stderr: -446> 2024-09-14T11:33:57.220+0000 7f85ccc0f640 10 monclient: get_auth_request con 0x55750e1f71d0 auth_method 0 2024-09-14T11:33:57.411 INFO:tasks.workunit.client.0.smithi071.stderr: -445> 2024-09-14T11:33:57.220+0000 7f85cc40e640 10 monclient: get_auth_request con 0x55750e201a70 auth_method 0 2024-09-14T11:33:57.411 INFO:tasks.workunit.client.0.smithi071.stderr: -444> 2024-09-14T11:33:57.220+0000 7f85cbc0d640 10 monclient: get_auth_request con 0x55750e206140 auth_method 0 2024-09-14T11:33:57.411 INFO:tasks.workunit.client.0.smithi071.stderr: -443> 2024-09-14T11:33:57.224+0000 7f85ccc0f640 10 monclient: get_auth_request con 0x55750e205850 auth_method 0 2024-09-14T11:33:57.411 INFO:tasks.workunit.client.0.smithi071.stderr: -442> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 10 monclient: build_initial_monmap 2024-09-14T11:33:57.412 INFO:tasks.workunit.client.0.smithi071.stderr: -441> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 1 build_initial for_mkfs: 0 2024-09-14T11:33:57.412 INFO:tasks.workunit.client.0.smithi071.stderr: -440> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 10 monclient: monmap: 2024-09-14T11:33:57.412 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:33:57.412 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:57.412 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:33:57.412 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:33:57.412 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:57.412 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:57.412 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:33:57.412 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:33:57.412 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:33:57.412 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:57.412 INFO:tasks.workunit.client.0.smithi071.stderr: -439> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20e1a0) adding auth protocol: cephx 2024-09-14T11:33:57.412 INFO:tasks.workunit.client.0.smithi071.stderr: -438> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20e1a0) adding auth protocol: cephx 2024-09-14T11:33:57.413 INFO:tasks.workunit.client.0.smithi071.stderr: -437> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20e1a0) adding auth protocol: cephx 2024-09-14T11:33:57.413 INFO:tasks.workunit.client.0.smithi071.stderr: -436> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20e1a0) adding con mode: secure 2024-09-14T11:33:57.413 INFO:tasks.workunit.client.0.smithi071.stderr: -435> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20e1a0) adding con mode: crc 2024-09-14T11:33:57.413 INFO:tasks.workunit.client.0.smithi071.stderr: -434> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20e1a0) adding con mode: secure 2024-09-14T11:33:57.413 INFO:tasks.workunit.client.0.smithi071.stderr: -433> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20e1a0) adding con mode: crc 2024-09-14T11:33:57.413 INFO:tasks.workunit.client.0.smithi071.stderr: -432> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20e1a0) adding con mode: secure 2024-09-14T11:33:57.413 INFO:tasks.workunit.client.0.smithi071.stderr: -431> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20e1a0) adding con mode: crc 2024-09-14T11:33:57.413 INFO:tasks.workunit.client.0.smithi071.stderr: -430> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20e1a0) adding con mode: crc 2024-09-14T11:33:57.413 INFO:tasks.workunit.client.0.smithi071.stderr: -429> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20e1a0) adding con mode: secure 2024-09-14T11:33:57.413 INFO:tasks.workunit.client.0.smithi071.stderr: -428> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20e1a0) adding con mode: crc 2024-09-14T11:33:57.413 INFO:tasks.workunit.client.0.smithi071.stderr: -427> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20e1a0) adding con mode: secure 2024-09-14T11:33:57.413 INFO:tasks.workunit.client.0.smithi071.stderr: -426> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20e1a0) adding con mode: crc 2024-09-14T11:33:57.413 INFO:tasks.workunit.client.0.smithi071.stderr: -425> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20e1a0) adding con mode: secure 2024-09-14T11:33:57.413 INFO:tasks.workunit.client.0.smithi071.stderr: -424> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:57.414 INFO:tasks.workunit.client.0.smithi071.stderr: -423> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 asok(0x55750dfa9d90) register_command objecter_requests cmddesc objecter_requests hook 0x55750e211b30 EEXIST 2024-09-14T11:33:57.414 INFO:tasks.workunit.client.0.smithi071.stderr: -422> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 10 monclient: init 2024-09-14T11:33:57.414 INFO:tasks.workunit.client.0.smithi071.stderr: -421> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20d098) adding auth protocol: cephx 2024-09-14T11:33:57.414 INFO:tasks.workunit.client.0.smithi071.stderr: -420> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20d098) adding auth protocol: cephx 2024-09-14T11:33:57.414 INFO:tasks.workunit.client.0.smithi071.stderr: -419> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20d098) adding auth protocol: cephx 2024-09-14T11:33:57.414 INFO:tasks.workunit.client.0.smithi071.stderr: -418> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20d098) adding con mode: secure 2024-09-14T11:33:57.414 INFO:tasks.workunit.client.0.smithi071.stderr: -417> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20d098) adding con mode: crc 2024-09-14T11:33:57.414 INFO:tasks.workunit.client.0.smithi071.stderr: -416> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20d098) adding con mode: secure 2024-09-14T11:33:57.414 INFO:tasks.workunit.client.0.smithi071.stderr: -415> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20d098) adding con mode: crc 2024-09-14T11:33:57.414 INFO:tasks.workunit.client.0.smithi071.stderr: -414> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20d098) adding con mode: secure 2024-09-14T11:33:57.414 INFO:tasks.workunit.client.0.smithi071.stderr: -413> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20d098) adding con mode: crc 2024-09-14T11:33:57.414 INFO:tasks.workunit.client.0.smithi071.stderr: -412> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20d098) adding con mode: crc 2024-09-14T11:33:57.414 INFO:tasks.workunit.client.0.smithi071.stderr: -411> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20d098) adding con mode: secure 2024-09-14T11:33:57.414 INFO:tasks.workunit.client.0.smithi071.stderr: -410> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20d098) adding con mode: crc 2024-09-14T11:33:57.415 INFO:tasks.workunit.client.0.smithi071.stderr: -409> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20d098) adding con mode: secure 2024-09-14T11:33:57.415 INFO:tasks.workunit.client.0.smithi071.stderr: -408> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20d098) adding con mode: crc 2024-09-14T11:33:57.415 INFO:tasks.workunit.client.0.smithi071.stderr: -407> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 AuthRegistry(0x55750e20d098) adding con mode: secure 2024-09-14T11:33:57.415 INFO:tasks.workunit.client.0.smithi071.stderr: -406> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:57.415 INFO:tasks.workunit.client.0.smithi071.stderr: -405> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:57.415 INFO:tasks.workunit.client.0.smithi071.stderr: -404> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 5 asok(0x55750dfa9d90) register_command rotate-key cmddesc rotate-key hook 0x55750e20d1e0 EEXIST 2024-09-14T11:33:57.415 INFO:tasks.workunit.client.0.smithi071.stderr: -403> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 10 monclient: _reopen_session rank -1 2024-09-14T11:33:57.415 INFO:tasks.workunit.client.0.smithi071.stderr: -402> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:33:57.415 INFO:tasks.workunit.client.0.smithi071.stderr: -401> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 10 monclient(hunting): picked mon.noname-b con 0x55750e235ce0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:33:57.415 INFO:tasks.workunit.client.0.smithi071.stderr: -400> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 10 monclient(hunting): picked mon.noname-a con 0x55750e235610 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:33:57.415 INFO:tasks.workunit.client.0.smithi071.stderr: -399> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 10 monclient(hunting): picked mon.noname-c con 0x55750e233ff0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:33:57.415 INFO:tasks.workunit.client.0.smithi071.stderr: -398> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:57.415 INFO:tasks.workunit.client.0.smithi071.stderr: -397> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:57.415 INFO:tasks.workunit.client.0.smithi071.stderr: -396> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:57.416 INFO:tasks.workunit.client.0.smithi071.stderr: -395> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 10 monclient(hunting): _renew_subs 2024-09-14T11:33:57.416 INFO:tasks.workunit.client.0.smithi071.stderr: -394> 2024-09-14T11:33:57.224+0000 7f85ce9089c0 10 monclient(hunting): authenticate will time out at 2449.347742s 2024-09-14T11:33:57.416 INFO:tasks.workunit.client.0.smithi071.stderr: -393> 2024-09-14T11:33:57.224+0000 7f85cc40e640 10 monclient(hunting): get_auth_request con 0x55750e233ff0 auth_method 0 2024-09-14T11:33:57.416 INFO:tasks.workunit.client.0.smithi071.stderr: -392> 2024-09-14T11:33:57.224+0000 7f85cc40e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:57.416 INFO:tasks.workunit.client.0.smithi071.stderr: -391> 2024-09-14T11:33:57.224+0000 7f85cc40e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:57.416 INFO:tasks.workunit.client.0.smithi071.stderr: -390> 2024-09-14T11:33:57.224+0000 7f85cc40e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:57.416 INFO:tasks.workunit.client.0.smithi071.stderr: -389> 2024-09-14T11:33:57.224+0000 7f85ccc0f640 10 monclient(hunting): get_auth_request con 0x55750e235610 auth_method 0 2024-09-14T11:33:57.416 INFO:tasks.workunit.client.0.smithi071.stderr: -388> 2024-09-14T11:33:57.224+0000 7f85ccc0f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:57.416 INFO:tasks.workunit.client.0.smithi071.stderr: -387> 2024-09-14T11:33:57.224+0000 7f85ccc0f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:57.416 INFO:tasks.workunit.client.0.smithi071.stderr: -386> 2024-09-14T11:33:57.224+0000 7f85ccc0f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:57.416 INFO:tasks.workunit.client.0.smithi071.stderr: -385> 2024-09-14T11:33:57.228+0000 7f85cc40e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:57.416 INFO:tasks.workunit.client.0.smithi071.stderr: -384> 2024-09-14T11:33:57.228+0000 7f85cc40e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:57.416 INFO:tasks.workunit.client.0.smithi071.stderr: -383> 2024-09-14T11:33:57.228+0000 7f85cc40e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:57.416 INFO:tasks.workunit.client.0.smithi071.stderr: -382> 2024-09-14T11:33:57.228+0000 7f85cbc0d640 10 monclient(hunting): get_auth_request con 0x55750e235ce0 auth_method 0 2024-09-14T11:33:57.417 INFO:tasks.workunit.client.0.smithi071.stderr: -381> 2024-09-14T11:33:57.228+0000 7f85cbc0d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:57.417 INFO:tasks.workunit.client.0.smithi071.stderr: -380> 2024-09-14T11:33:57.228+0000 7f85cbc0d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:57.417 INFO:tasks.workunit.client.0.smithi071.stderr: -379> 2024-09-14T11:33:57.228+0000 7f85cbc0d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:57.417 INFO:tasks.workunit.client.0.smithi071.stderr: -378> 2024-09-14T11:33:57.228+0000 7f85ccc0f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:57.417 INFO:tasks.workunit.client.0.smithi071.stderr: -377> 2024-09-14T11:33:57.228+0000 7f85ccc0f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:57.417 INFO:tasks.workunit.client.0.smithi071.stderr: -376> 2024-09-14T11:33:57.228+0000 7f85ccc0f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:57.417 INFO:tasks.workunit.client.0.smithi071.stderr: -375> 2024-09-14T11:33:57.228+0000 7f85cc40e640 10 monclient(hunting): handle_auth_done global_id 7643 payload 824 2024-09-14T11:33:57.417 INFO:tasks.workunit.client.0.smithi071.stderr: -374> 2024-09-14T11:33:57.228+0000 7f85cc40e640 10 monclient: _finish_hunting 0 2024-09-14T11:33:57.417 INFO:tasks.workunit.client.0.smithi071.stderr: -373> 2024-09-14T11:33:57.228+0000 7f85cc40e640 1 monclient: found mon.noname-c 2024-09-14T11:33:57.417 INFO:tasks.workunit.client.0.smithi071.stderr: -372> 2024-09-14T11:33:57.228+0000 7f85cc40e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:33:57.417 INFO:tasks.workunit.client.0.smithi071.stderr: -371> 2024-09-14T11:33:57.228+0000 7f84b1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:57.417 INFO:tasks.workunit.client.0.smithi071.stderr: -370> 2024-09-14T11:33:57.228+0000 7f84b1ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:57.417 INFO:tasks.workunit.client.0.smithi071.stderr: -369> 2024-09-14T11:33:57.228+0000 7f84b1ffb640 10 monclient: dump: 2024-09-14T11:33:57.418 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:33:57.418 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:33:57.418 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:57.418 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:57.418 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:57.418 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:57.418 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:33:57.418 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:33:57.418 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:33:57.418 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:57.418 INFO:tasks.workunit.client.0.smithi071.stderr: -368> 2024-09-14T11:33:57.228+0000 7f84b1ffb640 10 monclient: _finish_auth 0 2024-09-14T11:33:57.418 INFO:tasks.workunit.client.0.smithi071.stderr: -367> 2024-09-14T11:33:57.228+0000 7f84b1ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:33:57.418 INFO:tasks.workunit.client.0.smithi071.stderr: -366> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 monclient: authenticate success, global_id 7643 2024-09-14T11:33:57.418 INFO:tasks.workunit.client.0.smithi071.stderr: -365> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 10 monclient: _renew_subs 2024-09-14T11:33:57.419 INFO:tasks.workunit.client.0.smithi071.stderr: -364> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:33:57.419 INFO:tasks.workunit.client.0.smithi071.stderr: -363> 2024-09-14T11:33:57.228+0000 7f84b1ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:57.419 INFO:tasks.workunit.client.0.smithi071.stderr: -362> 2024-09-14T11:33:57.228+0000 7f84b1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:57.419 INFO:tasks.workunit.client.0.smithi071.stderr: -361> 2024-09-14T11:33:57.228+0000 7f84b1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:57.419 INFO:tasks.workunit.client.0.smithi071.stderr: -360> 2024-09-14T11:33:57.228+0000 7f84b1ffb640 10 monclient: dump: 2024-09-14T11:33:57.419 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:33:57.419 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:33:57.419 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:57.419 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:57.419 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:57.419 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:57.419 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:33:57.419 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:33:57.419 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:33:57.419 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:57.420 INFO:tasks.workunit.client.0.smithi071.stderr: -359> 2024-09-14T11:33:57.228+0000 7f85cd410640 4 set_mon_vals no callback set 2024-09-14T11:33:57.420 INFO:tasks.workunit.client.0.smithi071.stderr: -358> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 10 monclient: _renew_subs 2024-09-14T11:33:57.420 INFO:tasks.workunit.client.0.smithi071.stderr: -357> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:33:57.420 INFO:tasks.workunit.client.0.smithi071.stderr: -356> 2024-09-14T11:33:57.228+0000 7f84b1ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:57.420 INFO:tasks.workunit.client.0.smithi071.stderr: -355> 2024-09-14T11:33:57.228+0000 7f84b1ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:33:57.420 INFO:tasks.workunit.client.0.smithi071.stderr: -354> 2024-09-14T11:33:57.228+0000 7f84b1ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:33:57.420 INFO:tasks.workunit.client.0.smithi071.stderr: -353> 2024-09-14T11:33:57.228+0000 7f85cbc0d640 10 monclient: get_auth_request con 0x7f84a40717e0 auth_method 0 2024-09-14T11:33:57.420 INFO:tasks.workunit.client.0.smithi071.stderr: -352> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 10 monclient: get_monmap_and_config 2024-09-14T11:33:57.420 INFO:tasks.workunit.client.0.smithi071.stderr: -351> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 10 monclient: build_initial_monmap 2024-09-14T11:33:57.420 INFO:tasks.workunit.client.0.smithi071.stderr: -350> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 1 build_initial for_mkfs: 0 2024-09-14T11:33:57.420 INFO:tasks.workunit.client.0.smithi071.stderr: -349> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 10 monclient: monmap: 2024-09-14T11:33:57.420 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:33:57.420 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:57.420 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:33:57.421 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:33:57.421 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:57.421 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:57.421 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:33:57.421 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:33:57.421 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:33:57.421 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:57.421 INFO:tasks.workunit.client.0.smithi071.stderr: -348> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x55750e2555c0) adding auth protocol: cephx 2024-09-14T11:33:57.421 INFO:tasks.workunit.client.0.smithi071.stderr: -347> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x55750e2555c0) adding auth protocol: cephx 2024-09-14T11:33:57.421 INFO:tasks.workunit.client.0.smithi071.stderr: -346> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x55750e2555c0) adding auth protocol: cephx 2024-09-14T11:33:57.421 INFO:tasks.workunit.client.0.smithi071.stderr: -345> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x55750e2555c0) adding con mode: secure 2024-09-14T11:33:57.421 INFO:tasks.workunit.client.0.smithi071.stderr: -344> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x55750e2555c0) adding con mode: crc 2024-09-14T11:33:57.421 INFO:tasks.workunit.client.0.smithi071.stderr: -343> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x55750e2555c0) adding con mode: secure 2024-09-14T11:33:57.422 INFO:tasks.workunit.client.0.smithi071.stderr: -342> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x55750e2555c0) adding con mode: crc 2024-09-14T11:33:57.422 INFO:tasks.workunit.client.0.smithi071.stderr: -341> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x55750e2555c0) adding con mode: secure 2024-09-14T11:33:57.422 INFO:tasks.workunit.client.0.smithi071.stderr: -340> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x55750e2555c0) adding con mode: crc 2024-09-14T11:33:57.422 INFO:tasks.workunit.client.0.smithi071.stderr: -339> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x55750e2555c0) adding con mode: crc 2024-09-14T11:33:57.422 INFO:tasks.workunit.client.0.smithi071.stderr: -338> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x55750e2555c0) adding con mode: secure 2024-09-14T11:33:57.422 INFO:tasks.workunit.client.0.smithi071.stderr: -337> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x55750e2555c0) adding con mode: crc 2024-09-14T11:33:57.422 INFO:tasks.workunit.client.0.smithi071.stderr: -336> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x55750e2555c0) adding con mode: secure 2024-09-14T11:33:57.422 INFO:tasks.workunit.client.0.smithi071.stderr: -335> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x55750e2555c0) adding con mode: crc 2024-09-14T11:33:57.422 INFO:tasks.workunit.client.0.smithi071.stderr: -334> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x55750e2555c0) adding con mode: secure 2024-09-14T11:33:57.422 INFO:tasks.workunit.client.0.smithi071.stderr: -333> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:57.422 INFO:tasks.workunit.client.0.smithi071.stderr: -332> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 10 monclient: init 2024-09-14T11:33:57.422 INFO:tasks.workunit.client.0.smithi071.stderr: -331> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f41e0) adding auth protocol: cephx 2024-09-14T11:33:57.422 INFO:tasks.workunit.client.0.smithi071.stderr: -330> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f41e0) adding auth protocol: cephx 2024-09-14T11:33:57.423 INFO:tasks.workunit.client.0.smithi071.stderr: -329> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f41e0) adding auth protocol: cephx 2024-09-14T11:33:57.423 INFO:tasks.workunit.client.0.smithi071.stderr: -328> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f41e0) adding con mode: secure 2024-09-14T11:33:57.423 INFO:tasks.workunit.client.0.smithi071.stderr: -327> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f41e0) adding con mode: crc 2024-09-14T11:33:57.423 INFO:tasks.workunit.client.0.smithi071.stderr: -326> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f41e0) adding con mode: secure 2024-09-14T11:33:57.423 INFO:tasks.workunit.client.0.smithi071.stderr: -325> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f41e0) adding con mode: crc 2024-09-14T11:33:57.423 INFO:tasks.workunit.client.0.smithi071.stderr: -324> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f41e0) adding con mode: secure 2024-09-14T11:33:57.423 INFO:tasks.workunit.client.0.smithi071.stderr: -323> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f41e0) adding con mode: crc 2024-09-14T11:33:57.423 INFO:tasks.workunit.client.0.smithi071.stderr: -322> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f41e0) adding con mode: crc 2024-09-14T11:33:57.423 INFO:tasks.workunit.client.0.smithi071.stderr: -321> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f41e0) adding con mode: secure 2024-09-14T11:33:57.423 INFO:tasks.workunit.client.0.smithi071.stderr: -320> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f41e0) adding con mode: crc 2024-09-14T11:33:57.423 INFO:tasks.workunit.client.0.smithi071.stderr: -319> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f41e0) adding con mode: secure 2024-09-14T11:33:57.423 INFO:tasks.workunit.client.0.smithi071.stderr: -318> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f41e0) adding con mode: crc 2024-09-14T11:33:57.423 INFO:tasks.workunit.client.0.smithi071.stderr: -317> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f41e0) adding con mode: secure 2024-09-14T11:33:57.423 INFO:tasks.workunit.client.0.smithi071.stderr: -316> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:57.424 INFO:tasks.workunit.client.0.smithi071.stderr: -315> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:57.424 INFO:tasks.workunit.client.0.smithi071.stderr: -314> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 5 asok(0x55750dfa9d90) register_command rotate-key cmddesc rotate-key hook 0x7ffc591f4328 EEXIST 2024-09-14T11:33:57.424 INFO:tasks.workunit.client.0.smithi071.stderr: -313> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 10 monclient: _reopen_session rank -1 2024-09-14T11:33:57.424 INFO:tasks.workunit.client.0.smithi071.stderr: -312> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:33:57.424 INFO:tasks.workunit.client.0.smithi071.stderr: -311> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 10 monclient(hunting): picked mon.noname-b con 0x55750e283b60 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:33:57.424 INFO:tasks.workunit.client.0.smithi071.stderr: -310> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 10 monclient(hunting): picked mon.noname-c con 0x55750e283f40 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:33:57.424 INFO:tasks.workunit.client.0.smithi071.stderr: -309> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 10 monclient(hunting): picked mon.noname-a con 0x55750e285400 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:33:57.424 INFO:tasks.workunit.client.0.smithi071.stderr: -308> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:57.424 INFO:tasks.workunit.client.0.smithi071.stderr: -307> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:57.424 INFO:tasks.workunit.client.0.smithi071.stderr: -306> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:57.424 INFO:tasks.workunit.client.0.smithi071.stderr: -305> 2024-09-14T11:33:57.228+0000 7f85ce9089c0 10 monclient(hunting): _renew_subs 2024-09-14T11:33:57.424 INFO:tasks.workunit.client.0.smithi071.stderr: -304> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient(hunting): authenticate will time out at 2449.352010s 2024-09-14T11:33:57.424 INFO:tasks.workunit.client.0.smithi071.stderr: -303> 2024-09-14T11:33:57.232+0000 7f85ccc0f640 10 monclient(hunting): get_auth_request con 0x55750e283f40 auth_method 0 2024-09-14T11:33:57.424 INFO:tasks.workunit.client.0.smithi071.stderr: -302> 2024-09-14T11:33:57.232+0000 7f85ccc0f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:57.424 INFO:tasks.workunit.client.0.smithi071.stderr: -301> 2024-09-14T11:33:57.232+0000 7f85ccc0f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:57.425 INFO:tasks.workunit.client.0.smithi071.stderr: -300> 2024-09-14T11:33:57.232+0000 7f85ccc0f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:57.425 INFO:tasks.workunit.client.0.smithi071.stderr: -299> 2024-09-14T11:33:57.232+0000 7f85cc40e640 10 monclient(hunting): get_auth_request con 0x55750e285400 auth_method 0 2024-09-14T11:33:57.425 INFO:tasks.workunit.client.0.smithi071.stderr: -298> 2024-09-14T11:33:57.232+0000 7f85cc40e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:57.425 INFO:tasks.workunit.client.0.smithi071.stderr: -297> 2024-09-14T11:33:57.232+0000 7f85cc40e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:57.425 INFO:tasks.workunit.client.0.smithi071.stderr: -296> 2024-09-14T11:33:57.232+0000 7f85cc40e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:57.425 INFO:tasks.workunit.client.0.smithi071.stderr: -295> 2024-09-14T11:33:57.232+0000 7f85ccc0f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:57.425 INFO:tasks.workunit.client.0.smithi071.stderr: -294> 2024-09-14T11:33:57.232+0000 7f85ccc0f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:57.425 INFO:tasks.workunit.client.0.smithi071.stderr: -293> 2024-09-14T11:33:57.232+0000 7f85ccc0f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:57.425 INFO:tasks.workunit.client.0.smithi071.stderr: -292> 2024-09-14T11:33:57.232+0000 7f85cc40e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:57.425 INFO:tasks.workunit.client.0.smithi071.stderr: -291> 2024-09-14T11:33:57.232+0000 7f85cc40e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:57.425 INFO:tasks.workunit.client.0.smithi071.stderr: -290> 2024-09-14T11:33:57.232+0000 7f85cc40e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:57.425 INFO:tasks.workunit.client.0.smithi071.stderr: -289> 2024-09-14T11:33:57.232+0000 7f85ccc0f640 10 monclient(hunting): handle_auth_done global_id 7646 payload 274 2024-09-14T11:33:57.425 INFO:tasks.workunit.client.0.smithi071.stderr: -288> 2024-09-14T11:33:57.232+0000 7f85ccc0f640 10 monclient: _finish_hunting 0 2024-09-14T11:33:57.425 INFO:tasks.workunit.client.0.smithi071.stderr: -287> 2024-09-14T11:33:57.232+0000 7f85ccc0f640 1 monclient: found mon.noname-c 2024-09-14T11:33:57.426 INFO:tasks.workunit.client.0.smithi071.stderr: -286> 2024-09-14T11:33:57.232+0000 7f85ccc0f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:33:57.426 INFO:tasks.workunit.client.0.smithi071.stderr: -285> 2024-09-14T11:33:57.232+0000 7f84ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:57.426 INFO:tasks.workunit.client.0.smithi071.stderr: -284> 2024-09-14T11:33:57.232+0000 7f84ab7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:57.426 INFO:tasks.workunit.client.0.smithi071.stderr: -283> 2024-09-14T11:33:57.232+0000 7f84ab7fe640 10 monclient: dump: 2024-09-14T11:33:57.426 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:33:57.426 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:33:57.426 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:57.426 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:57.426 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:57.426 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:57.426 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:33:57.426 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:33:57.426 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:33:57.426 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:57.427 INFO:tasks.workunit.client.0.smithi071.stderr: -282> 2024-09-14T11:33:57.232+0000 7f84ab7fe640 10 monclient: _finish_auth 0 2024-09-14T11:33:57.427 INFO:tasks.workunit.client.0.smithi071.stderr: -281> 2024-09-14T11:33:57.232+0000 7f84ab7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:33:57.427 INFO:tasks.workunit.client.0.smithi071.stderr: -280> 2024-09-14T11:33:57.232+0000 7f84ab7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:57.427 INFO:tasks.workunit.client.0.smithi071.stderr: -279> 2024-09-14T11:33:57.232+0000 7f84ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:57.427 INFO:tasks.workunit.client.0.smithi071.stderr: -278> 2024-09-14T11:33:57.232+0000 7f84ab7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:57.427 INFO:tasks.workunit.client.0.smithi071.stderr: -277> 2024-09-14T11:33:57.232+0000 7f84ab7fe640 10 monclient: dump: 2024-09-14T11:33:57.427 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:33:57.427 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:33:57.427 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:57.427 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:57.427 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:57.427 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:57.427 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:33:57.428 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:33:57.428 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:33:57.428 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:57.428 INFO:tasks.workunit.client.0.smithi071.stderr: -276> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 monclient: authenticate success, global_id 7646 2024-09-14T11:33:57.428 INFO:tasks.workunit.client.0.smithi071.stderr: -275> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient: get_monmap_and_config success 2024-09-14T11:33:57.428 INFO:tasks.workunit.client.0.smithi071.stderr: -274> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 4 set_mon_vals no callback set 2024-09-14T11:33:57.428 INFO:tasks.workunit.client.0.smithi071.stderr: -273> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient: shutdown 2024-09-14T11:33:57.428 INFO:tasks.workunit.client.0.smithi071.stderr: -272> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient: build_initial_monmap 2024-09-14T11:33:57.428 INFO:tasks.workunit.client.0.smithi071.stderr: -271> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 1 build_initial for_mkfs: 0 2024-09-14T11:33:57.428 INFO:tasks.workunit.client.0.smithi071.stderr: -270> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient: monmap: 2024-09-14T11:33:57.428 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:33:57.428 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:57.428 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:33:57.428 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:33:57.428 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:57.429 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:57.429 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:33:57.429 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:33:57.429 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:33:57.429 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:57.429 INFO:tasks.workunit.client.0.smithi071.stderr: -269> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e27c0e0) adding auth protocol: cephx 2024-09-14T11:33:57.429 INFO:tasks.workunit.client.0.smithi071.stderr: -268> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e27c0e0) adding auth protocol: cephx 2024-09-14T11:33:57.429 INFO:tasks.workunit.client.0.smithi071.stderr: -267> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e27c0e0) adding auth protocol: cephx 2024-09-14T11:33:57.429 INFO:tasks.workunit.client.0.smithi071.stderr: -266> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e27c0e0) adding con mode: secure 2024-09-14T11:33:57.429 INFO:tasks.workunit.client.0.smithi071.stderr: -265> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e27c0e0) adding con mode: crc 2024-09-14T11:33:57.429 INFO:tasks.workunit.client.0.smithi071.stderr: -264> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e27c0e0) adding con mode: secure 2024-09-14T11:33:57.429 INFO:tasks.workunit.client.0.smithi071.stderr: -263> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e27c0e0) adding con mode: crc 2024-09-14T11:33:57.429 INFO:tasks.workunit.client.0.smithi071.stderr: -262> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e27c0e0) adding con mode: secure 2024-09-14T11:33:57.429 INFO:tasks.workunit.client.0.smithi071.stderr: -261> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e27c0e0) adding con mode: crc 2024-09-14T11:33:57.430 INFO:tasks.workunit.client.0.smithi071.stderr: -260> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e27c0e0) adding con mode: crc 2024-09-14T11:33:57.430 INFO:tasks.workunit.client.0.smithi071.stderr: -259> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e27c0e0) adding con mode: secure 2024-09-14T11:33:57.430 INFO:tasks.workunit.client.0.smithi071.stderr: -258> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e27c0e0) adding con mode: crc 2024-09-14T11:33:57.430 INFO:tasks.workunit.client.0.smithi071.stderr: -257> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e27c0e0) adding con mode: secure 2024-09-14T11:33:57.430 INFO:tasks.workunit.client.0.smithi071.stderr: -256> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e27c0e0) adding con mode: crc 2024-09-14T11:33:57.430 INFO:tasks.workunit.client.0.smithi071.stderr: -255> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e27c0e0) adding con mode: secure 2024-09-14T11:33:57.430 INFO:tasks.workunit.client.0.smithi071.stderr: -254> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:57.430 INFO:tasks.workunit.client.0.smithi071.stderr: -253> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 1 librados: starting msgr at 2024-09-14T11:33:57.430 INFO:tasks.workunit.client.0.smithi071.stderr: -252> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 1 librados: starting objecter 2024-09-14T11:33:57.430 INFO:tasks.workunit.client.0.smithi071.stderr: -251> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 asok(0x55750dfa9d90) register_command objecter_requests cmddesc objecter_requests hook 0x55750e2552b0 EEXIST 2024-09-14T11:33:57.430 INFO:tasks.workunit.client.0.smithi071.stderr: -250> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 1 librados: setting wanted keys 2024-09-14T11:33:57.430 INFO:tasks.workunit.client.0.smithi071.stderr: -249> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 1 librados: calling monclient init 2024-09-14T11:33:57.430 INFO:tasks.workunit.client.0.smithi071.stderr: -248> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient: init 2024-09-14T11:33:57.430 INFO:tasks.workunit.client.0.smithi071.stderr: -247> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e237b00) adding auth protocol: cephx 2024-09-14T11:33:57.430 INFO:tasks.workunit.client.0.smithi071.stderr: -246> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e237b00) adding auth protocol: cephx 2024-09-14T11:33:57.431 INFO:tasks.workunit.client.0.smithi071.stderr: -245> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e237b00) adding auth protocol: cephx 2024-09-14T11:33:57.431 INFO:tasks.workunit.client.0.smithi071.stderr: -244> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e237b00) adding con mode: secure 2024-09-14T11:33:57.431 INFO:tasks.workunit.client.0.smithi071.stderr: -243> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e237b00) adding con mode: crc 2024-09-14T11:33:57.431 INFO:tasks.workunit.client.0.smithi071.stderr: -242> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e237b00) adding con mode: secure 2024-09-14T11:33:57.431 INFO:tasks.workunit.client.0.smithi071.stderr: -241> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e237b00) adding con mode: crc 2024-09-14T11:33:57.431 INFO:tasks.workunit.client.0.smithi071.stderr: -240> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e237b00) adding con mode: secure 2024-09-14T11:33:57.431 INFO:tasks.workunit.client.0.smithi071.stderr: -239> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e237b00) adding con mode: crc 2024-09-14T11:33:57.431 INFO:tasks.workunit.client.0.smithi071.stderr: -238> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e237b00) adding con mode: crc 2024-09-14T11:33:57.431 INFO:tasks.workunit.client.0.smithi071.stderr: -237> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e237b00) adding con mode: secure 2024-09-14T11:33:57.431 INFO:tasks.workunit.client.0.smithi071.stderr: -236> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e237b00) adding con mode: crc 2024-09-14T11:33:57.431 INFO:tasks.workunit.client.0.smithi071.stderr: -235> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e237b00) adding con mode: secure 2024-09-14T11:33:57.431 INFO:tasks.workunit.client.0.smithi071.stderr: -234> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e237b00) adding con mode: crc 2024-09-14T11:33:57.431 INFO:tasks.workunit.client.0.smithi071.stderr: -233> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 AuthRegistry(0x55750e237b00) adding con mode: secure 2024-09-14T11:33:57.431 INFO:tasks.workunit.client.0.smithi071.stderr: -232> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:57.432 INFO:tasks.workunit.client.0.smithi071.stderr: -231> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:57.432 INFO:tasks.workunit.client.0.smithi071.stderr: -230> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 asok(0x55750dfa9d90) register_command rotate-key cmddesc rotate-key hook 0x55750e237c48 EEXIST 2024-09-14T11:33:57.432 INFO:tasks.workunit.client.0.smithi071.stderr: -229> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient: _reopen_session rank -1 2024-09-14T11:33:57.432 INFO:tasks.workunit.client.0.smithi071.stderr: -228> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:33:57.432 INFO:tasks.workunit.client.0.smithi071.stderr: -227> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient(hunting): picked mon.noname-c con 0x55750e283b60 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:33:57.432 INFO:tasks.workunit.client.0.smithi071.stderr: -226> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient(hunting): picked mon.noname-b con 0x55750e285400 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:33:57.432 INFO:tasks.workunit.client.0.smithi071.stderr: -225> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient(hunting): picked mon.noname-a con 0x55750e294050 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:33:57.432 INFO:tasks.workunit.client.0.smithi071.stderr: -224> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:57.432 INFO:tasks.workunit.client.0.smithi071.stderr: -223> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:57.432 INFO:tasks.workunit.client.0.smithi071.stderr: -222> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:57.432 INFO:tasks.workunit.client.0.smithi071.stderr: -221> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient(hunting): _renew_subs 2024-09-14T11:33:57.432 INFO:tasks.workunit.client.0.smithi071.stderr: -220> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient(hunting): authenticate will time out at 2449.354493s 2024-09-14T11:33:57.432 INFO:tasks.workunit.client.0.smithi071.stderr: -219> 2024-09-14T11:33:57.232+0000 7f85cbc0d640 10 monclient(hunting): get_auth_request con 0x55750e283b60 auth_method 0 2024-09-14T11:33:57.433 INFO:tasks.workunit.client.0.smithi071.stderr: -218> 2024-09-14T11:33:57.232+0000 7f85cbc0d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:57.433 INFO:tasks.workunit.client.0.smithi071.stderr: -217> 2024-09-14T11:33:57.232+0000 7f85cbc0d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:57.433 INFO:tasks.workunit.client.0.smithi071.stderr: -216> 2024-09-14T11:33:57.232+0000 7f85cbc0d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:57.433 INFO:tasks.workunit.client.0.smithi071.stderr: -215> 2024-09-14T11:33:57.232+0000 7f85cc40e640 10 monclient(hunting): get_auth_request con 0x55750e294050 auth_method 0 2024-09-14T11:33:57.433 INFO:tasks.workunit.client.0.smithi071.stderr: -214> 2024-09-14T11:33:57.232+0000 7f85cc40e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:57.433 INFO:tasks.workunit.client.0.smithi071.stderr: -213> 2024-09-14T11:33:57.232+0000 7f85cc40e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:57.433 INFO:tasks.workunit.client.0.smithi071.stderr: -212> 2024-09-14T11:33:57.232+0000 7f85cc40e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:57.433 INFO:tasks.workunit.client.0.smithi071.stderr: -211> 2024-09-14T11:33:57.232+0000 7f85cbc0d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:57.433 INFO:tasks.workunit.client.0.smithi071.stderr: -210> 2024-09-14T11:33:57.232+0000 7f85cbc0d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:57.433 INFO:tasks.workunit.client.0.smithi071.stderr: -209> 2024-09-14T11:33:57.232+0000 7f85cbc0d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:57.433 INFO:tasks.workunit.client.0.smithi071.stderr: -208> 2024-09-14T11:33:57.232+0000 7f85cc40e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:57.433 INFO:tasks.workunit.client.0.smithi071.stderr: -207> 2024-09-14T11:33:57.232+0000 7f85cc40e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:57.433 INFO:tasks.workunit.client.0.smithi071.stderr: -206> 2024-09-14T11:33:57.232+0000 7f85cc40e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:57.433 INFO:tasks.workunit.client.0.smithi071.stderr: -205> 2024-09-14T11:33:57.232+0000 7f85ccc0f640 10 monclient(hunting): get_auth_request con 0x55750e285400 auth_method 0 2024-09-14T11:33:57.433 INFO:tasks.workunit.client.0.smithi071.stderr: -204> 2024-09-14T11:33:57.232+0000 7f85ccc0f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:57.434 INFO:tasks.workunit.client.0.smithi071.stderr: -203> 2024-09-14T11:33:57.232+0000 7f85ccc0f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:57.434 INFO:tasks.workunit.client.0.smithi071.stderr: -202> 2024-09-14T11:33:57.232+0000 7f85ccc0f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:57.434 INFO:tasks.workunit.client.0.smithi071.stderr: -201> 2024-09-14T11:33:57.232+0000 7f85cbc0d640 10 monclient(hunting): handle_auth_done global_id 7649 payload 824 2024-09-14T11:33:57.434 INFO:tasks.workunit.client.0.smithi071.stderr: -200> 2024-09-14T11:33:57.232+0000 7f85cbc0d640 10 monclient: _finish_hunting 0 2024-09-14T11:33:57.434 INFO:tasks.workunit.client.0.smithi071.stderr: -199> 2024-09-14T11:33:57.232+0000 7f85cbc0d640 1 monclient: found mon.noname-c 2024-09-14T11:33:57.434 INFO:tasks.workunit.client.0.smithi071.stderr: -198> 2024-09-14T11:33:57.232+0000 7f85cbc0d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:33:57.434 INFO:tasks.workunit.client.0.smithi071.stderr: -197> 2024-09-14T11:33:57.232+0000 7f84a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:57.434 INFO:tasks.workunit.client.0.smithi071.stderr: -196> 2024-09-14T11:33:57.232+0000 7f84a9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:57.434 INFO:tasks.workunit.client.0.smithi071.stderr: -195> 2024-09-14T11:33:57.232+0000 7f84a9ffb640 10 monclient: dump: 2024-09-14T11:33:57.434 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:33:57.434 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:33:57.434 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:57.434 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:57.434 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:57.435 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:57.435 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:33:57.435 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:33:57.435 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:33:57.435 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:57.435 INFO:tasks.workunit.client.0.smithi071.stderr: -194> 2024-09-14T11:33:57.232+0000 7f84a9ffb640 10 monclient: _finish_auth 0 2024-09-14T11:33:57.435 INFO:tasks.workunit.client.0.smithi071.stderr: -193> 2024-09-14T11:33:57.232+0000 7f84a9ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:33:57.435 INFO:tasks.workunit.client.0.smithi071.stderr: -192> 2024-09-14T11:33:57.232+0000 7f84a9ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:57.435 INFO:tasks.workunit.client.0.smithi071.stderr: -191> 2024-09-14T11:33:57.232+0000 7f84a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:57.435 INFO:tasks.workunit.client.0.smithi071.stderr: -190> 2024-09-14T11:33:57.232+0000 7f84a9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:57.435 INFO:tasks.workunit.client.0.smithi071.stderr: -189> 2024-09-14T11:33:57.232+0000 7f84a9ffb640 10 monclient: dump: 2024-09-14T11:33:57.435 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:33:57.435 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:33:57.435 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:57.435 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:33:57.436 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:57.436 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:33:57.436 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:33:57.436 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:33:57.436 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:33:57.436 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:57.436 INFO:tasks.workunit.client.0.smithi071.stderr: -188> 2024-09-14T11:33:57.232+0000 7f84ab7fe640 4 set_mon_vals no callback set 2024-09-14T11:33:57.436 INFO:tasks.workunit.client.0.smithi071.stderr: -187> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 monclient: authenticate success, global_id 7649 2024-09-14T11:33:57.436 INFO:tasks.workunit.client.0.smithi071.stderr: -186> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient: _renew_subs 2024-09-14T11:33:57.436 INFO:tasks.workunit.client.0.smithi071.stderr: -185> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:33:57.436 INFO:tasks.workunit.client.0.smithi071.stderr: -184> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient: _renew_subs 2024-09-14T11:33:57.436 INFO:tasks.workunit.client.0.smithi071.stderr: -183> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:33:57.436 INFO:tasks.workunit.client.0.smithi071.stderr: -182> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 1 librados: init done 2024-09-14T11:33:57.436 INFO:tasks.workunit.client.0.smithi071.stderr: -181> 2024-09-14T11:33:57.232+0000 7f85ce9089c0 5 asok(0x55750dfa9d90) register_command cr dump hook 0x55750e27bc48 2024-09-14T11:33:57.437 INFO:tasks.workunit.client.0.smithi071.stderr: -180> 2024-09-14T11:33:57.236+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.437 INFO:tasks.workunit.client.0.smithi071.stderr: -179> 2024-09-14T11:33:57.236+0000 7f84a9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:57.437 INFO:tasks.workunit.client.0.smithi071.stderr: -178> 2024-09-14T11:33:57.236+0000 7f84a9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:33:57.437 INFO:tasks.workunit.client.0.smithi071.stderr: -177> 2024-09-14T11:33:57.236+0000 7f84a9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:33:57.437 INFO:tasks.workunit.client.0.smithi071.stderr: -176> 2024-09-14T11:33:57.236+0000 7f85ccc0f640 10 monclient: get_auth_request con 0x7f849c0718a0 auth_method 0 2024-09-14T11:33:57.437 INFO:tasks.workunit.client.0.smithi071.stderr: -175> 2024-09-14T11:33:57.236+0000 7f85cc40e640 10 monclient: get_auth_request con 0x55750e2a39f0 auth_method 0 2024-09-14T11:33:57.437 INFO:tasks.workunit.client.0.smithi071.stderr: -174> 2024-09-14T11:33:57.236+0000 7f85ce9089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.437 INFO:tasks.workunit.client.0.smithi071.stderr: -173> 2024-09-14T11:33:57.236+0000 7f85ce9089c0 20 realm 2024-09-14T11:33:57.437 INFO:tasks.workunit.client.0.smithi071.stderr: -172> 2024-09-14T11:33:57.236+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.437 INFO:tasks.workunit.client.0.smithi071.stderr: -171> 2024-09-14T11:33:57.236+0000 7f85ce9089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.437 INFO:tasks.workunit.client.0.smithi071.stderr: -170> 2024-09-14T11:33:57.236+0000 7f85ce9089c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:57.437 INFO:tasks.workunit.client.0.smithi071.stderr: -169> 2024-09-14T11:33:57.236+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.437 INFO:tasks.workunit.client.0.smithi071.stderr: -168> 2024-09-14T11:33:57.240+0000 7f85ce9089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.438 INFO:tasks.workunit.client.0.smithi071.stderr: -167> 2024-09-14T11:33:57.240+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.438 INFO:tasks.workunit.client.0.smithi071.stderr: -166> 2024-09-14T11:33:57.240+0000 7f85cbc0d640 10 monclient: get_auth_request con 0x55750e2a7ce0 auth_method 0 2024-09-14T11:33:57.438 INFO:tasks.workunit.client.0.smithi071.stderr: -165> 2024-09-14T11:33:57.240+0000 7f85ce9089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:57.438 INFO:tasks.workunit.client.0.smithi071.stderr: -164> 2024-09-14T11:33:57.240+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.438 INFO:tasks.workunit.client.0.smithi071.stderr: -163> 2024-09-14T11:33:57.240+0000 7f85ccc0f640 10 monclient: get_auth_request con 0x55750e2ab420 auth_method 0 2024-09-14T11:33:57.438 INFO:tasks.workunit.client.0.smithi071.stderr: -162> 2024-09-14T11:33:57.240+0000 7f85ce9089c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:57.438 INFO:tasks.workunit.client.0.smithi071.stderr: -161> 2024-09-14T11:33:57.240+0000 7f85ce9089c0 20 searching for the correct realm 2024-09-14T11:33:57.438 INFO:tasks.workunit.client.0.smithi071.stderr: -160> 2024-09-14T11:33:57.240+0000 7f85cc40e640 10 monclient: get_auth_request con 0x55750e2b01c0 auth_method 0 2024-09-14T11:33:57.438 INFO:tasks.workunit.client.0.smithi071.stderr: -159> 2024-09-14T11:33:57.244+0000 7f85cbc0d640 10 monclient: get_auth_request con 0x7f85bc034060 auth_method 0 2024-09-14T11:33:57.438 INFO:tasks.workunit.client.0.smithi071.stderr: -158> 2024-09-14T11:33:57.244+0000 7f85ccc0f640 10 monclient: get_auth_request con 0x7f85c0054060 auth_method 0 2024-09-14T11:33:57.438 INFO:tasks.workunit.client.0.smithi071.stderr: -157> 2024-09-14T11:33:57.244+0000 7f85cc40e640 0 -- 172.21.15.71:0/3711081096 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x55750e2b01c0 msgr2=0x55750e2b2680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:57.438 INFO:tasks.workunit.client.0.smithi071.stderr: -156> 2024-09-14T11:33:57.244+0000 7f84a9ffb640 1 client.7649.objecter ms_handle_reset 0x55750e2b01c0 session 0x55750e2afb40 osd.4 2024-09-14T11:33:57.439 INFO:tasks.workunit.client.0.smithi071.stderr: -155> 2024-09-14T11:33:57.244+0000 7f84a9ffb640 10 monclient: _renew_subs 2024-09-14T11:33:57.439 INFO:tasks.workunit.client.0.smithi071.stderr: -154> 2024-09-14T11:33:57.244+0000 7f84a9ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:33:57.439 INFO:tasks.workunit.client.0.smithi071.stderr: -153> 2024-09-14T11:33:57.244+0000 7f85cc40e640 10 monclient: get_auth_request con 0x7f85bc01c040 auth_method 0 2024-09-14T11:33:57.439 INFO:tasks.workunit.client.0.smithi071.stderr: -152> 2024-09-14T11:33:57.244+0000 7f85cc40e640 10 monclient: get_auth_request con 0x7f849c0813c0 auth_method 0 2024-09-14T11:33:57.439 INFO:tasks.workunit.client.0.smithi071.stderr: -151> 2024-09-14T11:33:57.248+0000 7f85cbc0d640 10 monclient: get_auth_request con 0x7f85c0089020 auth_method 0 2024-09-14T11:33:57.439 INFO:tasks.workunit.client.0.smithi071.stderr: -150> 2024-09-14T11:33:57.252+0000 7f85ccc0f640 0 -- 172.21.15.71:0/3711081096 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55750e2ab420 msgr2=0x55750e2ad810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:57.439 INFO:tasks.workunit.client.0.smithi071.stderr: -149> 2024-09-14T11:33:57.252+0000 7f84a9ffb640 1 client.7649.objecter ms_handle_reset 0x55750e2ab420 session 0x55750e2a7540 osd.3 2024-09-14T11:33:57.439 INFO:tasks.workunit.client.0.smithi071.stderr: -148> 2024-09-14T11:33:57.252+0000 7f85ccc0f640 10 monclient: get_auth_request con 0x55750e2b01c0 auth_method 0 2024-09-14T11:33:57.439 INFO:tasks.workunit.client.0.smithi071.stderr: -147> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:57.439 INFO:tasks.workunit.client.0.smithi071.stderr: -146> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:33:57.439 INFO:tasks.workunit.client.0.smithi071.stderr: -145> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:57.439 INFO:tasks.workunit.client.0.smithi071.stderr: -144> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:33:57.439 INFO:tasks.workunit.client.0.smithi071.stderr: -143> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:57.440 INFO:tasks.workunit.client.0.smithi071.stderr: -142> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:57.440 INFO:tasks.workunit.client.0.smithi071.stderr: -141> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.440 INFO:tasks.workunit.client.0.smithi071.stderr: -140> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.440 INFO:tasks.workunit.client.0.smithi071.stderr: -139> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.440 INFO:tasks.workunit.client.0.smithi071.stderr: -138> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:57.440 INFO:tasks.workunit.client.0.smithi071.stderr: -137> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.440 INFO:tasks.workunit.client.0.smithi071.stderr: -136> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:57.440 INFO:tasks.workunit.client.0.smithi071.stderr: -135> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 zone default found 2024-09-14T11:33:57.440 INFO:tasks.workunit.client.0.smithi071.stderr: -134> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 4 Realm: () 2024-09-14T11:33:57.440 INFO:tasks.workunit.client.0.smithi071.stderr: -133> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:33:57.440 INFO:tasks.workunit.client.0.smithi071.stderr: -132> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:33:57.440 INFO:tasks.workunit.client.0.smithi071.stderr: -131> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:57.440 INFO:tasks.workunit.client.0.smithi071.stderr: -130> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 zonegroup default 2024-09-14T11:33:57.440 INFO:tasks.workunit.client.0.smithi071.stderr: -129> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.440 INFO:tasks.workunit.client.0.smithi071.stderr: -128> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.441 INFO:tasks.workunit.client.0.smithi071.stderr: -127> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.441 INFO:tasks.workunit.client.0.smithi071.stderr: -126> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.441 INFO:tasks.workunit.client.0.smithi071.stderr: -125> 2024-09-14T11:33:57.260+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.441 INFO:tasks.workunit.client.0.smithi071.stderr: -124> 2024-09-14T11:33:57.264+0000 7f85ce9089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.441 INFO:tasks.workunit.client.0.smithi071.stderr: -123> 2024-09-14T11:33:57.264+0000 7f85ce9089c0 20 started sync module instance, tier type = 2024-09-14T11:33:57.441 INFO:tasks.workunit.client.0.smithi071.stderr: -122> 2024-09-14T11:33:57.264+0000 7f85ce9089c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:33:57.441 INFO:tasks.workunit.client.0.smithi071.stderr: -121> 2024-09-14T11:33:57.288+0000 7f85ce9089c0 20 add_watcher() i=0 2024-09-14T11:33:57.441 INFO:tasks.workunit.client.0.smithi071.stderr: -120> 2024-09-14T11:33:57.288+0000 7f85ce9089c0 20 add_watcher() i=1 2024-09-14T11:33:57.441 INFO:tasks.workunit.client.0.smithi071.stderr: -119> 2024-09-14T11:33:57.288+0000 7f85ce9089c0 20 add_watcher() i=2 2024-09-14T11:33:57.441 INFO:tasks.workunit.client.0.smithi071.stderr: -118> 2024-09-14T11:33:57.288+0000 7f85ce9089c0 20 add_watcher() i=3 2024-09-14T11:33:57.441 INFO:tasks.workunit.client.0.smithi071.stderr: -117> 2024-09-14T11:33:57.288+0000 7f85ce9089c0 20 add_watcher() i=4 2024-09-14T11:33:57.441 INFO:tasks.workunit.client.0.smithi071.stderr: -116> 2024-09-14T11:33:57.288+0000 7f85ce9089c0 20 add_watcher() i=5 2024-09-14T11:33:57.441 INFO:tasks.workunit.client.0.smithi071.stderr: -115> 2024-09-14T11:33:57.288+0000 7f85ce9089c0 20 add_watcher() i=6 2024-09-14T11:33:57.442 INFO:tasks.workunit.client.0.smithi071.stderr: -114> 2024-09-14T11:33:57.292+0000 7f85ce9089c0 20 add_watcher() i=7 2024-09-14T11:33:57.442 INFO:tasks.workunit.client.0.smithi071.stderr: -113> 2024-09-14T11:33:57.292+0000 7f85ce9089c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:57.442 INFO:tasks.workunit.client.0.smithi071.stderr: -112> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f46c0) adding auth protocol: cephx 2024-09-14T11:33:57.442 INFO:tasks.workunit.client.0.smithi071.stderr: -111> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f46c0) adding auth protocol: cephx 2024-09-14T11:33:57.442 INFO:tasks.workunit.client.0.smithi071.stderr: -110> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f46c0) adding auth protocol: cephx 2024-09-14T11:33:57.442 INFO:tasks.workunit.client.0.smithi071.stderr: -109> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f46c0) adding con mode: secure 2024-09-14T11:33:57.442 INFO:tasks.workunit.client.0.smithi071.stderr: -108> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f46c0) adding con mode: crc 2024-09-14T11:33:57.442 INFO:tasks.workunit.client.0.smithi071.stderr: -107> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f46c0) adding con mode: secure 2024-09-14T11:33:57.442 INFO:tasks.workunit.client.0.smithi071.stderr: -106> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f46c0) adding con mode: crc 2024-09-14T11:33:57.442 INFO:tasks.workunit.client.0.smithi071.stderr: -105> 2024-09-14T11:33:57.296+0000 7f8482fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:57.442 INFO:tasks.workunit.client.0.smithi071.stderr: -104> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f46c0) adding con mode: secure 2024-09-14T11:33:57.442 INFO:tasks.workunit.client.0.smithi071.stderr: -103> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f46c0) adding con mode: crc 2024-09-14T11:33:57.442 INFO:tasks.workunit.client.0.smithi071.stderr: -102> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f46c0) adding con mode: crc 2024-09-14T11:33:57.442 INFO:tasks.workunit.client.0.smithi071.stderr: -101> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f46c0) adding con mode: secure 2024-09-14T11:33:57.442 INFO:tasks.workunit.client.0.smithi071.stderr: -100> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f46c0) adding con mode: crc 2024-09-14T11:33:57.442 INFO:tasks.workunit.client.0.smithi071.stderr: -99> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f46c0) adding con mode: secure 2024-09-14T11:33:57.443 INFO:tasks.workunit.client.0.smithi071.stderr: -98> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f46c0) adding con mode: crc 2024-09-14T11:33:57.443 INFO:tasks.workunit.client.0.smithi071.stderr: -97> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 AuthRegistry(0x7ffc591f46c0) adding con mode: secure 2024-09-14T11:33:57.443 INFO:tasks.workunit.client.0.smithi071.stderr: -96> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:57.443 INFO:tasks.workunit.client.0.smithi071.stderr: -95> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:57.443 INFO:tasks.workunit.client.0.smithi071.stderr: -94> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:57.443 INFO:tasks.workunit.client.0.smithi071.stderr: -93> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 asok(0x55750dfa9d90) register_command cache list hook 0x55750e294470 2024-09-14T11:33:57.443 INFO:tasks.workunit.client.0.smithi071.stderr: -92> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 asok(0x55750dfa9d90) register_command cache inspect hook 0x55750e294470 2024-09-14T11:33:57.443 INFO:tasks.workunit.client.0.smithi071.stderr: -91> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 asok(0x55750dfa9d90) register_command cache erase hook 0x55750e294470 2024-09-14T11:33:57.443 INFO:tasks.workunit.client.0.smithi071.stderr: -90> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 asok(0x55750dfa9d90) register_command cache zap hook 0x55750e294470 2024-09-14T11:33:57.443 INFO:tasks.workunit.client.0.smithi071.stderr: -89> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 note: GC not initialized 2024-09-14T11:33:57.443 INFO:tasks.workunit.client.0.smithi071.stderr: -88> 2024-09-14T11:33:57.296+0000 7f8481fe3640 20 reqs_thread_entry: start 2024-09-14T11:33:57.443 INFO:tasks.workunit.client.0.smithi071.stderr: -87> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 asok(0x55750dfa9d90) register_command sync trace show hook 0x7f85c4004680 2024-09-14T11:33:57.443 INFO:tasks.workunit.client.0.smithi071.stderr: -86> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 asok(0x55750dfa9d90) register_command sync trace history hook 0x7f85c4004680 2024-09-14T11:33:57.443 INFO:tasks.workunit.client.0.smithi071.stderr: -85> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 asok(0x55750dfa9d90) register_command sync trace active hook 0x7f85c4004680 2024-09-14T11:33:57.444 INFO:tasks.workunit.client.0.smithi071.stderr: -84> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 5 asok(0x55750dfa9d90) register_command sync trace active_short hook 0x7f85c4004680 2024-09-14T11:33:57.444 INFO:tasks.workunit.client.0.smithi071.stderr: -83> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:57.444 INFO:tasks.workunit.client.0.smithi071.stderr: -82> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 20 Filter name: none 2024-09-14T11:33:57.444 INFO:tasks.workunit.client.0.smithi071.stderr: -81> 2024-09-14T11:33:57.296+0000 7f847affd640 20 reqs_thread_entry: start 2024-09-14T11:33:57.444 INFO:tasks.workunit.client.0.smithi071.stderr: -80> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:33:57.444 INFO:tasks.workunit.client.0.smithi071.stderr: -79> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.444 INFO:tasks.workunit.client.0.smithi071.stderr: -78> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:33:57.444 INFO:tasks.workunit.client.0.smithi071.stderr: -77> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:33:57.444 INFO:tasks.workunit.client.0.smithi071.stderr: -76> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:33:57.444 INFO:tasks.workunit.client.0.smithi071.stderr: -75> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 : miss 2024-09-14T11:33:57.444 INFO:tasks.workunit.client.0.smithi071.stderr: -74> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.444 INFO:tasks.workunit.client.0.smithi071.stderr: -73> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:33:57.444 INFO:tasks.workunit.client.0.smithi071.stderr: -72> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:33:57.445 INFO:tasks.workunit.client.0.smithi071.stderr: -71> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:33:57.445 INFO:tasks.workunit.client.0.smithi071.stderr: -70> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:57.445 INFO:tasks.workunit.client.0.smithi071.stderr: -69> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:33:57.445 INFO:tasks.workunit.client.0.smithi071.stderr: -68> 2024-09-14T11:33:57.296+0000 7f85ce9089c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 2024-09-14T11:33:57.445 INFO:tasks.workunit.client.0.smithi071.stderr: -67> 2024-09-14T11:33:57.308+0000 7f85ce9089c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:33:57.445 INFO:tasks.workunit.client.0.smithi071.stderr: -66> 2024-09-14T11:33:57.308+0000 7f85ce9089c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:33:57.445 INFO:tasks.workunit.client.0.smithi071.stderr: -65> 2024-09-14T11:33:57.308+0000 7f85ce9089c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:33:57.445 INFO:tasks.workunit.client.0.smithi071.stderr: -64> 2024-09-14T11:33:57.308+0000 7f85ce9089c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18, ofs0, ns] 2024-09-14T11:33:57.445 INFO:tasks.workunit.client.0.smithi071.stderr: -63> 2024-09-14T11:33:57.308+0000 7f84aaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464424 cookie 93961237241296 notifier 7649 bl.length()=911 2024-09-14T11:33:57.445 INFO:tasks.workunit.client.0.smithi071.stderr: -62> 2024-09-14T11:33:57.308+0000 7f84aaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:33:57.445 INFO:tasks.workunit.client.0.smithi071.stderr: -61> 2024-09-14T11:33:57.308+0000 7f84aaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:33:57.445 INFO:tasks.workunit.client.0.smithi071.stderr: -60> 2024-09-14T11:33:57.308+0000 7f84aaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:33:57.446 INFO:tasks.workunit.client.0.smithi071.stderr: -59> 2024-09-14T11:33:57.308+0000 7f85ce9089c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_sources= new_sources= 2024-09-14T11:33:57.446 INFO:tasks.workunit.client.0.smithi071.stderr: -58> 2024-09-14T11:33:57.308+0000 7f85ce9089c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential sources added=[] removed=[] 2024-09-14T11:33:57.446 INFO:tasks.workunit.client.0.smithi071.stderr: -57> 2024-09-14T11:33:57.308+0000 7f85ce9089c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_dests= new_dests= 2024-09-14T11:33:57.446 INFO:tasks.workunit.client.0.smithi071.stderr: -56> 2024-09-14T11:33:57.308+0000 7f85ce9089c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential dests added=[] removed=[] 2024-09-14T11:33:57.446 INFO:tasks.workunit.client.0.smithi071.stderr: -55> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.0 2024-09-14T11:33:57.446 INFO:tasks.workunit.client.0.smithi071.stderr: -54> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.0 2024-09-14T11:33:57.446 INFO:tasks.workunit.client.0.smithi071.stderr: -53> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.1 2024-09-14T11:33:57.446 INFO:tasks.workunit.client.0.smithi071.stderr: -52> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.1 2024-09-14T11:33:57.446 INFO:tasks.workunit.client.0.smithi071.stderr: -51> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.2 2024-09-14T11:33:57.446 INFO:tasks.workunit.client.0.smithi071.stderr: -50> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.2 2024-09-14T11:33:57.446 INFO:tasks.workunit.client.0.smithi071.stderr: -49> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.3 2024-09-14T11:33:57.446 INFO:tasks.workunit.client.0.smithi071.stderr: -48> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.3 2024-09-14T11:33:57.446 INFO:tasks.workunit.client.0.smithi071.stderr: -47> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.4 2024-09-14T11:33:57.446 INFO:tasks.workunit.client.0.smithi071.stderr: -46> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.4 2024-09-14T11:33:57.447 INFO:tasks.workunit.client.0.smithi071.stderr: -45> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.5 2024-09-14T11:33:57.447 INFO:tasks.workunit.client.0.smithi071.stderr: -44> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.5 2024-09-14T11:33:57.447 INFO:tasks.workunit.client.0.smithi071.stderr: -43> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.6 2024-09-14T11:33:57.447 INFO:tasks.workunit.client.0.smithi071.stderr: -42> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.6 2024-09-14T11:33:57.447 INFO:tasks.workunit.client.0.smithi071.stderr: -41> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.7 2024-09-14T11:33:57.447 INFO:tasks.workunit.client.0.smithi071.stderr: -40> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.7 2024-09-14T11:33:57.447 INFO:tasks.workunit.client.0.smithi071.stderr: -39> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.8 2024-09-14T11:33:57.447 INFO:tasks.workunit.client.0.smithi071.stderr: -38> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.8 2024-09-14T11:33:57.447 INFO:tasks.workunit.client.0.smithi071.stderr: -37> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.9 2024-09-14T11:33:57.447 INFO:tasks.workunit.client.0.smithi071.stderr: -36> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.9 2024-09-14T11:33:57.447 INFO:tasks.workunit.client.0.smithi071.stderr: -35> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.10 2024-09-14T11:33:57.447 INFO:tasks.workunit.client.0.smithi071.stderr: -34> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.10 2024-09-14T11:33:57.447 INFO:tasks.workunit.client.0.smithi071.stderr: -33> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.11 2024-09-14T11:33:57.447 INFO:tasks.workunit.client.0.smithi071.stderr: -32> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.11 2024-09-14T11:33:57.448 INFO:tasks.workunit.client.0.smithi071.stderr: -31> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.12 2024-09-14T11:33:57.448 INFO:tasks.workunit.client.0.smithi071.stderr: -30> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.12 2024-09-14T11:33:57.448 INFO:tasks.workunit.client.0.smithi071.stderr: -29> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.13 2024-09-14T11:33:57.448 INFO:tasks.workunit.client.0.smithi071.stderr: -28> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.13 2024-09-14T11:33:57.448 INFO:tasks.workunit.client.0.smithi071.stderr: -27> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.0 2024-09-14T11:33:57.448 INFO:tasks.workunit.client.0.smithi071.stderr: -26> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.0 2024-09-14T11:33:57.448 INFO:tasks.workunit.client.0.smithi071.stderr: -25> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.1 2024-09-14T11:33:57.448 INFO:tasks.workunit.client.0.smithi071.stderr: -24> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.1 2024-09-14T11:33:57.448 INFO:tasks.workunit.client.0.smithi071.stderr: -23> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.2 2024-09-14T11:33:57.448 INFO:tasks.workunit.client.0.smithi071.stderr: -22> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.2 2024-09-14T11:33:57.448 INFO:tasks.workunit.client.0.smithi071.stderr: -21> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.3 2024-09-14T11:33:57.448 INFO:tasks.workunit.client.0.smithi071.stderr: -20> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.3 2024-09-14T11:33:57.448 INFO:tasks.workunit.client.0.smithi071.stderr: -19> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.4 2024-09-14T11:33:57.448 INFO:tasks.workunit.client.0.smithi071.stderr: -18> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.4 2024-09-14T11:33:57.449 INFO:tasks.workunit.client.0.smithi071.stderr: -17> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.5 2024-09-14T11:33:57.449 INFO:tasks.workunit.client.0.smithi071.stderr: -16> 2024-09-14T11:33:57.320+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.5 2024-09-14T11:33:57.449 INFO:tasks.workunit.client.0.smithi071.stderr: -15> 2024-09-14T11:33:57.324+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.6 2024-09-14T11:33:57.449 INFO:tasks.workunit.client.0.smithi071.stderr: -14> 2024-09-14T11:33:57.324+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.6 2024-09-14T11:33:57.449 INFO:tasks.workunit.client.0.smithi071.stderr: -13> 2024-09-14T11:33:57.324+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.7 2024-09-14T11:33:57.449 INFO:tasks.workunit.client.0.smithi071.stderr: -12> 2024-09-14T11:33:57.324+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.7 2024-09-14T11:33:57.449 INFO:tasks.workunit.client.0.smithi071.stderr: -11> 2024-09-14T11:33:57.324+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.8 2024-09-14T11:33:57.449 INFO:tasks.workunit.client.0.smithi071.stderr: -10> 2024-09-14T11:33:57.324+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.8 2024-09-14T11:33:57.449 INFO:tasks.workunit.client.0.smithi071.stderr: -9> 2024-09-14T11:33:57.324+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.9 2024-09-14T11:33:57.449 INFO:tasks.workunit.client.0.smithi071.stderr: -8> 2024-09-14T11:33:57.324+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.9 2024-09-14T11:33:57.449 INFO:tasks.workunit.client.0.smithi071.stderr: -7> 2024-09-14T11:33:57.324+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.10 2024-09-14T11:33:57.449 INFO:tasks.workunit.client.0.smithi071.stderr: -6> 2024-09-14T11:33:57.324+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.10 2024-09-14T11:33:57.449 INFO:tasks.workunit.client.0.smithi071.stderr: -5> 2024-09-14T11:33:57.328+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.11 2024-09-14T11:33:57.449 INFO:tasks.workunit.client.0.smithi071.stderr: -4> 2024-09-14T11:33:57.328+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.11 2024-09-14T11:33:57.450 INFO:tasks.workunit.client.0.smithi071.stderr: -3> 2024-09-14T11:33:57.328+0000 7f85ce9089c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.12 2024-09-14T11:33:57.450 INFO:tasks.workunit.client.0.smithi071.stderr: -2> 2024-09-14T11:33:57.328+0000 7f85ce9089c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.12 2024-09-14T11:33:57.450 INFO:tasks.workunit.client.0.smithi071.stderr: -1> 2024-09-14T11:33:57.332+0000 7f85ce9089c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f85ce9089c0 time 2024-09-14T11:33:57.336638+0000 2024-09-14T11:33:57.450 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:33:57.450 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:57.450 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:57.450 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f85d21e22eb] 2024-09-14T11:33:57.450 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f85d21e249f] 2024-09-14T11:33:57.450 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55750cc76c01] 2024-09-14T11:33:57.450 INFO:tasks.workunit.client.0.smithi071.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55750cc8b231] 2024-09-14T11:33:57.450 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55750cc8c884] 2024-09-14T11:33:57.450 INFO:tasks.workunit.client.0.smithi071.stderr: 6: main() 2024-09-14T11:33:57.450 INFO:tasks.workunit.client.0.smithi071.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f85d1048d90] 2024-09-14T11:33:57.450 INFO:tasks.workunit.client.0.smithi071.stderr: 8: __libc_start_main() 2024-09-14T11:33:57.451 INFO:tasks.workunit.client.0.smithi071.stderr: 9: _start() 2024-09-14T11:33:57.451 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:57.451 INFO:tasks.workunit.client.0.smithi071.stderr: 0> 2024-09-14T11:33:57.336+0000 7f85ce9089c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:33:57.451 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f85ce9089c0 thread_name:radosgw-admin 2024-09-14T11:33:57.451 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:57.451 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:57.451 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f85d1061520] 2024-09-14T11:33:57.451 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:33:57.451 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:33:57.451 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:33:57.451 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f85d21e2345] 2024-09-14T11:33:57.451 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f85d21e249f] 2024-09-14T11:33:57.451 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55750cc76c01] 2024-09-14T11:33:57.452 INFO:tasks.workunit.client.0.smithi071.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55750cc8b231] 2024-09-14T11:33:57.452 INFO:tasks.workunit.client.0.smithi071.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55750cc8c884] 2024-09-14T11:33:57.452 INFO:tasks.workunit.client.0.smithi071.stderr: 10: main() 2024-09-14T11:33:57.452 INFO:tasks.workunit.client.0.smithi071.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f85d1048d90] 2024-09-14T11:33:57.452 INFO:tasks.workunit.client.0.smithi071.stderr: 12: __libc_start_main() 2024-09-14T11:33:57.452 INFO:tasks.workunit.client.0.smithi071.stderr: 13: _start() 2024-09-14T11:33:57.452 INFO:tasks.workunit.client.0.smithi071.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:33:57.452 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:33:57.452 INFO:tasks.workunit.client.0.smithi071.stderr:--- logging levels --- 2024-09-14T11:33:57.452 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 none 2024-09-14T11:33:57.452 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 lockdep 2024-09-14T11:33:57.452 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 context 2024-09-14T11:33:57.452 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 crush 2024-09-14T11:33:57.452 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds 2024-09-14T11:33:57.453 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_balancer 2024-09-14T11:33:57.453 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_locker 2024-09-14T11:33:57.453 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log 2024-09-14T11:33:57.453 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log_expire 2024-09-14T11:33:57.453 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_migrator 2024-09-14T11:33:57.453 INFO:tasks.workunit.client.0.smithi071.stderr: 3/ 5 mds_quiesce 2024-09-14T11:33:57.453 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 buffer 2024-09-14T11:33:57.453 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 timer 2024-09-14T11:33:57.453 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 filer 2024-09-14T11:33:57.453 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 striper 2024-09-14T11:33:57.453 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 objecter 2024-09-14T11:33:57.453 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rados 2024-09-14T11:33:57.453 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd 2024-09-14T11:33:57.454 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_mirror 2024-09-14T11:33:57.454 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_replay 2024-09-14T11:33:57.454 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_pwl 2024-09-14T11:33:57.454 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 journaler 2024-09-14T11:33:57.454 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objectcacher 2024-09-14T11:33:57.454 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:33:57.454 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 client 2024-09-14T11:33:57.454 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 osd 2024-09-14T11:33:57.454 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 optracker 2024-09-14T11:33:57.454 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objclass 2024-09-14T11:33:57.454 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 filestore 2024-09-14T11:33:57.454 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 journal 2024-09-14T11:33:57.454 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 ms 2024-09-14T11:33:57.454 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mon 2024-09-14T11:33:57.455 INFO:tasks.workunit.client.0.smithi071.stderr: 0/10 monc 2024-09-14T11:33:57.455 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 paxos 2024-09-14T11:33:57.455 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 tp 2024-09-14T11:33:57.455 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 auth 2024-09-14T11:33:57.455 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 crypto 2024-09-14T11:33:57.455 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 finisher 2024-09-14T11:33:57.455 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 reserver 2024-09-14T11:33:57.455 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 heartbeatmap 2024-09-14T11:33:57.455 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 perfcounter 2024-09-14T11:33:57.455 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw 2024-09-14T11:33:57.455 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_sync 2024-09-14T11:33:57.455 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_datacache 2024-09-14T11:33:57.455 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_access 2024-09-14T11:33:57.455 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:33:57.456 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_flight 2024-09-14T11:33:57.456 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:33:57.456 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw_notification 2024-09-14T11:33:57.456 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 javaclient 2024-09-14T11:33:57.456 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 asok 2024-09-14T11:33:57.456 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 throttle 2024-09-14T11:33:57.456 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 refs 2024-09-14T11:33:57.456 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 compressor 2024-09-14T11:33:57.456 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluestore 2024-09-14T11:33:57.456 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluefs 2024-09-14T11:33:57.456 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 bdev 2024-09-14T11:33:57.456 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 kstore 2024-09-14T11:33:57.456 INFO:tasks.workunit.client.0.smithi071.stderr: 4/ 5 rocksdb 2024-09-14T11:33:57.456 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 fuse 2024-09-14T11:33:57.457 INFO:tasks.workunit.client.0.smithi071.stderr: 2/ 5 mgr 2024-09-14T11:33:57.457 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mgrc 2024-09-14T11:33:57.457 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 dpdk 2024-09-14T11:33:57.457 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 eventtrace 2024-09-14T11:33:57.457 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 prioritycache 2024-09-14T11:33:57.457 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 test 2024-09-14T11:33:57.457 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:33:57.457 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephsqlite 2024-09-14T11:33:57.457 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:33:57.457 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore 2024-09-14T11:33:57.457 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_onode 2024-09-14T11:33:57.457 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_odata 2024-09-14T11:33:57.457 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_omap 2024-09-14T11:33:57.457 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_tm 2024-09-14T11:33:57.458 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_t 2024-09-14T11:33:57.458 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:33:57.458 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_epm 2024-09-14T11:33:57.458 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_lba 2024-09-14T11:33:57.458 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:33:57.458 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cache 2024-09-14T11:33:57.458 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_journal 2024-09-14T11:33:57.458 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_device 2024-09-14T11:33:57.458 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_backref 2024-09-14T11:33:57.458 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 alienstore 2024-09-14T11:33:57.458 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mclock 2024-09-14T11:33:57.458 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cyanstore 2024-09-14T11:33:57.458 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 ceph_exporter 2024-09-14T11:33:57.459 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 memstore 2024-09-14T11:33:57.459 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 trace 2024-09-14T11:33:57.459 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 ceph_dedup 2024-09-14T11:33:57.459 INFO:tasks.workunit.client.0.smithi071.stderr: -2/-2 (syslog threshold) 2024-09-14T11:33:57.459 INFO:tasks.workunit.client.0.smithi071.stderr: 99/99 (stderr threshold) 2024-09-14T11:33:57.459 INFO:tasks.workunit.client.0.smithi071.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:33:57.459 INFO:tasks.workunit.client.0.smithi071.stderr: 7f847affd640 / http_manager 2024-09-14T11:33:57.459 INFO:tasks.workunit.client.0.smithi071.stderr: 7f8481fe3640 / http_manager 2024-09-14T11:33:57.459 INFO:tasks.workunit.client.0.smithi071.stderr: 7f8482fe5640 / rgw_dt_lg_renew 2024-09-14T11:33:57.459 INFO:tasks.workunit.client.0.smithi071.stderr: 7f84a9ffb640 / ms_dispatch 2024-09-14T11:33:57.459 INFO:tasks.workunit.client.0.smithi071.stderr: 7f84aaffd640 / io_context_pool 2024-09-14T11:33:57.459 INFO:tasks.workunit.client.0.smithi071.stderr: 7f84ab7fe640 / io_context_pool 2024-09-14T11:33:57.459 INFO:tasks.workunit.client.0.smithi071.stderr: 7f84b1ffb640 / ms_dispatch 2024-09-14T11:33:57.459 INFO:tasks.workunit.client.0.smithi071.stderr: 7f84b8e09640 / ms_dispatch 2024-09-14T11:33:57.460 INFO:tasks.workunit.client.0.smithi071.stderr: 7f84ba60c640 / io_context_pool 2024-09-14T11:33:57.460 INFO:tasks.workunit.client.0.smithi071.stderr: 7f85cbc0d640 / msgr-worker-2 2024-09-14T11:33:57.460 INFO:tasks.workunit.client.0.smithi071.stderr: 7f85cc40e640 / msgr-worker-1 2024-09-14T11:33:57.460 INFO:tasks.workunit.client.0.smithi071.stderr: 7f85ccc0f640 / msgr-worker-0 2024-09-14T11:33:57.460 INFO:tasks.workunit.client.0.smithi071.stderr: 7f85cd410640 / io_context_pool 2024-09-14T11:33:57.460 INFO:tasks.workunit.client.0.smithi071.stderr: 7f85ce9089c0 / radosgw-admin 2024-09-14T11:33:57.460 INFO:tasks.workunit.client.0.smithi071.stderr: max_recent 500 2024-09-14T11:33:57.460 INFO:tasks.workunit.client.0.smithi071.stderr: max_new 1000 2024-09-14T11:33:57.460 INFO:tasks.workunit.client.0.smithi071.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:33:57.339039Z_f347a1db-dd2d-4f26-ac30-888635584da2/log 2024-09-14T11:33:57.460 INFO:tasks.workunit.client.0.smithi071.stderr:--- end dump of recent events --- 2024-09-14T11:33:57.460 INFO:tasks.workunit.client.0.smithi071.stderr:Aborted 2024-09-14T11:33:57.460 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:33:57.463 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:57.463 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:57.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.412+0000 7f0a548799c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.416+0000 7f0a548799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.416+0000 7f0a548799c0 20 realm 2024-09-14T11:33:57.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.416+0000 7f0a548799c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.416+0000 7f0a548799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.416+0000 7f0a548799c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:57.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.416+0000 7f0a548799c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.416+0000 7f0a548799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.416+0000 7f0a548799c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.420+0000 7f0a548799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:57.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.420+0000 7f0a548799c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.420+0000 7f0a548799c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:57.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.420+0000 7f0a548799c0 20 searching for the correct realm 2024-09-14T11:33:57.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.424+0000 7f0a52b80640 0 -- 172.21.15.71:0/1752656031 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f0a48026070 msgr2=0x7f0a480641c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:57.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.428+0000 7f0a52b80640 0 -- 172.21.15.71:0/1752656031 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x5605359ce590 msgr2=0x5605359d0980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:57.464 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.440+0000 7f0a548799c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:57.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.440+0000 7f0a548799c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:33:57.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.440+0000 7f0a548799c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:57.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.440+0000 7f0a548799c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:33:57.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.440+0000 7f0a548799c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:57.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.440+0000 7f0a548799c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:57.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.440+0000 7f0a548799c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.440+0000 7f0a548799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.440+0000 7f0a548799c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.440+0000 7f0a548799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:57.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.440+0000 7f0a548799c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.440+0000 7f0a548799c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:57.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.440+0000 7f0a548799c0 20 zone default found 2024-09-14T11:33:57.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.440+0000 7f0a548799c0 4 Realm: () 2024-09-14T11:33:57.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.440+0000 7f0a548799c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:33:57.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.440+0000 7f0a548799c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:33:57.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.440+0000 7f0a548799c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:57.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.440+0000 7f0a548799c0 20 zonegroup default 2024-09-14T11:33:57.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.440+0000 7f0a548799c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.440+0000 7f0a548799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.440+0000 7f0a548799c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.440+0000 7f0a548799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.440+0000 7f0a548799c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.440+0000 7f0a548799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.440+0000 7f0a548799c0 20 started sync module instance, tier type = 2024-09-14T11:33:57.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.440+0000 7f0a548799c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:33:57.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.460+0000 7f0a548799c0 20 add_watcher() i=0 2024-09-14T11:33:57.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.460+0000 7f0a548799c0 20 add_watcher() i=1 2024-09-14T11:33:57.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.460+0000 7f0a548799c0 20 add_watcher() i=2 2024-09-14T11:33:57.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.460+0000 7f0a548799c0 20 add_watcher() i=3 2024-09-14T11:33:57.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.460+0000 7f0a548799c0 20 add_watcher() i=4 2024-09-14T11:33:57.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.460+0000 7f0a548799c0 20 add_watcher() i=5 2024-09-14T11:33:57.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.460+0000 7f0a548799c0 20 add_watcher() i=6 2024-09-14T11:33:57.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.464+0000 7f0a548799c0 20 add_watcher() i=7 2024-09-14T11:33:57.467 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.464+0000 7f0a548799c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:57.469 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.468+0000 7f0908fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:57.469 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.468+0000 7f0a548799c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:57.469 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.468+0000 7f0a548799c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:57.469 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.468+0000 7f0a548799c0 5 note: GC not initialized 2024-09-14T11:33:57.469 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.468+0000 7f08837fe640 20 reqs_thread_entry: start 2024-09-14T11:33:57.469 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.468+0000 7f0a548799c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:57.469 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.468+0000 7f0a548799c0 20 Filter name: none 2024-09-14T11:33:57.469 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.468+0000 7f08817fa640 20 reqs_thread_entry: start 2024-09-14T11:33:57.469 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.468+0000 7f0a548799c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.469 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.468+0000 7f0a548799c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:33:57.469 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.468+0000 7f0a548799c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.469 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.468+0000 7f0a548799c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:33:57.469 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.468+0000 7f0a548799c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:57.470 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.468+0000 7f0a548799c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.470 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.468+0000 7f0a548799c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:33:57.470 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.468+0000 7f0a548799c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.470 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.468+0000 7f0a548799c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:33:57.470 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.468+0000 7f0a548799c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:57.470 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.472+0000 7f0908fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:57.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.476+0000 7f0a548799c0 20 remove_watcher() i=0 2024-09-14T11:33:57.474 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.476+0000 7f0a548799c0 2 removed watcher, disabling cache 2024-09-14T11:33:57.476 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.476+0000 7f0a548799c0 20 remove_watcher() i=1 2024-09-14T11:33:57.478 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.480+0000 7f0a548799c0 20 remove_watcher() i=2 2024-09-14T11:33:57.480 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.480+0000 7f0a548799c0 20 remove_watcher() i=3 2024-09-14T11:33:57.482 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.484+0000 7f0a548799c0 20 remove_watcher() i=4 2024-09-14T11:33:57.484 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.484+0000 7f0a548799c0 20 remove_watcher() i=5 2024-09-14T11:33:57.486 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.488+0000 7f0a548799c0 20 remove_watcher() i=6 2024-09-14T11:33:57.489 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.492+0000 7f0a548799c0 20 remove_watcher() i=7 2024-09-14T11:33:57.513 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:33:57.539 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:57.539 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:57.582 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.584+0000 7f69e58299c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.585 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.588+0000 7f69e58299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.585 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.588+0000 7f69e58299c0 20 realm 2024-09-14T11:33:57.585 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.588+0000 7f69e58299c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.586 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.588+0000 7f69e58299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.586 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.588+0000 7f69e58299c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:57.586 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.588+0000 7f69e58299c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.586 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.588+0000 7f69e58299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.586 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.588+0000 7f69e58299c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.586 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.588+0000 7f69e58299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:57.587 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.588+0000 7f69e58299c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.587 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.588+0000 7f69e58299c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:57.588 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.588+0000 7f69e58299c0 20 searching for the correct realm 2024-09-14T11:33:57.591 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.592+0000 7f69e3b30640 0 -- 172.21.15.71:0/3525999654 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f69d8030060 msgr2=0x7f69d80629a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:57.599 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.600+0000 7f69e3b30640 0 -- 172.21.15.71:0/3525999654 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x563576fb9840 msgr2=0x563576fbbc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:57.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.608+0000 7f69e58299c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:57.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.608+0000 7f69e58299c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:33:57.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.608+0000 7f69e58299c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:57.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.608+0000 7f69e58299c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:33:57.609 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.608+0000 7f69e58299c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:57.609 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.608+0000 7f69e58299c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:57.609 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.608+0000 7f69e58299c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.609 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.612+0000 7f69e58299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.609 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.612+0000 7f69e58299c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.609 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.612+0000 7f69e58299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:57.609 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.612+0000 7f69e58299c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.610 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.612+0000 7f69e58299c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:57.610 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.612+0000 7f69e58299c0 20 zone default found 2024-09-14T11:33:57.610 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.612+0000 7f69e58299c0 4 Realm: () 2024-09-14T11:33:57.610 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.612+0000 7f69e58299c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:33:57.611 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.612+0000 7f69e58299c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:33:57.611 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.612+0000 7f69e58299c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:57.611 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.612+0000 7f69e58299c0 20 zonegroup default 2024-09-14T11:33:57.611 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.612+0000 7f69e58299c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.612+0000 7f69e58299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.612+0000 7f69e58299c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.612+0000 7f69e58299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.612+0000 7f69e58299c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.612+0000 7f69e58299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:57.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.612+0000 7f69e58299c0 20 started sync module instance, tier type = 2024-09-14T11:33:57.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.612+0000 7f69e58299c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:33:57.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.632+0000 7f69e58299c0 20 add_watcher() i=0 2024-09-14T11:33:57.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.632+0000 7f69e58299c0 20 add_watcher() i=1 2024-09-14T11:33:57.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.632+0000 7f69e58299c0 20 add_watcher() i=2 2024-09-14T11:33:57.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.632+0000 7f69e58299c0 20 add_watcher() i=3 2024-09-14T11:33:57.630 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.632+0000 7f69e58299c0 20 add_watcher() i=4 2024-09-14T11:33:57.630 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.632+0000 7f69e58299c0 20 add_watcher() i=5 2024-09-14T11:33:57.630 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.632+0000 7f69e58299c0 20 add_watcher() i=6 2024-09-14T11:33:57.631 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.632+0000 7f69e58299c0 20 add_watcher() i=7 2024-09-14T11:33:57.632 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.632+0000 7f69e58299c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:57.635 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.636+0000 7f6899fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:57.636 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.636+0000 7f69e58299c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:57.636 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.636+0000 7f69e58299c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:57.636 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.636+0000 7f69e58299c0 5 note: GC not initialized 2024-09-14T11:33:57.636 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.636+0000 7f6898fe1640 20 reqs_thread_entry: start 2024-09-14T11:33:57.636 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.636+0000 7f69e58299c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:57.636 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.636+0000 7f69e58299c0 20 Filter name: none 2024-09-14T11:33:57.636 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.636+0000 7f68127fc640 20 reqs_thread_entry: start 2024-09-14T11:33:57.636 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.636+0000 7f69e58299c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:33:57.636 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.636+0000 7f69e58299c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.637 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.636+0000 7f69e58299c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:33:57.637 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.636+0000 7f69e58299c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:33:57.638 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.636+0000 7f69e58299c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:33:57.638 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.636+0000 7f69e58299c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 : miss 2024-09-14T11:33:57.638 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.636+0000 7f69e58299c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:57.638 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.640+0000 7f69e58299c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:33:57.638 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.640+0000 7f69e58299c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:33:57.638 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.640+0000 7f69e58299c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:33:57.638 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.640+0000 7f69e58299c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:57.638 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.640+0000 7f69e58299c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:33:57.638 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.640+0000 7f69e58299c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 2024-09-14T11:33:57.638 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.640+0000 7f69e58299c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.0 2024-09-14T11:33:57.638 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.640+0000 7f69e58299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.0 2024-09-14T11:33:57.638 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.640+0000 7f69e58299c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.1 2024-09-14T11:33:57.638 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.640+0000 7f69e58299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.1 2024-09-14T11:33:57.639 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.640+0000 7f69e58299c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.2 2024-09-14T11:33:57.639 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.640+0000 7f69e58299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.2 2024-09-14T11:33:57.639 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.640+0000 7f69e58299c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.3 2024-09-14T11:33:57.639 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.640+0000 7f69e58299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.3 2024-09-14T11:33:57.639 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.640+0000 7f69e58299c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.4 2024-09-14T11:33:57.640 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.640+0000 7f69e58299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.4 2024-09-14T11:33:57.640 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.640+0000 7f69e58299c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.5 2024-09-14T11:33:57.640 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.640+0000 7f69e58299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.5 2024-09-14T11:33:57.640 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.644+0000 7f69e58299c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.6 2024-09-14T11:33:57.640 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.644+0000 7f69e58299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.6 2024-09-14T11:33:57.641 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.644+0000 7f69e58299c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.7 2024-09-14T11:33:57.641 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.644+0000 7f69e58299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.7 2024-09-14T11:33:57.641 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.644+0000 7f69e58299c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.8 2024-09-14T11:33:57.641 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.644+0000 7f69e58299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.8 2024-09-14T11:33:57.642 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.644+0000 7f69e58299c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.9 2024-09-14T11:33:57.643 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.644+0000 7f69e58299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.9 2024-09-14T11:33:57.643 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.644+0000 7f69e58299c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.10 2024-09-14T11:33:57.643 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.644+0000 7f69e58299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.10 2024-09-14T11:33:57.643 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.644+0000 7f69e58299c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.11 2024-09-14T11:33:57.643 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.644+0000 7f69e58299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.11 2024-09-14T11:33:57.645 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.648+0000 7f69e58299c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.12 2024-09-14T11:33:57.645 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.648+0000 7f69e58299c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.12 2024-09-14T11:33:57.646 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.648+0000 7f6899fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:57.650 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.652+0000 7f69e58299c0 20 remove_watcher() i=0 2024-09-14T11:33:57.650 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.652+0000 7f69e58299c0 2 removed watcher, disabling cache 2024-09-14T11:33:57.652 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.652+0000 7f69e58299c0 20 remove_watcher() i=1 2024-09-14T11:33:57.654 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.656+0000 7f69e58299c0 20 remove_watcher() i=2 2024-09-14T11:33:57.656 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.656+0000 7f69e58299c0 20 remove_watcher() i=3 2024-09-14T11:33:57.658 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.660+0000 7f69e58299c0 20 remove_watcher() i=4 2024-09-14T11:33:57.660 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.660+0000 7f69e58299c0 20 remove_watcher() i=5 2024-09-14T11:33:57.662 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.664+0000 7f69e58299c0 20 remove_watcher() i=6 2024-09-14T11:33:57.665 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:33:57.668+0000 7f69e58299c0 20 remove_watcher() i=7 2024-09-14T11:34:27.709 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:34:27.742 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:27.742 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:27.791 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:27.792+0000 7fba47f339c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:27.794 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:27.796+0000 7fba47f339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:27.794 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:27.796+0000 7fba47f339c0 20 realm 2024-09-14T11:34:27.794 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:27.796+0000 7fba47f339c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:27.794 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:27.796+0000 7fba47f339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:27.795 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:27.796+0000 7fba47f339c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:27.795 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:27.796+0000 7fba47f339c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:27.795 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:27.796+0000 7fba47f339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:27.795 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:27.796+0000 7fba47f339c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:27.796 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:27.796+0000 7fba47f339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:27.796 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:27.796+0000 7fba47f339c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:27.797 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:27.800+0000 7fba47f339c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:27.797 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:27.800+0000 7fba47f339c0 20 searching for the correct realm 2024-09-14T11:34:27.799 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:27.800+0000 7fba45238640 0 -- 172.21.15.71:0/2392508337 >> [v2:172.21.15.71:6824/2436891866,v1:172.21.15.71:6825/2436891866] conn(0x7fba38021070 msgr2=0x7fba3804b970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:28.010 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.012+0000 7fba45a39640 0 -- 172.21.15.71:0/2392508337 >> [v2:172.21.15.157:6816/1231501119,v1:172.21.15.157:6817/1231501119] conn(0x5582440917b0 msgr2=0x558244093c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:28.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.028+0000 7fba47f339c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:28.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.028+0000 7fba47f339c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:34:28.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.028+0000 7fba47f339c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:28.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.028+0000 7fba47f339c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:34:28.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.028+0000 7fba47f339c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:28.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.028+0000 7fba47f339c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:28.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.028+0000 7fba47f339c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.028+0000 7fba47f339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:28.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.028+0000 7fba47f339c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.029 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.032+0000 7fba47f339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:28.029 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.032+0000 7fba47f339c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.030 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.032+0000 7fba47f339c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:28.030 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.032+0000 7fba47f339c0 20 zone default found 2024-09-14T11:34:28.030 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.032+0000 7fba47f339c0 4 Realm: () 2024-09-14T11:34:28.031 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.032+0000 7fba47f339c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:34:28.031 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.032+0000 7fba47f339c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:34:28.031 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.032+0000 7fba47f339c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:28.031 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.032+0000 7fba47f339c0 20 zonegroup default 2024-09-14T11:34:28.031 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.032+0000 7fba47f339c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.031 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.032+0000 7fba47f339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:28.031 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.032+0000 7fba47f339c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.032 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.032+0000 7fba47f339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:28.032 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.032+0000 7fba47f339c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.033 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.036+0000 7fba47f339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:28.033 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.036+0000 7fba47f339c0 20 started sync module instance, tier type = 2024-09-14T11:34:28.033 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.036+0000 7fba47f339c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:34:28.055 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.056+0000 7fba47f339c0 20 add_watcher() i=0 2024-09-14T11:34:28.055 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.056+0000 7fba47f339c0 20 add_watcher() i=1 2024-09-14T11:34:28.055 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.056+0000 7fba47f339c0 20 add_watcher() i=2 2024-09-14T11:34:28.055 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.056+0000 7fba47f339c0 20 add_watcher() i=3 2024-09-14T11:34:28.055 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.056+0000 7fba47f339c0 20 add_watcher() i=4 2024-09-14T11:34:28.056 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.056+0000 7fba47f339c0 20 add_watcher() i=5 2024-09-14T11:34:28.056 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.056+0000 7fba47f339c0 20 add_watcher() i=6 2024-09-14T11:34:28.058 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.060+0000 7fba47f339c0 20 add_watcher() i=7 2024-09-14T11:34:28.058 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.060+0000 7fba47f339c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:28.062 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.064+0000 7fb8f77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:28.063 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.064+0000 7fba47f339c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:28.063 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.064+0000 7fba47f339c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:28.063 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.064+0000 7fba47f339c0 5 note: GC not initialized 2024-09-14T11:34:28.063 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.064+0000 7fb8f67fc640 20 reqs_thread_entry: start 2024-09-14T11:34:28.063 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.064+0000 7fba47f339c0 20 init_complete bucket index max shards: 11 2024-09-14T11:34:28.064 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.064+0000 7fba47f339c0 20 Filter name: none 2024-09-14T11:34:28.064 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.064+0000 7fb867fff640 20 reqs_thread_entry: start 2024-09-14T11:34:28.064 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.064+0000 7fba47f339c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.065 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.068+0000 7fba47f339c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:28.065 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.068+0000 7fba47f339c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.065 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.068+0000 7fba47f339c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:34:28.065 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.068+0000 7fba47f339c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:28.066 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.068+0000 7fba47f339c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.066 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.068+0000 7fba47f339c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:28.066 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.068+0000 7fba47f339c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.066 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.068+0000 7fba47f339c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:34:28.066 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.068+0000 7fba47f339c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:28.069 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.072+0000 7fb8f77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:28.073 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.076+0000 7fba47f339c0 20 remove_watcher() i=0 2024-09-14T11:34:28.073 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.076+0000 7fba47f339c0 2 removed watcher, disabling cache 2024-09-14T11:34:28.075 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.076+0000 7fba47f339c0 20 remove_watcher() i=1 2024-09-14T11:34:28.077 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.080+0000 7fba47f339c0 20 remove_watcher() i=2 2024-09-14T11:34:28.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.080+0000 7fba47f339c0 20 remove_watcher() i=3 2024-09-14T11:34:28.081 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.084+0000 7fba47f339c0 20 remove_watcher() i=4 2024-09-14T11:34:28.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.084+0000 7fba47f339c0 20 remove_watcher() i=5 2024-09-14T11:34:28.086 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.088+0000 7fba47f339c0 20 remove_watcher() i=6 2024-09-14T11:34:28.088 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.088+0000 7fba47f339c0 20 remove_watcher() i=7 2024-09-14T11:34:28.140 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:34:28.170 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:28.170 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:28.214 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.216+0000 7f7e5b6339c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.216 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.220+0000 7f7e5b6339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:28.216 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.220+0000 7f7e5b6339c0 20 realm 2024-09-14T11:34:28.216 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.220+0000 7f7e5b6339c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.220+0000 7f7e5b6339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:28.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.220+0000 7f7e5b6339c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:28.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.220+0000 7f7e5b6339c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.220+0000 7f7e5b6339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:28.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.220+0000 7f7e5b6339c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.218 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.220+0000 7f7e5b6339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:28.218 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.220+0000 7f7e5b6339c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.219 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.220+0000 7f7e5b6339c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:28.219 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.220+0000 7f7e5b6339c0 20 searching for the correct realm 2024-09-14T11:34:28.223 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.224+0000 7f7e5993a640 0 -- 172.21.15.71:0/3509139997 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f7e500e9920 msgr2=0x7f7e500b9450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:28.229 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.232+0000 7f7e5993a640 0 -- 172.21.15.71:0/3509139997 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x5593abad6800 msgr2=0x5593abad8bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:28.241 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.244+0000 7f7e5b6339c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:28.241 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.244+0000 7f7e5b6339c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:34:28.241 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.244+0000 7f7e5b6339c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:28.241 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.244+0000 7f7e5b6339c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:34:28.241 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.244+0000 7f7e5b6339c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:28.241 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.244+0000 7f7e5b6339c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:28.241 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.244+0000 7f7e5b6339c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.242 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.244+0000 7f7e5b6339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:28.242 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.244+0000 7f7e5b6339c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.242 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.244+0000 7f7e5b6339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:28.242 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.244+0000 7f7e5b6339c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.244+0000 7f7e5b6339c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:28.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.244+0000 7f7e5b6339c0 20 zone default found 2024-09-14T11:34:28.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.244+0000 7f7e5b6339c0 4 Realm: () 2024-09-14T11:34:28.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.244+0000 7f7e5b6339c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:34:28.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.244+0000 7f7e5b6339c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:34:28.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.244+0000 7f7e5b6339c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:28.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.244+0000 7f7e5b6339c0 20 zonegroup default 2024-09-14T11:34:28.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.244+0000 7f7e5b6339c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.244+0000 7f7e5b6339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:28.244 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.244+0000 7f7e5b6339c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.244 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.244+0000 7f7e5b6339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:28.244 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.244+0000 7f7e5b6339c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.244 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.244+0000 7f7e5b6339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:28.244 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.244+0000 7f7e5b6339c0 20 started sync module instance, tier type = 2024-09-14T11:34:28.244 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.244+0000 7f7e5b6339c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:34:28.262 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.264+0000 7f7e5b6339c0 20 add_watcher() i=0 2024-09-14T11:34:28.262 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.264+0000 7f7e5b6339c0 20 add_watcher() i=1 2024-09-14T11:34:28.262 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.264+0000 7f7e5b6339c0 20 add_watcher() i=2 2024-09-14T11:34:28.262 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.264+0000 7f7e5b6339c0 20 add_watcher() i=3 2024-09-14T11:34:28.262 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.264+0000 7f7e5b6339c0 20 add_watcher() i=4 2024-09-14T11:34:28.262 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.264+0000 7f7e5b6339c0 20 add_watcher() i=5 2024-09-14T11:34:28.262 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.264+0000 7f7e5b6339c0 20 add_watcher() i=6 2024-09-14T11:34:28.264 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.268+0000 7f7e5b6339c0 20 add_watcher() i=7 2024-09-14T11:34:28.264 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.268+0000 7f7e5b6339c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:28.268 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.268+0000 7f7d0ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:28.268 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.272+0000 7f7e5b6339c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:28.268 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.272+0000 7f7e5b6339c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:28.268 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.272+0000 7f7e5b6339c0 5 note: GC not initialized 2024-09-14T11:34:28.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.272+0000 7f7d0efe5640 20 reqs_thread_entry: start 2024-09-14T11:34:28.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.272+0000 7f7e5b6339c0 20 init_complete bucket index max shards: 11 2024-09-14T11:34:28.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.272+0000 7f7e5b6339c0 20 Filter name: none 2024-09-14T11:34:28.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.272+0000 7f7d0cfe1640 20 reqs_thread_entry: start 2024-09-14T11:34:28.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.272+0000 7f7e5b6339c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:34:28.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.272+0000 7f7e5b6339c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.270 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.272+0000 7f7e5b6339c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:28.270 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.272+0000 7f7e5b6339c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:34:28.271 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.272+0000 7f7e5b6339c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:34:28.271 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.272+0000 7f7e5b6339c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 : miss 2024-09-14T11:34:28.271 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.272+0000 7f7e5b6339c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.271 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.272+0000 7f7e5b6339c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:34:28.271 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.272+0000 7f7e5b6339c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:34:28.271 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.272+0000 7f7e5b6339c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:34:28.271 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.272+0000 7f7e5b6339c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:28.271 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.272+0000 7f7e5b6339c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:28.271 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.272+0000 7f7e5b6339c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 2024-09-14T11:34:28.271 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.272+0000 7f7e5b6339c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.0 2024-09-14T11:34:28.271 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.272+0000 7f7e5b6339c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.0 2024-09-14T11:34:28.271 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.272+0000 7f7e5b6339c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.1 2024-09-14T11:34:28.271 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.272+0000 7f7e5b6339c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.1 2024-09-14T11:34:28.272 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.272+0000 7f7e5b6339c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.2 2024-09-14T11:34:28.272 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.272+0000 7f7e5b6339c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.2 2024-09-14T11:34:28.272 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.272+0000 7f7e5b6339c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.3 2024-09-14T11:34:28.272 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.272+0000 7f7e5b6339c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.3 2024-09-14T11:34:28.272 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.276+0000 7f7e5b6339c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.4 2024-09-14T11:34:28.273 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.276+0000 7f7e5b6339c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.4 2024-09-14T11:34:28.273 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.276+0000 7f7e5b6339c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.5 2024-09-14T11:34:28.273 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.276+0000 7f7e5b6339c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.5 2024-09-14T11:34:28.274 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.276+0000 7f7e5b6339c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.6 2024-09-14T11:34:28.274 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.276+0000 7f7e5b6339c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.6 2024-09-14T11:34:28.275 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.276+0000 7f7e5b6339c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.7 2024-09-14T11:34:28.275 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.276+0000 7f7e5b6339c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.7 2024-09-14T11:34:28.275 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.276+0000 7f7e5b6339c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.8 2024-09-14T11:34:28.275 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.276+0000 7f7e5b6339c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.8 2024-09-14T11:34:28.276 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.276+0000 7f7e5b6339c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.9 2024-09-14T11:34:28.276 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.276+0000 7f7e5b6339c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.9 2024-09-14T11:34:28.276 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.276+0000 7f7e5b6339c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.10 2024-09-14T11:34:28.276 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.276+0000 7f7e5b6339c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.10 2024-09-14T11:34:28.277 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.280+0000 7f7e5b6339c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.11 2024-09-14T11:34:28.277 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.280+0000 7f7e5b6339c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.11 2024-09-14T11:34:28.278 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.280+0000 7f7e5b6339c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.12 2024-09-14T11:34:28.278 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.280+0000 7f7e5b6339c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.12 2024-09-14T11:34:28.279 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.280+0000 7f7d0ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:28.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.284+0000 7f7e5b6339c0 20 remove_watcher() i=0 2024-09-14T11:34:28.283 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.284+0000 7f7e5b6339c0 2 removed watcher, disabling cache 2024-09-14T11:34:28.285 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.288+0000 7f7e5b6339c0 20 remove_watcher() i=1 2024-09-14T11:34:28.287 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.288+0000 7f7e5b6339c0 20 remove_watcher() i=2 2024-09-14T11:34:28.289 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.292+0000 7f7e5b6339c0 20 remove_watcher() i=3 2024-09-14T11:34:28.291 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.292+0000 7f7e5b6339c0 20 remove_watcher() i=4 2024-09-14T11:34:28.293 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.296+0000 7f7e5b6339c0 20 remove_watcher() i=5 2024-09-14T11:34:28.295 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.296+0000 7f7e5b6339c0 20 remove_watcher() i=6 2024-09-14T11:34:28.298 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.300+0000 7f7e5b6339c0 20 remove_watcher() i=7 2024-09-14T11:34:28.312 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:34:28.339 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:28.339 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:28.383 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.384+0000 7f4eedc0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.386 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.388+0000 7f4eedc0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:28.386 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.388+0000 7f4eedc0e9c0 20 realm 2024-09-14T11:34:28.386 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.388+0000 7f4eedc0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.386 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.388+0000 7f4eedc0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:28.387 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.388+0000 7f4eedc0e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:28.387 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.388+0000 7f4eedc0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.387 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.388+0000 7f4eedc0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:28.387 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.388+0000 7f4eedc0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.388 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.388+0000 7f4eedc0e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:28.388 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.388+0000 7f4eedc0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.389 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.392+0000 7f4eedc0e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:28.389 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.392+0000 7f4eedc0e9c0 20 searching for the correct realm 2024-09-14T11:34:28.392 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.396+0000 7f4eebf15640 0 -- 172.21.15.71:0/3726086718 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f4ee00faa80 msgr2=0x7f4ee0113a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:28.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.612+0000 7f4eebf15640 0 -- 172.21.15.71:0/3726086718 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x556962359780 msgr2=0x55696235bb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:28.623 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.624+0000 7f4eedc0e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:28.623 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.624+0000 7f4eedc0e9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:34:28.623 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.624+0000 7f4eedc0e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:28.623 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.624+0000 7f4eedc0e9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:34:28.624 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.624+0000 7f4eedc0e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:28.624 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.624+0000 7f4eedc0e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:28.624 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.624+0000 7f4eedc0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.624 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.624+0000 7f4eedc0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:28.624 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.628+0000 7f4eedc0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.625 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.628+0000 7f4eedc0e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:28.625 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.628+0000 7f4eedc0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.626 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.628+0000 7f4eedc0e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:28.626 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.628+0000 7f4eedc0e9c0 20 zone default found 2024-09-14T11:34:28.626 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.628+0000 7f4eedc0e9c0 4 Realm: () 2024-09-14T11:34:28.626 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.628+0000 7f4eedc0e9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:34:28.626 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.628+0000 7f4eedc0e9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:34:28.626 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.628+0000 7f4eedc0e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:28.626 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.628+0000 7f4eedc0e9c0 20 zonegroup default 2024-09-14T11:34:28.626 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.628+0000 7f4eedc0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.627 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.628+0000 7f4eedc0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:28.627 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.628+0000 7f4eedc0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.627 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.628+0000 7f4eedc0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:28.627 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.628+0000 7f4eedc0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.628+0000 7f4eedc0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:28.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.628+0000 7f4eedc0e9c0 20 started sync module instance, tier type = 2024-09-14T11:34:28.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.628+0000 7f4eedc0e9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:34:28.649 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.652+0000 7f4eedc0e9c0 20 add_watcher() i=0 2024-09-14T11:34:28.649 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.652+0000 7f4eedc0e9c0 20 add_watcher() i=1 2024-09-14T11:34:28.649 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.652+0000 7f4eedc0e9c0 20 add_watcher() i=2 2024-09-14T11:34:28.649 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.652+0000 7f4eedc0e9c0 20 add_watcher() i=3 2024-09-14T11:34:28.649 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.652+0000 7f4eedc0e9c0 20 add_watcher() i=4 2024-09-14T11:34:28.650 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.652+0000 7f4eedc0e9c0 20 add_watcher() i=5 2024-09-14T11:34:28.650 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.652+0000 7f4eedc0e9c0 20 add_watcher() i=6 2024-09-14T11:34:28.652 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.652+0000 7f4eedc0e9c0 20 add_watcher() i=7 2024-09-14T11:34:28.652 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.652+0000 7f4eedc0e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:28.656 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.656+0000 7f4da1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:28.657 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.660+0000 7f4eedc0e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:28.657 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.660+0000 7f4eedc0e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:28.657 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.660+0000 7f4eedc0e9c0 5 note: GC not initialized 2024-09-14T11:34:28.658 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.660+0000 7f4da0fe1640 20 reqs_thread_entry: start 2024-09-14T11:34:28.658 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.660+0000 7f4eedc0e9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:34:28.658 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.660+0000 7f4eedc0e9c0 20 Filter name: none 2024-09-14T11:34:28.659 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.660+0000 7f4d1a7fc640 20 reqs_thread_entry: start 2024-09-14T11:34:28.659 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.660+0000 7f4eedc0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.659 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.660+0000 7f4eedc0e9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:28.659 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.660+0000 7f4eedc0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.659 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.660+0000 7f4eedc0e9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:34:28.659 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.660+0000 7f4eedc0e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:28.660 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.660+0000 7f4eedc0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.660 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.660+0000 7f4eedc0e9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:28.660 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.660+0000 7f4eedc0e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.661 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.664+0000 7f4eedc0e9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:34:28.661 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.664+0000 7f4eedc0e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:28.664 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.664+0000 7f4da1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:28.668 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.672+0000 7f4eedc0e9c0 20 remove_watcher() i=0 2024-09-14T11:34:28.668 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.672+0000 7f4eedc0e9c0 2 removed watcher, disabling cache 2024-09-14T11:34:28.671 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.672+0000 7f4eedc0e9c0 20 remove_watcher() i=1 2024-09-14T11:34:28.673 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.676+0000 7f4eedc0e9c0 20 remove_watcher() i=2 2024-09-14T11:34:28.768 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.676+0000 7f4eedc0e9c0 20 remove_watcher() i=3 2024-09-14T11:34:28.769 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.680+0000 7f4eedc0e9c0 20 remove_watcher() i=4 2024-09-14T11:34:28.769 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.680+0000 7f4eedc0e9c0 20 remove_watcher() i=5 2024-09-14T11:34:28.769 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.684+0000 7f4eedc0e9c0 20 remove_watcher() i=6 2024-09-14T11:34:28.769 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.688+0000 7f4eedc0e9c0 20 remove_watcher() i=7 2024-09-14T11:34:28.769 INFO:tasks.workunit.client.0.smithi071.stderr: test: duplicated entries should be purged before reshard 2024-09-14T11:34:28.769 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:34:28.769 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:28.769 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:28.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.972+0000 7fec1db2c640 0 --2- 172.21.15.71:0/985581390 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0f8688bc0 0x55a0f868e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:34:28.977 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.980+0000 7fec208279c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.981 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.984+0000 7fec208279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:28.981 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.984+0000 7fec208279c0 20 realm 2024-09-14T11:34:28.981 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.984+0000 7fec208279c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.981 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.984+0000 7fec208279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:28.982 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.984+0000 7fec208279c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:28.982 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.984+0000 7fec208279c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.982 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.984+0000 7fec208279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:28.982 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.984+0000 7fec208279c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.982 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.984+0000 7fec208279c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:28.983 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.984+0000 7fec208279c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.983 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.984+0000 7fec1eb2e640 0 -- 172.21.15.71:0/492134663 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55a0f86af7c0 msgr2=0x55a0f86b1bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:28.984 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.984+0000 7fec208279c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:28.984 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.984+0000 7fec208279c0 20 searching for the correct realm 2024-09-14T11:34:28.989 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:28.992+0000 7fec1eb2e640 0 -- 172.21.15.71:0/492134663 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fec1403f070 msgr2=0x7fec1403f960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:29.005 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.008+0000 7fec208279c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:29.005 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.008+0000 7fec208279c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:34:29.005 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.008+0000 7fec208279c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:29.006 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.008+0000 7fec208279c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:34:29.006 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.008+0000 7fec208279c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:29.006 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.008+0000 7fec208279c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:29.006 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.008+0000 7fec208279c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.006 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.008+0000 7fec208279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.006 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.008+0000 7fec208279c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.006 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.008+0000 7fec208279c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:29.006 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.008+0000 7fec208279c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.007 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.008+0000 7fec208279c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:29.007 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.008+0000 7fec208279c0 20 zone default found 2024-09-14T11:34:29.007 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.008+0000 7fec208279c0 4 Realm: () 2024-09-14T11:34:29.007 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.008+0000 7fec208279c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:34:29.007 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.008+0000 7fec208279c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:34:29.007 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.008+0000 7fec208279c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:29.007 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.008+0000 7fec208279c0 20 zonegroup default 2024-09-14T11:34:29.007 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.008+0000 7fec208279c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.008 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.008+0000 7fec208279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.008 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.008+0000 7fec208279c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.008 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.008+0000 7fec208279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.008 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.008+0000 7fec208279c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.008 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.012+0000 7fec208279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.008 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.012+0000 7fec208279c0 20 started sync module instance, tier type = 2024-09-14T11:34:29.009 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.012+0000 7fec208279c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:34:29.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.028+0000 7fec208279c0 20 add_watcher() i=0 2024-09-14T11:34:29.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.028+0000 7fec208279c0 20 add_watcher() i=1 2024-09-14T11:34:29.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.028+0000 7fec208279c0 20 add_watcher() i=2 2024-09-14T11:34:29.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.028+0000 7fec208279c0 20 add_watcher() i=3 2024-09-14T11:34:29.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.028+0000 7fec208279c0 20 add_watcher() i=4 2024-09-14T11:34:29.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.028+0000 7fec208279c0 20 add_watcher() i=5 2024-09-14T11:34:29.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.028+0000 7fec208279c0 20 add_watcher() i=6 2024-09-14T11:34:29.030 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.032+0000 7fec208279c0 20 add_watcher() i=7 2024-09-14T11:34:29.030 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.032+0000 7fec208279c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:29.033 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.036+0000 7fead4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:29.034 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.036+0000 7fec208279c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:29.034 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.036+0000 7fec208279c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:29.034 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.036+0000 7fec208279c0 5 note: GC not initialized 2024-09-14T11:34:29.035 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.036+0000 7fea4f7fe640 20 reqs_thread_entry: start 2024-09-14T11:34:29.035 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.036+0000 7fec208279c0 20 init_complete bucket index max shards: 11 2024-09-14T11:34:29.035 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.036+0000 7fec208279c0 20 Filter name: none 2024-09-14T11:34:29.036 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.036+0000 7fea4d7fa640 20 reqs_thread_entry: start 2024-09-14T11:34:29.036 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.036+0000 7fec208279c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.036 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.036+0000 7fec208279c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:29.036 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.036+0000 7fec208279c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.040+0000 7fec208279c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:34:29.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.040+0000 7fec208279c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:29.037 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.040+0000 7fec208279c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.038 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.040+0000 7fec208279c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:29.038 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.040+0000 7fec208279c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.039 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.040+0000 7fec208279c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:34:29.039 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.040+0000 7fec208279c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:29.042 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.044+0000 7fead4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:29.045 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.048+0000 7fec208279c0 20 remove_watcher() i=0 2024-09-14T11:34:29.046 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.048+0000 7fec208279c0 2 removed watcher, disabling cache 2024-09-14T11:34:29.047 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.048+0000 7fec208279c0 20 remove_watcher() i=1 2024-09-14T11:34:29.049 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.052+0000 7fec208279c0 20 remove_watcher() i=2 2024-09-14T11:34:29.051 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.052+0000 7fec208279c0 20 remove_watcher() i=3 2024-09-14T11:34:29.053 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.056+0000 7fec208279c0 20 remove_watcher() i=4 2024-09-14T11:34:29.055 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.056+0000 7fec208279c0 20 remove_watcher() i=5 2024-09-14T11:34:29.058 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.060+0000 7fec208279c0 20 remove_watcher() i=6 2024-09-14T11:34:29.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.064+0000 7fec208279c0 20 remove_watcher() i=7 2024-09-14T11:34:29.079 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.079 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:34:29.079 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: a-bucket id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.18 num_objects: 10 size_kb: 1 num_shards: 13 2024-09-14T11:34:29.079 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.080 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:34:29.116 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:29.116 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:29.162 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.164+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.165 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.168+0000 7f1887e2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.165 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.168+0000 7f1887e2f9c0 20 realm 2024-09-14T11:34:29.165 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.168+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.166 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.168+0000 7f1887e2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.166 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.168+0000 7f1887e2f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:29.166 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.168+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.166 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.168+0000 7f1887e2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.166 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.168+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.167 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.168+0000 7f1887e2f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:29.167 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.168+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.168 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.168+0000 7f1887e2f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:29.168 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.168+0000 7f1887e2f9c0 20 searching for the correct realm 2024-09-14T11:34:29.170 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.172+0000 7f1885134640 0 -- 172.21.15.71:0/3078911883 >> [v2:172.21.15.71:6824/2436891866,v1:172.21.15.71:6825/2436891866] conn(0x7f1878067470 msgr2=0x7f18780661b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:29.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.180+0000 7f1885935640 0 -- 172.21.15.71:0/3078911883 >> [v2:172.21.15.157:6816/1231501119,v1:172.21.15.157:6817/1231501119] conn(0x5595eb3b5d30 msgr2=0x5595eb3b81d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:29.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.188+0000 7f1887e2f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:29.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.188+0000 7f1887e2f9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:34:29.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.188+0000 7f1887e2f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:29.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.188+0000 7f1887e2f9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:34:29.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.188+0000 7f1887e2f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:29.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.188+0000 7f1887e2f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:29.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.188+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.188+0000 7f1887e2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.188+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.188+0000 7f1887e2f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:29.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.188+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.192+0000 7f1887e2f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:29.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.192+0000 7f1887e2f9c0 20 zone default found 2024-09-14T11:34:29.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.192+0000 7f1887e2f9c0 4 Realm: () 2024-09-14T11:34:29.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.192+0000 7f1887e2f9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:34:29.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.192+0000 7f1887e2f9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:34:29.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.192+0000 7f1887e2f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:29.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.192+0000 7f1887e2f9c0 20 zonegroup default 2024-09-14T11:34:29.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.192+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.192+0000 7f1887e2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.192+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.192+0000 7f1887e2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.189 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.192+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.192+0000 7f1887e2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.192+0000 7f1887e2f9c0 20 started sync module instance, tier type = 2024-09-14T11:34:29.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.192+0000 7f1887e2f9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:34:29.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.208+0000 7f1887e2f9c0 20 add_watcher() i=0 2024-09-14T11:34:29.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.208+0000 7f1887e2f9c0 20 add_watcher() i=1 2024-09-14T11:34:29.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.208+0000 7f1887e2f9c0 20 add_watcher() i=2 2024-09-14T11:34:29.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.208+0000 7f1887e2f9c0 20 add_watcher() i=3 2024-09-14T11:34:29.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.208+0000 7f1887e2f9c0 20 add_watcher() i=4 2024-09-14T11:34:29.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.208+0000 7f1887e2f9c0 20 add_watcher() i=5 2024-09-14T11:34:29.207 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.208+0000 7f1887e2f9c0 20 add_watcher() i=6 2024-09-14T11:34:29.209 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.212+0000 7f1887e2f9c0 20 add_watcher() i=7 2024-09-14T11:34:29.209 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.212+0000 7f1887e2f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:29.213 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.216+0000 7f17377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:29.214 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.216+0000 7f1887e2f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:29.214 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.216+0000 7f1887e2f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:29.214 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 note: GC not initialized 2024-09-14T11:34:29.214 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.216+0000 7f17367fc640 20 reqs_thread_entry: start 2024-09-14T11:34:29.214 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.216+0000 7f1887e2f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:34:29.214 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.216+0000 7f1887e2f9c0 20 Filter name: none 2024-09-14T11:34:29.214 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.216+0000 7f16a7fff640 20 reqs_thread_entry: start 2024-09-14T11:34:29.214 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.216+0000 7f1887e2f9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:34:29.214 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.216+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.215 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.216+0000 7f1887e2f9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:29.215 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.216+0000 7f1887e2f9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:34:29.215 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.216+0000 7f1887e2f9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:34:29.215 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.216+0000 7f1887e2f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 : miss 2024-09-14T11:34:29.215 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.216+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.216 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.216+0000 7f1887e2f9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:34:29.216 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.216+0000 7f1887e2f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:34:29.216 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.216+0000 7f1887e2f9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:34:29.216 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.216+0000 7f1887e2f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:29.216 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.216+0000 7f1887e2f9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:29.216 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.216+0000 7f1887e2f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 2024-09-14T11:34:29.225 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.228+0000 7f1887e2f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:34:29.225 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.228+0000 7f1887e2f9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:34:29.225 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.228+0000 7f1887e2f9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:29.225 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.228+0000 7f1887e2f9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18, ofs0, ns] 2024-09-14T11:34:29.225 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.228+0000 7f17697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464426 cookie 94102385095504 notifier 7760 bl.length()=911 2024-09-14T11:34:29.225 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.228+0000 7f17697fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:34:29.225 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.228+0000 7f17697fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:34:29.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.228+0000 7f17697fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:29.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.228+0000 7f1887e2f9c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_sources= new_sources= 2024-09-14T11:34:29.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.228+0000 7f1887e2f9c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential sources added=[] removed=[] 2024-09-14T11:34:29.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.228+0000 7f1887e2f9c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_dests= new_dests= 2024-09-14T11:34:29.226 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.228+0000 7f1887e2f9c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential dests added=[] removed=[] 2024-09-14T11:34:29.235 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1887e2f9c0 time 2024-09-14T11:34:29.241615+0000 2024-09-14T11:34:29.235 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:29.237 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:29.237 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f188b7092eb] 2024-09-14T11:34:29.237 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f188b70949f] 2024-09-14T11:34:29.237 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5595e99e2c01] 2024-09-14T11:34:29.237 INFO:tasks.workunit.client.0.smithi071.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5595e99f7f3a] 2024-09-14T11:34:29.237 INFO:tasks.workunit.client.0.smithi071.stderr: 5: main() 2024-09-14T11:34:29.237 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f188a56fd90] 2024-09-14T11:34:29.237 INFO:tasks.workunit.client.0.smithi071.stderr: 7: __libc_start_main() 2024-09-14T11:34:29.237 INFO:tasks.workunit.client.0.smithi071.stderr: 8: _start() 2024-09-14T11:34:29.237 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.240+0000 7f1887e2f9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1887e2f9c0 time 2024-09-14T11:34:29.241615+0000 2024-09-14T11:34:29.237 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:29.237 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.238 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:29.238 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f188b7092eb] 2024-09-14T11:34:29.238 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f188b70949f] 2024-09-14T11:34:29.238 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5595e99e2c01] 2024-09-14T11:34:29.238 INFO:tasks.workunit.client.0.smithi071.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5595e99f7f3a] 2024-09-14T11:34:29.238 INFO:tasks.workunit.client.0.smithi071.stderr: 5: main() 2024-09-14T11:34:29.238 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f188a56fd90] 2024-09-14T11:34:29.238 INFO:tasks.workunit.client.0.smithi071.stderr: 7: __libc_start_main() 2024-09-14T11:34:29.238 INFO:tasks.workunit.client.0.smithi071.stderr: 8: _start() 2024-09-14T11:34:29.238 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.238 INFO:tasks.workunit.client.0.smithi071.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:34:29.238 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f1887e2f9c0 thread_name:radosgw-admin 2024-09-14T11:34:29.252 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:29.253 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f188a588520] 2024-09-14T11:34:29.253 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:34:29.253 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:34:29.253 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:34:29.253 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f188b709345] 2024-09-14T11:34:29.253 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f188b70949f] 2024-09-14T11:34:29.253 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5595e99e2c01] 2024-09-14T11:34:29.253 INFO:tasks.workunit.client.0.smithi071.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5595e99f7f3a] 2024-09-14T11:34:29.253 INFO:tasks.workunit.client.0.smithi071.stderr: 9: main() 2024-09-14T11:34:29.253 INFO:tasks.workunit.client.0.smithi071.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f188a56fd90] 2024-09-14T11:34:29.253 INFO:tasks.workunit.client.0.smithi071.stderr: 11: __libc_start_main() 2024-09-14T11:34:29.253 INFO:tasks.workunit.client.0.smithi071.stderr: 12: _start() 2024-09-14T11:34:29.253 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.240+0000 7f1887e2f9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:34:29.253 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f1887e2f9c0 thread_name:radosgw-admin 2024-09-14T11:34:29.254 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.254 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:29.254 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f188a588520] 2024-09-14T11:34:29.254 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:34:29.254 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:34:29.254 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:34:29.254 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f188b709345] 2024-09-14T11:34:29.254 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f188b70949f] 2024-09-14T11:34:29.254 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5595e99e2c01] 2024-09-14T11:34:29.254 INFO:tasks.workunit.client.0.smithi071.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5595e99f7f3a] 2024-09-14T11:34:29.254 INFO:tasks.workunit.client.0.smithi071.stderr: 9: main() 2024-09-14T11:34:29.254 INFO:tasks.workunit.client.0.smithi071.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f188a56fd90] 2024-09-14T11:34:29.254 INFO:tasks.workunit.client.0.smithi071.stderr: 11: __libc_start_main() 2024-09-14T11:34:29.255 INFO:tasks.workunit.client.0.smithi071.stderr: 12: _start() 2024-09-14T11:34:29.255 INFO:tasks.workunit.client.0.smithi071.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:34:29.255 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.255 INFO:tasks.workunit.client.0.smithi071.stderr:--- begin dump of recent events --- 2024-09-14T11:34:29.255 INFO:tasks.workunit.client.0.smithi071.stderr: -499> 2024-09-14T11:34:29.140+0000 7f1885134640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:29.255 INFO:tasks.workunit.client.0.smithi071.stderr: -498> 2024-09-14T11:34:29.140+0000 7f1885134640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:29.255 INFO:tasks.workunit.client.0.smithi071.stderr: -497> 2024-09-14T11:34:29.140+0000 7f1885935640 10 monclient(hunting): handle_auth_done global_id 7748 payload 274 2024-09-14T11:34:29.255 INFO:tasks.workunit.client.0.smithi071.stderr: -496> 2024-09-14T11:34:29.140+0000 7f1885935640 10 monclient: _finish_hunting 0 2024-09-14T11:34:29.255 INFO:tasks.workunit.client.0.smithi071.stderr: -495> 2024-09-14T11:34:29.140+0000 7f1885935640 1 monclient: found mon.noname-c 2024-09-14T11:34:29.255 INFO:tasks.workunit.client.0.smithi071.stderr: -494> 2024-09-14T11:34:29.140+0000 7f1885935640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:34:29.255 INFO:tasks.workunit.client.0.smithi071.stderr: -493> 2024-09-14T11:34:29.144+0000 7f1773e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:29.255 INFO:tasks.workunit.client.0.smithi071.stderr: -492> 2024-09-14T11:34:29.144+0000 7f1773e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:29.255 INFO:tasks.workunit.client.0.smithi071.stderr: -491> 2024-09-14T11:34:29.144+0000 7f1773e07640 10 monclient: dump: 2024-09-14T11:34:29.255 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:34:29.255 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:34:29.256 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.256 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.256 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:29.256 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:34:29.256 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:34:29.256 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:34:29.256 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:34:29.256 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.256 INFO:tasks.workunit.client.0.smithi071.stderr: -490> 2024-09-14T11:34:29.144+0000 7f1773e07640 10 monclient: _finish_auth 0 2024-09-14T11:34:29.256 INFO:tasks.workunit.client.0.smithi071.stderr: -489> 2024-09-14T11:34:29.144+0000 7f1773e07640 10 monclient: _check_auth_tickets 2024-09-14T11:34:29.256 INFO:tasks.workunit.client.0.smithi071.stderr: -488> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 monclient: authenticate success, global_id 7748 2024-09-14T11:34:29.256 INFO:tasks.workunit.client.0.smithi071.stderr: -487> 2024-09-14T11:34:29.144+0000 7f1773e07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:29.256 INFO:tasks.workunit.client.0.smithi071.stderr: -486> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:34:29.256 INFO:tasks.workunit.client.0.smithi071.stderr: -485> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 4 set_mon_vals no callback set 2024-09-14T11:34:29.256 INFO:tasks.workunit.client.0.smithi071.stderr: -484> 2024-09-14T11:34:29.144+0000 7f1773e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:29.257 INFO:tasks.workunit.client.0.smithi071.stderr: -483> 2024-09-14T11:34:29.144+0000 7f1773e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:29.257 INFO:tasks.workunit.client.0.smithi071.stderr: -482> 2024-09-14T11:34:29.144+0000 7f1773e07640 10 monclient: dump: 2024-09-14T11:34:29.257 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:34:29.257 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:34:29.257 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.257 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.257 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:29.257 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:34:29.257 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:34:29.257 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:34:29.257 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:34:29.257 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.257 INFO:tasks.workunit.client.0.smithi071.stderr: -481> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient: shutdown 2024-09-14T11:34:29.257 INFO:tasks.workunit.client.0.smithi071.stderr: -480> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 asok(0x5595eb0bcd90) unregister_commands rotate-key 2024-09-14T11:34:29.258 INFO:tasks.workunit.client.0.smithi071.stderr: -479> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient: build_initial_monmap 2024-09-14T11:34:29.258 INFO:tasks.workunit.client.0.smithi071.stderr: -478> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 1 build_initial for_mkfs: 0 2024-09-14T11:34:29.258 INFO:tasks.workunit.client.0.smithi071.stderr: -477> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient: monmap: 2024-09-14T11:34:29.258 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:34:29.258 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:29.258 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:34:29.258 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:34:29.258 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:29.258 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:34:29.258 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:34:29.258 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:34:29.258 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:34:29.258 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.258 INFO:tasks.workunit.client.0.smithi071.stderr: -476> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2f8d30) adding auth protocol: cephx 2024-09-14T11:34:29.259 INFO:tasks.workunit.client.0.smithi071.stderr: -475> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2f8d30) adding auth protocol: cephx 2024-09-14T11:34:29.259 INFO:tasks.workunit.client.0.smithi071.stderr: -474> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2f8d30) adding auth protocol: cephx 2024-09-14T11:34:29.259 INFO:tasks.workunit.client.0.smithi071.stderr: -473> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2f8d30) adding con mode: secure 2024-09-14T11:34:29.259 INFO:tasks.workunit.client.0.smithi071.stderr: -472> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2f8d30) adding con mode: crc 2024-09-14T11:34:29.259 INFO:tasks.workunit.client.0.smithi071.stderr: -471> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2f8d30) adding con mode: secure 2024-09-14T11:34:29.259 INFO:tasks.workunit.client.0.smithi071.stderr: -470> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2f8d30) adding con mode: crc 2024-09-14T11:34:29.259 INFO:tasks.workunit.client.0.smithi071.stderr: -469> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2f8d30) adding con mode: secure 2024-09-14T11:34:29.259 INFO:tasks.workunit.client.0.smithi071.stderr: -468> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2f8d30) adding con mode: crc 2024-09-14T11:34:29.259 INFO:tasks.workunit.client.0.smithi071.stderr: -467> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2f8d30) adding con mode: crc 2024-09-14T11:34:29.259 INFO:tasks.workunit.client.0.smithi071.stderr: -466> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2f8d30) adding con mode: secure 2024-09-14T11:34:29.259 INFO:tasks.workunit.client.0.smithi071.stderr: -465> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2f8d30) adding con mode: crc 2024-09-14T11:34:29.259 INFO:tasks.workunit.client.0.smithi071.stderr: -464> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2f8d30) adding con mode: secure 2024-09-14T11:34:29.259 INFO:tasks.workunit.client.0.smithi071.stderr: -463> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2f8d30) adding con mode: crc 2024-09-14T11:34:29.259 INFO:tasks.workunit.client.0.smithi071.stderr: -462> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2f8d30) adding con mode: secure 2024-09-14T11:34:29.259 INFO:tasks.workunit.client.0.smithi071.stderr: -461> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:29.260 INFO:tasks.workunit.client.0.smithi071.stderr: -460> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 1 librados: starting msgr at 2024-09-14T11:34:29.260 INFO:tasks.workunit.client.0.smithi071.stderr: -459> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 1 librados: starting objecter 2024-09-14T11:34:29.260 INFO:tasks.workunit.client.0.smithi071.stderr: -458> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 asok(0x5595eb0bcd90) register_command objecter_requests hook 0x5595eb2f9500 2024-09-14T11:34:29.260 INFO:tasks.workunit.client.0.smithi071.stderr: -457> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 1 librados: setting wanted keys 2024-09-14T11:34:29.260 INFO:tasks.workunit.client.0.smithi071.stderr: -456> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 1 librados: calling monclient init 2024-09-14T11:34:29.260 INFO:tasks.workunit.client.0.smithi071.stderr: -455> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient: init 2024-09-14T11:34:29.260 INFO:tasks.workunit.client.0.smithi071.stderr: -454> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2c7f90) adding auth protocol: cephx 2024-09-14T11:34:29.260 INFO:tasks.workunit.client.0.smithi071.stderr: -453> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2c7f90) adding auth protocol: cephx 2024-09-14T11:34:29.260 INFO:tasks.workunit.client.0.smithi071.stderr: -452> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2c7f90) adding auth protocol: cephx 2024-09-14T11:34:29.260 INFO:tasks.workunit.client.0.smithi071.stderr: -451> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2c7f90) adding con mode: secure 2024-09-14T11:34:29.260 INFO:tasks.workunit.client.0.smithi071.stderr: -450> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2c7f90) adding con mode: crc 2024-09-14T11:34:29.260 INFO:tasks.workunit.client.0.smithi071.stderr: -449> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2c7f90) adding con mode: secure 2024-09-14T11:34:29.260 INFO:tasks.workunit.client.0.smithi071.stderr: -448> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2c7f90) adding con mode: crc 2024-09-14T11:34:29.261 INFO:tasks.workunit.client.0.smithi071.stderr: -447> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2c7f90) adding con mode: secure 2024-09-14T11:34:29.261 INFO:tasks.workunit.client.0.smithi071.stderr: -446> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2c7f90) adding con mode: crc 2024-09-14T11:34:29.261 INFO:tasks.workunit.client.0.smithi071.stderr: -445> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2c7f90) adding con mode: crc 2024-09-14T11:34:29.261 INFO:tasks.workunit.client.0.smithi071.stderr: -444> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2c7f90) adding con mode: secure 2024-09-14T11:34:29.261 INFO:tasks.workunit.client.0.smithi071.stderr: -443> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2c7f90) adding con mode: crc 2024-09-14T11:34:29.261 INFO:tasks.workunit.client.0.smithi071.stderr: -442> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2c7f90) adding con mode: secure 2024-09-14T11:34:29.261 INFO:tasks.workunit.client.0.smithi071.stderr: -441> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2c7f90) adding con mode: crc 2024-09-14T11:34:29.261 INFO:tasks.workunit.client.0.smithi071.stderr: -440> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2c7f90) adding con mode: secure 2024-09-14T11:34:29.261 INFO:tasks.workunit.client.0.smithi071.stderr: -439> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:29.261 INFO:tasks.workunit.client.0.smithi071.stderr: -438> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:29.261 INFO:tasks.workunit.client.0.smithi071.stderr: -437> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 asok(0x5595eb0bcd90) register_command rotate-key hook 0x5595eb2c80d8 2024-09-14T11:34:29.261 INFO:tasks.workunit.client.0.smithi071.stderr: -436> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:34:29.261 INFO:tasks.workunit.client.0.smithi071.stderr: -435> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:34:29.261 INFO:tasks.workunit.client.0.smithi071.stderr: -434> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient(hunting): picked mon.noname-a con 0x5595eb2f87a0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:34:29.262 INFO:tasks.workunit.client.0.smithi071.stderr: -433> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient(hunting): picked mon.noname-c con 0x7f1870003c70 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:34:29.262 INFO:tasks.workunit.client.0.smithi071.stderr: -432> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient(hunting): picked mon.noname-b con 0x5595eb2f3130 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:34:29.262 INFO:tasks.workunit.client.0.smithi071.stderr: -431> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:29.262 INFO:tasks.workunit.client.0.smithi071.stderr: -430> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:29.262 INFO:tasks.workunit.client.0.smithi071.stderr: -429> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:29.262 INFO:tasks.workunit.client.0.smithi071.stderr: -428> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:34:29.262 INFO:tasks.workunit.client.0.smithi071.stderr: -427> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient(hunting): authenticate will time out at 2481.266383s 2024-09-14T11:34:29.262 INFO:tasks.workunit.client.0.smithi071.stderr: -426> 2024-09-14T11:34:29.144+0000 7f1885134640 10 monclient(hunting): get_auth_request con 0x7f1870003c70 auth_method 0 2024-09-14T11:34:29.262 INFO:tasks.workunit.client.0.smithi071.stderr: -425> 2024-09-14T11:34:29.144+0000 7f1885134640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:29.262 INFO:tasks.workunit.client.0.smithi071.stderr: -424> 2024-09-14T11:34:29.144+0000 7f1885134640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:29.262 INFO:tasks.workunit.client.0.smithi071.stderr: -423> 2024-09-14T11:34:29.144+0000 7f1885134640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:29.262 INFO:tasks.workunit.client.0.smithi071.stderr: -422> 2024-09-14T11:34:29.144+0000 7f1885935640 10 monclient(hunting): get_auth_request con 0x5595eb2f87a0 auth_method 0 2024-09-14T11:34:29.262 INFO:tasks.workunit.client.0.smithi071.stderr: -421> 2024-09-14T11:34:29.144+0000 7f1885935640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:29.262 INFO:tasks.workunit.client.0.smithi071.stderr: -420> 2024-09-14T11:34:29.144+0000 7f1885935640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:29.262 INFO:tasks.workunit.client.0.smithi071.stderr: -419> 2024-09-14T11:34:29.144+0000 7f1885935640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:29.263 INFO:tasks.workunit.client.0.smithi071.stderr: -418> 2024-09-14T11:34:29.144+0000 7f1885134640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:29.263 INFO:tasks.workunit.client.0.smithi071.stderr: -417> 2024-09-14T11:34:29.144+0000 7f1885134640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:29.263 INFO:tasks.workunit.client.0.smithi071.stderr: -416> 2024-09-14T11:34:29.144+0000 7f1885134640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:29.263 INFO:tasks.workunit.client.0.smithi071.stderr: -415> 2024-09-14T11:34:29.144+0000 7f1885935640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:29.263 INFO:tasks.workunit.client.0.smithi071.stderr: -414> 2024-09-14T11:34:29.144+0000 7f1885935640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:29.263 INFO:tasks.workunit.client.0.smithi071.stderr: -413> 2024-09-14T11:34:29.144+0000 7f1885935640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:29.263 INFO:tasks.workunit.client.0.smithi071.stderr: -412> 2024-09-14T11:34:29.144+0000 7f1885134640 10 monclient(hunting): handle_auth_done global_id 7751 payload 824 2024-09-14T11:34:29.263 INFO:tasks.workunit.client.0.smithi071.stderr: -411> 2024-09-14T11:34:29.144+0000 7f1885134640 10 monclient: _finish_hunting 0 2024-09-14T11:34:29.263 INFO:tasks.workunit.client.0.smithi071.stderr: -410> 2024-09-14T11:34:29.144+0000 7f1885134640 1 monclient: found mon.noname-c 2024-09-14T11:34:29.263 INFO:tasks.workunit.client.0.smithi071.stderr: -409> 2024-09-14T11:34:29.144+0000 7f1885134640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:34:29.263 INFO:tasks.workunit.client.0.smithi071.stderr: -408> 2024-09-14T11:34:29.144+0000 7f1772604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:29.263 INFO:tasks.workunit.client.0.smithi071.stderr: -407> 2024-09-14T11:34:29.144+0000 7f1772604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:29.263 INFO:tasks.workunit.client.0.smithi071.stderr: -406> 2024-09-14T11:34:29.144+0000 7f1772604640 10 monclient: dump: 2024-09-14T11:34:29.263 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:34:29.263 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:34:29.264 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.264 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.264 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:29.264 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:34:29.264 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:34:29.264 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:34:29.264 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:34:29.264 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.264 INFO:tasks.workunit.client.0.smithi071.stderr: -405> 2024-09-14T11:34:29.144+0000 7f1772604640 10 monclient: _finish_auth 0 2024-09-14T11:34:29.264 INFO:tasks.workunit.client.0.smithi071.stderr: -404> 2024-09-14T11:34:29.144+0000 7f1772604640 10 monclient: _check_auth_tickets 2024-09-14T11:34:29.264 INFO:tasks.workunit.client.0.smithi071.stderr: -403> 2024-09-14T11:34:29.144+0000 7f1772604640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:29.264 INFO:tasks.workunit.client.0.smithi071.stderr: -402> 2024-09-14T11:34:29.144+0000 7f1772604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:29.264 INFO:tasks.workunit.client.0.smithi071.stderr: -401> 2024-09-14T11:34:29.144+0000 7f1772604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:29.264 INFO:tasks.workunit.client.0.smithi071.stderr: -400> 2024-09-14T11:34:29.144+0000 7f1772604640 10 monclient: dump: 2024-09-14T11:34:29.264 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:34:29.264 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:34:29.265 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.265 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.265 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:29.265 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:34:29.265 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:34:29.265 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:34:29.265 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:34:29.265 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.265 INFO:tasks.workunit.client.0.smithi071.stderr: -399> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 monclient: authenticate success, global_id 7751 2024-09-14T11:34:29.265 INFO:tasks.workunit.client.0.smithi071.stderr: -398> 2024-09-14T11:34:29.144+0000 7f1773e07640 4 set_mon_vals no callback set 2024-09-14T11:34:29.265 INFO:tasks.workunit.client.0.smithi071.stderr: -397> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient: _renew_subs 2024-09-14T11:34:29.265 INFO:tasks.workunit.client.0.smithi071.stderr: -396> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:34:29.265 INFO:tasks.workunit.client.0.smithi071.stderr: -395> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient: _renew_subs 2024-09-14T11:34:29.265 INFO:tasks.workunit.client.0.smithi071.stderr: -394> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:34:29.265 INFO:tasks.workunit.client.0.smithi071.stderr: -393> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 1 librados: init done 2024-09-14T11:34:29.265 INFO:tasks.workunit.client.0.smithi071.stderr: -392> 2024-09-14T11:34:29.148+0000 7f1772604640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:29.266 INFO:tasks.workunit.client.0.smithi071.stderr: -391> 2024-09-14T11:34:29.148+0000 7f1772604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:34:29.266 INFO:tasks.workunit.client.0.smithi071.stderr: -390> 2024-09-14T11:34:29.148+0000 7f1772604640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:34:29.266 INFO:tasks.workunit.client.0.smithi071.stderr: -389> 2024-09-14T11:34:29.148+0000 7f1885935640 10 monclient: get_auth_request con 0x7f176c0718a0 auth_method 0 2024-09-14T11:34:29.266 INFO:tasks.workunit.client.0.smithi071.stderr: -388> 2024-09-14T11:34:29.148+0000 7f1886136640 10 monclient: get_auth_request con 0x5595eb3107e0 auth_method 0 2024-09-14T11:34:29.266 INFO:tasks.workunit.client.0.smithi071.stderr: -387> 2024-09-14T11:34:29.148+0000 7f1885935640 10 monclient: get_auth_request con 0x5595eb313b30 auth_method 0 2024-09-14T11:34:29.266 INFO:tasks.workunit.client.0.smithi071.stderr: -386> 2024-09-14T11:34:29.152+0000 7f1885134640 10 monclient: get_auth_request con 0x5595eb317e90 auth_method 0 2024-09-14T11:34:29.266 INFO:tasks.workunit.client.0.smithi071.stderr: -385> 2024-09-14T11:34:29.152+0000 7f1886136640 10 monclient: get_auth_request con 0x5595eb3173e0 auth_method 0 2024-09-14T11:34:29.266 INFO:tasks.workunit.client.0.smithi071.stderr: -384> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 10 monclient: build_initial_monmap 2024-09-14T11:34:29.266 INFO:tasks.workunit.client.0.smithi071.stderr: -383> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 1 build_initial for_mkfs: 0 2024-09-14T11:34:29.266 INFO:tasks.workunit.client.0.smithi071.stderr: -382> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 10 monclient: monmap: 2024-09-14T11:34:29.266 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:34:29.266 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:29.266 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:34:29.266 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:34:29.266 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:29.267 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:34:29.267 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:34:29.267 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:34:29.267 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:34:29.267 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.267 INFO:tasks.workunit.client.0.smithi071.stderr: -381> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31ffe0) adding auth protocol: cephx 2024-09-14T11:34:29.267 INFO:tasks.workunit.client.0.smithi071.stderr: -380> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31ffe0) adding auth protocol: cephx 2024-09-14T11:34:29.267 INFO:tasks.workunit.client.0.smithi071.stderr: -379> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31ffe0) adding auth protocol: cephx 2024-09-14T11:34:29.267 INFO:tasks.workunit.client.0.smithi071.stderr: -378> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31ffe0) adding con mode: secure 2024-09-14T11:34:29.267 INFO:tasks.workunit.client.0.smithi071.stderr: -377> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31ffe0) adding con mode: crc 2024-09-14T11:34:29.267 INFO:tasks.workunit.client.0.smithi071.stderr: -376> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31ffe0) adding con mode: secure 2024-09-14T11:34:29.267 INFO:tasks.workunit.client.0.smithi071.stderr: -375> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31ffe0) adding con mode: crc 2024-09-14T11:34:29.267 INFO:tasks.workunit.client.0.smithi071.stderr: -374> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31ffe0) adding con mode: secure 2024-09-14T11:34:29.267 INFO:tasks.workunit.client.0.smithi071.stderr: -373> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31ffe0) adding con mode: crc 2024-09-14T11:34:29.267 INFO:tasks.workunit.client.0.smithi071.stderr: -372> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31ffe0) adding con mode: crc 2024-09-14T11:34:29.268 INFO:tasks.workunit.client.0.smithi071.stderr: -371> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31ffe0) adding con mode: secure 2024-09-14T11:34:29.268 INFO:tasks.workunit.client.0.smithi071.stderr: -370> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31ffe0) adding con mode: crc 2024-09-14T11:34:29.268 INFO:tasks.workunit.client.0.smithi071.stderr: -369> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31ffe0) adding con mode: secure 2024-09-14T11:34:29.268 INFO:tasks.workunit.client.0.smithi071.stderr: -368> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31ffe0) adding con mode: crc 2024-09-14T11:34:29.268 INFO:tasks.workunit.client.0.smithi071.stderr: -367> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31ffe0) adding con mode: secure 2024-09-14T11:34:29.268 INFO:tasks.workunit.client.0.smithi071.stderr: -366> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:29.268 INFO:tasks.workunit.client.0.smithi071.stderr: -365> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 asok(0x5595eb0bcd90) register_command objecter_requests cmddesc objecter_requests hook 0x5595eb323810 EEXIST 2024-09-14T11:34:29.268 INFO:tasks.workunit.client.0.smithi071.stderr: -364> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 10 monclient: init 2024-09-14T11:34:29.268 INFO:tasks.workunit.client.0.smithi071.stderr: -363> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31eec8) adding auth protocol: cephx 2024-09-14T11:34:29.268 INFO:tasks.workunit.client.0.smithi071.stderr: -362> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31eec8) adding auth protocol: cephx 2024-09-14T11:34:29.268 INFO:tasks.workunit.client.0.smithi071.stderr: -361> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31eec8) adding auth protocol: cephx 2024-09-14T11:34:29.268 INFO:tasks.workunit.client.0.smithi071.stderr: -360> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31eec8) adding con mode: secure 2024-09-14T11:34:29.268 INFO:tasks.workunit.client.0.smithi071.stderr: -359> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31eec8) adding con mode: crc 2024-09-14T11:34:29.268 INFO:tasks.workunit.client.0.smithi071.stderr: -358> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31eec8) adding con mode: secure 2024-09-14T11:34:29.269 INFO:tasks.workunit.client.0.smithi071.stderr: -357> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31eec8) adding con mode: crc 2024-09-14T11:34:29.269 INFO:tasks.workunit.client.0.smithi071.stderr: -356> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31eec8) adding con mode: secure 2024-09-14T11:34:29.269 INFO:tasks.workunit.client.0.smithi071.stderr: -355> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31eec8) adding con mode: crc 2024-09-14T11:34:29.269 INFO:tasks.workunit.client.0.smithi071.stderr: -354> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31eec8) adding con mode: crc 2024-09-14T11:34:29.269 INFO:tasks.workunit.client.0.smithi071.stderr: -353> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31eec8) adding con mode: secure 2024-09-14T11:34:29.269 INFO:tasks.workunit.client.0.smithi071.stderr: -352> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31eec8) adding con mode: crc 2024-09-14T11:34:29.269 INFO:tasks.workunit.client.0.smithi071.stderr: -351> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31eec8) adding con mode: secure 2024-09-14T11:34:29.269 INFO:tasks.workunit.client.0.smithi071.stderr: -350> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31eec8) adding con mode: crc 2024-09-14T11:34:29.269 INFO:tasks.workunit.client.0.smithi071.stderr: -349> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31eec8) adding con mode: secure 2024-09-14T11:34:29.269 INFO:tasks.workunit.client.0.smithi071.stderr: -348> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:29.269 INFO:tasks.workunit.client.0.smithi071.stderr: -347> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:29.269 INFO:tasks.workunit.client.0.smithi071.stderr: -346> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 5 asok(0x5595eb0bcd90) register_command rotate-key cmddesc rotate-key hook 0x5595eb31f010 EEXIST 2024-09-14T11:34:29.269 INFO:tasks.workunit.client.0.smithi071.stderr: -345> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:34:29.269 INFO:tasks.workunit.client.0.smithi071.stderr: -344> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:34:29.269 INFO:tasks.workunit.client.0.smithi071.stderr: -343> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 10 monclient(hunting): picked mon.noname-a con 0x5595eb3479c0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:34:29.270 INFO:tasks.workunit.client.0.smithi071.stderr: -342> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 10 monclient(hunting): picked mon.noname-b con 0x5595eb3472f0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:34:29.270 INFO:tasks.workunit.client.0.smithi071.stderr: -341> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 10 monclient(hunting): picked mon.noname-c con 0x5595eb345cd0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:34:29.270 INFO:tasks.workunit.client.0.smithi071.stderr: -340> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:29.270 INFO:tasks.workunit.client.0.smithi071.stderr: -339> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:29.270 INFO:tasks.workunit.client.0.smithi071.stderr: -338> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:29.270 INFO:tasks.workunit.client.0.smithi071.stderr: -337> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:34:29.270 INFO:tasks.workunit.client.0.smithi071.stderr: -336> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 10 monclient(hunting): authenticate will time out at 2481.276476s 2024-09-14T11:34:29.270 INFO:tasks.workunit.client.0.smithi071.stderr: -335> 2024-09-14T11:34:29.156+0000 7f1885935640 10 monclient(hunting): get_auth_request con 0x5595eb345cd0 auth_method 0 2024-09-14T11:34:29.270 INFO:tasks.workunit.client.0.smithi071.stderr: -334> 2024-09-14T11:34:29.156+0000 7f1885935640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:29.270 INFO:tasks.workunit.client.0.smithi071.stderr: -333> 2024-09-14T11:34:29.156+0000 7f1885935640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:29.270 INFO:tasks.workunit.client.0.smithi071.stderr: -332> 2024-09-14T11:34:29.156+0000 7f1885935640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:29.270 INFO:tasks.workunit.client.0.smithi071.stderr: -331> 2024-09-14T11:34:29.156+0000 7f1885134640 10 monclient(hunting): get_auth_request con 0x5595eb3479c0 auth_method 0 2024-09-14T11:34:29.270 INFO:tasks.workunit.client.0.smithi071.stderr: -330> 2024-09-14T11:34:29.156+0000 7f1885134640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:29.270 INFO:tasks.workunit.client.0.smithi071.stderr: -329> 2024-09-14T11:34:29.156+0000 7f1885134640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:29.270 INFO:tasks.workunit.client.0.smithi071.stderr: -328> 2024-09-14T11:34:29.156+0000 7f1885134640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:29.271 INFO:tasks.workunit.client.0.smithi071.stderr: -327> 2024-09-14T11:34:29.156+0000 7f1885935640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:29.271 INFO:tasks.workunit.client.0.smithi071.stderr: -326> 2024-09-14T11:34:29.156+0000 7f1885935640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:29.271 INFO:tasks.workunit.client.0.smithi071.stderr: -325> 2024-09-14T11:34:29.156+0000 7f1885935640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:29.271 INFO:tasks.workunit.client.0.smithi071.stderr: -324> 2024-09-14T11:34:29.156+0000 7f1885134640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:29.271 INFO:tasks.workunit.client.0.smithi071.stderr: -323> 2024-09-14T11:34:29.156+0000 7f1885134640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:29.271 INFO:tasks.workunit.client.0.smithi071.stderr: -322> 2024-09-14T11:34:29.156+0000 7f1885134640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:29.271 INFO:tasks.workunit.client.0.smithi071.stderr: -321> 2024-09-14T11:34:29.156+0000 7f1886136640 10 monclient(hunting): get_auth_request con 0x5595eb3472f0 auth_method 0 2024-09-14T11:34:29.271 INFO:tasks.workunit.client.0.smithi071.stderr: -320> 2024-09-14T11:34:29.156+0000 7f1886136640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:29.271 INFO:tasks.workunit.client.0.smithi071.stderr: -319> 2024-09-14T11:34:29.156+0000 7f1886136640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:29.271 INFO:tasks.workunit.client.0.smithi071.stderr: -318> 2024-09-14T11:34:29.156+0000 7f1886136640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:29.271 INFO:tasks.workunit.client.0.smithi071.stderr: -317> 2024-09-14T11:34:29.156+0000 7f1885935640 10 monclient(hunting): handle_auth_done global_id 7754 payload 824 2024-09-14T11:34:29.271 INFO:tasks.workunit.client.0.smithi071.stderr: -316> 2024-09-14T11:34:29.156+0000 7f1885935640 10 monclient: _finish_hunting 0 2024-09-14T11:34:29.271 INFO:tasks.workunit.client.0.smithi071.stderr: -315> 2024-09-14T11:34:29.156+0000 7f1885935640 1 monclient: found mon.noname-c 2024-09-14T11:34:29.271 INFO:tasks.workunit.client.0.smithi071.stderr: -314> 2024-09-14T11:34:29.156+0000 7f1885935640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:34:29.271 INFO:tasks.workunit.client.0.smithi071.stderr: -313> 2024-09-14T11:34:29.156+0000 7f176b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:29.272 INFO:tasks.workunit.client.0.smithi071.stderr: -312> 2024-09-14T11:34:29.156+0000 7f176b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:29.272 INFO:tasks.workunit.client.0.smithi071.stderr: -311> 2024-09-14T11:34:29.156+0000 7f176b7fe640 10 monclient: dump: 2024-09-14T11:34:29.272 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:34:29.272 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:34:29.272 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.272 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.272 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:29.272 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:34:29.272 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:34:29.272 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:34:29.272 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:34:29.272 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.272 INFO:tasks.workunit.client.0.smithi071.stderr: -310> 2024-09-14T11:34:29.156+0000 7f176b7fe640 10 monclient: _finish_auth 0 2024-09-14T11:34:29.272 INFO:tasks.workunit.client.0.smithi071.stderr: -309> 2024-09-14T11:34:29.156+0000 7f176b7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:34:29.273 INFO:tasks.workunit.client.0.smithi071.stderr: -308> 2024-09-14T11:34:29.156+0000 7f176b7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:29.273 INFO:tasks.workunit.client.0.smithi071.stderr: -307> 2024-09-14T11:34:29.156+0000 7f176b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:29.273 INFO:tasks.workunit.client.0.smithi071.stderr: -306> 2024-09-14T11:34:29.156+0000 7f176b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:29.273 INFO:tasks.workunit.client.0.smithi071.stderr: -305> 2024-09-14T11:34:29.156+0000 7f176b7fe640 10 monclient: dump: 2024-09-14T11:34:29.273 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:34:29.273 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:34:29.273 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.273 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.273 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:29.273 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:34:29.273 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:34:29.273 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:34:29.273 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:34:29.273 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.273 INFO:tasks.workunit.client.0.smithi071.stderr: -304> 2024-09-14T11:34:29.156+0000 7f1886937640 4 set_mon_vals no callback set 2024-09-14T11:34:29.274 INFO:tasks.workunit.client.0.smithi071.stderr: -303> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 5 monclient: authenticate success, global_id 7754 2024-09-14T11:34:29.274 INFO:tasks.workunit.client.0.smithi071.stderr: -302> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 10 monclient: _renew_subs 2024-09-14T11:34:29.274 INFO:tasks.workunit.client.0.smithi071.stderr: -301> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:34:29.274 INFO:tasks.workunit.client.0.smithi071.stderr: -300> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 10 monclient: _renew_subs 2024-09-14T11:34:29.274 INFO:tasks.workunit.client.0.smithi071.stderr: -299> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:34:29.274 INFO:tasks.workunit.client.0.smithi071.stderr: -298> 2024-09-14T11:34:29.156+0000 7f176b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:29.274 INFO:tasks.workunit.client.0.smithi071.stderr: -297> 2024-09-14T11:34:29.156+0000 7f176b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:34:29.274 INFO:tasks.workunit.client.0.smithi071.stderr: -296> 2024-09-14T11:34:29.156+0000 7f176b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:34:29.274 INFO:tasks.workunit.client.0.smithi071.stderr: -295> 2024-09-14T11:34:29.156+0000 7f1885134640 10 monclient: get_auth_request con 0x7f17600717b0 auth_method 0 2024-09-14T11:34:29.274 INFO:tasks.workunit.client.0.smithi071.stderr: -294> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 10 monclient: get_monmap_and_config 2024-09-14T11:34:29.274 INFO:tasks.workunit.client.0.smithi071.stderr: -293> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 10 monclient: build_initial_monmap 2024-09-14T11:34:29.274 INFO:tasks.workunit.client.0.smithi071.stderr: -292> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 1 build_initial for_mkfs: 0 2024-09-14T11:34:29.274 INFO:tasks.workunit.client.0.smithi071.stderr: -291> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 10 monclient: monmap: 2024-09-14T11:34:29.274 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:34:29.274 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:29.274 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:34:29.275 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:34:29.275 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:29.275 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:34:29.275 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:34:29.275 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:34:29.275 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:34:29.275 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.275 INFO:tasks.workunit.client.0.smithi071.stderr: -290> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb367310) adding auth protocol: cephx 2024-09-14T11:34:29.275 INFO:tasks.workunit.client.0.smithi071.stderr: -289> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb367310) adding auth protocol: cephx 2024-09-14T11:34:29.275 INFO:tasks.workunit.client.0.smithi071.stderr: -288> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb367310) adding auth protocol: cephx 2024-09-14T11:34:29.275 INFO:tasks.workunit.client.0.smithi071.stderr: -287> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb367310) adding con mode: secure 2024-09-14T11:34:29.275 INFO:tasks.workunit.client.0.smithi071.stderr: -286> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb367310) adding con mode: crc 2024-09-14T11:34:29.275 INFO:tasks.workunit.client.0.smithi071.stderr: -285> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb367310) adding con mode: secure 2024-09-14T11:34:29.275 INFO:tasks.workunit.client.0.smithi071.stderr: -284> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb367310) adding con mode: crc 2024-09-14T11:34:29.276 INFO:tasks.workunit.client.0.smithi071.stderr: -283> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb367310) adding con mode: secure 2024-09-14T11:34:29.276 INFO:tasks.workunit.client.0.smithi071.stderr: -282> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb367310) adding con mode: crc 2024-09-14T11:34:29.276 INFO:tasks.workunit.client.0.smithi071.stderr: -281> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb367310) adding con mode: crc 2024-09-14T11:34:29.276 INFO:tasks.workunit.client.0.smithi071.stderr: -280> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb367310) adding con mode: secure 2024-09-14T11:34:29.276 INFO:tasks.workunit.client.0.smithi071.stderr: -279> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb367310) adding con mode: crc 2024-09-14T11:34:29.276 INFO:tasks.workunit.client.0.smithi071.stderr: -278> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb367310) adding con mode: secure 2024-09-14T11:34:29.276 INFO:tasks.workunit.client.0.smithi071.stderr: -277> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb367310) adding con mode: crc 2024-09-14T11:34:29.276 INFO:tasks.workunit.client.0.smithi071.stderr: -276> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb367310) adding con mode: secure 2024-09-14T11:34:29.276 INFO:tasks.workunit.client.0.smithi071.stderr: -275> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:29.276 INFO:tasks.workunit.client.0.smithi071.stderr: -274> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient: init 2024-09-14T11:34:29.276 INFO:tasks.workunit.client.0.smithi071.stderr: -273> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a380) adding auth protocol: cephx 2024-09-14T11:34:29.276 INFO:tasks.workunit.client.0.smithi071.stderr: -272> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a380) adding auth protocol: cephx 2024-09-14T11:34:29.276 INFO:tasks.workunit.client.0.smithi071.stderr: -271> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a380) adding auth protocol: cephx 2024-09-14T11:34:29.276 INFO:tasks.workunit.client.0.smithi071.stderr: -270> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a380) adding con mode: secure 2024-09-14T11:34:29.277 INFO:tasks.workunit.client.0.smithi071.stderr: -269> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a380) adding con mode: crc 2024-09-14T11:34:29.277 INFO:tasks.workunit.client.0.smithi071.stderr: -268> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a380) adding con mode: secure 2024-09-14T11:34:29.277 INFO:tasks.workunit.client.0.smithi071.stderr: -267> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a380) adding con mode: crc 2024-09-14T11:34:29.277 INFO:tasks.workunit.client.0.smithi071.stderr: -266> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a380) adding con mode: secure 2024-09-14T11:34:29.277 INFO:tasks.workunit.client.0.smithi071.stderr: -265> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a380) adding con mode: crc 2024-09-14T11:34:29.277 INFO:tasks.workunit.client.0.smithi071.stderr: -264> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a380) adding con mode: crc 2024-09-14T11:34:29.277 INFO:tasks.workunit.client.0.smithi071.stderr: -263> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a380) adding con mode: secure 2024-09-14T11:34:29.277 INFO:tasks.workunit.client.0.smithi071.stderr: -262> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a380) adding con mode: crc 2024-09-14T11:34:29.277 INFO:tasks.workunit.client.0.smithi071.stderr: -261> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a380) adding con mode: secure 2024-09-14T11:34:29.277 INFO:tasks.workunit.client.0.smithi071.stderr: -260> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a380) adding con mode: crc 2024-09-14T11:34:29.277 INFO:tasks.workunit.client.0.smithi071.stderr: -259> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a380) adding con mode: secure 2024-09-14T11:34:29.277 INFO:tasks.workunit.client.0.smithi071.stderr: -258> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:29.277 INFO:tasks.workunit.client.0.smithi071.stderr: -257> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:29.277 INFO:tasks.workunit.client.0.smithi071.stderr: -256> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 asok(0x5595eb0bcd90) register_command rotate-key cmddesc rotate-key hook 0x7fff7d79a4c8 EEXIST 2024-09-14T11:34:29.277 INFO:tasks.workunit.client.0.smithi071.stderr: -255> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:34:29.277 INFO:tasks.workunit.client.0.smithi071.stderr: -254> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:34:29.278 INFO:tasks.workunit.client.0.smithi071.stderr: -253> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient(hunting): picked mon.noname-c con 0x5595eb39b550 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:34:29.278 INFO:tasks.workunit.client.0.smithi071.stderr: -252> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient(hunting): picked mon.noname-a con 0x5595eb39b930 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:34:29.278 INFO:tasks.workunit.client.0.smithi071.stderr: -251> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient(hunting): picked mon.noname-b con 0x5595eb3957c0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:34:29.278 INFO:tasks.workunit.client.0.smithi071.stderr: -250> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:29.278 INFO:tasks.workunit.client.0.smithi071.stderr: -249> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:29.278 INFO:tasks.workunit.client.0.smithi071.stderr: -248> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:29.278 INFO:tasks.workunit.client.0.smithi071.stderr: -247> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:34:29.278 INFO:tasks.workunit.client.0.smithi071.stderr: -246> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient(hunting): authenticate will time out at 2481.280673s 2024-09-14T11:34:29.278 INFO:tasks.workunit.client.0.smithi071.stderr: -245> 2024-09-14T11:34:29.160+0000 7f1885134640 10 monclient(hunting): get_auth_request con 0x5595eb39b550 auth_method 0 2024-09-14T11:34:29.278 INFO:tasks.workunit.client.0.smithi071.stderr: -244> 2024-09-14T11:34:29.160+0000 7f1885134640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:29.278 INFO:tasks.workunit.client.0.smithi071.stderr: -243> 2024-09-14T11:34:29.160+0000 7f1885134640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:29.278 INFO:tasks.workunit.client.0.smithi071.stderr: -242> 2024-09-14T11:34:29.160+0000 7f1885134640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:29.278 INFO:tasks.workunit.client.0.smithi071.stderr: -241> 2024-09-14T11:34:29.160+0000 7f1886136640 10 monclient(hunting): get_auth_request con 0x5595eb39b930 auth_method 0 2024-09-14T11:34:29.278 INFO:tasks.workunit.client.0.smithi071.stderr: -240> 2024-09-14T11:34:29.160+0000 7f1886136640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:29.279 INFO:tasks.workunit.client.0.smithi071.stderr: -239> 2024-09-14T11:34:29.160+0000 7f1886136640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:29.279 INFO:tasks.workunit.client.0.smithi071.stderr: -238> 2024-09-14T11:34:29.160+0000 7f1886136640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:29.279 INFO:tasks.workunit.client.0.smithi071.stderr: -237> 2024-09-14T11:34:29.160+0000 7f1885134640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:29.279 INFO:tasks.workunit.client.0.smithi071.stderr: -236> 2024-09-14T11:34:29.160+0000 7f1885134640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:29.279 INFO:tasks.workunit.client.0.smithi071.stderr: -235> 2024-09-14T11:34:29.160+0000 7f1885134640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:29.279 INFO:tasks.workunit.client.0.smithi071.stderr: -234> 2024-09-14T11:34:29.160+0000 7f1886136640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:29.279 INFO:tasks.workunit.client.0.smithi071.stderr: -233> 2024-09-14T11:34:29.160+0000 7f1886136640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:29.279 INFO:tasks.workunit.client.0.smithi071.stderr: -232> 2024-09-14T11:34:29.160+0000 7f1886136640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:29.279 INFO:tasks.workunit.client.0.smithi071.stderr: -231> 2024-09-14T11:34:29.160+0000 7f1885134640 10 monclient(hunting): handle_auth_done global_id 7757 payload 274 2024-09-14T11:34:29.279 INFO:tasks.workunit.client.0.smithi071.stderr: -230> 2024-09-14T11:34:29.160+0000 7f1885134640 10 monclient: _finish_hunting 0 2024-09-14T11:34:29.279 INFO:tasks.workunit.client.0.smithi071.stderr: -229> 2024-09-14T11:34:29.160+0000 7f1885134640 1 monclient: found mon.noname-c 2024-09-14T11:34:29.279 INFO:tasks.workunit.client.0.smithi071.stderr: -228> 2024-09-14T11:34:29.160+0000 7f1885134640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:34:29.279 INFO:tasks.workunit.client.0.smithi071.stderr: -227> 2024-09-14T11:34:29.160+0000 7f17697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:29.279 INFO:tasks.workunit.client.0.smithi071.stderr: -226> 2024-09-14T11:34:29.160+0000 7f17697fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:29.279 INFO:tasks.workunit.client.0.smithi071.stderr: -225> 2024-09-14T11:34:29.160+0000 7f17697fa640 10 monclient: dump: 2024-09-14T11:34:29.279 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:34:29.280 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:34:29.280 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.280 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.280 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:29.280 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:34:29.280 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:34:29.280 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:34:29.280 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:34:29.280 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.280 INFO:tasks.workunit.client.0.smithi071.stderr: -224> 2024-09-14T11:34:29.160+0000 7f17697fa640 10 monclient: _finish_auth 0 2024-09-14T11:34:29.280 INFO:tasks.workunit.client.0.smithi071.stderr: -223> 2024-09-14T11:34:29.160+0000 7f17697fa640 10 monclient: _check_auth_tickets 2024-09-14T11:34:29.280 INFO:tasks.workunit.client.0.smithi071.stderr: -222> 2024-09-14T11:34:29.160+0000 7f17697fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:29.280 INFO:tasks.workunit.client.0.smithi071.stderr: -221> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 monclient: authenticate success, global_id 7757 2024-09-14T11:34:29.280 INFO:tasks.workunit.client.0.smithi071.stderr: -220> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:34:29.280 INFO:tasks.workunit.client.0.smithi071.stderr: -219> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 4 set_mon_vals no callback set 2024-09-14T11:34:29.281 INFO:tasks.workunit.client.0.smithi071.stderr: -218> 2024-09-14T11:34:29.160+0000 7f17697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:29.281 INFO:tasks.workunit.client.0.smithi071.stderr: -217> 2024-09-14T11:34:29.160+0000 7f17697fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:29.281 INFO:tasks.workunit.client.0.smithi071.stderr: -216> 2024-09-14T11:34:29.160+0000 7f17697fa640 10 monclient: dump: 2024-09-14T11:34:29.281 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:34:29.281 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:34:29.281 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.281 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.281 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:29.281 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:34:29.281 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:34:29.281 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:34:29.281 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:34:29.281 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.281 INFO:tasks.workunit.client.0.smithi071.stderr: -215> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient: shutdown 2024-09-14T11:34:29.281 INFO:tasks.workunit.client.0.smithi071.stderr: -214> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient: build_initial_monmap 2024-09-14T11:34:29.282 INFO:tasks.workunit.client.0.smithi071.stderr: -213> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 1 build_initial for_mkfs: 0 2024-09-14T11:34:29.282 INFO:tasks.workunit.client.0.smithi071.stderr: -212> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient: monmap: 2024-09-14T11:34:29.282 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:34:29.282 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:29.282 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:34:29.282 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:34:29.282 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:29.282 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:34:29.282 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:34:29.282 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:34:29.282 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:34:29.282 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.282 INFO:tasks.workunit.client.0.smithi071.stderr: -211> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3a0af0) adding auth protocol: cephx 2024-09-14T11:34:29.282 INFO:tasks.workunit.client.0.smithi071.stderr: -210> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3a0af0) adding auth protocol: cephx 2024-09-14T11:34:29.282 INFO:tasks.workunit.client.0.smithi071.stderr: -209> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3a0af0) adding auth protocol: cephx 2024-09-14T11:34:29.283 INFO:tasks.workunit.client.0.smithi071.stderr: -208> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3a0af0) adding con mode: secure 2024-09-14T11:34:29.283 INFO:tasks.workunit.client.0.smithi071.stderr: -207> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3a0af0) adding con mode: crc 2024-09-14T11:34:29.283 INFO:tasks.workunit.client.0.smithi071.stderr: -206> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3a0af0) adding con mode: secure 2024-09-14T11:34:29.283 INFO:tasks.workunit.client.0.smithi071.stderr: -205> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3a0af0) adding con mode: crc 2024-09-14T11:34:29.283 INFO:tasks.workunit.client.0.smithi071.stderr: -204> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3a0af0) adding con mode: secure 2024-09-14T11:34:29.283 INFO:tasks.workunit.client.0.smithi071.stderr: -203> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3a0af0) adding con mode: crc 2024-09-14T11:34:29.283 INFO:tasks.workunit.client.0.smithi071.stderr: -202> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3a0af0) adding con mode: crc 2024-09-14T11:34:29.283 INFO:tasks.workunit.client.0.smithi071.stderr: -201> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3a0af0) adding con mode: secure 2024-09-14T11:34:29.283 INFO:tasks.workunit.client.0.smithi071.stderr: -200> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3a0af0) adding con mode: crc 2024-09-14T11:34:29.283 INFO:tasks.workunit.client.0.smithi071.stderr: -199> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3a0af0) adding con mode: secure 2024-09-14T11:34:29.283 INFO:tasks.workunit.client.0.smithi071.stderr: -198> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3a0af0) adding con mode: crc 2024-09-14T11:34:29.283 INFO:tasks.workunit.client.0.smithi071.stderr: -197> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3a0af0) adding con mode: secure 2024-09-14T11:34:29.283 INFO:tasks.workunit.client.0.smithi071.stderr: -196> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:29.283 INFO:tasks.workunit.client.0.smithi071.stderr: -195> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 1 librados: starting msgr at 2024-09-14T11:34:29.283 INFO:tasks.workunit.client.0.smithi071.stderr: -194> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 1 librados: starting objecter 2024-09-14T11:34:29.284 INFO:tasks.workunit.client.0.smithi071.stderr: -193> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 asok(0x5595eb0bcd90) register_command objecter_requests cmddesc objecter_requests hook 0x5595eb2f3540 EEXIST 2024-09-14T11:34:29.284 INFO:tasks.workunit.client.0.smithi071.stderr: -192> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 1 librados: setting wanted keys 2024-09-14T11:34:29.284 INFO:tasks.workunit.client.0.smithi071.stderr: -191> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 1 librados: calling monclient init 2024-09-14T11:34:29.284 INFO:tasks.workunit.client.0.smithi071.stderr: -190> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient: init 2024-09-14T11:34:29.284 INFO:tasks.workunit.client.0.smithi071.stderr: -189> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3497e0) adding auth protocol: cephx 2024-09-14T11:34:29.284 INFO:tasks.workunit.client.0.smithi071.stderr: -188> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3497e0) adding auth protocol: cephx 2024-09-14T11:34:29.284 INFO:tasks.workunit.client.0.smithi071.stderr: -187> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3497e0) adding auth protocol: cephx 2024-09-14T11:34:29.284 INFO:tasks.workunit.client.0.smithi071.stderr: -186> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3497e0) adding con mode: secure 2024-09-14T11:34:29.284 INFO:tasks.workunit.client.0.smithi071.stderr: -185> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3497e0) adding con mode: crc 2024-09-14T11:34:29.284 INFO:tasks.workunit.client.0.smithi071.stderr: -184> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3497e0) adding con mode: secure 2024-09-14T11:34:29.284 INFO:tasks.workunit.client.0.smithi071.stderr: -183> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3497e0) adding con mode: crc 2024-09-14T11:34:29.284 INFO:tasks.workunit.client.0.smithi071.stderr: -182> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3497e0) adding con mode: secure 2024-09-14T11:34:29.284 INFO:tasks.workunit.client.0.smithi071.stderr: -181> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3497e0) adding con mode: crc 2024-09-14T11:34:29.284 INFO:tasks.workunit.client.0.smithi071.stderr: -180> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3497e0) adding con mode: crc 2024-09-14T11:34:29.284 INFO:tasks.workunit.client.0.smithi071.stderr: -179> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3497e0) adding con mode: secure 2024-09-14T11:34:29.285 INFO:tasks.workunit.client.0.smithi071.stderr: -178> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3497e0) adding con mode: crc 2024-09-14T11:34:29.285 INFO:tasks.workunit.client.0.smithi071.stderr: -177> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3497e0) adding con mode: secure 2024-09-14T11:34:29.285 INFO:tasks.workunit.client.0.smithi071.stderr: -176> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3497e0) adding con mode: crc 2024-09-14T11:34:29.285 INFO:tasks.workunit.client.0.smithi071.stderr: -175> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3497e0) adding con mode: secure 2024-09-14T11:34:29.285 INFO:tasks.workunit.client.0.smithi071.stderr: -174> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:29.285 INFO:tasks.workunit.client.0.smithi071.stderr: -173> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:29.285 INFO:tasks.workunit.client.0.smithi071.stderr: -172> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 asok(0x5595eb0bcd90) register_command rotate-key cmddesc rotate-key hook 0x5595eb349928 EEXIST 2024-09-14T11:34:29.285 INFO:tasks.workunit.client.0.smithi071.stderr: -171> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:34:29.285 INFO:tasks.workunit.client.0.smithi071.stderr: -170> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:34:29.285 INFO:tasks.workunit.client.0.smithi071.stderr: -169> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient(hunting): picked mon.noname-a con 0x5595eb39b550 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:34:29.285 INFO:tasks.workunit.client.0.smithi071.stderr: -168> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient(hunting): picked mon.noname-c con 0x5595eb3671f0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:34:29.285 INFO:tasks.workunit.client.0.smithi071.stderr: -167> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient(hunting): picked mon.noname-b con 0x5595eb399f30 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:34:29.286 INFO:tasks.workunit.client.0.smithi071.stderr: -166> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:29.286 INFO:tasks.workunit.client.0.smithi071.stderr: -165> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:29.286 INFO:tasks.workunit.client.0.smithi071.stderr: -164> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:29.286 INFO:tasks.workunit.client.0.smithi071.stderr: -163> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:34:29.286 INFO:tasks.workunit.client.0.smithi071.stderr: -162> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient(hunting): authenticate will time out at 2481.283277s 2024-09-14T11:34:29.286 INFO:tasks.workunit.client.0.smithi071.stderr: -161> 2024-09-14T11:34:29.160+0000 7f1885134640 10 monclient(hunting): get_auth_request con 0x5595eb39b550 auth_method 0 2024-09-14T11:34:29.286 INFO:tasks.workunit.client.0.smithi071.stderr: -160> 2024-09-14T11:34:29.160+0000 7f1885134640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:29.286 INFO:tasks.workunit.client.0.smithi071.stderr: -159> 2024-09-14T11:34:29.160+0000 7f1885134640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:29.286 INFO:tasks.workunit.client.0.smithi071.stderr: -158> 2024-09-14T11:34:29.160+0000 7f1885134640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:29.286 INFO:tasks.workunit.client.0.smithi071.stderr: -157> 2024-09-14T11:34:29.160+0000 7f1886136640 10 monclient(hunting): get_auth_request con 0x5595eb3671f0 auth_method 0 2024-09-14T11:34:29.286 INFO:tasks.workunit.client.0.smithi071.stderr: -156> 2024-09-14T11:34:29.160+0000 7f1886136640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:29.286 INFO:tasks.workunit.client.0.smithi071.stderr: -155> 2024-09-14T11:34:29.160+0000 7f1886136640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:29.286 INFO:tasks.workunit.client.0.smithi071.stderr: -154> 2024-09-14T11:34:29.160+0000 7f1886136640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:29.286 INFO:tasks.workunit.client.0.smithi071.stderr: -153> 2024-09-14T11:34:29.160+0000 7f1886136640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:29.286 INFO:tasks.workunit.client.0.smithi071.stderr: -152> 2024-09-14T11:34:29.160+0000 7f1886136640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:29.286 INFO:tasks.workunit.client.0.smithi071.stderr: -151> 2024-09-14T11:34:29.160+0000 7f1886136640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:29.287 INFO:tasks.workunit.client.0.smithi071.stderr: -150> 2024-09-14T11:34:29.160+0000 7f1885134640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:29.287 INFO:tasks.workunit.client.0.smithi071.stderr: -149> 2024-09-14T11:34:29.160+0000 7f1885134640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:29.287 INFO:tasks.workunit.client.0.smithi071.stderr: -148> 2024-09-14T11:34:29.160+0000 7f1885134640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:29.287 INFO:tasks.workunit.client.0.smithi071.stderr: -147> 2024-09-14T11:34:29.160+0000 7f1886136640 10 monclient(hunting): handle_auth_done global_id 7760 payload 824 2024-09-14T11:34:29.287 INFO:tasks.workunit.client.0.smithi071.stderr: -146> 2024-09-14T11:34:29.160+0000 7f1886136640 10 monclient: _finish_hunting 0 2024-09-14T11:34:29.287 INFO:tasks.workunit.client.0.smithi071.stderr: -145> 2024-09-14T11:34:29.160+0000 7f1886136640 1 monclient: found mon.noname-c 2024-09-14T11:34:29.287 INFO:tasks.workunit.client.0.smithi071.stderr: -144> 2024-09-14T11:34:29.160+0000 7f1886136640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:34:29.287 INFO:tasks.workunit.client.0.smithi071.stderr: -143> 2024-09-14T11:34:29.164+0000 7f17577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:29.287 INFO:tasks.workunit.client.0.smithi071.stderr: -142> 2024-09-14T11:34:29.164+0000 7f17577fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:29.287 INFO:tasks.workunit.client.0.smithi071.stderr: -141> 2024-09-14T11:34:29.164+0000 7f17577fe640 10 monclient: dump: 2024-09-14T11:34:29.287 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:34:29.287 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:34:29.287 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.287 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.287 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:29.288 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:34:29.288 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:34:29.288 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:34:29.288 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:34:29.288 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.288 INFO:tasks.workunit.client.0.smithi071.stderr: -140> 2024-09-14T11:34:29.164+0000 7f17577fe640 10 monclient: _finish_auth 0 2024-09-14T11:34:29.288 INFO:tasks.workunit.client.0.smithi071.stderr: -139> 2024-09-14T11:34:29.164+0000 7f17577fe640 10 monclient: _check_auth_tickets 2024-09-14T11:34:29.288 INFO:tasks.workunit.client.0.smithi071.stderr: -138> 2024-09-14T11:34:29.164+0000 7f17577fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:29.288 INFO:tasks.workunit.client.0.smithi071.stderr: -137> 2024-09-14T11:34:29.164+0000 7f17577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:29.288 INFO:tasks.workunit.client.0.smithi071.stderr: -136> 2024-09-14T11:34:29.164+0000 7f17577fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:29.288 INFO:tasks.workunit.client.0.smithi071.stderr: -135> 2024-09-14T11:34:29.164+0000 7f17577fe640 10 monclient: dump: 2024-09-14T11:34:29.288 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:34:29.288 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:34:29.288 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.288 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.289 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:29.289 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:34:29.289 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:34:29.289 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:34:29.289 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:34:29.289 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.289 INFO:tasks.workunit.client.0.smithi071.stderr: -134> 2024-09-14T11:34:29.164+0000 7f1887e2f9c0 5 monclient: authenticate success, global_id 7760 2024-09-14T11:34:29.289 INFO:tasks.workunit.client.0.smithi071.stderr: -133> 2024-09-14T11:34:29.164+0000 7f1887e2f9c0 10 monclient: _renew_subs 2024-09-14T11:34:29.289 INFO:tasks.workunit.client.0.smithi071.stderr: -132> 2024-09-14T11:34:29.164+0000 7f1887e2f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:34:29.289 INFO:tasks.workunit.client.0.smithi071.stderr: -131> 2024-09-14T11:34:29.164+0000 7f17697fa640 4 set_mon_vals no callback set 2024-09-14T11:34:29.289 INFO:tasks.workunit.client.0.smithi071.stderr: -130> 2024-09-14T11:34:29.164+0000 7f1887e2f9c0 10 monclient: _renew_subs 2024-09-14T11:34:29.289 INFO:tasks.workunit.client.0.smithi071.stderr: -129> 2024-09-14T11:34:29.164+0000 7f1887e2f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:34:29.289 INFO:tasks.workunit.client.0.smithi071.stderr: -128> 2024-09-14T11:34:29.164+0000 7f1887e2f9c0 1 librados: init done 2024-09-14T11:34:29.289 INFO:tasks.workunit.client.0.smithi071.stderr: -127> 2024-09-14T11:34:29.164+0000 7f1887e2f9c0 5 asok(0x5595eb0bcd90) register_command cr dump hook 0x5595eb368368 2024-09-14T11:34:29.289 INFO:tasks.workunit.client.0.smithi071.stderr: -126> 2024-09-14T11:34:29.164+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.289 INFO:tasks.workunit.client.0.smithi071.stderr: -125> 2024-09-14T11:34:29.164+0000 7f17577fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:29.290 INFO:tasks.workunit.client.0.smithi071.stderr: -124> 2024-09-14T11:34:29.164+0000 7f17577fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:34:29.290 INFO:tasks.workunit.client.0.smithi071.stderr: -123> 2024-09-14T11:34:29.164+0000 7f17577fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:34:29.290 INFO:tasks.workunit.client.0.smithi071.stderr: -122> 2024-09-14T11:34:29.164+0000 7f1885134640 10 monclient: get_auth_request con 0x7f17500718d0 auth_method 0 2024-09-14T11:34:29.290 INFO:tasks.workunit.client.0.smithi071.stderr: -121> 2024-09-14T11:34:29.164+0000 7f1885935640 10 monclient: get_auth_request con 0x5595eb3b5d30 auth_method 0 2024-09-14T11:34:29.290 INFO:tasks.workunit.client.0.smithi071.stderr: -120> 2024-09-14T11:34:29.168+0000 7f1887e2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.290 INFO:tasks.workunit.client.0.smithi071.stderr: -119> 2024-09-14T11:34:29.168+0000 7f1887e2f9c0 20 realm 2024-09-14T11:34:29.290 INFO:tasks.workunit.client.0.smithi071.stderr: -118> 2024-09-14T11:34:29.168+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.290 INFO:tasks.workunit.client.0.smithi071.stderr: -117> 2024-09-14T11:34:29.168+0000 7f1887e2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.290 INFO:tasks.workunit.client.0.smithi071.stderr: -116> 2024-09-14T11:34:29.168+0000 7f1887e2f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:29.290 INFO:tasks.workunit.client.0.smithi071.stderr: -115> 2024-09-14T11:34:29.168+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.290 INFO:tasks.workunit.client.0.smithi071.stderr: -114> 2024-09-14T11:34:29.168+0000 7f1887e2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.290 INFO:tasks.workunit.client.0.smithi071.stderr: -113> 2024-09-14T11:34:29.168+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.290 INFO:tasks.workunit.client.0.smithi071.stderr: -112> 2024-09-14T11:34:29.168+0000 7f1885134640 10 monclient: get_auth_request con 0x5595eb3b9f40 auth_method 0 2024-09-14T11:34:29.290 INFO:tasks.workunit.client.0.smithi071.stderr: -111> 2024-09-14T11:34:29.168+0000 7f1887e2f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:29.290 INFO:tasks.workunit.client.0.smithi071.stderr: -110> 2024-09-14T11:34:29.168+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.290 INFO:tasks.workunit.client.0.smithi071.stderr: -109> 2024-09-14T11:34:29.168+0000 7f1886136640 10 monclient: get_auth_request con 0x5595eb3bd780 auth_method 0 2024-09-14T11:34:29.291 INFO:tasks.workunit.client.0.smithi071.stderr: -108> 2024-09-14T11:34:29.168+0000 7f1887e2f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:29.291 INFO:tasks.workunit.client.0.smithi071.stderr: -107> 2024-09-14T11:34:29.168+0000 7f1887e2f9c0 20 searching for the correct realm 2024-09-14T11:34:29.291 INFO:tasks.workunit.client.0.smithi071.stderr: -106> 2024-09-14T11:34:29.168+0000 7f1885935640 10 monclient: get_auth_request con 0x5595eb3c24f0 auth_method 0 2024-09-14T11:34:29.291 INFO:tasks.workunit.client.0.smithi071.stderr: -105> 2024-09-14T11:34:29.172+0000 7f1885134640 10 monclient: get_auth_request con 0x7f1878067470 auth_method 0 2024-09-14T11:34:29.291 INFO:tasks.workunit.client.0.smithi071.stderr: -104> 2024-09-14T11:34:29.172+0000 7f1885134640 0 -- 172.21.15.71:0/3078911883 >> [v2:172.21.15.71:6824/2436891866,v1:172.21.15.71:6825/2436891866] conn(0x7f1878067470 msgr2=0x7f18780661b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:29.291 INFO:tasks.workunit.client.0.smithi071.stderr: -103> 2024-09-14T11:34:29.172+0000 7f17577fe640 1 client.7760.objecter ms_handle_reset 0x7f1878067470 session 0x7f187806de90 osd.2 2024-09-14T11:34:29.291 INFO:tasks.workunit.client.0.smithi071.stderr: -102> 2024-09-14T11:34:29.172+0000 7f17577fe640 10 monclient: _renew_subs 2024-09-14T11:34:29.291 INFO:tasks.workunit.client.0.smithi071.stderr: -101> 2024-09-14T11:34:29.172+0000 7f17577fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:34:29.291 INFO:tasks.workunit.client.0.smithi071.stderr: -100> 2024-09-14T11:34:29.172+0000 7f1885134640 10 monclient: get_auth_request con 0x7f1750081450 auth_method 0 2024-09-14T11:34:29.291 INFO:tasks.workunit.client.0.smithi071.stderr: -99> 2024-09-14T11:34:29.172+0000 7f1886136640 10 monclient: get_auth_request con 0x7f187c008040 auth_method 0 2024-09-14T11:34:29.291 INFO:tasks.workunit.client.0.smithi071.stderr: -98> 2024-09-14T11:34:29.176+0000 7f1885935640 10 monclient: get_auth_request con 0x7f1878067ba0 auth_method 0 2024-09-14T11:34:29.291 INFO:tasks.workunit.client.0.smithi071.stderr: -97> 2024-09-14T11:34:29.180+0000 7f1885935640 0 -- 172.21.15.71:0/3078911883 >> [v2:172.21.15.157:6816/1231501119,v1:172.21.15.157:6817/1231501119] conn(0x5595eb3b5d30 msgr2=0x5595eb3b81d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:29.291 INFO:tasks.workunit.client.0.smithi071.stderr: -96> 2024-09-14T11:34:29.180+0000 7f17577fe640 1 client.7760.objecter ms_handle_reset 0x5595eb3b5d30 session 0x5595eb3b56b0 osd.6 2024-09-14T11:34:29.291 INFO:tasks.workunit.client.0.smithi071.stderr: -95> 2024-09-14T11:34:29.180+0000 7f1885935640 10 monclient: get_auth_request con 0x7f1878067470 auth_method 0 2024-09-14T11:34:29.292 INFO:tasks.workunit.client.0.smithi071.stderr: -94> 2024-09-14T11:34:29.180+0000 7f1885134640 10 monclient: get_auth_request con 0x7f187c062400 auth_method 0 2024-09-14T11:34:29.292 INFO:tasks.workunit.client.0.smithi071.stderr: -93> 2024-09-14T11:34:29.188+0000 7f1887e2f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:29.292 INFO:tasks.workunit.client.0.smithi071.stderr: -92> 2024-09-14T11:34:29.188+0000 7f1887e2f9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:34:29.292 INFO:tasks.workunit.client.0.smithi071.stderr: -91> 2024-09-14T11:34:29.188+0000 7f1887e2f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:29.292 INFO:tasks.workunit.client.0.smithi071.stderr: -90> 2024-09-14T11:34:29.188+0000 7f1887e2f9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:34:29.292 INFO:tasks.workunit.client.0.smithi071.stderr: -89> 2024-09-14T11:34:29.188+0000 7f1887e2f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:29.292 INFO:tasks.workunit.client.0.smithi071.stderr: -88> 2024-09-14T11:34:29.188+0000 7f1887e2f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:29.292 INFO:tasks.workunit.client.0.smithi071.stderr: -87> 2024-09-14T11:34:29.188+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.292 INFO:tasks.workunit.client.0.smithi071.stderr: -86> 2024-09-14T11:34:29.188+0000 7f1887e2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.292 INFO:tasks.workunit.client.0.smithi071.stderr: -85> 2024-09-14T11:34:29.188+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.292 INFO:tasks.workunit.client.0.smithi071.stderr: -84> 2024-09-14T11:34:29.188+0000 7f1887e2f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:29.292 INFO:tasks.workunit.client.0.smithi071.stderr: -83> 2024-09-14T11:34:29.188+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.292 INFO:tasks.workunit.client.0.smithi071.stderr: -82> 2024-09-14T11:34:29.192+0000 7f1887e2f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:29.292 INFO:tasks.workunit.client.0.smithi071.stderr: -81> 2024-09-14T11:34:29.192+0000 7f1887e2f9c0 20 zone default found 2024-09-14T11:34:29.292 INFO:tasks.workunit.client.0.smithi071.stderr: -80> 2024-09-14T11:34:29.192+0000 7f1887e2f9c0 4 Realm: () 2024-09-14T11:34:29.293 INFO:tasks.workunit.client.0.smithi071.stderr: -79> 2024-09-14T11:34:29.192+0000 7f1887e2f9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:34:29.293 INFO:tasks.workunit.client.0.smithi071.stderr: -78> 2024-09-14T11:34:29.192+0000 7f1887e2f9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:34:29.293 INFO:tasks.workunit.client.0.smithi071.stderr: -77> 2024-09-14T11:34:29.192+0000 7f1887e2f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:29.293 INFO:tasks.workunit.client.0.smithi071.stderr: -76> 2024-09-14T11:34:29.192+0000 7f1887e2f9c0 20 zonegroup default 2024-09-14T11:34:29.293 INFO:tasks.workunit.client.0.smithi071.stderr: -75> 2024-09-14T11:34:29.192+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.293 INFO:tasks.workunit.client.0.smithi071.stderr: -74> 2024-09-14T11:34:29.192+0000 7f1887e2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.293 INFO:tasks.workunit.client.0.smithi071.stderr: -73> 2024-09-14T11:34:29.192+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.293 INFO:tasks.workunit.client.0.smithi071.stderr: -72> 2024-09-14T11:34:29.192+0000 7f1887e2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.293 INFO:tasks.workunit.client.0.smithi071.stderr: -71> 2024-09-14T11:34:29.192+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.293 INFO:tasks.workunit.client.0.smithi071.stderr: -70> 2024-09-14T11:34:29.192+0000 7f1887e2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.293 INFO:tasks.workunit.client.0.smithi071.stderr: -69> 2024-09-14T11:34:29.192+0000 7f1887e2f9c0 20 started sync module instance, tier type = 2024-09-14T11:34:29.293 INFO:tasks.workunit.client.0.smithi071.stderr: -68> 2024-09-14T11:34:29.192+0000 7f1887e2f9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:34:29.293 INFO:tasks.workunit.client.0.smithi071.stderr: -67> 2024-09-14T11:34:29.208+0000 7f1887e2f9c0 20 add_watcher() i=0 2024-09-14T11:34:29.293 INFO:tasks.workunit.client.0.smithi071.stderr: -66> 2024-09-14T11:34:29.208+0000 7f1887e2f9c0 20 add_watcher() i=1 2024-09-14T11:34:29.293 INFO:tasks.workunit.client.0.smithi071.stderr: -65> 2024-09-14T11:34:29.208+0000 7f1887e2f9c0 20 add_watcher() i=2 2024-09-14T11:34:29.293 INFO:tasks.workunit.client.0.smithi071.stderr: -64> 2024-09-14T11:34:29.208+0000 7f1887e2f9c0 20 add_watcher() i=3 2024-09-14T11:34:29.294 INFO:tasks.workunit.client.0.smithi071.stderr: -63> 2024-09-14T11:34:29.208+0000 7f1887e2f9c0 20 add_watcher() i=4 2024-09-14T11:34:29.294 INFO:tasks.workunit.client.0.smithi071.stderr: -62> 2024-09-14T11:34:29.208+0000 7f1887e2f9c0 20 add_watcher() i=5 2024-09-14T11:34:29.294 INFO:tasks.workunit.client.0.smithi071.stderr: -61> 2024-09-14T11:34:29.208+0000 7f1887e2f9c0 20 add_watcher() i=6 2024-09-14T11:34:29.294 INFO:tasks.workunit.client.0.smithi071.stderr: -60> 2024-09-14T11:34:29.212+0000 7f1887e2f9c0 20 add_watcher() i=7 2024-09-14T11:34:29.294 INFO:tasks.workunit.client.0.smithi071.stderr: -59> 2024-09-14T11:34:29.212+0000 7f1887e2f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:29.294 INFO:tasks.workunit.client.0.smithi071.stderr: -58> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a860) adding auth protocol: cephx 2024-09-14T11:34:29.294 INFO:tasks.workunit.client.0.smithi071.stderr: -57> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a860) adding auth protocol: cephx 2024-09-14T11:34:29.294 INFO:tasks.workunit.client.0.smithi071.stderr: -56> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a860) adding auth protocol: cephx 2024-09-14T11:34:29.294 INFO:tasks.workunit.client.0.smithi071.stderr: -55> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a860) adding con mode: secure 2024-09-14T11:34:29.294 INFO:tasks.workunit.client.0.smithi071.stderr: -54> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a860) adding con mode: crc 2024-09-14T11:34:29.294 INFO:tasks.workunit.client.0.smithi071.stderr: -53> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a860) adding con mode: secure 2024-09-14T11:34:29.294 INFO:tasks.workunit.client.0.smithi071.stderr: -52> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a860) adding con mode: crc 2024-09-14T11:34:29.294 INFO:tasks.workunit.client.0.smithi071.stderr: -51> 2024-09-14T11:34:29.216+0000 7f17377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:29.294 INFO:tasks.workunit.client.0.smithi071.stderr: -50> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a860) adding con mode: secure 2024-09-14T11:34:29.294 INFO:tasks.workunit.client.0.smithi071.stderr: -49> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a860) adding con mode: crc 2024-09-14T11:34:29.295 INFO:tasks.workunit.client.0.smithi071.stderr: -48> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a860) adding con mode: crc 2024-09-14T11:34:29.295 INFO:tasks.workunit.client.0.smithi071.stderr: -47> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a860) adding con mode: secure 2024-09-14T11:34:29.295 INFO:tasks.workunit.client.0.smithi071.stderr: -46> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a860) adding con mode: crc 2024-09-14T11:34:29.295 INFO:tasks.workunit.client.0.smithi071.stderr: -45> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a860) adding con mode: secure 2024-09-14T11:34:29.295 INFO:tasks.workunit.client.0.smithi071.stderr: -44> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a860) adding con mode: crc 2024-09-14T11:34:29.295 INFO:tasks.workunit.client.0.smithi071.stderr: -43> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a860) adding con mode: secure 2024-09-14T11:34:29.295 INFO:tasks.workunit.client.0.smithi071.stderr: -42> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:29.295 INFO:tasks.workunit.client.0.smithi071.stderr: -41> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:29.295 INFO:tasks.workunit.client.0.smithi071.stderr: -40> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:29.295 INFO:tasks.workunit.client.0.smithi071.stderr: -39> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 asok(0x5595eb0bcd90) register_command cache list hook 0x5595eb39a760 2024-09-14T11:34:29.295 INFO:tasks.workunit.client.0.smithi071.stderr: -38> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 asok(0x5595eb0bcd90) register_command cache inspect hook 0x5595eb39a760 2024-09-14T11:34:29.295 INFO:tasks.workunit.client.0.smithi071.stderr: -37> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 asok(0x5595eb0bcd90) register_command cache erase hook 0x5595eb39a760 2024-09-14T11:34:29.295 INFO:tasks.workunit.client.0.smithi071.stderr: -36> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 asok(0x5595eb0bcd90) register_command cache zap hook 0x5595eb39a760 2024-09-14T11:34:29.295 INFO:tasks.workunit.client.0.smithi071.stderr: -35> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 note: GC not initialized 2024-09-14T11:34:29.295 INFO:tasks.workunit.client.0.smithi071.stderr: -34> 2024-09-14T11:34:29.216+0000 7f17367fc640 20 reqs_thread_entry: start 2024-09-14T11:34:29.295 INFO:tasks.workunit.client.0.smithi071.stderr: -33> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 asok(0x5595eb0bcd90) register_command sync trace show hook 0x7f18780014f0 2024-09-14T11:34:29.296 INFO:tasks.workunit.client.0.smithi071.stderr: -32> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 asok(0x5595eb0bcd90) register_command sync trace history hook 0x7f18780014f0 2024-09-14T11:34:29.296 INFO:tasks.workunit.client.0.smithi071.stderr: -31> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 asok(0x5595eb0bcd90) register_command sync trace active hook 0x7f18780014f0 2024-09-14T11:34:29.296 INFO:tasks.workunit.client.0.smithi071.stderr: -30> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 asok(0x5595eb0bcd90) register_command sync trace active_short hook 0x7f18780014f0 2024-09-14T11:34:29.296 INFO:tasks.workunit.client.0.smithi071.stderr: -29> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:34:29.296 INFO:tasks.workunit.client.0.smithi071.stderr: -28> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 20 Filter name: none 2024-09-14T11:34:29.296 INFO:tasks.workunit.client.0.smithi071.stderr: -27> 2024-09-14T11:34:29.216+0000 7f16a7fff640 20 reqs_thread_entry: start 2024-09-14T11:34:29.296 INFO:tasks.workunit.client.0.smithi071.stderr: -26> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:34:29.296 INFO:tasks.workunit.client.0.smithi071.stderr: -25> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.296 INFO:tasks.workunit.client.0.smithi071.stderr: -24> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:29.296 INFO:tasks.workunit.client.0.smithi071.stderr: -23> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:34:29.296 INFO:tasks.workunit.client.0.smithi071.stderr: -22> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:34:29.296 INFO:tasks.workunit.client.0.smithi071.stderr: -21> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 : miss 2024-09-14T11:34:29.296 INFO:tasks.workunit.client.0.smithi071.stderr: -20> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.296 INFO:tasks.workunit.client.0.smithi071.stderr: -19> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:34:29.296 INFO:tasks.workunit.client.0.smithi071.stderr: -18> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:34:29.297 INFO:tasks.workunit.client.0.smithi071.stderr: -17> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:34:29.297 INFO:tasks.workunit.client.0.smithi071.stderr: -16> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:29.297 INFO:tasks.workunit.client.0.smithi071.stderr: -15> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:29.297 INFO:tasks.workunit.client.0.smithi071.stderr: -14> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 2024-09-14T11:34:29.297 INFO:tasks.workunit.client.0.smithi071.stderr: -13> 2024-09-14T11:34:29.228+0000 7f1887e2f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:34:29.297 INFO:tasks.workunit.client.0.smithi071.stderr: -12> 2024-09-14T11:34:29.228+0000 7f1887e2f9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:34:29.297 INFO:tasks.workunit.client.0.smithi071.stderr: -11> 2024-09-14T11:34:29.228+0000 7f1887e2f9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:29.297 INFO:tasks.workunit.client.0.smithi071.stderr: -10> 2024-09-14T11:34:29.228+0000 7f1887e2f9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18, ofs0, ns] 2024-09-14T11:34:29.297 INFO:tasks.workunit.client.0.smithi071.stderr: -9> 2024-09-14T11:34:29.228+0000 7f17697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464426 cookie 94102385095504 notifier 7760 bl.length()=911 2024-09-14T11:34:29.297 INFO:tasks.workunit.client.0.smithi071.stderr: -8> 2024-09-14T11:34:29.228+0000 7f17697fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:34:29.297 INFO:tasks.workunit.client.0.smithi071.stderr: -7> 2024-09-14T11:34:29.228+0000 7f17697fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:34:29.297 INFO:tasks.workunit.client.0.smithi071.stderr: -6> 2024-09-14T11:34:29.228+0000 7f17697fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:29.297 INFO:tasks.workunit.client.0.smithi071.stderr: -5> 2024-09-14T11:34:29.228+0000 7f1887e2f9c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_sources= new_sources= 2024-09-14T11:34:29.297 INFO:tasks.workunit.client.0.smithi071.stderr: -4> 2024-09-14T11:34:29.228+0000 7f1887e2f9c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential sources added=[] removed=[] 2024-09-14T11:34:29.297 INFO:tasks.workunit.client.0.smithi071.stderr: -3> 2024-09-14T11:34:29.228+0000 7f1887e2f9c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_dests= new_dests= 2024-09-14T11:34:29.298 INFO:tasks.workunit.client.0.smithi071.stderr: -2> 2024-09-14T11:34:29.228+0000 7f1887e2f9c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential dests added=[] removed=[] 2024-09-14T11:34:29.298 INFO:tasks.workunit.client.0.smithi071.stderr: -1> 2024-09-14T11:34:29.240+0000 7f1887e2f9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1887e2f9c0 time 2024-09-14T11:34:29.241615+0000 2024-09-14T11:34:29.298 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:29.298 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.298 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:29.298 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f188b7092eb] 2024-09-14T11:34:29.298 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f188b70949f] 2024-09-14T11:34:29.298 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5595e99e2c01] 2024-09-14T11:34:29.298 INFO:tasks.workunit.client.0.smithi071.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5595e99f7f3a] 2024-09-14T11:34:29.298 INFO:tasks.workunit.client.0.smithi071.stderr: 5: main() 2024-09-14T11:34:29.298 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f188a56fd90] 2024-09-14T11:34:29.298 INFO:tasks.workunit.client.0.smithi071.stderr: 7: __libc_start_main() 2024-09-14T11:34:29.298 INFO:tasks.workunit.client.0.smithi071.stderr: 8: _start() 2024-09-14T11:34:29.298 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.298 INFO:tasks.workunit.client.0.smithi071.stderr: 0> 2024-09-14T11:34:29.240+0000 7f1887e2f9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:34:29.298 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f1887e2f9c0 thread_name:radosgw-admin 2024-09-14T11:34:29.299 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.299 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:29.299 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f188a588520] 2024-09-14T11:34:29.299 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:34:29.299 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:34:29.299 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:34:29.299 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f188b709345] 2024-09-14T11:34:29.299 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f188b70949f] 2024-09-14T11:34:29.299 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5595e99e2c01] 2024-09-14T11:34:29.299 INFO:tasks.workunit.client.0.smithi071.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5595e99f7f3a] 2024-09-14T11:34:29.299 INFO:tasks.workunit.client.0.smithi071.stderr: 9: main() 2024-09-14T11:34:29.299 INFO:tasks.workunit.client.0.smithi071.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f188a56fd90] 2024-09-14T11:34:29.299 INFO:tasks.workunit.client.0.smithi071.stderr: 11: __libc_start_main() 2024-09-14T11:34:29.299 INFO:tasks.workunit.client.0.smithi071.stderr: 12: _start() 2024-09-14T11:34:29.299 INFO:tasks.workunit.client.0.smithi071.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:34:29.300 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.300 INFO:tasks.workunit.client.0.smithi071.stderr:--- logging levels --- 2024-09-14T11:34:29.300 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 none 2024-09-14T11:34:29.300 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 lockdep 2024-09-14T11:34:29.300 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 context 2024-09-14T11:34:29.300 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 crush 2024-09-14T11:34:29.300 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds 2024-09-14T11:34:29.300 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_balancer 2024-09-14T11:34:29.300 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_locker 2024-09-14T11:34:29.300 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log 2024-09-14T11:34:29.300 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log_expire 2024-09-14T11:34:29.300 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_migrator 2024-09-14T11:34:29.300 INFO:tasks.workunit.client.0.smithi071.stderr: 3/ 5 mds_quiesce 2024-09-14T11:34:29.300 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 buffer 2024-09-14T11:34:29.301 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 timer 2024-09-14T11:34:29.301 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 filer 2024-09-14T11:34:29.301 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 striper 2024-09-14T11:34:29.301 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 objecter 2024-09-14T11:34:29.301 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rados 2024-09-14T11:34:29.301 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd 2024-09-14T11:34:29.301 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_mirror 2024-09-14T11:34:29.301 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_replay 2024-09-14T11:34:29.301 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_pwl 2024-09-14T11:34:29.301 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 journaler 2024-09-14T11:34:29.301 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objectcacher 2024-09-14T11:34:29.301 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:34:29.301 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 client 2024-09-14T11:34:29.301 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 osd 2024-09-14T11:34:29.301 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 optracker 2024-09-14T11:34:29.302 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objclass 2024-09-14T11:34:29.302 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 filestore 2024-09-14T11:34:29.302 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 journal 2024-09-14T11:34:29.302 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 ms 2024-09-14T11:34:29.302 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mon 2024-09-14T11:34:29.302 INFO:tasks.workunit.client.0.smithi071.stderr: 0/10 monc 2024-09-14T11:34:29.302 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 paxos 2024-09-14T11:34:29.302 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 tp 2024-09-14T11:34:29.302 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 auth 2024-09-14T11:34:29.302 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 crypto 2024-09-14T11:34:29.302 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 finisher 2024-09-14T11:34:29.302 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 reserver 2024-09-14T11:34:29.302 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 heartbeatmap 2024-09-14T11:34:29.302 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 perfcounter 2024-09-14T11:34:29.302 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw 2024-09-14T11:34:29.302 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_sync 2024-09-14T11:34:29.303 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_datacache 2024-09-14T11:34:29.303 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_access 2024-09-14T11:34:29.303 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:34:29.303 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_flight 2024-09-14T11:34:29.303 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:34:29.303 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw_notification 2024-09-14T11:34:29.303 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 javaclient 2024-09-14T11:34:29.303 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 asok 2024-09-14T11:34:29.303 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 throttle 2024-09-14T11:34:29.303 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 refs 2024-09-14T11:34:29.303 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 compressor 2024-09-14T11:34:29.303 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluestore 2024-09-14T11:34:29.303 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluefs 2024-09-14T11:34:29.303 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 bdev 2024-09-14T11:34:29.303 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 kstore 2024-09-14T11:34:29.303 INFO:tasks.workunit.client.0.smithi071.stderr: 4/ 5 rocksdb 2024-09-14T11:34:29.304 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 fuse 2024-09-14T11:34:29.304 INFO:tasks.workunit.client.0.smithi071.stderr: 2/ 5 mgr 2024-09-14T11:34:29.304 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mgrc 2024-09-14T11:34:29.304 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 dpdk 2024-09-14T11:34:29.304 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 eventtrace 2024-09-14T11:34:29.304 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 prioritycache 2024-09-14T11:34:29.304 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 test 2024-09-14T11:34:29.304 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:34:29.304 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephsqlite 2024-09-14T11:34:29.304 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:34:29.304 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore 2024-09-14T11:34:29.304 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_onode 2024-09-14T11:34:29.304 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_odata 2024-09-14T11:34:29.304 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_omap 2024-09-14T11:34:29.304 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_tm 2024-09-14T11:34:29.305 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_t 2024-09-14T11:34:29.305 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:34:29.305 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_epm 2024-09-14T11:34:29.305 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_lba 2024-09-14T11:34:29.305 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:34:29.305 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cache 2024-09-14T11:34:29.305 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_journal 2024-09-14T11:34:29.305 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_device 2024-09-14T11:34:29.305 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_backref 2024-09-14T11:34:29.305 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 alienstore 2024-09-14T11:34:29.305 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mclock 2024-09-14T11:34:29.305 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cyanstore 2024-09-14T11:34:29.305 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 ceph_exporter 2024-09-14T11:34:29.305 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 memstore 2024-09-14T11:34:29.305 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 trace 2024-09-14T11:34:29.305 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 ceph_dedup 2024-09-14T11:34:29.306 INFO:tasks.workunit.client.0.smithi071.stderr: -2/-2 (syslog threshold) 2024-09-14T11:34:29.306 INFO:tasks.workunit.client.0.smithi071.stderr: 99/99 (stderr threshold) 2024-09-14T11:34:29.306 INFO:tasks.workunit.client.0.smithi071.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:34:29.306 INFO:tasks.workunit.client.0.smithi071.stderr: 7f16a7fff640 / http_manager 2024-09-14T11:34:29.306 INFO:tasks.workunit.client.0.smithi071.stderr: 7f17367fc640 / http_manager 2024-09-14T11:34:29.306 INFO:tasks.workunit.client.0.smithi071.stderr: 7f17377fe640 / rgw_dt_lg_renew 2024-09-14T11:34:29.306 INFO:tasks.workunit.client.0.smithi071.stderr: 7f17577fe640 / ms_dispatch 2024-09-14T11:34:29.306 INFO:tasks.workunit.client.0.smithi071.stderr: 7f17697fa640 / io_context_pool 2024-09-14T11:34:29.306 INFO:tasks.workunit.client.0.smithi071.stderr: 7f176b7fe640 / ms_dispatch 2024-09-14T11:34:29.306 INFO:tasks.workunit.client.0.smithi071.stderr: 7f1772604640 / ms_dispatch 2024-09-14T11:34:29.306 INFO:tasks.workunit.client.0.smithi071.stderr: 7f1773e07640 / io_context_pool 2024-09-14T11:34:29.306 INFO:tasks.workunit.client.0.smithi071.stderr: 7f1885134640 / msgr-worker-2 2024-09-14T11:34:29.306 INFO:tasks.workunit.client.0.smithi071.stderr: 7f1885935640 / msgr-worker-1 2024-09-14T11:34:29.306 INFO:tasks.workunit.client.0.smithi071.stderr: 7f1886136640 / msgr-worker-0 2024-09-14T11:34:29.306 INFO:tasks.workunit.client.0.smithi071.stderr: 7f1886937640 / io_context_pool 2024-09-14T11:34:29.307 INFO:tasks.workunit.client.0.smithi071.stderr: 7f1887e2f9c0 / radosgw-admin 2024-09-14T11:34:29.307 INFO:tasks.workunit.client.0.smithi071.stderr: max_recent 500 2024-09-14T11:34:29.307 INFO:tasks.workunit.client.0.smithi071.stderr: max_new 1000 2024-09-14T11:34:29.307 INFO:tasks.workunit.client.0.smithi071.stderr: log_file /var/log/ceph/ceph-client.admin.142108.log 2024-09-14T11:34:29.307 INFO:tasks.workunit.client.0.smithi071.stderr:--- end dump of recent events --- 2024-09-14T11:34:29.307 INFO:tasks.workunit.client.0.smithi071.stderr:--- begin dump of recent events --- 2024-09-14T11:34:29.307 INFO:tasks.workunit.client.0.smithi071.stderr: -499> 2024-09-14T11:34:29.140+0000 7f1885134640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:29.307 INFO:tasks.workunit.client.0.smithi071.stderr: -498> 2024-09-14T11:34:29.140+0000 7f1885134640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:29.307 INFO:tasks.workunit.client.0.smithi071.stderr: -497> 2024-09-14T11:34:29.140+0000 7f1885935640 10 monclient(hunting): handle_auth_done global_id 7748 payload 274 2024-09-14T11:34:29.307 INFO:tasks.workunit.client.0.smithi071.stderr: -496> 2024-09-14T11:34:29.140+0000 7f1885935640 10 monclient: _finish_hunting 0 2024-09-14T11:34:29.307 INFO:tasks.workunit.client.0.smithi071.stderr: -495> 2024-09-14T11:34:29.140+0000 7f1885935640 1 monclient: found mon.noname-c 2024-09-14T11:34:29.307 INFO:tasks.workunit.client.0.smithi071.stderr: -494> 2024-09-14T11:34:29.140+0000 7f1885935640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:34:29.307 INFO:tasks.workunit.client.0.smithi071.stderr: -493> 2024-09-14T11:34:29.144+0000 7f1773e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:29.307 INFO:tasks.workunit.client.0.smithi071.stderr: -492> 2024-09-14T11:34:29.144+0000 7f1773e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:29.308 INFO:tasks.workunit.client.0.smithi071.stderr: -491> 2024-09-14T11:34:29.144+0000 7f1773e07640 10 monclient: dump: 2024-09-14T11:34:29.308 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:34:29.308 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:34:29.308 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.308 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.308 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:29.308 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:34:29.308 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:34:29.308 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:34:29.308 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:34:29.308 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.308 INFO:tasks.workunit.client.0.smithi071.stderr: -490> 2024-09-14T11:34:29.144+0000 7f1773e07640 10 monclient: _finish_auth 0 2024-09-14T11:34:29.308 INFO:tasks.workunit.client.0.smithi071.stderr: -489> 2024-09-14T11:34:29.144+0000 7f1773e07640 10 monclient: _check_auth_tickets 2024-09-14T11:34:29.308 INFO:tasks.workunit.client.0.smithi071.stderr: -488> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 monclient: authenticate success, global_id 7748 2024-09-14T11:34:29.309 INFO:tasks.workunit.client.0.smithi071.stderr: -487> 2024-09-14T11:34:29.144+0000 7f1773e07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:29.309 INFO:tasks.workunit.client.0.smithi071.stderr: -486> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:34:29.309 INFO:tasks.workunit.client.0.smithi071.stderr: -485> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 4 set_mon_vals no callback set 2024-09-14T11:34:29.309 INFO:tasks.workunit.client.0.smithi071.stderr: -484> 2024-09-14T11:34:29.144+0000 7f1773e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:29.309 INFO:tasks.workunit.client.0.smithi071.stderr: -483> 2024-09-14T11:34:29.144+0000 7f1773e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:29.309 INFO:tasks.workunit.client.0.smithi071.stderr: -482> 2024-09-14T11:34:29.144+0000 7f1773e07640 10 monclient: dump: 2024-09-14T11:34:29.309 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:34:29.309 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:34:29.309 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.309 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.309 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:29.309 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:34:29.309 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:34:29.309 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:34:29.309 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:34:29.310 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.310 INFO:tasks.workunit.client.0.smithi071.stderr: -481> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient: shutdown 2024-09-14T11:34:29.310 INFO:tasks.workunit.client.0.smithi071.stderr: -480> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 asok(0x5595eb0bcd90) unregister_commands rotate-key 2024-09-14T11:34:29.310 INFO:tasks.workunit.client.0.smithi071.stderr: -479> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient: build_initial_monmap 2024-09-14T11:34:29.310 INFO:tasks.workunit.client.0.smithi071.stderr: -478> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 1 build_initial for_mkfs: 0 2024-09-14T11:34:29.310 INFO:tasks.workunit.client.0.smithi071.stderr: -477> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient: monmap: 2024-09-14T11:34:29.310 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:34:29.310 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:29.310 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:34:29.310 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:34:29.310 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:29.310 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:34:29.310 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:34:29.310 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:34:29.310 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:34:29.311 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.311 INFO:tasks.workunit.client.0.smithi071.stderr: -476> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2f8d30) adding auth protocol: cephx 2024-09-14T11:34:29.311 INFO:tasks.workunit.client.0.smithi071.stderr: -475> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2f8d30) adding auth protocol: cephx 2024-09-14T11:34:29.311 INFO:tasks.workunit.client.0.smithi071.stderr: -474> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2f8d30) adding auth protocol: cephx 2024-09-14T11:34:29.311 INFO:tasks.workunit.client.0.smithi071.stderr: -473> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2f8d30) adding con mode: secure 2024-09-14T11:34:29.311 INFO:tasks.workunit.client.0.smithi071.stderr: -472> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2f8d30) adding con mode: crc 2024-09-14T11:34:29.311 INFO:tasks.workunit.client.0.smithi071.stderr: -471> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2f8d30) adding con mode: secure 2024-09-14T11:34:29.311 INFO:tasks.workunit.client.0.smithi071.stderr: -470> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2f8d30) adding con mode: crc 2024-09-14T11:34:29.311 INFO:tasks.workunit.client.0.smithi071.stderr: -469> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2f8d30) adding con mode: secure 2024-09-14T11:34:29.311 INFO:tasks.workunit.client.0.smithi071.stderr: -468> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2f8d30) adding con mode: crc 2024-09-14T11:34:29.311 INFO:tasks.workunit.client.0.smithi071.stderr: -467> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2f8d30) adding con mode: crc 2024-09-14T11:34:29.311 INFO:tasks.workunit.client.0.smithi071.stderr: -466> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2f8d30) adding con mode: secure 2024-09-14T11:34:29.311 INFO:tasks.workunit.client.0.smithi071.stderr: -465> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2f8d30) adding con mode: crc 2024-09-14T11:34:29.311 INFO:tasks.workunit.client.0.smithi071.stderr: -464> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2f8d30) adding con mode: secure 2024-09-14T11:34:29.312 INFO:tasks.workunit.client.0.smithi071.stderr: -463> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2f8d30) adding con mode: crc 2024-09-14T11:34:29.312 INFO:tasks.workunit.client.0.smithi071.stderr: -462> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2f8d30) adding con mode: secure 2024-09-14T11:34:29.312 INFO:tasks.workunit.client.0.smithi071.stderr: -461> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:29.312 INFO:tasks.workunit.client.0.smithi071.stderr: -460> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 1 librados: starting msgr at 2024-09-14T11:34:29.312 INFO:tasks.workunit.client.0.smithi071.stderr: -459> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 1 librados: starting objecter 2024-09-14T11:34:29.312 INFO:tasks.workunit.client.0.smithi071.stderr: -458> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 asok(0x5595eb0bcd90) register_command objecter_requests hook 0x5595eb2f9500 2024-09-14T11:34:29.312 INFO:tasks.workunit.client.0.smithi071.stderr: -457> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 1 librados: setting wanted keys 2024-09-14T11:34:29.312 INFO:tasks.workunit.client.0.smithi071.stderr: -456> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 1 librados: calling monclient init 2024-09-14T11:34:29.312 INFO:tasks.workunit.client.0.smithi071.stderr: -455> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient: init 2024-09-14T11:34:29.312 INFO:tasks.workunit.client.0.smithi071.stderr: -454> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2c7f90) adding auth protocol: cephx 2024-09-14T11:34:29.312 INFO:tasks.workunit.client.0.smithi071.stderr: -453> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2c7f90) adding auth protocol: cephx 2024-09-14T11:34:29.312 INFO:tasks.workunit.client.0.smithi071.stderr: -452> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2c7f90) adding auth protocol: cephx 2024-09-14T11:34:29.312 INFO:tasks.workunit.client.0.smithi071.stderr: -451> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2c7f90) adding con mode: secure 2024-09-14T11:34:29.312 INFO:tasks.workunit.client.0.smithi071.stderr: -450> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2c7f90) adding con mode: crc 2024-09-14T11:34:29.313 INFO:tasks.workunit.client.0.smithi071.stderr: -449> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2c7f90) adding con mode: secure 2024-09-14T11:34:29.313 INFO:tasks.workunit.client.0.smithi071.stderr: -448> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2c7f90) adding con mode: crc 2024-09-14T11:34:29.313 INFO:tasks.workunit.client.0.smithi071.stderr: -447> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2c7f90) adding con mode: secure 2024-09-14T11:34:29.313 INFO:tasks.workunit.client.0.smithi071.stderr: -446> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2c7f90) adding con mode: crc 2024-09-14T11:34:29.313 INFO:tasks.workunit.client.0.smithi071.stderr: -445> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2c7f90) adding con mode: crc 2024-09-14T11:34:29.313 INFO:tasks.workunit.client.0.smithi071.stderr: -444> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2c7f90) adding con mode: secure 2024-09-14T11:34:29.313 INFO:tasks.workunit.client.0.smithi071.stderr: -443> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2c7f90) adding con mode: crc 2024-09-14T11:34:29.313 INFO:tasks.workunit.client.0.smithi071.stderr: -442> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2c7f90) adding con mode: secure 2024-09-14T11:34:29.313 INFO:tasks.workunit.client.0.smithi071.stderr: -441> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2c7f90) adding con mode: crc 2024-09-14T11:34:29.313 INFO:tasks.workunit.client.0.smithi071.stderr: -440> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb2c7f90) adding con mode: secure 2024-09-14T11:34:29.313 INFO:tasks.workunit.client.0.smithi071.stderr: -439> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:29.313 INFO:tasks.workunit.client.0.smithi071.stderr: -438> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:29.313 INFO:tasks.workunit.client.0.smithi071.stderr: -437> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 asok(0x5595eb0bcd90) register_command rotate-key hook 0x5595eb2c80d8 2024-09-14T11:34:29.314 INFO:tasks.workunit.client.0.smithi071.stderr: -436> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:34:29.314 INFO:tasks.workunit.client.0.smithi071.stderr: -435> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:34:29.314 INFO:tasks.workunit.client.0.smithi071.stderr: -434> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient(hunting): picked mon.noname-a con 0x5595eb2f87a0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:34:29.314 INFO:tasks.workunit.client.0.smithi071.stderr: -433> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient(hunting): picked mon.noname-c con 0x7f1870003c70 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:34:29.314 INFO:tasks.workunit.client.0.smithi071.stderr: -432> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient(hunting): picked mon.noname-b con 0x5595eb2f3130 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:34:29.314 INFO:tasks.workunit.client.0.smithi071.stderr: -431> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:29.314 INFO:tasks.workunit.client.0.smithi071.stderr: -430> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:29.314 INFO:tasks.workunit.client.0.smithi071.stderr: -429> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:29.314 INFO:tasks.workunit.client.0.smithi071.stderr: -428> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:34:29.314 INFO:tasks.workunit.client.0.smithi071.stderr: -427> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient(hunting): authenticate will time out at 2481.266383s 2024-09-14T11:34:29.314 INFO:tasks.workunit.client.0.smithi071.stderr: -426> 2024-09-14T11:34:29.144+0000 7f1885134640 10 monclient(hunting): get_auth_request con 0x7f1870003c70 auth_method 0 2024-09-14T11:34:29.314 INFO:tasks.workunit.client.0.smithi071.stderr: -425> 2024-09-14T11:34:29.144+0000 7f1885134640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:29.314 INFO:tasks.workunit.client.0.smithi071.stderr: -424> 2024-09-14T11:34:29.144+0000 7f1885134640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:29.314 INFO:tasks.workunit.client.0.smithi071.stderr: -423> 2024-09-14T11:34:29.144+0000 7f1885134640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:29.314 INFO:tasks.workunit.client.0.smithi071.stderr: -422> 2024-09-14T11:34:29.144+0000 7f1885935640 10 monclient(hunting): get_auth_request con 0x5595eb2f87a0 auth_method 0 2024-09-14T11:34:29.315 INFO:tasks.workunit.client.0.smithi071.stderr: -421> 2024-09-14T11:34:29.144+0000 7f1885935640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:29.315 INFO:tasks.workunit.client.0.smithi071.stderr: -420> 2024-09-14T11:34:29.144+0000 7f1885935640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:29.315 INFO:tasks.workunit.client.0.smithi071.stderr: -419> 2024-09-14T11:34:29.144+0000 7f1885935640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:29.315 INFO:tasks.workunit.client.0.smithi071.stderr: -418> 2024-09-14T11:34:29.144+0000 7f1885134640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:29.315 INFO:tasks.workunit.client.0.smithi071.stderr: -417> 2024-09-14T11:34:29.144+0000 7f1885134640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:29.315 INFO:tasks.workunit.client.0.smithi071.stderr: -416> 2024-09-14T11:34:29.144+0000 7f1885134640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:29.315 INFO:tasks.workunit.client.0.smithi071.stderr: -415> 2024-09-14T11:34:29.144+0000 7f1885935640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:29.315 INFO:tasks.workunit.client.0.smithi071.stderr: -414> 2024-09-14T11:34:29.144+0000 7f1885935640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:29.315 INFO:tasks.workunit.client.0.smithi071.stderr: -413> 2024-09-14T11:34:29.144+0000 7f1885935640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:29.315 INFO:tasks.workunit.client.0.smithi071.stderr: -412> 2024-09-14T11:34:29.144+0000 7f1885134640 10 monclient(hunting): handle_auth_done global_id 7751 payload 824 2024-09-14T11:34:29.315 INFO:tasks.workunit.client.0.smithi071.stderr: -411> 2024-09-14T11:34:29.144+0000 7f1885134640 10 monclient: _finish_hunting 0 2024-09-14T11:34:29.315 INFO:tasks.workunit.client.0.smithi071.stderr: -410> 2024-09-14T11:34:29.144+0000 7f1885134640 1 monclient: found mon.noname-c 2024-09-14T11:34:29.315 INFO:tasks.workunit.client.0.smithi071.stderr: -409> 2024-09-14T11:34:29.144+0000 7f1885134640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:34:29.315 INFO:tasks.workunit.client.0.smithi071.stderr: -408> 2024-09-14T11:34:29.144+0000 7f1772604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:29.315 INFO:tasks.workunit.client.0.smithi071.stderr: -407> 2024-09-14T11:34:29.144+0000 7f1772604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:29.316 INFO:tasks.workunit.client.0.smithi071.stderr: -406> 2024-09-14T11:34:29.144+0000 7f1772604640 10 monclient: dump: 2024-09-14T11:34:29.316 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:34:29.316 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:34:29.316 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.316 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.316 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:29.316 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:34:29.316 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:34:29.316 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:34:29.316 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:34:29.316 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.316 INFO:tasks.workunit.client.0.smithi071.stderr: -405> 2024-09-14T11:34:29.144+0000 7f1772604640 10 monclient: _finish_auth 0 2024-09-14T11:34:29.316 INFO:tasks.workunit.client.0.smithi071.stderr: -404> 2024-09-14T11:34:29.144+0000 7f1772604640 10 monclient: _check_auth_tickets 2024-09-14T11:34:29.316 INFO:tasks.workunit.client.0.smithi071.stderr: -403> 2024-09-14T11:34:29.144+0000 7f1772604640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:29.317 INFO:tasks.workunit.client.0.smithi071.stderr: -402> 2024-09-14T11:34:29.144+0000 7f1772604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:29.317 INFO:tasks.workunit.client.0.smithi071.stderr: -401> 2024-09-14T11:34:29.144+0000 7f1772604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:29.317 INFO:tasks.workunit.client.0.smithi071.stderr: -400> 2024-09-14T11:34:29.144+0000 7f1772604640 10 monclient: dump: 2024-09-14T11:34:29.317 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:34:29.317 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:34:29.317 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.317 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.317 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:29.317 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:34:29.317 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:34:29.317 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:34:29.317 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:34:29.317 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.317 INFO:tasks.workunit.client.0.smithi071.stderr: -399> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 5 monclient: authenticate success, global_id 7751 2024-09-14T11:34:29.318 INFO:tasks.workunit.client.0.smithi071.stderr: -398> 2024-09-14T11:34:29.144+0000 7f1773e07640 4 set_mon_vals no callback set 2024-09-14T11:34:29.318 INFO:tasks.workunit.client.0.smithi071.stderr: -397> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient: _renew_subs 2024-09-14T11:34:29.318 INFO:tasks.workunit.client.0.smithi071.stderr: -396> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:34:29.318 INFO:tasks.workunit.client.0.smithi071.stderr: -395> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient: _renew_subs 2024-09-14T11:34:29.318 INFO:tasks.workunit.client.0.smithi071.stderr: -394> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:34:29.318 INFO:tasks.workunit.client.0.smithi071.stderr: -393> 2024-09-14T11:34:29.144+0000 7f1887e2f9c0 1 librados: init done 2024-09-14T11:34:29.318 INFO:tasks.workunit.client.0.smithi071.stderr: -392> 2024-09-14T11:34:29.148+0000 7f1772604640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:29.318 INFO:tasks.workunit.client.0.smithi071.stderr: -391> 2024-09-14T11:34:29.148+0000 7f1772604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:34:29.318 INFO:tasks.workunit.client.0.smithi071.stderr: -390> 2024-09-14T11:34:29.148+0000 7f1772604640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:34:29.318 INFO:tasks.workunit.client.0.smithi071.stderr: -389> 2024-09-14T11:34:29.148+0000 7f1885935640 10 monclient: get_auth_request con 0x7f176c0718a0 auth_method 0 2024-09-14T11:34:29.318 INFO:tasks.workunit.client.0.smithi071.stderr: -388> 2024-09-14T11:34:29.148+0000 7f1886136640 10 monclient: get_auth_request con 0x5595eb3107e0 auth_method 0 2024-09-14T11:34:29.318 INFO:tasks.workunit.client.0.smithi071.stderr: -387> 2024-09-14T11:34:29.148+0000 7f1885935640 10 monclient: get_auth_request con 0x5595eb313b30 auth_method 0 2024-09-14T11:34:29.318 INFO:tasks.workunit.client.0.smithi071.stderr: -386> 2024-09-14T11:34:29.152+0000 7f1885134640 10 monclient: get_auth_request con 0x5595eb317e90 auth_method 0 2024-09-14T11:34:29.318 INFO:tasks.workunit.client.0.smithi071.stderr: -385> 2024-09-14T11:34:29.152+0000 7f1886136640 10 monclient: get_auth_request con 0x5595eb3173e0 auth_method 0 2024-09-14T11:34:29.318 INFO:tasks.workunit.client.0.smithi071.stderr: -384> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 10 monclient: build_initial_monmap 2024-09-14T11:34:29.319 INFO:tasks.workunit.client.0.smithi071.stderr: -383> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 1 build_initial for_mkfs: 0 2024-09-14T11:34:29.319 INFO:tasks.workunit.client.0.smithi071.stderr: -382> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 10 monclient: monmap: 2024-09-14T11:34:29.319 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:34:29.319 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:29.319 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:34:29.319 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:34:29.319 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:29.319 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:34:29.319 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:34:29.319 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:34:29.319 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:34:29.319 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.319 INFO:tasks.workunit.client.0.smithi071.stderr: -381> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31ffe0) adding auth protocol: cephx 2024-09-14T11:34:29.319 INFO:tasks.workunit.client.0.smithi071.stderr: -380> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31ffe0) adding auth protocol: cephx 2024-09-14T11:34:29.319 INFO:tasks.workunit.client.0.smithi071.stderr: -379> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31ffe0) adding auth protocol: cephx 2024-09-14T11:34:29.320 INFO:tasks.workunit.client.0.smithi071.stderr: -378> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31ffe0) adding con mode: secure 2024-09-14T11:34:29.320 INFO:tasks.workunit.client.0.smithi071.stderr: -377> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31ffe0) adding con mode: crc 2024-09-14T11:34:29.320 INFO:tasks.workunit.client.0.smithi071.stderr: -376> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31ffe0) adding con mode: secure 2024-09-14T11:34:29.320 INFO:tasks.workunit.client.0.smithi071.stderr: -375> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31ffe0) adding con mode: crc 2024-09-14T11:34:29.320 INFO:tasks.workunit.client.0.smithi071.stderr: -374> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31ffe0) adding con mode: secure 2024-09-14T11:34:29.320 INFO:tasks.workunit.client.0.smithi071.stderr: -373> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31ffe0) adding con mode: crc 2024-09-14T11:34:29.320 INFO:tasks.workunit.client.0.smithi071.stderr: -372> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31ffe0) adding con mode: crc 2024-09-14T11:34:29.320 INFO:tasks.workunit.client.0.smithi071.stderr: -371> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31ffe0) adding con mode: secure 2024-09-14T11:34:29.320 INFO:tasks.workunit.client.0.smithi071.stderr: -370> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31ffe0) adding con mode: crc 2024-09-14T11:34:29.320 INFO:tasks.workunit.client.0.smithi071.stderr: -369> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31ffe0) adding con mode: secure 2024-09-14T11:34:29.320 INFO:tasks.workunit.client.0.smithi071.stderr: -368> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31ffe0) adding con mode: crc 2024-09-14T11:34:29.320 INFO:tasks.workunit.client.0.smithi071.stderr: -367> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31ffe0) adding con mode: secure 2024-09-14T11:34:29.320 INFO:tasks.workunit.client.0.smithi071.stderr: -366> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:29.320 INFO:tasks.workunit.client.0.smithi071.stderr: -365> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 asok(0x5595eb0bcd90) register_command objecter_requests cmddesc objecter_requests hook 0x5595eb323810 EEXIST 2024-09-14T11:34:29.321 INFO:tasks.workunit.client.0.smithi071.stderr: -364> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 10 monclient: init 2024-09-14T11:34:29.321 INFO:tasks.workunit.client.0.smithi071.stderr: -363> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31eec8) adding auth protocol: cephx 2024-09-14T11:34:29.321 INFO:tasks.workunit.client.0.smithi071.stderr: -362> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31eec8) adding auth protocol: cephx 2024-09-14T11:34:29.321 INFO:tasks.workunit.client.0.smithi071.stderr: -361> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31eec8) adding auth protocol: cephx 2024-09-14T11:34:29.321 INFO:tasks.workunit.client.0.smithi071.stderr: -360> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31eec8) adding con mode: secure 2024-09-14T11:34:29.321 INFO:tasks.workunit.client.0.smithi071.stderr: -359> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31eec8) adding con mode: crc 2024-09-14T11:34:29.321 INFO:tasks.workunit.client.0.smithi071.stderr: -358> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31eec8) adding con mode: secure 2024-09-14T11:34:29.321 INFO:tasks.workunit.client.0.smithi071.stderr: -357> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31eec8) adding con mode: crc 2024-09-14T11:34:29.321 INFO:tasks.workunit.client.0.smithi071.stderr: -356> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31eec8) adding con mode: secure 2024-09-14T11:34:29.321 INFO:tasks.workunit.client.0.smithi071.stderr: -355> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31eec8) adding con mode: crc 2024-09-14T11:34:29.321 INFO:tasks.workunit.client.0.smithi071.stderr: -354> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31eec8) adding con mode: crc 2024-09-14T11:34:29.321 INFO:tasks.workunit.client.0.smithi071.stderr: -353> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31eec8) adding con mode: secure 2024-09-14T11:34:29.321 INFO:tasks.workunit.client.0.smithi071.stderr: -352> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31eec8) adding con mode: crc 2024-09-14T11:34:29.322 INFO:tasks.workunit.client.0.smithi071.stderr: -351> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31eec8) adding con mode: secure 2024-09-14T11:34:29.322 INFO:tasks.workunit.client.0.smithi071.stderr: -350> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31eec8) adding con mode: crc 2024-09-14T11:34:29.322 INFO:tasks.workunit.client.0.smithi071.stderr: -349> 2024-09-14T11:34:29.152+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb31eec8) adding con mode: secure 2024-09-14T11:34:29.322 INFO:tasks.workunit.client.0.smithi071.stderr: -348> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:29.322 INFO:tasks.workunit.client.0.smithi071.stderr: -347> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:29.322 INFO:tasks.workunit.client.0.smithi071.stderr: -346> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 5 asok(0x5595eb0bcd90) register_command rotate-key cmddesc rotate-key hook 0x5595eb31f010 EEXIST 2024-09-14T11:34:29.322 INFO:tasks.workunit.client.0.smithi071.stderr: -345> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:34:29.322 INFO:tasks.workunit.client.0.smithi071.stderr: -344> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:34:29.322 INFO:tasks.workunit.client.0.smithi071.stderr: -343> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 10 monclient(hunting): picked mon.noname-a con 0x5595eb3479c0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:34:29.322 INFO:tasks.workunit.client.0.smithi071.stderr: -342> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 10 monclient(hunting): picked mon.noname-b con 0x5595eb3472f0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:34:29.322 INFO:tasks.workunit.client.0.smithi071.stderr: -341> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 10 monclient(hunting): picked mon.noname-c con 0x5595eb345cd0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:34:29.322 INFO:tasks.workunit.client.0.smithi071.stderr: -340> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:29.322 INFO:tasks.workunit.client.0.smithi071.stderr: -339> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:29.322 INFO:tasks.workunit.client.0.smithi071.stderr: -338> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:29.323 INFO:tasks.workunit.client.0.smithi071.stderr: -337> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:34:29.323 INFO:tasks.workunit.client.0.smithi071.stderr: -336> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 10 monclient(hunting): authenticate will time out at 2481.276476s 2024-09-14T11:34:29.323 INFO:tasks.workunit.client.0.smithi071.stderr: -335> 2024-09-14T11:34:29.156+0000 7f1885935640 10 monclient(hunting): get_auth_request con 0x5595eb345cd0 auth_method 0 2024-09-14T11:34:29.323 INFO:tasks.workunit.client.0.smithi071.stderr: -334> 2024-09-14T11:34:29.156+0000 7f1885935640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:29.323 INFO:tasks.workunit.client.0.smithi071.stderr: -333> 2024-09-14T11:34:29.156+0000 7f1885935640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:29.323 INFO:tasks.workunit.client.0.smithi071.stderr: -332> 2024-09-14T11:34:29.156+0000 7f1885935640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:29.323 INFO:tasks.workunit.client.0.smithi071.stderr: -331> 2024-09-14T11:34:29.156+0000 7f1885134640 10 monclient(hunting): get_auth_request con 0x5595eb3479c0 auth_method 0 2024-09-14T11:34:29.323 INFO:tasks.workunit.client.0.smithi071.stderr: -330> 2024-09-14T11:34:29.156+0000 7f1885134640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:29.323 INFO:tasks.workunit.client.0.smithi071.stderr: -329> 2024-09-14T11:34:29.156+0000 7f1885134640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:29.323 INFO:tasks.workunit.client.0.smithi071.stderr: -328> 2024-09-14T11:34:29.156+0000 7f1885134640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:29.323 INFO:tasks.workunit.client.0.smithi071.stderr: -327> 2024-09-14T11:34:29.156+0000 7f1885935640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:29.323 INFO:tasks.workunit.client.0.smithi071.stderr: -326> 2024-09-14T11:34:29.156+0000 7f1885935640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:29.323 INFO:tasks.workunit.client.0.smithi071.stderr: -325> 2024-09-14T11:34:29.156+0000 7f1885935640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:29.323 INFO:tasks.workunit.client.0.smithi071.stderr: -324> 2024-09-14T11:34:29.156+0000 7f1885134640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:29.323 INFO:tasks.workunit.client.0.smithi071.stderr: -323> 2024-09-14T11:34:29.156+0000 7f1885134640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:29.323 INFO:tasks.workunit.client.0.smithi071.stderr: -322> 2024-09-14T11:34:29.156+0000 7f1885134640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:29.324 INFO:tasks.workunit.client.0.smithi071.stderr: -321> 2024-09-14T11:34:29.156+0000 7f1886136640 10 monclient(hunting): get_auth_request con 0x5595eb3472f0 auth_method 0 2024-09-14T11:34:29.324 INFO:tasks.workunit.client.0.smithi071.stderr: -320> 2024-09-14T11:34:29.156+0000 7f1886136640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:29.324 INFO:tasks.workunit.client.0.smithi071.stderr: -319> 2024-09-14T11:34:29.156+0000 7f1886136640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:29.324 INFO:tasks.workunit.client.0.smithi071.stderr: -318> 2024-09-14T11:34:29.156+0000 7f1886136640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:29.324 INFO:tasks.workunit.client.0.smithi071.stderr: -317> 2024-09-14T11:34:29.156+0000 7f1885935640 10 monclient(hunting): handle_auth_done global_id 7754 payload 824 2024-09-14T11:34:29.324 INFO:tasks.workunit.client.0.smithi071.stderr: -316> 2024-09-14T11:34:29.156+0000 7f1885935640 10 monclient: _finish_hunting 0 2024-09-14T11:34:29.324 INFO:tasks.workunit.client.0.smithi071.stderr: -315> 2024-09-14T11:34:29.156+0000 7f1885935640 1 monclient: found mon.noname-c 2024-09-14T11:34:29.324 INFO:tasks.workunit.client.0.smithi071.stderr: -314> 2024-09-14T11:34:29.156+0000 7f1885935640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:34:29.324 INFO:tasks.workunit.client.0.smithi071.stderr: -313> 2024-09-14T11:34:29.156+0000 7f176b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:29.324 INFO:tasks.workunit.client.0.smithi071.stderr: -312> 2024-09-14T11:34:29.156+0000 7f176b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:29.324 INFO:tasks.workunit.client.0.smithi071.stderr: -311> 2024-09-14T11:34:29.156+0000 7f176b7fe640 10 monclient: dump: 2024-09-14T11:34:29.324 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:34:29.324 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:34:29.324 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.324 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.325 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:29.325 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:34:29.325 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:34:29.325 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:34:29.325 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:34:29.325 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.325 INFO:tasks.workunit.client.0.smithi071.stderr: -310> 2024-09-14T11:34:29.156+0000 7f176b7fe640 10 monclient: _finish_auth 0 2024-09-14T11:34:29.325 INFO:tasks.workunit.client.0.smithi071.stderr: -309> 2024-09-14T11:34:29.156+0000 7f176b7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:34:29.325 INFO:tasks.workunit.client.0.smithi071.stderr: -308> 2024-09-14T11:34:29.156+0000 7f176b7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:29.325 INFO:tasks.workunit.client.0.smithi071.stderr: -307> 2024-09-14T11:34:29.156+0000 7f176b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:29.325 INFO:tasks.workunit.client.0.smithi071.stderr: -306> 2024-09-14T11:34:29.156+0000 7f176b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:29.325 INFO:tasks.workunit.client.0.smithi071.stderr: -305> 2024-09-14T11:34:29.156+0000 7f176b7fe640 10 monclient: dump: 2024-09-14T11:34:29.325 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:34:29.325 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:34:29.325 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.325 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.326 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:29.326 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:34:29.326 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:34:29.326 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:34:29.326 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:34:29.326 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.326 INFO:tasks.workunit.client.0.smithi071.stderr: -304> 2024-09-14T11:34:29.156+0000 7f1886937640 4 set_mon_vals no callback set 2024-09-14T11:34:29.326 INFO:tasks.workunit.client.0.smithi071.stderr: -303> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 5 monclient: authenticate success, global_id 7754 2024-09-14T11:34:29.326 INFO:tasks.workunit.client.0.smithi071.stderr: -302> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 10 monclient: _renew_subs 2024-09-14T11:34:29.326 INFO:tasks.workunit.client.0.smithi071.stderr: -301> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:34:29.326 INFO:tasks.workunit.client.0.smithi071.stderr: -300> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 10 monclient: _renew_subs 2024-09-14T11:34:29.326 INFO:tasks.workunit.client.0.smithi071.stderr: -299> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:34:29.326 INFO:tasks.workunit.client.0.smithi071.stderr: -298> 2024-09-14T11:34:29.156+0000 7f176b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:29.326 INFO:tasks.workunit.client.0.smithi071.stderr: -297> 2024-09-14T11:34:29.156+0000 7f176b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:34:29.326 INFO:tasks.workunit.client.0.smithi071.stderr: -296> 2024-09-14T11:34:29.156+0000 7f176b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:34:29.327 INFO:tasks.workunit.client.0.smithi071.stderr: -295> 2024-09-14T11:34:29.156+0000 7f1885134640 10 monclient: get_auth_request con 0x7f17600717b0 auth_method 0 2024-09-14T11:34:29.327 INFO:tasks.workunit.client.0.smithi071.stderr: -294> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 10 monclient: get_monmap_and_config 2024-09-14T11:34:29.327 INFO:tasks.workunit.client.0.smithi071.stderr: -293> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 10 monclient: build_initial_monmap 2024-09-14T11:34:29.327 INFO:tasks.workunit.client.0.smithi071.stderr: -292> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 1 build_initial for_mkfs: 0 2024-09-14T11:34:29.327 INFO:tasks.workunit.client.0.smithi071.stderr: -291> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 10 monclient: monmap: 2024-09-14T11:34:29.327 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:34:29.327 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:29.327 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:34:29.327 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:34:29.327 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:29.327 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:34:29.327 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:34:29.327 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:34:29.327 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:34:29.327 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.328 INFO:tasks.workunit.client.0.smithi071.stderr: -290> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb367310) adding auth protocol: cephx 2024-09-14T11:34:29.328 INFO:tasks.workunit.client.0.smithi071.stderr: -289> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb367310) adding auth protocol: cephx 2024-09-14T11:34:29.328 INFO:tasks.workunit.client.0.smithi071.stderr: -288> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb367310) adding auth protocol: cephx 2024-09-14T11:34:29.328 INFO:tasks.workunit.client.0.smithi071.stderr: -287> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb367310) adding con mode: secure 2024-09-14T11:34:29.328 INFO:tasks.workunit.client.0.smithi071.stderr: -286> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb367310) adding con mode: crc 2024-09-14T11:34:29.328 INFO:tasks.workunit.client.0.smithi071.stderr: -285> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb367310) adding con mode: secure 2024-09-14T11:34:29.328 INFO:tasks.workunit.client.0.smithi071.stderr: -284> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb367310) adding con mode: crc 2024-09-14T11:34:29.328 INFO:tasks.workunit.client.0.smithi071.stderr: -283> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb367310) adding con mode: secure 2024-09-14T11:34:29.328 INFO:tasks.workunit.client.0.smithi071.stderr: -282> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb367310) adding con mode: crc 2024-09-14T11:34:29.328 INFO:tasks.workunit.client.0.smithi071.stderr: -281> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb367310) adding con mode: crc 2024-09-14T11:34:29.328 INFO:tasks.workunit.client.0.smithi071.stderr: -280> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb367310) adding con mode: secure 2024-09-14T11:34:29.328 INFO:tasks.workunit.client.0.smithi071.stderr: -279> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb367310) adding con mode: crc 2024-09-14T11:34:29.328 INFO:tasks.workunit.client.0.smithi071.stderr: -278> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb367310) adding con mode: secure 2024-09-14T11:34:29.328 INFO:tasks.workunit.client.0.smithi071.stderr: -277> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb367310) adding con mode: crc 2024-09-14T11:34:29.328 INFO:tasks.workunit.client.0.smithi071.stderr: -276> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb367310) adding con mode: secure 2024-09-14T11:34:29.329 INFO:tasks.workunit.client.0.smithi071.stderr: -275> 2024-09-14T11:34:29.156+0000 7f1887e2f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:29.329 INFO:tasks.workunit.client.0.smithi071.stderr: -274> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient: init 2024-09-14T11:34:29.329 INFO:tasks.workunit.client.0.smithi071.stderr: -273> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a380) adding auth protocol: cephx 2024-09-14T11:34:29.329 INFO:tasks.workunit.client.0.smithi071.stderr: -272> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a380) adding auth protocol: cephx 2024-09-14T11:34:29.329 INFO:tasks.workunit.client.0.smithi071.stderr: -271> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a380) adding auth protocol: cephx 2024-09-14T11:34:29.329 INFO:tasks.workunit.client.0.smithi071.stderr: -270> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a380) adding con mode: secure 2024-09-14T11:34:29.329 INFO:tasks.workunit.client.0.smithi071.stderr: -269> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a380) adding con mode: crc 2024-09-14T11:34:29.329 INFO:tasks.workunit.client.0.smithi071.stderr: -268> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a380) adding con mode: secure 2024-09-14T11:34:29.329 INFO:tasks.workunit.client.0.smithi071.stderr: -267> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a380) adding con mode: crc 2024-09-14T11:34:29.329 INFO:tasks.workunit.client.0.smithi071.stderr: -266> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a380) adding con mode: secure 2024-09-14T11:34:29.329 INFO:tasks.workunit.client.0.smithi071.stderr: -265> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a380) adding con mode: crc 2024-09-14T11:34:29.329 INFO:tasks.workunit.client.0.smithi071.stderr: -264> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a380) adding con mode: crc 2024-09-14T11:34:29.329 INFO:tasks.workunit.client.0.smithi071.stderr: -263> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a380) adding con mode: secure 2024-09-14T11:34:29.329 INFO:tasks.workunit.client.0.smithi071.stderr: -262> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a380) adding con mode: crc 2024-09-14T11:34:29.329 INFO:tasks.workunit.client.0.smithi071.stderr: -261> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a380) adding con mode: secure 2024-09-14T11:34:29.330 INFO:tasks.workunit.client.0.smithi071.stderr: -260> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a380) adding con mode: crc 2024-09-14T11:34:29.330 INFO:tasks.workunit.client.0.smithi071.stderr: -259> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a380) adding con mode: secure 2024-09-14T11:34:29.330 INFO:tasks.workunit.client.0.smithi071.stderr: -258> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:29.330 INFO:tasks.workunit.client.0.smithi071.stderr: -257> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:29.330 INFO:tasks.workunit.client.0.smithi071.stderr: -256> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 asok(0x5595eb0bcd90) register_command rotate-key cmddesc rotate-key hook 0x7fff7d79a4c8 EEXIST 2024-09-14T11:34:29.330 INFO:tasks.workunit.client.0.smithi071.stderr: -255> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:34:29.330 INFO:tasks.workunit.client.0.smithi071.stderr: -254> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:34:29.330 INFO:tasks.workunit.client.0.smithi071.stderr: -253> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient(hunting): picked mon.noname-c con 0x5595eb39b550 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:34:29.330 INFO:tasks.workunit.client.0.smithi071.stderr: -252> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient(hunting): picked mon.noname-a con 0x5595eb39b930 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:34:29.330 INFO:tasks.workunit.client.0.smithi071.stderr: -251> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient(hunting): picked mon.noname-b con 0x5595eb3957c0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:34:29.330 INFO:tasks.workunit.client.0.smithi071.stderr: -250> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:29.330 INFO:tasks.workunit.client.0.smithi071.stderr: -249> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:29.330 INFO:tasks.workunit.client.0.smithi071.stderr: -248> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:29.330 INFO:tasks.workunit.client.0.smithi071.stderr: -247> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:34:29.330 INFO:tasks.workunit.client.0.smithi071.stderr: -246> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient(hunting): authenticate will time out at 2481.280673s 2024-09-14T11:34:29.330 INFO:tasks.workunit.client.0.smithi071.stderr: -245> 2024-09-14T11:34:29.160+0000 7f1885134640 10 monclient(hunting): get_auth_request con 0x5595eb39b550 auth_method 0 2024-09-14T11:34:29.331 INFO:tasks.workunit.client.0.smithi071.stderr: -244> 2024-09-14T11:34:29.160+0000 7f1885134640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:29.331 INFO:tasks.workunit.client.0.smithi071.stderr: -243> 2024-09-14T11:34:29.160+0000 7f1885134640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:29.331 INFO:tasks.workunit.client.0.smithi071.stderr: -242> 2024-09-14T11:34:29.160+0000 7f1885134640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:29.331 INFO:tasks.workunit.client.0.smithi071.stderr: -241> 2024-09-14T11:34:29.160+0000 7f1886136640 10 monclient(hunting): get_auth_request con 0x5595eb39b930 auth_method 0 2024-09-14T11:34:29.331 INFO:tasks.workunit.client.0.smithi071.stderr: -240> 2024-09-14T11:34:29.160+0000 7f1886136640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:29.331 INFO:tasks.workunit.client.0.smithi071.stderr: -239> 2024-09-14T11:34:29.160+0000 7f1886136640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:29.331 INFO:tasks.workunit.client.0.smithi071.stderr: -238> 2024-09-14T11:34:29.160+0000 7f1886136640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:29.331 INFO:tasks.workunit.client.0.smithi071.stderr: -237> 2024-09-14T11:34:29.160+0000 7f1885134640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:29.331 INFO:tasks.workunit.client.0.smithi071.stderr: -236> 2024-09-14T11:34:29.160+0000 7f1885134640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:29.331 INFO:tasks.workunit.client.0.smithi071.stderr: -235> 2024-09-14T11:34:29.160+0000 7f1885134640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:29.331 INFO:tasks.workunit.client.0.smithi071.stderr: -234> 2024-09-14T11:34:29.160+0000 7f1886136640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:29.331 INFO:tasks.workunit.client.0.smithi071.stderr: -233> 2024-09-14T11:34:29.160+0000 7f1886136640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:29.331 INFO:tasks.workunit.client.0.smithi071.stderr: -232> 2024-09-14T11:34:29.160+0000 7f1886136640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:29.331 INFO:tasks.workunit.client.0.smithi071.stderr: -231> 2024-09-14T11:34:29.160+0000 7f1885134640 10 monclient(hunting): handle_auth_done global_id 7757 payload 274 2024-09-14T11:34:29.331 INFO:tasks.workunit.client.0.smithi071.stderr: -230> 2024-09-14T11:34:29.160+0000 7f1885134640 10 monclient: _finish_hunting 0 2024-09-14T11:34:29.332 INFO:tasks.workunit.client.0.smithi071.stderr: -229> 2024-09-14T11:34:29.160+0000 7f1885134640 1 monclient: found mon.noname-c 2024-09-14T11:34:29.332 INFO:tasks.workunit.client.0.smithi071.stderr: -228> 2024-09-14T11:34:29.160+0000 7f1885134640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:34:29.332 INFO:tasks.workunit.client.0.smithi071.stderr: -227> 2024-09-14T11:34:29.160+0000 7f17697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:29.332 INFO:tasks.workunit.client.0.smithi071.stderr: -226> 2024-09-14T11:34:29.160+0000 7f17697fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:29.332 INFO:tasks.workunit.client.0.smithi071.stderr: -225> 2024-09-14T11:34:29.160+0000 7f17697fa640 10 monclient: dump: 2024-09-14T11:34:29.332 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:34:29.332 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:34:29.332 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.332 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.332 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:29.332 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:34:29.332 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:34:29.332 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:34:29.332 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:34:29.332 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.333 INFO:tasks.workunit.client.0.smithi071.stderr: -224> 2024-09-14T11:34:29.160+0000 7f17697fa640 10 monclient: _finish_auth 0 2024-09-14T11:34:29.333 INFO:tasks.workunit.client.0.smithi071.stderr: -223> 2024-09-14T11:34:29.160+0000 7f17697fa640 10 monclient: _check_auth_tickets 2024-09-14T11:34:29.333 INFO:tasks.workunit.client.0.smithi071.stderr: -222> 2024-09-14T11:34:29.160+0000 7f17697fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:29.333 INFO:tasks.workunit.client.0.smithi071.stderr: -221> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 monclient: authenticate success, global_id 7757 2024-09-14T11:34:29.333 INFO:tasks.workunit.client.0.smithi071.stderr: -220> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:34:29.333 INFO:tasks.workunit.client.0.smithi071.stderr: -219> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 4 set_mon_vals no callback set 2024-09-14T11:34:29.333 INFO:tasks.workunit.client.0.smithi071.stderr: -218> 2024-09-14T11:34:29.160+0000 7f17697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:29.333 INFO:tasks.workunit.client.0.smithi071.stderr: -217> 2024-09-14T11:34:29.160+0000 7f17697fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:29.333 INFO:tasks.workunit.client.0.smithi071.stderr: -216> 2024-09-14T11:34:29.160+0000 7f17697fa640 10 monclient: dump: 2024-09-14T11:34:29.333 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:34:29.333 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:34:29.333 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.333 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.333 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:29.333 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:34:29.334 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:34:29.334 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:34:29.334 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:34:29.334 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.334 INFO:tasks.workunit.client.0.smithi071.stderr: -215> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient: shutdown 2024-09-14T11:34:29.334 INFO:tasks.workunit.client.0.smithi071.stderr: -214> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient: build_initial_monmap 2024-09-14T11:34:29.334 INFO:tasks.workunit.client.0.smithi071.stderr: -213> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 1 build_initial for_mkfs: 0 2024-09-14T11:34:29.334 INFO:tasks.workunit.client.0.smithi071.stderr: -212> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient: monmap: 2024-09-14T11:34:29.334 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:34:29.334 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:29.334 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:34:29.334 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:34:29.334 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:29.334 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:34:29.335 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:34:29.335 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:34:29.335 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:34:29.335 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.335 INFO:tasks.workunit.client.0.smithi071.stderr: -211> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3a0af0) adding auth protocol: cephx 2024-09-14T11:34:29.335 INFO:tasks.workunit.client.0.smithi071.stderr: -210> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3a0af0) adding auth protocol: cephx 2024-09-14T11:34:29.335 INFO:tasks.workunit.client.0.smithi071.stderr: -209> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3a0af0) adding auth protocol: cephx 2024-09-14T11:34:29.335 INFO:tasks.workunit.client.0.smithi071.stderr: -208> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3a0af0) adding con mode: secure 2024-09-14T11:34:29.335 INFO:tasks.workunit.client.0.smithi071.stderr: -207> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3a0af0) adding con mode: crc 2024-09-14T11:34:29.335 INFO:tasks.workunit.client.0.smithi071.stderr: -206> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3a0af0) adding con mode: secure 2024-09-14T11:34:29.335 INFO:tasks.workunit.client.0.smithi071.stderr: -205> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3a0af0) adding con mode: crc 2024-09-14T11:34:29.335 INFO:tasks.workunit.client.0.smithi071.stderr: -204> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3a0af0) adding con mode: secure 2024-09-14T11:34:29.335 INFO:tasks.workunit.client.0.smithi071.stderr: -203> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3a0af0) adding con mode: crc 2024-09-14T11:34:29.335 INFO:tasks.workunit.client.0.smithi071.stderr: -202> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3a0af0) adding con mode: crc 2024-09-14T11:34:29.335 INFO:tasks.workunit.client.0.smithi071.stderr: -201> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3a0af0) adding con mode: secure 2024-09-14T11:34:29.335 INFO:tasks.workunit.client.0.smithi071.stderr: -200> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3a0af0) adding con mode: crc 2024-09-14T11:34:29.336 INFO:tasks.workunit.client.0.smithi071.stderr: -199> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3a0af0) adding con mode: secure 2024-09-14T11:34:29.336 INFO:tasks.workunit.client.0.smithi071.stderr: -198> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3a0af0) adding con mode: crc 2024-09-14T11:34:29.336 INFO:tasks.workunit.client.0.smithi071.stderr: -197> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3a0af0) adding con mode: secure 2024-09-14T11:34:29.336 INFO:tasks.workunit.client.0.smithi071.stderr: -196> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:29.336 INFO:tasks.workunit.client.0.smithi071.stderr: -195> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 1 librados: starting msgr at 2024-09-14T11:34:29.336 INFO:tasks.workunit.client.0.smithi071.stderr: -194> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 1 librados: starting objecter 2024-09-14T11:34:29.336 INFO:tasks.workunit.client.0.smithi071.stderr: -193> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 asok(0x5595eb0bcd90) register_command objecter_requests cmddesc objecter_requests hook 0x5595eb2f3540 EEXIST 2024-09-14T11:34:29.336 INFO:tasks.workunit.client.0.smithi071.stderr: -192> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 1 librados: setting wanted keys 2024-09-14T11:34:29.336 INFO:tasks.workunit.client.0.smithi071.stderr: -191> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 1 librados: calling monclient init 2024-09-14T11:34:29.336 INFO:tasks.workunit.client.0.smithi071.stderr: -190> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient: init 2024-09-14T11:34:29.336 INFO:tasks.workunit.client.0.smithi071.stderr: -189> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3497e0) adding auth protocol: cephx 2024-09-14T11:34:29.336 INFO:tasks.workunit.client.0.smithi071.stderr: -188> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3497e0) adding auth protocol: cephx 2024-09-14T11:34:29.336 INFO:tasks.workunit.client.0.smithi071.stderr: -187> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3497e0) adding auth protocol: cephx 2024-09-14T11:34:29.336 INFO:tasks.workunit.client.0.smithi071.stderr: -186> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3497e0) adding con mode: secure 2024-09-14T11:34:29.336 INFO:tasks.workunit.client.0.smithi071.stderr: -185> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3497e0) adding con mode: crc 2024-09-14T11:34:29.337 INFO:tasks.workunit.client.0.smithi071.stderr: -184> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3497e0) adding con mode: secure 2024-09-14T11:34:29.337 INFO:tasks.workunit.client.0.smithi071.stderr: -183> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3497e0) adding con mode: crc 2024-09-14T11:34:29.337 INFO:tasks.workunit.client.0.smithi071.stderr: -182> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3497e0) adding con mode: secure 2024-09-14T11:34:29.337 INFO:tasks.workunit.client.0.smithi071.stderr: -181> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3497e0) adding con mode: crc 2024-09-14T11:34:29.337 INFO:tasks.workunit.client.0.smithi071.stderr: -180> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3497e0) adding con mode: crc 2024-09-14T11:34:29.337 INFO:tasks.workunit.client.0.smithi071.stderr: -179> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3497e0) adding con mode: secure 2024-09-14T11:34:29.337 INFO:tasks.workunit.client.0.smithi071.stderr: -178> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3497e0) adding con mode: crc 2024-09-14T11:34:29.337 INFO:tasks.workunit.client.0.smithi071.stderr: -177> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3497e0) adding con mode: secure 2024-09-14T11:34:29.337 INFO:tasks.workunit.client.0.smithi071.stderr: -176> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3497e0) adding con mode: crc 2024-09-14T11:34:29.337 INFO:tasks.workunit.client.0.smithi071.stderr: -175> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 AuthRegistry(0x5595eb3497e0) adding con mode: secure 2024-09-14T11:34:29.337 INFO:tasks.workunit.client.0.smithi071.stderr: -174> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:29.337 INFO:tasks.workunit.client.0.smithi071.stderr: -173> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:29.337 INFO:tasks.workunit.client.0.smithi071.stderr: -172> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 5 asok(0x5595eb0bcd90) register_command rotate-key cmddesc rotate-key hook 0x5595eb349928 EEXIST 2024-09-14T11:34:29.337 INFO:tasks.workunit.client.0.smithi071.stderr: -171> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:34:29.337 INFO:tasks.workunit.client.0.smithi071.stderr: -170> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:34:29.337 INFO:tasks.workunit.client.0.smithi071.stderr: -169> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient(hunting): picked mon.noname-a con 0x5595eb39b550 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:34:29.338 INFO:tasks.workunit.client.0.smithi071.stderr: -168> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient(hunting): picked mon.noname-c con 0x5595eb3671f0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:34:29.338 INFO:tasks.workunit.client.0.smithi071.stderr: -167> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient(hunting): picked mon.noname-b con 0x5595eb399f30 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:34:29.338 INFO:tasks.workunit.client.0.smithi071.stderr: -166> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:29.338 INFO:tasks.workunit.client.0.smithi071.stderr: -165> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:29.338 INFO:tasks.workunit.client.0.smithi071.stderr: -164> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:29.338 INFO:tasks.workunit.client.0.smithi071.stderr: -163> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:34:29.338 INFO:tasks.workunit.client.0.smithi071.stderr: -162> 2024-09-14T11:34:29.160+0000 7f1887e2f9c0 10 monclient(hunting): authenticate will time out at 2481.283277s 2024-09-14T11:34:29.338 INFO:tasks.workunit.client.0.smithi071.stderr: -161> 2024-09-14T11:34:29.160+0000 7f1885134640 10 monclient(hunting): get_auth_request con 0x5595eb39b550 auth_method 0 2024-09-14T11:34:29.338 INFO:tasks.workunit.client.0.smithi071.stderr: -160> 2024-09-14T11:34:29.160+0000 7f1885134640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:29.338 INFO:tasks.workunit.client.0.smithi071.stderr: -159> 2024-09-14T11:34:29.160+0000 7f1885134640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:29.338 INFO:tasks.workunit.client.0.smithi071.stderr: -158> 2024-09-14T11:34:29.160+0000 7f1885134640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:29.338 INFO:tasks.workunit.client.0.smithi071.stderr: -157> 2024-09-14T11:34:29.160+0000 7f1886136640 10 monclient(hunting): get_auth_request con 0x5595eb3671f0 auth_method 0 2024-09-14T11:34:29.338 INFO:tasks.workunit.client.0.smithi071.stderr: -156> 2024-09-14T11:34:29.160+0000 7f1886136640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:29.338 INFO:tasks.workunit.client.0.smithi071.stderr: -155> 2024-09-14T11:34:29.160+0000 7f1886136640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:29.338 INFO:tasks.workunit.client.0.smithi071.stderr: -154> 2024-09-14T11:34:29.160+0000 7f1886136640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:29.339 INFO:tasks.workunit.client.0.smithi071.stderr: -153> 2024-09-14T11:34:29.160+0000 7f1886136640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:29.339 INFO:tasks.workunit.client.0.smithi071.stderr: -152> 2024-09-14T11:34:29.160+0000 7f1886136640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:29.339 INFO:tasks.workunit.client.0.smithi071.stderr: -151> 2024-09-14T11:34:29.160+0000 7f1886136640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:29.339 INFO:tasks.workunit.client.0.smithi071.stderr: -150> 2024-09-14T11:34:29.160+0000 7f1885134640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:29.339 INFO:tasks.workunit.client.0.smithi071.stderr: -149> 2024-09-14T11:34:29.160+0000 7f1885134640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:29.339 INFO:tasks.workunit.client.0.smithi071.stderr: -148> 2024-09-14T11:34:29.160+0000 7f1885134640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:29.339 INFO:tasks.workunit.client.0.smithi071.stderr: -147> 2024-09-14T11:34:29.160+0000 7f1886136640 10 monclient(hunting): handle_auth_done global_id 7760 payload 824 2024-09-14T11:34:29.339 INFO:tasks.workunit.client.0.smithi071.stderr: -146> 2024-09-14T11:34:29.160+0000 7f1886136640 10 monclient: _finish_hunting 0 2024-09-14T11:34:29.339 INFO:tasks.workunit.client.0.smithi071.stderr: -145> 2024-09-14T11:34:29.160+0000 7f1886136640 1 monclient: found mon.noname-c 2024-09-14T11:34:29.339 INFO:tasks.workunit.client.0.smithi071.stderr: -144> 2024-09-14T11:34:29.160+0000 7f1886136640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:34:29.339 INFO:tasks.workunit.client.0.smithi071.stderr: -143> 2024-09-14T11:34:29.164+0000 7f17577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:29.339 INFO:tasks.workunit.client.0.smithi071.stderr: -142> 2024-09-14T11:34:29.164+0000 7f17577fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:29.339 INFO:tasks.workunit.client.0.smithi071.stderr: -141> 2024-09-14T11:34:29.164+0000 7f17577fe640 10 monclient: dump: 2024-09-14T11:34:29.339 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:34:29.339 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:34:29.340 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.340 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.340 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:29.340 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:34:29.340 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:34:29.340 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:34:29.340 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:34:29.340 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.340 INFO:tasks.workunit.client.0.smithi071.stderr: -140> 2024-09-14T11:34:29.164+0000 7f17577fe640 10 monclient: _finish_auth 0 2024-09-14T11:34:29.340 INFO:tasks.workunit.client.0.smithi071.stderr: -139> 2024-09-14T11:34:29.164+0000 7f17577fe640 10 monclient: _check_auth_tickets 2024-09-14T11:34:29.340 INFO:tasks.workunit.client.0.smithi071.stderr: -138> 2024-09-14T11:34:29.164+0000 7f17577fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:29.340 INFO:tasks.workunit.client.0.smithi071.stderr: -137> 2024-09-14T11:34:29.164+0000 7f17577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:29.340 INFO:tasks.workunit.client.0.smithi071.stderr: -136> 2024-09-14T11:34:29.164+0000 7f17577fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:29.340 INFO:tasks.workunit.client.0.smithi071.stderr: -135> 2024-09-14T11:34:29.164+0000 7f17577fe640 10 monclient: dump: 2024-09-14T11:34:29.340 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:34:29.341 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:34:29.341 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.341 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:34:29.341 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:29.341 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:34:29.341 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:34:29.341 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:34:29.341 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:34:29.341 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.341 INFO:tasks.workunit.client.0.smithi071.stderr: -134> 2024-09-14T11:34:29.164+0000 7f1887e2f9c0 5 monclient: authenticate success, global_id 7760 2024-09-14T11:34:29.341 INFO:tasks.workunit.client.0.smithi071.stderr: -133> 2024-09-14T11:34:29.164+0000 7f1887e2f9c0 10 monclient: _renew_subs 2024-09-14T11:34:29.341 INFO:tasks.workunit.client.0.smithi071.stderr: -132> 2024-09-14T11:34:29.164+0000 7f1887e2f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:34:29.341 INFO:tasks.workunit.client.0.smithi071.stderr: -131> 2024-09-14T11:34:29.164+0000 7f17697fa640 4 set_mon_vals no callback set 2024-09-14T11:34:29.341 INFO:tasks.workunit.client.0.smithi071.stderr: -130> 2024-09-14T11:34:29.164+0000 7f1887e2f9c0 10 monclient: _renew_subs 2024-09-14T11:34:29.342 INFO:tasks.workunit.client.0.smithi071.stderr: -129> 2024-09-14T11:34:29.164+0000 7f1887e2f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:34:29.342 INFO:tasks.workunit.client.0.smithi071.stderr: -128> 2024-09-14T11:34:29.164+0000 7f1887e2f9c0 1 librados: init done 2024-09-14T11:34:29.342 INFO:tasks.workunit.client.0.smithi071.stderr: -127> 2024-09-14T11:34:29.164+0000 7f1887e2f9c0 5 asok(0x5595eb0bcd90) register_command cr dump hook 0x5595eb368368 2024-09-14T11:34:29.342 INFO:tasks.workunit.client.0.smithi071.stderr: -126> 2024-09-14T11:34:29.164+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.342 INFO:tasks.workunit.client.0.smithi071.stderr: -125> 2024-09-14T11:34:29.164+0000 7f17577fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:29.342 INFO:tasks.workunit.client.0.smithi071.stderr: -124> 2024-09-14T11:34:29.164+0000 7f17577fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:34:29.342 INFO:tasks.workunit.client.0.smithi071.stderr: -123> 2024-09-14T11:34:29.164+0000 7f17577fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:34:29.342 INFO:tasks.workunit.client.0.smithi071.stderr: -122> 2024-09-14T11:34:29.164+0000 7f1885134640 10 monclient: get_auth_request con 0x7f17500718d0 auth_method 0 2024-09-14T11:34:29.342 INFO:tasks.workunit.client.0.smithi071.stderr: -121> 2024-09-14T11:34:29.164+0000 7f1885935640 10 monclient: get_auth_request con 0x5595eb3b5d30 auth_method 0 2024-09-14T11:34:29.342 INFO:tasks.workunit.client.0.smithi071.stderr: -120> 2024-09-14T11:34:29.168+0000 7f1887e2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.342 INFO:tasks.workunit.client.0.smithi071.stderr: -119> 2024-09-14T11:34:29.168+0000 7f1887e2f9c0 20 realm 2024-09-14T11:34:29.342 INFO:tasks.workunit.client.0.smithi071.stderr: -118> 2024-09-14T11:34:29.168+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.342 INFO:tasks.workunit.client.0.smithi071.stderr: -117> 2024-09-14T11:34:29.168+0000 7f1887e2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.342 INFO:tasks.workunit.client.0.smithi071.stderr: -116> 2024-09-14T11:34:29.168+0000 7f1887e2f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:29.342 INFO:tasks.workunit.client.0.smithi071.stderr: -115> 2024-09-14T11:34:29.168+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.343 INFO:tasks.workunit.client.0.smithi071.stderr: -114> 2024-09-14T11:34:29.168+0000 7f1887e2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.343 INFO:tasks.workunit.client.0.smithi071.stderr: -113> 2024-09-14T11:34:29.168+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.343 INFO:tasks.workunit.client.0.smithi071.stderr: -112> 2024-09-14T11:34:29.168+0000 7f1885134640 10 monclient: get_auth_request con 0x5595eb3b9f40 auth_method 0 2024-09-14T11:34:29.343 INFO:tasks.workunit.client.0.smithi071.stderr: -111> 2024-09-14T11:34:29.168+0000 7f1887e2f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:29.343 INFO:tasks.workunit.client.0.smithi071.stderr: -110> 2024-09-14T11:34:29.168+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.343 INFO:tasks.workunit.client.0.smithi071.stderr: -109> 2024-09-14T11:34:29.168+0000 7f1886136640 10 monclient: get_auth_request con 0x5595eb3bd780 auth_method 0 2024-09-14T11:34:29.343 INFO:tasks.workunit.client.0.smithi071.stderr: -108> 2024-09-14T11:34:29.168+0000 7f1887e2f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:29.343 INFO:tasks.workunit.client.0.smithi071.stderr: -107> 2024-09-14T11:34:29.168+0000 7f1887e2f9c0 20 searching for the correct realm 2024-09-14T11:34:29.343 INFO:tasks.workunit.client.0.smithi071.stderr: -106> 2024-09-14T11:34:29.168+0000 7f1885935640 10 monclient: get_auth_request con 0x5595eb3c24f0 auth_method 0 2024-09-14T11:34:29.343 INFO:tasks.workunit.client.0.smithi071.stderr: -105> 2024-09-14T11:34:29.172+0000 7f1885134640 10 monclient: get_auth_request con 0x7f1878067470 auth_method 0 2024-09-14T11:34:29.343 INFO:tasks.workunit.client.0.smithi071.stderr: -104> 2024-09-14T11:34:29.172+0000 7f1885134640 0 -- 172.21.15.71:0/3078911883 >> [v2:172.21.15.71:6824/2436891866,v1:172.21.15.71:6825/2436891866] conn(0x7f1878067470 msgr2=0x7f18780661b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:29.343 INFO:tasks.workunit.client.0.smithi071.stderr: -103> 2024-09-14T11:34:29.172+0000 7f17577fe640 1 client.7760.objecter ms_handle_reset 0x7f1878067470 session 0x7f187806de90 osd.2 2024-09-14T11:34:29.343 INFO:tasks.workunit.client.0.smithi071.stderr: -102> 2024-09-14T11:34:29.172+0000 7f17577fe640 10 monclient: _renew_subs 2024-09-14T11:34:29.343 INFO:tasks.workunit.client.0.smithi071.stderr: -101> 2024-09-14T11:34:29.172+0000 7f17577fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:34:29.343 INFO:tasks.workunit.client.0.smithi071.stderr: -100> 2024-09-14T11:34:29.172+0000 7f1885134640 10 monclient: get_auth_request con 0x7f1750081450 auth_method 0 2024-09-14T11:34:29.343 INFO:tasks.workunit.client.0.smithi071.stderr: -99> 2024-09-14T11:34:29.172+0000 7f1886136640 10 monclient: get_auth_request con 0x7f187c008040 auth_method 0 2024-09-14T11:34:29.344 INFO:tasks.workunit.client.0.smithi071.stderr: -98> 2024-09-14T11:34:29.176+0000 7f1885935640 10 monclient: get_auth_request con 0x7f1878067ba0 auth_method 0 2024-09-14T11:34:29.344 INFO:tasks.workunit.client.0.smithi071.stderr: -97> 2024-09-14T11:34:29.180+0000 7f1885935640 0 -- 172.21.15.71:0/3078911883 >> [v2:172.21.15.157:6816/1231501119,v1:172.21.15.157:6817/1231501119] conn(0x5595eb3b5d30 msgr2=0x5595eb3b81d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:29.344 INFO:tasks.workunit.client.0.smithi071.stderr: -96> 2024-09-14T11:34:29.180+0000 7f17577fe640 1 client.7760.objecter ms_handle_reset 0x5595eb3b5d30 session 0x5595eb3b56b0 osd.6 2024-09-14T11:34:29.344 INFO:tasks.workunit.client.0.smithi071.stderr: -95> 2024-09-14T11:34:29.180+0000 7f1885935640 10 monclient: get_auth_request con 0x7f1878067470 auth_method 0 2024-09-14T11:34:29.344 INFO:tasks.workunit.client.0.smithi071.stderr: -94> 2024-09-14T11:34:29.180+0000 7f1885134640 10 monclient: get_auth_request con 0x7f187c062400 auth_method 0 2024-09-14T11:34:29.344 INFO:tasks.workunit.client.0.smithi071.stderr: -93> 2024-09-14T11:34:29.188+0000 7f1887e2f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:29.344 INFO:tasks.workunit.client.0.smithi071.stderr: -92> 2024-09-14T11:34:29.188+0000 7f1887e2f9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:34:29.344 INFO:tasks.workunit.client.0.smithi071.stderr: -91> 2024-09-14T11:34:29.188+0000 7f1887e2f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:29.344 INFO:tasks.workunit.client.0.smithi071.stderr: -90> 2024-09-14T11:34:29.188+0000 7f1887e2f9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:34:29.344 INFO:tasks.workunit.client.0.smithi071.stderr: -89> 2024-09-14T11:34:29.188+0000 7f1887e2f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:29.344 INFO:tasks.workunit.client.0.smithi071.stderr: -88> 2024-09-14T11:34:29.188+0000 7f1887e2f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:29.344 INFO:tasks.workunit.client.0.smithi071.stderr: -87> 2024-09-14T11:34:29.188+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.344 INFO:tasks.workunit.client.0.smithi071.stderr: -86> 2024-09-14T11:34:29.188+0000 7f1887e2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.344 INFO:tasks.workunit.client.0.smithi071.stderr: -85> 2024-09-14T11:34:29.188+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.345 INFO:tasks.workunit.client.0.smithi071.stderr: -84> 2024-09-14T11:34:29.188+0000 7f1887e2f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:29.345 INFO:tasks.workunit.client.0.smithi071.stderr: -83> 2024-09-14T11:34:29.188+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.345 INFO:tasks.workunit.client.0.smithi071.stderr: -82> 2024-09-14T11:34:29.192+0000 7f1887e2f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:29.345 INFO:tasks.workunit.client.0.smithi071.stderr: -81> 2024-09-14T11:34:29.192+0000 7f1887e2f9c0 20 zone default found 2024-09-14T11:34:29.345 INFO:tasks.workunit.client.0.smithi071.stderr: -80> 2024-09-14T11:34:29.192+0000 7f1887e2f9c0 4 Realm: () 2024-09-14T11:34:29.345 INFO:tasks.workunit.client.0.smithi071.stderr: -79> 2024-09-14T11:34:29.192+0000 7f1887e2f9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:34:29.345 INFO:tasks.workunit.client.0.smithi071.stderr: -78> 2024-09-14T11:34:29.192+0000 7f1887e2f9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:34:29.345 INFO:tasks.workunit.client.0.smithi071.stderr: -77> 2024-09-14T11:34:29.192+0000 7f1887e2f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:29.345 INFO:tasks.workunit.client.0.smithi071.stderr: -76> 2024-09-14T11:34:29.192+0000 7f1887e2f9c0 20 zonegroup default 2024-09-14T11:34:29.345 INFO:tasks.workunit.client.0.smithi071.stderr: -75> 2024-09-14T11:34:29.192+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.345 INFO:tasks.workunit.client.0.smithi071.stderr: -74> 2024-09-14T11:34:29.192+0000 7f1887e2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.345 INFO:tasks.workunit.client.0.smithi071.stderr: -73> 2024-09-14T11:34:29.192+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.345 INFO:tasks.workunit.client.0.smithi071.stderr: -72> 2024-09-14T11:34:29.192+0000 7f1887e2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.345 INFO:tasks.workunit.client.0.smithi071.stderr: -71> 2024-09-14T11:34:29.192+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.345 INFO:tasks.workunit.client.0.smithi071.stderr: -70> 2024-09-14T11:34:29.192+0000 7f1887e2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.345 INFO:tasks.workunit.client.0.smithi071.stderr: -69> 2024-09-14T11:34:29.192+0000 7f1887e2f9c0 20 started sync module instance, tier type = 2024-09-14T11:34:29.346 INFO:tasks.workunit.client.0.smithi071.stderr: -68> 2024-09-14T11:34:29.192+0000 7f1887e2f9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:34:29.346 INFO:tasks.workunit.client.0.smithi071.stderr: -67> 2024-09-14T11:34:29.208+0000 7f1887e2f9c0 20 add_watcher() i=0 2024-09-14T11:34:29.346 INFO:tasks.workunit.client.0.smithi071.stderr: -66> 2024-09-14T11:34:29.208+0000 7f1887e2f9c0 20 add_watcher() i=1 2024-09-14T11:34:29.346 INFO:tasks.workunit.client.0.smithi071.stderr: -65> 2024-09-14T11:34:29.208+0000 7f1887e2f9c0 20 add_watcher() i=2 2024-09-14T11:34:29.346 INFO:tasks.workunit.client.0.smithi071.stderr: -64> 2024-09-14T11:34:29.208+0000 7f1887e2f9c0 20 add_watcher() i=3 2024-09-14T11:34:29.346 INFO:tasks.workunit.client.0.smithi071.stderr: -63> 2024-09-14T11:34:29.208+0000 7f1887e2f9c0 20 add_watcher() i=4 2024-09-14T11:34:29.346 INFO:tasks.workunit.client.0.smithi071.stderr: -62> 2024-09-14T11:34:29.208+0000 7f1887e2f9c0 20 add_watcher() i=5 2024-09-14T11:34:29.346 INFO:tasks.workunit.client.0.smithi071.stderr: -61> 2024-09-14T11:34:29.208+0000 7f1887e2f9c0 20 add_watcher() i=6 2024-09-14T11:34:29.346 INFO:tasks.workunit.client.0.smithi071.stderr: -60> 2024-09-14T11:34:29.212+0000 7f1887e2f9c0 20 add_watcher() i=7 2024-09-14T11:34:29.346 INFO:tasks.workunit.client.0.smithi071.stderr: -59> 2024-09-14T11:34:29.212+0000 7f1887e2f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:29.346 INFO:tasks.workunit.client.0.smithi071.stderr: -58> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a860) adding auth protocol: cephx 2024-09-14T11:34:29.346 INFO:tasks.workunit.client.0.smithi071.stderr: -57> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a860) adding auth protocol: cephx 2024-09-14T11:34:29.346 INFO:tasks.workunit.client.0.smithi071.stderr: -56> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a860) adding auth protocol: cephx 2024-09-14T11:34:29.346 INFO:tasks.workunit.client.0.smithi071.stderr: -55> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a860) adding con mode: secure 2024-09-14T11:34:29.346 INFO:tasks.workunit.client.0.smithi071.stderr: -54> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a860) adding con mode: crc 2024-09-14T11:34:29.347 INFO:tasks.workunit.client.0.smithi071.stderr: -53> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a860) adding con mode: secure 2024-09-14T11:34:29.347 INFO:tasks.workunit.client.0.smithi071.stderr: -52> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a860) adding con mode: crc 2024-09-14T11:34:29.347 INFO:tasks.workunit.client.0.smithi071.stderr: -51> 2024-09-14T11:34:29.216+0000 7f17377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:29.347 INFO:tasks.workunit.client.0.smithi071.stderr: -50> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a860) adding con mode: secure 2024-09-14T11:34:29.347 INFO:tasks.workunit.client.0.smithi071.stderr: -49> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a860) adding con mode: crc 2024-09-14T11:34:29.347 INFO:tasks.workunit.client.0.smithi071.stderr: -48> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a860) adding con mode: crc 2024-09-14T11:34:29.347 INFO:tasks.workunit.client.0.smithi071.stderr: -47> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a860) adding con mode: secure 2024-09-14T11:34:29.347 INFO:tasks.workunit.client.0.smithi071.stderr: -46> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a860) adding con mode: crc 2024-09-14T11:34:29.347 INFO:tasks.workunit.client.0.smithi071.stderr: -45> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a860) adding con mode: secure 2024-09-14T11:34:29.347 INFO:tasks.workunit.client.0.smithi071.stderr: -44> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a860) adding con mode: crc 2024-09-14T11:34:29.347 INFO:tasks.workunit.client.0.smithi071.stderr: -43> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 AuthRegistry(0x7fff7d79a860) adding con mode: secure 2024-09-14T11:34:29.347 INFO:tasks.workunit.client.0.smithi071.stderr: -42> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:29.347 INFO:tasks.workunit.client.0.smithi071.stderr: -41> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:29.347 INFO:tasks.workunit.client.0.smithi071.stderr: -40> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:29.347 INFO:tasks.workunit.client.0.smithi071.stderr: -39> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 asok(0x5595eb0bcd90) register_command cache list hook 0x5595eb39a760 2024-09-14T11:34:29.347 INFO:tasks.workunit.client.0.smithi071.stderr: -38> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 asok(0x5595eb0bcd90) register_command cache inspect hook 0x5595eb39a760 2024-09-14T11:34:29.348 INFO:tasks.workunit.client.0.smithi071.stderr: -37> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 asok(0x5595eb0bcd90) register_command cache erase hook 0x5595eb39a760 2024-09-14T11:34:29.348 INFO:tasks.workunit.client.0.smithi071.stderr: -36> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 asok(0x5595eb0bcd90) register_command cache zap hook 0x5595eb39a760 2024-09-14T11:34:29.348 INFO:tasks.workunit.client.0.smithi071.stderr: -35> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 note: GC not initialized 2024-09-14T11:34:29.348 INFO:tasks.workunit.client.0.smithi071.stderr: -34> 2024-09-14T11:34:29.216+0000 7f17367fc640 20 reqs_thread_entry: start 2024-09-14T11:34:29.348 INFO:tasks.workunit.client.0.smithi071.stderr: -33> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 asok(0x5595eb0bcd90) register_command sync trace show hook 0x7f18780014f0 2024-09-14T11:34:29.348 INFO:tasks.workunit.client.0.smithi071.stderr: -32> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 asok(0x5595eb0bcd90) register_command sync trace history hook 0x7f18780014f0 2024-09-14T11:34:29.348 INFO:tasks.workunit.client.0.smithi071.stderr: -31> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 asok(0x5595eb0bcd90) register_command sync trace active hook 0x7f18780014f0 2024-09-14T11:34:29.348 INFO:tasks.workunit.client.0.smithi071.stderr: -30> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 5 asok(0x5595eb0bcd90) register_command sync trace active_short hook 0x7f18780014f0 2024-09-14T11:34:29.348 INFO:tasks.workunit.client.0.smithi071.stderr: -29> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:34:29.348 INFO:tasks.workunit.client.0.smithi071.stderr: -28> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 20 Filter name: none 2024-09-14T11:34:29.348 INFO:tasks.workunit.client.0.smithi071.stderr: -27> 2024-09-14T11:34:29.216+0000 7f16a7fff640 20 reqs_thread_entry: start 2024-09-14T11:34:29.348 INFO:tasks.workunit.client.0.smithi071.stderr: -26> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:34:29.348 INFO:tasks.workunit.client.0.smithi071.stderr: -25> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.348 INFO:tasks.workunit.client.0.smithi071.stderr: -24> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:29.348 INFO:tasks.workunit.client.0.smithi071.stderr: -23> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:34:29.349 INFO:tasks.workunit.client.0.smithi071.stderr: -22> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:34:29.349 INFO:tasks.workunit.client.0.smithi071.stderr: -21> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 : miss 2024-09-14T11:34:29.349 INFO:tasks.workunit.client.0.smithi071.stderr: -20> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.349 INFO:tasks.workunit.client.0.smithi071.stderr: -19> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:34:29.349 INFO:tasks.workunit.client.0.smithi071.stderr: -18> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:34:29.349 INFO:tasks.workunit.client.0.smithi071.stderr: -17> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:34:29.349 INFO:tasks.workunit.client.0.smithi071.stderr: -16> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:29.349 INFO:tasks.workunit.client.0.smithi071.stderr: -15> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:29.349 INFO:tasks.workunit.client.0.smithi071.stderr: -14> 2024-09-14T11:34:29.216+0000 7f1887e2f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 2024-09-14T11:34:29.349 INFO:tasks.workunit.client.0.smithi071.stderr: -13> 2024-09-14T11:34:29.228+0000 7f1887e2f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:34:29.349 INFO:tasks.workunit.client.0.smithi071.stderr: -12> 2024-09-14T11:34:29.228+0000 7f1887e2f9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:34:29.349 INFO:tasks.workunit.client.0.smithi071.stderr: -11> 2024-09-14T11:34:29.228+0000 7f1887e2f9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:29.349 INFO:tasks.workunit.client.0.smithi071.stderr: -10> 2024-09-14T11:34:29.228+0000 7f1887e2f9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18, ofs0, ns] 2024-09-14T11:34:29.349 INFO:tasks.workunit.client.0.smithi071.stderr: -9> 2024-09-14T11:34:29.228+0000 7f17697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464426 cookie 94102385095504 notifier 7760 bl.length()=911 2024-09-14T11:34:29.349 INFO:tasks.workunit.client.0.smithi071.stderr: -8> 2024-09-14T11:34:29.228+0000 7f17697fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:34:29.350 INFO:tasks.workunit.client.0.smithi071.stderr: -7> 2024-09-14T11:34:29.228+0000 7f17697fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:34:29.350 INFO:tasks.workunit.client.0.smithi071.stderr: -6> 2024-09-14T11:34:29.228+0000 7f17697fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:29.350 INFO:tasks.workunit.client.0.smithi071.stderr: -5> 2024-09-14T11:34:29.228+0000 7f1887e2f9c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_sources= new_sources= 2024-09-14T11:34:29.350 INFO:tasks.workunit.client.0.smithi071.stderr: -4> 2024-09-14T11:34:29.228+0000 7f1887e2f9c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential sources added=[] removed=[] 2024-09-14T11:34:29.350 INFO:tasks.workunit.client.0.smithi071.stderr: -3> 2024-09-14T11:34:29.228+0000 7f1887e2f9c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_dests= new_dests= 2024-09-14T11:34:29.350 INFO:tasks.workunit.client.0.smithi071.stderr: -2> 2024-09-14T11:34:29.228+0000 7f1887e2f9c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential dests added=[] removed=[] 2024-09-14T11:34:29.350 INFO:tasks.workunit.client.0.smithi071.stderr: -1> 2024-09-14T11:34:29.240+0000 7f1887e2f9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1887e2f9c0 time 2024-09-14T11:34:29.241615+0000 2024-09-14T11:34:29.350 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:29.350 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.350 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:29.350 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f188b7092eb] 2024-09-14T11:34:29.350 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f188b70949f] 2024-09-14T11:34:29.350 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5595e99e2c01] 2024-09-14T11:34:29.350 INFO:tasks.workunit.client.0.smithi071.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5595e99f7f3a] 2024-09-14T11:34:29.350 INFO:tasks.workunit.client.0.smithi071.stderr: 5: main() 2024-09-14T11:34:29.351 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f188a56fd90] 2024-09-14T11:34:29.351 INFO:tasks.workunit.client.0.smithi071.stderr: 7: __libc_start_main() 2024-09-14T11:34:29.351 INFO:tasks.workunit.client.0.smithi071.stderr: 8: _start() 2024-09-14T11:34:29.351 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.351 INFO:tasks.workunit.client.0.smithi071.stderr: 0> 2024-09-14T11:34:29.240+0000 7f1887e2f9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:34:29.351 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f1887e2f9c0 thread_name:radosgw-admin 2024-09-14T11:34:29.351 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.351 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:29.351 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f188a588520] 2024-09-14T11:34:29.351 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:34:29.351 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:34:29.351 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:34:29.351 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f188b709345] 2024-09-14T11:34:29.351 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f188b70949f] 2024-09-14T11:34:29.351 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5595e99e2c01] 2024-09-14T11:34:29.352 INFO:tasks.workunit.client.0.smithi071.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5595e99f7f3a] 2024-09-14T11:34:29.352 INFO:tasks.workunit.client.0.smithi071.stderr: 9: main() 2024-09-14T11:34:29.352 INFO:tasks.workunit.client.0.smithi071.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f188a56fd90] 2024-09-14T11:34:29.352 INFO:tasks.workunit.client.0.smithi071.stderr: 11: __libc_start_main() 2024-09-14T11:34:29.352 INFO:tasks.workunit.client.0.smithi071.stderr: 12: _start() 2024-09-14T11:34:29.352 INFO:tasks.workunit.client.0.smithi071.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:34:29.352 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:34:29.352 INFO:tasks.workunit.client.0.smithi071.stderr:--- logging levels --- 2024-09-14T11:34:29.352 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 none 2024-09-14T11:34:29.352 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 lockdep 2024-09-14T11:34:29.352 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 context 2024-09-14T11:34:29.352 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 crush 2024-09-14T11:34:29.352 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds 2024-09-14T11:34:29.352 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_balancer 2024-09-14T11:34:29.352 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_locker 2024-09-14T11:34:29.353 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log 2024-09-14T11:34:29.353 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log_expire 2024-09-14T11:34:29.353 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_migrator 2024-09-14T11:34:29.353 INFO:tasks.workunit.client.0.smithi071.stderr: 3/ 5 mds_quiesce 2024-09-14T11:34:29.353 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 buffer 2024-09-14T11:34:29.353 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 timer 2024-09-14T11:34:29.353 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 filer 2024-09-14T11:34:29.353 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 striper 2024-09-14T11:34:29.353 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 objecter 2024-09-14T11:34:29.353 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rados 2024-09-14T11:34:29.353 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd 2024-09-14T11:34:29.353 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_mirror 2024-09-14T11:34:29.353 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_replay 2024-09-14T11:34:29.353 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_pwl 2024-09-14T11:34:29.353 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 journaler 2024-09-14T11:34:29.353 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objectcacher 2024-09-14T11:34:29.354 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:34:29.354 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 client 2024-09-14T11:34:29.354 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 osd 2024-09-14T11:34:29.354 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 optracker 2024-09-14T11:34:29.354 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objclass 2024-09-14T11:34:29.354 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 filestore 2024-09-14T11:34:29.354 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 journal 2024-09-14T11:34:29.354 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 ms 2024-09-14T11:34:29.354 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mon 2024-09-14T11:34:29.354 INFO:tasks.workunit.client.0.smithi071.stderr: 0/10 monc 2024-09-14T11:34:29.354 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 paxos 2024-09-14T11:34:29.354 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 tp 2024-09-14T11:34:29.354 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 auth 2024-09-14T11:34:29.354 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 crypto 2024-09-14T11:34:29.354 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 finisher 2024-09-14T11:34:29.354 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 reserver 2024-09-14T11:34:29.355 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 heartbeatmap 2024-09-14T11:34:29.355 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 perfcounter 2024-09-14T11:34:29.355 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw 2024-09-14T11:34:29.355 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_sync 2024-09-14T11:34:29.355 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_datacache 2024-09-14T11:34:29.355 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_access 2024-09-14T11:34:29.355 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:34:29.355 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_flight 2024-09-14T11:34:29.355 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:34:29.355 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw_notification 2024-09-14T11:34:29.355 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 javaclient 2024-09-14T11:34:29.355 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 asok 2024-09-14T11:34:29.355 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 throttle 2024-09-14T11:34:29.355 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 refs 2024-09-14T11:34:29.355 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 compressor 2024-09-14T11:34:29.355 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluestore 2024-09-14T11:34:29.356 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluefs 2024-09-14T11:34:29.356 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 bdev 2024-09-14T11:34:29.356 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 kstore 2024-09-14T11:34:29.356 INFO:tasks.workunit.client.0.smithi071.stderr: 4/ 5 rocksdb 2024-09-14T11:34:29.356 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 fuse 2024-09-14T11:34:29.356 INFO:tasks.workunit.client.0.smithi071.stderr: 2/ 5 mgr 2024-09-14T11:34:29.356 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mgrc 2024-09-14T11:34:29.356 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 dpdk 2024-09-14T11:34:29.356 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 eventtrace 2024-09-14T11:34:29.356 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 prioritycache 2024-09-14T11:34:29.356 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 test 2024-09-14T11:34:29.356 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:34:29.356 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephsqlite 2024-09-14T11:34:29.356 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:34:29.357 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore 2024-09-14T11:34:29.357 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_onode 2024-09-14T11:34:29.357 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_odata 2024-09-14T11:34:29.357 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_omap 2024-09-14T11:34:29.357 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_tm 2024-09-14T11:34:29.357 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_t 2024-09-14T11:34:29.357 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:34:29.357 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_epm 2024-09-14T11:34:29.357 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_lba 2024-09-14T11:34:29.357 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:34:29.357 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cache 2024-09-14T11:34:29.357 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_journal 2024-09-14T11:34:29.357 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_device 2024-09-14T11:34:29.357 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_backref 2024-09-14T11:34:29.357 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 alienstore 2024-09-14T11:34:29.358 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mclock 2024-09-14T11:34:29.358 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cyanstore 2024-09-14T11:34:29.358 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 ceph_exporter 2024-09-14T11:34:29.358 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 memstore 2024-09-14T11:34:29.358 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 trace 2024-09-14T11:34:29.358 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 ceph_dedup 2024-09-14T11:34:29.358 INFO:tasks.workunit.client.0.smithi071.stderr: -2/-2 (syslog threshold) 2024-09-14T11:34:29.358 INFO:tasks.workunit.client.0.smithi071.stderr: 99/99 (stderr threshold) 2024-09-14T11:34:29.358 INFO:tasks.workunit.client.0.smithi071.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:34:29.358 INFO:tasks.workunit.client.0.smithi071.stderr: 7f16a7fff640 / http_manager 2024-09-14T11:34:29.358 INFO:tasks.workunit.client.0.smithi071.stderr: 7f17367fc640 / http_manager 2024-09-14T11:34:29.358 INFO:tasks.workunit.client.0.smithi071.stderr: 7f17377fe640 / rgw_dt_lg_renew 2024-09-14T11:34:29.358 INFO:tasks.workunit.client.0.smithi071.stderr: 7f17577fe640 / ms_dispatch 2024-09-14T11:34:29.358 INFO:tasks.workunit.client.0.smithi071.stderr: 7f17697fa640 / io_context_pool 2024-09-14T11:34:29.358 INFO:tasks.workunit.client.0.smithi071.stderr: 7f176b7fe640 / ms_dispatch 2024-09-14T11:34:29.359 INFO:tasks.workunit.client.0.smithi071.stderr: 7f1772604640 / ms_dispatch 2024-09-14T11:34:29.359 INFO:tasks.workunit.client.0.smithi071.stderr: 7f1773e07640 / io_context_pool 2024-09-14T11:34:29.359 INFO:tasks.workunit.client.0.smithi071.stderr: 7f1885134640 / msgr-worker-2 2024-09-14T11:34:29.359 INFO:tasks.workunit.client.0.smithi071.stderr: 7f1885935640 / msgr-worker-1 2024-09-14T11:34:29.359 INFO:tasks.workunit.client.0.smithi071.stderr: 7f1886136640 / msgr-worker-0 2024-09-14T11:34:29.359 INFO:tasks.workunit.client.0.smithi071.stderr: 7f1886937640 / io_context_pool 2024-09-14T11:34:29.359 INFO:tasks.workunit.client.0.smithi071.stderr: 7f1887e2f9c0 / radosgw-admin 2024-09-14T11:34:29.359 INFO:tasks.workunit.client.0.smithi071.stderr: max_recent 500 2024-09-14T11:34:29.359 INFO:tasks.workunit.client.0.smithi071.stderr: max_new 1000 2024-09-14T11:34:29.359 INFO:tasks.workunit.client.0.smithi071.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:34:29.243720Z_79dbb032-9812-4061-824e-d96e5d4bda5a/log 2024-09-14T11:34:29.359 INFO:tasks.workunit.client.0.smithi071.stderr:--- end dump of recent events --- 2024-09-14T11:34:29.359 INFO:tasks.workunit.client.0.smithi071.stderr:Aborted 2024-09-14T11:34:29.359 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:34:29.362 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:29.362 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:29.362 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.320+0000 7f51636509c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.362 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.324+0000 7f51636509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.362 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.324+0000 7f51636509c0 20 realm 2024-09-14T11:34:29.362 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.324+0000 7f51636509c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.362 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.324+0000 7f51636509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.362 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.324+0000 7f51636509c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:29.362 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.324+0000 7f51636509c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.362 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.324+0000 7f51636509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.362 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.324+0000 7f51636509c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.362 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.324+0000 7f51636509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:29.362 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.324+0000 7f51636509c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.324+0000 7f51636509c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:29.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.324+0000 7f51636509c0 20 searching for the correct realm 2024-09-14T11:34:29.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.328+0000 7f5161957640 0 -- 172.21.15.71:0/926649816 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f5158017070 msgr2=0x7f515808d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:29.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.336+0000 7f5161957640 0 -- 172.21.15.71:0/926649816 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55718fb2c7c0 msgr2=0x55718fb2ebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:29.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.344+0000 7f51636509c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:29.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.344+0000 7f51636509c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:34:29.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.344+0000 7f51636509c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:29.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.344+0000 7f51636509c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:34:29.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.344+0000 7f51636509c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:29.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.344+0000 7f51636509c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:29.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.344+0000 7f51636509c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.344+0000 7f51636509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.344+0000 7f51636509c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.344+0000 7f51636509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:29.363 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.344+0000 7f51636509c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.364 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.344+0000 7f51636509c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:29.364 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.344+0000 7f51636509c0 20 zone default found 2024-09-14T11:34:29.364 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.344+0000 7f51636509c0 4 Realm: () 2024-09-14T11:34:29.364 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.344+0000 7f51636509c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:34:29.364 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.344+0000 7f51636509c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:34:29.364 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.344+0000 7f51636509c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:29.364 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.344+0000 7f51636509c0 20 zonegroup default 2024-09-14T11:34:29.364 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.344+0000 7f51636509c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.364 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.348+0000 7f51636509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.364 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.348+0000 7f51636509c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.364 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.348+0000 7f51636509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.364 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.348+0000 7f51636509c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.364 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.348+0000 7f51636509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.364 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.348+0000 7f51636509c0 20 started sync module instance, tier type = 2024-09-14T11:34:29.364 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.348+0000 7f51636509c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:34:29.365 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.364+0000 7f51636509c0 20 add_watcher() i=0 2024-09-14T11:34:29.365 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.364+0000 7f51636509c0 20 add_watcher() i=1 2024-09-14T11:34:29.365 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.364+0000 7f51636509c0 20 add_watcher() i=2 2024-09-14T11:34:29.365 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.364+0000 7f51636509c0 20 add_watcher() i=3 2024-09-14T11:34:29.365 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.364+0000 7f51636509c0 20 add_watcher() i=4 2024-09-14T11:34:29.365 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.364+0000 7f51636509c0 20 add_watcher() i=5 2024-09-14T11:34:29.365 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.364+0000 7f51636509c0 20 add_watcher() i=6 2024-09-14T11:34:29.366 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.368+0000 7f51636509c0 20 add_watcher() i=7 2024-09-14T11:34:29.366 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.368+0000 7f51636509c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:29.369 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.372+0000 7f50177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:29.370 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.372+0000 7f51636509c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:29.370 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.372+0000 7f51636509c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:29.370 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.372+0000 7f51636509c0 5 note: GC not initialized 2024-09-14T11:34:29.370 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.372+0000 7f50167e4640 20 reqs_thread_entry: start 2024-09-14T11:34:29.370 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.372+0000 7f51636509c0 20 init_complete bucket index max shards: 11 2024-09-14T11:34:29.370 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.372+0000 7f51636509c0 20 Filter name: none 2024-09-14T11:34:29.370 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.372+0000 7f4f87fff640 20 reqs_thread_entry: start 2024-09-14T11:34:29.370 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.372+0000 7f51636509c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.371 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.372+0000 7f51636509c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:29.371 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.372+0000 7f51636509c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.371 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.372+0000 7f51636509c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:34:29.371 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.372+0000 7f51636509c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:29.371 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.372+0000 7f51636509c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.372 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.372+0000 7f51636509c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:29.372 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.372+0000 7f51636509c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.372 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.372+0000 7f51636509c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:34:29.372 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.372+0000 7f51636509c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:29.374 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.376+0000 7f50177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:29.378 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.380+0000 7f51636509c0 20 remove_watcher() i=0 2024-09-14T11:34:29.378 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.380+0000 7f51636509c0 2 removed watcher, disabling cache 2024-09-14T11:34:29.380 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.380+0000 7f51636509c0 20 remove_watcher() i=1 2024-09-14T11:34:29.382 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.384+0000 7f51636509c0 20 remove_watcher() i=2 2024-09-14T11:34:29.384 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.384+0000 7f51636509c0 20 remove_watcher() i=3 2024-09-14T11:34:29.386 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.388+0000 7f51636509c0 20 remove_watcher() i=4 2024-09-14T11:34:29.388 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.392+0000 7f51636509c0 20 remove_watcher() i=5 2024-09-14T11:34:29.391 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.392+0000 7f51636509c0 20 remove_watcher() i=6 2024-09-14T11:34:29.394 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.396+0000 7f51636509c0 20 remove_watcher() i=7 2024-09-14T11:34:29.419 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:34:29.448 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:29.448 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:29.492 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.492+0000 7f8611a2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.496+0000 7f8611a2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.496+0000 7f8611a2f9c0 20 realm 2024-09-14T11:34:29.494 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.496+0000 7f8611a2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.496+0000 7f8611a2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.496+0000 7f8611a2f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:29.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.496+0000 7f8611a2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.496+0000 7f8611a2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.495 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.496+0000 7f8611a2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.496+0000 7f8611a2f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:29.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.496+0000 7f8611a2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.496 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.500+0000 7f8611a2f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:29.497 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.500+0000 7f8611a2f9c0 20 searching for the correct realm 2024-09-14T11:34:29.500 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.504+0000 7f860fd36640 0 -- 172.21.15.71:0/3120874091 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f86041080c0 msgr2=0x7f8604135040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:29.716 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.716+0000 7f860fd36640 0 -- 172.21.15.71:0/3120874091 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x56220b5c5170 msgr2=0x56220b5c7560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:29.732 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.732+0000 7f8611a2f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:29.732 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.732+0000 7f8611a2f9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:34:29.732 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.732+0000 7f8611a2f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:29.732 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.732+0000 7f8611a2f9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:34:29.732 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.732+0000 7f8611a2f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:29.732 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.732+0000 7f8611a2f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:29.732 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.732+0000 7f8611a2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.732 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.736+0000 7f8611a2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.733 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.736+0000 7f8611a2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.733 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.736+0000 7f8611a2f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:29.733 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.736+0000 7f8611a2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.736+0000 7f8611a2f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:29.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.736+0000 7f8611a2f9c0 20 zone default found 2024-09-14T11:34:29.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.736+0000 7f8611a2f9c0 4 Realm: () 2024-09-14T11:34:29.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.736+0000 7f8611a2f9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:34:29.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.736+0000 7f8611a2f9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:34:29.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.736+0000 7f8611a2f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:29.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.736+0000 7f8611a2f9c0 20 zonegroup default 2024-09-14T11:34:29.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.736+0000 7f8611a2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.736+0000 7f8611a2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.736+0000 7f8611a2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.740+0000 7f8611a2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.740+0000 7f8611a2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.740+0000 7f8611a2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.740+0000 7f8611a2f9c0 20 started sync module instance, tier type = 2024-09-14T11:34:29.737 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.740+0000 7f8611a2f9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:34:29.760 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.760+0000 7f8611a2f9c0 20 add_watcher() i=0 2024-09-14T11:34:29.760 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.760+0000 7f8611a2f9c0 20 add_watcher() i=1 2024-09-14T11:34:29.760 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.760+0000 7f8611a2f9c0 20 add_watcher() i=2 2024-09-14T11:34:29.760 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.760+0000 7f8611a2f9c0 20 add_watcher() i=3 2024-09-14T11:34:29.760 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.760+0000 7f8611a2f9c0 20 add_watcher() i=4 2024-09-14T11:34:29.760 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.760+0000 7f8611a2f9c0 20 add_watcher() i=5 2024-09-14T11:34:29.761 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.760+0000 7f8611a2f9c0 20 add_watcher() i=6 2024-09-14T11:34:29.763 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.764+0000 7f8611a2f9c0 20 add_watcher() i=7 2024-09-14T11:34:29.763 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.764+0000 7f8611a2f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:29.766 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.768+0000 7f84c67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:29.767 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.768+0000 7f8611a2f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:29.767 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.768+0000 7f8611a2f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:29.767 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.768+0000 7f8611a2f9c0 5 note: GC not initialized 2024-09-14T11:34:29.768 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.768+0000 7f84c57e2640 20 reqs_thread_entry: start 2024-09-14T11:34:29.768 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.768+0000 7f8611a2f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:34:29.768 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.768+0000 7f8611a2f9c0 20 Filter name: none 2024-09-14T11:34:29.768 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.772+0000 7f84be7fc640 20 reqs_thread_entry: start 2024-09-14T11:34:29.768 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.772+0000 7f8611a2f9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:34:29.769 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.772+0000 7f8611a2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.769 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.772+0000 7f8611a2f9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:29.769 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.772+0000 7f8611a2f9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:34:29.769 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.772+0000 7f8611a2f9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:34:29.769 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.772+0000 7f8611a2f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 : miss 2024-09-14T11:34:29.769 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.772+0000 7f8611a2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.770 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.772+0000 7f8611a2f9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:34:29.770 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.772+0000 7f8611a2f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:34:29.770 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.772+0000 7f8611a2f9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:34:29.770 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.772+0000 7f8611a2f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:29.770 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.772+0000 7f8611a2f9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:29.770 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.772+0000 7f8611a2f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 2024-09-14T11:34:29.770 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.772+0000 7f8611a2f9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.0 2024-09-14T11:34:29.771 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.772+0000 7f8611a2f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.0 2024-09-14T11:34:29.771 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.772+0000 7f8611a2f9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.1 2024-09-14T11:34:29.771 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.772+0000 7f8611a2f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.1 2024-09-14T11:34:29.772 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.772+0000 7f8611a2f9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.2 2024-09-14T11:34:29.772 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.772+0000 7f8611a2f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.2 2024-09-14T11:34:29.772 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.772+0000 7f8611a2f9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.3 2024-09-14T11:34:29.772 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.772+0000 7f8611a2f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.3 2024-09-14T11:34:29.772 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.776+0000 7f8611a2f9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.4 2024-09-14T11:34:29.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.776+0000 7f8611a2f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.4 2024-09-14T11:34:29.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.776+0000 7f8611a2f9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.5 2024-09-14T11:34:29.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.776+0000 7f8611a2f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.5 2024-09-14T11:34:29.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.776+0000 7f8611a2f9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.6 2024-09-14T11:34:29.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.776+0000 7f8611a2f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.6 2024-09-14T11:34:29.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.776+0000 7f8611a2f9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.7 2024-09-14T11:34:29.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.776+0000 7f8611a2f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.7 2024-09-14T11:34:29.775 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.776+0000 7f8611a2f9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.8 2024-09-14T11:34:29.775 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.776+0000 7f8611a2f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.8 2024-09-14T11:34:29.776 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.780+0000 7f8611a2f9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.9 2024-09-14T11:34:29.776 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.780+0000 7f8611a2f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.9 2024-09-14T11:34:29.776 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.780+0000 7f8611a2f9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.10 2024-09-14T11:34:29.777 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.780+0000 7f8611a2f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.10 2024-09-14T11:34:29.777 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.780+0000 7f8611a2f9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.11 2024-09-14T11:34:29.778 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.780+0000 7f8611a2f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.11 2024-09-14T11:34:29.778 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.780+0000 7f8611a2f9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.12 2024-09-14T11:34:29.779 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.780+0000 7f8611a2f9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.12 2024-09-14T11:34:29.780 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.784+0000 7f84c67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:29.785 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.788+0000 7f8611a2f9c0 20 remove_watcher() i=0 2024-09-14T11:34:29.785 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.788+0000 7f8611a2f9c0 2 removed watcher, disabling cache 2024-09-14T11:34:29.787 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.788+0000 7f8611a2f9c0 20 remove_watcher() i=1 2024-09-14T11:34:29.789 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.792+0000 7f8611a2f9c0 20 remove_watcher() i=2 2024-09-14T11:34:29.792 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.792+0000 7f8611a2f9c0 20 remove_watcher() i=3 2024-09-14T11:34:29.794 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.796+0000 7f8611a2f9c0 20 remove_watcher() i=4 2024-09-14T11:34:29.796 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.800+0000 7f8611a2f9c0 20 remove_watcher() i=5 2024-09-14T11:34:29.799 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.800+0000 7f8611a2f9c0 20 remove_watcher() i=6 2024-09-14T11:34:29.802 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:29.804+0000 7f8611a2f9c0 20 remove_watcher() i=7 2024-09-14T11:34:59.840 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-14T11:34:59.880 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:59.880 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:59.924 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.923+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:59.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.927+0000 7f34647a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:59.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.927+0000 7f34647a69c0 20 realm 2024-09-14T11:34:59.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.927+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:59.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.927+0000 7f34647a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:59.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.927+0000 7f34647a69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:59.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.927+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:59.927 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.927+0000 7f34647a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:59.928 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.927+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:59.928 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.927+0000 7f34647a69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:59.928 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.931+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:59.929 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.931+0000 7f34647a69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:59.929 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.931+0000 7f34647a69c0 20 searching for the correct realm 2024-09-14T11:34:59.933 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.935+0000 7f34622ac640 0 -- 172.21.15.71:0/1860409313 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x55abab790a50 msgr2=0x55abab792f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:59.939 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.939+0000 7f3462aad640 0 -- 172.21.15.71:0/1860409313 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55abab78bc90 msgr2=0x55abab78e0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:59.948 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.947+0000 7f34647a69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:59.948 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.947+0000 7f34647a69c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:34:59.948 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.947+0000 7f34647a69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:59.948 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.947+0000 7f34647a69c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:34:59.948 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.947+0000 7f34647a69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:59.948 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.947+0000 7f34647a69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:59.948 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.947+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:59.949 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.951+0000 7f34647a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:59.949 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.951+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:59.949 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.951+0000 7f34647a69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:59.949 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.951+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:59.949 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.951+0000 7f34647a69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:59.950 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.951+0000 7f34647a69c0 20 zone default found 2024-09-14T11:34:59.950 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.951+0000 7f34647a69c0 4 Realm: () 2024-09-14T11:34:59.950 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.951+0000 7f34647a69c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:34:59.950 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.951+0000 7f34647a69c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:34:59.950 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.951+0000 7f34647a69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:59.950 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.951+0000 7f34647a69c0 20 zonegroup default 2024-09-14T11:34:59.950 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.951+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:59.951 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.951+0000 7f34647a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:59.951 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.951+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:59.951 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.951+0000 7f34647a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:59.951 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.951+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:59.951 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.951+0000 7f34647a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:59.952 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.951+0000 7f34647a69c0 20 started sync module instance, tier type = 2024-09-14T11:34:59.952 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.951+0000 7f34647a69c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:34:59.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.971+0000 7f34647a69c0 20 add_watcher() i=0 2024-09-14T11:34:59.969 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.971+0000 7f34647a69c0 20 add_watcher() i=1 2024-09-14T11:34:59.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.971+0000 7f34647a69c0 20 add_watcher() i=2 2024-09-14T11:34:59.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.971+0000 7f34647a69c0 20 add_watcher() i=3 2024-09-14T11:34:59.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.971+0000 7f34647a69c0 20 add_watcher() i=4 2024-09-14T11:34:59.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.971+0000 7f34647a69c0 20 add_watcher() i=5 2024-09-14T11:34:59.970 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.971+0000 7f34647a69c0 20 add_watcher() i=6 2024-09-14T11:34:59.972 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.975+0000 7f34647a69c0 20 add_watcher() i=7 2024-09-14T11:34:59.972 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.975+0000 7f34647a69c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:59.976 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.975+0000 7f3318fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:59.977 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.979+0000 7f34647a69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:59.977 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.979+0000 7f34647a69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:59.977 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.979+0000 7f34647a69c0 5 note: GC not initialized 2024-09-14T11:34:59.977 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.979+0000 7f32937fe640 20 reqs_thread_entry: start 2024-09-14T11:34:59.977 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.979+0000 7f34647a69c0 20 init_complete bucket index max shards: 11 2024-09-14T11:34:59.977 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.979+0000 7f34647a69c0 20 Filter name: none 2024-09-14T11:34:59.977 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.979+0000 7f32917fa640 20 reqs_thread_entry: start 2024-09-14T11:34:59.978 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.979+0000 7f34647a69c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:34:59.978 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.979+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:59.978 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.979+0000 7f34647a69c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:59.978 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.979+0000 7f34647a69c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:34:59.978 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.979+0000 7f34647a69c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:34:59.979 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.979+0000 7f34647a69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 : miss 2024-09-14T11:34:59.979 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.979+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:59.979 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.979+0000 7f34647a69c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:34:59.979 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.979+0000 7f34647a69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:34:59.979 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.979+0000 7f34647a69c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:34:59.979 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.979+0000 7f34647a69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:59.979 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.979+0000 7f34647a69c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:59.979 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.979+0000 7f34647a69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 2024-09-14T11:34:59.980 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.983+0000 7f34647a69c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:34:59.993 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.995+0000 7f34647a69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:34:59.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.995+0000 7f34647a69c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:34:59.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.995+0000 7f34647a69c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:59.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.995+0000 7f34647a69c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18, ofs0, ns] 2024-09-14T11:34:59.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.995+0000 7f3345ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464427 cookie 94195804617664 notifier 7814 bl.length()=911 2024-09-14T11:34:59.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.995+0000 7f3345ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:34:59.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.995+0000 7f3345ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:34:59.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.995+0000 7f3345ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:59.994 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.995+0000 7f34647a69c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_sources= new_sources= 2024-09-14T11:34:59.995 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.995+0000 7f34647a69c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential sources added=[] removed=[] 2024-09-14T11:34:59.995 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.995+0000 7f34647a69c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_dests= new_dests= 2024-09-14T11:34:59.995 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:34:59.995+0000 7f34647a69c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential dests added=[] removed=[] 2024-09-14T11:35:00.001 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f34647a69c0 time 2024-09-14T11:35:00.007720+0000 2024-09-14T11:35:00.001 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:00.003 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:00.003 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f34680802eb] 2024-09-14T11:35:00.003 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f346808049f] 2024-09-14T11:35:00.003 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aba87b2c01] 2024-09-14T11:35:00.003 INFO:tasks.workunit.client.0.smithi071.stderr: 4: radosgw-admin(+0x142325c) [0x55aba921125c] 2024-09-14T11:35:00.003 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55aba87c7ecd] 2024-09-14T11:35:00.003 INFO:tasks.workunit.client.0.smithi071.stderr: 6: main() 2024-09-14T11:35:00.003 INFO:tasks.workunit.client.0.smithi071.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3466ee6d90] 2024-09-14T11:35:00.004 INFO:tasks.workunit.client.0.smithi071.stderr: 8: __libc_start_main() 2024-09-14T11:35:00.004 INFO:tasks.workunit.client.0.smithi071.stderr: 9: _start() 2024-09-14T11:35:00.004 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.003+0000 7f34647a69c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f34647a69c0 time 2024-09-14T11:35:00.007720+0000 2024-09-14T11:35:00.004 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:00.004 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.004 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:00.004 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f34680802eb] 2024-09-14T11:35:00.004 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f346808049f] 2024-09-14T11:35:00.004 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aba87b2c01] 2024-09-14T11:35:00.004 INFO:tasks.workunit.client.0.smithi071.stderr: 4: radosgw-admin(+0x142325c) [0x55aba921125c] 2024-09-14T11:35:00.004 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55aba87c7ecd] 2024-09-14T11:35:00.004 INFO:tasks.workunit.client.0.smithi071.stderr: 6: main() 2024-09-14T11:35:00.005 INFO:tasks.workunit.client.0.smithi071.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3466ee6d90] 2024-09-14T11:35:00.005 INFO:tasks.workunit.client.0.smithi071.stderr: 8: __libc_start_main() 2024-09-14T11:35:00.005 INFO:tasks.workunit.client.0.smithi071.stderr: 9: _start() 2024-09-14T11:35:00.005 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.005 INFO:tasks.workunit.client.0.smithi071.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:35:00.005 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f34647a69c0 thread_name:radosgw-admin 2024-09-14T11:35:00.023 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:00.023 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3466eff520] 2024-09-14T11:35:00.023 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:35:00.023 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:35:00.023 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:35:00.023 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3468080345] 2024-09-14T11:35:00.023 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f346808049f] 2024-09-14T11:35:00.023 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aba87b2c01] 2024-09-14T11:35:00.023 INFO:tasks.workunit.client.0.smithi071.stderr: 8: radosgw-admin(+0x142325c) [0x55aba921125c] 2024-09-14T11:35:00.023 INFO:tasks.workunit.client.0.smithi071.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55aba87c7ecd] 2024-09-14T11:35:00.023 INFO:tasks.workunit.client.0.smithi071.stderr: 10: main() 2024-09-14T11:35:00.024 INFO:tasks.workunit.client.0.smithi071.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3466ee6d90] 2024-09-14T11:35:00.024 INFO:tasks.workunit.client.0.smithi071.stderr: 12: __libc_start_main() 2024-09-14T11:35:00.024 INFO:tasks.workunit.client.0.smithi071.stderr: 13: _start() 2024-09-14T11:35:00.024 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.003+0000 7f34647a69c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:35:00.024 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f34647a69c0 thread_name:radosgw-admin 2024-09-14T11:35:00.024 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.024 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:00.024 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3466eff520] 2024-09-14T11:35:00.024 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:35:00.024 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:35:00.024 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:35:00.024 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3468080345] 2024-09-14T11:35:00.024 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f346808049f] 2024-09-14T11:35:00.024 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aba87b2c01] 2024-09-14T11:35:00.025 INFO:tasks.workunit.client.0.smithi071.stderr: 8: radosgw-admin(+0x142325c) [0x55aba921125c] 2024-09-14T11:35:00.025 INFO:tasks.workunit.client.0.smithi071.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55aba87c7ecd] 2024-09-14T11:35:00.025 INFO:tasks.workunit.client.0.smithi071.stderr: 10: main() 2024-09-14T11:35:00.025 INFO:tasks.workunit.client.0.smithi071.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3466ee6d90] 2024-09-14T11:35:00.025 INFO:tasks.workunit.client.0.smithi071.stderr: 12: __libc_start_main() 2024-09-14T11:35:00.025 INFO:tasks.workunit.client.0.smithi071.stderr: 13: _start() 2024-09-14T11:35:00.025 INFO:tasks.workunit.client.0.smithi071.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:35:00.025 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.025 INFO:tasks.workunit.client.0.smithi071.stderr:--- begin dump of recent events --- 2024-09-14T11:35:00.025 INFO:tasks.workunit.client.0.smithi071.stderr: -499> 2024-09-14T11:34:59.903+0000 7f3461aab640 10 monclient: _finish_hunting 0 2024-09-14T11:35:00.025 INFO:tasks.workunit.client.0.smithi071.stderr: -498> 2024-09-14T11:34:59.903+0000 7f3461aab640 1 monclient: found mon.noname-c 2024-09-14T11:35:00.025 INFO:tasks.workunit.client.0.smithi071.stderr: -497> 2024-09-14T11:34:59.903+0000 7f3461aab640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:35:00.025 INFO:tasks.workunit.client.0.smithi071.stderr: -496> 2024-09-14T11:34:59.903+0000 7f34622ac640 10 monclient: get_auth_request con 0x55abab54bb00 auth_method 0 2024-09-14T11:35:00.025 INFO:tasks.workunit.client.0.smithi071.stderr: -495> 2024-09-14T11:34:59.903+0000 7f3350608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:00.026 INFO:tasks.workunit.client.0.smithi071.stderr: -494> 2024-09-14T11:34:59.903+0000 7f3350608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:00.026 INFO:tasks.workunit.client.0.smithi071.stderr: -493> 2024-09-14T11:34:59.903+0000 7f3350608640 10 monclient: dump: 2024-09-14T11:35:00.026 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:00.026 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:00.026 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.026 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.026 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:00.026 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:00.026 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:00.026 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:00.026 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:00.026 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.026 INFO:tasks.workunit.client.0.smithi071.stderr: -492> 2024-09-14T11:34:59.903+0000 7f3350608640 10 monclient: _finish_auth 0 2024-09-14T11:35:00.026 INFO:tasks.workunit.client.0.smithi071.stderr: -491> 2024-09-14T11:34:59.903+0000 7f3350608640 10 monclient: _check_auth_tickets 2024-09-14T11:35:00.027 INFO:tasks.workunit.client.0.smithi071.stderr: -490> 2024-09-14T11:34:59.903+0000 7f3350608640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:00.027 INFO:tasks.workunit.client.0.smithi071.stderr: -489> 2024-09-14T11:34:59.903+0000 7f3350608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:00.027 INFO:tasks.workunit.client.0.smithi071.stderr: -488> 2024-09-14T11:34:59.903+0000 7f3350608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:00.027 INFO:tasks.workunit.client.0.smithi071.stderr: -487> 2024-09-14T11:34:59.903+0000 7f3350608640 10 monclient: dump: 2024-09-14T11:35:00.027 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:00.027 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:00.027 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.027 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.027 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:00.027 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:00.027 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:00.027 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:00.027 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:00.027 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.028 INFO:tasks.workunit.client.0.smithi071.stderr: -486> 2024-09-14T11:34:59.903+0000 7f34647a69c0 5 monclient: authenticate success, global_id 7802 2024-09-14T11:35:00.028 INFO:tasks.workunit.client.0.smithi071.stderr: -485> 2024-09-14T11:34:59.903+0000 7f34647a69c0 10 monclient: get_monmap_and_config success 2024-09-14T11:35:00.028 INFO:tasks.workunit.client.0.smithi071.stderr: -484> 2024-09-14T11:34:59.903+0000 7f34647a69c0 4 set_mon_vals no callback set 2024-09-14T11:35:00.028 INFO:tasks.workunit.client.0.smithi071.stderr: -483> 2024-09-14T11:34:59.903+0000 7f34647a69c0 10 monclient: shutdown 2024-09-14T11:35:00.028 INFO:tasks.workunit.client.0.smithi071.stderr: -482> 2024-09-14T11:34:59.903+0000 7f34647a69c0 5 asok(0x55abab48dd90) unregister_commands rotate-key 2024-09-14T11:35:00.028 INFO:tasks.workunit.client.0.smithi071.stderr: -481> 2024-09-14T11:34:59.903+0000 7f34647a69c0 10 monclient: build_initial_monmap 2024-09-14T11:35:00.028 INFO:tasks.workunit.client.0.smithi071.stderr: -480> 2024-09-14T11:34:59.903+0000 7f34647a69c0 1 build_initial for_mkfs: 0 2024-09-14T11:35:00.028 INFO:tasks.workunit.client.0.smithi071.stderr: -479> 2024-09-14T11:34:59.903+0000 7f34647a69c0 10 monclient: monmap: 2024-09-14T11:35:00.028 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:35:00.028 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:00.028 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:35:00.028 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:35:00.028 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:00.028 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:00.029 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:35:00.029 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:35:00.029 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:35:00.029 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.029 INFO:tasks.workunit.client.0.smithi071.stderr: -478> 2024-09-14T11:34:59.903+0000 7f34647a69c0 5 AuthRegistry(0x55abab699f30) adding auth protocol: cephx 2024-09-14T11:35:00.029 INFO:tasks.workunit.client.0.smithi071.stderr: -477> 2024-09-14T11:34:59.903+0000 7f34647a69c0 5 AuthRegistry(0x55abab699f30) adding auth protocol: cephx 2024-09-14T11:35:00.029 INFO:tasks.workunit.client.0.smithi071.stderr: -476> 2024-09-14T11:34:59.903+0000 7f34647a69c0 5 AuthRegistry(0x55abab699f30) adding auth protocol: cephx 2024-09-14T11:35:00.029 INFO:tasks.workunit.client.0.smithi071.stderr: -475> 2024-09-14T11:34:59.903+0000 7f34647a69c0 5 AuthRegistry(0x55abab699f30) adding con mode: secure 2024-09-14T11:35:00.029 INFO:tasks.workunit.client.0.smithi071.stderr: -474> 2024-09-14T11:34:59.903+0000 7f34647a69c0 5 AuthRegistry(0x55abab699f30) adding con mode: crc 2024-09-14T11:35:00.029 INFO:tasks.workunit.client.0.smithi071.stderr: -473> 2024-09-14T11:34:59.903+0000 7f34647a69c0 5 AuthRegistry(0x55abab699f30) adding con mode: secure 2024-09-14T11:35:00.029 INFO:tasks.workunit.client.0.smithi071.stderr: -472> 2024-09-14T11:34:59.903+0000 7f34647a69c0 5 AuthRegistry(0x55abab699f30) adding con mode: crc 2024-09-14T11:35:00.029 INFO:tasks.workunit.client.0.smithi071.stderr: -471> 2024-09-14T11:34:59.903+0000 7f34647a69c0 5 AuthRegistry(0x55abab699f30) adding con mode: secure 2024-09-14T11:35:00.029 INFO:tasks.workunit.client.0.smithi071.stderr: -470> 2024-09-14T11:34:59.903+0000 7f34647a69c0 5 AuthRegistry(0x55abab699f30) adding con mode: crc 2024-09-14T11:35:00.030 INFO:tasks.workunit.client.0.smithi071.stderr: -469> 2024-09-14T11:34:59.903+0000 7f34647a69c0 5 AuthRegistry(0x55abab699f30) adding con mode: crc 2024-09-14T11:35:00.030 INFO:tasks.workunit.client.0.smithi071.stderr: -468> 2024-09-14T11:34:59.903+0000 7f34647a69c0 5 AuthRegistry(0x55abab699f30) adding con mode: secure 2024-09-14T11:35:00.030 INFO:tasks.workunit.client.0.smithi071.stderr: -467> 2024-09-14T11:34:59.903+0000 7f34647a69c0 5 AuthRegistry(0x55abab699f30) adding con mode: crc 2024-09-14T11:35:00.030 INFO:tasks.workunit.client.0.smithi071.stderr: -466> 2024-09-14T11:34:59.903+0000 7f34647a69c0 5 AuthRegistry(0x55abab699f30) adding con mode: secure 2024-09-14T11:35:00.030 INFO:tasks.workunit.client.0.smithi071.stderr: -465> 2024-09-14T11:34:59.903+0000 7f34647a69c0 5 AuthRegistry(0x55abab699f30) adding con mode: crc 2024-09-14T11:35:00.030 INFO:tasks.workunit.client.0.smithi071.stderr: -464> 2024-09-14T11:34:59.903+0000 7f34647a69c0 5 AuthRegistry(0x55abab699f30) adding con mode: secure 2024-09-14T11:35:00.030 INFO:tasks.workunit.client.0.smithi071.stderr: -463> 2024-09-14T11:34:59.907+0000 7f34647a69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:00.030 INFO:tasks.workunit.client.0.smithi071.stderr: -462> 2024-09-14T11:34:59.907+0000 7f34647a69c0 1 librados: starting msgr at 2024-09-14T11:35:00.030 INFO:tasks.workunit.client.0.smithi071.stderr: -461> 2024-09-14T11:34:59.907+0000 7f34647a69c0 1 librados: starting objecter 2024-09-14T11:35:00.030 INFO:tasks.workunit.client.0.smithi071.stderr: -460> 2024-09-14T11:34:59.907+0000 7f34647a69c0 5 asok(0x55abab48dd90) register_command objecter_requests hook 0x55abab6c6670 2024-09-14T11:35:00.030 INFO:tasks.workunit.client.0.smithi071.stderr: -459> 2024-09-14T11:34:59.907+0000 7f34647a69c0 1 librados: setting wanted keys 2024-09-14T11:35:00.030 INFO:tasks.workunit.client.0.smithi071.stderr: -458> 2024-09-14T11:34:59.907+0000 7f34647a69c0 1 librados: calling monclient init 2024-09-14T11:35:00.030 INFO:tasks.workunit.client.0.smithi071.stderr: -457> 2024-09-14T11:34:59.907+0000 7f34647a69c0 10 monclient: init 2024-09-14T11:35:00.030 INFO:tasks.workunit.client.0.smithi071.stderr: -456> 2024-09-14T11:34:59.907+0000 7f34647a69c0 5 AuthRegistry(0x55abab698140) adding auth protocol: cephx 2024-09-14T11:35:00.031 INFO:tasks.workunit.client.0.smithi071.stderr: -455> 2024-09-14T11:34:59.907+0000 7f34647a69c0 5 AuthRegistry(0x55abab698140) adding auth protocol: cephx 2024-09-14T11:35:00.031 INFO:tasks.workunit.client.0.smithi071.stderr: -454> 2024-09-14T11:34:59.907+0000 7f34647a69c0 5 AuthRegistry(0x55abab698140) adding auth protocol: cephx 2024-09-14T11:35:00.031 INFO:tasks.workunit.client.0.smithi071.stderr: -453> 2024-09-14T11:34:59.907+0000 7f34647a69c0 5 AuthRegistry(0x55abab698140) adding con mode: secure 2024-09-14T11:35:00.031 INFO:tasks.workunit.client.0.smithi071.stderr: -452> 2024-09-14T11:34:59.907+0000 7f34647a69c0 5 AuthRegistry(0x55abab698140) adding con mode: crc 2024-09-14T11:35:00.031 INFO:tasks.workunit.client.0.smithi071.stderr: -451> 2024-09-14T11:34:59.907+0000 7f34647a69c0 5 AuthRegistry(0x55abab698140) adding con mode: secure 2024-09-14T11:35:00.031 INFO:tasks.workunit.client.0.smithi071.stderr: -450> 2024-09-14T11:34:59.907+0000 7f34647a69c0 5 AuthRegistry(0x55abab698140) adding con mode: crc 2024-09-14T11:35:00.031 INFO:tasks.workunit.client.0.smithi071.stderr: -449> 2024-09-14T11:34:59.907+0000 7f34647a69c0 5 AuthRegistry(0x55abab698140) adding con mode: secure 2024-09-14T11:35:00.031 INFO:tasks.workunit.client.0.smithi071.stderr: -448> 2024-09-14T11:34:59.907+0000 7f34647a69c0 5 AuthRegistry(0x55abab698140) adding con mode: crc 2024-09-14T11:35:00.031 INFO:tasks.workunit.client.0.smithi071.stderr: -447> 2024-09-14T11:34:59.907+0000 7f34647a69c0 5 AuthRegistry(0x55abab698140) adding con mode: crc 2024-09-14T11:35:00.031 INFO:tasks.workunit.client.0.smithi071.stderr: -446> 2024-09-14T11:34:59.907+0000 7f34647a69c0 5 AuthRegistry(0x55abab698140) adding con mode: secure 2024-09-14T11:35:00.031 INFO:tasks.workunit.client.0.smithi071.stderr: -445> 2024-09-14T11:34:59.907+0000 7f34647a69c0 5 AuthRegistry(0x55abab698140) adding con mode: crc 2024-09-14T11:35:00.031 INFO:tasks.workunit.client.0.smithi071.stderr: -444> 2024-09-14T11:34:59.907+0000 7f34647a69c0 5 AuthRegistry(0x55abab698140) adding con mode: secure 2024-09-14T11:35:00.031 INFO:tasks.workunit.client.0.smithi071.stderr: -443> 2024-09-14T11:34:59.907+0000 7f34647a69c0 5 AuthRegistry(0x55abab698140) adding con mode: crc 2024-09-14T11:35:00.031 INFO:tasks.workunit.client.0.smithi071.stderr: -442> 2024-09-14T11:34:59.907+0000 7f34647a69c0 5 AuthRegistry(0x55abab698140) adding con mode: secure 2024-09-14T11:35:00.031 INFO:tasks.workunit.client.0.smithi071.stderr: -441> 2024-09-14T11:34:59.907+0000 7f34647a69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:00.031 INFO:tasks.workunit.client.0.smithi071.stderr: -440> 2024-09-14T11:34:59.907+0000 7f34647a69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:00.032 INFO:tasks.workunit.client.0.smithi071.stderr: -439> 2024-09-14T11:34:59.907+0000 7f34647a69c0 5 asok(0x55abab48dd90) register_command rotate-key hook 0x55abab698288 2024-09-14T11:35:00.032 INFO:tasks.workunit.client.0.smithi071.stderr: -438> 2024-09-14T11:34:59.907+0000 7f34647a69c0 10 monclient: _reopen_session rank -1 2024-09-14T11:35:00.032 INFO:tasks.workunit.client.0.smithi071.stderr: -437> 2024-09-14T11:34:59.907+0000 7f34647a69c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:35:00.032 INFO:tasks.workunit.client.0.smithi071.stderr: -436> 2024-09-14T11:34:59.907+0000 7f34647a69c0 10 monclient(hunting): picked mon.noname-c con 0x55abab54bb00 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:35:00.032 INFO:tasks.workunit.client.0.smithi071.stderr: -435> 2024-09-14T11:34:59.907+0000 7f34647a69c0 10 monclient(hunting): picked mon.noname-a con 0x55abab557870 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:35:00.032 INFO:tasks.workunit.client.0.smithi071.stderr: -434> 2024-09-14T11:34:59.907+0000 7f34647a69c0 10 monclient(hunting): picked mon.noname-b con 0x55abab69e7e0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:35:00.032 INFO:tasks.workunit.client.0.smithi071.stderr: -433> 2024-09-14T11:34:59.907+0000 7f34647a69c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:00.032 INFO:tasks.workunit.client.0.smithi071.stderr: -432> 2024-09-14T11:34:59.907+0000 7f34647a69c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:00.032 INFO:tasks.workunit.client.0.smithi071.stderr: -431> 2024-09-14T11:34:59.907+0000 7f34647a69c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:00.032 INFO:tasks.workunit.client.0.smithi071.stderr: -430> 2024-09-14T11:34:59.907+0000 7f34647a69c0 10 monclient(hunting): _renew_subs 2024-09-14T11:35:00.032 INFO:tasks.workunit.client.0.smithi071.stderr: -429> 2024-09-14T11:34:59.907+0000 7f34647a69c0 10 monclient(hunting): authenticate will time out at 2512.029077s 2024-09-14T11:35:00.032 INFO:tasks.workunit.client.0.smithi071.stderr: -428> 2024-09-14T11:34:59.907+0000 7f3461aab640 10 monclient(hunting): get_auth_request con 0x55abab557870 auth_method 0 2024-09-14T11:35:00.032 INFO:tasks.workunit.client.0.smithi071.stderr: -427> 2024-09-14T11:34:59.907+0000 7f3461aab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:00.033 INFO:tasks.workunit.client.0.smithi071.stderr: -426> 2024-09-14T11:34:59.907+0000 7f3461aab640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:00.033 INFO:tasks.workunit.client.0.smithi071.stderr: -425> 2024-09-14T11:34:59.907+0000 7f3461aab640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:00.033 INFO:tasks.workunit.client.0.smithi071.stderr: -424> 2024-09-14T11:34:59.907+0000 7f34622ac640 10 monclient(hunting): get_auth_request con 0x55abab54bb00 auth_method 0 2024-09-14T11:35:00.033 INFO:tasks.workunit.client.0.smithi071.stderr: -423> 2024-09-14T11:34:59.907+0000 7f34622ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:00.033 INFO:tasks.workunit.client.0.smithi071.stderr: -422> 2024-09-14T11:34:59.907+0000 7f34622ac640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:00.033 INFO:tasks.workunit.client.0.smithi071.stderr: -421> 2024-09-14T11:34:59.907+0000 7f34622ac640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:00.033 INFO:tasks.workunit.client.0.smithi071.stderr: -420> 2024-09-14T11:34:59.907+0000 7f3461aab640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:00.033 INFO:tasks.workunit.client.0.smithi071.stderr: -419> 2024-09-14T11:34:59.907+0000 7f3461aab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:00.033 INFO:tasks.workunit.client.0.smithi071.stderr: -418> 2024-09-14T11:34:59.907+0000 7f3461aab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:00.033 INFO:tasks.workunit.client.0.smithi071.stderr: -417> 2024-09-14T11:34:59.907+0000 7f34622ac640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:00.033 INFO:tasks.workunit.client.0.smithi071.stderr: -416> 2024-09-14T11:34:59.907+0000 7f34622ac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:00.033 INFO:tasks.workunit.client.0.smithi071.stderr: -415> 2024-09-14T11:34:59.907+0000 7f34622ac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:00.033 INFO:tasks.workunit.client.0.smithi071.stderr: -414> 2024-09-14T11:34:59.907+0000 7f3461aab640 10 monclient(hunting): handle_auth_done global_id 8220 payload 824 2024-09-14T11:35:00.033 INFO:tasks.workunit.client.0.smithi071.stderr: -413> 2024-09-14T11:34:59.907+0000 7f3461aab640 10 monclient: _finish_hunting 0 2024-09-14T11:35:00.034 INFO:tasks.workunit.client.0.smithi071.stderr: -412> 2024-09-14T11:34:59.907+0000 7f3461aab640 1 monclient: found mon.noname-a 2024-09-14T11:35:00.034 INFO:tasks.workunit.client.0.smithi071.stderr: -411> 2024-09-14T11:34:59.907+0000 7f3461aab640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:35:00.034 INFO:tasks.workunit.client.0.smithi071.stderr: -410> 2024-09-14T11:34:59.907+0000 7f334ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:00.034 INFO:tasks.workunit.client.0.smithi071.stderr: -409> 2024-09-14T11:34:59.907+0000 7f334ee05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:00.034 INFO:tasks.workunit.client.0.smithi071.stderr: -408> 2024-09-14T11:34:59.907+0000 7f334ee05640 10 monclient: dump: 2024-09-14T11:35:00.034 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:00.034 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:00.034 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.034 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.034 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:00.034 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:00.034 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:00.034 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:00.034 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:00.034 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.035 INFO:tasks.workunit.client.0.smithi071.stderr: -407> 2024-09-14T11:34:59.907+0000 7f334ee05640 10 monclient: _finish_auth 0 2024-09-14T11:35:00.035 INFO:tasks.workunit.client.0.smithi071.stderr: -406> 2024-09-14T11:34:59.907+0000 7f334ee05640 10 monclient: _check_auth_tickets 2024-09-14T11:35:00.035 INFO:tasks.workunit.client.0.smithi071.stderr: -405> 2024-09-14T11:34:59.907+0000 7f34647a69c0 5 monclient: authenticate success, global_id 8220 2024-09-14T11:35:00.035 INFO:tasks.workunit.client.0.smithi071.stderr: -404> 2024-09-14T11:34:59.907+0000 7f34647a69c0 10 monclient: _renew_subs 2024-09-14T11:35:00.035 INFO:tasks.workunit.client.0.smithi071.stderr: -403> 2024-09-14T11:34:59.907+0000 7f34647a69c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:35:00.035 INFO:tasks.workunit.client.0.smithi071.stderr: -402> 2024-09-14T11:34:59.907+0000 7f34647a69c0 10 monclient: _renew_subs 2024-09-14T11:35:00.035 INFO:tasks.workunit.client.0.smithi071.stderr: -401> 2024-09-14T11:34:59.907+0000 7f34647a69c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:35:00.035 INFO:tasks.workunit.client.0.smithi071.stderr: -400> 2024-09-14T11:34:59.907+0000 7f34647a69c0 1 librados: init done 2024-09-14T11:35:00.035 INFO:tasks.workunit.client.0.smithi071.stderr: -399> 2024-09-14T11:34:59.907+0000 7f334ee05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:00.035 INFO:tasks.workunit.client.0.smithi071.stderr: -398> 2024-09-14T11:34:59.907+0000 7f334ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:00.035 INFO:tasks.workunit.client.0.smithi071.stderr: -397> 2024-09-14T11:34:59.907+0000 7f334ee05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:00.035 INFO:tasks.workunit.client.0.smithi071.stderr: -396> 2024-09-14T11:34:59.907+0000 7f334ee05640 10 monclient: dump: 2024-09-14T11:35:00.035 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:00.036 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:00.036 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.036 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.036 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:00.036 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:00.036 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:00.036 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:00.036 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:00.036 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.036 INFO:tasks.workunit.client.0.smithi071.stderr: -395> 2024-09-14T11:34:59.907+0000 7f3350608640 4 set_mon_vals no callback set 2024-09-14T11:35:00.036 INFO:tasks.workunit.client.0.smithi071.stderr: -394> 2024-09-14T11:34:59.907+0000 7f334ee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:00.036 INFO:tasks.workunit.client.0.smithi071.stderr: -393> 2024-09-14T11:34:59.907+0000 7f334ee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:35:00.036 INFO:tasks.workunit.client.0.smithi071.stderr: -392> 2024-09-14T11:34:59.907+0000 7f334ee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:35:00.037 INFO:tasks.workunit.client.0.smithi071.stderr: -391> 2024-09-14T11:34:59.911+0000 7f34622ac640 10 monclient: get_auth_request con 0x7f33480718d0 auth_method 0 2024-09-14T11:35:00.037 INFO:tasks.workunit.client.0.smithi071.stderr: -390> 2024-09-14T11:34:59.911+0000 7f3462aad640 10 monclient: get_auth_request con 0x55abab6c0600 auth_method 0 2024-09-14T11:35:00.037 INFO:tasks.workunit.client.0.smithi071.stderr: -389> 2024-09-14T11:34:59.911+0000 7f34622ac640 10 monclient: get_auth_request con 0x55abab6e30b0 auth_method 0 2024-09-14T11:35:00.037 INFO:tasks.workunit.client.0.smithi071.stderr: -388> 2024-09-14T11:34:59.911+0000 7f3461aab640 10 monclient: get_auth_request con 0x55abab6e7540 auth_method 0 2024-09-14T11:35:00.037 INFO:tasks.workunit.client.0.smithi071.stderr: -387> 2024-09-14T11:34:59.915+0000 7f3462aad640 10 monclient: get_auth_request con 0x55abab6eb580 auth_method 0 2024-09-14T11:35:00.037 INFO:tasks.workunit.client.0.smithi071.stderr: -386> 2024-09-14T11:34:59.915+0000 7f34647a69c0 10 monclient: build_initial_monmap 2024-09-14T11:35:00.037 INFO:tasks.workunit.client.0.smithi071.stderr: -385> 2024-09-14T11:34:59.915+0000 7f34647a69c0 1 build_initial for_mkfs: 0 2024-09-14T11:35:00.037 INFO:tasks.workunit.client.0.smithi071.stderr: -384> 2024-09-14T11:34:59.915+0000 7f34647a69c0 10 monclient: monmap: 2024-09-14T11:35:00.037 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:35:00.037 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:00.037 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:35:00.037 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:35:00.038 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:00.038 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:00.038 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:35:00.038 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:35:00.038 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:35:00.038 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.038 INFO:tasks.workunit.client.0.smithi071.stderr: -383> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ef740) adding auth protocol: cephx 2024-09-14T11:35:00.038 INFO:tasks.workunit.client.0.smithi071.stderr: -382> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ef740) adding auth protocol: cephx 2024-09-14T11:35:00.038 INFO:tasks.workunit.client.0.smithi071.stderr: -381> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ef740) adding auth protocol: cephx 2024-09-14T11:35:00.038 INFO:tasks.workunit.client.0.smithi071.stderr: -380> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ef740) adding con mode: secure 2024-09-14T11:35:00.038 INFO:tasks.workunit.client.0.smithi071.stderr: -379> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ef740) adding con mode: crc 2024-09-14T11:35:00.038 INFO:tasks.workunit.client.0.smithi071.stderr: -378> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ef740) adding con mode: secure 2024-09-14T11:35:00.038 INFO:tasks.workunit.client.0.smithi071.stderr: -377> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ef740) adding con mode: crc 2024-09-14T11:35:00.038 INFO:tasks.workunit.client.0.smithi071.stderr: -376> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ef740) adding con mode: secure 2024-09-14T11:35:00.039 INFO:tasks.workunit.client.0.smithi071.stderr: -375> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ef740) adding con mode: crc 2024-09-14T11:35:00.039 INFO:tasks.workunit.client.0.smithi071.stderr: -374> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ef740) adding con mode: crc 2024-09-14T11:35:00.039 INFO:tasks.workunit.client.0.smithi071.stderr: -373> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ef740) adding con mode: secure 2024-09-14T11:35:00.039 INFO:tasks.workunit.client.0.smithi071.stderr: -372> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ef740) adding con mode: crc 2024-09-14T11:35:00.039 INFO:tasks.workunit.client.0.smithi071.stderr: -371> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ef740) adding con mode: secure 2024-09-14T11:35:00.039 INFO:tasks.workunit.client.0.smithi071.stderr: -370> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ef740) adding con mode: crc 2024-09-14T11:35:00.039 INFO:tasks.workunit.client.0.smithi071.stderr: -369> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ef740) adding con mode: secure 2024-09-14T11:35:00.039 INFO:tasks.workunit.client.0.smithi071.stderr: -368> 2024-09-14T11:34:59.915+0000 7f34647a69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:00.039 INFO:tasks.workunit.client.0.smithi071.stderr: -367> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 asok(0x55abab48dd90) register_command objecter_requests cmddesc objecter_requests hook 0x55abab6f3060 EEXIST 2024-09-14T11:35:00.039 INFO:tasks.workunit.client.0.smithi071.stderr: -366> 2024-09-14T11:34:59.915+0000 7f34647a69c0 10 monclient: init 2024-09-14T11:35:00.039 INFO:tasks.workunit.client.0.smithi071.stderr: -365> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ee598) adding auth protocol: cephx 2024-09-14T11:35:00.039 INFO:tasks.workunit.client.0.smithi071.stderr: -364> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ee598) adding auth protocol: cephx 2024-09-14T11:35:00.039 INFO:tasks.workunit.client.0.smithi071.stderr: -363> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ee598) adding auth protocol: cephx 2024-09-14T11:35:00.039 INFO:tasks.workunit.client.0.smithi071.stderr: -362> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ee598) adding con mode: secure 2024-09-14T11:35:00.039 INFO:tasks.workunit.client.0.smithi071.stderr: -361> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ee598) adding con mode: crc 2024-09-14T11:35:00.040 INFO:tasks.workunit.client.0.smithi071.stderr: -360> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ee598) adding con mode: secure 2024-09-14T11:35:00.040 INFO:tasks.workunit.client.0.smithi071.stderr: -359> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ee598) adding con mode: crc 2024-09-14T11:35:00.040 INFO:tasks.workunit.client.0.smithi071.stderr: -358> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ee598) adding con mode: secure 2024-09-14T11:35:00.040 INFO:tasks.workunit.client.0.smithi071.stderr: -357> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ee598) adding con mode: crc 2024-09-14T11:35:00.040 INFO:tasks.workunit.client.0.smithi071.stderr: -356> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ee598) adding con mode: crc 2024-09-14T11:35:00.040 INFO:tasks.workunit.client.0.smithi071.stderr: -355> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ee598) adding con mode: secure 2024-09-14T11:35:00.040 INFO:tasks.workunit.client.0.smithi071.stderr: -354> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ee598) adding con mode: crc 2024-09-14T11:35:00.040 INFO:tasks.workunit.client.0.smithi071.stderr: -353> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ee598) adding con mode: secure 2024-09-14T11:35:00.040 INFO:tasks.workunit.client.0.smithi071.stderr: -352> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ee598) adding con mode: crc 2024-09-14T11:35:00.040 INFO:tasks.workunit.client.0.smithi071.stderr: -351> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ee598) adding con mode: secure 2024-09-14T11:35:00.040 INFO:tasks.workunit.client.0.smithi071.stderr: -350> 2024-09-14T11:34:59.915+0000 7f34647a69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:00.040 INFO:tasks.workunit.client.0.smithi071.stderr: -349> 2024-09-14T11:34:59.915+0000 7f34647a69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:00.041 INFO:tasks.workunit.client.0.smithi071.stderr: -348> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 asok(0x55abab48dd90) register_command rotate-key cmddesc rotate-key hook 0x55abab6ee6e0 EEXIST 2024-09-14T11:35:00.041 INFO:tasks.workunit.client.0.smithi071.stderr: -347> 2024-09-14T11:34:59.915+0000 7f34647a69c0 10 monclient: _reopen_session rank -1 2024-09-14T11:35:00.041 INFO:tasks.workunit.client.0.smithi071.stderr: -346> 2024-09-14T11:34:59.915+0000 7f34647a69c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:35:00.041 INFO:tasks.workunit.client.0.smithi071.stderr: -345> 2024-09-14T11:34:59.915+0000 7f34647a69c0 10 monclient(hunting): picked mon.noname-a con 0x55abab717210 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:35:00.041 INFO:tasks.workunit.client.0.smithi071.stderr: -344> 2024-09-14T11:34:59.915+0000 7f34647a69c0 10 monclient(hunting): picked mon.noname-c con 0x55abab716b40 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:35:00.041 INFO:tasks.workunit.client.0.smithi071.stderr: -343> 2024-09-14T11:34:59.915+0000 7f34647a69c0 10 monclient(hunting): picked mon.noname-b con 0x55abab715520 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:35:00.041 INFO:tasks.workunit.client.0.smithi071.stderr: -342> 2024-09-14T11:34:59.915+0000 7f34647a69c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:00.041 INFO:tasks.workunit.client.0.smithi071.stderr: -341> 2024-09-14T11:34:59.915+0000 7f34647a69c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:00.041 INFO:tasks.workunit.client.0.smithi071.stderr: -340> 2024-09-14T11:34:59.915+0000 7f34647a69c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:00.041 INFO:tasks.workunit.client.0.smithi071.stderr: -339> 2024-09-14T11:34:59.915+0000 7f34647a69c0 10 monclient(hunting): _renew_subs 2024-09-14T11:35:00.041 INFO:tasks.workunit.client.0.smithi071.stderr: -338> 2024-09-14T11:34:59.915+0000 7f34647a69c0 10 monclient(hunting): authenticate will time out at 2512.038832s 2024-09-14T11:35:00.041 INFO:tasks.workunit.client.0.smithi071.stderr: -337> 2024-09-14T11:34:59.915+0000 7f3461aab640 10 monclient(hunting): get_auth_request con 0x55abab717210 auth_method 0 2024-09-14T11:35:00.041 INFO:tasks.workunit.client.0.smithi071.stderr: -336> 2024-09-14T11:34:59.915+0000 7f3461aab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:00.041 INFO:tasks.workunit.client.0.smithi071.stderr: -335> 2024-09-14T11:34:59.915+0000 7f3461aab640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:00.041 INFO:tasks.workunit.client.0.smithi071.stderr: -334> 2024-09-14T11:34:59.915+0000 7f3461aab640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:00.042 INFO:tasks.workunit.client.0.smithi071.stderr: -333> 2024-09-14T11:34:59.915+0000 7f3462aad640 10 monclient(hunting): get_auth_request con 0x55abab716b40 auth_method 0 2024-09-14T11:35:00.042 INFO:tasks.workunit.client.0.smithi071.stderr: -332> 2024-09-14T11:34:59.915+0000 7f3462aad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:00.042 INFO:tasks.workunit.client.0.smithi071.stderr: -331> 2024-09-14T11:34:59.915+0000 7f3462aad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:00.042 INFO:tasks.workunit.client.0.smithi071.stderr: -330> 2024-09-14T11:34:59.915+0000 7f3462aad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:00.042 INFO:tasks.workunit.client.0.smithi071.stderr: -329> 2024-09-14T11:34:59.915+0000 7f3461aab640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:00.042 INFO:tasks.workunit.client.0.smithi071.stderr: -328> 2024-09-14T11:34:59.915+0000 7f3461aab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:00.042 INFO:tasks.workunit.client.0.smithi071.stderr: -327> 2024-09-14T11:34:59.915+0000 7f3461aab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:00.042 INFO:tasks.workunit.client.0.smithi071.stderr: -326> 2024-09-14T11:34:59.915+0000 7f3462aad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:00.042 INFO:tasks.workunit.client.0.smithi071.stderr: -325> 2024-09-14T11:34:59.915+0000 7f3462aad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:00.042 INFO:tasks.workunit.client.0.smithi071.stderr: -324> 2024-09-14T11:34:59.915+0000 7f3462aad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:00.042 INFO:tasks.workunit.client.0.smithi071.stderr: -323> 2024-09-14T11:34:59.915+0000 7f3461aab640 10 monclient(hunting): handle_auth_done global_id 8223 payload 824 2024-09-14T11:35:00.042 INFO:tasks.workunit.client.0.smithi071.stderr: -322> 2024-09-14T11:34:59.915+0000 7f3461aab640 10 monclient: _finish_hunting 0 2024-09-14T11:35:00.042 INFO:tasks.workunit.client.0.smithi071.stderr: -321> 2024-09-14T11:34:59.915+0000 7f3461aab640 1 monclient: found mon.noname-a 2024-09-14T11:35:00.042 INFO:tasks.workunit.client.0.smithi071.stderr: -320> 2024-09-14T11:34:59.915+0000 7f3461aab640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:35:00.042 INFO:tasks.workunit.client.0.smithi071.stderr: -319> 2024-09-14T11:34:59.915+0000 7f34622ac640 10 monclient: get_auth_request con 0x55abab715520 auth_method 0 2024-09-14T11:35:00.043 INFO:tasks.workunit.client.0.smithi071.stderr: -318> 2024-09-14T11:34:59.915+0000 7f3347fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:00.043 INFO:tasks.workunit.client.0.smithi071.stderr: -317> 2024-09-14T11:34:59.915+0000 7f3347fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:00.043 INFO:tasks.workunit.client.0.smithi071.stderr: -316> 2024-09-14T11:34:59.915+0000 7f3347fff640 10 monclient: dump: 2024-09-14T11:35:00.043 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:00.043 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:00.043 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.043 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.043 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:00.043 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:00.043 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:00.043 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:00.043 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:00.043 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.043 INFO:tasks.workunit.client.0.smithi071.stderr: -315> 2024-09-14T11:34:59.915+0000 7f3347fff640 10 monclient: _finish_auth 0 2024-09-14T11:35:00.043 INFO:tasks.workunit.client.0.smithi071.stderr: -314> 2024-09-14T11:34:59.915+0000 7f3347fff640 10 monclient: _check_auth_tickets 2024-09-14T11:35:00.044 INFO:tasks.workunit.client.0.smithi071.stderr: -313> 2024-09-14T11:34:59.915+0000 7f3347fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:00.044 INFO:tasks.workunit.client.0.smithi071.stderr: -312> 2024-09-14T11:34:59.915+0000 7f3347fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:00.044 INFO:tasks.workunit.client.0.smithi071.stderr: -311> 2024-09-14T11:34:59.915+0000 7f3347fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:00.044 INFO:tasks.workunit.client.0.smithi071.stderr: -310> 2024-09-14T11:34:59.915+0000 7f3347fff640 10 monclient: dump: 2024-09-14T11:35:00.044 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:00.044 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:00.044 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.044 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.044 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:00.044 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:00.044 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:00.044 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:00.044 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:00.045 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.045 INFO:tasks.workunit.client.0.smithi071.stderr: -309> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 monclient: authenticate success, global_id 8223 2024-09-14T11:35:00.045 INFO:tasks.workunit.client.0.smithi071.stderr: -308> 2024-09-14T11:34:59.915+0000 7f34647a69c0 10 monclient: _renew_subs 2024-09-14T11:35:00.045 INFO:tasks.workunit.client.0.smithi071.stderr: -307> 2024-09-14T11:34:59.915+0000 7f34612aa640 4 set_mon_vals no callback set 2024-09-14T11:35:00.045 INFO:tasks.workunit.client.0.smithi071.stderr: -306> 2024-09-14T11:34:59.915+0000 7f34647a69c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:35:00.045 INFO:tasks.workunit.client.0.smithi071.stderr: -305> 2024-09-14T11:34:59.915+0000 7f34647a69c0 10 monclient: _renew_subs 2024-09-14T11:35:00.045 INFO:tasks.workunit.client.0.smithi071.stderr: -304> 2024-09-14T11:34:59.915+0000 7f34647a69c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:35:00.045 INFO:tasks.workunit.client.0.smithi071.stderr: -303> 2024-09-14T11:34:59.919+0000 7f3347fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:00.045 INFO:tasks.workunit.client.0.smithi071.stderr: -302> 2024-09-14T11:34:59.919+0000 7f3347fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:35:00.045 INFO:tasks.workunit.client.0.smithi071.stderr: -301> 2024-09-14T11:34:59.919+0000 7f3347fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:35:00.045 INFO:tasks.workunit.client.0.smithi071.stderr: -300> 2024-09-14T11:34:59.919+0000 7f3462aad640 10 monclient: get_auth_request con 0x7f333c0717e0 auth_method 0 2024-09-14T11:35:00.045 INFO:tasks.workunit.client.0.smithi071.stderr: -299> 2024-09-14T11:34:59.919+0000 7f34647a69c0 10 monclient: get_monmap_and_config 2024-09-14T11:35:00.045 INFO:tasks.workunit.client.0.smithi071.stderr: -298> 2024-09-14T11:34:59.919+0000 7f34647a69c0 10 monclient: build_initial_monmap 2024-09-14T11:35:00.046 INFO:tasks.workunit.client.0.smithi071.stderr: -297> 2024-09-14T11:34:59.919+0000 7f34647a69c0 1 build_initial for_mkfs: 0 2024-09-14T11:35:00.046 INFO:tasks.workunit.client.0.smithi071.stderr: -296> 2024-09-14T11:34:59.919+0000 7f34647a69c0 10 monclient: monmap: 2024-09-14T11:35:00.046 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:35:00.046 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:00.046 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:35:00.046 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:35:00.046 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:00.046 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:00.046 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:35:00.046 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:35:00.046 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:35:00.046 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.046 INFO:tasks.workunit.client.0.smithi071.stderr: -295> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x55abab736790) adding auth protocol: cephx 2024-09-14T11:35:00.046 INFO:tasks.workunit.client.0.smithi071.stderr: -294> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x55abab736790) adding auth protocol: cephx 2024-09-14T11:35:00.046 INFO:tasks.workunit.client.0.smithi071.stderr: -293> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x55abab736790) adding auth protocol: cephx 2024-09-14T11:35:00.047 INFO:tasks.workunit.client.0.smithi071.stderr: -292> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x55abab736790) adding con mode: secure 2024-09-14T11:35:00.047 INFO:tasks.workunit.client.0.smithi071.stderr: -291> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x55abab736790) adding con mode: crc 2024-09-14T11:35:00.047 INFO:tasks.workunit.client.0.smithi071.stderr: -290> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x55abab736790) adding con mode: secure 2024-09-14T11:35:00.047 INFO:tasks.workunit.client.0.smithi071.stderr: -289> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x55abab736790) adding con mode: crc 2024-09-14T11:35:00.047 INFO:tasks.workunit.client.0.smithi071.stderr: -288> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x55abab736790) adding con mode: secure 2024-09-14T11:35:00.047 INFO:tasks.workunit.client.0.smithi071.stderr: -287> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x55abab736790) adding con mode: crc 2024-09-14T11:35:00.047 INFO:tasks.workunit.client.0.smithi071.stderr: -286> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x55abab736790) adding con mode: crc 2024-09-14T11:35:00.047 INFO:tasks.workunit.client.0.smithi071.stderr: -285> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x55abab736790) adding con mode: secure 2024-09-14T11:35:00.047 INFO:tasks.workunit.client.0.smithi071.stderr: -284> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x55abab736790) adding con mode: crc 2024-09-14T11:35:00.047 INFO:tasks.workunit.client.0.smithi071.stderr: -283> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x55abab736790) adding con mode: secure 2024-09-14T11:35:00.047 INFO:tasks.workunit.client.0.smithi071.stderr: -282> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x55abab736790) adding con mode: crc 2024-09-14T11:35:00.047 INFO:tasks.workunit.client.0.smithi071.stderr: -281> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x55abab736790) adding con mode: secure 2024-09-14T11:35:00.047 INFO:tasks.workunit.client.0.smithi071.stderr: -280> 2024-09-14T11:34:59.919+0000 7f34647a69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:00.047 INFO:tasks.workunit.client.0.smithi071.stderr: -279> 2024-09-14T11:34:59.919+0000 7f34647a69c0 10 monclient: init 2024-09-14T11:35:00.047 INFO:tasks.workunit.client.0.smithi071.stderr: -278> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1701c0) adding auth protocol: cephx 2024-09-14T11:35:00.048 INFO:tasks.workunit.client.0.smithi071.stderr: -277> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1701c0) adding auth protocol: cephx 2024-09-14T11:35:00.048 INFO:tasks.workunit.client.0.smithi071.stderr: -276> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1701c0) adding auth protocol: cephx 2024-09-14T11:35:00.048 INFO:tasks.workunit.client.0.smithi071.stderr: -275> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1701c0) adding con mode: secure 2024-09-14T11:35:00.048 INFO:tasks.workunit.client.0.smithi071.stderr: -274> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1701c0) adding con mode: crc 2024-09-14T11:35:00.048 INFO:tasks.workunit.client.0.smithi071.stderr: -273> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1701c0) adding con mode: secure 2024-09-14T11:35:00.048 INFO:tasks.workunit.client.0.smithi071.stderr: -272> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1701c0) adding con mode: crc 2024-09-14T11:35:00.048 INFO:tasks.workunit.client.0.smithi071.stderr: -271> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1701c0) adding con mode: secure 2024-09-14T11:35:00.048 INFO:tasks.workunit.client.0.smithi071.stderr: -270> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1701c0) adding con mode: crc 2024-09-14T11:35:00.048 INFO:tasks.workunit.client.0.smithi071.stderr: -269> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1701c0) adding con mode: crc 2024-09-14T11:35:00.048 INFO:tasks.workunit.client.0.smithi071.stderr: -268> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1701c0) adding con mode: secure 2024-09-14T11:35:00.048 INFO:tasks.workunit.client.0.smithi071.stderr: -267> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1701c0) adding con mode: crc 2024-09-14T11:35:00.048 INFO:tasks.workunit.client.0.smithi071.stderr: -266> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1701c0) adding con mode: secure 2024-09-14T11:35:00.048 INFO:tasks.workunit.client.0.smithi071.stderr: -265> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1701c0) adding con mode: crc 2024-09-14T11:35:00.048 INFO:tasks.workunit.client.0.smithi071.stderr: -264> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1701c0) adding con mode: secure 2024-09-14T11:35:00.049 INFO:tasks.workunit.client.0.smithi071.stderr: -263> 2024-09-14T11:34:59.919+0000 7f34647a69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:00.049 INFO:tasks.workunit.client.0.smithi071.stderr: -262> 2024-09-14T11:34:59.919+0000 7f34647a69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:00.049 INFO:tasks.workunit.client.0.smithi071.stderr: -261> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 asok(0x55abab48dd90) register_command rotate-key cmddesc rotate-key hook 0x7fffaf170308 EEXIST 2024-09-14T11:35:00.049 INFO:tasks.workunit.client.0.smithi071.stderr: -260> 2024-09-14T11:34:59.919+0000 7f34647a69c0 10 monclient: _reopen_session rank -1 2024-09-14T11:35:00.049 INFO:tasks.workunit.client.0.smithi071.stderr: -259> 2024-09-14T11:34:59.919+0000 7f34647a69c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:35:00.049 INFO:tasks.workunit.client.0.smithi071.stderr: -258> 2024-09-14T11:34:59.919+0000 7f34647a69c0 10 monclient(hunting): picked mon.noname-c con 0x55abab76ade0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:35:00.049 INFO:tasks.workunit.client.0.smithi071.stderr: -257> 2024-09-14T11:34:59.919+0000 7f34647a69c0 10 monclient(hunting): picked mon.noname-b con 0x55abab73a800 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:35:00.049 INFO:tasks.workunit.client.0.smithi071.stderr: -256> 2024-09-14T11:34:59.919+0000 7f34647a69c0 10 monclient(hunting): picked mon.noname-a con 0x55abab7665b0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:35:00.049 INFO:tasks.workunit.client.0.smithi071.stderr: -255> 2024-09-14T11:34:59.919+0000 7f34647a69c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:00.049 INFO:tasks.workunit.client.0.smithi071.stderr: -254> 2024-09-14T11:34:59.919+0000 7f34647a69c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:00.049 INFO:tasks.workunit.client.0.smithi071.stderr: -253> 2024-09-14T11:34:59.919+0000 7f34647a69c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:00.049 INFO:tasks.workunit.client.0.smithi071.stderr: -252> 2024-09-14T11:34:59.919+0000 7f34647a69c0 10 monclient(hunting): _renew_subs 2024-09-14T11:35:00.049 INFO:tasks.workunit.client.0.smithi071.stderr: -251> 2024-09-14T11:34:59.919+0000 7f34647a69c0 10 monclient(hunting): authenticate will time out at 2512.042867s 2024-09-14T11:35:00.049 INFO:tasks.workunit.client.0.smithi071.stderr: -250> 2024-09-14T11:34:59.919+0000 7f3461aab640 10 monclient(hunting): get_auth_request con 0x55abab76ade0 auth_method 0 2024-09-14T11:35:00.050 INFO:tasks.workunit.client.0.smithi071.stderr: -249> 2024-09-14T11:34:59.919+0000 7f3461aab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:00.050 INFO:tasks.workunit.client.0.smithi071.stderr: -248> 2024-09-14T11:34:59.919+0000 7f3461aab640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:00.050 INFO:tasks.workunit.client.0.smithi071.stderr: -247> 2024-09-14T11:34:59.919+0000 7f3461aab640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:00.050 INFO:tasks.workunit.client.0.smithi071.stderr: -246> 2024-09-14T11:34:59.919+0000 7f34622ac640 10 monclient(hunting): get_auth_request con 0x55abab7665b0 auth_method 0 2024-09-14T11:35:00.050 INFO:tasks.workunit.client.0.smithi071.stderr: -245> 2024-09-14T11:34:59.919+0000 7f34622ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:00.050 INFO:tasks.workunit.client.0.smithi071.stderr: -244> 2024-09-14T11:34:59.919+0000 7f34622ac640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:00.050 INFO:tasks.workunit.client.0.smithi071.stderr: -243> 2024-09-14T11:34:59.919+0000 7f34622ac640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:00.050 INFO:tasks.workunit.client.0.smithi071.stderr: -242> 2024-09-14T11:34:59.919+0000 7f3461aab640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:00.050 INFO:tasks.workunit.client.0.smithi071.stderr: -241> 2024-09-14T11:34:59.919+0000 7f3461aab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:00.050 INFO:tasks.workunit.client.0.smithi071.stderr: -240> 2024-09-14T11:34:59.919+0000 7f3461aab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:00.050 INFO:tasks.workunit.client.0.smithi071.stderr: -239> 2024-09-14T11:34:59.919+0000 7f34622ac640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:00.050 INFO:tasks.workunit.client.0.smithi071.stderr: -238> 2024-09-14T11:34:59.919+0000 7f34622ac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:00.050 INFO:tasks.workunit.client.0.smithi071.stderr: -237> 2024-09-14T11:34:59.919+0000 7f34622ac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:00.050 INFO:tasks.workunit.client.0.smithi071.stderr: -236> 2024-09-14T11:34:59.919+0000 7f3461aab640 10 monclient(hunting): handle_auth_done global_id 7811 payload 274 2024-09-14T11:35:00.051 INFO:tasks.workunit.client.0.smithi071.stderr: -235> 2024-09-14T11:34:59.919+0000 7f3461aab640 10 monclient: _finish_hunting 0 2024-09-14T11:35:00.051 INFO:tasks.workunit.client.0.smithi071.stderr: -234> 2024-09-14T11:34:59.919+0000 7f3461aab640 1 monclient: found mon.noname-c 2024-09-14T11:35:00.051 INFO:tasks.workunit.client.0.smithi071.stderr: -233> 2024-09-14T11:34:59.919+0000 7f3461aab640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:35:00.051 INFO:tasks.workunit.client.0.smithi071.stderr: -232> 2024-09-14T11:34:59.919+0000 7f3345ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:00.051 INFO:tasks.workunit.client.0.smithi071.stderr: -231> 2024-09-14T11:34:59.919+0000 7f3345ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:00.051 INFO:tasks.workunit.client.0.smithi071.stderr: -230> 2024-09-14T11:34:59.919+0000 7f3345ffb640 10 monclient: dump: 2024-09-14T11:35:00.051 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:00.051 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:00.051 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.051 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.051 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:00.051 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:00.051 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:00.052 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:00.052 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:00.052 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.052 INFO:tasks.workunit.client.0.smithi071.stderr: -229> 2024-09-14T11:34:59.919+0000 7f3345ffb640 10 monclient: _finish_auth 0 2024-09-14T11:35:00.052 INFO:tasks.workunit.client.0.smithi071.stderr: -228> 2024-09-14T11:34:59.919+0000 7f3345ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:35:00.052 INFO:tasks.workunit.client.0.smithi071.stderr: -227> 2024-09-14T11:34:59.919+0000 7f3345ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:00.052 INFO:tasks.workunit.client.0.smithi071.stderr: -226> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 monclient: authenticate success, global_id 7811 2024-09-14T11:35:00.052 INFO:tasks.workunit.client.0.smithi071.stderr: -225> 2024-09-14T11:34:59.919+0000 7f34647a69c0 10 monclient: get_monmap_and_config success 2024-09-14T11:35:00.052 INFO:tasks.workunit.client.0.smithi071.stderr: -224> 2024-09-14T11:34:59.919+0000 7f34647a69c0 4 set_mon_vals no callback set 2024-09-14T11:35:00.052 INFO:tasks.workunit.client.0.smithi071.stderr: -223> 2024-09-14T11:34:59.919+0000 7f3345ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:00.052 INFO:tasks.workunit.client.0.smithi071.stderr: -222> 2024-09-14T11:34:59.919+0000 7f3345ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:00.052 INFO:tasks.workunit.client.0.smithi071.stderr: -221> 2024-09-14T11:34:59.919+0000 7f3345ffb640 10 monclient: dump: 2024-09-14T11:35:00.052 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:00.053 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:00.053 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.053 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.053 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:00.053 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:00.053 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:00.053 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:00.053 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:00.053 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.053 INFO:tasks.workunit.client.0.smithi071.stderr: -220> 2024-09-14T11:34:59.923+0000 7f34647a69c0 10 monclient: shutdown 2024-09-14T11:35:00.053 INFO:tasks.workunit.client.0.smithi071.stderr: -219> 2024-09-14T11:34:59.923+0000 7f34647a69c0 10 monclient: build_initial_monmap 2024-09-14T11:35:00.053 INFO:tasks.workunit.client.0.smithi071.stderr: -218> 2024-09-14T11:34:59.923+0000 7f34647a69c0 1 build_initial for_mkfs: 0 2024-09-14T11:35:00.053 INFO:tasks.workunit.client.0.smithi071.stderr: -217> 2024-09-14T11:34:59.923+0000 7f34647a69c0 10 monclient: monmap: 2024-09-14T11:35:00.053 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:35:00.054 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:00.054 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:35:00.054 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:35:00.054 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:00.054 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:00.054 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:35:00.054 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:35:00.054 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:35:00.054 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.054 INFO:tasks.workunit.client.0.smithi071.stderr: -216> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab75b800) adding auth protocol: cephx 2024-09-14T11:35:00.054 INFO:tasks.workunit.client.0.smithi071.stderr: -215> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab75b800) adding auth protocol: cephx 2024-09-14T11:35:00.054 INFO:tasks.workunit.client.0.smithi071.stderr: -214> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab75b800) adding auth protocol: cephx 2024-09-14T11:35:00.054 INFO:tasks.workunit.client.0.smithi071.stderr: -213> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab75b800) adding con mode: secure 2024-09-14T11:35:00.054 INFO:tasks.workunit.client.0.smithi071.stderr: -212> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab75b800) adding con mode: crc 2024-09-14T11:35:00.054 INFO:tasks.workunit.client.0.smithi071.stderr: -211> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab75b800) adding con mode: secure 2024-09-14T11:35:00.055 INFO:tasks.workunit.client.0.smithi071.stderr: -210> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab75b800) adding con mode: crc 2024-09-14T11:35:00.055 INFO:tasks.workunit.client.0.smithi071.stderr: -209> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab75b800) adding con mode: secure 2024-09-14T11:35:00.055 INFO:tasks.workunit.client.0.smithi071.stderr: -208> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab75b800) adding con mode: crc 2024-09-14T11:35:00.055 INFO:tasks.workunit.client.0.smithi071.stderr: -207> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab75b800) adding con mode: crc 2024-09-14T11:35:00.055 INFO:tasks.workunit.client.0.smithi071.stderr: -206> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab75b800) adding con mode: secure 2024-09-14T11:35:00.055 INFO:tasks.workunit.client.0.smithi071.stderr: -205> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab75b800) adding con mode: crc 2024-09-14T11:35:00.055 INFO:tasks.workunit.client.0.smithi071.stderr: -204> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab75b800) adding con mode: secure 2024-09-14T11:35:00.055 INFO:tasks.workunit.client.0.smithi071.stderr: -203> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab75b800) adding con mode: crc 2024-09-14T11:35:00.055 INFO:tasks.workunit.client.0.smithi071.stderr: -202> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab75b800) adding con mode: secure 2024-09-14T11:35:00.055 INFO:tasks.workunit.client.0.smithi071.stderr: -201> 2024-09-14T11:34:59.923+0000 7f34647a69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:00.055 INFO:tasks.workunit.client.0.smithi071.stderr: -200> 2024-09-14T11:34:59.923+0000 7f34647a69c0 1 librados: starting msgr at 2024-09-14T11:35:00.055 INFO:tasks.workunit.client.0.smithi071.stderr: -199> 2024-09-14T11:34:59.923+0000 7f34647a69c0 1 librados: starting objecter 2024-09-14T11:35:00.055 INFO:tasks.workunit.client.0.smithi071.stderr: -198> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 asok(0x55abab48dd90) register_command objecter_requests cmddesc objecter_requests hook 0x55abab761410 EEXIST 2024-09-14T11:35:00.055 INFO:tasks.workunit.client.0.smithi071.stderr: -197> 2024-09-14T11:34:59.923+0000 7f34647a69c0 1 librados: setting wanted keys 2024-09-14T11:35:00.056 INFO:tasks.workunit.client.0.smithi071.stderr: -196> 2024-09-14T11:34:59.923+0000 7f34647a69c0 1 librados: calling monclient init 2024-09-14T11:35:00.056 INFO:tasks.workunit.client.0.smithi071.stderr: -195> 2024-09-14T11:34:59.923+0000 7f34647a69c0 10 monclient: init 2024-09-14T11:35:00.056 INFO:tasks.workunit.client.0.smithi071.stderr: -194> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab719030) adding auth protocol: cephx 2024-09-14T11:35:00.056 INFO:tasks.workunit.client.0.smithi071.stderr: -193> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab719030) adding auth protocol: cephx 2024-09-14T11:35:00.056 INFO:tasks.workunit.client.0.smithi071.stderr: -192> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab719030) adding auth protocol: cephx 2024-09-14T11:35:00.056 INFO:tasks.workunit.client.0.smithi071.stderr: -191> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab719030) adding con mode: secure 2024-09-14T11:35:00.056 INFO:tasks.workunit.client.0.smithi071.stderr: -190> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab719030) adding con mode: crc 2024-09-14T11:35:00.056 INFO:tasks.workunit.client.0.smithi071.stderr: -189> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab719030) adding con mode: secure 2024-09-14T11:35:00.056 INFO:tasks.workunit.client.0.smithi071.stderr: -188> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab719030) adding con mode: crc 2024-09-14T11:35:00.056 INFO:tasks.workunit.client.0.smithi071.stderr: -187> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab719030) adding con mode: secure 2024-09-14T11:35:00.056 INFO:tasks.workunit.client.0.smithi071.stderr: -186> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab719030) adding con mode: crc 2024-09-14T11:35:00.056 INFO:tasks.workunit.client.0.smithi071.stderr: -185> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab719030) adding con mode: crc 2024-09-14T11:35:00.056 INFO:tasks.workunit.client.0.smithi071.stderr: -184> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab719030) adding con mode: secure 2024-09-14T11:35:00.056 INFO:tasks.workunit.client.0.smithi071.stderr: -183> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab719030) adding con mode: crc 2024-09-14T11:35:00.056 INFO:tasks.workunit.client.0.smithi071.stderr: -182> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab719030) adding con mode: secure 2024-09-14T11:35:00.057 INFO:tasks.workunit.client.0.smithi071.stderr: -181> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab719030) adding con mode: crc 2024-09-14T11:35:00.057 INFO:tasks.workunit.client.0.smithi071.stderr: -180> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab719030) adding con mode: secure 2024-09-14T11:35:00.057 INFO:tasks.workunit.client.0.smithi071.stderr: -179> 2024-09-14T11:34:59.923+0000 7f34647a69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:00.057 INFO:tasks.workunit.client.0.smithi071.stderr: -178> 2024-09-14T11:34:59.923+0000 7f34647a69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:00.057 INFO:tasks.workunit.client.0.smithi071.stderr: -177> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 asok(0x55abab48dd90) register_command rotate-key cmddesc rotate-key hook 0x55abab719178 EEXIST 2024-09-14T11:35:00.057 INFO:tasks.workunit.client.0.smithi071.stderr: -176> 2024-09-14T11:34:59.923+0000 7f34647a69c0 10 monclient: _reopen_session rank -1 2024-09-14T11:35:00.057 INFO:tasks.workunit.client.0.smithi071.stderr: -175> 2024-09-14T11:34:59.923+0000 7f34647a69c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:35:00.057 INFO:tasks.workunit.client.0.smithi071.stderr: -174> 2024-09-14T11:34:59.923+0000 7f34647a69c0 10 monclient(hunting): picked mon.noname-c con 0x55abab73a800 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:35:00.057 INFO:tasks.workunit.client.0.smithi071.stderr: -173> 2024-09-14T11:34:59.923+0000 7f34647a69c0 10 monclient(hunting): picked mon.noname-a con 0x55abab7665b0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:35:00.057 INFO:tasks.workunit.client.0.smithi071.stderr: -172> 2024-09-14T11:34:59.923+0000 7f34647a69c0 10 monclient(hunting): picked mon.noname-b con 0x55abab76ade0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:35:00.057 INFO:tasks.workunit.client.0.smithi071.stderr: -171> 2024-09-14T11:34:59.923+0000 7f34647a69c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:00.057 INFO:tasks.workunit.client.0.smithi071.stderr: -170> 2024-09-14T11:34:59.923+0000 7f34647a69c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:00.057 INFO:tasks.workunit.client.0.smithi071.stderr: -169> 2024-09-14T11:34:59.923+0000 7f34647a69c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:00.057 INFO:tasks.workunit.client.0.smithi071.stderr: -168> 2024-09-14T11:34:59.923+0000 7f34647a69c0 10 monclient(hunting): _renew_subs 2024-09-14T11:35:00.058 INFO:tasks.workunit.client.0.smithi071.stderr: -167> 2024-09-14T11:34:59.923+0000 7f34647a69c0 10 monclient(hunting): authenticate will time out at 2512.045462s 2024-09-14T11:35:00.058 INFO:tasks.workunit.client.0.smithi071.stderr: -166> 2024-09-14T11:34:59.923+0000 7f3461aab640 10 monclient(hunting): get_auth_request con 0x55abab73a800 auth_method 0 2024-09-14T11:35:00.058 INFO:tasks.workunit.client.0.smithi071.stderr: -165> 2024-09-14T11:34:59.923+0000 7f3461aab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:00.058 INFO:tasks.workunit.client.0.smithi071.stderr: -164> 2024-09-14T11:34:59.923+0000 7f3461aab640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:00.058 INFO:tasks.workunit.client.0.smithi071.stderr: -163> 2024-09-14T11:34:59.923+0000 7f3461aab640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:00.058 INFO:tasks.workunit.client.0.smithi071.stderr: -162> 2024-09-14T11:34:59.923+0000 7f3462aad640 10 monclient(hunting): get_auth_request con 0x55abab7665b0 auth_method 0 2024-09-14T11:35:00.058 INFO:tasks.workunit.client.0.smithi071.stderr: -161> 2024-09-14T11:34:59.923+0000 7f3462aad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:00.058 INFO:tasks.workunit.client.0.smithi071.stderr: -160> 2024-09-14T11:34:59.923+0000 7f3462aad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:00.058 INFO:tasks.workunit.client.0.smithi071.stderr: -159> 2024-09-14T11:34:59.923+0000 7f3462aad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:00.058 INFO:tasks.workunit.client.0.smithi071.stderr: -158> 2024-09-14T11:34:59.923+0000 7f3461aab640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:00.058 INFO:tasks.workunit.client.0.smithi071.stderr: -157> 2024-09-14T11:34:59.923+0000 7f3461aab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:00.058 INFO:tasks.workunit.client.0.smithi071.stderr: -156> 2024-09-14T11:34:59.923+0000 7f3461aab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:00.058 INFO:tasks.workunit.client.0.smithi071.stderr: -155> 2024-09-14T11:34:59.923+0000 7f3462aad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:00.058 INFO:tasks.workunit.client.0.smithi071.stderr: -154> 2024-09-14T11:34:59.923+0000 7f3462aad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:00.059 INFO:tasks.workunit.client.0.smithi071.stderr: -153> 2024-09-14T11:34:59.923+0000 7f3462aad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:00.059 INFO:tasks.workunit.client.0.smithi071.stderr: -152> 2024-09-14T11:34:59.923+0000 7f34622ac640 10 monclient(hunting): get_auth_request con 0x55abab76ade0 auth_method 0 2024-09-14T11:35:00.059 INFO:tasks.workunit.client.0.smithi071.stderr: -151> 2024-09-14T11:34:59.923+0000 7f34622ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:00.059 INFO:tasks.workunit.client.0.smithi071.stderr: -150> 2024-09-14T11:34:59.923+0000 7f34622ac640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:00.059 INFO:tasks.workunit.client.0.smithi071.stderr: -149> 2024-09-14T11:34:59.923+0000 7f34622ac640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:00.059 INFO:tasks.workunit.client.0.smithi071.stderr: -148> 2024-09-14T11:34:59.923+0000 7f3461aab640 10 monclient(hunting): handle_auth_done global_id 7814 payload 824 2024-09-14T11:35:00.059 INFO:tasks.workunit.client.0.smithi071.stderr: -147> 2024-09-14T11:34:59.923+0000 7f3461aab640 10 monclient: _finish_hunting 0 2024-09-14T11:35:00.059 INFO:tasks.workunit.client.0.smithi071.stderr: -146> 2024-09-14T11:34:59.923+0000 7f3461aab640 1 monclient: found mon.noname-c 2024-09-14T11:35:00.059 INFO:tasks.workunit.client.0.smithi071.stderr: -145> 2024-09-14T11:34:59.923+0000 7f3461aab640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:35:00.059 INFO:tasks.workunit.client.0.smithi071.stderr: -144> 2024-09-14T11:34:59.923+0000 7f3333fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:00.059 INFO:tasks.workunit.client.0.smithi071.stderr: -143> 2024-09-14T11:34:59.923+0000 7f3333fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:00.059 INFO:tasks.workunit.client.0.smithi071.stderr: -142> 2024-09-14T11:34:59.923+0000 7f3333fff640 10 monclient: dump: 2024-09-14T11:35:00.059 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:00.059 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:00.059 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.060 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.060 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:00.060 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:00.060 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:00.060 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:00.060 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:00.060 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.060 INFO:tasks.workunit.client.0.smithi071.stderr: -141> 2024-09-14T11:34:59.923+0000 7f3333fff640 10 monclient: _finish_auth 0 2024-09-14T11:35:00.060 INFO:tasks.workunit.client.0.smithi071.stderr: -140> 2024-09-14T11:34:59.923+0000 7f3333fff640 10 monclient: _check_auth_tickets 2024-09-14T11:35:00.060 INFO:tasks.workunit.client.0.smithi071.stderr: -139> 2024-09-14T11:34:59.923+0000 7f3333fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:00.060 INFO:tasks.workunit.client.0.smithi071.stderr: -138> 2024-09-14T11:34:59.923+0000 7f3333fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:00.060 INFO:tasks.workunit.client.0.smithi071.stderr: -137> 2024-09-14T11:34:59.923+0000 7f3333fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:00.060 INFO:tasks.workunit.client.0.smithi071.stderr: -136> 2024-09-14T11:34:59.923+0000 7f3333fff640 10 monclient: dump: 2024-09-14T11:35:00.060 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:00.061 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:00.061 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.061 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.061 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:00.061 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:00.061 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:00.061 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:00.061 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:00.061 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.061 INFO:tasks.workunit.client.0.smithi071.stderr: -135> 2024-09-14T11:34:59.923+0000 7f3345ffb640 4 set_mon_vals no callback set 2024-09-14T11:35:00.061 INFO:tasks.workunit.client.0.smithi071.stderr: -134> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 monclient: authenticate success, global_id 7814 2024-09-14T11:35:00.061 INFO:tasks.workunit.client.0.smithi071.stderr: -133> 2024-09-14T11:34:59.923+0000 7f34647a69c0 10 monclient: _renew_subs 2024-09-14T11:35:00.061 INFO:tasks.workunit.client.0.smithi071.stderr: -132> 2024-09-14T11:34:59.923+0000 7f34647a69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:35:00.061 INFO:tasks.workunit.client.0.smithi071.stderr: -131> 2024-09-14T11:34:59.923+0000 7f34647a69c0 10 monclient: _renew_subs 2024-09-14T11:35:00.061 INFO:tasks.workunit.client.0.smithi071.stderr: -130> 2024-09-14T11:34:59.923+0000 7f34647a69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:35:00.062 INFO:tasks.workunit.client.0.smithi071.stderr: -129> 2024-09-14T11:34:59.923+0000 7f34647a69c0 1 librados: init done 2024-09-14T11:35:00.062 INFO:tasks.workunit.client.0.smithi071.stderr: -128> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 asok(0x55abab48dd90) register_command cr dump hook 0x55abab73afc8 2024-09-14T11:35:00.062 INFO:tasks.workunit.client.0.smithi071.stderr: -127> 2024-09-14T11:34:59.923+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.062 INFO:tasks.workunit.client.0.smithi071.stderr: -126> 2024-09-14T11:34:59.927+0000 7f3333fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:00.062 INFO:tasks.workunit.client.0.smithi071.stderr: -125> 2024-09-14T11:34:59.927+0000 7f3333fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:35:00.062 INFO:tasks.workunit.client.0.smithi071.stderr: -124> 2024-09-14T11:34:59.927+0000 7f3333fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:35:00.062 INFO:tasks.workunit.client.0.smithi071.stderr: -123> 2024-09-14T11:34:59.927+0000 7f3462aad640 10 monclient: get_auth_request con 0x7f332c0718a0 auth_method 0 2024-09-14T11:35:00.062 INFO:tasks.workunit.client.0.smithi071.stderr: -122> 2024-09-14T11:34:59.927+0000 7f34622ac640 10 monclient: get_auth_request con 0x55abab784190 auth_method 0 2024-09-14T11:35:00.062 INFO:tasks.workunit.client.0.smithi071.stderr: -121> 2024-09-14T11:34:59.927+0000 7f34647a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:00.062 INFO:tasks.workunit.client.0.smithi071.stderr: -120> 2024-09-14T11:34:59.927+0000 7f34647a69c0 20 realm 2024-09-14T11:35:00.062 INFO:tasks.workunit.client.0.smithi071.stderr: -119> 2024-09-14T11:34:59.927+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.062 INFO:tasks.workunit.client.0.smithi071.stderr: -118> 2024-09-14T11:34:59.927+0000 7f34647a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:00.062 INFO:tasks.workunit.client.0.smithi071.stderr: -117> 2024-09-14T11:34:59.927+0000 7f34647a69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:00.063 INFO:tasks.workunit.client.0.smithi071.stderr: -116> 2024-09-14T11:34:59.927+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.063 INFO:tasks.workunit.client.0.smithi071.stderr: -115> 2024-09-14T11:34:59.927+0000 7f34647a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:00.063 INFO:tasks.workunit.client.0.smithi071.stderr: -114> 2024-09-14T11:34:59.927+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.063 INFO:tasks.workunit.client.0.smithi071.stderr: -113> 2024-09-14T11:34:59.927+0000 7f3461aab640 10 monclient: get_auth_request con 0x55abab788430 auth_method 0 2024-09-14T11:35:00.063 INFO:tasks.workunit.client.0.smithi071.stderr: -112> 2024-09-14T11:34:59.927+0000 7f34647a69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:00.063 INFO:tasks.workunit.client.0.smithi071.stderr: -111> 2024-09-14T11:34:59.931+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.063 INFO:tasks.workunit.client.0.smithi071.stderr: -110> 2024-09-14T11:34:59.931+0000 7f3462aad640 10 monclient: get_auth_request con 0x55abab78bc90 auth_method 0 2024-09-14T11:35:00.063 INFO:tasks.workunit.client.0.smithi071.stderr: -109> 2024-09-14T11:34:59.931+0000 7f34647a69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:00.063 INFO:tasks.workunit.client.0.smithi071.stderr: -108> 2024-09-14T11:34:59.931+0000 7f34647a69c0 20 searching for the correct realm 2024-09-14T11:35:00.063 INFO:tasks.workunit.client.0.smithi071.stderr: -107> 2024-09-14T11:34:59.931+0000 7f34622ac640 10 monclient: get_auth_request con 0x55abab790a50 auth_method 0 2024-09-14T11:35:00.063 INFO:tasks.workunit.client.0.smithi071.stderr: -106> 2024-09-14T11:34:59.931+0000 7f3461aab640 10 monclient: get_auth_request con 0x7f345c0bb040 auth_method 0 2024-09-14T11:35:00.063 INFO:tasks.workunit.client.0.smithi071.stderr: -105> 2024-09-14T11:34:59.935+0000 7f3462aad640 10 monclient: get_auth_request con 0x7f345802a060 auth_method 0 2024-09-14T11:35:00.063 INFO:tasks.workunit.client.0.smithi071.stderr: -104> 2024-09-14T11:34:59.935+0000 7f34622ac640 0 -- 172.21.15.71:0/1860409313 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x55abab790a50 msgr2=0x55abab792f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:00.063 INFO:tasks.workunit.client.0.smithi071.stderr: -103> 2024-09-14T11:34:59.935+0000 7f3333fff640 1 client.7814.objecter ms_handle_reset 0x55abab790a50 session 0x55abab7903d0 osd.4 2024-09-14T11:35:00.064 INFO:tasks.workunit.client.0.smithi071.stderr: -102> 2024-09-14T11:34:59.935+0000 7f3333fff640 10 monclient: _renew_subs 2024-09-14T11:35:00.064 INFO:tasks.workunit.client.0.smithi071.stderr: -101> 2024-09-14T11:34:59.935+0000 7f3333fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:35:00.064 INFO:tasks.workunit.client.0.smithi071.stderr: -100> 2024-09-14T11:34:59.935+0000 7f34622ac640 10 monclient: get_auth_request con 0x7f332c0813c0 auth_method 0 2024-09-14T11:35:00.064 INFO:tasks.workunit.client.0.smithi071.stderr: -99> 2024-09-14T11:34:59.935+0000 7f34622ac640 10 monclient: get_auth_request con 0x7f345c0e4400 auth_method 0 2024-09-14T11:35:00.064 INFO:tasks.workunit.client.0.smithi071.stderr: -98> 2024-09-14T11:34:59.939+0000 7f3461aab640 10 monclient: get_auth_request con 0x7f3458015070 auth_method 0 2024-09-14T11:35:00.064 INFO:tasks.workunit.client.0.smithi071.stderr: -97> 2024-09-14T11:34:59.939+0000 7f3462aad640 0 -- 172.21.15.71:0/1860409313 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55abab78bc90 msgr2=0x55abab78e0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:00.064 INFO:tasks.workunit.client.0.smithi071.stderr: -96> 2024-09-14T11:34:59.939+0000 7f3333fff640 1 client.7814.objecter ms_handle_reset 0x55abab78bc90 session 0x55abab7877c0 osd.3 2024-09-14T11:35:00.064 INFO:tasks.workunit.client.0.smithi071.stderr: -95> 2024-09-14T11:34:59.939+0000 7f3462aad640 10 monclient: get_auth_request con 0x55abab790a50 auth_method 0 2024-09-14T11:35:00.064 INFO:tasks.workunit.client.0.smithi071.stderr: -94> 2024-09-14T11:34:59.947+0000 7f34647a69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:00.064 INFO:tasks.workunit.client.0.smithi071.stderr: -93> 2024-09-14T11:34:59.947+0000 7f34647a69c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:35:00.064 INFO:tasks.workunit.client.0.smithi071.stderr: -92> 2024-09-14T11:34:59.947+0000 7f34647a69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:00.064 INFO:tasks.workunit.client.0.smithi071.stderr: -91> 2024-09-14T11:34:59.947+0000 7f34647a69c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:35:00.064 INFO:tasks.workunit.client.0.smithi071.stderr: -90> 2024-09-14T11:34:59.947+0000 7f34647a69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:00.064 INFO:tasks.workunit.client.0.smithi071.stderr: -89> 2024-09-14T11:34:59.947+0000 7f34647a69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:00.065 INFO:tasks.workunit.client.0.smithi071.stderr: -88> 2024-09-14T11:34:59.947+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.065 INFO:tasks.workunit.client.0.smithi071.stderr: -87> 2024-09-14T11:34:59.951+0000 7f34647a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:00.065 INFO:tasks.workunit.client.0.smithi071.stderr: -86> 2024-09-14T11:34:59.951+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.065 INFO:tasks.workunit.client.0.smithi071.stderr: -85> 2024-09-14T11:34:59.951+0000 7f34647a69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:00.065 INFO:tasks.workunit.client.0.smithi071.stderr: -84> 2024-09-14T11:34:59.951+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.065 INFO:tasks.workunit.client.0.smithi071.stderr: -83> 2024-09-14T11:34:59.951+0000 7f34647a69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:00.065 INFO:tasks.workunit.client.0.smithi071.stderr: -82> 2024-09-14T11:34:59.951+0000 7f34647a69c0 20 zone default found 2024-09-14T11:35:00.065 INFO:tasks.workunit.client.0.smithi071.stderr: -81> 2024-09-14T11:34:59.951+0000 7f34647a69c0 4 Realm: () 2024-09-14T11:35:00.065 INFO:tasks.workunit.client.0.smithi071.stderr: -80> 2024-09-14T11:34:59.951+0000 7f34647a69c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:35:00.065 INFO:tasks.workunit.client.0.smithi071.stderr: -79> 2024-09-14T11:34:59.951+0000 7f34647a69c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:35:00.065 INFO:tasks.workunit.client.0.smithi071.stderr: -78> 2024-09-14T11:34:59.951+0000 7f34647a69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:00.065 INFO:tasks.workunit.client.0.smithi071.stderr: -77> 2024-09-14T11:34:59.951+0000 7f34647a69c0 20 zonegroup default 2024-09-14T11:35:00.066 INFO:tasks.workunit.client.0.smithi071.stderr: -76> 2024-09-14T11:34:59.951+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.066 INFO:tasks.workunit.client.0.smithi071.stderr: -75> 2024-09-14T11:34:59.951+0000 7f34647a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:00.066 INFO:tasks.workunit.client.0.smithi071.stderr: -74> 2024-09-14T11:34:59.951+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.066 INFO:tasks.workunit.client.0.smithi071.stderr: -73> 2024-09-14T11:34:59.951+0000 7f34647a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:00.066 INFO:tasks.workunit.client.0.smithi071.stderr: -72> 2024-09-14T11:34:59.951+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.066 INFO:tasks.workunit.client.0.smithi071.stderr: -71> 2024-09-14T11:34:59.951+0000 7f34647a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:00.066 INFO:tasks.workunit.client.0.smithi071.stderr: -70> 2024-09-14T11:34:59.951+0000 7f34647a69c0 20 started sync module instance, tier type = 2024-09-14T11:35:00.066 INFO:tasks.workunit.client.0.smithi071.stderr: -69> 2024-09-14T11:34:59.951+0000 7f34647a69c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:35:00.066 INFO:tasks.workunit.client.0.smithi071.stderr: -68> 2024-09-14T11:34:59.971+0000 7f34647a69c0 20 add_watcher() i=0 2024-09-14T11:35:00.066 INFO:tasks.workunit.client.0.smithi071.stderr: -67> 2024-09-14T11:34:59.971+0000 7f34647a69c0 20 add_watcher() i=1 2024-09-14T11:35:00.066 INFO:tasks.workunit.client.0.smithi071.stderr: -66> 2024-09-14T11:34:59.971+0000 7f34647a69c0 20 add_watcher() i=2 2024-09-14T11:35:00.066 INFO:tasks.workunit.client.0.smithi071.stderr: -65> 2024-09-14T11:34:59.971+0000 7f34647a69c0 20 add_watcher() i=3 2024-09-14T11:35:00.066 INFO:tasks.workunit.client.0.smithi071.stderr: -64> 2024-09-14T11:34:59.971+0000 7f34647a69c0 20 add_watcher() i=4 2024-09-14T11:35:00.066 INFO:tasks.workunit.client.0.smithi071.stderr: -63> 2024-09-14T11:34:59.971+0000 7f34647a69c0 20 add_watcher() i=5 2024-09-14T11:35:00.066 INFO:tasks.workunit.client.0.smithi071.stderr: -62> 2024-09-14T11:34:59.971+0000 7f34647a69c0 20 add_watcher() i=6 2024-09-14T11:35:00.067 INFO:tasks.workunit.client.0.smithi071.stderr: -61> 2024-09-14T11:34:59.975+0000 7f34647a69c0 20 add_watcher() i=7 2024-09-14T11:35:00.067 INFO:tasks.workunit.client.0.smithi071.stderr: -60> 2024-09-14T11:34:59.975+0000 7f34647a69c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:00.067 INFO:tasks.workunit.client.0.smithi071.stderr: -59> 2024-09-14T11:34:59.975+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1706a0) adding auth protocol: cephx 2024-09-14T11:35:00.067 INFO:tasks.workunit.client.0.smithi071.stderr: -58> 2024-09-14T11:34:59.975+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1706a0) adding auth protocol: cephx 2024-09-14T11:35:00.067 INFO:tasks.workunit.client.0.smithi071.stderr: -57> 2024-09-14T11:34:59.975+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1706a0) adding auth protocol: cephx 2024-09-14T11:35:00.067 INFO:tasks.workunit.client.0.smithi071.stderr: -56> 2024-09-14T11:34:59.975+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1706a0) adding con mode: secure 2024-09-14T11:35:00.067 INFO:tasks.workunit.client.0.smithi071.stderr: -55> 2024-09-14T11:34:59.975+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1706a0) adding con mode: crc 2024-09-14T11:35:00.067 INFO:tasks.workunit.client.0.smithi071.stderr: -54> 2024-09-14T11:34:59.975+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1706a0) adding con mode: secure 2024-09-14T11:35:00.067 INFO:tasks.workunit.client.0.smithi071.stderr: -53> 2024-09-14T11:34:59.975+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1706a0) adding con mode: crc 2024-09-14T11:35:00.067 INFO:tasks.workunit.client.0.smithi071.stderr: -52> 2024-09-14T11:34:59.975+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1706a0) adding con mode: secure 2024-09-14T11:35:00.067 INFO:tasks.workunit.client.0.smithi071.stderr: -51> 2024-09-14T11:34:59.975+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1706a0) adding con mode: crc 2024-09-14T11:35:00.067 INFO:tasks.workunit.client.0.smithi071.stderr: -50> 2024-09-14T11:34:59.975+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1706a0) adding con mode: crc 2024-09-14T11:35:00.067 INFO:tasks.workunit.client.0.smithi071.stderr: -49> 2024-09-14T11:34:59.975+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1706a0) adding con mode: secure 2024-09-14T11:35:00.067 INFO:tasks.workunit.client.0.smithi071.stderr: -48> 2024-09-14T11:34:59.975+0000 7f3318fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:00.068 INFO:tasks.workunit.client.0.smithi071.stderr: -47> 2024-09-14T11:34:59.975+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1706a0) adding con mode: crc 2024-09-14T11:35:00.068 INFO:tasks.workunit.client.0.smithi071.stderr: -46> 2024-09-14T11:34:59.975+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1706a0) adding con mode: secure 2024-09-14T11:35:00.068 INFO:tasks.workunit.client.0.smithi071.stderr: -45> 2024-09-14T11:34:59.975+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1706a0) adding con mode: crc 2024-09-14T11:35:00.068 INFO:tasks.workunit.client.0.smithi071.stderr: -44> 2024-09-14T11:34:59.975+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1706a0) adding con mode: secure 2024-09-14T11:35:00.068 INFO:tasks.workunit.client.0.smithi071.stderr: -43> 2024-09-14T11:34:59.979+0000 7f34647a69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:00.068 INFO:tasks.workunit.client.0.smithi071.stderr: -42> 2024-09-14T11:34:59.979+0000 7f34647a69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:00.068 INFO:tasks.workunit.client.0.smithi071.stderr: -41> 2024-09-14T11:34:59.979+0000 7f34647a69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:00.068 INFO:tasks.workunit.client.0.smithi071.stderr: -40> 2024-09-14T11:34:59.979+0000 7f34647a69c0 5 asok(0x55abab48dd90) register_command cache list hook 0x55abab761e00 2024-09-14T11:35:00.068 INFO:tasks.workunit.client.0.smithi071.stderr: -39> 2024-09-14T11:34:59.979+0000 7f34647a69c0 5 asok(0x55abab48dd90) register_command cache inspect hook 0x55abab761e00 2024-09-14T11:35:00.068 INFO:tasks.workunit.client.0.smithi071.stderr: -38> 2024-09-14T11:34:59.979+0000 7f34647a69c0 5 asok(0x55abab48dd90) register_command cache erase hook 0x55abab761e00 2024-09-14T11:35:00.068 INFO:tasks.workunit.client.0.smithi071.stderr: -37> 2024-09-14T11:34:59.979+0000 7f34647a69c0 5 asok(0x55abab48dd90) register_command cache zap hook 0x55abab761e00 2024-09-14T11:35:00.068 INFO:tasks.workunit.client.0.smithi071.stderr: -36> 2024-09-14T11:34:59.979+0000 7f34647a69c0 5 note: GC not initialized 2024-09-14T11:35:00.068 INFO:tasks.workunit.client.0.smithi071.stderr: -35> 2024-09-14T11:34:59.979+0000 7f32937fe640 20 reqs_thread_entry: start 2024-09-14T11:35:00.068 INFO:tasks.workunit.client.0.smithi071.stderr: -34> 2024-09-14T11:34:59.979+0000 7f34647a69c0 5 asok(0x55abab48dd90) register_command sync trace show hook 0x7f3454004db0 2024-09-14T11:35:00.068 INFO:tasks.workunit.client.0.smithi071.stderr: -33> 2024-09-14T11:34:59.979+0000 7f34647a69c0 5 asok(0x55abab48dd90) register_command sync trace history hook 0x7f3454004db0 2024-09-14T11:35:00.069 INFO:tasks.workunit.client.0.smithi071.stderr: -32> 2024-09-14T11:34:59.979+0000 7f34647a69c0 5 asok(0x55abab48dd90) register_command sync trace active hook 0x7f3454004db0 2024-09-14T11:35:00.069 INFO:tasks.workunit.client.0.smithi071.stderr: -31> 2024-09-14T11:34:59.979+0000 7f34647a69c0 5 asok(0x55abab48dd90) register_command sync trace active_short hook 0x7f3454004db0 2024-09-14T11:35:00.069 INFO:tasks.workunit.client.0.smithi071.stderr: -30> 2024-09-14T11:34:59.979+0000 7f34647a69c0 20 init_complete bucket index max shards: 11 2024-09-14T11:35:00.069 INFO:tasks.workunit.client.0.smithi071.stderr: -29> 2024-09-14T11:34:59.979+0000 7f34647a69c0 20 Filter name: none 2024-09-14T11:35:00.069 INFO:tasks.workunit.client.0.smithi071.stderr: -28> 2024-09-14T11:34:59.979+0000 7f32917fa640 20 reqs_thread_entry: start 2024-09-14T11:35:00.069 INFO:tasks.workunit.client.0.smithi071.stderr: -27> 2024-09-14T11:34:59.979+0000 7f34647a69c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:35:00.069 INFO:tasks.workunit.client.0.smithi071.stderr: -26> 2024-09-14T11:34:59.979+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.069 INFO:tasks.workunit.client.0.smithi071.stderr: -25> 2024-09-14T11:34:59.979+0000 7f34647a69c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:35:00.069 INFO:tasks.workunit.client.0.smithi071.stderr: -24> 2024-09-14T11:34:59.979+0000 7f34647a69c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:35:00.069 INFO:tasks.workunit.client.0.smithi071.stderr: -23> 2024-09-14T11:34:59.979+0000 7f34647a69c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:35:00.069 INFO:tasks.workunit.client.0.smithi071.stderr: -22> 2024-09-14T11:34:59.979+0000 7f34647a69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 : miss 2024-09-14T11:35:00.069 INFO:tasks.workunit.client.0.smithi071.stderr: -21> 2024-09-14T11:34:59.979+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.069 INFO:tasks.workunit.client.0.smithi071.stderr: -20> 2024-09-14T11:34:59.979+0000 7f34647a69c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:35:00.069 INFO:tasks.workunit.client.0.smithi071.stderr: -19> 2024-09-14T11:34:59.979+0000 7f34647a69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:35:00.070 INFO:tasks.workunit.client.0.smithi071.stderr: -18> 2024-09-14T11:34:59.979+0000 7f34647a69c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:35:00.070 INFO:tasks.workunit.client.0.smithi071.stderr: -17> 2024-09-14T11:34:59.979+0000 7f34647a69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:00.070 INFO:tasks.workunit.client.0.smithi071.stderr: -16> 2024-09-14T11:34:59.979+0000 7f34647a69c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:00.070 INFO:tasks.workunit.client.0.smithi071.stderr: -15> 2024-09-14T11:34:59.979+0000 7f34647a69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 2024-09-14T11:35:00.070 INFO:tasks.workunit.client.0.smithi071.stderr: -14> 2024-09-14T11:34:59.983+0000 7f34647a69c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:35:00.070 INFO:tasks.workunit.client.0.smithi071.stderr: -13> 2024-09-14T11:34:59.995+0000 7f34647a69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:35:00.070 INFO:tasks.workunit.client.0.smithi071.stderr: -12> 2024-09-14T11:34:59.995+0000 7f34647a69c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:35:00.070 INFO:tasks.workunit.client.0.smithi071.stderr: -11> 2024-09-14T11:34:59.995+0000 7f34647a69c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:00.070 INFO:tasks.workunit.client.0.smithi071.stderr: -10> 2024-09-14T11:34:59.995+0000 7f34647a69c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18, ofs0, ns] 2024-09-14T11:35:00.070 INFO:tasks.workunit.client.0.smithi071.stderr: -9> 2024-09-14T11:34:59.995+0000 7f3345ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464427 cookie 94195804617664 notifier 7814 bl.length()=911 2024-09-14T11:35:00.070 INFO:tasks.workunit.client.0.smithi071.stderr: -8> 2024-09-14T11:34:59.995+0000 7f3345ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:35:00.070 INFO:tasks.workunit.client.0.smithi071.stderr: -7> 2024-09-14T11:34:59.995+0000 7f3345ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:35:00.070 INFO:tasks.workunit.client.0.smithi071.stderr: -6> 2024-09-14T11:34:59.995+0000 7f3345ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:00.070 INFO:tasks.workunit.client.0.smithi071.stderr: -5> 2024-09-14T11:34:59.995+0000 7f34647a69c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_sources= new_sources= 2024-09-14T11:35:00.070 INFO:tasks.workunit.client.0.smithi071.stderr: -4> 2024-09-14T11:34:59.995+0000 7f34647a69c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential sources added=[] removed=[] 2024-09-14T11:35:00.071 INFO:tasks.workunit.client.0.smithi071.stderr: -3> 2024-09-14T11:34:59.995+0000 7f34647a69c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_dests= new_dests= 2024-09-14T11:35:00.071 INFO:tasks.workunit.client.0.smithi071.stderr: -2> 2024-09-14T11:34:59.995+0000 7f34647a69c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential dests added=[] removed=[] 2024-09-14T11:35:00.071 INFO:tasks.workunit.client.0.smithi071.stderr: -1> 2024-09-14T11:35:00.003+0000 7f34647a69c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f34647a69c0 time 2024-09-14T11:35:00.007720+0000 2024-09-14T11:35:00.071 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:00.071 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.071 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:00.071 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f34680802eb] 2024-09-14T11:35:00.071 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f346808049f] 2024-09-14T11:35:00.071 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aba87b2c01] 2024-09-14T11:35:00.071 INFO:tasks.workunit.client.0.smithi071.stderr: 4: radosgw-admin(+0x142325c) [0x55aba921125c] 2024-09-14T11:35:00.071 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55aba87c7ecd] 2024-09-14T11:35:00.071 INFO:tasks.workunit.client.0.smithi071.stderr: 6: main() 2024-09-14T11:35:00.071 INFO:tasks.workunit.client.0.smithi071.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3466ee6d90] 2024-09-14T11:35:00.071 INFO:tasks.workunit.client.0.smithi071.stderr: 8: __libc_start_main() 2024-09-14T11:35:00.072 INFO:tasks.workunit.client.0.smithi071.stderr: 9: _start() 2024-09-14T11:35:00.072 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.072 INFO:tasks.workunit.client.0.smithi071.stderr: 0> 2024-09-14T11:35:00.003+0000 7f34647a69c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:35:00.072 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f34647a69c0 thread_name:radosgw-admin 2024-09-14T11:35:00.072 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.072 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:00.072 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3466eff520] 2024-09-14T11:35:00.072 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:35:00.072 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:35:00.072 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:35:00.072 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3468080345] 2024-09-14T11:35:00.072 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f346808049f] 2024-09-14T11:35:00.072 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aba87b2c01] 2024-09-14T11:35:00.072 INFO:tasks.workunit.client.0.smithi071.stderr: 8: radosgw-admin(+0x142325c) [0x55aba921125c] 2024-09-14T11:35:00.072 INFO:tasks.workunit.client.0.smithi071.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55aba87c7ecd] 2024-09-14T11:35:00.073 INFO:tasks.workunit.client.0.smithi071.stderr: 10: main() 2024-09-14T11:35:00.073 INFO:tasks.workunit.client.0.smithi071.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3466ee6d90] 2024-09-14T11:35:00.073 INFO:tasks.workunit.client.0.smithi071.stderr: 12: __libc_start_main() 2024-09-14T11:35:00.073 INFO:tasks.workunit.client.0.smithi071.stderr: 13: _start() 2024-09-14T11:35:00.073 INFO:tasks.workunit.client.0.smithi071.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:35:00.073 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.073 INFO:tasks.workunit.client.0.smithi071.stderr:--- logging levels --- 2024-09-14T11:35:00.073 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 none 2024-09-14T11:35:00.073 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 lockdep 2024-09-14T11:35:00.073 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 context 2024-09-14T11:35:00.073 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 crush 2024-09-14T11:35:00.073 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds 2024-09-14T11:35:00.073 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_balancer 2024-09-14T11:35:00.073 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_locker 2024-09-14T11:35:00.073 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log 2024-09-14T11:35:00.074 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log_expire 2024-09-14T11:35:00.074 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_migrator 2024-09-14T11:35:00.074 INFO:tasks.workunit.client.0.smithi071.stderr: 3/ 5 mds_quiesce 2024-09-14T11:35:00.074 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 buffer 2024-09-14T11:35:00.074 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 timer 2024-09-14T11:35:00.074 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 filer 2024-09-14T11:35:00.074 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 striper 2024-09-14T11:35:00.074 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 objecter 2024-09-14T11:35:00.074 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rados 2024-09-14T11:35:00.074 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd 2024-09-14T11:35:00.074 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_mirror 2024-09-14T11:35:00.074 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_replay 2024-09-14T11:35:00.074 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_pwl 2024-09-14T11:35:00.074 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 journaler 2024-09-14T11:35:00.074 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objectcacher 2024-09-14T11:35:00.074 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:35:00.075 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 client 2024-09-14T11:35:00.075 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 osd 2024-09-14T11:35:00.075 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 optracker 2024-09-14T11:35:00.075 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objclass 2024-09-14T11:35:00.075 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 filestore 2024-09-14T11:35:00.075 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 journal 2024-09-14T11:35:00.075 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 ms 2024-09-14T11:35:00.075 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mon 2024-09-14T11:35:00.075 INFO:tasks.workunit.client.0.smithi071.stderr: 0/10 monc 2024-09-14T11:35:00.075 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 paxos 2024-09-14T11:35:00.075 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 tp 2024-09-14T11:35:00.075 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 auth 2024-09-14T11:35:00.075 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 crypto 2024-09-14T11:35:00.075 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 finisher 2024-09-14T11:35:00.075 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 reserver 2024-09-14T11:35:00.076 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 heartbeatmap 2024-09-14T11:35:00.076 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 perfcounter 2024-09-14T11:35:00.076 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw 2024-09-14T11:35:00.076 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_sync 2024-09-14T11:35:00.076 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_datacache 2024-09-14T11:35:00.076 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_access 2024-09-14T11:35:00.076 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:35:00.076 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_flight 2024-09-14T11:35:00.076 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:35:00.076 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw_notification 2024-09-14T11:35:00.076 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 javaclient 2024-09-14T11:35:00.076 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 asok 2024-09-14T11:35:00.076 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 throttle 2024-09-14T11:35:00.076 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 refs 2024-09-14T11:35:00.076 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 compressor 2024-09-14T11:35:00.077 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluestore 2024-09-14T11:35:00.077 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluefs 2024-09-14T11:35:00.077 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 bdev 2024-09-14T11:35:00.077 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 kstore 2024-09-14T11:35:00.077 INFO:tasks.workunit.client.0.smithi071.stderr: 4/ 5 rocksdb 2024-09-14T11:35:00.077 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 fuse 2024-09-14T11:35:00.077 INFO:tasks.workunit.client.0.smithi071.stderr: 2/ 5 mgr 2024-09-14T11:35:00.077 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mgrc 2024-09-14T11:35:00.077 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 dpdk 2024-09-14T11:35:00.077 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 eventtrace 2024-09-14T11:35:00.077 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 prioritycache 2024-09-14T11:35:00.077 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 test 2024-09-14T11:35:00.077 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:35:00.077 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephsqlite 2024-09-14T11:35:00.078 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:35:00.078 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore 2024-09-14T11:35:00.078 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_onode 2024-09-14T11:35:00.078 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_odata 2024-09-14T11:35:00.078 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_omap 2024-09-14T11:35:00.078 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_tm 2024-09-14T11:35:00.078 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_t 2024-09-14T11:35:00.078 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:35:00.078 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_epm 2024-09-14T11:35:00.078 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_lba 2024-09-14T11:35:00.078 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:35:00.078 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cache 2024-09-14T11:35:00.078 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_journal 2024-09-14T11:35:00.078 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_device 2024-09-14T11:35:00.078 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_backref 2024-09-14T11:35:00.079 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 alienstore 2024-09-14T11:35:00.079 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mclock 2024-09-14T11:35:00.079 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cyanstore 2024-09-14T11:35:00.079 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 ceph_exporter 2024-09-14T11:35:00.079 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 memstore 2024-09-14T11:35:00.079 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 trace 2024-09-14T11:35:00.079 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 ceph_dedup 2024-09-14T11:35:00.079 INFO:tasks.workunit.client.0.smithi071.stderr: -2/-2 (syslog threshold) 2024-09-14T11:35:00.079 INFO:tasks.workunit.client.0.smithi071.stderr: 99/99 (stderr threshold) 2024-09-14T11:35:00.079 INFO:tasks.workunit.client.0.smithi071.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:35:00.079 INFO:tasks.workunit.client.0.smithi071.stderr: 7f32917fa640 / http_manager 2024-09-14T11:35:00.079 INFO:tasks.workunit.client.0.smithi071.stderr: 7f32937fe640 / http_manager 2024-09-14T11:35:00.079 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3318fe1640 / rgw_dt_lg_renew 2024-09-14T11:35:00.079 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3333fff640 / ms_dispatch 2024-09-14T11:35:00.079 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3345ffb640 / io_context_pool 2024-09-14T11:35:00.080 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3347fff640 / ms_dispatch 2024-09-14T11:35:00.080 INFO:tasks.workunit.client.0.smithi071.stderr: 7f334ee05640 / ms_dispatch 2024-09-14T11:35:00.080 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3350608640 / io_context_pool 2024-09-14T11:35:00.080 INFO:tasks.workunit.client.0.smithi071.stderr: 7f34612aa640 / io_context_pool 2024-09-14T11:35:00.080 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3461aab640 / msgr-worker-2 2024-09-14T11:35:00.080 INFO:tasks.workunit.client.0.smithi071.stderr: 7f34622ac640 / msgr-worker-1 2024-09-14T11:35:00.080 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3462aad640 / msgr-worker-0 2024-09-14T11:35:00.080 INFO:tasks.workunit.client.0.smithi071.stderr: 7f34647a69c0 / radosgw-admin 2024-09-14T11:35:00.080 INFO:tasks.workunit.client.0.smithi071.stderr: max_recent 500 2024-09-14T11:35:00.080 INFO:tasks.workunit.client.0.smithi071.stderr: max_new 1000 2024-09-14T11:35:00.080 INFO:tasks.workunit.client.0.smithi071.stderr: log_file /var/log/ceph/ceph-client.admin.143878.log 2024-09-14T11:35:00.080 INFO:tasks.workunit.client.0.smithi071.stderr:--- end dump of recent events --- 2024-09-14T11:35:00.080 INFO:tasks.workunit.client.0.smithi071.stderr:--- begin dump of recent events --- 2024-09-14T11:35:00.080 INFO:tasks.workunit.client.0.smithi071.stderr: -499> 2024-09-14T11:34:59.903+0000 7f3461aab640 10 monclient: _finish_hunting 0 2024-09-14T11:35:00.080 INFO:tasks.workunit.client.0.smithi071.stderr: -498> 2024-09-14T11:34:59.903+0000 7f3461aab640 1 monclient: found mon.noname-c 2024-09-14T11:35:00.081 INFO:tasks.workunit.client.0.smithi071.stderr: -497> 2024-09-14T11:34:59.903+0000 7f3461aab640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:35:00.081 INFO:tasks.workunit.client.0.smithi071.stderr: -496> 2024-09-14T11:34:59.903+0000 7f34622ac640 10 monclient: get_auth_request con 0x55abab54bb00 auth_method 0 2024-09-14T11:35:00.081 INFO:tasks.workunit.client.0.smithi071.stderr: -495> 2024-09-14T11:34:59.903+0000 7f3350608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:00.081 INFO:tasks.workunit.client.0.smithi071.stderr: -494> 2024-09-14T11:34:59.903+0000 7f3350608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:00.081 INFO:tasks.workunit.client.0.smithi071.stderr: -493> 2024-09-14T11:34:59.903+0000 7f3350608640 10 monclient: dump: 2024-09-14T11:35:00.081 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:00.081 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:00.081 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.081 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.081 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:00.081 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:00.081 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:00.081 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:00.081 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:00.082 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.082 INFO:tasks.workunit.client.0.smithi071.stderr: -492> 2024-09-14T11:34:59.903+0000 7f3350608640 10 monclient: _finish_auth 0 2024-09-14T11:35:00.082 INFO:tasks.workunit.client.0.smithi071.stderr: -491> 2024-09-14T11:34:59.903+0000 7f3350608640 10 monclient: _check_auth_tickets 2024-09-14T11:35:00.082 INFO:tasks.workunit.client.0.smithi071.stderr: -490> 2024-09-14T11:34:59.903+0000 7f3350608640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:00.082 INFO:tasks.workunit.client.0.smithi071.stderr: -489> 2024-09-14T11:34:59.903+0000 7f3350608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:00.082 INFO:tasks.workunit.client.0.smithi071.stderr: -488> 2024-09-14T11:34:59.903+0000 7f3350608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:00.082 INFO:tasks.workunit.client.0.smithi071.stderr: -487> 2024-09-14T11:34:59.903+0000 7f3350608640 10 monclient: dump: 2024-09-14T11:35:00.082 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:00.082 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:00.082 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.082 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.082 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:00.082 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:00.082 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:00.082 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:00.083 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:00.083 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.083 INFO:tasks.workunit.client.0.smithi071.stderr: -486> 2024-09-14T11:34:59.903+0000 7f34647a69c0 5 monclient: authenticate success, global_id 7802 2024-09-14T11:35:00.083 INFO:tasks.workunit.client.0.smithi071.stderr: -485> 2024-09-14T11:34:59.903+0000 7f34647a69c0 10 monclient: get_monmap_and_config success 2024-09-14T11:35:00.083 INFO:tasks.workunit.client.0.smithi071.stderr: -484> 2024-09-14T11:34:59.903+0000 7f34647a69c0 4 set_mon_vals no callback set 2024-09-14T11:35:00.083 INFO:tasks.workunit.client.0.smithi071.stderr: -483> 2024-09-14T11:34:59.903+0000 7f34647a69c0 10 monclient: shutdown 2024-09-14T11:35:00.083 INFO:tasks.workunit.client.0.smithi071.stderr: -482> 2024-09-14T11:34:59.903+0000 7f34647a69c0 5 asok(0x55abab48dd90) unregister_commands rotate-key 2024-09-14T11:35:00.083 INFO:tasks.workunit.client.0.smithi071.stderr: -481> 2024-09-14T11:34:59.903+0000 7f34647a69c0 10 monclient: build_initial_monmap 2024-09-14T11:35:00.083 INFO:tasks.workunit.client.0.smithi071.stderr: -480> 2024-09-14T11:34:59.903+0000 7f34647a69c0 1 build_initial for_mkfs: 0 2024-09-14T11:35:00.083 INFO:tasks.workunit.client.0.smithi071.stderr: -479> 2024-09-14T11:34:59.903+0000 7f34647a69c0 10 monclient: monmap: 2024-09-14T11:35:00.083 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:35:00.083 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:00.083 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:35:00.083 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:35:00.084 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:00.084 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:00.084 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:35:00.084 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:35:00.084 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:35:00.084 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.084 INFO:tasks.workunit.client.0.smithi071.stderr: -478> 2024-09-14T11:34:59.903+0000 7f34647a69c0 5 AuthRegistry(0x55abab699f30) adding auth protocol: cephx 2024-09-14T11:35:00.084 INFO:tasks.workunit.client.0.smithi071.stderr: -477> 2024-09-14T11:34:59.903+0000 7f34647a69c0 5 AuthRegistry(0x55abab699f30) adding auth protocol: cephx 2024-09-14T11:35:00.084 INFO:tasks.workunit.client.0.smithi071.stderr: -476> 2024-09-14T11:34:59.903+0000 7f34647a69c0 5 AuthRegistry(0x55abab699f30) adding auth protocol: cephx 2024-09-14T11:35:00.084 INFO:tasks.workunit.client.0.smithi071.stderr: -475> 2024-09-14T11:34:59.903+0000 7f34647a69c0 5 AuthRegistry(0x55abab699f30) adding con mode: secure 2024-09-14T11:35:00.084 INFO:tasks.workunit.client.0.smithi071.stderr: -474> 2024-09-14T11:34:59.903+0000 7f34647a69c0 5 AuthRegistry(0x55abab699f30) adding con mode: crc 2024-09-14T11:35:00.084 INFO:tasks.workunit.client.0.smithi071.stderr: -473> 2024-09-14T11:34:59.903+0000 7f34647a69c0 5 AuthRegistry(0x55abab699f30) adding con mode: secure 2024-09-14T11:35:00.084 INFO:tasks.workunit.client.0.smithi071.stderr: -472> 2024-09-14T11:34:59.903+0000 7f34647a69c0 5 AuthRegistry(0x55abab699f30) adding con mode: crc 2024-09-14T11:35:00.084 INFO:tasks.workunit.client.0.smithi071.stderr: -471> 2024-09-14T11:34:59.903+0000 7f34647a69c0 5 AuthRegistry(0x55abab699f30) adding con mode: secure 2024-09-14T11:35:00.085 INFO:tasks.workunit.client.0.smithi071.stderr: -470> 2024-09-14T11:34:59.903+0000 7f34647a69c0 5 AuthRegistry(0x55abab699f30) adding con mode: crc 2024-09-14T11:35:00.085 INFO:tasks.workunit.client.0.smithi071.stderr: -469> 2024-09-14T11:34:59.903+0000 7f34647a69c0 5 AuthRegistry(0x55abab699f30) adding con mode: crc 2024-09-14T11:35:00.085 INFO:tasks.workunit.client.0.smithi071.stderr: -468> 2024-09-14T11:34:59.903+0000 7f34647a69c0 5 AuthRegistry(0x55abab699f30) adding con mode: secure 2024-09-14T11:35:00.085 INFO:tasks.workunit.client.0.smithi071.stderr: -467> 2024-09-14T11:34:59.903+0000 7f34647a69c0 5 AuthRegistry(0x55abab699f30) adding con mode: crc 2024-09-14T11:35:00.085 INFO:tasks.workunit.client.0.smithi071.stderr: -466> 2024-09-14T11:34:59.903+0000 7f34647a69c0 5 AuthRegistry(0x55abab699f30) adding con mode: secure 2024-09-14T11:35:00.085 INFO:tasks.workunit.client.0.smithi071.stderr: -465> 2024-09-14T11:34:59.903+0000 7f34647a69c0 5 AuthRegistry(0x55abab699f30) adding con mode: crc 2024-09-14T11:35:00.085 INFO:tasks.workunit.client.0.smithi071.stderr: -464> 2024-09-14T11:34:59.903+0000 7f34647a69c0 5 AuthRegistry(0x55abab699f30) adding con mode: secure 2024-09-14T11:35:00.085 INFO:tasks.workunit.client.0.smithi071.stderr: -463> 2024-09-14T11:34:59.907+0000 7f34647a69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:00.085 INFO:tasks.workunit.client.0.smithi071.stderr: -462> 2024-09-14T11:34:59.907+0000 7f34647a69c0 1 librados: starting msgr at 2024-09-14T11:35:00.085 INFO:tasks.workunit.client.0.smithi071.stderr: -461> 2024-09-14T11:34:59.907+0000 7f34647a69c0 1 librados: starting objecter 2024-09-14T11:35:00.085 INFO:tasks.workunit.client.0.smithi071.stderr: -460> 2024-09-14T11:34:59.907+0000 7f34647a69c0 5 asok(0x55abab48dd90) register_command objecter_requests hook 0x55abab6c6670 2024-09-14T11:35:00.085 INFO:tasks.workunit.client.0.smithi071.stderr: -459> 2024-09-14T11:34:59.907+0000 7f34647a69c0 1 librados: setting wanted keys 2024-09-14T11:35:00.086 INFO:tasks.workunit.client.0.smithi071.stderr: -458> 2024-09-14T11:34:59.907+0000 7f34647a69c0 1 librados: calling monclient init 2024-09-14T11:35:00.086 INFO:tasks.workunit.client.0.smithi071.stderr: -457> 2024-09-14T11:34:59.907+0000 7f34647a69c0 10 monclient: init 2024-09-14T11:35:00.086 INFO:tasks.workunit.client.0.smithi071.stderr: -456> 2024-09-14T11:34:59.907+0000 7f34647a69c0 5 AuthRegistry(0x55abab698140) adding auth protocol: cephx 2024-09-14T11:35:00.086 INFO:tasks.workunit.client.0.smithi071.stderr: -455> 2024-09-14T11:34:59.907+0000 7f34647a69c0 5 AuthRegistry(0x55abab698140) adding auth protocol: cephx 2024-09-14T11:35:00.086 INFO:tasks.workunit.client.0.smithi071.stderr: -454> 2024-09-14T11:34:59.907+0000 7f34647a69c0 5 AuthRegistry(0x55abab698140) adding auth protocol: cephx 2024-09-14T11:35:00.086 INFO:tasks.workunit.client.0.smithi071.stderr: -453> 2024-09-14T11:34:59.907+0000 7f34647a69c0 5 AuthRegistry(0x55abab698140) adding con mode: secure 2024-09-14T11:35:00.086 INFO:tasks.workunit.client.0.smithi071.stderr: -452> 2024-09-14T11:34:59.907+0000 7f34647a69c0 5 AuthRegistry(0x55abab698140) adding con mode: crc 2024-09-14T11:35:00.086 INFO:tasks.workunit.client.0.smithi071.stderr: -451> 2024-09-14T11:34:59.907+0000 7f34647a69c0 5 AuthRegistry(0x55abab698140) adding con mode: secure 2024-09-14T11:35:00.086 INFO:tasks.workunit.client.0.smithi071.stderr: -450> 2024-09-14T11:34:59.907+0000 7f34647a69c0 5 AuthRegistry(0x55abab698140) adding con mode: crc 2024-09-14T11:35:00.086 INFO:tasks.workunit.client.0.smithi071.stderr: -449> 2024-09-14T11:34:59.907+0000 7f34647a69c0 5 AuthRegistry(0x55abab698140) adding con mode: secure 2024-09-14T11:35:00.086 INFO:tasks.workunit.client.0.smithi071.stderr: -448> 2024-09-14T11:34:59.907+0000 7f34647a69c0 5 AuthRegistry(0x55abab698140) adding con mode: crc 2024-09-14T11:35:00.086 INFO:tasks.workunit.client.0.smithi071.stderr: -447> 2024-09-14T11:34:59.907+0000 7f34647a69c0 5 AuthRegistry(0x55abab698140) adding con mode: crc 2024-09-14T11:35:00.086 INFO:tasks.workunit.client.0.smithi071.stderr: -446> 2024-09-14T11:34:59.907+0000 7f34647a69c0 5 AuthRegistry(0x55abab698140) adding con mode: secure 2024-09-14T11:35:00.086 INFO:tasks.workunit.client.0.smithi071.stderr: -445> 2024-09-14T11:34:59.907+0000 7f34647a69c0 5 AuthRegistry(0x55abab698140) adding con mode: crc 2024-09-14T11:35:00.086 INFO:tasks.workunit.client.0.smithi071.stderr: -444> 2024-09-14T11:34:59.907+0000 7f34647a69c0 5 AuthRegistry(0x55abab698140) adding con mode: secure 2024-09-14T11:35:00.087 INFO:tasks.workunit.client.0.smithi071.stderr: -443> 2024-09-14T11:34:59.907+0000 7f34647a69c0 5 AuthRegistry(0x55abab698140) adding con mode: crc 2024-09-14T11:35:00.087 INFO:tasks.workunit.client.0.smithi071.stderr: -442> 2024-09-14T11:34:59.907+0000 7f34647a69c0 5 AuthRegistry(0x55abab698140) adding con mode: secure 2024-09-14T11:35:00.087 INFO:tasks.workunit.client.0.smithi071.stderr: -441> 2024-09-14T11:34:59.907+0000 7f34647a69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:00.087 INFO:tasks.workunit.client.0.smithi071.stderr: -440> 2024-09-14T11:34:59.907+0000 7f34647a69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:00.087 INFO:tasks.workunit.client.0.smithi071.stderr: -439> 2024-09-14T11:34:59.907+0000 7f34647a69c0 5 asok(0x55abab48dd90) register_command rotate-key hook 0x55abab698288 2024-09-14T11:35:00.087 INFO:tasks.workunit.client.0.smithi071.stderr: -438> 2024-09-14T11:34:59.907+0000 7f34647a69c0 10 monclient: _reopen_session rank -1 2024-09-14T11:35:00.087 INFO:tasks.workunit.client.0.smithi071.stderr: -437> 2024-09-14T11:34:59.907+0000 7f34647a69c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:35:00.087 INFO:tasks.workunit.client.0.smithi071.stderr: -436> 2024-09-14T11:34:59.907+0000 7f34647a69c0 10 monclient(hunting): picked mon.noname-c con 0x55abab54bb00 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:35:00.087 INFO:tasks.workunit.client.0.smithi071.stderr: -435> 2024-09-14T11:34:59.907+0000 7f34647a69c0 10 monclient(hunting): picked mon.noname-a con 0x55abab557870 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:35:00.087 INFO:tasks.workunit.client.0.smithi071.stderr: -434> 2024-09-14T11:34:59.907+0000 7f34647a69c0 10 monclient(hunting): picked mon.noname-b con 0x55abab69e7e0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:35:00.087 INFO:tasks.workunit.client.0.smithi071.stderr: -433> 2024-09-14T11:34:59.907+0000 7f34647a69c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:00.087 INFO:tasks.workunit.client.0.smithi071.stderr: -432> 2024-09-14T11:34:59.907+0000 7f34647a69c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:00.087 INFO:tasks.workunit.client.0.smithi071.stderr: -431> 2024-09-14T11:34:59.907+0000 7f34647a69c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:00.088 INFO:tasks.workunit.client.0.smithi071.stderr: -430> 2024-09-14T11:34:59.907+0000 7f34647a69c0 10 monclient(hunting): _renew_subs 2024-09-14T11:35:00.088 INFO:tasks.workunit.client.0.smithi071.stderr: -429> 2024-09-14T11:34:59.907+0000 7f34647a69c0 10 monclient(hunting): authenticate will time out at 2512.029077s 2024-09-14T11:35:00.088 INFO:tasks.workunit.client.0.smithi071.stderr: -428> 2024-09-14T11:34:59.907+0000 7f3461aab640 10 monclient(hunting): get_auth_request con 0x55abab557870 auth_method 0 2024-09-14T11:35:00.088 INFO:tasks.workunit.client.0.smithi071.stderr: -427> 2024-09-14T11:34:59.907+0000 7f3461aab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:00.088 INFO:tasks.workunit.client.0.smithi071.stderr: -426> 2024-09-14T11:34:59.907+0000 7f3461aab640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:00.088 INFO:tasks.workunit.client.0.smithi071.stderr: -425> 2024-09-14T11:34:59.907+0000 7f3461aab640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:00.088 INFO:tasks.workunit.client.0.smithi071.stderr: -424> 2024-09-14T11:34:59.907+0000 7f34622ac640 10 monclient(hunting): get_auth_request con 0x55abab54bb00 auth_method 0 2024-09-14T11:35:00.088 INFO:tasks.workunit.client.0.smithi071.stderr: -423> 2024-09-14T11:34:59.907+0000 7f34622ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:00.088 INFO:tasks.workunit.client.0.smithi071.stderr: -422> 2024-09-14T11:34:59.907+0000 7f34622ac640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:00.088 INFO:tasks.workunit.client.0.smithi071.stderr: -421> 2024-09-14T11:34:59.907+0000 7f34622ac640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:00.088 INFO:tasks.workunit.client.0.smithi071.stderr: -420> 2024-09-14T11:34:59.907+0000 7f3461aab640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:00.088 INFO:tasks.workunit.client.0.smithi071.stderr: -419> 2024-09-14T11:34:59.907+0000 7f3461aab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:00.088 INFO:tasks.workunit.client.0.smithi071.stderr: -418> 2024-09-14T11:34:59.907+0000 7f3461aab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:00.088 INFO:tasks.workunit.client.0.smithi071.stderr: -417> 2024-09-14T11:34:59.907+0000 7f34622ac640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:00.089 INFO:tasks.workunit.client.0.smithi071.stderr: -416> 2024-09-14T11:34:59.907+0000 7f34622ac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:00.089 INFO:tasks.workunit.client.0.smithi071.stderr: -415> 2024-09-14T11:34:59.907+0000 7f34622ac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:00.089 INFO:tasks.workunit.client.0.smithi071.stderr: -414> 2024-09-14T11:34:59.907+0000 7f3461aab640 10 monclient(hunting): handle_auth_done global_id 8220 payload 824 2024-09-14T11:35:00.089 INFO:tasks.workunit.client.0.smithi071.stderr: -413> 2024-09-14T11:34:59.907+0000 7f3461aab640 10 monclient: _finish_hunting 0 2024-09-14T11:35:00.089 INFO:tasks.workunit.client.0.smithi071.stderr: -412> 2024-09-14T11:34:59.907+0000 7f3461aab640 1 monclient: found mon.noname-a 2024-09-14T11:35:00.089 INFO:tasks.workunit.client.0.smithi071.stderr: -411> 2024-09-14T11:34:59.907+0000 7f3461aab640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:35:00.089 INFO:tasks.workunit.client.0.smithi071.stderr: -410> 2024-09-14T11:34:59.907+0000 7f334ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:00.089 INFO:tasks.workunit.client.0.smithi071.stderr: -409> 2024-09-14T11:34:59.907+0000 7f334ee05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:00.089 INFO:tasks.workunit.client.0.smithi071.stderr: -408> 2024-09-14T11:34:59.907+0000 7f334ee05640 10 monclient: dump: 2024-09-14T11:35:00.089 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:00.089 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:00.089 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.089 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.089 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:00.090 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:00.090 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:00.090 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:00.090 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:00.090 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.090 INFO:tasks.workunit.client.0.smithi071.stderr: -407> 2024-09-14T11:34:59.907+0000 7f334ee05640 10 monclient: _finish_auth 0 2024-09-14T11:35:00.090 INFO:tasks.workunit.client.0.smithi071.stderr: -406> 2024-09-14T11:34:59.907+0000 7f334ee05640 10 monclient: _check_auth_tickets 2024-09-14T11:35:00.090 INFO:tasks.workunit.client.0.smithi071.stderr: -405> 2024-09-14T11:34:59.907+0000 7f34647a69c0 5 monclient: authenticate success, global_id 8220 2024-09-14T11:35:00.090 INFO:tasks.workunit.client.0.smithi071.stderr: -404> 2024-09-14T11:34:59.907+0000 7f34647a69c0 10 monclient: _renew_subs 2024-09-14T11:35:00.090 INFO:tasks.workunit.client.0.smithi071.stderr: -403> 2024-09-14T11:34:59.907+0000 7f34647a69c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:35:00.090 INFO:tasks.workunit.client.0.smithi071.stderr: -402> 2024-09-14T11:34:59.907+0000 7f34647a69c0 10 monclient: _renew_subs 2024-09-14T11:35:00.090 INFO:tasks.workunit.client.0.smithi071.stderr: -401> 2024-09-14T11:34:59.907+0000 7f34647a69c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:35:00.090 INFO:tasks.workunit.client.0.smithi071.stderr: -400> 2024-09-14T11:34:59.907+0000 7f34647a69c0 1 librados: init done 2024-09-14T11:35:00.090 INFO:tasks.workunit.client.0.smithi071.stderr: -399> 2024-09-14T11:34:59.907+0000 7f334ee05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:00.091 INFO:tasks.workunit.client.0.smithi071.stderr: -398> 2024-09-14T11:34:59.907+0000 7f334ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:00.091 INFO:tasks.workunit.client.0.smithi071.stderr: -397> 2024-09-14T11:34:59.907+0000 7f334ee05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:00.091 INFO:tasks.workunit.client.0.smithi071.stderr: -396> 2024-09-14T11:34:59.907+0000 7f334ee05640 10 monclient: dump: 2024-09-14T11:35:00.091 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:00.091 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:00.091 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.091 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.091 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:00.091 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:00.091 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:00.091 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:00.091 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:00.091 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.091 INFO:tasks.workunit.client.0.smithi071.stderr: -395> 2024-09-14T11:34:59.907+0000 7f3350608640 4 set_mon_vals no callback set 2024-09-14T11:35:00.091 INFO:tasks.workunit.client.0.smithi071.stderr: -394> 2024-09-14T11:34:59.907+0000 7f334ee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:00.092 INFO:tasks.workunit.client.0.smithi071.stderr: -393> 2024-09-14T11:34:59.907+0000 7f334ee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:35:00.092 INFO:tasks.workunit.client.0.smithi071.stderr: -392> 2024-09-14T11:34:59.907+0000 7f334ee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:35:00.092 INFO:tasks.workunit.client.0.smithi071.stderr: -391> 2024-09-14T11:34:59.911+0000 7f34622ac640 10 monclient: get_auth_request con 0x7f33480718d0 auth_method 0 2024-09-14T11:35:00.092 INFO:tasks.workunit.client.0.smithi071.stderr: -390> 2024-09-14T11:34:59.911+0000 7f3462aad640 10 monclient: get_auth_request con 0x55abab6c0600 auth_method 0 2024-09-14T11:35:00.092 INFO:tasks.workunit.client.0.smithi071.stderr: -389> 2024-09-14T11:34:59.911+0000 7f34622ac640 10 monclient: get_auth_request con 0x55abab6e30b0 auth_method 0 2024-09-14T11:35:00.092 INFO:tasks.workunit.client.0.smithi071.stderr: -388> 2024-09-14T11:34:59.911+0000 7f3461aab640 10 monclient: get_auth_request con 0x55abab6e7540 auth_method 0 2024-09-14T11:35:00.092 INFO:tasks.workunit.client.0.smithi071.stderr: -387> 2024-09-14T11:34:59.915+0000 7f3462aad640 10 monclient: get_auth_request con 0x55abab6eb580 auth_method 0 2024-09-14T11:35:00.092 INFO:tasks.workunit.client.0.smithi071.stderr: -386> 2024-09-14T11:34:59.915+0000 7f34647a69c0 10 monclient: build_initial_monmap 2024-09-14T11:35:00.092 INFO:tasks.workunit.client.0.smithi071.stderr: -385> 2024-09-14T11:34:59.915+0000 7f34647a69c0 1 build_initial for_mkfs: 0 2024-09-14T11:35:00.092 INFO:tasks.workunit.client.0.smithi071.stderr: -384> 2024-09-14T11:34:59.915+0000 7f34647a69c0 10 monclient: monmap: 2024-09-14T11:35:00.092 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:35:00.092 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:00.092 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:35:00.092 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:35:00.092 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:00.093 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:00.093 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:35:00.093 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:35:00.093 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:35:00.093 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.093 INFO:tasks.workunit.client.0.smithi071.stderr: -383> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ef740) adding auth protocol: cephx 2024-09-14T11:35:00.093 INFO:tasks.workunit.client.0.smithi071.stderr: -382> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ef740) adding auth protocol: cephx 2024-09-14T11:35:00.093 INFO:tasks.workunit.client.0.smithi071.stderr: -381> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ef740) adding auth protocol: cephx 2024-09-14T11:35:00.093 INFO:tasks.workunit.client.0.smithi071.stderr: -380> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ef740) adding con mode: secure 2024-09-14T11:35:00.093 INFO:tasks.workunit.client.0.smithi071.stderr: -379> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ef740) adding con mode: crc 2024-09-14T11:35:00.093 INFO:tasks.workunit.client.0.smithi071.stderr: -378> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ef740) adding con mode: secure 2024-09-14T11:35:00.093 INFO:tasks.workunit.client.0.smithi071.stderr: -377> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ef740) adding con mode: crc 2024-09-14T11:35:00.093 INFO:tasks.workunit.client.0.smithi071.stderr: -376> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ef740) adding con mode: secure 2024-09-14T11:35:00.093 INFO:tasks.workunit.client.0.smithi071.stderr: -375> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ef740) adding con mode: crc 2024-09-14T11:35:00.094 INFO:tasks.workunit.client.0.smithi071.stderr: -374> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ef740) adding con mode: crc 2024-09-14T11:35:00.094 INFO:tasks.workunit.client.0.smithi071.stderr: -373> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ef740) adding con mode: secure 2024-09-14T11:35:00.094 INFO:tasks.workunit.client.0.smithi071.stderr: -372> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ef740) adding con mode: crc 2024-09-14T11:35:00.094 INFO:tasks.workunit.client.0.smithi071.stderr: -371> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ef740) adding con mode: secure 2024-09-14T11:35:00.094 INFO:tasks.workunit.client.0.smithi071.stderr: -370> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ef740) adding con mode: crc 2024-09-14T11:35:00.094 INFO:tasks.workunit.client.0.smithi071.stderr: -369> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ef740) adding con mode: secure 2024-09-14T11:35:00.094 INFO:tasks.workunit.client.0.smithi071.stderr: -368> 2024-09-14T11:34:59.915+0000 7f34647a69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:00.094 INFO:tasks.workunit.client.0.smithi071.stderr: -367> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 asok(0x55abab48dd90) register_command objecter_requests cmddesc objecter_requests hook 0x55abab6f3060 EEXIST 2024-09-14T11:35:00.094 INFO:tasks.workunit.client.0.smithi071.stderr: -366> 2024-09-14T11:34:59.915+0000 7f34647a69c0 10 monclient: init 2024-09-14T11:35:00.094 INFO:tasks.workunit.client.0.smithi071.stderr: -365> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ee598) adding auth protocol: cephx 2024-09-14T11:35:00.094 INFO:tasks.workunit.client.0.smithi071.stderr: -364> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ee598) adding auth protocol: cephx 2024-09-14T11:35:00.094 INFO:tasks.workunit.client.0.smithi071.stderr: -363> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ee598) adding auth protocol: cephx 2024-09-14T11:35:00.094 INFO:tasks.workunit.client.0.smithi071.stderr: -362> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ee598) adding con mode: secure 2024-09-14T11:35:00.094 INFO:tasks.workunit.client.0.smithi071.stderr: -361> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ee598) adding con mode: crc 2024-09-14T11:35:00.095 INFO:tasks.workunit.client.0.smithi071.stderr: -360> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ee598) adding con mode: secure 2024-09-14T11:35:00.095 INFO:tasks.workunit.client.0.smithi071.stderr: -359> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ee598) adding con mode: crc 2024-09-14T11:35:00.095 INFO:tasks.workunit.client.0.smithi071.stderr: -358> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ee598) adding con mode: secure 2024-09-14T11:35:00.095 INFO:tasks.workunit.client.0.smithi071.stderr: -357> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ee598) adding con mode: crc 2024-09-14T11:35:00.095 INFO:tasks.workunit.client.0.smithi071.stderr: -356> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ee598) adding con mode: crc 2024-09-14T11:35:00.095 INFO:tasks.workunit.client.0.smithi071.stderr: -355> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ee598) adding con mode: secure 2024-09-14T11:35:00.095 INFO:tasks.workunit.client.0.smithi071.stderr: -354> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ee598) adding con mode: crc 2024-09-14T11:35:00.095 INFO:tasks.workunit.client.0.smithi071.stderr: -353> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ee598) adding con mode: secure 2024-09-14T11:35:00.095 INFO:tasks.workunit.client.0.smithi071.stderr: -352> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ee598) adding con mode: crc 2024-09-14T11:35:00.095 INFO:tasks.workunit.client.0.smithi071.stderr: -351> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 AuthRegistry(0x55abab6ee598) adding con mode: secure 2024-09-14T11:35:00.095 INFO:tasks.workunit.client.0.smithi071.stderr: -350> 2024-09-14T11:34:59.915+0000 7f34647a69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:00.095 INFO:tasks.workunit.client.0.smithi071.stderr: -349> 2024-09-14T11:34:59.915+0000 7f34647a69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:00.095 INFO:tasks.workunit.client.0.smithi071.stderr: -348> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 asok(0x55abab48dd90) register_command rotate-key cmddesc rotate-key hook 0x55abab6ee6e0 EEXIST 2024-09-14T11:35:00.095 INFO:tasks.workunit.client.0.smithi071.stderr: -347> 2024-09-14T11:34:59.915+0000 7f34647a69c0 10 monclient: _reopen_session rank -1 2024-09-14T11:35:00.096 INFO:tasks.workunit.client.0.smithi071.stderr: -346> 2024-09-14T11:34:59.915+0000 7f34647a69c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:35:00.096 INFO:tasks.workunit.client.0.smithi071.stderr: -345> 2024-09-14T11:34:59.915+0000 7f34647a69c0 10 monclient(hunting): picked mon.noname-a con 0x55abab717210 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:35:00.096 INFO:tasks.workunit.client.0.smithi071.stderr: -344> 2024-09-14T11:34:59.915+0000 7f34647a69c0 10 monclient(hunting): picked mon.noname-c con 0x55abab716b40 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:35:00.096 INFO:tasks.workunit.client.0.smithi071.stderr: -343> 2024-09-14T11:34:59.915+0000 7f34647a69c0 10 monclient(hunting): picked mon.noname-b con 0x55abab715520 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:35:00.096 INFO:tasks.workunit.client.0.smithi071.stderr: -342> 2024-09-14T11:34:59.915+0000 7f34647a69c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:00.096 INFO:tasks.workunit.client.0.smithi071.stderr: -341> 2024-09-14T11:34:59.915+0000 7f34647a69c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:00.096 INFO:tasks.workunit.client.0.smithi071.stderr: -340> 2024-09-14T11:34:59.915+0000 7f34647a69c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:00.096 INFO:tasks.workunit.client.0.smithi071.stderr: -339> 2024-09-14T11:34:59.915+0000 7f34647a69c0 10 monclient(hunting): _renew_subs 2024-09-14T11:35:00.096 INFO:tasks.workunit.client.0.smithi071.stderr: -338> 2024-09-14T11:34:59.915+0000 7f34647a69c0 10 monclient(hunting): authenticate will time out at 2512.038832s 2024-09-14T11:35:00.096 INFO:tasks.workunit.client.0.smithi071.stderr: -337> 2024-09-14T11:34:59.915+0000 7f3461aab640 10 monclient(hunting): get_auth_request con 0x55abab717210 auth_method 0 2024-09-14T11:35:00.096 INFO:tasks.workunit.client.0.smithi071.stderr: -336> 2024-09-14T11:34:59.915+0000 7f3461aab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:00.096 INFO:tasks.workunit.client.0.smithi071.stderr: -335> 2024-09-14T11:34:59.915+0000 7f3461aab640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:00.096 INFO:tasks.workunit.client.0.smithi071.stderr: -334> 2024-09-14T11:34:59.915+0000 7f3461aab640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:00.096 INFO:tasks.workunit.client.0.smithi071.stderr: -333> 2024-09-14T11:34:59.915+0000 7f3462aad640 10 monclient(hunting): get_auth_request con 0x55abab716b40 auth_method 0 2024-09-14T11:35:00.096 INFO:tasks.workunit.client.0.smithi071.stderr: -332> 2024-09-14T11:34:59.915+0000 7f3462aad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:00.097 INFO:tasks.workunit.client.0.smithi071.stderr: -331> 2024-09-14T11:34:59.915+0000 7f3462aad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:00.097 INFO:tasks.workunit.client.0.smithi071.stderr: -330> 2024-09-14T11:34:59.915+0000 7f3462aad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:00.097 INFO:tasks.workunit.client.0.smithi071.stderr: -329> 2024-09-14T11:34:59.915+0000 7f3461aab640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:00.097 INFO:tasks.workunit.client.0.smithi071.stderr: -328> 2024-09-14T11:34:59.915+0000 7f3461aab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:00.097 INFO:tasks.workunit.client.0.smithi071.stderr: -327> 2024-09-14T11:34:59.915+0000 7f3461aab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:00.097 INFO:tasks.workunit.client.0.smithi071.stderr: -326> 2024-09-14T11:34:59.915+0000 7f3462aad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:00.097 INFO:tasks.workunit.client.0.smithi071.stderr: -325> 2024-09-14T11:34:59.915+0000 7f3462aad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:00.097 INFO:tasks.workunit.client.0.smithi071.stderr: -324> 2024-09-14T11:34:59.915+0000 7f3462aad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:00.097 INFO:tasks.workunit.client.0.smithi071.stderr: -323> 2024-09-14T11:34:59.915+0000 7f3461aab640 10 monclient(hunting): handle_auth_done global_id 8223 payload 824 2024-09-14T11:35:00.097 INFO:tasks.workunit.client.0.smithi071.stderr: -322> 2024-09-14T11:34:59.915+0000 7f3461aab640 10 monclient: _finish_hunting 0 2024-09-14T11:35:00.097 INFO:tasks.workunit.client.0.smithi071.stderr: -321> 2024-09-14T11:34:59.915+0000 7f3461aab640 1 monclient: found mon.noname-a 2024-09-14T11:35:00.097 INFO:tasks.workunit.client.0.smithi071.stderr: -320> 2024-09-14T11:34:59.915+0000 7f3461aab640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:35:00.097 INFO:tasks.workunit.client.0.smithi071.stderr: -319> 2024-09-14T11:34:59.915+0000 7f34622ac640 10 monclient: get_auth_request con 0x55abab715520 auth_method 0 2024-09-14T11:35:00.097 INFO:tasks.workunit.client.0.smithi071.stderr: -318> 2024-09-14T11:34:59.915+0000 7f3347fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:00.097 INFO:tasks.workunit.client.0.smithi071.stderr: -317> 2024-09-14T11:34:59.915+0000 7f3347fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:00.098 INFO:tasks.workunit.client.0.smithi071.stderr: -316> 2024-09-14T11:34:59.915+0000 7f3347fff640 10 monclient: dump: 2024-09-14T11:35:00.098 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:00.098 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:00.098 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.098 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.098 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:00.098 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:00.098 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:00.098 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:00.098 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:00.098 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.098 INFO:tasks.workunit.client.0.smithi071.stderr: -315> 2024-09-14T11:34:59.915+0000 7f3347fff640 10 monclient: _finish_auth 0 2024-09-14T11:35:00.098 INFO:tasks.workunit.client.0.smithi071.stderr: -314> 2024-09-14T11:34:59.915+0000 7f3347fff640 10 monclient: _check_auth_tickets 2024-09-14T11:35:00.099 INFO:tasks.workunit.client.0.smithi071.stderr: -313> 2024-09-14T11:34:59.915+0000 7f3347fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:00.099 INFO:tasks.workunit.client.0.smithi071.stderr: -312> 2024-09-14T11:34:59.915+0000 7f3347fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:00.099 INFO:tasks.workunit.client.0.smithi071.stderr: -311> 2024-09-14T11:34:59.915+0000 7f3347fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:00.099 INFO:tasks.workunit.client.0.smithi071.stderr: -310> 2024-09-14T11:34:59.915+0000 7f3347fff640 10 monclient: dump: 2024-09-14T11:35:00.099 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:00.099 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:00.099 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.099 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.099 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:00.099 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:00.099 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:00.099 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:00.099 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:00.099 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.100 INFO:tasks.workunit.client.0.smithi071.stderr: -309> 2024-09-14T11:34:59.915+0000 7f34647a69c0 5 monclient: authenticate success, global_id 8223 2024-09-14T11:35:00.100 INFO:tasks.workunit.client.0.smithi071.stderr: -308> 2024-09-14T11:34:59.915+0000 7f34647a69c0 10 monclient: _renew_subs 2024-09-14T11:35:00.100 INFO:tasks.workunit.client.0.smithi071.stderr: -307> 2024-09-14T11:34:59.915+0000 7f34612aa640 4 set_mon_vals no callback set 2024-09-14T11:35:00.100 INFO:tasks.workunit.client.0.smithi071.stderr: -306> 2024-09-14T11:34:59.915+0000 7f34647a69c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:35:00.100 INFO:tasks.workunit.client.0.smithi071.stderr: -305> 2024-09-14T11:34:59.915+0000 7f34647a69c0 10 monclient: _renew_subs 2024-09-14T11:35:00.100 INFO:tasks.workunit.client.0.smithi071.stderr: -304> 2024-09-14T11:34:59.915+0000 7f34647a69c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:35:00.100 INFO:tasks.workunit.client.0.smithi071.stderr: -303> 2024-09-14T11:34:59.919+0000 7f3347fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:00.100 INFO:tasks.workunit.client.0.smithi071.stderr: -302> 2024-09-14T11:34:59.919+0000 7f3347fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:35:00.100 INFO:tasks.workunit.client.0.smithi071.stderr: -301> 2024-09-14T11:34:59.919+0000 7f3347fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:35:00.100 INFO:tasks.workunit.client.0.smithi071.stderr: -300> 2024-09-14T11:34:59.919+0000 7f3462aad640 10 monclient: get_auth_request con 0x7f333c0717e0 auth_method 0 2024-09-14T11:35:00.100 INFO:tasks.workunit.client.0.smithi071.stderr: -299> 2024-09-14T11:34:59.919+0000 7f34647a69c0 10 monclient: get_monmap_and_config 2024-09-14T11:35:00.100 INFO:tasks.workunit.client.0.smithi071.stderr: -298> 2024-09-14T11:34:59.919+0000 7f34647a69c0 10 monclient: build_initial_monmap 2024-09-14T11:35:00.100 INFO:tasks.workunit.client.0.smithi071.stderr: -297> 2024-09-14T11:34:59.919+0000 7f34647a69c0 1 build_initial for_mkfs: 0 2024-09-14T11:35:00.100 INFO:tasks.workunit.client.0.smithi071.stderr: -296> 2024-09-14T11:34:59.919+0000 7f34647a69c0 10 monclient: monmap: 2024-09-14T11:35:00.100 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:35:00.101 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:00.101 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:35:00.101 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:35:00.101 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:00.101 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:00.101 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:35:00.101 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:35:00.101 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:35:00.101 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.101 INFO:tasks.workunit.client.0.smithi071.stderr: -295> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x55abab736790) adding auth protocol: cephx 2024-09-14T11:35:00.101 INFO:tasks.workunit.client.0.smithi071.stderr: -294> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x55abab736790) adding auth protocol: cephx 2024-09-14T11:35:00.101 INFO:tasks.workunit.client.0.smithi071.stderr: -293> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x55abab736790) adding auth protocol: cephx 2024-09-14T11:35:00.101 INFO:tasks.workunit.client.0.smithi071.stderr: -292> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x55abab736790) adding con mode: secure 2024-09-14T11:35:00.101 INFO:tasks.workunit.client.0.smithi071.stderr: -291> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x55abab736790) adding con mode: crc 2024-09-14T11:35:00.101 INFO:tasks.workunit.client.0.smithi071.stderr: -290> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x55abab736790) adding con mode: secure 2024-09-14T11:35:00.102 INFO:tasks.workunit.client.0.smithi071.stderr: -289> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x55abab736790) adding con mode: crc 2024-09-14T11:35:00.102 INFO:tasks.workunit.client.0.smithi071.stderr: -288> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x55abab736790) adding con mode: secure 2024-09-14T11:35:00.102 INFO:tasks.workunit.client.0.smithi071.stderr: -287> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x55abab736790) adding con mode: crc 2024-09-14T11:35:00.102 INFO:tasks.workunit.client.0.smithi071.stderr: -286> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x55abab736790) adding con mode: crc 2024-09-14T11:35:00.102 INFO:tasks.workunit.client.0.smithi071.stderr: -285> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x55abab736790) adding con mode: secure 2024-09-14T11:35:00.102 INFO:tasks.workunit.client.0.smithi071.stderr: -284> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x55abab736790) adding con mode: crc 2024-09-14T11:35:00.102 INFO:tasks.workunit.client.0.smithi071.stderr: -283> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x55abab736790) adding con mode: secure 2024-09-14T11:35:00.102 INFO:tasks.workunit.client.0.smithi071.stderr: -282> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x55abab736790) adding con mode: crc 2024-09-14T11:35:00.102 INFO:tasks.workunit.client.0.smithi071.stderr: -281> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x55abab736790) adding con mode: secure 2024-09-14T11:35:00.102 INFO:tasks.workunit.client.0.smithi071.stderr: -280> 2024-09-14T11:34:59.919+0000 7f34647a69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:00.102 INFO:tasks.workunit.client.0.smithi071.stderr: -279> 2024-09-14T11:34:59.919+0000 7f34647a69c0 10 monclient: init 2024-09-14T11:35:00.102 INFO:tasks.workunit.client.0.smithi071.stderr: -278> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1701c0) adding auth protocol: cephx 2024-09-14T11:35:00.102 INFO:tasks.workunit.client.0.smithi071.stderr: -277> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1701c0) adding auth protocol: cephx 2024-09-14T11:35:00.102 INFO:tasks.workunit.client.0.smithi071.stderr: -276> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1701c0) adding auth protocol: cephx 2024-09-14T11:35:00.103 INFO:tasks.workunit.client.0.smithi071.stderr: -275> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1701c0) adding con mode: secure 2024-09-14T11:35:00.103 INFO:tasks.workunit.client.0.smithi071.stderr: -274> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1701c0) adding con mode: crc 2024-09-14T11:35:00.103 INFO:tasks.workunit.client.0.smithi071.stderr: -273> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1701c0) adding con mode: secure 2024-09-14T11:35:00.103 INFO:tasks.workunit.client.0.smithi071.stderr: -272> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1701c0) adding con mode: crc 2024-09-14T11:35:00.103 INFO:tasks.workunit.client.0.smithi071.stderr: -271> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1701c0) adding con mode: secure 2024-09-14T11:35:00.103 INFO:tasks.workunit.client.0.smithi071.stderr: -270> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1701c0) adding con mode: crc 2024-09-14T11:35:00.103 INFO:tasks.workunit.client.0.smithi071.stderr: -269> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1701c0) adding con mode: crc 2024-09-14T11:35:00.103 INFO:tasks.workunit.client.0.smithi071.stderr: -268> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1701c0) adding con mode: secure 2024-09-14T11:35:00.103 INFO:tasks.workunit.client.0.smithi071.stderr: -267> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1701c0) adding con mode: crc 2024-09-14T11:35:00.103 INFO:tasks.workunit.client.0.smithi071.stderr: -266> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1701c0) adding con mode: secure 2024-09-14T11:35:00.103 INFO:tasks.workunit.client.0.smithi071.stderr: -265> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1701c0) adding con mode: crc 2024-09-14T11:35:00.103 INFO:tasks.workunit.client.0.smithi071.stderr: -264> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1701c0) adding con mode: secure 2024-09-14T11:35:00.103 INFO:tasks.workunit.client.0.smithi071.stderr: -263> 2024-09-14T11:34:59.919+0000 7f34647a69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:00.103 INFO:tasks.workunit.client.0.smithi071.stderr: -262> 2024-09-14T11:34:59.919+0000 7f34647a69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:00.104 INFO:tasks.workunit.client.0.smithi071.stderr: -261> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 asok(0x55abab48dd90) register_command rotate-key cmddesc rotate-key hook 0x7fffaf170308 EEXIST 2024-09-14T11:35:00.104 INFO:tasks.workunit.client.0.smithi071.stderr: -260> 2024-09-14T11:34:59.919+0000 7f34647a69c0 10 monclient: _reopen_session rank -1 2024-09-14T11:35:00.104 INFO:tasks.workunit.client.0.smithi071.stderr: -259> 2024-09-14T11:34:59.919+0000 7f34647a69c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:35:00.104 INFO:tasks.workunit.client.0.smithi071.stderr: -258> 2024-09-14T11:34:59.919+0000 7f34647a69c0 10 monclient(hunting): picked mon.noname-c con 0x55abab76ade0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:35:00.104 INFO:tasks.workunit.client.0.smithi071.stderr: -257> 2024-09-14T11:34:59.919+0000 7f34647a69c0 10 monclient(hunting): picked mon.noname-b con 0x55abab73a800 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:35:00.104 INFO:tasks.workunit.client.0.smithi071.stderr: -256> 2024-09-14T11:34:59.919+0000 7f34647a69c0 10 monclient(hunting): picked mon.noname-a con 0x55abab7665b0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:35:00.104 INFO:tasks.workunit.client.0.smithi071.stderr: -255> 2024-09-14T11:34:59.919+0000 7f34647a69c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:00.104 INFO:tasks.workunit.client.0.smithi071.stderr: -254> 2024-09-14T11:34:59.919+0000 7f34647a69c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:00.104 INFO:tasks.workunit.client.0.smithi071.stderr: -253> 2024-09-14T11:34:59.919+0000 7f34647a69c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:00.104 INFO:tasks.workunit.client.0.smithi071.stderr: -252> 2024-09-14T11:34:59.919+0000 7f34647a69c0 10 monclient(hunting): _renew_subs 2024-09-14T11:35:00.104 INFO:tasks.workunit.client.0.smithi071.stderr: -251> 2024-09-14T11:34:59.919+0000 7f34647a69c0 10 monclient(hunting): authenticate will time out at 2512.042867s 2024-09-14T11:35:00.104 INFO:tasks.workunit.client.0.smithi071.stderr: -250> 2024-09-14T11:34:59.919+0000 7f3461aab640 10 monclient(hunting): get_auth_request con 0x55abab76ade0 auth_method 0 2024-09-14T11:35:00.104 INFO:tasks.workunit.client.0.smithi071.stderr: -249> 2024-09-14T11:34:59.919+0000 7f3461aab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:00.105 INFO:tasks.workunit.client.0.smithi071.stderr: -248> 2024-09-14T11:34:59.919+0000 7f3461aab640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:00.105 INFO:tasks.workunit.client.0.smithi071.stderr: -247> 2024-09-14T11:34:59.919+0000 7f3461aab640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:00.105 INFO:tasks.workunit.client.0.smithi071.stderr: -246> 2024-09-14T11:34:59.919+0000 7f34622ac640 10 monclient(hunting): get_auth_request con 0x55abab7665b0 auth_method 0 2024-09-14T11:35:00.105 INFO:tasks.workunit.client.0.smithi071.stderr: -245> 2024-09-14T11:34:59.919+0000 7f34622ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:00.105 INFO:tasks.workunit.client.0.smithi071.stderr: -244> 2024-09-14T11:34:59.919+0000 7f34622ac640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:00.105 INFO:tasks.workunit.client.0.smithi071.stderr: -243> 2024-09-14T11:34:59.919+0000 7f34622ac640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:00.105 INFO:tasks.workunit.client.0.smithi071.stderr: -242> 2024-09-14T11:34:59.919+0000 7f3461aab640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:00.105 INFO:tasks.workunit.client.0.smithi071.stderr: -241> 2024-09-14T11:34:59.919+0000 7f3461aab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:00.105 INFO:tasks.workunit.client.0.smithi071.stderr: -240> 2024-09-14T11:34:59.919+0000 7f3461aab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:00.105 INFO:tasks.workunit.client.0.smithi071.stderr: -239> 2024-09-14T11:34:59.919+0000 7f34622ac640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:00.105 INFO:tasks.workunit.client.0.smithi071.stderr: -238> 2024-09-14T11:34:59.919+0000 7f34622ac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:00.105 INFO:tasks.workunit.client.0.smithi071.stderr: -237> 2024-09-14T11:34:59.919+0000 7f34622ac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:00.105 INFO:tasks.workunit.client.0.smithi071.stderr: -236> 2024-09-14T11:34:59.919+0000 7f3461aab640 10 monclient(hunting): handle_auth_done global_id 7811 payload 274 2024-09-14T11:35:00.105 INFO:tasks.workunit.client.0.smithi071.stderr: -235> 2024-09-14T11:34:59.919+0000 7f3461aab640 10 monclient: _finish_hunting 0 2024-09-14T11:35:00.106 INFO:tasks.workunit.client.0.smithi071.stderr: -234> 2024-09-14T11:34:59.919+0000 7f3461aab640 1 monclient: found mon.noname-c 2024-09-14T11:35:00.106 INFO:tasks.workunit.client.0.smithi071.stderr: -233> 2024-09-14T11:34:59.919+0000 7f3461aab640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:35:00.106 INFO:tasks.workunit.client.0.smithi071.stderr: -232> 2024-09-14T11:34:59.919+0000 7f3345ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:00.106 INFO:tasks.workunit.client.0.smithi071.stderr: -231> 2024-09-14T11:34:59.919+0000 7f3345ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:00.106 INFO:tasks.workunit.client.0.smithi071.stderr: -230> 2024-09-14T11:34:59.919+0000 7f3345ffb640 10 monclient: dump: 2024-09-14T11:35:00.106 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:00.106 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:00.106 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.106 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.106 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:00.106 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:00.107 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:00.107 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:00.107 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:00.107 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.107 INFO:tasks.workunit.client.0.smithi071.stderr: -229> 2024-09-14T11:34:59.919+0000 7f3345ffb640 10 monclient: _finish_auth 0 2024-09-14T11:35:00.107 INFO:tasks.workunit.client.0.smithi071.stderr: -228> 2024-09-14T11:34:59.919+0000 7f3345ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:35:00.107 INFO:tasks.workunit.client.0.smithi071.stderr: -227> 2024-09-14T11:34:59.919+0000 7f3345ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:00.107 INFO:tasks.workunit.client.0.smithi071.stderr: -226> 2024-09-14T11:34:59.919+0000 7f34647a69c0 5 monclient: authenticate success, global_id 7811 2024-09-14T11:35:00.107 INFO:tasks.workunit.client.0.smithi071.stderr: -225> 2024-09-14T11:34:59.919+0000 7f34647a69c0 10 monclient: get_monmap_and_config success 2024-09-14T11:35:00.107 INFO:tasks.workunit.client.0.smithi071.stderr: -224> 2024-09-14T11:34:59.919+0000 7f34647a69c0 4 set_mon_vals no callback set 2024-09-14T11:35:00.107 INFO:tasks.workunit.client.0.smithi071.stderr: -223> 2024-09-14T11:34:59.919+0000 7f3345ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:00.107 INFO:tasks.workunit.client.0.smithi071.stderr: -222> 2024-09-14T11:34:59.919+0000 7f3345ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:00.107 INFO:tasks.workunit.client.0.smithi071.stderr: -221> 2024-09-14T11:34:59.919+0000 7f3345ffb640 10 monclient: dump: 2024-09-14T11:35:00.107 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:00.108 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:00.108 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.108 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.108 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:00.108 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:00.108 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:00.108 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:00.108 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:00.108 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.108 INFO:tasks.workunit.client.0.smithi071.stderr: -220> 2024-09-14T11:34:59.923+0000 7f34647a69c0 10 monclient: shutdown 2024-09-14T11:35:00.108 INFO:tasks.workunit.client.0.smithi071.stderr: -219> 2024-09-14T11:34:59.923+0000 7f34647a69c0 10 monclient: build_initial_monmap 2024-09-14T11:35:00.108 INFO:tasks.workunit.client.0.smithi071.stderr: -218> 2024-09-14T11:34:59.923+0000 7f34647a69c0 1 build_initial for_mkfs: 0 2024-09-14T11:35:00.108 INFO:tasks.workunit.client.0.smithi071.stderr: -217> 2024-09-14T11:34:59.923+0000 7f34647a69c0 10 monclient: monmap: 2024-09-14T11:35:00.108 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:35:00.109 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:00.109 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:35:00.109 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:35:00.109 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:00.109 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:00.109 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:35:00.109 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:35:00.109 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:35:00.109 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.109 INFO:tasks.workunit.client.0.smithi071.stderr: -216> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab75b800) adding auth protocol: cephx 2024-09-14T11:35:00.109 INFO:tasks.workunit.client.0.smithi071.stderr: -215> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab75b800) adding auth protocol: cephx 2024-09-14T11:35:00.109 INFO:tasks.workunit.client.0.smithi071.stderr: -214> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab75b800) adding auth protocol: cephx 2024-09-14T11:35:00.109 INFO:tasks.workunit.client.0.smithi071.stderr: -213> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab75b800) adding con mode: secure 2024-09-14T11:35:00.109 INFO:tasks.workunit.client.0.smithi071.stderr: -212> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab75b800) adding con mode: crc 2024-09-14T11:35:00.110 INFO:tasks.workunit.client.0.smithi071.stderr: -211> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab75b800) adding con mode: secure 2024-09-14T11:35:00.110 INFO:tasks.workunit.client.0.smithi071.stderr: -210> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab75b800) adding con mode: crc 2024-09-14T11:35:00.110 INFO:tasks.workunit.client.0.smithi071.stderr: -209> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab75b800) adding con mode: secure 2024-09-14T11:35:00.110 INFO:tasks.workunit.client.0.smithi071.stderr: -208> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab75b800) adding con mode: crc 2024-09-14T11:35:00.110 INFO:tasks.workunit.client.0.smithi071.stderr: -207> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab75b800) adding con mode: crc 2024-09-14T11:35:00.110 INFO:tasks.workunit.client.0.smithi071.stderr: -206> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab75b800) adding con mode: secure 2024-09-14T11:35:00.110 INFO:tasks.workunit.client.0.smithi071.stderr: -205> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab75b800) adding con mode: crc 2024-09-14T11:35:00.110 INFO:tasks.workunit.client.0.smithi071.stderr: -204> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab75b800) adding con mode: secure 2024-09-14T11:35:00.110 INFO:tasks.workunit.client.0.smithi071.stderr: -203> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab75b800) adding con mode: crc 2024-09-14T11:35:00.110 INFO:tasks.workunit.client.0.smithi071.stderr: -202> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab75b800) adding con mode: secure 2024-09-14T11:35:00.110 INFO:tasks.workunit.client.0.smithi071.stderr: -201> 2024-09-14T11:34:59.923+0000 7f34647a69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:00.110 INFO:tasks.workunit.client.0.smithi071.stderr: -200> 2024-09-14T11:34:59.923+0000 7f34647a69c0 1 librados: starting msgr at 2024-09-14T11:35:00.110 INFO:tasks.workunit.client.0.smithi071.stderr: -199> 2024-09-14T11:34:59.923+0000 7f34647a69c0 1 librados: starting objecter 2024-09-14T11:35:00.110 INFO:tasks.workunit.client.0.smithi071.stderr: -198> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 asok(0x55abab48dd90) register_command objecter_requests cmddesc objecter_requests hook 0x55abab761410 EEXIST 2024-09-14T11:35:00.110 INFO:tasks.workunit.client.0.smithi071.stderr: -197> 2024-09-14T11:34:59.923+0000 7f34647a69c0 1 librados: setting wanted keys 2024-09-14T11:35:00.111 INFO:tasks.workunit.client.0.smithi071.stderr: -196> 2024-09-14T11:34:59.923+0000 7f34647a69c0 1 librados: calling monclient init 2024-09-14T11:35:00.111 INFO:tasks.workunit.client.0.smithi071.stderr: -195> 2024-09-14T11:34:59.923+0000 7f34647a69c0 10 monclient: init 2024-09-14T11:35:00.111 INFO:tasks.workunit.client.0.smithi071.stderr: -194> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab719030) adding auth protocol: cephx 2024-09-14T11:35:00.111 INFO:tasks.workunit.client.0.smithi071.stderr: -193> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab719030) adding auth protocol: cephx 2024-09-14T11:35:00.111 INFO:tasks.workunit.client.0.smithi071.stderr: -192> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab719030) adding auth protocol: cephx 2024-09-14T11:35:00.111 INFO:tasks.workunit.client.0.smithi071.stderr: -191> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab719030) adding con mode: secure 2024-09-14T11:35:00.111 INFO:tasks.workunit.client.0.smithi071.stderr: -190> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab719030) adding con mode: crc 2024-09-14T11:35:00.111 INFO:tasks.workunit.client.0.smithi071.stderr: -189> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab719030) adding con mode: secure 2024-09-14T11:35:00.111 INFO:tasks.workunit.client.0.smithi071.stderr: -188> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab719030) adding con mode: crc 2024-09-14T11:35:00.111 INFO:tasks.workunit.client.0.smithi071.stderr: -187> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab719030) adding con mode: secure 2024-09-14T11:35:00.111 INFO:tasks.workunit.client.0.smithi071.stderr: -186> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab719030) adding con mode: crc 2024-09-14T11:35:00.111 INFO:tasks.workunit.client.0.smithi071.stderr: -185> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab719030) adding con mode: crc 2024-09-14T11:35:00.111 INFO:tasks.workunit.client.0.smithi071.stderr: -184> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab719030) adding con mode: secure 2024-09-14T11:35:00.111 INFO:tasks.workunit.client.0.smithi071.stderr: -183> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab719030) adding con mode: crc 2024-09-14T11:35:00.111 INFO:tasks.workunit.client.0.smithi071.stderr: -182> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab719030) adding con mode: secure 2024-09-14T11:35:00.112 INFO:tasks.workunit.client.0.smithi071.stderr: -181> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab719030) adding con mode: crc 2024-09-14T11:35:00.112 INFO:tasks.workunit.client.0.smithi071.stderr: -180> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 AuthRegistry(0x55abab719030) adding con mode: secure 2024-09-14T11:35:00.112 INFO:tasks.workunit.client.0.smithi071.stderr: -179> 2024-09-14T11:34:59.923+0000 7f34647a69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:00.112 INFO:tasks.workunit.client.0.smithi071.stderr: -178> 2024-09-14T11:34:59.923+0000 7f34647a69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:00.112 INFO:tasks.workunit.client.0.smithi071.stderr: -177> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 asok(0x55abab48dd90) register_command rotate-key cmddesc rotate-key hook 0x55abab719178 EEXIST 2024-09-14T11:35:00.112 INFO:tasks.workunit.client.0.smithi071.stderr: -176> 2024-09-14T11:34:59.923+0000 7f34647a69c0 10 monclient: _reopen_session rank -1 2024-09-14T11:35:00.112 INFO:tasks.workunit.client.0.smithi071.stderr: -175> 2024-09-14T11:34:59.923+0000 7f34647a69c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:35:00.112 INFO:tasks.workunit.client.0.smithi071.stderr: -174> 2024-09-14T11:34:59.923+0000 7f34647a69c0 10 monclient(hunting): picked mon.noname-c con 0x55abab73a800 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:35:00.112 INFO:tasks.workunit.client.0.smithi071.stderr: -173> 2024-09-14T11:34:59.923+0000 7f34647a69c0 10 monclient(hunting): picked mon.noname-a con 0x55abab7665b0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:35:00.112 INFO:tasks.workunit.client.0.smithi071.stderr: -172> 2024-09-14T11:34:59.923+0000 7f34647a69c0 10 monclient(hunting): picked mon.noname-b con 0x55abab76ade0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:35:00.112 INFO:tasks.workunit.client.0.smithi071.stderr: -171> 2024-09-14T11:34:59.923+0000 7f34647a69c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:00.112 INFO:tasks.workunit.client.0.smithi071.stderr: -170> 2024-09-14T11:34:59.923+0000 7f34647a69c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:00.112 INFO:tasks.workunit.client.0.smithi071.stderr: -169> 2024-09-14T11:34:59.923+0000 7f34647a69c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:00.112 INFO:tasks.workunit.client.0.smithi071.stderr: -168> 2024-09-14T11:34:59.923+0000 7f34647a69c0 10 monclient(hunting): _renew_subs 2024-09-14T11:35:00.112 INFO:tasks.workunit.client.0.smithi071.stderr: -167> 2024-09-14T11:34:59.923+0000 7f34647a69c0 10 monclient(hunting): authenticate will time out at 2512.045462s 2024-09-14T11:35:00.113 INFO:tasks.workunit.client.0.smithi071.stderr: -166> 2024-09-14T11:34:59.923+0000 7f3461aab640 10 monclient(hunting): get_auth_request con 0x55abab73a800 auth_method 0 2024-09-14T11:35:00.113 INFO:tasks.workunit.client.0.smithi071.stderr: -165> 2024-09-14T11:34:59.923+0000 7f3461aab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:00.113 INFO:tasks.workunit.client.0.smithi071.stderr: -164> 2024-09-14T11:34:59.923+0000 7f3461aab640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:00.113 INFO:tasks.workunit.client.0.smithi071.stderr: -163> 2024-09-14T11:34:59.923+0000 7f3461aab640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:00.113 INFO:tasks.workunit.client.0.smithi071.stderr: -162> 2024-09-14T11:34:59.923+0000 7f3462aad640 10 monclient(hunting): get_auth_request con 0x55abab7665b0 auth_method 0 2024-09-14T11:35:00.113 INFO:tasks.workunit.client.0.smithi071.stderr: -161> 2024-09-14T11:34:59.923+0000 7f3462aad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:00.113 INFO:tasks.workunit.client.0.smithi071.stderr: -160> 2024-09-14T11:34:59.923+0000 7f3462aad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:00.113 INFO:tasks.workunit.client.0.smithi071.stderr: -159> 2024-09-14T11:34:59.923+0000 7f3462aad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:00.113 INFO:tasks.workunit.client.0.smithi071.stderr: -158> 2024-09-14T11:34:59.923+0000 7f3461aab640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:00.113 INFO:tasks.workunit.client.0.smithi071.stderr: -157> 2024-09-14T11:34:59.923+0000 7f3461aab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:00.113 INFO:tasks.workunit.client.0.smithi071.stderr: -156> 2024-09-14T11:34:59.923+0000 7f3461aab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:00.113 INFO:tasks.workunit.client.0.smithi071.stderr: -155> 2024-09-14T11:34:59.923+0000 7f3462aad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:00.113 INFO:tasks.workunit.client.0.smithi071.stderr: -154> 2024-09-14T11:34:59.923+0000 7f3462aad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:00.113 INFO:tasks.workunit.client.0.smithi071.stderr: -153> 2024-09-14T11:34:59.923+0000 7f3462aad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:00.113 INFO:tasks.workunit.client.0.smithi071.stderr: -152> 2024-09-14T11:34:59.923+0000 7f34622ac640 10 monclient(hunting): get_auth_request con 0x55abab76ade0 auth_method 0 2024-09-14T11:35:00.114 INFO:tasks.workunit.client.0.smithi071.stderr: -151> 2024-09-14T11:34:59.923+0000 7f34622ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:00.114 INFO:tasks.workunit.client.0.smithi071.stderr: -150> 2024-09-14T11:34:59.923+0000 7f34622ac640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:00.114 INFO:tasks.workunit.client.0.smithi071.stderr: -149> 2024-09-14T11:34:59.923+0000 7f34622ac640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:00.114 INFO:tasks.workunit.client.0.smithi071.stderr: -148> 2024-09-14T11:34:59.923+0000 7f3461aab640 10 monclient(hunting): handle_auth_done global_id 7814 payload 824 2024-09-14T11:35:00.114 INFO:tasks.workunit.client.0.smithi071.stderr: -147> 2024-09-14T11:34:59.923+0000 7f3461aab640 10 monclient: _finish_hunting 0 2024-09-14T11:35:00.114 INFO:tasks.workunit.client.0.smithi071.stderr: -146> 2024-09-14T11:34:59.923+0000 7f3461aab640 1 monclient: found mon.noname-c 2024-09-14T11:35:00.114 INFO:tasks.workunit.client.0.smithi071.stderr: -145> 2024-09-14T11:34:59.923+0000 7f3461aab640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:35:00.114 INFO:tasks.workunit.client.0.smithi071.stderr: -144> 2024-09-14T11:34:59.923+0000 7f3333fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:00.114 INFO:tasks.workunit.client.0.smithi071.stderr: -143> 2024-09-14T11:34:59.923+0000 7f3333fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:00.114 INFO:tasks.workunit.client.0.smithi071.stderr: -142> 2024-09-14T11:34:59.923+0000 7f3333fff640 10 monclient: dump: 2024-09-14T11:35:00.114 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:00.114 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:00.114 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.114 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.115 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:00.115 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:00.115 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:00.115 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:00.115 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:00.115 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.115 INFO:tasks.workunit.client.0.smithi071.stderr: -141> 2024-09-14T11:34:59.923+0000 7f3333fff640 10 monclient: _finish_auth 0 2024-09-14T11:35:00.115 INFO:tasks.workunit.client.0.smithi071.stderr: -140> 2024-09-14T11:34:59.923+0000 7f3333fff640 10 monclient: _check_auth_tickets 2024-09-14T11:35:00.115 INFO:tasks.workunit.client.0.smithi071.stderr: -139> 2024-09-14T11:34:59.923+0000 7f3333fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:00.115 INFO:tasks.workunit.client.0.smithi071.stderr: -138> 2024-09-14T11:34:59.923+0000 7f3333fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:00.115 INFO:tasks.workunit.client.0.smithi071.stderr: -137> 2024-09-14T11:34:59.923+0000 7f3333fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:00.115 INFO:tasks.workunit.client.0.smithi071.stderr: -136> 2024-09-14T11:34:59.923+0000 7f3333fff640 10 monclient: dump: 2024-09-14T11:35:00.115 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:00.115 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:00.115 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.116 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:00.116 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:00.116 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:00.116 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:00.116 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:00.116 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:00.116 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.116 INFO:tasks.workunit.client.0.smithi071.stderr: -135> 2024-09-14T11:34:59.923+0000 7f3345ffb640 4 set_mon_vals no callback set 2024-09-14T11:35:00.116 INFO:tasks.workunit.client.0.smithi071.stderr: -134> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 monclient: authenticate success, global_id 7814 2024-09-14T11:35:00.116 INFO:tasks.workunit.client.0.smithi071.stderr: -133> 2024-09-14T11:34:59.923+0000 7f34647a69c0 10 monclient: _renew_subs 2024-09-14T11:35:00.116 INFO:tasks.workunit.client.0.smithi071.stderr: -132> 2024-09-14T11:34:59.923+0000 7f34647a69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:35:00.116 INFO:tasks.workunit.client.0.smithi071.stderr: -131> 2024-09-14T11:34:59.923+0000 7f34647a69c0 10 monclient: _renew_subs 2024-09-14T11:35:00.116 INFO:tasks.workunit.client.0.smithi071.stderr: -130> 2024-09-14T11:34:59.923+0000 7f34647a69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:35:00.116 INFO:tasks.workunit.client.0.smithi071.stderr: -129> 2024-09-14T11:34:59.923+0000 7f34647a69c0 1 librados: init done 2024-09-14T11:35:00.117 INFO:tasks.workunit.client.0.smithi071.stderr: -128> 2024-09-14T11:34:59.923+0000 7f34647a69c0 5 asok(0x55abab48dd90) register_command cr dump hook 0x55abab73afc8 2024-09-14T11:35:00.117 INFO:tasks.workunit.client.0.smithi071.stderr: -127> 2024-09-14T11:34:59.923+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.117 INFO:tasks.workunit.client.0.smithi071.stderr: -126> 2024-09-14T11:34:59.927+0000 7f3333fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:00.117 INFO:tasks.workunit.client.0.smithi071.stderr: -125> 2024-09-14T11:34:59.927+0000 7f3333fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:35:00.117 INFO:tasks.workunit.client.0.smithi071.stderr: -124> 2024-09-14T11:34:59.927+0000 7f3333fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:35:00.117 INFO:tasks.workunit.client.0.smithi071.stderr: -123> 2024-09-14T11:34:59.927+0000 7f3462aad640 10 monclient: get_auth_request con 0x7f332c0718a0 auth_method 0 2024-09-14T11:35:00.117 INFO:tasks.workunit.client.0.smithi071.stderr: -122> 2024-09-14T11:34:59.927+0000 7f34622ac640 10 monclient: get_auth_request con 0x55abab784190 auth_method 0 2024-09-14T11:35:00.117 INFO:tasks.workunit.client.0.smithi071.stderr: -121> 2024-09-14T11:34:59.927+0000 7f34647a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:00.117 INFO:tasks.workunit.client.0.smithi071.stderr: -120> 2024-09-14T11:34:59.927+0000 7f34647a69c0 20 realm 2024-09-14T11:35:00.117 INFO:tasks.workunit.client.0.smithi071.stderr: -119> 2024-09-14T11:34:59.927+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.117 INFO:tasks.workunit.client.0.smithi071.stderr: -118> 2024-09-14T11:34:59.927+0000 7f34647a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:00.117 INFO:tasks.workunit.client.0.smithi071.stderr: -117> 2024-09-14T11:34:59.927+0000 7f34647a69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:00.117 INFO:tasks.workunit.client.0.smithi071.stderr: -116> 2024-09-14T11:34:59.927+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.117 INFO:tasks.workunit.client.0.smithi071.stderr: -115> 2024-09-14T11:34:59.927+0000 7f34647a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:00.117 INFO:tasks.workunit.client.0.smithi071.stderr: -114> 2024-09-14T11:34:59.927+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.118 INFO:tasks.workunit.client.0.smithi071.stderr: -113> 2024-09-14T11:34:59.927+0000 7f3461aab640 10 monclient: get_auth_request con 0x55abab788430 auth_method 0 2024-09-14T11:35:00.118 INFO:tasks.workunit.client.0.smithi071.stderr: -112> 2024-09-14T11:34:59.927+0000 7f34647a69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:00.118 INFO:tasks.workunit.client.0.smithi071.stderr: -111> 2024-09-14T11:34:59.931+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.118 INFO:tasks.workunit.client.0.smithi071.stderr: -110> 2024-09-14T11:34:59.931+0000 7f3462aad640 10 monclient: get_auth_request con 0x55abab78bc90 auth_method 0 2024-09-14T11:35:00.118 INFO:tasks.workunit.client.0.smithi071.stderr: -109> 2024-09-14T11:34:59.931+0000 7f34647a69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:00.118 INFO:tasks.workunit.client.0.smithi071.stderr: -108> 2024-09-14T11:34:59.931+0000 7f34647a69c0 20 searching for the correct realm 2024-09-14T11:35:00.118 INFO:tasks.workunit.client.0.smithi071.stderr: -107> 2024-09-14T11:34:59.931+0000 7f34622ac640 10 monclient: get_auth_request con 0x55abab790a50 auth_method 0 2024-09-14T11:35:00.118 INFO:tasks.workunit.client.0.smithi071.stderr: -106> 2024-09-14T11:34:59.931+0000 7f3461aab640 10 monclient: get_auth_request con 0x7f345c0bb040 auth_method 0 2024-09-14T11:35:00.118 INFO:tasks.workunit.client.0.smithi071.stderr: -105> 2024-09-14T11:34:59.935+0000 7f3462aad640 10 monclient: get_auth_request con 0x7f345802a060 auth_method 0 2024-09-14T11:35:00.118 INFO:tasks.workunit.client.0.smithi071.stderr: -104> 2024-09-14T11:34:59.935+0000 7f34622ac640 0 -- 172.21.15.71:0/1860409313 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x55abab790a50 msgr2=0x55abab792f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:00.118 INFO:tasks.workunit.client.0.smithi071.stderr: -103> 2024-09-14T11:34:59.935+0000 7f3333fff640 1 client.7814.objecter ms_handle_reset 0x55abab790a50 session 0x55abab7903d0 osd.4 2024-09-14T11:35:00.118 INFO:tasks.workunit.client.0.smithi071.stderr: -102> 2024-09-14T11:34:59.935+0000 7f3333fff640 10 monclient: _renew_subs 2024-09-14T11:35:00.118 INFO:tasks.workunit.client.0.smithi071.stderr: -101> 2024-09-14T11:34:59.935+0000 7f3333fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:35:00.118 INFO:tasks.workunit.client.0.smithi071.stderr: -100> 2024-09-14T11:34:59.935+0000 7f34622ac640 10 monclient: get_auth_request con 0x7f332c0813c0 auth_method 0 2024-09-14T11:35:00.118 INFO:tasks.workunit.client.0.smithi071.stderr: -99> 2024-09-14T11:34:59.935+0000 7f34622ac640 10 monclient: get_auth_request con 0x7f345c0e4400 auth_method 0 2024-09-14T11:35:00.118 INFO:tasks.workunit.client.0.smithi071.stderr: -98> 2024-09-14T11:34:59.939+0000 7f3461aab640 10 monclient: get_auth_request con 0x7f3458015070 auth_method 0 2024-09-14T11:35:00.119 INFO:tasks.workunit.client.0.smithi071.stderr: -97> 2024-09-14T11:34:59.939+0000 7f3462aad640 0 -- 172.21.15.71:0/1860409313 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55abab78bc90 msgr2=0x55abab78e0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:00.119 INFO:tasks.workunit.client.0.smithi071.stderr: -96> 2024-09-14T11:34:59.939+0000 7f3333fff640 1 client.7814.objecter ms_handle_reset 0x55abab78bc90 session 0x55abab7877c0 osd.3 2024-09-14T11:35:00.119 INFO:tasks.workunit.client.0.smithi071.stderr: -95> 2024-09-14T11:34:59.939+0000 7f3462aad640 10 monclient: get_auth_request con 0x55abab790a50 auth_method 0 2024-09-14T11:35:00.119 INFO:tasks.workunit.client.0.smithi071.stderr: -94> 2024-09-14T11:34:59.947+0000 7f34647a69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:00.119 INFO:tasks.workunit.client.0.smithi071.stderr: -93> 2024-09-14T11:34:59.947+0000 7f34647a69c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:35:00.119 INFO:tasks.workunit.client.0.smithi071.stderr: -92> 2024-09-14T11:34:59.947+0000 7f34647a69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:00.119 INFO:tasks.workunit.client.0.smithi071.stderr: -91> 2024-09-14T11:34:59.947+0000 7f34647a69c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:35:00.119 INFO:tasks.workunit.client.0.smithi071.stderr: -90> 2024-09-14T11:34:59.947+0000 7f34647a69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:00.119 INFO:tasks.workunit.client.0.smithi071.stderr: -89> 2024-09-14T11:34:59.947+0000 7f34647a69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:00.119 INFO:tasks.workunit.client.0.smithi071.stderr: -88> 2024-09-14T11:34:59.947+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.119 INFO:tasks.workunit.client.0.smithi071.stderr: -87> 2024-09-14T11:34:59.951+0000 7f34647a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:00.119 INFO:tasks.workunit.client.0.smithi071.stderr: -86> 2024-09-14T11:34:59.951+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.119 INFO:tasks.workunit.client.0.smithi071.stderr: -85> 2024-09-14T11:34:59.951+0000 7f34647a69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:00.119 INFO:tasks.workunit.client.0.smithi071.stderr: -84> 2024-09-14T11:34:59.951+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.119 INFO:tasks.workunit.client.0.smithi071.stderr: -83> 2024-09-14T11:34:59.951+0000 7f34647a69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:00.120 INFO:tasks.workunit.client.0.smithi071.stderr: -82> 2024-09-14T11:34:59.951+0000 7f34647a69c0 20 zone default found 2024-09-14T11:35:00.120 INFO:tasks.workunit.client.0.smithi071.stderr: -81> 2024-09-14T11:34:59.951+0000 7f34647a69c0 4 Realm: () 2024-09-14T11:35:00.120 INFO:tasks.workunit.client.0.smithi071.stderr: -80> 2024-09-14T11:34:59.951+0000 7f34647a69c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:35:00.120 INFO:tasks.workunit.client.0.smithi071.stderr: -79> 2024-09-14T11:34:59.951+0000 7f34647a69c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:35:00.120 INFO:tasks.workunit.client.0.smithi071.stderr: -78> 2024-09-14T11:34:59.951+0000 7f34647a69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:00.120 INFO:tasks.workunit.client.0.smithi071.stderr: -77> 2024-09-14T11:34:59.951+0000 7f34647a69c0 20 zonegroup default 2024-09-14T11:35:00.120 INFO:tasks.workunit.client.0.smithi071.stderr: -76> 2024-09-14T11:34:59.951+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.120 INFO:tasks.workunit.client.0.smithi071.stderr: -75> 2024-09-14T11:34:59.951+0000 7f34647a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:00.120 INFO:tasks.workunit.client.0.smithi071.stderr: -74> 2024-09-14T11:34:59.951+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.120 INFO:tasks.workunit.client.0.smithi071.stderr: -73> 2024-09-14T11:34:59.951+0000 7f34647a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:00.120 INFO:tasks.workunit.client.0.smithi071.stderr: -72> 2024-09-14T11:34:59.951+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.120 INFO:tasks.workunit.client.0.smithi071.stderr: -71> 2024-09-14T11:34:59.951+0000 7f34647a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:00.120 INFO:tasks.workunit.client.0.smithi071.stderr: -70> 2024-09-14T11:34:59.951+0000 7f34647a69c0 20 started sync module instance, tier type = 2024-09-14T11:35:00.121 INFO:tasks.workunit.client.0.smithi071.stderr: -69> 2024-09-14T11:34:59.951+0000 7f34647a69c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:35:00.121 INFO:tasks.workunit.client.0.smithi071.stderr: -68> 2024-09-14T11:34:59.971+0000 7f34647a69c0 20 add_watcher() i=0 2024-09-14T11:35:00.121 INFO:tasks.workunit.client.0.smithi071.stderr: -67> 2024-09-14T11:34:59.971+0000 7f34647a69c0 20 add_watcher() i=1 2024-09-14T11:35:00.121 INFO:tasks.workunit.client.0.smithi071.stderr: -66> 2024-09-14T11:34:59.971+0000 7f34647a69c0 20 add_watcher() i=2 2024-09-14T11:35:00.121 INFO:tasks.workunit.client.0.smithi071.stderr: -65> 2024-09-14T11:34:59.971+0000 7f34647a69c0 20 add_watcher() i=3 2024-09-14T11:35:00.121 INFO:tasks.workunit.client.0.smithi071.stderr: -64> 2024-09-14T11:34:59.971+0000 7f34647a69c0 20 add_watcher() i=4 2024-09-14T11:35:00.121 INFO:tasks.workunit.client.0.smithi071.stderr: -63> 2024-09-14T11:34:59.971+0000 7f34647a69c0 20 add_watcher() i=5 2024-09-14T11:35:00.121 INFO:tasks.workunit.client.0.smithi071.stderr: -62> 2024-09-14T11:34:59.971+0000 7f34647a69c0 20 add_watcher() i=6 2024-09-14T11:35:00.121 INFO:tasks.workunit.client.0.smithi071.stderr: -61> 2024-09-14T11:34:59.975+0000 7f34647a69c0 20 add_watcher() i=7 2024-09-14T11:35:00.121 INFO:tasks.workunit.client.0.smithi071.stderr: -60> 2024-09-14T11:34:59.975+0000 7f34647a69c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:00.121 INFO:tasks.workunit.client.0.smithi071.stderr: -59> 2024-09-14T11:34:59.975+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1706a0) adding auth protocol: cephx 2024-09-14T11:35:00.121 INFO:tasks.workunit.client.0.smithi071.stderr: -58> 2024-09-14T11:34:59.975+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1706a0) adding auth protocol: cephx 2024-09-14T11:35:00.121 INFO:tasks.workunit.client.0.smithi071.stderr: -57> 2024-09-14T11:34:59.975+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1706a0) adding auth protocol: cephx 2024-09-14T11:35:00.121 INFO:tasks.workunit.client.0.smithi071.stderr: -56> 2024-09-14T11:34:59.975+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1706a0) adding con mode: secure 2024-09-14T11:35:00.121 INFO:tasks.workunit.client.0.smithi071.stderr: -55> 2024-09-14T11:34:59.975+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1706a0) adding con mode: crc 2024-09-14T11:35:00.122 INFO:tasks.workunit.client.0.smithi071.stderr: -54> 2024-09-14T11:34:59.975+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1706a0) adding con mode: secure 2024-09-14T11:35:00.122 INFO:tasks.workunit.client.0.smithi071.stderr: -53> 2024-09-14T11:34:59.975+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1706a0) adding con mode: crc 2024-09-14T11:35:00.122 INFO:tasks.workunit.client.0.smithi071.stderr: -52> 2024-09-14T11:34:59.975+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1706a0) adding con mode: secure 2024-09-14T11:35:00.122 INFO:tasks.workunit.client.0.smithi071.stderr: -51> 2024-09-14T11:34:59.975+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1706a0) adding con mode: crc 2024-09-14T11:35:00.122 INFO:tasks.workunit.client.0.smithi071.stderr: -50> 2024-09-14T11:34:59.975+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1706a0) adding con mode: crc 2024-09-14T11:35:00.122 INFO:tasks.workunit.client.0.smithi071.stderr: -49> 2024-09-14T11:34:59.975+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1706a0) adding con mode: secure 2024-09-14T11:35:00.122 INFO:tasks.workunit.client.0.smithi071.stderr: -48> 2024-09-14T11:34:59.975+0000 7f3318fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:00.122 INFO:tasks.workunit.client.0.smithi071.stderr: -47> 2024-09-14T11:34:59.975+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1706a0) adding con mode: crc 2024-09-14T11:35:00.122 INFO:tasks.workunit.client.0.smithi071.stderr: -46> 2024-09-14T11:34:59.975+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1706a0) adding con mode: secure 2024-09-14T11:35:00.122 INFO:tasks.workunit.client.0.smithi071.stderr: -45> 2024-09-14T11:34:59.975+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1706a0) adding con mode: crc 2024-09-14T11:35:00.122 INFO:tasks.workunit.client.0.smithi071.stderr: -44> 2024-09-14T11:34:59.975+0000 7f34647a69c0 5 AuthRegistry(0x7fffaf1706a0) adding con mode: secure 2024-09-14T11:35:00.122 INFO:tasks.workunit.client.0.smithi071.stderr: -43> 2024-09-14T11:34:59.979+0000 7f34647a69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:00.122 INFO:tasks.workunit.client.0.smithi071.stderr: -42> 2024-09-14T11:34:59.979+0000 7f34647a69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:00.122 INFO:tasks.workunit.client.0.smithi071.stderr: -41> 2024-09-14T11:34:59.979+0000 7f34647a69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:00.122 INFO:tasks.workunit.client.0.smithi071.stderr: -40> 2024-09-14T11:34:59.979+0000 7f34647a69c0 5 asok(0x55abab48dd90) register_command cache list hook 0x55abab761e00 2024-09-14T11:35:00.123 INFO:tasks.workunit.client.0.smithi071.stderr: -39> 2024-09-14T11:34:59.979+0000 7f34647a69c0 5 asok(0x55abab48dd90) register_command cache inspect hook 0x55abab761e00 2024-09-14T11:35:00.123 INFO:tasks.workunit.client.0.smithi071.stderr: -38> 2024-09-14T11:34:59.979+0000 7f34647a69c0 5 asok(0x55abab48dd90) register_command cache erase hook 0x55abab761e00 2024-09-14T11:35:00.123 INFO:tasks.workunit.client.0.smithi071.stderr: -37> 2024-09-14T11:34:59.979+0000 7f34647a69c0 5 asok(0x55abab48dd90) register_command cache zap hook 0x55abab761e00 2024-09-14T11:35:00.123 INFO:tasks.workunit.client.0.smithi071.stderr: -36> 2024-09-14T11:34:59.979+0000 7f34647a69c0 5 note: GC not initialized 2024-09-14T11:35:00.123 INFO:tasks.workunit.client.0.smithi071.stderr: -35> 2024-09-14T11:34:59.979+0000 7f32937fe640 20 reqs_thread_entry: start 2024-09-14T11:35:00.123 INFO:tasks.workunit.client.0.smithi071.stderr: -34> 2024-09-14T11:34:59.979+0000 7f34647a69c0 5 asok(0x55abab48dd90) register_command sync trace show hook 0x7f3454004db0 2024-09-14T11:35:00.123 INFO:tasks.workunit.client.0.smithi071.stderr: -33> 2024-09-14T11:34:59.979+0000 7f34647a69c0 5 asok(0x55abab48dd90) register_command sync trace history hook 0x7f3454004db0 2024-09-14T11:35:00.123 INFO:tasks.workunit.client.0.smithi071.stderr: -32> 2024-09-14T11:34:59.979+0000 7f34647a69c0 5 asok(0x55abab48dd90) register_command sync trace active hook 0x7f3454004db0 2024-09-14T11:35:00.123 INFO:tasks.workunit.client.0.smithi071.stderr: -31> 2024-09-14T11:34:59.979+0000 7f34647a69c0 5 asok(0x55abab48dd90) register_command sync trace active_short hook 0x7f3454004db0 2024-09-14T11:35:00.123 INFO:tasks.workunit.client.0.smithi071.stderr: -30> 2024-09-14T11:34:59.979+0000 7f34647a69c0 20 init_complete bucket index max shards: 11 2024-09-14T11:35:00.123 INFO:tasks.workunit.client.0.smithi071.stderr: -29> 2024-09-14T11:34:59.979+0000 7f34647a69c0 20 Filter name: none 2024-09-14T11:35:00.123 INFO:tasks.workunit.client.0.smithi071.stderr: -28> 2024-09-14T11:34:59.979+0000 7f32917fa640 20 reqs_thread_entry: start 2024-09-14T11:35:00.123 INFO:tasks.workunit.client.0.smithi071.stderr: -27> 2024-09-14T11:34:59.979+0000 7f34647a69c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:35:00.123 INFO:tasks.workunit.client.0.smithi071.stderr: -26> 2024-09-14T11:34:59.979+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.123 INFO:tasks.workunit.client.0.smithi071.stderr: -25> 2024-09-14T11:34:59.979+0000 7f34647a69c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:35:00.123 INFO:tasks.workunit.client.0.smithi071.stderr: -24> 2024-09-14T11:34:59.979+0000 7f34647a69c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:35:00.124 INFO:tasks.workunit.client.0.smithi071.stderr: -23> 2024-09-14T11:34:59.979+0000 7f34647a69c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:35:00.124 INFO:tasks.workunit.client.0.smithi071.stderr: -22> 2024-09-14T11:34:59.979+0000 7f34647a69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 : miss 2024-09-14T11:35:00.124 INFO:tasks.workunit.client.0.smithi071.stderr: -21> 2024-09-14T11:34:59.979+0000 7f34647a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.124 INFO:tasks.workunit.client.0.smithi071.stderr: -20> 2024-09-14T11:34:59.979+0000 7f34647a69c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:35:00.124 INFO:tasks.workunit.client.0.smithi071.stderr: -19> 2024-09-14T11:34:59.979+0000 7f34647a69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:35:00.124 INFO:tasks.workunit.client.0.smithi071.stderr: -18> 2024-09-14T11:34:59.979+0000 7f34647a69c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:35:00.124 INFO:tasks.workunit.client.0.smithi071.stderr: -17> 2024-09-14T11:34:59.979+0000 7f34647a69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:00.124 INFO:tasks.workunit.client.0.smithi071.stderr: -16> 2024-09-14T11:34:59.979+0000 7f34647a69c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:00.124 INFO:tasks.workunit.client.0.smithi071.stderr: -15> 2024-09-14T11:34:59.979+0000 7f34647a69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 2024-09-14T11:35:00.124 INFO:tasks.workunit.client.0.smithi071.stderr: -14> 2024-09-14T11:34:59.983+0000 7f34647a69c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:35:00.124 INFO:tasks.workunit.client.0.smithi071.stderr: -13> 2024-09-14T11:34:59.995+0000 7f34647a69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:35:00.124 INFO:tasks.workunit.client.0.smithi071.stderr: -12> 2024-09-14T11:34:59.995+0000 7f34647a69c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:35:00.124 INFO:tasks.workunit.client.0.smithi071.stderr: -11> 2024-09-14T11:34:59.995+0000 7f34647a69c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:00.125 INFO:tasks.workunit.client.0.smithi071.stderr: -10> 2024-09-14T11:34:59.995+0000 7f34647a69c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18, ofs0, ns] 2024-09-14T11:35:00.125 INFO:tasks.workunit.client.0.smithi071.stderr: -9> 2024-09-14T11:34:59.995+0000 7f3345ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464427 cookie 94195804617664 notifier 7814 bl.length()=911 2024-09-14T11:35:00.125 INFO:tasks.workunit.client.0.smithi071.stderr: -8> 2024-09-14T11:34:59.995+0000 7f3345ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:35:00.125 INFO:tasks.workunit.client.0.smithi071.stderr: -7> 2024-09-14T11:34:59.995+0000 7f3345ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:35:00.125 INFO:tasks.workunit.client.0.smithi071.stderr: -6> 2024-09-14T11:34:59.995+0000 7f3345ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:00.125 INFO:tasks.workunit.client.0.smithi071.stderr: -5> 2024-09-14T11:34:59.995+0000 7f34647a69c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_sources= new_sources= 2024-09-14T11:35:00.125 INFO:tasks.workunit.client.0.smithi071.stderr: -4> 2024-09-14T11:34:59.995+0000 7f34647a69c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential sources added=[] removed=[] 2024-09-14T11:35:00.125 INFO:tasks.workunit.client.0.smithi071.stderr: -3> 2024-09-14T11:34:59.995+0000 7f34647a69c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_dests= new_dests= 2024-09-14T11:35:00.125 INFO:tasks.workunit.client.0.smithi071.stderr: -2> 2024-09-14T11:34:59.995+0000 7f34647a69c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential dests added=[] removed=[] 2024-09-14T11:35:00.125 INFO:tasks.workunit.client.0.smithi071.stderr: -1> 2024-09-14T11:35:00.003+0000 7f34647a69c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f34647a69c0 time 2024-09-14T11:35:00.007720+0000 2024-09-14T11:35:00.125 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:00.125 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.125 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:00.126 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f34680802eb] 2024-09-14T11:35:00.126 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f346808049f] 2024-09-14T11:35:00.126 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aba87b2c01] 2024-09-14T11:35:00.126 INFO:tasks.workunit.client.0.smithi071.stderr: 4: radosgw-admin(+0x142325c) [0x55aba921125c] 2024-09-14T11:35:00.126 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55aba87c7ecd] 2024-09-14T11:35:00.126 INFO:tasks.workunit.client.0.smithi071.stderr: 6: main() 2024-09-14T11:35:00.126 INFO:tasks.workunit.client.0.smithi071.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3466ee6d90] 2024-09-14T11:35:00.126 INFO:tasks.workunit.client.0.smithi071.stderr: 8: __libc_start_main() 2024-09-14T11:35:00.126 INFO:tasks.workunit.client.0.smithi071.stderr: 9: _start() 2024-09-14T11:35:00.126 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.126 INFO:tasks.workunit.client.0.smithi071.stderr: 0> 2024-09-14T11:35:00.003+0000 7f34647a69c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:35:00.126 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f34647a69c0 thread_name:radosgw-admin 2024-09-14T11:35:00.126 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.126 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:00.127 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3466eff520] 2024-09-14T11:35:00.127 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:35:00.127 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:35:00.127 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:35:00.127 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3468080345] 2024-09-14T11:35:00.127 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f346808049f] 2024-09-14T11:35:00.127 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aba87b2c01] 2024-09-14T11:35:00.127 INFO:tasks.workunit.client.0.smithi071.stderr: 8: radosgw-admin(+0x142325c) [0x55aba921125c] 2024-09-14T11:35:00.127 INFO:tasks.workunit.client.0.smithi071.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55aba87c7ecd] 2024-09-14T11:35:00.127 INFO:tasks.workunit.client.0.smithi071.stderr: 10: main() 2024-09-14T11:35:00.127 INFO:tasks.workunit.client.0.smithi071.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3466ee6d90] 2024-09-14T11:35:00.127 INFO:tasks.workunit.client.0.smithi071.stderr: 12: __libc_start_main() 2024-09-14T11:35:00.127 INFO:tasks.workunit.client.0.smithi071.stderr: 13: _start() 2024-09-14T11:35:00.127 INFO:tasks.workunit.client.0.smithi071.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:35:00.128 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:00.128 INFO:tasks.workunit.client.0.smithi071.stderr:--- logging levels --- 2024-09-14T11:35:00.128 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 none 2024-09-14T11:35:00.128 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 lockdep 2024-09-14T11:35:00.128 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 context 2024-09-14T11:35:00.128 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 crush 2024-09-14T11:35:00.128 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds 2024-09-14T11:35:00.128 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_balancer 2024-09-14T11:35:00.128 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_locker 2024-09-14T11:35:00.128 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log 2024-09-14T11:35:00.128 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log_expire 2024-09-14T11:35:00.128 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_migrator 2024-09-14T11:35:00.128 INFO:tasks.workunit.client.0.smithi071.stderr: 3/ 5 mds_quiesce 2024-09-14T11:35:00.128 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 buffer 2024-09-14T11:35:00.129 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 timer 2024-09-14T11:35:00.129 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 filer 2024-09-14T11:35:00.129 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 striper 2024-09-14T11:35:00.129 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 objecter 2024-09-14T11:35:00.129 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rados 2024-09-14T11:35:00.129 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd 2024-09-14T11:35:00.129 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_mirror 2024-09-14T11:35:00.129 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_replay 2024-09-14T11:35:00.129 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_pwl 2024-09-14T11:35:00.129 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 journaler 2024-09-14T11:35:00.129 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objectcacher 2024-09-14T11:35:00.129 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:35:00.129 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 client 2024-09-14T11:35:00.130 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 osd 2024-09-14T11:35:00.130 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 optracker 2024-09-14T11:35:00.130 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objclass 2024-09-14T11:35:00.130 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 filestore 2024-09-14T11:35:00.130 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 journal 2024-09-14T11:35:00.130 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 ms 2024-09-14T11:35:00.130 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mon 2024-09-14T11:35:00.130 INFO:tasks.workunit.client.0.smithi071.stderr: 0/10 monc 2024-09-14T11:35:00.130 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 paxos 2024-09-14T11:35:00.130 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 tp 2024-09-14T11:35:00.130 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 auth 2024-09-14T11:35:00.131 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 crypto 2024-09-14T11:35:00.131 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 finisher 2024-09-14T11:35:00.131 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 reserver 2024-09-14T11:35:00.131 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 heartbeatmap 2024-09-14T11:35:00.131 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 perfcounter 2024-09-14T11:35:00.131 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw 2024-09-14T11:35:00.131 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_sync 2024-09-14T11:35:00.131 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_datacache 2024-09-14T11:35:00.131 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_access 2024-09-14T11:35:00.131 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:35:00.131 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_flight 2024-09-14T11:35:00.131 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:35:00.132 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw_notification 2024-09-14T11:35:00.132 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 javaclient 2024-09-14T11:35:00.132 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 asok 2024-09-14T11:35:00.132 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 throttle 2024-09-14T11:35:00.132 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 refs 2024-09-14T11:35:00.132 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 compressor 2024-09-14T11:35:00.132 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluestore 2024-09-14T11:35:00.132 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluefs 2024-09-14T11:35:00.132 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 bdev 2024-09-14T11:35:00.132 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 kstore 2024-09-14T11:35:00.132 INFO:tasks.workunit.client.0.smithi071.stderr: 4/ 5 rocksdb 2024-09-14T11:35:00.132 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 fuse 2024-09-14T11:35:00.132 INFO:tasks.workunit.client.0.smithi071.stderr: 2/ 5 mgr 2024-09-14T11:35:00.132 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mgrc 2024-09-14T11:35:00.133 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 dpdk 2024-09-14T11:35:00.133 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 eventtrace 2024-09-14T11:35:00.133 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 prioritycache 2024-09-14T11:35:00.133 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 test 2024-09-14T11:35:00.133 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:35:00.133 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephsqlite 2024-09-14T11:35:00.133 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:35:00.133 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore 2024-09-14T11:35:00.133 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_onode 2024-09-14T11:35:00.133 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_odata 2024-09-14T11:35:00.133 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_omap 2024-09-14T11:35:00.133 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_tm 2024-09-14T11:35:00.133 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_t 2024-09-14T11:35:00.133 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:35:00.134 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_epm 2024-09-14T11:35:00.134 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_lba 2024-09-14T11:35:00.134 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:35:00.134 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cache 2024-09-14T11:35:00.134 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_journal 2024-09-14T11:35:00.134 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_device 2024-09-14T11:35:00.134 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_backref 2024-09-14T11:35:00.134 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 alienstore 2024-09-14T11:35:00.134 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mclock 2024-09-14T11:35:00.134 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cyanstore 2024-09-14T11:35:00.134 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 ceph_exporter 2024-09-14T11:35:00.134 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 memstore 2024-09-14T11:35:00.134 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 trace 2024-09-14T11:35:00.134 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 ceph_dedup 2024-09-14T11:35:00.135 INFO:tasks.workunit.client.0.smithi071.stderr: -2/-2 (syslog threshold) 2024-09-14T11:35:00.135 INFO:tasks.workunit.client.0.smithi071.stderr: 99/99 (stderr threshold) 2024-09-14T11:35:00.135 INFO:tasks.workunit.client.0.smithi071.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:35:00.135 INFO:tasks.workunit.client.0.smithi071.stderr: 7f32917fa640 / http_manager 2024-09-14T11:35:00.135 INFO:tasks.workunit.client.0.smithi071.stderr: 7f32937fe640 / http_manager 2024-09-14T11:35:00.135 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3318fe1640 / rgw_dt_lg_renew 2024-09-14T11:35:00.135 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3333fff640 / ms_dispatch 2024-09-14T11:35:00.135 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3345ffb640 / io_context_pool 2024-09-14T11:35:00.135 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3347fff640 / ms_dispatch 2024-09-14T11:35:00.135 INFO:tasks.workunit.client.0.smithi071.stderr: 7f334ee05640 / ms_dispatch 2024-09-14T11:35:00.135 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3350608640 / io_context_pool 2024-09-14T11:35:00.135 INFO:tasks.workunit.client.0.smithi071.stderr: 7f34612aa640 / io_context_pool 2024-09-14T11:35:00.135 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3461aab640 / msgr-worker-2 2024-09-14T11:35:00.136 INFO:tasks.workunit.client.0.smithi071.stderr: 7f34622ac640 / msgr-worker-1 2024-09-14T11:35:00.136 INFO:tasks.workunit.client.0.smithi071.stderr: 7f3462aad640 / msgr-worker-0 2024-09-14T11:35:00.136 INFO:tasks.workunit.client.0.smithi071.stderr: 7f34647a69c0 / radosgw-admin 2024-09-14T11:35:00.136 INFO:tasks.workunit.client.0.smithi071.stderr: max_recent 500 2024-09-14T11:35:00.136 INFO:tasks.workunit.client.0.smithi071.stderr: max_new 1000 2024-09-14T11:35:00.136 INFO:tasks.workunit.client.0.smithi071.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:35:00.010170Z_f93d2184-1151-42fc-bf14-a399b45f64c4/log 2024-09-14T11:35:00.136 INFO:tasks.workunit.client.0.smithi071.stderr:--- end dump of recent events --- 2024-09-14T11:35:00.136 INFO:tasks.workunit.client.0.smithi071.stderr:Aborted 2024-09-14T11:35:00.136 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:35:00.141 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:00.141 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:00.141 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.083+0000 7f3abc3f89c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.087+0000 7f3abc3f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:00.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.087+0000 7f3abc3f89c0 20 realm 2024-09-14T11:35:00.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.087+0000 7f3abc3f89c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.087+0000 7f3abc3f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:00.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.087+0000 7f3abc3f89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:00.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.087+0000 7f3abc3f89c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.087+0000 7f3abc3f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:00.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.087+0000 7f3abc3f89c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.087+0000 7f3abc3f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:00.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.087+0000 7f3abc3f89c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.087+0000 7f3abc3f89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:00.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.087+0000 7f3abc3f89c0 20 searching for the correct realm 2024-09-14T11:35:00.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.095+0000 7f3aba6ff640 0 -- 172.21.15.71:0/4221361561 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f3ab002a040 msgr2=0x7f3ab0029920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:00.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.099+0000 7f3aba6ff640 0 -- 172.21.15.71:0/4221361561 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55889eeca500 msgr2=0x55889eecc8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:00.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.107+0000 7f3abc3f89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:00.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.107+0000 7f3abc3f89c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:35:00.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.107+0000 7f3abc3f89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:00.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.107+0000 7f3abc3f89c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:35:00.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.107+0000 7f3abc3f89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:00.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.107+0000 7f3abc3f89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:00.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.107+0000 7f3abc3f89c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.107+0000 7f3abc3f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:00.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.107+0000 7f3abc3f89c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.107+0000 7f3abc3f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:00.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.107+0000 7f3abc3f89c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.107+0000 7f3abc3f89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:00.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.107+0000 7f3abc3f89c0 20 zone default found 2024-09-14T11:35:00.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.107+0000 7f3abc3f89c0 4 Realm: () 2024-09-14T11:35:00.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.107+0000 7f3abc3f89c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:35:00.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.107+0000 7f3abc3f89c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:35:00.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.107+0000 7f3abc3f89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:00.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.107+0000 7f3abc3f89c0 20 zonegroup default 2024-09-14T11:35:00.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.107+0000 7f3abc3f89c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.111+0000 7f3abc3f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:00.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.111+0000 7f3abc3f89c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.111+0000 7f3abc3f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:00.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.111+0000 7f3abc3f89c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.111+0000 7f3abc3f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:00.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.111+0000 7f3abc3f89c0 20 started sync module instance, tier type = 2024-09-14T11:35:00.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.111+0000 7f3abc3f89c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:35:00.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.127+0000 7f3abc3f89c0 20 add_watcher() i=0 2024-09-14T11:35:00.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.127+0000 7f3abc3f89c0 20 add_watcher() i=1 2024-09-14T11:35:00.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.127+0000 7f3abc3f89c0 20 add_watcher() i=2 2024-09-14T11:35:00.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.127+0000 7f3abc3f89c0 20 add_watcher() i=3 2024-09-14T11:35:00.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.127+0000 7f3abc3f89c0 20 add_watcher() i=4 2024-09-14T11:35:00.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.127+0000 7f3abc3f89c0 20 add_watcher() i=5 2024-09-14T11:35:00.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.127+0000 7f3abc3f89c0 20 add_watcher() i=6 2024-09-14T11:35:00.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.127+0000 7f3abc3f89c0 20 add_watcher() i=7 2024-09-14T11:35:00.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.127+0000 7f3abc3f89c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:00.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.131+0000 7f396ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:00.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.131+0000 7f3abc3f89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:00.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.131+0000 7f3abc3f89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:00.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.131+0000 7f3abc3f89c0 5 note: GC not initialized 2024-09-14T11:35:00.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.131+0000 7f396efe5640 20 reqs_thread_entry: start 2024-09-14T11:35:00.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.131+0000 7f3abc3f89c0 20 init_complete bucket index max shards: 11 2024-09-14T11:35:00.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.131+0000 7f3abc3f89c0 20 Filter name: none 2024-09-14T11:35:00.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.131+0000 7f396cfe1640 20 reqs_thread_entry: start 2024-09-14T11:35:00.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.131+0000 7f3abc3f89c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:35:00.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.131+0000 7f3abc3f89c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.131+0000 7f3abc3f89c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:35:00.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.131+0000 7f3abc3f89c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:35:00.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.131+0000 7f3abc3f89c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:35:00.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.131+0000 7f3abc3f89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 : miss 2024-09-14T11:35:00.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.131+0000 7f3abc3f89c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:00.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.131+0000 7f3abc3f89c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:35:00.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.131+0000 7f3abc3f89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:35:00.147 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.131+0000 7f3abc3f89c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:35:00.147 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.131+0000 7f3abc3f89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:00.147 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.131+0000 7f3abc3f89c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:00.147 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.131+0000 7f3abc3f89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 2024-09-14T11:35:00.147 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.131+0000 7f3abc3f89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.0 2024-09-14T11:35:00.147 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.131+0000 7f3abc3f89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.0 2024-09-14T11:35:00.147 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.135+0000 7f3abc3f89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.1 2024-09-14T11:35:00.147 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.135+0000 7f3abc3f89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.1 2024-09-14T11:35:00.148 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.135+0000 7f3abc3f89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.2 2024-09-14T11:35:00.148 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.135+0000 7f3abc3f89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.2 2024-09-14T11:35:00.148 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.135+0000 7f3abc3f89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.3 2024-09-14T11:35:00.148 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.135+0000 7f3abc3f89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.3 2024-09-14T11:35:00.148 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.135+0000 7f3abc3f89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.4 2024-09-14T11:35:00.148 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.135+0000 7f3abc3f89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.4 2024-09-14T11:35:00.148 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.135+0000 7f3abc3f89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.5 2024-09-14T11:35:00.148 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.135+0000 7f3abc3f89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.5 2024-09-14T11:35:00.148 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.135+0000 7f3abc3f89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.6 2024-09-14T11:35:00.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.135+0000 7f3abc3f89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.6 2024-09-14T11:35:00.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.135+0000 7f3abc3f89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.7 2024-09-14T11:35:00.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.135+0000 7f3abc3f89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.7 2024-09-14T11:35:00.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.139+0000 7f3abc3f89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.8 2024-09-14T11:35:00.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.139+0000 7f3abc3f89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.8 2024-09-14T11:35:00.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.139+0000 7f3abc3f89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.9 2024-09-14T11:35:00.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.139+0000 7f3abc3f89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.9 2024-09-14T11:35:00.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.139+0000 7f3abc3f89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.10 2024-09-14T11:35:00.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.139+0000 7f3abc3f89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.10 2024-09-14T11:35:00.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.139+0000 7f3abc3f89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.11 2024-09-14T11:35:00.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.139+0000 7f3abc3f89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.11 2024-09-14T11:35:00.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.139+0000 7f3abc3f89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.12 2024-09-14T11:35:00.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.139+0000 7f3abc3f89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.12 2024-09-14T11:35:00.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.139+0000 7f396ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:00.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.143+0000 7f3abc3f89c0 20 remove_watcher() i=0 2024-09-14T11:35:00.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.143+0000 7f3abc3f89c0 2 removed watcher, disabling cache 2024-09-14T11:35:00.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.147+0000 7f3abc3f89c0 20 remove_watcher() i=1 2024-09-14T11:35:00.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.147+0000 7f3abc3f89c0 20 remove_watcher() i=2 2024-09-14T11:35:00.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.151+0000 7f3abc3f89c0 20 remove_watcher() i=3 2024-09-14T11:35:00.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.151+0000 7f3abc3f89c0 20 remove_watcher() i=4 2024-09-14T11:35:00.153 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.155+0000 7f3abc3f89c0 20 remove_watcher() i=5 2024-09-14T11:35:00.154 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.155+0000 7f3abc3f89c0 20 remove_watcher() i=6 2024-09-14T11:35:00.156 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:00.159+0000 7f3abc3f89c0 20 remove_watcher() i=7 2024-09-14T11:35:00.170 INFO:tasks.workunit.client.0.smithi071.stderr: test: duplicated entries can be purged manually 2024-09-14T11:35:30.188 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:35:30.222 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:30.222 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:30.266 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.267+0000 7f5b985b69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.269 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.271+0000 7f5b985b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:30.270 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.271+0000 7f5b985b69c0 20 realm 2024-09-14T11:35:30.270 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.271+0000 7f5b985b69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.270 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.271+0000 7f5b985b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:30.270 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.271+0000 7f5b985b69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:30.270 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.271+0000 7f5b985b69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.270 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.271+0000 7f5b985b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:30.270 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.271+0000 7f5b985b69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.271 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.271+0000 7f5b985b69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:30.271 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.271+0000 7f5b985b69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.271 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.271+0000 7f5b985b69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:30.272 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.271+0000 7f5b985b69c0 20 searching for the correct realm 2024-09-14T11:35:30.275 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.275+0000 7f5b968bd640 0 -- 172.21.15.71:0/1147556267 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f5b8c0ef950 msgr2=0x7f5b8c0b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:35:30.488 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.491+0000 7f5b968bd640 0 -- 172.21.15.71:0/1147556267 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55cf930da8e0 msgr2=0x55cf930dccd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:30.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.503+0000 7f5b985b69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:30.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.503+0000 7f5b985b69c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:35:30.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.503+0000 7f5b985b69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:30.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.503+0000 7f5b985b69c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:35:30.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.503+0000 7f5b985b69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:30.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.503+0000 7f5b985b69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:30.503 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.503+0000 7f5b985b69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.504 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.503+0000 7f5b985b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:30.504 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.503+0000 7f5b985b69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.504 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.503+0000 7f5b985b69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:30.504 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.503+0000 7f5b985b69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.505 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.507+0000 7f5b985b69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:30.505 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.507+0000 7f5b985b69c0 20 zone default found 2024-09-14T11:35:30.505 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.507+0000 7f5b985b69c0 4 Realm: () 2024-09-14T11:35:30.505 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.507+0000 7f5b985b69c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:35:30.505 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.507+0000 7f5b985b69c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:35:30.505 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.507+0000 7f5b985b69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:30.505 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.507+0000 7f5b985b69c0 20 zonegroup default 2024-09-14T11:35:30.505 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.507+0000 7f5b985b69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.506 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.507+0000 7f5b985b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:30.506 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.507+0000 7f5b985b69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.506 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.507+0000 7f5b985b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:30.506 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.507+0000 7f5b985b69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.507 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.507+0000 7f5b985b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:30.507 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.507+0000 7f5b985b69c0 20 started sync module instance, tier type = 2024-09-14T11:35:30.507 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.507+0000 7f5b985b69c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:35:30.527 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.527+0000 7f5b985b69c0 20 add_watcher() i=0 2024-09-14T11:35:30.528 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.527+0000 7f5b985b69c0 20 add_watcher() i=1 2024-09-14T11:35:30.528 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.527+0000 7f5b985b69c0 20 add_watcher() i=2 2024-09-14T11:35:30.528 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.527+0000 7f5b985b69c0 20 add_watcher() i=3 2024-09-14T11:35:30.528 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.527+0000 7f5b985b69c0 20 add_watcher() i=4 2024-09-14T11:35:30.528 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.527+0000 7f5b985b69c0 20 add_watcher() i=5 2024-09-14T11:35:30.528 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.527+0000 7f5b985b69c0 20 add_watcher() i=6 2024-09-14T11:35:30.530 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.531+0000 7f5b985b69c0 20 add_watcher() i=7 2024-09-14T11:35:30.530 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.531+0000 7f5b985b69c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:30.535 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.535+0000 7f5a4cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:30.536 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.535+0000 7f5b985b69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:30.536 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.535+0000 7f5b985b69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:30.536 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.535+0000 7f5b985b69c0 5 note: GC not initialized 2024-09-14T11:35:30.536 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.535+0000 7f59c77fe640 20 reqs_thread_entry: start 2024-09-14T11:35:30.536 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.535+0000 7f5b985b69c0 20 init_complete bucket index max shards: 11 2024-09-14T11:35:30.536 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.535+0000 7f5b985b69c0 20 Filter name: none 2024-09-14T11:35:30.536 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.535+0000 7f59c57fa640 20 reqs_thread_entry: start 2024-09-14T11:35:30.537 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.535+0000 7f5b985b69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.537 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.539+0000 7f5b985b69c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:35:30.538 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.539+0000 7f5b985b69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.538 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.539+0000 7f5b985b69c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:35:30.538 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.539+0000 7f5b985b69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:30.538 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.539+0000 7f5b985b69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.538 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.539+0000 7f5b985b69c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:35:30.538 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.539+0000 7f5b985b69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.538 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.539+0000 7f5b985b69c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:35:30.538 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.539+0000 7f5b985b69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:30.541 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.543+0000 7f5a4cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:30.545 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.547+0000 7f5b985b69c0 20 remove_watcher() i=0 2024-09-14T11:35:30.546 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.547+0000 7f5b985b69c0 2 removed watcher, disabling cache 2024-09-14T11:35:30.548 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.551+0000 7f5b985b69c0 20 remove_watcher() i=1 2024-09-14T11:35:30.550 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.551+0000 7f5b985b69c0 20 remove_watcher() i=2 2024-09-14T11:35:30.553 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.555+0000 7f5b985b69c0 20 remove_watcher() i=3 2024-09-14T11:35:30.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.555+0000 7f5b985b69c0 20 remove_watcher() i=4 2024-09-14T11:35:30.557 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.559+0000 7f5b985b69c0 20 remove_watcher() i=5 2024-09-14T11:35:30.560 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.559+0000 7f5b985b69c0 20 remove_watcher() i=6 2024-09-14T11:35:30.562 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.563+0000 7f5b985b69c0 20 remove_watcher() i=7 2024-09-14T11:35:30.578 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:30.579 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:35:30.579 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: a-bucket id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.18 num_objects: 11 size_kb: 1 num_shards: 13 2024-09-14T11:35:30.579 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:30.579 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:35:30.615 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:30.615 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:30.660 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.663+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.663 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.663+0000 7f4dbe7a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:30.663 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.663+0000 7f4dbe7a79c0 20 realm 2024-09-14T11:35:30.663 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.663+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.663 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.663+0000 7f4dbe7a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:30.663 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.663+0000 7f4dbe7a79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:30.663 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.663+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.663 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.663+0000 7f4dbe7a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:30.663 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.663+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.664 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.667+0000 7f4dbe7a79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:30.664 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.667+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:30.665 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.667+0000 7f4dbe7a79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:30.665 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.667+0000 7f4dbe7a79c0 20 searching for the correct realm 2024-09-14T11:35:30.872 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:30.871+0000 7f4dbcaae640 0 -- 172.21.15.71:0/2540549110 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f4da4008040 msgr2=0x7f4da4063cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:31.084 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.083+0000 7f4dbcaae640 0 -- 172.21.15.71:0/2540549110 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x555bf4426ab0 msgr2=0x555bf4428ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:31.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.099+0000 7f4dbe7a79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:31.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.099+0000 7f4dbe7a79c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:35:31.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.099+0000 7f4dbe7a79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:31.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.099+0000 7f4dbe7a79c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:35:31.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.099+0000 7f4dbe7a79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:31.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.099+0000 7f4dbe7a79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:31.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.099+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.100 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.099+0000 7f4dbe7a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.100 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.099+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.100 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:31.100 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.101 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:31.102 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 zone default found 2024-09-14T11:35:31.102 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 4 Realm: () 2024-09-14T11:35:31.102 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:35:31.102 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:35:31.102 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:31.102 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 zonegroup default 2024-09-14T11:35:31.102 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.102 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.102 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.103 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.103 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.103 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.103 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 started sync module instance, tier type = 2024-09-14T11:35:31.104 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:35:31.125 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.127+0000 7f4dbe7a79c0 20 add_watcher() i=0 2024-09-14T11:35:31.125 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.127+0000 7f4dbe7a79c0 20 add_watcher() i=1 2024-09-14T11:35:31.125 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.127+0000 7f4dbe7a79c0 20 add_watcher() i=2 2024-09-14T11:35:31.125 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.127+0000 7f4dbe7a79c0 20 add_watcher() i=3 2024-09-14T11:35:31.125 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.127+0000 7f4dbe7a79c0 20 add_watcher() i=4 2024-09-14T11:35:31.125 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.127+0000 7f4dbe7a79c0 20 add_watcher() i=5 2024-09-14T11:35:31.125 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.127+0000 7f4dbe7a79c0 20 add_watcher() i=6 2024-09-14T11:35:31.127 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.127+0000 7f4dbe7a79c0 20 add_watcher() i=7 2024-09-14T11:35:31.127 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.127+0000 7f4dbe7a79c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:31.131 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.131+0000 7f4c72fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:31.132 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:31.132 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:31.132 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 note: GC not initialized 2024-09-14T11:35:31.133 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.131+0000 7f4c71fdb640 20 reqs_thread_entry: start 2024-09-14T11:35:31.133 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 20 init_complete bucket index max shards: 11 2024-09-14T11:35:31.133 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 20 Filter name: none 2024-09-14T11:35:31.133 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.135+0000 7f4be37fe640 20 reqs_thread_entry: start 2024-09-14T11:35:31.133 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:35:31.133 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:35:31.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:35:31.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:35:31.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 : miss 2024-09-14T11:35:31.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:35:31.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:35:31.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:35:31.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:31.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:31.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 2024-09-14T11:35:31.135 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:35:31.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.151+0000 7f4dbe7a79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:35:31.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.151+0000 7f4dbe7a79c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:35:31.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.151+0000 7f4dbe7a79c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:31.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.151+0000 7f4dbe7a79c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18, ofs0, ns] 2024-09-14T11:35:31.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.151+0000 7f4c937fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464428 cookie 93853428382176 notifier 7862 bl.length()=911 2024-09-14T11:35:31.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.151+0000 7f4c937fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:35:31.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.151+0000 7f4c937fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:35:31.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.151+0000 7f4c937fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:31.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.151+0000 7f4dbe7a79c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_sources= new_sources= 2024-09-14T11:35:31.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.151+0000 7f4dbe7a79c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential sources added=[] removed=[] 2024-09-14T11:35:31.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.151+0000 7f4dbe7a79c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_dests= new_dests= 2024-09-14T11:35:31.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.151+0000 7f4dbe7a79c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential dests added=[] removed=[] 2024-09-14T11:35:31.160 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4dbe7a79c0 time 2024-09-14T11:35:31.166804+0000 2024-09-14T11:35:31.160 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:31.162 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:31.162 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f4dc20812eb] 2024-09-14T11:35:31.162 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4dc208149f] 2024-09-14T11:35:31.162 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555bf230dc01] 2024-09-14T11:35:31.162 INFO:tasks.workunit.client.0.smithi071.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x555bf2322f3a] 2024-09-14T11:35:31.162 INFO:tasks.workunit.client.0.smithi071.stderr: 5: main() 2024-09-14T11:35:31.162 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4dc0ee7d90] 2024-09-14T11:35:31.162 INFO:tasks.workunit.client.0.smithi071.stderr: 7: __libc_start_main() 2024-09-14T11:35:31.162 INFO:tasks.workunit.client.0.smithi071.stderr: 8: _start() 2024-09-14T11:35:31.162 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.163+0000 7f4dbe7a79c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4dbe7a79c0 time 2024-09-14T11:35:31.166804+0000 2024-09-14T11:35:31.162 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:31.162 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.163 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:31.163 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f4dc20812eb] 2024-09-14T11:35:31.163 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4dc208149f] 2024-09-14T11:35:31.163 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555bf230dc01] 2024-09-14T11:35:31.163 INFO:tasks.workunit.client.0.smithi071.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x555bf2322f3a] 2024-09-14T11:35:31.163 INFO:tasks.workunit.client.0.smithi071.stderr: 5: main() 2024-09-14T11:35:31.163 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4dc0ee7d90] 2024-09-14T11:35:31.163 INFO:tasks.workunit.client.0.smithi071.stderr: 7: __libc_start_main() 2024-09-14T11:35:31.163 INFO:tasks.workunit.client.0.smithi071.stderr: 8: _start() 2024-09-14T11:35:31.163 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.163 INFO:tasks.workunit.client.0.smithi071.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:35:31.163 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f4dbe7a79c0 thread_name:radosgw-admin 2024-09-14T11:35:31.180 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:31.180 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f4dc0f00520] 2024-09-14T11:35:31.180 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:35:31.181 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:35:31.181 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:35:31.181 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f4dc2081345] 2024-09-14T11:35:31.181 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4dc208149f] 2024-09-14T11:35:31.181 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555bf230dc01] 2024-09-14T11:35:31.181 INFO:tasks.workunit.client.0.smithi071.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x555bf2322f3a] 2024-09-14T11:35:31.181 INFO:tasks.workunit.client.0.smithi071.stderr: 9: main() 2024-09-14T11:35:31.181 INFO:tasks.workunit.client.0.smithi071.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4dc0ee7d90] 2024-09-14T11:35:31.181 INFO:tasks.workunit.client.0.smithi071.stderr: 11: __libc_start_main() 2024-09-14T11:35:31.181 INFO:tasks.workunit.client.0.smithi071.stderr: 12: _start() 2024-09-14T11:35:31.181 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.163+0000 7f4dbe7a79c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:35:31.181 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f4dbe7a79c0 thread_name:radosgw-admin 2024-09-14T11:35:31.181 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.181 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:31.182 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f4dc0f00520] 2024-09-14T11:35:31.182 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:35:31.182 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:35:31.182 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:35:31.182 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f4dc2081345] 2024-09-14T11:35:31.182 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4dc208149f] 2024-09-14T11:35:31.182 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555bf230dc01] 2024-09-14T11:35:31.182 INFO:tasks.workunit.client.0.smithi071.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x555bf2322f3a] 2024-09-14T11:35:31.182 INFO:tasks.workunit.client.0.smithi071.stderr: 9: main() 2024-09-14T11:35:31.182 INFO:tasks.workunit.client.0.smithi071.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4dc0ee7d90] 2024-09-14T11:35:31.182 INFO:tasks.workunit.client.0.smithi071.stderr: 11: __libc_start_main() 2024-09-14T11:35:31.182 INFO:tasks.workunit.client.0.smithi071.stderr: 12: _start() 2024-09-14T11:35:31.182 INFO:tasks.workunit.client.0.smithi071.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:35:31.182 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.183 INFO:tasks.workunit.client.0.smithi071.stderr:--- begin dump of recent events --- 2024-09-14T11:35:31.183 INFO:tasks.workunit.client.0.smithi071.stderr: -499> 2024-09-14T11:35:30.639+0000 7f4dbcaae640 10 monclient(hunting): handle_auth_done global_id 7850 payload 274 2024-09-14T11:35:31.183 INFO:tasks.workunit.client.0.smithi071.stderr: -498> 2024-09-14T11:35:30.639+0000 7f4dbcaae640 10 monclient: _finish_hunting 0 2024-09-14T11:35:31.183 INFO:tasks.workunit.client.0.smithi071.stderr: -497> 2024-09-14T11:35:30.639+0000 7f4dbcaae640 1 monclient: found mon.noname-c 2024-09-14T11:35:31.183 INFO:tasks.workunit.client.0.smithi071.stderr: -496> 2024-09-14T11:35:30.639+0000 7f4dbcaae640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:35:31.183 INFO:tasks.workunit.client.0.smithi071.stderr: -495> 2024-09-14T11:35:30.639+0000 7f4caa60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:31.183 INFO:tasks.workunit.client.0.smithi071.stderr: -494> 2024-09-14T11:35:30.639+0000 7f4caa60c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:31.183 INFO:tasks.workunit.client.0.smithi071.stderr: -493> 2024-09-14T11:35:30.639+0000 7f4caa60c640 10 monclient: dump: 2024-09-14T11:35:31.183 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:31.183 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:31.183 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.183 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.183 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:31.183 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:31.183 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:31.184 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:31.184 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:31.184 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.184 INFO:tasks.workunit.client.0.smithi071.stderr: -492> 2024-09-14T11:35:30.639+0000 7f4caa60c640 10 monclient: _finish_auth 0 2024-09-14T11:35:31.184 INFO:tasks.workunit.client.0.smithi071.stderr: -491> 2024-09-14T11:35:30.639+0000 7f4caa60c640 10 monclient: _check_auth_tickets 2024-09-14T11:35:31.184 INFO:tasks.workunit.client.0.smithi071.stderr: -490> 2024-09-14T11:35:30.639+0000 7f4caa60c640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:31.184 INFO:tasks.workunit.client.0.smithi071.stderr: -489> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 monclient: authenticate success, global_id 7850 2024-09-14T11:35:31.184 INFO:tasks.workunit.client.0.smithi071.stderr: -488> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 10 monclient: get_monmap_and_config success 2024-09-14T11:35:31.184 INFO:tasks.workunit.client.0.smithi071.stderr: -487> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 4 set_mon_vals no callback set 2024-09-14T11:35:31.184 INFO:tasks.workunit.client.0.smithi071.stderr: -486> 2024-09-14T11:35:30.639+0000 7f4caa60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:31.184 INFO:tasks.workunit.client.0.smithi071.stderr: -485> 2024-09-14T11:35:30.639+0000 7f4caa60c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:31.184 INFO:tasks.workunit.client.0.smithi071.stderr: -484> 2024-09-14T11:35:30.639+0000 7f4caa60c640 10 monclient: dump: 2024-09-14T11:35:31.184 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:31.184 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:31.184 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.185 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.185 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:31.185 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:31.185 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:31.185 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:31.185 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:31.185 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.185 INFO:tasks.workunit.client.0.smithi071.stderr: -483> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 10 monclient: shutdown 2024-09-14T11:35:31.185 INFO:tasks.workunit.client.0.smithi071.stderr: -482> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 asok(0x555bf4127d90) unregister_commands rotate-key 2024-09-14T11:35:31.185 INFO:tasks.workunit.client.0.smithi071.stderr: -481> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 10 monclient: build_initial_monmap 2024-09-14T11:35:31.185 INFO:tasks.workunit.client.0.smithi071.stderr: -480> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 1 build_initial for_mkfs: 0 2024-09-14T11:35:31.185 INFO:tasks.workunit.client.0.smithi071.stderr: -479> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 10 monclient: monmap: 2024-09-14T11:35:31.185 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:35:31.185 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:31.185 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:35:31.185 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:35:31.186 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:31.186 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:31.186 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:35:31.186 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:35:31.186 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:35:31.186 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.186 INFO:tasks.workunit.client.0.smithi071.stderr: -478> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43385c0) adding auth protocol: cephx 2024-09-14T11:35:31.186 INFO:tasks.workunit.client.0.smithi071.stderr: -477> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43385c0) adding auth protocol: cephx 2024-09-14T11:35:31.186 INFO:tasks.workunit.client.0.smithi071.stderr: -476> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43385c0) adding auth protocol: cephx 2024-09-14T11:35:31.186 INFO:tasks.workunit.client.0.smithi071.stderr: -475> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43385c0) adding con mode: secure 2024-09-14T11:35:31.186 INFO:tasks.workunit.client.0.smithi071.stderr: -474> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43385c0) adding con mode: crc 2024-09-14T11:35:31.186 INFO:tasks.workunit.client.0.smithi071.stderr: -473> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43385c0) adding con mode: secure 2024-09-14T11:35:31.186 INFO:tasks.workunit.client.0.smithi071.stderr: -472> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43385c0) adding con mode: crc 2024-09-14T11:35:31.186 INFO:tasks.workunit.client.0.smithi071.stderr: -471> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43385c0) adding con mode: secure 2024-09-14T11:35:31.186 INFO:tasks.workunit.client.0.smithi071.stderr: -470> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43385c0) adding con mode: crc 2024-09-14T11:35:31.187 INFO:tasks.workunit.client.0.smithi071.stderr: -469> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43385c0) adding con mode: crc 2024-09-14T11:35:31.187 INFO:tasks.workunit.client.0.smithi071.stderr: -468> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43385c0) adding con mode: secure 2024-09-14T11:35:31.187 INFO:tasks.workunit.client.0.smithi071.stderr: -467> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43385c0) adding con mode: crc 2024-09-14T11:35:31.187 INFO:tasks.workunit.client.0.smithi071.stderr: -466> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43385c0) adding con mode: secure 2024-09-14T11:35:31.187 INFO:tasks.workunit.client.0.smithi071.stderr: -465> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43385c0) adding con mode: crc 2024-09-14T11:35:31.187 INFO:tasks.workunit.client.0.smithi071.stderr: -464> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43385c0) adding con mode: secure 2024-09-14T11:35:31.187 INFO:tasks.workunit.client.0.smithi071.stderr: -463> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:31.187 INFO:tasks.workunit.client.0.smithi071.stderr: -462> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 1 librados: starting msgr at 2024-09-14T11:35:31.187 INFO:tasks.workunit.client.0.smithi071.stderr: -461> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 1 librados: starting objecter 2024-09-14T11:35:31.187 INFO:tasks.workunit.client.0.smithi071.stderr: -460> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 asok(0x555bf4127d90) register_command objecter_requests hook 0x555bf4363990 2024-09-14T11:35:31.187 INFO:tasks.workunit.client.0.smithi071.stderr: -459> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 1 librados: setting wanted keys 2024-09-14T11:35:31.187 INFO:tasks.workunit.client.0.smithi071.stderr: -458> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 1 librados: calling monclient init 2024-09-14T11:35:31.187 INFO:tasks.workunit.client.0.smithi071.stderr: -457> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 10 monclient: init 2024-09-14T11:35:31.187 INFO:tasks.workunit.client.0.smithi071.stderr: -456> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4333100) adding auth protocol: cephx 2024-09-14T11:35:31.187 INFO:tasks.workunit.client.0.smithi071.stderr: -455> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4333100) adding auth protocol: cephx 2024-09-14T11:35:31.187 INFO:tasks.workunit.client.0.smithi071.stderr: -454> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4333100) adding auth protocol: cephx 2024-09-14T11:35:31.188 INFO:tasks.workunit.client.0.smithi071.stderr: -453> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4333100) adding con mode: secure 2024-09-14T11:35:31.188 INFO:tasks.workunit.client.0.smithi071.stderr: -452> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4333100) adding con mode: crc 2024-09-14T11:35:31.188 INFO:tasks.workunit.client.0.smithi071.stderr: -451> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4333100) adding con mode: secure 2024-09-14T11:35:31.188 INFO:tasks.workunit.client.0.smithi071.stderr: -450> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4333100) adding con mode: crc 2024-09-14T11:35:31.188 INFO:tasks.workunit.client.0.smithi071.stderr: -449> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4333100) adding con mode: secure 2024-09-14T11:35:31.188 INFO:tasks.workunit.client.0.smithi071.stderr: -448> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4333100) adding con mode: crc 2024-09-14T11:35:31.188 INFO:tasks.workunit.client.0.smithi071.stderr: -447> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4333100) adding con mode: crc 2024-09-14T11:35:31.188 INFO:tasks.workunit.client.0.smithi071.stderr: -446> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4333100) adding con mode: secure 2024-09-14T11:35:31.188 INFO:tasks.workunit.client.0.smithi071.stderr: -445> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4333100) adding con mode: crc 2024-09-14T11:35:31.188 INFO:tasks.workunit.client.0.smithi071.stderr: -444> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4333100) adding con mode: secure 2024-09-14T11:35:31.188 INFO:tasks.workunit.client.0.smithi071.stderr: -443> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4333100) adding con mode: crc 2024-09-14T11:35:31.188 INFO:tasks.workunit.client.0.smithi071.stderr: -442> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4333100) adding con mode: secure 2024-09-14T11:35:31.188 INFO:tasks.workunit.client.0.smithi071.stderr: -441> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:31.188 INFO:tasks.workunit.client.0.smithi071.stderr: -440> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:31.189 INFO:tasks.workunit.client.0.smithi071.stderr: -439> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 5 asok(0x555bf4127d90) register_command rotate-key hook 0x555bf4333248 2024-09-14T11:35:31.189 INFO:tasks.workunit.client.0.smithi071.stderr: -438> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 10 monclient: _reopen_session rank -1 2024-09-14T11:35:31.189 INFO:tasks.workunit.client.0.smithi071.stderr: -437> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:35:31.189 INFO:tasks.workunit.client.0.smithi071.stderr: -436> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 10 monclient(hunting): picked mon.noname-a con 0x555bf41ec370 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:35:31.189 INFO:tasks.workunit.client.0.smithi071.stderr: -435> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 10 monclient(hunting): picked mon.noname-c con 0x555bf427bd00 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:35:31.189 INFO:tasks.workunit.client.0.smithi071.stderr: -434> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 10 monclient(hunting): picked mon.noname-b con 0x555bf4336480 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:35:31.189 INFO:tasks.workunit.client.0.smithi071.stderr: -433> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:31.189 INFO:tasks.workunit.client.0.smithi071.stderr: -432> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:31.189 INFO:tasks.workunit.client.0.smithi071.stderr: -431> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:31.189 INFO:tasks.workunit.client.0.smithi071.stderr: -430> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 10 monclient(hunting): _renew_subs 2024-09-14T11:35:31.189 INFO:tasks.workunit.client.0.smithi071.stderr: -429> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 10 monclient(hunting): authenticate will time out at 2542.764456s 2024-09-14T11:35:31.189 INFO:tasks.workunit.client.0.smithi071.stderr: -428> 2024-09-14T11:35:30.643+0000 7f4dbc2ad640 10 monclient(hunting): get_auth_request con 0x555bf41ec370 auth_method 0 2024-09-14T11:35:31.189 INFO:tasks.workunit.client.0.smithi071.stderr: -427> 2024-09-14T11:35:30.643+0000 7f4dbc2ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:31.189 INFO:tasks.workunit.client.0.smithi071.stderr: -426> 2024-09-14T11:35:30.643+0000 7f4dbc2ad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:31.189 INFO:tasks.workunit.client.0.smithi071.stderr: -425> 2024-09-14T11:35:30.643+0000 7f4dbc2ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:31.190 INFO:tasks.workunit.client.0.smithi071.stderr: -424> 2024-09-14T11:35:30.643+0000 7f4db3aac640 10 monclient(hunting): get_auth_request con 0x555bf427bd00 auth_method 0 2024-09-14T11:35:31.190 INFO:tasks.workunit.client.0.smithi071.stderr: -423> 2024-09-14T11:35:30.643+0000 7f4db3aac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:31.190 INFO:tasks.workunit.client.0.smithi071.stderr: -422> 2024-09-14T11:35:30.643+0000 7f4db3aac640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:31.190 INFO:tasks.workunit.client.0.smithi071.stderr: -421> 2024-09-14T11:35:30.643+0000 7f4db3aac640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:31.190 INFO:tasks.workunit.client.0.smithi071.stderr: -420> 2024-09-14T11:35:30.643+0000 7f4dbc2ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:31.190 INFO:tasks.workunit.client.0.smithi071.stderr: -419> 2024-09-14T11:35:30.643+0000 7f4dbc2ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:31.190 INFO:tasks.workunit.client.0.smithi071.stderr: -418> 2024-09-14T11:35:30.643+0000 7f4dbc2ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:31.190 INFO:tasks.workunit.client.0.smithi071.stderr: -417> 2024-09-14T11:35:30.643+0000 7f4db3aac640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:31.190 INFO:tasks.workunit.client.0.smithi071.stderr: -416> 2024-09-14T11:35:30.643+0000 7f4db3aac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:31.190 INFO:tasks.workunit.client.0.smithi071.stderr: -415> 2024-09-14T11:35:30.643+0000 7f4db3aac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:31.190 INFO:tasks.workunit.client.0.smithi071.stderr: -414> 2024-09-14T11:35:30.643+0000 7f4dbc2ad640 10 monclient(hunting): handle_auth_done global_id 8274 payload 824 2024-09-14T11:35:31.190 INFO:tasks.workunit.client.0.smithi071.stderr: -413> 2024-09-14T11:35:30.643+0000 7f4dbc2ad640 10 monclient: _finish_hunting 0 2024-09-14T11:35:31.190 INFO:tasks.workunit.client.0.smithi071.stderr: -412> 2024-09-14T11:35:30.643+0000 7f4dbc2ad640 1 monclient: found mon.noname-a 2024-09-14T11:35:31.190 INFO:tasks.workunit.client.0.smithi071.stderr: -411> 2024-09-14T11:35:30.643+0000 7f4dbc2ad640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:35:31.190 INFO:tasks.workunit.client.0.smithi071.stderr: -410> 2024-09-14T11:35:30.643+0000 7f4ca8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:31.190 INFO:tasks.workunit.client.0.smithi071.stderr: -409> 2024-09-14T11:35:30.643+0000 7f4ca8e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:31.191 INFO:tasks.workunit.client.0.smithi071.stderr: -408> 2024-09-14T11:35:30.643+0000 7f4ca8e09640 10 monclient: dump: 2024-09-14T11:35:31.191 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:31.191 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:31.191 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.191 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.191 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:31.191 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:31.191 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:31.191 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:31.191 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:31.191 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.191 INFO:tasks.workunit.client.0.smithi071.stderr: -407> 2024-09-14T11:35:30.643+0000 7f4ca8e09640 10 monclient: _finish_auth 0 2024-09-14T11:35:31.191 INFO:tasks.workunit.client.0.smithi071.stderr: -406> 2024-09-14T11:35:30.643+0000 7f4ca8e09640 10 monclient: _check_auth_tickets 2024-09-14T11:35:31.191 INFO:tasks.workunit.client.0.smithi071.stderr: -405> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 5 monclient: authenticate success, global_id 8274 2024-09-14T11:35:31.192 INFO:tasks.workunit.client.0.smithi071.stderr: -404> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 10 monclient: _renew_subs 2024-09-14T11:35:31.192 INFO:tasks.workunit.client.0.smithi071.stderr: -403> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:35:31.192 INFO:tasks.workunit.client.0.smithi071.stderr: -402> 2024-09-14T11:35:30.643+0000 7f4ca8e09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:31.192 INFO:tasks.workunit.client.0.smithi071.stderr: -401> 2024-09-14T11:35:30.643+0000 7f4ca8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:31.192 INFO:tasks.workunit.client.0.smithi071.stderr: -400> 2024-09-14T11:35:30.643+0000 7f4ca8e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:31.192 INFO:tasks.workunit.client.0.smithi071.stderr: -399> 2024-09-14T11:35:30.643+0000 7f4ca8e09640 10 monclient: dump: 2024-09-14T11:35:31.192 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:31.192 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:31.192 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.192 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.192 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:31.192 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:31.192 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:31.192 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:31.192 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:31.193 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.193 INFO:tasks.workunit.client.0.smithi071.stderr: -398> 2024-09-14T11:35:30.643+0000 7f4caa60c640 4 set_mon_vals no callback set 2024-09-14T11:35:31.193 INFO:tasks.workunit.client.0.smithi071.stderr: -397> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 10 monclient: _renew_subs 2024-09-14T11:35:31.193 INFO:tasks.workunit.client.0.smithi071.stderr: -396> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:35:31.193 INFO:tasks.workunit.client.0.smithi071.stderr: -395> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 1 librados: init done 2024-09-14T11:35:31.193 INFO:tasks.workunit.client.0.smithi071.stderr: -394> 2024-09-14T11:35:30.643+0000 7f4ca8e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:31.193 INFO:tasks.workunit.client.0.smithi071.stderr: -393> 2024-09-14T11:35:30.643+0000 7f4ca8e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:35:31.193 INFO:tasks.workunit.client.0.smithi071.stderr: -392> 2024-09-14T11:35:30.643+0000 7f4ca8e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:35:31.193 INFO:tasks.workunit.client.0.smithi071.stderr: -391> 2024-09-14T11:35:30.643+0000 7f4db3aac640 10 monclient: get_auth_request con 0x7f4ca40718d0 auth_method 0 2024-09-14T11:35:31.193 INFO:tasks.workunit.client.0.smithi071.stderr: -390> 2024-09-14T11:35:30.647+0000 7f4dbcaae640 10 monclient: get_auth_request con 0x555bf4374860 auth_method 0 2024-09-14T11:35:31.193 INFO:tasks.workunit.client.0.smithi071.stderr: -389> 2024-09-14T11:35:30.647+0000 7f4dbc2ad640 10 monclient: get_auth_request con 0x555bf437dfa0 auth_method 0 2024-09-14T11:35:31.193 INFO:tasks.workunit.client.0.smithi071.stderr: -388> 2024-09-14T11:35:30.647+0000 7f4db3aac640 10 monclient: get_auth_request con 0x555bf4382300 auth_method 0 2024-09-14T11:35:31.193 INFO:tasks.workunit.client.0.smithi071.stderr: -387> 2024-09-14T11:35:30.647+0000 7f4dbcaae640 10 monclient: get_auth_request con 0x555bf43817d0 auth_method 0 2024-09-14T11:35:31.193 INFO:tasks.workunit.client.0.smithi071.stderr: -386> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 10 monclient: build_initial_monmap 2024-09-14T11:35:31.193 INFO:tasks.workunit.client.0.smithi071.stderr: -385> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 1 build_initial for_mkfs: 0 2024-09-14T11:35:31.194 INFO:tasks.workunit.client.0.smithi071.stderr: -384> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 10 monclient: monmap: 2024-09-14T11:35:31.194 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:35:31.194 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:31.194 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:35:31.194 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:35:31.194 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:31.194 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:31.194 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:35:31.194 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:35:31.194 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:35:31.194 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.194 INFO:tasks.workunit.client.0.smithi071.stderr: -383> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf438a460) adding auth protocol: cephx 2024-09-14T11:35:31.194 INFO:tasks.workunit.client.0.smithi071.stderr: -382> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf438a460) adding auth protocol: cephx 2024-09-14T11:35:31.194 INFO:tasks.workunit.client.0.smithi071.stderr: -381> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf438a460) adding auth protocol: cephx 2024-09-14T11:35:31.194 INFO:tasks.workunit.client.0.smithi071.stderr: -380> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf438a460) adding con mode: secure 2024-09-14T11:35:31.195 INFO:tasks.workunit.client.0.smithi071.stderr: -379> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf438a460) adding con mode: crc 2024-09-14T11:35:31.195 INFO:tasks.workunit.client.0.smithi071.stderr: -378> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf438a460) adding con mode: secure 2024-09-14T11:35:31.195 INFO:tasks.workunit.client.0.smithi071.stderr: -377> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf438a460) adding con mode: crc 2024-09-14T11:35:31.195 INFO:tasks.workunit.client.0.smithi071.stderr: -376> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf438a460) adding con mode: secure 2024-09-14T11:35:31.195 INFO:tasks.workunit.client.0.smithi071.stderr: -375> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf438a460) adding con mode: crc 2024-09-14T11:35:31.195 INFO:tasks.workunit.client.0.smithi071.stderr: -374> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf438a460) adding con mode: crc 2024-09-14T11:35:31.195 INFO:tasks.workunit.client.0.smithi071.stderr: -373> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf438a460) adding con mode: secure 2024-09-14T11:35:31.195 INFO:tasks.workunit.client.0.smithi071.stderr: -372> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf438a460) adding con mode: crc 2024-09-14T11:35:31.195 INFO:tasks.workunit.client.0.smithi071.stderr: -371> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf438a460) adding con mode: secure 2024-09-14T11:35:31.195 INFO:tasks.workunit.client.0.smithi071.stderr: -370> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf438a460) adding con mode: crc 2024-09-14T11:35:31.195 INFO:tasks.workunit.client.0.smithi071.stderr: -369> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf438a460) adding con mode: secure 2024-09-14T11:35:31.195 INFO:tasks.workunit.client.0.smithi071.stderr: -368> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:31.195 INFO:tasks.workunit.client.0.smithi071.stderr: -367> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 asok(0x555bf4127d90) register_command objecter_requests cmddesc objecter_requests hook 0x555bf438de10 EEXIST 2024-09-14T11:35:31.196 INFO:tasks.workunit.client.0.smithi071.stderr: -366> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 10 monclient: init 2024-09-14T11:35:31.196 INFO:tasks.workunit.client.0.smithi071.stderr: -365> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4389358) adding auth protocol: cephx 2024-09-14T11:35:31.196 INFO:tasks.workunit.client.0.smithi071.stderr: -364> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4389358) adding auth protocol: cephx 2024-09-14T11:35:31.196 INFO:tasks.workunit.client.0.smithi071.stderr: -363> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4389358) adding auth protocol: cephx 2024-09-14T11:35:31.196 INFO:tasks.workunit.client.0.smithi071.stderr: -362> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4389358) adding con mode: secure 2024-09-14T11:35:31.196 INFO:tasks.workunit.client.0.smithi071.stderr: -361> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4389358) adding con mode: crc 2024-09-14T11:35:31.196 INFO:tasks.workunit.client.0.smithi071.stderr: -360> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4389358) adding con mode: secure 2024-09-14T11:35:31.196 INFO:tasks.workunit.client.0.smithi071.stderr: -359> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4389358) adding con mode: crc 2024-09-14T11:35:31.196 INFO:tasks.workunit.client.0.smithi071.stderr: -358> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4389358) adding con mode: secure 2024-09-14T11:35:31.196 INFO:tasks.workunit.client.0.smithi071.stderr: -357> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4389358) adding con mode: crc 2024-09-14T11:35:31.196 INFO:tasks.workunit.client.0.smithi071.stderr: -356> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4389358) adding con mode: crc 2024-09-14T11:35:31.196 INFO:tasks.workunit.client.0.smithi071.stderr: -355> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4389358) adding con mode: secure 2024-09-14T11:35:31.197 INFO:tasks.workunit.client.0.smithi071.stderr: -354> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4389358) adding con mode: crc 2024-09-14T11:35:31.197 INFO:tasks.workunit.client.0.smithi071.stderr: -353> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4389358) adding con mode: secure 2024-09-14T11:35:31.197 INFO:tasks.workunit.client.0.smithi071.stderr: -352> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4389358) adding con mode: crc 2024-09-14T11:35:31.197 INFO:tasks.workunit.client.0.smithi071.stderr: -351> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4389358) adding con mode: secure 2024-09-14T11:35:31.197 INFO:tasks.workunit.client.0.smithi071.stderr: -350> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:31.197 INFO:tasks.workunit.client.0.smithi071.stderr: -349> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:31.197 INFO:tasks.workunit.client.0.smithi071.stderr: -348> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 asok(0x555bf4127d90) register_command rotate-key cmddesc rotate-key hook 0x555bf43894a0 EEXIST 2024-09-14T11:35:31.197 INFO:tasks.workunit.client.0.smithi071.stderr: -347> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 10 monclient: _reopen_session rank -1 2024-09-14T11:35:31.197 INFO:tasks.workunit.client.0.smithi071.stderr: -346> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:35:31.197 INFO:tasks.workunit.client.0.smithi071.stderr: -345> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 10 monclient(hunting): picked mon.noname-c con 0x555bf43b1fc0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:35:31.197 INFO:tasks.workunit.client.0.smithi071.stderr: -344> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 10 monclient(hunting): picked mon.noname-a con 0x555bf43b18f0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:35:31.197 INFO:tasks.workunit.client.0.smithi071.stderr: -343> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 10 monclient(hunting): picked mon.noname-b con 0x555bf43b02d0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:35:31.197 INFO:tasks.workunit.client.0.smithi071.stderr: -342> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:31.197 INFO:tasks.workunit.client.0.smithi071.stderr: -341> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:31.198 INFO:tasks.workunit.client.0.smithi071.stderr: -340> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:31.198 INFO:tasks.workunit.client.0.smithi071.stderr: -339> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 10 monclient(hunting): _renew_subs 2024-09-14T11:35:31.198 INFO:tasks.workunit.client.0.smithi071.stderr: -338> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 10 monclient(hunting): authenticate will time out at 2542.774520s 2024-09-14T11:35:31.198 INFO:tasks.workunit.client.0.smithi071.stderr: -337> 2024-09-14T11:35:30.651+0000 7f4db3aac640 10 monclient(hunting): get_auth_request con 0x555bf43b1fc0 auth_method 0 2024-09-14T11:35:31.198 INFO:tasks.workunit.client.0.smithi071.stderr: -336> 2024-09-14T11:35:30.651+0000 7f4db3aac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:31.198 INFO:tasks.workunit.client.0.smithi071.stderr: -335> 2024-09-14T11:35:30.651+0000 7f4db3aac640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:31.198 INFO:tasks.workunit.client.0.smithi071.stderr: -334> 2024-09-14T11:35:30.651+0000 7f4db3aac640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:31.198 INFO:tasks.workunit.client.0.smithi071.stderr: -333> 2024-09-14T11:35:30.651+0000 7f4dbcaae640 10 monclient(hunting): get_auth_request con 0x555bf43b18f0 auth_method 0 2024-09-14T11:35:31.198 INFO:tasks.workunit.client.0.smithi071.stderr: -332> 2024-09-14T11:35:30.651+0000 7f4dbcaae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:31.198 INFO:tasks.workunit.client.0.smithi071.stderr: -331> 2024-09-14T11:35:30.651+0000 7f4dbcaae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:31.198 INFO:tasks.workunit.client.0.smithi071.stderr: -330> 2024-09-14T11:35:30.651+0000 7f4dbcaae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:31.198 INFO:tasks.workunit.client.0.smithi071.stderr: -329> 2024-09-14T11:35:30.651+0000 7f4db3aac640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:31.198 INFO:tasks.workunit.client.0.smithi071.stderr: -328> 2024-09-14T11:35:30.651+0000 7f4db3aac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:31.198 INFO:tasks.workunit.client.0.smithi071.stderr: -327> 2024-09-14T11:35:30.651+0000 7f4db3aac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:31.199 INFO:tasks.workunit.client.0.smithi071.stderr: -326> 2024-09-14T11:35:30.651+0000 7f4dbcaae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:31.199 INFO:tasks.workunit.client.0.smithi071.stderr: -325> 2024-09-14T11:35:30.651+0000 7f4dbcaae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:31.199 INFO:tasks.workunit.client.0.smithi071.stderr: -324> 2024-09-14T11:35:30.651+0000 7f4dbcaae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:31.199 INFO:tasks.workunit.client.0.smithi071.stderr: -323> 2024-09-14T11:35:30.651+0000 7f4db3aac640 10 monclient(hunting): handle_auth_done global_id 7856 payload 824 2024-09-14T11:35:31.199 INFO:tasks.workunit.client.0.smithi071.stderr: -322> 2024-09-14T11:35:30.651+0000 7f4db3aac640 10 monclient: _finish_hunting 0 2024-09-14T11:35:31.199 INFO:tasks.workunit.client.0.smithi071.stderr: -321> 2024-09-14T11:35:30.651+0000 7f4db3aac640 1 monclient: found mon.noname-c 2024-09-14T11:35:31.199 INFO:tasks.workunit.client.0.smithi071.stderr: -320> 2024-09-14T11:35:30.651+0000 7f4db3aac640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:35:31.199 INFO:tasks.workunit.client.0.smithi071.stderr: -319> 2024-09-14T11:35:30.651+0000 7f4dbc2ad640 10 monclient: get_auth_request con 0x555bf43b02d0 auth_method 0 2024-09-14T11:35:31.199 INFO:tasks.workunit.client.0.smithi071.stderr: -318> 2024-09-14T11:35:30.651+0000 7f4ca1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:31.199 INFO:tasks.workunit.client.0.smithi071.stderr: -317> 2024-09-14T11:35:30.651+0000 7f4ca1ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:31.199 INFO:tasks.workunit.client.0.smithi071.stderr: -316> 2024-09-14T11:35:30.651+0000 7f4ca1ffb640 10 monclient: dump: 2024-09-14T11:35:31.199 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:31.199 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:31.199 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.199 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.200 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:31.200 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:31.200 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:31.200 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:31.200 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:31.200 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.200 INFO:tasks.workunit.client.0.smithi071.stderr: -315> 2024-09-14T11:35:30.651+0000 7f4ca1ffb640 10 monclient: _finish_auth 0 2024-09-14T11:35:31.200 INFO:tasks.workunit.client.0.smithi071.stderr: -314> 2024-09-14T11:35:30.651+0000 7f4ca1ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:35:31.200 INFO:tasks.workunit.client.0.smithi071.stderr: -313> 2024-09-14T11:35:30.651+0000 7f4ca1ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:31.200 INFO:tasks.workunit.client.0.smithi071.stderr: -312> 2024-09-14T11:35:30.651+0000 7f4ca1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:31.200 INFO:tasks.workunit.client.0.smithi071.stderr: -311> 2024-09-14T11:35:30.651+0000 7f4ca1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:31.200 INFO:tasks.workunit.client.0.smithi071.stderr: -310> 2024-09-14T11:35:30.651+0000 7f4ca1ffb640 10 monclient: dump: 2024-09-14T11:35:31.200 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:31.200 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:31.200 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.201 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.201 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:31.201 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:31.201 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:31.201 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:31.201 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:31.201 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.201 INFO:tasks.workunit.client.0.smithi071.stderr: -309> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 monclient: authenticate success, global_id 7856 2024-09-14T11:35:31.201 INFO:tasks.workunit.client.0.smithi071.stderr: -308> 2024-09-14T11:35:30.651+0000 7f4dbd2af640 4 set_mon_vals no callback set 2024-09-14T11:35:31.201 INFO:tasks.workunit.client.0.smithi071.stderr: -307> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 10 monclient: _renew_subs 2024-09-14T11:35:31.201 INFO:tasks.workunit.client.0.smithi071.stderr: -306> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:35:31.201 INFO:tasks.workunit.client.0.smithi071.stderr: -305> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 10 monclient: _renew_subs 2024-09-14T11:35:31.201 INFO:tasks.workunit.client.0.smithi071.stderr: -304> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:35:31.202 INFO:tasks.workunit.client.0.smithi071.stderr: -303> 2024-09-14T11:35:30.655+0000 7f4ca1ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:31.202 INFO:tasks.workunit.client.0.smithi071.stderr: -302> 2024-09-14T11:35:30.655+0000 7f4ca1ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:35:31.202 INFO:tasks.workunit.client.0.smithi071.stderr: -301> 2024-09-14T11:35:30.655+0000 7f4ca1ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:35:31.202 INFO:tasks.workunit.client.0.smithi071.stderr: -300> 2024-09-14T11:35:30.655+0000 7f4dbcaae640 10 monclient: get_auth_request con 0x7f4c940717e0 auth_method 0 2024-09-14T11:35:31.202 INFO:tasks.workunit.client.0.smithi071.stderr: -299> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 10 monclient: get_monmap_and_config 2024-09-14T11:35:31.202 INFO:tasks.workunit.client.0.smithi071.stderr: -298> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 10 monclient: build_initial_monmap 2024-09-14T11:35:31.202 INFO:tasks.workunit.client.0.smithi071.stderr: -297> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 1 build_initial for_mkfs: 0 2024-09-14T11:35:31.202 INFO:tasks.workunit.client.0.smithi071.stderr: -296> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 10 monclient: monmap: 2024-09-14T11:35:31.202 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:35:31.202 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:31.202 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:35:31.202 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:35:31.202 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:31.202 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:31.202 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:35:31.202 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:35:31.203 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:35:31.203 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.203 INFO:tasks.workunit.client.0.smithi071.stderr: -295> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1960) adding auth protocol: cephx 2024-09-14T11:35:31.203 INFO:tasks.workunit.client.0.smithi071.stderr: -294> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1960) adding auth protocol: cephx 2024-09-14T11:35:31.203 INFO:tasks.workunit.client.0.smithi071.stderr: -293> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1960) adding auth protocol: cephx 2024-09-14T11:35:31.203 INFO:tasks.workunit.client.0.smithi071.stderr: -292> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1960) adding con mode: secure 2024-09-14T11:35:31.203 INFO:tasks.workunit.client.0.smithi071.stderr: -291> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1960) adding con mode: crc 2024-09-14T11:35:31.203 INFO:tasks.workunit.client.0.smithi071.stderr: -290> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1960) adding con mode: secure 2024-09-14T11:35:31.203 INFO:tasks.workunit.client.0.smithi071.stderr: -289> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1960) adding con mode: crc 2024-09-14T11:35:31.203 INFO:tasks.workunit.client.0.smithi071.stderr: -288> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1960) adding con mode: secure 2024-09-14T11:35:31.203 INFO:tasks.workunit.client.0.smithi071.stderr: -287> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1960) adding con mode: crc 2024-09-14T11:35:31.203 INFO:tasks.workunit.client.0.smithi071.stderr: -286> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1960) adding con mode: crc 2024-09-14T11:35:31.203 INFO:tasks.workunit.client.0.smithi071.stderr: -285> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1960) adding con mode: secure 2024-09-14T11:35:31.203 INFO:tasks.workunit.client.0.smithi071.stderr: -284> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1960) adding con mode: crc 2024-09-14T11:35:31.203 INFO:tasks.workunit.client.0.smithi071.stderr: -283> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1960) adding con mode: secure 2024-09-14T11:35:31.204 INFO:tasks.workunit.client.0.smithi071.stderr: -282> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1960) adding con mode: crc 2024-09-14T11:35:31.204 INFO:tasks.workunit.client.0.smithi071.stderr: -281> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1960) adding con mode: secure 2024-09-14T11:35:31.204 INFO:tasks.workunit.client.0.smithi071.stderr: -280> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:31.204 INFO:tasks.workunit.client.0.smithi071.stderr: -279> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 10 monclient: init 2024-09-14T11:35:31.204 INFO:tasks.workunit.client.0.smithi071.stderr: -278> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790530) adding auth protocol: cephx 2024-09-14T11:35:31.204 INFO:tasks.workunit.client.0.smithi071.stderr: -277> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790530) adding auth protocol: cephx 2024-09-14T11:35:31.204 INFO:tasks.workunit.client.0.smithi071.stderr: -276> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790530) adding auth protocol: cephx 2024-09-14T11:35:31.204 INFO:tasks.workunit.client.0.smithi071.stderr: -275> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790530) adding con mode: secure 2024-09-14T11:35:31.204 INFO:tasks.workunit.client.0.smithi071.stderr: -274> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790530) adding con mode: crc 2024-09-14T11:35:31.204 INFO:tasks.workunit.client.0.smithi071.stderr: -273> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790530) adding con mode: secure 2024-09-14T11:35:31.204 INFO:tasks.workunit.client.0.smithi071.stderr: -272> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790530) adding con mode: crc 2024-09-14T11:35:31.204 INFO:tasks.workunit.client.0.smithi071.stderr: -271> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790530) adding con mode: secure 2024-09-14T11:35:31.204 INFO:tasks.workunit.client.0.smithi071.stderr: -270> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790530) adding con mode: crc 2024-09-14T11:35:31.204 INFO:tasks.workunit.client.0.smithi071.stderr: -269> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790530) adding con mode: crc 2024-09-14T11:35:31.204 INFO:tasks.workunit.client.0.smithi071.stderr: -268> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790530) adding con mode: secure 2024-09-14T11:35:31.205 INFO:tasks.workunit.client.0.smithi071.stderr: -267> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790530) adding con mode: crc 2024-09-14T11:35:31.205 INFO:tasks.workunit.client.0.smithi071.stderr: -266> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790530) adding con mode: secure 2024-09-14T11:35:31.205 INFO:tasks.workunit.client.0.smithi071.stderr: -265> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790530) adding con mode: crc 2024-09-14T11:35:31.205 INFO:tasks.workunit.client.0.smithi071.stderr: -264> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790530) adding con mode: secure 2024-09-14T11:35:31.205 INFO:tasks.workunit.client.0.smithi071.stderr: -263> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:31.205 INFO:tasks.workunit.client.0.smithi071.stderr: -262> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:31.205 INFO:tasks.workunit.client.0.smithi071.stderr: -261> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 asok(0x555bf4127d90) register_command rotate-key cmddesc rotate-key hook 0x7ffff8790678 EEXIST 2024-09-14T11:35:31.205 INFO:tasks.workunit.client.0.smithi071.stderr: -260> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 10 monclient: _reopen_session rank -1 2024-09-14T11:35:31.205 INFO:tasks.workunit.client.0.smithi071.stderr: -259> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:35:31.205 INFO:tasks.workunit.client.0.smithi071.stderr: -258> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 10 monclient(hunting): picked mon.noname-b con 0x555bf4405e00 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:35:31.205 INFO:tasks.workunit.client.0.smithi071.stderr: -257> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 10 monclient(hunting): picked mon.noname-c con 0x555bf43f6be0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:35:31.205 INFO:tasks.workunit.client.0.smithi071.stderr: -256> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 10 monclient(hunting): picked mon.noname-a con 0x555bf4401220 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:35:31.205 INFO:tasks.workunit.client.0.smithi071.stderr: -255> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:31.205 INFO:tasks.workunit.client.0.smithi071.stderr: -254> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:31.205 INFO:tasks.workunit.client.0.smithi071.stderr: -253> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:31.206 INFO:tasks.workunit.client.0.smithi071.stderr: -252> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 10 monclient(hunting): _renew_subs 2024-09-14T11:35:31.206 INFO:tasks.workunit.client.0.smithi071.stderr: -251> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 10 monclient(hunting): authenticate will time out at 2542.778998s 2024-09-14T11:35:31.206 INFO:tasks.workunit.client.0.smithi071.stderr: -250> 2024-09-14T11:35:30.655+0000 7f4dbcaae640 10 monclient(hunting): get_auth_request con 0x555bf43f6be0 auth_method 0 2024-09-14T11:35:31.206 INFO:tasks.workunit.client.0.smithi071.stderr: -249> 2024-09-14T11:35:30.655+0000 7f4dbcaae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:31.206 INFO:tasks.workunit.client.0.smithi071.stderr: -248> 2024-09-14T11:35:30.655+0000 7f4dbcaae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:31.206 INFO:tasks.workunit.client.0.smithi071.stderr: -247> 2024-09-14T11:35:30.655+0000 7f4dbcaae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:31.206 INFO:tasks.workunit.client.0.smithi071.stderr: -246> 2024-09-14T11:35:30.655+0000 7f4dbc2ad640 10 monclient(hunting): get_auth_request con 0x555bf4401220 auth_method 0 2024-09-14T11:35:31.206 INFO:tasks.workunit.client.0.smithi071.stderr: -245> 2024-09-14T11:35:30.655+0000 7f4dbc2ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:31.206 INFO:tasks.workunit.client.0.smithi071.stderr: -244> 2024-09-14T11:35:30.655+0000 7f4dbc2ad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:31.206 INFO:tasks.workunit.client.0.smithi071.stderr: -243> 2024-09-14T11:35:30.655+0000 7f4dbc2ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:31.206 INFO:tasks.workunit.client.0.smithi071.stderr: -242> 2024-09-14T11:35:30.655+0000 7f4dbc2ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:31.206 INFO:tasks.workunit.client.0.smithi071.stderr: -241> 2024-09-14T11:35:30.655+0000 7f4dbc2ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:31.206 INFO:tasks.workunit.client.0.smithi071.stderr: -240> 2024-09-14T11:35:30.655+0000 7f4dbc2ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:31.206 INFO:tasks.workunit.client.0.smithi071.stderr: -239> 2024-09-14T11:35:30.655+0000 7f4dbcaae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:31.207 INFO:tasks.workunit.client.0.smithi071.stderr: -238> 2024-09-14T11:35:30.655+0000 7f4dbcaae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:31.207 INFO:tasks.workunit.client.0.smithi071.stderr: -237> 2024-09-14T11:35:30.655+0000 7f4dbcaae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:31.207 INFO:tasks.workunit.client.0.smithi071.stderr: -236> 2024-09-14T11:35:30.655+0000 7f4dbc2ad640 10 monclient(hunting): handle_auth_done global_id 8280 payload 274 2024-09-14T11:35:31.207 INFO:tasks.workunit.client.0.smithi071.stderr: -235> 2024-09-14T11:35:30.655+0000 7f4dbc2ad640 10 monclient: _finish_hunting 0 2024-09-14T11:35:31.207 INFO:tasks.workunit.client.0.smithi071.stderr: -234> 2024-09-14T11:35:30.655+0000 7f4dbc2ad640 1 monclient: found mon.noname-a 2024-09-14T11:35:31.207 INFO:tasks.workunit.client.0.smithi071.stderr: -233> 2024-09-14T11:35:30.655+0000 7f4dbc2ad640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:35:31.207 INFO:tasks.workunit.client.0.smithi071.stderr: -232> 2024-09-14T11:35:30.655+0000 7f4c937fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:31.207 INFO:tasks.workunit.client.0.smithi071.stderr: -231> 2024-09-14T11:35:30.655+0000 7f4c937fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:31.207 INFO:tasks.workunit.client.0.smithi071.stderr: -230> 2024-09-14T11:35:30.655+0000 7f4c937fe640 10 monclient: dump: 2024-09-14T11:35:31.207 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:31.207 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:31.207 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.207 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.208 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:31.208 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:31.208 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:31.208 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:31.208 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:31.208 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.208 INFO:tasks.workunit.client.0.smithi071.stderr: -229> 2024-09-14T11:35:30.655+0000 7f4c937fe640 10 monclient: _finish_auth 0 2024-09-14T11:35:31.208 INFO:tasks.workunit.client.0.smithi071.stderr: -228> 2024-09-14T11:35:30.655+0000 7f4c937fe640 10 monclient: _check_auth_tickets 2024-09-14T11:35:31.208 INFO:tasks.workunit.client.0.smithi071.stderr: -227> 2024-09-14T11:35:30.655+0000 7f4c937fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:31.208 INFO:tasks.workunit.client.0.smithi071.stderr: -226> 2024-09-14T11:35:30.655+0000 7f4c937fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:31.208 INFO:tasks.workunit.client.0.smithi071.stderr: -225> 2024-09-14T11:35:30.655+0000 7f4c937fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:31.208 INFO:tasks.workunit.client.0.smithi071.stderr: -224> 2024-09-14T11:35:30.655+0000 7f4c937fe640 10 monclient: dump: 2024-09-14T11:35:31.208 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:31.208 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:31.209 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.209 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.209 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:31.209 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:31.209 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:31.209 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:31.209 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:31.209 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.209 INFO:tasks.workunit.client.0.smithi071.stderr: -223> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 monclient: authenticate success, global_id 8280 2024-09-14T11:35:31.209 INFO:tasks.workunit.client.0.smithi071.stderr: -222> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 10 monclient: get_monmap_and_config success 2024-09-14T11:35:31.209 INFO:tasks.workunit.client.0.smithi071.stderr: -221> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 4 set_mon_vals no callback set 2024-09-14T11:35:31.209 INFO:tasks.workunit.client.0.smithi071.stderr: -220> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 10 monclient: shutdown 2024-09-14T11:35:31.209 INFO:tasks.workunit.client.0.smithi071.stderr: -219> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 10 monclient: build_initial_monmap 2024-09-14T11:35:31.209 INFO:tasks.workunit.client.0.smithi071.stderr: -218> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 1 build_initial for_mkfs: 0 2024-09-14T11:35:31.210 INFO:tasks.workunit.client.0.smithi071.stderr: -217> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 10 monclient: monmap: 2024-09-14T11:35:31.210 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:35:31.210 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:31.210 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:35:31.210 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:35:31.210 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:31.210 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:31.210 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:35:31.210 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:35:31.210 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:35:31.210 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.210 INFO:tasks.workunit.client.0.smithi071.stderr: -216> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1910) adding auth protocol: cephx 2024-09-14T11:35:31.210 INFO:tasks.workunit.client.0.smithi071.stderr: -215> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1910) adding auth protocol: cephx 2024-09-14T11:35:31.210 INFO:tasks.workunit.client.0.smithi071.stderr: -214> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1910) adding auth protocol: cephx 2024-09-14T11:35:31.211 INFO:tasks.workunit.client.0.smithi071.stderr: -213> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1910) adding con mode: secure 2024-09-14T11:35:31.211 INFO:tasks.workunit.client.0.smithi071.stderr: -212> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1910) adding con mode: crc 2024-09-14T11:35:31.211 INFO:tasks.workunit.client.0.smithi071.stderr: -211> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1910) adding con mode: secure 2024-09-14T11:35:31.211 INFO:tasks.workunit.client.0.smithi071.stderr: -210> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1910) adding con mode: crc 2024-09-14T11:35:31.211 INFO:tasks.workunit.client.0.smithi071.stderr: -209> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1910) adding con mode: secure 2024-09-14T11:35:31.211 INFO:tasks.workunit.client.0.smithi071.stderr: -208> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1910) adding con mode: crc 2024-09-14T11:35:31.211 INFO:tasks.workunit.client.0.smithi071.stderr: -207> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1910) adding con mode: crc 2024-09-14T11:35:31.211 INFO:tasks.workunit.client.0.smithi071.stderr: -206> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1910) adding con mode: secure 2024-09-14T11:35:31.211 INFO:tasks.workunit.client.0.smithi071.stderr: -205> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1910) adding con mode: crc 2024-09-14T11:35:31.211 INFO:tasks.workunit.client.0.smithi071.stderr: -204> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1910) adding con mode: secure 2024-09-14T11:35:31.211 INFO:tasks.workunit.client.0.smithi071.stderr: -203> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1910) adding con mode: crc 2024-09-14T11:35:31.211 INFO:tasks.workunit.client.0.smithi071.stderr: -202> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1910) adding con mode: secure 2024-09-14T11:35:31.211 INFO:tasks.workunit.client.0.smithi071.stderr: -201> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:31.212 INFO:tasks.workunit.client.0.smithi071.stderr: -200> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 1 librados: starting msgr at 2024-09-14T11:35:31.212 INFO:tasks.workunit.client.0.smithi071.stderr: -199> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 1 librados: starting objecter 2024-09-14T11:35:31.212 INFO:tasks.workunit.client.0.smithi071.stderr: -198> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 asok(0x555bf4127d90) register_command objecter_requests cmddesc objecter_requests hook 0x555bf43f7560 EEXIST 2024-09-14T11:35:31.212 INFO:tasks.workunit.client.0.smithi071.stderr: -197> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 1 librados: setting wanted keys 2024-09-14T11:35:31.212 INFO:tasks.workunit.client.0.smithi071.stderr: -196> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 1 librados: calling monclient init 2024-09-14T11:35:31.212 INFO:tasks.workunit.client.0.smithi071.stderr: -195> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 10 monclient: init 2024-09-14T11:35:31.212 INFO:tasks.workunit.client.0.smithi071.stderr: -194> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43b3de0) adding auth protocol: cephx 2024-09-14T11:35:31.212 INFO:tasks.workunit.client.0.smithi071.stderr: -193> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43b3de0) adding auth protocol: cephx 2024-09-14T11:35:31.212 INFO:tasks.workunit.client.0.smithi071.stderr: -192> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43b3de0) adding auth protocol: cephx 2024-09-14T11:35:31.212 INFO:tasks.workunit.client.0.smithi071.stderr: -191> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43b3de0) adding con mode: secure 2024-09-14T11:35:31.212 INFO:tasks.workunit.client.0.smithi071.stderr: -190> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43b3de0) adding con mode: crc 2024-09-14T11:35:31.212 INFO:tasks.workunit.client.0.smithi071.stderr: -189> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43b3de0) adding con mode: secure 2024-09-14T11:35:31.212 INFO:tasks.workunit.client.0.smithi071.stderr: -188> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43b3de0) adding con mode: crc 2024-09-14T11:35:31.212 INFO:tasks.workunit.client.0.smithi071.stderr: -187> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43b3de0) adding con mode: secure 2024-09-14T11:35:31.213 INFO:tasks.workunit.client.0.smithi071.stderr: -186> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43b3de0) adding con mode: crc 2024-09-14T11:35:31.213 INFO:tasks.workunit.client.0.smithi071.stderr: -185> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43b3de0) adding con mode: crc 2024-09-14T11:35:31.213 INFO:tasks.workunit.client.0.smithi071.stderr: -184> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43b3de0) adding con mode: secure 2024-09-14T11:35:31.213 INFO:tasks.workunit.client.0.smithi071.stderr: -183> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43b3de0) adding con mode: crc 2024-09-14T11:35:31.213 INFO:tasks.workunit.client.0.smithi071.stderr: -182> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43b3de0) adding con mode: secure 2024-09-14T11:35:31.213 INFO:tasks.workunit.client.0.smithi071.stderr: -181> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43b3de0) adding con mode: crc 2024-09-14T11:35:31.213 INFO:tasks.workunit.client.0.smithi071.stderr: -180> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43b3de0) adding con mode: secure 2024-09-14T11:35:31.213 INFO:tasks.workunit.client.0.smithi071.stderr: -179> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:31.213 INFO:tasks.workunit.client.0.smithi071.stderr: -178> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:31.213 INFO:tasks.workunit.client.0.smithi071.stderr: -177> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 asok(0x555bf4127d90) register_command rotate-key cmddesc rotate-key hook 0x555bf43b3f28 EEXIST 2024-09-14T11:35:31.213 INFO:tasks.workunit.client.0.smithi071.stderr: -176> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 10 monclient: _reopen_session rank -1 2024-09-14T11:35:31.213 INFO:tasks.workunit.client.0.smithi071.stderr: -175> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:35:31.213 INFO:tasks.workunit.client.0.smithi071.stderr: -174> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 10 monclient(hunting): picked mon.noname-a con 0x555bf43f6be0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:35:31.214 INFO:tasks.workunit.client.0.smithi071.stderr: -173> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 10 monclient(hunting): picked mon.noname-b con 0x555bf4401220 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:35:31.214 INFO:tasks.workunit.client.0.smithi071.stderr: -172> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 10 monclient(hunting): picked mon.noname-c con 0x555bf4405e00 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:35:31.214 INFO:tasks.workunit.client.0.smithi071.stderr: -171> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:31.214 INFO:tasks.workunit.client.0.smithi071.stderr: -170> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:31.214 INFO:tasks.workunit.client.0.smithi071.stderr: -169> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:31.214 INFO:tasks.workunit.client.0.smithi071.stderr: -168> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 10 monclient(hunting): _renew_subs 2024-09-14T11:35:31.214 INFO:tasks.workunit.client.0.smithi071.stderr: -167> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 10 monclient(hunting): authenticate will time out at 2542.781587s 2024-09-14T11:35:31.214 INFO:tasks.workunit.client.0.smithi071.stderr: -166> 2024-09-14T11:35:30.659+0000 7f4dbc2ad640 10 monclient(hunting): get_auth_request con 0x555bf4405e00 auth_method 0 2024-09-14T11:35:31.214 INFO:tasks.workunit.client.0.smithi071.stderr: -165> 2024-09-14T11:35:30.659+0000 7f4dbc2ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:31.214 INFO:tasks.workunit.client.0.smithi071.stderr: -164> 2024-09-14T11:35:30.659+0000 7f4dbc2ad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:31.214 INFO:tasks.workunit.client.0.smithi071.stderr: -163> 2024-09-14T11:35:30.659+0000 7f4dbc2ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:31.214 INFO:tasks.workunit.client.0.smithi071.stderr: -162> 2024-09-14T11:35:30.659+0000 7f4db3aac640 10 monclient(hunting): get_auth_request con 0x555bf43f6be0 auth_method 0 2024-09-14T11:35:31.214 INFO:tasks.workunit.client.0.smithi071.stderr: -161> 2024-09-14T11:35:30.659+0000 7f4db3aac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:31.214 INFO:tasks.workunit.client.0.smithi071.stderr: -160> 2024-09-14T11:35:30.659+0000 7f4db3aac640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:31.214 INFO:tasks.workunit.client.0.smithi071.stderr: -159> 2024-09-14T11:35:30.659+0000 7f4db3aac640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:31.215 INFO:tasks.workunit.client.0.smithi071.stderr: -158> 2024-09-14T11:35:30.659+0000 7f4dbc2ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:31.215 INFO:tasks.workunit.client.0.smithi071.stderr: -157> 2024-09-14T11:35:30.659+0000 7f4dbc2ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:31.215 INFO:tasks.workunit.client.0.smithi071.stderr: -156> 2024-09-14T11:35:30.659+0000 7f4dbc2ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:31.215 INFO:tasks.workunit.client.0.smithi071.stderr: -155> 2024-09-14T11:35:30.659+0000 7f4db3aac640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:31.215 INFO:tasks.workunit.client.0.smithi071.stderr: -154> 2024-09-14T11:35:30.659+0000 7f4db3aac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:31.215 INFO:tasks.workunit.client.0.smithi071.stderr: -153> 2024-09-14T11:35:30.659+0000 7f4db3aac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:31.215 INFO:tasks.workunit.client.0.smithi071.stderr: -152> 2024-09-14T11:35:30.659+0000 7f4dbcaae640 10 monclient(hunting): get_auth_request con 0x555bf4401220 auth_method 0 2024-09-14T11:35:31.215 INFO:tasks.workunit.client.0.smithi071.stderr: -151> 2024-09-14T11:35:30.659+0000 7f4dbcaae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:31.215 INFO:tasks.workunit.client.0.smithi071.stderr: -150> 2024-09-14T11:35:30.659+0000 7f4dbcaae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:31.215 INFO:tasks.workunit.client.0.smithi071.stderr: -149> 2024-09-14T11:35:30.659+0000 7f4dbcaae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:31.215 INFO:tasks.workunit.client.0.smithi071.stderr: -148> 2024-09-14T11:35:30.659+0000 7f4dbc2ad640 10 monclient(hunting): handle_auth_done global_id 7862 payload 824 2024-09-14T11:35:31.215 INFO:tasks.workunit.client.0.smithi071.stderr: -147> 2024-09-14T11:35:30.659+0000 7f4dbc2ad640 10 monclient: _finish_hunting 0 2024-09-14T11:35:31.215 INFO:tasks.workunit.client.0.smithi071.stderr: -146> 2024-09-14T11:35:30.659+0000 7f4dbc2ad640 1 monclient: found mon.noname-c 2024-09-14T11:35:31.215 INFO:tasks.workunit.client.0.smithi071.stderr: -145> 2024-09-14T11:35:30.659+0000 7f4dbc2ad640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:35:31.216 INFO:tasks.workunit.client.0.smithi071.stderr: -144> 2024-09-14T11:35:30.659+0000 7f4c91ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:31.216 INFO:tasks.workunit.client.0.smithi071.stderr: -143> 2024-09-14T11:35:30.659+0000 7f4c91ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:31.216 INFO:tasks.workunit.client.0.smithi071.stderr: -142> 2024-09-14T11:35:30.659+0000 7f4c91ffb640 10 monclient: dump: 2024-09-14T11:35:31.216 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:31.216 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:31.216 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.216 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.216 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:31.216 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:31.216 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:31.216 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:31.216 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:31.216 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.216 INFO:tasks.workunit.client.0.smithi071.stderr: -141> 2024-09-14T11:35:30.659+0000 7f4c91ffb640 10 monclient: _finish_auth 0 2024-09-14T11:35:31.216 INFO:tasks.workunit.client.0.smithi071.stderr: -140> 2024-09-14T11:35:30.659+0000 7f4c91ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:35:31.217 INFO:tasks.workunit.client.0.smithi071.stderr: -139> 2024-09-14T11:35:30.659+0000 7f4c91ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:31.217 INFO:tasks.workunit.client.0.smithi071.stderr: -138> 2024-09-14T11:35:30.659+0000 7f4c91ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:31.217 INFO:tasks.workunit.client.0.smithi071.stderr: -137> 2024-09-14T11:35:30.659+0000 7f4c91ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:31.217 INFO:tasks.workunit.client.0.smithi071.stderr: -136> 2024-09-14T11:35:30.659+0000 7f4c91ffb640 10 monclient: dump: 2024-09-14T11:35:31.217 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:31.217 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:31.217 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.217 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.217 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:31.217 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:31.217 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:31.217 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:31.217 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:31.217 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.217 INFO:tasks.workunit.client.0.smithi071.stderr: -135> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 monclient: authenticate success, global_id 7862 2024-09-14T11:35:31.218 INFO:tasks.workunit.client.0.smithi071.stderr: -134> 2024-09-14T11:35:30.659+0000 7f4c937fe640 4 set_mon_vals no callback set 2024-09-14T11:35:31.218 INFO:tasks.workunit.client.0.smithi071.stderr: -133> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 10 monclient: _renew_subs 2024-09-14T11:35:31.218 INFO:tasks.workunit.client.0.smithi071.stderr: -132> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:35:31.218 INFO:tasks.workunit.client.0.smithi071.stderr: -131> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 10 monclient: _renew_subs 2024-09-14T11:35:31.218 INFO:tasks.workunit.client.0.smithi071.stderr: -130> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:35:31.218 INFO:tasks.workunit.client.0.smithi071.stderr: -129> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 1 librados: init done 2024-09-14T11:35:31.218 INFO:tasks.workunit.client.0.smithi071.stderr: -128> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 asok(0x555bf4127d90) register_command cr dump hook 0x7f4dac0f8cf8 2024-09-14T11:35:31.218 INFO:tasks.workunit.client.0.smithi071.stderr: -127> 2024-09-14T11:35:30.663+0000 7f4c91ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:31.218 INFO:tasks.workunit.client.0.smithi071.stderr: -126> 2024-09-14T11:35:30.663+0000 7f4c91ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:35:31.218 INFO:tasks.workunit.client.0.smithi071.stderr: -125> 2024-09-14T11:35:30.663+0000 7f4c91ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:35:31.218 INFO:tasks.workunit.client.0.smithi071.stderr: -124> 2024-09-14T11:35:30.663+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.218 INFO:tasks.workunit.client.0.smithi071.stderr: -123> 2024-09-14T11:35:30.663+0000 7f4db3aac640 10 monclient: get_auth_request con 0x7f4c840718d0 auth_method 0 2024-09-14T11:35:31.218 INFO:tasks.workunit.client.0.smithi071.stderr: -122> 2024-09-14T11:35:30.663+0000 7f4dbcaae640 10 monclient: get_auth_request con 0x555bf441eff0 auth_method 0 2024-09-14T11:35:31.218 INFO:tasks.workunit.client.0.smithi071.stderr: -121> 2024-09-14T11:35:30.663+0000 7f4dbe7a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.219 INFO:tasks.workunit.client.0.smithi071.stderr: -120> 2024-09-14T11:35:30.663+0000 7f4dbe7a79c0 20 realm 2024-09-14T11:35:31.219 INFO:tasks.workunit.client.0.smithi071.stderr: -119> 2024-09-14T11:35:30.663+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.219 INFO:tasks.workunit.client.0.smithi071.stderr: -118> 2024-09-14T11:35:30.663+0000 7f4dbe7a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.219 INFO:tasks.workunit.client.0.smithi071.stderr: -117> 2024-09-14T11:35:30.663+0000 7f4dbe7a79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:31.219 INFO:tasks.workunit.client.0.smithi071.stderr: -116> 2024-09-14T11:35:30.663+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.219 INFO:tasks.workunit.client.0.smithi071.stderr: -115> 2024-09-14T11:35:30.663+0000 7f4dbe7a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.219 INFO:tasks.workunit.client.0.smithi071.stderr: -114> 2024-09-14T11:35:30.663+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.219 INFO:tasks.workunit.client.0.smithi071.stderr: -113> 2024-09-14T11:35:30.663+0000 7f4db3aac640 10 monclient: get_auth_request con 0x555bf4423250 auth_method 0 2024-09-14T11:35:31.219 INFO:tasks.workunit.client.0.smithi071.stderr: -112> 2024-09-14T11:35:30.667+0000 7f4dbe7a79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:31.219 INFO:tasks.workunit.client.0.smithi071.stderr: -111> 2024-09-14T11:35:30.667+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.219 INFO:tasks.workunit.client.0.smithi071.stderr: -110> 2024-09-14T11:35:30.667+0000 7f4dbcaae640 10 monclient: get_auth_request con 0x555bf4426ab0 auth_method 0 2024-09-14T11:35:31.219 INFO:tasks.workunit.client.0.smithi071.stderr: -109> 2024-09-14T11:35:30.667+0000 7f4dbe7a79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:31.219 INFO:tasks.workunit.client.0.smithi071.stderr: -108> 2024-09-14T11:35:30.667+0000 7f4dbe7a79c0 20 searching for the correct realm 2024-09-14T11:35:31.219 INFO:tasks.workunit.client.0.smithi071.stderr: -107> 2024-09-14T11:35:30.667+0000 7f4dbc2ad640 10 monclient: get_auth_request con 0x555bf442b7e0 auth_method 0 2024-09-14T11:35:31.220 INFO:tasks.workunit.client.0.smithi071.stderr: -106> 2024-09-14T11:35:30.871+0000 7f4dbc2ad640 10 monclient: get_auth_request con 0x555bf442b7e0 auth_method 0 2024-09-14T11:35:31.220 INFO:tasks.workunit.client.0.smithi071.stderr: -105> 2024-09-14T11:35:30.871+0000 7f4db3aac640 10 monclient: get_auth_request con 0x7f4dac0c1070 auth_method 0 2024-09-14T11:35:31.220 INFO:tasks.workunit.client.0.smithi071.stderr: -104> 2024-09-14T11:35:30.871+0000 7f4dbcaae640 0 -- 172.21.15.71:0/2540549110 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f4da4008040 msgr2=0x7f4da4063cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:31.220 INFO:tasks.workunit.client.0.smithi071.stderr: -103> 2024-09-14T11:35:30.871+0000 7f4dbcaae640 10 monclient: get_auth_request con 0x7f4da4008040 auth_method 0 2024-09-14T11:35:31.220 INFO:tasks.workunit.client.0.smithi071.stderr: -102> 2024-09-14T11:35:31.075+0000 7f4dbcaae640 10 monclient: get_auth_request con 0x7f4da4008040 auth_method 0 2024-09-14T11:35:31.220 INFO:tasks.workunit.client.0.smithi071.stderr: -101> 2024-09-14T11:35:31.079+0000 7f4dbc2ad640 10 monclient: get_auth_request con 0x7f4dac112cd0 auth_method 0 2024-09-14T11:35:31.220 INFO:tasks.workunit.client.0.smithi071.stderr: -100> 2024-09-14T11:35:31.083+0000 7f4db3aac640 10 monclient: get_auth_request con 0x7f4da406abb0 auth_method 0 2024-09-14T11:35:31.220 INFO:tasks.workunit.client.0.smithi071.stderr: -99> 2024-09-14T11:35:31.083+0000 7f4dbcaae640 0 -- 172.21.15.71:0/2540549110 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x555bf4426ab0 msgr2=0x555bf4428ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:31.220 INFO:tasks.workunit.client.0.smithi071.stderr: -98> 2024-09-14T11:35:31.087+0000 7f4c91ffb640 1 client.7862.objecter ms_handle_reset 0x555bf4426ab0 session 0x555bf44225e0 osd.3 2024-09-14T11:35:31.220 INFO:tasks.workunit.client.0.smithi071.stderr: -97> 2024-09-14T11:35:31.087+0000 7f4c91ffb640 10 monclient: _renew_subs 2024-09-14T11:35:31.220 INFO:tasks.workunit.client.0.smithi071.stderr: -96> 2024-09-14T11:35:31.087+0000 7f4c91ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:35:31.220 INFO:tasks.workunit.client.0.smithi071.stderr: -95> 2024-09-14T11:35:31.087+0000 7f4dbcaae640 10 monclient: get_auth_request con 0x7f4c840813f0 auth_method 0 2024-09-14T11:35:31.220 INFO:tasks.workunit.client.0.smithi071.stderr: -94> 2024-09-14T11:35:31.099+0000 7f4dbe7a79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:31.221 INFO:tasks.workunit.client.0.smithi071.stderr: -93> 2024-09-14T11:35:31.099+0000 7f4dbe7a79c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:35:31.221 INFO:tasks.workunit.client.0.smithi071.stderr: -92> 2024-09-14T11:35:31.099+0000 7f4dbe7a79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:31.221 INFO:tasks.workunit.client.0.smithi071.stderr: -91> 2024-09-14T11:35:31.099+0000 7f4dbe7a79c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:35:31.221 INFO:tasks.workunit.client.0.smithi071.stderr: -90> 2024-09-14T11:35:31.099+0000 7f4dbe7a79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:31.221 INFO:tasks.workunit.client.0.smithi071.stderr: -89> 2024-09-14T11:35:31.099+0000 7f4dbe7a79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:31.221 INFO:tasks.workunit.client.0.smithi071.stderr: -88> 2024-09-14T11:35:31.099+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.221 INFO:tasks.workunit.client.0.smithi071.stderr: -87> 2024-09-14T11:35:31.099+0000 7f4dbe7a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.221 INFO:tasks.workunit.client.0.smithi071.stderr: -86> 2024-09-14T11:35:31.099+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.221 INFO:tasks.workunit.client.0.smithi071.stderr: -85> 2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:31.221 INFO:tasks.workunit.client.0.smithi071.stderr: -84> 2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.221 INFO:tasks.workunit.client.0.smithi071.stderr: -83> 2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:31.221 INFO:tasks.workunit.client.0.smithi071.stderr: -82> 2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 zone default found 2024-09-14T11:35:31.222 INFO:tasks.workunit.client.0.smithi071.stderr: -81> 2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 4 Realm: () 2024-09-14T11:35:31.222 INFO:tasks.workunit.client.0.smithi071.stderr: -80> 2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:35:31.222 INFO:tasks.workunit.client.0.smithi071.stderr: -79> 2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:35:31.222 INFO:tasks.workunit.client.0.smithi071.stderr: -78> 2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:31.222 INFO:tasks.workunit.client.0.smithi071.stderr: -77> 2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 zonegroup default 2024-09-14T11:35:31.222 INFO:tasks.workunit.client.0.smithi071.stderr: -76> 2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.222 INFO:tasks.workunit.client.0.smithi071.stderr: -75> 2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.222 INFO:tasks.workunit.client.0.smithi071.stderr: -74> 2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.222 INFO:tasks.workunit.client.0.smithi071.stderr: -73> 2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.222 INFO:tasks.workunit.client.0.smithi071.stderr: -72> 2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.222 INFO:tasks.workunit.client.0.smithi071.stderr: -71> 2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.222 INFO:tasks.workunit.client.0.smithi071.stderr: -70> 2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 started sync module instance, tier type = 2024-09-14T11:35:31.222 INFO:tasks.workunit.client.0.smithi071.stderr: -69> 2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:35:31.223 INFO:tasks.workunit.client.0.smithi071.stderr: -68> 2024-09-14T11:35:31.127+0000 7f4dbe7a79c0 20 add_watcher() i=0 2024-09-14T11:35:31.223 INFO:tasks.workunit.client.0.smithi071.stderr: -67> 2024-09-14T11:35:31.127+0000 7f4dbe7a79c0 20 add_watcher() i=1 2024-09-14T11:35:31.223 INFO:tasks.workunit.client.0.smithi071.stderr: -66> 2024-09-14T11:35:31.127+0000 7f4dbe7a79c0 20 add_watcher() i=2 2024-09-14T11:35:31.223 INFO:tasks.workunit.client.0.smithi071.stderr: -65> 2024-09-14T11:35:31.127+0000 7f4dbe7a79c0 20 add_watcher() i=3 2024-09-14T11:35:31.223 INFO:tasks.workunit.client.0.smithi071.stderr: -64> 2024-09-14T11:35:31.127+0000 7f4dbe7a79c0 20 add_watcher() i=4 2024-09-14T11:35:31.223 INFO:tasks.workunit.client.0.smithi071.stderr: -63> 2024-09-14T11:35:31.127+0000 7f4dbe7a79c0 20 add_watcher() i=5 2024-09-14T11:35:31.223 INFO:tasks.workunit.client.0.smithi071.stderr: -62> 2024-09-14T11:35:31.127+0000 7f4dbe7a79c0 20 add_watcher() i=6 2024-09-14T11:35:31.223 INFO:tasks.workunit.client.0.smithi071.stderr: -61> 2024-09-14T11:35:31.127+0000 7f4dbe7a79c0 20 add_watcher() i=7 2024-09-14T11:35:31.223 INFO:tasks.workunit.client.0.smithi071.stderr: -60> 2024-09-14T11:35:31.127+0000 7f4dbe7a79c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:31.223 INFO:tasks.workunit.client.0.smithi071.stderr: -59> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790a10) adding auth protocol: cephx 2024-09-14T11:35:31.223 INFO:tasks.workunit.client.0.smithi071.stderr: -58> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790a10) adding auth protocol: cephx 2024-09-14T11:35:31.223 INFO:tasks.workunit.client.0.smithi071.stderr: -57> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790a10) adding auth protocol: cephx 2024-09-14T11:35:31.223 INFO:tasks.workunit.client.0.smithi071.stderr: -56> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790a10) adding con mode: secure 2024-09-14T11:35:31.223 INFO:tasks.workunit.client.0.smithi071.stderr: -55> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790a10) adding con mode: crc 2024-09-14T11:35:31.224 INFO:tasks.workunit.client.0.smithi071.stderr: -54> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790a10) adding con mode: secure 2024-09-14T11:35:31.224 INFO:tasks.workunit.client.0.smithi071.stderr: -53> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790a10) adding con mode: crc 2024-09-14T11:35:31.224 INFO:tasks.workunit.client.0.smithi071.stderr: -52> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790a10) adding con mode: secure 2024-09-14T11:35:31.224 INFO:tasks.workunit.client.0.smithi071.stderr: -51> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790a10) adding con mode: crc 2024-09-14T11:35:31.224 INFO:tasks.workunit.client.0.smithi071.stderr: -50> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790a10) adding con mode: crc 2024-09-14T11:35:31.224 INFO:tasks.workunit.client.0.smithi071.stderr: -49> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790a10) adding con mode: secure 2024-09-14T11:35:31.224 INFO:tasks.workunit.client.0.smithi071.stderr: -48> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790a10) adding con mode: crc 2024-09-14T11:35:31.224 INFO:tasks.workunit.client.0.smithi071.stderr: -47> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790a10) adding con mode: secure 2024-09-14T11:35:31.224 INFO:tasks.workunit.client.0.smithi071.stderr: -46> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790a10) adding con mode: crc 2024-09-14T11:35:31.224 INFO:tasks.workunit.client.0.smithi071.stderr: -45> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790a10) adding con mode: secure 2024-09-14T11:35:31.224 INFO:tasks.workunit.client.0.smithi071.stderr: -44> 2024-09-14T11:35:31.131+0000 7f4c72fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:31.224 INFO:tasks.workunit.client.0.smithi071.stderr: -43> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:31.224 INFO:tasks.workunit.client.0.smithi071.stderr: -42> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:31.225 INFO:tasks.workunit.client.0.smithi071.stderr: -41> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:31.225 INFO:tasks.workunit.client.0.smithi071.stderr: -40> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 asok(0x555bf4127d90) register_command cache list hook 0x555bf43d3400 2024-09-14T11:35:31.225 INFO:tasks.workunit.client.0.smithi071.stderr: -39> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 asok(0x555bf4127d90) register_command cache inspect hook 0x555bf43d3400 2024-09-14T11:35:31.225 INFO:tasks.workunit.client.0.smithi071.stderr: -38> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 asok(0x555bf4127d90) register_command cache erase hook 0x555bf43d3400 2024-09-14T11:35:31.225 INFO:tasks.workunit.client.0.smithi071.stderr: -37> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 asok(0x555bf4127d90) register_command cache zap hook 0x555bf43d3400 2024-09-14T11:35:31.225 INFO:tasks.workunit.client.0.smithi071.stderr: -36> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 note: GC not initialized 2024-09-14T11:35:31.225 INFO:tasks.workunit.client.0.smithi071.stderr: -35> 2024-09-14T11:35:31.131+0000 7f4c71fdb640 20 reqs_thread_entry: start 2024-09-14T11:35:31.225 INFO:tasks.workunit.client.0.smithi071.stderr: -34> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 5 asok(0x555bf4127d90) register_command sync trace show hook 0x7f4da4004830 2024-09-14T11:35:31.225 INFO:tasks.workunit.client.0.smithi071.stderr: -33> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 5 asok(0x555bf4127d90) register_command sync trace history hook 0x7f4da4004830 2024-09-14T11:35:31.225 INFO:tasks.workunit.client.0.smithi071.stderr: -32> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 5 asok(0x555bf4127d90) register_command sync trace active hook 0x7f4da4004830 2024-09-14T11:35:31.225 INFO:tasks.workunit.client.0.smithi071.stderr: -31> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 5 asok(0x555bf4127d90) register_command sync trace active_short hook 0x7f4da4004830 2024-09-14T11:35:31.225 INFO:tasks.workunit.client.0.smithi071.stderr: -30> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 20 init_complete bucket index max shards: 11 2024-09-14T11:35:31.225 INFO:tasks.workunit.client.0.smithi071.stderr: -29> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 20 Filter name: none 2024-09-14T11:35:31.225 INFO:tasks.workunit.client.0.smithi071.stderr: -28> 2024-09-14T11:35:31.135+0000 7f4be37fe640 20 reqs_thread_entry: start 2024-09-14T11:35:31.226 INFO:tasks.workunit.client.0.smithi071.stderr: -27> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:35:31.226 INFO:tasks.workunit.client.0.smithi071.stderr: -26> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.226 INFO:tasks.workunit.client.0.smithi071.stderr: -25> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:35:31.226 INFO:tasks.workunit.client.0.smithi071.stderr: -24> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:35:31.226 INFO:tasks.workunit.client.0.smithi071.stderr: -23> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:35:31.226 INFO:tasks.workunit.client.0.smithi071.stderr: -22> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 : miss 2024-09-14T11:35:31.226 INFO:tasks.workunit.client.0.smithi071.stderr: -21> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.226 INFO:tasks.workunit.client.0.smithi071.stderr: -20> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:35:31.226 INFO:tasks.workunit.client.0.smithi071.stderr: -19> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:35:31.226 INFO:tasks.workunit.client.0.smithi071.stderr: -18> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:35:31.226 INFO:tasks.workunit.client.0.smithi071.stderr: -17> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:31.226 INFO:tasks.workunit.client.0.smithi071.stderr: -16> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:31.226 INFO:tasks.workunit.client.0.smithi071.stderr: -15> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 2024-09-14T11:35:31.226 INFO:tasks.workunit.client.0.smithi071.stderr: -14> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:35:31.227 INFO:tasks.workunit.client.0.smithi071.stderr: -13> 2024-09-14T11:35:31.151+0000 7f4dbe7a79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:35:31.227 INFO:tasks.workunit.client.0.smithi071.stderr: -12> 2024-09-14T11:35:31.151+0000 7f4dbe7a79c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:35:31.227 INFO:tasks.workunit.client.0.smithi071.stderr: -11> 2024-09-14T11:35:31.151+0000 7f4dbe7a79c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:31.227 INFO:tasks.workunit.client.0.smithi071.stderr: -10> 2024-09-14T11:35:31.151+0000 7f4dbe7a79c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18, ofs0, ns] 2024-09-14T11:35:31.227 INFO:tasks.workunit.client.0.smithi071.stderr: -9> 2024-09-14T11:35:31.151+0000 7f4c937fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464428 cookie 93853428382176 notifier 7862 bl.length()=911 2024-09-14T11:35:31.227 INFO:tasks.workunit.client.0.smithi071.stderr: -8> 2024-09-14T11:35:31.151+0000 7f4c937fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:35:31.227 INFO:tasks.workunit.client.0.smithi071.stderr: -7> 2024-09-14T11:35:31.151+0000 7f4c937fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:35:31.227 INFO:tasks.workunit.client.0.smithi071.stderr: -6> 2024-09-14T11:35:31.151+0000 7f4c937fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:31.227 INFO:tasks.workunit.client.0.smithi071.stderr: -5> 2024-09-14T11:35:31.151+0000 7f4dbe7a79c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_sources= new_sources= 2024-09-14T11:35:31.227 INFO:tasks.workunit.client.0.smithi071.stderr: -4> 2024-09-14T11:35:31.151+0000 7f4dbe7a79c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential sources added=[] removed=[] 2024-09-14T11:35:31.227 INFO:tasks.workunit.client.0.smithi071.stderr: -3> 2024-09-14T11:35:31.151+0000 7f4dbe7a79c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_dests= new_dests= 2024-09-14T11:35:31.227 INFO:tasks.workunit.client.0.smithi071.stderr: -2> 2024-09-14T11:35:31.151+0000 7f4dbe7a79c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential dests added=[] removed=[] 2024-09-14T11:35:31.227 INFO:tasks.workunit.client.0.smithi071.stderr: -1> 2024-09-14T11:35:31.163+0000 7f4dbe7a79c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4dbe7a79c0 time 2024-09-14T11:35:31.166804+0000 2024-09-14T11:35:31.227 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:31.228 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.228 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:31.228 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f4dc20812eb] 2024-09-14T11:35:31.228 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4dc208149f] 2024-09-14T11:35:31.228 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555bf230dc01] 2024-09-14T11:35:31.228 INFO:tasks.workunit.client.0.smithi071.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x555bf2322f3a] 2024-09-14T11:35:31.228 INFO:tasks.workunit.client.0.smithi071.stderr: 5: main() 2024-09-14T11:35:31.228 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4dc0ee7d90] 2024-09-14T11:35:31.228 INFO:tasks.workunit.client.0.smithi071.stderr: 7: __libc_start_main() 2024-09-14T11:35:31.228 INFO:tasks.workunit.client.0.smithi071.stderr: 8: _start() 2024-09-14T11:35:31.228 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.228 INFO:tasks.workunit.client.0.smithi071.stderr: 0> 2024-09-14T11:35:31.163+0000 7f4dbe7a79c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:35:31.228 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f4dbe7a79c0 thread_name:radosgw-admin 2024-09-14T11:35:31.228 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.228 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:31.229 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f4dc0f00520] 2024-09-14T11:35:31.229 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:35:31.229 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:35:31.229 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:35:31.229 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f4dc2081345] 2024-09-14T11:35:31.229 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4dc208149f] 2024-09-14T11:35:31.229 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555bf230dc01] 2024-09-14T11:35:31.229 INFO:tasks.workunit.client.0.smithi071.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x555bf2322f3a] 2024-09-14T11:35:31.229 INFO:tasks.workunit.client.0.smithi071.stderr: 9: main() 2024-09-14T11:35:31.229 INFO:tasks.workunit.client.0.smithi071.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4dc0ee7d90] 2024-09-14T11:35:31.229 INFO:tasks.workunit.client.0.smithi071.stderr: 11: __libc_start_main() 2024-09-14T11:35:31.229 INFO:tasks.workunit.client.0.smithi071.stderr: 12: _start() 2024-09-14T11:35:31.230 INFO:tasks.workunit.client.0.smithi071.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:35:31.230 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.230 INFO:tasks.workunit.client.0.smithi071.stderr:--- logging levels --- 2024-09-14T11:35:31.230 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 none 2024-09-14T11:35:31.230 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 lockdep 2024-09-14T11:35:31.230 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 context 2024-09-14T11:35:31.230 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 crush 2024-09-14T11:35:31.230 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds 2024-09-14T11:35:31.230 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_balancer 2024-09-14T11:35:31.230 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_locker 2024-09-14T11:35:31.230 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log 2024-09-14T11:35:31.230 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log_expire 2024-09-14T11:35:31.230 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_migrator 2024-09-14T11:35:31.230 INFO:tasks.workunit.client.0.smithi071.stderr: 3/ 5 mds_quiesce 2024-09-14T11:35:31.230 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 buffer 2024-09-14T11:35:31.231 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 timer 2024-09-14T11:35:31.231 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 filer 2024-09-14T11:35:31.231 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 striper 2024-09-14T11:35:31.231 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 objecter 2024-09-14T11:35:31.231 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rados 2024-09-14T11:35:31.231 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd 2024-09-14T11:35:31.231 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_mirror 2024-09-14T11:35:31.231 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_replay 2024-09-14T11:35:31.231 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_pwl 2024-09-14T11:35:31.231 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 journaler 2024-09-14T11:35:31.231 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objectcacher 2024-09-14T11:35:31.231 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:35:31.231 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 client 2024-09-14T11:35:31.231 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 osd 2024-09-14T11:35:31.232 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 optracker 2024-09-14T11:35:31.232 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objclass 2024-09-14T11:35:31.232 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 filestore 2024-09-14T11:35:31.232 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 journal 2024-09-14T11:35:31.232 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 ms 2024-09-14T11:35:31.232 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mon 2024-09-14T11:35:31.232 INFO:tasks.workunit.client.0.smithi071.stderr: 0/10 monc 2024-09-14T11:35:31.232 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 paxos 2024-09-14T11:35:31.232 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 tp 2024-09-14T11:35:31.232 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 auth 2024-09-14T11:35:31.232 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 crypto 2024-09-14T11:35:31.232 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 finisher 2024-09-14T11:35:31.232 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 reserver 2024-09-14T11:35:31.232 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 heartbeatmap 2024-09-14T11:35:31.232 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 perfcounter 2024-09-14T11:35:31.233 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw 2024-09-14T11:35:31.233 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_sync 2024-09-14T11:35:31.233 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_datacache 2024-09-14T11:35:31.233 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_access 2024-09-14T11:35:31.233 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:35:31.233 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_flight 2024-09-14T11:35:31.233 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:35:31.233 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw_notification 2024-09-14T11:35:31.233 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 javaclient 2024-09-14T11:35:31.233 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 asok 2024-09-14T11:35:31.233 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 throttle 2024-09-14T11:35:31.233 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 refs 2024-09-14T11:35:31.233 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 compressor 2024-09-14T11:35:31.233 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluestore 2024-09-14T11:35:31.233 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluefs 2024-09-14T11:35:31.234 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 bdev 2024-09-14T11:35:31.234 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 kstore 2024-09-14T11:35:31.234 INFO:tasks.workunit.client.0.smithi071.stderr: 4/ 5 rocksdb 2024-09-14T11:35:31.234 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 fuse 2024-09-14T11:35:31.234 INFO:tasks.workunit.client.0.smithi071.stderr: 2/ 5 mgr 2024-09-14T11:35:31.234 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mgrc 2024-09-14T11:35:31.234 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 dpdk 2024-09-14T11:35:31.234 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 eventtrace 2024-09-14T11:35:31.234 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 prioritycache 2024-09-14T11:35:31.234 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 test 2024-09-14T11:35:31.234 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:35:31.234 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephsqlite 2024-09-14T11:35:31.234 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:35:31.234 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore 2024-09-14T11:35:31.234 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_onode 2024-09-14T11:35:31.234 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_odata 2024-09-14T11:35:31.235 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_omap 2024-09-14T11:35:31.235 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_tm 2024-09-14T11:35:31.235 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_t 2024-09-14T11:35:31.235 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:35:31.235 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_epm 2024-09-14T11:35:31.235 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_lba 2024-09-14T11:35:31.235 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:35:31.235 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cache 2024-09-14T11:35:31.235 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_journal 2024-09-14T11:35:31.235 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_device 2024-09-14T11:35:31.235 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_backref 2024-09-14T11:35:31.235 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 alienstore 2024-09-14T11:35:31.235 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mclock 2024-09-14T11:35:31.235 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cyanstore 2024-09-14T11:35:31.236 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 ceph_exporter 2024-09-14T11:35:31.236 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 memstore 2024-09-14T11:35:31.236 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 trace 2024-09-14T11:35:31.236 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 ceph_dedup 2024-09-14T11:35:31.236 INFO:tasks.workunit.client.0.smithi071.stderr: -2/-2 (syslog threshold) 2024-09-14T11:35:31.236 INFO:tasks.workunit.client.0.smithi071.stderr: 99/99 (stderr threshold) 2024-09-14T11:35:31.236 INFO:tasks.workunit.client.0.smithi071.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:35:31.236 INFO:tasks.workunit.client.0.smithi071.stderr: 7f4be37fe640 / http_manager 2024-09-14T11:35:31.236 INFO:tasks.workunit.client.0.smithi071.stderr: 7f4c71fdb640 / http_manager 2024-09-14T11:35:31.236 INFO:tasks.workunit.client.0.smithi071.stderr: 7f4c72fdd640 / rgw_dt_lg_renew 2024-09-14T11:35:31.236 INFO:tasks.workunit.client.0.smithi071.stderr: 7f4c91ffb640 / ms_dispatch 2024-09-14T11:35:31.236 INFO:tasks.workunit.client.0.smithi071.stderr: 7f4c937fe640 / io_context_pool 2024-09-14T11:35:31.236 INFO:tasks.workunit.client.0.smithi071.stderr: 7f4ca1ffb640 / ms_dispatch 2024-09-14T11:35:31.236 INFO:tasks.workunit.client.0.smithi071.stderr: 7f4ca8e09640 / ms_dispatch 2024-09-14T11:35:31.237 INFO:tasks.workunit.client.0.smithi071.stderr: 7f4caa60c640 / io_context_pool 2024-09-14T11:35:31.237 INFO:tasks.workunit.client.0.smithi071.stderr: 7f4db3aac640 / msgr-worker-2 2024-09-14T11:35:31.237 INFO:tasks.workunit.client.0.smithi071.stderr: 7f4dbc2ad640 / msgr-worker-1 2024-09-14T11:35:31.237 INFO:tasks.workunit.client.0.smithi071.stderr: 7f4dbcaae640 / msgr-worker-0 2024-09-14T11:35:31.237 INFO:tasks.workunit.client.0.smithi071.stderr: 7f4dbd2af640 / io_context_pool 2024-09-14T11:35:31.237 INFO:tasks.workunit.client.0.smithi071.stderr: 7f4dbe7a79c0 / radosgw-admin 2024-09-14T11:35:31.237 INFO:tasks.workunit.client.0.smithi071.stderr: max_recent 500 2024-09-14T11:35:31.237 INFO:tasks.workunit.client.0.smithi071.stderr: max_new 1000 2024-09-14T11:35:31.237 INFO:tasks.workunit.client.0.smithi071.stderr: log_file /var/log/ceph/ceph-client.admin.145651.log 2024-09-14T11:35:31.237 INFO:tasks.workunit.client.0.smithi071.stderr:--- end dump of recent events --- 2024-09-14T11:35:31.237 INFO:tasks.workunit.client.0.smithi071.stderr:--- begin dump of recent events --- 2024-09-14T11:35:31.237 INFO:tasks.workunit.client.0.smithi071.stderr: -499> 2024-09-14T11:35:30.639+0000 7f4dbcaae640 10 monclient(hunting): handle_auth_done global_id 7850 payload 274 2024-09-14T11:35:31.238 INFO:tasks.workunit.client.0.smithi071.stderr: -498> 2024-09-14T11:35:30.639+0000 7f4dbcaae640 10 monclient: _finish_hunting 0 2024-09-14T11:35:31.238 INFO:tasks.workunit.client.0.smithi071.stderr: -497> 2024-09-14T11:35:30.639+0000 7f4dbcaae640 1 monclient: found mon.noname-c 2024-09-14T11:35:31.238 INFO:tasks.workunit.client.0.smithi071.stderr: -496> 2024-09-14T11:35:30.639+0000 7f4dbcaae640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:35:31.238 INFO:tasks.workunit.client.0.smithi071.stderr: -495> 2024-09-14T11:35:30.639+0000 7f4caa60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:31.238 INFO:tasks.workunit.client.0.smithi071.stderr: -494> 2024-09-14T11:35:30.639+0000 7f4caa60c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:31.238 INFO:tasks.workunit.client.0.smithi071.stderr: -493> 2024-09-14T11:35:30.639+0000 7f4caa60c640 10 monclient: dump: 2024-09-14T11:35:31.238 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:31.238 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:31.238 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.238 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.238 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:31.238 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:31.239 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:31.239 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:31.239 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:31.239 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.239 INFO:tasks.workunit.client.0.smithi071.stderr: -492> 2024-09-14T11:35:30.639+0000 7f4caa60c640 10 monclient: _finish_auth 0 2024-09-14T11:35:31.239 INFO:tasks.workunit.client.0.smithi071.stderr: -491> 2024-09-14T11:35:30.639+0000 7f4caa60c640 10 monclient: _check_auth_tickets 2024-09-14T11:35:31.239 INFO:tasks.workunit.client.0.smithi071.stderr: -490> 2024-09-14T11:35:30.639+0000 7f4caa60c640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:31.239 INFO:tasks.workunit.client.0.smithi071.stderr: -489> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 monclient: authenticate success, global_id 7850 2024-09-14T11:35:31.239 INFO:tasks.workunit.client.0.smithi071.stderr: -488> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 10 monclient: get_monmap_and_config success 2024-09-14T11:35:31.239 INFO:tasks.workunit.client.0.smithi071.stderr: -487> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 4 set_mon_vals no callback set 2024-09-14T11:35:31.239 INFO:tasks.workunit.client.0.smithi071.stderr: -486> 2024-09-14T11:35:30.639+0000 7f4caa60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:31.239 INFO:tasks.workunit.client.0.smithi071.stderr: -485> 2024-09-14T11:35:30.639+0000 7f4caa60c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:31.239 INFO:tasks.workunit.client.0.smithi071.stderr: -484> 2024-09-14T11:35:30.639+0000 7f4caa60c640 10 monclient: dump: 2024-09-14T11:35:31.239 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:31.240 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:31.240 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.240 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.240 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:31.240 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:31.240 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:31.240 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:31.240 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:31.240 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.240 INFO:tasks.workunit.client.0.smithi071.stderr: -483> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 10 monclient: shutdown 2024-09-14T11:35:31.240 INFO:tasks.workunit.client.0.smithi071.stderr: -482> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 asok(0x555bf4127d90) unregister_commands rotate-key 2024-09-14T11:35:31.240 INFO:tasks.workunit.client.0.smithi071.stderr: -481> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 10 monclient: build_initial_monmap 2024-09-14T11:35:31.240 INFO:tasks.workunit.client.0.smithi071.stderr: -480> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 1 build_initial for_mkfs: 0 2024-09-14T11:35:31.240 INFO:tasks.workunit.client.0.smithi071.stderr: -479> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 10 monclient: monmap: 2024-09-14T11:35:31.241 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:35:31.241 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:31.241 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:35:31.241 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:35:31.241 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:31.241 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:31.241 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:35:31.241 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:35:31.241 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:35:31.241 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.241 INFO:tasks.workunit.client.0.smithi071.stderr: -478> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43385c0) adding auth protocol: cephx 2024-09-14T11:35:31.241 INFO:tasks.workunit.client.0.smithi071.stderr: -477> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43385c0) adding auth protocol: cephx 2024-09-14T11:35:31.241 INFO:tasks.workunit.client.0.smithi071.stderr: -476> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43385c0) adding auth protocol: cephx 2024-09-14T11:35:31.241 INFO:tasks.workunit.client.0.smithi071.stderr: -475> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43385c0) adding con mode: secure 2024-09-14T11:35:31.242 INFO:tasks.workunit.client.0.smithi071.stderr: -474> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43385c0) adding con mode: crc 2024-09-14T11:35:31.242 INFO:tasks.workunit.client.0.smithi071.stderr: -473> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43385c0) adding con mode: secure 2024-09-14T11:35:31.242 INFO:tasks.workunit.client.0.smithi071.stderr: -472> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43385c0) adding con mode: crc 2024-09-14T11:35:31.242 INFO:tasks.workunit.client.0.smithi071.stderr: -471> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43385c0) adding con mode: secure 2024-09-14T11:35:31.242 INFO:tasks.workunit.client.0.smithi071.stderr: -470> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43385c0) adding con mode: crc 2024-09-14T11:35:31.242 INFO:tasks.workunit.client.0.smithi071.stderr: -469> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43385c0) adding con mode: crc 2024-09-14T11:35:31.242 INFO:tasks.workunit.client.0.smithi071.stderr: -468> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43385c0) adding con mode: secure 2024-09-14T11:35:31.242 INFO:tasks.workunit.client.0.smithi071.stderr: -467> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43385c0) adding con mode: crc 2024-09-14T11:35:31.242 INFO:tasks.workunit.client.0.smithi071.stderr: -466> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43385c0) adding con mode: secure 2024-09-14T11:35:31.242 INFO:tasks.workunit.client.0.smithi071.stderr: -465> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43385c0) adding con mode: crc 2024-09-14T11:35:31.242 INFO:tasks.workunit.client.0.smithi071.stderr: -464> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43385c0) adding con mode: secure 2024-09-14T11:35:31.242 INFO:tasks.workunit.client.0.smithi071.stderr: -463> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:31.242 INFO:tasks.workunit.client.0.smithi071.stderr: -462> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 1 librados: starting msgr at 2024-09-14T11:35:31.242 INFO:tasks.workunit.client.0.smithi071.stderr: -461> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 1 librados: starting objecter 2024-09-14T11:35:31.243 INFO:tasks.workunit.client.0.smithi071.stderr: -460> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 asok(0x555bf4127d90) register_command objecter_requests hook 0x555bf4363990 2024-09-14T11:35:31.243 INFO:tasks.workunit.client.0.smithi071.stderr: -459> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 1 librados: setting wanted keys 2024-09-14T11:35:31.243 INFO:tasks.workunit.client.0.smithi071.stderr: -458> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 1 librados: calling monclient init 2024-09-14T11:35:31.243 INFO:tasks.workunit.client.0.smithi071.stderr: -457> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 10 monclient: init 2024-09-14T11:35:31.243 INFO:tasks.workunit.client.0.smithi071.stderr: -456> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4333100) adding auth protocol: cephx 2024-09-14T11:35:31.243 INFO:tasks.workunit.client.0.smithi071.stderr: -455> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4333100) adding auth protocol: cephx 2024-09-14T11:35:31.243 INFO:tasks.workunit.client.0.smithi071.stderr: -454> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4333100) adding auth protocol: cephx 2024-09-14T11:35:31.243 INFO:tasks.workunit.client.0.smithi071.stderr: -453> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4333100) adding con mode: secure 2024-09-14T11:35:31.243 INFO:tasks.workunit.client.0.smithi071.stderr: -452> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4333100) adding con mode: crc 2024-09-14T11:35:31.243 INFO:tasks.workunit.client.0.smithi071.stderr: -451> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4333100) adding con mode: secure 2024-09-14T11:35:31.243 INFO:tasks.workunit.client.0.smithi071.stderr: -450> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4333100) adding con mode: crc 2024-09-14T11:35:31.243 INFO:tasks.workunit.client.0.smithi071.stderr: -449> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4333100) adding con mode: secure 2024-09-14T11:35:31.243 INFO:tasks.workunit.client.0.smithi071.stderr: -448> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4333100) adding con mode: crc 2024-09-14T11:35:31.243 INFO:tasks.workunit.client.0.smithi071.stderr: -447> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4333100) adding con mode: crc 2024-09-14T11:35:31.244 INFO:tasks.workunit.client.0.smithi071.stderr: -446> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4333100) adding con mode: secure 2024-09-14T11:35:31.244 INFO:tasks.workunit.client.0.smithi071.stderr: -445> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4333100) adding con mode: crc 2024-09-14T11:35:31.244 INFO:tasks.workunit.client.0.smithi071.stderr: -444> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4333100) adding con mode: secure 2024-09-14T11:35:31.244 INFO:tasks.workunit.client.0.smithi071.stderr: -443> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4333100) adding con mode: crc 2024-09-14T11:35:31.244 INFO:tasks.workunit.client.0.smithi071.stderr: -442> 2024-09-14T11:35:30.639+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4333100) adding con mode: secure 2024-09-14T11:35:31.244 INFO:tasks.workunit.client.0.smithi071.stderr: -441> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:31.244 INFO:tasks.workunit.client.0.smithi071.stderr: -440> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:31.244 INFO:tasks.workunit.client.0.smithi071.stderr: -439> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 5 asok(0x555bf4127d90) register_command rotate-key hook 0x555bf4333248 2024-09-14T11:35:31.244 INFO:tasks.workunit.client.0.smithi071.stderr: -438> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 10 monclient: _reopen_session rank -1 2024-09-14T11:35:31.244 INFO:tasks.workunit.client.0.smithi071.stderr: -437> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:35:31.244 INFO:tasks.workunit.client.0.smithi071.stderr: -436> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 10 monclient(hunting): picked mon.noname-a con 0x555bf41ec370 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:35:31.244 INFO:tasks.workunit.client.0.smithi071.stderr: -435> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 10 monclient(hunting): picked mon.noname-c con 0x555bf427bd00 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:35:31.244 INFO:tasks.workunit.client.0.smithi071.stderr: -434> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 10 monclient(hunting): picked mon.noname-b con 0x555bf4336480 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:35:31.244 INFO:tasks.workunit.client.0.smithi071.stderr: -433> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:31.245 INFO:tasks.workunit.client.0.smithi071.stderr: -432> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:31.245 INFO:tasks.workunit.client.0.smithi071.stderr: -431> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:31.245 INFO:tasks.workunit.client.0.smithi071.stderr: -430> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 10 monclient(hunting): _renew_subs 2024-09-14T11:35:31.245 INFO:tasks.workunit.client.0.smithi071.stderr: -429> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 10 monclient(hunting): authenticate will time out at 2542.764456s 2024-09-14T11:35:31.245 INFO:tasks.workunit.client.0.smithi071.stderr: -428> 2024-09-14T11:35:30.643+0000 7f4dbc2ad640 10 monclient(hunting): get_auth_request con 0x555bf41ec370 auth_method 0 2024-09-14T11:35:31.245 INFO:tasks.workunit.client.0.smithi071.stderr: -427> 2024-09-14T11:35:30.643+0000 7f4dbc2ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:31.245 INFO:tasks.workunit.client.0.smithi071.stderr: -426> 2024-09-14T11:35:30.643+0000 7f4dbc2ad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:31.245 INFO:tasks.workunit.client.0.smithi071.stderr: -425> 2024-09-14T11:35:30.643+0000 7f4dbc2ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:31.245 INFO:tasks.workunit.client.0.smithi071.stderr: -424> 2024-09-14T11:35:30.643+0000 7f4db3aac640 10 monclient(hunting): get_auth_request con 0x555bf427bd00 auth_method 0 2024-09-14T11:35:31.245 INFO:tasks.workunit.client.0.smithi071.stderr: -423> 2024-09-14T11:35:30.643+0000 7f4db3aac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:31.245 INFO:tasks.workunit.client.0.smithi071.stderr: -422> 2024-09-14T11:35:30.643+0000 7f4db3aac640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:31.245 INFO:tasks.workunit.client.0.smithi071.stderr: -421> 2024-09-14T11:35:30.643+0000 7f4db3aac640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:31.245 INFO:tasks.workunit.client.0.smithi071.stderr: -420> 2024-09-14T11:35:30.643+0000 7f4dbc2ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:31.245 INFO:tasks.workunit.client.0.smithi071.stderr: -419> 2024-09-14T11:35:30.643+0000 7f4dbc2ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:31.246 INFO:tasks.workunit.client.0.smithi071.stderr: -418> 2024-09-14T11:35:30.643+0000 7f4dbc2ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:31.246 INFO:tasks.workunit.client.0.smithi071.stderr: -417> 2024-09-14T11:35:30.643+0000 7f4db3aac640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:31.246 INFO:tasks.workunit.client.0.smithi071.stderr: -416> 2024-09-14T11:35:30.643+0000 7f4db3aac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:31.246 INFO:tasks.workunit.client.0.smithi071.stderr: -415> 2024-09-14T11:35:30.643+0000 7f4db3aac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:31.246 INFO:tasks.workunit.client.0.smithi071.stderr: -414> 2024-09-14T11:35:30.643+0000 7f4dbc2ad640 10 monclient(hunting): handle_auth_done global_id 8274 payload 824 2024-09-14T11:35:31.246 INFO:tasks.workunit.client.0.smithi071.stderr: -413> 2024-09-14T11:35:30.643+0000 7f4dbc2ad640 10 monclient: _finish_hunting 0 2024-09-14T11:35:31.246 INFO:tasks.workunit.client.0.smithi071.stderr: -412> 2024-09-14T11:35:30.643+0000 7f4dbc2ad640 1 monclient: found mon.noname-a 2024-09-14T11:35:31.246 INFO:tasks.workunit.client.0.smithi071.stderr: -411> 2024-09-14T11:35:30.643+0000 7f4dbc2ad640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:35:31.246 INFO:tasks.workunit.client.0.smithi071.stderr: -410> 2024-09-14T11:35:30.643+0000 7f4ca8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:31.246 INFO:tasks.workunit.client.0.smithi071.stderr: -409> 2024-09-14T11:35:30.643+0000 7f4ca8e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:31.246 INFO:tasks.workunit.client.0.smithi071.stderr: -408> 2024-09-14T11:35:30.643+0000 7f4ca8e09640 10 monclient: dump: 2024-09-14T11:35:31.246 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:31.246 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:31.246 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.246 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.247 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:31.247 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:31.247 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:31.247 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:31.247 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:31.247 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.247 INFO:tasks.workunit.client.0.smithi071.stderr: -407> 2024-09-14T11:35:30.643+0000 7f4ca8e09640 10 monclient: _finish_auth 0 2024-09-14T11:35:31.247 INFO:tasks.workunit.client.0.smithi071.stderr: -406> 2024-09-14T11:35:30.643+0000 7f4ca8e09640 10 monclient: _check_auth_tickets 2024-09-14T11:35:31.247 INFO:tasks.workunit.client.0.smithi071.stderr: -405> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 5 monclient: authenticate success, global_id 8274 2024-09-14T11:35:31.247 INFO:tasks.workunit.client.0.smithi071.stderr: -404> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 10 monclient: _renew_subs 2024-09-14T11:35:31.247 INFO:tasks.workunit.client.0.smithi071.stderr: -403> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:35:31.247 INFO:tasks.workunit.client.0.smithi071.stderr: -402> 2024-09-14T11:35:30.643+0000 7f4ca8e09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:31.247 INFO:tasks.workunit.client.0.smithi071.stderr: -401> 2024-09-14T11:35:30.643+0000 7f4ca8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:31.247 INFO:tasks.workunit.client.0.smithi071.stderr: -400> 2024-09-14T11:35:30.643+0000 7f4ca8e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:31.247 INFO:tasks.workunit.client.0.smithi071.stderr: -399> 2024-09-14T11:35:30.643+0000 7f4ca8e09640 10 monclient: dump: 2024-09-14T11:35:31.248 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:31.248 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:31.248 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.248 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.248 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:31.248 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:31.248 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:31.248 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:31.248 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:31.248 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.248 INFO:tasks.workunit.client.0.smithi071.stderr: -398> 2024-09-14T11:35:30.643+0000 7f4caa60c640 4 set_mon_vals no callback set 2024-09-14T11:35:31.248 INFO:tasks.workunit.client.0.smithi071.stderr: -397> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 10 monclient: _renew_subs 2024-09-14T11:35:31.248 INFO:tasks.workunit.client.0.smithi071.stderr: -396> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.71:3300/0 2024-09-14T11:35:31.248 INFO:tasks.workunit.client.0.smithi071.stderr: -395> 2024-09-14T11:35:30.643+0000 7f4dbe7a79c0 1 librados: init done 2024-09-14T11:35:31.248 INFO:tasks.workunit.client.0.smithi071.stderr: -394> 2024-09-14T11:35:30.643+0000 7f4ca8e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:31.249 INFO:tasks.workunit.client.0.smithi071.stderr: -393> 2024-09-14T11:35:30.643+0000 7f4ca8e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:35:31.249 INFO:tasks.workunit.client.0.smithi071.stderr: -392> 2024-09-14T11:35:30.643+0000 7f4ca8e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:35:31.249 INFO:tasks.workunit.client.0.smithi071.stderr: -391> 2024-09-14T11:35:30.643+0000 7f4db3aac640 10 monclient: get_auth_request con 0x7f4ca40718d0 auth_method 0 2024-09-14T11:35:31.249 INFO:tasks.workunit.client.0.smithi071.stderr: -390> 2024-09-14T11:35:30.647+0000 7f4dbcaae640 10 monclient: get_auth_request con 0x555bf4374860 auth_method 0 2024-09-14T11:35:31.249 INFO:tasks.workunit.client.0.smithi071.stderr: -389> 2024-09-14T11:35:30.647+0000 7f4dbc2ad640 10 monclient: get_auth_request con 0x555bf437dfa0 auth_method 0 2024-09-14T11:35:31.249 INFO:tasks.workunit.client.0.smithi071.stderr: -388> 2024-09-14T11:35:30.647+0000 7f4db3aac640 10 monclient: get_auth_request con 0x555bf4382300 auth_method 0 2024-09-14T11:35:31.249 INFO:tasks.workunit.client.0.smithi071.stderr: -387> 2024-09-14T11:35:30.647+0000 7f4dbcaae640 10 monclient: get_auth_request con 0x555bf43817d0 auth_method 0 2024-09-14T11:35:31.249 INFO:tasks.workunit.client.0.smithi071.stderr: -386> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 10 monclient: build_initial_monmap 2024-09-14T11:35:31.249 INFO:tasks.workunit.client.0.smithi071.stderr: -385> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 1 build_initial for_mkfs: 0 2024-09-14T11:35:31.249 INFO:tasks.workunit.client.0.smithi071.stderr: -384> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 10 monclient: monmap: 2024-09-14T11:35:31.249 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:35:31.249 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:31.249 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:35:31.249 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:35:31.249 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:31.250 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:31.250 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:35:31.250 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:35:31.250 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:35:31.250 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.250 INFO:tasks.workunit.client.0.smithi071.stderr: -383> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf438a460) adding auth protocol: cephx 2024-09-14T11:35:31.250 INFO:tasks.workunit.client.0.smithi071.stderr: -382> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf438a460) adding auth protocol: cephx 2024-09-14T11:35:31.250 INFO:tasks.workunit.client.0.smithi071.stderr: -381> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf438a460) adding auth protocol: cephx 2024-09-14T11:35:31.250 INFO:tasks.workunit.client.0.smithi071.stderr: -380> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf438a460) adding con mode: secure 2024-09-14T11:35:31.250 INFO:tasks.workunit.client.0.smithi071.stderr: -379> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf438a460) adding con mode: crc 2024-09-14T11:35:31.250 INFO:tasks.workunit.client.0.smithi071.stderr: -378> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf438a460) adding con mode: secure 2024-09-14T11:35:31.250 INFO:tasks.workunit.client.0.smithi071.stderr: -377> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf438a460) adding con mode: crc 2024-09-14T11:35:31.250 INFO:tasks.workunit.client.0.smithi071.stderr: -376> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf438a460) adding con mode: secure 2024-09-14T11:35:31.250 INFO:tasks.workunit.client.0.smithi071.stderr: -375> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf438a460) adding con mode: crc 2024-09-14T11:35:31.250 INFO:tasks.workunit.client.0.smithi071.stderr: -374> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf438a460) adding con mode: crc 2024-09-14T11:35:31.250 INFO:tasks.workunit.client.0.smithi071.stderr: -373> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf438a460) adding con mode: secure 2024-09-14T11:35:31.251 INFO:tasks.workunit.client.0.smithi071.stderr: -372> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf438a460) adding con mode: crc 2024-09-14T11:35:31.251 INFO:tasks.workunit.client.0.smithi071.stderr: -371> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf438a460) adding con mode: secure 2024-09-14T11:35:31.251 INFO:tasks.workunit.client.0.smithi071.stderr: -370> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf438a460) adding con mode: crc 2024-09-14T11:35:31.251 INFO:tasks.workunit.client.0.smithi071.stderr: -369> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf438a460) adding con mode: secure 2024-09-14T11:35:31.251 INFO:tasks.workunit.client.0.smithi071.stderr: -368> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:31.251 INFO:tasks.workunit.client.0.smithi071.stderr: -367> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 asok(0x555bf4127d90) register_command objecter_requests cmddesc objecter_requests hook 0x555bf438de10 EEXIST 2024-09-14T11:35:31.251 INFO:tasks.workunit.client.0.smithi071.stderr: -366> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 10 monclient: init 2024-09-14T11:35:31.251 INFO:tasks.workunit.client.0.smithi071.stderr: -365> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4389358) adding auth protocol: cephx 2024-09-14T11:35:31.251 INFO:tasks.workunit.client.0.smithi071.stderr: -364> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4389358) adding auth protocol: cephx 2024-09-14T11:35:31.251 INFO:tasks.workunit.client.0.smithi071.stderr: -363> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4389358) adding auth protocol: cephx 2024-09-14T11:35:31.251 INFO:tasks.workunit.client.0.smithi071.stderr: -362> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4389358) adding con mode: secure 2024-09-14T11:35:31.252 INFO:tasks.workunit.client.0.smithi071.stderr: -361> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4389358) adding con mode: crc 2024-09-14T11:35:31.252 INFO:tasks.workunit.client.0.smithi071.stderr: -360> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4389358) adding con mode: secure 2024-09-14T11:35:31.252 INFO:tasks.workunit.client.0.smithi071.stderr: -359> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4389358) adding con mode: crc 2024-09-14T11:35:31.252 INFO:tasks.workunit.client.0.smithi071.stderr: -358> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4389358) adding con mode: secure 2024-09-14T11:35:31.252 INFO:tasks.workunit.client.0.smithi071.stderr: -357> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4389358) adding con mode: crc 2024-09-14T11:35:31.252 INFO:tasks.workunit.client.0.smithi071.stderr: -356> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4389358) adding con mode: crc 2024-09-14T11:35:31.252 INFO:tasks.workunit.client.0.smithi071.stderr: -355> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4389358) adding con mode: secure 2024-09-14T11:35:31.252 INFO:tasks.workunit.client.0.smithi071.stderr: -354> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4389358) adding con mode: crc 2024-09-14T11:35:31.252 INFO:tasks.workunit.client.0.smithi071.stderr: -353> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4389358) adding con mode: secure 2024-09-14T11:35:31.252 INFO:tasks.workunit.client.0.smithi071.stderr: -352> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4389358) adding con mode: crc 2024-09-14T11:35:31.252 INFO:tasks.workunit.client.0.smithi071.stderr: -351> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf4389358) adding con mode: secure 2024-09-14T11:35:31.252 INFO:tasks.workunit.client.0.smithi071.stderr: -350> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:31.252 INFO:tasks.workunit.client.0.smithi071.stderr: -349> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:31.252 INFO:tasks.workunit.client.0.smithi071.stderr: -348> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 asok(0x555bf4127d90) register_command rotate-key cmddesc rotate-key hook 0x555bf43894a0 EEXIST 2024-09-14T11:35:31.252 INFO:tasks.workunit.client.0.smithi071.stderr: -347> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 10 monclient: _reopen_session rank -1 2024-09-14T11:35:31.253 INFO:tasks.workunit.client.0.smithi071.stderr: -346> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:35:31.253 INFO:tasks.workunit.client.0.smithi071.stderr: -345> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 10 monclient(hunting): picked mon.noname-c con 0x555bf43b1fc0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:35:31.253 INFO:tasks.workunit.client.0.smithi071.stderr: -344> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 10 monclient(hunting): picked mon.noname-a con 0x555bf43b18f0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:35:31.253 INFO:tasks.workunit.client.0.smithi071.stderr: -343> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 10 monclient(hunting): picked mon.noname-b con 0x555bf43b02d0 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:35:31.253 INFO:tasks.workunit.client.0.smithi071.stderr: -342> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:31.253 INFO:tasks.workunit.client.0.smithi071.stderr: -341> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:31.253 INFO:tasks.workunit.client.0.smithi071.stderr: -340> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:31.253 INFO:tasks.workunit.client.0.smithi071.stderr: -339> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 10 monclient(hunting): _renew_subs 2024-09-14T11:35:31.253 INFO:tasks.workunit.client.0.smithi071.stderr: -338> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 10 monclient(hunting): authenticate will time out at 2542.774520s 2024-09-14T11:35:31.253 INFO:tasks.workunit.client.0.smithi071.stderr: -337> 2024-09-14T11:35:30.651+0000 7f4db3aac640 10 monclient(hunting): get_auth_request con 0x555bf43b1fc0 auth_method 0 2024-09-14T11:35:31.253 INFO:tasks.workunit.client.0.smithi071.stderr: -336> 2024-09-14T11:35:30.651+0000 7f4db3aac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:31.253 INFO:tasks.workunit.client.0.smithi071.stderr: -335> 2024-09-14T11:35:30.651+0000 7f4db3aac640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:31.253 INFO:tasks.workunit.client.0.smithi071.stderr: -334> 2024-09-14T11:35:30.651+0000 7f4db3aac640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:31.253 INFO:tasks.workunit.client.0.smithi071.stderr: -333> 2024-09-14T11:35:30.651+0000 7f4dbcaae640 10 monclient(hunting): get_auth_request con 0x555bf43b18f0 auth_method 0 2024-09-14T11:35:31.253 INFO:tasks.workunit.client.0.smithi071.stderr: -332> 2024-09-14T11:35:30.651+0000 7f4dbcaae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:31.254 INFO:tasks.workunit.client.0.smithi071.stderr: -331> 2024-09-14T11:35:30.651+0000 7f4dbcaae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:31.254 INFO:tasks.workunit.client.0.smithi071.stderr: -330> 2024-09-14T11:35:30.651+0000 7f4dbcaae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:31.254 INFO:tasks.workunit.client.0.smithi071.stderr: -329> 2024-09-14T11:35:30.651+0000 7f4db3aac640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:31.254 INFO:tasks.workunit.client.0.smithi071.stderr: -328> 2024-09-14T11:35:30.651+0000 7f4db3aac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:31.254 INFO:tasks.workunit.client.0.smithi071.stderr: -327> 2024-09-14T11:35:30.651+0000 7f4db3aac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:31.254 INFO:tasks.workunit.client.0.smithi071.stderr: -326> 2024-09-14T11:35:30.651+0000 7f4dbcaae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:31.254 INFO:tasks.workunit.client.0.smithi071.stderr: -325> 2024-09-14T11:35:30.651+0000 7f4dbcaae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:31.254 INFO:tasks.workunit.client.0.smithi071.stderr: -324> 2024-09-14T11:35:30.651+0000 7f4dbcaae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:31.254 INFO:tasks.workunit.client.0.smithi071.stderr: -323> 2024-09-14T11:35:30.651+0000 7f4db3aac640 10 monclient(hunting): handle_auth_done global_id 7856 payload 824 2024-09-14T11:35:31.254 INFO:tasks.workunit.client.0.smithi071.stderr: -322> 2024-09-14T11:35:30.651+0000 7f4db3aac640 10 monclient: _finish_hunting 0 2024-09-14T11:35:31.254 INFO:tasks.workunit.client.0.smithi071.stderr: -321> 2024-09-14T11:35:30.651+0000 7f4db3aac640 1 monclient: found mon.noname-c 2024-09-14T11:35:31.254 INFO:tasks.workunit.client.0.smithi071.stderr: -320> 2024-09-14T11:35:30.651+0000 7f4db3aac640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:35:31.254 INFO:tasks.workunit.client.0.smithi071.stderr: -319> 2024-09-14T11:35:30.651+0000 7f4dbc2ad640 10 monclient: get_auth_request con 0x555bf43b02d0 auth_method 0 2024-09-14T11:35:31.254 INFO:tasks.workunit.client.0.smithi071.stderr: -318> 2024-09-14T11:35:30.651+0000 7f4ca1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:31.254 INFO:tasks.workunit.client.0.smithi071.stderr: -317> 2024-09-14T11:35:30.651+0000 7f4ca1ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:31.255 INFO:tasks.workunit.client.0.smithi071.stderr: -316> 2024-09-14T11:35:30.651+0000 7f4ca1ffb640 10 monclient: dump: 2024-09-14T11:35:31.255 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:31.255 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:31.255 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.255 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.255 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:31.255 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:31.255 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:31.255 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:31.255 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:31.255 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.255 INFO:tasks.workunit.client.0.smithi071.stderr: -315> 2024-09-14T11:35:30.651+0000 7f4ca1ffb640 10 monclient: _finish_auth 0 2024-09-14T11:35:31.255 INFO:tasks.workunit.client.0.smithi071.stderr: -314> 2024-09-14T11:35:30.651+0000 7f4ca1ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:35:31.255 INFO:tasks.workunit.client.0.smithi071.stderr: -313> 2024-09-14T11:35:30.651+0000 7f4ca1ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:31.255 INFO:tasks.workunit.client.0.smithi071.stderr: -312> 2024-09-14T11:35:30.651+0000 7f4ca1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:31.256 INFO:tasks.workunit.client.0.smithi071.stderr: -311> 2024-09-14T11:35:30.651+0000 7f4ca1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:31.256 INFO:tasks.workunit.client.0.smithi071.stderr: -310> 2024-09-14T11:35:30.651+0000 7f4ca1ffb640 10 monclient: dump: 2024-09-14T11:35:31.256 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:31.256 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:31.256 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.256 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.256 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:31.256 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:31.256 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:31.256 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:31.256 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:31.256 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.256 INFO:tasks.workunit.client.0.smithi071.stderr: -309> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 5 monclient: authenticate success, global_id 7856 2024-09-14T11:35:31.256 INFO:tasks.workunit.client.0.smithi071.stderr: -308> 2024-09-14T11:35:30.651+0000 7f4dbd2af640 4 set_mon_vals no callback set 2024-09-14T11:35:31.257 INFO:tasks.workunit.client.0.smithi071.stderr: -307> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 10 monclient: _renew_subs 2024-09-14T11:35:31.257 INFO:tasks.workunit.client.0.smithi071.stderr: -306> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:35:31.257 INFO:tasks.workunit.client.0.smithi071.stderr: -305> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 10 monclient: _renew_subs 2024-09-14T11:35:31.257 INFO:tasks.workunit.client.0.smithi071.stderr: -304> 2024-09-14T11:35:30.651+0000 7f4dbe7a79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:35:31.257 INFO:tasks.workunit.client.0.smithi071.stderr: -303> 2024-09-14T11:35:30.655+0000 7f4ca1ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:31.257 INFO:tasks.workunit.client.0.smithi071.stderr: -302> 2024-09-14T11:35:30.655+0000 7f4ca1ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:35:31.257 INFO:tasks.workunit.client.0.smithi071.stderr: -301> 2024-09-14T11:35:30.655+0000 7f4ca1ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:35:31.257 INFO:tasks.workunit.client.0.smithi071.stderr: -300> 2024-09-14T11:35:30.655+0000 7f4dbcaae640 10 monclient: get_auth_request con 0x7f4c940717e0 auth_method 0 2024-09-14T11:35:31.257 INFO:tasks.workunit.client.0.smithi071.stderr: -299> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 10 monclient: get_monmap_and_config 2024-09-14T11:35:31.257 INFO:tasks.workunit.client.0.smithi071.stderr: -298> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 10 monclient: build_initial_monmap 2024-09-14T11:35:31.257 INFO:tasks.workunit.client.0.smithi071.stderr: -297> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 1 build_initial for_mkfs: 0 2024-09-14T11:35:31.257 INFO:tasks.workunit.client.0.smithi071.stderr: -296> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 10 monclient: monmap: 2024-09-14T11:35:31.257 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:35:31.257 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:31.257 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:35:31.258 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:35:31.258 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:31.258 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:31.258 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:35:31.258 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:35:31.258 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:35:31.258 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.258 INFO:tasks.workunit.client.0.smithi071.stderr: -295> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1960) adding auth protocol: cephx 2024-09-14T11:35:31.258 INFO:tasks.workunit.client.0.smithi071.stderr: -294> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1960) adding auth protocol: cephx 2024-09-14T11:35:31.258 INFO:tasks.workunit.client.0.smithi071.stderr: -293> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1960) adding auth protocol: cephx 2024-09-14T11:35:31.258 INFO:tasks.workunit.client.0.smithi071.stderr: -292> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1960) adding con mode: secure 2024-09-14T11:35:31.258 INFO:tasks.workunit.client.0.smithi071.stderr: -291> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1960) adding con mode: crc 2024-09-14T11:35:31.258 INFO:tasks.workunit.client.0.smithi071.stderr: -290> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1960) adding con mode: secure 2024-09-14T11:35:31.258 INFO:tasks.workunit.client.0.smithi071.stderr: -289> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1960) adding con mode: crc 2024-09-14T11:35:31.258 INFO:tasks.workunit.client.0.smithi071.stderr: -288> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1960) adding con mode: secure 2024-09-14T11:35:31.259 INFO:tasks.workunit.client.0.smithi071.stderr: -287> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1960) adding con mode: crc 2024-09-14T11:35:31.259 INFO:tasks.workunit.client.0.smithi071.stderr: -286> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1960) adding con mode: crc 2024-09-14T11:35:31.259 INFO:tasks.workunit.client.0.smithi071.stderr: -285> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1960) adding con mode: secure 2024-09-14T11:35:31.259 INFO:tasks.workunit.client.0.smithi071.stderr: -284> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1960) adding con mode: crc 2024-09-14T11:35:31.259 INFO:tasks.workunit.client.0.smithi071.stderr: -283> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1960) adding con mode: secure 2024-09-14T11:35:31.259 INFO:tasks.workunit.client.0.smithi071.stderr: -282> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1960) adding con mode: crc 2024-09-14T11:35:31.259 INFO:tasks.workunit.client.0.smithi071.stderr: -281> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1960) adding con mode: secure 2024-09-14T11:35:31.259 INFO:tasks.workunit.client.0.smithi071.stderr: -280> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:31.259 INFO:tasks.workunit.client.0.smithi071.stderr: -279> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 10 monclient: init 2024-09-14T11:35:31.259 INFO:tasks.workunit.client.0.smithi071.stderr: -278> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790530) adding auth protocol: cephx 2024-09-14T11:35:31.259 INFO:tasks.workunit.client.0.smithi071.stderr: -277> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790530) adding auth protocol: cephx 2024-09-14T11:35:31.259 INFO:tasks.workunit.client.0.smithi071.stderr: -276> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790530) adding auth protocol: cephx 2024-09-14T11:35:31.259 INFO:tasks.workunit.client.0.smithi071.stderr: -275> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790530) adding con mode: secure 2024-09-14T11:35:31.259 INFO:tasks.workunit.client.0.smithi071.stderr: -274> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790530) adding con mode: crc 2024-09-14T11:35:31.259 INFO:tasks.workunit.client.0.smithi071.stderr: -273> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790530) adding con mode: secure 2024-09-14T11:35:31.260 INFO:tasks.workunit.client.0.smithi071.stderr: -272> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790530) adding con mode: crc 2024-09-14T11:35:31.260 INFO:tasks.workunit.client.0.smithi071.stderr: -271> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790530) adding con mode: secure 2024-09-14T11:35:31.260 INFO:tasks.workunit.client.0.smithi071.stderr: -270> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790530) adding con mode: crc 2024-09-14T11:35:31.260 INFO:tasks.workunit.client.0.smithi071.stderr: -269> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790530) adding con mode: crc 2024-09-14T11:35:31.260 INFO:tasks.workunit.client.0.smithi071.stderr: -268> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790530) adding con mode: secure 2024-09-14T11:35:31.260 INFO:tasks.workunit.client.0.smithi071.stderr: -267> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790530) adding con mode: crc 2024-09-14T11:35:31.260 INFO:tasks.workunit.client.0.smithi071.stderr: -266> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790530) adding con mode: secure 2024-09-14T11:35:31.260 INFO:tasks.workunit.client.0.smithi071.stderr: -265> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790530) adding con mode: crc 2024-09-14T11:35:31.260 INFO:tasks.workunit.client.0.smithi071.stderr: -264> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790530) adding con mode: secure 2024-09-14T11:35:31.260 INFO:tasks.workunit.client.0.smithi071.stderr: -263> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:31.260 INFO:tasks.workunit.client.0.smithi071.stderr: -262> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:31.260 INFO:tasks.workunit.client.0.smithi071.stderr: -261> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 asok(0x555bf4127d90) register_command rotate-key cmddesc rotate-key hook 0x7ffff8790678 EEXIST 2024-09-14T11:35:31.260 INFO:tasks.workunit.client.0.smithi071.stderr: -260> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 10 monclient: _reopen_session rank -1 2024-09-14T11:35:31.260 INFO:tasks.workunit.client.0.smithi071.stderr: -259> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:35:31.260 INFO:tasks.workunit.client.0.smithi071.stderr: -258> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 10 monclient(hunting): picked mon.noname-b con 0x555bf4405e00 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:35:31.261 INFO:tasks.workunit.client.0.smithi071.stderr: -257> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 10 monclient(hunting): picked mon.noname-c con 0x555bf43f6be0 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:35:31.261 INFO:tasks.workunit.client.0.smithi071.stderr: -256> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 10 monclient(hunting): picked mon.noname-a con 0x555bf4401220 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:35:31.261 INFO:tasks.workunit.client.0.smithi071.stderr: -255> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:31.261 INFO:tasks.workunit.client.0.smithi071.stderr: -254> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:31.261 INFO:tasks.workunit.client.0.smithi071.stderr: -253> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:31.261 INFO:tasks.workunit.client.0.smithi071.stderr: -252> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 10 monclient(hunting): _renew_subs 2024-09-14T11:35:31.261 INFO:tasks.workunit.client.0.smithi071.stderr: -251> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 10 monclient(hunting): authenticate will time out at 2542.778998s 2024-09-14T11:35:31.261 INFO:tasks.workunit.client.0.smithi071.stderr: -250> 2024-09-14T11:35:30.655+0000 7f4dbcaae640 10 monclient(hunting): get_auth_request con 0x555bf43f6be0 auth_method 0 2024-09-14T11:35:31.261 INFO:tasks.workunit.client.0.smithi071.stderr: -249> 2024-09-14T11:35:30.655+0000 7f4dbcaae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:31.261 INFO:tasks.workunit.client.0.smithi071.stderr: -248> 2024-09-14T11:35:30.655+0000 7f4dbcaae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:31.261 INFO:tasks.workunit.client.0.smithi071.stderr: -247> 2024-09-14T11:35:30.655+0000 7f4dbcaae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:31.261 INFO:tasks.workunit.client.0.smithi071.stderr: -246> 2024-09-14T11:35:30.655+0000 7f4dbc2ad640 10 monclient(hunting): get_auth_request con 0x555bf4401220 auth_method 0 2024-09-14T11:35:31.261 INFO:tasks.workunit.client.0.smithi071.stderr: -245> 2024-09-14T11:35:30.655+0000 7f4dbc2ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:31.261 INFO:tasks.workunit.client.0.smithi071.stderr: -244> 2024-09-14T11:35:30.655+0000 7f4dbc2ad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:31.262 INFO:tasks.workunit.client.0.smithi071.stderr: -243> 2024-09-14T11:35:30.655+0000 7f4dbc2ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:31.262 INFO:tasks.workunit.client.0.smithi071.stderr: -242> 2024-09-14T11:35:30.655+0000 7f4dbc2ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:31.262 INFO:tasks.workunit.client.0.smithi071.stderr: -241> 2024-09-14T11:35:30.655+0000 7f4dbc2ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:31.262 INFO:tasks.workunit.client.0.smithi071.stderr: -240> 2024-09-14T11:35:30.655+0000 7f4dbc2ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:31.262 INFO:tasks.workunit.client.0.smithi071.stderr: -239> 2024-09-14T11:35:30.655+0000 7f4dbcaae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:31.262 INFO:tasks.workunit.client.0.smithi071.stderr: -238> 2024-09-14T11:35:30.655+0000 7f4dbcaae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:31.262 INFO:tasks.workunit.client.0.smithi071.stderr: -237> 2024-09-14T11:35:30.655+0000 7f4dbcaae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:31.262 INFO:tasks.workunit.client.0.smithi071.stderr: -236> 2024-09-14T11:35:30.655+0000 7f4dbc2ad640 10 monclient(hunting): handle_auth_done global_id 8280 payload 274 2024-09-14T11:35:31.262 INFO:tasks.workunit.client.0.smithi071.stderr: -235> 2024-09-14T11:35:30.655+0000 7f4dbc2ad640 10 monclient: _finish_hunting 0 2024-09-14T11:35:31.262 INFO:tasks.workunit.client.0.smithi071.stderr: -234> 2024-09-14T11:35:30.655+0000 7f4dbc2ad640 1 monclient: found mon.noname-a 2024-09-14T11:35:31.262 INFO:tasks.workunit.client.0.smithi071.stderr: -233> 2024-09-14T11:35:30.655+0000 7f4dbc2ad640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.71:3300/0 2024-09-14T11:35:31.262 INFO:tasks.workunit.client.0.smithi071.stderr: -232> 2024-09-14T11:35:30.655+0000 7f4c937fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:31.262 INFO:tasks.workunit.client.0.smithi071.stderr: -231> 2024-09-14T11:35:30.655+0000 7f4c937fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:31.262 INFO:tasks.workunit.client.0.smithi071.stderr: -230> 2024-09-14T11:35:30.655+0000 7f4c937fe640 10 monclient: dump: 2024-09-14T11:35:31.262 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:31.262 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:31.263 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.263 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.263 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:31.263 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:31.263 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:31.263 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:31.263 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:31.263 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.263 INFO:tasks.workunit.client.0.smithi071.stderr: -229> 2024-09-14T11:35:30.655+0000 7f4c937fe640 10 monclient: _finish_auth 0 2024-09-14T11:35:31.263 INFO:tasks.workunit.client.0.smithi071.stderr: -228> 2024-09-14T11:35:30.655+0000 7f4c937fe640 10 monclient: _check_auth_tickets 2024-09-14T11:35:31.263 INFO:tasks.workunit.client.0.smithi071.stderr: -227> 2024-09-14T11:35:30.655+0000 7f4c937fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:31.263 INFO:tasks.workunit.client.0.smithi071.stderr: -226> 2024-09-14T11:35:30.655+0000 7f4c937fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:31.263 INFO:tasks.workunit.client.0.smithi071.stderr: -225> 2024-09-14T11:35:30.655+0000 7f4c937fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:31.263 INFO:tasks.workunit.client.0.smithi071.stderr: -224> 2024-09-14T11:35:30.655+0000 7f4c937fe640 10 monclient: dump: 2024-09-14T11:35:31.264 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:31.264 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:31.264 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.264 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.264 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:31.264 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:31.264 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:31.264 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:31.264 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:31.264 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.264 INFO:tasks.workunit.client.0.smithi071.stderr: -223> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 5 monclient: authenticate success, global_id 8280 2024-09-14T11:35:31.264 INFO:tasks.workunit.client.0.smithi071.stderr: -222> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 10 monclient: get_monmap_and_config success 2024-09-14T11:35:31.264 INFO:tasks.workunit.client.0.smithi071.stderr: -221> 2024-09-14T11:35:30.655+0000 7f4dbe7a79c0 4 set_mon_vals no callback set 2024-09-14T11:35:31.264 INFO:tasks.workunit.client.0.smithi071.stderr: -220> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 10 monclient: shutdown 2024-09-14T11:35:31.264 INFO:tasks.workunit.client.0.smithi071.stderr: -219> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 10 monclient: build_initial_monmap 2024-09-14T11:35:31.264 INFO:tasks.workunit.client.0.smithi071.stderr: -218> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 1 build_initial for_mkfs: 0 2024-09-14T11:35:31.265 INFO:tasks.workunit.client.0.smithi071.stderr: -217> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 10 monclient: monmap: 2024-09-14T11:35:31.265 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 0 2024-09-14T11:35:31.265 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:31.265 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 0.000000 2024-09-14T11:35:31.265 INFO:tasks.workunit.client.0.smithi071.stderr:created 0.000000 2024-09-14T11:35:31.265 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:31.265 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:31.265 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.noname-a 2024-09-14T11:35:31.265 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.noname-b 2024-09-14T11:35:31.265 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.noname-c 2024-09-14T11:35:31.265 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.265 INFO:tasks.workunit.client.0.smithi071.stderr: -216> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1910) adding auth protocol: cephx 2024-09-14T11:35:31.265 INFO:tasks.workunit.client.0.smithi071.stderr: -215> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1910) adding auth protocol: cephx 2024-09-14T11:35:31.265 INFO:tasks.workunit.client.0.smithi071.stderr: -214> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1910) adding auth protocol: cephx 2024-09-14T11:35:31.265 INFO:tasks.workunit.client.0.smithi071.stderr: -213> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1910) adding con mode: secure 2024-09-14T11:35:31.266 INFO:tasks.workunit.client.0.smithi071.stderr: -212> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1910) adding con mode: crc 2024-09-14T11:35:31.266 INFO:tasks.workunit.client.0.smithi071.stderr: -211> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1910) adding con mode: secure 2024-09-14T11:35:31.266 INFO:tasks.workunit.client.0.smithi071.stderr: -210> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1910) adding con mode: crc 2024-09-14T11:35:31.266 INFO:tasks.workunit.client.0.smithi071.stderr: -209> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1910) adding con mode: secure 2024-09-14T11:35:31.266 INFO:tasks.workunit.client.0.smithi071.stderr: -208> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1910) adding con mode: crc 2024-09-14T11:35:31.266 INFO:tasks.workunit.client.0.smithi071.stderr: -207> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1910) adding con mode: crc 2024-09-14T11:35:31.266 INFO:tasks.workunit.client.0.smithi071.stderr: -206> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1910) adding con mode: secure 2024-09-14T11:35:31.266 INFO:tasks.workunit.client.0.smithi071.stderr: -205> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1910) adding con mode: crc 2024-09-14T11:35:31.266 INFO:tasks.workunit.client.0.smithi071.stderr: -204> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1910) adding con mode: secure 2024-09-14T11:35:31.266 INFO:tasks.workunit.client.0.smithi071.stderr: -203> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1910) adding con mode: crc 2024-09-14T11:35:31.266 INFO:tasks.workunit.client.0.smithi071.stderr: -202> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43d1910) adding con mode: secure 2024-09-14T11:35:31.266 INFO:tasks.workunit.client.0.smithi071.stderr: -201> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:31.266 INFO:tasks.workunit.client.0.smithi071.stderr: -200> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 1 librados: starting msgr at 2024-09-14T11:35:31.266 INFO:tasks.workunit.client.0.smithi071.stderr: -199> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 1 librados: starting objecter 2024-09-14T11:35:31.267 INFO:tasks.workunit.client.0.smithi071.stderr: -198> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 asok(0x555bf4127d90) register_command objecter_requests cmddesc objecter_requests hook 0x555bf43f7560 EEXIST 2024-09-14T11:35:31.267 INFO:tasks.workunit.client.0.smithi071.stderr: -197> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 1 librados: setting wanted keys 2024-09-14T11:35:31.267 INFO:tasks.workunit.client.0.smithi071.stderr: -196> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 1 librados: calling monclient init 2024-09-14T11:35:31.267 INFO:tasks.workunit.client.0.smithi071.stderr: -195> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 10 monclient: init 2024-09-14T11:35:31.267 INFO:tasks.workunit.client.0.smithi071.stderr: -194> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43b3de0) adding auth protocol: cephx 2024-09-14T11:35:31.267 INFO:tasks.workunit.client.0.smithi071.stderr: -193> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43b3de0) adding auth protocol: cephx 2024-09-14T11:35:31.267 INFO:tasks.workunit.client.0.smithi071.stderr: -192> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43b3de0) adding auth protocol: cephx 2024-09-14T11:35:31.267 INFO:tasks.workunit.client.0.smithi071.stderr: -191> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43b3de0) adding con mode: secure 2024-09-14T11:35:31.267 INFO:tasks.workunit.client.0.smithi071.stderr: -190> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43b3de0) adding con mode: crc 2024-09-14T11:35:31.267 INFO:tasks.workunit.client.0.smithi071.stderr: -189> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43b3de0) adding con mode: secure 2024-09-14T11:35:31.267 INFO:tasks.workunit.client.0.smithi071.stderr: -188> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43b3de0) adding con mode: crc 2024-09-14T11:35:31.267 INFO:tasks.workunit.client.0.smithi071.stderr: -187> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43b3de0) adding con mode: secure 2024-09-14T11:35:31.267 INFO:tasks.workunit.client.0.smithi071.stderr: -186> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43b3de0) adding con mode: crc 2024-09-14T11:35:31.267 INFO:tasks.workunit.client.0.smithi071.stderr: -185> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43b3de0) adding con mode: crc 2024-09-14T11:35:31.267 INFO:tasks.workunit.client.0.smithi071.stderr: -184> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43b3de0) adding con mode: secure 2024-09-14T11:35:31.268 INFO:tasks.workunit.client.0.smithi071.stderr: -183> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43b3de0) adding con mode: crc 2024-09-14T11:35:31.268 INFO:tasks.workunit.client.0.smithi071.stderr: -182> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43b3de0) adding con mode: secure 2024-09-14T11:35:31.268 INFO:tasks.workunit.client.0.smithi071.stderr: -181> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43b3de0) adding con mode: crc 2024-09-14T11:35:31.268 INFO:tasks.workunit.client.0.smithi071.stderr: -180> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 AuthRegistry(0x555bf43b3de0) adding con mode: secure 2024-09-14T11:35:31.268 INFO:tasks.workunit.client.0.smithi071.stderr: -179> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:31.268 INFO:tasks.workunit.client.0.smithi071.stderr: -178> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:31.268 INFO:tasks.workunit.client.0.smithi071.stderr: -177> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 asok(0x555bf4127d90) register_command rotate-key cmddesc rotate-key hook 0x555bf43b3f28 EEXIST 2024-09-14T11:35:31.268 INFO:tasks.workunit.client.0.smithi071.stderr: -176> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 10 monclient: _reopen_session rank -1 2024-09-14T11:35:31.268 INFO:tasks.workunit.client.0.smithi071.stderr: -175> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:35:31.268 INFO:tasks.workunit.client.0.smithi071.stderr: -174> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 10 monclient(hunting): picked mon.noname-a con 0x555bf43f6be0 addr [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-14T11:35:31.268 INFO:tasks.workunit.client.0.smithi071.stderr: -173> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 10 monclient(hunting): picked mon.noname-b con 0x555bf4401220 addr [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-09-14T11:35:31.268 INFO:tasks.workunit.client.0.smithi071.stderr: -172> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 10 monclient(hunting): picked mon.noname-c con 0x555bf4405e00 addr [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] 2024-09-14T11:35:31.268 INFO:tasks.workunit.client.0.smithi071.stderr: -171> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:31.268 INFO:tasks.workunit.client.0.smithi071.stderr: -170> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:31.269 INFO:tasks.workunit.client.0.smithi071.stderr: -169> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:31.269 INFO:tasks.workunit.client.0.smithi071.stderr: -168> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 10 monclient(hunting): _renew_subs 2024-09-14T11:35:31.269 INFO:tasks.workunit.client.0.smithi071.stderr: -167> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 10 monclient(hunting): authenticate will time out at 2542.781587s 2024-09-14T11:35:31.269 INFO:tasks.workunit.client.0.smithi071.stderr: -166> 2024-09-14T11:35:30.659+0000 7f4dbc2ad640 10 monclient(hunting): get_auth_request con 0x555bf4405e00 auth_method 0 2024-09-14T11:35:31.269 INFO:tasks.workunit.client.0.smithi071.stderr: -165> 2024-09-14T11:35:30.659+0000 7f4dbc2ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:31.269 INFO:tasks.workunit.client.0.smithi071.stderr: -164> 2024-09-14T11:35:30.659+0000 7f4dbc2ad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:31.269 INFO:tasks.workunit.client.0.smithi071.stderr: -163> 2024-09-14T11:35:30.659+0000 7f4dbc2ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:31.269 INFO:tasks.workunit.client.0.smithi071.stderr: -162> 2024-09-14T11:35:30.659+0000 7f4db3aac640 10 monclient(hunting): get_auth_request con 0x555bf43f6be0 auth_method 0 2024-09-14T11:35:31.269 INFO:tasks.workunit.client.0.smithi071.stderr: -161> 2024-09-14T11:35:30.659+0000 7f4db3aac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:31.269 INFO:tasks.workunit.client.0.smithi071.stderr: -160> 2024-09-14T11:35:30.659+0000 7f4db3aac640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:31.269 INFO:tasks.workunit.client.0.smithi071.stderr: -159> 2024-09-14T11:35:30.659+0000 7f4db3aac640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:31.269 INFO:tasks.workunit.client.0.smithi071.stderr: -158> 2024-09-14T11:35:30.659+0000 7f4dbc2ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:31.269 INFO:tasks.workunit.client.0.smithi071.stderr: -157> 2024-09-14T11:35:30.659+0000 7f4dbc2ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:31.269 INFO:tasks.workunit.client.0.smithi071.stderr: -156> 2024-09-14T11:35:30.659+0000 7f4dbc2ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:31.269 INFO:tasks.workunit.client.0.smithi071.stderr: -155> 2024-09-14T11:35:30.659+0000 7f4db3aac640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:31.270 INFO:tasks.workunit.client.0.smithi071.stderr: -154> 2024-09-14T11:35:30.659+0000 7f4db3aac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:31.270 INFO:tasks.workunit.client.0.smithi071.stderr: -153> 2024-09-14T11:35:30.659+0000 7f4db3aac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:31.270 INFO:tasks.workunit.client.0.smithi071.stderr: -152> 2024-09-14T11:35:30.659+0000 7f4dbcaae640 10 monclient(hunting): get_auth_request con 0x555bf4401220 auth_method 0 2024-09-14T11:35:31.270 INFO:tasks.workunit.client.0.smithi071.stderr: -151> 2024-09-14T11:35:30.659+0000 7f4dbcaae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:31.270 INFO:tasks.workunit.client.0.smithi071.stderr: -150> 2024-09-14T11:35:30.659+0000 7f4dbcaae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:31.270 INFO:tasks.workunit.client.0.smithi071.stderr: -149> 2024-09-14T11:35:30.659+0000 7f4dbcaae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:31.270 INFO:tasks.workunit.client.0.smithi071.stderr: -148> 2024-09-14T11:35:30.659+0000 7f4dbc2ad640 10 monclient(hunting): handle_auth_done global_id 7862 payload 824 2024-09-14T11:35:31.270 INFO:tasks.workunit.client.0.smithi071.stderr: -147> 2024-09-14T11:35:30.659+0000 7f4dbc2ad640 10 monclient: _finish_hunting 0 2024-09-14T11:35:31.270 INFO:tasks.workunit.client.0.smithi071.stderr: -146> 2024-09-14T11:35:30.659+0000 7f4dbc2ad640 1 monclient: found mon.noname-c 2024-09-14T11:35:31.270 INFO:tasks.workunit.client.0.smithi071.stderr: -145> 2024-09-14T11:35:30.659+0000 7f4dbc2ad640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.71:3301/0 2024-09-14T11:35:31.270 INFO:tasks.workunit.client.0.smithi071.stderr: -144> 2024-09-14T11:35:30.659+0000 7f4c91ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:31.270 INFO:tasks.workunit.client.0.smithi071.stderr: -143> 2024-09-14T11:35:30.659+0000 7f4c91ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:31.270 INFO:tasks.workunit.client.0.smithi071.stderr: -142> 2024-09-14T11:35:30.659+0000 7f4c91ffb640 10 monclient: dump: 2024-09-14T11:35:31.270 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:31.270 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:31.271 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.271 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.271 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:31.271 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:31.271 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:31.271 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:31.271 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:31.271 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.271 INFO:tasks.workunit.client.0.smithi071.stderr: -141> 2024-09-14T11:35:30.659+0000 7f4c91ffb640 10 monclient: _finish_auth 0 2024-09-14T11:35:31.271 INFO:tasks.workunit.client.0.smithi071.stderr: -140> 2024-09-14T11:35:30.659+0000 7f4c91ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:35:31.271 INFO:tasks.workunit.client.0.smithi071.stderr: -139> 2024-09-14T11:35:30.659+0000 7f4c91ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:31.271 INFO:tasks.workunit.client.0.smithi071.stderr: -138> 2024-09-14T11:35:30.659+0000 7f4c91ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:31.271 INFO:tasks.workunit.client.0.smithi071.stderr: -137> 2024-09-14T11:35:30.659+0000 7f4c91ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:31.271 INFO:tasks.workunit.client.0.smithi071.stderr: -136> 2024-09-14T11:35:30.659+0000 7f4c91ffb640 10 monclient: dump: 2024-09-14T11:35:31.271 INFO:tasks.workunit.client.0.smithi071.stderr:epoch 1 2024-09-14T11:35:31.272 INFO:tasks.workunit.client.0.smithi071.stderr:fsid 26f8926f-0d5e-4c48-adc1-d4f1601407fa 2024-09-14T11:35:31.272 INFO:tasks.workunit.client.0.smithi071.stderr:last_changed 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.272 INFO:tasks.workunit.client.0.smithi071.stderr:created 2024-09-14T11:08:42.901215+0000 2024-09-14T11:35:31.272 INFO:tasks.workunit.client.0.smithi071.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:31.272 INFO:tasks.workunit.client.0.smithi071.stderr:election_strategy: 1 2024-09-14T11:35:31.272 INFO:tasks.workunit.client.0.smithi071.stderr:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-09-14T11:35:31.272 INFO:tasks.workunit.client.0.smithi071.stderr:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-09-14T11:35:31.272 INFO:tasks.workunit.client.0.smithi071.stderr:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-14T11:35:31.272 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.272 INFO:tasks.workunit.client.0.smithi071.stderr: -135> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 monclient: authenticate success, global_id 7862 2024-09-14T11:35:31.272 INFO:tasks.workunit.client.0.smithi071.stderr: -134> 2024-09-14T11:35:30.659+0000 7f4c937fe640 4 set_mon_vals no callback set 2024-09-14T11:35:31.272 INFO:tasks.workunit.client.0.smithi071.stderr: -133> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 10 monclient: _renew_subs 2024-09-14T11:35:31.272 INFO:tasks.workunit.client.0.smithi071.stderr: -132> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:35:31.272 INFO:tasks.workunit.client.0.smithi071.stderr: -131> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 10 monclient: _renew_subs 2024-09-14T11:35:31.273 INFO:tasks.workunit.client.0.smithi071.stderr: -130> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:35:31.273 INFO:tasks.workunit.client.0.smithi071.stderr: -129> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 1 librados: init done 2024-09-14T11:35:31.273 INFO:tasks.workunit.client.0.smithi071.stderr: -128> 2024-09-14T11:35:30.659+0000 7f4dbe7a79c0 5 asok(0x555bf4127d90) register_command cr dump hook 0x7f4dac0f8cf8 2024-09-14T11:35:31.273 INFO:tasks.workunit.client.0.smithi071.stderr: -127> 2024-09-14T11:35:30.663+0000 7f4c91ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:31.273 INFO:tasks.workunit.client.0.smithi071.stderr: -126> 2024-09-14T11:35:30.663+0000 7f4c91ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:35:31.273 INFO:tasks.workunit.client.0.smithi071.stderr: -125> 2024-09-14T11:35:30.663+0000 7f4c91ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.71:6832/1492027983,v1:172.21.15.71:6833/1492027983] 2024-09-14T11:35:31.273 INFO:tasks.workunit.client.0.smithi071.stderr: -124> 2024-09-14T11:35:30.663+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.273 INFO:tasks.workunit.client.0.smithi071.stderr: -123> 2024-09-14T11:35:30.663+0000 7f4db3aac640 10 monclient: get_auth_request con 0x7f4c840718d0 auth_method 0 2024-09-14T11:35:31.273 INFO:tasks.workunit.client.0.smithi071.stderr: -122> 2024-09-14T11:35:30.663+0000 7f4dbcaae640 10 monclient: get_auth_request con 0x555bf441eff0 auth_method 0 2024-09-14T11:35:31.273 INFO:tasks.workunit.client.0.smithi071.stderr: -121> 2024-09-14T11:35:30.663+0000 7f4dbe7a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.273 INFO:tasks.workunit.client.0.smithi071.stderr: -120> 2024-09-14T11:35:30.663+0000 7f4dbe7a79c0 20 realm 2024-09-14T11:35:31.273 INFO:tasks.workunit.client.0.smithi071.stderr: -119> 2024-09-14T11:35:30.663+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.273 INFO:tasks.workunit.client.0.smithi071.stderr: -118> 2024-09-14T11:35:30.663+0000 7f4dbe7a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.273 INFO:tasks.workunit.client.0.smithi071.stderr: -117> 2024-09-14T11:35:30.663+0000 7f4dbe7a79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:31.273 INFO:tasks.workunit.client.0.smithi071.stderr: -116> 2024-09-14T11:35:30.663+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.274 INFO:tasks.workunit.client.0.smithi071.stderr: -115> 2024-09-14T11:35:30.663+0000 7f4dbe7a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.274 INFO:tasks.workunit.client.0.smithi071.stderr: -114> 2024-09-14T11:35:30.663+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.274 INFO:tasks.workunit.client.0.smithi071.stderr: -113> 2024-09-14T11:35:30.663+0000 7f4db3aac640 10 monclient: get_auth_request con 0x555bf4423250 auth_method 0 2024-09-14T11:35:31.274 INFO:tasks.workunit.client.0.smithi071.stderr: -112> 2024-09-14T11:35:30.667+0000 7f4dbe7a79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:31.274 INFO:tasks.workunit.client.0.smithi071.stderr: -111> 2024-09-14T11:35:30.667+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.274 INFO:tasks.workunit.client.0.smithi071.stderr: -110> 2024-09-14T11:35:30.667+0000 7f4dbcaae640 10 monclient: get_auth_request con 0x555bf4426ab0 auth_method 0 2024-09-14T11:35:31.274 INFO:tasks.workunit.client.0.smithi071.stderr: -109> 2024-09-14T11:35:30.667+0000 7f4dbe7a79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:31.274 INFO:tasks.workunit.client.0.smithi071.stderr: -108> 2024-09-14T11:35:30.667+0000 7f4dbe7a79c0 20 searching for the correct realm 2024-09-14T11:35:31.274 INFO:tasks.workunit.client.0.smithi071.stderr: -107> 2024-09-14T11:35:30.667+0000 7f4dbc2ad640 10 monclient: get_auth_request con 0x555bf442b7e0 auth_method 0 2024-09-14T11:35:31.274 INFO:tasks.workunit.client.0.smithi071.stderr: -106> 2024-09-14T11:35:30.871+0000 7f4dbc2ad640 10 monclient: get_auth_request con 0x555bf442b7e0 auth_method 0 2024-09-14T11:35:31.274 INFO:tasks.workunit.client.0.smithi071.stderr: -105> 2024-09-14T11:35:30.871+0000 7f4db3aac640 10 monclient: get_auth_request con 0x7f4dac0c1070 auth_method 0 2024-09-14T11:35:31.274 INFO:tasks.workunit.client.0.smithi071.stderr: -104> 2024-09-14T11:35:30.871+0000 7f4dbcaae640 0 -- 172.21.15.71:0/2540549110 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f4da4008040 msgr2=0x7f4da4063cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:31.274 INFO:tasks.workunit.client.0.smithi071.stderr: -103> 2024-09-14T11:35:30.871+0000 7f4dbcaae640 10 monclient: get_auth_request con 0x7f4da4008040 auth_method 0 2024-09-14T11:35:31.274 INFO:tasks.workunit.client.0.smithi071.stderr: -102> 2024-09-14T11:35:31.075+0000 7f4dbcaae640 10 monclient: get_auth_request con 0x7f4da4008040 auth_method 0 2024-09-14T11:35:31.274 INFO:tasks.workunit.client.0.smithi071.stderr: -101> 2024-09-14T11:35:31.079+0000 7f4dbc2ad640 10 monclient: get_auth_request con 0x7f4dac112cd0 auth_method 0 2024-09-14T11:35:31.274 INFO:tasks.workunit.client.0.smithi071.stderr: -100> 2024-09-14T11:35:31.083+0000 7f4db3aac640 10 monclient: get_auth_request con 0x7f4da406abb0 auth_method 0 2024-09-14T11:35:31.275 INFO:tasks.workunit.client.0.smithi071.stderr: -99> 2024-09-14T11:35:31.083+0000 7f4dbcaae640 0 -- 172.21.15.71:0/2540549110 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x555bf4426ab0 msgr2=0x555bf4428ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:31.275 INFO:tasks.workunit.client.0.smithi071.stderr: -98> 2024-09-14T11:35:31.087+0000 7f4c91ffb640 1 client.7862.objecter ms_handle_reset 0x555bf4426ab0 session 0x555bf44225e0 osd.3 2024-09-14T11:35:31.275 INFO:tasks.workunit.client.0.smithi071.stderr: -97> 2024-09-14T11:35:31.087+0000 7f4c91ffb640 10 monclient: _renew_subs 2024-09-14T11:35:31.275 INFO:tasks.workunit.client.0.smithi071.stderr: -96> 2024-09-14T11:35:31.087+0000 7f4c91ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.71:3301/0 2024-09-14T11:35:31.275 INFO:tasks.workunit.client.0.smithi071.stderr: -95> 2024-09-14T11:35:31.087+0000 7f4dbcaae640 10 monclient: get_auth_request con 0x7f4c840813f0 auth_method 0 2024-09-14T11:35:31.275 INFO:tasks.workunit.client.0.smithi071.stderr: -94> 2024-09-14T11:35:31.099+0000 7f4dbe7a79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:31.275 INFO:tasks.workunit.client.0.smithi071.stderr: -93> 2024-09-14T11:35:31.099+0000 7f4dbe7a79c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:35:31.275 INFO:tasks.workunit.client.0.smithi071.stderr: -92> 2024-09-14T11:35:31.099+0000 7f4dbe7a79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:31.275 INFO:tasks.workunit.client.0.smithi071.stderr: -91> 2024-09-14T11:35:31.099+0000 7f4dbe7a79c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:35:31.275 INFO:tasks.workunit.client.0.smithi071.stderr: -90> 2024-09-14T11:35:31.099+0000 7f4dbe7a79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:31.275 INFO:tasks.workunit.client.0.smithi071.stderr: -89> 2024-09-14T11:35:31.099+0000 7f4dbe7a79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:31.275 INFO:tasks.workunit.client.0.smithi071.stderr: -88> 2024-09-14T11:35:31.099+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.275 INFO:tasks.workunit.client.0.smithi071.stderr: -87> 2024-09-14T11:35:31.099+0000 7f4dbe7a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.275 INFO:tasks.workunit.client.0.smithi071.stderr: -86> 2024-09-14T11:35:31.099+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.275 INFO:tasks.workunit.client.0.smithi071.stderr: -85> 2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:31.276 INFO:tasks.workunit.client.0.smithi071.stderr: -84> 2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.276 INFO:tasks.workunit.client.0.smithi071.stderr: -83> 2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:31.276 INFO:tasks.workunit.client.0.smithi071.stderr: -82> 2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 zone default found 2024-09-14T11:35:31.276 INFO:tasks.workunit.client.0.smithi071.stderr: -81> 2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 4 Realm: () 2024-09-14T11:35:31.276 INFO:tasks.workunit.client.0.smithi071.stderr: -80> 2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:35:31.276 INFO:tasks.workunit.client.0.smithi071.stderr: -79> 2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:35:31.276 INFO:tasks.workunit.client.0.smithi071.stderr: -78> 2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:31.276 INFO:tasks.workunit.client.0.smithi071.stderr: -77> 2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 zonegroup default 2024-09-14T11:35:31.276 INFO:tasks.workunit.client.0.smithi071.stderr: -76> 2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.276 INFO:tasks.workunit.client.0.smithi071.stderr: -75> 2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.276 INFO:tasks.workunit.client.0.smithi071.stderr: -74> 2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.276 INFO:tasks.workunit.client.0.smithi071.stderr: -73> 2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.276 INFO:tasks.workunit.client.0.smithi071.stderr: -72> 2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.277 INFO:tasks.workunit.client.0.smithi071.stderr: -71> 2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.277 INFO:tasks.workunit.client.0.smithi071.stderr: -70> 2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 started sync module instance, tier type = 2024-09-14T11:35:31.277 INFO:tasks.workunit.client.0.smithi071.stderr: -69> 2024-09-14T11:35:31.103+0000 7f4dbe7a79c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:35:31.277 INFO:tasks.workunit.client.0.smithi071.stderr: -68> 2024-09-14T11:35:31.127+0000 7f4dbe7a79c0 20 add_watcher() i=0 2024-09-14T11:35:31.277 INFO:tasks.workunit.client.0.smithi071.stderr: -67> 2024-09-14T11:35:31.127+0000 7f4dbe7a79c0 20 add_watcher() i=1 2024-09-14T11:35:31.277 INFO:tasks.workunit.client.0.smithi071.stderr: -66> 2024-09-14T11:35:31.127+0000 7f4dbe7a79c0 20 add_watcher() i=2 2024-09-14T11:35:31.277 INFO:tasks.workunit.client.0.smithi071.stderr: -65> 2024-09-14T11:35:31.127+0000 7f4dbe7a79c0 20 add_watcher() i=3 2024-09-14T11:35:31.277 INFO:tasks.workunit.client.0.smithi071.stderr: -64> 2024-09-14T11:35:31.127+0000 7f4dbe7a79c0 20 add_watcher() i=4 2024-09-14T11:35:31.277 INFO:tasks.workunit.client.0.smithi071.stderr: -63> 2024-09-14T11:35:31.127+0000 7f4dbe7a79c0 20 add_watcher() i=5 2024-09-14T11:35:31.277 INFO:tasks.workunit.client.0.smithi071.stderr: -62> 2024-09-14T11:35:31.127+0000 7f4dbe7a79c0 20 add_watcher() i=6 2024-09-14T11:35:31.277 INFO:tasks.workunit.client.0.smithi071.stderr: -61> 2024-09-14T11:35:31.127+0000 7f4dbe7a79c0 20 add_watcher() i=7 2024-09-14T11:35:31.277 INFO:tasks.workunit.client.0.smithi071.stderr: -60> 2024-09-14T11:35:31.127+0000 7f4dbe7a79c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:31.277 INFO:tasks.workunit.client.0.smithi071.stderr: -59> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790a10) adding auth protocol: cephx 2024-09-14T11:35:31.277 INFO:tasks.workunit.client.0.smithi071.stderr: -58> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790a10) adding auth protocol: cephx 2024-09-14T11:35:31.277 INFO:tasks.workunit.client.0.smithi071.stderr: -57> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790a10) adding auth protocol: cephx 2024-09-14T11:35:31.277 INFO:tasks.workunit.client.0.smithi071.stderr: -56> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790a10) adding con mode: secure 2024-09-14T11:35:31.278 INFO:tasks.workunit.client.0.smithi071.stderr: -55> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790a10) adding con mode: crc 2024-09-14T11:35:31.278 INFO:tasks.workunit.client.0.smithi071.stderr: -54> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790a10) adding con mode: secure 2024-09-14T11:35:31.278 INFO:tasks.workunit.client.0.smithi071.stderr: -53> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790a10) adding con mode: crc 2024-09-14T11:35:31.278 INFO:tasks.workunit.client.0.smithi071.stderr: -52> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790a10) adding con mode: secure 2024-09-14T11:35:31.278 INFO:tasks.workunit.client.0.smithi071.stderr: -51> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790a10) adding con mode: crc 2024-09-14T11:35:31.278 INFO:tasks.workunit.client.0.smithi071.stderr: -50> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790a10) adding con mode: crc 2024-09-14T11:35:31.278 INFO:tasks.workunit.client.0.smithi071.stderr: -49> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790a10) adding con mode: secure 2024-09-14T11:35:31.278 INFO:tasks.workunit.client.0.smithi071.stderr: -48> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790a10) adding con mode: crc 2024-09-14T11:35:31.278 INFO:tasks.workunit.client.0.smithi071.stderr: -47> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790a10) adding con mode: secure 2024-09-14T11:35:31.278 INFO:tasks.workunit.client.0.smithi071.stderr: -46> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790a10) adding con mode: crc 2024-09-14T11:35:31.278 INFO:tasks.workunit.client.0.smithi071.stderr: -45> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 AuthRegistry(0x7ffff8790a10) adding con mode: secure 2024-09-14T11:35:31.278 INFO:tasks.workunit.client.0.smithi071.stderr: -44> 2024-09-14T11:35:31.131+0000 7f4c72fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:31.278 INFO:tasks.workunit.client.0.smithi071.stderr: -43> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:31.278 INFO:tasks.workunit.client.0.smithi071.stderr: -42> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:31.279 INFO:tasks.workunit.client.0.smithi071.stderr: -41> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:31.279 INFO:tasks.workunit.client.0.smithi071.stderr: -40> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 asok(0x555bf4127d90) register_command cache list hook 0x555bf43d3400 2024-09-14T11:35:31.279 INFO:tasks.workunit.client.0.smithi071.stderr: -39> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 asok(0x555bf4127d90) register_command cache inspect hook 0x555bf43d3400 2024-09-14T11:35:31.279 INFO:tasks.workunit.client.0.smithi071.stderr: -38> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 asok(0x555bf4127d90) register_command cache erase hook 0x555bf43d3400 2024-09-14T11:35:31.279 INFO:tasks.workunit.client.0.smithi071.stderr: -37> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 asok(0x555bf4127d90) register_command cache zap hook 0x555bf43d3400 2024-09-14T11:35:31.279 INFO:tasks.workunit.client.0.smithi071.stderr: -36> 2024-09-14T11:35:31.131+0000 7f4dbe7a79c0 5 note: GC not initialized 2024-09-14T11:35:31.279 INFO:tasks.workunit.client.0.smithi071.stderr: -35> 2024-09-14T11:35:31.131+0000 7f4c71fdb640 20 reqs_thread_entry: start 2024-09-14T11:35:31.279 INFO:tasks.workunit.client.0.smithi071.stderr: -34> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 5 asok(0x555bf4127d90) register_command sync trace show hook 0x7f4da4004830 2024-09-14T11:35:31.279 INFO:tasks.workunit.client.0.smithi071.stderr: -33> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 5 asok(0x555bf4127d90) register_command sync trace history hook 0x7f4da4004830 2024-09-14T11:35:31.279 INFO:tasks.workunit.client.0.smithi071.stderr: -32> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 5 asok(0x555bf4127d90) register_command sync trace active hook 0x7f4da4004830 2024-09-14T11:35:31.279 INFO:tasks.workunit.client.0.smithi071.stderr: -31> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 5 asok(0x555bf4127d90) register_command sync trace active_short hook 0x7f4da4004830 2024-09-14T11:35:31.279 INFO:tasks.workunit.client.0.smithi071.stderr: -30> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 20 init_complete bucket index max shards: 11 2024-09-14T11:35:31.279 INFO:tasks.workunit.client.0.smithi071.stderr: -29> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 20 Filter name: none 2024-09-14T11:35:31.279 INFO:tasks.workunit.client.0.smithi071.stderr: -28> 2024-09-14T11:35:31.135+0000 7f4be37fe640 20 reqs_thread_entry: start 2024-09-14T11:35:31.279 INFO:tasks.workunit.client.0.smithi071.stderr: -27> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:35:31.280 INFO:tasks.workunit.client.0.smithi071.stderr: -26> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.280 INFO:tasks.workunit.client.0.smithi071.stderr: -25> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:35:31.280 INFO:tasks.workunit.client.0.smithi071.stderr: -24> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:35:31.280 INFO:tasks.workunit.client.0.smithi071.stderr: -23> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:35:31.280 INFO:tasks.workunit.client.0.smithi071.stderr: -22> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 : miss 2024-09-14T11:35:31.280 INFO:tasks.workunit.client.0.smithi071.stderr: -21> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.280 INFO:tasks.workunit.client.0.smithi071.stderr: -20> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:35:31.280 INFO:tasks.workunit.client.0.smithi071.stderr: -19> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:35:31.280 INFO:tasks.workunit.client.0.smithi071.stderr: -18> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:35:31.280 INFO:tasks.workunit.client.0.smithi071.stderr: -17> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:31.280 INFO:tasks.workunit.client.0.smithi071.stderr: -16> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:31.280 INFO:tasks.workunit.client.0.smithi071.stderr: -15> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 2024-09-14T11:35:31.280 INFO:tasks.workunit.client.0.smithi071.stderr: -14> 2024-09-14T11:35:31.135+0000 7f4dbe7a79c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:35:31.280 INFO:tasks.workunit.client.0.smithi071.stderr: -13> 2024-09-14T11:35:31.151+0000 7f4dbe7a79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:35:31.281 INFO:tasks.workunit.client.0.smithi071.stderr: -12> 2024-09-14T11:35:31.151+0000 7f4dbe7a79c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:35:31.281 INFO:tasks.workunit.client.0.smithi071.stderr: -11> 2024-09-14T11:35:31.151+0000 7f4dbe7a79c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:31.281 INFO:tasks.workunit.client.0.smithi071.stderr: -10> 2024-09-14T11:35:31.151+0000 7f4dbe7a79c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18, ofs0, ns] 2024-09-14T11:35:31.281 INFO:tasks.workunit.client.0.smithi071.stderr: -9> 2024-09-14T11:35:31.151+0000 7f4c937fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464428 cookie 93853428382176 notifier 7862 bl.length()=911 2024-09-14T11:35:31.281 INFO:tasks.workunit.client.0.smithi071.stderr: -8> 2024-09-14T11:35:31.151+0000 7f4c937fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:35:31.281 INFO:tasks.workunit.client.0.smithi071.stderr: -7> 2024-09-14T11:35:31.151+0000 7f4c937fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:35:31.281 INFO:tasks.workunit.client.0.smithi071.stderr: -6> 2024-09-14T11:35:31.151+0000 7f4c937fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:31.281 INFO:tasks.workunit.client.0.smithi071.stderr: -5> 2024-09-14T11:35:31.151+0000 7f4dbe7a79c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_sources= new_sources= 2024-09-14T11:35:31.281 INFO:tasks.workunit.client.0.smithi071.stderr: -4> 2024-09-14T11:35:31.151+0000 7f4dbe7a79c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential sources added=[] removed=[] 2024-09-14T11:35:31.281 INFO:tasks.workunit.client.0.smithi071.stderr: -3> 2024-09-14T11:35:31.151+0000 7f4dbe7a79c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_dests= new_dests= 2024-09-14T11:35:31.281 INFO:tasks.workunit.client.0.smithi071.stderr: -2> 2024-09-14T11:35:31.151+0000 7f4dbe7a79c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential dests added=[] removed=[] 2024-09-14T11:35:31.281 INFO:tasks.workunit.client.0.smithi071.stderr: -1> 2024-09-14T11:35:31.163+0000 7f4dbe7a79c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4dbe7a79c0 time 2024-09-14T11:35:31.166804+0000 2024-09-14T11:35:31.281 INFO:tasks.workunit.client.0.smithi071.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:31.282 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.282 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:31.282 INFO:tasks.workunit.client.0.smithi071.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f4dc20812eb] 2024-09-14T11:35:31.282 INFO:tasks.workunit.client.0.smithi071.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4dc208149f] 2024-09-14T11:35:31.282 INFO:tasks.workunit.client.0.smithi071.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555bf230dc01] 2024-09-14T11:35:31.282 INFO:tasks.workunit.client.0.smithi071.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x555bf2322f3a] 2024-09-14T11:35:31.282 INFO:tasks.workunit.client.0.smithi071.stderr: 5: main() 2024-09-14T11:35:31.282 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4dc0ee7d90] 2024-09-14T11:35:31.282 INFO:tasks.workunit.client.0.smithi071.stderr: 7: __libc_start_main() 2024-09-14T11:35:31.282 INFO:tasks.workunit.client.0.smithi071.stderr: 8: _start() 2024-09-14T11:35:31.282 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.282 INFO:tasks.workunit.client.0.smithi071.stderr: 0> 2024-09-14T11:35:31.163+0000 7f4dbe7a79c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:35:31.282 INFO:tasks.workunit.client.0.smithi071.stderr: in thread 7f4dbe7a79c0 thread_name:radosgw-admin 2024-09-14T11:35:31.282 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.282 INFO:tasks.workunit.client.0.smithi071.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:31.283 INFO:tasks.workunit.client.0.smithi071.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f4dc0f00520] 2024-09-14T11:35:31.283 INFO:tasks.workunit.client.0.smithi071.stderr: 2: pthread_kill() 2024-09-14T11:35:31.283 INFO:tasks.workunit.client.0.smithi071.stderr: 3: raise() 2024-09-14T11:35:31.283 INFO:tasks.workunit.client.0.smithi071.stderr: 4: abort() 2024-09-14T11:35:31.283 INFO:tasks.workunit.client.0.smithi071.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f4dc2081345] 2024-09-14T11:35:31.283 INFO:tasks.workunit.client.0.smithi071.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4dc208149f] 2024-09-14T11:35:31.283 INFO:tasks.workunit.client.0.smithi071.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555bf230dc01] 2024-09-14T11:35:31.283 INFO:tasks.workunit.client.0.smithi071.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x555bf2322f3a] 2024-09-14T11:35:31.283 INFO:tasks.workunit.client.0.smithi071.stderr: 9: main() 2024-09-14T11:35:31.283 INFO:tasks.workunit.client.0.smithi071.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4dc0ee7d90] 2024-09-14T11:35:31.283 INFO:tasks.workunit.client.0.smithi071.stderr: 11: __libc_start_main() 2024-09-14T11:35:31.283 INFO:tasks.workunit.client.0.smithi071.stderr: 12: _start() 2024-09-14T11:35:31.283 INFO:tasks.workunit.client.0.smithi071.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:35:31.283 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:35:31.283 INFO:tasks.workunit.client.0.smithi071.stderr:--- logging levels --- 2024-09-14T11:35:31.284 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 none 2024-09-14T11:35:31.284 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 lockdep 2024-09-14T11:35:31.284 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 context 2024-09-14T11:35:31.284 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 crush 2024-09-14T11:35:31.284 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds 2024-09-14T11:35:31.284 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_balancer 2024-09-14T11:35:31.284 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_locker 2024-09-14T11:35:31.284 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log 2024-09-14T11:35:31.284 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_log_expire 2024-09-14T11:35:31.284 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mds_migrator 2024-09-14T11:35:31.284 INFO:tasks.workunit.client.0.smithi071.stderr: 3/ 5 mds_quiesce 2024-09-14T11:35:31.284 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 buffer 2024-09-14T11:35:31.284 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 timer 2024-09-14T11:35:31.284 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 filer 2024-09-14T11:35:31.285 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 striper 2024-09-14T11:35:31.285 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 1 objecter 2024-09-14T11:35:31.285 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rados 2024-09-14T11:35:31.285 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd 2024-09-14T11:35:31.285 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_mirror 2024-09-14T11:35:31.285 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_replay 2024-09-14T11:35:31.285 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 rbd_pwl 2024-09-14T11:35:31.285 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 journaler 2024-09-14T11:35:31.285 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objectcacher 2024-09-14T11:35:31.285 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:35:31.285 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 client 2024-09-14T11:35:31.285 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 osd 2024-09-14T11:35:31.285 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 optracker 2024-09-14T11:35:31.285 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 objclass 2024-09-14T11:35:31.285 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 filestore 2024-09-14T11:35:31.286 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 journal 2024-09-14T11:35:31.286 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 ms 2024-09-14T11:35:31.286 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mon 2024-09-14T11:35:31.286 INFO:tasks.workunit.client.0.smithi071.stderr: 0/10 monc 2024-09-14T11:35:31.286 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 paxos 2024-09-14T11:35:31.286 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 tp 2024-09-14T11:35:31.286 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 auth 2024-09-14T11:35:31.286 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 crypto 2024-09-14T11:35:31.286 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 finisher 2024-09-14T11:35:31.286 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 reserver 2024-09-14T11:35:31.286 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 heartbeatmap 2024-09-14T11:35:31.286 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 perfcounter 2024-09-14T11:35:31.286 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw 2024-09-14T11:35:31.286 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_sync 2024-09-14T11:35:31.286 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_datacache 2024-09-14T11:35:31.287 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_access 2024-09-14T11:35:31.287 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:35:31.287 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_flight 2024-09-14T11:35:31.287 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:35:31.287 INFO:tasks.workunit.client.0.smithi071.stderr: 20/20 rgw_notification 2024-09-14T11:35:31.287 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 javaclient 2024-09-14T11:35:31.287 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 asok 2024-09-14T11:35:31.287 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 1 throttle 2024-09-14T11:35:31.287 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 0 refs 2024-09-14T11:35:31.287 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 compressor 2024-09-14T11:35:31.287 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluestore 2024-09-14T11:35:31.287 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 bluefs 2024-09-14T11:35:31.287 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 3 bdev 2024-09-14T11:35:31.287 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 kstore 2024-09-14T11:35:31.288 INFO:tasks.workunit.client.0.smithi071.stderr: 4/ 5 rocksdb 2024-09-14T11:35:31.288 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 fuse 2024-09-14T11:35:31.288 INFO:tasks.workunit.client.0.smithi071.stderr: 2/ 5 mgr 2024-09-14T11:35:31.288 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mgrc 2024-09-14T11:35:31.288 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 dpdk 2024-09-14T11:35:31.288 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 eventtrace 2024-09-14T11:35:31.288 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 prioritycache 2024-09-14T11:35:31.288 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 test 2024-09-14T11:35:31.288 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:35:31.288 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cephsqlite 2024-09-14T11:35:31.288 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:35:31.288 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore 2024-09-14T11:35:31.288 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_onode 2024-09-14T11:35:31.288 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_odata 2024-09-14T11:35:31.288 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_omap 2024-09-14T11:35:31.289 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_tm 2024-09-14T11:35:31.289 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_t 2024-09-14T11:35:31.289 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:35:31.289 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_epm 2024-09-14T11:35:31.289 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_lba 2024-09-14T11:35:31.289 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:35:31.289 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_cache 2024-09-14T11:35:31.289 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_journal 2024-09-14T11:35:31.289 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_device 2024-09-14T11:35:31.289 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 seastore_backref 2024-09-14T11:35:31.289 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 alienstore 2024-09-14T11:35:31.289 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 mclock 2024-09-14T11:35:31.289 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 cyanstore 2024-09-14T11:35:31.289 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 ceph_exporter 2024-09-14T11:35:31.289 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 memstore 2024-09-14T11:35:31.289 INFO:tasks.workunit.client.0.smithi071.stderr: 1/ 5 trace 2024-09-14T11:35:31.290 INFO:tasks.workunit.client.0.smithi071.stderr: 0/ 5 ceph_dedup 2024-09-14T11:35:31.290 INFO:tasks.workunit.client.0.smithi071.stderr: -2/-2 (syslog threshold) 2024-09-14T11:35:31.290 INFO:tasks.workunit.client.0.smithi071.stderr: 99/99 (stderr threshold) 2024-09-14T11:35:31.290 INFO:tasks.workunit.client.0.smithi071.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:35:31.290 INFO:tasks.workunit.client.0.smithi071.stderr: 7f4be37fe640 / http_manager 2024-09-14T11:35:31.290 INFO:tasks.workunit.client.0.smithi071.stderr: 7f4c71fdb640 / http_manager 2024-09-14T11:35:31.290 INFO:tasks.workunit.client.0.smithi071.stderr: 7f4c72fdd640 / rgw_dt_lg_renew 2024-09-14T11:35:31.290 INFO:tasks.workunit.client.0.smithi071.stderr: 7f4c91ffb640 / ms_dispatch 2024-09-14T11:35:31.290 INFO:tasks.workunit.client.0.smithi071.stderr: 7f4c937fe640 / io_context_pool 2024-09-14T11:35:31.290 INFO:tasks.workunit.client.0.smithi071.stderr: 7f4ca1ffb640 / ms_dispatch 2024-09-14T11:35:31.290 INFO:tasks.workunit.client.0.smithi071.stderr: 7f4ca8e09640 / ms_dispatch 2024-09-14T11:35:31.290 INFO:tasks.workunit.client.0.smithi071.stderr: 7f4caa60c640 / io_context_pool 2024-09-14T11:35:31.290 INFO:tasks.workunit.client.0.smithi071.stderr: 7f4db3aac640 / msgr-worker-2 2024-09-14T11:35:31.290 INFO:tasks.workunit.client.0.smithi071.stderr: 7f4dbc2ad640 / msgr-worker-1 2024-09-14T11:35:31.290 INFO:tasks.workunit.client.0.smithi071.stderr: 7f4dbcaae640 / msgr-worker-0 2024-09-14T11:35:31.291 INFO:tasks.workunit.client.0.smithi071.stderr: 7f4dbd2af640 / io_context_pool 2024-09-14T11:35:31.291 INFO:tasks.workunit.client.0.smithi071.stderr: 7f4dbe7a79c0 / radosgw-admin 2024-09-14T11:35:31.291 INFO:tasks.workunit.client.0.smithi071.stderr: max_recent 500 2024-09-14T11:35:31.291 INFO:tasks.workunit.client.0.smithi071.stderr: max_new 1000 2024-09-14T11:35:31.291 INFO:tasks.workunit.client.0.smithi071.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:35:31.169365Z_48992fa2-f308-4493-a2f6-f0360f992765/log 2024-09-14T11:35:31.291 INFO:tasks.workunit.client.0.smithi071.stderr:--- end dump of recent events --- 2024-09-14T11:35:31.291 INFO:tasks.workunit.client.0.smithi071.stderr:Aborted 2024-09-14T11:35:31.291 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:35:31.292 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:31.292 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:31.292 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.247+0000 7f64c71af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.292 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.251+0000 7f64c71af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.292 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.251+0000 7f64c71af9c0 20 realm 2024-09-14T11:35:31.292 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.251+0000 7f64c71af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.292 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.251+0000 7f64c71af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.292 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.251+0000 7f64c71af9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:31.293 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.251+0000 7f64c71af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.293 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.251+0000 7f64c71af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.293 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.251+0000 7f64c71af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.293 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.251+0000 7f64c71af9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:31.293 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.251+0000 7f64c71af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.293 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.251+0000 7f64c71af9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:31.293 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.251+0000 7f64c71af9c0 20 searching for the correct realm 2024-09-14T11:35:31.293 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.259+0000 7f64c4cb5640 0 -- 172.21.15.71:0/3828021856 >> [v2:172.21.15.157:6808/527702018,v1:172.21.15.157:6809/527702018] conn(0x7f64b40d6420 msgr2=0x7f64b40d68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:35:31.475 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.475+0000 7f64c4cb5640 0 -- 172.21.15.71:0/3828021856 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x55ed1f7a4f70 msgr2=0x55ed1f7a7430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:31.484 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.483+0000 7f64c71af9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:31.484 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.483+0000 7f64c71af9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:35:31.484 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.483+0000 7f64c71af9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:31.484 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.483+0000 7f64c71af9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:35:31.484 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.483+0000 7f64c71af9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:31.484 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.483+0000 7f64c71af9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:31.484 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.483+0000 7f64c71af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.485 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.487+0000 7f64c71af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.485 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.487+0000 7f64c71af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.485 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.487+0000 7f64c71af9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:31.485 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.487+0000 7f64c71af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.486 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.487+0000 7f64c71af9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:31.486 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.487+0000 7f64c71af9c0 20 zone default found 2024-09-14T11:35:31.486 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.487+0000 7f64c71af9c0 4 Realm: () 2024-09-14T11:35:31.487 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.487+0000 7f64c71af9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:35:31.487 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.487+0000 7f64c71af9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:35:31.487 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.487+0000 7f64c71af9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:31.487 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.487+0000 7f64c71af9c0 20 zonegroup default 2024-09-14T11:35:31.487 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.487+0000 7f64c71af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.487 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.487+0000 7f64c71af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.487 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.487+0000 7f64c71af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.487 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.487+0000 7f64c71af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.488 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.487+0000 7f64c71af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.488 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.491+0000 7f64c71af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.488 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.491+0000 7f64c71af9c0 20 started sync module instance, tier type = 2024-09-14T11:35:31.488 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.491+0000 7f64c71af9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:35:31.511 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.511+0000 7f64c71af9c0 20 add_watcher() i=0 2024-09-14T11:35:31.511 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.511+0000 7f64c71af9c0 20 add_watcher() i=1 2024-09-14T11:35:31.511 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.511+0000 7f64c71af9c0 20 add_watcher() i=2 2024-09-14T11:35:31.511 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.511+0000 7f64c71af9c0 20 add_watcher() i=3 2024-09-14T11:35:31.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.511+0000 7f64c71af9c0 20 add_watcher() i=4 2024-09-14T11:35:31.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.511+0000 7f64c71af9c0 20 add_watcher() i=5 2024-09-14T11:35:31.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.511+0000 7f64c71af9c0 20 add_watcher() i=6 2024-09-14T11:35:31.514 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.515+0000 7f64c71af9c0 20 add_watcher() i=7 2024-09-14T11:35:31.514 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.515+0000 7f64c71af9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:31.518 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.519+0000 7f637afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:31.519 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.519+0000 7f64c71af9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:31.520 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.519+0000 7f64c71af9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:31.520 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.519+0000 7f64c71af9c0 5 note: GC not initialized 2024-09-14T11:35:31.520 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.519+0000 7f6379fe3640 20 reqs_thread_entry: start 2024-09-14T11:35:31.521 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.523+0000 7f64c71af9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:35:31.521 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.523+0000 7f64c71af9c0 20 Filter name: none 2024-09-14T11:35:31.521 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.523+0000 7f62eb7fe640 20 reqs_thread_entry: start 2024-09-14T11:35:31.521 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.523+0000 7f64c71af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.521 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.523+0000 7f64c71af9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:35:31.521 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.523+0000 7f64c71af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.523+0000 7f64c71af9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:35:31.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.523+0000 7f64c71af9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:31.522 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.523+0000 7f64c71af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.523 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.523+0000 7f64c71af9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:35:31.523 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.523+0000 7f64c71af9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.523 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.523+0000 7f64c71af9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:35:31.523 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.523+0000 7f64c71af9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:31.526 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.527+0000 7f637afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:31.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.531+0000 7f64c71af9c0 20 remove_watcher() i=0 2024-09-14T11:35:31.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.531+0000 7f64c71af9c0 2 removed watcher, disabling cache 2024-09-14T11:35:31.533 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.535+0000 7f64c71af9c0 20 remove_watcher() i=1 2024-09-14T11:35:31.535 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.535+0000 7f64c71af9c0 20 remove_watcher() i=2 2024-09-14T11:35:31.537 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.539+0000 7f64c71af9c0 20 remove_watcher() i=3 2024-09-14T11:35:31.539 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.539+0000 7f64c71af9c0 20 remove_watcher() i=4 2024-09-14T11:35:31.541 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.543+0000 7f64c71af9c0 20 remove_watcher() i=5 2024-09-14T11:35:31.544 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.547+0000 7f64c71af9c0 20 remove_watcher() i=6 2024-09-14T11:35:31.547 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.547+0000 7f64c71af9c0 20 remove_watcher() i=7 2024-09-14T11:35:31.574 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:35:31.605 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:31.606 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:31.650 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.651+0000 7f858a13d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.653 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.655+0000 7f858a13d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.653 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.655+0000 7f858a13d9c0 20 realm 2024-09-14T11:35:31.653 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.655+0000 7f858a13d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.654 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.655+0000 7f858a13d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.654 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.655+0000 7f858a13d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:31.654 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.655+0000 7f858a13d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.654 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.655+0000 7f858a13d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.654 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.655+0000 7f858a13d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.655 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.655+0000 7f858a13d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:31.655 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.655+0000 7f858a13d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.656 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.655+0000 7f858a13d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:31.656 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.655+0000 7f858a13d9c0 20 searching for the correct realm 2024-09-14T11:35:31.659 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.659+0000 7f8588444640 0 -- 172.21.15.71:0/1616365257 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f857c01a040 msgr2=0x7f857c06f6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:31.666 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.667+0000 7f8587442640 0 -- 172.21.15.71:0/1616365257 >> [v2:172.21.15.157:6800/3420822707,v1:172.21.15.157:6801/3420822707] conn(0x7f857c068d50 msgr2=0x7f857c071910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:31.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.675+0000 7f858a13d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:31.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.675+0000 7f858a13d9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:35:31.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.675+0000 7f858a13d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:31.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.675+0000 7f858a13d9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:35:31.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.675+0000 7f858a13d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:31.675 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.675+0000 7f858a13d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:31.675 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.675+0000 7f858a13d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.675 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.675+0000 7f858a13d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.675 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.675+0000 7f858a13d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.675 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.675+0000 7f858a13d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:31.675 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.675+0000 7f858a13d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.676 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.679+0000 7f858a13d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:31.676 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.679+0000 7f858a13d9c0 20 zone default found 2024-09-14T11:35:31.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.679+0000 7f858a13d9c0 4 Realm: () 2024-09-14T11:35:31.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.679+0000 7f858a13d9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:35:31.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.679+0000 7f858a13d9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:35:31.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.679+0000 7f858a13d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:31.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.679+0000 7f858a13d9c0 20 zonegroup default 2024-09-14T11:35:31.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.679+0000 7f858a13d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.678 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.679+0000 7f858a13d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.678 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.679+0000 7f858a13d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.678 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.679+0000 7f858a13d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.678 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.679+0000 7f858a13d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.678 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.679+0000 7f858a13d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:31.678 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.679+0000 7f858a13d9c0 20 started sync module instance, tier type = 2024-09-14T11:35:31.678 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.679+0000 7f858a13d9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:35:31.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.695+0000 7f858a13d9c0 20 add_watcher() i=0 2024-09-14T11:35:31.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.695+0000 7f858a13d9c0 20 add_watcher() i=1 2024-09-14T11:35:31.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.695+0000 7f858a13d9c0 20 add_watcher() i=2 2024-09-14T11:35:31.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.695+0000 7f858a13d9c0 20 add_watcher() i=3 2024-09-14T11:35:31.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.695+0000 7f858a13d9c0 20 add_watcher() i=4 2024-09-14T11:35:31.696 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.695+0000 7f858a13d9c0 20 add_watcher() i=5 2024-09-14T11:35:31.696 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.695+0000 7f858a13d9c0 20 add_watcher() i=6 2024-09-14T11:35:31.697 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.699+0000 7f858a13d9c0 20 add_watcher() i=7 2024-09-14T11:35:31.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.699+0000 7f858a13d9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:31.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.703+0000 7f843dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:31.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.703+0000 7f858a13d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:31.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.703+0000 7f858a13d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:31.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.703+0000 7f858a13d9c0 5 note: GC not initialized 2024-09-14T11:35:31.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.703+0000 7f843cfe1640 20 reqs_thread_entry: start 2024-09-14T11:35:31.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.703+0000 7f858a13d9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:35:31.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.703+0000 7f858a13d9c0 20 Filter name: none 2024-09-14T11:35:31.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.703+0000 7f83b67fc640 20 reqs_thread_entry: start 2024-09-14T11:35:31.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.703+0000 7f858a13d9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:35:31.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.703+0000 7f858a13d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.703 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.703+0000 7f858a13d9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:35:31.703 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.703+0000 7f858a13d9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:35:31.703 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.703+0000 7f858a13d9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:35:31.704 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.703+0000 7f858a13d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 : miss 2024-09-14T11:35:31.704 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.703+0000 7f858a13d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:31.704 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.703+0000 7f858a13d9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:35:31.704 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.703+0000 7f858a13d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:35:31.704 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.703+0000 7f858a13d9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:35:31.704 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.703+0000 7f858a13d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:31.704 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.703+0000 7f858a13d9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:31.704 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.703+0000 7f858a13d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 2024-09-14T11:35:31.704 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.703+0000 7f858a13d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.0 2024-09-14T11:35:31.704 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.703+0000 7f858a13d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.0 2024-09-14T11:35:31.704 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.703+0000 7f858a13d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.1 2024-09-14T11:35:31.704 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.703+0000 7f858a13d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.1 2024-09-14T11:35:31.705 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.707+0000 7f858a13d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.2 2024-09-14T11:35:31.705 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.707+0000 7f858a13d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.2 2024-09-14T11:35:31.705 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.707+0000 7f858a13d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.3 2024-09-14T11:35:31.705 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.707+0000 7f858a13d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.3 2024-09-14T11:35:31.705 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.707+0000 7f858a13d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.4 2024-09-14T11:35:31.705 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.707+0000 7f858a13d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.4 2024-09-14T11:35:31.705 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.707+0000 7f858a13d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.5 2024-09-14T11:35:31.706 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.707+0000 7f858a13d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.5 2024-09-14T11:35:31.706 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.707+0000 7f858a13d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.6 2024-09-14T11:35:31.706 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.707+0000 7f858a13d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.6 2024-09-14T11:35:31.706 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.707+0000 7f858a13d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.7 2024-09-14T11:35:31.706 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.707+0000 7f858a13d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.7 2024-09-14T11:35:31.707 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.707+0000 7f858a13d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.8 2024-09-14T11:35:31.707 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.707+0000 7f858a13d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.8 2024-09-14T11:35:31.707 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.707+0000 7f858a13d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.9 2024-09-14T11:35:31.707 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.707+0000 7f858a13d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.9 2024-09-14T11:35:31.708 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.707+0000 7f858a13d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.10 2024-09-14T11:35:31.708 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.707+0000 7f858a13d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.10 2024-09-14T11:35:31.709 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.711+0000 7f858a13d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.11 2024-09-14T11:35:31.709 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.711+0000 7f858a13d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.11 2024-09-14T11:35:31.710 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.711+0000 7f858a13d9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.12 2024-09-14T11:35:31.710 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.711+0000 7f858a13d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.12 2024-09-14T11:35:31.711 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.711+0000 7f843dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:31.715 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.715+0000 7f858a13d9c0 20 remove_watcher() i=0 2024-09-14T11:35:31.715 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.715+0000 7f858a13d9c0 2 removed watcher, disabling cache 2024-09-14T11:35:31.717 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.719+0000 7f858a13d9c0 20 remove_watcher() i=1 2024-09-14T11:35:31.719 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.719+0000 7f858a13d9c0 20 remove_watcher() i=2 2024-09-14T11:35:31.721 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.723+0000 7f858a13d9c0 20 remove_watcher() i=3 2024-09-14T11:35:31.723 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.723+0000 7f858a13d9c0 20 remove_watcher() i=4 2024-09-14T11:35:31.725 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.727+0000 7f858a13d9c0 20 remove_watcher() i=5 2024-09-14T11:35:31.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.727+0000 7f858a13d9c0 20 remove_watcher() i=6 2024-09-14T11:35:31.730 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:35:31.731+0000 7f858a13d9c0 20 remove_watcher() i=7 2024-09-14T11:36:01.757 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-14T11:36:01.790 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:01.790 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:01.835 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:01.834+0000 7fa5c71289c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:01.837 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:01.838+0000 7fa5c71289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:01.837 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:01.838+0000 7fa5c71289c0 20 realm 2024-09-14T11:36:01.838 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:01.838+0000 7fa5c71289c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:01.838 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:01.838+0000 7fa5c71289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:01.838 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:01.838+0000 7fa5c71289c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:01.838 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:01.838+0000 7fa5c71289c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:01.838 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:01.838+0000 7fa5c71289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:01.839 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:01.838+0000 7fa5c71289c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:01.839 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:01.838+0000 7fa5c71289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:01.839 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:01.838+0000 7fa5c71289c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:01.840 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:01.838+0000 7fa5c71289c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:01.840 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:01.838+0000 7fa5c71289c0 20 searching for the correct realm 2024-09-14T11:36:01.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:01.842+0000 7fa5c542f640 0 -- 172.21.15.71:0/1130589541 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fa5b806c020 msgr2=0x7fa5b809b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:02.056 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.058+0000 7fa5c542f640 0 -- 172.21.15.71:0/1130589541 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55e95be171d0 msgr2=0x55e95be195e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:02.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.070+0000 7fa5c71289c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:02.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.070+0000 7fa5c71289c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:36:02.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.070+0000 7fa5c71289c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:02.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.070+0000 7fa5c71289c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:36:02.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.070+0000 7fa5c71289c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:02.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.070+0000 7fa5c71289c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:02.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.070+0000 7fa5c71289c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.073 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.074+0000 7fa5c71289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:02.073 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.074+0000 7fa5c71289c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.073 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.074+0000 7fa5c71289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:02.073 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.074+0000 7fa5c71289c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.074 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.074+0000 7fa5c71289c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:02.074 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.074+0000 7fa5c71289c0 20 zone default found 2024-09-14T11:36:02.074 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.074+0000 7fa5c71289c0 4 Realm: () 2024-09-14T11:36:02.074 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.074+0000 7fa5c71289c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:36:02.074 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.074+0000 7fa5c71289c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:36:02.074 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.074+0000 7fa5c71289c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:02.074 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.074+0000 7fa5c71289c0 20 zonegroup default 2024-09-14T11:36:02.074 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.074+0000 7fa5c71289c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.075 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.074+0000 7fa5c71289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:02.075 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.074+0000 7fa5c71289c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.075 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.074+0000 7fa5c71289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:02.076 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.074+0000 7fa5c71289c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.077 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.078+0000 7fa5c71289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:02.077 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.078+0000 7fa5c71289c0 20 started sync module instance, tier type = 2024-09-14T11:36:02.077 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.078+0000 7fa5c71289c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:36:02.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.098+0000 7fa5c71289c0 20 add_watcher() i=0 2024-09-14T11:36:02.100 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.098+0000 7fa5c71289c0 20 add_watcher() i=1 2024-09-14T11:36:02.100 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.098+0000 7fa5c71289c0 20 add_watcher() i=2 2024-09-14T11:36:02.100 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.098+0000 7fa5c71289c0 20 add_watcher() i=3 2024-09-14T11:36:02.100 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.098+0000 7fa5c71289c0 20 add_watcher() i=4 2024-09-14T11:36:02.100 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.098+0000 7fa5c71289c0 20 add_watcher() i=5 2024-09-14T11:36:02.100 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.098+0000 7fa5c71289c0 20 add_watcher() i=6 2024-09-14T11:36:02.102 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.102+0000 7fa5c71289c0 20 add_watcher() i=7 2024-09-14T11:36:02.102 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.102+0000 7fa5c71289c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:02.105 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.106+0000 7fa47b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:02.106 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.106+0000 7fa5c71289c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:02.107 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.106+0000 7fa5c71289c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:02.107 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.106+0000 7fa5c71289c0 5 note: GC not initialized 2024-09-14T11:36:02.108 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.106+0000 7fa47a7e4640 20 reqs_thread_entry: start 2024-09-14T11:36:02.108 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.106+0000 7fa5c71289c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:02.108 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.106+0000 7fa5c71289c0 20 Filter name: none 2024-09-14T11:36:02.108 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.106+0000 7fa473fff640 20 reqs_thread_entry: start 2024-09-14T11:36:02.108 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.106+0000 7fa5c71289c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:36:02.108 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.106+0000 7fa5c71289c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.109 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.110+0000 7fa5c71289c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:36:02.109 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.110+0000 7fa5c71289c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:36:02.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.110+0000 7fa5c71289c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:36:02.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.110+0000 7fa5c71289c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 : miss 2024-09-14T11:36:02.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.110+0000 7fa5c71289c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.110+0000 7fa5c71289c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:36:02.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.110+0000 7fa5c71289c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:36:02.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.110+0000 7fa5c71289c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:36:02.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.110+0000 7fa5c71289c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:02.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.110+0000 7fa5c71289c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:02.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.110+0000 7fa5c71289c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 2024-09-14T11:36:02.116 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.118+0000 7fa47b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:02.121 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.122+0000 7fa5c71289c0 20 remove_watcher() i=0 2024-09-14T11:36:02.121 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.122+0000 7fa5c71289c0 2 removed watcher, disabling cache 2024-09-14T11:36:02.123 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.122+0000 7fa5c71289c0 20 remove_watcher() i=1 2024-09-14T11:36:02.125 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.126+0000 7fa5c71289c0 20 remove_watcher() i=2 2024-09-14T11:36:02.127 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.126+0000 7fa5c71289c0 20 remove_watcher() i=3 2024-09-14T11:36:02.129 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.130+0000 7fa5c71289c0 20 remove_watcher() i=4 2024-09-14T11:36:02.131 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.130+0000 7fa5c71289c0 20 remove_watcher() i=5 2024-09-14T11:36:02.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.134+0000 7fa5c71289c0 20 remove_watcher() i=6 2024-09-14T11:36:02.137 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.138+0000 7fa5c71289c0 20 remove_watcher() i=7 2024-09-14T11:36:02.156 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:36:02.188 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:02.188 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:02.234 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.234+0000 7f0705cd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.236 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.238+0000 7f0705cd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:02.236 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.238+0000 7f0705cd69c0 20 realm 2024-09-14T11:36:02.236 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.238+0000 7f0705cd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.237 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.238+0000 7f0705cd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:02.237 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.238+0000 7f0705cd69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:02.237 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.238+0000 7f0705cd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.237 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.238+0000 7f0705cd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:02.237 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.238+0000 7f0705cd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.238 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.238+0000 7f0705cd69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:02.238 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.238+0000 7f0705cd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.238+0000 7f0705cd69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:02.239 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.238+0000 7f0705cd69c0 20 searching for the correct realm 2024-09-14T11:36:02.449 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.450+0000 7f0703fdd640 0 -- 172.21.15.71:0/835365486 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f06f8028020 msgr2=0x7f06f805de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:02.664 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.666+0000 7f0703fdd640 0 -- 172.21.15.71:0/835365486 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x56013fb78f00 msgr2=0x56013fb7b2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:02.680 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.682+0000 7f0705cd69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:02.680 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.682+0000 7f0705cd69c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:36:02.680 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.682+0000 7f0705cd69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:02.680 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.682+0000 7f0705cd69c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:36:02.680 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.682+0000 7f0705cd69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:02.681 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.682+0000 7f0705cd69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:02.681 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.682+0000 7f0705cd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.681 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.682+0000 7f0705cd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:02.681 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.682+0000 7f0705cd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.682 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.682+0000 7f0705cd69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:02.682 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.682+0000 7f0705cd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.683 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.682+0000 7f0705cd69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:02.683 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.682+0000 7f0705cd69c0 20 zone default found 2024-09-14T11:36:02.683 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.682+0000 7f0705cd69c0 4 Realm: () 2024-09-14T11:36:02.683 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.682+0000 7f0705cd69c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:36:02.683 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.682+0000 7f0705cd69c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:36:02.683 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.682+0000 7f0705cd69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:02.683 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.682+0000 7f0705cd69c0 20 zonegroup default 2024-09-14T11:36:02.683 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.682+0000 7f0705cd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.684 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.682+0000 7f0705cd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:02.684 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.682+0000 7f0705cd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.684 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.686+0000 7f0705cd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:02.684 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.686+0000 7f0705cd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.685 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.686+0000 7f0705cd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:02.685 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.686+0000 7f0705cd69c0 20 started sync module instance, tier type = 2024-09-14T11:36:02.685 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.686+0000 7f0705cd69c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:36:02.708 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.706+0000 7f0705cd69c0 20 add_watcher() i=0 2024-09-14T11:36:02.708 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.706+0000 7f0705cd69c0 20 add_watcher() i=1 2024-09-14T11:36:02.708 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.706+0000 7f0705cd69c0 20 add_watcher() i=2 2024-09-14T11:36:02.708 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.706+0000 7f0705cd69c0 20 add_watcher() i=3 2024-09-14T11:36:02.708 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.706+0000 7f0705cd69c0 20 add_watcher() i=4 2024-09-14T11:36:02.708 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.706+0000 7f0705cd69c0 20 add_watcher() i=5 2024-09-14T11:36:02.708 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.706+0000 7f0705cd69c0 20 add_watcher() i=6 2024-09-14T11:36:02.710 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.710+0000 7f0705cd69c0 20 add_watcher() i=7 2024-09-14T11:36:02.710 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.710+0000 7f0705cd69c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:02.715 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.714+0000 7f05b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:02.716 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.718+0000 7f0705cd69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:02.716 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.718+0000 7f0705cd69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:02.716 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.718+0000 7f0705cd69c0 5 note: GC not initialized 2024-09-14T11:36:02.717 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.718+0000 7f05b8fe1640 20 reqs_thread_entry: start 2024-09-14T11:36:02.717 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.718+0000 7f0705cd69c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:02.717 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.718+0000 7f0705cd69c0 20 Filter name: none 2024-09-14T11:36:02.717 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.718+0000 7f05327fc640 20 reqs_thread_entry: start 2024-09-14T11:36:02.718 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.718+0000 7f0705cd69c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:36:02.718 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.718+0000 7f0705cd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.719 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.718+0000 7f0705cd69c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:36:02.719 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.718+0000 7f0705cd69c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:36:02.719 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.718+0000 7f0705cd69c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:36:02.719 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.718+0000 7f0705cd69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 : miss 2024-09-14T11:36:02.719 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.718+0000 7f0705cd69c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.719 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.718+0000 7f0705cd69c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:36:02.719 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.718+0000 7f0705cd69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:36:02.719 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.718+0000 7f0705cd69c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:36:02.719 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.718+0000 7f0705cd69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:02.720 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.718+0000 7f0705cd69c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:02.720 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.718+0000 7f0705cd69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 2024-09-14T11:36:02.720 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.718+0000 7f0705cd69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.0 2024-09-14T11:36:02.720 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.718+0000 7f0705cd69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.0 2024-09-14T11:36:02.720 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.718+0000 7f0705cd69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.1 2024-09-14T11:36:02.720 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.718+0000 7f0705cd69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.1 2024-09-14T11:36:02.721 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.722+0000 7f0705cd69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.2 2024-09-14T11:36:02.721 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.722+0000 7f0705cd69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.2 2024-09-14T11:36:02.722 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.722+0000 7f0705cd69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.3 2024-09-14T11:36:02.722 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.722+0000 7f0705cd69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.3 2024-09-14T11:36:02.722 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.722+0000 7f0705cd69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.4 2024-09-14T11:36:02.722 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.722+0000 7f0705cd69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.4 2024-09-14T11:36:02.722 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.722+0000 7f0705cd69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.5 2024-09-14T11:36:02.723 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.722+0000 7f0705cd69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.5 2024-09-14T11:36:02.723 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.722+0000 7f0705cd69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.6 2024-09-14T11:36:02.723 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.722+0000 7f0705cd69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.6 2024-09-14T11:36:02.724 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.726+0000 7f0705cd69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.7 2024-09-14T11:36:02.724 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.726+0000 7f0705cd69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.7 2024-09-14T11:36:02.724 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.726+0000 7f0705cd69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.8 2024-09-14T11:36:02.725 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.726+0000 7f0705cd69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.8 2024-09-14T11:36:02.725 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.726+0000 7f0705cd69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.9 2024-09-14T11:36:02.725 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.726+0000 7f0705cd69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.9 2024-09-14T11:36:02.726 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.726+0000 7f0705cd69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.10 2024-09-14T11:36:02.726 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.726+0000 7f0705cd69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.10 2024-09-14T11:36:02.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.726+0000 7f0705cd69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.11 2024-09-14T11:36:02.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.726+0000 7f0705cd69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.11 2024-09-14T11:36:02.728 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.730+0000 7f0705cd69c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.12 2024-09-14T11:36:02.728 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.730+0000 7f0705cd69c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.12 2024-09-14T11:36:02.730 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.730+0000 7f05b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:02.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.738+0000 7f0705cd69c0 20 remove_watcher() i=0 2024-09-14T11:36:02.736 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.738+0000 7f0705cd69c0 2 removed watcher, disabling cache 2024-09-14T11:36:02.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.738+0000 7f0705cd69c0 20 remove_watcher() i=1 2024-09-14T11:36:02.741 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.742+0000 7f0705cd69c0 20 remove_watcher() i=2 2024-09-14T11:36:02.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.742+0000 7f0705cd69c0 20 remove_watcher() i=3 2024-09-14T11:36:02.745 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.746+0000 7f0705cd69c0 20 remove_watcher() i=4 2024-09-14T11:36:02.747 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.746+0000 7f0705cd69c0 20 remove_watcher() i=5 2024-09-14T11:36:02.750 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.750+0000 7f0705cd69c0 20 remove_watcher() i=6 2024-09-14T11:36:02.753 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.754+0000 7f0705cd69c0 20 remove_watcher() i=7 2024-09-14T11:36:02.774 INFO:tasks.workunit.client.0.smithi071.stderr:check reshard logrecord successfully 2024-09-14T11:36:02.774 INFO:tasks.workunit.client.0.smithi071.stderr: test: reshard versioned bucket 2024-09-14T11:36:02.774 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:36:02.805 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:02.805 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:02.851 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.850+0000 7f26135f79c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.853 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.854+0000 7f26135f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:02.854 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.854+0000 7f26135f79c0 20 realm 2024-09-14T11:36:02.854 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.854+0000 7f26135f79c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.854 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.854+0000 7f26135f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:02.855 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.854+0000 7f26135f79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:02.855 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.854+0000 7f26135f79c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.855 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.854+0000 7f26135f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:02.855 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.854+0000 7f26135f79c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.855 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.854+0000 7f26135f79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:02.855 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.854+0000 7f26135f79c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.856 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.858+0000 7f26135f79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:02.856 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.858+0000 7f26135f79c0 20 searching for the correct realm 2024-09-14T11:36:02.860 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:02.858+0000 7f26118fe640 0 -- 172.21.15.71:0/1194927299 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f25fc08db60 msgr2=0x7f25fc03aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:03.076 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.078+0000 7f26118fe640 0 -- 172.21.15.71:0/1194927299 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55984442e0e0 msgr2=0x5598444304d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:03.295 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.294+0000 7f26135f79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:03.295 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.294+0000 7f26135f79c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:36:03.295 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.294+0000 7f26135f79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:03.295 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.294+0000 7f26135f79c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:36:03.295 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.294+0000 7f26135f79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:03.296 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.294+0000 7f26135f79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:03.296 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.294+0000 7f26135f79c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:03.296 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.294+0000 7f26135f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:03.296 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.294+0000 7f26135f79c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:03.297 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.298+0000 7f26135f79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:03.297 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.298+0000 7f26135f79c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:03.298 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.298+0000 7f26135f79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:03.298 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.298+0000 7f26135f79c0 20 zone default found 2024-09-14T11:36:03.298 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.298+0000 7f26135f79c0 4 Realm: () 2024-09-14T11:36:03.298 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.298+0000 7f26135f79c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:36:03.298 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.298+0000 7f26135f79c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:36:03.299 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.298+0000 7f26135f79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:03.299 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.298+0000 7f26135f79c0 20 zonegroup default 2024-09-14T11:36:03.299 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.298+0000 7f26135f79c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:03.299 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.298+0000 7f26135f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:03.299 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.298+0000 7f26135f79c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:03.300 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.298+0000 7f26135f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:03.300 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.298+0000 7f26135f79c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:03.300 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.302+0000 7f26135f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:03.300 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.302+0000 7f26135f79c0 20 started sync module instance, tier type = 2024-09-14T11:36:03.300 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.302+0000 7f26135f79c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:36:03.322 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.322+0000 7f26135f79c0 20 add_watcher() i=0 2024-09-14T11:36:03.322 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.322+0000 7f26135f79c0 20 add_watcher() i=1 2024-09-14T11:36:03.322 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.322+0000 7f26135f79c0 20 add_watcher() i=2 2024-09-14T11:36:03.323 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.322+0000 7f26135f79c0 20 add_watcher() i=3 2024-09-14T11:36:03.323 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.322+0000 7f26135f79c0 20 add_watcher() i=4 2024-09-14T11:36:03.323 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.322+0000 7f26135f79c0 20 add_watcher() i=5 2024-09-14T11:36:03.323 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.322+0000 7f26135f79c0 20 add_watcher() i=6 2024-09-14T11:36:03.325 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.326+0000 7f26135f79c0 20 add_watcher() i=7 2024-09-14T11:36:03.325 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.326+0000 7f26135f79c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:03.329 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.330+0000 7f24c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:03.330 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.330+0000 7f26135f79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:03.330 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.330+0000 7f26135f79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:03.330 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.330+0000 7f26135f79c0 5 note: GC not initialized 2024-09-14T11:36:03.331 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.330+0000 7f24c67e4640 20 reqs_thread_entry: start 2024-09-14T11:36:03.331 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.330+0000 7f26135f79c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:03.331 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.330+0000 7f26135f79c0 20 Filter name: none 2024-09-14T11:36:03.331 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.330+0000 7f2437fff640 20 reqs_thread_entry: start 2024-09-14T11:36:03.331 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.330+0000 7f26135f79c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:03.332 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.334+0000 7f26135f79c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:03.332 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.334+0000 7f26135f79c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:03.333 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.334+0000 7f26135f79c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:03.333 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.334+0000 7f26135f79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:03.333 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.334+0000 7f26135f79c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:03.334 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.334+0000 7f26135f79c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:03.334 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.334+0000 7f26135f79c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:03.334 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.334+0000 7f26135f79c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:03.334 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.334+0000 7f26135f79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:03.338 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.338+0000 7f24c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:03.342 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.342+0000 7f26135f79c0 20 remove_watcher() i=0 2024-09-14T11:36:03.342 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.342+0000 7f26135f79c0 2 removed watcher, disabling cache 2024-09-14T11:36:03.344 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.346+0000 7f26135f79c0 20 remove_watcher() i=1 2024-09-14T11:36:03.346 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.346+0000 7f26135f79c0 20 remove_watcher() i=2 2024-09-14T11:36:03.348 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.350+0000 7f26135f79c0 20 remove_watcher() i=3 2024-09-14T11:36:03.350 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.350+0000 7f26135f79c0 20 remove_watcher() i=4 2024-09-14T11:36:03.352 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.354+0000 7f26135f79c0 20 remove_watcher() i=5 2024-09-14T11:36:03.355 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.354+0000 7f26135f79c0 20 remove_watcher() i=6 2024-09-14T11:36:03.357 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.358+0000 7f26135f79c0 20 remove_watcher() i=7 2024-09-14T11:36:03.374 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:36:03.375 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:36:03.375 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: myver id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.19 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-14T11:36:03.375 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:36:03.375 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-09-14T11:36:03.407 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:03.407 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:03.454 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.454+0000 7f40f53569c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:03.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.458+0000 7f40f53569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:03.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.458+0000 7f40f53569c0 20 realm 2024-09-14T11:36:03.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.458+0000 7f40f53569c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:03.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.458+0000 7f40f53569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:03.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.458+0000 7f40f53569c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:03.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.458+0000 7f40f53569c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:03.458 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.458+0000 7f40f53569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:03.458 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.458+0000 7f40f53569c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:03.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.458+0000 7f40f53569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:03.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.458+0000 7f40f53569c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:03.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.458+0000 7f40f53569c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:03.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.458+0000 7f40f53569c0 20 searching for the correct realm 2024-09-14T11:36:03.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.462+0000 7f40f365d640 0 -- 172.21.15.71:0/1233846959 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f40e808ac20 msgr2=0x7f40e8042950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:03.676 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.674+0000 7f40f365d640 0 -- 172.21.15.71:0/1233846959 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55e0a10f99d0 msgr2=0x55e0a10fbdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:03.691 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.690+0000 7f40f53569c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:03.691 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.690+0000 7f40f53569c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:36:03.691 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.690+0000 7f40f53569c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:03.691 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.690+0000 7f40f53569c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:36:03.691 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.690+0000 7f40f53569c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:03.692 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.690+0000 7f40f53569c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:03.692 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.690+0000 7f40f53569c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:03.692 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.690+0000 7f40f53569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:03.692 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.690+0000 7f40f53569c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:03.693 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.694+0000 7f40f53569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:03.693 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.694+0000 7f40f53569c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:03.693 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.694+0000 7f40f53569c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:03.693 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.694+0000 7f40f53569c0 20 zone default found 2024-09-14T11:36:03.693 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.694+0000 7f40f53569c0 4 Realm: () 2024-09-14T11:36:03.693 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.694+0000 7f40f53569c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:36:03.694 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.694+0000 7f40f53569c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:36:03.694 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.694+0000 7f40f53569c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:03.694 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.694+0000 7f40f53569c0 20 zonegroup default 2024-09-14T11:36:03.694 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.694+0000 7f40f53569c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:03.694 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.694+0000 7f40f53569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:03.694 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.694+0000 7f40f53569c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:03.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.694+0000 7f40f53569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:03.695 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.694+0000 7f40f53569c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:03.696 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.694+0000 7f40f53569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:03.696 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.694+0000 7f40f53569c0 20 started sync module instance, tier type = 2024-09-14T11:36:03.696 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.694+0000 7f40f53569c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:36:03.719 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.718+0000 7f40f53569c0 20 add_watcher() i=0 2024-09-14T11:36:03.719 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.718+0000 7f40f53569c0 20 add_watcher() i=1 2024-09-14T11:36:03.719 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.718+0000 7f40f53569c0 20 add_watcher() i=2 2024-09-14T11:36:03.719 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.718+0000 7f40f53569c0 20 add_watcher() i=3 2024-09-14T11:36:03.719 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.718+0000 7f40f53569c0 20 add_watcher() i=4 2024-09-14T11:36:03.720 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.718+0000 7f40f53569c0 20 add_watcher() i=5 2024-09-14T11:36:03.720 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.718+0000 7f40f53569c0 20 add_watcher() i=6 2024-09-14T11:36:03.721 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.722+0000 7f40f53569c0 20 add_watcher() i=7 2024-09-14T11:36:03.722 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.722+0000 7f40f53569c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:03.726 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.726+0000 7f3fa97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:03.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.726+0000 7f40f53569c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:03.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.726+0000 7f40f53569c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:03.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.726+0000 7f40f53569c0 5 note: GC not initialized 2024-09-14T11:36:03.728 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.726+0000 7f3f23fff640 20 reqs_thread_entry: start 2024-09-14T11:36:03.728 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.726+0000 7f40f53569c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:03.728 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.730+0000 7f40f53569c0 20 Filter name: none 2024-09-14T11:36:03.728 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.730+0000 7f3f21ffb640 20 reqs_thread_entry: start 2024-09-14T11:36:03.728 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.730+0000 7f40f53569c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:36:03.729 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.730+0000 7f40f53569c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:03.730 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.730+0000 7f40f53569c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:03.730 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.730+0000 7f40f53569c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:36:03.730 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.730+0000 7f40f53569c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:36:03.730 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.730+0000 7f40f53569c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 : miss 2024-09-14T11:36:03.730 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.730+0000 7f40f53569c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:03.730 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.730+0000 7f40f53569c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:03.730 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.730+0000 7f40f53569c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 info.flags=0x17 2024-09-14T11:36:03.731 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.730+0000 7f40f53569c0 10 adding default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 to cache LRU end 2024-09-14T11:36:03.731 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.730+0000 7f40f53569c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:03.731 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.730+0000 7f40f53569c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:03.731 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.730+0000 7f40f53569c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 2024-09-14T11:36:03.741 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.742+0000 7f40f53569c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 info.flags=0x17 2024-09-14T11:36:03.741 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.742+0000 7f40f53569c0 10 moving default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 to cache LRU end 2024-09-14T11:36:03.741 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.742+0000 7f40f53569c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:03.741 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.742+0000 7f40f53569c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19, ofs0, ns] 2024-09-14T11:36:03.741 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.742+0000 7f3fd5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464382 cookie 94423263233200 notifier 8391 bl.length()=905 2024-09-14T11:36:03.742 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.742+0000 7f3fd5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 info.flags=0x17 2024-09-14T11:36:03.742 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.742+0000 7f3fd5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 to cache LRU end 2024-09-14T11:36:03.742 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.742+0000 7f3fd5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:03.742 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.742+0000 7f40f53569c0 20 handle_bi_update(): bucket=:myver[4444f441-0c56-48df-a905-d49e7e44d629.4596.19]): orig_sources= new_sources= 2024-09-14T11:36:03.742 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.742+0000 7f40f53569c0 20 handle_bi_update(): bucket=:myver[4444f441-0c56-48df-a905-d49e7e44d629.4596.19]): potential sources added=[] removed=[] 2024-09-14T11:36:03.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.742+0000 7f40f53569c0 20 handle_bi_update(): bucket=:myver[4444f441-0c56-48df-a905-d49e7e44d629.4596.19]): orig_dests= new_dests= 2024-09-14T11:36:03.743 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.742+0000 7f40f53569c0 20 handle_bi_update(): bucket=:myver[4444f441-0c56-48df-a905-d49e7e44d629.4596.19]): potential dests added=[] removed=[] 2024-09-14T11:36:03.754 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.754+0000 7f40f53569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.0 2024-09-14T11:36:03.754 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.754+0000 7f40f53569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.0 2024-09-14T11:36:03.754 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.754+0000 7f40f53569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.1 2024-09-14T11:36:03.755 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.754+0000 7f40f53569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.1 2024-09-14T11:36:03.755 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.754+0000 7f40f53569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.2 2024-09-14T11:36:03.755 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.754+0000 7f40f53569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.2 2024-09-14T11:36:03.755 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.754+0000 7f40f53569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.3 2024-09-14T11:36:03.755 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.754+0000 7f40f53569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.3 2024-09-14T11:36:03.755 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.754+0000 7f40f53569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.4 2024-09-14T11:36:03.755 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.754+0000 7f40f53569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.4 2024-09-14T11:36:03.755 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.754+0000 7f40f53569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.5 2024-09-14T11:36:03.755 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.754+0000 7f40f53569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.5 2024-09-14T11:36:03.755 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.754+0000 7f40f53569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.6 2024-09-14T11:36:03.755 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.754+0000 7f40f53569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.6 2024-09-14T11:36:03.755 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.754+0000 7f40f53569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.7 2024-09-14T11:36:03.756 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.754+0000 7f40f53569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.7 2024-09-14T11:36:03.756 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.754+0000 7f40f53569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.8 2024-09-14T11:36:03.756 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.754+0000 7f40f53569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.8 2024-09-14T11:36:03.756 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.754+0000 7f40f53569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.9 2024-09-14T11:36:03.756 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.754+0000 7f40f53569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.9 2024-09-14T11:36:03.756 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.754+0000 7f40f53569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.10 2024-09-14T11:36:03.756 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.754+0000 7f40f53569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.10 2024-09-14T11:36:03.756 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.754+0000 7f40f53569c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.11 2024-09-14T11:36:03.756 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.754+0000 7f40f53569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.11 2024-09-14T11:36:03.756 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.754+0000 7f40f53569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.0 2024-09-14T11:36:03.757 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.754+0000 7f40f53569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1 2024-09-14T11:36:03.757 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.754+0000 7f40f53569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2 2024-09-14T11:36:03.757 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.758+0000 7f40f53569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3 2024-09-14T11:36:03.758 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.758+0000 7f40f53569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.4 2024-09-14T11:36:03.758 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.758+0000 7f40f53569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.5 2024-09-14T11:36:03.759 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.758+0000 7f40f53569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.6 2024-09-14T11:36:03.760 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.762+0000 7f40f53569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.7 2024-09-14T11:36:03.762 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.762+0000 7f40f53569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.8 2024-09-14T11:36:03.763 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.762+0000 7f40f53569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.9 2024-09-14T11:36:03.763 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.762+0000 7f40f53569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.10 2024-09-14T11:36:03.765 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.766+0000 7f40f53569c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:03.765 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.766+0000 7f40f53569c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 2024-09-14T11:36:03.767 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.766+0000 7f40f53569c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 info.flags=0x17 2024-09-14T11:36:03.767 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.766+0000 7f40f53569c0 10 moving default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 to cache LRU end 2024-09-14T11:36:03.767 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.766+0000 7f40f53569c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:03.767 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.766+0000 7f40f53569c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19, ofs0, ns] 2024-09-14T11:36:03.768 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.766+0000 7f3fd67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464383 cookie 94423263233200 notifier 8391 bl.length()=905 2024-09-14T11:36:03.768 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.766+0000 7f3fd67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 info.flags=0x17 2024-09-14T11:36:03.768 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.766+0000 7f3fd67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 to cache LRU end 2024-09-14T11:36:03.768 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.766+0000 7f3fd67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:03.768 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.770+0000 7f40f53569c0 20 handle_bi_update(): bucket=:myver[4444f441-0c56-48df-a905-d49e7e44d629.4596.19]): orig_sources= new_sources= 2024-09-14T11:36:03.768 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.770+0000 7f40f53569c0 20 handle_bi_update(): bucket=:myver[4444f441-0c56-48df-a905-d49e7e44d629.4596.19]): potential sources added=[] removed=[] 2024-09-14T11:36:03.769 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.770+0000 7f40f53569c0 20 handle_bi_update(): bucket=:myver[4444f441-0c56-48df-a905-d49e7e44d629.4596.19]): orig_dests= new_dests= 2024-09-14T11:36:03.769 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.770+0000 7f40f53569c0 20 handle_bi_update(): bucket=:myver[4444f441-0c56-48df-a905-d49e7e44d629.4596.19]): potential dests added=[] removed=[] 2024-09-14T11:36:03.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.774+0000 7f40f53569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.0 2024-09-14T11:36:03.775 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.774+0000 7f40f53569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1 2024-09-14T11:36:03.776 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.774+0000 7f40f53569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2 2024-09-14T11:36:03.776 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.778+0000 7f40f53569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3 2024-09-14T11:36:03.777 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.778+0000 7f40f53569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.4 2024-09-14T11:36:03.778 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.778+0000 7f40f53569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.5 2024-09-14T11:36:03.778 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.778+0000 7f40f53569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.6 2024-09-14T11:36:03.779 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.778+0000 7f40f53569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.7 2024-09-14T11:36:03.780 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.778+0000 7f40f53569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.8 2024-09-14T11:36:03.780 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.782+0000 7f40f53569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.9 2024-09-14T11:36:03.781 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.782+0000 7f40f53569c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.10 2024-09-14T11:36:03.782 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.782+0000 7f40f53569c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:03.782 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.782+0000 7f40f53569c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 2024-09-14T11:36:03.784 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.782+0000 7f40f53569c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 info.flags=0x17 2024-09-14T11:36:03.784 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.782+0000 7f40f53569c0 10 moving default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 to cache LRU end 2024-09-14T11:36:03.784 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.782+0000 7f40f53569c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:03.784 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.782+0000 7f40f53569c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19, ofs0, ns] 2024-09-14T11:36:03.784 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.786+0000 7f3fd5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464384 cookie 94423263233200 notifier 8391 bl.length()=873 2024-09-14T11:36:03.785 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.786+0000 7f3fd5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 info.flags=0x17 2024-09-14T11:36:03.785 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.786+0000 7f3fd5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 to cache LRU end 2024-09-14T11:36:03.785 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.786+0000 7f3fd5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:03.785 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.786+0000 7f40f53569c0 20 handle_bi_update(): bucket=:myver[4444f441-0c56-48df-a905-d49e7e44d629.4596.19]): orig_sources= new_sources= 2024-09-14T11:36:03.786 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.786+0000 7f40f53569c0 20 handle_bi_update(): bucket=:myver[4444f441-0c56-48df-a905-d49e7e44d629.4596.19]): potential sources added=[] removed=[] 2024-09-14T11:36:03.786 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.786+0000 7f40f53569c0 20 handle_bi_update(): bucket=:myver[4444f441-0c56-48df-a905-d49e7e44d629.4596.19]): orig_dests= new_dests= 2024-09-14T11:36:03.786 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.786+0000 7f40f53569c0 20 handle_bi_update(): bucket=:myver[4444f441-0c56-48df-a905-d49e7e44d629.4596.19]): potential dests added=[] removed=[] 2024-09-14T11:36:03.791 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.790+0000 7f40f53569c0 1 execute INFO: reshard of bucket "myver" from 11 shards to 12 shards completed successfully 2024-09-14T11:36:03.795 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.794+0000 7f3fa97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:03.799 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.798+0000 7f40f53569c0 20 remove_watcher() i=0 2024-09-14T11:36:03.799 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.798+0000 7f40f53569c0 2 removed watcher, disabling cache 2024-09-14T11:36:03.801 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.802+0000 7f40f53569c0 20 remove_watcher() i=1 2024-09-14T11:36:03.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.802+0000 7f40f53569c0 20 remove_watcher() i=2 2024-09-14T11:36:03.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.806+0000 7f40f53569c0 20 remove_watcher() i=3 2024-09-14T11:36:03.808 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.810+0000 7f40f53569c0 20 remove_watcher() i=4 2024-09-14T11:36:03.811 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.810+0000 7f40f53569c0 20 remove_watcher() i=5 2024-09-14T11:36:03.814 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.814+0000 7f40f53569c0 20 remove_watcher() i=6 2024-09-14T11:36:03.817 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.818+0000 7f40f53569c0 20 remove_watcher() i=7 2024-09-14T11:36:03.833 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:36:03.865 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:03.865 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:03.910 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.910+0000 7f6c21e299c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:03.912 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.914+0000 7f6c21e299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:03.912 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.914+0000 7f6c21e299c0 20 realm 2024-09-14T11:36:03.912 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.914+0000 7f6c21e299c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:03.913 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.914+0000 7f6c21e299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:03.913 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.914+0000 7f6c21e299c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:03.913 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.914+0000 7f6c21e299c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:03.914 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.914+0000 7f6c21e299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:03.914 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.914+0000 7f6c21e299c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:03.914 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.914+0000 7f6c21e299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:03.914 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.914+0000 7f6c21e299c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:03.915 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.914+0000 7f6c21e299c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:03.915 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.914+0000 7f6c21e299c0 20 searching for the correct realm 2024-09-14T11:36:03.919 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:03.918+0000 7f6c20130640 0 -- 172.21.15.71:0/1420468396 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f6c08032060 msgr2=0x7f6c08063220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:04.132 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.130+0000 7f6c20130640 0 -- 172.21.15.71:0/1420468396 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55f9142d80c0 msgr2=0x55f9142da4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:04.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.146+0000 7f6c21e299c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:04.147 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.146+0000 7f6c21e299c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:36:04.147 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.146+0000 7f6c21e299c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:04.147 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.146+0000 7f6c21e299c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:36:04.147 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.146+0000 7f6c21e299c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:04.147 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.146+0000 7f6c21e299c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:04.147 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.146+0000 7f6c21e299c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.147 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.146+0000 7f6c21e299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:04.147 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.146+0000 7f6c21e299c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.148 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.146+0000 7f6c21e299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:04.148 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.146+0000 7f6c21e299c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.150+0000 7f6c21e299c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:04.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.150+0000 7f6c21e299c0 20 zone default found 2024-09-14T11:36:04.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.150+0000 7f6c21e299c0 4 Realm: () 2024-09-14T11:36:04.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.150+0000 7f6c21e299c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:36:04.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.150+0000 7f6c21e299c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:36:04.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.150+0000 7f6c21e299c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:04.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.150+0000 7f6c21e299c0 20 zonegroup default 2024-09-14T11:36:04.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.150+0000 7f6c21e299c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.150+0000 7f6c21e299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:04.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.150+0000 7f6c21e299c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.150 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.150+0000 7f6c21e299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:04.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.150+0000 7f6c21e299c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.151 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.150+0000 7f6c21e299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:04.152 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.150+0000 7f6c21e299c0 20 started sync module instance, tier type = 2024-09-14T11:36:04.152 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.150+0000 7f6c21e299c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:36:04.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.174+0000 7f6c21e299c0 20 add_watcher() i=0 2024-09-14T11:36:04.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.174+0000 7f6c21e299c0 20 add_watcher() i=1 2024-09-14T11:36:04.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.174+0000 7f6c21e299c0 20 add_watcher() i=2 2024-09-14T11:36:04.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.174+0000 7f6c21e299c0 20 add_watcher() i=3 2024-09-14T11:36:04.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.174+0000 7f6c21e299c0 20 add_watcher() i=4 2024-09-14T11:36:04.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.174+0000 7f6c21e299c0 20 add_watcher() i=5 2024-09-14T11:36:04.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.174+0000 7f6c21e299c0 20 add_watcher() i=6 2024-09-14T11:36:04.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.178+0000 7f6c21e299c0 20 add_watcher() i=7 2024-09-14T11:36:04.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.178+0000 7f6c21e299c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:04.182 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.182+0000 7f6ad5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:04.183 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.182+0000 7f6c21e299c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:04.183 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.182+0000 7f6c21e299c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:04.183 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.182+0000 7f6c21e299c0 5 note: GC not initialized 2024-09-14T11:36:04.183 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.182+0000 7f6ad4fe1640 20 reqs_thread_entry: start 2024-09-14T11:36:04.184 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.182+0000 7f6c21e299c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:04.184 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.182+0000 7f6c21e299c0 20 Filter name: none 2024-09-14T11:36:04.184 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.186+0000 7f6a4e7fc640 20 reqs_thread_entry: start 2024-09-14T11:36:04.184 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.186+0000 7f6c21e299c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.185 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.186+0000 7f6c21e299c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:04.185 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.186+0000 7f6c21e299c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.186 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.186+0000 7f6c21e299c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:04.186 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.186+0000 7f6c21e299c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:04.186 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.186+0000 7f6c21e299c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.186+0000 7f6c21e299c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:04.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.186+0000 7f6c21e299c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.186+0000 7f6c21e299c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:04.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.190+0000 7f6c21e299c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:04.191 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.190+0000 7f6ad5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:04.195 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.194+0000 7f6c21e299c0 20 remove_watcher() i=0 2024-09-14T11:36:04.196 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.194+0000 7f6c21e299c0 2 removed watcher, disabling cache 2024-09-14T11:36:04.197 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.198+0000 7f6c21e299c0 20 remove_watcher() i=1 2024-09-14T11:36:04.200 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.198+0000 7f6c21e299c0 20 remove_watcher() i=2 2024-09-14T11:36:04.202 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.202+0000 7f6c21e299c0 20 remove_watcher() i=3 2024-09-14T11:36:04.204 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.202+0000 7f6c21e299c0 20 remove_watcher() i=4 2024-09-14T11:36:04.206 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.206+0000 7f6c21e299c0 20 remove_watcher() i=5 2024-09-14T11:36:04.208 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.210+0000 7f6c21e299c0 20 remove_watcher() i=6 2024-09-14T11:36:04.211 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.210+0000 7f6c21e299c0 20 remove_watcher() i=7 2024-09-14T11:36:04.229 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:36:04.229 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:36:04.229 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: myver id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.19 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-14T11:36:04.229 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:36:04.277 INFO:tasks.workunit.client.0.smithi071.stderr: test: reshard removes olh entries with empty name 2024-09-14T11:36:04.430 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:36:04.461 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:04.461 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:04.507 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.506+0000 7f85551ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.509 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.510+0000 7f85551ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:04.510 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.510+0000 7f85551ad9c0 20 realm 2024-09-14T11:36:04.510 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.510+0000 7f85551ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.510 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.510+0000 7f85551ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:04.511 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.510+0000 7f85551ad9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:04.511 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.510+0000 7f85551ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.511 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.510+0000 7f85551ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:04.511 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.510+0000 7f85551ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.511 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.510+0000 7f85551ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:04.511 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.510+0000 7f85551ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.514+0000 7f85551ad9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:04.512 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.514+0000 7f85551ad9c0 20 searching for the correct realm 2024-09-14T11:36:04.516 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.514+0000 7f85534b4640 0 -- 172.21.15.71:0/3242804385 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f8548017070 msgr2=0x7f8548077040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:04.728 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.730+0000 7f85534b4640 0 -- 172.21.15.71:0/3242804385 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x5576c34987a0 msgr2=0x5576c349ab90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:04.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.742+0000 7f85551ad9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:04.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.742+0000 7f85551ad9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:36:04.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.742+0000 7f85551ad9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:04.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.742+0000 7f85551ad9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:36:04.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.742+0000 7f85551ad9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:04.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.742+0000 7f85551ad9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:04.745 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.746+0000 7f85551ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.745 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.746+0000 7f85551ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:04.745 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.746+0000 7f85551ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.746 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.746+0000 7f85551ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:04.746 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.746+0000 7f85551ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.747 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.746+0000 7f85551ad9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:04.747 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.746+0000 7f85551ad9c0 20 zone default found 2024-09-14T11:36:04.747 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.746+0000 7f85551ad9c0 4 Realm: () 2024-09-14T11:36:04.747 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.746+0000 7f85551ad9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:36:04.747 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.746+0000 7f85551ad9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:36:04.747 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.746+0000 7f85551ad9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:04.747 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.746+0000 7f85551ad9c0 20 zonegroup default 2024-09-14T11:36:04.747 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.746+0000 7f85551ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.748 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.746+0000 7f85551ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:04.748 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.746+0000 7f85551ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.748 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.750+0000 7f85551ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:04.748 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.750+0000 7f85551ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.749 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.750+0000 7f85551ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:04.749 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.750+0000 7f85551ad9c0 20 started sync module instance, tier type = 2024-09-14T11:36:04.750 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.750+0000 7f85551ad9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:36:04.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.774+0000 7f85551ad9c0 20 add_watcher() i=0 2024-09-14T11:36:04.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.774+0000 7f85551ad9c0 20 add_watcher() i=1 2024-09-14T11:36:04.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.774+0000 7f85551ad9c0 20 add_watcher() i=2 2024-09-14T11:36:04.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.774+0000 7f85551ad9c0 20 add_watcher() i=3 2024-09-14T11:36:04.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.774+0000 7f85551ad9c0 20 add_watcher() i=4 2024-09-14T11:36:04.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.774+0000 7f85551ad9c0 20 add_watcher() i=5 2024-09-14T11:36:04.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.774+0000 7f85551ad9c0 20 add_watcher() i=6 2024-09-14T11:36:04.775 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.774+0000 7f85551ad9c0 20 add_watcher() i=7 2024-09-14T11:36:04.775 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.774+0000 7f85551ad9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:04.779 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.778+0000 7f84097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:04.780 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.782+0000 7f85551ad9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:04.780 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.782+0000 7f85551ad9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:04.780 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.782+0000 7f85551ad9c0 5 note: GC not initialized 2024-09-14T11:36:04.780 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.782+0000 7f8383fff640 20 reqs_thread_entry: start 2024-09-14T11:36:04.781 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.782+0000 7f85551ad9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:04.781 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.782+0000 7f85551ad9c0 20 Filter name: none 2024-09-14T11:36:04.781 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.782+0000 7f8381ffb640 20 reqs_thread_entry: start 2024-09-14T11:36:04.781 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.782+0000 7f85551ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.782 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.782+0000 7f85551ad9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:36:04.782 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.782+0000 7f85551ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.783 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.782+0000 7f85551ad9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:36:04.783 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.782+0000 7f85551ad9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:04.783 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.782+0000 7f85551ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.783 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.782+0000 7f85551ad9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:36:04.783 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.782+0000 7f85551ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.784 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.782+0000 7f85551ad9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:36:04.784 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.782+0000 7f85551ad9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:04.787 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.786+0000 7f84097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:04.791 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.790+0000 7f85551ad9c0 20 remove_watcher() i=0 2024-09-14T11:36:04.791 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.790+0000 7f85551ad9c0 2 removed watcher, disabling cache 2024-09-14T11:36:04.793 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.794+0000 7f85551ad9c0 20 remove_watcher() i=1 2024-09-14T11:36:04.795 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.794+0000 7f85551ad9c0 20 remove_watcher() i=2 2024-09-14T11:36:04.797 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.798+0000 7f85551ad9c0 20 remove_watcher() i=3 2024-09-14T11:36:04.799 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.798+0000 7f85551ad9c0 20 remove_watcher() i=4 2024-09-14T11:36:04.802 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.802+0000 7f85551ad9c0 20 remove_watcher() i=5 2024-09-14T11:36:04.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.806+0000 7f85551ad9c0 20 remove_watcher() i=6 2024-09-14T11:36:04.808 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.810+0000 7f85551ad9c0 20 remove_watcher() i=7 2024-09-14T11:36:04.832 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:36:04.832 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:36:04.832 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: a-bucket id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.18 num_objects: 0 size_kb: 0 num_shards: 13 2024-09-14T11:36:04.832 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:36:04.832 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-14T11:36:04.859 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:04.860 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:04.905 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.906+0000 7fa1ec2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.908 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.910+0000 7fa1ec2d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:04.908 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.910+0000 7fa1ec2d19c0 20 realm 2024-09-14T11:36:04.908 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.910+0000 7fa1ec2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.909 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.910+0000 7fa1ec2d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:04.909 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.910+0000 7fa1ec2d19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:04.909 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.910+0000 7fa1ec2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.909 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.910+0000 7fa1ec2d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:04.909 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.910+0000 7fa1ec2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.910 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.910+0000 7fa1ec2d19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:04.910 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.910+0000 7fa1ec2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:04.911 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.910+0000 7fa1ec2d19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:04.911 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.910+0000 7fa1ec2d19c0 20 searching for the correct realm 2024-09-14T11:36:04.915 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:04.914+0000 7fa1ea5d8640 0 -- 172.21.15.71:0/2990760219 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fa1e001a040 msgr2=0x7fa1e005de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:05.129 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.126+0000 7fa1ea5d8640 0 -- 172.21.15.71:0/2990760219 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55a139ae5820 msgr2=0x55a139ae7c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:05.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.142+0000 7fa1ec2d19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:05.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.142+0000 7fa1ec2d19c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:36:05.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.142+0000 7fa1ec2d19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:05.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.142+0000 7fa1ec2d19c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:36:05.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.142+0000 7fa1ec2d19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:05.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.142+0000 7fa1ec2d19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:05.143 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.142+0000 7fa1ec2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.142+0000 7fa1ec2d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.142+0000 7fa1ec2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.146+0000 7fa1ec2d19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:05.144 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.146+0000 7fa1ec2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.146+0000 7fa1ec2d19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:05.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.146+0000 7fa1ec2d19c0 20 zone default found 2024-09-14T11:36:05.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.146+0000 7fa1ec2d19c0 4 Realm: () 2024-09-14T11:36:05.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.146+0000 7fa1ec2d19c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:36:05.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.146+0000 7fa1ec2d19c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:36:05.145 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.146+0000 7fa1ec2d19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:05.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.146+0000 7fa1ec2d19c0 20 zonegroup default 2024-09-14T11:36:05.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.146+0000 7fa1ec2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.146+0000 7fa1ec2d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.146 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.146+0000 7fa1ec2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.147 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.146+0000 7fa1ec2d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.147 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.146+0000 7fa1ec2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.147 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.146+0000 7fa1ec2d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.147 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.146+0000 7fa1ec2d19c0 20 started sync module instance, tier type = 2024-09-14T11:36:05.148 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.146+0000 7fa1ec2d19c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:36:05.168 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.166+0000 7fa1ec2d19c0 20 add_watcher() i=0 2024-09-14T11:36:05.168 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.166+0000 7fa1ec2d19c0 20 add_watcher() i=1 2024-09-14T11:36:05.168 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.166+0000 7fa1ec2d19c0 20 add_watcher() i=2 2024-09-14T11:36:05.168 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.166+0000 7fa1ec2d19c0 20 add_watcher() i=3 2024-09-14T11:36:05.168 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.166+0000 7fa1ec2d19c0 20 add_watcher() i=4 2024-09-14T11:36:05.169 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.166+0000 7fa1ec2d19c0 20 add_watcher() i=5 2024-09-14T11:36:05.169 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.166+0000 7fa1ec2d19c0 20 add_watcher() i=6 2024-09-14T11:36:05.170 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.170+0000 7fa1ec2d19c0 20 add_watcher() i=7 2024-09-14T11:36:05.170 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.170+0000 7fa1ec2d19c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:05.174 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.174+0000 7fa09b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:05.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.174+0000 7fa1ec2d19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:05.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.174+0000 7fa1ec2d19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:05.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.174+0000 7fa1ec2d19c0 5 note: GC not initialized 2024-09-14T11:36:05.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.174+0000 7fa09a7fc640 20 reqs_thread_entry: start 2024-09-14T11:36:05.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.178+0000 7fa1ec2d19c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:05.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.178+0000 7fa1ec2d19c0 20 Filter name: none 2024-09-14T11:36:05.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.178+0000 7fa00bfff640 20 reqs_thread_entry: start 2024-09-14T11:36:05.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.178+0000 7fa1ec2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.178+0000 7fa1ec2d19c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:36:05.177 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.178+0000 7fa1ec2d19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.178 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.178+0000 7fa1ec2d19c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:36:05.178 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.178+0000 7fa1ec2d19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:05.179 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.178+0000 7fa09b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:05.184 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.186+0000 7fa1ec2d19c0 20 remove_watcher() i=0 2024-09-14T11:36:05.184 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.186+0000 7fa1ec2d19c0 2 removed watcher, disabling cache 2024-09-14T11:36:05.186 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.186+0000 7fa1ec2d19c0 20 remove_watcher() i=1 2024-09-14T11:36:05.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.190+0000 7fa1ec2d19c0 20 remove_watcher() i=2 2024-09-14T11:36:05.191 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.190+0000 7fa1ec2d19c0 20 remove_watcher() i=3 2024-09-14T11:36:05.193 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.194+0000 7fa1ec2d19c0 20 remove_watcher() i=4 2024-09-14T11:36:05.195 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.194+0000 7fa1ec2d19c0 20 remove_watcher() i=5 2024-09-14T11:36:05.198 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.198+0000 7fa1ec2d19c0 20 remove_watcher() i=6 2024-09-14T11:36:05.201 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.202+0000 7fa1ec2d19c0 20 remove_watcher() i=7 2024-09-14T11:36:05.217 INFO:tasks.workunit.client.0.smithi071.stderr:rados -p default.rgw.buckets.index setomapval .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-14T11:36:05.245 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:05.245 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:05.264 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-14T11:36:05.289 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:05.289 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:05.333 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.334+0000 7f4cfac229c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.335 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.334+0000 7f4cfac229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.335 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.334+0000 7f4cfac229c0 20 realm 2024-09-14T11:36:05.335 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.334+0000 7f4cfac229c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.336 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.334+0000 7f4cfac229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.336 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.334+0000 7f4cfac229c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:05.336 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.334+0000 7f4cfac229c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.336 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.338+0000 7f4cfac229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.336 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.338+0000 7f4cfac229c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.337 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.338+0000 7f4cfac229c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:05.337 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.338+0000 7f4cfac229c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.338 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.338+0000 7f4cfac229c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:05.338 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.338+0000 7f4cfac229c0 20 searching for the correct realm 2024-09-14T11:36:05.341 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.342+0000 7f4cf8f29640 0 -- 172.21.15.71:0/2220900183 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f4cec06fc20 msgr2=0x7f4cec072e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:05.556 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.558+0000 7f4cf8f29640 0 -- 172.21.15.71:0/2220900183 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x559d32b7a100 msgr2=0x559d32b7c4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:05.571 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.570+0000 7f4cfac229c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:05.571 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.570+0000 7f4cfac229c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:36:05.571 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.570+0000 7f4cfac229c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:05.571 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.570+0000 7f4cfac229c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:36:05.571 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.570+0000 7f4cfac229c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:05.571 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.570+0000 7f4cfac229c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:05.571 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.570+0000 7f4cfac229c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.572 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.570+0000 7f4cfac229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.572 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.570+0000 7f4cfac229c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.574+0000 7f4cfac229c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:05.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.574+0000 7f4cfac229c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.574+0000 7f4cfac229c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:05.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.574+0000 7f4cfac229c0 20 zone default found 2024-09-14T11:36:05.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.574+0000 7f4cfac229c0 4 Realm: () 2024-09-14T11:36:05.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.574+0000 7f4cfac229c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:36:05.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.574+0000 7f4cfac229c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:36:05.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.574+0000 7f4cfac229c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:05.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.574+0000 7f4cfac229c0 20 zonegroup default 2024-09-14T11:36:05.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.574+0000 7f4cfac229c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.574+0000 7f4cfac229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.575 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.574+0000 7f4cfac229c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.575 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.574+0000 7f4cfac229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.575 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.574+0000 7f4cfac229c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.576 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.578+0000 7f4cfac229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.576 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.578+0000 7f4cfac229c0 20 started sync module instance, tier type = 2024-09-14T11:36:05.576 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.578+0000 7f4cfac229c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:36:05.599 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.598+0000 7f4cfac229c0 20 add_watcher() i=0 2024-09-14T11:36:05.599 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.598+0000 7f4cfac229c0 20 add_watcher() i=1 2024-09-14T11:36:05.599 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.598+0000 7f4cfac229c0 20 add_watcher() i=2 2024-09-14T11:36:05.599 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.598+0000 7f4cfac229c0 20 add_watcher() i=3 2024-09-14T11:36:05.599 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.598+0000 7f4cfac229c0 20 add_watcher() i=4 2024-09-14T11:36:05.599 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.598+0000 7f4cfac229c0 20 add_watcher() i=5 2024-09-14T11:36:05.599 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.598+0000 7f4cfac229c0 20 add_watcher() i=6 2024-09-14T11:36:05.601 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.602+0000 7f4cfac229c0 20 add_watcher() i=7 2024-09-14T11:36:05.601 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.602+0000 7f4cfac229c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:05.605 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.606+0000 7f4baefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:05.606 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.606+0000 7f4cfac229c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:05.606 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.606+0000 7f4cfac229c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:05.606 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.606+0000 7f4cfac229c0 5 note: GC not initialized 2024-09-14T11:36:05.607 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.606+0000 7f4badfdb640 20 reqs_thread_entry: start 2024-09-14T11:36:05.607 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.606+0000 7f4cfac229c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:05.607 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.606+0000 7f4cfac229c0 20 Filter name: none 2024-09-14T11:36:05.607 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.606+0000 7f4b1f7fe640 20 reqs_thread_entry: start 2024-09-14T11:36:05.607 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.606+0000 7f4cfac229c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.606+0000 7f4cfac229c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:36:05.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.606+0000 7f4cfac229c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.610+0000 7f4cfac229c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:36:05.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.610+0000 7f4cfac229c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:05.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.610+0000 7f4cfac229c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:36:05.609 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.610+0000 7f4cfac229c0 20 INFO: main: starting shard=0 2024-09-14T11:36:05.609 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.610+0000 7f4cfac229c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.0 2024-09-14T11:36:05.609 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.610+0000 7f4cfac229c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.0 2024-09-14T11:36:05.609 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.610+0000 7f4cfac229c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:36:05.609 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.610+0000 7f4cfac229c0 20 INFO: main: starting shard=1 2024-09-14T11:36:05.609 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.610+0000 7f4cfac229c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.1 2024-09-14T11:36:05.609 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.610+0000 7f4cfac229c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.1 2024-09-14T11:36:05.610 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.610+0000 7f4cfac229c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:05.610 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.610+0000 7f4cfac229c0 20 INFO: main: starting shard=2 2024-09-14T11:36:05.611 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.610+0000 7f4cfac229c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.2 2024-09-14T11:36:05.611 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.610+0000 7f4cfac229c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.2 2024-09-14T11:36:05.611 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.610+0000 7f4cfac229c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:05.611 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.610+0000 7f4cfac229c0 20 INFO: main: starting shard=3 2024-09-14T11:36:05.611 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.610+0000 7f4cfac229c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.3 2024-09-14T11:36:05.611 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.610+0000 7f4cfac229c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.3 2024-09-14T11:36:05.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.610+0000 7f4cfac229c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:05.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.610+0000 7f4cfac229c0 20 INFO: main: starting shard=4 2024-09-14T11:36:05.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.610+0000 7f4cfac229c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.4 2024-09-14T11:36:05.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.610+0000 7f4cfac229c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.4 2024-09-14T11:36:05.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.614+0000 7f4cfac229c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:05.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.614+0000 7f4cfac229c0 20 INFO: main: starting shard=5 2024-09-14T11:36:05.613 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.614+0000 7f4cfac229c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.5 2024-09-14T11:36:05.613 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.614+0000 7f4cfac229c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.5 2024-09-14T11:36:05.614 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.614+0000 7f4cfac229c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:05.614 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.614+0000 7f4cfac229c0 20 INFO: main: starting shard=6 2024-09-14T11:36:05.614 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.614+0000 7f4cfac229c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.6 2024-09-14T11:36:05.614 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.614+0000 7f4cfac229c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.6 2024-09-14T11:36:05.614 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.614+0000 7f4cfac229c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:05.614 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.614+0000 7f4cfac229c0 20 INFO: main: starting shard=7 2024-09-14T11:36:05.614 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.614+0000 7f4cfac229c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.7 2024-09-14T11:36:05.615 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.614+0000 7f4cfac229c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.7 2024-09-14T11:36:05.615 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.614+0000 7f4cfac229c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:05.615 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.614+0000 7f4cfac229c0 20 INFO: main: starting shard=8 2024-09-14T11:36:05.615 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.614+0000 7f4cfac229c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.8 2024-09-14T11:36:05.615 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.614+0000 7f4cfac229c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.8 2024-09-14T11:36:05.616 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.618+0000 7f4cfac229c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:05.616 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.618+0000 7f4cfac229c0 20 INFO: main: starting shard=9 2024-09-14T11:36:05.616 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.618+0000 7f4cfac229c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.9 2024-09-14T11:36:05.616 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.618+0000 7f4cfac229c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.9 2024-09-14T11:36:05.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.618+0000 7f4cfac229c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:05.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.618+0000 7f4cfac229c0 20 INFO: main: starting shard=10 2024-09-14T11:36:05.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.618+0000 7f4cfac229c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.10 2024-09-14T11:36:05.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.618+0000 7f4cfac229c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.10 2024-09-14T11:36:05.618 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.618+0000 7f4cfac229c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:05.618 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.618+0000 7f4cfac229c0 20 INFO: main: starting shard=11 2024-09-14T11:36:05.618 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.618+0000 7f4cfac229c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.11 2024-09-14T11:36:05.618 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.618+0000 7f4cfac229c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.11 2024-09-14T11:36:05.619 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.618+0000 7f4cfac229c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:05.619 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.618+0000 7f4cfac229c0 20 INFO: main: starting shard=12 2024-09-14T11:36:05.619 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.618+0000 7f4cfac229c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.12 2024-09-14T11:36:05.619 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.618+0000 7f4cfac229c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.12 2024-09-14T11:36:05.620 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.622+0000 7f4cfac229c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:05.620 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.622+0000 7f4cfac229c0 20 INFO: main: done 2024-09-14T11:36:05.621 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.622+0000 7f4baefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:05.625 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.626+0000 7f4cfac229c0 20 remove_watcher() i=0 2024-09-14T11:36:05.625 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.626+0000 7f4cfac229c0 2 removed watcher, disabling cache 2024-09-14T11:36:05.627 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.626+0000 7f4cfac229c0 20 remove_watcher() i=1 2024-09-14T11:36:05.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.630+0000 7f4cfac229c0 20 remove_watcher() i=2 2024-09-14T11:36:05.632 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.634+0000 7f4cfac229c0 20 remove_watcher() i=3 2024-09-14T11:36:05.634 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.634+0000 7f4cfac229c0 20 remove_watcher() i=4 2024-09-14T11:36:05.636 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.638+0000 7f4cfac229c0 20 remove_watcher() i=5 2024-09-14T11:36:05.639 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.638+0000 7f4cfac229c0 20 remove_watcher() i=6 2024-09-14T11:36:05.641 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.642+0000 7f4cfac229c0 20 remove_watcher() i=7 2024-09-14T11:36:05.656 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-14T11:36:05.686 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:05.687 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:05.728 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.730+0000 7f9f713b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.731 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.730+0000 7f9f713b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.731 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.730+0000 7f9f713b89c0 20 realm 2024-09-14T11:36:05.731 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.730+0000 7f9f713b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.731 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.730+0000 7f9f713b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.731 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.730+0000 7f9f713b89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:05.732 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.730+0000 7f9f713b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.732 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.730+0000 7f9f713b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.732 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.730+0000 7f9f713b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.732 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.734+0000 7f9f713b89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:05.732 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.734+0000 7f9f713b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.733 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.734+0000 7f9f713b89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:05.733 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.734+0000 7f9f713b89c0 20 searching for the correct realm 2024-09-14T11:36:05.741 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.738+0000 7f9f6f6bf640 0 -- 172.21.15.71:0/2749478713 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f9f580ed040 msgr2=0x7f9f580ed930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:05.744 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.746+0000 7f9f6f6bf640 0 -- 172.21.15.71:0/2749478713 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x555c91d90720 msgr2=0x555c91d92b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:05.753 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.754+0000 7f9f713b89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:05.753 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.754+0000 7f9f713b89c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:36:05.753 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.754+0000 7f9f713b89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:05.753 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.754+0000 7f9f713b89c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:36:05.753 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.754+0000 7f9f713b89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:05.753 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.754+0000 7f9f713b89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:05.753 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.754+0000 7f9f713b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.754 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.754+0000 7f9f713b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.754 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.754+0000 7f9f713b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.754 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.754+0000 7f9f713b89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:05.754 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.754+0000 7f9f713b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.755 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.754+0000 7f9f713b89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:05.755 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.754+0000 7f9f713b89c0 20 zone default found 2024-09-14T11:36:05.755 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.754+0000 7f9f713b89c0 4 Realm: () 2024-09-14T11:36:05.755 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.754+0000 7f9f713b89c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:36:05.755 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.754+0000 7f9f713b89c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:36:05.755 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.754+0000 7f9f713b89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:05.755 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.754+0000 7f9f713b89c0 20 zonegroup default 2024-09-14T11:36:05.755 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.754+0000 7f9f713b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.756 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.754+0000 7f9f713b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.756 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.754+0000 7f9f713b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.756 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.754+0000 7f9f713b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.756 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.754+0000 7f9f713b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.756 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.758+0000 7f9f713b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.756 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.758+0000 7f9f713b89c0 20 started sync module instance, tier type = 2024-09-14T11:36:05.756 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.758+0000 7f9f713b89c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:36:05.773 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.774+0000 7f9f713b89c0 20 add_watcher() i=0 2024-09-14T11:36:05.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.774+0000 7f9f713b89c0 20 add_watcher() i=1 2024-09-14T11:36:05.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.774+0000 7f9f713b89c0 20 add_watcher() i=2 2024-09-14T11:36:05.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.774+0000 7f9f713b89c0 20 add_watcher() i=3 2024-09-14T11:36:05.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.774+0000 7f9f713b89c0 20 add_watcher() i=4 2024-09-14T11:36:05.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.774+0000 7f9f713b89c0 20 add_watcher() i=5 2024-09-14T11:36:05.774 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.774+0000 7f9f713b89c0 20 add_watcher() i=6 2024-09-14T11:36:05.776 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.778+0000 7f9f713b89c0 20 add_watcher() i=7 2024-09-14T11:36:05.776 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.778+0000 7f9f713b89c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:05.779 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.778+0000 7f9e257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:05.780 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.778+0000 7f9f713b89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:05.780 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.778+0000 7f9f713b89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:05.780 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.778+0000 7f9f713b89c0 5 note: GC not initialized 2024-09-14T11:36:05.781 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.782+0000 7f9d9ffff640 20 reqs_thread_entry: start 2024-09-14T11:36:05.781 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.782+0000 7f9f713b89c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:05.781 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.782+0000 7f9f713b89c0 20 Filter name: none 2024-09-14T11:36:05.781 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.782+0000 7f9d9dffb640 20 reqs_thread_entry: start 2024-09-14T11:36:05.781 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.782+0000 7f9f713b89c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:36:05.781 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.782+0000 7f9f713b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.782 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.782+0000 7f9f713b89c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:36:05.782 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.782+0000 7f9f713b89c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:36:05.782 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.782+0000 7f9f713b89c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:36:05.782 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.782+0000 7f9f713b89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 : miss 2024-09-14T11:36:05.782 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.782+0000 7f9f713b89c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.782 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.782+0000 7f9f713b89c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:36:05.782 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.782+0000 7f9f713b89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:36:05.782 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.782+0000 7f9f713b89c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:36:05.782 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.782+0000 7f9f713b89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:05.782 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.782+0000 7f9f713b89c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:05.782 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.782+0000 7f9f713b89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 2024-09-14T11:36:05.788 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.786+0000 7f9f713b89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:36:05.788 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.786+0000 7f9f713b89c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:36:05.788 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.786+0000 7f9f713b89c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:05.788 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.786+0000 7f9f713b89c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18, ofs0, ns] 2024-09-14T11:36:05.788 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.790+0000 7f9e51ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464430 cookie 93856072308384 notifier 8487 bl.length()=911 2024-09-14T11:36:05.788 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.790+0000 7f9e51ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:36:05.788 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.790+0000 7f9e51ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:36:05.788 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.790+0000 7f9e51ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:05.789 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.790+0000 7f9f713b89c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_sources= new_sources= 2024-09-14T11:36:05.789 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.790+0000 7f9f713b89c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential sources added=[] removed=[] 2024-09-14T11:36:05.789 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.790+0000 7f9f713b89c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_dests= new_dests= 2024-09-14T11:36:05.789 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.790+0000 7f9f713b89c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential dests added=[] removed=[] 2024-09-14T11:36:05.800 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.802+0000 7f9f713b89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.0 2024-09-14T11:36:05.800 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.802+0000 7f9f713b89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.0 2024-09-14T11:36:05.800 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.802+0000 7f9f713b89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.0 2024-09-14T11:36:05.800 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.802+0000 7f9f713b89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.0 2024-09-14T11:36:05.801 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.802+0000 7f9f713b89c0 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-14T11:36:05.801 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.802+0000 7f9f713b89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.1 2024-09-14T11:36:05.801 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.802+0000 7f9f713b89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.1 2024-09-14T11:36:05.802 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.802+0000 7f9f713b89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.2 2024-09-14T11:36:05.802 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.802+0000 7f9f713b89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.2 2024-09-14T11:36:05.802 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.802+0000 7f9f713b89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.3 2024-09-14T11:36:05.802 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.802+0000 7f9f713b89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.3 2024-09-14T11:36:05.803 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.802+0000 7f9f713b89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.4 2024-09-14T11:36:05.803 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.802+0000 7f9f713b89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.4 2024-09-14T11:36:05.803 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.802+0000 7f9f713b89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.5 2024-09-14T11:36:05.803 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.802+0000 7f9f713b89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.5 2024-09-14T11:36:05.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.806+0000 7f9f713b89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.6 2024-09-14T11:36:05.804 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.806+0000 7f9f713b89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.6 2024-09-14T11:36:05.805 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.806+0000 7f9f713b89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.7 2024-09-14T11:36:05.805 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.806+0000 7f9f713b89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.7 2024-09-14T11:36:05.805 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.806+0000 7f9f713b89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.8 2024-09-14T11:36:05.805 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.806+0000 7f9f713b89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.8 2024-09-14T11:36:05.806 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.806+0000 7f9f713b89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.9 2024-09-14T11:36:05.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.806+0000 7f9f713b89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.9 2024-09-14T11:36:05.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.806+0000 7f9f713b89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.10 2024-09-14T11:36:05.807 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.806+0000 7f9f713b89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.10 2024-09-14T11:36:05.808 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.810+0000 7f9f713b89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.11 2024-09-14T11:36:05.808 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.810+0000 7f9f713b89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.11 2024-09-14T11:36:05.809 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.810+0000 7f9f713b89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.12 2024-09-14T11:36:05.810 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.810+0000 7f9f713b89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.12 2024-09-14T11:36:05.810 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.810+0000 7f9f713b89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:05.810 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.810+0000 7f9f713b89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 2024-09-14T11:36:05.811 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.810+0000 7f9f713b89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:36:05.812 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.810+0000 7f9f713b89c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:36:05.812 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.810+0000 7f9f713b89c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:05.812 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.810+0000 7f9f713b89c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18, ofs0, ns] 2024-09-14T11:36:05.812 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.814+0000 7f9e51ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464431 cookie 93856072308384 notifier 8487 bl.length()=911 2024-09-14T11:36:05.812 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.814+0000 7f9e51ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:36:05.813 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.814+0000 7f9e51ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:36:05.813 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.814+0000 7f9e51ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:05.813 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.814+0000 7f9f713b89c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_sources= new_sources= 2024-09-14T11:36:05.813 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.814+0000 7f9f713b89c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential sources added=[] removed=[] 2024-09-14T11:36:05.813 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.814+0000 7f9f713b89c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_dests= new_dests= 2024-09-14T11:36:05.813 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.814+0000 7f9f713b89c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential dests added=[] removed=[] 2024-09-14T11:36:05.817 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.818+0000 7f9f713b89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.0 2024-09-14T11:36:05.817 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.818+0000 7f9f713b89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.0 2024-09-14T11:36:05.818 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.818+0000 7f9f713b89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.1 2024-09-14T11:36:05.818 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.818+0000 7f9f713b89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.1 2024-09-14T11:36:05.818 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.818+0000 7f9f713b89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.2 2024-09-14T11:36:05.818 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.818+0000 7f9f713b89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.2 2024-09-14T11:36:05.819 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.818+0000 7f9f713b89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.3 2024-09-14T11:36:05.819 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.818+0000 7f9f713b89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.3 2024-09-14T11:36:05.819 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.818+0000 7f9f713b89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.4 2024-09-14T11:36:05.819 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.818+0000 7f9f713b89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.4 2024-09-14T11:36:05.820 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.818+0000 7f9f713b89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.5 2024-09-14T11:36:05.820 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.818+0000 7f9f713b89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.5 2024-09-14T11:36:05.820 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.822+0000 7f9f713b89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.6 2024-09-14T11:36:05.820 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.822+0000 7f9f713b89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.6 2024-09-14T11:36:05.821 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.822+0000 7f9f713b89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.7 2024-09-14T11:36:05.821 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.822+0000 7f9f713b89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.7 2024-09-14T11:36:05.821 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.822+0000 7f9f713b89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.8 2024-09-14T11:36:05.821 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.822+0000 7f9f713b89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.8 2024-09-14T11:36:05.822 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.822+0000 7f9f713b89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.9 2024-09-14T11:36:05.822 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.822+0000 7f9f713b89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.9 2024-09-14T11:36:05.822 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.822+0000 7f9f713b89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.10 2024-09-14T11:36:05.822 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.822+0000 7f9f713b89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.10 2024-09-14T11:36:05.823 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.822+0000 7f9f713b89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.11 2024-09-14T11:36:05.823 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.822+0000 7f9f713b89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.11 2024-09-14T11:36:05.824 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.826+0000 7f9f713b89c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.12 2024-09-14T11:36:05.824 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.826+0000 7f9f713b89c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.2.12 2024-09-14T11:36:05.824 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.826+0000 7f9f713b89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:05.825 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.826+0000 7f9f713b89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 2024-09-14T11:36:05.826 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.826+0000 7f9f713b89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:36:05.826 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.826+0000 7f9f713b89c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:36:05.826 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.826+0000 7f9f713b89c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:05.826 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.826+0000 7f9f713b89c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18, ofs0, ns] 2024-09-14T11:36:05.827 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.826+0000 7f9e51ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464432 cookie 93856072308384 notifier 8487 bl.length()=879 2024-09-14T11:36:05.827 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.826+0000 7f9e51ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 info.flags=0x17 2024-09-14T11:36:05.827 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.826+0000 7f9e51ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.18 to cache LRU end 2024-09-14T11:36:05.827 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.826+0000 7f9e51ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:05.828 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.826+0000 7f9f713b89c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_sources= new_sources= 2024-09-14T11:36:05.828 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.826+0000 7f9f713b89c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential sources added=[] removed=[] 2024-09-14T11:36:05.828 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.826+0000 7f9f713b89c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): orig_dests= new_dests= 2024-09-14T11:36:05.828 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.826+0000 7f9f713b89c0 20 handle_bi_update(): bucket=:a-bucket[4444f441-0c56-48df-a905-d49e7e44d629.4596.18]): potential dests added=[] removed=[] 2024-09-14T11:36:05.831 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.830+0000 7f9f713b89c0 1 execute INFO: reshard of bucket "a-bucket" from 13 shards to 1 shards completed successfully 2024-09-14T11:36:05.835 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.834+0000 7f9e257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:05.839 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.838+0000 7f9f713b89c0 20 remove_watcher() i=0 2024-09-14T11:36:05.839 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.838+0000 7f9f713b89c0 2 removed watcher, disabling cache 2024-09-14T11:36:05.841 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.842+0000 7f9f713b89c0 20 remove_watcher() i=1 2024-09-14T11:36:05.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.842+0000 7f9f713b89c0 20 remove_watcher() i=2 2024-09-14T11:36:05.845 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.846+0000 7f9f713b89c0 20 remove_watcher() i=3 2024-09-14T11:36:05.847 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.846+0000 7f9f713b89c0 20 remove_watcher() i=4 2024-09-14T11:36:05.850 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.850+0000 7f9f713b89c0 20 remove_watcher() i=5 2024-09-14T11:36:05.852 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.854+0000 7f9f713b89c0 20 remove_watcher() i=6 2024-09-14T11:36:05.855 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.854+0000 7f9f713b89c0 20 remove_watcher() i=7 2024-09-14T11:36:05.871 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-14T11:36:05.900 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:05.901 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:05.945 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.946+0000 7f4e313ba9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.948 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.950+0000 7f4e313ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.948 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.950+0000 7f4e313ba9c0 20 realm 2024-09-14T11:36:05.948 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.950+0000 7f4e313ba9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.949 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.950+0000 7f4e313ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.949 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.950+0000 7f4e313ba9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:05.949 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.950+0000 7f4e313ba9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.949 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.950+0000 7f4e313ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.949 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.950+0000 7f4e313ba9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.950 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.950+0000 7f4e313ba9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:05.950 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.950+0000 7f4e313ba9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.951 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.950+0000 7f4e313ba9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:05.951 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.950+0000 7f4e313ba9c0 20 searching for the correct realm 2024-09-14T11:36:05.954 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:05.954+0000 7f4e2f6c1640 0 -- 172.21.15.71:0/3772983246 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f4e24076020 msgr2=0x7f4e24097ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:06.168 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.170+0000 7f4e2f6c1640 0 -- 172.21.15.71:0/3772983246 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x5615e28f1c00 msgr2=0x5615e28f3ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:06.182 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.182+0000 7f4e313ba9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:06.183 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.182+0000 7f4e313ba9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:36:06.183 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.182+0000 7f4e313ba9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:06.183 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.182+0000 7f4e313ba9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:36:06.183 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.182+0000 7f4e313ba9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:06.183 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.182+0000 7f4e313ba9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:06.183 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.182+0000 7f4e313ba9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.183 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.182+0000 7f4e313ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.183 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.182+0000 7f4e313ba9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.184 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.186+0000 7f4e313ba9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:06.184 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.186+0000 7f4e313ba9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.185 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.186+0000 7f4e313ba9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:06.185 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.186+0000 7f4e313ba9c0 20 zone default found 2024-09-14T11:36:06.185 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.186+0000 7f4e313ba9c0 4 Realm: () 2024-09-14T11:36:06.185 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.186+0000 7f4e313ba9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:36:06.185 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.186+0000 7f4e313ba9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:36:06.185 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.186+0000 7f4e313ba9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:06.186 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.186+0000 7f4e313ba9c0 20 zonegroup default 2024-09-14T11:36:06.186 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.186+0000 7f4e313ba9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.186 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.186+0000 7f4e313ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.186 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.186+0000 7f4e313ba9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.186 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.186+0000 7f4e313ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.186+0000 7f4e313ba9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.186+0000 7f4e313ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.186+0000 7f4e313ba9c0 20 started sync module instance, tier type = 2024-09-14T11:36:06.188 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.186+0000 7f4e313ba9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:36:06.210 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.210+0000 7f4e313ba9c0 20 add_watcher() i=0 2024-09-14T11:36:06.210 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.210+0000 7f4e313ba9c0 20 add_watcher() i=1 2024-09-14T11:36:06.210 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.210+0000 7f4e313ba9c0 20 add_watcher() i=2 2024-09-14T11:36:06.210 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.210+0000 7f4e313ba9c0 20 add_watcher() i=3 2024-09-14T11:36:06.211 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.210+0000 7f4e313ba9c0 20 add_watcher() i=4 2024-09-14T11:36:06.211 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.210+0000 7f4e313ba9c0 20 add_watcher() i=5 2024-09-14T11:36:06.211 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.210+0000 7f4e313ba9c0 20 add_watcher() i=6 2024-09-14T11:36:06.213 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.214+0000 7f4e313ba9c0 20 add_watcher() i=7 2024-09-14T11:36:06.213 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.214+0000 7f4e313ba9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:06.217 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.218+0000 7f4ce57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:06.218 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.218+0000 7f4e313ba9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:06.218 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.218+0000 7f4e313ba9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:06.218 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.218+0000 7f4e313ba9c0 5 note: GC not initialized 2024-09-14T11:36:06.219 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.218+0000 7f4c5ffff640 20 reqs_thread_entry: start 2024-09-14T11:36:06.219 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.218+0000 7f4e313ba9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:06.219 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.218+0000 7f4e313ba9c0 20 Filter name: none 2024-09-14T11:36:06.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.218+0000 7f4c5dffb640 20 reqs_thread_entry: start 2024-09-14T11:36:06.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.218+0000 7f4e313ba9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.222+0000 7f4e313ba9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:36:06.220 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.222+0000 7f4e313ba9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.221 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.222+0000 7f4e313ba9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:36:06.221 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.222+0000 7f4e313ba9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:06.221 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.222+0000 7f4e313ba9c0 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-14T11:36:06.221 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.222+0000 7f4e313ba9c0 20 INFO: main: starting shard=0 2024-09-14T11:36:06.221 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.222+0000 7f4e313ba9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.0 2024-09-14T11:36:06.221 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.222+0000 7f4e313ba9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.18.3.0 2024-09-14T11:36:06.223 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.222+0000 7f4e313ba9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:06.223 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.222+0000 7f4e313ba9c0 20 INFO: main: done 2024-09-14T11:36:06.224 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.226+0000 7f4ce57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:06.228 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.230+0000 7f4e313ba9c0 20 remove_watcher() i=0 2024-09-14T11:36:06.229 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.230+0000 7f4e313ba9c0 2 removed watcher, disabling cache 2024-09-14T11:36:06.231 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.230+0000 7f4e313ba9c0 20 remove_watcher() i=1 2024-09-14T11:36:06.233 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.234+0000 7f4e313ba9c0 20 remove_watcher() i=2 2024-09-14T11:36:06.236 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.234+0000 7f4e313ba9c0 20 remove_watcher() i=3 2024-09-14T11:36:06.238 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.238+0000 7f4e313ba9c0 20 remove_watcher() i=4 2024-09-14T11:36:06.240 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.242+0000 7f4e313ba9c0 20 remove_watcher() i=5 2024-09-14T11:36:06.243 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.242+0000 7f4e313ba9c0 20 remove_watcher() i=6 2024-09-14T11:36:06.246 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.246+0000 7f4e313ba9c0 20 remove_watcher() i=7 2024-09-14T11:36:06.269 INFO:tasks.workunit.client.0.smithi071.stderr: test: PUT succeeds during reshard 2024-09-14T11:36:06.269 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:36:06.296 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:06.296 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:06.537 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.538+0000 7fbcbe618640 0 --2- 172.21.15.71:0/4183267800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c09c059490 0x55c09c04f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:36:06.546 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.546+0000 7fbcc0b129c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.548 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.550+0000 7fbcc0b129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.548 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.550+0000 7fbcc0b129c0 20 realm 2024-09-14T11:36:06.548 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.550+0000 7fbcc0b129c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.549 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.550+0000 7fbcc0b129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.549 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.550+0000 7fbcc0b129c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:06.549 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.550+0000 7fbcc0b129c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.549 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.550+0000 7fbcc0b129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.549 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.550+0000 7fbcc0b129c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.550 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.550+0000 7fbcc0b129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:06.550 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.550+0000 7fbcc0b129c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.551 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.550+0000 7fbcc0b129c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:06.551 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.550+0000 7fbcc0b129c0 20 searching for the correct realm 2024-09-14T11:36:06.553 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.554+0000 7fbcbde17640 0 -- 172.21.15.71:0/1771000849 >> [v2:172.21.15.71:6824/2436891866,v1:172.21.15.71:6825/2436891866] conn(0x7fbcb0024030 msgr2=0x7fbcb0049400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:06.768 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.770+0000 7fbcbee19640 0 -- 172.21.15.71:0/1771000849 >> [v2:172.21.15.157:6816/1231501119,v1:172.21.15.157:6817/1231501119] conn(0x55c09c0761e0 msgr2=0x55c09c078640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:06.785 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.786+0000 7fbcc0b129c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:06.785 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.786+0000 7fbcc0b129c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:36:06.786 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.786+0000 7fbcc0b129c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:06.786 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.786+0000 7fbcc0b129c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:36:06.786 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.786+0000 7fbcc0b129c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:06.786 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.786+0000 7fbcc0b129c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:06.786 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.786+0000 7fbcc0b129c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.786 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.786+0000 7fbcc0b129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.786 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.786+0000 7fbcc0b129c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.787 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.786+0000 7fbcc0b129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:06.787 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.786+0000 7fbcc0b129c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.788 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.786+0000 7fbcc0b129c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:06.788 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.790+0000 7fbcc0b129c0 20 zone default found 2024-09-14T11:36:06.788 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.790+0000 7fbcc0b129c0 4 Realm: () 2024-09-14T11:36:06.788 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.790+0000 7fbcc0b129c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:36:06.788 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.790+0000 7fbcc0b129c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:36:06.788 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.790+0000 7fbcc0b129c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:06.788 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.790+0000 7fbcc0b129c0 20 zonegroup default 2024-09-14T11:36:06.788 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.790+0000 7fbcc0b129c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.789 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.790+0000 7fbcc0b129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.789 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.790+0000 7fbcc0b129c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.789 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.790+0000 7fbcc0b129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.790 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.790+0000 7fbcc0b129c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.790 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.790+0000 7fbcc0b129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.791 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.790+0000 7fbcc0b129c0 20 started sync module instance, tier type = 2024-09-14T11:36:06.791 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.790+0000 7fbcc0b129c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:36:06.813 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.814+0000 7fbcc0b129c0 20 add_watcher() i=0 2024-09-14T11:36:06.813 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.814+0000 7fbcc0b129c0 20 add_watcher() i=1 2024-09-14T11:36:06.813 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.814+0000 7fbcc0b129c0 20 add_watcher() i=2 2024-09-14T11:36:06.813 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.814+0000 7fbcc0b129c0 20 add_watcher() i=3 2024-09-14T11:36:06.813 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.814+0000 7fbcc0b129c0 20 add_watcher() i=4 2024-09-14T11:36:06.813 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.814+0000 7fbcc0b129c0 20 add_watcher() i=5 2024-09-14T11:36:06.813 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.814+0000 7fbcc0b129c0 20 add_watcher() i=6 2024-09-14T11:36:06.815 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.814+0000 7fbcc0b129c0 20 add_watcher() i=7 2024-09-14T11:36:06.815 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.814+0000 7fbcc0b129c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:06.819 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.818+0000 7fbb74fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:06.820 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.822+0000 7fbcc0b129c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:06.820 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.822+0000 7fbcc0b129c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:06.820 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.822+0000 7fbcc0b129c0 5 note: GC not initialized 2024-09-14T11:36:06.821 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.822+0000 7fbaef7fe640 20 reqs_thread_entry: start 2024-09-14T11:36:06.821 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.822+0000 7fbcc0b129c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:06.821 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.822+0000 7fbcc0b129c0 20 Filter name: none 2024-09-14T11:36:06.821 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.822+0000 7fbcc0b129c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.821 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.822+0000 7fbaed7fa640 20 reqs_thread_entry: start 2024-09-14T11:36:06.822 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.822+0000 7fbcc0b129c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:06.822 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.822+0000 7fbcc0b129c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.823 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.822+0000 7fbcc0b129c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:06.823 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.822+0000 7fbcc0b129c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:06.823 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.822+0000 7fbcc0b129c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.824 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.826+0000 7fbcc0b129c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:06.824 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.826+0000 7fbcc0b129c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.825 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.826+0000 7fbcc0b129c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:06.825 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.826+0000 7fbcc0b129c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:06.828 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.830+0000 7fbb74fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:06.837 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.838+0000 7fbcc0b129c0 20 remove_watcher() i=0 2024-09-14T11:36:06.837 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.838+0000 7fbcc0b129c0 2 removed watcher, disabling cache 2024-09-14T11:36:06.839 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.838+0000 7fbcc0b129c0 20 remove_watcher() i=1 2024-09-14T11:36:06.841 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.842+0000 7fbcc0b129c0 20 remove_watcher() i=2 2024-09-14T11:36:06.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.842+0000 7fbcc0b129c0 20 remove_watcher() i=3 2024-09-14T11:36:06.845 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.846+0000 7fbcc0b129c0 20 remove_watcher() i=4 2024-09-14T11:36:06.847 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.846+0000 7fbcc0b129c0 20 remove_watcher() i=5 2024-09-14T11:36:06.850 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.850+0000 7fbcc0b129c0 20 remove_watcher() i=6 2024-09-14T11:36:06.852 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.854+0000 7fbcc0b129c0 20 remove_watcher() i=7 2024-09-14T11:36:06.867 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:36:06.867 INFO:tasks.workunit.client.0.smithi071.stderr:BUCKET_STATS: 2024-09-14T11:36:06.867 INFO:tasks.workunit.client.0.smithi071.stderr:bucket: myver id: 4444f441-0c56-48df-a905-d49e7e44d629.4596.19 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-14T11:36:06.867 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:36:06.867 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-09-14T11:36:06.899 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:06.899 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:06.944 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.946+0000 7f1dd3b689c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.946 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.946+0000 7f1dd3b689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.946 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.946+0000 7f1dd3b689c0 20 realm 2024-09-14T11:36:06.946 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.946+0000 7f1dd3b689c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.947 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.946+0000 7f1dd3b689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.947 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.946+0000 7f1dd3b689c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:06.947 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.946+0000 7f1dd3b689c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.947 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.946+0000 7f1dd3b689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.947 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.946+0000 7f1dd3b689c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.948 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.950+0000 7f1dd3b689c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:06.948 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.950+0000 7f1dd3b689c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.949 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.950+0000 7f1dd3b689c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:06.949 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.950+0000 7f1dd3b689c0 20 searching for the correct realm 2024-09-14T11:36:06.952 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:06.954+0000 7f1dd1e6f640 0 -- 172.21.15.71:0/1161140097 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x5654bc93b840 msgr2=0x7f1dbc108190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:07.568 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.566+0000 7f1dc8e6d640 0 -- 172.21.15.71:0/1161140097 >> [v2:172.21.15.157:6800/3420822707,v1:172.21.15.157:6801/3420822707] conn(0x7f1dbc106040 msgr2=0x7f1dbc0b9740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:07.580 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.582+0000 7f1dd3b689c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:07.581 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.582+0000 7f1dd3b689c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:36:07.581 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.582+0000 7f1dd3b689c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:07.581 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.582+0000 7f1dd3b689c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:36:07.581 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.582+0000 7f1dd3b689c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:07.581 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.582+0000 7f1dd3b689c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:07.581 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.582+0000 7f1dd3b689c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.581 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.582+0000 7f1dd3b689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:07.581 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.582+0000 7f1dd3b689c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.582 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.582+0000 7f1dd3b689c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:07.582 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.582+0000 7f1dd3b689c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.583 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.582+0000 7f1dd3b689c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:07.583 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.582+0000 7f1dd3b689c0 20 zone default found 2024-09-14T11:36:07.583 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.582+0000 7f1dd3b689c0 4 Realm: () 2024-09-14T11:36:07.583 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.582+0000 7f1dd3b689c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:36:07.584 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.582+0000 7f1dd3b689c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:36:07.584 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.582+0000 7f1dd3b689c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:07.584 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.582+0000 7f1dd3b689c0 20 zonegroup default 2024-09-14T11:36:07.584 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.582+0000 7f1dd3b689c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.584 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.582+0000 7f1dd3b689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:07.584 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.582+0000 7f1dd3b689c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.585 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.586+0000 7f1dd3b689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:07.585 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.586+0000 7f1dd3b689c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.585 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.586+0000 7f1dd3b689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:07.586 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.586+0000 7f1dd3b689c0 20 started sync module instance, tier type = 2024-09-14T11:36:07.586 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.586+0000 7f1dd3b689c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:36:07.607 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.606+0000 7f1dd3b689c0 20 add_watcher() i=0 2024-09-14T11:36:07.607 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.606+0000 7f1dd3b689c0 20 add_watcher() i=1 2024-09-14T11:36:07.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.606+0000 7f1dd3b689c0 20 add_watcher() i=2 2024-09-14T11:36:07.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.606+0000 7f1dd3b689c0 20 add_watcher() i=3 2024-09-14T11:36:07.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.606+0000 7f1dd3b689c0 20 add_watcher() i=4 2024-09-14T11:36:07.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.606+0000 7f1dd3b689c0 20 add_watcher() i=5 2024-09-14T11:36:07.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.606+0000 7f1dd3b689c0 20 add_watcher() i=6 2024-09-14T11:36:07.610 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.610+0000 7f1dd3b689c0 20 add_watcher() i=7 2024-09-14T11:36:07.610 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.610+0000 7f1dd3b689c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:07.614 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.614+0000 7f1c877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:07.615 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.614+0000 7f1dd3b689c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:07.615 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.614+0000 7f1dd3b689c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:07.615 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.614+0000 7f1dd3b689c0 5 note: GC not initialized 2024-09-14T11:36:07.615 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.614+0000 7f1c867e4640 20 reqs_thread_entry: start 2024-09-14T11:36:07.615 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.614+0000 7f1dd3b689c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:07.616 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.614+0000 7f1dd3b689c0 20 Filter name: none 2024-09-14T11:36:07.616 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.614+0000 7f1bf7fff640 20 reqs_thread_entry: start 2024-09-14T11:36:07.616 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.614+0000 7f1dd3b689c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:36:07.616 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.614+0000 7f1dd3b689c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.618+0000 7f1dd3b689c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:07.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.618+0000 7f1dd3b689c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:36:07.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.618+0000 7f1dd3b689c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:36:07.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.618+0000 7f1dd3b689c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 : miss 2024-09-14T11:36:07.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.618+0000 7f1dd3b689c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.618+0000 7f1dd3b689c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:07.618 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.618+0000 7f1dd3b689c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 info.flags=0x17 2024-09-14T11:36:07.618 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.618+0000 7f1dd3b689c0 10 adding default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 to cache LRU end 2024-09-14T11:36:07.618 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.618+0000 7f1dd3b689c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:07.618 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.618+0000 7f1dd3b689c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:07.618 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.618+0000 7f1dd3b689c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 2024-09-14T11:36:07.627 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.626+0000 7f1dd3b689c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 info.flags=0x17 2024-09-14T11:36:07.627 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.626+0000 7f1dd3b689c0 10 moving default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 to cache LRU end 2024-09-14T11:36:07.627 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.626+0000 7f1dd3b689c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:07.627 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.626+0000 7f1dd3b689c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19, ofs0, ns] 2024-09-14T11:36:07.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.630+0000 7f1cb4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464385 cookie 94921941429824 notifier 8114 bl.length()=905 2024-09-14T11:36:07.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.630+0000 7f1cb4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 info.flags=0x17 2024-09-14T11:36:07.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.630+0000 7f1cb4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 to cache LRU end 2024-09-14T11:36:07.628 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.630+0000 7f1cb4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:07.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.630+0000 7f1dd3b689c0 20 handle_bi_update(): bucket=:myver[4444f441-0c56-48df-a905-d49e7e44d629.4596.19]): orig_sources= new_sources= 2024-09-14T11:36:07.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.630+0000 7f1dd3b689c0 20 handle_bi_update(): bucket=:myver[4444f441-0c56-48df-a905-d49e7e44d629.4596.19]): potential sources added=[] removed=[] 2024-09-14T11:36:07.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.630+0000 7f1dd3b689c0 20 handle_bi_update(): bucket=:myver[4444f441-0c56-48df-a905-d49e7e44d629.4596.19]): orig_dests= new_dests= 2024-09-14T11:36:07.629 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.630+0000 7f1dd3b689c0 20 handle_bi_update(): bucket=:myver[4444f441-0c56-48df-a905-d49e7e44d629.4596.19]): potential dests added=[] removed=[] 2024-09-14T11:36:07.640 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:07.642+0000 7f1dd3b689c0 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-14T11:36:07.901 INFO:tasks.workunit.client.0.smithi071.stderr:put object successful 2024-09-14T11:36:12.641 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.642+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.0 2024-09-14T11:36:12.641 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.642+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.0 2024-09-14T11:36:12.641 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.642+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.1 2024-09-14T11:36:12.641 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.642+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.1 2024-09-14T11:36:12.641 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.642+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.2 2024-09-14T11:36:12.641 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.642+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.2 2024-09-14T11:36:12.641 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.642+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.3 2024-09-14T11:36:12.641 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.642+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.3 2024-09-14T11:36:12.641 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.642+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.4 2024-09-14T11:36:12.642 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.642+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.4 2024-09-14T11:36:12.642 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.642+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.5 2024-09-14T11:36:12.642 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.642+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.5 2024-09-14T11:36:12.642 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.642+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.6 2024-09-14T11:36:12.642 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.642+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.6 2024-09-14T11:36:12.642 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.642+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.7 2024-09-14T11:36:12.642 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.642+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.7 2024-09-14T11:36:12.642 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.642+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.8 2024-09-14T11:36:12.642 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.642+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.8 2024-09-14T11:36:12.642 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.642+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.9 2024-09-14T11:36:12.642 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.642+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.9 2024-09-14T11:36:12.642 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.642+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.10 2024-09-14T11:36:12.642 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.642+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.10 2024-09-14T11:36:12.643 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.642+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.11 2024-09-14T11:36:12.643 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.642+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.11 2024-09-14T11:36:12.643 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.642+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.12 2024-09-14T11:36:12.643 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.642+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.12 2024-09-14T11:36:12.643 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.642+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.0 2024-09-14T11:36:12.643 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.642+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.0 2024-09-14T11:36:12.643 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.642+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.1 2024-09-14T11:36:12.643 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.642+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.1 2024-09-14T11:36:12.644 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.642+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.2 2024-09-14T11:36:12.644 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.642+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.2 2024-09-14T11:36:12.645 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.646+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.3 2024-09-14T11:36:12.645 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.646+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.3 2024-09-14T11:36:12.646 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.646+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.4 2024-09-14T11:36:12.646 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.646+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.4 2024-09-14T11:36:12.647 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.646+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.5 2024-09-14T11:36:12.648 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.646+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.5 2024-09-14T11:36:12.649 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.650+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.6 2024-09-14T11:36:12.649 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.650+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.6 2024-09-14T11:36:12.650 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.650+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.7 2024-09-14T11:36:12.650 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.650+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.7 2024-09-14T11:36:12.652 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.650+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.8 2024-09-14T11:36:12.652 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.650+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.8 2024-09-14T11:36:12.653 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.654+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.9 2024-09-14T11:36:12.653 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.654+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.9 2024-09-14T11:36:12.654 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.654+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.10 2024-09-14T11:36:12.654 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.654+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.10 2024-09-14T11:36:12.655 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.654+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.11 2024-09-14T11:36:12.655 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.654+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.11 2024-09-14T11:36:12.660 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.658+0000 7f1dd3b689c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:12.660 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.662+0000 7f1dd3b689c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 2024-09-14T11:36:12.663 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.662+0000 7f1dd3b689c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 info.flags=0x17 2024-09-14T11:36:12.663 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.662+0000 7f1dd3b689c0 10 moving default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 to cache LRU end 2024-09-14T11:36:12.663 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.662+0000 7f1dd3b689c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:12.663 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.662+0000 7f1dd3b689c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19, ofs0, ns] 2024-09-14T11:36:12.664 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.662+0000 7f1cb4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464386 cookie 94921941429824 notifier 8114 bl.length()=905 2024-09-14T11:36:12.664 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.662+0000 7f1cb4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 info.flags=0x17 2024-09-14T11:36:12.664 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.662+0000 7f1cb4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 to cache LRU end 2024-09-14T11:36:12.664 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.662+0000 7f1cb4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:12.665 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.666+0000 7f1dd3b689c0 20 handle_bi_update(): bucket=:myver[4444f441-0c56-48df-a905-d49e7e44d629.4596.19]): orig_sources= new_sources= 2024-09-14T11:36:12.665 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.666+0000 7f1dd3b689c0 20 handle_bi_update(): bucket=:myver[4444f441-0c56-48df-a905-d49e7e44d629.4596.19]): potential sources added=[] removed=[] 2024-09-14T11:36:12.666 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.666+0000 7f1dd3b689c0 20 handle_bi_update(): bucket=:myver[4444f441-0c56-48df-a905-d49e7e44d629.4596.19]): orig_dests= new_dests= 2024-09-14T11:36:12.666 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.666+0000 7f1dd3b689c0 20 handle_bi_update(): bucket=:myver[4444f441-0c56-48df-a905-d49e7e44d629.4596.19]): potential dests added=[] removed=[] 2024-09-14T11:36:12.672 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.670+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.0 2024-09-14T11:36:12.672 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.670+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.0 2024-09-14T11:36:12.672 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.674+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.1 2024-09-14T11:36:12.673 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.674+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.1 2024-09-14T11:36:12.673 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.674+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.2 2024-09-14T11:36:12.673 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.674+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.2 2024-09-14T11:36:12.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.674+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.3 2024-09-14T11:36:12.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.674+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.3 2024-09-14T11:36:12.675 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.674+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.4 2024-09-14T11:36:12.675 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.674+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.4 2024-09-14T11:36:12.676 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.678+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.5 2024-09-14T11:36:12.676 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.678+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.5 2024-09-14T11:36:12.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.678+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.6 2024-09-14T11:36:12.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.678+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.6 2024-09-14T11:36:12.678 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.678+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.7 2024-09-14T11:36:12.678 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.678+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.7 2024-09-14T11:36:12.678 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.678+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.8 2024-09-14T11:36:12.679 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.678+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.8 2024-09-14T11:36:12.679 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.678+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.9 2024-09-14T11:36:12.679 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.678+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.9 2024-09-14T11:36:12.680 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.682+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.10 2024-09-14T11:36:12.680 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.682+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.10 2024-09-14T11:36:12.681 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.682+0000 7f1dd3b689c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.11 2024-09-14T11:36:12.681 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.682+0000 7f1dd3b689c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.1.11 2024-09-14T11:36:12.687 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.686+0000 7f1dd3b689c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:12.687 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.686+0000 7f1dd3b689c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 2024-09-14T11:36:12.690 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.690+0000 7f1dd3b689c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 info.flags=0x17 2024-09-14T11:36:12.690 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.690+0000 7f1dd3b689c0 10 moving default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 to cache LRU end 2024-09-14T11:36:12.690 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.690+0000 7f1dd3b689c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:12.690 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.690+0000 7f1dd3b689c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19, ofs0, ns] 2024-09-14T11:36:12.690 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.690+0000 7f1ca3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464387 cookie 94921941429824 notifier 8114 bl.length()=873 2024-09-14T11:36:12.690 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.690+0000 7f1ca3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 info.flags=0x17 2024-09-14T11:36:12.691 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.690+0000 7f1ca3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 to cache LRU end 2024-09-14T11:36:12.691 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.690+0000 7f1ca3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:12.692 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.690+0000 7f1dd3b689c0 20 handle_bi_update(): bucket=:myver[4444f441-0c56-48df-a905-d49e7e44d629.4596.19]): orig_sources= new_sources= 2024-09-14T11:36:12.692 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.690+0000 7f1dd3b689c0 20 handle_bi_update(): bucket=:myver[4444f441-0c56-48df-a905-d49e7e44d629.4596.19]): potential sources added=[] removed=[] 2024-09-14T11:36:12.692 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.690+0000 7f1dd3b689c0 20 handle_bi_update(): bucket=:myver[4444f441-0c56-48df-a905-d49e7e44d629.4596.19]): orig_dests= new_dests= 2024-09-14T11:36:12.692 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.690+0000 7f1dd3b689c0 20 handle_bi_update(): bucket=:myver[4444f441-0c56-48df-a905-d49e7e44d629.4596.19]): potential dests added=[] removed=[] 2024-09-14T11:36:12.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.698+0000 7f1dd3b689c0 1 execute INFO: reshard of bucket "myver" from 12 shards to 13 shards completed successfully 2024-09-14T11:36:12.704 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.706+0000 7f1c877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:12.710 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.710+0000 7f1dd3b689c0 20 remove_watcher() i=0 2024-09-14T11:36:12.710 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.710+0000 7f1dd3b689c0 2 removed watcher, disabling cache 2024-09-14T11:36:12.712 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.714+0000 7f1dd3b689c0 20 remove_watcher() i=1 2024-09-14T11:36:12.715 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.714+0000 7f1dd3b689c0 20 remove_watcher() i=2 2024-09-14T11:36:12.718 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.718+0000 7f1dd3b689c0 20 remove_watcher() i=3 2024-09-14T11:36:12.720 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.722+0000 7f1dd3b689c0 20 remove_watcher() i=4 2024-09-14T11:36:12.723 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.722+0000 7f1dd3b689c0 20 remove_watcher() i=5 2024-09-14T11:36:12.726 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.726+0000 7f1dd3b689c0 20 remove_watcher() i=6 2024-09-14T11:36:12.728 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:12.730+0000 7f1dd3b689c0 20 remove_watcher() i=7 2024-09-14T11:36:12.904 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-14T11:36:12.904 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:36:13.089 INFO:tasks.workunit.client.0.smithi071.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:36:13.530 INFO:tasks.workunit.client.0.smithi071.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T11:36:15.033 INFO:tasks.workunit.client.0.smithi071.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:36:15.034 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-14T11:36:15.071 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:15.071 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:15.327 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.326+0000 7f6d0bb069c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.330 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.330+0000 7f6d0bb069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:15.330 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.330+0000 7f6d0bb069c0 20 realm 2024-09-14T11:36:15.330 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.330+0000 7f6d0bb069c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.331 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.330+0000 7f6d0bb069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:15.331 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.330+0000 7f6d0bb069c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:15.331 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.330+0000 7f6d0bb069c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.331 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.330+0000 7f6d0bb069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:15.331 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.330+0000 7f6d0bb069c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.332 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.334+0000 7f6d0bb069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:15.332 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.334+0000 7f6d0bb069c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.333 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.334+0000 7f6d0bb069c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:15.333 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.334+0000 7f6d0bb069c0 20 searching for the correct realm 2024-09-14T11:36:15.337 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.338+0000 7f6d09e0d640 0 -- 172.21.15.71:0/915130749 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f6cf4008040 msgr2=0x7f6cf40668d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:15.551 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.550+0000 7f6d09e0d640 0 -- 172.21.15.71:0/915130749 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x5609e3973280 msgr2=0x5609e3975670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:15.565 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.566+0000 7f6d0bb069c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:15.565 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.566+0000 7f6d0bb069c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:36:15.565 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.566+0000 7f6d0bb069c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:15.565 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.566+0000 7f6d0bb069c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:36:15.565 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.566+0000 7f6d0bb069c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:15.565 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.566+0000 7f6d0bb069c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:15.565 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.566+0000 7f6d0bb069c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.566 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.566+0000 7f6d0bb069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:15.566 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.566+0000 7f6d0bb069c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.566 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.566+0000 7f6d0bb069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:15.567 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.566+0000 7f6d0bb069c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.568 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.566+0000 7f6d0bb069c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:15.568 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.566+0000 7f6d0bb069c0 20 zone default found 2024-09-14T11:36:15.568 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.566+0000 7f6d0bb069c0 4 Realm: () 2024-09-14T11:36:15.568 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.566+0000 7f6d0bb069c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:36:15.569 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.566+0000 7f6d0bb069c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:36:15.569 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.566+0000 7f6d0bb069c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:15.569 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.566+0000 7f6d0bb069c0 20 zonegroup default 2024-09-14T11:36:15.569 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.566+0000 7f6d0bb069c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.569 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.570+0000 7f6d0bb069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:15.569 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.570+0000 7f6d0bb069c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.569 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.570+0000 7f6d0bb069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:15.569 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.570+0000 7f6d0bb069c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.570 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.570+0000 7f6d0bb069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:15.570 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.570+0000 7f6d0bb069c0 20 started sync module instance, tier type = 2024-09-14T11:36:15.570 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.570+0000 7f6d0bb069c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:36:15.593 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.594+0000 7f6d0bb069c0 20 add_watcher() i=0 2024-09-14T11:36:15.593 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.594+0000 7f6d0bb069c0 20 add_watcher() i=1 2024-09-14T11:36:15.593 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.594+0000 7f6d0bb069c0 20 add_watcher() i=2 2024-09-14T11:36:15.593 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.594+0000 7f6d0bb069c0 20 add_watcher() i=3 2024-09-14T11:36:15.593 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.594+0000 7f6d0bb069c0 20 add_watcher() i=4 2024-09-14T11:36:15.593 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.594+0000 7f6d0bb069c0 20 add_watcher() i=5 2024-09-14T11:36:15.593 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.594+0000 7f6d0bb069c0 20 add_watcher() i=6 2024-09-14T11:36:15.595 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.594+0000 7f6d0bb069c0 20 add_watcher() i=7 2024-09-14T11:36:15.595 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.594+0000 7f6d0bb069c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:15.599 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.598+0000 7f6bbf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:15.600 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.602+0000 7f6d0bb069c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:15.601 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.602+0000 7f6d0bb069c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:15.601 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.602+0000 7f6d0bb069c0 5 note: GC not initialized 2024-09-14T11:36:15.602 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.602+0000 7f6bbe7e4640 20 reqs_thread_entry: start 2024-09-14T11:36:15.602 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.602+0000 7f6d0bb069c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:15.602 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.602+0000 7f6d0bb069c0 20 Filter name: none 2024-09-14T11:36:15.602 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.602+0000 7f6b2ffff640 20 reqs_thread_entry: start 2024-09-14T11:36:15.602 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.602+0000 7f6d0bb069c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.603 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.602+0000 7f6d0bb069c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:15.603 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.602+0000 7f6d0bb069c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.605 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.606+0000 7f6d0bb069c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:15.605 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.606+0000 7f6d0bb069c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:15.605 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.606+0000 7f6d0bb069c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:36:15.605 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.606+0000 7f6d0bb069c0 20 INFO: main: starting shard=0 2024-09-14T11:36:15.605 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.606+0000 7f6d0bb069c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.0 2024-09-14T11:36:15.605 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.606+0000 7f6d0bb069c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.0 2024-09-14T11:36:15.606 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.606+0000 7f6d0bb069c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:15.606 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.606+0000 7f6d0bb069c0 20 INFO: main: starting shard=1 2024-09-14T11:36:15.606 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.606+0000 7f6d0bb069c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.1 2024-09-14T11:36:15.606 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.606+0000 7f6d0bb069c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.1 2024-09-14T11:36:15.607 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.606+0000 7f6d0bb069c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:15.607 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.606+0000 7f6d0bb069c0 20 INFO: main: starting shard=2 2024-09-14T11:36:15.607 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.606+0000 7f6d0bb069c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.2 2024-09-14T11:36:15.607 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.606+0000 7f6d0bb069c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.2 2024-09-14T11:36:15.607 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.606+0000 7f6d0bb069c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:15.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.606+0000 7f6d0bb069c0 20 INFO: main: starting shard=3 2024-09-14T11:36:15.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.606+0000 7f6d0bb069c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.3 2024-09-14T11:36:15.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.606+0000 7f6d0bb069c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.3 2024-09-14T11:36:15.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.610+0000 7f6d0bb069c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:15.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.610+0000 7f6d0bb069c0 20 INFO: main: starting shard=4 2024-09-14T11:36:15.608 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.610+0000 7f6d0bb069c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.4 2024-09-14T11:36:15.609 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.610+0000 7f6d0bb069c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.4 2024-09-14T11:36:15.609 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.610+0000 7f6d0bb069c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:15.609 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.610+0000 7f6d0bb069c0 20 INFO: main: starting shard=5 2024-09-14T11:36:15.609 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.610+0000 7f6d0bb069c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.5 2024-09-14T11:36:15.609 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.610+0000 7f6d0bb069c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.5 2024-09-14T11:36:15.610 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.610+0000 7f6d0bb069c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:36:15.610 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.610+0000 7f6d0bb069c0 20 INFO: main: starting shard=6 2024-09-14T11:36:15.610 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.610+0000 7f6d0bb069c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.6 2024-09-14T11:36:15.610 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.610+0000 7f6d0bb069c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.6 2024-09-14T11:36:15.611 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.610+0000 7f6d0bb069c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:15.611 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.610+0000 7f6d0bb069c0 20 INFO: main: starting shard=7 2024-09-14T11:36:15.611 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.610+0000 7f6d0bb069c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.7 2024-09-14T11:36:15.611 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.610+0000 7f6d0bb069c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.7 2024-09-14T11:36:15.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.610+0000 7f6d0bb069c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:15.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.610+0000 7f6d0bb069c0 20 INFO: main: starting shard=8 2024-09-14T11:36:15.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.610+0000 7f6d0bb069c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.8 2024-09-14T11:36:15.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.610+0000 7f6d0bb069c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.8 2024-09-14T11:36:15.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.614+0000 7f6d0bb069c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:15.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.614+0000 7f6d0bb069c0 20 INFO: main: starting shard=9 2024-09-14T11:36:15.613 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.614+0000 7f6d0bb069c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.9 2024-09-14T11:36:15.613 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.614+0000 7f6d0bb069c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.9 2024-09-14T11:36:15.613 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.614+0000 7f6d0bb069c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:15.613 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.614+0000 7f6d0bb069c0 20 INFO: main: starting shard=10 2024-09-14T11:36:15.613 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.614+0000 7f6d0bb069c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.10 2024-09-14T11:36:15.613 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.614+0000 7f6d0bb069c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.10 2024-09-14T11:36:15.614 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.614+0000 7f6d0bb069c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:15.614 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.614+0000 7f6d0bb069c0 20 INFO: main: starting shard=11 2024-09-14T11:36:15.614 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.614+0000 7f6d0bb069c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.11 2024-09-14T11:36:15.615 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.614+0000 7f6d0bb069c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.11 2024-09-14T11:36:15.616 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.614+0000 7f6d0bb069c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:15.616 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.614+0000 7f6d0bb069c0 20 INFO: main: starting shard=12 2024-09-14T11:36:15.616 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.614+0000 7f6d0bb069c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.12 2024-09-14T11:36:15.616 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.614+0000 7f6d0bb069c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.12 2024-09-14T11:36:15.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.618+0000 7f6d0bb069c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:15.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.618+0000 7f6d0bb069c0 20 INFO: main: done 2024-09-14T11:36:15.618 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.618+0000 7f6bbf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:15.623 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.622+0000 7f6d0bb069c0 20 remove_watcher() i=0 2024-09-14T11:36:15.623 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.622+0000 7f6d0bb069c0 2 removed watcher, disabling cache 2024-09-14T11:36:15.625 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.626+0000 7f6d0bb069c0 20 remove_watcher() i=1 2024-09-14T11:36:15.627 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.626+0000 7f6d0bb069c0 20 remove_watcher() i=2 2024-09-14T11:36:15.630 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.630+0000 7f6d0bb069c0 20 remove_watcher() i=3 2024-09-14T11:36:15.632 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.634+0000 7f6d0bb069c0 20 remove_watcher() i=4 2024-09-14T11:36:15.634 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.634+0000 7f6d0bb069c0 20 remove_watcher() i=5 2024-09-14T11:36:15.637 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.638+0000 7f6d0bb069c0 20 remove_watcher() i=6 2024-09-14T11:36:15.640 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.642+0000 7f6d0bb069c0 20 remove_watcher() i=7 2024-09-14T11:36:15.729 INFO:tasks.workunit.client.0.smithi071.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:36:15.729 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-14T11:36:15.764 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:15.764 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:15.810 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.810+0000 7f77ee9429c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.812 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.814+0000 7f77ee9429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:15.813 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.814+0000 7f77ee9429c0 20 realm 2024-09-14T11:36:15.813 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.814+0000 7f77ee9429c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.813 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.814+0000 7f77ee9429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:15.813 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.814+0000 7f77ee9429c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:15.814 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.814+0000 7f77ee9429c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.814 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.814+0000 7f77ee9429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:15.814 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.814+0000 7f77ee9429c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.814 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.814+0000 7f77ee9429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:15.814 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.814+0000 7f77ee9429c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.815 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.814+0000 7f77ee9429c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:15.815 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.814+0000 7f77ee9429c0 20 searching for the correct realm 2024-09-14T11:36:15.819 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:15.818+0000 7f77ecc49640 0 -- 172.21.15.71:0/4096659918 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f77d4018070 msgr2=0x7f77d40738f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:16.032 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.034+0000 7f77ecc49640 0 -- 172.21.15.71:0/4096659918 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x5587fc058e60 msgr2=0x5587fc05b250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:16.047 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.046+0000 7f77ee9429c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:16.047 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.046+0000 7f77ee9429c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:36:16.047 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.046+0000 7f77ee9429c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:16.047 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.046+0000 7f77ee9429c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:36:16.048 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.046+0000 7f77ee9429c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:16.048 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.046+0000 7f77ee9429c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:16.048 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.046+0000 7f77ee9429c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.048 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.050+0000 7f77ee9429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:16.048 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.050+0000 7f77ee9429c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.049 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.050+0000 7f77ee9429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:16.049 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.050+0000 7f77ee9429c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.050 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.050+0000 7f77ee9429c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:16.050 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.050+0000 7f77ee9429c0 20 zone default found 2024-09-14T11:36:16.050 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.050+0000 7f77ee9429c0 4 Realm: () 2024-09-14T11:36:16.050 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.050+0000 7f77ee9429c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:36:16.050 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.050+0000 7f77ee9429c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:36:16.051 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.050+0000 7f77ee9429c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:16.051 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.050+0000 7f77ee9429c0 20 zonegroup default 2024-09-14T11:36:16.051 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.050+0000 7f77ee9429c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.051 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.050+0000 7f77ee9429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:16.051 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.050+0000 7f77ee9429c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.052 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.050+0000 7f77ee9429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:16.052 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.050+0000 7f77ee9429c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.052 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.054+0000 7f77ee9429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:16.053 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.054+0000 7f77ee9429c0 20 started sync module instance, tier type = 2024-09-14T11:36:16.053 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.054+0000 7f77ee9429c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:36:16.077 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.078+0000 7f77ee9429c0 20 add_watcher() i=0 2024-09-14T11:36:16.077 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.078+0000 7f77ee9429c0 20 add_watcher() i=1 2024-09-14T11:36:16.077 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.078+0000 7f77ee9429c0 20 add_watcher() i=2 2024-09-14T11:36:16.077 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.078+0000 7f77ee9429c0 20 add_watcher() i=3 2024-09-14T11:36:16.077 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.078+0000 7f77ee9429c0 20 add_watcher() i=4 2024-09-14T11:36:16.077 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.078+0000 7f77ee9429c0 20 add_watcher() i=5 2024-09-14T11:36:16.077 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.078+0000 7f77ee9429c0 20 add_watcher() i=6 2024-09-14T11:36:16.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.078+0000 7f77ee9429c0 20 add_watcher() i=7 2024-09-14T11:36:16.079 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.078+0000 7f77ee9429c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:16.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.082+0000 7f76a2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:16.084 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.086+0000 7f77ee9429c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:16.085 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.086+0000 7f77ee9429c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:16.085 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.086+0000 7f77ee9429c0 5 note: GC not initialized 2024-09-14T11:36:16.086 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.086+0000 7f76a1fdb640 20 reqs_thread_entry: start 2024-09-14T11:36:16.086 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.086+0000 7f77ee9429c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:16.086 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.086+0000 7f77ee9429c0 20 Filter name: none 2024-09-14T11:36:16.086 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.086+0000 7f76137fe640 20 reqs_thread_entry: start 2024-09-14T11:36:16.086 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.086+0000 7f77ee9429c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.087 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.086+0000 7f77ee9429c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:16.087 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.086+0000 7f77ee9429c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.087 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.086+0000 7f77ee9429c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:16.088 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.086+0000 7f77ee9429c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:16.088 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.086+0000 7f77ee9429c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:36:16.088 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.086+0000 7f77ee9429c0 20 INFO: main: starting shard=0 2024-09-14T11:36:16.088 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.086+0000 7f77ee9429c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.0 2024-09-14T11:36:16.088 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.086+0000 7f77ee9429c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.0 2024-09-14T11:36:16.089 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.090+0000 7f77ee9429c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:16.089 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.090+0000 7f77ee9429c0 20 INFO: main: starting shard=1 2024-09-14T11:36:16.089 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.090+0000 7f77ee9429c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.1 2024-09-14T11:36:16.089 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.090+0000 7f77ee9429c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.1 2024-09-14T11:36:16.090 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.090+0000 7f77ee9429c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:16.090 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.090+0000 7f77ee9429c0 20 INFO: main: starting shard=2 2024-09-14T11:36:16.090 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.090+0000 7f77ee9429c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.2 2024-09-14T11:36:16.091 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.090+0000 7f77ee9429c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.2 2024-09-14T11:36:16.091 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.090+0000 7f77ee9429c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:16.091 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.090+0000 7f77ee9429c0 20 INFO: main: starting shard=3 2024-09-14T11:36:16.091 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.090+0000 7f77ee9429c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.3 2024-09-14T11:36:16.091 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.090+0000 7f77ee9429c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.3 2024-09-14T11:36:16.092 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.090+0000 7f77ee9429c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:16.092 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.094+0000 7f77ee9429c0 20 INFO: main: starting shard=4 2024-09-14T11:36:16.092 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.094+0000 7f77ee9429c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.4 2024-09-14T11:36:16.092 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.094+0000 7f77ee9429c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.4 2024-09-14T11:36:16.093 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.094+0000 7f77ee9429c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:16.093 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.094+0000 7f77ee9429c0 20 INFO: main: starting shard=5 2024-09-14T11:36:16.093 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.094+0000 7f77ee9429c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.5 2024-09-14T11:36:16.093 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.094+0000 7f77ee9429c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.5 2024-09-14T11:36:16.093 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.094+0000 7f77ee9429c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:16.094 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.094+0000 7f77ee9429c0 20 INFO: main: starting shard=6 2024-09-14T11:36:16.094 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.094+0000 7f77ee9429c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.6 2024-09-14T11:36:16.094 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.094+0000 7f77ee9429c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.6 2024-09-14T11:36:16.094 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.094+0000 7f77ee9429c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:16.095 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.094+0000 7f77ee9429c0 20 INFO: main: starting shard=7 2024-09-14T11:36:16.095 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.094+0000 7f77ee9429c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.7 2024-09-14T11:36:16.095 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.094+0000 7f77ee9429c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.7 2024-09-14T11:36:16.096 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.094+0000 7f77ee9429c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:16.096 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.094+0000 7f77ee9429c0 20 INFO: main: starting shard=8 2024-09-14T11:36:16.096 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.094+0000 7f77ee9429c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.8 2024-09-14T11:36:16.096 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.094+0000 7f77ee9429c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.8 2024-09-14T11:36:16.096 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.094+0000 7f77ee9429c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:16.096 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.094+0000 7f77ee9429c0 20 INFO: main: starting shard=9 2024-09-14T11:36:16.096 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.094+0000 7f77ee9429c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.9 2024-09-14T11:36:16.096 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.094+0000 7f77ee9429c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.9 2024-09-14T11:36:16.097 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.098+0000 7f77ee9429c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:36:16.097 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.098+0000 7f77ee9429c0 20 INFO: main: starting shard=10 2024-09-14T11:36:16.097 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.098+0000 7f77ee9429c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.10 2024-09-14T11:36:16.097 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.098+0000 7f77ee9429c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.10 2024-09-14T11:36:16.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.098+0000 7f77ee9429c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:16.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.098+0000 7f77ee9429c0 20 INFO: main: starting shard=11 2024-09-14T11:36:16.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.098+0000 7f77ee9429c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.11 2024-09-14T11:36:16.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.098+0000 7f77ee9429c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.11 2024-09-14T11:36:16.100 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.102+0000 7f77ee9429c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:16.100 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.102+0000 7f77ee9429c0 20 INFO: main: starting shard=12 2024-09-14T11:36:16.100 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.102+0000 7f77ee9429c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.12 2024-09-14T11:36:16.101 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.102+0000 7f77ee9429c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.12 2024-09-14T11:36:16.102 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.102+0000 7f77ee9429c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:16.102 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.102+0000 7f77ee9429c0 20 INFO: main: done 2024-09-14T11:36:16.104 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.102+0000 7f76a2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:16.108 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.110+0000 7f77ee9429c0 20 remove_watcher() i=0 2024-09-14T11:36:16.108 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.110+0000 7f77ee9429c0 2 removed watcher, disabling cache 2024-09-14T11:36:16.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.110+0000 7f77ee9429c0 20 remove_watcher() i=1 2024-09-14T11:36:16.113 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.114+0000 7f77ee9429c0 20 remove_watcher() i=2 2024-09-14T11:36:16.115 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.114+0000 7f77ee9429c0 20 remove_watcher() i=3 2024-09-14T11:36:16.117 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.118+0000 7f77ee9429c0 20 remove_watcher() i=4 2024-09-14T11:36:16.119 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.118+0000 7f77ee9429c0 20 remove_watcher() i=5 2024-09-14T11:36:16.121 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.122+0000 7f77ee9429c0 20 remove_watcher() i=6 2024-09-14T11:36:16.124 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.126+0000 7f77ee9429c0 20 remove_watcher() i=7 2024-09-14T11:36:16.209 INFO:tasks.workunit.client.0.smithi071.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:36:16.209 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-14T11:36:16.244 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:16.244 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:16.289 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.290+0000 7f42bedab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.292 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.294+0000 7f42bedab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:16.292 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.294+0000 7f42bedab9c0 20 realm 2024-09-14T11:36:16.292 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.294+0000 7f42bedab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.293 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.294+0000 7f42bedab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:16.293 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.294+0000 7f42bedab9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:16.293 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.294+0000 7f42bedab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.293 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.294+0000 7f42bedab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:16.293 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.294+0000 7f42bedab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.294 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.294+0000 7f42bedab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:16.294 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.294+0000 7f42bedab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.295 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.294+0000 7f42bedab9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:16.295 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.294+0000 7f42bedab9c0 20 searching for the correct realm 2024-09-14T11:36:16.299 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.298+0000 7f42bd0b2640 0 -- 172.21.15.71:0/1460129402 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f42b0020060 msgr2=0x7f42b0072a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:16.511 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.510+0000 7f42bd0b2640 0 -- 172.21.15.71:0/1460129402 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x56426e9c6470 msgr2=0x56426e9c8860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:16.526 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.526+0000 7f42bedab9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:16.526 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.526+0000 7f42bedab9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:36:16.526 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.526+0000 7f42bedab9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:16.526 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.526+0000 7f42bedab9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:36:16.526 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.526+0000 7f42bedab9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:16.526 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.526+0000 7f42bedab9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:16.526 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.526+0000 7f42bedab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.527 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.526+0000 7f42bedab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:16.527 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.526+0000 7f42bedab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.527 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.526+0000 7f42bedab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:16.528 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.526+0000 7f42bedab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.528 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.530+0000 7f42bedab9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:16.528 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.530+0000 7f42bedab9c0 20 zone default found 2024-09-14T11:36:16.528 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.530+0000 7f42bedab9c0 4 Realm: () 2024-09-14T11:36:16.529 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.530+0000 7f42bedab9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:36:16.529 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.530+0000 7f42bedab9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:36:16.529 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.530+0000 7f42bedab9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:16.529 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.530+0000 7f42bedab9c0 20 zonegroup default 2024-09-14T11:36:16.529 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.530+0000 7f42bedab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.529 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.530+0000 7f42bedab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:16.529 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.530+0000 7f42bedab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.530 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.530+0000 7f42bedab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:16.530 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.530+0000 7f42bedab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.530+0000 7f42bedab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:16.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.530+0000 7f42bedab9c0 20 started sync module instance, tier type = 2024-09-14T11:36:16.531 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.530+0000 7f42bedab9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:36:16.554 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.554+0000 7f42bedab9c0 20 add_watcher() i=0 2024-09-14T11:36:16.554 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.554+0000 7f42bedab9c0 20 add_watcher() i=1 2024-09-14T11:36:16.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.554+0000 7f42bedab9c0 20 add_watcher() i=2 2024-09-14T11:36:16.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.554+0000 7f42bedab9c0 20 add_watcher() i=3 2024-09-14T11:36:16.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.554+0000 7f42bedab9c0 20 add_watcher() i=4 2024-09-14T11:36:16.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.554+0000 7f42bedab9c0 20 add_watcher() i=5 2024-09-14T11:36:16.555 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.554+0000 7f42bedab9c0 20 add_watcher() i=6 2024-09-14T11:36:16.557 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.558+0000 7f42bedab9c0 20 add_watcher() i=7 2024-09-14T11:36:16.557 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.558+0000 7f42bedab9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:16.562 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.562+0000 7f41737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:16.562 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.562+0000 7f42bedab9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:16.563 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.562+0000 7f42bedab9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:16.563 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.562+0000 7f42bedab9c0 5 note: GC not initialized 2024-09-14T11:36:16.563 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.562+0000 7f41727e4640 20 reqs_thread_entry: start 2024-09-14T11:36:16.563 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.562+0000 7f42bedab9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:16.563 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.562+0000 7f42bedab9c0 20 Filter name: none 2024-09-14T11:36:16.564 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.562+0000 7f416b7fe640 20 reqs_thread_entry: start 2024-09-14T11:36:16.564 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.562+0000 7f42bedab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.565 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.566+0000 7f42bedab9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:16.565 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.566+0000 7f42bedab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.566 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.566+0000 7f42bedab9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:16.566 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.566+0000 7f42bedab9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:16.566 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.566+0000 7f42bedab9c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:36:16.566 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.566+0000 7f42bedab9c0 20 INFO: main: starting shard=0 2024-09-14T11:36:16.566 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.566+0000 7f42bedab9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.0 2024-09-14T11:36:16.566 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.566+0000 7f42bedab9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.0 2024-09-14T11:36:16.567 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.566+0000 7f42bedab9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:36:16.567 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.566+0000 7f42bedab9c0 20 INFO: main: starting shard=1 2024-09-14T11:36:16.567 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.566+0000 7f42bedab9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.1 2024-09-14T11:36:16.567 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.566+0000 7f42bedab9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.1 2024-09-14T11:36:16.568 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.570+0000 7f42bedab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:16.568 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.570+0000 7f42bedab9c0 20 INFO: main: starting shard=2 2024-09-14T11:36:16.568 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.570+0000 7f42bedab9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.2 2024-09-14T11:36:16.569 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.570+0000 7f42bedab9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.2 2024-09-14T11:36:16.569 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.570+0000 7f42bedab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:16.569 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.570+0000 7f42bedab9c0 20 INFO: main: starting shard=3 2024-09-14T11:36:16.569 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.570+0000 7f42bedab9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.3 2024-09-14T11:36:16.570 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.570+0000 7f42bedab9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.3 2024-09-14T11:36:16.570 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.570+0000 7f42bedab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:16.571 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.570+0000 7f42bedab9c0 20 INFO: main: starting shard=4 2024-09-14T11:36:16.572 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.570+0000 7f42bedab9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.4 2024-09-14T11:36:16.572 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.570+0000 7f42bedab9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.4 2024-09-14T11:36:16.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.570+0000 7f42bedab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:16.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.570+0000 7f42bedab9c0 20 INFO: main: starting shard=5 2024-09-14T11:36:16.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.570+0000 7f42bedab9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.5 2024-09-14T11:36:16.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.570+0000 7f42bedab9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.5 2024-09-14T11:36:16.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.570+0000 7f42bedab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:16.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.570+0000 7f42bedab9c0 20 INFO: main: starting shard=6 2024-09-14T11:36:16.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.570+0000 7f42bedab9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.6 2024-09-14T11:36:16.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.570+0000 7f42bedab9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.6 2024-09-14T11:36:16.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.574+0000 7f42bedab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:16.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.574+0000 7f42bedab9c0 20 INFO: main: starting shard=7 2024-09-14T11:36:16.573 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.574+0000 7f42bedab9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.7 2024-09-14T11:36:16.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.574+0000 7f42bedab9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.7 2024-09-14T11:36:16.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.574+0000 7f42bedab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:16.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.574+0000 7f42bedab9c0 20 INFO: main: starting shard=8 2024-09-14T11:36:16.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.574+0000 7f42bedab9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.8 2024-09-14T11:36:16.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.574+0000 7f42bedab9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.8 2024-09-14T11:36:16.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.574+0000 7f42bedab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:16.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.574+0000 7f42bedab9c0 20 INFO: main: starting shard=9 2024-09-14T11:36:16.574 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.574+0000 7f42bedab9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.9 2024-09-14T11:36:16.575 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.574+0000 7f42bedab9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.9 2024-09-14T11:36:16.575 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.574+0000 7f42bedab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:16.575 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.574+0000 7f42bedab9c0 20 INFO: main: starting shard=10 2024-09-14T11:36:16.575 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.574+0000 7f42bedab9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.10 2024-09-14T11:36:16.575 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.574+0000 7f42bedab9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.10 2024-09-14T11:36:16.576 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.578+0000 7f42bedab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:16.576 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.578+0000 7f42bedab9c0 20 INFO: main: starting shard=11 2024-09-14T11:36:16.576 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.578+0000 7f42bedab9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.11 2024-09-14T11:36:16.576 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.578+0000 7f42bedab9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.11 2024-09-14T11:36:16.577 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.578+0000 7f42bedab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:16.577 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.578+0000 7f42bedab9c0 20 INFO: main: starting shard=12 2024-09-14T11:36:16.577 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.578+0000 7f42bedab9c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.12 2024-09-14T11:36:16.577 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.578+0000 7f42bedab9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.12 2024-09-14T11:36:16.578 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.578+0000 7f42bedab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:16.578 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.578+0000 7f42bedab9c0 20 INFO: main: done 2024-09-14T11:36:16.579 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.578+0000 7f41737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:16.584 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.586+0000 7f42bedab9c0 20 remove_watcher() i=0 2024-09-14T11:36:16.584 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.586+0000 7f42bedab9c0 2 removed watcher, disabling cache 2024-09-14T11:36:16.586 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.586+0000 7f42bedab9c0 20 remove_watcher() i=1 2024-09-14T11:36:16.588 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.590+0000 7f42bedab9c0 20 remove_watcher() i=2 2024-09-14T11:36:16.590 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.590+0000 7f42bedab9c0 20 remove_watcher() i=3 2024-09-14T11:36:16.592 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.594+0000 7f42bedab9c0 20 remove_watcher() i=4 2024-09-14T11:36:16.595 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.594+0000 7f42bedab9c0 20 remove_watcher() i=5 2024-09-14T11:36:16.597 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.598+0000 7f42bedab9c0 20 remove_watcher() i=6 2024-09-14T11:36:16.601 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:16.602+0000 7f42bedab9c0 20 remove_watcher() i=7 2024-09-14T11:36:16.629 INFO:tasks.workunit.client.0.smithi071.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:36:17.077 INFO:tasks.workunit.client.0.smithi071.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T11:36:17.514 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-14T11:36:17.548 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:17.548 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:17.590 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.590+0000 7f31a1ae39c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.593 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.594+0000 7f31a1ae39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:17.593 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.594+0000 7f31a1ae39c0 20 realm 2024-09-14T11:36:17.593 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.594+0000 7f31a1ae39c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.593 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.594+0000 7f31a1ae39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:17.594 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.594+0000 7f31a1ae39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:17.594 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.594+0000 7f31a1ae39c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.594 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.594+0000 7f31a1ae39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:17.594 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.594+0000 7f31a1ae39c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.594 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.594+0000 7f31a1ae39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:17.594 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.594+0000 7f31a1ae39c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.595 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.594+0000 7f31a1ae39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:17.595 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.594+0000 7f31a1ae39c0 20 searching for the correct realm 2024-09-14T11:36:17.599 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.598+0000 7f319fdea640 0 -- 172.21.15.71:0/627654878 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f3188008040 msgr2=0x7f3188066340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:17.605 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.606+0000 7f319fdea640 0 -- 172.21.15.71:0/627654878 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x563270c84ef0 msgr2=0x563270c872e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:17.614 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.614+0000 7f31a1ae39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:17.614 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.614+0000 7f31a1ae39c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:36:17.614 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.614+0000 7f31a1ae39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:17.615 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.614+0000 7f31a1ae39c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:36:17.615 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.614+0000 7f31a1ae39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:17.615 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.614+0000 7f31a1ae39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:17.615 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.614+0000 7f31a1ae39c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.615 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.614+0000 7f31a1ae39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:17.615 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.614+0000 7f31a1ae39c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.616 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.614+0000 7f31a1ae39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:17.616 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.614+0000 7f31a1ae39c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.616 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.618+0000 7f31a1ae39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:17.616 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.618+0000 7f31a1ae39c0 20 zone default found 2024-09-14T11:36:17.616 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.618+0000 7f31a1ae39c0 4 Realm: () 2024-09-14T11:36:17.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.618+0000 7f31a1ae39c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:36:17.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.618+0000 7f31a1ae39c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:36:17.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.618+0000 7f31a1ae39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:17.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.618+0000 7f31a1ae39c0 20 zonegroup default 2024-09-14T11:36:17.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.618+0000 7f31a1ae39c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.618+0000 7f31a1ae39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:17.617 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.618+0000 7f31a1ae39c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.618 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.618+0000 7f31a1ae39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:17.618 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.618+0000 7f31a1ae39c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.618 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.618+0000 7f31a1ae39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:17.618 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.618+0000 7f31a1ae39c0 20 started sync module instance, tier type = 2024-09-14T11:36:17.618 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.618+0000 7f31a1ae39c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:36:17.635 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.634+0000 7f31a1ae39c0 20 add_watcher() i=0 2024-09-14T11:36:17.635 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.634+0000 7f31a1ae39c0 20 add_watcher() i=1 2024-09-14T11:36:17.635 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.634+0000 7f31a1ae39c0 20 add_watcher() i=2 2024-09-14T11:36:17.635 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.634+0000 7f31a1ae39c0 20 add_watcher() i=3 2024-09-14T11:36:17.635 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.634+0000 7f31a1ae39c0 20 add_watcher() i=4 2024-09-14T11:36:17.635 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.634+0000 7f31a1ae39c0 20 add_watcher() i=5 2024-09-14T11:36:17.636 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.634+0000 7f31a1ae39c0 20 add_watcher() i=6 2024-09-14T11:36:17.638 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.638+0000 7f31a1ae39c0 20 add_watcher() i=7 2024-09-14T11:36:17.638 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.638+0000 7f31a1ae39c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:17.642 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.642+0000 7f3055fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:17.642 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.642+0000 7f31a1ae39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:17.642 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.642+0000 7f31a1ae39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:17.642 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.642+0000 7f31a1ae39c0 5 note: GC not initialized 2024-09-14T11:36:17.642 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.642+0000 7f3054fe1640 20 reqs_thread_entry: start 2024-09-14T11:36:17.642 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.642+0000 7f31a1ae39c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:17.642 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.642+0000 7f31a1ae39c0 20 Filter name: none 2024-09-14T11:36:17.642 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.642+0000 7f2fce7fc640 20 reqs_thread_entry: start 2024-09-14T11:36:17.642 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.642+0000 7f31a1ae39c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:36:17.643 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.642+0000 7f31a1ae39c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.643 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.642+0000 7f31a1ae39c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:17.643 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.642+0000 7f31a1ae39c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:36:17.644 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.642+0000 7f31a1ae39c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:36:17.644 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.642+0000 7f31a1ae39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 : miss 2024-09-14T11:36:17.644 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.642+0000 7f31a1ae39c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.644 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.642+0000 7f31a1ae39c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:17.644 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.642+0000 7f31a1ae39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 info.flags=0x17 2024-09-14T11:36:17.644 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.642+0000 7f31a1ae39c0 10 adding default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 to cache LRU end 2024-09-14T11:36:17.644 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.642+0000 7f31a1ae39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:17.644 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.642+0000 7f31a1ae39c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:17.644 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.642+0000 7f31a1ae39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 2024-09-14T11:36:17.656 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.654+0000 7f31a1ae39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 info.flags=0x17 2024-09-14T11:36:17.656 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.654+0000 7f31a1ae39c0 10 moving default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 to cache LRU end 2024-09-14T11:36:17.656 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.654+0000 7f31a1ae39c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:17.656 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.654+0000 7f31a1ae39c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19, ofs0, ns] 2024-09-14T11:36:17.656 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.658+0000 7f30827fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464388 cookie 94774640573008 notifier 8201 bl.length()=905 2024-09-14T11:36:17.656 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.658+0000 7f30827fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 info.flags=0x17 2024-09-14T11:36:17.657 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.658+0000 7f30827fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 to cache LRU end 2024-09-14T11:36:17.657 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.658+0000 7f30827fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:17.657 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.658+0000 7f31a1ae39c0 20 handle_bi_update(): bucket=:myver[4444f441-0c56-48df-a905-d49e7e44d629.4596.19]): orig_sources= new_sources= 2024-09-14T11:36:17.657 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.658+0000 7f31a1ae39c0 20 handle_bi_update(): bucket=:myver[4444f441-0c56-48df-a905-d49e7e44d629.4596.19]): potential sources added=[] removed=[] 2024-09-14T11:36:17.657 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.658+0000 7f31a1ae39c0 20 handle_bi_update(): bucket=:myver[4444f441-0c56-48df-a905-d49e7e44d629.4596.19]): orig_dests= new_dests= 2024-09-14T11:36:17.658 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.658+0000 7f31a1ae39c0 20 handle_bi_update(): bucket=:myver[4444f441-0c56-48df-a905-d49e7e44d629.4596.19]): potential dests added=[] removed=[] 2024-09-14T11:36:17.672 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.0 2024-09-14T11:36:17.672 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.0 2024-09-14T11:36:17.672 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.1 2024-09-14T11:36:17.672 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.1 2024-09-14T11:36:17.672 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.2 2024-09-14T11:36:17.672 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.2 2024-09-14T11:36:17.672 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.3 2024-09-14T11:36:17.672 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.3 2024-09-14T11:36:17.672 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.4 2024-09-14T11:36:17.672 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.4 2024-09-14T11:36:17.672 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.5 2024-09-14T11:36:17.673 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.5 2024-09-14T11:36:17.673 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.6 2024-09-14T11:36:17.673 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.6 2024-09-14T11:36:17.673 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.7 2024-09-14T11:36:17.673 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.7 2024-09-14T11:36:17.673 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.8 2024-09-14T11:36:17.673 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.8 2024-09-14T11:36:17.673 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.9 2024-09-14T11:36:17.673 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.9 2024-09-14T11:36:17.673 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.10 2024-09-14T11:36:17.673 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.10 2024-09-14T11:36:17.673 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.11 2024-09-14T11:36:17.673 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.11 2024-09-14T11:36:17.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.12 2024-09-14T11:36:17.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.12 2024-09-14T11:36:17.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.13 2024-09-14T11:36:17.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.13 2024-09-14T11:36:17.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.14 2024-09-14T11:36:17.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.14 2024-09-14T11:36:17.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.15 2024-09-14T11:36:17.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.15 2024-09-14T11:36:17.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.16 2024-09-14T11:36:17.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.16 2024-09-14T11:36:17.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.0 2024-09-14T11:36:17.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.0 2024-09-14T11:36:17.674 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.1 2024-09-14T11:36:17.675 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.670+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.1 2024-09-14T11:36:17.675 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.674+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.2 2024-09-14T11:36:17.675 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.674+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.2 2024-09-14T11:36:17.675 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.674+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.3 2024-09-14T11:36:17.676 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.674+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.3 2024-09-14T11:36:17.676 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.674+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.4 2024-09-14T11:36:17.676 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.674+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.4 2024-09-14T11:36:17.676 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.674+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.5 2024-09-14T11:36:17.676 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.674+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.5 2024-09-14T11:36:17.676 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.674+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.6 2024-09-14T11:36:17.676 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.674+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.6 2024-09-14T11:36:17.676 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.678+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.7 2024-09-14T11:36:17.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.678+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.7 2024-09-14T11:36:17.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.678+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.8 2024-09-14T11:36:17.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.678+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.8 2024-09-14T11:36:17.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.678+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.9 2024-09-14T11:36:17.677 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.678+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.9 2024-09-14T11:36:17.679 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.678+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.10 2024-09-14T11:36:17.679 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.678+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.10 2024-09-14T11:36:17.680 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.682+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.11 2024-09-14T11:36:17.680 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.682+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.11 2024-09-14T11:36:17.681 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.682+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.12 2024-09-14T11:36:17.681 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.682+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.12 2024-09-14T11:36:17.686 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.686+0000 7f31a1ae39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:17.686 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.686+0000 7f31a1ae39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 2024-09-14T11:36:17.687 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.686+0000 7f31a1ae39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 info.flags=0x17 2024-09-14T11:36:17.688 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.686+0000 7f31a1ae39c0 10 moving default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 to cache LRU end 2024-09-14T11:36:17.688 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.686+0000 7f31a1ae39c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:17.688 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.686+0000 7f31a1ae39c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19, ofs0, ns] 2024-09-14T11:36:17.688 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.690+0000 7f3082ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464389 cookie 94774640573008 notifier 8201 bl.length()=905 2024-09-14T11:36:17.688 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.690+0000 7f3082ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 info.flags=0x17 2024-09-14T11:36:17.688 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.690+0000 7f3082ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 to cache LRU end 2024-09-14T11:36:17.689 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.690+0000 7f3082ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:17.690 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.690+0000 7f31a1ae39c0 20 handle_bi_update(): bucket=:myver[4444f441-0c56-48df-a905-d49e7e44d629.4596.19]): orig_sources= new_sources= 2024-09-14T11:36:17.690 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.690+0000 7f31a1ae39c0 20 handle_bi_update(): bucket=:myver[4444f441-0c56-48df-a905-d49e7e44d629.4596.19]): potential sources added=[] removed=[] 2024-09-14T11:36:17.690 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.690+0000 7f31a1ae39c0 20 handle_bi_update(): bucket=:myver[4444f441-0c56-48df-a905-d49e7e44d629.4596.19]): orig_dests= new_dests= 2024-09-14T11:36:17.690 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.690+0000 7f31a1ae39c0 20 handle_bi_update(): bucket=:myver[4444f441-0c56-48df-a905-d49e7e44d629.4596.19]): potential dests added=[] removed=[] 2024-09-14T11:36:17.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.698+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.0 2024-09-14T11:36:17.698 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.698+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.0 2024-09-14T11:36:17.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.698+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.1 2024-09-14T11:36:17.699 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.698+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.1 2024-09-14T11:36:17.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.698+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.2 2024-09-14T11:36:17.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.698+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.2 2024-09-14T11:36:17.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.702+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.3 2024-09-14T11:36:17.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.702+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.3 2024-09-14T11:36:17.700 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.702+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.4 2024-09-14T11:36:17.701 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.702+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.4 2024-09-14T11:36:17.701 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.702+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.5 2024-09-14T11:36:17.701 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.702+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.5 2024-09-14T11:36:17.701 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.702+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.6 2024-09-14T11:36:17.701 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.702+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.6 2024-09-14T11:36:17.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.702+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.7 2024-09-14T11:36:17.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.702+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.7 2024-09-14T11:36:17.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.702+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.8 2024-09-14T11:36:17.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.702+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.8 2024-09-14T11:36:17.702 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.702+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.9 2024-09-14T11:36:17.703 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.702+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.9 2024-09-14T11:36:17.703 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.702+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.10 2024-09-14T11:36:17.703 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.702+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.10 2024-09-14T11:36:17.704 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.706+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.11 2024-09-14T11:36:17.704 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.706+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.11 2024-09-14T11:36:17.705 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.706+0000 7f31a1ae39c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.12 2024-09-14T11:36:17.705 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.706+0000 7f31a1ae39c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.2.12 2024-09-14T11:36:17.706 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.706+0000 7f31a1ae39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:17.706 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.706+0000 7f31a1ae39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 2024-09-14T11:36:17.708 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.706+0000 7f31a1ae39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 info.flags=0x17 2024-09-14T11:36:17.708 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.706+0000 7f31a1ae39c0 10 moving default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 to cache LRU end 2024-09-14T11:36:17.708 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.706+0000 7f31a1ae39c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:17.708 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.706+0000 7f31a1ae39c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19, ofs0, ns] 2024-09-14T11:36:17.708 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.710+0000 7f30827fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464390 cookie 94774640573008 notifier 8201 bl.length()=873 2024-09-14T11:36:17.708 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.710+0000 7f30827fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 info.flags=0x17 2024-09-14T11:36:17.709 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.710+0000 7f30827fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 to cache LRU end 2024-09-14T11:36:17.709 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.710+0000 7f30827fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:17.709 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.710+0000 7f31a1ae39c0 20 handle_bi_update(): bucket=:myver[4444f441-0c56-48df-a905-d49e7e44d629.4596.19]): orig_sources= new_sources= 2024-09-14T11:36:17.709 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.710+0000 7f31a1ae39c0 20 handle_bi_update(): bucket=:myver[4444f441-0c56-48df-a905-d49e7e44d629.4596.19]): potential sources added=[] removed=[] 2024-09-14T11:36:17.709 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.710+0000 7f31a1ae39c0 20 handle_bi_update(): bucket=:myver[4444f441-0c56-48df-a905-d49e7e44d629.4596.19]): orig_dests= new_dests= 2024-09-14T11:36:17.709 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.710+0000 7f31a1ae39c0 20 handle_bi_update(): bucket=:myver[4444f441-0c56-48df-a905-d49e7e44d629.4596.19]): potential dests added=[] removed=[] 2024-09-14T11:36:17.715 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.714+0000 7f31a1ae39c0 1 execute INFO: reshard of bucket "myver" from 13 shards to 17 shards completed successfully 2024-09-14T11:36:17.719 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.718+0000 7f3055fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:17.725 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.726+0000 7f31a1ae39c0 20 remove_watcher() i=0 2024-09-14T11:36:17.725 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.726+0000 7f31a1ae39c0 2 removed watcher, disabling cache 2024-09-14T11:36:17.727 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.726+0000 7f31a1ae39c0 20 remove_watcher() i=1 2024-09-14T11:36:17.729 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.730+0000 7f31a1ae39c0 20 remove_watcher() i=2 2024-09-14T11:36:17.731 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.730+0000 7f31a1ae39c0 20 remove_watcher() i=3 2024-09-14T11:36:17.733 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.734+0000 7f31a1ae39c0 20 remove_watcher() i=4 2024-09-14T11:36:17.735 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.734+0000 7f31a1ae39c0 20 remove_watcher() i=5 2024-09-14T11:36:17.738 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.738+0000 7f31a1ae39c0 20 remove_watcher() i=6 2024-09-14T11:36:17.741 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.742+0000 7f31a1ae39c0 20 remove_watcher() i=7 2024-09-14T11:36:17.756 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:36:17.790 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:17.791 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:17.835 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.834+0000 7f2a1fa319c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.837 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.838+0000 7f2a1fa319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:17.837 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.838+0000 7f2a1fa319c0 20 realm 2024-09-14T11:36:17.837 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.838+0000 7f2a1fa319c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.838 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.838+0000 7f2a1fa319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:17.838 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.838+0000 7f2a1fa319c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:17.838 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.838+0000 7f2a1fa319c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.838 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.838+0000 7f2a1fa319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:17.838 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.838+0000 7f2a1fa319c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.839 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.838+0000 7f2a1fa319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:17.839 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.838+0000 7f2a1fa319c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.840 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.838+0000 7f2a1fa319c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:17.840 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.838+0000 7f2a1fa319c0 20 searching for the correct realm 2024-09-14T11:36:17.843 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:17.842+0000 7f2a1dd38640 0 -- 172.21.15.71:0/1172923206 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f2a140f7930 msgr2=0x7f2a140ce410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:18.056 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.058+0000 7f2a1dd38640 0 -- 172.21.15.71:0/1172923206 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55977b21eda0 msgr2=0x55977b221190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:18.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.070+0000 7f2a1fa319c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:18.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.070+0000 7f2a1fa319c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:36:18.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.070+0000 7f2a1fa319c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:18.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.070+0000 7f2a1fa319c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:36:18.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.070+0000 7f2a1fa319c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:18.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.070+0000 7f2a1fa319c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:18.073 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.070+0000 7f2a1fa319c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.074 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.074+0000 7f2a1fa319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.074 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.074+0000 7f2a1fa319c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.074 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.074+0000 7f2a1fa319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:18.074 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.074+0000 7f2a1fa319c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.074 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.074+0000 7f2a1fa319c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:18.075 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.074+0000 7f2a1fa319c0 20 zone default found 2024-09-14T11:36:18.075 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.074+0000 7f2a1fa319c0 4 Realm: () 2024-09-14T11:36:18.075 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.074+0000 7f2a1fa319c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:36:18.075 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.074+0000 7f2a1fa319c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:36:18.075 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.074+0000 7f2a1fa319c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:18.075 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.074+0000 7f2a1fa319c0 20 zonegroup default 2024-09-14T11:36:18.075 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.074+0000 7f2a1fa319c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.076 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.074+0000 7f2a1fa319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.076 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.074+0000 7f2a1fa319c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.076 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.074+0000 7f2a1fa319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.076 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.074+0000 7f2a1fa319c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.076 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.078+0000 7f2a1fa319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.076 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.078+0000 7f2a1fa319c0 20 started sync module instance, tier type = 2024-09-14T11:36:18.077 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.078+0000 7f2a1fa319c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:36:18.098 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.098+0000 7f2a1fa319c0 20 add_watcher() i=0 2024-09-14T11:36:18.098 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.098+0000 7f2a1fa319c0 20 add_watcher() i=1 2024-09-14T11:36:18.098 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.098+0000 7f2a1fa319c0 20 add_watcher() i=2 2024-09-14T11:36:18.098 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.098+0000 7f2a1fa319c0 20 add_watcher() i=3 2024-09-14T11:36:18.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.098+0000 7f2a1fa319c0 20 add_watcher() i=4 2024-09-14T11:36:18.099 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.098+0000 7f2a1fa319c0 20 add_watcher() i=5 2024-09-14T11:36:18.100 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.102+0000 7f2a1fa319c0 20 add_watcher() i=6 2024-09-14T11:36:18.105 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.106+0000 7f2a1fa319c0 20 add_watcher() i=7 2024-09-14T11:36:18.105 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.106+0000 7f2a1fa319c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:18.109 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.110+0000 7f28d3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:18.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.110+0000 7f2a1fa319c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:18.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.110+0000 7f2a1fa319c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:18.110 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.110+0000 7f2a1fa319c0 5 note: GC not initialized 2024-09-14T11:36:18.112 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.110+0000 7f28d2fe5640 20 reqs_thread_entry: start 2024-09-14T11:36:18.112 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.110+0000 7f2a1fa319c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:18.112 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.110+0000 7f2a1fa319c0 20 Filter name: none 2024-09-14T11:36:18.112 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.110+0000 7f28d0fe1640 20 reqs_thread_entry: start 2024-09-14T11:36:18.112 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.110+0000 7f2a1fa319c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:36:18.112 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.110+0000 7f2a1fa319c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.113 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.114+0000 7f2a1fa319c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:18.113 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.114+0000 7f2a1fa319c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:36:18.113 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.114+0000 7f2a1fa319c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:36:18.113 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.114+0000 7f2a1fa319c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 : miss 2024-09-14T11:36:18.114 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.114+0000 7f2a1fa319c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.115 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.114+0000 7f2a1fa319c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:18.115 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.114+0000 7f2a1fa319c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 info.flags=0x17 2024-09-14T11:36:18.115 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.114+0000 7f2a1fa319c0 10 adding default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 to cache LRU end 2024-09-14T11:36:18.115 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.114+0000 7f2a1fa319c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:18.115 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.114+0000 7f2a1fa319c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:18.115 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.114+0000 7f2a1fa319c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:4444f441-0c56-48df-a905-d49e7e44d629.4596.19 2024-09-14T11:36:18.115 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.114+0000 7f2a1fa319c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.0 2024-09-14T11:36:18.115 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.114+0000 7f2a1fa319c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.0 2024-09-14T11:36:18.116 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.114+0000 7f2a1fa319c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:36:18.117 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.114+0000 7f2a1fa319c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.1 2024-09-14T11:36:18.117 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.114+0000 7f2a1fa319c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.1 2024-09-14T11:36:18.117 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.118+0000 7f2a1fa319c0 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-14T11:36:18.117 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.118+0000 7f2a1fa319c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.2 2024-09-14T11:36:18.117 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.118+0000 7f2a1fa319c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.2 2024-09-14T11:36:18.118 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.118+0000 7f2a1fa319c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:36:18.118 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.118+0000 7f2a1fa319c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.3 2024-09-14T11:36:18.118 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.118+0000 7f2a1fa319c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.3 2024-09-14T11:36:18.119 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.118+0000 7f2a1fa319c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:36:18.119 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.118+0000 7f2a1fa319c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.4 2024-09-14T11:36:18.119 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.118+0000 7f2a1fa319c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.4 2024-09-14T11:36:18.120 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.122+0000 7f2a1fa319c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:36:18.121 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.122+0000 7f2a1fa319c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.5 2024-09-14T11:36:18.121 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.122+0000 7f2a1fa319c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.5 2024-09-14T11:36:18.122 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.122+0000 7f2a1fa319c0 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-14T11:36:18.122 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.122+0000 7f2a1fa319c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.6 2024-09-14T11:36:18.122 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.122+0000 7f2a1fa319c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.6 2024-09-14T11:36:18.123 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.122+0000 7f2a1fa319c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:36:18.124 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.122+0000 7f2a1fa319c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.7 2024-09-14T11:36:18.124 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.122+0000 7f2a1fa319c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.7 2024-09-14T11:36:18.125 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.126+0000 7f2a1fa319c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:36:18.125 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.126+0000 7f2a1fa319c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.8 2024-09-14T11:36:18.125 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.126+0000 7f2a1fa319c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.8 2024-09-14T11:36:18.126 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.126+0000 7f2a1fa319c0 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-14T11:36:18.127 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.126+0000 7f2a1fa319c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.9 2024-09-14T11:36:18.127 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.126+0000 7f2a1fa319c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.9 2024-09-14T11:36:18.127 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.126+0000 7f2a1fa319c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.10 2024-09-14T11:36:18.128 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.126+0000 7f2a1fa319c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.10 2024-09-14T11:36:18.128 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.130+0000 7f2a1fa319c0 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-14T11:36:18.128 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.130+0000 7f2a1fa319c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.11 2024-09-14T11:36:18.128 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.130+0000 7f2a1fa319c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.11 2024-09-14T11:36:18.129 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.130+0000 7f2a1fa319c0 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-14T11:36:18.129 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.130+0000 7f2a1fa319c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.12 2024-09-14T11:36:18.130 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.130+0000 7f2a1fa319c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.12 2024-09-14T11:36:18.131 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.130+0000 7f2a1fa319c0 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-14T11:36:18.131 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.130+0000 7f2a1fa319c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.13 2024-09-14T11:36:18.131 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.130+0000 7f2a1fa319c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.13 2024-09-14T11:36:18.132 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.134+0000 7f2a1fa319c0 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-14T11:36:18.133 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.134+0000 7f2a1fa319c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.14 2024-09-14T11:36:18.133 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.134+0000 7f2a1fa319c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.14 2024-09-14T11:36:18.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.134+0000 7f2a1fa319c0 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-14T11:36:18.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.134+0000 7f2a1fa319c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.15 2024-09-14T11:36:18.134 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.134+0000 7f2a1fa319c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.15 2024-09-14T11:36:18.135 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.134+0000 7f2a1fa319c0 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-14T11:36:18.135 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.134+0000 7f2a1fa319c0 10 bucket_obj is .dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.16 2024-09-14T11:36:18.135 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.134+0000 7f2a1fa319c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.16 2024-09-14T11:36:18.135 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.134+0000 7f2a1fa319c0 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-14T11:36:18.136 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.134+0000 7f2a1fa319c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.9 2024-09-14T11:36:18.136 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.138+0000 7f2a1fa319c0 20 get_obj_state: octx=0x55977af14290 obj=myver:x state=0x55977b255cd8 s->prefetch_data=0 2024-09-14T11:36:18.137 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.138+0000 7f2a1fa319c0 20 get_obj_state: setting s->obj_tag to 8gjm32efc5cwnusbg5e9mib5ddxp4pqo 2024-09-14T11:36:18.137 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.138+0000 7f2a1fa319c0 20 get_obj_state_impl: setting s->olh_tag to 0qjk5dgpzmxe1s37t8g3thx5au5bxd0o 2024-09-14T11:36:18.137 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.138+0000 7f2a1fa319c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=0qjk5dgpzmxe1s37t8g3thx5au5bxd0o 2024-09-14T11:36:18.139 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.138+0000 7f2a1fa319c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.9 2024-09-14T11:36:18.141 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.142+0000 7f2a1fa319c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.9 2024-09-14T11:36:18.141 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.142+0000 7f2a1fa319c0 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-14T11:36:18.141 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.142+0000 7f2a1fa319c0 20 olh_log_entry: epoch=2 op=3 key=x[xR8ogA-U1DR3BK7.-qtw0gM5aU3Ql9u] 2024-09-14T11:36:18.141 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.142+0000 7f2a1fa319c0 20 get_obj_state: octx=0x55977af14290 obj=myver:_:xR8ogA-U1DR3BK7.-qtw0gM5aU3Ql9u_x state=0x55977b284088 s->prefetch_data=0 2024-09-14T11:36:18.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.142+0000 7f2a1fa319c0 10 manifest: total_size = 9 2024-09-14T11:36:18.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.142+0000 7f2a1fa319c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.11728829281626813990 2024-09-14T11:36:18.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.142+0000 7f2a1fa319c0 20 get_obj_state: octx=0x55977af14290 obj=myver:_:xR8ogA-U1DR3BK7.-qtw0gM5aU3Ql9u_x state=0x55977b284088 s->prefetch_data=0 2024-09-14T11:36:18.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.142+0000 7f2a1fa319c0 20 prepare_atomic_modification: state is not atomic. state=0x55977b284088 2024-09-14T11:36:18.142 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.142+0000 7f2a1fa319c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.9 2024-09-14T11:36:18.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.150+0000 7f2900ff9640 20 handle_completion(): completion ok for obj=x[xR8ogA-U1DR3BK7.-qtw0gM5aU3Ql9u] 2024-09-14T11:36:18.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.150+0000 7f2a1fa319c0 20 get_obj_state: octx=0x55977af14290 obj=myver:x state=0x55977b255cd8 s->prefetch_data=0 2024-09-14T11:36:18.149 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.150+0000 7f2a1fa319c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=0qjk5dgpzmxe1s37t8g3thx5au5bxd0o 2024-09-14T11:36:18.153 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.154+0000 7f2a1fa319c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.9 2024-09-14T11:36:18.155 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.154+0000 7f2a1fa319c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.9 2024-09-14T11:36:18.155 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.154+0000 7f2a1fa319c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.9 2024-09-14T11:36:18.156 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.154+0000 7f2a1fa319c0 20 get_obj_state: octx=0x55977af14290 obj=myver:y state=0x55977b25a5c8 s->prefetch_data=0 2024-09-14T11:36:18.157 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.158+0000 7f2a1fa319c0 20 get_obj_state: setting s->obj_tag to i0jndrd04sszlz9db9jiuqm1hbpbqzro 2024-09-14T11:36:18.157 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.158+0000 7f2a1fa319c0 20 get_obj_state_impl: setting s->olh_tag to qerco3t355ciif1pl26sp21bwltht7ia 2024-09-14T11:36:18.157 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.158+0000 7f2a1fa319c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=qerco3t355ciif1pl26sp21bwltht7ia 2024-09-14T11:36:18.159 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.158+0000 7f2a1fa319c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.9 2024-09-14T11:36:18.161 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.162+0000 7f2a1fa319c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.9 2024-09-14T11:36:18.161 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.162+0000 7f2a1fa319c0 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-14T11:36:18.162 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.162+0000 7f2a1fa319c0 20 olh_log_entry: epoch=2 op=3 key=y[fURrGjaW0q6PZsbJng5cEn9RSKADrA7] 2024-09-14T11:36:18.162 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.162+0000 7f2a1fa319c0 20 get_obj_state: octx=0x55977af14290 obj=myver:_:fURrGjaW0q6PZsbJng5cEn9RSKADrA7_y state=0x55977b284088 s->prefetch_data=0 2024-09-14T11:36:18.163 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.162+0000 7f2a1fa319c0 10 manifest: total_size = 9 2024-09-14T11:36:18.163 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.162+0000 7f2a1fa319c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.3293728993938025917 2024-09-14T11:36:18.163 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.162+0000 7f2a1fa319c0 20 get_obj_state: octx=0x55977af14290 obj=myver:_:fURrGjaW0q6PZsbJng5cEn9RSKADrA7_y state=0x55977b284088 s->prefetch_data=0 2024-09-14T11:36:18.163 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.162+0000 7f2a1fa319c0 20 prepare_atomic_modification: state is not atomic. state=0x55977b284088 2024-09-14T11:36:18.163 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.162+0000 7f2a1fa319c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.9 2024-09-14T11:36:18.169 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.170+0000 7f28effff640 20 handle_completion(): completion ok for obj=y[fURrGjaW0q6PZsbJng5cEn9RSKADrA7] 2024-09-14T11:36:18.170 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.170+0000 7f2a1fa319c0 20 get_obj_state: octx=0x55977af14290 obj=myver:y state=0x55977b25a5c8 s->prefetch_data=0 2024-09-14T11:36:18.170 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.170+0000 7f2a1fa319c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=qerco3t355ciif1pl26sp21bwltht7ia 2024-09-14T11:36:18.173 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.174+0000 7f2a1fa319c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.9 2024-09-14T11:36:18.174 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.174+0000 7f2a1fa319c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.9 2024-09-14T11:36:18.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.174+0000 7f2a1fa319c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.9 2024-09-14T11:36:18.175 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.174+0000 7f2a1fa319c0 20 get_obj_state: octx=0x55977af14290 obj=myver:z state=0x55977b25a5c8 s->prefetch_data=0 2024-09-14T11:36:18.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.178+0000 7f2a1fa319c0 20 get_obj_state: setting s->obj_tag to jiuqxm7e8ft51f22o0zaee1btkf7n0yn 2024-09-14T11:36:18.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.178+0000 7f2a1fa319c0 20 get_obj_state_impl: setting s->olh_tag to 7i52mcdhyptgcf3m624rhe5ip71yn3bi 2024-09-14T11:36:18.176 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.178+0000 7f2a1fa319c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7i52mcdhyptgcf3m624rhe5ip71yn3bi 2024-09-14T11:36:18.179 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.178+0000 7f2a1fa319c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.9 2024-09-14T11:36:18.181 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.182+0000 7f2a1fa319c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.9 2024-09-14T11:36:18.182 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.182+0000 7f2a1fa319c0 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-14T11:36:18.182 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.182+0000 7f2a1fa319c0 20 olh_log_entry: epoch=2 op=3 key=z[.f5bHNGnkI6T5hWZVzkovJL9G6RxkH6] 2024-09-14T11:36:18.182 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.182+0000 7f2a1fa319c0 20 get_obj_state: octx=0x55977af14290 obj=myver:_:.f5bHNGnkI6T5hWZVzkovJL9G6RxkH6_z state=0x55977b283a68 s->prefetch_data=0 2024-09-14T11:36:18.183 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.182+0000 7f2a1fa319c0 10 manifest: total_size = 9 2024-09-14T11:36:18.183 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.182+0000 7f2a1fa319c0 20 get_obj_state: setting s->obj_tag to 4444f441-0c56-48df-a905-d49e7e44d629.4596.17670201355686060169 2024-09-14T11:36:18.183 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.182+0000 7f2a1fa319c0 20 get_obj_state: octx=0x55977af14290 obj=myver:_:.f5bHNGnkI6T5hWZVzkovJL9G6RxkH6_z state=0x55977b283a68 s->prefetch_data=0 2024-09-14T11:36:18.183 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.182+0000 7f2a1fa319c0 20 prepare_atomic_modification: state is not atomic. state=0x55977b283a68 2024-09-14T11:36:18.183 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.182+0000 7f2a1fa319c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.9 2024-09-14T11:36:18.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.190+0000 7f2900ff9640 20 handle_completion(): completion ok for obj=z[.f5bHNGnkI6T5hWZVzkovJL9G6RxkH6] 2024-09-14T11:36:18.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.190+0000 7f2a1fa319c0 20 get_obj_state: octx=0x55977af14290 obj=myver:z state=0x55977b25a5c8 s->prefetch_data=0 2024-09-14T11:36:18.190 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.190+0000 7f2a1fa319c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7i52mcdhyptgcf3m624rhe5ip71yn3bi 2024-09-14T11:36:18.196 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.198+0000 7f2a1fa319c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.9 2024-09-14T11:36:18.198 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.198+0000 7f2a1fa319c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.19.3.9 2024-09-14T11:36:18.198 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.198+0000 7f2a1fa319c0 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-14T11:36:18.198 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.198+0000 7f2a1fa319c0 1 NOTICE: finished all shards (3 entries removed) 2024-09-14T11:36:18.199 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.198+0000 7f28d3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:18.204 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.206+0000 7f2a1fa319c0 20 remove_watcher() i=0 2024-09-14T11:36:18.205 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.206+0000 7f2a1fa319c0 2 removed watcher, disabling cache 2024-09-14T11:36:18.206 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.206+0000 7f2a1fa319c0 20 remove_watcher() i=1 2024-09-14T11:36:18.209 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.210+0000 7f2a1fa319c0 20 remove_watcher() i=2 2024-09-14T11:36:18.211 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.210+0000 7f2a1fa319c0 20 remove_watcher() i=3 2024-09-14T11:36:18.215 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.214+0000 7f2a1fa319c0 20 remove_watcher() i=4 2024-09-14T11:36:18.218 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.218+0000 7f2a1fa319c0 20 remove_watcher() i=5 2024-09-14T11:36:18.221 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.222+0000 7f2a1fa319c0 20 remove_watcher() i=6 2024-09-14T11:36:18.224 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.226+0000 7f2a1fa319c0 20 remove_watcher() i=7 2024-09-14T11:36:18.297 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:36:18.328 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:18.328 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:18.374 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.374+0000 7f2aa11749c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.377 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.378+0000 7f2aa11749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.377 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.378+0000 7f2aa11749c0 20 realm 2024-09-14T11:36:18.377 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.378+0000 7f2aa11749c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.378 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.378+0000 7f2aa11749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.378 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.378+0000 7f2aa11749c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:18.378 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.378+0000 7f2aa11749c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.378 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.378+0000 7f2aa11749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.378 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.378+0000 7f2aa11749c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.379 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.378+0000 7f2aa11749c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:18.379 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.378+0000 7f2aa11749c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.380 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.378+0000 7f2aa11749c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:18.380 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.378+0000 7f2aa11749c0 20 searching for the correct realm 2024-09-14T11:36:18.384 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.382+0000 7f2a9f47b640 0 -- 172.21.15.71:0/4060512515 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f2a94132ac0 msgr2=0x7f2a940fdb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:18.595 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.594+0000 7f2a9f47b640 0 -- 172.21.15.71:0/4060512515 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55a96c35b480 msgr2=0x55a96c35d870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:18.611 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.610+0000 7f2aa11749c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:18.611 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.610+0000 7f2aa11749c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:36:18.611 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.610+0000 7f2aa11749c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:18.611 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.610+0000 7f2aa11749c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:36:18.611 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.610+0000 7f2aa11749c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:18.611 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.610+0000 7f2aa11749c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:18.611 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.610+0000 7f2aa11749c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.610+0000 7f2aa11749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.610+0000 7f2aa11749c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.614+0000 7f2aa11749c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:18.612 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.614+0000 7f2aa11749c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.613 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.614+0000 7f2aa11749c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:18.613 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.614+0000 7f2aa11749c0 20 zone default found 2024-09-14T11:36:18.613 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.614+0000 7f2aa11749c0 4 Realm: () 2024-09-14T11:36:18.613 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.614+0000 7f2aa11749c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:36:18.613 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.614+0000 7f2aa11749c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:36:18.614 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.614+0000 7f2aa11749c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:18.614 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.614+0000 7f2aa11749c0 20 zonegroup default 2024-09-14T11:36:18.614 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.614+0000 7f2aa11749c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.614 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.614+0000 7f2aa11749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.614 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.614+0000 7f2aa11749c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.614 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.614+0000 7f2aa11749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.615 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.614+0000 7f2aa11749c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.616 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.614+0000 7f2aa11749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.616 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.614+0000 7f2aa11749c0 20 started sync module instance, tier type = 2024-09-14T11:36:18.616 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.614+0000 7f2aa11749c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:36:18.638 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.638+0000 7f2aa11749c0 20 add_watcher() i=0 2024-09-14T11:36:18.638 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.638+0000 7f2aa11749c0 20 add_watcher() i=1 2024-09-14T11:36:18.638 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.638+0000 7f2aa11749c0 20 add_watcher() i=2 2024-09-14T11:36:18.638 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.638+0000 7f2aa11749c0 20 add_watcher() i=3 2024-09-14T11:36:18.638 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.638+0000 7f2aa11749c0 20 add_watcher() i=4 2024-09-14T11:36:18.638 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.638+0000 7f2aa11749c0 20 add_watcher() i=5 2024-09-14T11:36:18.638 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.638+0000 7f2aa11749c0 20 add_watcher() i=6 2024-09-14T11:36:18.640 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.642+0000 7f2aa11749c0 20 add_watcher() i=7 2024-09-14T11:36:18.640 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.642+0000 7f2aa11749c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:18.644 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.642+0000 7f29557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:18.645 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.646+0000 7f2aa11749c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:18.645 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.646+0000 7f2aa11749c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:18.645 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.646+0000 7f2aa11749c0 5 note: GC not initialized 2024-09-14T11:36:18.646 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.646+0000 7f28cffff640 20 reqs_thread_entry: start 2024-09-14T11:36:18.646 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.646+0000 7f2aa11749c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:18.646 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.646+0000 7f2aa11749c0 20 Filter name: none 2024-09-14T11:36:18.646 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.646+0000 7f28cdffb640 20 reqs_thread_entry: start 2024-09-14T11:36:18.646 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.646+0000 7f2aa11749c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.646 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.646+0000 7f2aa11749c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:18.647 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.646+0000 7f2aa11749c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.647 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.646+0000 7f2aa11749c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:18.647 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.646+0000 7f2aa11749c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:18.647 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.646+0000 7f2aa11749c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.648 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.650+0000 7f2aa11749c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:18.648 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.650+0000 7f2aa11749c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.649 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.650+0000 7f2aa11749c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:18.649 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.650+0000 7f2aa11749c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:18.653 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.654+0000 7f29557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:18.657 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.658+0000 7f2aa11749c0 20 remove_watcher() i=0 2024-09-14T11:36:18.657 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.658+0000 7f2aa11749c0 2 removed watcher, disabling cache 2024-09-14T11:36:18.659 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.658+0000 7f2aa11749c0 20 remove_watcher() i=1 2024-09-14T11:36:18.661 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.662+0000 7f2aa11749c0 20 remove_watcher() i=2 2024-09-14T11:36:18.663 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.662+0000 7f2aa11749c0 20 remove_watcher() i=3 2024-09-14T11:36:18.665 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.666+0000 7f2aa11749c0 20 remove_watcher() i=4 2024-09-14T11:36:18.667 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.666+0000 7f2aa11749c0 20 remove_watcher() i=5 2024-09-14T11:36:18.670 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.670+0000 7f2aa11749c0 20 remove_watcher() i=6 2024-09-14T11:36:18.673 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:36:18.674+0000 7f2aa11749c0 20 remove_watcher() i=7 2024-09-14T11:36:18.687 INFO:tasks.workunit.client.0.smithi071.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-14T11:36:18.688 INFO:tasks.workunit.client.0.smithi071.stderr:Deleting bucket a-bucket 2024-09-14T11:36:18.725 INFO:tasks.workunit.client.0.smithi071.stderr:Deleting bucket myver 2024-09-14T11:36:18.869 INFO:tasks.workunit.client.0.smithi071.stderr:Completed resharding tests 2024-09-14T11:36:18.869 INFO:tasks.workunit.client.0.smithi071.stdout:connected to http://localhost:80 2024-09-14T11:36:18.989 INFO:tasks.workunit.client.0.smithi071.stderr:+ deactivate 2024-09-14T11:36:18.989 INFO:tasks.workunit.client.0.smithi071.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-14T11:36:18.989 INFO:tasks.workunit.client.0.smithi071.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T11:36:18.989 INFO:tasks.workunit.client.0.smithi071.stderr:+ export PATH 2024-09-14T11:36:18.989 INFO:tasks.workunit.client.0.smithi071.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T11:36:18.989 INFO:tasks.workunit.client.0.smithi071.stderr:+ '[' -n '' ']' 2024-09-14T11:36:18.989 INFO:tasks.workunit.client.0.smithi071.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:36:18.989 INFO:tasks.workunit.client.0.smithi071.stderr:+ hash -r 2024-09-14T11:36:18.989 INFO:tasks.workunit.client.0.smithi071.stderr:+ '[' -n '' ']' 2024-09-14T11:36:18.990 INFO:tasks.workunit.client.0.smithi071.stderr:+ unset VIRTUAL_ENV 2024-09-14T11:36:18.990 INFO:tasks.workunit.client.0.smithi071.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-14T11:36:18.990 INFO:tasks.workunit.client.0.smithi071.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T11:36:18.990 INFO:tasks.workunit.client.0.smithi071.stderr:+ unset -f deactivate 2024-09-14T11:36:18.990 INFO:tasks.workunit.client.0.smithi071.stderr:+ echo OK. 2024-09-14T11:36:18.991 INFO:tasks.workunit.client.0.smithi071.stdout:OK. 2024-09-14T11:36:18.991 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:36:18.991 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:36:19.002 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-14T11:36:19.003 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:36:19.440 DEBUG:teuthology.parallel:result is None 2024-09-14T11:36:19.440 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:36:19.452 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:36:19.452 DEBUG:teuthology.orchestra.run.smithi071:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:36:19.501 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:36:19.501 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-14T11:36:19.517 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-14T11:36:19.517 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-14T11:36:19.517 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-14T11:36:19.518 DEBUG:teuthology.orchestra.run.smithi071:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-14T11:36:19.548 INFO:teuthology.orchestra.run.smithi071.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-14T11:36:23.950 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-14T11:36:23.950 DEBUG:teuthology.orchestra.run.smithi071:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-14T11:36:24.040 INFO:teuthology.orchestra.run.smithi071.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required DEB packages. Installing via sudo. 2024-09-14T11:36:24.095 INFO:teuthology.orchestra.run.smithi071.stdout:Reading package lists... 2024-09-14T11:36:24.304 INFO:teuthology.orchestra.run.smithi071.stdout:Building dependency tree... 2024-09-14T11:36:24.304 INFO:teuthology.orchestra.run.smithi071.stdout:Reading state information... 2024-09-14T11:36:24.493 INFO:teuthology.orchestra.run.smithi071.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T11:36:24.493 INFO:teuthology.orchestra.run.smithi071.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T11:36:24.494 INFO:teuthology.orchestra.run.smithi071.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T11:36:24.494 INFO:teuthology.orchestra.run.smithi071.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T11:36:24.494 INFO:teuthology.orchestra.run.smithi071.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T11:36:24.494 INFO:teuthology.orchestra.run.smithi071.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T11:36:24.494 INFO:teuthology.orchestra.run.smithi071.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T11:36:24.495 INFO:teuthology.orchestra.run.smithi071.stdout:The following additional packages will be installed: 2024-09-14T11:36:24.496 INFO:teuthology.orchestra.run.smithi071.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-09-14T11:36:24.496 INFO:teuthology.orchestra.run.smithi071.stdout: openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-09-14T11:36:24.497 INFO:teuthology.orchestra.run.smithi071.stdout:Suggested packages: 2024-09-14T11:36:24.497 INFO:teuthology.orchestra.run.smithi071.stdout: gvfs openjdk-8-demo openjdk-8-source visualvm libnss-mdns fonts-nanum 2024-09-14T11:36:24.497 INFO:teuthology.orchestra.run.smithi071.stdout: fonts-ipafont-gothic fonts-ipafont-mincho fonts-wqy-microhei 2024-09-14T11:36:24.497 INFO:teuthology.orchestra.run.smithi071.stdout: fonts-wqy-zenhei fonts-indic 2024-09-14T11:36:24.533 INFO:teuthology.orchestra.run.smithi071.stdout:The following NEW packages will be installed: 2024-09-14T11:36:24.533 INFO:teuthology.orchestra.run.smithi071.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-09-14T11:36:24.534 INFO:teuthology.orchestra.run.smithi071.stdout: openjdk-8-jdk openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-09-14T11:36:24.734 INFO:teuthology.orchestra.run.smithi071.stdout:0 upgraded, 9 newly installed, 0 to remove and 331 not upgraded. 2024-09-14T11:36:24.734 INFO:teuthology.orchestra.run.smithi071.stdout:Need to get 46.0 MB of archives. 2024-09-14T11:36:24.734 INFO:teuthology.orchestra.run.smithi071.stdout:After this operation, 155 MB of additional disk space will be used. 2024-09-14T11:36:24.734 INFO:teuthology.orchestra.run.smithi071.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-common all 2.24.33-2ubuntu2.1 [125 kB] 2024-09-14T11:36:25.101 INFO:teuthology.orchestra.run.smithi071.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-0 amd64 2.24.33-2ubuntu2.1 [2,038 kB] 2024-09-14T11:36:25.456 INFO:teuthology.orchestra.run.smithi071.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail18 amd64 2.24.33-2ubuntu2.1 [15.9 kB] 2024-09-14T11:36:25.457 INFO:teuthology.orchestra.run.smithi071.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail-common amd64 2.24.33-2ubuntu2.1 [132 kB] 2024-09-14T11:36:25.463 INFO:teuthology.orchestra.run.smithi071.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-bin amd64 2.24.33-2ubuntu2.1 [7,936 B] 2024-09-14T11:36:25.464 INFO:teuthology.orchestra.run.smithi071.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre-headless amd64 8u422-b05-1~22.04 [30.8 MB] 2024-09-14T11:36:26.520 INFO:teuthology.orchestra.run.smithi071.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre amd64 8u422-b05-1~22.04 [75.5 kB] 2024-09-14T11:36:26.638 INFO:teuthology.orchestra.run.smithi071.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk-headless amd64 8u422-b05-1~22.04 [8,843 kB] 2024-09-14T11:36:26.770 INFO:teuthology.orchestra.run.smithi071.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk amd64 8u422-b05-1~22.04 [4,012 kB] 2024-09-14T11:36:27.192 INFO:teuthology.orchestra.run.smithi071.stderr:debconf: unable to initialize frontend: Dialog 2024-09-14T11:36:27.193 INFO:teuthology.orchestra.run.smithi071.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-09-14T11:36:27.193 INFO:teuthology.orchestra.run.smithi071.stderr:debconf: falling back to frontend: Readline 2024-09-14T11:36:27.205 INFO:teuthology.orchestra.run.smithi071.stderr:debconf: unable to initialize frontend: Readline 2024-09-14T11:36:27.205 INFO:teuthology.orchestra.run.smithi071.stderr:debconf: (This frontend requires a controlling tty.) 2024-09-14T11:36:27.205 INFO:teuthology.orchestra.run.smithi071.stderr:debconf: falling back to frontend: Teletype 2024-09-14T11:36:27.208 INFO:teuthology.orchestra.run.smithi071.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-09-14T11:36:27.242 INFO:teuthology.orchestra.run.smithi071.stdout:Fetched 46.0 MB in 2s (19.7 MB/s) 2024-09-14T11:36:27.357 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libgtk2.0-common. 2024-09-14T11:36:27.453 INFO:teuthology.orchestra.run.smithi071.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 177250 files and directories currently installed.) 2024-09-14T11:36:27.458 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../0-libgtk2.0-common_2.24.33-2ubuntu2.1_all.deb ... 2024-09-14T11:36:27.505 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-09-14T11:36:27.892 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libgtk2.0-0:amd64. 2024-09-14T11:36:27.921 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../1-libgtk2.0-0_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-14T11:36:28.001 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-14T11:36:28.497 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libgail18:amd64. 2024-09-14T11:36:28.525 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../2-libgail18_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-14T11:36:28.571 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-14T11:36:28.833 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libgail-common:amd64. 2024-09-14T11:36:28.849 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../3-libgail-common_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-14T11:36:28.891 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-14T11:36:29.152 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libgtk2.0-bin. 2024-09-14T11:36:29.169 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../4-libgtk2.0-bin_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-14T11:36:29.210 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-09-14T11:36:29.672 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package openjdk-8-jre-headless:amd64. 2024-09-14T11:36:29.701 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../5-openjdk-8-jre-headless_8u422-b05-1~22.04_amd64.deb ... 2024-09-14T11:36:29.751 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-14T11:36:31.336 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package openjdk-8-jre:amd64. 2024-09-14T11:36:31.365 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../6-openjdk-8-jre_8u422-b05-1~22.04_amd64.deb ... 2024-09-14T11:36:31.405 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-09-14T11:36:31.857 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package openjdk-8-jdk-headless:amd64. 2024-09-14T11:36:31.886 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../7-openjdk-8-jdk-headless_8u422-b05-1~22.04_amd64.deb ... 2024-09-14T11:36:31.928 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-14T11:36:32.636 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package openjdk-8-jdk:amd64. 2024-09-14T11:36:32.652 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../8-openjdk-8-jdk_8u422-b05-1~22.04_amd64.deb ... 2024-09-14T11:36:32.698 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-09-14T11:36:33.047 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-14T11:36:34.161 INFO:teuthology.orchestra.run.smithi071.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/orbd to provide /usr/bin/orbd (orbd) in auto mode 2024-09-14T11:36:34.186 INFO:teuthology.orchestra.run.smithi071.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/servertool to provide /usr/bin/servertool (servertool) in auto mode 2024-09-14T11:36:34.213 INFO:teuthology.orchestra.run.smithi071.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/tnameserv to provide /usr/bin/tnameserv (tnameserv) in auto mode 2024-09-14T11:36:34.561 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-09-14T11:36:34.729 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-14T11:36:35.138 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-09-14T11:36:35.230 INFO:teuthology.orchestra.run.smithi071.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/policytool to provide /usr/bin/policytool (policytool) in auto mode 2024-09-14T11:36:35.291 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-14T11:36:35.366 INFO:teuthology.orchestra.run.smithi071.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/clhsdb to provide /usr/bin/clhsdb (clhsdb) in auto mode 2024-09-14T11:36:35.396 INFO:teuthology.orchestra.run.smithi071.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/extcheck to provide /usr/bin/extcheck (extcheck) in auto mode 2024-09-14T11:36:35.413 INFO:teuthology.orchestra.run.smithi071.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/hsdb to provide /usr/bin/hsdb (hsdb) in auto mode 2024-09-14T11:36:35.429 INFO:teuthology.orchestra.run.smithi071.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/idlj to provide /usr/bin/idlj (idlj) in auto mode 2024-09-14T11:36:35.557 INFO:teuthology.orchestra.run.smithi071.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/javah to provide /usr/bin/javah (javah) in auto mode 2024-09-14T11:36:35.718 INFO:teuthology.orchestra.run.smithi071.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jhat to provide /usr/bin/jhat (jhat) in auto mode 2024-09-14T11:36:35.853 INFO:teuthology.orchestra.run.smithi071.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jsadebugd to provide /usr/bin/jsadebugd (jsadebugd) in auto mode 2024-09-14T11:36:35.946 INFO:teuthology.orchestra.run.smithi071.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/native2ascii to provide /usr/bin/native2ascii (native2ascii) in auto mode 2024-09-14T11:36:35.998 INFO:teuthology.orchestra.run.smithi071.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/schemagen to provide /usr/bin/schemagen (schemagen) in auto mode 2024-09-14T11:36:36.047 INFO:teuthology.orchestra.run.smithi071.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsgen to provide /usr/bin/wsgen (wsgen) in auto mode 2024-09-14T11:36:36.074 INFO:teuthology.orchestra.run.smithi071.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsimport to provide /usr/bin/wsimport (wsimport) in auto mode 2024-09-14T11:36:36.098 INFO:teuthology.orchestra.run.smithi071.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/xjc to provide /usr/bin/xjc (xjc) in auto mode 2024-09-14T11:36:36.163 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-14T11:36:36.289 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-09-14T11:36:36.415 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-09-14T11:36:36.515 INFO:teuthology.orchestra.run.smithi071.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/appletviewer to provide /usr/bin/appletviewer (appletviewer) in auto mode 2024-09-14T11:36:36.601 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-14T11:36:36.703 INFO:teuthology.orchestra.run.smithi071.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-14T11:36:37.770 INFO:teuthology.orchestra.run.smithi071.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-14T11:36:37.871 INFO:teuthology.orchestra.run.smithi071.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-14T11:36:38.156 INFO:teuthology.orchestra.run.smithi071.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-14T11:36:38.580 INFO:teuthology.orchestra.run.smithi071.stdout: Gradle will be installed under /opt/gradle 2024-09-14T11:36:38.607 INFO:teuthology.orchestra.run.smithi071.stderr:--2024-09-14 11:36:38-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-14T11:36:38.624 INFO:teuthology.orchestra.run.smithi071.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.72.101, 104.16.73.101, 2606:4700::6810:4865, ... 2024-09-14T11:36:38.637 INFO:teuthology.orchestra.run.smithi071.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.72.101|:443... connected. 2024-09-14T11:36:38.690 INFO:teuthology.orchestra.run.smithi071.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-14T11:36:38.690 INFO:teuthology.orchestra.run.smithi071.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-14T11:36:38.690 INFO:teuthology.orchestra.run.smithi071.stderr:--2024-09-14 11:36:38-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-14T11:36:38.692 INFO:teuthology.orchestra.run.smithi071.stderr:Resolving github.com (github.com)... 140.82.113.4 2024-09-14T11:36:38.700 INFO:teuthology.orchestra.run.smithi071.stderr:Connecting to github.com (github.com)|140.82.113.4|:443... connected. 2024-09-14T11:36:38.793 INFO:teuthology.orchestra.run.smithi071.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-14T11:36:38.793 INFO:teuthology.orchestra.run.smithi071.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240914%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240914T113638Z&X-Amz-Expires=300&X-Amz-Signature=e7fe995cf9437d6fc59d164b4ba00d8a0cee34710ba6954c1fc9f2111547bfcb&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-14T11:36:38.793 INFO:teuthology.orchestra.run.smithi071.stderr:--2024-09-14 11:36:38-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240914%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240914T113638Z&X-Amz-Expires=300&X-Amz-Signature=e7fe995cf9437d6fc59d164b4ba00d8a0cee34710ba6954c1fc9f2111547bfcb&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-14T11:36:38.795 INFO:teuthology.orchestra.run.smithi071.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.109.133, 185.199.110.133, 185.199.108.133, ... 2024-09-14T11:36:38.808 INFO:teuthology.orchestra.run.smithi071.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.109.133|:443... connected. 2024-09-14T11:36:38.895 INFO:teuthology.orchestra.run.smithi071.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-14T11:36:38.895 INFO:teuthology.orchestra.run.smithi071.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-14T11:36:38.896 INFO:teuthology.orchestra.run.smithi071.stderr:Saving to: 'gradle-6.0.1-bin.zip' 2024-09-14T11:36:38.896 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-14T11:36:38.907 INFO:teuthology.orchestra.run.smithi071.stderr: 0K .......... .......... .......... .......... .......... 0% 3.94M 23s 2024-09-14T11:36:38.920 INFO:teuthology.orchestra.run.smithi071.stderr: 50K .......... .......... .......... .......... .......... 0% 3.99M 23s 2024-09-14T11:36:38.923 INFO:teuthology.orchestra.run.smithi071.stderr: 100K .......... .......... .......... .......... .......... 0% 14.9M 17s 2024-09-14T11:36:38.925 INFO:teuthology.orchestra.run.smithi071.stderr: 150K .......... .......... .......... .......... .......... 0% 18.5M 14s 2024-09-14T11:36:38.933 INFO:teuthology.orchestra.run.smithi071.stderr: 200K .......... .......... .......... .......... .......... 0% 6.69M 14s 2024-09-14T11:36:38.934 INFO:teuthology.orchestra.run.smithi071.stderr: 250K .......... .......... .......... .......... .......... 0% 35.9M 12s 2024-09-14T11:36:38.938 INFO:teuthology.orchestra.run.smithi071.stderr: 300K .......... .......... .......... .......... .......... 0% 23.4M 11s 2024-09-14T11:36:38.938 INFO:teuthology.orchestra.run.smithi071.stderr: 350K .......... .......... .......... .......... .......... 0% 63.0M 10s 2024-09-14T11:36:38.946 INFO:teuthology.orchestra.run.smithi071.stderr: 400K .......... .......... .......... .......... .......... 0% 7.32M 10s 2024-09-14T11:36:38.946 INFO:teuthology.orchestra.run.smithi071.stderr: 450K .......... .......... .......... .......... .......... 0% 76.2M 9s 2024-09-14T11:36:38.946 INFO:teuthology.orchestra.run.smithi071.stderr: 500K .......... .......... .......... .......... .......... 0% 43.3M 8s 2024-09-14T11:36:38.951 INFO:teuthology.orchestra.run.smithi071.stderr: 550K .......... .......... .......... .......... .......... 0% 38.3M 8s 2024-09-14T11:36:38.951 INFO:teuthology.orchestra.run.smithi071.stderr: 600K .......... .......... .......... .......... .......... 0% 77.7M 7s 2024-09-14T11:36:38.952 INFO:teuthology.orchestra.run.smithi071.stderr: 650K .......... .......... .......... .......... .......... 0% 80.0M 7s 2024-09-14T11:36:38.952 INFO:teuthology.orchestra.run.smithi071.stderr: 700K .......... .......... .......... .......... .......... 0% 42.6M 7s 2024-09-14T11:36:38.952 INFO:teuthology.orchestra.run.smithi071.stderr: 750K .......... .......... .......... .......... .......... 0% 82.3M 6s 2024-09-14T11:36:38.952 INFO:teuthology.orchestra.run.smithi071.stderr: 800K .......... .......... .......... .......... .......... 0% 81.4M 6s 2024-09-14T11:36:39.823 INFO:teuthology.orchestra.run.smithi071.stderr: 850K .......... .......... .......... .......... .......... 0% 8.56M 6s 2024-09-14T11:36:39.823 INFO:teuthology.orchestra.run.smithi071.stderr: 900K .......... .......... .......... .......... .......... 1% 68.8M 6s 2024-09-14T11:36:39.823 INFO:teuthology.orchestra.run.smithi071.stderr: 950K .......... .......... .......... .......... .......... 1% 84.7M 6s 2024-09-14T11:36:39.823 INFO:teuthology.orchestra.run.smithi071.stderr: 1000K .......... .......... .......... .......... .......... 1% 75.1M 6s 2024-09-14T11:36:39.823 INFO:teuthology.orchestra.run.smithi071.stderr: 1050K .......... .......... .......... .......... .......... 1% 83.7M 5s 2024-09-14T11:36:39.824 INFO:teuthology.orchestra.run.smithi071.stderr: 1100K .......... .......... .......... .......... .......... 1% 66.9M 5s 2024-09-14T11:36:39.824 INFO:teuthology.orchestra.run.smithi071.stderr: 1150K .......... .......... .......... .......... .......... 1% 76.8M 5s 2024-09-14T11:36:39.824 INFO:teuthology.orchestra.run.smithi071.stderr: 1200K .......... .......... .......... .......... .......... 1% 81.0M 5s 2024-09-14T11:36:39.824 INFO:teuthology.orchestra.run.smithi071.stderr: 1250K .......... .......... .......... .......... .......... 1% 81.7M 5s 2024-09-14T11:36:39.824 INFO:teuthology.orchestra.run.smithi071.stderr: 1300K .......... .......... .......... .......... .......... 1% 65.9M 5s 2024-09-14T11:36:39.824 INFO:teuthology.orchestra.run.smithi071.stderr: 1350K .......... .......... .......... .......... .......... 1% 80.3M 4s 2024-09-14T11:36:39.824 INFO:teuthology.orchestra.run.smithi071.stderr: 1400K .......... .......... .......... .......... .......... 1% 79.9M 4s 2024-09-14T11:36:39.824 INFO:teuthology.orchestra.run.smithi071.stderr: 1450K .......... .......... .......... .......... .......... 1% 81.2M 4s 2024-09-14T11:36:39.824 INFO:teuthology.orchestra.run.smithi071.stderr: 1500K .......... .......... .......... .......... .......... 1% 68.3M 4s 2024-09-14T11:36:39.824 INFO:teuthology.orchestra.run.smithi071.stderr: 1550K .......... .......... .......... .......... .......... 1% 83.8M 4s 2024-09-14T11:36:39.824 INFO:teuthology.orchestra.run.smithi071.stderr: 1600K .......... .......... .......... .......... .......... 1% 78.0M 4s 2024-09-14T11:36:39.824 INFO:teuthology.orchestra.run.smithi071.stderr: 1650K .......... .......... .......... .......... .......... 1% 83.7M 4s 2024-09-14T11:36:39.824 INFO:teuthology.orchestra.run.smithi071.stderr: 1700K .......... .......... .......... .......... .......... 1% 72.4M 4s 2024-09-14T11:36:39.824 INFO:teuthology.orchestra.run.smithi071.stderr: 1750K .......... .......... .......... .......... .......... 1% 34.5M 4s 2024-09-14T11:36:39.824 INFO:teuthology.orchestra.run.smithi071.stderr: 1800K .......... .......... .......... .......... .......... 1% 76.4M 4s 2024-09-14T11:36:39.825 INFO:teuthology.orchestra.run.smithi071.stderr: 1850K .......... .......... .......... .......... .......... 2% 75.5M 4s 2024-09-14T11:36:39.825 INFO:teuthology.orchestra.run.smithi071.stderr: 1900K .......... .......... .......... .......... .......... 2% 64.2M 4s 2024-09-14T11:36:39.825 INFO:teuthology.orchestra.run.smithi071.stderr: 1950K .......... .......... .......... .......... .......... 2% 82.0M 3s 2024-09-14T11:36:39.825 INFO:teuthology.orchestra.run.smithi071.stderr: 2000K .......... .......... .......... .......... .......... 2% 76.8M 3s 2024-09-14T11:36:39.825 INFO:teuthology.orchestra.run.smithi071.stderr: 2050K .......... .......... .......... .......... .......... 2% 75.0M 3s 2024-09-14T11:36:39.825 INFO:teuthology.orchestra.run.smithi071.stderr: 2100K .......... .......... .......... .......... .......... 2% 69.0M 3s 2024-09-14T11:36:39.825 INFO:teuthology.orchestra.run.smithi071.stderr: 2150K .......... .......... .......... .......... .......... 2% 72.0M 3s 2024-09-14T11:36:39.825 INFO:teuthology.orchestra.run.smithi071.stderr: 2200K .......... .......... .......... .......... .......... 2% 79.3M 3s 2024-09-14T11:36:39.825 INFO:teuthology.orchestra.run.smithi071.stderr: 2250K .......... .......... .......... .......... .......... 2% 73.1M 3s 2024-09-14T11:36:39.825 INFO:teuthology.orchestra.run.smithi071.stderr: 2300K .......... .......... .......... .......... .......... 2% 63.8M 3s 2024-09-14T11:36:39.825 INFO:teuthology.orchestra.run.smithi071.stderr: 2350K .......... .......... .......... .......... .......... 2% 79.3M 3s 2024-09-14T11:36:39.825 INFO:teuthology.orchestra.run.smithi071.stderr: 2400K .......... .......... .......... .......... .......... 2% 80.2M 3s 2024-09-14T11:36:39.825 INFO:teuthology.orchestra.run.smithi071.stderr: 2450K .......... .......... .......... .......... .......... 2% 83.2M 3s 2024-09-14T11:36:39.826 INFO:teuthology.orchestra.run.smithi071.stderr: 2500K .......... .......... .......... .......... .......... 2% 73.4M 3s 2024-09-14T11:36:39.826 INFO:teuthology.orchestra.run.smithi071.stderr: 2550K .......... .......... .......... .......... .......... 2% 77.0M 3s 2024-09-14T11:36:39.826 INFO:teuthology.orchestra.run.smithi071.stderr: 2600K .......... .......... .......... .......... .......... 2% 81.6M 3s 2024-09-14T11:36:39.826 INFO:teuthology.orchestra.run.smithi071.stderr: 2650K .......... .......... .......... .......... .......... 2% 75.5M 3s 2024-09-14T11:36:39.826 INFO:teuthology.orchestra.run.smithi071.stderr: 2700K .......... .......... .......... .......... .......... 2% 66.8M 3s 2024-09-14T11:36:39.826 INFO:teuthology.orchestra.run.smithi071.stderr: 2750K .......... .......... .......... .......... .......... 3% 74.5M 3s 2024-09-14T11:36:39.826 INFO:teuthology.orchestra.run.smithi071.stderr: 2800K .......... .......... .......... .......... .......... 3% 70.0M 3s 2024-09-14T11:36:39.826 INFO:teuthology.orchestra.run.smithi071.stderr: 2850K .......... .......... .......... .......... .......... 3% 76.0M 3s 2024-09-14T11:36:39.826 INFO:teuthology.orchestra.run.smithi071.stderr: 2900K .......... .......... .......... .......... .......... 3% 66.2M 3s 2024-09-14T11:36:39.826 INFO:teuthology.orchestra.run.smithi071.stderr: 2950K .......... .......... .......... .......... .......... 3% 72.4M 3s 2024-09-14T11:36:39.826 INFO:teuthology.orchestra.run.smithi071.stderr: 3000K .......... .......... .......... .......... .......... 3% 76.6M 3s 2024-09-14T11:36:39.826 INFO:teuthology.orchestra.run.smithi071.stderr: 3050K .......... .......... .......... .......... .......... 3% 72.6M 3s 2024-09-14T11:36:39.826 INFO:teuthology.orchestra.run.smithi071.stderr: 3100K .......... .......... .......... .......... .......... 3% 63.9M 3s 2024-09-14T11:36:39.826 INFO:teuthology.orchestra.run.smithi071.stderr: 3150K .......... .......... .......... .......... .......... 3% 70.5M 3s 2024-09-14T11:36:39.826 INFO:teuthology.orchestra.run.smithi071.stderr: 3200K .......... .......... .......... .......... .......... 3% 77.2M 3s 2024-09-14T11:36:39.827 INFO:teuthology.orchestra.run.smithi071.stderr: 3250K .......... .......... .......... .......... .......... 3% 72.8M 3s 2024-09-14T11:36:39.827 INFO:teuthology.orchestra.run.smithi071.stderr: 3300K .......... .......... .......... .......... .......... 3% 109M 3s 2024-09-14T11:36:39.827 INFO:teuthology.orchestra.run.smithi071.stderr: 3350K .......... .......... .......... .......... .......... 3% 147M 2s 2024-09-14T11:36:39.827 INFO:teuthology.orchestra.run.smithi071.stderr: 3400K .......... .......... .......... .......... .......... 3% 132M 2s 2024-09-14T11:36:39.827 INFO:teuthology.orchestra.run.smithi071.stderr: 3450K .......... .......... .......... .......... .......... 3% 152M 2s 2024-09-14T11:36:39.827 INFO:teuthology.orchestra.run.smithi071.stderr: 3500K .......... .......... .......... .......... .......... 3% 126M 2s 2024-09-14T11:36:39.827 INFO:teuthology.orchestra.run.smithi071.stderr: 3550K .......... .......... .......... .......... .......... 3% 151M 2s 2024-09-14T11:36:39.827 INFO:teuthology.orchestra.run.smithi071.stderr: 3600K .......... .......... .......... .......... .......... 3% 153M 2s 2024-09-14T11:36:39.827 INFO:teuthology.orchestra.run.smithi071.stderr: 3650K .......... .......... .......... .......... .......... 3% 151M 2s 2024-09-14T11:36:39.827 INFO:teuthology.orchestra.run.smithi071.stderr: 3700K .......... .......... .......... .......... .......... 4% 136M 2s 2024-09-14T11:36:39.827 INFO:teuthology.orchestra.run.smithi071.stderr: 3750K .......... .......... .......... .......... .......... 4% 152M 2s 2024-09-14T11:36:39.827 INFO:teuthology.orchestra.run.smithi071.stderr: 3800K .......... .......... .......... .......... .......... 4% 144M 2s 2024-09-14T11:36:39.827 INFO:teuthology.orchestra.run.smithi071.stderr: 3850K .......... .......... .......... .......... .......... 4% 151M 2s 2024-09-14T11:36:39.827 INFO:teuthology.orchestra.run.smithi071.stderr: 3900K .......... .......... .......... .......... .......... 4% 68.5M 2s 2024-09-14T11:36:39.827 INFO:teuthology.orchestra.run.smithi071.stderr: 3950K .......... .......... .......... .......... .......... 4% 113M 2s 2024-09-14T11:36:39.827 INFO:teuthology.orchestra.run.smithi071.stderr: 4000K .......... .......... .......... .......... .......... 4% 114M 2s 2024-09-14T11:36:39.828 INFO:teuthology.orchestra.run.smithi071.stderr: 4050K .......... .......... .......... .......... .......... 4% 147M 2s 2024-09-14T11:36:39.828 INFO:teuthology.orchestra.run.smithi071.stderr: 4100K .......... .......... .......... .......... .......... 4% 93.8M 2s 2024-09-14T11:36:39.828 INFO:teuthology.orchestra.run.smithi071.stderr: 4150K .......... .......... .......... .......... .......... 4% 154M 2s 2024-09-14T11:36:39.828 INFO:teuthology.orchestra.run.smithi071.stderr: 4200K .......... .......... .......... .......... .......... 4% 97.6M 2s 2024-09-14T11:36:39.828 INFO:teuthology.orchestra.run.smithi071.stderr: 4250K .......... .......... .......... .......... .......... 4% 104M 2s 2024-09-14T11:36:39.828 INFO:teuthology.orchestra.run.smithi071.stderr: 4300K .......... .......... .......... .......... .......... 4% 83.7M 2s 2024-09-14T11:36:39.828 INFO:teuthology.orchestra.run.smithi071.stderr: 4350K .......... .......... .......... .......... .......... 4% 112M 2s 2024-09-14T11:36:39.828 INFO:teuthology.orchestra.run.smithi071.stderr: 4400K .......... .......... .......... .......... .......... 4% 164M 2s 2024-09-14T11:36:39.828 INFO:teuthology.orchestra.run.smithi071.stderr: 4450K .......... .......... .......... .......... .......... 4% 110M 2s 2024-09-14T11:36:39.828 INFO:teuthology.orchestra.run.smithi071.stderr: 4500K .......... .......... .......... .......... .......... 4% 144M 2s 2024-09-14T11:36:39.828 INFO:teuthology.orchestra.run.smithi071.stderr: 4550K .......... .......... .......... .......... .......... 4% 163M 2s 2024-09-14T11:36:39.828 INFO:teuthology.orchestra.run.smithi071.stderr: 4600K .......... .......... .......... .......... .......... 5% 96.1M 2s 2024-09-14T11:36:39.828 INFO:teuthology.orchestra.run.smithi071.stderr: 4650K .......... .......... .......... .......... .......... 5% 153M 2s 2024-09-14T11:36:39.828 INFO:teuthology.orchestra.run.smithi071.stderr: 4700K .......... .......... .......... .......... .......... 5% 136M 2s 2024-09-14T11:36:39.828 INFO:teuthology.orchestra.run.smithi071.stderr: 4750K .......... .......... .......... .......... .......... 5% 115M 2s 2024-09-14T11:36:39.829 INFO:teuthology.orchestra.run.smithi071.stderr: 4800K .......... .......... .......... .......... .......... 5% 110M 2s 2024-09-14T11:36:39.829 INFO:teuthology.orchestra.run.smithi071.stderr: 4850K .......... .......... .......... .......... .......... 5% 172M 2s 2024-09-14T11:36:39.829 INFO:teuthology.orchestra.run.smithi071.stderr: 4900K .......... .......... .......... .......... .......... 5% 158M 2s 2024-09-14T11:36:39.829 INFO:teuthology.orchestra.run.smithi071.stderr: 4950K .......... .......... .......... .......... .......... 5% 127M 2s 2024-09-14T11:36:39.829 INFO:teuthology.orchestra.run.smithi071.stderr: 5000K .......... .......... .......... .......... .......... 5% 160M 2s 2024-09-14T11:36:39.829 INFO:teuthology.orchestra.run.smithi071.stderr: 5050K .......... .......... .......... .......... .......... 5% 177M 2s 2024-09-14T11:36:39.829 INFO:teuthology.orchestra.run.smithi071.stderr: 5100K .......... .......... .......... .......... .......... 5% 144M 2s 2024-09-14T11:36:39.829 INFO:teuthology.orchestra.run.smithi071.stderr: 5150K .......... .......... .......... .......... .......... 5% 175M 2s 2024-09-14T11:36:39.829 INFO:teuthology.orchestra.run.smithi071.stderr: 5200K .......... .......... .......... .......... .......... 5% 177M 2s 2024-09-14T11:36:39.829 INFO:teuthology.orchestra.run.smithi071.stderr: 5250K .......... .......... .......... .......... .......... 5% 175M 2s 2024-09-14T11:36:39.829 INFO:teuthology.orchestra.run.smithi071.stderr: 5300K .......... .......... .......... .......... .......... 5% 159M 2s 2024-09-14T11:36:39.829 INFO:teuthology.orchestra.run.smithi071.stderr: 5350K .......... .......... .......... .......... .......... 5% 178M 2s 2024-09-14T11:36:39.829 INFO:teuthology.orchestra.run.smithi071.stderr: 5400K .......... .......... .......... .......... .......... 5% 168M 2s 2024-09-14T11:36:39.829 INFO:teuthology.orchestra.run.smithi071.stderr: 5450K .......... .......... .......... .......... .......... 5% 175M 2s 2024-09-14T11:36:39.829 INFO:teuthology.orchestra.run.smithi071.stderr: 5500K .......... .......... .......... .......... .......... 5% 152M 2s 2024-09-14T11:36:39.830 INFO:teuthology.orchestra.run.smithi071.stderr: 5550K .......... .......... .......... .......... .......... 6% 88.8M 2s 2024-09-14T11:36:39.830 INFO:teuthology.orchestra.run.smithi071.stderr: 5600K .......... .......... .......... .......... .......... 6% 108M 2s 2024-09-14T11:36:39.830 INFO:teuthology.orchestra.run.smithi071.stderr: 5650K .......... .......... .......... .......... .......... 6% 139M 2s 2024-09-14T11:36:39.830 INFO:teuthology.orchestra.run.smithi071.stderr: 5700K .......... .......... .......... .......... .......... 6% 146M 2s 2024-09-14T11:36:39.830 INFO:teuthology.orchestra.run.smithi071.stderr: 5750K .......... .......... .......... .......... .......... 6% 123M 2s 2024-09-14T11:36:39.830 INFO:teuthology.orchestra.run.smithi071.stderr: 5800K .......... .......... .......... .......... .......... 6% 171M 2s 2024-09-14T11:36:39.830 INFO:teuthology.orchestra.run.smithi071.stderr: 5850K .......... .......... .......... .......... .......... 6% 183M 2s 2024-09-14T11:36:39.830 INFO:teuthology.orchestra.run.smithi071.stderr: 5900K .......... .......... .......... .......... .......... 6% 114M 2s 2024-09-14T11:36:39.830 INFO:teuthology.orchestra.run.smithi071.stderr: 5950K .......... .......... .......... .......... .......... 6% 117M 2s 2024-09-14T11:36:39.830 INFO:teuthology.orchestra.run.smithi071.stderr: 6000K .......... .......... .......... .......... .......... 6% 163M 2s 2024-09-14T11:36:39.830 INFO:teuthology.orchestra.run.smithi071.stderr: 6050K .......... .......... .......... .......... .......... 6% 152M 2s 2024-09-14T11:36:39.830 INFO:teuthology.orchestra.run.smithi071.stderr: 6100K .......... .......... .......... .......... .......... 6% 120M 2s 2024-09-14T11:36:39.830 INFO:teuthology.orchestra.run.smithi071.stderr: 6150K .......... .......... .......... .......... .......... 6% 193M 2s 2024-09-14T11:36:39.830 INFO:teuthology.orchestra.run.smithi071.stderr: 6200K .......... .......... .......... .......... .......... 6% 194M 2s 2024-09-14T11:36:39.830 INFO:teuthology.orchestra.run.smithi071.stderr: 6250K .......... .......... .......... .......... .......... 6% 113M 2s 2024-09-14T11:36:39.831 INFO:teuthology.orchestra.run.smithi071.stderr: 6300K .......... .......... .......... .......... .......... 6% 157M 2s 2024-09-14T11:36:39.831 INFO:teuthology.orchestra.run.smithi071.stderr: 6350K .......... .......... .......... .......... .......... 6% 138M 2s 2024-09-14T11:36:39.831 INFO:teuthology.orchestra.run.smithi071.stderr: 6400K .......... .......... .......... .......... .......... 6% 189M 2s 2024-09-14T11:36:39.831 INFO:teuthology.orchestra.run.smithi071.stderr: 6450K .......... .......... .......... .......... .......... 6% 134M 2s 2024-09-14T11:36:39.831 INFO:teuthology.orchestra.run.smithi071.stderr: 6500K .......... .......... .......... .......... .......... 7% 172M 2s 2024-09-14T11:36:39.831 INFO:teuthology.orchestra.run.smithi071.stderr: 6550K .......... .......... .......... .......... .......... 7% 137M 2s 2024-09-14T11:36:39.831 INFO:teuthology.orchestra.run.smithi071.stderr: 6600K .......... .......... .......... .......... .......... 7% 134M 2s 2024-09-14T11:36:39.831 INFO:teuthology.orchestra.run.smithi071.stderr: 6650K .......... .......... .......... .......... .......... 7% 189M 2s 2024-09-14T11:36:39.831 INFO:teuthology.orchestra.run.smithi071.stderr: 6700K .......... .......... .......... .......... .......... 7% 126M 2s 2024-09-14T11:36:39.831 INFO:teuthology.orchestra.run.smithi071.stderr: 6750K .......... .......... .......... .......... .......... 7% 210M 1s 2024-09-14T11:36:39.831 INFO:teuthology.orchestra.run.smithi071.stderr: 6800K .......... .......... .......... .......... .......... 7% 154M 1s 2024-09-14T11:36:39.831 INFO:teuthology.orchestra.run.smithi071.stderr: 6850K .......... .......... .......... .......... .......... 7% 149M 1s 2024-09-14T11:36:39.831 INFO:teuthology.orchestra.run.smithi071.stderr: 6900K .......... .......... .......... .......... .......... 7% 184M 1s 2024-09-14T11:36:39.831 INFO:teuthology.orchestra.run.smithi071.stderr: 6950K .......... .......... .......... .......... .......... 7% 206M 1s 2024-09-14T11:36:39.831 INFO:teuthology.orchestra.run.smithi071.stderr: 7000K .......... .......... .......... .......... .......... 7% 202M 1s 2024-09-14T11:36:39.831 INFO:teuthology.orchestra.run.smithi071.stderr: 7050K .......... .......... .......... .......... .......... 7% 208M 1s 2024-09-14T11:36:39.832 INFO:teuthology.orchestra.run.smithi071.stderr: 7100K .......... .......... .......... .......... .......... 7% 171M 1s 2024-09-14T11:36:39.832 INFO:teuthology.orchestra.run.smithi071.stderr: 7150K .......... .......... .......... .......... .......... 7% 211M 1s 2024-09-14T11:36:39.832 INFO:teuthology.orchestra.run.smithi071.stderr: 7200K .......... .......... .......... .......... .......... 7% 210M 1s 2024-09-14T11:36:39.832 INFO:teuthology.orchestra.run.smithi071.stderr: 7250K .......... .......... .......... .......... .......... 7% 201M 1s 2024-09-14T11:36:39.832 INFO:teuthology.orchestra.run.smithi071.stderr: 7300K .......... .......... .......... .......... .......... 7% 185M 1s 2024-09-14T11:36:39.832 INFO:teuthology.orchestra.run.smithi071.stderr: 7350K .......... .......... .......... .......... .......... 7% 208M 1s 2024-09-14T11:36:39.832 INFO:teuthology.orchestra.run.smithi071.stderr: 7400K .......... .......... .......... .......... .......... 8% 235M 1s 2024-09-14T11:36:39.832 INFO:teuthology.orchestra.run.smithi071.stderr: 7450K .......... .......... .......... .......... .......... 8% 228M 1s 2024-09-14T11:36:39.832 INFO:teuthology.orchestra.run.smithi071.stderr: 7500K .......... .......... .......... .......... .......... 8% 176M 1s 2024-09-14T11:36:39.832 INFO:teuthology.orchestra.run.smithi071.stderr: 7550K .......... .......... .......... .......... .......... 8% 135M 1s 2024-09-14T11:36:39.832 INFO:teuthology.orchestra.run.smithi071.stderr: 7600K .......... .......... .......... .......... .......... 8% 122M 1s 2024-09-14T11:36:39.832 INFO:teuthology.orchestra.run.smithi071.stderr: 7650K .......... .......... .......... .......... .......... 8% 134M 1s 2024-09-14T11:36:39.832 INFO:teuthology.orchestra.run.smithi071.stderr: 7700K .......... .......... .......... .......... .......... 8% 191M 1s 2024-09-14T11:36:39.832 INFO:teuthology.orchestra.run.smithi071.stderr: 7750K .......... .......... .......... .......... .......... 8% 230M 1s 2024-09-14T11:36:39.833 INFO:teuthology.orchestra.run.smithi071.stderr: 7800K .......... .......... .......... .......... .......... 8% 210M 1s 2024-09-14T11:36:39.833 INFO:teuthology.orchestra.run.smithi071.stderr: 7850K .......... .......... .......... .......... .......... 8% 139M 1s 2024-09-14T11:36:39.833 INFO:teuthology.orchestra.run.smithi071.stderr: 7900K .......... .......... .......... .......... .......... 8% 190M 1s 2024-09-14T11:36:39.833 INFO:teuthology.orchestra.run.smithi071.stderr: 7950K .......... .......... .......... .......... .......... 8% 129M 1s 2024-09-14T11:36:39.833 INFO:teuthology.orchestra.run.smithi071.stderr: 8000K .......... .......... .......... .......... .......... 8% 217M 1s 2024-09-14T11:36:39.833 INFO:teuthology.orchestra.run.smithi071.stderr: 8050K .......... .......... .......... .......... .......... 8% 186M 1s 2024-09-14T11:36:39.833 INFO:teuthology.orchestra.run.smithi071.stderr: 8100K .......... .......... .......... .......... .......... 8% 137M 1s 2024-09-14T11:36:39.833 INFO:teuthology.orchestra.run.smithi071.stderr: 8150K .......... .......... .......... .......... .......... 8% 237M 1s 2024-09-14T11:36:39.833 INFO:teuthology.orchestra.run.smithi071.stderr: 8200K .......... .......... .......... .......... .......... 8% 162M 1s 2024-09-14T11:36:39.833 INFO:teuthology.orchestra.run.smithi071.stderr: 8250K .......... .......... .......... .......... .......... 8% 235M 1s 2024-09-14T11:36:39.833 INFO:teuthology.orchestra.run.smithi071.stderr: 8300K .......... .......... .......... .......... .......... 8% 170M 1s 2024-09-14T11:36:39.833 INFO:teuthology.orchestra.run.smithi071.stderr: 8350K .......... .......... .......... .......... .......... 9% 189M 1s 2024-09-14T11:36:39.833 INFO:teuthology.orchestra.run.smithi071.stderr: 8400K .......... .......... .......... .......... .......... 9% 159M 1s 2024-09-14T11:36:39.833 INFO:teuthology.orchestra.run.smithi071.stderr: 8450K .......... .......... .......... .......... .......... 9% 240M 1s 2024-09-14T11:36:39.833 INFO:teuthology.orchestra.run.smithi071.stderr: 8500K .......... .......... .......... .......... .......... 9% 217M 1s 2024-09-14T11:36:39.834 INFO:teuthology.orchestra.run.smithi071.stderr: 8550K .......... .......... .......... .......... .......... 9% 192M 1s 2024-09-14T11:36:39.834 INFO:teuthology.orchestra.run.smithi071.stderr: 8600K .......... .......... .......... .......... .......... 9% 151M 1s 2024-09-14T11:36:39.834 INFO:teuthology.orchestra.run.smithi071.stderr: 8650K .......... .......... .......... .......... .......... 9% 191M 1s 2024-09-14T11:36:39.834 INFO:teuthology.orchestra.run.smithi071.stderr: 8700K .......... .......... .......... .......... .......... 9% 193M 1s 2024-09-14T11:36:39.834 INFO:teuthology.orchestra.run.smithi071.stderr: 8750K .......... .......... .......... .......... .......... 9% 228M 1s 2024-09-14T11:36:39.834 INFO:teuthology.orchestra.run.smithi071.stderr: 8800K .......... .......... .......... .......... .......... 9% 156M 1s 2024-09-14T11:36:39.834 INFO:teuthology.orchestra.run.smithi071.stderr: 8850K .......... .......... .......... .......... .......... 9% 214M 1s 2024-09-14T11:36:39.834 INFO:teuthology.orchestra.run.smithi071.stderr: 8900K .......... .......... .......... .......... .......... 9% 193M 1s 2024-09-14T11:36:39.834 INFO:teuthology.orchestra.run.smithi071.stderr: 8950K .......... .......... .......... .......... .......... 9% 155M 1s 2024-09-14T11:36:39.834 INFO:teuthology.orchestra.run.smithi071.stderr: 9000K .......... .......... .......... .......... .......... 9% 229M 1s 2024-09-14T11:36:39.834 INFO:teuthology.orchestra.run.smithi071.stderr: 9050K .......... .......... .......... .......... .......... 9% 250M 1s 2024-09-14T11:36:39.834 INFO:teuthology.orchestra.run.smithi071.stderr: 9100K .......... .......... .......... .......... .......... 9% 139M 1s 2024-09-14T11:36:39.834 INFO:teuthology.orchestra.run.smithi071.stderr: 9150K .......... .......... .......... .......... .......... 9% 198M 1s 2024-09-14T11:36:39.834 INFO:teuthology.orchestra.run.smithi071.stderr: 9200K .......... .......... .......... .......... .......... 9% 251M 1s 2024-09-14T11:36:39.834 INFO:teuthology.orchestra.run.smithi071.stderr: 9250K .......... .......... .......... .......... .......... 10% 249M 1s 2024-09-14T11:36:39.834 INFO:teuthology.orchestra.run.smithi071.stderr: 9300K .......... .......... .......... .......... .......... 10% 225M 1s 2024-09-14T11:36:39.835 INFO:teuthology.orchestra.run.smithi071.stderr: 9350K .......... .......... .......... .......... .......... 10% 243M 1s 2024-09-14T11:36:39.835 INFO:teuthology.orchestra.run.smithi071.stderr: 9400K .......... .......... .......... .......... .......... 10% 246M 1s 2024-09-14T11:36:39.835 INFO:teuthology.orchestra.run.smithi071.stderr: 9450K .......... .......... .......... .......... .......... 10% 250M 1s 2024-09-14T11:36:39.835 INFO:teuthology.orchestra.run.smithi071.stderr: 9500K .......... .......... .......... .......... .......... 10% 205M 1s 2024-09-14T11:36:39.835 INFO:teuthology.orchestra.run.smithi071.stderr: 9550K .......... .......... .......... .......... .......... 10% 241M 1s 2024-09-14T11:36:39.835 INFO:teuthology.orchestra.run.smithi071.stderr: 9600K .......... .......... .......... .......... .......... 10% 235M 1s 2024-09-14T11:36:39.835 INFO:teuthology.orchestra.run.smithi071.stderr: 9650K .......... .......... .......... .......... .......... 10% 250M 1s 2024-09-14T11:36:39.835 INFO:teuthology.orchestra.run.smithi071.stderr: 9700K .......... .......... .......... .......... .......... 10% 213M 1s 2024-09-14T11:36:39.835 INFO:teuthology.orchestra.run.smithi071.stderr: 9750K .......... .......... .......... .......... .......... 10% 264M 1s 2024-09-14T11:36:39.835 INFO:teuthology.orchestra.run.smithi071.stderr: 9800K .......... .......... .......... .......... .......... 10% 262M 1s 2024-09-14T11:36:39.835 INFO:teuthology.orchestra.run.smithi071.stderr: 9850K .......... .......... .......... .......... .......... 10% 252M 1s 2024-09-14T11:36:39.835 INFO:teuthology.orchestra.run.smithi071.stderr: 9900K .......... .......... .......... .......... .......... 10% 221M 1s 2024-09-14T11:36:39.835 INFO:teuthology.orchestra.run.smithi071.stderr: 9950K .......... .......... .......... .......... .......... 10% 142M 1s 2024-09-14T11:36:39.835 INFO:teuthology.orchestra.run.smithi071.stderr: 10000K .......... .......... .......... .......... .......... 10% 157M 1s 2024-09-14T11:36:39.835 INFO:teuthology.orchestra.run.smithi071.stderr: 10050K .......... .......... .......... .......... .......... 10% 127M 1s 2024-09-14T11:36:39.835 INFO:teuthology.orchestra.run.smithi071.stderr: 10100K .......... .......... .......... .......... .......... 10% 124M 1s 2024-09-14T11:36:39.836 INFO:teuthology.orchestra.run.smithi071.stderr: 10150K .......... .......... .......... .......... .......... 10% 264M 1s 2024-09-14T11:36:39.836 INFO:teuthology.orchestra.run.smithi071.stderr: 10200K .......... .......... .......... .......... .......... 11% 247M 1s 2024-09-14T11:36:39.836 INFO:teuthology.orchestra.run.smithi071.stderr: 10250K .......... .......... .......... .......... .......... 11% 154M 1s 2024-09-14T11:36:39.836 INFO:teuthology.orchestra.run.smithi071.stderr: 10300K .......... .......... .......... .......... .......... 11% 183M 1s 2024-09-14T11:36:39.836 INFO:teuthology.orchestra.run.smithi071.stderr: 10350K .......... .......... .......... .......... .......... 11% 154M 1s 2024-09-14T11:36:39.836 INFO:teuthology.orchestra.run.smithi071.stderr: 10400K .......... .......... .......... .......... .......... 11% 164M 1s 2024-09-14T11:36:39.836 INFO:teuthology.orchestra.run.smithi071.stderr: 10450K .......... .......... .......... .......... .......... 11% 273M 1s 2024-09-14T11:36:39.836 INFO:teuthology.orchestra.run.smithi071.stderr: 10500K .......... .......... .......... .......... .......... 11% 179M 1s 2024-09-14T11:36:39.836 INFO:teuthology.orchestra.run.smithi071.stderr: 10550K .......... .......... .......... .......... .......... 11% 222M 1s 2024-09-14T11:36:39.836 INFO:teuthology.orchestra.run.smithi071.stderr: 10600K .......... .......... .......... .......... .......... 11% 227M 1s 2024-09-14T11:36:39.836 INFO:teuthology.orchestra.run.smithi071.stderr: 10650K .......... .......... .......... .......... .......... 11% 199M 1s 2024-09-14T11:36:39.836 INFO:teuthology.orchestra.run.smithi071.stderr: 10700K .......... .......... .......... .......... .......... 11% 221M 1s 2024-09-14T11:36:39.836 INFO:teuthology.orchestra.run.smithi071.stderr: 10750K .......... .......... .......... .......... .......... 11% 278M 1s 2024-09-14T11:36:39.836 INFO:teuthology.orchestra.run.smithi071.stderr: 10800K .......... .......... .......... .......... .......... 11% 256M 1s 2024-09-14T11:36:39.836 INFO:teuthology.orchestra.run.smithi071.stderr: 10850K .......... .......... .......... .......... .......... 11% 204M 1s 2024-09-14T11:36:39.837 INFO:teuthology.orchestra.run.smithi071.stderr: 10900K .......... .......... .......... .......... .......... 11% 161M 1s 2024-09-14T11:36:39.837 INFO:teuthology.orchestra.run.smithi071.stderr: 10950K .......... .......... .......... .......... .......... 11% 285M 1s 2024-09-14T11:36:39.837 INFO:teuthology.orchestra.run.smithi071.stderr: 11000K .......... .......... .......... .......... .......... 11% 288M 1s 2024-09-14T11:36:39.837 INFO:teuthology.orchestra.run.smithi071.stderr: 11050K .......... .......... .......... .......... .......... 11% 282M 1s 2024-09-14T11:36:39.837 INFO:teuthology.orchestra.run.smithi071.stderr: 11100K .......... .......... .......... .......... .......... 12% 157M 1s 2024-09-14T11:36:39.837 INFO:teuthology.orchestra.run.smithi071.stderr: 11150K .......... .......... .......... .......... .......... 12% 176M 1s 2024-09-14T11:36:39.837 INFO:teuthology.orchestra.run.smithi071.stderr: 11200K .......... .......... .......... .......... .......... 12% 211M 1s 2024-09-14T11:36:39.837 INFO:teuthology.orchestra.run.smithi071.stderr: 11250K .......... .......... .......... .......... .......... 12% 253M 1s 2024-09-14T11:36:39.837 INFO:teuthology.orchestra.run.smithi071.stderr: 11300K .......... .......... .......... .......... .......... 12% 271M 1s 2024-09-14T11:36:39.837 INFO:teuthology.orchestra.run.smithi071.stderr: 11350K .......... .......... .......... .......... .......... 12% 278M 1s 2024-09-14T11:36:39.837 INFO:teuthology.orchestra.run.smithi071.stderr: 11400K .......... .......... .......... .......... .......... 12% 239M 1s 2024-09-14T11:36:39.837 INFO:teuthology.orchestra.run.smithi071.stderr: 11450K .......... .......... .......... .......... .......... 12% 163M 1s 2024-09-14T11:36:39.837 INFO:teuthology.orchestra.run.smithi071.stderr: 11500K .......... .......... .......... .......... .......... 12% 176M 1s 2024-09-14T11:36:39.837 INFO:teuthology.orchestra.run.smithi071.stderr: 11550K .......... .......... .......... .......... .......... 12% 188M 1s 2024-09-14T11:36:39.837 INFO:teuthology.orchestra.run.smithi071.stderr: 11600K .......... .......... .......... .......... .......... 12% 290M 1s 2024-09-14T11:36:39.837 INFO:teuthology.orchestra.run.smithi071.stderr: 11650K .......... .......... .......... .......... .......... 12% 264M 1s 2024-09-14T11:36:39.838 INFO:teuthology.orchestra.run.smithi071.stderr: 11700K .......... .......... .......... .......... .......... 12% 183M 1s 2024-09-14T11:36:39.838 INFO:teuthology.orchestra.run.smithi071.stderr: 11750K .......... .......... .......... .......... .......... 12% 233M 1s 2024-09-14T11:36:39.838 INFO:teuthology.orchestra.run.smithi071.stderr: 11800K .......... .......... .......... .......... .......... 12% 295M 1s 2024-09-14T11:36:39.838 INFO:teuthology.orchestra.run.smithi071.stderr: 11850K .......... .......... .......... .......... .......... 12% 205M 1s 2024-09-14T11:36:39.838 INFO:teuthology.orchestra.run.smithi071.stderr: 11900K .......... .......... .......... .......... .......... 12% 194M 1s 2024-09-14T11:36:39.838 INFO:teuthology.orchestra.run.smithi071.stderr: 11950K .......... .......... .......... .......... .......... 12% 206M 1s 2024-09-14T11:36:39.838 INFO:teuthology.orchestra.run.smithi071.stderr: 12000K .......... .......... .......... .......... .......... 12% 211M 1s 2024-09-14T11:36:39.838 INFO:teuthology.orchestra.run.smithi071.stderr: 12050K .......... .......... .......... .......... .......... 13% 216M 1s 2024-09-14T11:36:39.838 INFO:teuthology.orchestra.run.smithi071.stderr: 12100K .......... .......... .......... .......... .......... 13% 137M 1s 2024-09-14T11:36:39.838 INFO:teuthology.orchestra.run.smithi071.stderr: 12150K .......... .......... .......... .......... .......... 13% 146M 1s 2024-09-14T11:36:39.838 INFO:teuthology.orchestra.run.smithi071.stderr: 12200K .......... .......... .......... .......... .......... 13% 195M 1s 2024-09-14T11:36:39.838 INFO:teuthology.orchestra.run.smithi071.stderr: 12250K .......... .......... .......... .......... .......... 13% 176M 1s 2024-09-14T11:36:39.838 INFO:teuthology.orchestra.run.smithi071.stderr: 12300K .......... .......... .......... .......... .......... 13% 158M 1s 2024-09-14T11:36:39.838 INFO:teuthology.orchestra.run.smithi071.stderr: 12350K .......... .......... .......... .......... .......... 13% 177M 1s 2024-09-14T11:36:39.838 INFO:teuthology.orchestra.run.smithi071.stderr: 12400K .......... .......... .......... .......... .......... 13% 73.2M 1s 2024-09-14T11:36:39.839 INFO:teuthology.orchestra.run.smithi071.stderr: 12450K .......... .......... .......... .......... .......... 13% 187M 1s 2024-09-14T11:36:39.839 INFO:teuthology.orchestra.run.smithi071.stderr: 12500K .......... .......... .......... .......... .......... 13% 190M 1s 2024-09-14T11:36:39.839 INFO:teuthology.orchestra.run.smithi071.stderr: 12550K .......... .......... .......... .......... .......... 13% 306M 1s 2024-09-14T11:36:39.839 INFO:teuthology.orchestra.run.smithi071.stderr: 12600K .......... .......... .......... .......... .......... 13% 213M 1s 2024-09-14T11:36:39.839 INFO:teuthology.orchestra.run.smithi071.stderr: 12650K .......... .......... .......... .......... .......... 13% 267M 1s 2024-09-14T11:36:39.839 INFO:teuthology.orchestra.run.smithi071.stderr: 12700K .......... .......... .......... .......... .......... 13% 339M 1s 2024-09-14T11:36:39.839 INFO:teuthology.orchestra.run.smithi071.stderr: 12750K .......... .......... .......... .......... .......... 13% 248M 1s 2024-09-14T11:36:39.839 INFO:teuthology.orchestra.run.smithi071.stderr: 12800K .......... .......... .......... .......... .......... 13% 250M 1s 2024-09-14T11:36:39.839 INFO:teuthology.orchestra.run.smithi071.stderr: 12850K .......... .......... .......... .......... .......... 13% 289M 1s 2024-09-14T11:36:39.839 INFO:teuthology.orchestra.run.smithi071.stderr: 12900K .......... .......... .......... .......... .......... 13% 189M 1s 2024-09-14T11:36:39.839 INFO:teuthology.orchestra.run.smithi071.stderr: 12950K .......... .......... .......... .......... .......... 13% 264M 1s 2024-09-14T11:36:39.839 INFO:teuthology.orchestra.run.smithi071.stderr: 13000K .......... .......... .......... .......... .......... 14% 370M 1s 2024-09-14T11:36:39.839 INFO:teuthology.orchestra.run.smithi071.stderr: 13050K .......... .......... .......... .......... .......... 14% 349M 1s 2024-09-14T11:36:39.839 INFO:teuthology.orchestra.run.smithi071.stderr: 13100K .......... .......... .......... .......... .......... 14% 225M 1s 2024-09-14T11:36:39.839 INFO:teuthology.orchestra.run.smithi071.stderr: 13150K .......... .......... .......... .......... .......... 14% 272M 1s 2024-09-14T11:36:39.839 INFO:teuthology.orchestra.run.smithi071.stderr: 13200K .......... .......... .......... .......... .......... 14% 274M 1s 2024-09-14T11:36:39.840 INFO:teuthology.orchestra.run.smithi071.stderr: 13250K .......... .......... .......... .......... .......... 14% 318M 1s 2024-09-14T11:36:39.840 INFO:teuthology.orchestra.run.smithi071.stderr: 13300K .......... .......... .......... .......... .......... 14% 351M 1s 2024-09-14T11:36:39.840 INFO:teuthology.orchestra.run.smithi071.stderr: 13350K .......... .......... .......... .......... .......... 14% 272M 1s 2024-09-14T11:36:39.840 INFO:teuthology.orchestra.run.smithi071.stderr: 13400K .......... .......... .......... .......... .......... 14% 331M 1s 2024-09-14T11:36:39.840 INFO:teuthology.orchestra.run.smithi071.stderr: 13450K .......... .......... .......... .......... .......... 14% 392M 1s 2024-09-14T11:36:39.840 INFO:teuthology.orchestra.run.smithi071.stderr: 13500K .......... .......... .......... .......... .......... 14% 325M 1s 2024-09-14T11:36:39.840 INFO:teuthology.orchestra.run.smithi071.stderr: 13550K .......... .......... .......... .......... .......... 14% 350M 1s 2024-09-14T11:36:39.840 INFO:teuthology.orchestra.run.smithi071.stderr: 13600K .......... .......... .......... .......... .......... 14% 318M 1s 2024-09-14T11:36:39.840 INFO:teuthology.orchestra.run.smithi071.stderr: 13650K .......... .......... .......... .......... .......... 14% 224M 1s 2024-09-14T11:36:39.840 INFO:teuthology.orchestra.run.smithi071.stderr: 13700K .......... .......... .......... .......... .......... 14% 302M 1s 2024-09-14T11:36:39.840 INFO:teuthology.orchestra.run.smithi071.stderr: 13750K .......... .......... .......... .......... .......... 14% 397M 1s 2024-09-14T11:36:39.840 INFO:teuthology.orchestra.run.smithi071.stderr: 13800K .......... .......... .......... .......... .......... 14% 367M 1s 2024-09-14T11:36:39.840 INFO:teuthology.orchestra.run.smithi071.stderr: 13850K .......... .......... .......... .......... .......... 14% 389M 1s 2024-09-14T11:36:39.840 INFO:teuthology.orchestra.run.smithi071.stderr: 13900K .......... .......... .......... .......... .......... 15% 316M 1s 2024-09-14T11:36:39.840 INFO:teuthology.orchestra.run.smithi071.stderr: 13950K .......... .......... .......... .......... .......... 15% 257M 1s 2024-09-14T11:36:39.840 INFO:teuthology.orchestra.run.smithi071.stderr: 14000K .......... .......... .......... .......... .......... 15% 219M 1s 2024-09-14T11:36:39.841 INFO:teuthology.orchestra.run.smithi071.stderr: 14050K .......... .......... .......... .......... .......... 15% 183M 1s 2024-09-14T11:36:39.841 INFO:teuthology.orchestra.run.smithi071.stderr: 14100K .......... .......... .......... .......... .......... 15% 193M 1s 2024-09-14T11:36:39.841 INFO:teuthology.orchestra.run.smithi071.stderr: 14150K .......... .......... .......... .......... .......... 15% 224M 1s 2024-09-14T11:36:39.841 INFO:teuthology.orchestra.run.smithi071.stderr: 14200K .......... .......... .......... .......... .......... 15% 335M 1s 2024-09-14T11:36:39.841 INFO:teuthology.orchestra.run.smithi071.stderr: 14250K .......... .......... .......... .......... .......... 15% 393M 1s 2024-09-14T11:36:39.841 INFO:teuthology.orchestra.run.smithi071.stderr: 14300K .......... .......... .......... .......... .......... 15% 266M 1s 2024-09-14T11:36:39.841 INFO:teuthology.orchestra.run.smithi071.stderr: 14350K .......... .......... .......... .......... .......... 15% 278M 1s 2024-09-14T11:36:39.841 INFO:teuthology.orchestra.run.smithi071.stderr: 14400K .......... .......... .......... .......... .......... 15% 188M 1s 2024-09-14T11:36:39.841 INFO:teuthology.orchestra.run.smithi071.stderr: 14450K .......... .......... .......... .......... .......... 15% 270M 1s 2024-09-14T11:36:39.841 INFO:teuthology.orchestra.run.smithi071.stderr: 14500K .......... .......... .......... .......... .......... 15% 247M 1s 2024-09-14T11:36:39.841 INFO:teuthology.orchestra.run.smithi071.stderr: 14550K .......... .......... .......... .......... .......... 15% 388M 1s 2024-09-14T11:36:39.841 INFO:teuthology.orchestra.run.smithi071.stderr: 14600K .......... .......... .......... .......... .......... 15% 377M 1s 2024-09-14T11:36:39.841 INFO:teuthology.orchestra.run.smithi071.stderr: 14650K .......... .......... .......... .......... .......... 15% 270M 1s 2024-09-14T11:36:39.841 INFO:teuthology.orchestra.run.smithi071.stderr: 14700K .......... .......... .......... .......... .......... 15% 207M 1s 2024-09-14T11:36:39.841 INFO:teuthology.orchestra.run.smithi071.stderr: 14750K .......... .......... .......... .......... .......... 15% 387M 1s 2024-09-14T11:36:39.842 INFO:teuthology.orchestra.run.smithi071.stderr: 14800K .......... .......... .......... .......... .......... 15% 391M 1s 2024-09-14T11:36:39.842 INFO:teuthology.orchestra.run.smithi071.stderr: 14850K .......... .......... .......... .......... .......... 16% 397M 1s 2024-09-14T11:36:39.842 INFO:teuthology.orchestra.run.smithi071.stderr: 14900K .......... .......... .......... .......... .......... 16% 336M 1s 2024-09-14T11:36:39.842 INFO:teuthology.orchestra.run.smithi071.stderr: 14950K .......... .......... .......... .......... .......... 16% 14.9M 1s 2024-09-14T11:36:39.842 INFO:teuthology.orchestra.run.smithi071.stderr: 15000K .......... .......... .......... .......... .......... 16% 219M 1s 2024-09-14T11:36:39.842 INFO:teuthology.orchestra.run.smithi071.stderr: 15050K .......... .......... .......... .......... .......... 16% 157M 1s 2024-09-14T11:36:39.842 INFO:teuthology.orchestra.run.smithi071.stderr: 15100K .......... .......... .......... .......... .......... 16% 184M 1s 2024-09-14T11:36:39.842 INFO:teuthology.orchestra.run.smithi071.stderr: 15150K .......... .......... .......... .......... .......... 16% 248M 1s 2024-09-14T11:36:39.842 INFO:teuthology.orchestra.run.smithi071.stderr: 15200K .......... .......... .......... .......... .......... 16% 234M 1s 2024-09-14T11:36:39.842 INFO:teuthology.orchestra.run.smithi071.stderr: 15250K .......... .......... .......... .......... .......... 16% 212M 1s 2024-09-14T11:36:39.842 INFO:teuthology.orchestra.run.smithi071.stderr: 15300K .......... .......... .......... .......... .......... 16% 245M 1s 2024-09-14T11:36:39.842 INFO:teuthology.orchestra.run.smithi071.stderr: 15350K .......... .......... .......... .......... .......... 16% 246M 1s 2024-09-14T11:36:39.842 INFO:teuthology.orchestra.run.smithi071.stderr: 15400K .......... .......... .......... .......... .......... 16% 316M 1s 2024-09-14T11:36:39.842 INFO:teuthology.orchestra.run.smithi071.stderr: 15450K .......... .......... .......... .......... .......... 16% 203M 1s 2024-09-14T11:36:39.842 INFO:teuthology.orchestra.run.smithi071.stderr: 15500K .......... .......... .......... .......... .......... 16% 211M 1s 2024-09-14T11:36:39.842 INFO:teuthology.orchestra.run.smithi071.stderr: 15550K .......... .......... .......... .......... .......... 16% 246M 1s 2024-09-14T11:36:39.843 INFO:teuthology.orchestra.run.smithi071.stderr: 15600K .......... .......... .......... .......... .......... 16% 242M 1s 2024-09-14T11:36:39.843 INFO:teuthology.orchestra.run.smithi071.stderr: 15650K .......... .......... .......... .......... .......... 16% 256M 1s 2024-09-14T11:36:39.843 INFO:teuthology.orchestra.run.smithi071.stderr: 15700K .......... .......... .......... .......... .......... 16% 214M 1s 2024-09-14T11:36:39.843 INFO:teuthology.orchestra.run.smithi071.stderr: 15750K .......... .......... .......... .......... .......... 17% 315M 1s 2024-09-14T11:36:39.843 INFO:teuthology.orchestra.run.smithi071.stderr: 15800K .......... .......... .......... .......... .......... 17% 310M 1s 2024-09-14T11:36:39.843 INFO:teuthology.orchestra.run.smithi071.stderr: 15850K .......... .......... .......... .......... .......... 17% 222M 1s 2024-09-14T11:36:39.843 INFO:teuthology.orchestra.run.smithi071.stderr: 15900K .......... .......... .......... .......... .......... 17% 271M 1s 2024-09-14T11:36:39.843 INFO:teuthology.orchestra.run.smithi071.stderr: 15950K .......... .......... .......... .......... .......... 17% 347M 1s 2024-09-14T11:36:39.843 INFO:teuthology.orchestra.run.smithi071.stderr: 16000K .......... .......... .......... .......... .......... 17% 354M 1s 2024-09-14T11:36:39.843 INFO:teuthology.orchestra.run.smithi071.stderr: 16050K .......... .......... .......... .......... .......... 17% 344M 1s 2024-09-14T11:36:39.843 INFO:teuthology.orchestra.run.smithi071.stderr: 16100K .......... .......... .......... .......... .......... 17% 201M 1s 2024-09-14T11:36:39.843 INFO:teuthology.orchestra.run.smithi071.stderr: 16150K .......... .......... .......... .......... .......... 17% 174M 1s 2024-09-14T11:36:39.843 INFO:teuthology.orchestra.run.smithi071.stderr: 16200K .......... .......... .......... .......... .......... 17% 283M 1s 2024-09-14T11:36:39.843 INFO:teuthology.orchestra.run.smithi071.stderr: 16250K .......... .......... .......... .......... .......... 17% 312M 1s 2024-09-14T11:36:39.843 INFO:teuthology.orchestra.run.smithi071.stderr: 16300K .......... .......... .......... .......... .......... 17% 225M 1s 2024-09-14T11:36:39.843 INFO:teuthology.orchestra.run.smithi071.stderr: 16350K .......... .......... .......... .......... .......... 17% 198M 1s 2024-09-14T11:36:39.844 INFO:teuthology.orchestra.run.smithi071.stderr: 16400K .......... .......... .......... .......... .......... 17% 161M 1s 2024-09-14T11:36:39.844 INFO:teuthology.orchestra.run.smithi071.stderr: 16450K .......... .......... .......... .......... .......... 17% 339M 1s 2024-09-14T11:36:39.844 INFO:teuthology.orchestra.run.smithi071.stderr: 16500K .......... .......... .......... .......... .......... 17% 242M 1s 2024-09-14T11:36:39.844 INFO:teuthology.orchestra.run.smithi071.stderr: 16550K .......... .......... .......... .......... .......... 17% 349M 1s 2024-09-14T11:36:39.844 INFO:teuthology.orchestra.run.smithi071.stderr: 16600K .......... .......... .......... .......... .......... 17% 348M 1s 2024-09-14T11:36:39.844 INFO:teuthology.orchestra.run.smithi071.stderr: 16650K .......... .......... .......... .......... .......... 17% 328M 1s 2024-09-14T11:36:39.844 INFO:teuthology.orchestra.run.smithi071.stderr: 16700K .......... .......... .......... .......... .......... 18% 250M 1s 2024-09-14T11:36:39.844 INFO:teuthology.orchestra.run.smithi071.stderr: 16750K .......... .......... .......... .......... .......... 18% 219M 1s 2024-09-14T11:36:39.844 INFO:teuthology.orchestra.run.smithi071.stderr: 16800K .......... .......... .......... .......... .......... 18% 214M 1s 2024-09-14T11:36:39.844 INFO:teuthology.orchestra.run.smithi071.stderr: 16850K .......... .......... .......... .......... .......... 18% 220M 1s 2024-09-14T11:36:39.844 INFO:teuthology.orchestra.run.smithi071.stderr: 16900K .......... .......... .......... .......... .......... 18% 218M 1s 2024-09-14T11:36:39.844 INFO:teuthology.orchestra.run.smithi071.stderr: 16950K .......... .......... .......... .......... .......... 18% 305M 1s 2024-09-14T11:36:39.844 INFO:teuthology.orchestra.run.smithi071.stderr: 17000K .......... .......... .......... .......... .......... 18% 197M 1s 2024-09-14T11:36:39.844 INFO:teuthology.orchestra.run.smithi071.stderr: 17050K .......... .......... .......... .......... .......... 18% 233M 1s 2024-09-14T11:36:39.845 INFO:teuthology.orchestra.run.smithi071.stderr: 17100K .......... .......... .......... .......... .......... 18% 281M 1s 2024-09-14T11:36:39.845 INFO:teuthology.orchestra.run.smithi071.stderr: 17150K .......... .......... .......... .......... .......... 18% 328M 1s 2024-09-14T11:36:39.845 INFO:teuthology.orchestra.run.smithi071.stderr: 17200K .......... .......... .......... .......... .......... 18% 345M 1s 2024-09-14T11:36:39.845 INFO:teuthology.orchestra.run.smithi071.stderr: 17250K .......... .......... .......... .......... .......... 18% 350M 1s 2024-09-14T11:36:39.845 INFO:teuthology.orchestra.run.smithi071.stderr: 17300K .......... .......... .......... .......... .......... 18% 307M 1s 2024-09-14T11:36:39.845 INFO:teuthology.orchestra.run.smithi071.stderr: 17350K .......... .......... .......... .......... .......... 18% 351M 1s 2024-09-14T11:36:39.845 INFO:teuthology.orchestra.run.smithi071.stderr: 17400K .......... .......... .......... .......... .......... 18% 333M 1s 2024-09-14T11:36:39.845 INFO:teuthology.orchestra.run.smithi071.stderr: 17450K .......... .......... .......... .......... .......... 18% 325M 1s 2024-09-14T11:36:39.845 INFO:teuthology.orchestra.run.smithi071.stderr: 17500K .......... .......... .......... .......... .......... 18% 290M 1s 2024-09-14T11:36:39.845 INFO:teuthology.orchestra.run.smithi071.stderr: 17550K .......... .......... .......... .......... .......... 18% 342M 1s 2024-09-14T11:36:39.845 INFO:teuthology.orchestra.run.smithi071.stderr: 17600K .......... .......... .......... .......... .......... 18% 330M 1s 2024-09-14T11:36:39.845 INFO:teuthology.orchestra.run.smithi071.stderr: 17650K .......... .......... .......... .......... .......... 19% 334M 1s 2024-09-14T11:36:39.845 INFO:teuthology.orchestra.run.smithi071.stderr: 17700K .......... .......... .......... .......... .......... 19% 287M 1s 2024-09-14T11:36:39.845 INFO:teuthology.orchestra.run.smithi071.stderr: 17750K .......... .......... .......... .......... .......... 19% 339M 1s 2024-09-14T11:36:39.846 INFO:teuthology.orchestra.run.smithi071.stderr: 17800K .......... .......... .......... .......... .......... 19% 29.1M 1s 2024-09-14T11:36:39.846 INFO:teuthology.orchestra.run.smithi071.stderr: 17850K .......... .......... .......... .......... .......... 19% 183M 1s 2024-09-14T11:36:39.846 INFO:teuthology.orchestra.run.smithi071.stderr: 17900K .......... .......... .......... .......... .......... 19% 243M 1s 2024-09-14T11:36:39.846 INFO:teuthology.orchestra.run.smithi071.stderr: 17950K .......... .......... .......... .......... .......... 19% 260M 1s 2024-09-14T11:36:39.846 INFO:teuthology.orchestra.run.smithi071.stderr: 18000K .......... .......... .......... .......... .......... 19% 170M 1s 2024-09-14T11:36:39.846 INFO:teuthology.orchestra.run.smithi071.stderr: 18050K .......... .......... .......... .......... .......... 19% 211M 1s 2024-09-14T11:36:39.846 INFO:teuthology.orchestra.run.smithi071.stderr: 18100K .......... .......... .......... .......... .......... 19% 270M 1s 2024-09-14T11:36:39.846 INFO:teuthology.orchestra.run.smithi071.stderr: 18150K .......... .......... .......... .......... .......... 19% 251M 1s 2024-09-14T11:36:39.846 INFO:teuthology.orchestra.run.smithi071.stderr: 18200K .......... .......... .......... .......... .......... 19% 186M 1s 2024-09-14T11:36:39.846 INFO:teuthology.orchestra.run.smithi071.stderr: 18250K .......... .......... .......... .......... .......... 19% 247M 1s 2024-09-14T11:36:39.846 INFO:teuthology.orchestra.run.smithi071.stderr: 18300K .......... .......... .......... .......... .......... 19% 238M 1s 2024-09-14T11:36:39.846 INFO:teuthology.orchestra.run.smithi071.stderr: 18350K .......... .......... .......... .......... .......... 19% 233M 1s 2024-09-14T11:36:39.846 INFO:teuthology.orchestra.run.smithi071.stderr: 18400K .......... .......... .......... .......... .......... 19% 227M 1s 2024-09-14T11:36:39.846 INFO:teuthology.orchestra.run.smithi071.stderr: 18450K .......... .......... .......... .......... .......... 19% 232M 1s 2024-09-14T11:36:39.846 INFO:teuthology.orchestra.run.smithi071.stderr: 18500K .......... .......... .......... .......... .......... 19% 231M 1s 2024-09-14T11:36:39.846 INFO:teuthology.orchestra.run.smithi071.stderr: 18550K .......... .......... .......... .......... .......... 20% 317M 1s 2024-09-14T11:36:39.847 INFO:teuthology.orchestra.run.smithi071.stderr: 18600K .......... .......... .......... .......... .......... 20% 225M 1s 2024-09-14T11:36:39.847 INFO:teuthology.orchestra.run.smithi071.stderr: 18650K .......... .......... .......... .......... .......... 20% 319M 1s 2024-09-14T11:36:39.847 INFO:teuthology.orchestra.run.smithi071.stderr: 18700K .......... .......... .......... .......... .......... 20% 237M 1s 2024-09-14T11:36:39.847 INFO:teuthology.orchestra.run.smithi071.stderr: 18750K .......... .......... .......... .......... .......... 20% 231M 1s 2024-09-14T11:36:39.847 INFO:teuthology.orchestra.run.smithi071.stderr: 18800K .......... .......... .......... .......... .......... 20% 320M 1s 2024-09-14T11:36:39.847 INFO:teuthology.orchestra.run.smithi071.stderr: 18850K .......... .......... .......... .......... .......... 20% 331M 1s 2024-09-14T11:36:39.847 INFO:teuthology.orchestra.run.smithi071.stderr: 18900K .......... .......... .......... .......... .......... 20% 209M 1s 2024-09-14T11:36:39.847 INFO:teuthology.orchestra.run.smithi071.stderr: 18950K .......... .......... .......... .......... .......... 20% 244M 1s 2024-09-14T11:36:39.847 INFO:teuthology.orchestra.run.smithi071.stderr: 19000K .......... .......... .......... .......... .......... 20% 201M 1s 2024-09-14T11:36:39.847 INFO:teuthology.orchestra.run.smithi071.stderr: 19050K .......... .......... .......... .......... .......... 20% 308M 1s 2024-09-14T11:36:39.847 INFO:teuthology.orchestra.run.smithi071.stderr: 19100K .......... .......... .......... .......... .......... 20% 239M 1s 2024-09-14T11:36:39.847 INFO:teuthology.orchestra.run.smithi071.stderr: 19150K .......... .......... .......... .......... .......... 20% 211M 1s 2024-09-14T11:36:39.848 INFO:teuthology.orchestra.run.smithi071.stderr: 19200K .......... .......... .......... .......... .......... 20% 249M 1s 2024-09-14T11:36:39.848 INFO:teuthology.orchestra.run.smithi071.stderr: 19250K .......... .......... .......... .......... .......... 20% 297M 1s 2024-09-14T11:36:39.848 INFO:teuthology.orchestra.run.smithi071.stderr: 19300K .......... .......... .......... .......... .......... 20% 226M 1s 2024-09-14T11:36:39.848 INFO:teuthology.orchestra.run.smithi071.stderr: 19350K .......... .......... .......... .......... .......... 20% 334M 1s 2024-09-14T11:36:39.848 INFO:teuthology.orchestra.run.smithi071.stderr: 19400K .......... .......... .......... .......... .......... 20% 340M 1s 2024-09-14T11:36:39.848 INFO:teuthology.orchestra.run.smithi071.stderr: 19450K .......... .......... .......... .......... .......... 20% 318M 1s 2024-09-14T11:36:39.848 INFO:teuthology.orchestra.run.smithi071.stderr: 19500K .......... .......... .......... .......... .......... 21% 282M 1s 2024-09-14T11:36:39.848 INFO:teuthology.orchestra.run.smithi071.stderr: 19550K .......... .......... .......... .......... .......... 21% 306M 1s 2024-09-14T11:36:39.848 INFO:teuthology.orchestra.run.smithi071.stderr: 19600K .......... .......... .......... .......... .......... 21% 212M 1s 2024-09-14T11:36:39.848 INFO:teuthology.orchestra.run.smithi071.stderr: 19650K .......... .......... .......... .......... .......... 21% 229M 1s 2024-09-14T11:36:39.848 INFO:teuthology.orchestra.run.smithi071.stderr: 19700K .......... .......... .......... .......... .......... 21% 181M 1s 2024-09-14T11:36:39.848 INFO:teuthology.orchestra.run.smithi071.stderr: 19750K .......... .......... .......... .......... .......... 21% 295M 1s 2024-09-14T11:36:39.848 INFO:teuthology.orchestra.run.smithi071.stderr: 19800K .......... .......... .......... .......... .......... 21% 229M 1s 2024-09-14T11:36:39.848 INFO:teuthology.orchestra.run.smithi071.stderr: 19850K .......... .......... .......... .......... .......... 21% 217M 1s 2024-09-14T11:36:39.848 INFO:teuthology.orchestra.run.smithi071.stderr: 19900K .......... .......... .......... .......... .......... 21% 198M 1s 2024-09-14T11:36:39.849 INFO:teuthology.orchestra.run.smithi071.stderr: 19950K .......... .......... .......... .......... .......... 21% 309M 1s 2024-09-14T11:36:39.849 INFO:teuthology.orchestra.run.smithi071.stderr: 20000K .......... .......... .......... .......... .......... 21% 340M 1s 2024-09-14T11:36:39.849 INFO:teuthology.orchestra.run.smithi071.stderr: 20050K .......... .......... .......... .......... .......... 21% 337M 1s 2024-09-14T11:36:39.849 INFO:teuthology.orchestra.run.smithi071.stderr: 20100K .......... .......... .......... .......... .......... 21% 299M 1s 2024-09-14T11:36:39.849 INFO:teuthology.orchestra.run.smithi071.stderr: 20150K .......... .......... .......... .......... .......... 21% 323M 1s 2024-09-14T11:36:39.849 INFO:teuthology.orchestra.run.smithi071.stderr: 20200K .......... .......... .......... .......... .......... 21% 306M 1s 2024-09-14T11:36:39.849 INFO:teuthology.orchestra.run.smithi071.stderr: 20250K .......... .......... .......... .......... .......... 21% 331M 1s 2024-09-14T11:36:39.849 INFO:teuthology.orchestra.run.smithi071.stderr: 20300K .......... .......... .......... .......... .......... 21% 17.1M 1s 2024-09-14T11:36:39.849 INFO:teuthology.orchestra.run.smithi071.stderr: 20350K .......... .......... .......... .......... .......... 21% 192M 1s 2024-09-14T11:36:39.849 INFO:teuthology.orchestra.run.smithi071.stderr: 20400K .......... .......... .......... .......... .......... 22% 176M 1s 2024-09-14T11:36:39.849 INFO:teuthology.orchestra.run.smithi071.stderr: 20450K .......... .......... .......... .......... .......... 22% 220M 1s 2024-09-14T11:36:39.849 INFO:teuthology.orchestra.run.smithi071.stderr: 20500K .......... .......... .......... .......... .......... 22% 167M 1s 2024-09-14T11:36:39.849 INFO:teuthology.orchestra.run.smithi071.stderr: 20550K .......... .......... .......... .......... .......... 22% 219M 1s 2024-09-14T11:36:39.850 INFO:teuthology.orchestra.run.smithi071.stderr: 20600K .......... .......... .......... .......... .......... 22% 183M 1s 2024-09-14T11:36:39.850 INFO:teuthology.orchestra.run.smithi071.stderr: 20650K .......... .......... .......... .......... .......... 22% 217M 1s 2024-09-14T11:36:39.850 INFO:teuthology.orchestra.run.smithi071.stderr: 20700K .......... .......... .......... .......... .......... 22% 240M 1s 2024-09-14T11:36:39.850 INFO:teuthology.orchestra.run.smithi071.stderr: 20750K .......... .......... .......... .......... .......... 22% 255M 1s 2024-09-14T11:36:39.850 INFO:teuthology.orchestra.run.smithi071.stderr: 20800K .......... .......... .......... .......... .......... 22% 270M 1s 2024-09-14T11:36:39.850 INFO:teuthology.orchestra.run.smithi071.stderr: 20850K .......... .......... .......... .......... .......... 22% 229M 1s 2024-09-14T11:36:39.850 INFO:teuthology.orchestra.run.smithi071.stderr: 20900K .......... .......... .......... .......... .......... 22% 254M 1s 2024-09-14T11:36:39.850 INFO:teuthology.orchestra.run.smithi071.stderr: 20950K .......... .......... .......... .......... .......... 22% 248M 1s 2024-09-14T11:36:39.850 INFO:teuthology.orchestra.run.smithi071.stderr: 21000K .......... .......... .......... .......... .......... 22% 214M 1s 2024-09-14T11:36:39.850 INFO:teuthology.orchestra.run.smithi071.stderr: 21050K .......... .......... .......... .......... .......... 22% 277M 1s 2024-09-14T11:36:39.850 INFO:teuthology.orchestra.run.smithi071.stderr: 21100K .......... .......... .......... .......... .......... 22% 263M 1s 2024-09-14T11:36:39.850 INFO:teuthology.orchestra.run.smithi071.stderr: 21150K .......... .......... .......... .......... .......... 22% 224M 1s 2024-09-14T11:36:39.850 INFO:teuthology.orchestra.run.smithi071.stderr: 21200K .......... .......... .......... .......... .......... 22% 230M 1s 2024-09-14T11:36:39.850 INFO:teuthology.orchestra.run.smithi071.stderr: 21250K .......... .......... .......... .......... .......... 22% 316M 1s 2024-09-14T11:36:39.850 INFO:teuthology.orchestra.run.smithi071.stderr: 21300K .......... .......... .......... .......... .......... 22% 213M 1s 2024-09-14T11:36:39.851 INFO:teuthology.orchestra.run.smithi071.stderr: 21350K .......... .......... .......... .......... .......... 23% 257M 1s 2024-09-14T11:36:39.851 INFO:teuthology.orchestra.run.smithi071.stderr: 21400K .......... .......... .......... .......... .......... 23% 245M 1s 2024-09-14T11:36:39.851 INFO:teuthology.orchestra.run.smithi071.stderr: 21450K .......... .......... .......... .......... .......... 23% 244M 1s 2024-09-14T11:36:39.851 INFO:teuthology.orchestra.run.smithi071.stderr: 21500K .......... .......... .......... .......... .......... 23% 229M 1s 2024-09-14T11:36:39.851 INFO:teuthology.orchestra.run.smithi071.stderr: 21550K .......... .......... .......... .......... .......... 23% 257M 1s 2024-09-14T11:36:39.851 INFO:teuthology.orchestra.run.smithi071.stderr: 21600K .......... .......... .......... .......... .......... 23% 316M 1s 2024-09-14T11:36:39.851 INFO:teuthology.orchestra.run.smithi071.stderr: 21650K .......... .......... .......... .......... .......... 23% 232M 1s 2024-09-14T11:36:39.851 INFO:teuthology.orchestra.run.smithi071.stderr: 21700K .......... .......... .......... .......... .......... 23% 149M 1s 2024-09-14T11:36:39.851 INFO:teuthology.orchestra.run.smithi071.stderr: 21750K .......... .......... .......... .......... .......... 23% 264M 1s 2024-09-14T11:36:39.851 INFO:teuthology.orchestra.run.smithi071.stderr: 21800K .......... .......... .......... .......... .......... 23% 319M 1s 2024-09-14T11:36:39.851 INFO:teuthology.orchestra.run.smithi071.stderr: 21850K .......... .......... .......... .......... .......... 23% 323M 1s 2024-09-14T11:36:39.851 INFO:teuthology.orchestra.run.smithi071.stderr: 21900K .......... .......... .......... .......... .......... 23% 294M 1s 2024-09-14T11:36:39.851 INFO:teuthology.orchestra.run.smithi071.stderr: 21950K .......... .......... .......... .......... .......... 23% 189M 1s 2024-09-14T11:36:39.851 INFO:teuthology.orchestra.run.smithi071.stderr: 22000K .......... .......... .......... .......... .......... 23% 186M 1s 2024-09-14T11:36:39.851 INFO:teuthology.orchestra.run.smithi071.stderr: 22050K .......... .......... .......... .......... .......... 23% 179M 1s 2024-09-14T11:36:39.852 INFO:teuthology.orchestra.run.smithi071.stderr: 22100K .......... .......... .......... .......... .......... 23% 282M 1s 2024-09-14T11:36:39.852 INFO:teuthology.orchestra.run.smithi071.stderr: 22150K .......... .......... .......... .......... .......... 23% 260M 1s 2024-09-14T11:36:39.852 INFO:teuthology.orchestra.run.smithi071.stderr: 22200K .......... .......... .......... .......... .......... 23% 183M 1s 2024-09-14T11:36:39.852 INFO:teuthology.orchestra.run.smithi071.stderr: 22250K .......... .......... .......... .......... .......... 24% 224M 1s 2024-09-14T11:36:39.852 INFO:teuthology.orchestra.run.smithi071.stderr: 22300K .......... .......... .......... .......... .......... 24% 264M 1s 2024-09-14T11:36:39.852 INFO:teuthology.orchestra.run.smithi071.stderr: 22350K .......... .......... .......... .......... .......... 24% 324M 1s 2024-09-14T11:36:39.852 INFO:teuthology.orchestra.run.smithi071.stderr: 22400K .......... .......... .......... .......... .......... 24% 328M 1s 2024-09-14T11:36:39.852 INFO:teuthology.orchestra.run.smithi071.stderr: 22450K .......... .......... .......... .......... .......... 24% 292M 1s 2024-09-14T11:36:39.852 INFO:teuthology.orchestra.run.smithi071.stderr: 22500K .......... .......... .......... .......... .......... 24% 293M 1s 2024-09-14T11:36:39.852 INFO:teuthology.orchestra.run.smithi071.stderr: 22550K .......... .......... .......... .......... .......... 24% 324M 1s 2024-09-14T11:36:39.852 INFO:teuthology.orchestra.run.smithi071.stderr: 22600K .......... .......... .......... .......... .......... 24% 280M 1s 2024-09-14T11:36:39.852 INFO:teuthology.orchestra.run.smithi071.stderr: 22650K .......... .......... .......... .......... .......... 24% 321M 1s 2024-09-14T11:36:39.852 INFO:teuthology.orchestra.run.smithi071.stderr: 22700K .......... .......... .......... .......... .......... 24% 260M 1s 2024-09-14T11:36:39.852 INFO:teuthology.orchestra.run.smithi071.stderr: 22750K .......... .......... .......... .......... .......... 24% 306M 1s 2024-09-14T11:36:39.852 INFO:teuthology.orchestra.run.smithi071.stderr: 22800K .......... .......... .......... .......... .......... 24% 317M 1s 2024-09-14T11:36:39.852 INFO:teuthology.orchestra.run.smithi071.stderr: 22850K .......... .......... .......... .......... .......... 24% 323M 1s 2024-09-14T11:36:39.853 INFO:teuthology.orchestra.run.smithi071.stderr: 22900K .......... .......... .......... .......... .......... 24% 286M 1s 2024-09-14T11:36:39.853 INFO:teuthology.orchestra.run.smithi071.stderr: 22950K .......... .......... .......... .......... .......... 24% 309M 1s 2024-09-14T11:36:39.853 INFO:teuthology.orchestra.run.smithi071.stderr: 23000K .......... .......... .......... .......... .......... 24% 33.9M 1s 2024-09-14T11:36:39.853 INFO:teuthology.orchestra.run.smithi071.stderr: 23050K .......... .......... .......... .......... .......... 24% 194M 1s 2024-09-14T11:36:39.853 INFO:teuthology.orchestra.run.smithi071.stderr: 23100K .......... .......... .......... .......... .......... 24% 177M 1s 2024-09-14T11:36:39.853 INFO:teuthology.orchestra.run.smithi071.stderr: 23150K .......... .......... .......... .......... .......... 24% 241M 1s 2024-09-14T11:36:39.853 INFO:teuthology.orchestra.run.smithi071.stderr: 23200K .......... .......... .......... .......... .......... 25% 190M 1s 2024-09-14T11:36:39.853 INFO:teuthology.orchestra.run.smithi071.stderr: 23250K .......... .......... .......... .......... .......... 25% 271M 1s 2024-09-14T11:36:39.853 INFO:teuthology.orchestra.run.smithi071.stderr: 23300K .......... .......... .......... .......... .......... 25% 190M 1s 2024-09-14T11:36:39.853 INFO:teuthology.orchestra.run.smithi071.stderr: 23350K .......... .......... .......... .......... .......... 25% 232M 1s 2024-09-14T11:36:39.853 INFO:teuthology.orchestra.run.smithi071.stderr: 23400K .......... .......... .......... .......... .......... 25% 285M 1s 2024-09-14T11:36:39.853 INFO:teuthology.orchestra.run.smithi071.stderr: 23450K .......... .......... .......... .......... .......... 25% 220M 1s 2024-09-14T11:36:39.853 INFO:teuthology.orchestra.run.smithi071.stderr: 23500K .......... .......... .......... .......... .......... 25% 222M 1s 2024-09-14T11:36:39.853 INFO:teuthology.orchestra.run.smithi071.stderr: 23550K .......... .......... .......... .......... .......... 25% 268M 1s 2024-09-14T11:36:39.853 INFO:teuthology.orchestra.run.smithi071.stderr: 23600K .......... .......... .......... .......... .......... 25% 287M 1s 2024-09-14T11:36:39.854 INFO:teuthology.orchestra.run.smithi071.stderr: 23650K .......... .......... .......... .......... .......... 25% 268M 1s 2024-09-14T11:36:39.854 INFO:teuthology.orchestra.run.smithi071.stderr: 23700K .......... .......... .......... .......... .......... 25% 215M 1s 2024-09-14T11:36:39.854 INFO:teuthology.orchestra.run.smithi071.stderr: 23750K .......... .......... .......... .......... .......... 25% 287M 1s 2024-09-14T11:36:39.854 INFO:teuthology.orchestra.run.smithi071.stderr: 23800K .......... .......... .......... .......... .......... 25% 237M 1s 2024-09-14T11:36:39.854 INFO:teuthology.orchestra.run.smithi071.stderr: 23850K .......... .......... .......... .......... .......... 25% 265M 1s 2024-09-14T11:36:39.854 INFO:teuthology.orchestra.run.smithi071.stderr: 23900K .......... .......... .......... .......... .......... 25% 244M 1s 2024-09-14T11:36:39.854 INFO:teuthology.orchestra.run.smithi071.stderr: 23950K .......... .......... .......... .......... .......... 25% 255M 1s 2024-09-14T11:36:39.854 INFO:teuthology.orchestra.run.smithi071.stderr: 24000K .......... .......... .......... .......... .......... 25% 239M 1s 2024-09-14T11:36:39.854 INFO:teuthology.orchestra.run.smithi071.stderr: 24050K .......... .......... .......... .......... .......... 25% 323M 1s 2024-09-14T11:36:39.854 INFO:teuthology.orchestra.run.smithi071.stderr: 24100K .......... .......... .......... .......... .......... 25% 211M 1s 2024-09-14T11:36:39.854 INFO:teuthology.orchestra.run.smithi071.stderr: 24150K .......... .......... .......... .......... .......... 26% 267M 1s 2024-09-14T11:36:39.854 INFO:teuthology.orchestra.run.smithi071.stderr: 24200K .......... .......... .......... .......... .......... 26% 241M 1s 2024-09-14T11:36:39.854 INFO:teuthology.orchestra.run.smithi071.stderr: 24250K .......... .......... .......... .......... .......... 26% 243M 1s 2024-09-14T11:36:39.854 INFO:teuthology.orchestra.run.smithi071.stderr: 24300K .......... .......... .......... .......... .......... 26% 246M 1s 2024-09-14T11:36:39.854 INFO:teuthology.orchestra.run.smithi071.stderr: 24350K .......... .......... .......... .......... .......... 26% 233M 1s 2024-09-14T11:36:39.854 INFO:teuthology.orchestra.run.smithi071.stderr: 24400K .......... .......... .......... .......... .......... 26% 316M 1s 2024-09-14T11:36:39.855 INFO:teuthology.orchestra.run.smithi071.stderr: 24450K .......... .......... .......... .......... .......... 26% 234M 1s 2024-09-14T11:36:39.855 INFO:teuthology.orchestra.run.smithi071.stderr: 24500K .......... .......... .......... .......... .......... 26% 200M 1s 2024-09-14T11:36:39.855 INFO:teuthology.orchestra.run.smithi071.stderr: 24550K .......... .......... .......... .......... .......... 26% 276M 1s 2024-09-14T11:36:39.855 INFO:teuthology.orchestra.run.smithi071.stderr: 24600K .......... .......... .......... .......... .......... 26% 322M 1s 2024-09-14T11:36:39.855 INFO:teuthology.orchestra.run.smithi071.stderr: 24650K .......... .......... .......... .......... .......... 26% 321M 1s 2024-09-14T11:36:39.855 INFO:teuthology.orchestra.run.smithi071.stderr: 24700K .......... .......... .......... .......... .......... 26% 207M 1s 2024-09-14T11:36:39.855 INFO:teuthology.orchestra.run.smithi071.stderr: 24750K .......... .......... .......... .......... .......... 26% 274M 1s 2024-09-14T11:36:39.855 INFO:teuthology.orchestra.run.smithi071.stderr: 24800K .......... .......... .......... .......... .......... 26% 210M 1s 2024-09-14T11:36:39.855 INFO:teuthology.orchestra.run.smithi071.stderr: 24850K .......... .......... .......... .......... .......... 26% 222M 1s 2024-09-14T11:36:39.855 INFO:teuthology.orchestra.run.smithi071.stderr: 24900K .......... .......... .......... .......... .......... 26% 254M 1s 2024-09-14T11:36:39.855 INFO:teuthology.orchestra.run.smithi071.stderr: 24950K .......... .......... .......... .......... .......... 26% 315M 1s 2024-09-14T11:36:39.855 INFO:teuthology.orchestra.run.smithi071.stderr: 25000K .......... .......... .......... .......... .......... 26% 237M 1s 2024-09-14T11:36:39.855 INFO:teuthology.orchestra.run.smithi071.stderr: 25050K .......... .......... .......... .......... .......... 27% 152M 1s 2024-09-14T11:36:39.855 INFO:teuthology.orchestra.run.smithi071.stderr: 25100K .......... .......... .......... .......... .......... 27% 266M 1s 2024-09-14T11:36:39.855 INFO:teuthology.orchestra.run.smithi071.stderr: 25150K .......... .......... .......... .......... .......... 27% 314M 1s 2024-09-14T11:36:39.856 INFO:teuthology.orchestra.run.smithi071.stderr: 25200K .......... .......... .......... .......... .......... 27% 218M 1s 2024-09-14T11:36:39.856 INFO:teuthology.orchestra.run.smithi071.stderr: 25250K .......... .......... .......... .......... .......... 27% 318M 1s 2024-09-14T11:36:39.856 INFO:teuthology.orchestra.run.smithi071.stderr: 25300K .......... .......... .......... .......... .......... 27% 295M 1s 2024-09-14T11:36:39.856 INFO:teuthology.orchestra.run.smithi071.stderr: 25350K .......... .......... .......... .......... .......... 27% 327M 1s 2024-09-14T11:36:39.856 INFO:teuthology.orchestra.run.smithi071.stderr: 25400K .......... .......... .......... .......... .......... 27% 328M 1s 2024-09-14T11:36:39.856 INFO:teuthology.orchestra.run.smithi071.stderr: 25450K .......... .......... .......... .......... .......... 27% 16.4M 1s 2024-09-14T11:36:39.856 INFO:teuthology.orchestra.run.smithi071.stderr: 25500K .......... .......... .......... .......... .......... 27% 146M 1s 2024-09-14T11:36:39.856 INFO:teuthology.orchestra.run.smithi071.stderr: 25550K .......... .......... .......... .......... .......... 27% 182M 1s 2024-09-14T11:36:39.856 INFO:teuthology.orchestra.run.smithi071.stderr: 25600K .......... .......... .......... .......... .......... 27% 203M 1s 2024-09-14T11:36:39.856 INFO:teuthology.orchestra.run.smithi071.stderr: 25650K .......... .......... .......... .......... .......... 27% 243M 1s 2024-09-14T11:36:39.856 INFO:teuthology.orchestra.run.smithi071.stderr: 25700K .......... .......... .......... .......... .......... 27% 166M 1s 2024-09-14T11:36:39.856 INFO:teuthology.orchestra.run.smithi071.stderr: 25750K .......... .......... .......... .......... .......... 27% 212M 1s 2024-09-14T11:36:39.856 INFO:teuthology.orchestra.run.smithi071.stderr: 25800K .......... .......... .......... .......... .......... 27% 253M 1s 2024-09-14T11:36:39.856 INFO:teuthology.orchestra.run.smithi071.stderr: 25850K .......... .......... .......... .......... .......... 27% 180M 1s 2024-09-14T11:36:39.856 INFO:teuthology.orchestra.run.smithi071.stderr: 25900K .......... .......... .......... .......... .......... 27% 225M 1s 2024-09-14T11:36:39.856 INFO:teuthology.orchestra.run.smithi071.stderr: 25950K .......... .......... .......... .......... .......... 27% 313M 1s 2024-09-14T11:36:39.857 INFO:teuthology.orchestra.run.smithi071.stderr: 26000K .......... .......... .......... .......... .......... 28% 170M 1s 2024-09-14T11:36:39.857 INFO:teuthology.orchestra.run.smithi071.stderr: 26050K .......... .......... .......... .......... .......... 28% 190M 1s 2024-09-14T11:36:39.857 INFO:teuthology.orchestra.run.smithi071.stderr: 26100K .......... .......... .......... .......... .......... 28% 195M 1s 2024-09-14T11:36:39.857 INFO:teuthology.orchestra.run.smithi071.stderr: 26150K .......... .......... .......... .......... .......... 28% 214M 1s 2024-09-14T11:36:39.857 INFO:teuthology.orchestra.run.smithi071.stderr: 26200K .......... .......... .......... .......... .......... 28% 218M 1s 2024-09-14T11:36:39.857 INFO:teuthology.orchestra.run.smithi071.stderr: 26250K .......... .......... .......... .......... .......... 28% 200M 1s 2024-09-14T11:36:39.857 INFO:teuthology.orchestra.run.smithi071.stderr: 26300K .......... .......... .......... .......... .......... 28% 253M 1s 2024-09-14T11:36:39.857 INFO:teuthology.orchestra.run.smithi071.stderr: 26350K .......... .......... .......... .......... .......... 28% 221M 1s 2024-09-14T11:36:39.857 INFO:teuthology.orchestra.run.smithi071.stderr: 26400K .......... .......... .......... .......... .......... 28% 209M 1s 2024-09-14T11:36:39.857 INFO:teuthology.orchestra.run.smithi071.stderr: 26450K .......... .......... .......... .......... .......... 28% 246M 1s 2024-09-14T11:36:39.857 INFO:teuthology.orchestra.run.smithi071.stderr: 26500K .......... .......... .......... .......... .......... 28% 244M 1s 2024-09-14T11:36:39.857 INFO:teuthology.orchestra.run.smithi071.stderr: 26550K .......... .......... .......... .......... .......... 28% 315M 1s 2024-09-14T11:36:39.857 INFO:teuthology.orchestra.run.smithi071.stderr: 26600K .......... .......... .......... .......... .......... 28% 219M 1s 2024-09-14T11:36:39.857 INFO:teuthology.orchestra.run.smithi071.stderr: 26650K .......... .......... .......... .......... .......... 28% 237M 1s 2024-09-14T11:36:39.857 INFO:teuthology.orchestra.run.smithi071.stderr: 26700K .......... .......... .......... .......... .......... 28% 217M 1s 2024-09-14T11:36:39.858 INFO:teuthology.orchestra.run.smithi071.stderr: 26750K .......... .......... .......... .......... .......... 28% 227M 1s 2024-09-14T11:36:39.858 INFO:teuthology.orchestra.run.smithi071.stderr: 26800K .......... .......... .......... .......... .......... 28% 326M 1s 2024-09-14T11:36:39.858 INFO:teuthology.orchestra.run.smithi071.stderr: 26850K .......... .......... .......... .......... .......... 28% 332M 1s 2024-09-14T11:36:39.858 INFO:teuthology.orchestra.run.smithi071.stderr: 26900K .......... .......... .......... .......... .......... 29% 296M 1s 2024-09-14T11:36:39.858 INFO:teuthology.orchestra.run.smithi071.stderr: 26950K .......... .......... .......... .......... .......... 29% 328M 1s 2024-09-14T11:36:39.858 INFO:teuthology.orchestra.run.smithi071.stderr: 27000K .......... .......... .......... .......... .......... 29% 320M 1s 2024-09-14T11:36:39.858 INFO:teuthology.orchestra.run.smithi071.stderr: 27050K .......... .......... .......... .......... .......... 29% 331M 1s 2024-09-14T11:36:39.858 INFO:teuthology.orchestra.run.smithi071.stderr: 27100K .......... .......... .......... .......... .......... 29% 177M 1s 2024-09-14T11:36:39.858 INFO:teuthology.orchestra.run.smithi071.stderr: 27150K .......... .......... .......... .......... .......... 29% 157M 1s 2024-09-14T11:36:39.858 INFO:teuthology.orchestra.run.smithi071.stderr: 27200K .......... .......... .......... .......... .......... 29% 262M 1s 2024-09-14T11:36:39.858 INFO:teuthology.orchestra.run.smithi071.stderr: 27250K .......... .......... .......... .......... .......... 29% 152M 1s 2024-09-14T11:36:39.858 INFO:teuthology.orchestra.run.smithi071.stderr: 27300K .......... .......... .......... .......... .......... 29% 286M 1s 2024-09-14T11:36:39.858 INFO:teuthology.orchestra.run.smithi071.stderr: 27350K .......... .......... .......... .......... .......... 29% 329M 1s 2024-09-14T11:36:39.858 INFO:teuthology.orchestra.run.smithi071.stderr: 27400K .......... .......... .......... .......... .......... 29% 308M 1s 2024-09-14T11:36:39.858 INFO:teuthology.orchestra.run.smithi071.stderr: 27450K .......... .......... .......... .......... .......... 29% 332M 1s 2024-09-14T11:36:39.858 INFO:teuthology.orchestra.run.smithi071.stderr: 27500K .......... .......... .......... .......... .......... 29% 271M 1s 2024-09-14T11:36:39.859 INFO:teuthology.orchestra.run.smithi071.stderr: 27550K .......... .......... .......... .......... .......... 29% 337M 1s 2024-09-14T11:36:39.859 INFO:teuthology.orchestra.run.smithi071.stderr: 27600K .......... .......... .......... .......... .......... 29% 331M 1s 2024-09-14T11:36:39.859 INFO:teuthology.orchestra.run.smithi071.stderr: 27650K .......... .......... .......... .......... .......... 29% 336M 1s 2024-09-14T11:36:39.859 INFO:teuthology.orchestra.run.smithi071.stderr: 27700K .......... .......... .......... .......... .......... 29% 302M 1s 2024-09-14T11:36:39.859 INFO:teuthology.orchestra.run.smithi071.stderr: 27750K .......... .......... .......... .......... .......... 29% 320M 1s 2024-09-14T11:36:39.859 INFO:teuthology.orchestra.run.smithi071.stderr: 27800K .......... .......... .......... .......... .......... 29% 321M 1s 2024-09-14T11:36:39.859 INFO:teuthology.orchestra.run.smithi071.stderr: 27850K .......... .......... .......... .......... .......... 30% 326M 1s 2024-09-14T11:36:39.859 INFO:teuthology.orchestra.run.smithi071.stderr: 27900K .......... .......... .......... .......... .......... 30% 273M 1s 2024-09-14T11:36:39.859 INFO:teuthology.orchestra.run.smithi071.stderr: 27950K .......... .......... .......... .......... .......... 30% 330M 1s 2024-09-14T11:36:39.859 INFO:teuthology.orchestra.run.smithi071.stderr: 28000K .......... .......... .......... .......... .......... 30% 317M 1s 2024-09-14T11:36:39.859 INFO:teuthology.orchestra.run.smithi071.stderr: 28050K .......... .......... .......... .......... .......... 30% 327M 1s 2024-09-14T11:36:39.859 INFO:teuthology.orchestra.run.smithi071.stderr: 28100K .......... .......... .......... .......... .......... 30% 297M 1s 2024-09-14T11:36:39.859 INFO:teuthology.orchestra.run.smithi071.stderr: 28150K .......... .......... .......... .......... .......... 30% 27.0M 1s 2024-09-14T11:36:39.859 INFO:teuthology.orchestra.run.smithi071.stderr: 28200K .......... .......... .......... .......... .......... 30% 192M 1s 2024-09-14T11:36:39.859 INFO:teuthology.orchestra.run.smithi071.stderr: 28250K .......... .......... .......... .......... .......... 30% 225M 1s 2024-09-14T11:36:39.859 INFO:teuthology.orchestra.run.smithi071.stderr: 28300K .......... .......... .......... .......... .......... 30% 235M 1s 2024-09-14T11:36:39.860 INFO:teuthology.orchestra.run.smithi071.stderr: 28350K .......... .......... .......... .......... .......... 30% 248M 1s 2024-09-14T11:36:39.860 INFO:teuthology.orchestra.run.smithi071.stderr: 28400K .......... .......... .......... .......... .......... 30% 209M 1s 2024-09-14T11:36:39.860 INFO:teuthology.orchestra.run.smithi071.stderr: 28450K .......... .......... .......... .......... .......... 30% 230M 1s 2024-09-14T11:36:39.860 INFO:teuthology.orchestra.run.smithi071.stderr: 28500K .......... .......... .......... .......... .......... 30% 258M 1s 2024-09-14T11:36:39.860 INFO:teuthology.orchestra.run.smithi071.stderr: 28550K .......... .......... .......... .......... .......... 30% 310M 1s 2024-09-14T11:36:39.860 INFO:teuthology.orchestra.run.smithi071.stderr: 28600K .......... .......... .......... .......... .......... 30% 201M 0s 2024-09-14T11:36:39.860 INFO:teuthology.orchestra.run.smithi071.stderr: 28650K .......... .......... .......... .......... .......... 30% 318M 0s 2024-09-14T11:36:39.860 INFO:teuthology.orchestra.run.smithi071.stderr: 28700K .......... .......... .......... .......... .......... 30% 192M 0s 2024-09-14T11:36:39.860 INFO:teuthology.orchestra.run.smithi071.stderr: 28750K .......... .......... .......... .......... .......... 31% 201M 0s 2024-09-14T11:36:39.860 INFO:teuthology.orchestra.run.smithi071.stderr: 28800K .......... .......... .......... .......... .......... 31% 265M 0s 2024-09-14T11:36:39.860 INFO:teuthology.orchestra.run.smithi071.stderr: 28850K .......... .......... .......... .......... .......... 31% 271M 0s 2024-09-14T11:36:39.860 INFO:teuthology.orchestra.run.smithi071.stderr: 28900K .......... .......... .......... .......... .......... 31% 308M 0s 2024-09-14T11:36:39.860 INFO:teuthology.orchestra.run.smithi071.stderr: 28950K .......... .......... .......... .......... .......... 31% 281M 0s 2024-09-14T11:36:39.860 INFO:teuthology.orchestra.run.smithi071.stderr: 29000K .......... .......... .......... .......... .......... 31% 267M 0s 2024-09-14T11:36:39.860 INFO:teuthology.orchestra.run.smithi071.stderr: 29050K .......... .......... .......... .......... .......... 31% 342M 0s 2024-09-14T11:36:39.861 INFO:teuthology.orchestra.run.smithi071.stderr: 29100K .......... .......... .......... .......... .......... 31% 185M 0s 2024-09-14T11:36:39.861 INFO:teuthology.orchestra.run.smithi071.stderr: 29150K .......... .......... .......... .......... .......... 31% 248M 0s 2024-09-14T11:36:39.861 INFO:teuthology.orchestra.run.smithi071.stderr: 29200K .......... .......... .......... .......... .......... 31% 271M 0s 2024-09-14T11:36:39.861 INFO:teuthology.orchestra.run.smithi071.stderr: 29250K .......... .......... .......... .......... .......... 31% 236M 0s 2024-09-14T11:36:39.861 INFO:teuthology.orchestra.run.smithi071.stderr: 29300K .......... .......... .......... .......... .......... 31% 222M 0s 2024-09-14T11:36:39.861 INFO:teuthology.orchestra.run.smithi071.stderr: 29350K .......... .......... .......... .......... .......... 31% 335M 0s 2024-09-14T11:36:39.861 INFO:teuthology.orchestra.run.smithi071.stderr: 29400K .......... .......... .......... .......... .......... 31% 265M 0s 2024-09-14T11:36:39.861 INFO:teuthology.orchestra.run.smithi071.stderr: 29450K .......... .......... .......... .......... .......... 31% 288M 0s 2024-09-14T11:36:39.861 INFO:teuthology.orchestra.run.smithi071.stderr: 29500K .......... .......... .......... .......... .......... 31% 213M 0s 2024-09-14T11:36:39.861 INFO:teuthology.orchestra.run.smithi071.stderr: 29550K .......... .......... .......... .......... .......... 31% 225M 0s 2024-09-14T11:36:39.861 INFO:teuthology.orchestra.run.smithi071.stderr: 29600K .......... .......... .......... .......... .......... 31% 282M 0s 2024-09-14T11:36:39.861 INFO:teuthology.orchestra.run.smithi071.stderr: 29650K .......... .......... .......... .......... .......... 31% 263M 0s 2024-09-14T11:36:39.861 INFO:teuthology.orchestra.run.smithi071.stderr: 29700K .......... .......... .......... .......... .......... 32% 307M 0s 2024-09-14T11:36:39.861 INFO:teuthology.orchestra.run.smithi071.stderr: 29750K .......... .......... .......... .......... .......... 32% 338M 0s 2024-09-14T11:36:39.861 INFO:teuthology.orchestra.run.smithi071.stderr: 29800K .......... .......... .......... .......... .......... 32% 348M 0s 2024-09-14T11:36:39.862 INFO:teuthology.orchestra.run.smithi071.stderr: 29850K .......... .......... .......... .......... .......... 32% 348M 0s 2024-09-14T11:36:39.862 INFO:teuthology.orchestra.run.smithi071.stderr: 29900K .......... .......... .......... .......... .......... 32% 272M 0s 2024-09-14T11:36:39.862 INFO:teuthology.orchestra.run.smithi071.stderr: 29950K .......... .......... .......... .......... .......... 32% 226M 0s 2024-09-14T11:36:39.862 INFO:teuthology.orchestra.run.smithi071.stderr: 30000K .......... .......... .......... .......... .......... 32% 208M 0s 2024-09-14T11:36:39.862 INFO:teuthology.orchestra.run.smithi071.stderr: 30050K .......... .......... .......... .......... .......... 32% 224M 0s 2024-09-14T11:36:39.862 INFO:teuthology.orchestra.run.smithi071.stderr: 30100K .......... .......... .......... .......... .......... 32% 252M 0s 2024-09-14T11:36:39.862 INFO:teuthology.orchestra.run.smithi071.stderr: 30150K .......... .......... .......... .......... .......... 32% 287M 0s 2024-09-14T11:36:39.862 INFO:teuthology.orchestra.run.smithi071.stderr: 30200K .......... .......... .......... .......... .......... 32% 261M 0s 2024-09-14T11:36:39.862 INFO:teuthology.orchestra.run.smithi071.stderr: 30250K .......... .......... .......... .......... .......... 32% 330M 0s 2024-09-14T11:36:39.862 INFO:teuthology.orchestra.run.smithi071.stderr: 30300K .......... .......... .......... .......... .......... 32% 293M 0s 2024-09-14T11:36:39.862 INFO:teuthology.orchestra.run.smithi071.stderr: 30350K .......... .......... .......... .......... .......... 32% 352M 0s 2024-09-14T11:36:39.862 INFO:teuthology.orchestra.run.smithi071.stderr: 30400K .......... .......... .......... .......... .......... 32% 344M 0s 2024-09-14T11:36:39.862 INFO:teuthology.orchestra.run.smithi071.stderr: 30450K .......... .......... .......... .......... .......... 32% 346M 0s 2024-09-14T11:36:39.862 INFO:teuthology.orchestra.run.smithi071.stderr: 30500K .......... .......... .......... .......... .......... 32% 14.2M 0s 2024-09-14T11:36:39.863 INFO:teuthology.orchestra.run.smithi071.stderr: 30550K .......... .......... .......... .......... .......... 32% 194M 0s 2024-09-14T11:36:39.863 INFO:teuthology.orchestra.run.smithi071.stderr: 30600K .......... .......... .......... .......... .......... 32% 203M 0s 2024-09-14T11:36:39.863 INFO:teuthology.orchestra.run.smithi071.stderr: 30650K .......... .......... .......... .......... .......... 33% 218M 0s 2024-09-14T11:36:39.863 INFO:teuthology.orchestra.run.smithi071.stderr: 30700K .......... .......... .......... .......... .......... 33% 204M 0s 2024-09-14T11:36:39.863 INFO:teuthology.orchestra.run.smithi071.stderr: 30750K .......... .......... .......... .......... .......... 33% 216M 0s 2024-09-14T11:36:39.863 INFO:teuthology.orchestra.run.smithi071.stderr: 30800K .......... .......... .......... .......... .......... 33% 218M 0s 2024-09-14T11:36:39.863 INFO:teuthology.orchestra.run.smithi071.stderr: 30850K .......... .......... .......... .......... .......... 33% 223M 0s 2024-09-14T11:36:39.863 INFO:teuthology.orchestra.run.smithi071.stderr: 30900K .......... .......... .......... .......... .......... 33% 261M 0s 2024-09-14T11:36:39.863 INFO:teuthology.orchestra.run.smithi071.stderr: 30950K .......... .......... .......... .......... .......... 33% 218M 0s 2024-09-14T11:36:39.863 INFO:teuthology.orchestra.run.smithi071.stderr: 31000K .......... .......... .......... .......... .......... 33% 258M 0s 2024-09-14T11:36:39.863 INFO:teuthology.orchestra.run.smithi071.stderr: 31050K .......... .......... .......... .......... .......... 33% 231M 0s 2024-09-14T11:36:39.863 INFO:teuthology.orchestra.run.smithi071.stderr: 31100K .......... .......... .......... .......... .......... 33% 232M 0s 2024-09-14T11:36:39.863 INFO:teuthology.orchestra.run.smithi071.stderr: 31150K .......... .......... .......... .......... .......... 33% 135M 0s 2024-09-14T11:36:39.863 INFO:teuthology.orchestra.run.smithi071.stderr: 31200K .......... .......... .......... .......... .......... 33% 339M 0s 2024-09-14T11:36:39.864 INFO:teuthology.orchestra.run.smithi071.stderr: 31250K .......... .......... .......... .......... .......... 33% 224M 0s 2024-09-14T11:36:39.864 INFO:teuthology.orchestra.run.smithi071.stderr: 31300K .......... .......... .......... .......... .......... 33% 217M 0s 2024-09-14T11:36:39.864 INFO:teuthology.orchestra.run.smithi071.stderr: 31350K .......... .......... .......... .......... .......... 33% 206M 0s 2024-09-14T11:36:39.864 INFO:teuthology.orchestra.run.smithi071.stderr: 31400K .......... .......... .......... .......... .......... 33% 320M 0s 2024-09-14T11:36:39.864 INFO:teuthology.orchestra.run.smithi071.stderr: 31450K .......... .......... .......... .......... .......... 33% 267M 0s 2024-09-14T11:36:39.864 INFO:teuthology.orchestra.run.smithi071.stderr: 31500K .......... .......... .......... .......... .......... 33% 166M 0s 2024-09-14T11:36:39.864 INFO:teuthology.orchestra.run.smithi071.stderr: 31550K .......... .......... .......... .......... .......... 34% 197M 0s 2024-09-14T11:36:39.864 INFO:teuthology.orchestra.run.smithi071.stderr: 31600K .......... .......... .......... .......... .......... 34% 235M 0s 2024-09-14T11:36:39.864 INFO:teuthology.orchestra.run.smithi071.stderr: 31650K .......... .......... .......... .......... .......... 34% 311M 0s 2024-09-14T11:36:39.864 INFO:teuthology.orchestra.run.smithi071.stderr: 31700K .......... .......... .......... .......... .......... 34% 221M 0s 2024-09-14T11:36:39.864 INFO:teuthology.orchestra.run.smithi071.stderr: 31750K .......... .......... .......... .......... .......... 34% 347M 0s 2024-09-14T11:36:39.864 INFO:teuthology.orchestra.run.smithi071.stderr: 31800K .......... .......... .......... .......... .......... 34% 334M 0s 2024-09-14T11:36:39.864 INFO:teuthology.orchestra.run.smithi071.stderr: 31850K .......... .......... .......... .......... .......... 34% 228M 0s 2024-09-14T11:36:39.864 INFO:teuthology.orchestra.run.smithi071.stderr: 31900K .......... .......... .......... .......... .......... 34% 220M 0s 2024-09-14T11:36:39.864 INFO:teuthology.orchestra.run.smithi071.stderr: 31950K .......... .......... .......... .......... .......... 34% 309M 0s 2024-09-14T11:36:39.864 INFO:teuthology.orchestra.run.smithi071.stderr: 32000K .......... .......... .......... .......... .......... 34% 345M 0s 2024-09-14T11:36:39.865 INFO:teuthology.orchestra.run.smithi071.stderr: 32050K .......... .......... .......... .......... .......... 34% 288M 0s 2024-09-14T11:36:39.865 INFO:teuthology.orchestra.run.smithi071.stderr: 32100K .......... .......... .......... .......... .......... 34% 342M 0s 2024-09-14T11:36:39.865 INFO:teuthology.orchestra.run.smithi071.stderr: 32150K .......... .......... .......... .......... .......... 34% 348M 0s 2024-09-14T11:36:39.865 INFO:teuthology.orchestra.run.smithi071.stderr: 32200K .......... .......... .......... .......... .......... 34% 281M 0s 2024-09-14T11:36:39.865 INFO:teuthology.orchestra.run.smithi071.stderr: 32250K .......... .......... .......... .......... .......... 34% 203M 0s 2024-09-14T11:36:39.865 INFO:teuthology.orchestra.run.smithi071.stderr: 32300K .......... .......... .......... .......... .......... 34% 231M 0s 2024-09-14T11:36:39.865 INFO:teuthology.orchestra.run.smithi071.stderr: 32350K .......... .......... .......... .......... .......... 34% 289M 0s 2024-09-14T11:36:39.865 INFO:teuthology.orchestra.run.smithi071.stderr: 32400K .......... .......... .......... .......... .......... 34% 221M 0s 2024-09-14T11:36:39.865 INFO:teuthology.orchestra.run.smithi071.stderr: 32450K .......... .......... .......... .......... .......... 34% 163M 0s 2024-09-14T11:36:39.865 INFO:teuthology.orchestra.run.smithi071.stderr: 32500K .......... .......... .......... .......... .......... 35% 339M 0s 2024-09-14T11:36:39.865 INFO:teuthology.orchestra.run.smithi071.stderr: 32550K .......... .......... .......... .......... .......... 35% 338M 0s 2024-09-14T11:36:39.865 INFO:teuthology.orchestra.run.smithi071.stderr: 32600K .......... .......... .......... .......... .......... 35% 355M 0s 2024-09-14T11:36:39.865 INFO:teuthology.orchestra.run.smithi071.stderr: 32650K .......... .......... .......... .......... .......... 35% 316M 0s 2024-09-14T11:36:39.865 INFO:teuthology.orchestra.run.smithi071.stderr: 32700K .......... .......... .......... .......... .......... 35% 350M 0s 2024-09-14T11:36:39.865 INFO:teuthology.orchestra.run.smithi071.stderr: 32750K .......... .......... .......... .......... .......... 35% 318M 0s 2024-09-14T11:36:39.866 INFO:teuthology.orchestra.run.smithi071.stderr: 32800K .......... .......... .......... .......... .......... 35% 339M 0s 2024-09-14T11:36:39.866 INFO:teuthology.orchestra.run.smithi071.stderr: 32850K .......... .......... .......... .......... .......... 35% 231M 0s 2024-09-14T11:36:39.866 INFO:teuthology.orchestra.run.smithi071.stderr: 32900K .......... .......... .......... .......... .......... 35% 345M 0s 2024-09-14T11:36:39.866 INFO:teuthology.orchestra.run.smithi071.stderr: 32950K .......... .......... .......... .......... .......... 35% 348M 0s 2024-09-14T11:36:39.866 INFO:teuthology.orchestra.run.smithi071.stderr: 33000K .......... .......... .......... .......... .......... 35% 335M 0s 2024-09-14T11:36:39.866 INFO:teuthology.orchestra.run.smithi071.stderr: 33050K .......... .......... .......... .......... .......... 35% 301M 0s 2024-09-14T11:36:39.866 INFO:teuthology.orchestra.run.smithi071.stderr: 33100K .......... .......... .......... .......... .......... 35% 325M 0s 2024-09-14T11:36:39.866 INFO:teuthology.orchestra.run.smithi071.stderr: 33150K .......... .......... .......... .......... .......... 35% 351M 0s 2024-09-14T11:36:39.866 INFO:teuthology.orchestra.run.smithi071.stderr: 33200K .......... .......... .......... .......... .......... 35% 343M 0s 2024-09-14T11:36:39.866 INFO:teuthology.orchestra.run.smithi071.stderr: 33250K .......... .......... .......... .......... .......... 35% 291M 0s 2024-09-14T11:36:39.866 INFO:teuthology.orchestra.run.smithi071.stderr: 33300K .......... .......... .......... .......... .......... 35% 27.5M 0s 2024-09-14T11:36:39.866 INFO:teuthology.orchestra.run.smithi071.stderr: 33350K .......... .......... .......... .......... .......... 35% 184M 0s 2024-09-14T11:36:39.866 INFO:teuthology.orchestra.run.smithi071.stderr: 33400K .......... .......... .......... .......... .......... 36% 253M 0s 2024-09-14T11:36:39.866 INFO:teuthology.orchestra.run.smithi071.stderr: 33450K .......... .......... .......... .......... .......... 36% 225M 0s 2024-09-14T11:36:39.866 INFO:teuthology.orchestra.run.smithi071.stderr: 33500K .......... .......... .......... .......... .......... 36% 293M 0s 2024-09-14T11:36:39.867 INFO:teuthology.orchestra.run.smithi071.stderr: 33550K .......... .......... .......... .......... .......... 36% 242M 0s 2024-09-14T11:36:39.867 INFO:teuthology.orchestra.run.smithi071.stderr: 33600K .......... .......... .......... .......... .......... 36% 244M 0s 2024-09-14T11:36:39.867 INFO:teuthology.orchestra.run.smithi071.stderr: 33650K .......... .......... .......... .......... .......... 36% 277M 0s 2024-09-14T11:36:39.867 INFO:teuthology.orchestra.run.smithi071.stderr: 33700K .......... .......... .......... .......... .......... 36% 325M 0s 2024-09-14T11:36:39.867 INFO:teuthology.orchestra.run.smithi071.stderr: 33750K .......... .......... .......... .......... .......... 36% 242M 0s 2024-09-14T11:36:39.867 INFO:teuthology.orchestra.run.smithi071.stderr: 33800K .......... .......... .......... .......... .......... 36% 248M 0s 2024-09-14T11:36:39.867 INFO:teuthology.orchestra.run.smithi071.stderr: 33850K .......... .......... .......... .......... .......... 36% 199M 0s 2024-09-14T11:36:39.867 INFO:teuthology.orchestra.run.smithi071.stderr: 33900K .......... .......... .......... .......... .......... 36% 236M 0s 2024-09-14T11:36:39.867 INFO:teuthology.orchestra.run.smithi071.stderr: 33950K .......... .......... .......... .......... .......... 36% 244M 0s 2024-09-14T11:36:39.867 INFO:teuthology.orchestra.run.smithi071.stderr: 34000K .......... .......... .......... .......... .......... 36% 224M 0s 2024-09-14T11:36:39.867 INFO:teuthology.orchestra.run.smithi071.stderr: 34050K .......... .......... .......... .......... .......... 36% 235M 0s 2024-09-14T11:36:39.867 INFO:teuthology.orchestra.run.smithi071.stderr: 34100K .......... .......... .......... .......... .......... 36% 250M 0s 2024-09-14T11:36:39.867 INFO:teuthology.orchestra.run.smithi071.stderr: 34150K .......... .......... .......... .......... .......... 36% 288M 0s 2024-09-14T11:36:39.867 INFO:teuthology.orchestra.run.smithi071.stderr: 34200K .......... .......... .......... .......... .......... 36% 248M 0s 2024-09-14T11:36:39.867 INFO:teuthology.orchestra.run.smithi071.stderr: 34250K .......... .......... .......... .......... .......... 36% 284M 0s 2024-09-14T11:36:39.867 INFO:teuthology.orchestra.run.smithi071.stderr: 34300K .......... .......... .......... .......... .......... 36% 284M 0s 2024-09-14T11:36:39.868 INFO:teuthology.orchestra.run.smithi071.stderr: 34350K .......... .......... .......... .......... .......... 37% 246M 0s 2024-09-14T11:36:39.868 INFO:teuthology.orchestra.run.smithi071.stderr: 34400K .......... .......... .......... .......... .......... 37% 278M 0s 2024-09-14T11:36:39.868 INFO:teuthology.orchestra.run.smithi071.stderr: 34450K .......... .......... .......... .......... .......... 37% 240M 0s 2024-09-14T11:36:39.868 INFO:teuthology.orchestra.run.smithi071.stderr: 34500K .......... .......... .......... .......... .......... 37% 315M 0s 2024-09-14T11:36:39.868 INFO:teuthology.orchestra.run.smithi071.stderr: 34550K .......... .......... .......... .......... .......... 37% 271M 0s 2024-09-14T11:36:39.868 INFO:teuthology.orchestra.run.smithi071.stderr: 34600K .......... .......... .......... .......... .......... 37% 287M 0s 2024-09-14T11:36:39.868 INFO:teuthology.orchestra.run.smithi071.stderr: 34650K .......... .......... .......... .......... .......... 37% 233M 0s 2024-09-14T11:36:39.868 INFO:teuthology.orchestra.run.smithi071.stderr: 34700K .......... .......... .......... .......... .......... 37% 319M 0s 2024-09-14T11:36:39.868 INFO:teuthology.orchestra.run.smithi071.stderr: 34750K .......... .......... .......... .......... .......... 37% 326M 0s 2024-09-14T11:36:39.868 INFO:teuthology.orchestra.run.smithi071.stderr: 34800K .......... .......... .......... .......... .......... 37% 331M 0s 2024-09-14T11:36:39.868 INFO:teuthology.orchestra.run.smithi071.stderr: 34850K .......... .......... .......... .......... .......... 37% 207M 0s 2024-09-14T11:36:39.868 INFO:teuthology.orchestra.run.smithi071.stderr: 34900K .......... .......... .......... .......... .......... 37% 253M 0s 2024-09-14T11:36:39.868 INFO:teuthology.orchestra.run.smithi071.stderr: 34950K .......... .......... .......... .......... .......... 37% 345M 0s 2024-09-14T11:36:39.868 INFO:teuthology.orchestra.run.smithi071.stderr: 35000K .......... .......... .......... .......... .......... 37% 371M 0s 2024-09-14T11:36:39.868 INFO:teuthology.orchestra.run.smithi071.stderr: 35050K .......... .......... .......... .......... .......... 37% 317M 0s 2024-09-14T11:36:39.869 INFO:teuthology.orchestra.run.smithi071.stderr: 35100K .......... .......... .......... .......... .......... 37% 364M 0s 2024-09-14T11:36:39.869 INFO:teuthology.orchestra.run.smithi071.stderr: 35150K .......... .......... .......... .......... .......... 37% 279M 0s 2024-09-14T11:36:39.869 INFO:teuthology.orchestra.run.smithi071.stderr: 35200K .......... .......... .......... .......... .......... 37% 231M 0s 2024-09-14T11:36:39.869 INFO:teuthology.orchestra.run.smithi071.stderr: 35250K .......... .......... .......... .......... .......... 37% 195M 0s 2024-09-14T11:36:39.869 INFO:teuthology.orchestra.run.smithi071.stderr: 35300K .......... .......... .......... .......... .......... 38% 277M 0s 2024-09-14T11:36:39.869 INFO:teuthology.orchestra.run.smithi071.stderr: 35350K .......... .......... .......... .......... .......... 38% 276M 0s 2024-09-14T11:36:39.869 INFO:teuthology.orchestra.run.smithi071.stderr: 35400K .......... .......... .......... .......... .......... 38% 257M 0s 2024-09-14T11:36:39.869 INFO:teuthology.orchestra.run.smithi071.stderr: 35450K .......... .......... .......... .......... .......... 38% 299M 0s 2024-09-14T11:36:39.869 INFO:teuthology.orchestra.run.smithi071.stderr: 35500K .......... .......... .......... .......... .......... 38% 295M 0s 2024-09-14T11:36:39.869 INFO:teuthology.orchestra.run.smithi071.stderr: 35550K .......... .......... .......... .......... .......... 38% 351M 0s 2024-09-14T11:36:39.869 INFO:teuthology.orchestra.run.smithi071.stderr: 35600K .......... .......... .......... .......... .......... 38% 369M 0s 2024-09-14T11:36:39.869 INFO:teuthology.orchestra.run.smithi071.stderr: 35650K .......... .......... .......... .......... .......... 38% 306M 0s 2024-09-14T11:36:39.869 INFO:teuthology.orchestra.run.smithi071.stderr: 35700K .......... .......... .......... .......... .......... 38% 346M 0s 2024-09-14T11:36:39.869 INFO:teuthology.orchestra.run.smithi071.stderr: 35750K .......... .......... .......... .......... .......... 38% 13.0M 0s 2024-09-14T11:36:39.869 INFO:teuthology.orchestra.run.smithi071.stderr: 35800K .......... .......... .......... .......... .......... 38% 215M 0s 2024-09-14T11:36:39.870 INFO:teuthology.orchestra.run.smithi071.stderr: 35850K .......... .......... .......... .......... .......... 38% 215M 0s 2024-09-14T11:36:39.870 INFO:teuthology.orchestra.run.smithi071.stderr: 35900K .......... .......... .......... .......... .......... 38% 287M 0s 2024-09-14T11:36:39.870 INFO:teuthology.orchestra.run.smithi071.stderr: 35950K .......... .......... .......... .......... .......... 38% 226M 0s 2024-09-14T11:36:39.870 INFO:teuthology.orchestra.run.smithi071.stderr: 36000K .......... .......... .......... .......... .......... 38% 257M 0s 2024-09-14T11:36:39.870 INFO:teuthology.orchestra.run.smithi071.stderr: 36050K .......... .......... .......... .......... .......... 38% 209M 0s 2024-09-14T11:36:39.870 INFO:teuthology.orchestra.run.smithi071.stderr: 36100K .......... .......... .......... .......... .......... 38% 282M 0s 2024-09-14T11:36:39.870 INFO:teuthology.orchestra.run.smithi071.stderr: 36150K .......... .......... .......... .......... .......... 38% 265M 0s 2024-09-14T11:36:39.870 INFO:teuthology.orchestra.run.smithi071.stderr: 36200K .......... .......... .......... .......... .......... 39% 300M 0s 2024-09-14T11:36:39.870 INFO:teuthology.orchestra.run.smithi071.stderr: 36250K .......... .......... .......... .......... .......... 39% 321M 0s 2024-09-14T11:36:39.870 INFO:teuthology.orchestra.run.smithi071.stderr: 36300K .......... .......... .......... .......... .......... 39% 311M 0s 2024-09-14T11:36:39.870 INFO:teuthology.orchestra.run.smithi071.stderr: 36350K .......... .......... .......... .......... .......... 39% 264M 0s 2024-09-14T11:36:39.870 INFO:teuthology.orchestra.run.smithi071.stderr: 36400K .......... .......... .......... .......... .......... 39% 302M 0s 2024-09-14T11:36:39.870 INFO:teuthology.orchestra.run.smithi071.stderr: 36450K .......... .......... .......... .......... .......... 39% 254M 0s 2024-09-14T11:36:39.870 INFO:teuthology.orchestra.run.smithi071.stderr: 36500K .......... .......... .......... .......... .......... 39% 227M 0s 2024-09-14T11:36:39.870 INFO:teuthology.orchestra.run.smithi071.stderr: 36550K .......... .......... .......... .......... .......... 39% 362M 0s 2024-09-14T11:36:39.870 INFO:teuthology.orchestra.run.smithi071.stderr: 36600K .......... .......... .......... .......... .......... 39% 254M 0s 2024-09-14T11:36:39.871 INFO:teuthology.orchestra.run.smithi071.stderr: 36650K .......... .......... .......... .......... .......... 39% 231M 0s 2024-09-14T11:36:39.871 INFO:teuthology.orchestra.run.smithi071.stderr: 36700K .......... .......... .......... .......... .......... 39% 281M 0s 2024-09-14T11:36:39.871 INFO:teuthology.orchestra.run.smithi071.stderr: 36750K .......... .......... .......... .......... .......... 39% 229M 0s 2024-09-14T11:36:39.871 INFO:teuthology.orchestra.run.smithi071.stderr: 36800K .......... .......... .......... .......... .......... 39% 234M 0s 2024-09-14T11:36:39.871 INFO:teuthology.orchestra.run.smithi071.stderr: 36850K .......... .......... .......... .......... .......... 39% 242M 0s 2024-09-14T11:36:39.871 INFO:teuthology.orchestra.run.smithi071.stderr: 36900K .......... .......... .......... .......... .......... 39% 314M 0s 2024-09-14T11:36:39.871 INFO:teuthology.orchestra.run.smithi071.stderr: 36950K .......... .......... .......... .......... .......... 39% 233M 0s 2024-09-14T11:36:39.871 INFO:teuthology.orchestra.run.smithi071.stderr: 37000K .......... .......... .......... .......... .......... 39% 249M 0s 2024-09-14T11:36:39.871 INFO:teuthology.orchestra.run.smithi071.stderr: 37050K .......... .......... .......... .......... .......... 39% 283M 0s 2024-09-14T11:36:39.871 INFO:teuthology.orchestra.run.smithi071.stderr: 37100K .......... .......... .......... .......... .......... 39% 305M 0s 2024-09-14T11:36:39.871 INFO:teuthology.orchestra.run.smithi071.stderr: 37150K .......... .......... .......... .......... .......... 40% 319M 0s 2024-09-14T11:36:39.871 INFO:teuthology.orchestra.run.smithi071.stderr: 37200K .......... .......... .......... .......... .......... 40% 371M 0s 2024-09-14T11:36:39.871 INFO:teuthology.orchestra.run.smithi071.stderr: 37250K .......... .......... .......... .......... .......... 40% 223M 0s 2024-09-14T11:36:39.871 INFO:teuthology.orchestra.run.smithi071.stderr: 37300K .......... .......... .......... .......... .......... 40% 275M 0s 2024-09-14T11:36:39.871 INFO:teuthology.orchestra.run.smithi071.stderr: 37350K .......... .......... .......... .......... .......... 40% 266M 0s 2024-09-14T11:36:39.872 INFO:teuthology.orchestra.run.smithi071.stderr: 37400K .......... .......... .......... .......... .......... 40% 355M 0s 2024-09-14T11:36:39.872 INFO:teuthology.orchestra.run.smithi071.stderr: 37450K .......... .......... .......... .......... .......... 40% 332M 0s 2024-09-14T11:36:39.872 INFO:teuthology.orchestra.run.smithi071.stderr: 37500K .......... .......... .......... .......... .......... 40% 370M 0s 2024-09-14T11:36:39.872 INFO:teuthology.orchestra.run.smithi071.stderr: 37550K .......... .......... .......... .......... .......... 40% 364M 0s 2024-09-14T11:36:39.872 INFO:teuthology.orchestra.run.smithi071.stderr: 37600K .......... .......... .......... .......... .......... 40% 330M 0s 2024-09-14T11:36:39.872 INFO:teuthology.orchestra.run.smithi071.stderr: 37650K .......... .......... .......... .......... .......... 40% 200M 0s 2024-09-14T11:36:39.872 INFO:teuthology.orchestra.run.smithi071.stderr: 37700K .......... .......... .......... .......... .......... 40% 255M 0s 2024-09-14T11:36:39.872 INFO:teuthology.orchestra.run.smithi071.stderr: 37750K .......... .......... .......... .......... .......... 40% 310M 0s 2024-09-14T11:36:39.872 INFO:teuthology.orchestra.run.smithi071.stderr: 37800K .......... .......... .......... .......... .......... 40% 228M 0s 2024-09-14T11:36:39.872 INFO:teuthology.orchestra.run.smithi071.stderr: 37850K .......... .......... .......... .......... .......... 40% 322M 0s 2024-09-14T11:36:39.872 INFO:teuthology.orchestra.run.smithi071.stderr: 37900K .......... .......... .......... .......... .......... 40% 249M 0s 2024-09-14T11:36:39.872 INFO:teuthology.orchestra.run.smithi071.stderr: 37950K .......... .......... .......... .......... .......... 40% 282M 0s 2024-09-14T11:36:39.872 INFO:teuthology.orchestra.run.smithi071.stderr: 38000K .......... .......... .......... .......... .......... 40% 378M 0s 2024-09-14T11:36:39.872 INFO:teuthology.orchestra.run.smithi071.stderr: 38050K .......... .......... .......... .......... .......... 41% 307M 0s 2024-09-14T11:36:39.872 INFO:teuthology.orchestra.run.smithi071.stderr: 38100K .......... .......... .......... .......... .......... 41% 375M 0s 2024-09-14T11:36:39.873 INFO:teuthology.orchestra.run.smithi071.stderr: 38150K .......... .......... .......... .......... .......... 41% 370M 0s 2024-09-14T11:36:39.873 INFO:teuthology.orchestra.run.smithi071.stderr: 38200K .......... .......... .......... .......... .......... 41% 372M 0s 2024-09-14T11:36:39.873 INFO:teuthology.orchestra.run.smithi071.stderr: 38250K .......... .......... .......... .......... .......... 41% 339M 0s 2024-09-14T11:36:39.873 INFO:teuthology.orchestra.run.smithi071.stderr: 38300K .......... .......... .......... .......... .......... 41% 375M 0s 2024-09-14T11:36:39.873 INFO:teuthology.orchestra.run.smithi071.stderr: 38350K .......... .......... .......... .......... .......... 41% 353M 0s 2024-09-14T11:36:39.873 INFO:teuthology.orchestra.run.smithi071.stderr: 38400K .......... .......... .......... .......... .......... 41% 376M 0s 2024-09-14T11:36:39.873 INFO:teuthology.orchestra.run.smithi071.stderr: 38450K .......... .......... .......... .......... .......... 41% 313M 0s 2024-09-14T11:36:39.873 INFO:teuthology.orchestra.run.smithi071.stderr: 38500K .......... .......... .......... .......... .......... 41% 372M 0s 2024-09-14T11:36:39.873 INFO:teuthology.orchestra.run.smithi071.stderr: 38550K .......... .......... .......... .......... .......... 41% 375M 0s 2024-09-14T11:36:39.873 INFO:teuthology.orchestra.run.smithi071.stderr: 38600K .......... .......... .......... .......... .......... 41% 19.0M 0s 2024-09-14T11:36:39.873 INFO:teuthology.orchestra.run.smithi071.stderr: 38650K .......... .......... .......... .......... .......... 41% 200M 0s 2024-09-14T11:36:39.873 INFO:teuthology.orchestra.run.smithi071.stderr: 38700K .......... .......... .......... .......... .......... 41% 298M 0s 2024-09-14T11:36:39.873 INFO:teuthology.orchestra.run.smithi071.stderr: 38750K .......... .......... .......... .......... .......... 41% 299M 0s 2024-09-14T11:36:39.873 INFO:teuthology.orchestra.run.smithi071.stderr: 38800K .......... .......... .......... .......... .......... 41% 248M 0s 2024-09-14T11:36:39.874 INFO:teuthology.orchestra.run.smithi071.stderr: 38850K .......... .......... .......... .......... .......... 41% 302M 0s 2024-09-14T11:36:39.874 INFO:teuthology.orchestra.run.smithi071.stderr: 38900K .......... .......... .......... .......... .......... 41% 308M 0s 2024-09-14T11:36:39.874 INFO:teuthology.orchestra.run.smithi071.stderr: 38950K .......... .......... .......... .......... .......... 41% 230M 0s 2024-09-14T11:36:39.874 INFO:teuthology.orchestra.run.smithi071.stderr: 39000K .......... .......... .......... .......... .......... 42% 259M 0s 2024-09-14T11:36:39.874 INFO:teuthology.orchestra.run.smithi071.stderr: 39050K .......... .......... .......... .......... .......... 42% 211M 0s 2024-09-14T11:36:39.874 INFO:teuthology.orchestra.run.smithi071.stderr: 39100K .......... .......... .......... .......... .......... 42% 264M 0s 2024-09-14T11:36:39.874 INFO:teuthology.orchestra.run.smithi071.stderr: 39150K .......... .......... .......... .......... .......... 42% 321M 0s 2024-09-14T11:36:39.874 INFO:teuthology.orchestra.run.smithi071.stderr: 39200K .......... .......... .......... .......... .......... 42% 342M 0s 2024-09-14T11:36:39.874 INFO:teuthology.orchestra.run.smithi071.stderr: 39250K .......... .......... .......... .......... .......... 42% 215M 0s 2024-09-14T11:36:39.874 INFO:teuthology.orchestra.run.smithi071.stderr: 39300K .......... .......... .......... .......... .......... 42% 327M 0s 2024-09-14T11:36:39.874 INFO:teuthology.orchestra.run.smithi071.stderr: 39350K .......... .......... .......... .......... .......... 42% 270M 0s 2024-09-14T11:36:39.874 INFO:teuthology.orchestra.run.smithi071.stderr: 39400K .......... .......... .......... .......... .......... 42% 220M 0s 2024-09-14T11:36:39.874 INFO:teuthology.orchestra.run.smithi071.stderr: 39450K .......... .......... .......... .......... .......... 42% 285M 0s 2024-09-14T11:36:39.874 INFO:teuthology.orchestra.run.smithi071.stderr: 39500K .......... .......... .......... .......... .......... 42% 374M 0s 2024-09-14T11:36:39.874 INFO:teuthology.orchestra.run.smithi071.stderr: 39550K .......... .......... .......... .......... .......... 42% 250M 0s 2024-09-14T11:36:39.874 INFO:teuthology.orchestra.run.smithi071.stderr: 39600K .......... .......... .......... .......... .......... 42% 264M 0s 2024-09-14T11:36:39.875 INFO:teuthology.orchestra.run.smithi071.stderr: 39650K .......... .......... .......... .......... .......... 42% 289M 0s 2024-09-14T11:36:39.875 INFO:teuthology.orchestra.run.smithi071.stderr: 39700K .......... .......... .......... .......... .......... 42% 286M 0s 2024-09-14T11:36:39.875 INFO:teuthology.orchestra.run.smithi071.stderr: 39750K .......... .......... .......... .......... .......... 42% 292M 0s 2024-09-14T11:36:39.875 INFO:teuthology.orchestra.run.smithi071.stderr: 39800K .......... .......... .......... .......... .......... 42% 276M 0s 2024-09-14T11:36:39.875 INFO:teuthology.orchestra.run.smithi071.stderr: 39850K .......... .......... .......... .......... .......... 42% 248M 0s 2024-09-14T11:36:39.875 INFO:teuthology.orchestra.run.smithi071.stderr: 39900K .......... .......... .......... .......... .......... 43% 248M 0s 2024-09-14T11:36:39.875 INFO:teuthology.orchestra.run.smithi071.stderr: 39950K .......... .......... .......... .......... .......... 43% 281M 0s 2024-09-14T11:36:39.875 INFO:teuthology.orchestra.run.smithi071.stderr: 40000K .......... .......... .......... .......... .......... 43% 352M 0s 2024-09-14T11:36:39.875 INFO:teuthology.orchestra.run.smithi071.stderr: 40050K .......... .......... .......... .......... .......... 43% 221M 0s 2024-09-14T11:36:39.875 INFO:teuthology.orchestra.run.smithi071.stderr: 40100K .......... .......... .......... .......... .......... 43% 277M 0s 2024-09-14T11:36:39.875 INFO:teuthology.orchestra.run.smithi071.stderr: 40150K .......... .......... .......... .......... .......... 43% 217M 0s 2024-09-14T11:36:39.875 INFO:teuthology.orchestra.run.smithi071.stderr: 40200K .......... .......... .......... .......... .......... 43% 277M 0s 2024-09-14T11:36:39.875 INFO:teuthology.orchestra.run.smithi071.stderr: 40250K .......... .......... .......... .......... .......... 43% 235M 0s 2024-09-14T11:36:39.875 INFO:teuthology.orchestra.run.smithi071.stderr: 40300K .......... .......... .......... .......... .......... 43% 372M 0s 2024-09-14T11:36:39.876 INFO:teuthology.orchestra.run.smithi071.stderr: 40350K .......... .......... .......... .......... .......... 43% 358M 0s 2024-09-14T11:36:39.876 INFO:teuthology.orchestra.run.smithi071.stderr: 40400K .......... .......... .......... .......... .......... 43% 375M 0s 2024-09-14T11:36:39.876 INFO:teuthology.orchestra.run.smithi071.stderr: 40450K .......... .......... .......... .......... .......... 43% 289M 0s 2024-09-14T11:36:39.876 INFO:teuthology.orchestra.run.smithi071.stderr: 40500K .......... .......... .......... .......... .......... 43% 261M 0s 2024-09-14T11:36:39.876 INFO:teuthology.orchestra.run.smithi071.stderr: 40550K .......... .......... .......... .......... .......... 43% 202M 0s 2024-09-14T11:36:39.876 INFO:teuthology.orchestra.run.smithi071.stderr: 40600K .......... .......... .......... .......... .......... 43% 265M 0s 2024-09-14T11:36:39.876 INFO:teuthology.orchestra.run.smithi071.stderr: 40650K .......... .......... .......... .......... .......... 43% 258M 0s 2024-09-14T11:36:39.876 INFO:teuthology.orchestra.run.smithi071.stderr: 40700K .......... .......... .......... .......... .......... 43% 280M 0s 2024-09-14T11:36:39.876 INFO:teuthology.orchestra.run.smithi071.stderr: 40750K .......... .......... .......... .......... .......... 43% 364M 0s 2024-09-14T11:36:39.876 INFO:teuthology.orchestra.run.smithi071.stderr: 40800K .......... .......... .......... .......... .......... 43% 300M 0s 2024-09-14T11:36:39.876 INFO:teuthology.orchestra.run.smithi071.stderr: 40850K .......... .......... .......... .......... .......... 44% 225M 0s 2024-09-14T11:36:39.876 INFO:teuthology.orchestra.run.smithi071.stderr: 40900K .......... .......... .......... .......... .......... 44% 367M 0s 2024-09-14T11:36:39.876 INFO:teuthology.orchestra.run.smithi071.stderr: 40950K .......... .......... .......... .......... .......... 44% 376M 0s 2024-09-14T11:36:39.876 INFO:teuthology.orchestra.run.smithi071.stderr: 41000K .......... .......... .......... .......... .......... 44% 370M 0s 2024-09-14T11:36:39.877 INFO:teuthology.orchestra.run.smithi071.stderr: 41050K .......... .......... .......... .......... .......... 44% 295M 0s 2024-09-14T11:36:39.877 INFO:teuthology.orchestra.run.smithi071.stderr: 41100K .......... .......... .......... .......... .......... 44% 341M 0s 2024-09-14T11:36:39.877 INFO:teuthology.orchestra.run.smithi071.stderr: 41150K .......... .......... .......... .......... .......... 44% 13.5M 0s 2024-09-14T11:36:39.877 INFO:teuthology.orchestra.run.smithi071.stderr: 41200K .......... .......... .......... .......... .......... 44% 309M 0s 2024-09-14T11:36:39.877 INFO:teuthology.orchestra.run.smithi071.stderr: 41250K .......... .......... .......... .......... .......... 44% 198M 0s 2024-09-14T11:36:39.877 INFO:teuthology.orchestra.run.smithi071.stderr: 41300K .......... .......... .......... .......... .......... 44% 238M 0s 2024-09-14T11:36:39.877 INFO:teuthology.orchestra.run.smithi071.stderr: 41350K .......... .......... .......... .......... .......... 44% 258M 0s 2024-09-14T11:36:39.877 INFO:teuthology.orchestra.run.smithi071.stderr: 41400K .......... .......... .......... .......... .......... 44% 328M 0s 2024-09-14T11:36:39.877 INFO:teuthology.orchestra.run.smithi071.stderr: 41450K .......... .......... .......... .......... .......... 44% 191M 0s 2024-09-14T11:36:39.877 INFO:teuthology.orchestra.run.smithi071.stderr: 41500K .......... .......... .......... .......... .......... 44% 269M 0s 2024-09-14T11:36:39.877 INFO:teuthology.orchestra.run.smithi071.stderr: 41550K .......... .......... .......... .......... .......... 44% 351M 0s 2024-09-14T11:36:39.877 INFO:teuthology.orchestra.run.smithi071.stderr: 41600K .......... .......... .......... .......... .......... 44% 286M 0s 2024-09-14T11:36:39.877 INFO:teuthology.orchestra.run.smithi071.stderr: 41650K .......... .......... .......... .......... .......... 44% 248M 0s 2024-09-14T11:36:39.877 INFO:teuthology.orchestra.run.smithi071.stderr: 41700K .......... .......... .......... .......... .......... 44% 375M 0s 2024-09-14T11:36:39.877 INFO:teuthology.orchestra.run.smithi071.stderr: 41750K .......... .......... .......... .......... .......... 44% 364M 0s 2024-09-14T11:36:39.877 INFO:teuthology.orchestra.run.smithi071.stderr: 41800K .......... .......... .......... .......... .......... 45% 319M 0s 2024-09-14T11:36:39.878 INFO:teuthology.orchestra.run.smithi071.stderr: 41850K .......... .......... .......... .......... .......... 45% 207M 0s 2024-09-14T11:36:39.878 INFO:teuthology.orchestra.run.smithi071.stderr: 41900K .......... .......... .......... .......... .......... 45% 249M 0s 2024-09-14T11:36:39.878 INFO:teuthology.orchestra.run.smithi071.stderr: 41950K .......... .......... .......... .......... .......... 45% 345M 0s 2024-09-14T11:36:39.878 INFO:teuthology.orchestra.run.smithi071.stderr: 42000K .......... .......... .......... .......... .......... 45% 385M 0s 2024-09-14T11:36:39.878 INFO:teuthology.orchestra.run.smithi071.stderr: 42050K .......... .......... .......... .......... .......... 45% 242M 0s 2024-09-14T11:36:39.878 INFO:teuthology.orchestra.run.smithi071.stderr: 42100K .......... .......... .......... .......... .......... 45% 235M 0s 2024-09-14T11:36:39.878 INFO:teuthology.orchestra.run.smithi071.stderr: 42150K .......... .......... .......... .......... .......... 45% 268M 0s 2024-09-14T11:36:39.878 INFO:teuthology.orchestra.run.smithi071.stderr: 42200K .......... .......... .......... .......... .......... 45% 311M 0s 2024-09-14T11:36:39.878 INFO:teuthology.orchestra.run.smithi071.stderr: 42250K .......... .......... .......... .......... .......... 45% 364M 0s 2024-09-14T11:36:39.878 INFO:teuthology.orchestra.run.smithi071.stderr: 42300K .......... .......... .......... .......... .......... 45% 270M 0s 2024-09-14T11:36:39.878 INFO:teuthology.orchestra.run.smithi071.stderr: 42350K .......... .......... .......... .......... .......... 45% 259M 0s 2024-09-14T11:36:39.878 INFO:teuthology.orchestra.run.smithi071.stderr: 42400K .......... .......... .......... .......... .......... 45% 359M 0s 2024-09-14T11:36:39.878 INFO:teuthology.orchestra.run.smithi071.stderr: 42450K .......... .......... .......... .......... .......... 45% 305M 0s 2024-09-14T11:36:39.878 INFO:teuthology.orchestra.run.smithi071.stderr: 42500K .......... .......... .......... .......... .......... 45% 227M 0s 2024-09-14T11:36:39.878 INFO:teuthology.orchestra.run.smithi071.stderr: 42550K .......... .......... .......... .......... .......... 45% 224M 0s 2024-09-14T11:36:39.879 INFO:teuthology.orchestra.run.smithi071.stderr: 42600K .......... .......... .......... .......... .......... 45% 326M 0s 2024-09-14T11:36:39.879 INFO:teuthology.orchestra.run.smithi071.stderr: 42650K .......... .......... .......... .......... .......... 45% 376M 0s 2024-09-14T11:36:39.879 INFO:teuthology.orchestra.run.smithi071.stderr: 42700K .......... .......... .......... .......... .......... 46% 229M 0s 2024-09-14T11:36:39.879 INFO:teuthology.orchestra.run.smithi071.stderr: 42750K .......... .......... .......... .......... .......... 46% 280M 0s 2024-09-14T11:36:39.879 INFO:teuthology.orchestra.run.smithi071.stderr: 42800K .......... .......... .......... .......... .......... 46% 269M 0s 2024-09-14T11:36:39.879 INFO:teuthology.orchestra.run.smithi071.stderr: 42850K .......... .......... .......... .......... .......... 46% 338M 0s 2024-09-14T11:36:39.879 INFO:teuthology.orchestra.run.smithi071.stderr: 42900K .......... .......... .......... .......... .......... 46% 318M 0s 2024-09-14T11:36:39.879 INFO:teuthology.orchestra.run.smithi071.stderr: 42950K .......... .......... .......... .......... .......... 46% 381M 0s 2024-09-14T11:36:39.879 INFO:teuthology.orchestra.run.smithi071.stderr: 43000K .......... .......... .......... .......... .......... 46% 357M 0s 2024-09-14T11:36:39.879 INFO:teuthology.orchestra.run.smithi071.stderr: 43050K .......... .......... .......... .......... .......... 46% 303M 0s 2024-09-14T11:36:39.879 INFO:teuthology.orchestra.run.smithi071.stderr: 43100K .......... .......... .......... .......... .......... 46% 206M 0s 2024-09-14T11:36:39.879 INFO:teuthology.orchestra.run.smithi071.stderr: 43150K .......... .......... .......... .......... .......... 46% 242M 0s 2024-09-14T11:36:39.879 INFO:teuthology.orchestra.run.smithi071.stderr: 43200K .......... .......... .......... .......... .......... 46% 280M 0s 2024-09-14T11:36:39.879 INFO:teuthology.orchestra.run.smithi071.stderr: 43250K .......... .......... .......... .......... .......... 46% 367M 0s 2024-09-14T11:36:39.879 INFO:teuthology.orchestra.run.smithi071.stderr: 43300K .......... .......... .......... .......... .......... 46% 239M 0s 2024-09-14T11:36:39.879 INFO:teuthology.orchestra.run.smithi071.stderr: 43350K .......... .......... .......... .......... .......... 46% 280M 0s 2024-09-14T11:36:39.880 INFO:teuthology.orchestra.run.smithi071.stderr: 43400K .......... .......... .......... .......... .......... 46% 378M 0s 2024-09-14T11:36:39.880 INFO:teuthology.orchestra.run.smithi071.stderr: 43450K .......... .......... .......... .......... .......... 46% 257M 0s 2024-09-14T11:36:39.880 INFO:teuthology.orchestra.run.smithi071.stderr: 43500K .......... .......... .......... .......... .......... 46% 324M 0s 2024-09-14T11:36:39.880 INFO:teuthology.orchestra.run.smithi071.stderr: 43550K .......... .......... .......... .......... .......... 46% 381M 0s 2024-09-14T11:36:39.880 INFO:teuthology.orchestra.run.smithi071.stderr: 43600K .......... .......... .......... .......... .......... 46% 375M 0s 2024-09-14T11:36:39.880 INFO:teuthology.orchestra.run.smithi071.stderr: 43650K .......... .......... .......... .......... .......... 47% 373M 0s 2024-09-14T11:36:39.880 INFO:teuthology.orchestra.run.smithi071.stderr: 43700K .......... .......... .......... .......... .......... 47% 321M 0s 2024-09-14T11:36:39.880 INFO:teuthology.orchestra.run.smithi071.stderr: 43750K .......... .......... .......... .......... .......... 47% 386M 0s 2024-09-14T11:36:39.880 INFO:teuthology.orchestra.run.smithi071.stderr: 43800K .......... .......... .......... .......... .......... 47% 380M 0s 2024-09-14T11:36:39.880 INFO:teuthology.orchestra.run.smithi071.stderr: 43850K .......... .......... .......... .......... .......... 47% 356M 0s 2024-09-14T11:36:39.880 INFO:teuthology.orchestra.run.smithi071.stderr: 43900K .......... .......... .......... .......... .......... 47% 340M 0s 2024-09-14T11:36:39.880 INFO:teuthology.orchestra.run.smithi071.stderr: 43950K .......... .......... .......... .......... .......... 47% 16.0M 0s 2024-09-14T11:36:39.880 INFO:teuthology.orchestra.run.smithi071.stderr: 44000K .......... .......... .......... .......... .......... 47% 216M 0s 2024-09-14T11:36:39.880 INFO:teuthology.orchestra.run.smithi071.stderr: 44050K .......... .......... .......... .......... .......... 47% 282M 0s 2024-09-14T11:36:39.880 INFO:teuthology.orchestra.run.smithi071.stderr: 44100K .......... .......... .......... .......... .......... 47% 299M 0s 2024-09-14T11:36:39.881 INFO:teuthology.orchestra.run.smithi071.stderr: 44150K .......... .......... .......... .......... .......... 47% 265M 0s 2024-09-14T11:36:39.881 INFO:teuthology.orchestra.run.smithi071.stderr: 44200K .......... .......... .......... .......... .......... 47% 267M 0s 2024-09-14T11:36:39.881 INFO:teuthology.orchestra.run.smithi071.stderr: 44250K .......... .......... .......... .......... .......... 47% 254M 0s 2024-09-14T11:36:39.881 INFO:teuthology.orchestra.run.smithi071.stderr: 44300K .......... .......... .......... .......... .......... 47% 182M 0s 2024-09-14T11:36:39.881 INFO:teuthology.orchestra.run.smithi071.stderr: 44350K .......... .......... .......... .......... .......... 47% 215M 0s 2024-09-14T11:36:39.881 INFO:teuthology.orchestra.run.smithi071.stderr: 44400K .......... .......... .......... .......... .......... 47% 250M 0s 2024-09-14T11:36:39.881 INFO:teuthology.orchestra.run.smithi071.stderr: 44450K .......... .......... .......... .......... .......... 47% 361M 0s 2024-09-14T11:36:39.881 INFO:teuthology.orchestra.run.smithi071.stderr: 44500K .......... .......... .......... .......... .......... 47% 320M 0s 2024-09-14T11:36:39.881 INFO:teuthology.orchestra.run.smithi071.stderr: 44550K .......... .......... .......... .......... .......... 48% 304M 0s 2024-09-14T11:36:39.881 INFO:teuthology.orchestra.run.smithi071.stderr: 44600K .......... .......... .......... .......... .......... 48% 244M 0s 2024-09-14T11:36:39.881 INFO:teuthology.orchestra.run.smithi071.stderr: 44650K .......... .......... .......... .......... .......... 48% 267M 0s 2024-09-14T11:36:39.881 INFO:teuthology.orchestra.run.smithi071.stderr: 44700K .......... .......... .......... .......... .......... 48% 277M 0s 2024-09-14T11:36:39.881 INFO:teuthology.orchestra.run.smithi071.stderr: 44750K .......... .......... .......... .......... .......... 48% 280M 0s 2024-09-14T11:36:39.881 INFO:teuthology.orchestra.run.smithi071.stderr: 44800K .......... .......... .......... .......... .......... 48% 264M 0s 2024-09-14T11:36:39.881 INFO:teuthology.orchestra.run.smithi071.stderr: 44850K .......... .......... .......... .......... .......... 48% 268M 0s 2024-09-14T11:36:39.882 INFO:teuthology.orchestra.run.smithi071.stderr: 44900K .......... .......... .......... .......... .......... 48% 303M 0s 2024-09-14T11:36:39.882 INFO:teuthology.orchestra.run.smithi071.stderr: 44950K .......... .......... .......... .......... .......... 48% 243M 0s 2024-09-14T11:36:39.882 INFO:teuthology.orchestra.run.smithi071.stderr: 45000K .......... .......... .......... .......... .......... 48% 260M 0s 2024-09-14T11:36:39.882 INFO:teuthology.orchestra.run.smithi071.stderr: 45050K .......... .......... .......... .......... .......... 48% 354M 0s 2024-09-14T11:36:39.882 INFO:teuthology.orchestra.run.smithi071.stderr: 45100K .......... .......... .......... .......... .......... 48% 293M 0s 2024-09-14T11:36:39.882 INFO:teuthology.orchestra.run.smithi071.stderr: 45150K .......... .......... .......... .......... .......... 48% 214M 0s 2024-09-14T11:36:39.882 INFO:teuthology.orchestra.run.smithi071.stderr: 45200K .......... .......... .......... .......... .......... 48% 301M 0s 2024-09-14T11:36:39.882 INFO:teuthology.orchestra.run.smithi071.stderr: 45250K .......... .......... .......... .......... .......... 48% 317M 0s 2024-09-14T11:36:39.882 INFO:teuthology.orchestra.run.smithi071.stderr: 45300K .......... .......... .......... .......... .......... 48% 339M 0s 2024-09-14T11:36:39.882 INFO:teuthology.orchestra.run.smithi071.stderr: 45350K .......... .......... .......... .......... .......... 48% 296M 0s 2024-09-14T11:36:39.882 INFO:teuthology.orchestra.run.smithi071.stderr: 45400K .......... .......... .......... .......... .......... 48% 295M 0s 2024-09-14T11:36:39.882 INFO:teuthology.orchestra.run.smithi071.stderr: 45450K .......... .......... .......... .......... .......... 48% 239M 0s 2024-09-14T11:36:39.882 INFO:teuthology.orchestra.run.smithi071.stderr: 45500K .......... .......... .......... .......... .......... 49% 228M 0s 2024-09-14T11:36:39.882 INFO:teuthology.orchestra.run.smithi071.stderr: 45550K .......... .......... .......... .......... .......... 49% 267M 0s 2024-09-14T11:36:39.882 INFO:teuthology.orchestra.run.smithi071.stderr: 45600K .......... .......... .......... .......... .......... 49% 378M 0s 2024-09-14T11:36:39.882 INFO:teuthology.orchestra.run.smithi071.stderr: 45650K .......... .......... .......... .......... .......... 49% 357M 0s 2024-09-14T11:36:39.883 INFO:teuthology.orchestra.run.smithi071.stderr: 45700K .......... .......... .......... .......... .......... 49% 336M 0s 2024-09-14T11:36:39.883 INFO:teuthology.orchestra.run.smithi071.stderr: 45750K .......... .......... .......... .......... .......... 49% 311M 0s 2024-09-14T11:36:39.883 INFO:teuthology.orchestra.run.smithi071.stderr: 45800K .......... .......... .......... .......... .......... 49% 219M 0s 2024-09-14T11:36:39.883 INFO:teuthology.orchestra.run.smithi071.stderr: 45850K .......... .......... .......... .......... .......... 49% 282M 0s 2024-09-14T11:36:39.883 INFO:teuthology.orchestra.run.smithi071.stderr: 45900K .......... .......... .......... .......... .......... 49% 195M 0s 2024-09-14T11:36:39.883 INFO:teuthology.orchestra.run.smithi071.stderr: 45950K .......... .......... .......... .......... .......... 49% 275M 0s 2024-09-14T11:36:39.883 INFO:teuthology.orchestra.run.smithi071.stderr: 46000K .......... .......... .......... .......... .......... 49% 342M 0s 2024-09-14T11:36:39.883 INFO:teuthology.orchestra.run.smithi071.stderr: 46050K .......... .......... .......... .......... .......... 49% 315M 0s 2024-09-14T11:36:39.883 INFO:teuthology.orchestra.run.smithi071.stderr: 46100K .......... .......... .......... .......... .......... 49% 249M 0s 2024-09-14T11:36:39.883 INFO:teuthology.orchestra.run.smithi071.stderr: 46150K .......... .......... .......... .......... .......... 49% 235M 0s 2024-09-14T11:36:39.883 INFO:teuthology.orchestra.run.smithi071.stderr: 46200K .......... .......... .......... .......... .......... 49% 371M 0s 2024-09-14T11:36:39.883 INFO:teuthology.orchestra.run.smithi071.stderr: 46250K .......... .......... .......... .......... .......... 49% 339M 0s 2024-09-14T11:36:39.883 INFO:teuthology.orchestra.run.smithi071.stderr: 46300K .......... .......... .......... .......... .......... 49% 379M 0s 2024-09-14T11:36:39.884 INFO:teuthology.orchestra.run.smithi071.stderr: 46350K .......... .......... .......... .......... .......... 49% 381M 0s 2024-09-14T11:36:39.884 INFO:teuthology.orchestra.run.smithi071.stderr: 46400K .......... .......... .......... .......... .......... 49% 335M 0s 2024-09-14T11:36:39.884 INFO:teuthology.orchestra.run.smithi071.stderr: 46450K .......... .......... .......... .......... .......... 50% 380M 0s 2024-09-14T11:36:39.884 INFO:teuthology.orchestra.run.smithi071.stderr: 46500K .......... .......... .......... .......... .......... 50% 383M 0s 2024-09-14T11:36:39.884 INFO:teuthology.orchestra.run.smithi071.stderr: 46550K .......... .......... .......... .......... .......... 50% 381M 0s 2024-09-14T11:36:39.884 INFO:teuthology.orchestra.run.smithi071.stderr: 46600K .......... .......... .......... .......... .......... 50% 14.9M 0s 2024-09-14T11:36:39.884 INFO:teuthology.orchestra.run.smithi071.stderr: 46650K .......... .......... .......... .......... .......... 50% 219M 0s 2024-09-14T11:36:39.884 INFO:teuthology.orchestra.run.smithi071.stderr: 46700K .......... .......... .......... .......... .......... 50% 253M 0s 2024-09-14T11:36:39.884 INFO:teuthology.orchestra.run.smithi071.stderr: 46750K .......... .......... .......... .......... .......... 50% 210M 0s 2024-09-14T11:36:39.884 INFO:teuthology.orchestra.run.smithi071.stderr: 46800K .......... .......... .......... .......... .......... 50% 250M 0s 2024-09-14T11:36:39.884 INFO:teuthology.orchestra.run.smithi071.stderr: 46850K .......... .......... .......... .......... .......... 50% 311M 0s 2024-09-14T11:36:39.884 INFO:teuthology.orchestra.run.smithi071.stderr: 46900K .......... .......... .......... .......... .......... 50% 295M 0s 2024-09-14T11:36:39.884 INFO:teuthology.orchestra.run.smithi071.stderr: 46950K .......... .......... .......... .......... .......... 50% 346M 0s 2024-09-14T11:36:39.884 INFO:teuthology.orchestra.run.smithi071.stderr: 47000K .......... .......... .......... .......... .......... 50% 305M 0s 2024-09-14T11:36:39.884 INFO:teuthology.orchestra.run.smithi071.stderr: 47050K .......... .......... .......... .......... .......... 50% 385M 0s 2024-09-14T11:36:39.884 INFO:teuthology.orchestra.run.smithi071.stderr: 47100K .......... .......... .......... .......... .......... 50% 373M 0s 2024-09-14T11:36:39.885 INFO:teuthology.orchestra.run.smithi071.stderr: 47150K .......... .......... .......... .......... .......... 50% 283M 0s 2024-09-14T11:36:39.885 INFO:teuthology.orchestra.run.smithi071.stderr: 47200K .......... .......... .......... .......... .......... 50% 217M 0s 2024-09-14T11:36:39.885 INFO:teuthology.orchestra.run.smithi071.stderr: 47250K .......... .......... .......... .......... .......... 50% 288M 0s 2024-09-14T11:36:39.885 INFO:teuthology.orchestra.run.smithi071.stderr: 47300K .......... .......... .......... .......... .......... 50% 246M 0s 2024-09-14T11:36:39.885 INFO:teuthology.orchestra.run.smithi071.stderr: 47350K .......... .......... .......... .......... .......... 51% 298M 0s 2024-09-14T11:36:39.885 INFO:teuthology.orchestra.run.smithi071.stderr: 47400K .......... .......... .......... .......... .......... 51% 218M 0s 2024-09-14T11:36:39.885 INFO:teuthology.orchestra.run.smithi071.stderr: 47450K .......... .......... .......... .......... .......... 51% 266M 0s 2024-09-14T11:36:39.885 INFO:teuthology.orchestra.run.smithi071.stderr: 47500K .......... .......... .......... .......... .......... 51% 287M 0s 2024-09-14T11:36:39.885 INFO:teuthology.orchestra.run.smithi071.stderr: 47550K .......... .......... .......... .......... .......... 51% 300M 0s 2024-09-14T11:36:39.885 INFO:teuthology.orchestra.run.smithi071.stderr: 47600K .......... .......... .......... .......... .......... 51% 268M 0s 2024-09-14T11:36:39.885 INFO:teuthology.orchestra.run.smithi071.stderr: 47650K .......... .......... .......... .......... .......... 51% 280M 0s 2024-09-14T11:36:39.885 INFO:teuthology.orchestra.run.smithi071.stderr: 47700K .......... .......... .......... .......... .......... 51% 262M 0s 2024-09-14T11:36:39.885 INFO:teuthology.orchestra.run.smithi071.stderr: 47750K .......... .......... .......... .......... .......... 51% 352M 0s 2024-09-14T11:36:39.885 INFO:teuthology.orchestra.run.smithi071.stderr: 47800K .......... .......... .......... .......... .......... 51% 242M 0s 2024-09-14T11:36:39.885 INFO:teuthology.orchestra.run.smithi071.stderr: 47850K .......... .......... .......... .......... .......... 51% 254M 0s 2024-09-14T11:36:39.886 INFO:teuthology.orchestra.run.smithi071.stderr: 47900K .......... .......... .......... .......... .......... 51% 218M 0s 2024-09-14T11:36:39.886 INFO:teuthology.orchestra.run.smithi071.stderr: 47950K .......... .......... .......... .......... .......... 51% 276M 0s 2024-09-14T11:36:39.886 INFO:teuthology.orchestra.run.smithi071.stderr: 48000K .......... .......... .......... .......... .......... 51% 225M 0s 2024-09-14T11:36:39.886 INFO:teuthology.orchestra.run.smithi071.stderr: 48050K .......... .......... .......... .......... .......... 51% 323M 0s 2024-09-14T11:36:39.886 INFO:teuthology.orchestra.run.smithi071.stderr: 48100K .......... .......... .......... .......... .......... 51% 375M 0s 2024-09-14T11:36:39.886 INFO:teuthology.orchestra.run.smithi071.stderr: 48150K .......... .......... .......... .......... .......... 51% 279M 0s 2024-09-14T11:36:39.886 INFO:teuthology.orchestra.run.smithi071.stderr: 48200K .......... .......... .......... .......... .......... 51% 248M 0s 2024-09-14T11:36:39.886 INFO:teuthology.orchestra.run.smithi071.stderr: 48250K .......... .......... .......... .......... .......... 51% 258M 0s 2024-09-14T11:36:39.886 INFO:teuthology.orchestra.run.smithi071.stderr: 48300K .......... .......... .......... .......... .......... 52% 375M 0s 2024-09-14T11:36:39.886 INFO:teuthology.orchestra.run.smithi071.stderr: 48350K .......... .......... .......... .......... .......... 52% 375M 0s 2024-09-14T11:36:39.886 INFO:teuthology.orchestra.run.smithi071.stderr: 48400K .......... .......... .......... .......... .......... 52% 314M 0s 2024-09-14T11:36:39.886 INFO:teuthology.orchestra.run.smithi071.stderr: 48450K .......... .......... .......... .......... .......... 52% 296M 0s 2024-09-14T11:36:39.886 INFO:teuthology.orchestra.run.smithi071.stderr: 48500K .......... .......... .......... .......... .......... 52% 240M 0s 2024-09-14T11:36:39.886 INFO:teuthology.orchestra.run.smithi071.stderr: 48550K .......... .......... .......... .......... .......... 52% 236M 0s 2024-09-14T11:36:39.886 INFO:teuthology.orchestra.run.smithi071.stderr: 48600K .......... .......... .......... .......... .......... 52% 334M 0s 2024-09-14T11:36:39.886 INFO:teuthology.orchestra.run.smithi071.stderr: 48650K .......... .......... .......... .......... .......... 52% 246M 0s 2024-09-14T11:36:39.887 INFO:teuthology.orchestra.run.smithi071.stderr: 48700K .......... .......... .......... .......... .......... 52% 233M 0s 2024-09-14T11:36:39.887 INFO:teuthology.orchestra.run.smithi071.stderr: 48750K .......... .......... .......... .......... .......... 52% 266M 0s 2024-09-14T11:36:39.887 INFO:teuthology.orchestra.run.smithi071.stderr: 48800K .......... .......... .......... .......... .......... 52% 306M 0s 2024-09-14T11:36:39.887 INFO:teuthology.orchestra.run.smithi071.stderr: 48850K .......... .......... .......... .......... .......... 52% 316M 0s 2024-09-14T11:36:39.887 INFO:teuthology.orchestra.run.smithi071.stderr: 48900K .......... .......... .......... .......... .......... 52% 288M 0s 2024-09-14T11:36:39.887 INFO:teuthology.orchestra.run.smithi071.stderr: 48950K .......... .......... .......... .......... .......... 52% 368M 0s 2024-09-14T11:36:39.887 INFO:teuthology.orchestra.run.smithi071.stderr: 49000K .......... .......... .......... .......... .......... 52% 342M 0s 2024-09-14T11:36:39.887 INFO:teuthology.orchestra.run.smithi071.stderr: 49050K .......... .......... .......... .......... .......... 52% 382M 0s 2024-09-14T11:36:39.887 INFO:teuthology.orchestra.run.smithi071.stderr: 49100K .......... .......... .......... .......... .......... 52% 356M 0s 2024-09-14T11:36:39.887 INFO:teuthology.orchestra.run.smithi071.stderr: 49150K .......... .......... .......... .......... .......... 52% 365M 0s 2024-09-14T11:36:39.887 INFO:teuthology.orchestra.run.smithi071.stderr: 49200K .......... .......... .......... .......... .......... 53% 345M 0s 2024-09-14T11:36:39.887 INFO:teuthology.orchestra.run.smithi071.stderr: 49250K .......... .......... .......... .......... .......... 53% 300M 0s 2024-09-14T11:36:39.887 INFO:teuthology.orchestra.run.smithi071.stderr: 49300K .......... .......... .......... .......... .......... 53% 14.8M 0s 2024-09-14T11:36:39.887 INFO:teuthology.orchestra.run.smithi071.stderr: 49350K .......... .......... .......... .......... .......... 53% 228M 0s 2024-09-14T11:36:39.888 INFO:teuthology.orchestra.run.smithi071.stderr: 49400K .......... .......... .......... .......... .......... 53% 268M 0s 2024-09-14T11:36:39.888 INFO:teuthology.orchestra.run.smithi071.stderr: 49450K .......... .......... .......... .......... .......... 53% 321M 0s 2024-09-14T11:36:39.888 INFO:teuthology.orchestra.run.smithi071.stderr: 49500K .......... .......... .......... .......... .......... 53% 292M 0s 2024-09-14T11:36:39.888 INFO:teuthology.orchestra.run.smithi071.stderr: 49550K .......... .......... .......... .......... .......... 53% 253M 0s 2024-09-14T11:36:39.888 INFO:teuthology.orchestra.run.smithi071.stderr: 49600K .......... .......... .......... .......... .......... 53% 269M 0s 2024-09-14T11:36:39.888 INFO:teuthology.orchestra.run.smithi071.stderr: 49650K .......... .......... .......... .......... .......... 53% 305M 0s 2024-09-14T11:36:39.888 INFO:teuthology.orchestra.run.smithi071.stderr: 49700K .......... .......... .......... .......... .......... 53% 311M 0s 2024-09-14T11:36:39.888 INFO:teuthology.orchestra.run.smithi071.stderr: 49750K .......... .......... .......... .......... .......... 53% 350M 0s 2024-09-14T11:36:39.888 INFO:teuthology.orchestra.run.smithi071.stderr: 49800K .......... .......... .......... .......... .......... 53% 279M 0s 2024-09-14T11:36:39.888 INFO:teuthology.orchestra.run.smithi071.stderr: 49850K .......... .......... .......... .......... .......... 53% 234M 0s 2024-09-14T11:36:39.888 INFO:teuthology.orchestra.run.smithi071.stderr: 49900K .......... .......... .......... .......... .......... 53% 235M 0s 2024-09-14T11:36:39.888 INFO:teuthology.orchestra.run.smithi071.stderr: 49950K .......... .......... .......... .......... .......... 53% 260M 0s 2024-09-14T11:36:39.888 INFO:teuthology.orchestra.run.smithi071.stderr: 50000K .......... .......... .......... .......... .......... 53% 307M 0s 2024-09-14T11:36:39.888 INFO:teuthology.orchestra.run.smithi071.stderr: 50050K .......... .......... .......... .......... .......... 53% 346M 0s 2024-09-14T11:36:39.888 INFO:teuthology.orchestra.run.smithi071.stderr: 50100K .......... .......... .......... .......... .......... 53% 209M 0s 2024-09-14T11:36:39.889 INFO:teuthology.orchestra.run.smithi071.stderr: 50150K .......... .......... .......... .......... .......... 54% 375M 0s 2024-09-14T11:36:39.889 INFO:teuthology.orchestra.run.smithi071.stderr: 50200K .......... .......... .......... .......... .......... 54% 294M 0s 2024-09-14T11:36:39.889 INFO:teuthology.orchestra.run.smithi071.stderr: 50250K .......... .......... .......... .......... .......... 54% 258M 0s 2024-09-14T11:36:39.889 INFO:teuthology.orchestra.run.smithi071.stderr: 50300K .......... .......... .......... .......... .......... 54% 263M 0s 2024-09-14T11:36:39.889 INFO:teuthology.orchestra.run.smithi071.stderr: 50350K .......... .......... .......... .......... .......... 54% 385M 0s 2024-09-14T11:36:39.889 INFO:teuthology.orchestra.run.smithi071.stderr: 50400K .......... .......... .......... .......... .......... 54% 311M 0s 2024-09-14T11:36:39.889 INFO:teuthology.orchestra.run.smithi071.stderr: 50450K .......... .......... .......... .......... .......... 54% 236M 0s 2024-09-14T11:36:39.889 INFO:teuthology.orchestra.run.smithi071.stderr: 50500K .......... .......... .......... .......... .......... 54% 226M 0s 2024-09-14T11:36:39.889 INFO:teuthology.orchestra.run.smithi071.stderr: 50550K .......... .......... .......... .......... .......... 54% 332M 0s 2024-09-14T11:36:39.889 INFO:teuthology.orchestra.run.smithi071.stderr: 50600K .......... .......... .......... .......... .......... 54% 300M 0s 2024-09-14T11:36:39.889 INFO:teuthology.orchestra.run.smithi071.stderr: 50650K .......... .......... .......... .......... .......... 54% 295M 0s 2024-09-14T11:36:39.889 INFO:teuthology.orchestra.run.smithi071.stderr: 50700K .......... .......... .......... .......... .......... 54% 216M 0s 2024-09-14T11:36:39.889 INFO:teuthology.orchestra.run.smithi071.stderr: 50750K .......... .......... .......... .......... .......... 54% 374M 0s 2024-09-14T11:36:39.889 INFO:teuthology.orchestra.run.smithi071.stderr: 50800K .......... .......... .......... .......... .......... 54% 314M 0s 2024-09-14T11:36:39.889 INFO:teuthology.orchestra.run.smithi071.stderr: 50850K .......... .......... .......... .......... .......... 54% 256M 0s 2024-09-14T11:36:39.890 INFO:teuthology.orchestra.run.smithi071.stderr: 50900K .......... .......... .......... .......... .......... 54% 274M 0s 2024-09-14T11:36:39.890 INFO:teuthology.orchestra.run.smithi071.stderr: 50950K .......... .......... .......... .......... .......... 54% 325M 0s 2024-09-14T11:36:39.890 INFO:teuthology.orchestra.run.smithi071.stderr: 51000K .......... .......... .......... .......... .......... 54% 386M 0s 2024-09-14T11:36:39.890 INFO:teuthology.orchestra.run.smithi071.stderr: 51050K .......... .......... .......... .......... .......... 55% 394M 0s 2024-09-14T11:36:39.890 INFO:teuthology.orchestra.run.smithi071.stderr: 51100K .......... .......... .......... .......... .......... 55% 351M 0s 2024-09-14T11:36:39.890 INFO:teuthology.orchestra.run.smithi071.stderr: 51150K .......... .......... .......... .......... .......... 55% 290M 0s 2024-09-14T11:36:39.890 INFO:teuthology.orchestra.run.smithi071.stderr: 51200K .......... .......... .......... .......... .......... 55% 234M 0s 2024-09-14T11:36:39.890 INFO:teuthology.orchestra.run.smithi071.stderr: 51250K .......... .......... .......... .......... .......... 55% 251M 0s 2024-09-14T11:36:39.890 INFO:teuthology.orchestra.run.smithi071.stderr: 51300K .......... .......... .......... .......... .......... 55% 262M 0s 2024-09-14T11:36:39.890 INFO:teuthology.orchestra.run.smithi071.stderr: 51350K .......... .......... .......... .......... .......... 55% 276M 0s 2024-09-14T11:36:39.890 INFO:teuthology.orchestra.run.smithi071.stderr: 51400K .......... .......... .......... .......... .......... 55% 296M 0s 2024-09-14T11:36:39.890 INFO:teuthology.orchestra.run.smithi071.stderr: 51450K .......... .......... .......... .......... .......... 55% 343M 0s 2024-09-14T11:36:39.890 INFO:teuthology.orchestra.run.smithi071.stderr: 51500K .......... .......... .......... .......... .......... 55% 252M 0s 2024-09-14T11:36:39.890 INFO:teuthology.orchestra.run.smithi071.stderr: 51550K .......... .......... .......... .......... .......... 55% 393M 0s 2024-09-14T11:36:39.890 INFO:teuthology.orchestra.run.smithi071.stderr: 51600K .......... .......... .......... .......... .......... 55% 303M 0s 2024-09-14T11:36:39.890 INFO:teuthology.orchestra.run.smithi071.stderr: 51650K .......... .......... .......... .......... .......... 55% 285M 0s 2024-09-14T11:36:39.891 INFO:teuthology.orchestra.run.smithi071.stderr: 51700K .......... .......... .......... .......... .......... 55% 331M 0s 2024-09-14T11:36:39.891 INFO:teuthology.orchestra.run.smithi071.stderr: 51750K .......... .......... .......... .......... .......... 55% 387M 0s 2024-09-14T11:36:39.891 INFO:teuthology.orchestra.run.smithi071.stderr: 51800K .......... .......... .......... .......... .......... 55% 395M 0s 2024-09-14T11:36:39.891 INFO:teuthology.orchestra.run.smithi071.stderr: 51850K .......... .......... .......... .......... .......... 55% 391M 0s 2024-09-14T11:36:39.891 INFO:teuthology.orchestra.run.smithi071.stderr: 51900K .......... .......... .......... .......... .......... 55% 322M 0s 2024-09-14T11:36:39.891 INFO:teuthology.orchestra.run.smithi071.stderr: 51950K .......... .......... .......... .......... .......... 55% 385M 0s 2024-09-14T11:36:39.891 INFO:teuthology.orchestra.run.smithi071.stderr: 52000K .......... .......... .......... .......... .......... 56% 15.0M 0s 2024-09-14T11:36:39.891 INFO:teuthology.orchestra.run.smithi071.stderr: 52050K .......... .......... .......... .......... .......... 56% 206M 0s 2024-09-14T11:36:39.891 INFO:teuthology.orchestra.run.smithi071.stderr: 52100K .......... .......... .......... .......... .......... 56% 254M 0s 2024-09-14T11:36:39.891 INFO:teuthology.orchestra.run.smithi071.stderr: 52150K .......... .......... .......... .......... .......... 56% 241M 0s 2024-09-14T11:36:39.891 INFO:teuthology.orchestra.run.smithi071.stderr: 52200K .......... .......... .......... .......... .......... 56% 292M 0s 2024-09-14T11:36:39.891 INFO:teuthology.orchestra.run.smithi071.stderr: 52250K .......... .......... .......... .......... .......... 56% 344M 0s 2024-09-14T11:36:39.891 INFO:teuthology.orchestra.run.smithi071.stderr: 52300K .......... .......... .......... .......... .......... 56% 265M 0s 2024-09-14T11:36:39.891 INFO:teuthology.orchestra.run.smithi071.stderr: 52350K .......... .......... .......... .......... .......... 56% 314M 0s 2024-09-14T11:36:39.891 INFO:teuthology.orchestra.run.smithi071.stderr: 52400K .......... .......... .......... .......... .......... 56% 267M 0s 2024-09-14T11:36:39.891 INFO:teuthology.orchestra.run.smithi071.stderr: 52450K .......... .......... .......... .......... .......... 56% 309M 0s 2024-09-14T11:36:39.892 INFO:teuthology.orchestra.run.smithi071.stderr: 52500K .......... .......... .......... .......... .......... 56% 299M 0s 2024-09-14T11:36:39.892 INFO:teuthology.orchestra.run.smithi071.stderr: 52550K .......... .......... .......... .......... .......... 56% 302M 0s 2024-09-14T11:36:39.892 INFO:teuthology.orchestra.run.smithi071.stderr: 52600K .......... .......... .......... .......... .......... 56% 295M 0s 2024-09-14T11:36:39.892 INFO:teuthology.orchestra.run.smithi071.stderr: 52650K .......... .......... .......... .......... .......... 56% 311M 0s 2024-09-14T11:36:39.892 INFO:teuthology.orchestra.run.smithi071.stderr: 52700K .......... .......... .......... .......... .......... 56% 239M 0s 2024-09-14T11:36:39.892 INFO:teuthology.orchestra.run.smithi071.stderr: 52750K .......... .......... .......... .......... .......... 56% 327M 0s 2024-09-14T11:36:39.892 INFO:teuthology.orchestra.run.smithi071.stderr: 52800K .......... .......... .......... .......... .......... 56% 302M 0s 2024-09-14T11:36:39.892 INFO:teuthology.orchestra.run.smithi071.stderr: 52850K .......... .......... .......... .......... .......... 56% 324M 0s 2024-09-14T11:36:39.892 INFO:teuthology.orchestra.run.smithi071.stderr: 52900K .......... .......... .......... .......... .......... 56% 302M 0s 2024-09-14T11:36:39.892 INFO:teuthology.orchestra.run.smithi071.stderr: 52950K .......... .......... .......... .......... .......... 57% 280M 0s 2024-09-14T11:36:39.892 INFO:teuthology.orchestra.run.smithi071.stderr: 53000K .......... .......... .......... .......... .......... 57% 355M 0s 2024-09-14T11:36:39.892 INFO:teuthology.orchestra.run.smithi071.stderr: 53050K .......... .......... .......... .......... .......... 57% 356M 0s 2024-09-14T11:36:39.893 INFO:teuthology.orchestra.run.smithi071.stderr: 53100K .......... .......... .......... .......... .......... 57% 246M 0s 2024-09-14T11:36:39.893 INFO:teuthology.orchestra.run.smithi071.stderr: 53150K .......... .......... .......... .......... .......... 57% 326M 0s 2024-09-14T11:36:39.893 INFO:teuthology.orchestra.run.smithi071.stderr: 53200K .......... .......... .......... .......... .......... 57% 381M 0s 2024-09-14T11:36:39.893 INFO:teuthology.orchestra.run.smithi071.stderr: 53250K .......... .......... .......... .......... .......... 57% 349M 0s 2024-09-14T11:36:39.893 INFO:teuthology.orchestra.run.smithi071.stderr: 53300K .......... .......... .......... .......... .......... 57% 239M 0s 2024-09-14T11:36:39.893 INFO:teuthology.orchestra.run.smithi071.stderr: 53350K .......... .......... .......... .......... .......... 57% 210M 0s 2024-09-14T11:36:39.893 INFO:teuthology.orchestra.run.smithi071.stderr: 53400K .......... .......... .......... .......... .......... 57% 234M 0s 2024-09-14T11:36:39.893 INFO:teuthology.orchestra.run.smithi071.stderr: 53450K .......... .......... .......... .......... .......... 57% 371M 0s 2024-09-14T11:36:39.893 INFO:teuthology.orchestra.run.smithi071.stderr: 53500K .......... .......... .......... .......... .......... 57% 325M 0s 2024-09-14T11:36:39.893 INFO:teuthology.orchestra.run.smithi071.stderr: 53550K .......... .......... .......... .......... .......... 57% 303M 0s 2024-09-14T11:36:39.893 INFO:teuthology.orchestra.run.smithi071.stderr: 53600K .......... .......... .......... .......... .......... 57% 202M 0s 2024-09-14T11:36:39.893 INFO:teuthology.orchestra.run.smithi071.stderr: 53650K .......... .......... .......... .......... .......... 57% 367M 0s 2024-09-14T11:36:39.893 INFO:teuthology.orchestra.run.smithi071.stderr: 53700K .......... .......... .......... .......... .......... 57% 256M 0s 2024-09-14T11:36:39.893 INFO:teuthology.orchestra.run.smithi071.stderr: 53750K .......... .......... .......... .......... .......... 57% 295M 0s 2024-09-14T11:36:39.894 INFO:teuthology.orchestra.run.smithi071.stderr: 53800K .......... .......... .......... .......... .......... 57% 380M 0s 2024-09-14T11:36:39.894 INFO:teuthology.orchestra.run.smithi071.stderr: 53850K .......... .......... .......... .......... .......... 58% 392M 0s 2024-09-14T11:36:39.894 INFO:teuthology.orchestra.run.smithi071.stderr: 53900K .......... .......... .......... .......... .......... 58% 239M 0s 2024-09-14T11:36:39.894 INFO:teuthology.orchestra.run.smithi071.stderr: 53950K .......... .......... .......... .......... .......... 58% 254M 0s 2024-09-14T11:36:39.894 INFO:teuthology.orchestra.run.smithi071.stderr: 54000K .......... .......... .......... .......... .......... 58% 283M 0s 2024-09-14T11:36:39.894 INFO:teuthology.orchestra.run.smithi071.stderr: 54050K .......... .......... .......... .......... .......... 58% 390M 0s 2024-09-14T11:36:39.894 INFO:teuthology.orchestra.run.smithi071.stderr: 54100K .......... .......... .......... .......... .......... 58% 253M 0s 2024-09-14T11:36:39.894 INFO:teuthology.orchestra.run.smithi071.stderr: 54150K .......... .......... .......... .......... .......... 58% 387M 0s 2024-09-14T11:36:39.894 INFO:teuthology.orchestra.run.smithi071.stderr: 54200K .......... .......... .......... .......... .......... 58% 282M 0s 2024-09-14T11:36:39.894 INFO:teuthology.orchestra.run.smithi071.stderr: 54250K .......... .......... .......... .......... .......... 58% 262M 0s 2024-09-14T11:36:39.894 INFO:teuthology.orchestra.run.smithi071.stderr: 54300K .......... .......... .......... .......... .......... 58% 258M 0s 2024-09-14T11:36:39.894 INFO:teuthology.orchestra.run.smithi071.stderr: 54350K .......... .......... .......... .......... .......... 58% 268M 0s 2024-09-14T11:36:39.894 INFO:teuthology.orchestra.run.smithi071.stderr: 54400K .......... .......... .......... .......... .......... 58% 249M 0s 2024-09-14T11:36:39.894 INFO:teuthology.orchestra.run.smithi071.stderr: 54450K .......... .......... .......... .......... .......... 58% 380M 0s 2024-09-14T11:36:39.894 INFO:teuthology.orchestra.run.smithi071.stderr: 54500K .......... .......... .......... .......... .......... 58% 352M 0s 2024-09-14T11:36:39.895 INFO:teuthology.orchestra.run.smithi071.stderr: 54550K .......... .......... .......... .......... .......... 58% 393M 0s 2024-09-14T11:36:39.895 INFO:teuthology.orchestra.run.smithi071.stderr: 54600K .......... .......... .......... .......... .......... 58% 393M 0s 2024-09-14T11:36:39.895 INFO:teuthology.orchestra.run.smithi071.stderr: 54650K .......... .......... .......... .......... .......... 58% 392M 0s 2024-09-14T11:36:39.895 INFO:teuthology.orchestra.run.smithi071.stderr: 54700K .......... .......... .......... .......... .......... 58% 321M 0s 2024-09-14T11:36:39.895 INFO:teuthology.orchestra.run.smithi071.stderr: 54750K .......... .......... .......... .......... .......... 58% 13.4M 0s 2024-09-14T11:36:39.895 INFO:teuthology.orchestra.run.smithi071.stderr: 54800K .......... .......... .......... .......... .......... 59% 226M 0s 2024-09-14T11:36:39.895 INFO:teuthology.orchestra.run.smithi071.stderr: 54850K .......... .......... .......... .......... .......... 59% 238M 0s 2024-09-14T11:36:39.895 INFO:teuthology.orchestra.run.smithi071.stderr: 54900K .......... .......... .......... .......... .......... 59% 231M 0s 2024-09-14T11:36:39.895 INFO:teuthology.orchestra.run.smithi071.stderr: 54950K .......... .......... .......... .......... .......... 59% 237M 0s 2024-09-14T11:36:39.895 INFO:teuthology.orchestra.run.smithi071.stderr: 55000K .......... .......... .......... .......... .......... 59% 290M 0s 2024-09-14T11:36:39.895 INFO:teuthology.orchestra.run.smithi071.stderr: 55050K .......... .......... .......... .......... .......... 59% 374M 0s 2024-09-14T11:36:39.895 INFO:teuthology.orchestra.run.smithi071.stderr: 55100K .......... .......... .......... .......... .......... 59% 271M 0s 2024-09-14T11:36:39.895 INFO:teuthology.orchestra.run.smithi071.stderr: 55150K .......... .......... .......... .......... .......... 59% 260M 0s 2024-09-14T11:36:39.895 INFO:teuthology.orchestra.run.smithi071.stderr: 55200K .......... .......... .......... .......... .......... 59% 308M 0s 2024-09-14T11:36:39.895 INFO:teuthology.orchestra.run.smithi071.stderr: 55250K .......... .......... .......... .......... .......... 59% 293M 0s 2024-09-14T11:36:39.895 INFO:teuthology.orchestra.run.smithi071.stderr: 55300K .......... .......... .......... .......... .......... 59% 319M 0s 2024-09-14T11:36:39.896 INFO:teuthology.orchestra.run.smithi071.stderr: 55350K .......... .......... .......... .......... .......... 59% 249M 0s 2024-09-14T11:36:39.896 INFO:teuthology.orchestra.run.smithi071.stderr: 55400K .......... .......... .......... .......... .......... 59% 354M 0s 2024-09-14T11:36:39.896 INFO:teuthology.orchestra.run.smithi071.stderr: 55450K .......... .......... .......... .......... .......... 59% 289M 0s 2024-09-14T11:36:39.896 INFO:teuthology.orchestra.run.smithi071.stderr: 55500K .......... .......... .......... .......... .......... 59% 239M 0s 2024-09-14T11:36:39.896 INFO:teuthology.orchestra.run.smithi071.stderr: 55550K .......... .......... .......... .......... .......... 59% 331M 0s 2024-09-14T11:36:39.896 INFO:teuthology.orchestra.run.smithi071.stderr: 55600K .......... .......... .......... .......... .......... 59% 302M 0s 2024-09-14T11:36:39.896 INFO:teuthology.orchestra.run.smithi071.stderr: 55650K .......... .......... .......... .......... .......... 59% 294M 0s 2024-09-14T11:36:39.896 INFO:teuthology.orchestra.run.smithi071.stderr: 55700K .......... .......... .......... .......... .......... 60% 266M 0s 2024-09-14T11:36:39.896 INFO:teuthology.orchestra.run.smithi071.stderr: 55750K .......... .......... .......... .......... .......... 60% 349M 0s 2024-09-14T11:36:39.896 INFO:teuthology.orchestra.run.smithi071.stderr: 55800K .......... .......... .......... .......... .......... 60% 287M 0s 2024-09-14T11:36:39.896 INFO:teuthology.orchestra.run.smithi071.stderr: 55850K .......... .......... .......... .......... .......... 60% 340M 0s 2024-09-14T11:36:39.896 INFO:teuthology.orchestra.run.smithi071.stderr: 55900K .......... .......... .......... .......... .......... 60% 222M 0s 2024-09-14T11:36:39.896 INFO:teuthology.orchestra.run.smithi071.stderr: 55950K .......... .......... .......... .......... .......... 60% 308M 0s 2024-09-14T11:36:39.896 INFO:teuthology.orchestra.run.smithi071.stderr: 56000K .......... .......... .......... .......... .......... 60% 307M 0s 2024-09-14T11:36:39.896 INFO:teuthology.orchestra.run.smithi071.stderr: 56050K .......... .......... .......... .......... .......... 60% 314M 0s 2024-09-14T11:36:39.897 INFO:teuthology.orchestra.run.smithi071.stderr: 56100K .......... .......... .......... .......... .......... 60% 298M 0s 2024-09-14T11:36:39.897 INFO:teuthology.orchestra.run.smithi071.stderr: 56150K .......... .......... .......... .......... .......... 60% 337M 0s 2024-09-14T11:36:39.897 INFO:teuthology.orchestra.run.smithi071.stderr: 56200K .......... .......... .......... .......... .......... 60% 328M 0s 2024-09-14T11:36:39.897 INFO:teuthology.orchestra.run.smithi071.stderr: 56250K .......... .......... .......... .......... .......... 60% 272M 0s 2024-09-14T11:36:39.897 INFO:teuthology.orchestra.run.smithi071.stderr: 56300K .......... .......... .......... .......... .......... 60% 320M 0s 2024-09-14T11:36:39.897 INFO:teuthology.orchestra.run.smithi071.stderr: 56350K .......... .......... .......... .......... .......... 60% 399M 0s 2024-09-14T11:36:39.897 INFO:teuthology.orchestra.run.smithi071.stderr: 56400K .......... .......... .......... .......... .......... 60% 360M 0s 2024-09-14T11:36:39.897 INFO:teuthology.orchestra.run.smithi071.stderr: 56450K .......... .......... .......... .......... .......... 60% 282M 0s 2024-09-14T11:36:39.897 INFO:teuthology.orchestra.run.smithi071.stderr: 56500K .......... .......... .......... .......... .......... 60% 247M 0s 2024-09-14T11:36:39.897 INFO:teuthology.orchestra.run.smithi071.stderr: 56550K .......... .......... .......... .......... .......... 60% 289M 0s 2024-09-14T11:36:39.897 INFO:teuthology.orchestra.run.smithi071.stderr: 56600K .......... .......... .......... .......... .......... 60% 314M 0s 2024-09-14T11:36:39.897 INFO:teuthology.orchestra.run.smithi071.stderr: 56650K .......... .......... .......... .......... .......... 61% 297M 0s 2024-09-14T11:36:39.897 INFO:teuthology.orchestra.run.smithi071.stderr: 56700K .......... .......... .......... .......... .......... 61% 196M 0s 2024-09-14T11:36:39.897 INFO:teuthology.orchestra.run.smithi071.stderr: 56750K .......... .......... .......... .......... .......... 61% 253M 0s 2024-09-14T11:36:39.897 INFO:teuthology.orchestra.run.smithi071.stderr: 56800K .......... .......... .......... .......... .......... 61% 281M 0s 2024-09-14T11:36:39.897 INFO:teuthology.orchestra.run.smithi071.stderr: 56850K .......... .......... .......... .......... .......... 61% 255M 0s 2024-09-14T11:36:39.898 INFO:teuthology.orchestra.run.smithi071.stderr: 56900K .......... .......... .......... .......... .......... 61% 295M 0s 2024-09-14T11:36:39.898 INFO:teuthology.orchestra.run.smithi071.stderr: 56950K .......... .......... .......... .......... .......... 61% 304M 0s 2024-09-14T11:36:39.898 INFO:teuthology.orchestra.run.smithi071.stderr: 57000K .......... .......... .......... .......... .......... 61% 388M 0s 2024-09-14T11:36:39.898 INFO:teuthology.orchestra.run.smithi071.stderr: 57050K .......... .......... .......... .......... .......... 61% 317M 0s 2024-09-14T11:36:39.898 INFO:teuthology.orchestra.run.smithi071.stderr: 57100K .......... .......... .......... .......... .......... 61% 270M 0s 2024-09-14T11:36:39.898 INFO:teuthology.orchestra.run.smithi071.stderr: 57150K .......... .......... .......... .......... .......... 61% 387M 0s 2024-09-14T11:36:39.898 INFO:teuthology.orchestra.run.smithi071.stderr: 57200K .......... .......... .......... .......... .......... 61% 395M 0s 2024-09-14T11:36:39.898 INFO:teuthology.orchestra.run.smithi071.stderr: 57250K .......... .......... .......... .......... .......... 61% 385M 0s 2024-09-14T11:36:39.898 INFO:teuthology.orchestra.run.smithi071.stderr: 57300K .......... .......... .......... .......... .......... 61% 351M 0s 2024-09-14T11:36:39.898 INFO:teuthology.orchestra.run.smithi071.stderr: 57350K .......... .......... .......... .......... .......... 61% 391M 0s 2024-09-14T11:36:39.898 INFO:teuthology.orchestra.run.smithi071.stderr: 57400K .......... .......... .......... .......... .......... 61% 357M 0s 2024-09-14T11:36:39.898 INFO:teuthology.orchestra.run.smithi071.stderr: 57450K .......... .......... .......... .......... .......... 61% 308M 0s 2024-09-14T11:36:39.898 INFO:teuthology.orchestra.run.smithi071.stderr: 57500K .......... .......... .......... .......... .......... 61% 14.5M 0s 2024-09-14T11:36:39.898 INFO:teuthology.orchestra.run.smithi071.stderr: 57550K .......... .......... .......... .......... .......... 62% 321M 0s 2024-09-14T11:36:39.898 INFO:teuthology.orchestra.run.smithi071.stderr: 57600K .......... .......... .......... .......... .......... 62% 233M 0s 2024-09-14T11:36:39.898 INFO:teuthology.orchestra.run.smithi071.stderr: 57650K .......... .......... .......... .......... .......... 62% 231M 0s 2024-09-14T11:36:39.899 INFO:teuthology.orchestra.run.smithi071.stderr: 57700K .......... .......... .......... .......... .......... 62% 280M 0s 2024-09-14T11:36:39.899 INFO:teuthology.orchestra.run.smithi071.stderr: 57750K .......... .......... .......... .......... .......... 62% 204M 0s 2024-09-14T11:36:39.899 INFO:teuthology.orchestra.run.smithi071.stderr: 57800K .......... .......... .......... .......... .......... 62% 244M 0s 2024-09-14T11:36:39.899 INFO:teuthology.orchestra.run.smithi071.stderr: 57850K .......... .......... .......... .......... .......... 62% 240M 0s 2024-09-14T11:36:39.899 INFO:teuthology.orchestra.run.smithi071.stderr: 57900K .......... .......... .......... .......... .......... 62% 220M 0s 2024-09-14T11:36:39.899 INFO:teuthology.orchestra.run.smithi071.stderr: 57950K .......... .......... .......... .......... .......... 62% 264M 0s 2024-09-14T11:36:39.899 INFO:teuthology.orchestra.run.smithi071.stderr: 58000K .......... .......... .......... .......... .......... 62% 229M 0s 2024-09-14T11:36:39.899 INFO:teuthology.orchestra.run.smithi071.stderr: 58050K .......... .......... .......... .......... .......... 62% 302M 0s 2024-09-14T11:36:39.899 INFO:teuthology.orchestra.run.smithi071.stderr: 58100K .......... .......... .......... .......... .......... 62% 159M 0s 2024-09-14T11:36:39.899 INFO:teuthology.orchestra.run.smithi071.stderr: 58150K .......... .......... .......... .......... .......... 62% 351M 0s 2024-09-14T11:36:39.899 INFO:teuthology.orchestra.run.smithi071.stderr: 58200K .......... .......... .......... .......... .......... 62% 393M 0s 2024-09-14T11:36:39.899 INFO:teuthology.orchestra.run.smithi071.stderr: 58250K .......... .......... .......... .......... .......... 62% 275M 0s 2024-09-14T11:36:39.899 INFO:teuthology.orchestra.run.smithi071.stderr: 58300K .......... .......... .......... .......... .......... 62% 279M 0s 2024-09-14T11:36:39.899 INFO:teuthology.orchestra.run.smithi071.stderr: 58350K .......... .......... .......... .......... .......... 62% 316M 0s 2024-09-14T11:36:39.899 INFO:teuthology.orchestra.run.smithi071.stderr: 58400K .......... .......... .......... .......... .......... 62% 252M 0s 2024-09-14T11:36:39.899 INFO:teuthology.orchestra.run.smithi071.stderr: 58450K .......... .......... .......... .......... .......... 62% 259M 0s 2024-09-14T11:36:39.900 INFO:teuthology.orchestra.run.smithi071.stderr: 58500K .......... .......... .......... .......... .......... 63% 257M 0s 2024-09-14T11:36:39.900 INFO:teuthology.orchestra.run.smithi071.stderr: 58550K .......... .......... .......... .......... .......... 63% 340M 0s 2024-09-14T11:36:39.900 INFO:teuthology.orchestra.run.smithi071.stderr: 58600K .......... .......... .......... .......... .......... 63% 274M 0s 2024-09-14T11:36:39.900 INFO:teuthology.orchestra.run.smithi071.stderr: 58650K .......... .......... .......... .......... .......... 63% 289M 0s 2024-09-14T11:36:39.900 INFO:teuthology.orchestra.run.smithi071.stderr: 58700K .......... .......... .......... .......... .......... 63% 218M 0s 2024-09-14T11:36:39.900 INFO:teuthology.orchestra.run.smithi071.stderr: 58750K .......... .......... .......... .......... .......... 63% 338M 0s 2024-09-14T11:36:39.900 INFO:teuthology.orchestra.run.smithi071.stderr: 58800K .......... .......... .......... .......... .......... 63% 287M 0s 2024-09-14T11:36:39.900 INFO:teuthology.orchestra.run.smithi071.stderr: 58850K .......... .......... .......... .......... .......... 63% 361M 0s 2024-09-14T11:36:39.900 INFO:teuthology.orchestra.run.smithi071.stderr: 58900K .......... .......... .......... .......... .......... 63% 261M 0s 2024-09-14T11:36:39.900 INFO:teuthology.orchestra.run.smithi071.stderr: 58950K .......... .......... .......... .......... .......... 63% 258M 0s 2024-09-14T11:36:39.900 INFO:teuthology.orchestra.run.smithi071.stderr: 59000K .......... .......... .......... .......... .......... 63% 386M 0s 2024-09-14T11:36:39.900 INFO:teuthology.orchestra.run.smithi071.stderr: 59050K .......... .......... .......... .......... .......... 63% 389M 0s 2024-09-14T11:36:39.900 INFO:teuthology.orchestra.run.smithi071.stderr: 59100K .......... .......... .......... .......... .......... 63% 269M 0s 2024-09-14T11:36:39.900 INFO:teuthology.orchestra.run.smithi071.stderr: 59150K .......... .......... .......... .......... .......... 63% 257M 0s 2024-09-14T11:36:39.900 INFO:teuthology.orchestra.run.smithi071.stderr: 59200K .......... .......... .......... .......... .......... 63% 253M 0s 2024-09-14T11:36:39.901 INFO:teuthology.orchestra.run.smithi071.stderr: 59250K .......... .......... .......... .......... .......... 63% 241M 0s 2024-09-14T11:36:39.901 INFO:teuthology.orchestra.run.smithi071.stderr: 59300K .......... .......... .......... .......... .......... 63% 303M 0s 2024-09-14T11:36:39.901 INFO:teuthology.orchestra.run.smithi071.stderr: 59350K .......... .......... .......... .......... .......... 63% 316M 0s 2024-09-14T11:36:39.901 INFO:teuthology.orchestra.run.smithi071.stderr: 59400K .......... .......... .......... .......... .......... 63% 219M 0s 2024-09-14T11:36:39.901 INFO:teuthology.orchestra.run.smithi071.stderr: 59450K .......... .......... .......... .......... .......... 64% 316M 0s 2024-09-14T11:36:39.901 INFO:teuthology.orchestra.run.smithi071.stderr: 59500K .......... .......... .......... .......... .......... 64% 226M 0s 2024-09-14T11:36:39.901 INFO:teuthology.orchestra.run.smithi071.stderr: 59550K .......... .......... .......... .......... .......... 64% 321M 0s 2024-09-14T11:36:39.901 INFO:teuthology.orchestra.run.smithi071.stderr: 59600K .......... .......... .......... .......... .......... 64% 397M 0s 2024-09-14T11:36:39.901 INFO:teuthology.orchestra.run.smithi071.stderr: 59650K .......... .......... .......... .......... .......... 64% 215M 0s 2024-09-14T11:36:39.901 INFO:teuthology.orchestra.run.smithi071.stderr: 59700K .......... .......... .......... .......... .......... 64% 298M 0s 2024-09-14T11:36:39.901 INFO:teuthology.orchestra.run.smithi071.stderr: 59750K .......... .......... .......... .......... .......... 64% 383M 0s 2024-09-14T11:36:39.901 INFO:teuthology.orchestra.run.smithi071.stderr: 59800K .......... .......... .......... .......... .......... 64% 390M 0s 2024-09-14T11:36:39.902 INFO:teuthology.orchestra.run.smithi071.stderr: 59850K .......... .......... .......... .......... .......... 64% 390M 0s 2024-09-14T11:36:39.902 INFO:teuthology.orchestra.run.smithi071.stderr: 59900K .......... .......... .......... .......... .......... 64% 296M 0s 2024-09-14T11:36:39.902 INFO:teuthology.orchestra.run.smithi071.stderr: 59950K .......... .......... .......... .......... .......... 64% 395M 0s 2024-09-14T11:36:39.902 INFO:teuthology.orchestra.run.smithi071.stderr: 60000K .......... .......... .......... .......... .......... 64% 388M 0s 2024-09-14T11:36:39.902 INFO:teuthology.orchestra.run.smithi071.stderr: 60050K .......... .......... .......... .......... .......... 64% 385M 0s 2024-09-14T11:36:39.902 INFO:teuthology.orchestra.run.smithi071.stderr: 60100K .......... .......... .......... .......... .......... 64% 350M 0s 2024-09-14T11:36:39.902 INFO:teuthology.orchestra.run.smithi071.stderr: 60150K .......... .......... .......... .......... .......... 64% 393M 0s 2024-09-14T11:36:39.902 INFO:teuthology.orchestra.run.smithi071.stderr: 60200K .......... .......... .......... .......... .......... 64% 392M 0s 2024-09-14T11:36:39.902 INFO:teuthology.orchestra.run.smithi071.stderr: 60250K .......... .......... .......... .......... .......... 64% 16.2M 0s 2024-09-14T11:36:39.902 INFO:teuthology.orchestra.run.smithi071.stderr: 60300K .......... .......... .......... .......... .......... 64% 178M 0s 2024-09-14T11:36:39.902 INFO:teuthology.orchestra.run.smithi071.stderr: 60350K .......... .......... .......... .......... .......... 65% 242M 0s 2024-09-14T11:36:39.902 INFO:teuthology.orchestra.run.smithi071.stderr: 60400K .......... .......... .......... .......... .......... 65% 343M 0s 2024-09-14T11:36:39.902 INFO:teuthology.orchestra.run.smithi071.stderr: 60450K .......... .......... .......... .......... .......... 65% 252M 0s 2024-09-14T11:36:39.902 INFO:teuthology.orchestra.run.smithi071.stderr: 60500K .......... .......... .......... .......... .......... 65% 289M 0s 2024-09-14T11:36:39.902 INFO:teuthology.orchestra.run.smithi071.stderr: 60550K .......... .......... .......... .......... .......... 65% 405M 0s 2024-09-14T11:36:39.903 INFO:teuthology.orchestra.run.smithi071.stderr: 60600K .......... .......... .......... .......... .......... 65% 403M 0s 2024-09-14T11:36:39.903 INFO:teuthology.orchestra.run.smithi071.stderr: 60650K .......... .......... .......... .......... .......... 65% 401M 0s 2024-09-14T11:36:39.903 INFO:teuthology.orchestra.run.smithi071.stderr: 60700K .......... .......... .......... .......... .......... 65% 220M 0s 2024-09-14T11:36:39.903 INFO:teuthology.orchestra.run.smithi071.stderr: 60750K .......... .......... .......... .......... .......... 65% 371M 0s 2024-09-14T11:36:39.903 INFO:teuthology.orchestra.run.smithi071.stderr: 60800K .......... .......... .......... .......... .......... 65% 282M 0s 2024-09-14T11:36:39.903 INFO:teuthology.orchestra.run.smithi071.stderr: 60850K .......... .......... .......... .......... .......... 65% 240M 0s 2024-09-14T11:36:39.903 INFO:teuthology.orchestra.run.smithi071.stderr: 60900K .......... .......... .......... .......... .......... 65% 245M 0s 2024-09-14T11:36:39.903 INFO:teuthology.orchestra.run.smithi071.stderr: 60950K .......... .......... .......... .......... .......... 65% 334M 0s 2024-09-14T11:36:39.903 INFO:teuthology.orchestra.run.smithi071.stderr: 61000K .......... .......... .......... .......... .......... 65% 393M 0s 2024-09-14T11:36:39.903 INFO:teuthology.orchestra.run.smithi071.stderr: 61050K .......... .......... .......... .......... .......... 65% 319M 0s 2024-09-14T11:36:39.903 INFO:teuthology.orchestra.run.smithi071.stderr: 61100K .......... .......... .......... .......... .......... 65% 220M 0s 2024-09-14T11:36:39.903 INFO:teuthology.orchestra.run.smithi071.stderr: 61150K .......... .......... .......... .......... .......... 65% 338M 0s 2024-09-14T11:36:39.903 INFO:teuthology.orchestra.run.smithi071.stderr: 61200K .......... .......... .......... .......... .......... 65% 403M 0s 2024-09-14T11:36:39.903 INFO:teuthology.orchestra.run.smithi071.stderr: 61250K .......... .......... .......... .......... .......... 65% 398M 0s 2024-09-14T11:36:39.903 INFO:teuthology.orchestra.run.smithi071.stderr: 61300K .......... .......... .......... .......... .......... 66% 355M 0s 2024-09-14T11:36:39.903 INFO:teuthology.orchestra.run.smithi071.stderr: 61350K .......... .......... .......... .......... .......... 66% 364M 0s 2024-09-14T11:36:39.904 INFO:teuthology.orchestra.run.smithi071.stderr: 61400K .......... .......... .......... .......... .......... 66% 236M 0s 2024-09-14T11:36:39.904 INFO:teuthology.orchestra.run.smithi071.stderr: 61450K .......... .......... .......... .......... .......... 66% 291M 0s 2024-09-14T11:36:39.904 INFO:teuthology.orchestra.run.smithi071.stderr: 61500K .......... .......... .......... .......... .......... 66% 261M 0s 2024-09-14T11:36:39.904 INFO:teuthology.orchestra.run.smithi071.stderr: 61550K .......... .......... .......... .......... .......... 66% 218M 0s 2024-09-14T11:36:39.904 INFO:teuthology.orchestra.run.smithi071.stderr: 61600K .......... .......... .......... .......... .......... 66% 325M 0s 2024-09-14T11:36:39.904 INFO:teuthology.orchestra.run.smithi071.stderr: 61650K .......... .......... .......... .......... .......... 66% 270M 0s 2024-09-14T11:36:39.904 INFO:teuthology.orchestra.run.smithi071.stderr: 61700K .......... .......... .......... .......... .......... 66% 353M 0s 2024-09-14T11:36:39.904 INFO:teuthology.orchestra.run.smithi071.stderr: 61750K .......... .......... .......... .......... .......... 66% 387M 0s 2024-09-14T11:36:39.904 INFO:teuthology.orchestra.run.smithi071.stderr: 61800K .......... .......... .......... .......... .......... 66% 337M 0s 2024-09-14T11:36:39.904 INFO:teuthology.orchestra.run.smithi071.stderr: 61850K .......... .......... .......... .......... .......... 66% 242M 0s 2024-09-14T11:36:39.904 INFO:teuthology.orchestra.run.smithi071.stderr: 61900K .......... .......... .......... .......... .......... 66% 386M 0s 2024-09-14T11:36:39.904 INFO:teuthology.orchestra.run.smithi071.stderr: 61950K .......... .......... .......... .......... .......... 66% 402M 0s 2024-09-14T11:36:39.904 INFO:teuthology.orchestra.run.smithi071.stderr: 62000K .......... .......... .......... .......... .......... 66% 334M 0s 2024-09-14T11:36:39.904 INFO:teuthology.orchestra.run.smithi071.stderr: 62050K .......... .......... .......... .......... .......... 66% 228M 0s 2024-09-14T11:36:39.904 INFO:teuthology.orchestra.run.smithi071.stderr: 62100K .......... .......... .......... .......... .......... 66% 325M 0s 2024-09-14T11:36:39.905 INFO:teuthology.orchestra.run.smithi071.stderr: 62150K .......... .......... .......... .......... .......... 66% 313M 0s 2024-09-14T11:36:39.905 INFO:teuthology.orchestra.run.smithi071.stderr: 62200K .......... .......... .......... .......... .......... 67% 222M 0s 2024-09-14T11:36:39.905 INFO:teuthology.orchestra.run.smithi071.stderr: 62250K .......... .......... .......... .......... .......... 67% 276M 0s 2024-09-14T11:36:39.905 INFO:teuthology.orchestra.run.smithi071.stderr: 62300K .......... .......... .......... .......... .......... 67% 407M 0s 2024-09-14T11:36:39.905 INFO:teuthology.orchestra.run.smithi071.stderr: 62350K .......... .......... .......... .......... .......... 67% 399M 0s 2024-09-14T11:36:39.905 INFO:teuthology.orchestra.run.smithi071.stderr: 62400K .......... .......... .......... .......... .......... 67% 402M 0s 2024-09-14T11:36:39.905 INFO:teuthology.orchestra.run.smithi071.stderr: 62450K .......... .......... .......... .......... .......... 67% 271M 0s 2024-09-14T11:36:39.905 INFO:teuthology.orchestra.run.smithi071.stderr: 62500K .......... .......... .......... .......... .......... 67% 221M 0s 2024-09-14T11:36:39.905 INFO:teuthology.orchestra.run.smithi071.stderr: 62550K .......... .......... .......... .......... .......... 67% 246M 0s 2024-09-14T11:36:39.905 INFO:teuthology.orchestra.run.smithi071.stderr: 62600K .......... .......... .......... .......... .......... 67% 280M 0s 2024-09-14T11:36:39.905 INFO:teuthology.orchestra.run.smithi071.stderr: 62650K .......... .......... .......... .......... .......... 67% 335M 0s 2024-09-14T11:36:39.905 INFO:teuthology.orchestra.run.smithi071.stderr: 62700K .......... .......... .......... .......... .......... 67% 397M 0s 2024-09-14T11:36:39.905 INFO:teuthology.orchestra.run.smithi071.stderr: 62750K .......... .......... .......... .......... .......... 67% 373M 0s 2024-09-14T11:36:39.905 INFO:teuthology.orchestra.run.smithi071.stderr: 62800K .......... .......... .......... .......... .......... 67% 400M 0s 2024-09-14T11:36:39.905 INFO:teuthology.orchestra.run.smithi071.stderr: 62850K .......... .......... .......... .......... .......... 67% 12.2M 0s 2024-09-14T11:36:39.905 INFO:teuthology.orchestra.run.smithi071.stderr: 62900K .......... .......... .......... .......... .......... 67% 275M 0s 2024-09-14T11:36:39.906 INFO:teuthology.orchestra.run.smithi071.stderr: 62950K .......... .......... .......... .......... .......... 67% 282M 0s 2024-09-14T11:36:39.906 INFO:teuthology.orchestra.run.smithi071.stderr: 63000K .......... .......... .......... .......... .......... 67% 313M 0s 2024-09-14T11:36:39.906 INFO:teuthology.orchestra.run.smithi071.stderr: 63050K .......... .......... .......... .......... .......... 67% 243M 0s 2024-09-14T11:36:39.906 INFO:teuthology.orchestra.run.smithi071.stderr: 63100K .......... .......... .......... .......... .......... 67% 350M 0s 2024-09-14T11:36:39.906 INFO:teuthology.orchestra.run.smithi071.stderr: 63150K .......... .......... .......... .......... .......... 68% 382M 0s 2024-09-14T11:36:39.906 INFO:teuthology.orchestra.run.smithi071.stderr: 63200K .......... .......... .......... .......... .......... 68% 397M 0s 2024-09-14T11:36:39.906 INFO:teuthology.orchestra.run.smithi071.stderr: 63250K .......... .......... .......... .......... .......... 68% 356M 0s 2024-09-14T11:36:39.906 INFO:teuthology.orchestra.run.smithi071.stderr: 63300K .......... .......... .......... .......... .......... 68% 398M 0s 2024-09-14T11:36:39.906 INFO:teuthology.orchestra.run.smithi071.stderr: 63350K .......... .......... .......... .......... .......... 68% 370M 0s 2024-09-14T11:36:39.906 INFO:teuthology.orchestra.run.smithi071.stderr: 63400K .......... .......... .......... .......... .......... 68% 365M 0s 2024-09-14T11:36:39.906 INFO:teuthology.orchestra.run.smithi071.stderr: 63450K .......... .......... .......... .......... .......... 68% 308M 0s 2024-09-14T11:36:39.906 INFO:teuthology.orchestra.run.smithi071.stderr: 63500K .......... .......... .......... .......... .......... 68% 362M 0s 2024-09-14T11:36:39.906 INFO:teuthology.orchestra.run.smithi071.stderr: 63550K .......... .......... .......... .......... .......... 68% 384M 0s 2024-09-14T11:36:39.906 INFO:teuthology.orchestra.run.smithi071.stderr: 63600K .......... .......... .......... .......... .......... 68% 354M 0s 2024-09-14T11:36:39.906 INFO:teuthology.orchestra.run.smithi071.stderr: 63650K .......... .......... .......... .......... .......... 68% 327M 0s 2024-09-14T11:36:39.906 INFO:teuthology.orchestra.run.smithi071.stderr: 63700K .......... .......... .......... .......... .......... 68% 371M 0s 2024-09-14T11:36:39.907 INFO:teuthology.orchestra.run.smithi071.stderr: 63750K .......... .......... .......... .......... .......... 68% 383M 0s 2024-09-14T11:36:39.907 INFO:teuthology.orchestra.run.smithi071.stderr: 63800K .......... .......... .......... .......... .......... 68% 387M 0s 2024-09-14T11:36:39.907 INFO:teuthology.orchestra.run.smithi071.stderr: 63850K .......... .......... .......... .......... .......... 68% 320M 0s 2024-09-14T11:36:39.907 INFO:teuthology.orchestra.run.smithi071.stderr: 63900K .......... .......... .......... .......... .......... 68% 337M 0s 2024-09-14T11:36:39.907 INFO:teuthology.orchestra.run.smithi071.stderr: 63950K .......... .......... .......... .......... .......... 68% 377M 0s 2024-09-14T11:36:39.907 INFO:teuthology.orchestra.run.smithi071.stderr: 64000K .......... .......... .......... .......... .......... 68% 396M 0s 2024-09-14T11:36:39.907 INFO:teuthology.orchestra.run.smithi071.stderr: 64050K .......... .......... .......... .......... .......... 68% 358M 0s 2024-09-14T11:36:39.907 INFO:teuthology.orchestra.run.smithi071.stderr: 64100K .......... .......... .......... .......... .......... 69% 388M 0s 2024-09-14T11:36:39.907 INFO:teuthology.orchestra.run.smithi071.stderr: 64150K .......... .......... .......... .......... .......... 69% 359M 0s 2024-09-14T11:36:39.907 INFO:teuthology.orchestra.run.smithi071.stderr: 64200K .......... .......... .......... .......... .......... 69% 301M 0s 2024-09-14T11:36:39.907 INFO:teuthology.orchestra.run.smithi071.stderr: 64250K .......... .......... .......... .......... .......... 69% 349M 0s 2024-09-14T11:36:39.907 INFO:teuthology.orchestra.run.smithi071.stderr: 64300K .......... .......... .......... .......... .......... 69% 351M 0s 2024-09-14T11:36:39.907 INFO:teuthology.orchestra.run.smithi071.stderr: 64350K .......... .......... .......... .......... .......... 69% 286M 0s 2024-09-14T11:36:39.907 INFO:teuthology.orchestra.run.smithi071.stderr: 64400K .......... .......... .......... .......... .......... 69% 365M 0s 2024-09-14T11:36:39.907 INFO:teuthology.orchestra.run.smithi071.stderr: 64450K .......... .......... .......... .......... .......... 69% 332M 0s 2024-09-14T11:36:39.907 INFO:teuthology.orchestra.run.smithi071.stderr: 64500K .......... .......... .......... .......... .......... 69% 373M 0s 2024-09-14T11:36:39.908 INFO:teuthology.orchestra.run.smithi071.stderr: 64550K .......... .......... .......... .......... .......... 69% 346M 0s 2024-09-14T11:36:39.908 INFO:teuthology.orchestra.run.smithi071.stderr: 64600K .......... .......... .......... .......... .......... 69% 357M 0s 2024-09-14T11:36:39.908 INFO:teuthology.orchestra.run.smithi071.stderr: 64650K .......... .......... .......... .......... .......... 69% 347M 0s 2024-09-14T11:36:39.908 INFO:teuthology.orchestra.run.smithi071.stderr: 64700K .......... .......... .......... .......... .......... 69% 343M 0s 2024-09-14T11:36:39.908 INFO:teuthology.orchestra.run.smithi071.stderr: 64750K .......... .......... .......... .......... .......... 69% 314M 0s 2024-09-14T11:36:39.908 INFO:teuthology.orchestra.run.smithi071.stderr: 64800K .......... .......... .......... .......... .......... 69% 389M 0s 2024-09-14T11:36:39.908 INFO:teuthology.orchestra.run.smithi071.stderr: 64850K .......... .......... .......... .......... .......... 69% 372M 0s 2024-09-14T11:36:39.908 INFO:teuthology.orchestra.run.smithi071.stderr: 64900K .......... .......... .......... .......... .......... 69% 369M 0s 2024-09-14T11:36:39.908 INFO:teuthology.orchestra.run.smithi071.stderr: 64950K .......... .......... .......... .......... .......... 69% 316M 0s 2024-09-14T11:36:39.908 INFO:teuthology.orchestra.run.smithi071.stderr: 65000K .......... .......... .......... .......... .......... 70% 348M 0s 2024-09-14T11:36:39.908 INFO:teuthology.orchestra.run.smithi071.stderr: 65050K .......... .......... .......... .......... .......... 70% 379M 0s 2024-09-14T11:36:39.908 INFO:teuthology.orchestra.run.smithi071.stderr: 65100K .......... .......... .......... .......... .......... 70% 391M 0s 2024-09-14T11:36:39.908 INFO:teuthology.orchestra.run.smithi071.stderr: 65150K .......... .......... .......... .......... .......... 70% 313M 0s 2024-09-14T11:36:39.908 INFO:teuthology.orchestra.run.smithi071.stderr: 65200K .......... .......... .......... .......... .......... 70% 278M 0s 2024-09-14T11:36:39.908 INFO:teuthology.orchestra.run.smithi071.stderr: 65250K .......... .......... .......... .......... .......... 70% 328M 0s 2024-09-14T11:36:39.909 INFO:teuthology.orchestra.run.smithi071.stderr: 65300K .......... .......... .......... .......... .......... 70% 192M 0s 2024-09-14T11:36:39.909 INFO:teuthology.orchestra.run.smithi071.stderr: 65350K .......... .......... .......... .......... .......... 70% 220M 0s 2024-09-14T11:36:39.909 INFO:teuthology.orchestra.run.smithi071.stderr: 65400K .......... .......... .......... .......... .......... 70% 345M 0s 2024-09-14T11:36:39.909 INFO:teuthology.orchestra.run.smithi071.stderr: 65450K .......... .......... .......... .......... .......... 70% 331M 0s 2024-09-14T11:36:39.909 INFO:teuthology.orchestra.run.smithi071.stderr: 65500K .......... .......... .......... .......... .......... 70% 382M 0s 2024-09-14T11:36:39.909 INFO:teuthology.orchestra.run.smithi071.stderr: 65550K .......... .......... .......... .......... .......... 70% 295M 0s 2024-09-14T11:36:39.909 INFO:teuthology.orchestra.run.smithi071.stderr: 65600K .......... .......... .......... .......... .......... 70% 380M 0s 2024-09-14T11:36:39.909 INFO:teuthology.orchestra.run.smithi071.stderr: 65650K .......... .......... .......... .......... .......... 70% 315M 0s 2024-09-14T11:36:39.909 INFO:teuthology.orchestra.run.smithi071.stderr: 65700K .......... .......... .......... .......... .......... 70% 12.2M 0s 2024-09-14T11:36:39.909 INFO:teuthology.orchestra.run.smithi071.stderr: 65750K .......... .......... .......... .......... .......... 70% 292M 0s 2024-09-14T11:36:39.909 INFO:teuthology.orchestra.run.smithi071.stderr: 65800K .......... .......... .......... .......... .......... 70% 379M 0s 2024-09-14T11:36:39.909 INFO:teuthology.orchestra.run.smithi071.stderr: 65850K .......... .......... .......... .......... .......... 70% 335M 0s 2024-09-14T11:36:39.909 INFO:teuthology.orchestra.run.smithi071.stderr: 65900K .......... .......... .......... .......... .......... 70% 371M 0s 2024-09-14T11:36:39.909 INFO:teuthology.orchestra.run.smithi071.stderr: 65950K .......... .......... .......... .......... .......... 71% 291M 0s 2024-09-14T11:36:39.909 INFO:teuthology.orchestra.run.smithi071.stderr: 66000K .......... .......... .......... .......... .......... 71% 366M 0s 2024-09-14T11:36:39.910 INFO:teuthology.orchestra.run.smithi071.stderr: 66050K .......... .......... .......... .......... .......... 71% 332M 0s 2024-09-14T11:36:39.910 INFO:teuthology.orchestra.run.smithi071.stderr: 66100K .......... .......... .......... .......... .......... 71% 332M 0s 2024-09-14T11:36:39.910 INFO:teuthology.orchestra.run.smithi071.stderr: 66150K .......... .......... .......... .......... .......... 71% 325M 0s 2024-09-14T11:36:39.910 INFO:teuthology.orchestra.run.smithi071.stderr: 66200K .......... .......... .......... .......... .......... 71% 367M 0s 2024-09-14T11:36:39.910 INFO:teuthology.orchestra.run.smithi071.stderr: 66250K .......... .......... .......... .......... .......... 71% 359M 0s 2024-09-14T11:36:39.910 INFO:teuthology.orchestra.run.smithi071.stderr: 66300K .......... .......... .......... .......... .......... 71% 337M 0s 2024-09-14T11:36:39.910 INFO:teuthology.orchestra.run.smithi071.stderr: 66350K .......... .......... .......... .......... .......... 71% 312M 0s 2024-09-14T11:36:39.910 INFO:teuthology.orchestra.run.smithi071.stderr: 66400K .......... .......... .......... .......... .......... 71% 386M 0s 2024-09-14T11:36:39.910 INFO:teuthology.orchestra.run.smithi071.stderr: 66450K .......... .......... .......... .......... .......... 71% 352M 0s 2024-09-14T11:36:39.910 INFO:teuthology.orchestra.run.smithi071.stderr: 66500K .......... .......... .......... .......... .......... 71% 254M 0s 2024-09-14T11:36:39.910 INFO:teuthology.orchestra.run.smithi071.stderr: 66550K .......... .......... .......... .......... .......... 71% 301M 0s 2024-09-14T11:36:39.910 INFO:teuthology.orchestra.run.smithi071.stderr: 66600K .......... .......... .......... .......... .......... 71% 339M 0s 2024-09-14T11:36:39.910 INFO:teuthology.orchestra.run.smithi071.stderr: 66650K .......... .......... .......... .......... .......... 71% 359M 0s 2024-09-14T11:36:39.910 INFO:teuthology.orchestra.run.smithi071.stderr: 66700K .......... .......... .......... .......... .......... 71% 363M 0s 2024-09-14T11:36:39.910 INFO:teuthology.orchestra.run.smithi071.stderr: 66750K .......... .......... .......... .......... .......... 71% 295M 0s 2024-09-14T11:36:39.910 INFO:teuthology.orchestra.run.smithi071.stderr: 66800K .......... .......... .......... .......... .......... 71% 315M 0s 2024-09-14T11:36:39.911 INFO:teuthology.orchestra.run.smithi071.stderr: 66850K .......... .......... .......... .......... .......... 72% 362M 0s 2024-09-14T11:36:39.911 INFO:teuthology.orchestra.run.smithi071.stderr: 66900K .......... .......... .......... .......... .......... 72% 375M 0s 2024-09-14T11:36:39.911 INFO:teuthology.orchestra.run.smithi071.stderr: 66950K .......... .......... .......... .......... .......... 72% 338M 0s 2024-09-14T11:36:39.911 INFO:teuthology.orchestra.run.smithi071.stderr: 67000K .......... .......... .......... .......... .......... 72% 353M 0s 2024-09-14T11:36:39.911 INFO:teuthology.orchestra.run.smithi071.stderr: 67050K .......... .......... .......... .......... .......... 72% 163M 0s 2024-09-14T11:36:39.911 INFO:teuthology.orchestra.run.smithi071.stderr: 67100K .......... .......... .......... .......... .......... 72% 336M 0s 2024-09-14T11:36:39.911 INFO:teuthology.orchestra.run.smithi071.stderr: 67150K .......... .......... .......... .......... .......... 72% 295M 0s 2024-09-14T11:36:39.911 INFO:teuthology.orchestra.run.smithi071.stderr: 67200K .......... .......... .......... .......... .......... 72% 348M 0s 2024-09-14T11:36:39.911 INFO:teuthology.orchestra.run.smithi071.stderr: 67250K .......... .......... .......... .......... .......... 72% 380M 0s 2024-09-14T11:36:39.911 INFO:teuthology.orchestra.run.smithi071.stderr: 67300K .......... .......... .......... .......... .......... 72% 363M 0s 2024-09-14T11:36:39.911 INFO:teuthology.orchestra.run.smithi071.stderr: 67350K .......... .......... .......... .......... .......... 72% 327M 0s 2024-09-14T11:36:39.911 INFO:teuthology.orchestra.run.smithi071.stderr: 67400K .......... .......... .......... .......... .......... 72% 377M 0s 2024-09-14T11:36:39.911 INFO:teuthology.orchestra.run.smithi071.stderr: 67450K .......... .......... .......... .......... .......... 72% 374M 0s 2024-09-14T11:36:39.911 INFO:teuthology.orchestra.run.smithi071.stderr: 67500K .......... .......... .......... .......... .......... 72% 371M 0s 2024-09-14T11:36:39.911 INFO:teuthology.orchestra.run.smithi071.stderr: 67550K .......... .......... .......... .......... .......... 72% 294M 0s 2024-09-14T11:36:39.912 INFO:teuthology.orchestra.run.smithi071.stderr: 67600K .......... .......... .......... .......... .......... 72% 333M 0s 2024-09-14T11:36:39.912 INFO:teuthology.orchestra.run.smithi071.stderr: 67650K .......... .......... .......... .......... .......... 72% 362M 0s 2024-09-14T11:36:39.912 INFO:teuthology.orchestra.run.smithi071.stderr: 67700K .......... .......... .......... .......... .......... 72% 335M 0s 2024-09-14T11:36:39.912 INFO:teuthology.orchestra.run.smithi071.stderr: 67750K .......... .......... .......... .......... .......... 72% 321M 0s 2024-09-14T11:36:39.912 INFO:teuthology.orchestra.run.smithi071.stderr: 67800K .......... .......... .......... .......... .......... 73% 347M 0s 2024-09-14T11:36:39.912 INFO:teuthology.orchestra.run.smithi071.stderr: 67850K .......... .......... .......... .......... .......... 73% 375M 0s 2024-09-14T11:36:39.912 INFO:teuthology.orchestra.run.smithi071.stderr: 67900K .......... .......... .......... .......... .......... 73% 395M 0s 2024-09-14T11:36:39.912 INFO:teuthology.orchestra.run.smithi071.stderr: 67950K .......... .......... .......... .......... .......... 73% 321M 0s 2024-09-14T11:36:39.912 INFO:teuthology.orchestra.run.smithi071.stderr: 68000K .......... .......... .......... .......... .......... 73% 358M 0s 2024-09-14T11:36:39.912 INFO:teuthology.orchestra.run.smithi071.stderr: 68050K .......... .......... .......... .......... .......... 73% 350M 0s 2024-09-14T11:36:39.912 INFO:teuthology.orchestra.run.smithi071.stderr: 68100K .......... .......... .......... .......... .......... 73% 363M 0s 2024-09-14T11:36:39.912 INFO:teuthology.orchestra.run.smithi071.stderr: 68150K .......... .......... .......... .......... .......... 73% 298M 0s 2024-09-14T11:36:39.912 INFO:teuthology.orchestra.run.smithi071.stderr: 68200K .......... .......... .......... .......... .......... 73% 243M 0s 2024-09-14T11:36:39.912 INFO:teuthology.orchestra.run.smithi071.stderr: 68250K .......... .......... .......... .......... .......... 73% 238M 0s 2024-09-14T11:36:39.912 INFO:teuthology.orchestra.run.smithi071.stderr: 68300K .......... .......... .......... .......... .......... 73% 215M 0s 2024-09-14T11:36:39.912 INFO:teuthology.orchestra.run.smithi071.stderr: 68350K .......... .......... .......... .......... .......... 73% 180M 0s 2024-09-14T11:36:39.913 INFO:teuthology.orchestra.run.smithi071.stderr: 68400K .......... .......... .......... .......... .......... 73% 369M 0s 2024-09-14T11:36:39.913 INFO:teuthology.orchestra.run.smithi071.stderr: 68450K .......... .......... .......... .......... .......... 73% 377M 0s 2024-09-14T11:36:39.913 INFO:teuthology.orchestra.run.smithi071.stderr: 68500K .......... .......... .......... .......... .......... 73% 372M 0s 2024-09-14T11:36:39.913 INFO:teuthology.orchestra.run.smithi071.stderr: 68550K .......... .......... .......... .......... .......... 73% 344M 0s 2024-09-14T11:36:39.913 INFO:teuthology.orchestra.run.smithi071.stderr: 68600K .......... .......... .......... .......... .......... 73% 382M 0s 2024-09-14T11:36:39.913 INFO:teuthology.orchestra.run.smithi071.stderr: 68650K .......... .......... .......... .......... .......... 73% 12.8M 0s 2024-09-14T11:36:39.913 INFO:teuthology.orchestra.run.smithi071.stderr: 68700K .......... .......... .......... .......... .......... 74% 339M 0s 2024-09-14T11:36:39.913 INFO:teuthology.orchestra.run.smithi071.stderr: 68750K .......... .......... .......... .......... .......... 74% 276M 0s 2024-09-14T11:36:39.913 INFO:teuthology.orchestra.run.smithi071.stderr: 68800K .......... .......... .......... .......... .......... 74% 338M 0s 2024-09-14T11:36:39.913 INFO:teuthology.orchestra.run.smithi071.stderr: 68850K .......... .......... .......... .......... .......... 74% 334M 0s 2024-09-14T11:36:39.913 INFO:teuthology.orchestra.run.smithi071.stderr: 68900K .......... .......... .......... .......... .......... 74% 378M 0s 2024-09-14T11:36:39.913 INFO:teuthology.orchestra.run.smithi071.stderr: 68950K .......... .......... .......... .......... .......... 74% 344M 0s 2024-09-14T11:36:39.913 INFO:teuthology.orchestra.run.smithi071.stderr: 69000K .......... .......... .......... .......... .......... 74% 357M 0s 2024-09-14T11:36:39.914 INFO:teuthology.orchestra.run.smithi071.stderr: 69050K .......... .......... .......... .......... .......... 74% 332M 0s 2024-09-14T11:36:39.914 INFO:teuthology.orchestra.run.smithi071.stderr: 69100K .......... .......... .......... .......... .......... 74% 345M 0s 2024-09-14T11:36:39.914 INFO:teuthology.orchestra.run.smithi071.stderr: 69150K .......... .......... .......... .......... .......... 74% 280M 0s 2024-09-14T11:36:39.914 INFO:teuthology.orchestra.run.smithi071.stderr: 69200K .......... .......... .......... .......... .......... 74% 324M 0s 2024-09-14T11:36:39.914 INFO:teuthology.orchestra.run.smithi071.stderr: 69250K .......... .......... .......... .......... .......... 74% 366M 0s 2024-09-14T11:36:39.914 INFO:teuthology.orchestra.run.smithi071.stderr: 69300K .......... .......... .......... .......... .......... 74% 384M 0s 2024-09-14T11:36:39.914 INFO:teuthology.orchestra.run.smithi071.stderr: 69350K .......... .......... .......... .......... .......... 74% 347M 0s 2024-09-14T11:36:39.914 INFO:teuthology.orchestra.run.smithi071.stderr: 69400K .......... .......... .......... .......... .......... 74% 357M 0s 2024-09-14T11:36:39.914 INFO:teuthology.orchestra.run.smithi071.stderr: 69450K .......... .......... .......... .......... .......... 74% 349M 0s 2024-09-14T11:36:39.914 INFO:teuthology.orchestra.run.smithi071.stderr: 69500K .......... .......... .......... .......... .......... 74% 339M 0s 2024-09-14T11:36:39.914 INFO:teuthology.orchestra.run.smithi071.stderr: 69550K .......... .......... .......... .......... .......... 74% 307M 0s 2024-09-14T11:36:39.914 INFO:teuthology.orchestra.run.smithi071.stderr: 69600K .......... .......... .......... .......... .......... 74% 380M 0s 2024-09-14T11:36:39.914 INFO:teuthology.orchestra.run.smithi071.stderr: 69650K .......... .......... .......... .......... .......... 75% 369M 0s 2024-09-14T11:36:39.914 INFO:teuthology.orchestra.run.smithi071.stderr: 69700K .......... .......... .......... .......... .......... 75% 385M 0s 2024-09-14T11:36:39.914 INFO:teuthology.orchestra.run.smithi071.stderr: 69750K .......... .......... .......... .......... .......... 75% 232M 0s 2024-09-14T11:36:39.914 INFO:teuthology.orchestra.run.smithi071.stderr: 69800K .......... .......... .......... .......... .......... 75% 382M 0s 2024-09-14T11:36:39.915 INFO:teuthology.orchestra.run.smithi071.stderr: 69850K .......... .......... .......... .......... .......... 75% 384M 0s 2024-09-14T11:36:39.915 INFO:teuthology.orchestra.run.smithi071.stderr: 69900K .......... .......... .......... .......... .......... 75% 223M 0s 2024-09-14T11:36:39.915 INFO:teuthology.orchestra.run.smithi071.stderr: 69950K .......... .......... .......... .......... .......... 75% 241M 0s 2024-09-14T11:36:39.915 INFO:teuthology.orchestra.run.smithi071.stderr: 70000K .......... .......... .......... .......... .......... 75% 385M 0s 2024-09-14T11:36:39.915 INFO:teuthology.orchestra.run.smithi071.stderr: 70050K .......... .......... .......... .......... .......... 75% 361M 0s 2024-09-14T11:36:39.915 INFO:teuthology.orchestra.run.smithi071.stderr: 70100K .......... .......... .......... .......... .......... 75% 357M 0s 2024-09-14T11:36:39.915 INFO:teuthology.orchestra.run.smithi071.stderr: 70150K .......... .......... .......... .......... .......... 75% 315M 0s 2024-09-14T11:36:39.915 INFO:teuthology.orchestra.run.smithi071.stderr: 70200K .......... .......... .......... .......... .......... 75% 363M 0s 2024-09-14T11:36:39.915 INFO:teuthology.orchestra.run.smithi071.stderr: 70250K .......... .......... .......... .......... .......... 75% 383M 0s 2024-09-14T11:36:39.915 INFO:teuthology.orchestra.run.smithi071.stderr: 70300K .......... .......... .......... .......... .......... 75% 389M 0s 2024-09-14T11:36:39.915 INFO:teuthology.orchestra.run.smithi071.stderr: 70350K .......... .......... .......... .......... .......... 75% 306M 0s 2024-09-14T11:36:39.915 INFO:teuthology.orchestra.run.smithi071.stderr: 70400K .......... .......... .......... .......... .......... 75% 388M 0s 2024-09-14T11:36:39.915 INFO:teuthology.orchestra.run.smithi071.stderr: 70450K .......... .......... .......... .......... .......... 75% 351M 0s 2024-09-14T11:36:39.915 INFO:teuthology.orchestra.run.smithi071.stderr: 70500K .......... .......... .......... .......... .......... 75% 367M 0s 2024-09-14T11:36:39.915 INFO:teuthology.orchestra.run.smithi071.stderr: 70550K .......... .......... .......... .......... .......... 75% 324M 0s 2024-09-14T11:36:39.915 INFO:teuthology.orchestra.run.smithi071.stderr: 70600K .......... .......... .......... .......... .......... 76% 371M 0s 2024-09-14T11:36:39.916 INFO:teuthology.orchestra.run.smithi071.stderr: 70650K .......... .......... .......... .......... .......... 76% 366M 0s 2024-09-14T11:36:39.916 INFO:teuthology.orchestra.run.smithi071.stderr: 70700K .......... .......... .......... .......... .......... 76% 381M 0s 2024-09-14T11:36:39.916 INFO:teuthology.orchestra.run.smithi071.stderr: 70750K .......... .......... .......... .......... .......... 76% 316M 0s 2024-09-14T11:36:39.916 INFO:teuthology.orchestra.run.smithi071.stderr: 70800K .......... .......... .......... .......... .......... 76% 379M 0s 2024-09-14T11:36:39.916 INFO:teuthology.orchestra.run.smithi071.stderr: 70850K .......... .......... .......... .......... .......... 76% 243M 0s 2024-09-14T11:36:39.916 INFO:teuthology.orchestra.run.smithi071.stderr: 70900K .......... .......... .......... .......... .......... 76% 355M 0s 2024-09-14T11:36:39.916 INFO:teuthology.orchestra.run.smithi071.stderr: 70950K .......... .......... .......... .......... .......... 76% 328M 0s 2024-09-14T11:36:39.916 INFO:teuthology.orchestra.run.smithi071.stderr: 71000K .......... .......... .......... .......... .......... 76% 341M 0s 2024-09-14T11:36:39.916 INFO:teuthology.orchestra.run.smithi071.stderr: 71050K .......... .......... .......... .......... .......... 76% 344M 0s 2024-09-14T11:36:39.916 INFO:teuthology.orchestra.run.smithi071.stderr: 71100K .......... .......... .......... .......... .......... 76% 336M 0s 2024-09-14T11:36:39.916 INFO:teuthology.orchestra.run.smithi071.stderr: 71150K .......... .......... .......... .......... .......... 76% 297M 0s 2024-09-14T11:36:39.916 INFO:teuthology.orchestra.run.smithi071.stderr: 71200K .......... .......... .......... .......... .......... 76% 367M 0s 2024-09-14T11:36:39.916 INFO:teuthology.orchestra.run.smithi071.stderr: 71250K .......... .......... .......... .......... .......... 76% 367M 0s 2024-09-14T11:36:39.916 INFO:teuthology.orchestra.run.smithi071.stderr: 71300K .......... .......... .......... .......... .......... 76% 367M 0s 2024-09-14T11:36:39.916 INFO:teuthology.orchestra.run.smithi071.stderr: 71350K .......... .......... .......... .......... .......... 76% 347M 0s 2024-09-14T11:36:39.917 INFO:teuthology.orchestra.run.smithi071.stderr: 71400K .......... .......... .......... .......... .......... 76% 372M 0s 2024-09-14T11:36:39.917 INFO:teuthology.orchestra.run.smithi071.stderr: 71450K .......... .......... .......... .......... .......... 76% 11.1M 0s 2024-09-14T11:36:39.917 INFO:teuthology.orchestra.run.smithi071.stderr: 71500K .......... .......... .......... .......... .......... 77% 342M 0s 2024-09-14T11:36:39.917 INFO:teuthology.orchestra.run.smithi071.stderr: 71550K .......... .......... .......... .......... .......... 77% 346M 0s 2024-09-14T11:36:39.917 INFO:teuthology.orchestra.run.smithi071.stderr: 71600K .......... .......... .......... .......... .......... 77% 343M 0s 2024-09-14T11:36:39.917 INFO:teuthology.orchestra.run.smithi071.stderr: 71650K .......... .......... .......... .......... .......... 77% 321M 0s 2024-09-14T11:36:39.917 INFO:teuthology.orchestra.run.smithi071.stderr: 71700K .......... .......... .......... .......... .......... 77% 356M 0s 2024-09-14T11:36:39.917 INFO:teuthology.orchestra.run.smithi071.stderr: 71750K .......... .......... .......... .......... .......... 77% 362M 0s 2024-09-14T11:36:39.917 INFO:teuthology.orchestra.run.smithi071.stderr: 71800K .......... .......... .......... .......... .......... 77% 375M 0s 2024-09-14T11:36:39.917 INFO:teuthology.orchestra.run.smithi071.stderr: 71850K .......... .......... .......... .......... .......... 77% 355M 0s 2024-09-14T11:36:39.917 INFO:teuthology.orchestra.run.smithi071.stderr: 71900K .......... .......... .......... .......... .......... 77% 311M 0s 2024-09-14T11:36:39.917 INFO:teuthology.orchestra.run.smithi071.stderr: 71950K .......... .......... .......... .......... .......... 77% 329M 0s 2024-09-14T11:36:39.917 INFO:teuthology.orchestra.run.smithi071.stderr: 72000K .......... .......... .......... .......... .......... 77% 363M 0s 2024-09-14T11:36:39.917 INFO:teuthology.orchestra.run.smithi071.stderr: 72050K .......... .......... .......... .......... .......... 77% 370M 0s 2024-09-14T11:36:39.917 INFO:teuthology.orchestra.run.smithi071.stderr: 72100K .......... .......... .......... .......... .......... 77% 330M 0s 2024-09-14T11:36:39.918 INFO:teuthology.orchestra.run.smithi071.stderr: 72150K .......... .......... .......... .......... .......... 77% 391M 0s 2024-09-14T11:36:39.918 INFO:teuthology.orchestra.run.smithi071.stderr: 72200K .......... .......... .......... .......... .......... 77% 362M 0s 2024-09-14T11:36:39.918 INFO:teuthology.orchestra.run.smithi071.stderr: 72250K .......... .......... .......... .......... .......... 77% 377M 0s 2024-09-14T11:36:39.918 INFO:teuthology.orchestra.run.smithi071.stderr: 72300K .......... .......... .......... .......... .......... 77% 315M 0s 2024-09-14T11:36:39.918 INFO:teuthology.orchestra.run.smithi071.stderr: 72350K .......... .......... .......... .......... .......... 77% 385M 0s 2024-09-14T11:36:39.918 INFO:teuthology.orchestra.run.smithi071.stderr: 72400K .......... .......... .......... .......... .......... 77% 343M 0s 2024-09-14T11:36:39.918 INFO:teuthology.orchestra.run.smithi071.stderr: 72450K .......... .......... .......... .......... .......... 78% 320M 0s 2024-09-14T11:36:39.918 INFO:teuthology.orchestra.run.smithi071.stderr: 72500K .......... .......... .......... .......... .......... 78% 292M 0s 2024-09-14T11:36:39.918 INFO:teuthology.orchestra.run.smithi071.stderr: 72550K .......... .......... .......... .......... .......... 78% 347M 0s 2024-09-14T11:36:39.918 INFO:teuthology.orchestra.run.smithi071.stderr: 72600K .......... .......... .......... .......... .......... 78% 377M 0s 2024-09-14T11:36:39.918 INFO:teuthology.orchestra.run.smithi071.stderr: 72650K .......... .......... .......... .......... .......... 78% 378M 0s 2024-09-14T11:36:39.918 INFO:teuthology.orchestra.run.smithi071.stderr: 72700K .......... .......... .......... .......... .......... 78% 274M 0s 2024-09-14T11:36:39.918 INFO:teuthology.orchestra.run.smithi071.stderr: 72750K .......... .......... .......... .......... .......... 78% 375M 0s 2024-09-14T11:36:39.918 INFO:teuthology.orchestra.run.smithi071.stderr: 72800K .......... .......... .......... .......... .......... 78% 367M 0s 2024-09-14T11:36:39.918 INFO:teuthology.orchestra.run.smithi071.stderr: 72850K .......... .......... .......... .......... .......... 78% 358M 0s 2024-09-14T11:36:39.918 INFO:teuthology.orchestra.run.smithi071.stderr: 72900K .......... .......... .......... .......... .......... 78% 310M 0s 2024-09-14T11:36:39.919 INFO:teuthology.orchestra.run.smithi071.stderr: 72950K .......... .......... .......... .......... .......... 78% 356M 0s 2024-09-14T11:36:39.919 INFO:teuthology.orchestra.run.smithi071.stderr: 73000K .......... .......... .......... .......... .......... 78% 339M 0s 2024-09-14T11:36:39.919 INFO:teuthology.orchestra.run.smithi071.stderr: 73050K .......... .......... .......... .......... .......... 78% 371M 0s 2024-09-14T11:36:39.919 INFO:teuthology.orchestra.run.smithi071.stderr: 73100K .......... .......... .......... .......... .......... 78% 291M 0s 2024-09-14T11:36:39.919 INFO:teuthology.orchestra.run.smithi071.stderr: 73150K .......... .......... .......... .......... .......... 78% 360M 0s 2024-09-14T11:36:39.919 INFO:teuthology.orchestra.run.smithi071.stderr: 73200K .......... .......... .......... .......... .......... 78% 329M 0s 2024-09-14T11:36:39.919 INFO:teuthology.orchestra.run.smithi071.stderr: 73250K .......... .......... .......... .......... .......... 78% 364M 0s 2024-09-14T11:36:39.919 INFO:teuthology.orchestra.run.smithi071.stderr: 73300K .......... .......... .......... .......... .......... 78% 314M 0s 2024-09-14T11:36:39.919 INFO:teuthology.orchestra.run.smithi071.stderr: 73350K .......... .......... .......... .......... .......... 79% 363M 0s 2024-09-14T11:36:39.919 INFO:teuthology.orchestra.run.smithi071.stderr: 73400K .......... .......... .......... .......... .......... 79% 354M 0s 2024-09-14T11:36:39.919 INFO:teuthology.orchestra.run.smithi071.stderr: 73450K .......... .......... .......... .......... .......... 79% 327M 0s 2024-09-14T11:36:39.919 INFO:teuthology.orchestra.run.smithi071.stderr: 73500K .......... .......... .......... .......... .......... 79% 296M 0s 2024-09-14T11:36:39.919 INFO:teuthology.orchestra.run.smithi071.stderr: 73550K .......... .......... .......... .......... .......... 79% 368M 0s 2024-09-14T11:36:39.919 INFO:teuthology.orchestra.run.smithi071.stderr: 73600K .......... .......... .......... .......... .......... 79% 363M 0s 2024-09-14T11:36:39.919 INFO:teuthology.orchestra.run.smithi071.stderr: 73650K .......... .......... .......... .......... .......... 79% 373M 0s 2024-09-14T11:36:39.919 INFO:teuthology.orchestra.run.smithi071.stderr: 73700K .......... .......... .......... .......... .......... 79% 332M 0s 2024-09-14T11:36:39.920 INFO:teuthology.orchestra.run.smithi071.stderr: 73750K .......... .......... .......... .......... .......... 79% 355M 0s 2024-09-14T11:36:39.920 INFO:teuthology.orchestra.run.smithi071.stderr: 73800K .......... .......... .......... .......... .......... 79% 372M 0s 2024-09-14T11:36:39.920 INFO:teuthology.orchestra.run.smithi071.stderr: 73850K .......... .......... .......... .......... .......... 79% 266M 0s 2024-09-14T11:36:39.920 INFO:teuthology.orchestra.run.smithi071.stderr: 73900K .......... .......... .......... .......... .......... 79% 320M 0s 2024-09-14T11:36:39.920 INFO:teuthology.orchestra.run.smithi071.stderr: 73950K .......... .......... .......... .......... .......... 79% 304M 0s 2024-09-14T11:36:39.920 INFO:teuthology.orchestra.run.smithi071.stderr: 74000K .......... .......... .......... .......... .......... 79% 322M 0s 2024-09-14T11:36:39.920 INFO:teuthology.orchestra.run.smithi071.stderr: 74050K .......... .......... .......... .......... .......... 79% 319M 0s 2024-09-14T11:36:39.920 INFO:teuthology.orchestra.run.smithi071.stderr: 74100K .......... .......... .......... .......... .......... 79% 295M 0s 2024-09-14T11:36:39.920 INFO:teuthology.orchestra.run.smithi071.stderr: 74150K .......... .......... .......... .......... .......... 79% 339M 0s 2024-09-14T11:36:39.920 INFO:teuthology.orchestra.run.smithi071.stderr: 74200K .......... .......... .......... .......... .......... 79% 345M 0s 2024-09-14T11:36:39.920 INFO:teuthology.orchestra.run.smithi071.stderr: 74250K .......... .......... .......... .......... .......... 79% 358M 0s 2024-09-14T11:36:39.920 INFO:teuthology.orchestra.run.smithi071.stderr: 74300K .......... .......... .......... .......... .......... 80% 303M 0s 2024-09-14T11:36:39.920 INFO:teuthology.orchestra.run.smithi071.stderr: 74350K .......... .......... .......... .......... .......... 80% 381M 0s 2024-09-14T11:36:39.920 INFO:teuthology.orchestra.run.smithi071.stderr: 74400K .......... .......... .......... .......... .......... 80% 13.0M 0s 2024-09-14T11:36:39.920 INFO:teuthology.orchestra.run.smithi071.stderr: 74450K .......... .......... .......... .......... .......... 80% 309M 0s 2024-09-14T11:36:39.921 INFO:teuthology.orchestra.run.smithi071.stderr: 74500K .......... .......... .......... .......... .......... 80% 139M 0s 2024-09-14T11:36:39.921 INFO:teuthology.orchestra.run.smithi071.stderr: 74550K .......... .......... .......... .......... .......... 80% 368M 0s 2024-09-14T11:36:39.921 INFO:teuthology.orchestra.run.smithi071.stderr: 74600K .......... .......... .......... .......... .......... 80% 363M 0s 2024-09-14T11:36:39.921 INFO:teuthology.orchestra.run.smithi071.stderr: 74650K .......... .......... .......... .......... .......... 80% 383M 0s 2024-09-14T11:36:39.921 INFO:teuthology.orchestra.run.smithi071.stderr: 74700K .......... .......... .......... .......... .......... 80% 177M 0s 2024-09-14T11:36:39.921 INFO:teuthology.orchestra.run.smithi071.stderr: 74750K .......... .......... .......... .......... .......... 80% 355M 0s 2024-09-14T11:36:39.921 INFO:teuthology.orchestra.run.smithi071.stderr: 74800K .......... .......... .......... .......... .......... 80% 360M 0s 2024-09-14T11:36:39.921 INFO:teuthology.orchestra.run.smithi071.stderr: 74850K .......... .......... .......... .......... .......... 80% 365M 0s 2024-09-14T11:36:39.921 INFO:teuthology.orchestra.run.smithi071.stderr: 74900K .......... .......... .......... .......... .......... 80% 344M 0s 2024-09-14T11:36:39.921 INFO:teuthology.orchestra.run.smithi071.stderr: 74950K .......... .......... .......... .......... .......... 80% 235M 0s 2024-09-14T11:36:39.921 INFO:teuthology.orchestra.run.smithi071.stderr: 75000K .......... .......... .......... .......... .......... 80% 326M 0s 2024-09-14T11:36:39.921 INFO:teuthology.orchestra.run.smithi071.stderr: 75050K .......... .......... .......... .......... .......... 80% 338M 0s 2024-09-14T11:36:39.921 INFO:teuthology.orchestra.run.smithi071.stderr: 75100K .......... .......... .......... .......... .......... 80% 293M 0s 2024-09-14T11:36:39.921 INFO:teuthology.orchestra.run.smithi071.stderr: 75150K .......... .......... .......... .......... .......... 80% 384M 0s 2024-09-14T11:36:39.921 INFO:teuthology.orchestra.run.smithi071.stderr: 75200K .......... .......... .......... .......... .......... 81% 346M 0s 2024-09-14T11:36:39.921 INFO:teuthology.orchestra.run.smithi071.stderr: 75250K .......... .......... .......... .......... .......... 81% 346M 0s 2024-09-14T11:36:39.922 INFO:teuthology.orchestra.run.smithi071.stderr: 75300K .......... .......... .......... .......... .......... 81% 334M 0s 2024-09-14T11:36:39.922 INFO:teuthology.orchestra.run.smithi071.stderr: 75350K .......... .......... .......... .......... .......... 81% 291M 0s 2024-09-14T11:36:39.922 INFO:teuthology.orchestra.run.smithi071.stderr: 75400K .......... .......... .......... .......... .......... 81% 215M 0s 2024-09-14T11:36:39.922 INFO:teuthology.orchestra.run.smithi071.stderr: 75450K .......... .......... .......... .......... .......... 81% 320M 0s 2024-09-14T11:36:39.922 INFO:teuthology.orchestra.run.smithi071.stderr: 75500K .......... .......... .......... .......... .......... 81% 301M 0s 2024-09-14T11:36:39.922 INFO:teuthology.orchestra.run.smithi071.stderr: 75550K .......... .......... .......... .......... .......... 81% 372M 0s 2024-09-14T11:36:39.922 INFO:teuthology.orchestra.run.smithi071.stderr: 75600K .......... .......... .......... .......... .......... 81% 366M 0s 2024-09-14T11:36:39.922 INFO:teuthology.orchestra.run.smithi071.stderr: 75650K .......... .......... .......... .......... .......... 81% 347M 0s 2024-09-14T11:36:39.922 INFO:teuthology.orchestra.run.smithi071.stderr: 75700K .......... .......... .......... .......... .......... 81% 325M 0s 2024-09-14T11:36:39.922 INFO:teuthology.orchestra.run.smithi071.stderr: 75750K .......... .......... .......... .......... .......... 81% 383M 0s 2024-09-14T11:36:39.922 INFO:teuthology.orchestra.run.smithi071.stderr: 75800K .......... .......... .......... .......... .......... 81% 344M 0s 2024-09-14T11:36:39.922 INFO:teuthology.orchestra.run.smithi071.stderr: 75850K .......... .......... .......... .......... .......... 81% 332M 0s 2024-09-14T11:36:39.922 INFO:teuthology.orchestra.run.smithi071.stderr: 75900K .......... .......... .......... .......... .......... 81% 273M 0s 2024-09-14T11:36:39.922 INFO:teuthology.orchestra.run.smithi071.stderr: 75950K .......... .......... .......... .......... .......... 81% 346M 0s 2024-09-14T11:36:39.922 INFO:teuthology.orchestra.run.smithi071.stderr: 76000K .......... .......... .......... .......... .......... 81% 354M 0s 2024-09-14T11:36:39.922 INFO:teuthology.orchestra.run.smithi071.stderr: 76050K .......... .......... .......... .......... .......... 81% 352M 0s 2024-09-14T11:36:39.923 INFO:teuthology.orchestra.run.smithi071.stderr: 76100K .......... .......... .......... .......... .......... 81% 315M 0s 2024-09-14T11:36:39.923 INFO:teuthology.orchestra.run.smithi071.stderr: 76150K .......... .......... .......... .......... .......... 82% 376M 0s 2024-09-14T11:36:39.923 INFO:teuthology.orchestra.run.smithi071.stderr: 76200K .......... .......... .......... .......... .......... 82% 363M 0s 2024-09-14T11:36:39.923 INFO:teuthology.orchestra.run.smithi071.stderr: 76250K .......... .......... .......... .......... .......... 82% 349M 0s 2024-09-14T11:36:39.923 INFO:teuthology.orchestra.run.smithi071.stderr: 76300K .......... .......... .......... .......... .......... 82% 290M 0s 2024-09-14T11:36:39.923 INFO:teuthology.orchestra.run.smithi071.stderr: 76350K .......... .......... .......... .......... .......... 82% 380M 0s 2024-09-14T11:36:39.923 INFO:teuthology.orchestra.run.smithi071.stderr: 76400K .......... .......... .......... .......... .......... 82% 385M 0s 2024-09-14T11:36:39.923 INFO:teuthology.orchestra.run.smithi071.stderr: 76450K .......... .......... .......... .......... .......... 82% 375M 0s 2024-09-14T11:36:39.923 INFO:teuthology.orchestra.run.smithi071.stderr: 76500K .......... .......... .......... .......... .......... 82% 309M 0s 2024-09-14T11:36:39.923 INFO:teuthology.orchestra.run.smithi071.stderr: 76550K .......... .......... .......... .......... .......... 82% 312M 0s 2024-09-14T11:36:39.923 INFO:teuthology.orchestra.run.smithi071.stderr: 76600K .......... .......... .......... .......... .......... 82% 346M 0s 2024-09-14T11:36:39.923 INFO:teuthology.orchestra.run.smithi071.stderr: 76650K .......... .......... .......... .......... .......... 82% 363M 0s 2024-09-14T11:36:39.923 INFO:teuthology.orchestra.run.smithi071.stderr: 76700K .......... .......... .......... .......... .......... 82% 314M 0s 2024-09-14T11:36:39.923 INFO:teuthology.orchestra.run.smithi071.stderr: 76750K .......... .......... .......... .......... .......... 82% 358M 0s 2024-09-14T11:36:39.924 INFO:teuthology.orchestra.run.smithi071.stderr: 76800K .......... .......... .......... .......... .......... 82% 329M 0s 2024-09-14T11:36:39.924 INFO:teuthology.orchestra.run.smithi071.stderr: 76850K .......... .......... .......... .......... .......... 82% 345M 0s 2024-09-14T11:36:39.924 INFO:teuthology.orchestra.run.smithi071.stderr: 76900K .......... .......... .......... .......... .......... 82% 320M 0s 2024-09-14T11:36:39.924 INFO:teuthology.orchestra.run.smithi071.stderr: 76950K .......... .......... .......... .......... .......... 82% 362M 0s 2024-09-14T11:36:39.924 INFO:teuthology.orchestra.run.smithi071.stderr: 77000K .......... .......... .......... .......... .......... 82% 333M 0s 2024-09-14T11:36:39.924 INFO:teuthology.orchestra.run.smithi071.stderr: 77050K .......... .......... .......... .......... .......... 82% 359M 0s 2024-09-14T11:36:39.924 INFO:teuthology.orchestra.run.smithi071.stderr: 77100K .......... .......... .......... .......... .......... 83% 317M 0s 2024-09-14T11:36:39.924 INFO:teuthology.orchestra.run.smithi071.stderr: 77150K .......... .......... .......... .......... .......... 83% 382M 0s 2024-09-14T11:36:39.924 INFO:teuthology.orchestra.run.smithi071.stderr: 77200K .......... .......... .......... .......... .......... 83% 381M 0s 2024-09-14T11:36:39.924 INFO:teuthology.orchestra.run.smithi071.stderr: 77250K .......... .......... .......... .......... .......... 83% 381M 0s 2024-09-14T11:36:39.924 INFO:teuthology.orchestra.run.smithi071.stderr: 77300K .......... .......... .......... .......... .......... 83% 13.6M 0s 2024-09-14T11:36:39.924 INFO:teuthology.orchestra.run.smithi071.stderr: 77350K .......... .......... .......... .......... .......... 83% 326M 0s 2024-09-14T11:36:39.924 INFO:teuthology.orchestra.run.smithi071.stderr: 77400K .......... .......... .......... .......... .......... 83% 369M 0s 2024-09-14T11:36:39.924 INFO:teuthology.orchestra.run.smithi071.stderr: 77450K .......... .......... .......... .......... .......... 83% 351M 0s 2024-09-14T11:36:39.925 INFO:teuthology.orchestra.run.smithi071.stderr: 77500K .......... .......... .......... .......... .......... 83% 302M 0s 2024-09-14T11:36:39.925 INFO:teuthology.orchestra.run.smithi071.stderr: 77550K .......... .......... .......... .......... .......... 83% 382M 0s 2024-09-14T11:36:39.925 INFO:teuthology.orchestra.run.smithi071.stderr: 77600K .......... .......... .......... .......... .......... 83% 120M 0s 2024-09-14T11:36:39.925 INFO:teuthology.orchestra.run.smithi071.stderr: 77650K .......... .......... .......... .......... .......... 83% 336M 0s 2024-09-14T11:36:39.925 INFO:teuthology.orchestra.run.smithi071.stderr: 77700K .......... .......... .......... .......... .......... 83% 328M 0s 2024-09-14T11:36:39.925 INFO:teuthology.orchestra.run.smithi071.stderr: 77750K .......... .......... .......... .......... .......... 83% 334M 0s 2024-09-14T11:36:39.925 INFO:teuthology.orchestra.run.smithi071.stderr: 77800K .......... .......... .......... .......... .......... 83% 368M 0s 2024-09-14T11:36:39.925 INFO:teuthology.orchestra.run.smithi071.stderr: 77850K .......... .......... .......... .......... .......... 83% 170M 0s 2024-09-14T11:36:39.925 INFO:teuthology.orchestra.run.smithi071.stderr: 77900K .......... .......... .......... .......... .......... 83% 193M 0s 2024-09-14T11:36:39.925 INFO:teuthology.orchestra.run.smithi071.stderr: 77950K .......... .......... .......... .......... .......... 83% 332M 0s 2024-09-14T11:36:39.925 INFO:teuthology.orchestra.run.smithi071.stderr: 78000K .......... .......... .......... .......... .......... 84% 356M 0s 2024-09-14T11:36:39.925 INFO:teuthology.orchestra.run.smithi071.stderr: 78050K .......... .......... .......... .......... .......... 84% 365M 0s 2024-09-14T11:36:39.925 INFO:teuthology.orchestra.run.smithi071.stderr: 78100K .......... .......... .......... .......... .......... 84% 334M 0s 2024-09-14T11:36:39.926 INFO:teuthology.orchestra.run.smithi071.stderr: 78150K .......... .......... .......... .......... .......... 84% 365M 0s 2024-09-14T11:36:39.926 INFO:teuthology.orchestra.run.smithi071.stderr: 78200K .......... .......... .......... .......... .......... 84% 384M 0s 2024-09-14T11:36:39.926 INFO:teuthology.orchestra.run.smithi071.stderr: 78250K .......... .......... .......... .......... .......... 84% 362M 0s 2024-09-14T11:36:39.926 INFO:teuthology.orchestra.run.smithi071.stderr: 78300K .......... .......... .......... .......... .......... 84% 288M 0s 2024-09-14T11:36:39.926 INFO:teuthology.orchestra.run.smithi071.stderr: 78350K .......... .......... .......... .......... .......... 84% 356M 0s 2024-09-14T11:36:39.926 INFO:teuthology.orchestra.run.smithi071.stderr: 78400K .......... .......... .......... .......... .......... 84% 388M 0s 2024-09-14T11:36:39.926 INFO:teuthology.orchestra.run.smithi071.stderr: 78450K .......... .......... .......... .......... .......... 84% 389M 0s 2024-09-14T11:36:39.926 INFO:teuthology.orchestra.run.smithi071.stderr: 78500K .......... .......... .......... .......... .......... 84% 269M 0s 2024-09-14T11:36:39.926 INFO:teuthology.orchestra.run.smithi071.stderr: 78550K .......... .......... .......... .......... .......... 84% 363M 0s 2024-09-14T11:36:39.926 INFO:teuthology.orchestra.run.smithi071.stderr: 78600K .......... .......... .......... .......... .......... 84% 353M 0s 2024-09-14T11:36:39.926 INFO:teuthology.orchestra.run.smithi071.stderr: 78650K .......... .......... .......... .......... .......... 84% 362M 0s 2024-09-14T11:36:39.926 INFO:teuthology.orchestra.run.smithi071.stderr: 78700K .......... .......... .......... .......... .......... 84% 302M 0s 2024-09-14T11:36:39.926 INFO:teuthology.orchestra.run.smithi071.stderr: 78750K .......... .......... .......... .......... .......... 84% 368M 0s 2024-09-14T11:36:39.926 INFO:teuthology.orchestra.run.smithi071.stderr: 78800K .......... .......... .......... .......... .......... 84% 201M 0s 2024-09-14T11:36:39.927 INFO:teuthology.orchestra.run.smithi071.stderr: 78850K .......... .......... .......... .......... .......... 84% 268M 0s 2024-09-14T11:36:39.927 INFO:teuthology.orchestra.run.smithi071.stderr: 78900K .......... .......... .......... .......... .......... 84% 307M 0s 2024-09-14T11:36:39.927 INFO:teuthology.orchestra.run.smithi071.stderr: 78950K .......... .......... .......... .......... .......... 85% 365M 0s 2024-09-14T11:36:39.927 INFO:teuthology.orchestra.run.smithi071.stderr: 79000K .......... .......... .......... .......... .......... 85% 368M 0s 2024-09-14T11:36:39.927 INFO:teuthology.orchestra.run.smithi071.stderr: 79050K .......... .......... .......... .......... .......... 85% 343M 0s 2024-09-14T11:36:39.927 INFO:teuthology.orchestra.run.smithi071.stderr: 79100K .......... .......... .......... .......... .......... 85% 300M 0s 2024-09-14T11:36:39.927 INFO:teuthology.orchestra.run.smithi071.stderr: 79150K .......... .......... .......... .......... .......... 85% 381M 0s 2024-09-14T11:36:39.927 INFO:teuthology.orchestra.run.smithi071.stderr: 79200K .......... .......... .......... .......... .......... 85% 389M 0s 2024-09-14T11:36:39.927 INFO:teuthology.orchestra.run.smithi071.stderr: 79250K .......... .......... .......... .......... .......... 85% 351M 0s 2024-09-14T11:36:39.927 INFO:teuthology.orchestra.run.smithi071.stderr: 79300K .......... .......... .......... .......... .......... 85% 306M 0s 2024-09-14T11:36:39.927 INFO:teuthology.orchestra.run.smithi071.stderr: 79350K .......... .......... .......... .......... .......... 85% 327M 0s 2024-09-14T11:36:39.927 INFO:teuthology.orchestra.run.smithi071.stderr: 79400K .......... .......... .......... .......... .......... 85% 338M 0s 2024-09-14T11:36:39.927 INFO:teuthology.orchestra.run.smithi071.stderr: 79450K .......... .......... .......... .......... .......... 85% 369M 0s 2024-09-14T11:36:39.927 INFO:teuthology.orchestra.run.smithi071.stderr: 79500K .......... .......... .......... .......... .......... 85% 319M 0s 2024-09-14T11:36:39.927 INFO:teuthology.orchestra.run.smithi071.stderr: 79550K .......... .......... .......... .......... .......... 85% 346M 0s 2024-09-14T11:36:39.927 INFO:teuthology.orchestra.run.smithi071.stderr: 79600K .......... .......... .......... .......... .......... 85% 360M 0s 2024-09-14T11:36:39.928 INFO:teuthology.orchestra.run.smithi071.stderr: 79650K .......... .......... .......... .......... .......... 85% 388M 0s 2024-09-14T11:36:39.928 INFO:teuthology.orchestra.run.smithi071.stderr: 79700K .......... .......... .......... .......... .......... 85% 327M 0s 2024-09-14T11:36:39.928 INFO:teuthology.orchestra.run.smithi071.stderr: 79750K .......... .......... .......... .......... .......... 85% 280M 0s 2024-09-14T11:36:39.928 INFO:teuthology.orchestra.run.smithi071.stderr: 79800K .......... .......... .......... .......... .......... 85% 357M 0s 2024-09-14T11:36:39.928 INFO:teuthology.orchestra.run.smithi071.stderr: 79850K .......... .......... .......... .......... .......... 86% 380M 0s 2024-09-14T11:36:39.928 INFO:teuthology.orchestra.run.smithi071.stderr: 79900K .......... .......... .......... .......... .......... 86% 298M 0s 2024-09-14T11:36:39.928 INFO:teuthology.orchestra.run.smithi071.stderr: 79950K .......... .......... .......... .......... .......... 86% 349M 0s 2024-09-14T11:36:39.928 INFO:teuthology.orchestra.run.smithi071.stderr: 80000K .......... .......... .......... .......... .......... 86% 346M 0s 2024-09-14T11:36:39.928 INFO:teuthology.orchestra.run.smithi071.stderr: 80050K .......... .......... .......... .......... .......... 86% 362M 0s 2024-09-14T11:36:39.928 INFO:teuthology.orchestra.run.smithi071.stderr: 80100K .......... .......... .......... .......... .......... 86% 340M 0s 2024-09-14T11:36:39.928 INFO:teuthology.orchestra.run.smithi071.stderr: 80150K .......... .......... .......... .......... .......... 86% 12.9M 0s 2024-09-14T11:36:39.928 INFO:teuthology.orchestra.run.smithi071.stderr: 80200K .......... .......... .......... .......... .......... 86% 359M 0s 2024-09-14T11:36:39.928 INFO:teuthology.orchestra.run.smithi071.stderr: 80250K .......... .......... .......... .......... .......... 86% 354M 0s 2024-09-14T11:36:39.928 INFO:teuthology.orchestra.run.smithi071.stderr: 80300K .......... .......... .......... .......... .......... 86% 278M 0s 2024-09-14T11:36:39.928 INFO:teuthology.orchestra.run.smithi071.stderr: 80350K .......... .......... .......... .......... .......... 86% 347M 0s 2024-09-14T11:36:39.929 INFO:teuthology.orchestra.run.smithi071.stderr: 80400K .......... .......... .......... .......... .......... 86% 381M 0s 2024-09-14T11:36:39.929 INFO:teuthology.orchestra.run.smithi071.stderr: 80450K .......... .......... .......... .......... .......... 86% 361M 0s 2024-09-14T11:36:39.929 INFO:teuthology.orchestra.run.smithi071.stderr: 80500K .......... .......... .......... .......... .......... 86% 334M 0s 2024-09-14T11:36:39.929 INFO:teuthology.orchestra.run.smithi071.stderr: 80550K .......... .......... .......... .......... .......... 86% 338M 0s 2024-09-14T11:36:39.929 INFO:teuthology.orchestra.run.smithi071.stderr: 80600K .......... .......... .......... .......... .......... 86% 365M 0s 2024-09-14T11:36:39.929 INFO:teuthology.orchestra.run.smithi071.stderr: 80650K .......... .......... .......... .......... .......... 86% 342M 0s 2024-09-14T11:36:39.929 INFO:teuthology.orchestra.run.smithi071.stderr: 80700K .......... .......... .......... .......... .......... 86% 305M 0s 2024-09-14T11:36:39.929 INFO:teuthology.orchestra.run.smithi071.stderr: 80750K .......... .......... .......... .......... .......... 86% 379M 0s 2024-09-14T11:36:39.929 INFO:teuthology.orchestra.run.smithi071.stderr: 80800K .......... .......... .......... .......... .......... 87% 369M 0s 2024-09-14T11:36:39.929 INFO:teuthology.orchestra.run.smithi071.stderr: 80850K .......... .......... .......... .......... .......... 87% 356M 0s 2024-09-14T11:36:39.929 INFO:teuthology.orchestra.run.smithi071.stderr: 80900K .......... .......... .......... .......... .......... 87% 323M 0s 2024-09-14T11:36:39.929 INFO:teuthology.orchestra.run.smithi071.stderr: 80950K .......... .......... .......... .......... .......... 87% 349M 0s 2024-09-14T11:36:39.929 INFO:teuthology.orchestra.run.smithi071.stderr: 81000K .......... .......... .......... .......... .......... 87% 325M 0s 2024-09-14T11:36:39.929 INFO:teuthology.orchestra.run.smithi071.stderr: 81050K .......... .......... .......... .......... .......... 87% 366M 0s 2024-09-14T11:36:39.929 INFO:teuthology.orchestra.run.smithi071.stderr: 81100K .......... .......... .......... .......... .......... 87% 195M 0s 2024-09-14T11:36:39.929 INFO:teuthology.orchestra.run.smithi071.stderr: 81150K .......... .......... .......... .......... .......... 87% 346M 0s 2024-09-14T11:36:39.930 INFO:teuthology.orchestra.run.smithi071.stderr: 81200K .......... .......... .......... .......... .......... 87% 349M 0s 2024-09-14T11:36:39.930 INFO:teuthology.orchestra.run.smithi071.stderr: 81250K .......... .......... .......... .......... .......... 87% 350M 0s 2024-09-14T11:36:39.930 INFO:teuthology.orchestra.run.smithi071.stderr: 81300K .......... .......... .......... .......... .......... 87% 313M 0s 2024-09-14T11:36:39.930 INFO:teuthology.orchestra.run.smithi071.stderr: 81350K .......... .......... .......... .......... .......... 87% 357M 0s 2024-09-14T11:36:39.930 INFO:teuthology.orchestra.run.smithi071.stderr: 81400K .......... .......... .......... .......... .......... 87% 348M 0s 2024-09-14T11:36:39.930 INFO:teuthology.orchestra.run.smithi071.stderr: 81450K .......... .......... .......... .......... .......... 87% 352M 0s 2024-09-14T11:36:39.930 INFO:teuthology.orchestra.run.smithi071.stderr: 81500K .......... .......... .......... .......... .......... 87% 297M 0s 2024-09-14T11:36:39.930 INFO:teuthology.orchestra.run.smithi071.stderr: 81550K .......... .......... .......... .......... .......... 87% 336M 0s 2024-09-14T11:36:39.930 INFO:teuthology.orchestra.run.smithi071.stderr: 81600K .......... .......... .......... .......... .......... 87% 350M 0s 2024-09-14T11:36:39.930 INFO:teuthology.orchestra.run.smithi071.stderr: 81650K .......... .......... .......... .......... .......... 87% 349M 0s 2024-09-14T11:36:39.930 INFO:teuthology.orchestra.run.smithi071.stderr: 81700K .......... .......... .......... .......... .......... 87% 330M 0s 2024-09-14T11:36:39.930 INFO:teuthology.orchestra.run.smithi071.stderr: 81750K .......... .......... .......... .......... .......... 88% 163M 0s 2024-09-14T11:36:39.930 INFO:teuthology.orchestra.run.smithi071.stderr: 81800K .......... .......... .......... .......... .......... 88% 334M 0s 2024-09-14T11:36:39.930 INFO:teuthology.orchestra.run.smithi071.stderr: 81850K .......... .......... .......... .......... .......... 88% 343M 0s 2024-09-14T11:36:39.930 INFO:teuthology.orchestra.run.smithi071.stderr: 81900K .......... .......... .......... .......... .......... 88% 326M 0s 2024-09-14T11:36:39.931 INFO:teuthology.orchestra.run.smithi071.stderr: 81950K .......... .......... .......... .......... .......... 88% 287M 0s 2024-09-14T11:36:39.931 INFO:teuthology.orchestra.run.smithi071.stderr: 82000K .......... .......... .......... .......... .......... 88% 290M 0s 2024-09-14T11:36:39.931 INFO:teuthology.orchestra.run.smithi071.stderr: 82050K .......... .......... .......... .......... .......... 88% 344M 0s 2024-09-14T11:36:39.931 INFO:teuthology.orchestra.run.smithi071.stderr: 82100K .......... .......... .......... .......... .......... 88% 368M 0s 2024-09-14T11:36:39.931 INFO:teuthology.orchestra.run.smithi071.stderr: 82150K .......... .......... .......... .......... .......... 88% 291M 0s 2024-09-14T11:36:39.931 INFO:teuthology.orchestra.run.smithi071.stderr: 82200K .......... .......... .......... .......... .......... 88% 330M 0s 2024-09-14T11:36:39.931 INFO:teuthology.orchestra.run.smithi071.stderr: 82250K .......... .......... .......... .......... .......... 88% 349M 0s 2024-09-14T11:36:39.931 INFO:teuthology.orchestra.run.smithi071.stderr: 82300K .......... .......... .......... .......... .......... 88% 353M 0s 2024-09-14T11:36:39.931 INFO:teuthology.orchestra.run.smithi071.stderr: 82350K .......... .......... .......... .......... .......... 88% 298M 0s 2024-09-14T11:36:39.931 INFO:teuthology.orchestra.run.smithi071.stderr: 82400K .......... .......... .......... .......... .......... 88% 347M 0s 2024-09-14T11:36:39.931 INFO:teuthology.orchestra.run.smithi071.stderr: 82450K .......... .......... .......... .......... .......... 88% 356M 0s 2024-09-14T11:36:39.931 INFO:teuthology.orchestra.run.smithi071.stderr: 82500K .......... .......... .......... .......... .......... 88% 342M 0s 2024-09-14T11:36:39.931 INFO:teuthology.orchestra.run.smithi071.stderr: 82550K .......... .......... .......... .......... .......... 88% 327M 0s 2024-09-14T11:36:39.931 INFO:teuthology.orchestra.run.smithi071.stderr: 82600K .......... .......... .......... .......... .......... 88% 342M 0s 2024-09-14T11:36:39.931 INFO:teuthology.orchestra.run.smithi071.stderr: 82650K .......... .......... .......... .......... .......... 89% 345M 0s 2024-09-14T11:36:39.931 INFO:teuthology.orchestra.run.smithi071.stderr: 82700K .......... .......... .......... .......... .......... 89% 324M 0s 2024-09-14T11:36:39.932 INFO:teuthology.orchestra.run.smithi071.stderr: 82750K .......... .......... .......... .......... .......... 89% 287M 0s 2024-09-14T11:36:39.932 INFO:teuthology.orchestra.run.smithi071.stderr: 82800K .......... .......... .......... .......... .......... 89% 307M 0s 2024-09-14T11:36:39.932 INFO:teuthology.orchestra.run.smithi071.stderr: 82850K .......... .......... .......... .......... .......... 89% 316M 0s 2024-09-14T11:36:39.932 INFO:teuthology.orchestra.run.smithi071.stderr: 82900K .......... .......... .......... .......... .......... 89% 361M 0s 2024-09-14T11:36:39.932 INFO:teuthology.orchestra.run.smithi071.stderr: 82950K .......... .......... .......... .......... .......... 89% 329M 0s 2024-09-14T11:36:39.932 INFO:teuthology.orchestra.run.smithi071.stderr: 83000K .......... .......... .......... .......... .......... 89% 12.4M 0s 2024-09-14T11:36:39.932 INFO:teuthology.orchestra.run.smithi071.stderr: 83050K .......... .......... .......... .......... .......... 89% 328M 0s 2024-09-14T11:36:39.932 INFO:teuthology.orchestra.run.smithi071.stderr: 83100K .......... .......... .......... .......... .......... 89% 380M 0s 2024-09-14T11:36:39.932 INFO:teuthology.orchestra.run.smithi071.stderr: 83150K .......... .......... .......... .......... .......... 89% 303M 0s 2024-09-14T11:36:39.932 INFO:teuthology.orchestra.run.smithi071.stderr: 83200K .......... .......... .......... .......... .......... 89% 359M 0s 2024-09-14T11:36:39.932 INFO:teuthology.orchestra.run.smithi071.stderr: 83250K .......... .......... .......... .......... .......... 89% 344M 0s 2024-09-14T11:36:39.932 INFO:teuthology.orchestra.run.smithi071.stderr: 83300K .......... .......... .......... .......... .......... 89% 323M 0s 2024-09-14T11:36:39.932 INFO:teuthology.orchestra.run.smithi071.stderr: 83350K .......... .......... .......... .......... .......... 89% 326M 0s 2024-09-14T11:36:39.932 INFO:teuthology.orchestra.run.smithi071.stderr: 83400K .......... .......... .......... .......... .......... 89% 324M 0s 2024-09-14T11:36:39.933 INFO:teuthology.orchestra.run.smithi071.stderr: 83450K .......... .......... .......... .......... .......... 89% 375M 0s 2024-09-14T11:36:39.933 INFO:teuthology.orchestra.run.smithi071.stderr: 83500K .......... .......... .......... .......... .......... 89% 380M 0s 2024-09-14T11:36:39.933 INFO:teuthology.orchestra.run.smithi071.stderr: 83550K .......... .......... .......... .......... .......... 89% 315M 0s 2024-09-14T11:36:39.933 INFO:teuthology.orchestra.run.smithi071.stderr: 83600K .......... .......... .......... .......... .......... 90% 321M 0s 2024-09-14T11:36:39.933 INFO:teuthology.orchestra.run.smithi071.stderr: 83650K .......... .......... .......... .......... .......... 90% 349M 0s 2024-09-14T11:36:39.933 INFO:teuthology.orchestra.run.smithi071.stderr: 83700K .......... .......... .......... .......... .......... 90% 348M 0s 2024-09-14T11:36:39.933 INFO:teuthology.orchestra.run.smithi071.stderr: 83750K .......... .......... .......... .......... .......... 90% 330M 0s 2024-09-14T11:36:39.933 INFO:teuthology.orchestra.run.smithi071.stderr: 83800K .......... .......... .......... .......... .......... 90% 372M 0s 2024-09-14T11:36:39.933 INFO:teuthology.orchestra.run.smithi071.stderr: 83850K .......... .......... .......... .......... .......... 90% 372M 0s 2024-09-14T11:36:39.933 INFO:teuthology.orchestra.run.smithi071.stderr: 83900K .......... .......... .......... .......... .......... 90% 342M 0s 2024-09-14T11:36:39.933 INFO:teuthology.orchestra.run.smithi071.stderr: 83950K .......... .......... .......... .......... .......... 90% 288M 0s 2024-09-14T11:36:39.933 INFO:teuthology.orchestra.run.smithi071.stderr: 84000K .......... .......... .......... .......... .......... 90% 337M 0s 2024-09-14T11:36:39.933 INFO:teuthology.orchestra.run.smithi071.stderr: 84050K .......... .......... .......... .......... .......... 90% 322M 0s 2024-09-14T11:36:39.933 INFO:teuthology.orchestra.run.smithi071.stderr: 84100K .......... .......... .......... .......... .......... 90% 334M 0s 2024-09-14T11:36:39.933 INFO:teuthology.orchestra.run.smithi071.stderr: 84150K .......... .......... .......... .......... .......... 90% 310M 0s 2024-09-14T11:36:39.933 INFO:teuthology.orchestra.run.smithi071.stderr: 84200K .......... .......... .......... .......... .......... 90% 369M 0s 2024-09-14T11:36:39.934 INFO:teuthology.orchestra.run.smithi071.stderr: 84250K .......... .......... .......... .......... .......... 90% 368M 0s 2024-09-14T11:36:39.934 INFO:teuthology.orchestra.run.smithi071.stderr: 84300K .......... .......... .......... .......... .......... 90% 306M 0s 2024-09-14T11:36:39.934 INFO:teuthology.orchestra.run.smithi071.stderr: 84350K .......... .......... .......... .......... .......... 90% 285M 0s 2024-09-14T11:36:39.934 INFO:teuthology.orchestra.run.smithi071.stderr: 84400K .......... .......... .......... .......... .......... 90% 327M 0s 2024-09-14T11:36:39.934 INFO:teuthology.orchestra.run.smithi071.stderr: 84450K .......... .......... .......... .......... .......... 90% 345M 0s 2024-09-14T11:36:39.934 INFO:teuthology.orchestra.run.smithi071.stderr: 84500K .......... .......... .......... .......... .......... 91% 369M 0s 2024-09-14T11:36:39.934 INFO:teuthology.orchestra.run.smithi071.stderr: 84550K .......... .......... .......... .......... .......... 91% 334M 0s 2024-09-14T11:36:39.934 INFO:teuthology.orchestra.run.smithi071.stderr: 84600K .......... .......... .......... .......... .......... 91% 356M 0s 2024-09-14T11:36:39.934 INFO:teuthology.orchestra.run.smithi071.stderr: 84650K .......... .......... .......... .......... .......... 91% 332M 0s 2024-09-14T11:36:39.934 INFO:teuthology.orchestra.run.smithi071.stderr: 84700K .......... .......... .......... .......... .......... 91% 332M 0s 2024-09-14T11:36:39.934 INFO:teuthology.orchestra.run.smithi071.stderr: 84750K .......... .......... .......... .......... .......... 91% 286M 0s 2024-09-14T11:36:39.934 INFO:teuthology.orchestra.run.smithi071.stderr: 84800K .......... .......... .......... .......... .......... 91% 347M 0s 2024-09-14T11:36:39.934 INFO:teuthology.orchestra.run.smithi071.stderr: 84850K .......... .......... .......... .......... .......... 91% 343M 0s 2024-09-14T11:36:39.934 INFO:teuthology.orchestra.run.smithi071.stderr: 84900K .......... .......... .......... .......... .......... 91% 334M 0s 2024-09-14T11:36:39.934 INFO:teuthology.orchestra.run.smithi071.stderr: 84950K .......... .......... .......... .......... .......... 91% 266M 0s 2024-09-14T11:36:39.935 INFO:teuthology.orchestra.run.smithi071.stderr: 85000K .......... .......... .......... .......... .......... 91% 342M 0s 2024-09-14T11:36:39.935 INFO:teuthology.orchestra.run.smithi071.stderr: 85050K .......... .......... .......... .......... .......... 91% 371M 0s 2024-09-14T11:36:39.935 INFO:teuthology.orchestra.run.smithi071.stderr: 85100K .......... .......... .......... .......... .......... 91% 376M 0s 2024-09-14T11:36:39.935 INFO:teuthology.orchestra.run.smithi071.stderr: 85150K .......... .......... .......... .......... .......... 91% 214M 0s 2024-09-14T11:36:39.935 INFO:teuthology.orchestra.run.smithi071.stderr: 85200K .......... .......... .......... .......... .......... 91% 327M 0s 2024-09-14T11:36:39.935 INFO:teuthology.orchestra.run.smithi071.stderr: 85250K .......... .......... .......... .......... .......... 91% 313M 0s 2024-09-14T11:36:39.935 INFO:teuthology.orchestra.run.smithi071.stderr: 85300K .......... .......... .......... .......... .......... 91% 331M 0s 2024-09-14T11:36:39.935 INFO:teuthology.orchestra.run.smithi071.stderr: 85350K .......... .......... .......... .......... .......... 91% 313M 0s 2024-09-14T11:36:39.935 INFO:teuthology.orchestra.run.smithi071.stderr: 85400K .......... .......... .......... .......... .......... 91% 369M 0s 2024-09-14T11:36:39.935 INFO:teuthology.orchestra.run.smithi071.stderr: 85450K .......... .......... .......... .......... .......... 92% 355M 0s 2024-09-14T11:36:39.935 INFO:teuthology.orchestra.run.smithi071.stderr: 85500K .......... .......... .......... .......... .......... 92% 350M 0s 2024-09-14T11:36:39.935 INFO:teuthology.orchestra.run.smithi071.stderr: 85550K .......... .......... .......... .......... .......... 92% 314M 0s 2024-09-14T11:36:39.935 INFO:teuthology.orchestra.run.smithi071.stderr: 85600K .......... .......... .......... .......... .......... 92% 332M 0s 2024-09-14T11:36:39.935 INFO:teuthology.orchestra.run.smithi071.stderr: 85650K .......... .......... .......... .......... .......... 92% 335M 0s 2024-09-14T11:36:39.935 INFO:teuthology.orchestra.run.smithi071.stderr: 85700K .......... .......... .......... .......... .......... 92% 343M 0s 2024-09-14T11:36:39.936 INFO:teuthology.orchestra.run.smithi071.stderr: 85750K .......... .......... .......... .......... .......... 92% 308M 0s 2024-09-14T11:36:39.936 INFO:teuthology.orchestra.run.smithi071.stderr: 85800K .......... .......... .......... .......... .......... 92% 369M 0s 2024-09-14T11:36:39.936 INFO:teuthology.orchestra.run.smithi071.stderr: 85850K .......... .......... .......... .......... .......... 92% 377M 0s 2024-09-14T11:36:39.936 INFO:teuthology.orchestra.run.smithi071.stderr: 85900K .......... .......... .......... .......... .......... 92% 380M 0s 2024-09-14T11:36:39.936 INFO:teuthology.orchestra.run.smithi071.stderr: 85950K .......... .......... .......... .......... .......... 92% 12.2M 0s 2024-09-14T11:36:39.936 INFO:teuthology.orchestra.run.smithi071.stderr: 86000K .......... .......... .......... .......... .......... 92% 339M 0s 2024-09-14T11:36:39.936 INFO:teuthology.orchestra.run.smithi071.stderr: 86050K .......... .......... .......... .......... .......... 92% 367M 0s 2024-09-14T11:36:39.936 INFO:teuthology.orchestra.run.smithi071.stderr: 86100K .......... .......... .......... .......... .......... 92% 259M 0s 2024-09-14T11:36:39.936 INFO:teuthology.orchestra.run.smithi071.stderr: 86150K .......... .......... .......... .......... .......... 92% 297M 0s 2024-09-14T11:36:39.936 INFO:teuthology.orchestra.run.smithi071.stderr: 86200K .......... .......... .......... .......... .......... 92% 372M 0s 2024-09-14T11:36:39.936 INFO:teuthology.orchestra.run.smithi071.stderr: 86250K .......... .......... .......... .......... .......... 92% 378M 0s 2024-09-14T11:36:39.936 INFO:teuthology.orchestra.run.smithi071.stderr: 86300K .......... .......... .......... .......... .......... 92% 336M 0s 2024-09-14T11:36:39.936 INFO:teuthology.orchestra.run.smithi071.stderr: 86350K .......... .......... .......... .......... .......... 93% 284M 0s 2024-09-14T11:36:39.936 INFO:teuthology.orchestra.run.smithi071.stderr: 86400K .......... .......... .......... .......... .......... 93% 363M 0s 2024-09-14T11:36:39.936 INFO:teuthology.orchestra.run.smithi071.stderr: 86450K .......... .......... .......... .......... .......... 93% 353M 0s 2024-09-14T11:36:39.937 INFO:teuthology.orchestra.run.smithi071.stderr: 86500K .......... .......... .......... .......... .......... 93% 359M 0s 2024-09-14T11:36:39.937 INFO:teuthology.orchestra.run.smithi071.stderr: 86550K .......... .......... .......... .......... .......... 93% 322M 0s 2024-09-14T11:36:39.937 INFO:teuthology.orchestra.run.smithi071.stderr: 86600K .......... .......... .......... .......... .......... 93% 374M 0s 2024-09-14T11:36:39.937 INFO:teuthology.orchestra.run.smithi071.stderr: 86650K .......... .......... .......... .......... .......... 93% 366M 0s 2024-09-14T11:36:39.937 INFO:teuthology.orchestra.run.smithi071.stderr: 86700K .......... .......... .......... .......... .......... 93% 377M 0s 2024-09-14T11:36:39.937 INFO:teuthology.orchestra.run.smithi071.stderr: 86750K .......... .......... .......... .......... .......... 93% 299M 0s 2024-09-14T11:36:39.937 INFO:teuthology.orchestra.run.smithi071.stderr: 86800K .......... .......... .......... .......... .......... 93% 358M 0s 2024-09-14T11:36:39.937 INFO:teuthology.orchestra.run.smithi071.stderr: 86850K .......... .......... .......... .......... .......... 93% 363M 0s 2024-09-14T11:36:39.937 INFO:teuthology.orchestra.run.smithi071.stderr: 86900K .......... .......... .......... .......... .......... 93% 351M 0s 2024-09-14T11:36:39.937 INFO:teuthology.orchestra.run.smithi071.stderr: 86950K .......... .......... .......... .......... .......... 93% 319M 0s 2024-09-14T11:36:39.937 INFO:teuthology.orchestra.run.smithi071.stderr: 87000K .......... .......... .......... .......... .......... 93% 341M 0s 2024-09-14T11:36:39.937 INFO:teuthology.orchestra.run.smithi071.stderr: 87050K .......... .......... .......... .......... .......... 93% 375M 0s 2024-09-14T11:36:39.937 INFO:teuthology.orchestra.run.smithi071.stderr: 87100K .......... .......... .......... .......... .......... 93% 377M 0s 2024-09-14T11:36:39.937 INFO:teuthology.orchestra.run.smithi071.stderr: 87150K .......... .......... .......... .......... .......... 93% 311M 0s 2024-09-14T11:36:39.937 INFO:teuthology.orchestra.run.smithi071.stderr: 87200K .......... .......... .......... .......... .......... 93% 353M 0s 2024-09-14T11:36:39.937 INFO:teuthology.orchestra.run.smithi071.stderr: 87250K .......... .......... .......... .......... .......... 93% 358M 0s 2024-09-14T11:36:39.938 INFO:teuthology.orchestra.run.smithi071.stderr: 87300K .......... .......... .......... .......... .......... 94% 379M 0s 2024-09-14T11:36:39.938 INFO:teuthology.orchestra.run.smithi071.stderr: 87350K .......... .......... .......... .......... .......... 94% 340M 0s 2024-09-14T11:36:39.938 INFO:teuthology.orchestra.run.smithi071.stderr: 87400K .......... .......... .......... .......... .......... 94% 339M 0s 2024-09-14T11:36:39.938 INFO:teuthology.orchestra.run.smithi071.stderr: 87450K .......... .......... .......... .......... .......... 94% 363M 0s 2024-09-14T11:36:39.938 INFO:teuthology.orchestra.run.smithi071.stderr: 87500K .......... .......... .......... .......... .......... 94% 345M 0s 2024-09-14T11:36:39.938 INFO:teuthology.orchestra.run.smithi071.stderr: 87550K .......... .......... .......... .......... .......... 94% 290M 0s 2024-09-14T11:36:39.938 INFO:teuthology.orchestra.run.smithi071.stderr: 87600K .......... .......... .......... .......... .......... 94% 354M 0s 2024-09-14T11:36:39.938 INFO:teuthology.orchestra.run.smithi071.stderr: 87650K .......... .......... .......... .......... .......... 94% 357M 0s 2024-09-14T11:36:39.938 INFO:teuthology.orchestra.run.smithi071.stderr: 87700K .......... .......... .......... .......... .......... 94% 352M 0s 2024-09-14T11:36:39.938 INFO:teuthology.orchestra.run.smithi071.stderr: 87750K .......... .......... .......... .......... .......... 94% 305M 0s 2024-09-14T11:36:39.938 INFO:teuthology.orchestra.run.smithi071.stderr: 87800K .......... .......... .......... .......... .......... 94% 374M 0s 2024-09-14T11:36:39.938 INFO:teuthology.orchestra.run.smithi071.stderr: 87850K .......... .......... .......... .......... .......... 94% 374M 0s 2024-09-14T11:36:39.938 INFO:teuthology.orchestra.run.smithi071.stderr: 87900K .......... .......... .......... .......... .......... 94% 373M 0s 2024-09-14T11:36:39.938 INFO:teuthology.orchestra.run.smithi071.stderr: 87950K .......... .......... .......... .......... .......... 94% 296M 0s 2024-09-14T11:36:39.938 INFO:teuthology.orchestra.run.smithi071.stderr: 88000K .......... .......... .......... .......... .......... 94% 371M 0s 2024-09-14T11:36:39.939 INFO:teuthology.orchestra.run.smithi071.stderr: 88050K .......... .......... .......... .......... .......... 94% 129M 0s 2024-09-14T11:36:39.939 INFO:teuthology.orchestra.run.smithi071.stderr: 88100K .......... .......... .......... .......... .......... 94% 338M 0s 2024-09-14T11:36:39.939 INFO:teuthology.orchestra.run.smithi071.stderr: 88150K .......... .......... .......... .......... .......... 94% 283M 0s 2024-09-14T11:36:39.939 INFO:teuthology.orchestra.run.smithi071.stderr: 88200K .......... .......... .......... .......... .......... 94% 329M 0s 2024-09-14T11:36:39.939 INFO:teuthology.orchestra.run.smithi071.stderr: 88250K .......... .......... .......... .......... .......... 95% 364M 0s 2024-09-14T11:36:39.939 INFO:teuthology.orchestra.run.smithi071.stderr: 88300K .......... .......... .......... .......... .......... 95% 369M 0s 2024-09-14T11:36:39.939 INFO:teuthology.orchestra.run.smithi071.stderr: 88350K .......... .......... .......... .......... .......... 95% 277M 0s 2024-09-14T11:36:39.939 INFO:teuthology.orchestra.run.smithi071.stderr: 88400K .......... .......... .......... .......... .......... 95% 320M 0s 2024-09-14T11:36:39.939 INFO:teuthology.orchestra.run.smithi071.stderr: 88450K .......... .......... .......... .......... .......... 95% 361M 0s 2024-09-14T11:36:39.939 INFO:teuthology.orchestra.run.smithi071.stderr: 88500K .......... .......... .......... .......... .......... 95% 360M 0s 2024-09-14T11:36:39.939 INFO:teuthology.orchestra.run.smithi071.stderr: 88550K .......... .......... .......... .......... .......... 95% 331M 0s 2024-09-14T11:36:39.939 INFO:teuthology.orchestra.run.smithi071.stderr: 88600K .......... .......... .......... .......... .......... 95% 324M 0s 2024-09-14T11:36:39.939 INFO:teuthology.orchestra.run.smithi071.stderr: 88650K .......... .......... .......... .......... .......... 95% 378M 0s 2024-09-14T11:36:39.939 INFO:teuthology.orchestra.run.smithi071.stderr: 88700K .......... .......... .......... .......... .......... 95% 372M 0s 2024-09-14T11:36:39.939 INFO:teuthology.orchestra.run.smithi071.stderr: 88750K .......... .......... .......... .......... .......... 95% 311M 0s 2024-09-14T11:36:39.939 INFO:teuthology.orchestra.run.smithi071.stderr: 88800K .......... .......... .......... .......... .......... 95% 12.6M 0s 2024-09-14T11:36:39.940 INFO:teuthology.orchestra.run.smithi071.stderr: 88850K .......... .......... .......... .......... .......... 95% 305M 0s 2024-09-14T11:36:39.940 INFO:teuthology.orchestra.run.smithi071.stderr: 88900K .......... .......... .......... .......... .......... 95% 344M 0s 2024-09-14T11:36:39.940 INFO:teuthology.orchestra.run.smithi071.stderr: 88950K .......... .......... .......... .......... .......... 95% 308M 0s 2024-09-14T11:36:39.940 INFO:teuthology.orchestra.run.smithi071.stderr: 89000K .......... .......... .......... .......... .......... 95% 366M 0s 2024-09-14T11:36:39.940 INFO:teuthology.orchestra.run.smithi071.stderr: 89050K .......... .......... .......... .......... .......... 95% 208M 0s 2024-09-14T11:36:39.940 INFO:teuthology.orchestra.run.smithi071.stderr: 89100K .......... .......... .......... .......... .......... 95% 232M 0s 2024-09-14T11:36:39.940 INFO:teuthology.orchestra.run.smithi071.stderr: 89150K .......... .......... .......... .......... .......... 96% 267M 0s 2024-09-14T11:36:39.940 INFO:teuthology.orchestra.run.smithi071.stderr: 89200K .......... .......... .......... .......... .......... 96% 338M 0s 2024-09-14T11:36:39.940 INFO:teuthology.orchestra.run.smithi071.stderr: 89250K .......... .......... .......... .......... .......... 96% 276M 0s 2024-09-14T11:36:39.940 INFO:teuthology.orchestra.run.smithi071.stderr: 89300K .......... .......... .......... .......... .......... 96% 301M 0s 2024-09-14T11:36:39.940 INFO:teuthology.orchestra.run.smithi071.stderr: 89350K .......... .......... .......... .......... .......... 96% 270M 0s 2024-09-14T11:36:39.940 INFO:teuthology.orchestra.run.smithi071.stderr: 89400K .......... .......... .......... .......... .......... 96% 312M 0s 2024-09-14T11:36:39.940 INFO:teuthology.orchestra.run.smithi071.stderr: 89450K .......... .......... .......... .......... .......... 96% 327M 0s 2024-09-14T11:36:39.940 INFO:teuthology.orchestra.run.smithi071.stderr: 89500K .......... .......... .......... .......... .......... 96% 358M 0s 2024-09-14T11:36:39.940 INFO:teuthology.orchestra.run.smithi071.stderr: 89550K .......... .......... .......... .......... .......... 96% 281M 0s 2024-09-14T11:36:39.941 INFO:teuthology.orchestra.run.smithi071.stderr: 89600K .......... .......... .......... .......... .......... 96% 329M 0s 2024-09-14T11:36:39.941 INFO:teuthology.orchestra.run.smithi071.stderr: 89650K .......... .......... .......... .......... .......... 96% 318M 0s 2024-09-14T11:36:39.941 INFO:teuthology.orchestra.run.smithi071.stderr: 89700K .......... .......... .......... .......... .......... 96% 318M 0s 2024-09-14T11:36:39.941 INFO:teuthology.orchestra.run.smithi071.stderr: 89750K .......... .......... .......... .......... .......... 96% 311M 0s 2024-09-14T11:36:39.941 INFO:teuthology.orchestra.run.smithi071.stderr: 89800K .......... .......... .......... .......... .......... 96% 326M 0s 2024-09-14T11:36:39.941 INFO:teuthology.orchestra.run.smithi071.stderr: 89850K .......... .......... .......... .......... .......... 96% 351M 0s 2024-09-14T11:36:39.941 INFO:teuthology.orchestra.run.smithi071.stderr: 89900K .......... .......... .......... .......... .......... 96% 320M 0s 2024-09-14T11:36:39.941 INFO:teuthology.orchestra.run.smithi071.stderr: 89950K .......... .......... .......... .......... .......... 96% 273M 0s 2024-09-14T11:36:39.941 INFO:teuthology.orchestra.run.smithi071.stderr: 90000K .......... .......... .......... .......... .......... 96% 353M 0s 2024-09-14T11:36:39.941 INFO:teuthology.orchestra.run.smithi071.stderr: 90050K .......... .......... .......... .......... .......... 96% 324M 0s 2024-09-14T11:36:39.941 INFO:teuthology.orchestra.run.smithi071.stderr: 90100K .......... .......... .......... .......... .......... 97% 342M 0s 2024-09-14T11:36:39.941 INFO:teuthology.orchestra.run.smithi071.stderr: 90150K .......... .......... .......... .......... .......... 97% 320M 0s 2024-09-14T11:36:39.941 INFO:teuthology.orchestra.run.smithi071.stderr: 90200K .......... .......... .......... .......... .......... 97% 270M 0s 2024-09-14T11:36:39.941 INFO:teuthology.orchestra.run.smithi071.stderr: 90250K .......... .......... .......... .......... .......... 97% 333M 0s 2024-09-14T11:36:39.941 INFO:teuthology.orchestra.run.smithi071.stderr: 90300K .......... .......... .......... .......... .......... 97% 353M 0s 2024-09-14T11:36:39.941 INFO:teuthology.orchestra.run.smithi071.stderr: 90350K .......... .......... .......... .......... .......... 97% 265M 0s 2024-09-14T11:36:39.942 INFO:teuthology.orchestra.run.smithi071.stderr: 90400K .......... .......... .......... .......... .......... 97% 349M 0s 2024-09-14T11:36:39.942 INFO:teuthology.orchestra.run.smithi071.stderr: 90450K .......... .......... .......... .......... .......... 97% 322M 0s 2024-09-14T11:36:39.942 INFO:teuthology.orchestra.run.smithi071.stderr: 90500K .......... .......... .......... .......... .......... 97% 334M 0s 2024-09-14T11:36:39.942 INFO:teuthology.orchestra.run.smithi071.stderr: 90550K .......... .......... .......... .......... .......... 97% 305M 0s 2024-09-14T11:36:39.942 INFO:teuthology.orchestra.run.smithi071.stderr: 90600K .......... .......... .......... .......... .......... 97% 331M 0s 2024-09-14T11:36:39.942 INFO:teuthology.orchestra.run.smithi071.stderr: 90650K .......... .......... .......... .......... .......... 97% 349M 0s 2024-09-14T11:36:39.942 INFO:teuthology.orchestra.run.smithi071.stderr: 90700K .......... .......... .......... .......... .......... 97% 352M 0s 2024-09-14T11:36:39.942 INFO:teuthology.orchestra.run.smithi071.stderr: 90750K .......... .......... .......... .......... .......... 97% 300M 0s 2024-09-14T11:36:39.942 INFO:teuthology.orchestra.run.smithi071.stderr: 90800K .......... .......... .......... .......... .......... 97% 343M 0s 2024-09-14T11:36:39.942 INFO:teuthology.orchestra.run.smithi071.stderr: 90850K .......... .......... .......... .......... .......... 97% 335M 0s 2024-09-14T11:36:39.942 INFO:teuthology.orchestra.run.smithi071.stderr: 90900K .......... .......... .......... .......... .......... 97% 358M 0s 2024-09-14T11:36:39.942 INFO:teuthology.orchestra.run.smithi071.stderr: 90950K .......... .......... .......... .......... .......... 97% 305M 0s 2024-09-14T11:36:39.942 INFO:teuthology.orchestra.run.smithi071.stderr: 91000K .......... .......... .......... .......... .......... 98% 354M 0s 2024-09-14T11:36:39.942 INFO:teuthology.orchestra.run.smithi071.stderr: 91050K .......... .......... .......... .......... .......... 98% 324M 0s 2024-09-14T11:36:39.942 INFO:teuthology.orchestra.run.smithi071.stderr: 91100K .......... .......... .......... .......... .......... 98% 321M 0s 2024-09-14T11:36:39.942 INFO:teuthology.orchestra.run.smithi071.stderr: 91150K .......... .......... .......... .......... .......... 98% 288M 0s 2024-09-14T11:36:39.943 INFO:teuthology.orchestra.run.smithi071.stderr: 91200K .......... .......... .......... .......... .......... 98% 338M 0s 2024-09-14T11:36:39.943 INFO:teuthology.orchestra.run.smithi071.stderr: 91250K .......... .......... .......... .......... .......... 98% 325M 0s 2024-09-14T11:36:39.943 INFO:teuthology.orchestra.run.smithi071.stderr: 91300K .......... .......... .......... .......... .......... 98% 361M 0s 2024-09-14T11:36:39.943 INFO:teuthology.orchestra.run.smithi071.stderr: 91350K .......... .......... .......... .......... .......... 98% 321M 0s 2024-09-14T11:36:39.943 INFO:teuthology.orchestra.run.smithi071.stderr: 91400K .......... .......... .......... .......... .......... 98% 334M 0s 2024-09-14T11:36:39.943 INFO:teuthology.orchestra.run.smithi071.stderr: 91450K .......... .......... .......... .......... .......... 98% 311M 0s 2024-09-14T11:36:39.943 INFO:teuthology.orchestra.run.smithi071.stderr: 91500K .......... .......... .......... .......... .......... 98% 343M 0s 2024-09-14T11:36:39.943 INFO:teuthology.orchestra.run.smithi071.stderr: 91550K .......... .......... .......... .......... .......... 98% 299M 0s 2024-09-14T11:36:39.943 INFO:teuthology.orchestra.run.smithi071.stderr: 91600K .......... .......... .......... .......... .......... 98% 356M 0s 2024-09-14T11:36:39.943 INFO:teuthology.orchestra.run.smithi071.stderr: 91650K .......... .......... .......... .......... .......... 98% 360M 0s 2024-09-14T11:36:39.943 INFO:teuthology.orchestra.run.smithi071.stderr: 91700K .......... .......... .......... .......... .......... 98% 15.0M 0s 2024-09-14T11:36:39.943 INFO:teuthology.orchestra.run.smithi071.stderr: 91750K .......... .......... .......... .......... .......... 98% 247M 0s 2024-09-14T11:36:39.943 INFO:teuthology.orchestra.run.smithi071.stderr: 91800K .......... .......... .......... .......... .......... 98% 338M 0s 2024-09-14T11:36:39.943 INFO:teuthology.orchestra.run.smithi071.stderr: 91850K .......... .......... .......... .......... .......... 98% 360M 0s 2024-09-14T11:36:39.943 INFO:teuthology.orchestra.run.smithi071.stderr: 91900K .......... .......... .......... .......... .......... 98% 91.0M 0s 2024-09-14T11:36:39.943 INFO:teuthology.orchestra.run.smithi071.stderr: 91950K .......... .......... .......... .......... .......... 99% 239M 0s 2024-09-14T11:36:39.944 INFO:teuthology.orchestra.run.smithi071.stderr: 92000K .......... .......... .......... .......... .......... 99% 323M 0s 2024-09-14T11:36:39.944 INFO:teuthology.orchestra.run.smithi071.stderr: 92050K .......... .......... .......... .......... .......... 99% 339M 0s 2024-09-14T11:36:39.944 INFO:teuthology.orchestra.run.smithi071.stderr: 92100K .......... .......... .......... .......... .......... 99% 339M 0s 2024-09-14T11:36:39.944 INFO:teuthology.orchestra.run.smithi071.stderr: 92150K .......... .......... .......... .......... .......... 99% 321M 0s 2024-09-14T11:36:39.944 INFO:teuthology.orchestra.run.smithi071.stderr: 92200K .......... .......... .......... .......... .......... 99% 310M 0s 2024-09-14T11:36:39.944 INFO:teuthology.orchestra.run.smithi071.stderr: 92250K .......... .......... .......... .......... .......... 99% 369M 0s 2024-09-14T11:36:39.944 INFO:teuthology.orchestra.run.smithi071.stderr: 92300K .......... .......... .......... .......... .......... 99% 331M 0s 2024-09-14T11:36:39.944 INFO:teuthology.orchestra.run.smithi071.stderr: 92350K .......... .......... .......... .......... .......... 99% 276M 0s 2024-09-14T11:36:39.944 INFO:teuthology.orchestra.run.smithi071.stderr: 92400K .......... .......... .......... .......... .......... 99% 350M 0s 2024-09-14T11:36:39.944 INFO:teuthology.orchestra.run.smithi071.stderr: 92450K .......... .......... .......... .......... .......... 99% 316M 0s 2024-09-14T11:36:39.944 INFO:teuthology.orchestra.run.smithi071.stderr: 92500K .......... .......... .......... .......... .......... 99% 362M 0s 2024-09-14T11:36:39.944 INFO:teuthology.orchestra.run.smithi071.stderr: 92550K .......... .......... .......... .......... .......... 99% 316M 0s 2024-09-14T11:36:39.944 INFO:teuthology.orchestra.run.smithi071.stderr: 92600K .......... .......... .......... .......... .......... 99% 341M 0s 2024-09-14T11:36:39.944 INFO:teuthology.orchestra.run.smithi071.stderr: 92650K .......... .......... .......... .......... .......... 99% 330M 0s 2024-09-14T11:36:39.944 INFO:teuthology.orchestra.run.smithi071.stderr: 92700K .......... .......... .......... .......... .......... 99% 355M 0s 2024-09-14T11:36:39.945 INFO:teuthology.orchestra.run.smithi071.stderr: 92750K .......... .......... .......... .......... .......... 99% 311M 0s 2024-09-14T11:36:39.945 INFO:teuthology.orchestra.run.smithi071.stderr: 92800K .......... .......... .......... .......... .......... 99% 368M 0s 2024-09-14T11:36:39.945 INFO:teuthology.orchestra.run.smithi071.stderr: 92850K .......... .......... .......... .......... .......... 99% 379M 0s 2024-09-14T11:36:39.945 INFO:teuthology.orchestra.run.smithi071.stderr: 92900K 100% 134G=0.5s 2024-09-14T11:36:39.945 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-14T11:36:39.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14 11:36:39 (179 MB/s) - 'gradle-6.0.1-bin.zip' saved [95129672/95129672] 2024-09-14T11:36:39.945 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-14T11:36:39.964 INFO:teuthology.orchestra.run.smithi071.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-14T11:36:39.964 INFO:teuthology.orchestra.run.smithi071.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-14T11:36:39.964 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-14T11:36:39.964 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-14T11:36:39.964 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-14T11:36:39.964 INFO:teuthology.orchestra.run.smithi071.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-14T11:36:39.964 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-14T11:36:39.964 INFO:teuthology.orchestra.run.smithi071.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-14T11:36:39.964 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-14T11:36:39.964 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-14T11:36:39.965 INFO:teuthology.orchestra.run.smithi071.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-14T11:36:39.965 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-14T11:36:39.965 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-14T11:36:39.965 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-14T11:36:39.965 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-14T11:36:39.965 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-14T11:36:39.965 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-14T11:36:39.965 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-14T11:36:39.965 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-14T11:36:39.965 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-14T11:36:39.965 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-14T11:36:39.965 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-14T11:36:39.965 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-14T11:36:39.965 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-14T11:36:39.965 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-14T11:36:39.966 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-14T11:36:39.966 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-14T11:36:39.966 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-14T11:36:39.966 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-14T11:36:39.966 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-14T11:36:39.966 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-14T11:36:39.966 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-14T11:36:39.966 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-14T11:36:39.966 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-14T11:36:39.966 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-14T11:36:39.966 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-14T11:36:39.966 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-14T11:36:39.966 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-14T11:36:39.966 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-14T11:36:39.967 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-14T11:36:39.967 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-14T11:36:39.967 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-14T11:36:39.967 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-14T11:36:39.967 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-14T11:36:39.967 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-14T11:36:39.967 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-14T11:36:39.967 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-14T11:36:39.967 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-14T11:36:39.967 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-14T11:36:39.967 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-14T11:36:39.967 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-14T11:36:39.967 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-14T11:36:39.967 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-14T11:36:39.968 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-14T11:36:39.968 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-14T11:36:39.968 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-14T11:36:39.968 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-14T11:36:39.968 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-14T11:36:39.968 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-14T11:36:39.968 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-14T11:36:39.968 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-14T11:36:39.968 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-14T11:36:39.968 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-14T11:36:39.968 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-14T11:36:39.968 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-14T11:36:39.968 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-14T11:36:39.968 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-14T11:36:39.969 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-14T11:36:39.969 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-14T11:36:39.969 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-14T11:36:39.969 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-14T11:36:39.969 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-14T11:36:39.969 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-14T11:36:39.969 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-14T11:36:39.969 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-14T11:36:39.969 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-14T11:36:39.969 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-14T11:36:39.969 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-14T11:36:39.969 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-14T11:36:39.969 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-14T11:36:39.969 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-14T11:36:39.969 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-14T11:36:39.970 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-14T11:36:39.970 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-14T11:36:39.970 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-14T11:36:39.970 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-14T11:36:39.970 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-14T11:36:39.970 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-14T11:36:39.970 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-14T11:36:39.970 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-14T11:36:39.970 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-14T11:36:39.970 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-14T11:36:39.970 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-14T11:36:39.970 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-14T11:36:39.970 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-14T11:36:39.970 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-14T11:36:39.971 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-14T11:36:39.971 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-14T11:36:39.971 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-14T11:36:39.971 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-14T11:36:39.971 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-14T11:36:39.971 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-14T11:36:39.971 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-14T11:36:39.971 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-14T11:36:39.971 INFO:teuthology.orchestra.run.smithi071.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-14T11:36:39.971 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-14T11:36:39.971 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-14T11:36:39.971 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-14T11:36:39.971 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-14T11:36:39.971 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-14T11:36:39.971 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-14T11:36:39.972 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-14T11:36:39.972 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-14T11:36:39.972 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-14T11:36:39.972 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-14T11:36:39.972 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-14T11:36:39.972 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-14T11:36:39.972 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-14T11:36:39.972 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-14T11:36:39.972 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-14T11:36:39.972 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-14T11:36:39.972 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-14T11:36:39.972 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-14T11:36:39.972 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-14T11:36:39.972 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-14T11:36:39.973 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-14T11:36:39.973 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-14T11:36:39.973 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-14T11:36:39.973 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-14T11:36:39.973 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-14T11:36:39.973 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-14T11:36:39.973 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-14T11:36:39.973 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-14T11:36:39.973 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-14T11:36:39.973 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-14T11:36:39.973 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-14T11:36:39.973 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-14T11:36:39.973 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-14T11:36:39.973 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-14T11:36:39.974 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-14T11:36:39.974 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-14T11:36:39.974 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-14T11:36:39.974 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-14T11:36:39.974 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-14T11:36:39.974 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-14T11:36:39.974 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-14T11:36:39.974 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-14T11:36:39.974 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-14T11:36:39.974 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-14T11:36:39.974 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-14T11:36:39.974 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-14T11:36:39.974 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-14T11:36:39.974 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-14T11:36:39.975 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-14T11:36:39.976 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-14T11:36:39.976 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-14T11:36:39.976 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-14T11:36:39.976 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-14T11:36:39.976 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-14T11:36:39.978 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-14T11:36:39.980 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-14T11:36:39.984 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-14T11:36:39.984 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-14T11:36:39.985 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-14T11:36:39.985 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-14T11:36:39.986 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-14T11:36:39.986 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-14T11:36:39.988 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-14T11:36:39.996 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-14T11:36:39.997 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-14T11:36:39.999 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-14T11:36:39.999 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-14T11:36:40.000 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-14T11:36:40.000 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-14T11:36:40.000 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-14T11:36:40.003 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-14T11:36:40.006 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-14T11:36:40.008 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-14T11:36:40.009 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-14T11:36:40.011 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-14T11:36:40.013 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-14T11:36:40.014 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-14T11:36:40.020 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-14T11:36:40.023 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-14T11:36:40.029 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-14T11:36:40.034 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-14T11:36:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-14T11:36:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-14T11:36:40.046 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-14T11:36:40.048 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-14T11:36:40.055 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-14T11:36:40.055 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-14T11:36:40.063 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-14T11:36:40.065 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-14T11:36:40.066 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-14T11:36:40.070 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-14T11:36:40.075 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-14T11:36:40.103 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-14T11:36:40.105 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-14T11:36:40.106 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-14T11:36:40.107 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-14T11:36:40.108 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-14T11:36:40.108 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-14T11:36:40.109 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-14T11:36:40.109 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-14T11:36:40.111 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-14T11:36:40.111 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-14T11:36:40.112 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-14T11:36:40.112 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-14T11:36:40.113 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-14T11:36:40.114 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-14T11:36:40.115 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-14T11:36:40.115 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-14T11:36:40.116 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-14T11:36:40.116 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-14T11:36:40.116 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-14T11:36:40.116 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-14T11:36:40.116 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-14T11:36:40.117 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-14T11:36:40.117 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-14T11:36:40.118 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-14T11:36:40.119 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-14T11:36:40.123 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-14T11:36:40.124 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-14T11:36:40.125 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-14T11:36:40.125 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-14T11:36:40.125 INFO:teuthology.orchestra.run.smithi071.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-14T11:36:40.157 INFO:teuthology.orchestra.run.smithi071.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2024-09-14T11:36:40.586 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:36:40.586 INFO:teuthology.orchestra.run.smithi071.stdout:Welcome to Gradle 6.0.1! 2024-09-14T11:36:40.586 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:36:40.586 INFO:teuthology.orchestra.run.smithi071.stdout:Here are the highlights of this release: 2024-09-14T11:36:40.586 INFO:teuthology.orchestra.run.smithi071.stdout: - Substantial improvements in dependency management, including 2024-09-14T11:36:40.586 INFO:teuthology.orchestra.run.smithi071.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-14T11:36:40.586 INFO:teuthology.orchestra.run.smithi071.stdout: - Advanced control of transitive versions 2024-09-14T11:36:40.587 INFO:teuthology.orchestra.run.smithi071.stdout: - Support for optional features and dependencies 2024-09-14T11:36:40.587 INFO:teuthology.orchestra.run.smithi071.stdout: - Rules to tweak published metadata 2024-09-14T11:36:40.587 INFO:teuthology.orchestra.run.smithi071.stdout: - Support for Java 13 2024-09-14T11:36:40.587 INFO:teuthology.orchestra.run.smithi071.stdout: - Faster incremental Java and Groovy compilation 2024-09-14T11:36:40.587 INFO:teuthology.orchestra.run.smithi071.stdout: - New Zinc compiler for Scala 2024-09-14T11:36:40.587 INFO:teuthology.orchestra.run.smithi071.stdout: - VS2019 support 2024-09-14T11:36:40.587 INFO:teuthology.orchestra.run.smithi071.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-14T11:36:40.587 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:36:40.589 INFO:teuthology.orchestra.run.smithi071.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-14T11:36:40.589 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:36:40.590 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:36:40.590 INFO:teuthology.orchestra.run.smithi071.stdout:------------------------------------------------------------ 2024-09-14T11:36:40.590 INFO:teuthology.orchestra.run.smithi071.stdout:Gradle 6.0.1 2024-09-14T11:36:40.590 INFO:teuthology.orchestra.run.smithi071.stdout:------------------------------------------------------------ 2024-09-14T11:36:40.590 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:36:40.590 INFO:teuthology.orchestra.run.smithi071.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-14T11:36:40.590 INFO:teuthology.orchestra.run.smithi071.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-14T11:36:40.590 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:36:40.590 INFO:teuthology.orchestra.run.smithi071.stdout:Kotlin: 1.3.50 2024-09-14T11:36:40.590 INFO:teuthology.orchestra.run.smithi071.stdout:Groovy: 2.5.8 2024-09-14T11:36:40.590 INFO:teuthology.orchestra.run.smithi071.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-14T11:36:40.590 INFO:teuthology.orchestra.run.smithi071.stdout:JVM: 11.0.17 (Ubuntu 11.0.17+8-post-Ubuntu-1ubuntu222.04) 2024-09-14T11:36:40.590 INFO:teuthology.orchestra.run.smithi071.stdout:OS: Linux 5.15.0-121-generic amd64 2024-09-14T11:36:40.590 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:36:40.594 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-14T11:36:40.594 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-14T11:36:40.594 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi071.front.sepia.ceph.com 2024-09-14T11:36:40.594 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-14T11:36:40.594 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi157.front.sepia.ceph.com 2024-09-14T11:36:40.595 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-14T11:36:40.850 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-14T11:36:40.850 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-14T11:36:40.850 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'TVXFEPYIKEKJZDICOLMF', 'access_secret': 'qcXl4eQ/bTOcszo4jPzAySHiId6wyhy1qkTGENu+NlcLLGdrFxt8cw==', 'region': 'mexico', 'endpoint': 'smithi071.front.sepia.ceph.com:80', 'port': 80, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': False, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi071.front.sepia.ceph.com'} 2024-09-14T11:36:40.851 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-14T11:36:40.851 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'TVXFEPYIKEKJZDICOLMF', '--secret', 'qcXl4eQ/bTOcszo4jPzAySHiId6wyhy1qkTGENu+NlcLLGdrFxt8cw==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-14T11:36:40.851 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key TVXFEPYIKEKJZDICOLMF --secret qcXl4eQ/bTOcszo4jPzAySHiId6wyhy1qkTGENu+NlcLLGdrFxt8cw== --email tester.client.0_test@test.test --cluster ceph 2024-09-14T11:36:40.894 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:40.894 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:40.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:40.938+0000 7f9c9b6979c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:40.942+0000 7f9c9b6979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:40.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:40.942+0000 7f9c9b6979c0 20 realm 2024-09-14T11:36:40.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:40.942+0000 7f9c9b6979c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:40.942+0000 7f9c9b6979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:40.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:40.942+0000 7f9c9b6979c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:40.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:40.942+0000 7f9c9b6979c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:40.942+0000 7f9c9b6979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:40.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:40.942+0000 7f9c9b6979c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:40.942+0000 7f9c9b6979c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:40.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:40.942+0000 7f9c9b6979c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:40.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:40.942+0000 7f9c9b6979c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:40.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:40.942+0000 7f9c9b6979c0 20 searching for the correct realm 2024-09-14T11:36:40.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:40.946+0000 7f9c9999e640 0 -- 172.21.15.71:0/3323814882 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f9c9000ec20 msgr2=0x7f9c90071750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:41.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.158+0000 7f9c9999e640 0 -- 172.21.15.71:0/3323814882 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55bd85a4fc60 msgr2=0x55bd85a52070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:41.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.174+0000 7f9c9b6979c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:41.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.174+0000 7f9c9b6979c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:36:41.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.174+0000 7f9c9b6979c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:41.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.174+0000 7f9c9b6979c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:36:41.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.174+0000 7f9c9b6979c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:41.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.174+0000 7f9c9b6979c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:41.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.174+0000 7f9c9b6979c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.174+0000 7f9c9b6979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.174+0000 7f9c9b6979c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.178+0000 7f9c9b6979c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:41.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.178+0000 7f9c9b6979c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.178+0000 7f9c9b6979c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:41.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.178+0000 7f9c9b6979c0 20 zone default found 2024-09-14T11:36:41.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.178+0000 7f9c9b6979c0 4 Realm: () 2024-09-14T11:36:41.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.178+0000 7f9c9b6979c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:36:41.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.178+0000 7f9c9b6979c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:36:41.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.178+0000 7f9c9b6979c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:41.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.178+0000 7f9c9b6979c0 20 zonegroup default 2024-09-14T11:36:41.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.178+0000 7f9c9b6979c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.178+0000 7f9c9b6979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.178+0000 7f9c9b6979c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.178+0000 7f9c9b6979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.178+0000 7f9c9b6979c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.178+0000 7f9c9b6979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.178+0000 7f9c9b6979c0 20 started sync module instance, tier type = 2024-09-14T11:36:41.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.178+0000 7f9c9b6979c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:36:41.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.206+0000 7f9c9b6979c0 20 add_watcher() i=0 2024-09-14T11:36:41.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.206+0000 7f9c9b6979c0 20 add_watcher() i=1 2024-09-14T11:36:41.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.206+0000 7f9c9b6979c0 20 add_watcher() i=2 2024-09-14T11:36:41.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.206+0000 7f9c9b6979c0 20 add_watcher() i=3 2024-09-14T11:36:41.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.206+0000 7f9c9b6979c0 20 add_watcher() i=4 2024-09-14T11:36:41.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.206+0000 7f9c9b6979c0 20 add_watcher() i=5 2024-09-14T11:36:41.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.206+0000 7f9c9b6979c0 20 add_watcher() i=6 2024-09-14T11:36:41.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.206+0000 7f9c9b6979c0 20 add_watcher() i=7 2024-09-14T11:36:41.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.206+0000 7f9c9b6979c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:41.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.210+0000 7f9b4f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:41.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.210+0000 7f9c9b6979c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:41.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.210+0000 7f9c9b6979c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:41.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.210+0000 7f9c9b6979c0 5 note: GC not initialized 2024-09-14T11:36:41.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.214+0000 7f9b4e7e4640 20 reqs_thread_entry: start 2024-09-14T11:36:41.208 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.214+0000 7f9c9b6979c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:41.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.214+0000 7f9c9b6979c0 20 Filter name: none 2024-09-14T11:36:41.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.214+0000 7f9abffff640 20 reqs_thread_entry: start 2024-09-14T11:36:41.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.214+0000 7f9c9b6979c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-14T11:36:41.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.214+0000 7f9c9b6979c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.214+0000 7f9c9b6979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.214+0000 7f9c9b6979c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-14T11:36:41.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.214+0000 7f9c9b6979c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:36:41.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.214+0000 7f9c9b6979c0 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-14T11:36:41.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.214+0000 7f9c9b6979c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.214+0000 7f9c9b6979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.214+0000 7f9c9b6979c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-14T11:36:41.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.214+0000 7f9c9b6979c0 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:36:41.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.214+0000 7f9c9b6979c0 10 cache get: name=default.rgw.meta+users.keys+TVXFEPYIKEKJZDICOLMF : miss 2024-09-14T11:36:41.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.214+0000 7f9c9b6979c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.214+0000 7f9c9b6979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.214+0000 7f9c9b6979c0 10 cache put: name=default.rgw.meta+users.keys+TVXFEPYIKEKJZDICOLMF info.flags=0x0 2024-09-14T11:36:41.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.214+0000 7f9c9b6979c0 10 adding default.rgw.meta+users.keys+TVXFEPYIKEKJZDICOLMF to cache LRU end 2024-09-14T11:36:41.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.214+0000 7f9c9b6979c0 10 cache get: name=default.rgw.meta+users.keys+TVXFEPYIKEKJZDICOLMF : hit (negative entry) 2024-09-14T11:36:41.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.214+0000 7f9c9b6979c0 10 cache get: name=default.rgw.meta+users.keys+TVXFEPYIKEKJZDICOLMF : hit (negative entry) 2024-09-14T11:36:41.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.218+0000 7f9c9b6979c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-14T11:36:41.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.218+0000 7f9c9b6979c0 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:36:41.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.218+0000 7f9c9b6979c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-14T11:36:41.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.218+0000 7f9b7cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464392 cookie 94272479408720 notifier 8249 bl.length()=670 2024-09-14T11:36:41.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.218+0000 7f9b7cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-14T11:36:41.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.218+0000 7f9b7cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:36:41.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.222+0000 7f9c9b6979c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-14T11:36:41.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.222+0000 7f9c9b6979c0 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:36:41.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.222+0000 7f9c9b6979c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-14T11:36:41.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.222+0000 7f9b6bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464292 cookie 94272479399952 notifier 8249 bl.length()=200 2024-09-14T11:36:41.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.222+0000 7f9b6bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-14T11:36:41.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.222+0000 7f9b6bfff640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:36:41.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.226+0000 7f9c9b6979c0 10 cache put: name=default.rgw.meta+users.keys+TVXFEPYIKEKJZDICOLMF info.flags=0x7 2024-09-14T11:36:41.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.226+0000 7f9c9b6979c0 10 moving default.rgw.meta+users.keys+TVXFEPYIKEKJZDICOLMF to cache LRU end 2024-09-14T11:36:41.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.226+0000 7f9c9b6979c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:TVXFEPYIKEKJZDICOLMF, ofs0, ns] 2024-09-14T11:36:41.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.230+0000 7f9b6bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464393 cookie 94272479411392 notifier 8249 bl.length()=189 2024-09-14T11:36:41.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.230+0000 7f9b6bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+TVXFEPYIKEKJZDICOLMF info.flags=0x7 2024-09-14T11:36:41.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.230+0000 7f9b6bfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+TVXFEPYIKEKJZDICOLMF to cache LRU end 2024-09-14T11:36:41.225 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T11:36:41.225 INFO:teuthology.orchestra.run.smithi071.stdout: "user_id": "tester.client.0", 2024-09-14T11:36:41.225 INFO:teuthology.orchestra.run.smithi071.stdout: "display_name": "Ms. tester.client.0", 2024-09-14T11:36:41.225 INFO:teuthology.orchestra.run.smithi071.stdout: "email": "tester.client.0_test@test.test", 2024-09-14T11:36:41.225 INFO:teuthology.orchestra.run.smithi071.stdout: "suspended": 0, 2024-09-14T11:36:41.226 INFO:teuthology.orchestra.run.smithi071.stdout: "max_buckets": 1000, 2024-09-14T11:36:41.226 INFO:teuthology.orchestra.run.smithi071.stdout: "subusers": [], 2024-09-14T11:36:41.226 INFO:teuthology.orchestra.run.smithi071.stdout: "keys": [ 2024-09-14T11:36:41.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T11:36:41.226 INFO:teuthology.orchestra.run.smithi071.stdout: "user": "tester.client.0", 2024-09-14T11:36:41.226 INFO:teuthology.orchestra.run.smithi071.stdout: "access_key": "TVXFEPYIKEKJZDICOLMF", 2024-09-14T11:36:41.226 INFO:teuthology.orchestra.run.smithi071.stdout: "secret_key": "qcXl4eQ/bTOcszo4jPzAySHiId6wyhy1qkTGENu+NlcLLGdrFxt8cw==", 2024-09-14T11:36:41.226 INFO:teuthology.orchestra.run.smithi071.stdout: "active": true, 2024-09-14T11:36:41.226 INFO:teuthology.orchestra.run.smithi071.stdout: "create_date": "2024-09-14T11:36:41.217853Z" 2024-09-14T11:36:41.226 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T11:36:41.226 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-14T11:36:41.226 INFO:teuthology.orchestra.run.smithi071.stdout: "swift_keys": [], 2024-09-14T11:36:41.226 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": [], 2024-09-14T11:36:41.226 INFO:teuthology.orchestra.run.smithi071.stdout: "op_mask": "read, write, delete", 2024-09-14T11:36:41.227 INFO:teuthology.orchestra.run.smithi071.stdout: "default_placement": "", 2024-09-14T11:36:41.227 INFO:teuthology.orchestra.run.smithi071.stdout: "default_storage_class": "", 2024-09-14T11:36:41.227 INFO:teuthology.orchestra.run.smithi071.stdout: "placement_tags": [], 2024-09-14T11:36:41.227 INFO:teuthology.orchestra.run.smithi071.stdout: "bucket_quota": { 2024-09-14T11:36:41.227 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": false, 2024-09-14T11:36:41.227 INFO:teuthology.orchestra.run.smithi071.stdout: "check_on_raw": false, 2024-09-14T11:36:41.227 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size": -1, 2024-09-14T11:36:41.227 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size_kb": 0, 2024-09-14T11:36:41.227 INFO:teuthology.orchestra.run.smithi071.stdout: "max_objects": -1 2024-09-14T11:36:41.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T11:36:41.227 INFO:teuthology.orchestra.run.smithi071.stdout: "user_quota": { 2024-09-14T11:36:41.227 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": false, 2024-09-14T11:36:41.227 INFO:teuthology.orchestra.run.smithi071.stdout: "check_on_raw": false, 2024-09-14T11:36:41.228 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size": -1, 2024-09-14T11:36:41.228 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size_kb": 0, 2024-09-14T11:36:41.228 INFO:teuthology.orchestra.run.smithi071.stdout: "max_objects": -1 2024-09-14T11:36:41.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T11:36:41.228 INFO:teuthology.orchestra.run.smithi071.stdout: "temp_url_keys": [], 2024-09-14T11:36:41.228 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "rgw", 2024-09-14T11:36:41.228 INFO:teuthology.orchestra.run.smithi071.stdout: "mfa_ids": [], 2024-09-14T11:36:41.228 INFO:teuthology.orchestra.run.smithi071.stdout: "account_id": "", 2024-09-14T11:36:41.228 INFO:teuthology.orchestra.run.smithi071.stdout: "path": "/", 2024-09-14T11:36:41.228 INFO:teuthology.orchestra.run.smithi071.stdout: "create_date": "2024-09-14T11:36:41.217812Z", 2024-09-14T11:36:41.228 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-09-14T11:36:41.228 INFO:teuthology.orchestra.run.smithi071.stdout: "group_ids": [] 2024-09-14T11:36:41.228 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T11:36:41.229 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:36:41.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.230+0000 7f9b4f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:41.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.234+0000 7f9c9b6979c0 20 remove_watcher() i=0 2024-09-14T11:36:41.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.234+0000 7f9c9b6979c0 2 removed watcher, disabling cache 2024-09-14T11:36:41.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.238+0000 7f9c9b6979c0 20 remove_watcher() i=1 2024-09-14T11:36:41.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.238+0000 7f9c9b6979c0 20 remove_watcher() i=2 2024-09-14T11:36:41.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.242+0000 7f9c9b6979c0 20 remove_watcher() i=3 2024-09-14T11:36:41.240 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.246+0000 7f9c9b6979c0 20 remove_watcher() i=4 2024-09-14T11:36:41.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.246+0000 7f9c9b6979c0 20 remove_watcher() i=5 2024-09-14T11:36:41.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.250+0000 7f9c9b6979c0 20 remove_watcher() i=6 2024-09-14T11:36:41.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.250+0000 7f9c9b6979c0 20 remove_watcher() i=7 2024-09-14T11:36:41.268 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T11:36:41.268 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-14T11:36:41.315 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-14T11:36:41.315 DEBUG:teuthology.orchestra.run.smithi071:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-14T11:36:41.360 DEBUG:teuthology.orchestra.run.smithi071:> radosgw-admin gc process --include-all 2024-09-14T11:36:41.435 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:41.436 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:41.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.486+0000 7f635d1639c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.490+0000 7f635d1639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.490+0000 7f635d1639c0 20 realm 2024-09-14T11:36:41.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.490+0000 7f635d1639c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.490+0000 7f635d1639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.490+0000 7f635d1639c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:41.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.490+0000 7f635d1639c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.490+0000 7f635d1639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.490+0000 7f635d1639c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.490+0000 7f635d1639c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:41.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.490+0000 7f635d1639c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.490+0000 7f635d1639c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:41.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.490+0000 7f635d1639c0 20 searching for the correct realm 2024-09-14T11:36:41.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.494+0000 7f635b46a640 0 -- 172.21.15.71:0/1496822312 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f6344035070 msgr2=0x7f6344041980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:41.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.710+0000 7f635b46a640 0 -- 172.21.15.71:0/1496822312 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55ed53080b90 msgr2=0x55ed53082f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:41.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.722+0000 7f635d1639c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:41.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.722+0000 7f635d1639c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:36:41.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.722+0000 7f635d1639c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:41.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.722+0000 7f635d1639c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:36:41.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.722+0000 7f635d1639c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:41.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.722+0000 7f635d1639c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:41.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.722+0000 7f635d1639c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.722+0000 7f635d1639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.722+0000 7f635d1639c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.726+0000 7f635d1639c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:41.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.726+0000 7f635d1639c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.726+0000 7f635d1639c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:41.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.726+0000 7f635d1639c0 20 zone default found 2024-09-14T11:36:41.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.726+0000 7f635d1639c0 4 Realm: () 2024-09-14T11:36:41.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.726+0000 7f635d1639c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:36:41.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.726+0000 7f635d1639c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:36:41.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.726+0000 7f635d1639c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:41.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.726+0000 7f635d1639c0 20 zonegroup default 2024-09-14T11:36:41.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.726+0000 7f635d1639c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.726+0000 7f635d1639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.726+0000 7f635d1639c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.726+0000 7f635d1639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.726+0000 7f635d1639c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:41.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.726+0000 7f635d1639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:41.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.726+0000 7f635d1639c0 20 started sync module instance, tier type = 2024-09-14T11:36:41.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.726+0000 7f635d1639c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:36:41.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.750+0000 7f635d1639c0 20 add_watcher() i=0 2024-09-14T11:36:41.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.750+0000 7f635d1639c0 20 add_watcher() i=1 2024-09-14T11:36:41.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.750+0000 7f635d1639c0 20 add_watcher() i=2 2024-09-14T11:36:41.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.750+0000 7f635d1639c0 20 add_watcher() i=3 2024-09-14T11:36:41.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.750+0000 7f635d1639c0 20 add_watcher() i=4 2024-09-14T11:36:41.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.750+0000 7f635d1639c0 20 add_watcher() i=5 2024-09-14T11:36:41.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.750+0000 7f635d1639c0 20 add_watcher() i=6 2024-09-14T11:36:41.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.754+0000 7f635d1639c0 20 add_watcher() i=7 2024-09-14T11:36:41.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.754+0000 7f635d1639c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:41.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.758+0000 7f62117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:41.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.758+0000 7f635d1639c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:41.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.758+0000 7f635d1639c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:41.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.854+0000 7f618bfff640 20 reqs_thread_entry: start 2024-09-14T11:36:41.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.854+0000 7f635d1639c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:41.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.854+0000 7f635d1639c0 20 Filter name: none 2024-09-14T11:36:41.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.854+0000 7f6189ffb640 20 reqs_thread_entry: start 2024-09-14T11:36:41.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.854+0000 7f635d1639c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:36:41.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.858+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:41.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.862+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:41.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.862+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:36:41.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.862+0000 7f635d1639c0 20 garbage collection: RGWGC::process iterating over entry tag='_zcHJf3d2rDv9ChU8RXXFemh1AxDpXYl', time=2024-09-14T13:27:52.015715+0000, chain.objs.size()=3 2024-09-14T11:36:41.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.862+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_.sHGs8TuBw9JzJZE_EZteMRUZuHcPjUT_0 2024-09-14T11:36:41.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.862+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_.sHGs8TuBw9JzJZE_EZteMRUZuHcPjUT_1 2024-09-14T11:36:41.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.862+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_.sHGs8TuBw9JzJZE_EZteMRUZuHcPjUT_2 2024-09-14T11:36:41.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.866+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:41.870 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.874+0000 7f635d1639c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:36:41.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.878+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:41.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.878+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:41.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.882+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:36:41.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.882+0000 7f635d1639c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.13717130956286753088', time=2024-09-14T13:27:52.059950+0000, chain.objs.size()=3 2024-09-14T11:36:41.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.882+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__multipart_foo-STANDARD.2~vfDoXiTVhFA7T9j9Mah7i0_qIuVFA2D.1 2024-09-14T11:36:41.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.882+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__multipart_foo-STANDARD.2~vfDoXiTVhFA7T9j9Mah7i0_qIuVFA2D.2 2024-09-14T11:36:41.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.882+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__multipart_foo-STANDARD.2~vfDoXiTVhFA7T9j9Mah7i0_qIuVFA2D.3 2024-09-14T11:36:41.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.882+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:41.884 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.890+0000 7f635d1639c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:36:41.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.894+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:41.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.894+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:41.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.894+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:36:41.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.894+0000 7f635d1639c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.5874220928900087383', time=2024-09-14T13:27:51.875022+0000, chain.objs.size()=2 2024-09-14T11:36:41.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.894+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.16__shadow_.CgDU-ASKYTEkR7gJy21pheomq78MAe3_0 2024-09-14T11:36:41.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.894+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.16__shadow_.CgDU-ASKYTEkR7gJy21pheomq78MAe3_1 2024-09-14T11:36:41.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.894+0000 7f635d1639c0 20 garbage collection: RGWGC::process iterating over entry tag='_PXFUfaFOvxzz92ufSpJfoBvLANkrLV_', time=2024-09-14T13:27:51.982346+0000, chain.objs.size()=2 2024-09-14T11:36:41.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.894+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_.KU0e3prm6JTxtPHSfejsygpPLYcVaHn_1 2024-09-14T11:36:41.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.894+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_.KU0e3prm6JTxtPHSfejsygpPLYcVaHn_2 2024-09-14T11:36:41.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.902+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:41.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.906+0000 7f635d1639c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:36:41.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.910+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:41.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.910+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:41.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.910+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:41.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.914+0000 7f635d1639c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:36:41.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.918+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:41.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.918+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:41.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.918+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:36:41.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.918+0000 7f635d1639c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.2052927584773766205', time=2024-09-14T13:27:51.821249+0000, chain.objs.size()=2 2024-09-14T11:36:41.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.918+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.16__shadow_.g6sq6Rn7qrpVyLqE2LIWJDgnfTZSSP9_0 2024-09-14T11:36:41.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.918+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.16__shadow_.g6sq6Rn7qrpVyLqE2LIWJDgnfTZSSP9_1 2024-09-14T11:36:41.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.918+0000 7f635d1639c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.8037930266624252016', time=2024-09-14T13:27:52.026630+0000, chain.objs.size()=3 2024-09-14T11:36:41.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.918+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__multipart_foo-STANDARD.2~vfDoXiTVhFA7T9j9Mah7i0_qIuVFA2D.1 2024-09-14T11:36:41.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.918+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__multipart_foo-STANDARD.2~vfDoXiTVhFA7T9j9Mah7i0_qIuVFA2D.2 2024-09-14T11:36:41.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.918+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__multipart_foo-STANDARD.2~vfDoXiTVhFA7T9j9Mah7i0_qIuVFA2D.3 2024-09-14T11:36:41.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.918+0000 7f635d1639c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.2794250060553398098', time=2024-09-14T13:27:52.156005+0000, chain.objs.size()=3 2024-09-14T11:36:41.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.918+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.15__multipart_foo-STANDARD.2~W5E7QNlMzdhY1Us2WBAPt2dK8dy9XLx.1 2024-09-14T11:36:41.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.918+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.15__multipart_foo-STANDARD.2~W5E7QNlMzdhY1Us2WBAPt2dK8dy9XLx.2 2024-09-14T11:36:41.916 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.918+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.15__multipart_foo-STANDARD.2~W5E7QNlMzdhY1Us2WBAPt2dK8dy9XLx.3 2024-09-14T11:36:41.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.926+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:41.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.930+0000 7f635d1639c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:36:41.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.934+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:41.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.934+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:41.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.934+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:41.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.938+0000 7f635d1639c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:36:41.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.942+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:41.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.942+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:41.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.942+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:41.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.946+0000 7f635d1639c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:36:41.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.950+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:41.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.950+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:41.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.954+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:36:41.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.954+0000 7f635d1639c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.12543994024347469545', time=2024-09-14T13:27:52.049814+0000, chain.objs.size()=5 2024-09-14T11:36:41.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.954+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__multipart_foo-LUKEWARM.2~wnGxUZz24rQ8pCuVTC2BozMef0w5grr.1 2024-09-14T11:36:41.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.954+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_foo-LUKEWARM.2~wnGxUZz24rQ8pCuVTC2BozMef0w5grr.1_1 2024-09-14T11:36:41.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.954+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__multipart_foo-LUKEWARM.2~wnGxUZz24rQ8pCuVTC2BozMef0w5grr.2 2024-09-14T11:36:41.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.954+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_foo-LUKEWARM.2~wnGxUZz24rQ8pCuVTC2BozMef0w5grr.2_1 2024-09-14T11:36:41.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.954+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__multipart_foo-LUKEWARM.2~wnGxUZz24rQ8pCuVTC2BozMef0w5grr.3 2024-09-14T11:36:41.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.958+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:41.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.962+0000 7f635d1639c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:36:41.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.966+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:41.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.966+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:41.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.966+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:36:41.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.966+0000 7f635d1639c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.9396261497937821289', time=2024-09-14T13:27:51.892819+0000, chain.objs.size()=2 2024-09-14T11:36:41.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.966+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.16__shadow_.CgDU-ASKYTEkR7gJy21pheomq78MAe3_0 2024-09-14T11:36:41.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.966+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.16__shadow_.CgDU-ASKYTEkR7gJy21pheomq78MAe3_1 2024-09-14T11:36:41.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.966+0000 7f635d1639c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.17420912978980184107', time=2024-09-14T13:27:52.092359+0000, chain.objs.size()=5 2024-09-14T11:36:41.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.966+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__multipart_foo-FROZEN.2~Z2XsI4VViPIwKl8YefERH4QpfwU7wbu.1 2024-09-14T11:36:41.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.966+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_foo-FROZEN.2~Z2XsI4VViPIwKl8YefERH4QpfwU7wbu.1_1 2024-09-14T11:36:41.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.966+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__multipart_foo-FROZEN.2~Z2XsI4VViPIwKl8YefERH4QpfwU7wbu.2 2024-09-14T11:36:41.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.966+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_foo-FROZEN.2~Z2XsI4VViPIwKl8YefERH4QpfwU7wbu.2_1 2024-09-14T11:36:41.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.966+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__multipart_foo-FROZEN.2~Z2XsI4VViPIwKl8YefERH4QpfwU7wbu.3 2024-09-14T11:36:41.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.966+0000 7f635d1639c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.16615220495683222752', time=2024-09-14T13:27:52.221522+0000, chain.objs.size()=3 2024-09-14T11:36:41.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.966+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.14__shadow_.JnrMy6l1epGhjU9F5I5LlUDMe0hMSmD_0 2024-09-14T11:36:41.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.966+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.14__shadow_.JnrMy6l1epGhjU9F5I5LlUDMe0hMSmD_1 2024-09-14T11:36:41.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.966+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.14__shadow_.JnrMy6l1epGhjU9F5I5LlUDMe0hMSmD_2 2024-09-14T11:36:41.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.974+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:41.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.978+0000 7f635d1639c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:36:41.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.982+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:41.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.982+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:41.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.986+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:36:41.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.986+0000 7f635d1639c0 20 garbage collection: RGWGC::process iterating over entry tag='_X6fkfTDX0KCwF-pexucVwN8MgSsAen_', time=2024-09-14T13:27:52.081645+0000, chain.objs.size()=1 2024-09-14T11:36:41.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.986+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_.eq9ST321Tm8ugkG1z6_CiGWxIH2gF4W_0 2024-09-14T11:36:41.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.990+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:41.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.994+0000 7f635d1639c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:36:41.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.998+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:41.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:41.998+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:41.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.002+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:36:41.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.002+0000 7f635d1639c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.3191211840646490391', time=2024-09-14T13:27:51.591449+0000, chain.objs.size()=4 2024-09-14T11:36:41.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.002+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.12__multipart_foo.2~RgUV0a2AutdXXNPezH4-p8Y_HGHBtFw.1 2024-09-14T11:36:41.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.002+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.12__multipart_foo.2~RgUV0a2AutdXXNPezH4-p8Y_HGHBtFw.2 2024-09-14T11:36:41.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.002+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.12__multipart_foo.2~RgUV0a2AutdXXNPezH4-p8Y_HGHBtFw.3 2024-09-14T11:36:41.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.002+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.12__multipart_foo.2~RgUV0a2AutdXXNPezH4-p8Y_HGHBtFw.4 2024-09-14T11:36:42.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.006+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:42.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.010+0000 7f635d1639c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:36:42.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.014+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.014+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.014+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:36:42.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.014+0000 7f635d1639c0 20 garbage collection: RGWGC::process iterating over entry tag='_rVi17clicgbLD6ty84WUvZDNyg26rm1', time=2024-09-14T13:27:51.810853+0000, chain.objs.size()=1 2024-09-14T11:36:42.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.014+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.16__shadow_.dPHvP8Vey-u-OsnxahCFfBL3Kzj_z_r_1 2024-09-14T11:36:42.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.018+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:42.020 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.026+0000 7f635d1639c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:36:42.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.026+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.030+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.030+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.034+0000 7f635d1639c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:36:42.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.038+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.038+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.042+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:36:42.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.042+0000 7f635d1639c0 20 garbage collection: RGWGC::process iterating over entry tag='_35v80u_EhgUGaKp6Jf9LqzfSk8w8bW7', time=2024-09-14T13:27:51.796548+0000, chain.objs.size()=1 2024-09-14T11:36:42.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.042+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.16__shadow_.VZwIiKPS5qQZFd0Lu4ezofoaHYB0gPN_0 2024-09-14T11:36:42.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.042+0000 7f635d1639c0 20 garbage collection: RGWGC::process iterating over entry tag='_JyXHmYTKy5ZsuLSHxjrOIU2XM7tOwy8', time=2024-09-14T13:27:51.904697+0000, chain.objs.size()=1 2024-09-14T11:36:42.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.042+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.16__shadow_.rjW8L7jgXZDXf1BMIlFl0q4z3pSiVFQ_0 2024-09-14T11:36:42.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.042+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:42.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.050+0000 7f635d1639c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:36:42.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.054+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.054+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.054+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:36:42.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.054+0000 7f635d1639c0 20 garbage collection: RGWGC::process iterating over entry tag='_Gm8wD5KmXYyuZCDueJQwJka2TnU30ux', time=2024-09-14T13:27:51.969501+0000, chain.objs.size()=1 2024-09-14T11:36:42.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.054+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_.HBEZZ0957jeoV1S-Dd1gk3xvuNP_bYH_0 2024-09-14T11:36:42.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.054+0000 7f635d1639c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.917786962471870912', time=2024-09-14T13:27:51.993196+0000, chain.objs.size()=5 2024-09-14T11:36:42.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.054+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__multipart_foo-FROZEN.2~Z2XsI4VViPIwKl8YefERH4QpfwU7wbu.1 2024-09-14T11:36:42.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.054+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_foo-FROZEN.2~Z2XsI4VViPIwKl8YefERH4QpfwU7wbu.1_1 2024-09-14T11:36:42.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.054+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__multipart_foo-FROZEN.2~Z2XsI4VViPIwKl8YefERH4QpfwU7wbu.2 2024-09-14T11:36:42.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.054+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_foo-FROZEN.2~Z2XsI4VViPIwKl8YefERH4QpfwU7wbu.2_1 2024-09-14T11:36:42.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.054+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__multipart_foo-FROZEN.2~Z2XsI4VViPIwKl8YefERH4QpfwU7wbu.3 2024-09-14T11:36:42.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.062+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:42.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.066+0000 7f635d1639c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:36:42.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.074+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.074+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.071 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.074+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.078+0000 7f635d1639c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:36:42.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.082+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.082+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.086+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.086+0000 7f635d1639c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:36:42.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.090+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.094+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.094+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:36:42.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.094+0000 7f635d1639c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.13092448305453608123', time=2024-09-14T13:27:51.635853+0000, chain.objs.size()=4 2024-09-14T11:36:42.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.094+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.13__multipart_foo.2~6R_Xep2QplJg4wL2LIgbe5EgHgL5iSh.1 2024-09-14T11:36:42.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.094+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.13__multipart_foo.2~6R_Xep2QplJg4wL2LIgbe5EgHgL5iSh.2 2024-09-14T11:36:42.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.094+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.13__multipart_foo.2~6R_Xep2QplJg4wL2LIgbe5EgHgL5iSh.3 2024-09-14T11:36:42.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.094+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.13__multipart_foo.2~6R_Xep2QplJg4wL2LIgbe5EgHgL5iSh.4 2024-09-14T11:36:42.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.098+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:42.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.102+0000 7f635d1639c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:36:42.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.106+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.106+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.110+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.110+0000 7f635d1639c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:36:42.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.114+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.118+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.118+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:36:42.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.118+0000 7f635d1639c0 20 garbage collection: RGWGC::process iterating over entry tag='_TmOp8RidCet_RFvBfGje759qdGjU2Mi', time=2024-09-14T13:27:52.004348+0000, chain.objs.size()=3 2024-09-14T11:36:42.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.118+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_.HLvejBt-OW582ZPnwGF9lILyTF9ES2I_0 2024-09-14T11:36:42.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.118+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_.HLvejBt-OW582ZPnwGF9lILyTF9ES2I_1 2024-09-14T11:36:42.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.118+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_.HLvejBt-OW582ZPnwGF9lILyTF9ES2I_2 2024-09-14T11:36:42.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.126+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:42.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.130+0000 7f635d1639c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:36:42.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.134+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.138+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.138+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:36:42.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.138+0000 7f635d1639c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.9686345642249279478', time=2024-09-14T13:27:51.687682+0000, chain.objs.size()=4 2024-09-14T11:36:42.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.138+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.11__multipart_foo.2~2OoCl30kmY2RdV0wwJOAZ2sLLiC51n4.1 2024-09-14T11:36:42.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.138+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.11__multipart_foo.2~2OoCl30kmY2RdV0wwJOAZ2sLLiC51n4.2 2024-09-14T11:36:42.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.138+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.11__multipart_foo.2~2OoCl30kmY2RdV0wwJOAZ2sLLiC51n4.3 2024-09-14T11:36:42.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.138+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.11__multipart_foo.2~2OoCl30kmY2RdV0wwJOAZ2sLLiC51n4.4 2024-09-14T11:36:42.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.142+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:42.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.150+0000 7f635d1639c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:36:42.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.150+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.154+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.154+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:36:42.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.154+0000 7f635d1639c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.14726407191215750792', time=2024-09-14T13:27:52.145606+0000, chain.objs.size()=5 2024-09-14T11:36:42.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.154+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.15__multipart_foo-FROZEN.2~FfoX9V2Ci3TsZQUZwus2W4ghQDo916Y.1 2024-09-14T11:36:42.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.154+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.15__shadow_foo-FROZEN.2~FfoX9V2Ci3TsZQUZwus2W4ghQDo916Y.1_1 2024-09-14T11:36:42.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.154+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.15__multipart_foo-FROZEN.2~FfoX9V2Ci3TsZQUZwus2W4ghQDo916Y.2 2024-09-14T11:36:42.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.154+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.15__shadow_foo-FROZEN.2~FfoX9V2Ci3TsZQUZwus2W4ghQDo916Y.2_1 2024-09-14T11:36:42.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.154+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.15__multipart_foo-FROZEN.2~FfoX9V2Ci3TsZQUZwus2W4ghQDo916Y.3 2024-09-14T11:36:42.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.162+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:42.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.170+0000 7f635d1639c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:36:42.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.170+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.174+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.174+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:36:42.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.174+0000 7f635d1639c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.6910468811735193230', time=2024-09-14T13:27:51.744952+0000, chain.objs.size()=4 2024-09-14T11:36:42.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.174+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.10__multipart_foo.2~qOkeBLCZltEPanteIm6avI1371rWb-y.1 2024-09-14T11:36:42.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.174+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.10__multipart_foo.2~qOkeBLCZltEPanteIm6avI1371rWb-y.2 2024-09-14T11:36:42.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.174+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.10__multipart_foo.2~qOkeBLCZltEPanteIm6avI1371rWb-y.3 2024-09-14T11:36:42.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.174+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.10__multipart_foo.2~qOkeBLCZltEPanteIm6avI1371rWb-y.4 2024-09-14T11:36:42.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.174+0000 7f635d1639c0 20 garbage collection: RGWGC::process iterating over entry tag='_CUTfoLMNojCKIxCgzZN_3pxniI6pmyj', time=2024-09-14T13:27:52.039240+0000, chain.objs.size()=2 2024-09-14T11:36:42.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.174+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_.53Pknlk-PbEsb6wq7sR0Gf6HJRoAJRy_1 2024-09-14T11:36:42.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.174+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_.53Pknlk-PbEsb6wq7sR0Gf6HJRoAJRy_2 2024-09-14T11:36:42.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.182+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:42.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.186+0000 7f635d1639c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:36:42.187 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.190+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.194+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.194+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.194+0000 7f635d1639c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:36:42.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.198+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.202+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.202+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:36:42.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.202+0000 7f635d1639c0 20 garbage collection: RGWGC::process iterating over entry tag='_hlcTxeHtlgN6n-r_UHawzvKRI-B4_At', time=2024-09-14T13:27:51.832928+0000, chain.objs.size()=2 2024-09-14T11:36:42.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.202+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.16__shadow_.0tdH4twfeD8hBlBrzlQbuiNlHc2HVom_0 2024-09-14T11:36:42.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.202+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.16__shadow_.0tdH4twfeD8hBlBrzlQbuiNlHc2HVom_1 2024-09-14T11:36:42.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.202+0000 7f635d1639c0 20 garbage collection: RGWGC::process iterating over entry tag='_N4GSpgIep1FJ-APUgWG5aEKS4OhG5bC', time=2024-09-14T13:27:51.843940+0000, chain.objs.size()=2 2024-09-14T11:36:42.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.202+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.16__shadow_.Xuu6HsF9QkZmTAdMWGRq4uA9hbJYCEy_0 2024-09-14T11:36:42.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.202+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.16__shadow_.Xuu6HsF9QkZmTAdMWGRq4uA9hbJYCEy_1 2024-09-14T11:36:42.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.206+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:42.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.214+0000 7f635d1639c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:36:42.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.218+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.218+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.222+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.226+0000 7f635d1639c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:36:42.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.230+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.230+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.226 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.230+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.234+0000 7f635d1639c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:36:42.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.238+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.238+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.238+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:36:42.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.238+0000 7f635d1639c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.10206638901650819103', time=2024-09-14T13:27:52.166420+0000, chain.objs.size()=5 2024-09-14T11:36:42.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.238+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.15__multipart_foo-LUKEWARM.2~v_EepglqXwkb2GCnKZuRv55Y-yVzA16.1 2024-09-14T11:36:42.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.238+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.15__shadow_foo-LUKEWARM.2~v_EepglqXwkb2GCnKZuRv55Y-yVzA16.1_1 2024-09-14T11:36:42.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.238+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.15__multipart_foo-LUKEWARM.2~v_EepglqXwkb2GCnKZuRv55Y-yVzA16.2 2024-09-14T11:36:42.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.238+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.15__shadow_foo-LUKEWARM.2~v_EepglqXwkb2GCnKZuRv55Y-yVzA16.2_1 2024-09-14T11:36:42.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.238+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.15__multipart_foo-LUKEWARM.2~v_EepglqXwkb2GCnKZuRv55Y-yVzA16.3 2024-09-14T11:36:42.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.238+0000 7f635d1639c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.4949082907019608828', time=2024-09-14T13:27:52.239295+0000, chain.objs.size()=3 2024-09-14T11:36:42.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.238+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.14__shadow_.UMp4Mq3VuzxrP8luL67QKnJipTCrINQ_0 2024-09-14T11:36:42.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.238+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.14__shadow_.UMp4Mq3VuzxrP8luL67QKnJipTCrINQ_1 2024-09-14T11:36:42.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.238+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.14__shadow_.UMp4Mq3VuzxrP8luL67QKnJipTCrINQ_2 2024-09-14T11:36:42.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.246+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:42.249 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.254+0000 7f635d1639c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:36:42.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.258+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.254 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.258+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.258+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:36:42.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.258+0000 7f635d1639c0 20 garbage collection: RGWGC::process iterating over entry tag='_x1PfNkElFUp7ruIivay9VNBSwx2qLuC', time=2024-09-14T13:27:51.863649+0000, chain.objs.size()=1 2024-09-14T11:36:42.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.258+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.16__shadow_.a1g67wTKQM9cY0OVZFZ08fLf7hGdADX_1 2024-09-14T11:36:42.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.258+0000 7f635d1639c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.8930030370581082418', time=2024-09-14T13:27:52.070956+0000, chain.objs.size()=5 2024-09-14T11:36:42.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.258+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__multipart_foo-LUKEWARM.2~wnGxUZz24rQ8pCuVTC2BozMef0w5grr.1 2024-09-14T11:36:42.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.258+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_foo-LUKEWARM.2~wnGxUZz24rQ8pCuVTC2BozMef0w5grr.1_1 2024-09-14T11:36:42.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.258+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__multipart_foo-LUKEWARM.2~wnGxUZz24rQ8pCuVTC2BozMef0w5grr.2 2024-09-14T11:36:42.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.258+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__shadow_foo-LUKEWARM.2~wnGxUZz24rQ8pCuVTC2BozMef0w5grr.2_1 2024-09-14T11:36:42.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.258+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.17__multipart_foo-LUKEWARM.2~wnGxUZz24rQ8pCuVTC2BozMef0w5grr.3 2024-09-14T11:36:42.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.266+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:42.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.270+0000 7f635d1639c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:36:42.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.274+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.274+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.278+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:36:42.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.278+0000 7f635d1639c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.11486585344214849425', time=2024-09-14T13:27:51.915443+0000, chain.objs.size()=2 2024-09-14T11:36:42.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.278+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.16__shadow_.g6sq6Rn7qrpVyLqE2LIWJDgnfTZSSP9_0 2024-09-14T11:36:42.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.278+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.16__shadow_.g6sq6Rn7qrpVyLqE2LIWJDgnfTZSSP9_1 2024-09-14T11:36:42.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.282+0000 7f635d1639c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:42.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.286+0000 7f635d1639c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:36:42.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.290+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.290+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.290+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.294+0000 7f635d1639c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:36:42.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.298+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.298+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.298+0000 7f635d1639c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.302+0000 7f62117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:42.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.306+0000 7f635d1639c0 20 remove_watcher() i=0 2024-09-14T11:36:42.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.306+0000 7f635d1639c0 2 removed watcher, disabling cache 2024-09-14T11:36:42.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.310+0000 7f635d1639c0 20 remove_watcher() i=1 2024-09-14T11:36:42.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.310+0000 7f635d1639c0 20 remove_watcher() i=2 2024-09-14T11:36:42.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.314+0000 7f635d1639c0 20 remove_watcher() i=3 2024-09-14T11:36:42.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.318+0000 7f635d1639c0 20 remove_watcher() i=4 2024-09-14T11:36:42.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.318+0000 7f635d1639c0 20 remove_watcher() i=5 2024-09-14T11:36:42.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.322+0000 7f635d1639c0 20 remove_watcher() i=6 2024-09-14T11:36:42.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.326+0000 7f635d1639c0 20 remove_watcher() i=7 2024-09-14T11:36:42.339 DEBUG:teuthology.orchestra.run.smithi071:> radosgw-admin gc process --include-all 2024-09-14T11:36:42.410 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:42.410 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:42.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.462+0000 7f71bdaeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.462+0000 7f71bdaeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:42.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.462+0000 7f71bdaeb9c0 20 realm 2024-09-14T11:36:42.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.462+0000 7f71bdaeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.466+0000 7f71bdaeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:42.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.466+0000 7f71bdaeb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:42.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.466+0000 7f71bdaeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.466+0000 7f71bdaeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:42.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.466+0000 7f71bdaeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.466+0000 7f71bdaeb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:42.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.466+0000 7f71bdaeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.466+0000 7f71bdaeb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:42.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.466+0000 7f71bdaeb9c0 20 searching for the correct realm 2024-09-14T11:36:42.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.470+0000 7f71bbdf2640 0 -- 172.21.15.71:0/3726981125 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f71a403d060 msgr2=0x7f71a4064020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:42.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.478+0000 7f71bbdf2640 0 -- 172.21.15.71:0/3726981125 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55d9d9cded60 msgr2=0x55d9d9ce1170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:42.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.486+0000 7f71bdaeb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:42.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.486+0000 7f71bdaeb9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:36:42.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.486+0000 7f71bdaeb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:42.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.486+0000 7f71bdaeb9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:36:42.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.486+0000 7f71bdaeb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:42.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.486+0000 7f71bdaeb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:42.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.486+0000 7f71bdaeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.486+0000 7f71bdaeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:42.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.486+0000 7f71bdaeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.486+0000 7f71bdaeb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:42.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.486+0000 7f71bdaeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.490+0000 7f71bdaeb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:42.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.490+0000 7f71bdaeb9c0 20 zone default found 2024-09-14T11:36:42.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.490+0000 7f71bdaeb9c0 4 Realm: () 2024-09-14T11:36:42.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.490+0000 7f71bdaeb9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:36:42.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.490+0000 7f71bdaeb9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:36:42.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.490+0000 7f71bdaeb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:42.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.490+0000 7f71bdaeb9c0 20 zonegroup default 2024-09-14T11:36:42.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.490+0000 7f71bdaeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.490+0000 7f71bdaeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:42.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.490+0000 7f71bdaeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.490+0000 7f71bdaeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:42.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.490+0000 7f71bdaeb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.490+0000 7f71bdaeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:42.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.490+0000 7f71bdaeb9c0 20 started sync module instance, tier type = 2024-09-14T11:36:42.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.490+0000 7f71bdaeb9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:36:42.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.510+0000 7f71bdaeb9c0 20 add_watcher() i=0 2024-09-14T11:36:42.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.510+0000 7f71bdaeb9c0 20 add_watcher() i=1 2024-09-14T11:36:42.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.510+0000 7f71bdaeb9c0 20 add_watcher() i=2 2024-09-14T11:36:42.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.510+0000 7f71bdaeb9c0 20 add_watcher() i=3 2024-09-14T11:36:42.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.510+0000 7f71bdaeb9c0 20 add_watcher() i=4 2024-09-14T11:36:42.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.510+0000 7f71bdaeb9c0 20 add_watcher() i=5 2024-09-14T11:36:42.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.510+0000 7f71bdaeb9c0 20 add_watcher() i=6 2024-09-14T11:36:42.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.514+0000 7f71bdaeb9c0 20 add_watcher() i=7 2024-09-14T11:36:42.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.514+0000 7f71bdaeb9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:42.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.514+0000 7f7071fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:42.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.518+0000 7f71bdaeb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:42.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.518+0000 7f71bdaeb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:42.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.594+0000 7f7070fe1640 20 reqs_thread_entry: start 2024-09-14T11:36:42.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.594+0000 7f71bdaeb9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:42.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.594+0000 7f71bdaeb9c0 20 Filter name: none 2024-09-14T11:36:42.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.594+0000 7f6fea7fc640 20 reqs_thread_entry: start 2024-09-14T11:36:42.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.594+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:36:42.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.598+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.598+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.602+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.602+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:36:42.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.606+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.606+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.606+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.610+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:36:42.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.614+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.614+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.618+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.618+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:36:42.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.622+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.622+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.626+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.626+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:36:42.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.630+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.630+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.630+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.629 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.634+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:36:42.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.638+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.638+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.638+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.638+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:36:42.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.642+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.646+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.646+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.650+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:36:42.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.654+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.654+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.654+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.654+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:36:42.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.658+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.658+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.662+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.662+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:36:42.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.666+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.666+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.666+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.670+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:36:42.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.670+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.670+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.670+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.674+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:36:42.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.674+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.674+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.678+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.678+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:36:42.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.682+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.686+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.686+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.690+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:36:42.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.690+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.690+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.690+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.694+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:36:42.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.698+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.698+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.702+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.702+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:36:42.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.706+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.706+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.706+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.710+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:36:42.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.714+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.714+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.714+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.718+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:36:42.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.718+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.722+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.722+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.722+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:36:42.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.730+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.730+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.734+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.734+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:36:42.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.738+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.738+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.738+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.742+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:36:42.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.746+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.746+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.746+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.750+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:36:42.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.754+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.754+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.754+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.754+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:36:42.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.758+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.762+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.762+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.762+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:36:42.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.766+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.770+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.770+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.774+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:36:42.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.778+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.778+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.778+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.782+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:36:42.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.786+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.784 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.790+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.790+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.794+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:36:42.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.798+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.798+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.798+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.802+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:36:42.802 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.806+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.810+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.810+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.810+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:36:42.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.814+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.818+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.818+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.818+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:36:42.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.826+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.826+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.826+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.830+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:36:42.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.834+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.834+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.834+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.838+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:36:42.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.842+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.842+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:42.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.846+0000 7f71bdaeb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:42.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.850+0000 7f7071fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:42.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.854+0000 7f71bdaeb9c0 20 remove_watcher() i=0 2024-09-14T11:36:42.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.854+0000 7f71bdaeb9c0 2 removed watcher, disabling cache 2024-09-14T11:36:42.852 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.858+0000 7f71bdaeb9c0 20 remove_watcher() i=1 2024-09-14T11:36:42.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.858+0000 7f71bdaeb9c0 20 remove_watcher() i=2 2024-09-14T11:36:42.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.862+0000 7f71bdaeb9c0 20 remove_watcher() i=3 2024-09-14T11:36:42.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.862+0000 7f71bdaeb9c0 20 remove_watcher() i=4 2024-09-14T11:36:42.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.866+0000 7f71bdaeb9c0 20 remove_watcher() i=5 2024-09-14T11:36:42.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.870+0000 7f71bdaeb9c0 20 remove_watcher() i=6 2024-09-14T11:36:42.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:36:42.870+0000 7f71bdaeb9c0 20 remove_watcher() i=7 2024-09-14T11:36:42.885 DEBUG:teuthology.orchestra.run.smithi071:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-14T11:36:43.527 INFO:teuthology.orchestra.run.smithi071.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-14T11:36:48.128 INFO:teuthology.orchestra.run.smithi071.stdout:> Task :clean UP-TO-DATE 2024-09-14T11:37:06.626 INFO:teuthology.orchestra.run.smithi071.stdout:> Task :compileJava 2024-09-14T11:37:06.626 INFO:teuthology.orchestra.run.smithi071.stdout:> Task :processResources 2024-09-14T11:37:06.626 INFO:teuthology.orchestra.run.smithi071.stdout:> Task :classes 2024-09-14T11:37:07.426 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:07.426 INFO:teuthology.orchestra.run.smithi071.stdout:> Task :compileTestJava 2024-09-14T11:37:07.427 INFO:teuthology.orchestra.run.smithi071.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:37:07.427 INFO:teuthology.orchestra.run.smithi071.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:37:07.427 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:07.428 INFO:teuthology.orchestra.run.smithi071.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:37:07.428 INFO:teuthology.orchestra.run.smithi071.stdout:> Task :testClasses 2024-09-14T11:37:13.826 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:13.826 INFO:teuthology.orchestra.run.smithi071.stdout:> Task :test 2024-09-14T11:37:13.826 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:13.826 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-14T11:37:14.626 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:14.626 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-14T11:37:14.926 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:14.926 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-14T11:37:15.026 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:15.026 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-14T11:37:15.326 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:15.326 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-14T11:37:15.826 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:15.826 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-14T11:37:16.126 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:16.126 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-14T11:37:16.126 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:16.126 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-14T11:37:16.226 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:16.226 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-14T11:37:16.326 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:16.326 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-14T11:37:16.525 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:16.526 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-14T11:37:17.126 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:17.126 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-14T11:37:17.626 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:17.626 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-14T11:37:17.826 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:17.920 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-14T11:37:17.920 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14 11:37:17,795 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:37:23.026 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:23.026 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-14T11:37:23.526 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:23.526 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-14T11:37:23.526 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:23.526 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-14T11:37:23.826 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:23.826 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-14T11:37:23.826 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:23.826 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-14T11:37:24.326 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:24.326 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-14T11:37:25.026 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:25.026 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-14T11:37:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:25.326 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-14T11:37:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:25.326 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-14T11:37:25.426 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:25.426 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-14T11:37:27.826 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:27.826 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-14T11:37:28.126 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:28.126 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-14T11:37:28.626 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:28.626 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-14T11:37:28.926 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:28.926 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-14T11:37:29.326 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:29.326 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-14T11:37:29.626 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:29.626 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-14T11:37:38.426 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:38.426 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-14T11:37:38.726 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:38.726 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-14T11:37:40.226 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:40.226 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-14T11:37:40.526 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:40.526 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-14T11:37:41.426 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:41.426 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-14T11:37:41.726 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:41.726 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-14T11:37:42.126 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:42.126 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-14T11:37:42.626 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:42.626 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-14T11:37:42.626 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:42.626 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-14T11:37:42.926 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:42.926 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-14T11:37:42.926 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:42.926 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-14T11:37:43.225 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:43.226 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-14T11:37:43.329 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:43.329 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-14T11:37:43.526 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:43.526 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-14T11:37:43.625 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:43.626 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-14T11:37:43.926 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:43.926 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-14T11:37:43.926 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:43.926 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-14T11:37:44.226 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:44.226 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-14T11:37:44.226 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:44.226 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-14T11:37:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:44.526 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-14T11:37:44.526 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:44.526 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-14T11:37:44.826 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:44.826 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-14T11:37:45.426 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:45.426 INFO:teuthology.orchestra.run.smithi071.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-14T11:37:45.726 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:45.726 INFO:teuthology.orchestra.run.smithi071.stdout:---------------------------------------------------------------------- 2024-09-14T11:37:45.726 INFO:teuthology.orchestra.run.smithi071.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-14T11:37:45.726 INFO:teuthology.orchestra.run.smithi071.stdout:---------------------------------------------------------------------- 2024-09-14T11:37:45.812 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:45.813 INFO:teuthology.orchestra.run.smithi071.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:37:45.813 INFO:teuthology.orchestra.run.smithi071.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:37:45.813 INFO:teuthology.orchestra.run.smithi071.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:37:45.813 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:45.813 INFO:teuthology.orchestra.run.smithi071.stdout:BUILD SUCCESSFUL in 1m 2s 2024-09-14T11:37:45.813 INFO:teuthology.orchestra.run.smithi071.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-14T11:37:46.134 DEBUG:teuthology.orchestra.run.smithi071:> radosgw-admin gc process --include-all 2024-09-14T11:37:46.166 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:46.167 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:46.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.216+0000 7f198b9c39c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:46.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.216+0000 7f198b9c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:46.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.216+0000 7f198b9c39c0 20 realm 2024-09-14T11:37:46.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.216+0000 7f198b9c39c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:46.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.216+0000 7f198b9c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:46.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.216+0000 7f198b9c39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:46.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.216+0000 7f198b9c39c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:46.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.220+0000 7f198b9c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:46.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.220+0000 7f198b9c39c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:46.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.220+0000 7f198b9c39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:46.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.220+0000 7f198b9c39c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:46.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.220+0000 7f198b9c39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:46.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.220+0000 7f198b9c39c0 20 searching for the correct realm 2024-09-14T11:37:46.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.224+0000 7f1988cc8640 0 -- 172.21.15.71:0/2001209152 >> [v2:172.21.15.71:6824/2436891866,v1:172.21.15.71:6825/2436891866] conn(0x7f197c0a8b60 msgr2=0x7f197c0dd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:46.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.440+0000 7f19894c9640 0 -- 172.21.15.71:0/2001209152 >> [v2:172.21.15.157:6816/1231501119,v1:172.21.15.157:6817/1231501119] conn(0x558dd1511e00 msgr2=0x558dd15142c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:46.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.456+0000 7f198b9c39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:46.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.456+0000 7f198b9c39c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:37:46.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.456+0000 7f198b9c39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:46.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.456+0000 7f198b9c39c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:37:46.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.456+0000 7f198b9c39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:46.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.456+0000 7f198b9c39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:46.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.456+0000 7f198b9c39c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:46.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.456+0000 7f198b9c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:46.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.456+0000 7f198b9c39c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:46.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.456+0000 7f198b9c39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:46.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.456+0000 7f198b9c39c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:46.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.460+0000 7f198b9c39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:46.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.460+0000 7f198b9c39c0 20 zone default found 2024-09-14T11:37:46.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.460+0000 7f198b9c39c0 4 Realm: () 2024-09-14T11:37:46.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.460+0000 7f198b9c39c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:37:46.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.460+0000 7f198b9c39c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:37:46.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.460+0000 7f198b9c39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:46.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.460+0000 7f198b9c39c0 20 zonegroup default 2024-09-14T11:37:46.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.460+0000 7f198b9c39c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:46.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.460+0000 7f198b9c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:46.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.460+0000 7f198b9c39c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:46.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.460+0000 7f198b9c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:46.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.460+0000 7f198b9c39c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:46.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.460+0000 7f198b9c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:46.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.460+0000 7f198b9c39c0 20 started sync module instance, tier type = 2024-09-14T11:37:46.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.460+0000 7f198b9c39c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:37:46.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.484+0000 7f198b9c39c0 20 add_watcher() i=0 2024-09-14T11:37:46.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.484+0000 7f198b9c39c0 20 add_watcher() i=1 2024-09-14T11:37:46.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.484+0000 7f198b9c39c0 20 add_watcher() i=2 2024-09-14T11:37:46.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.484+0000 7f198b9c39c0 20 add_watcher() i=3 2024-09-14T11:37:46.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.484+0000 7f198b9c39c0 20 add_watcher() i=4 2024-09-14T11:37:46.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.484+0000 7f198b9c39c0 20 add_watcher() i=5 2024-09-14T11:37:46.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.484+0000 7f198b9c39c0 20 add_watcher() i=6 2024-09-14T11:37:46.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.484+0000 7f198b9c39c0 20 add_watcher() i=7 2024-09-14T11:37:46.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.484+0000 7f198b9c39c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:46.488 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.492+0000 7f183ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:46.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.492+0000 7f198b9c39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:46.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.492+0000 7f198b9c39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:46.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.580+0000 7f183efe5640 20 reqs_thread_entry: start 2024-09-14T11:37:46.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.580+0000 7f198b9c39c0 20 init_complete bucket index max shards: 11 2024-09-14T11:37:46.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.580+0000 7f198b9c39c0 20 Filter name: none 2024-09-14T11:37:46.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.580+0000 7f183cfe1640 20 reqs_thread_entry: start 2024-09-14T11:37:46.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.580+0000 7f198b9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:37:46.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.584+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.588+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.588+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:37:46.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.588+0000 7f198b9c39c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.17650069992795765012', time=2024-09-14T13:37:41.476314+0000, chain.objs.size()=9 2024-09-14T11:37:46.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.588+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.58__multipart_key1.2~6g5HQMtqxUNRN0NCiWiKrDt4Pu7ycMj.1 2024-09-14T11:37:46.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.588+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.58__shadow_key1.2~6g5HQMtqxUNRN0NCiWiKrDt4Pu7ycMj.1_1 2024-09-14T11:37:46.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.588+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.58__multipart_key1.2~6g5HQMtqxUNRN0NCiWiKrDt4Pu7ycMj.2 2024-09-14T11:37:46.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.588+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.58__shadow_key1.2~6g5HQMtqxUNRN0NCiWiKrDt4Pu7ycMj.2_1 2024-09-14T11:37:46.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.588+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.58__multipart_key1.2~6g5HQMtqxUNRN0NCiWiKrDt4Pu7ycMj.3 2024-09-14T11:37:46.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.588+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.58__shadow_key1.2~6g5HQMtqxUNRN0NCiWiKrDt4Pu7ycMj.3_1 2024-09-14T11:37:46.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.588+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.58__multipart_key1.2~6g5HQMtqxUNRN0NCiWiKrDt4Pu7ycMj.4 2024-09-14T11:37:46.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.588+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.58__shadow_key1.2~6g5HQMtqxUNRN0NCiWiKrDt4Pu7ycMj.4_1 2024-09-14T11:37:46.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.588+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.58__multipart_key1.2~6g5HQMtqxUNRN0NCiWiKrDt4Pu7ycMj.5 2024-09-14T11:37:46.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.596+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.600+0000 7f198b9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:37:46.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.600+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.600+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.604+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.604+0000 7f198b9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:37:46.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.608+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.608+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.608+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.612+0000 7f198b9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:37:46.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.616+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.616+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.616+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:37:46.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.616+0000 7f198b9c39c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.3122078009251463538', time=2024-09-14T13:37:37.070666+0000, chain.objs.size()=16 2024-09-14T11:37:46.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.616+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~qk_an4YbNtZMgTDwZAzPbhTDZJuSIRW.1 2024-09-14T11:37:46.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.616+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~qk_an4YbNtZMgTDwZAzPbhTDZJuSIRW.1_1 2024-09-14T11:37:46.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.616+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~qk_an4YbNtZMgTDwZAzPbhTDZJuSIRW.1_2 2024-09-14T11:37:46.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.616+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~qk_an4YbNtZMgTDwZAzPbhTDZJuSIRW.2 2024-09-14T11:37:46.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.616+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~qk_an4YbNtZMgTDwZAzPbhTDZJuSIRW.2_1 2024-09-14T11:37:46.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.616+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~qk_an4YbNtZMgTDwZAzPbhTDZJuSIRW.2_2 2024-09-14T11:37:46.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.616+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~qk_an4YbNtZMgTDwZAzPbhTDZJuSIRW.3 2024-09-14T11:37:46.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.616+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~qk_an4YbNtZMgTDwZAzPbhTDZJuSIRW.3_1 2024-09-14T11:37:46.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.616+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~qk_an4YbNtZMgTDwZAzPbhTDZJuSIRW.3_2 2024-09-14T11:37:46.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.616+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~qk_an4YbNtZMgTDwZAzPbhTDZJuSIRW.4 2024-09-14T11:37:46.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.616+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~qk_an4YbNtZMgTDwZAzPbhTDZJuSIRW.4_1 2024-09-14T11:37:46.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.616+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~qk_an4YbNtZMgTDwZAzPbhTDZJuSIRW.4_2 2024-09-14T11:37:46.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.628+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~qk_an4YbNtZMgTDwZAzPbhTDZJuSIRW.5 2024-09-14T11:37:46.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.628+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~qk_an4YbNtZMgTDwZAzPbhTDZJuSIRW.5_1 2024-09-14T11:37:46.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.628+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~qk_an4YbNtZMgTDwZAzPbhTDZJuSIRW.5_2 2024-09-14T11:37:46.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.628+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~qk_an4YbNtZMgTDwZAzPbhTDZJuSIRW.6 2024-09-14T11:37:46.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.636+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.640+0000 7f198b9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:37:46.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.640+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.644+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.644+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:37:46.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.644+0000 7f198b9c39c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.13630849544228506851', time=2024-09-14T13:37:45.479973+0000, chain.objs.size()=21 2024-09-14T11:37:46.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.644+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.67__multipart_key1.2~zZJDctqRtAJJob9DXoGcC-Q9ivSrHWM.1 2024-09-14T11:37:46.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.644+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.67__shadow_key1.2~zZJDctqRtAJJob9DXoGcC-Q9ivSrHWM.1_1 2024-09-14T11:37:46.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.644+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.67__multipart_key1.2~zZJDctqRtAJJob9DXoGcC-Q9ivSrHWM.2 2024-09-14T11:37:46.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.644+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.67__shadow_key1.2~zZJDctqRtAJJob9DXoGcC-Q9ivSrHWM.2_1 2024-09-14T11:37:46.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.644+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.67__multipart_key1.2~zZJDctqRtAJJob9DXoGcC-Q9ivSrHWM.3 2024-09-14T11:37:46.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.644+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.67__shadow_key1.2~zZJDctqRtAJJob9DXoGcC-Q9ivSrHWM.3_1 2024-09-14T11:37:46.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.644+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.67__multipart_key1.2~zZJDctqRtAJJob9DXoGcC-Q9ivSrHWM.4 2024-09-14T11:37:46.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.644+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.67__shadow_key1.2~zZJDctqRtAJJob9DXoGcC-Q9ivSrHWM.4_1 2024-09-14T11:37:46.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.644+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.67__multipart_key1.2~zZJDctqRtAJJob9DXoGcC-Q9ivSrHWM.5 2024-09-14T11:37:46.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.644+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.67__shadow_key1.2~zZJDctqRtAJJob9DXoGcC-Q9ivSrHWM.5_1 2024-09-14T11:37:46.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.644+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.67__multipart_key1.2~zZJDctqRtAJJob9DXoGcC-Q9ivSrHWM.6 2024-09-14T11:37:46.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.644+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.67__shadow_key1.2~zZJDctqRtAJJob9DXoGcC-Q9ivSrHWM.6_1 2024-09-14T11:37:46.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.652+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.67__multipart_key1.2~zZJDctqRtAJJob9DXoGcC-Q9ivSrHWM.7 2024-09-14T11:37:46.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.652+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.67__shadow_key1.2~zZJDctqRtAJJob9DXoGcC-Q9ivSrHWM.7_1 2024-09-14T11:37:46.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.652+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.67__multipart_key1.2~zZJDctqRtAJJob9DXoGcC-Q9ivSrHWM.8 2024-09-14T11:37:46.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.652+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.67__shadow_key1.2~zZJDctqRtAJJob9DXoGcC-Q9ivSrHWM.8_1 2024-09-14T11:37:46.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.652+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.67__multipart_key1.2~zZJDctqRtAJJob9DXoGcC-Q9ivSrHWM.9 2024-09-14T11:37:46.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.652+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.67__shadow_key1.2~zZJDctqRtAJJob9DXoGcC-Q9ivSrHWM.9_1 2024-09-14T11:37:46.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.652+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.67__multipart_key1.2~zZJDctqRtAJJob9DXoGcC-Q9ivSrHWM.10 2024-09-14T11:37:46.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.652+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.67__shadow_key1.2~zZJDctqRtAJJob9DXoGcC-Q9ivSrHWM.10_1 2024-09-14T11:37:46.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.656+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.67__multipart_key1.2~zZJDctqRtAJJob9DXoGcC-Q9ivSrHWM.11 2024-09-14T11:37:46.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.660+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.665 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.668+0000 7f198b9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:37:46.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.668+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.672+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.672+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.672+0000 7f198b9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:37:46.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.676+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.676+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.676+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.676+0000 7f198b9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:37:46.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.680+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.680+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.680+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:37:46.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.680+0000 7f198b9c39c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.12935393007314293091', time=2024-09-14T13:37:19.825872+0000, chain.objs.size()=9 2024-09-14T11:37:46.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.680+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__multipart_key1.2~X5bEtLvrsiuJcIsDipUSHyJsBM_I7WX.1 2024-09-14T11:37:46.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.680+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__shadow_key1.2~X5bEtLvrsiuJcIsDipUSHyJsBM_I7WX.1_1 2024-09-14T11:37:46.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.680+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__multipart_key1.2~X5bEtLvrsiuJcIsDipUSHyJsBM_I7WX.2 2024-09-14T11:37:46.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.680+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__shadow_key1.2~X5bEtLvrsiuJcIsDipUSHyJsBM_I7WX.2_1 2024-09-14T11:37:46.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.680+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__multipart_key1.2~X5bEtLvrsiuJcIsDipUSHyJsBM_I7WX.3 2024-09-14T11:37:46.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.680+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__shadow_key1.2~X5bEtLvrsiuJcIsDipUSHyJsBM_I7WX.3_1 2024-09-14T11:37:46.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.680+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__multipart_key1.2~X5bEtLvrsiuJcIsDipUSHyJsBM_I7WX.4 2024-09-14T11:37:46.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.680+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__shadow_key1.2~X5bEtLvrsiuJcIsDipUSHyJsBM_I7WX.4_1 2024-09-14T11:37:46.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.680+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__multipart_key1.2~X5bEtLvrsiuJcIsDipUSHyJsBM_I7WX.5 2024-09-14T11:37:46.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.680+0000 7f198b9c39c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.8493586476827114823', time=2024-09-14T13:37:20.786410+0000, chain.objs.size()=9 2024-09-14T11:37:46.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.680+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__multipart_key1.2~PrVtev1ZoSXMTpkRJst6k254QA5N3P5.1 2024-09-14T11:37:46.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.680+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__shadow_key1.2~PrVtev1ZoSXMTpkRJst6k254QA5N3P5.1_1 2024-09-14T11:37:46.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.680+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__multipart_key1.2~PrVtev1ZoSXMTpkRJst6k254QA5N3P5.2 2024-09-14T11:37:46.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.688+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__shadow_key1.2~PrVtev1ZoSXMTpkRJst6k254QA5N3P5.2_1 2024-09-14T11:37:46.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.688+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__multipart_key1.2~PrVtev1ZoSXMTpkRJst6k254QA5N3P5.3 2024-09-14T11:37:46.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.688+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__shadow_key1.2~PrVtev1ZoSXMTpkRJst6k254QA5N3P5.3_1 2024-09-14T11:37:46.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.688+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__multipart_key1.2~PrVtev1ZoSXMTpkRJst6k254QA5N3P5.4 2024-09-14T11:37:46.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.688+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__shadow_key1.2~PrVtev1ZoSXMTpkRJst6k254QA5N3P5.4_1 2024-09-14T11:37:46.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.688+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__multipart_key1.2~PrVtev1ZoSXMTpkRJst6k254QA5N3P5.5 2024-09-14T11:37:46.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.696+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.700+0000 7f198b9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:37:46.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.704+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.704+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.708+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:37:46.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.708+0000 7f198b9c39c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.2900726300582827001', time=2024-09-14T13:37:27.860952+0000, chain.objs.size()=9 2024-09-14T11:37:46.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.708+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.53__multipart_key1.2~1MUHliZvCbdj-7Lw0oV9xOL04ENmoAa.1 2024-09-14T11:37:46.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.708+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.53__shadow_key1.2~1MUHliZvCbdj-7Lw0oV9xOL04ENmoAa.1_1 2024-09-14T11:37:46.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.708+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.53__multipart_key1.2~1MUHliZvCbdj-7Lw0oV9xOL04ENmoAa.2 2024-09-14T11:37:46.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.708+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.53__shadow_key1.2~1MUHliZvCbdj-7Lw0oV9xOL04ENmoAa.2_1 2024-09-14T11:37:46.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.708+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.53__multipart_key1.2~1MUHliZvCbdj-7Lw0oV9xOL04ENmoAa.3 2024-09-14T11:37:46.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.708+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.53__shadow_key1.2~1MUHliZvCbdj-7Lw0oV9xOL04ENmoAa.3_1 2024-09-14T11:37:46.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.708+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.53__multipart_key1.2~1MUHliZvCbdj-7Lw0oV9xOL04ENmoAa.4 2024-09-14T11:37:46.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.708+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.53__shadow_key1.2~1MUHliZvCbdj-7Lw0oV9xOL04ENmoAa.4_1 2024-09-14T11:37:46.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.708+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.53__multipart_key1.2~1MUHliZvCbdj-7Lw0oV9xOL04ENmoAa.5 2024-09-14T11:37:46.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.716+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.720+0000 7f198b9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:37:46.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.724+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.724+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.724+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.724+0000 7f198b9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:37:46.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.728+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.732+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.732+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:37:46.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.732+0000 7f198b9c39c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.12998362303366068367', time=2024-09-14T13:37:15.915515+0000, chain.objs.size()=9 2024-09-14T11:37:46.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.732+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.43__multipart_key1.2~Ihp7N6KxfgoWTaon4-cyFBeVgdR1WFl.1 2024-09-14T11:37:46.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.732+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.43__shadow_key1.2~Ihp7N6KxfgoWTaon4-cyFBeVgdR1WFl.1_1 2024-09-14T11:37:46.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.732+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.43__multipart_key1.2~Ihp7N6KxfgoWTaon4-cyFBeVgdR1WFl.2 2024-09-14T11:37:46.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.732+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.43__shadow_key1.2~Ihp7N6KxfgoWTaon4-cyFBeVgdR1WFl.2_1 2024-09-14T11:37:46.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.732+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.43__multipart_key1.2~Ihp7N6KxfgoWTaon4-cyFBeVgdR1WFl.3 2024-09-14T11:37:46.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.732+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.43__shadow_key1.2~Ihp7N6KxfgoWTaon4-cyFBeVgdR1WFl.3_1 2024-09-14T11:37:46.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.732+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.43__multipart_key1.2~Ihp7N6KxfgoWTaon4-cyFBeVgdR1WFl.4 2024-09-14T11:37:46.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.732+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.43__shadow_key1.2~Ihp7N6KxfgoWTaon4-cyFBeVgdR1WFl.4_1 2024-09-14T11:37:46.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.732+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.43__multipart_key1.2~Ihp7N6KxfgoWTaon4-cyFBeVgdR1WFl.5 2024-09-14T11:37:46.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.740+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.744+0000 7f198b9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:37:46.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.748+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.752+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.752+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:37:46.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.752+0000 7f198b9c39c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.13012491046004800400', time=2024-09-14T13:37:28.670895+0000, chain.objs.size()=9 2024-09-14T11:37:46.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.752+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.54__multipart_file.mpg.2~ZBdwSNVLlOBp1I5GpnUTzbtkMiv9816.1 2024-09-14T11:37:46.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.752+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.54__shadow_file.mpg.2~ZBdwSNVLlOBp1I5GpnUTzbtkMiv9816.1_1 2024-09-14T11:37:46.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.752+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.54__multipart_file.mpg.2~ZBdwSNVLlOBp1I5GpnUTzbtkMiv9816.2 2024-09-14T11:37:46.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.752+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.54__shadow_file.mpg.2~ZBdwSNVLlOBp1I5GpnUTzbtkMiv9816.2_1 2024-09-14T11:37:46.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.752+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.54__multipart_file.mpg.2~ZBdwSNVLlOBp1I5GpnUTzbtkMiv9816.3 2024-09-14T11:37:46.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.752+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.54__shadow_file.mpg.2~ZBdwSNVLlOBp1I5GpnUTzbtkMiv9816.3_1 2024-09-14T11:37:46.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.752+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.54__multipart_file.mpg.2~ZBdwSNVLlOBp1I5GpnUTzbtkMiv9816.4 2024-09-14T11:37:46.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.752+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.54__shadow_file.mpg.2~ZBdwSNVLlOBp1I5GpnUTzbtkMiv9816.4_1 2024-09-14T11:37:46.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.752+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.54__multipart_file.mpg.2~ZBdwSNVLlOBp1I5GpnUTzbtkMiv9816.5 2024-09-14T11:37:46.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.752+0000 7f198b9c39c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.13609021565785221832', time=2024-09-14T13:37:28.698260+0000, chain.objs.size()=9 2024-09-14T11:37:46.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.752+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.54__multipart_file2.mpg.2~apbt5TMAhzV_dVk7b8u0P8be2PTB76N.1 2024-09-14T11:37:46.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.752+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.54__shadow_file2.mpg.2~apbt5TMAhzV_dVk7b8u0P8be2PTB76N.1_1 2024-09-14T11:37:46.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.752+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.54__multipart_file2.mpg.2~apbt5TMAhzV_dVk7b8u0P8be2PTB76N.2 2024-09-14T11:37:46.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.756+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.54__shadow_file2.mpg.2~apbt5TMAhzV_dVk7b8u0P8be2PTB76N.2_1 2024-09-14T11:37:46.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.760+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.54__multipart_file2.mpg.2~apbt5TMAhzV_dVk7b8u0P8be2PTB76N.3 2024-09-14T11:37:46.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.760+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.54__shadow_file2.mpg.2~apbt5TMAhzV_dVk7b8u0P8be2PTB76N.3_1 2024-09-14T11:37:46.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.760+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.54__multipart_file2.mpg.2~apbt5TMAhzV_dVk7b8u0P8be2PTB76N.4 2024-09-14T11:37:46.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.760+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.54__shadow_file2.mpg.2~apbt5TMAhzV_dVk7b8u0P8be2PTB76N.4_1 2024-09-14T11:37:46.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.760+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.54__multipart_file2.mpg.2~apbt5TMAhzV_dVk7b8u0P8be2PTB76N.5 2024-09-14T11:37:46.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.760+0000 7f198b9c39c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.16345632151531451985', time=2024-09-14T13:37:35.749499+0000, chain.objs.size()=19 2024-09-14T11:37:46.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.760+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~MAoK6i87gdDTrHwFv9vyAczLCczFDjS.1 2024-09-14T11:37:46.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.760+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~MAoK6i87gdDTrHwFv9vyAczLCczFDjS.1_1 2024-09-14T11:37:46.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.760+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~MAoK6i87gdDTrHwFv9vyAczLCczFDjS.2 2024-09-14T11:37:46.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.760+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~MAoK6i87gdDTrHwFv9vyAczLCczFDjS.2_1 2024-09-14T11:37:46.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.760+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~MAoK6i87gdDTrHwFv9vyAczLCczFDjS.3 2024-09-14T11:37:46.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.764+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~MAoK6i87gdDTrHwFv9vyAczLCczFDjS.3_1 2024-09-14T11:37:46.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.768+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~MAoK6i87gdDTrHwFv9vyAczLCczFDjS.4 2024-09-14T11:37:46.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.768+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~MAoK6i87gdDTrHwFv9vyAczLCczFDjS.4_1 2024-09-14T11:37:46.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.768+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~MAoK6i87gdDTrHwFv9vyAczLCczFDjS.5 2024-09-14T11:37:46.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.768+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~MAoK6i87gdDTrHwFv9vyAczLCczFDjS.5_1 2024-09-14T11:37:46.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.768+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~MAoK6i87gdDTrHwFv9vyAczLCczFDjS.6 2024-09-14T11:37:46.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.768+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~MAoK6i87gdDTrHwFv9vyAczLCczFDjS.6_1 2024-09-14T11:37:46.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.772+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~MAoK6i87gdDTrHwFv9vyAczLCczFDjS.7 2024-09-14T11:37:46.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.772+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~MAoK6i87gdDTrHwFv9vyAczLCczFDjS.7_1 2024-09-14T11:37:46.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.772+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~MAoK6i87gdDTrHwFv9vyAczLCczFDjS.8 2024-09-14T11:37:46.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.772+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~MAoK6i87gdDTrHwFv9vyAczLCczFDjS.8_1 2024-09-14T11:37:46.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.772+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~MAoK6i87gdDTrHwFv9vyAczLCczFDjS.9 2024-09-14T11:37:46.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.772+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~MAoK6i87gdDTrHwFv9vyAczLCczFDjS.9_1 2024-09-14T11:37:46.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.772+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~MAoK6i87gdDTrHwFv9vyAczLCczFDjS.10 2024-09-14T11:37:46.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.780+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.784+0000 7f198b9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:37:46.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.788+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.785 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.788+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.786 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.788+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.792+0000 7f198b9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:37:46.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.792+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.792+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.796+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.796+0000 7f198b9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:37:46.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.800+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.800+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.800+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:37:46.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.800+0000 7f198b9c39c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.17315134683040515175', time=2024-09-14T13:37:17.165198+0000, chain.objs.size()=9 2024-09-14T11:37:46.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.800+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.45__multipart_key1.2~le6SYtyDbAr24VUERoArBJ2HIfR1w5p.1 2024-09-14T11:37:46.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.800+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.45__shadow_key1.2~le6SYtyDbAr24VUERoArBJ2HIfR1w5p.1_1 2024-09-14T11:37:46.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.800+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.45__multipart_key1.2~le6SYtyDbAr24VUERoArBJ2HIfR1w5p.2 2024-09-14T11:37:46.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.800+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.45__shadow_key1.2~le6SYtyDbAr24VUERoArBJ2HIfR1w5p.2_1 2024-09-14T11:37:46.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.800+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.45__multipart_key1.2~le6SYtyDbAr24VUERoArBJ2HIfR1w5p.3 2024-09-14T11:37:46.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.800+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.45__shadow_key1.2~le6SYtyDbAr24VUERoArBJ2HIfR1w5p.3_1 2024-09-14T11:37:46.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.800+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.45__multipart_key1.2~le6SYtyDbAr24VUERoArBJ2HIfR1w5p.4 2024-09-14T11:37:46.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.800+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.45__shadow_key1.2~le6SYtyDbAr24VUERoArBJ2HIfR1w5p.4_1 2024-09-14T11:37:46.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.800+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.45__multipart_key1.2~le6SYtyDbAr24VUERoArBJ2HIfR1w5p.5 2024-09-14T11:37:46.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.800+0000 7f198b9c39c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.4560356305829156530', time=2024-09-14T13:37:22.204342+0000, chain.objs.size()=7 2024-09-14T11:37:46.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.804+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__multipart_key1.2~IMAHPNuGVdBXB23dyVUkNjNP513wZX9.1 2024-09-14T11:37:46.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.804+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__shadow_key1.2~IMAHPNuGVdBXB23dyVUkNjNP513wZX9.1_1 2024-09-14T11:37:46.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.804+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__shadow_key1.2~IMAHPNuGVdBXB23dyVUkNjNP513wZX9.1_2 2024-09-14T11:37:46.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.804+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__multipart_key1.2~IMAHPNuGVdBXB23dyVUkNjNP513wZX9.2 2024-09-14T11:37:46.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.804+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__shadow_key1.2~IMAHPNuGVdBXB23dyVUkNjNP513wZX9.2_1 2024-09-14T11:37:46.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.804+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__shadow_key1.2~IMAHPNuGVdBXB23dyVUkNjNP513wZX9.2_2 2024-09-14T11:37:46.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.804+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__multipart_key1.2~IMAHPNuGVdBXB23dyVUkNjNP513wZX9.3 2024-09-14T11:37:46.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.812+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.816+0000 7f198b9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:37:46.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.820+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.820+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.820+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:37:46.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.820+0000 7f198b9c39c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.14688342554556449441', time=2024-09-14T13:37:17.362909+0000, chain.objs.size()=9 2024-09-14T11:37:46.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.820+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.45__multipart_key1.2~le6SYtyDbAr24VUERoArBJ2HIfR1w5p.1 2024-09-14T11:37:46.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.820+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.45__shadow_key1.2~le6SYtyDbAr24VUERoArBJ2HIfR1w5p.1_1 2024-09-14T11:37:46.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.820+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.45__multipart_key1.2~le6SYtyDbAr24VUERoArBJ2HIfR1w5p.2 2024-09-14T11:37:46.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.820+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.45__shadow_key1.2~le6SYtyDbAr24VUERoArBJ2HIfR1w5p.2_1 2024-09-14T11:37:46.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.820+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.45__multipart_key1.2~le6SYtyDbAr24VUERoArBJ2HIfR1w5p.3 2024-09-14T11:37:46.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.820+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.45__shadow_key1.2~le6SYtyDbAr24VUERoArBJ2HIfR1w5p.3_1 2024-09-14T11:37:46.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.820+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.45__multipart_key1.2~le6SYtyDbAr24VUERoArBJ2HIfR1w5p.4 2024-09-14T11:37:46.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.820+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.45__shadow_key1.2~le6SYtyDbAr24VUERoArBJ2HIfR1w5p.4_1 2024-09-14T11:37:46.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.820+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.45__multipart_key1.2~le6SYtyDbAr24VUERoArBJ2HIfR1w5p.5 2024-09-14T11:37:46.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.820+0000 7f198b9c39c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.6817370797296129690', time=2024-09-14T13:37:38.457727+0000, chain.objs.size()=16 2024-09-14T11:37:46.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.820+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~PO-WxzIDSRHKuFxZ5_L8W_a6KqgsA2_.1 2024-09-14T11:37:46.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.820+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~PO-WxzIDSRHKuFxZ5_L8W_a6KqgsA2_.1_1 2024-09-14T11:37:46.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.820+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~PO-WxzIDSRHKuFxZ5_L8W_a6KqgsA2_.1_2 2024-09-14T11:37:46.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.828+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~PO-WxzIDSRHKuFxZ5_L8W_a6KqgsA2_.2 2024-09-14T11:37:46.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.828+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~PO-WxzIDSRHKuFxZ5_L8W_a6KqgsA2_.2_1 2024-09-14T11:37:46.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.828+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~PO-WxzIDSRHKuFxZ5_L8W_a6KqgsA2_.2_2 2024-09-14T11:37:46.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.828+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~PO-WxzIDSRHKuFxZ5_L8W_a6KqgsA2_.3 2024-09-14T11:37:46.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.828+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~PO-WxzIDSRHKuFxZ5_L8W_a6KqgsA2_.3_1 2024-09-14T11:37:46.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.832+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~PO-WxzIDSRHKuFxZ5_L8W_a6KqgsA2_.3_2 2024-09-14T11:37:46.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.832+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~PO-WxzIDSRHKuFxZ5_L8W_a6KqgsA2_.4 2024-09-14T11:37:46.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.832+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~PO-WxzIDSRHKuFxZ5_L8W_a6KqgsA2_.4_1 2024-09-14T11:37:46.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.832+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~PO-WxzIDSRHKuFxZ5_L8W_a6KqgsA2_.4_2 2024-09-14T11:37:46.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.836+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~PO-WxzIDSRHKuFxZ5_L8W_a6KqgsA2_.5 2024-09-14T11:37:46.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.836+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~PO-WxzIDSRHKuFxZ5_L8W_a6KqgsA2_.5_1 2024-09-14T11:37:46.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.836+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~PO-WxzIDSRHKuFxZ5_L8W_a6KqgsA2_.5_2 2024-09-14T11:37:46.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.836+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~PO-WxzIDSRHKuFxZ5_L8W_a6KqgsA2_.6 2024-09-14T11:37:46.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.840+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.848+0000 7f198b9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:37:46.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.848+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.849 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.852+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.852+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.853 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.856+0000 7f198b9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:37:46.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.856+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.860+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.860+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.860+0000 7f198b9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:37:46.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.864+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.864+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.864+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:37:46.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.864+0000 7f198b9c39c0 20 garbage collection: RGWGC::process iterating over entry tag='2~XExNSS7V_XFA4BDWryd1C1CF42WMWOu', time=2024-09-14T13:37:29.511273+0000, chain.objs.size()=5 2024-09-14T11:37:46.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.864+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.55__multipart_key1.2~XExNSS7V_XFA4BDWryd1C1CF42WMWOu.7 2024-09-14T11:37:46.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.864+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.55__shadow_key1.2~XExNSS7V_XFA4BDWryd1C1CF42WMWOu.7_1 2024-09-14T11:37:46.864 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.864+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.55__multipart_key1.2~XExNSS7V_XFA4BDWryd1C1CF42WMWOu.10 2024-09-14T11:37:46.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.864+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.55__shadow_key1.2~XExNSS7V_XFA4BDWryd1C1CF42WMWOu.10_1 2024-09-14T11:37:46.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.868+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.55__multipart_key1.2~XExNSS7V_XFA4BDWryd1C1CF42WMWOu.13 2024-09-14T11:37:46.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.868+0000 7f198b9c39c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.2662408902391856533', time=2024-09-14T13:37:32.944989+0000, chain.objs.size()=21 2024-09-14T11:37:46.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.868+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~VYdXiKxkH3gGciY28szqW1An3DEDhQ7.1 2024-09-14T11:37:46.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.868+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~VYdXiKxkH3gGciY28szqW1An3DEDhQ7.1_1 2024-09-14T11:37:46.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.868+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~VYdXiKxkH3gGciY28szqW1An3DEDhQ7.2 2024-09-14T11:37:46.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.868+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~VYdXiKxkH3gGciY28szqW1An3DEDhQ7.2_1 2024-09-14T11:37:46.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.868+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~VYdXiKxkH3gGciY28szqW1An3DEDhQ7.3 2024-09-14T11:37:46.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.868+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~VYdXiKxkH3gGciY28szqW1An3DEDhQ7.3_1 2024-09-14T11:37:46.865 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.868+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~VYdXiKxkH3gGciY28szqW1An3DEDhQ7.4 2024-09-14T11:37:46.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.872+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~VYdXiKxkH3gGciY28szqW1An3DEDhQ7.4_1 2024-09-14T11:37:46.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.872+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~VYdXiKxkH3gGciY28szqW1An3DEDhQ7.5 2024-09-14T11:37:46.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.872+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~VYdXiKxkH3gGciY28szqW1An3DEDhQ7.5_1 2024-09-14T11:37:46.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.872+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~VYdXiKxkH3gGciY28szqW1An3DEDhQ7.6 2024-09-14T11:37:46.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.872+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~VYdXiKxkH3gGciY28szqW1An3DEDhQ7.6_1 2024-09-14T11:37:46.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.872+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~VYdXiKxkH3gGciY28szqW1An3DEDhQ7.7 2024-09-14T11:37:46.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.872+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~VYdXiKxkH3gGciY28szqW1An3DEDhQ7.7_1 2024-09-14T11:37:46.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.876+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~VYdXiKxkH3gGciY28szqW1An3DEDhQ7.8 2024-09-14T11:37:46.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.876+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~VYdXiKxkH3gGciY28szqW1An3DEDhQ7.8_1 2024-09-14T11:37:46.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.876+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~VYdXiKxkH3gGciY28szqW1An3DEDhQ7.9 2024-09-14T11:37:46.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.876+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~VYdXiKxkH3gGciY28szqW1An3DEDhQ7.9_1 2024-09-14T11:37:46.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.880+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~VYdXiKxkH3gGciY28szqW1An3DEDhQ7.10 2024-09-14T11:37:46.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.880+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~VYdXiKxkH3gGciY28szqW1An3DEDhQ7.10_1 2024-09-14T11:37:46.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.880+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~VYdXiKxkH3gGciY28szqW1An3DEDhQ7.11 2024-09-14T11:37:46.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.884+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.888+0000 7f198b9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:37:46.890 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.892+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.892+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.896+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-14T11:37:46.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.896+0000 7f198b9c39c0 20 garbage collection: RGWGC::process iterating over entry tag='2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk', time=2024-09-14T13:37:42.318522+0000, chain.objs.size()=60 2024-09-14T11:37:46.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.896+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.1 2024-09-14T11:37:46.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.896+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.2 2024-09-14T11:37:46.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.896+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.3 2024-09-14T11:37:46.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.896+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.4 2024-09-14T11:37:46.893 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.896+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.5 2024-09-14T11:37:46.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.896+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.6 2024-09-14T11:37:46.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.896+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.7 2024-09-14T11:37:46.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.896+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.8 2024-09-14T11:37:46.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.896+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.9 2024-09-14T11:37:46.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.896+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.10 2024-09-14T11:37:46.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.896+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.11 2024-09-14T11:37:46.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.896+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.12 2024-09-14T11:37:46.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.900+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.13 2024-09-14T11:37:46.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.900+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.14 2024-09-14T11:37:46.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.900+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.15 2024-09-14T11:37:46.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.900+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.16 2024-09-14T11:37:46.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.900+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.17 2024-09-14T11:37:46.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.900+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.18 2024-09-14T11:37:46.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.900+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.19 2024-09-14T11:37:46.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.900+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.20 2024-09-14T11:37:46.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.900+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.21 2024-09-14T11:37:46.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.900+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.22 2024-09-14T11:37:46.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.900+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.23 2024-09-14T11:37:46.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.900+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.24 2024-09-14T11:37:46.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.904+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.25 2024-09-14T11:37:46.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.904+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.26 2024-09-14T11:37:46.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.904+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.27 2024-09-14T11:37:46.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.904+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.28 2024-09-14T11:37:46.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.904+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.29 2024-09-14T11:37:46.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.904+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.30 2024-09-14T11:37:46.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.908+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.31 2024-09-14T11:37:46.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.908+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.32 2024-09-14T11:37:46.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.908+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.33 2024-09-14T11:37:46.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.908+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.34 2024-09-14T11:37:46.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.908+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.35 2024-09-14T11:37:46.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.908+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.36 2024-09-14T11:37:46.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.908+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.37 2024-09-14T11:37:46.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.908+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.38 2024-09-14T11:37:46.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.912+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.39 2024-09-14T11:37:46.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.912+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.40 2024-09-14T11:37:46.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.912+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.41 2024-09-14T11:37:46.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.912+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.42 2024-09-14T11:37:46.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.912+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.43 2024-09-14T11:37:46.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.912+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.44 2024-09-14T11:37:46.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.912+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.45 2024-09-14T11:37:46.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.912+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.46 2024-09-14T11:37:46.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.912+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.47 2024-09-14T11:37:46.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.916+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.48 2024-09-14T11:37:46.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.916+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.49 2024-09-14T11:37:46.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.916+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.50 2024-09-14T11:37:46.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.916+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.51 2024-09-14T11:37:46.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.916+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.52 2024-09-14T11:37:46.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.916+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.53 2024-09-14T11:37:46.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.916+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.54 2024-09-14T11:37:46.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.916+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.55 2024-09-14T11:37:46.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.916+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.56 2024-09-14T11:37:46.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.916+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.57 2024-09-14T11:37:46.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.916+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.58 2024-09-14T11:37:46.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.920+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.59 2024-09-14T11:37:46.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.920+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.60 2024-09-14T11:37:46.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.920+0000 7f198b9c39c0 20 garbage collection: RGWGC::process iterating over entry tag='2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk', time=2024-09-14T13:37:42.370299+0000, chain.objs.size()=11 2024-09-14T11:37:46.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.920+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.61 2024-09-14T11:37:46.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.920+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.62 2024-09-14T11:37:46.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.920+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.63 2024-09-14T11:37:46.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.920+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.64 2024-09-14T11:37:46.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.920+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.65 2024-09-14T11:37:46.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.920+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.66 2024-09-14T11:37:46.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.920+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.67 2024-09-14T11:37:46.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.920+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.68 2024-09-14T11:37:46.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.920+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.69 2024-09-14T11:37:46.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.924+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.70 2024-09-14T11:37:46.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.924+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.71 2024-09-14T11:37:46.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.924+0000 7f198b9c39c0 20 garbage collection: RGWGC::process iterating over entry tag='2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk', time=2024-09-14T13:37:42.399999+0000, chain.objs.size()=4 2024-09-14T11:37:46.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.924+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.72 2024-09-14T11:37:46.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.924+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.74 2024-09-14T11:37:46.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.924+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.75 2024-09-14T11:37:46.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.924+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.76 2024-09-14T11:37:46.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.928+0000 7f198b9c39c0 20 garbage collection: RGWGC::process iterating over entry tag='2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk', time=2024-09-14T13:37:42.437029+0000, chain.objs.size()=6 2024-09-14T11:37:46.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.928+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.73 2024-09-14T11:37:46.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.928+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.77 2024-09-14T11:37:46.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.928+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.78 2024-09-14T11:37:46.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.928+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.79 2024-09-14T11:37:46.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.928+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.80 2024-09-14T11:37:46.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.928+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.81 2024-09-14T11:37:46.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.928+0000 7f198b9c39c0 20 garbage collection: RGWGC::process iterating over entry tag='2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk', time=2024-09-14T13:37:42.456818+0000, chain.objs.size()=6 2024-09-14T11:37:46.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.928+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.82 2024-09-14T11:37:46.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.928+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.83 2024-09-14T11:37:46.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.928+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.84 2024-09-14T11:37:46.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.928+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.85 2024-09-14T11:37:46.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.928+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.86 2024-09-14T11:37:46.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.928+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.87 2024-09-14T11:37:46.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.932+0000 7f198b9c39c0 20 garbage collection: RGWGC::process iterating over entry tag='2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk', time=2024-09-14T13:37:42.468108+0000, chain.objs.size()=3 2024-09-14T11:37:46.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.932+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.88 2024-09-14T11:37:46.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.932+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.90 2024-09-14T11:37:46.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.932+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.91 2024-09-14T11:37:46.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.932+0000 7f198b9c39c0 20 garbage collection: RGWGC::process iterating over entry tag='2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk', time=2024-09-14T13:37:42.479360+0000, chain.objs.size()=2 2024-09-14T11:37:46.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.932+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.89 2024-09-14T11:37:46.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.932+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.59__multipart_key1.2~QD6OFlIUaJabfvASzrrOHy4dE9ha-uk.92 2024-09-14T11:37:46.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.936+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.940+0000 7f198b9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:37:46.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.940+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.940+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.944+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.944+0000 7f198b9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:37:46.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.948+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.948+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.948+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.948+0000 7f198b9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:37:46.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.952+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.956+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.956+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.956+0000 7f198b9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:37:46.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.960+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.960+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.960+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.964+0000 7f198b9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:37:46.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.964+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.968+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.968+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.968+0000 7f198b9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:37:46.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.972+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.972+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.972+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:37:46.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.972+0000 7f198b9c39c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.7157108845784768925', time=2024-09-14T13:37:22.913386+0000, chain.objs.size()=7 2024-09-14T11:37:46.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.972+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__multipart_key1.2~Qd17JcBrK9KWiJuHpp5pkp0hmL9gv8L.1 2024-09-14T11:37:46.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.972+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__shadow_key1.2~Qd17JcBrK9KWiJuHpp5pkp0hmL9gv8L.1_1 2024-09-14T11:37:46.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.972+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__shadow_key1.2~Qd17JcBrK9KWiJuHpp5pkp0hmL9gv8L.1_2 2024-09-14T11:37:46.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.972+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__multipart_key1.2~Qd17JcBrK9KWiJuHpp5pkp0hmL9gv8L.2 2024-09-14T11:37:46.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.972+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__shadow_key1.2~Qd17JcBrK9KWiJuHpp5pkp0hmL9gv8L.2_1 2024-09-14T11:37:46.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.972+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__shadow_key1.2~Qd17JcBrK9KWiJuHpp5pkp0hmL9gv8L.2_2 2024-09-14T11:37:46.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.972+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__multipart_key1.2~Qd17JcBrK9KWiJuHpp5pkp0hmL9gv8L.3 2024-09-14T11:37:46.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.972+0000 7f198b9c39c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.6711005097705018509', time=2024-09-14T13:37:25.051784+0000, chain.objs.size()=9 2024-09-14T11:37:46.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.972+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.52__multipart_key1.2~Bv81nzTYPVNJP62NR1wmmaOJcv0MGhV.1 2024-09-14T11:37:46.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.972+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.52__shadow_key1.2~Bv81nzTYPVNJP62NR1wmmaOJcv0MGhV.1_1 2024-09-14T11:37:46.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.972+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.52__multipart_key1.2~Bv81nzTYPVNJP62NR1wmmaOJcv0MGhV.2 2024-09-14T11:37:46.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.972+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.52__shadow_key1.2~Bv81nzTYPVNJP62NR1wmmaOJcv0MGhV.2_1 2024-09-14T11:37:46.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.972+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.52__multipart_key1.2~Bv81nzTYPVNJP62NR1wmmaOJcv0MGhV.3 2024-09-14T11:37:46.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.980+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.52__shadow_key1.2~Bv81nzTYPVNJP62NR1wmmaOJcv0MGhV.3_1 2024-09-14T11:37:46.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.980+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.52__multipart_key1.2~Bv81nzTYPVNJP62NR1wmmaOJcv0MGhV.4 2024-09-14T11:37:46.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.984+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.52__shadow_key1.2~Bv81nzTYPVNJP62NR1wmmaOJcv0MGhV.4_1 2024-09-14T11:37:46.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.984+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.52__multipart_key1.2~Bv81nzTYPVNJP62NR1wmmaOJcv0MGhV.5 2024-09-14T11:37:46.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.984+0000 7f198b9c39c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.3021154007088575981', time=2024-09-14T13:37:38.285850+0000, chain.objs.size()=16 2024-09-14T11:37:46.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.984+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~ch-8eEve-6dcLEBHmvnY5X2caW_GDAh.1 2024-09-14T11:37:46.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.984+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~ch-8eEve-6dcLEBHmvnY5X2caW_GDAh.1_1 2024-09-14T11:37:46.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.984+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~ch-8eEve-6dcLEBHmvnY5X2caW_GDAh.1_2 2024-09-14T11:37:46.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.984+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~ch-8eEve-6dcLEBHmvnY5X2caW_GDAh.2 2024-09-14T11:37:46.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.984+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~ch-8eEve-6dcLEBHmvnY5X2caW_GDAh.2_1 2024-09-14T11:37:46.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.984+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~ch-8eEve-6dcLEBHmvnY5X2caW_GDAh.2_2 2024-09-14T11:37:46.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.984+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~ch-8eEve-6dcLEBHmvnY5X2caW_GDAh.3 2024-09-14T11:37:46.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.984+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~ch-8eEve-6dcLEBHmvnY5X2caW_GDAh.3_1 2024-09-14T11:37:46.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.984+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~ch-8eEve-6dcLEBHmvnY5X2caW_GDAh.3_2 2024-09-14T11:37:46.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.988+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~ch-8eEve-6dcLEBHmvnY5X2caW_GDAh.4 2024-09-14T11:37:46.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.992+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~ch-8eEve-6dcLEBHmvnY5X2caW_GDAh.4_1 2024-09-14T11:37:46.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.992+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~ch-8eEve-6dcLEBHmvnY5X2caW_GDAh.4_2 2024-09-14T11:37:46.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.996+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~ch-8eEve-6dcLEBHmvnY5X2caW_GDAh.5 2024-09-14T11:37:46.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.996+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~ch-8eEve-6dcLEBHmvnY5X2caW_GDAh.5_1 2024-09-14T11:37:46.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.996+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~ch-8eEve-6dcLEBHmvnY5X2caW_GDAh.5_2 2024-09-14T11:37:46.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:46.996+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~ch-8eEve-6dcLEBHmvnY5X2caW_GDAh.6 2024-09-14T11:37:46.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.000+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:47.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.004+0000 7f198b9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:37:47.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.004+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.008+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.008+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.008+0000 7f198b9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:37:47.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.012+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.012+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.016+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:37:47.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.016+0000 7f198b9c39c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.7398148467090141125', time=2024-09-14T13:37:21.464958+0000, chain.objs.size()=9 2024-09-14T11:37:47.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.016+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__multipart_key1.2~XT11cgS4C-M69FulXiJjjyMCQQlLJ7y.1 2024-09-14T11:37:47.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.016+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__shadow_key1.2~XT11cgS4C-M69FulXiJjjyMCQQlLJ7y.1_1 2024-09-14T11:37:47.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.016+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__multipart_key1.2~XT11cgS4C-M69FulXiJjjyMCQQlLJ7y.2 2024-09-14T11:37:47.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.016+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__shadow_key1.2~XT11cgS4C-M69FulXiJjjyMCQQlLJ7y.2_1 2024-09-14T11:37:47.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.016+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__multipart_key1.2~XT11cgS4C-M69FulXiJjjyMCQQlLJ7y.3 2024-09-14T11:37:47.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.016+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__shadow_key1.2~XT11cgS4C-M69FulXiJjjyMCQQlLJ7y.3_1 2024-09-14T11:37:47.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.016+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__multipart_key1.2~XT11cgS4C-M69FulXiJjjyMCQQlLJ7y.4 2024-09-14T11:37:47.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.016+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__shadow_key1.2~XT11cgS4C-M69FulXiJjjyMCQQlLJ7y.4_1 2024-09-14T11:37:47.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.016+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__multipart_key1.2~XT11cgS4C-M69FulXiJjjyMCQQlLJ7y.5 2024-09-14T11:37:47.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.016+0000 7f198b9c39c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.12452044606968261638', time=2024-09-14T13:37:34.432713+0000, chain.objs.size()=21 2024-09-14T11:37:47.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.016+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~wXDMqdHv_lmP2E7o_kmelQuPJSH9799.1 2024-09-14T11:37:47.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.016+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~wXDMqdHv_lmP2E7o_kmelQuPJSH9799.1_1 2024-09-14T11:37:47.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.016+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~wXDMqdHv_lmP2E7o_kmelQuPJSH9799.2 2024-09-14T11:37:47.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.020+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~wXDMqdHv_lmP2E7o_kmelQuPJSH9799.2_1 2024-09-14T11:37:47.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.020+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~wXDMqdHv_lmP2E7o_kmelQuPJSH9799.3 2024-09-14T11:37:47.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.020+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~wXDMqdHv_lmP2E7o_kmelQuPJSH9799.3_1 2024-09-14T11:37:47.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.020+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~wXDMqdHv_lmP2E7o_kmelQuPJSH9799.4 2024-09-14T11:37:47.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.020+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~wXDMqdHv_lmP2E7o_kmelQuPJSH9799.4_1 2024-09-14T11:37:47.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.024+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~wXDMqdHv_lmP2E7o_kmelQuPJSH9799.5 2024-09-14T11:37:47.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.024+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~wXDMqdHv_lmP2E7o_kmelQuPJSH9799.5_1 2024-09-14T11:37:47.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.024+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~wXDMqdHv_lmP2E7o_kmelQuPJSH9799.6 2024-09-14T11:37:47.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.024+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~wXDMqdHv_lmP2E7o_kmelQuPJSH9799.6_1 2024-09-14T11:37:47.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.024+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~wXDMqdHv_lmP2E7o_kmelQuPJSH9799.7 2024-09-14T11:37:47.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.024+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~wXDMqdHv_lmP2E7o_kmelQuPJSH9799.7_1 2024-09-14T11:37:47.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.024+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~wXDMqdHv_lmP2E7o_kmelQuPJSH9799.8 2024-09-14T11:37:47.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.028+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~wXDMqdHv_lmP2E7o_kmelQuPJSH9799.8_1 2024-09-14T11:37:47.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.032+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~wXDMqdHv_lmP2E7o_kmelQuPJSH9799.9 2024-09-14T11:37:47.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.032+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~wXDMqdHv_lmP2E7o_kmelQuPJSH9799.9_1 2024-09-14T11:37:47.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.032+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~wXDMqdHv_lmP2E7o_kmelQuPJSH9799.10 2024-09-14T11:37:47.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.032+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__shadow_key1.2~wXDMqdHv_lmP2E7o_kmelQuPJSH9799.10_1 2024-09-14T11:37:47.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.032+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.56__multipart_key1.2~wXDMqdHv_lmP2E7o_kmelQuPJSH9799.11 2024-09-14T11:37:47.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.036+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:47.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.040+0000 7f198b9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:37:47.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.044+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.044+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.048+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:37:47.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.048+0000 7f198b9c39c0 20 garbage collection: RGWGC::process iterating over entry tag='2~Ta0Sd6ERYT-tJBfNa1gzQOn6qN_q8o2', time=2024-09-14T13:37:14.552986+0000, chain.objs.size()=9 2024-09-14T11:37:47.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.048+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.41__multipart_key1.2~Ta0Sd6ERYT-tJBfNa1gzQOn6qN_q8o2.1 2024-09-14T11:37:47.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.048+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.41__shadow_key1.2~Ta0Sd6ERYT-tJBfNa1gzQOn6qN_q8o2.1_1 2024-09-14T11:37:47.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.048+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.41__multipart_key1.2~Ta0Sd6ERYT-tJBfNa1gzQOn6qN_q8o2.2 2024-09-14T11:37:47.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.048+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.41__shadow_key1.2~Ta0Sd6ERYT-tJBfNa1gzQOn6qN_q8o2.2_1 2024-09-14T11:37:47.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.048+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.41__multipart_key1.2~Ta0Sd6ERYT-tJBfNa1gzQOn6qN_q8o2.3 2024-09-14T11:37:47.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.048+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.41__shadow_key1.2~Ta0Sd6ERYT-tJBfNa1gzQOn6qN_q8o2.3_1 2024-09-14T11:37:47.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.048+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.41__multipart_key1.2~Ta0Sd6ERYT-tJBfNa1gzQOn6qN_q8o2.4 2024-09-14T11:37:47.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.048+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.41__shadow_key1.2~Ta0Sd6ERYT-tJBfNa1gzQOn6qN_q8o2.4_1 2024-09-14T11:37:47.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.048+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.41__multipart_key1.2~Ta0Sd6ERYT-tJBfNa1gzQOn6qN_q8o2.5 2024-09-14T11:37:47.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.052+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:47.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.056+0000 7f198b9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:37:47.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.060+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.060+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.060+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.060+0000 7f198b9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:37:47.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.064+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.064+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.064+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:37:47.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.064+0000 7f198b9c39c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.14751574315966123536', time=2024-09-14T13:37:23.283555+0000, chain.objs.size()=5 2024-09-14T11:37:47.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.064+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.47__shadow_.ifbbvConk0AVaABz7uLzD2QF_WLG5NY_1 2024-09-14T11:37:47.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.064+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.47__shadow_.ifbbvConk0AVaABz7uLzD2QF_WLG5NY_2 2024-09-14T11:37:47.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.064+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.47__shadow_.ifbbvConk0AVaABz7uLzD2QF_WLG5NY_3 2024-09-14T11:37:47.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.064+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.47__shadow_.ifbbvConk0AVaABz7uLzD2QF_WLG5NY_4 2024-09-14T11:37:47.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.064+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.47__shadow_.ifbbvConk0AVaABz7uLzD2QF_WLG5NY_5 2024-09-14T11:37:47.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.072+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:47.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.076+0000 7f198b9c39c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:37:47.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.076+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.080+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.080+0000 7f198b9c39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:37:47.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.080+0000 7f198b9c39c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.6706962159664454100', time=2024-09-14T13:37:23.089968+0000, chain.objs.size()=7 2024-09-14T11:37:47.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.080+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__multipart_key1.2~lhjaJoj61r5AND-usDLwlPssgZFvMo_.1 2024-09-14T11:37:47.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.080+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__shadow_key1.2~lhjaJoj61r5AND-usDLwlPssgZFvMo_.1_1 2024-09-14T11:37:47.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.080+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__shadow_key1.2~lhjaJoj61r5AND-usDLwlPssgZFvMo_.1_2 2024-09-14T11:37:47.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.080+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__multipart_key1.2~lhjaJoj61r5AND-usDLwlPssgZFvMo_.2 2024-09-14T11:37:47.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.080+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__shadow_key1.2~lhjaJoj61r5AND-usDLwlPssgZFvMo_.2_1 2024-09-14T11:37:47.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.080+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__shadow_key1.2~lhjaJoj61r5AND-usDLwlPssgZFvMo_.2_2 2024-09-14T11:37:47.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.080+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.48__multipart_key1.2~lhjaJoj61r5AND-usDLwlPssgZFvMo_.3 2024-09-14T11:37:47.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.080+0000 7f198b9c39c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.18443400950231893830', time=2024-09-14T13:37:40.262951+0000, chain.objs.size()=9 2024-09-14T11:37:47.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.080+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.57__multipart_key1.2~oaVZIEhdjvGKygFLJ409c2y5x-GO4Fy.1 2024-09-14T11:37:47.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.080+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.57__shadow_key1.2~oaVZIEhdjvGKygFLJ409c2y5x-GO4Fy.1_1 2024-09-14T11:37:47.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.080+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.57__multipart_key1.2~oaVZIEhdjvGKygFLJ409c2y5x-GO4Fy.2 2024-09-14T11:37:47.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.080+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.57__shadow_key1.2~oaVZIEhdjvGKygFLJ409c2y5x-GO4Fy.2_1 2024-09-14T11:37:47.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.080+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.57__multipart_key1.2~oaVZIEhdjvGKygFLJ409c2y5x-GO4Fy.3 2024-09-14T11:37:47.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.084+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.57__shadow_key1.2~oaVZIEhdjvGKygFLJ409c2y5x-GO4Fy.3_1 2024-09-14T11:37:47.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.084+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.57__multipart_key1.2~oaVZIEhdjvGKygFLJ409c2y5x-GO4Fy.4 2024-09-14T11:37:47.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.084+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.57__shadow_key1.2~oaVZIEhdjvGKygFLJ409c2y5x-GO4Fy.4_1 2024-09-14T11:37:47.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.084+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.57__multipart_key1.2~oaVZIEhdjvGKygFLJ409c2y5x-GO4Fy.5 2024-09-14T11:37:47.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.088+0000 7f198b9c39c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:47.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.096+0000 7f183ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:47.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.100+0000 7f198b9c39c0 20 remove_watcher() i=0 2024-09-14T11:37:47.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.100+0000 7f198b9c39c0 2 removed watcher, disabling cache 2024-09-14T11:37:47.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.100+0000 7f198b9c39c0 20 remove_watcher() i=1 2024-09-14T11:37:47.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.104+0000 7f198b9c39c0 20 remove_watcher() i=2 2024-09-14T11:37:47.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.104+0000 7f198b9c39c0 20 remove_watcher() i=3 2024-09-14T11:37:47.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.108+0000 7f198b9c39c0 20 remove_watcher() i=4 2024-09-14T11:37:47.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.108+0000 7f198b9c39c0 20 remove_watcher() i=5 2024-09-14T11:37:47.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.108+0000 7f198b9c39c0 20 remove_watcher() i=6 2024-09-14T11:37:47.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.112+0000 7f198b9c39c0 20 remove_watcher() i=7 2024-09-14T11:37:47.126 DEBUG:teuthology.orchestra.run.smithi071:> radosgw-admin gc process --include-all 2024-09-14T11:37:47.198 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:47.198 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:47.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.244+0000 7f7c021219c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:47.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.248+0000 7f7c021219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:47.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.248+0000 7f7c021219c0 20 realm 2024-09-14T11:37:47.245 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.248+0000 7f7c021219c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:47.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.248+0000 7f7c021219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:47.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.248+0000 7f7c021219c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:47.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.248+0000 7f7c021219c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:47.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.248+0000 7f7c021219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:47.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.248+0000 7f7c021219c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:47.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.248+0000 7f7c021219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:47.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.248+0000 7f7c021219c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:47.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.252+0000 7f7c021219c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:47.248 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.252+0000 7f7c021219c0 20 searching for the correct realm 2024-09-14T11:37:47.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.256+0000 7f7c00428640 0 -- 172.21.15.71:0/1589597215 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f7bf40bac20 msgr2=0x7f7bf411a400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:47.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.260+0000 7f7c00428640 0 -- 172.21.15.71:0/1589597215 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x557d5edd1d40 msgr2=0x557d5edd4150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:47.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.272+0000 7f7c021219c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:47.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.272+0000 7f7c021219c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:37:47.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.272+0000 7f7c021219c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:47.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.272+0000 7f7c021219c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:37:47.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.272+0000 7f7c021219c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:47.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.272+0000 7f7c021219c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:47.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.272+0000 7f7c021219c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:47.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.272+0000 7f7c021219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:47.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.272+0000 7f7c021219c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:47.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.272+0000 7f7c021219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:47.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.272+0000 7f7c021219c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:47.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.272+0000 7f7c021219c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:47.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.272+0000 7f7c021219c0 20 zone default found 2024-09-14T11:37:47.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.272+0000 7f7c021219c0 4 Realm: () 2024-09-14T11:37:47.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.272+0000 7f7c021219c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:37:47.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.272+0000 7f7c021219c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:37:47.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.272+0000 7f7c021219c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:47.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.272+0000 7f7c021219c0 20 zonegroup default 2024-09-14T11:37:47.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.272+0000 7f7c021219c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:47.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.272+0000 7f7c021219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:47.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.272+0000 7f7c021219c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:47.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.272+0000 7f7c021219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:47.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.272+0000 7f7c021219c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:47.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.276+0000 7f7c021219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:47.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.276+0000 7f7c021219c0 20 started sync module instance, tier type = 2024-09-14T11:37:47.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.276+0000 7f7c021219c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:37:47.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.292+0000 7f7c021219c0 20 add_watcher() i=0 2024-09-14T11:37:47.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.292+0000 7f7c021219c0 20 add_watcher() i=1 2024-09-14T11:37:47.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.292+0000 7f7c021219c0 20 add_watcher() i=2 2024-09-14T11:37:47.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.292+0000 7f7c021219c0 20 add_watcher() i=3 2024-09-14T11:37:47.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.292+0000 7f7c021219c0 20 add_watcher() i=4 2024-09-14T11:37:47.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.292+0000 7f7c021219c0 20 add_watcher() i=5 2024-09-14T11:37:47.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.292+0000 7f7c021219c0 20 add_watcher() i=6 2024-09-14T11:37:47.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.296+0000 7f7c021219c0 20 add_watcher() i=7 2024-09-14T11:37:47.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.296+0000 7f7c021219c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:47.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.300+0000 7f7ab67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:47.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.300+0000 7f7c021219c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:47.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.300+0000 7f7c021219c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:47.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.372+0000 7f7ab57e2640 20 reqs_thread_entry: start 2024-09-14T11:37:47.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.372+0000 7f7c021219c0 20 init_complete bucket index max shards: 11 2024-09-14T11:37:47.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.372+0000 7f7c021219c0 20 Filter name: none 2024-09-14T11:37:47.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.372+0000 7f7aae7fc640 20 reqs_thread_entry: start 2024-09-14T11:37:47.372 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.372+0000 7f7c021219c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:37:47.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.376+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.376+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.376+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.377 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.380+0000 7f7c021219c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:37:47.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.380+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.384+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.384+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.388+0000 7f7c021219c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:37:47.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.388+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.392+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.392+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.392+0000 7f7c021219c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:37:47.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.396+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.400+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.400+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.404+0000 7f7c021219c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:37:47.403 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.404+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.408+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.408+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.408+0000 7f7c021219c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:37:47.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.412+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.412+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.412+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.416+0000 7f7c021219c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:37:47.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.420+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.420+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.420+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.424+0000 7f7c021219c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:37:47.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.428+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.428+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.428+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.432+0000 7f7c021219c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:37:47.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.436+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.436+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.436 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.440+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.440+0000 7f7c021219c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:37:47.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.444+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.444+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.444+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.448+0000 7f7c021219c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:37:47.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.448+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.452+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.452+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.456+0000 7f7c021219c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:37:47.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.460+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.460+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.460+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.464+0000 7f7c021219c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:37:47.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.468+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.468+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.468+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.472+0000 7f7c021219c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:37:47.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.476+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.476+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.476 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.480+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.480+0000 7f7c021219c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:37:47.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.484+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.484+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.488+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.488+0000 7f7c021219c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:37:47.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.492+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.492 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.496+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.496+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.496+0000 7f7c021219c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:37:47.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.504+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.504+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.504+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.508+0000 7f7c021219c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:37:47.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.512+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.512+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.516+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.516+0000 7f7c021219c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:37:47.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.520+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.520+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.524+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.524+0000 7f7c021219c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:37:47.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.528+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.532+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.532+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.536+0000 7f7c021219c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:37:47.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.540+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.540+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.540+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.544+0000 7f7c021219c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:37:47.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.548+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.548+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.548+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.552+0000 7f7c021219c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:37:47.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.556+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.556+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.560+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.560+0000 7f7c021219c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:37:47.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.564+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.568+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.568+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.572+0000 7f7c021219c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:37:47.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.576+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.576+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.576+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.580+0000 7f7c021219c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:37:47.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.584+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.584+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.584+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.588+0000 7f7c021219c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:37:47.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.592+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.592+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.592+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.596+0000 7f7c021219c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:37:47.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.600+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.600+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.604+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.604+0000 7f7c021219c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:37:47.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.608+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.612+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.612+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.616+0000 7f7c021219c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:37:47.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.620+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.620+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.620+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.624+0000 7f7c021219c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:37:47.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.628+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.628+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.628+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.632+0000 7f7c021219c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:37:47.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.636+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.636+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.640+0000 7f7c021219c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.644+0000 7f7ab67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:47.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.648+0000 7f7c021219c0 20 remove_watcher() i=0 2024-09-14T11:37:47.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.648+0000 7f7c021219c0 2 removed watcher, disabling cache 2024-09-14T11:37:47.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.652+0000 7f7c021219c0 20 remove_watcher() i=1 2024-09-14T11:37:47.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.656+0000 7f7c021219c0 20 remove_watcher() i=2 2024-09-14T11:37:47.655 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.656+0000 7f7c021219c0 20 remove_watcher() i=3 2024-09-14T11:37:47.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.660+0000 7f7c021219c0 20 remove_watcher() i=4 2024-09-14T11:37:47.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.664+0000 7f7c021219c0 20 remove_watcher() i=5 2024-09-14T11:37:47.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.664+0000 7f7c021219c0 20 remove_watcher() i=6 2024-09-14T11:37:47.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.668+0000 7f7c021219c0 20 remove_watcher() i=7 2024-09-14T11:37:47.686 DEBUG:teuthology.orchestra.run.smithi071:> radosgw-admin gc process --include-all 2024-09-14T11:37:47.762 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:47.762 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:47.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.812+0000 7f1e8748b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:47.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.812+0000 7f1e8748b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:47.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.812+0000 7f1e8748b9c0 20 realm 2024-09-14T11:37:47.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.812+0000 7f1e8748b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:47.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.812+0000 7f1e8748b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:47.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.812+0000 7f1e8748b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:47.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.812+0000 7f1e8748b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:47.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.812+0000 7f1e8748b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:47.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.812+0000 7f1e8748b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:47.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.816+0000 7f1e8748b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:47.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.816+0000 7f1e8748b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:47.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.816+0000 7f1e8748b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:47.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.816+0000 7f1e8748b9c0 20 searching for the correct realm 2024-09-14T11:37:47.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.820+0000 7f1e85792640 0 -- 172.21.15.71:0/826206014 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f1e780ee040 msgr2=0x7f1e780ee930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:47.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.828+0000 7f1e85792640 0 -- 172.21.15.71:0/826206014 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x556b32c23100 msgr2=0x556b32c25510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:47.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.836+0000 7f1e8748b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:47.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.836+0000 7f1e8748b9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:37:47.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.836+0000 7f1e8748b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:47.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.836+0000 7f1e8748b9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:37:47.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.836+0000 7f1e8748b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:47.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.836+0000 7f1e8748b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:47.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.836+0000 7f1e8748b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:47.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.836+0000 7f1e8748b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:47.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.836+0000 7f1e8748b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:47.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.836+0000 7f1e8748b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:47.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.836+0000 7f1e8748b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:47.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.840+0000 7f1e8748b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:47.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.840+0000 7f1e8748b9c0 20 zone default found 2024-09-14T11:37:47.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.840+0000 7f1e8748b9c0 4 Realm: () 2024-09-14T11:37:47.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.840+0000 7f1e8748b9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:37:47.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.840+0000 7f1e8748b9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:37:47.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.840+0000 7f1e8748b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:47.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.840+0000 7f1e8748b9c0 20 zonegroup default 2024-09-14T11:37:47.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.840+0000 7f1e8748b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:47.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.840+0000 7f1e8748b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:47.837 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.840+0000 7f1e8748b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:47.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.840+0000 7f1e8748b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:47.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.840+0000 7f1e8748b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:47.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.840+0000 7f1e8748b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:47.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.840+0000 7f1e8748b9c0 20 started sync module instance, tier type = 2024-09-14T11:37:47.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.840+0000 7f1e8748b9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:37:47.855 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.856+0000 7f1e8748b9c0 20 add_watcher() i=0 2024-09-14T11:37:47.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.856+0000 7f1e8748b9c0 20 add_watcher() i=1 2024-09-14T11:37:47.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.856+0000 7f1e8748b9c0 20 add_watcher() i=2 2024-09-14T11:37:47.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.856+0000 7f1e8748b9c0 20 add_watcher() i=3 2024-09-14T11:37:47.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.856+0000 7f1e8748b9c0 20 add_watcher() i=4 2024-09-14T11:37:47.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.856+0000 7f1e8748b9c0 20 add_watcher() i=5 2024-09-14T11:37:47.856 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.860+0000 7f1e8748b9c0 20 add_watcher() i=6 2024-09-14T11:37:47.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.860+0000 7f1e8748b9c0 20 add_watcher() i=7 2024-09-14T11:37:47.858 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.860+0000 7f1e8748b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:47.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.864+0000 7f1d3afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:47.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.864+0000 7f1e8748b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:47.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.864+0000 7f1e8748b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:47.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.944+0000 7f1d39fe3640 20 reqs_thread_entry: start 2024-09-14T11:37:47.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.944+0000 7f1e8748b9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:37:47.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.944+0000 7f1e8748b9c0 20 Filter name: none 2024-09-14T11:37:47.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.944+0000 7f1cab7fe640 20 reqs_thread_entry: start 2024-09-14T11:37:47.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.944+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:37:47.944 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.948+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.948+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.948+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.948+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:37:47.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.952+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.952+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.952+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.956+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:37:47.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.960+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.960+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.960+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.964+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:37:47.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.964+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.964+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.964+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.968+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:37:47.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.972+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.969 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.972+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.972+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.976+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:37:47.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.980+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.980+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.980+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.984+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:37:47.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.988+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.988+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.988+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.988+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:37:47.990 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.992+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.992+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.992+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:47.996+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:37:47.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.000+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:47.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.000+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:47.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.000+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.004+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:37:48.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.008+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.005 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.008+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:48.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.008+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.012+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:37:48.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.016+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.016+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:48.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.016+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.020+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:37:48.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.024+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.024+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:48.023 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.024+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.028+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:37:48.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.032+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.032+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:48.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.032+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.032 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.036+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:37:48.035 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.036+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.040+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:48.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.040+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.044+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:37:48.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.044+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.048+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:48.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.048+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.048+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:37:48.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.052+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.052+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:48.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.052+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.056+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:37:48.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.060+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.058 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.060+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:48.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.060+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.064+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:37:48.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.068+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.068+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:48.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.068+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.072+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:37:48.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.076+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.076+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:48.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.076+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.080+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:37:48.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.084+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.084+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:48.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.084+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.088+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:37:48.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.092+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.092+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:48.091 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.092+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.096+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:37:48.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.100+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.104+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:48.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.104+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.108+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:37:48.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.112+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.112+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:48.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.112+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.116+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:37:48.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.120+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.120+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:48.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.120+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.124+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:37:48.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.124+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.128+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:48.127 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.128+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.132+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:37:48.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.136+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.136+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:48.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.136+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.140+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:37:48.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.144+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.144+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:48.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.148+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.148+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:37:48.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.152+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.152+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:48.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.152+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.154 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.156+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:37:48.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.160+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.160+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:48.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.164+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.162 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.164+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:37:48.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.168+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.168+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:48.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.172+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.172+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:37:48.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.176+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.180+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:48.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.180+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.180+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:37:48.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.184+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.188+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:48.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.188+0000 7f1e8748b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.189 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.192+0000 7f1d3afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:48.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.196+0000 7f1e8748b9c0 20 remove_watcher() i=0 2024-09-14T11:37:48.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.196+0000 7f1e8748b9c0 2 removed watcher, disabling cache 2024-09-14T11:37:48.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.200+0000 7f1e8748b9c0 20 remove_watcher() i=1 2024-09-14T11:37:48.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.200+0000 7f1e8748b9c0 20 remove_watcher() i=2 2024-09-14T11:37:48.200 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.204+0000 7f1e8748b9c0 20 remove_watcher() i=3 2024-09-14T11:37:48.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.204+0000 7f1e8748b9c0 20 remove_watcher() i=4 2024-09-14T11:37:48.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.208+0000 7f1e8748b9c0 20 remove_watcher() i=5 2024-09-14T11:37:48.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.208+0000 7f1e8748b9c0 20 remove_watcher() i=6 2024-09-14T11:37:48.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.212+0000 7f1e8748b9c0 20 remove_watcher() i=7 2024-09-14T11:37:48.228 DEBUG:teuthology.orchestra.run.smithi071:> radosgw-admin gc process --include-all 2024-09-14T11:37:48.304 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:48.304 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:48.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.352+0000 7ffb5db9a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:48.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.356+0000 7ffb5db9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:48.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.356+0000 7ffb5db9a9c0 20 realm 2024-09-14T11:37:48.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.356+0000 7ffb5db9a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:48.702 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.356+0000 7ffb5db9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:48.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.356+0000 7ffb5db9a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:48.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.356+0000 7ffb5db9a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:48.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.356+0000 7ffb5db9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:48.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.356+0000 7ffb5db9a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:48.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.356+0000 7ffb5db9a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:48.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.356+0000 7ffb5db9a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:48.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.360+0000 7ffb5db9a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:48.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.360+0000 7ffb5db9a9c0 20 searching for the correct realm 2024-09-14T11:37:48.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.364+0000 7ffb5bea1640 0 -- 172.21.15.71:0/3005037934 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7ffb50040020 msgr2=0x7ffb50068a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:48.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.576+0000 7ffb5ae9f640 0 -- 172.21.15.71:0/3005037934 >> [v2:172.21.15.157:6800/3420822707,v1:172.21.15.157:6801/3420822707] conn(0x7ffb5002a070 msgr2=0x7ffb50072c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:48.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.796+0000 7ffb5db9a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:48.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.796+0000 7ffb5db9a9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:37:48.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.796+0000 7ffb5db9a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:48.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.796+0000 7ffb5db9a9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:37:48.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.796+0000 7ffb5db9a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:48.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.796+0000 7ffb5db9a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:48.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.796+0000 7ffb5db9a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:48.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.796+0000 7ffb5db9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:48.795 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.796+0000 7ffb5db9a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:48.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.800+0000 7ffb5db9a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:48.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.800+0000 7ffb5db9a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:48.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.800+0000 7ffb5db9a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:48.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.800+0000 7ffb5db9a9c0 20 zone default found 2024-09-14T11:37:48.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.800+0000 7ffb5db9a9c0 4 Realm: () 2024-09-14T11:37:48.797 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.800+0000 7ffb5db9a9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:37:48.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.800+0000 7ffb5db9a9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:37:48.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.800+0000 7ffb5db9a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:48.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.800+0000 7ffb5db9a9c0 20 zonegroup default 2024-09-14T11:37:48.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.800+0000 7ffb5db9a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:48.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.800+0000 7ffb5db9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:48.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.800+0000 7ffb5db9a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:48.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.800+0000 7ffb5db9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:48.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.800+0000 7ffb5db9a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:48.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.800+0000 7ffb5db9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:48.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.804+0000 7ffb5db9a9c0 20 started sync module instance, tier type = 2024-09-14T11:37:48.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.804+0000 7ffb5db9a9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:37:48.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.824+0000 7ffb5db9a9c0 20 add_watcher() i=0 2024-09-14T11:37:48.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.824+0000 7ffb5db9a9c0 20 add_watcher() i=1 2024-09-14T11:37:48.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.824+0000 7ffb5db9a9c0 20 add_watcher() i=2 2024-09-14T11:37:48.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.824+0000 7ffb5db9a9c0 20 add_watcher() i=3 2024-09-14T11:37:48.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.824+0000 7ffb5db9a9c0 20 add_watcher() i=4 2024-09-14T11:37:48.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.824+0000 7ffb5db9a9c0 20 add_watcher() i=5 2024-09-14T11:37:48.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.824+0000 7ffb5db9a9c0 20 add_watcher() i=6 2024-09-14T11:37:48.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.828+0000 7ffb5db9a9c0 20 add_watcher() i=7 2024-09-14T11:37:48.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.828+0000 7ffb5db9a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:48.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.832+0000 7ffa11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:48.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.832+0000 7ffb5db9a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:48.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.832+0000 7ffb5db9a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:48.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.924+0000 7ffa10fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:48.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.924+0000 7ffb5db9a9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:37:48.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.924+0000 7ffb5db9a9c0 20 Filter name: none 2024-09-14T11:37:48.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.924+0000 7ff98a7fc640 20 reqs_thread_entry: start 2024-09-14T11:37:48.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.924+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:37:48.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.928+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.928+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:48.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.932+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.932+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:37:48.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.936+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.940+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:48.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.940+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.944+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:37:48.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.944+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.948+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:48.946 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.948+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.952+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:37:48.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.952+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.956+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:48.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.956+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.956+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:37:48.958 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.960+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.960+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:48.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.964+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.962 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.964+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:37:48.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.968+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.968+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:48.966 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.968+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.972+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:37:48.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.972+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.976+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:48.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.976+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.976 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.980+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:37:48.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.980+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.984+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:48.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.984+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.984+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:37:48.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.988+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.988+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:48.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.988+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.988 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.992+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:37:48.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.992+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.996+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:48.992 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.996+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:48.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:48.996+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:37:48.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.000+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.004+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.004+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.008+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:37:49.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.008+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.008+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.008+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.012+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:37:49.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.016+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.016+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.015 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.016+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.020+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:37:49.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.024+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.024+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.028+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.028+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:37:49.029 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.032+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.032+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.032+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.036+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:37:49.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.040+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.040+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.040+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.044+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:37:49.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.048+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.048+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.048+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.052+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:37:49.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.056+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.056+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.056+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.060+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:37:49.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.064+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.064+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.064+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.065 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.068+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:37:49.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.072+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.072+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.072+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.076+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:37:49.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.076+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.076+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.080+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.080+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:37:49.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.084+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.084+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.088+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.088+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:37:49.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.092+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.096+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.096+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.096+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:37:49.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.100+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.104+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.101 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.104+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.108+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:37:49.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.108+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.112+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.112+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.116+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:37:49.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.116+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.120+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.120+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.124+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:37:49.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.124+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.123 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.124+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.128+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.128+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:37:49.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.132+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.136+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.136+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.136+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:37:49.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.140+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.144+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.144+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.144+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:37:49.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.148+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.152+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.152+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.156+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:37:49.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.160+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.160+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.160+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.164+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:37:49.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.168+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.168+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.168+0000 7ffb5db9a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.176+0000 7ffa11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:49.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.180+0000 7ffb5db9a9c0 20 remove_watcher() i=0 2024-09-14T11:37:49.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.180+0000 7ffb5db9a9c0 2 removed watcher, disabling cache 2024-09-14T11:37:49.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.180+0000 7ffb5db9a9c0 20 remove_watcher() i=1 2024-09-14T11:37:49.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.184+0000 7ffb5db9a9c0 20 remove_watcher() i=2 2024-09-14T11:37:49.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.188+0000 7ffb5db9a9c0 20 remove_watcher() i=3 2024-09-14T11:37:49.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.188+0000 7ffb5db9a9c0 20 remove_watcher() i=4 2024-09-14T11:37:49.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.192+0000 7ffb5db9a9c0 20 remove_watcher() i=5 2024-09-14T11:37:49.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.192+0000 7ffb5db9a9c0 20 remove_watcher() i=6 2024-09-14T11:37:49.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:49.196+0000 7ffb5db9a9c0 20 remove_watcher() i=7 2024-09-14T11:37:49.211 DEBUG:teuthology.orchestra.run.smithi071:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-14T11:37:49.929 INFO:teuthology.orchestra.run.smithi071.stdout:> Task :clean 2024-09-14T11:37:50.827 INFO:teuthology.orchestra.run.smithi071.stdout:> Task :compileJava 2024-09-14T11:37:50.827 INFO:teuthology.orchestra.run.smithi071.stdout:> Task :processResources 2024-09-14T11:37:50.827 INFO:teuthology.orchestra.run.smithi071.stdout:> Task :classes 2024-09-14T11:37:51.327 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:51.327 INFO:teuthology.orchestra.run.smithi071.stdout:> Task :compileTestJava 2024-09-14T11:37:51.327 INFO:teuthology.orchestra.run.smithi071.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:37:51.328 INFO:teuthology.orchestra.run.smithi071.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:37:51.427 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:51.427 INFO:teuthology.orchestra.run.smithi071.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:37:51.427 INFO:teuthology.orchestra.run.smithi071.stdout:> Task :testClasses 2024-09-14T11:37:53.430 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:53.430 INFO:teuthology.orchestra.run.smithi071.stdout:> Task :test 2024-09-14T11:37:53.430 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:53.430 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Bucket tests STANDARD_OUT 2024-09-14T11:37:53.430 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14 11:37:52,875 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:37:53.430 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:53.431 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-14T11:37:53.431 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:53.431 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-14T11:37:53.431 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:53.431 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-14T11:37:53.431 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:53.431 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-14T11:37:53.627 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:53.627 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-14T11:37:53.727 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:53.727 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-14T11:37:53.927 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:53.927 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-14T11:37:54.127 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:54.127 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-14T11:37:54.227 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:54.227 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-14T11:37:54.327 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:54.327 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-14T11:37:54.627 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:54.627 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-14T11:37:54.627 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:54.628 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-14T11:37:54.727 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:54.727 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-14T11:37:54.827 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:54.827 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-14T11:37:55.327 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:55.327 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-14T11:37:55.427 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:55.427 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-14T11:37:55.727 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:55.727 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-14T11:37:55.728 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:55.728 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-14T11:37:55.854 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:55.854 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------- 2024-09-14T11:37:55.854 INFO:teuthology.orchestra.run.smithi071.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-14T11:37:55.854 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------- 2024-09-14T11:37:55.854 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:55.855 INFO:teuthology.orchestra.run.smithi071.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:37:55.855 INFO:teuthology.orchestra.run.smithi071.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:37:55.855 INFO:teuthology.orchestra.run.smithi071.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:37:55.855 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:37:55.855 INFO:teuthology.orchestra.run.smithi071.stdout:BUILD SUCCESSFUL in 6s 2024-09-14T11:37:55.855 INFO:teuthology.orchestra.run.smithi071.stdout:5 actionable tasks: 5 executed 2024-09-14T11:37:55.862 DEBUG:teuthology.orchestra.run.smithi071:> radosgw-admin gc process --include-all 2024-09-14T11:37:55.887 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:55.887 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:55.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:55.932+0000 7f9065da29c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:55.936+0000 7f9065da29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:55.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:55.936+0000 7f9065da29c0 20 realm 2024-09-14T11:37:55.933 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:55.936+0000 7f9065da29c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:55.936+0000 7f9065da29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:55.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:55.936+0000 7f9065da29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:55.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:55.936+0000 7f9065da29c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:55.936+0000 7f9065da29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:55.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:55.936+0000 7f9065da29c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:55.936+0000 7f9065da29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:55.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:55.936+0000 7f9065da29c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:55.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:55.940+0000 7f9065da29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:55.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:55.940+0000 7f9065da29c0 20 searching for the correct realm 2024-09-14T11:37:55.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:55.944+0000 7f90638a8640 0 -- 172.21.15.71:0/2306684851 >> [v2:172.21.15.157:6808/527702018,v1:172.21.15.157:6809/527702018] conn(0x7f905400eb20 msgr2=0x7f9054048930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:56.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.160+0000 7f90638a8640 0 -- 172.21.15.71:0/2306684851 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x56002bfbfef0 msgr2=0x56002bfc23b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:56.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.168+0000 7f9065da29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:56.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.168+0000 7f9065da29c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:37:56.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.168+0000 7f9065da29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:56.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.168+0000 7f9065da29c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:37:56.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.168+0000 7f9065da29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:56.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.168+0000 7f9065da29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:56.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.168+0000 7f9065da29c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.172+0000 7f9065da29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:56.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.172+0000 7f9065da29c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.172+0000 7f9065da29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:56.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.172+0000 7f9065da29c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.172+0000 7f9065da29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:56.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.172+0000 7f9065da29c0 20 zone default found 2024-09-14T11:37:56.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.172+0000 7f9065da29c0 4 Realm: () 2024-09-14T11:37:56.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.172+0000 7f9065da29c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:37:56.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.172+0000 7f9065da29c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:37:56.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.172+0000 7f9065da29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:56.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.172+0000 7f9065da29c0 20 zonegroup default 2024-09-14T11:37:56.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.172+0000 7f9065da29c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.172+0000 7f9065da29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:56.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.172+0000 7f9065da29c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.172+0000 7f9065da29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:56.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.172+0000 7f9065da29c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.172+0000 7f9065da29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:56.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.172+0000 7f9065da29c0 20 started sync module instance, tier type = 2024-09-14T11:37:56.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.172+0000 7f9065da29c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:37:56.195 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.196+0000 7f9065da29c0 20 add_watcher() i=0 2024-09-14T11:37:56.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.196+0000 7f9065da29c0 20 add_watcher() i=1 2024-09-14T11:37:56.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.196+0000 7f9065da29c0 20 add_watcher() i=2 2024-09-14T11:37:56.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.196+0000 7f9065da29c0 20 add_watcher() i=3 2024-09-14T11:37:56.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.196+0000 7f9065da29c0 20 add_watcher() i=4 2024-09-14T11:37:56.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.196+0000 7f9065da29c0 20 add_watcher() i=5 2024-09-14T11:37:56.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.196+0000 7f9065da29c0 20 add_watcher() i=6 2024-09-14T11:37:56.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.200+0000 7f9065da29c0 20 add_watcher() i=7 2024-09-14T11:37:56.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.200+0000 7f9065da29c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:56.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.204+0000 7f8f19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:56.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.204+0000 7f9065da29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:56.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.204+0000 7f9065da29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:56.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.296+0000 7f8f18fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:56.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.296+0000 7f9065da29c0 20 init_complete bucket index max shards: 11 2024-09-14T11:37:56.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.296+0000 7f9065da29c0 20 Filter name: none 2024-09-14T11:37:56.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.296+0000 7f8e927fc640 20 reqs_thread_entry: start 2024-09-14T11:37:56.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.296+0000 7f9065da29c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:37:56.298 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.300+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.300+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.300+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.304+0000 7f9065da29c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:37:56.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.308+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.306 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.308+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.308+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.312+0000 7f9065da29c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:37:56.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.312+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.316+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.316+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.316+0000 7f9065da29c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:37:56.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.320+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.320+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.319 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.320+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.328+0000 7f9065da29c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:37:56.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.328+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.328+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.328+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.329 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.332+0000 7f9065da29c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:37:56.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.332+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.332+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.336+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.336+0000 7f9065da29c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:37:56.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.340+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.340+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.340+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.344+0000 7f9065da29c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:37:56.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.348+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.348+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.348+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.352+0000 7f9065da29c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:37:56.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.352+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.356+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.356+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.360+0000 7f9065da29c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:37:56.359 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.360+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.364+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.362 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.364+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.368 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.372+0000 7f9065da29c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:37:56.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.372+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.376+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.376+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.380+0000 7f9065da29c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:37:56.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.380+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.380+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.380 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.380+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.381 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.384+0000 7f9065da29c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:37:56.384 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.388+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.386 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.388+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.387 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.388+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.389 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.392+0000 7f9065da29c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:37:56.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.396+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.392 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.396+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.396+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.396+0000 7f9065da29c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:37:56.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.400+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.404+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.404+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.404+0000 7f9065da29c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:37:56.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.412+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.412+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.412+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.416+0000 7f9065da29c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:37:56.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.416+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.420+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.420+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.420+0000 7f9065da29c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:37:56.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.424+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.428+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.428+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.428+0000 7f9065da29c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:37:56.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.432+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.436+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.436+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.440+0000 7f9065da29c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:37:56.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.444+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.444+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.444+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.445 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.448+0000 7f9065da29c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:37:56.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.452+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.452+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.452+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.456+0000 7f9065da29c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:37:56.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.460+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.460+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.464+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.468+0000 7f9065da29c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:37:56.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.468+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.472+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.472+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.476+0000 7f9065da29c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:37:56.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.480+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.480+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.484+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.484+0000 7f9065da29c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:37:56.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.488+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.492+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.492+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.496+0000 7f9065da29c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:37:56.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.500+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.500+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.500+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.504+0000 7f9065da29c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:37:56.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.508+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.508+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.507 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.508+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.512+0000 7f9065da29c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:37:56.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.516+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.516+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.520+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.524+0000 7f9065da29c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:37:56.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.524+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.528+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.528+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.532+0000 7f9065da29c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:37:56.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.536+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.536+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.536+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.540+0000 7f9065da29c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:37:56.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.544+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.544+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.548+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.548+0000 7f9065da29c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:37:56.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.552+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.556+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.556+0000 7f9065da29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.560+0000 7f8f19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:56.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.564+0000 7f9065da29c0 20 remove_watcher() i=0 2024-09-14T11:37:56.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.564+0000 7f9065da29c0 2 removed watcher, disabling cache 2024-09-14T11:37:56.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.568+0000 7f9065da29c0 20 remove_watcher() i=1 2024-09-14T11:37:56.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.568+0000 7f9065da29c0 20 remove_watcher() i=2 2024-09-14T11:37:56.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.572+0000 7f9065da29c0 20 remove_watcher() i=3 2024-09-14T11:37:56.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.576+0000 7f9065da29c0 20 remove_watcher() i=4 2024-09-14T11:37:56.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.576+0000 7f9065da29c0 20 remove_watcher() i=5 2024-09-14T11:37:56.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.580+0000 7f9065da29c0 20 remove_watcher() i=6 2024-09-14T11:37:56.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.584+0000 7f9065da29c0 20 remove_watcher() i=7 2024-09-14T11:37:56.606 DEBUG:teuthology.orchestra.run.smithi071:> radosgw-admin gc process --include-all 2024-09-14T11:37:56.679 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:56.679 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:56.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.728+0000 7f38bc8bb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.728+0000 7f38bc8bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:56.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.728+0000 7f38bc8bb9c0 20 realm 2024-09-14T11:37:56.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.728+0000 7f38bc8bb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.728+0000 7f38bc8bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:56.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.728+0000 7f38bc8bb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:56.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.728+0000 7f38bc8bb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.728+0000 7f38bc8bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:56.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.728+0000 7f38bc8bb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.732+0000 7f38bc8bb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:56.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.732+0000 7f38bc8bb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.732+0000 7f38bc8bb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:56.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.732+0000 7f38bc8bb9c0 20 searching for the correct realm 2024-09-14T11:37:56.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.736+0000 7f38babc2640 0 -- 172.21.15.71:0/3204094247 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f38a4043030 msgr2=0x7f38a4043410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:56.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.744+0000 7f38babc2640 0 -- 172.21.15.71:0/3204094247 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x5613381f5d70 msgr2=0x5613381f8160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:56.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.752+0000 7f38bc8bb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:56.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.752+0000 7f38bc8bb9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:37:56.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.752+0000 7f38bc8bb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:56.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.752+0000 7f38bc8bb9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:37:56.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.752+0000 7f38bc8bb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:56.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.752+0000 7f38bc8bb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:56.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.752+0000 7f38bc8bb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.752+0000 7f38bc8bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:56.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.752+0000 7f38bc8bb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.752+0000 7f38bc8bb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:56.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.752+0000 7f38bc8bb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.752+0000 7f38bc8bb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:56.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.752+0000 7f38bc8bb9c0 20 zone default found 2024-09-14T11:37:56.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.752+0000 7f38bc8bb9c0 4 Realm: () 2024-09-14T11:37:56.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.752+0000 7f38bc8bb9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:37:56.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.752+0000 7f38bc8bb9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:37:56.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.752+0000 7f38bc8bb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:56.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.752+0000 7f38bc8bb9c0 20 zonegroup default 2024-09-14T11:37:56.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.752+0000 7f38bc8bb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.752+0000 7f38bc8bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:56.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.752+0000 7f38bc8bb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.752+0000 7f38bc8bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:56.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.752+0000 7f38bc8bb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:56.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.752+0000 7f38bc8bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:56.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.752+0000 7f38bc8bb9c0 20 started sync module instance, tier type = 2024-09-14T11:37:56.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.752+0000 7f38bc8bb9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:37:56.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.772+0000 7f38bc8bb9c0 20 add_watcher() i=0 2024-09-14T11:37:56.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.772+0000 7f38bc8bb9c0 20 add_watcher() i=1 2024-09-14T11:37:56.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.772+0000 7f38bc8bb9c0 20 add_watcher() i=2 2024-09-14T11:37:56.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.772+0000 7f38bc8bb9c0 20 add_watcher() i=3 2024-09-14T11:37:56.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.772+0000 7f38bc8bb9c0 20 add_watcher() i=4 2024-09-14T11:37:56.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.772+0000 7f38bc8bb9c0 20 add_watcher() i=5 2024-09-14T11:37:56.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.772+0000 7f38bc8bb9c0 20 add_watcher() i=6 2024-09-14T11:37:56.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.772+0000 7f38bc8bb9c0 20 add_watcher() i=7 2024-09-14T11:37:56.772 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.772+0000 7f38bc8bb9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:56.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.776+0000 7f3770fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:56.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.776+0000 7f38bc8bb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:56.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.776+0000 7f38bc8bb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:56.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.860+0000 7f36eb7fe640 20 reqs_thread_entry: start 2024-09-14T11:37:56.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.860+0000 7f38bc8bb9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:37:56.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.860+0000 7f38bc8bb9c0 20 Filter name: none 2024-09-14T11:37:56.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.860+0000 7f36e97fa640 20 reqs_thread_entry: start 2024-09-14T11:37:56.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.860+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:37:56.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.860+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.864+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.861 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.864+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.863 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.864+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:37:56.867 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.868+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.872+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.872+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.872+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:37:56.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.876+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.875 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.876+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.880+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.880+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:37:56.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.884+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.884+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.883 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.884+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.888+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:37:56.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.892+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.892+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.892+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.892+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:37:56.894 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.896+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.896+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.895 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.896+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.900+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:37:56.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.904+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.904+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.904+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.904+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:37:56.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.912+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.910 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.912+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.912+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.916+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:37:56.917 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.920+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.920+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.920+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.924+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:37:56.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.928+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.928+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.928+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.932+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:37:56.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.936+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.936+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.940+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.940+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:37:56.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.944+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.944+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.944+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.948+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:37:56.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.952+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.952+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.952+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.952+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:37:56.955 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.956+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.956 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.960+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.960+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.960+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:37:56.963 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.964+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.968+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.968+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.967 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.968+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:37:56.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.972+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.972+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.976+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.975 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.976+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:37:56.978 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.980+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.980+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.980 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.984+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.984+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:37:56.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.988+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.988+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.988+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.992+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:37:56.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.996+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.996+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:56.995 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:56.996+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:56.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.000+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:37:57.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.004+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.004+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.004+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.007 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.008+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:37:57.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.012+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.016+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.013 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.016+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.020+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:37:57.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.020+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.021 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.024+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.024+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.025 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.028+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:37:57.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.032+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.032+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.030 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.032+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.033 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.036+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:37:57.036 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.040+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.040+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.038 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.040+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.040+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:37:57.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.044+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.048+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.048+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.052+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:37:57.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.052+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.056+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.056+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.056+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:37:57.059 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.060+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.064+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.064+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.068+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:37:57.067 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.068+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.069 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.072+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.072+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.076+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:37:57.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.080+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.080+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.080+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.084+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:37:57.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.084+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.088+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.088+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.092+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:37:57.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.092+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.096+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.096+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.100+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:37:57.102 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.104+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.104+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.104 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.104+0000 7f38bc8bb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.112+0000 7f3770fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:57.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.116+0000 7f38bc8bb9c0 20 remove_watcher() i=0 2024-09-14T11:37:57.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.116+0000 7f38bc8bb9c0 2 removed watcher, disabling cache 2024-09-14T11:37:57.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.116+0000 7f38bc8bb9c0 20 remove_watcher() i=1 2024-09-14T11:37:57.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.120+0000 7f38bc8bb9c0 20 remove_watcher() i=2 2024-09-14T11:37:57.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.124+0000 7f38bc8bb9c0 20 remove_watcher() i=3 2024-09-14T11:37:57.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.124+0000 7f38bc8bb9c0 20 remove_watcher() i=4 2024-09-14T11:37:57.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.128+0000 7f38bc8bb9c0 20 remove_watcher() i=5 2024-09-14T11:37:57.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.132+0000 7f38bc8bb9c0 20 remove_watcher() i=6 2024-09-14T11:37:57.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.136+0000 7f38bc8bb9c0 20 remove_watcher() i=7 2024-09-14T11:37:57.151 DEBUG:teuthology.orchestra.run.smithi071:> radosgw-admin gc process --include-all 2024-09-14T11:37:57.223 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:57.223 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:57.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.276+0000 7faf864db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.276+0000 7faf864db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:57.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.276+0000 7faf864db9c0 20 realm 2024-09-14T11:37:57.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.276+0000 7faf864db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.276+0000 7faf864db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:57.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.276+0000 7faf864db9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:57.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.276+0000 7faf864db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.276+0000 7faf864db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:57.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.276+0000 7faf864db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.280+0000 7faf864db9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:57.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.280+0000 7faf864db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.280+0000 7faf864db9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:57.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.280+0000 7faf864db9c0 20 searching for the correct realm 2024-09-14T11:37:57.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.280+0000 7faf837e0640 0 -- 172.21.15.71:0/1563238560 >> [v2:172.21.15.71:6824/2436891866,v1:172.21.15.71:6825/2436891866] conn(0x7faf7410c000 msgr2=0x7faf740ff1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:57.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.492+0000 7faf847e2640 0 -- 172.21.15.71:0/1563238560 >> [v2:172.21.15.157:6816/1231501119,v1:172.21.15.157:6817/1231501119] conn(0x556bbf824730 msgr2=0x556bbf826b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:57.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.512+0000 7faf864db9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:57.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.512+0000 7faf864db9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:37:57.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.512+0000 7faf864db9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:57.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.512+0000 7faf864db9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:37:57.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.512+0000 7faf864db9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:57.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.512+0000 7faf864db9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:57.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.512+0000 7faf864db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.512+0000 7faf864db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:57.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.512+0000 7faf864db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.512+0000 7faf864db9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:57.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.512+0000 7faf864db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.516+0000 7faf864db9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:57.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.516+0000 7faf864db9c0 20 zone default found 2024-09-14T11:37:57.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.516+0000 7faf864db9c0 4 Realm: () 2024-09-14T11:37:57.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.516+0000 7faf864db9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:37:57.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.516+0000 7faf864db9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:37:57.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.516+0000 7faf864db9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:57.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.516+0000 7faf864db9c0 20 zonegroup default 2024-09-14T11:37:57.512 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.516+0000 7faf864db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.516+0000 7faf864db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:57.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.516+0000 7faf864db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.516+0000 7faf864db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:57.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.516+0000 7faf864db9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:57.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.516+0000 7faf864db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:57.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.516+0000 7faf864db9c0 20 started sync module instance, tier type = 2024-09-14T11:37:57.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.516+0000 7faf864db9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:37:57.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.540+0000 7faf864db9c0 20 add_watcher() i=0 2024-09-14T11:37:57.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.540+0000 7faf864db9c0 20 add_watcher() i=1 2024-09-14T11:37:57.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.540+0000 7faf864db9c0 20 add_watcher() i=2 2024-09-14T11:37:57.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.540+0000 7faf864db9c0 20 add_watcher() i=3 2024-09-14T11:37:57.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.540+0000 7faf864db9c0 20 add_watcher() i=4 2024-09-14T11:37:57.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.540+0000 7faf864db9c0 20 add_watcher() i=5 2024-09-14T11:37:57.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.540+0000 7faf864db9c0 20 add_watcher() i=6 2024-09-14T11:37:57.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.544+0000 7faf864db9c0 20 add_watcher() i=7 2024-09-14T11:37:57.540 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.544+0000 7faf864db9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:57.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.548+0000 7fae35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:57.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.548+0000 7faf864db9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:57.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.548+0000 7faf864db9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:57.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.640+0000 7fae34fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:57.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.640+0000 7faf864db9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:37:57.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.644+0000 7faf864db9c0 20 Filter name: none 2024-09-14T11:37:57.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.644+0000 7fadae7fc640 20 reqs_thread_entry: start 2024-09-14T11:37:57.640 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.644+0000 7faf864db9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:37:57.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.644+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.644+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.644+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.648+0000 7faf864db9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:37:57.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.648+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.652+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.652+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.652+0000 7faf864db9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:37:57.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.656+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.660+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.660+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.660+0000 7faf864db9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:37:57.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.664+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.664+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.664+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.668+0000 7faf864db9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:37:57.667 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.668+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.672+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.672+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.676+0000 7faf864db9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:37:57.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.680+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.680+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.680+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.684+0000 7faf864db9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:37:57.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.684+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.684+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.688+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.688+0000 7faf864db9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:37:57.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.692+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.692+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.692+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.700+0000 7faf864db9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:37:57.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.700+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.704+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.704+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.708+0000 7faf864db9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:37:57.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.708+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.708+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.712+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.712+0000 7faf864db9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:37:57.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.716+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.716+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.720+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.718 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.720+0000 7faf864db9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:37:57.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.724+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.724+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.724+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.728+0000 7faf864db9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:37:57.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.728+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.728+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.732+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.732+0000 7faf864db9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:37:57.734 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.736+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.736 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.740+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.740+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.744+0000 7faf864db9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:37:57.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.748+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.748+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.748+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.748+0000 7faf864db9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:37:57.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.752+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.756+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.756+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.756+0000 7faf864db9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:37:57.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.760+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.764+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.764+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.768+0000 7faf864db9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:37:57.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.772+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.772+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.772+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.776+0000 7faf864db9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:37:57.777 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.780+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.780+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.784+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.784+0000 7faf864db9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:37:57.787 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.788+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.792+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.792+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.796+0000 7faf864db9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:37:57.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.800+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.804+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.804+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.808+0000 7faf864db9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:37:57.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.812+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.816+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.816+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.817 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.820+0000 7faf864db9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:37:57.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.824+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.824+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.824 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.824+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.828+0000 7faf864db9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:37:57.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.832+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.832+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.832 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.836+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.836+0000 7faf864db9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:37:57.839 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.840+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.844+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.844+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.848+0000 7faf864db9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:37:57.848 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.852+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.852+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.851 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.852+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.854 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.856+0000 7faf864db9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:37:57.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.860+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.859 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.860+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.860 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.860+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.864+0000 7faf864db9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:37:57.866 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.868+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.868+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.869 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.872+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.872+0000 7faf864db9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:37:57.876 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.876+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.880+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.880+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.884+0000 7faf864db9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:37:57.886 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.888+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.888 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.892+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.889 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.892+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.891 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.892+0000 7faf864db9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:37:57.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.900+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.900+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.900+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.904+0000 7faf864db9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:37:57.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.908+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.912+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:57.908 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.912+0000 7faf864db9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:57.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.916+0000 7fae35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:57.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.920+0000 7faf864db9c0 20 remove_watcher() i=0 2024-09-14T11:37:57.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.920+0000 7faf864db9c0 2 removed watcher, disabling cache 2024-09-14T11:37:57.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.924+0000 7faf864db9c0 20 remove_watcher() i=1 2024-09-14T11:37:57.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.928+0000 7faf864db9c0 20 remove_watcher() i=2 2024-09-14T11:37:57.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.928+0000 7faf864db9c0 20 remove_watcher() i=3 2024-09-14T11:37:57.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.932+0000 7faf864db9c0 20 remove_watcher() i=4 2024-09-14T11:37:57.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.932+0000 7faf864db9c0 20 remove_watcher() i=5 2024-09-14T11:37:57.934 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.936+0000 7faf864db9c0 20 remove_watcher() i=6 2024-09-14T11:37:57.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:57.940+0000 7faf864db9c0 20 remove_watcher() i=7 2024-09-14T11:37:57.955 DEBUG:teuthology.orchestra.run.smithi071:> radosgw-admin gc process --include-all 2024-09-14T11:37:58.026 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:58.027 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:58.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.076+0000 7fc4095079c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.080+0000 7fc4095079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.080+0000 7fc4095079c0 20 realm 2024-09-14T11:37:58.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.080+0000 7fc4095079c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.080+0000 7fc4095079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.080+0000 7fc4095079c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:58.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.080+0000 7fc4095079c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.080+0000 7fc4095079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.080+0000 7fc4095079c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.080+0000 7fc4095079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:58.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.080+0000 7fc4095079c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.080+0000 7fc4095079c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:58.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.080+0000 7fc4095079c0 20 searching for the correct realm 2024-09-14T11:37:58.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.084+0000 7fc40780e640 0 -- 172.21.15.71:0/3311067978 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fc3fc008050 msgr2=0x7fc3fc046410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:58.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.296+0000 7fc40780e640 0 -- 172.21.15.71:0/3311067978 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x5609fab65f10 msgr2=0x5609fab68300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:58.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.312+0000 7fc4095079c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:58.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.312+0000 7fc4095079c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:37:58.309 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.312+0000 7fc4095079c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:58.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.312+0000 7fc4095079c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:37:58.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.312+0000 7fc4095079c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:58.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.312+0000 7fc4095079c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:58.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.312+0000 7fc4095079c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.312+0000 7fc4095079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.310 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.312+0000 7fc4095079c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.312+0000 7fc4095079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:58.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.312+0000 7fc4095079c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.312+0000 7fc4095079c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:58.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.312+0000 7fc4095079c0 20 zone default found 2024-09-14T11:37:58.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.312+0000 7fc4095079c0 4 Realm: () 2024-09-14T11:37:58.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.312+0000 7fc4095079c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:37:58.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.312+0000 7fc4095079c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:37:58.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.312+0000 7fc4095079c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:58.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.312+0000 7fc4095079c0 20 zonegroup default 2024-09-14T11:37:58.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.312+0000 7fc4095079c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.316+0000 7fc4095079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.316+0000 7fc4095079c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.316+0000 7fc4095079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.316+0000 7fc4095079c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:58.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.316+0000 7fc4095079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:58.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.316+0000 7fc4095079c0 20 started sync module instance, tier type = 2024-09-14T11:37:58.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.316+0000 7fc4095079c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:37:58.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.340+0000 7fc4095079c0 20 add_watcher() i=0 2024-09-14T11:37:58.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.340+0000 7fc4095079c0 20 add_watcher() i=1 2024-09-14T11:37:58.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.340+0000 7fc4095079c0 20 add_watcher() i=2 2024-09-14T11:37:58.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.340+0000 7fc4095079c0 20 add_watcher() i=3 2024-09-14T11:37:58.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.340+0000 7fc4095079c0 20 add_watcher() i=4 2024-09-14T11:37:58.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.340+0000 7fc4095079c0 20 add_watcher() i=5 2024-09-14T11:37:58.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.340+0000 7fc4095079c0 20 add_watcher() i=6 2024-09-14T11:37:58.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.340+0000 7fc4095079c0 20 add_watcher() i=7 2024-09-14T11:37:58.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.340+0000 7fc4095079c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:58.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.344+0000 7fc2bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:58.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.348+0000 7fc4095079c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:58.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.348+0000 7fc4095079c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:58.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.440+0000 7fc2bcfe1640 20 reqs_thread_entry: start 2024-09-14T11:37:58.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.440+0000 7fc4095079c0 20 init_complete bucket index max shards: 11 2024-09-14T11:37:58.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.440+0000 7fc4095079c0 20 Filter name: none 2024-09-14T11:37:58.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.440+0000 7fc2367fc640 20 reqs_thread_entry: start 2024-09-14T11:37:58.437 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.440+0000 7fc4095079c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:37:58.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.440+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.444+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:58.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.444+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.444+0000 7fc4095079c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:37:58.447 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.448+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.449 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.452+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:58.450 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.452+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.456+0000 7fc4095079c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:37:58.455 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.456+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.460+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:58.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.460+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.460+0000 7fc4095079c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:37:58.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.464+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.464+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:58.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.468+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.468+0000 7fc4095079c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:37:58.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.472+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.472 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.476+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:58.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.476+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.476+0000 7fc4095079c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:37:58.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.480+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.480+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:58.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.484+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.484+0000 7fc4095079c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:37:58.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.488+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.488+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:58.487 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.488+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.492+0000 7fc4095079c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:37:58.493 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.496+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.496+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:58.495 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.496+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.500+0000 7fc4095079c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:37:58.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.504+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.504+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:58.503 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.504+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.508+0000 7fc4095079c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:37:58.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.512+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.512+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:58.511 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.512+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.516+0000 7fc4095079c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:37:58.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.516+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.520+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:58.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.520+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.520+0000 7fc4095079c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:37:58.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.524+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.524+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:58.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.524+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.528+0000 7fc4095079c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:37:58.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.532+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.532+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:58.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.532+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.536+0000 7fc4095079c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:37:58.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.540+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.540+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:58.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.540+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.541 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.544+0000 7fc4095079c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:37:58.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.548+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.548+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:58.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.548+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.552+0000 7fc4095079c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:37:58.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.556+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.556+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:58.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.560+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.560+0000 7fc4095079c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:37:58.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.564+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.568+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:58.565 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.568+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.568 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.572+0000 7fc4095079c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:37:58.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.572+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.576+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:58.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.576+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.575 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.576+0000 7fc4095079c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:37:58.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.580+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.584+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:58.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.584+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.588+0000 7fc4095079c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:37:58.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.592+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.596+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:58.593 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.596+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.596+0000 7fc4095079c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:37:58.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.600+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.604+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:58.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.604+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.608+0000 7fc4095079c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:37:58.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.612+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.612+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:58.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.616+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.616+0000 7fc4095079c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:37:58.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.620+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.624+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:58.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.624+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.628+0000 7fc4095079c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:37:58.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.628+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.632+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:58.632 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.632+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.636+0000 7fc4095079c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:37:58.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.640+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.640+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:58.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.640+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.644+0000 7fc4095079c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:37:58.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.648+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.648+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:58.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.652+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.652+0000 7fc4095079c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:37:58.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.656+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.660+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:58.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.660+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.660+0000 7fc4095079c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:37:58.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.664+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.668+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:58.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.668+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.668+0000 7fc4095079c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:37:58.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.672+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.672+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:58.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.676+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.676+0000 7fc4095079c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:37:58.679 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.680+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.681 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.684+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:58.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.684+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.688+0000 7fc4095079c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:37:58.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.692+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.692+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:58.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.692+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.696+0000 7fc4095079c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:37:58.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.700+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.700+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:58.698 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.700+0000 7fc4095079c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:58.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.704+0000 7fc2bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:58.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.712+0000 7fc4095079c0 20 remove_watcher() i=0 2024-09-14T11:37:58.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.712+0000 7fc4095079c0 2 removed watcher, disabling cache 2024-09-14T11:37:58.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.712+0000 7fc4095079c0 20 remove_watcher() i=1 2024-09-14T11:37:58.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.716+0000 7fc4095079c0 20 remove_watcher() i=2 2024-09-14T11:37:58.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.716+0000 7fc4095079c0 20 remove_watcher() i=3 2024-09-14T11:37:58.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.720+0000 7fc4095079c0 20 remove_watcher() i=4 2024-09-14T11:37:58.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.724+0000 7fc4095079c0 20 remove_watcher() i=5 2024-09-14T11:37:58.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.724+0000 7fc4095079c0 20 remove_watcher() i=6 2024-09-14T11:37:58.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:37:58.728+0000 7fc4095079c0 20 remove_watcher() i=7 2024-09-14T11:37:58.745 DEBUG:teuthology.orchestra.run.smithi071:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-14T11:37:59.430 INFO:teuthology.orchestra.run.smithi071.stdout:> Task :clean 2024-09-14T11:38:00.328 INFO:teuthology.orchestra.run.smithi071.stdout:> Task :compileJava 2024-09-14T11:38:00.328 INFO:teuthology.orchestra.run.smithi071.stdout:> Task :processResources 2024-09-14T11:38:00.328 INFO:teuthology.orchestra.run.smithi071.stdout:> Task :classes 2024-09-14T11:38:00.827 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:00.828 INFO:teuthology.orchestra.run.smithi071.stdout:> Task :compileTestJava 2024-09-14T11:38:00.828 INFO:teuthology.orchestra.run.smithi071.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:38:00.828 INFO:teuthology.orchestra.run.smithi071.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:38:00.829 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:00.829 INFO:teuthology.orchestra.run.smithi071.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:38:00.829 INFO:teuthology.orchestra.run.smithi071.stdout:> Task :testClasses 2024-09-14T11:38:02.827 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:02.828 INFO:teuthology.orchestra.run.smithi071.stdout:> Task :test 2024-09-14T11:38:02.828 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:02.828 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests STANDARD_OUT 2024-09-14T11:38:02.829 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14 11:38:02,108 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:38:02.829 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:02.829 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-14T11:38:02.829 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:02.829 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-14T11:38:03.027 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:03.027 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-14T11:38:03.127 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:03.127 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-14T11:38:03.428 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:03.428 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-14T11:38:03.428 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:03.428 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-14T11:38:03.727 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:03.727 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-14T11:38:05.327 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:05.327 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-14T11:38:05.627 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:05.628 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-14T11:38:05.628 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:05.628 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-14T11:38:05.927 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:05.927 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-14T11:38:06.127 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:06.127 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-14T11:38:06.427 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:06.427 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-14T11:38:06.428 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:06.428 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-14T11:38:06.527 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:06.528 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-14T11:38:06.528 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:06.528 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-14T11:38:06.827 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:06.827 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-14T11:38:07.027 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:07.027 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-14T11:38:07.327 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:07.327 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-14T11:38:07.427 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:07.428 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-14T11:38:07.627 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:07.627 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-14T11:38:07.727 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:07.727 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-14T11:38:08.027 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:08.028 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-14T11:38:08.028 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:08.028 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-14T11:38:08.327 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:08.327 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-14T11:38:08.427 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:08.427 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-14T11:38:08.627 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:08.627 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-14T11:38:08.727 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:08.727 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-14T11:38:09.027 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:09.027 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-14T11:38:09.127 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:09.127 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-14T11:38:09.427 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:09.427 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-14T11:38:09.527 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:09.528 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-14T11:38:09.827 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:09.828 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-14T11:38:10.227 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:10.227 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-14T11:38:10.727 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:10.727 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-14T11:38:16.027 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:16.027 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-14T11:38:16.427 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:16.428 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-14T11:38:16.527 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:16.527 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-14T11:38:16.727 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:16.727 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-14T11:38:16.827 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:16.827 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-14T11:38:17.227 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:17.227 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-14T11:38:17.727 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:17.727 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-14T11:38:18.027 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:18.027 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-14T11:38:18.027 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:18.028 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-14T11:38:18.127 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:18.127 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-14T11:38:18.927 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:18.927 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-14T11:38:19.127 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:19.267 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-14T11:38:19.627 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:19.627 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-14T11:38:19.927 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:19.927 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-14T11:38:20.727 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:20.727 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-14T11:38:21.027 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:21.027 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-14T11:38:24.527 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:24.528 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-14T11:38:24.827 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:24.827 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-14T11:38:26.227 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:26.227 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-14T11:38:26.527 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:26.527 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-14T11:38:28.127 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:28.127 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-14T11:38:28.427 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:28.427 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-14T11:38:28.927 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:28.927 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-14T11:38:29.527 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:29.527 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-14T11:38:29.527 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:29.528 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-14T11:38:29.627 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:29.627 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-14T11:38:29.727 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:29.727 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-14T11:38:29.927 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:29.927 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-14T11:38:30.027 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:30.027 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-14T11:38:30.327 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:30.327 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-14T11:38:30.328 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:30.328 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-14T11:38:30.627 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:30.627 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-14T11:38:30.727 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:30.727 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-14T11:38:30.927 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:30.927 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-14T11:38:31.027 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:31.027 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-14T11:38:31.327 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:31.327 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-14T11:38:31.327 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:31.328 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-14T11:38:31.627 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:31.627 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-14T11:38:31.727 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:31.727 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-14T11:38:32.027 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:32.027 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-14T11:38:32.127 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:32.127 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-14T11:38:32.427 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:32.427 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-14T11:38:32.527 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:32.527 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-14T11:38:32.827 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:32.827 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-14T11:38:32.927 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:32.927 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-14T11:38:33.227 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:33.227 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-14T11:38:33.327 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:33.327 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-14T11:38:33.627 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:33.627 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-14T11:38:33.727 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:33.727 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-14T11:38:34.027 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:34.027 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-14T11:38:34.127 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:34.127 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-14T11:38:34.527 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:34.527 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-14T11:38:34.627 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:34.627 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-14T11:38:34.927 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:34.927 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-14T11:38:35.027 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:35.027 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-14T11:38:35.327 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:35.327 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-14T11:38:35.427 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:35.427 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-14T11:38:35.727 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:35.727 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-14T11:38:35.827 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:35.827 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-14T11:38:36.127 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:36.127 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-14T11:38:36.227 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:36.227 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-14T11:38:36.527 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:36.527 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-14T11:38:36.627 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:36.627 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-14T11:38:36.927 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:36.927 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-14T11:38:37.027 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:37.027 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-14T11:38:37.327 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:37.327 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-14T11:38:37.427 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:37.427 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-14T11:38:37.727 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:37.727 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-14T11:38:37.827 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:37.827 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-14T11:38:38.127 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:38.127 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-14T11:38:38.227 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:38.227 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-14T11:38:38.527 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:38.527 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-14T11:38:38.627 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:38.627 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-14T11:38:38.927 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:38.928 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-14T11:38:39.027 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:39.027 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-14T11:38:39.327 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:39.327 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-14T11:38:39.427 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:39.427 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-14T11:38:39.727 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:39.727 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-14T11:38:39.827 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:39.827 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-14T11:38:40.127 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:40.127 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-14T11:38:40.227 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:40.227 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-14T11:38:40.527 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:40.527 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-14T11:38:40.627 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:40.627 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-14T11:38:40.927 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:40.927 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-14T11:38:41.027 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:41.027 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-14T11:38:41.227 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:41.227 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-14T11:38:41.327 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:41.327 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-14T11:38:41.527 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:41.527 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-14T11:38:41.528 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:41.528 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-14T11:38:41.827 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:41.827 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-14T11:38:42.027 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:42.027 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-14T11:38:42.227 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:42.227 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-14T11:38:42.327 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:42.327 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-14T11:38:42.427 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:42.427 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-14T11:38:42.527 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:42.527 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-14T11:38:42.727 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:42.727 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-14T11:38:42.827 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:42.827 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-14T11:38:43.127 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:43.127 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-14T11:38:43.227 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:43.227 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-14T11:38:43.427 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:43.427 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-14T11:38:43.527 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:43.527 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-14T11:38:43.827 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:43.827 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-14T11:38:44.127 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:44.127 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-14T11:38:44.427 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:44.427 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-14T11:38:44.827 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:44.827 INFO:teuthology.orchestra.run.smithi071.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-14T11:38:45.187 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:45.187 INFO:teuthology.orchestra.run.smithi071.stdout:---------------------------------------------------------------------- 2024-09-14T11:38:45.187 INFO:teuthology.orchestra.run.smithi071.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-14T11:38:45.187 INFO:teuthology.orchestra.run.smithi071.stdout:---------------------------------------------------------------------- 2024-09-14T11:38:45.187 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:45.187 INFO:teuthology.orchestra.run.smithi071.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:38:45.187 INFO:teuthology.orchestra.run.smithi071.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:38:45.187 INFO:teuthology.orchestra.run.smithi071.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:38:45.188 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:45.188 INFO:teuthology.orchestra.run.smithi071.stdout:BUILD SUCCESSFUL in 46s 2024-09-14T11:38:45.188 INFO:teuthology.orchestra.run.smithi071.stdout:5 actionable tasks: 5 executed 2024-09-14T11:38:45.205 DEBUG:teuthology.orchestra.run.smithi071:> radosgw-admin gc process --include-all 2024-09-14T11:38:45.231 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:45.231 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:45.276 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.279+0000 7f65348609c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:45.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.279+0000 7f65348609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:45.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.279+0000 7f65348609c0 20 realm 2024-09-14T11:38:45.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.279+0000 7f65348609c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.279+0000 7f65348609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.279+0000 7f65348609c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.279+0000 7f65348609c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.283+0000 7f65348609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:45.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.283+0000 7f65348609c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:45.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.283+0000 7f65348609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:45.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.283+0000 7f65348609c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:45.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.283+0000 7f65348609c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:45.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.283+0000 7f65348609c0 20 searching for the correct realm 2024-09-14T11:38:45.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.287+0000 7f6532366640 0 -- 172.21.15.71:0/809918431 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x557226362bf0 msgr2=0x5572263650b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:45.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.295+0000 7f6532366640 0 -- 172.21.15.71:0/809918431 >> [v2:172.21.15.157:6816/1231501119,v1:172.21.15.157:6817/1231501119] conn(0x557226356430 msgr2=0x557226358860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:45.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.303+0000 7f65348609c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:45.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.303+0000 7f65348609c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:38:45.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.303+0000 7f65348609c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:45.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.303+0000 7f65348609c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:38:45.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.303+0000 7f65348609c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:45.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.303+0000 7f65348609c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:45.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.303+0000 7f65348609c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:45.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.303+0000 7f65348609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:45.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.303+0000 7f65348609c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:45.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.303+0000 7f65348609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:45.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.303+0000 7f65348609c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:45.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.303+0000 7f65348609c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:45.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.303+0000 7f65348609c0 20 zone default found 2024-09-14T11:38:45.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.303+0000 7f65348609c0 4 Realm: () 2024-09-14T11:38:45.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.303+0000 7f65348609c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:38:45.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.303+0000 7f65348609c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:38:45.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.303+0000 7f65348609c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:45.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.303+0000 7f65348609c0 20 zonegroup default 2024-09-14T11:38:45.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.303+0000 7f65348609c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:45.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.303+0000 7f65348609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:45.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.303+0000 7f65348609c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:45.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.303+0000 7f65348609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:45.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.303+0000 7f65348609c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:45.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.303+0000 7f65348609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:45.304 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.303+0000 7f65348609c0 20 started sync module instance, tier type = 2024-09-14T11:38:45.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.303+0000 7f65348609c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:38:45.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.323+0000 7f65348609c0 20 add_watcher() i=0 2024-09-14T11:38:45.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.323+0000 7f65348609c0 20 add_watcher() i=1 2024-09-14T11:38:45.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.323+0000 7f65348609c0 20 add_watcher() i=2 2024-09-14T11:38:45.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.323+0000 7f65348609c0 20 add_watcher() i=3 2024-09-14T11:38:45.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.323+0000 7f65348609c0 20 add_watcher() i=4 2024-09-14T11:38:45.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.323+0000 7f65348609c0 20 add_watcher() i=5 2024-09-14T11:38:45.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.323+0000 7f65348609c0 20 add_watcher() i=6 2024-09-14T11:38:45.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.327+0000 7f65348609c0 20 add_watcher() i=7 2024-09-14T11:38:45.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.327+0000 7f65348609c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:45.327 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.327+0000 7f63e8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:45.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.327+0000 7f65348609c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:45.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.327+0000 7f65348609c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:45.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.403+0000 7f63637fe640 20 reqs_thread_entry: start 2024-09-14T11:38:45.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.403+0000 7f65348609c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:45.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.403+0000 7f65348609c0 20 Filter name: none 2024-09-14T11:38:45.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.403+0000 7f63617fa640 20 reqs_thread_entry: start 2024-09-14T11:38:45.402 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.403+0000 7f65348609c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:38:45.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.407+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.407+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:45.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.407+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.409 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.411+0000 7f65348609c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:38:45.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.411+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.411+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:45.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.415+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.415+0000 7f65348609c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:38:45.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.419+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.419+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:45.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.419+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:38:45.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.419+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.12753301461692212947', time=2024-09-14T13:38:23.401329+0000, chain.objs.size()=9 2024-09-14T11:38:45.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.419+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__multipart_key1.2~lC4PvXpWcv-16oeI4mGjWB7_5eMJPQ9.1 2024-09-14T11:38:45.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.419+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__shadow_key1.2~lC4PvXpWcv-16oeI4mGjWB7_5eMJPQ9.1_1 2024-09-14T11:38:45.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.419+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__multipart_key1.2~lC4PvXpWcv-16oeI4mGjWB7_5eMJPQ9.2 2024-09-14T11:38:45.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.419+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__shadow_key1.2~lC4PvXpWcv-16oeI4mGjWB7_5eMJPQ9.2_1 2024-09-14T11:38:45.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.419+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__multipart_key1.2~lC4PvXpWcv-16oeI4mGjWB7_5eMJPQ9.3 2024-09-14T11:38:45.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.419+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__shadow_key1.2~lC4PvXpWcv-16oeI4mGjWB7_5eMJPQ9.3_1 2024-09-14T11:38:45.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.419+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__multipart_key1.2~lC4PvXpWcv-16oeI4mGjWB7_5eMJPQ9.4 2024-09-14T11:38:45.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.419+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__shadow_key1.2~lC4PvXpWcv-16oeI4mGjWB7_5eMJPQ9.4_1 2024-09-14T11:38:45.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.419+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__multipart_key1.2~lC4PvXpWcv-16oeI4mGjWB7_5eMJPQ9.5 2024-09-14T11:38:45.424 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.427+0000 7f65348609c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:45.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.431+0000 7f65348609c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:38:45.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.431+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.435+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:45.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.435+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.435+0000 7f65348609c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:38:45.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.439+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.439+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:45.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.443+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:38:45.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.443+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.7561107007750056253', time=2024-09-14T13:38:17.751434+0000, chain.objs.size()=9 2024-09-14T11:38:45.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.443+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.99__multipart_key1.2~fdNQfFp9UjZSS809KqOJrkMum0pEast.1 2024-09-14T11:38:45.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.443+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.99__shadow_key1.2~fdNQfFp9UjZSS809KqOJrkMum0pEast.1_1 2024-09-14T11:38:45.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.443+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.99__multipart_key1.2~fdNQfFp9UjZSS809KqOJrkMum0pEast.2 2024-09-14T11:38:45.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.443+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.99__shadow_key1.2~fdNQfFp9UjZSS809KqOJrkMum0pEast.2_1 2024-09-14T11:38:45.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.443+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.99__multipart_key1.2~fdNQfFp9UjZSS809KqOJrkMum0pEast.3 2024-09-14T11:38:45.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.443+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.99__shadow_key1.2~fdNQfFp9UjZSS809KqOJrkMum0pEast.3_1 2024-09-14T11:38:45.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.443+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.99__multipart_key1.2~fdNQfFp9UjZSS809KqOJrkMum0pEast.4 2024-09-14T11:38:45.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.443+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.99__shadow_key1.2~fdNQfFp9UjZSS809KqOJrkMum0pEast.4_1 2024-09-14T11:38:45.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.443+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.99__multipart_key1.2~fdNQfFp9UjZSS809KqOJrkMum0pEast.5 2024-09-14T11:38:45.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.443+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.7215666606818210066', time=2024-09-14T13:38:44.222752+0000, chain.objs.size()=9 2024-09-14T11:38:45.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.443+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.144__multipart_key1.2~E0aEEt5ueXher5HC-KAzOK3xc3FgD7j.1 2024-09-14T11:38:45.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.443+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.144__shadow_key1.2~E0aEEt5ueXher5HC-KAzOK3xc3FgD7j.1_1 2024-09-14T11:38:45.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.443+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.144__multipart_key1.2~E0aEEt5ueXher5HC-KAzOK3xc3FgD7j.2 2024-09-14T11:38:45.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.447+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.144__shadow_key1.2~E0aEEt5ueXher5HC-KAzOK3xc3FgD7j.2_1 2024-09-14T11:38:45.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.447+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.144__multipart_key1.2~E0aEEt5ueXher5HC-KAzOK3xc3FgD7j.3 2024-09-14T11:38:45.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.447+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.144__shadow_key1.2~E0aEEt5ueXher5HC-KAzOK3xc3FgD7j.3_1 2024-09-14T11:38:45.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.447+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.144__multipart_key1.2~E0aEEt5ueXher5HC-KAzOK3xc3FgD7j.4 2024-09-14T11:38:45.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.451+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.144__shadow_key1.2~E0aEEt5ueXher5HC-KAzOK3xc3FgD7j.4_1 2024-09-14T11:38:45.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.451+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.144__multipart_key1.2~E0aEEt5ueXher5HC-KAzOK3xc3FgD7j.5 2024-09-14T11:38:45.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.451+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.16266013928716678443', time=2024-09-14T13:38:44.915566+0000, chain.objs.size()=9 2024-09-14T11:38:45.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.451+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.145__multipart_key1/data/file.mpg.2~pnpCPxZJB0tFcA2MhpFjjNcdywFgf2J.1 2024-09-14T11:38:45.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.451+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.145__shadow_key1/data/file.mpg.2~pnpCPxZJB0tFcA2MhpFjjNcdywFgf2J.1_1 2024-09-14T11:38:45.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.451+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.145__multipart_key1/data/file.mpg.2~pnpCPxZJB0tFcA2MhpFjjNcdywFgf2J.2 2024-09-14T11:38:45.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.451+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.145__shadow_key1/data/file.mpg.2~pnpCPxZJB0tFcA2MhpFjjNcdywFgf2J.2_1 2024-09-14T11:38:45.452 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.451+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.145__multipart_key1/data/file.mpg.2~pnpCPxZJB0tFcA2MhpFjjNcdywFgf2J.3 2024-09-14T11:38:45.453 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.455+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.145__shadow_key1/data/file.mpg.2~pnpCPxZJB0tFcA2MhpFjjNcdywFgf2J.3_1 2024-09-14T11:38:45.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.455+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.145__multipart_key1/data/file.mpg.2~pnpCPxZJB0tFcA2MhpFjjNcdywFgf2J.4 2024-09-14T11:38:45.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.455+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.145__shadow_key1/data/file.mpg.2~pnpCPxZJB0tFcA2MhpFjjNcdywFgf2J.4_1 2024-09-14T11:38:45.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.455+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.145__multipart_key1/data/file.mpg.2~pnpCPxZJB0tFcA2MhpFjjNcdywFgf2J.5 2024-09-14T11:38:45.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.459+0000 7f65348609c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:45.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.467+0000 7f65348609c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:38:45.467 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.467+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.471+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:45.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.471+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:38:45.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.471+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.4995608190801644710', time=2024-09-14T13:38:14.446192+0000, chain.objs.size()=9 2024-09-14T11:38:45.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.471+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__multipart_key1.2~WeT-M_YgDzZI64pBe0XJfjPo2fkABuh.1 2024-09-14T11:38:45.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.471+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__shadow_key1.2~WeT-M_YgDzZI64pBe0XJfjPo2fkABuh.1_1 2024-09-14T11:38:45.470 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.471+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__multipart_key1.2~WeT-M_YgDzZI64pBe0XJfjPo2fkABuh.2 2024-09-14T11:38:45.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.471+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__shadow_key1.2~WeT-M_YgDzZI64pBe0XJfjPo2fkABuh.2_1 2024-09-14T11:38:45.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.471+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__multipart_key1.2~WeT-M_YgDzZI64pBe0XJfjPo2fkABuh.3 2024-09-14T11:38:45.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.471+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__shadow_key1.2~WeT-M_YgDzZI64pBe0XJfjPo2fkABuh.3_1 2024-09-14T11:38:45.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.471+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__multipart_key1.2~WeT-M_YgDzZI64pBe0XJfjPo2fkABuh.4 2024-09-14T11:38:45.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.471+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__shadow_key1.2~WeT-M_YgDzZI64pBe0XJfjPo2fkABuh.4_1 2024-09-14T11:38:45.471 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.471+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__multipart_key1.2~WeT-M_YgDzZI64pBe0XJfjPo2fkABuh.5 2024-09-14T11:38:45.475 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.475+0000 7f65348609c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:45.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.483+0000 7f65348609c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:38:45.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.483+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.483+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:45.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.487+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-14T11:38:45.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.487+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL', time=2024-09-14T13:38:29.094340+0000, chain.objs.size()=89 2024-09-14T11:38:45.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.487+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.1 2024-09-14T11:38:45.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.487+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.2 2024-09-14T11:38:45.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.487+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.3 2024-09-14T11:38:45.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.487+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.4 2024-09-14T11:38:45.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.487+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.5 2024-09-14T11:38:45.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.487+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.6 2024-09-14T11:38:45.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.487+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.7 2024-09-14T11:38:45.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.487+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.8 2024-09-14T11:38:45.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.487+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.9 2024-09-14T11:38:45.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.487+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.10 2024-09-14T11:38:45.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.487+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.11 2024-09-14T11:38:45.486 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.487+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.12 2024-09-14T11:38:45.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.491+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.13 2024-09-14T11:38:45.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.491+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.14 2024-09-14T11:38:45.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.491+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.15 2024-09-14T11:38:45.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.491+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.16 2024-09-14T11:38:45.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.491+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.17 2024-09-14T11:38:45.490 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.491+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.18 2024-09-14T11:38:45.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.491+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.19 2024-09-14T11:38:45.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.491+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.20 2024-09-14T11:38:45.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.491+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.21 2024-09-14T11:38:45.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.491+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.22 2024-09-14T11:38:45.491 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.491+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.23 2024-09-14T11:38:45.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.495+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.24 2024-09-14T11:38:45.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.495+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.25 2024-09-14T11:38:45.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.495+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.26 2024-09-14T11:38:45.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.495+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.27 2024-09-14T11:38:45.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.495+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.28 2024-09-14T11:38:45.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.495+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.29 2024-09-14T11:38:45.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.495+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.30 2024-09-14T11:38:45.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.495+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.31 2024-09-14T11:38:45.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.495+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.32 2024-09-14T11:38:45.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.495+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.33 2024-09-14T11:38:45.497 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.495+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.34 2024-09-14T11:38:45.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.499+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.35 2024-09-14T11:38:45.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.499+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.36 2024-09-14T11:38:45.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.503+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.37 2024-09-14T11:38:45.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.503+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.38 2024-09-14T11:38:45.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.503+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.39 2024-09-14T11:38:45.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.503+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.40 2024-09-14T11:38:45.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.503+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.41 2024-09-14T11:38:45.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.503+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.42 2024-09-14T11:38:45.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.503+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.43 2024-09-14T11:38:45.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.503+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.44 2024-09-14T11:38:45.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.503+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.45 2024-09-14T11:38:45.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.503+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.46 2024-09-14T11:38:45.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.503+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.47 2024-09-14T11:38:45.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.507+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.48 2024-09-14T11:38:45.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.507+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.49 2024-09-14T11:38:45.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.507+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.50 2024-09-14T11:38:45.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.507+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.51 2024-09-14T11:38:45.505 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.507+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.52 2024-09-14T11:38:45.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.507+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.53 2024-09-14T11:38:45.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.507+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.54 2024-09-14T11:38:45.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.507+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.55 2024-09-14T11:38:45.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.507+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.56 2024-09-14T11:38:45.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.507+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.57 2024-09-14T11:38:45.506 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.507+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.58 2024-09-14T11:38:45.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.511+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.59 2024-09-14T11:38:45.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.511+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.60 2024-09-14T11:38:45.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.511+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.61 2024-09-14T11:38:45.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.511+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.62 2024-09-14T11:38:45.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.511+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.63 2024-09-14T11:38:45.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.515+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.64 2024-09-14T11:38:45.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.515+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.65 2024-09-14T11:38:45.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.515+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.66 2024-09-14T11:38:45.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.515+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.67 2024-09-14T11:38:45.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.515+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.68 2024-09-14T11:38:45.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.515+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.69 2024-09-14T11:38:45.514 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.515+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.70 2024-09-14T11:38:45.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.519+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.71 2024-09-14T11:38:45.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.519+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.72 2024-09-14T11:38:45.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.519+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.73 2024-09-14T11:38:45.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.519+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.74 2024-09-14T11:38:45.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.519+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.75 2024-09-14T11:38:45.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.519+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.76 2024-09-14T11:38:45.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.519+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.77 2024-09-14T11:38:45.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.519+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.78 2024-09-14T11:38:45.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.519+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.79 2024-09-14T11:38:45.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.519+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.80 2024-09-14T11:38:45.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.519+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.81 2024-09-14T11:38:45.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.519+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.82 2024-09-14T11:38:45.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.519+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.83 2024-09-14T11:38:45.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.519+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.84 2024-09-14T11:38:45.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.519+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.85 2024-09-14T11:38:45.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.523+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.86 2024-09-14T11:38:45.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.523+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.87 2024-09-14T11:38:45.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.523+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.88 2024-09-14T11:38:45.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.523+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.89 2024-09-14T11:38:45.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.523+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL', time=2024-09-14T13:38:29.113313+0000, chain.objs.size()=10 2024-09-14T11:38:45.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.523+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.90 2024-09-14T11:38:45.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.523+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.91 2024-09-14T11:38:45.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.523+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.92 2024-09-14T11:38:45.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.523+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.93 2024-09-14T11:38:45.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.523+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.94 2024-09-14T11:38:45.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.523+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.95 2024-09-14T11:38:45.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.523+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.96 2024-09-14T11:38:45.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.527+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.97 2024-09-14T11:38:45.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.527+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.98 2024-09-14T11:38:45.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.527+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.99 2024-09-14T11:38:45.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.527+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL', time=2024-09-14T13:38:29.136198+0000, chain.objs.size()=10 2024-09-14T11:38:45.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.527+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.100 2024-09-14T11:38:45.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.527+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.101 2024-09-14T11:38:45.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.527+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.102 2024-09-14T11:38:45.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.527+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.103 2024-09-14T11:38:45.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.527+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.104 2024-09-14T11:38:45.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.527+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.105 2024-09-14T11:38:45.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.527+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.106 2024-09-14T11:38:45.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.527+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.107 2024-09-14T11:38:45.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.531+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.108 2024-09-14T11:38:45.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.531+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.109 2024-09-14T11:38:45.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.531+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL', time=2024-09-14T13:38:29.163069+0000, chain.objs.size()=10 2024-09-14T11:38:45.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.531+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.110 2024-09-14T11:38:45.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.531+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.111 2024-09-14T11:38:45.531 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.531+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.112 2024-09-14T11:38:45.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.531+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.113 2024-09-14T11:38:45.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.531+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.114 2024-09-14T11:38:45.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.531+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.115 2024-09-14T11:38:45.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.531+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.116 2024-09-14T11:38:45.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.531+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.117 2024-09-14T11:38:45.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.531+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.118 2024-09-14T11:38:45.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.535+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.119 2024-09-14T11:38:45.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.535+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL', time=2024-09-14T13:38:29.184082+0000, chain.objs.size()=6 2024-09-14T11:38:45.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.535+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.120 2024-09-14T11:38:45.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.535+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.121 2024-09-14T11:38:45.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.535+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.122 2024-09-14T11:38:45.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.535+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.124 2024-09-14T11:38:45.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.539+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.125 2024-09-14T11:38:45.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.539+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.129 2024-09-14T11:38:45.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.539+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL', time=2024-09-14T13:38:29.204953+0000, chain.objs.size()=10 2024-09-14T11:38:45.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.539+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.123 2024-09-14T11:38:45.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.539+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.126 2024-09-14T11:38:45.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.539+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.127 2024-09-14T11:38:45.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.539+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.128 2024-09-14T11:38:45.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.539+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.130 2024-09-14T11:38:45.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.539+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.131 2024-09-14T11:38:45.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.539+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.132 2024-09-14T11:38:45.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.539+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.133 2024-09-14T11:38:45.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.539+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.134 2024-09-14T11:38:45.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.539+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.135 2024-09-14T11:38:45.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.543+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL', time=2024-09-14T13:38:29.220752+0000, chain.objs.size()=6 2024-09-14T11:38:45.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.543+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.136 2024-09-14T11:38:45.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.543+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.137 2024-09-14T11:38:45.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.543+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.138 2024-09-14T11:38:45.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.543+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.139 2024-09-14T11:38:45.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.543+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.140 2024-09-14T11:38:45.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.543+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.141 2024-09-14T11:38:45.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.543+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL', time=2024-09-14T13:38:29.242876+0000, chain.objs.size()=10 2024-09-14T11:38:45.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.543+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.142 2024-09-14T11:38:45.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.547+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.143 2024-09-14T11:38:45.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.547+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.144 2024-09-14T11:38:45.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.547+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.145 2024-09-14T11:38:45.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.547+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.146 2024-09-14T11:38:45.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.547+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.147 2024-09-14T11:38:45.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.547+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.148 2024-09-14T11:38:45.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.547+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.149 2024-09-14T11:38:45.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.547+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.150 2024-09-14T11:38:45.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.547+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.151 2024-09-14T11:38:45.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.547+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL', time=2024-09-14T13:38:29.267131+0000, chain.objs.size()=10 2024-09-14T11:38:45.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.547+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.152 2024-09-14T11:38:45.546 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.547+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.153 2024-09-14T11:38:45.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.547+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.154 2024-09-14T11:38:45.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.551+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.155 2024-09-14T11:38:45.548 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.551+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.156 2024-09-14T11:38:45.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.551+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.157 2024-09-14T11:38:45.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.551+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.158 2024-09-14T11:38:45.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.551+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.159 2024-09-14T11:38:45.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.551+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.160 2024-09-14T11:38:45.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.551+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.161 2024-09-14T11:38:45.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.551+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL', time=2024-09-14T13:38:29.292912+0000, chain.objs.size()=11 2024-09-14T11:38:45.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.551+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.162 2024-09-14T11:38:45.549 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.551+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.163 2024-09-14T11:38:45.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.551+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.164 2024-09-14T11:38:45.550 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.551+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.165 2024-09-14T11:38:45.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.551+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.166 2024-09-14T11:38:45.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.551+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.167 2024-09-14T11:38:45.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.551+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.168 2024-09-14T11:38:45.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.551+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.169 2024-09-14T11:38:45.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.551+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.170 2024-09-14T11:38:45.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.551+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.171 2024-09-14T11:38:45.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.551+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.172 2024-09-14T11:38:45.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.551+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL', time=2024-09-14T13:38:29.309601+0000, chain.objs.size()=6 2024-09-14T11:38:45.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.551+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.173 2024-09-14T11:38:45.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.551+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.174 2024-09-14T11:38:45.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.551+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.175 2024-09-14T11:38:45.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.555+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.176 2024-09-14T11:38:45.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.555+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.177 2024-09-14T11:38:45.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.555+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.178 2024-09-14T11:38:45.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.555+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL', time=2024-09-14T13:38:29.335262+0000, chain.objs.size()=10 2024-09-14T11:38:45.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.555+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.179 2024-09-14T11:38:45.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.555+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.180 2024-09-14T11:38:45.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.555+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.181 2024-09-14T11:38:45.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.555+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.182 2024-09-14T11:38:45.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.555+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.183 2024-09-14T11:38:45.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.555+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.184 2024-09-14T11:38:45.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.555+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.185 2024-09-14T11:38:45.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.555+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.186 2024-09-14T11:38:45.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.555+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.187 2024-09-14T11:38:45.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.559+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.188 2024-09-14T11:38:45.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.559+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL', time=2024-09-14T13:38:29.358956+0000, chain.objs.size()=9 2024-09-14T11:38:45.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.559+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.189 2024-09-14T11:38:45.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.559+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.190 2024-09-14T11:38:45.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.559+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.191 2024-09-14T11:38:45.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.559+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.192 2024-09-14T11:38:45.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.559+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.193 2024-09-14T11:38:45.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.559+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.194 2024-09-14T11:38:45.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.559+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.195 2024-09-14T11:38:45.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.559+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.197 2024-09-14T11:38:45.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.559+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.198 2024-09-14T11:38:45.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.559+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL', time=2024-09-14T13:38:29.374707+0000, chain.objs.size()=8 2024-09-14T11:38:45.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.559+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.196 2024-09-14T11:38:45.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.563+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.199 2024-09-14T11:38:45.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.563+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.200 2024-09-14T11:38:45.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.563+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.201 2024-09-14T11:38:45.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.563+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.202 2024-09-14T11:38:45.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.563+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.203 2024-09-14T11:38:45.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.563+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.204 2024-09-14T11:38:45.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.563+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.205 2024-09-14T11:38:45.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.563+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL', time=2024-09-14T13:38:29.388951+0000, chain.objs.size()=7 2024-09-14T11:38:45.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.563+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.206 2024-09-14T11:38:45.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.563+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.207 2024-09-14T11:38:45.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.563+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.208 2024-09-14T11:38:45.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.563+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.209 2024-09-14T11:38:45.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.563+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.210 2024-09-14T11:38:45.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.563+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.211 2024-09-14T11:38:45.564 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.563+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.106__multipart_key1.2~lwWgi2Tutr1KSguvocPh-hZmCSvlbHL.212 2024-09-14T11:38:45.566 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.567+0000 7f65348609c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:45.569 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.571+0000 7f65348609c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:38:45.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.571+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.575+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:45.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.575+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.575+0000 7f65348609c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:38:45.576 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.579+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.577 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.579+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:45.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.579+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:38:45.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.579+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='2~OPU79Fy7UyxFPowInivmrJjbXZIbNv3', time=2024-09-14T13:38:05.240769+0000, chain.objs.size()=9 2024-09-14T11:38:45.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.579+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.80__multipart_key1.2~OPU79Fy7UyxFPowInivmrJjbXZIbNv3.1 2024-09-14T11:38:45.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.579+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.80__shadow_key1.2~OPU79Fy7UyxFPowInivmrJjbXZIbNv3.1_1 2024-09-14T11:38:45.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.579+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.80__multipart_key1.2~OPU79Fy7UyxFPowInivmrJjbXZIbNv3.2 2024-09-14T11:38:45.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.579+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.80__shadow_key1.2~OPU79Fy7UyxFPowInivmrJjbXZIbNv3.2_1 2024-09-14T11:38:45.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.579+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.80__multipart_key1.2~OPU79Fy7UyxFPowInivmrJjbXZIbNv3.3 2024-09-14T11:38:45.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.579+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.80__shadow_key1.2~OPU79Fy7UyxFPowInivmrJjbXZIbNv3.3_1 2024-09-14T11:38:45.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.579+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.80__multipart_key1.2~OPU79Fy7UyxFPowInivmrJjbXZIbNv3.4 2024-09-14T11:38:45.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.579+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.80__shadow_key1.2~OPU79Fy7UyxFPowInivmrJjbXZIbNv3.4_1 2024-09-14T11:38:45.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.579+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.80__multipart_key1.2~OPU79Fy7UyxFPowInivmrJjbXZIbNv3.5 2024-09-14T11:38:45.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.579+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.7218926695043587437', time=2024-09-14T13:38:24.468607+0000, chain.objs.size()=7 2024-09-14T11:38:45.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.579+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__multipart_key1.2~kU6uHlaCb7H_glr-2_mCblVsRxO8RqT.1 2024-09-14T11:38:45.579 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.579+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__shadow_key1.2~kU6uHlaCb7H_glr-2_mCblVsRxO8RqT.1_1 2024-09-14T11:38:45.580 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.579+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__shadow_key1.2~kU6uHlaCb7H_glr-2_mCblVsRxO8RqT.1_2 2024-09-14T11:38:45.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.583+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__multipart_key1.2~kU6uHlaCb7H_glr-2_mCblVsRxO8RqT.2 2024-09-14T11:38:45.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.583+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__shadow_key1.2~kU6uHlaCb7H_glr-2_mCblVsRxO8RqT.2_1 2024-09-14T11:38:45.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.583+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__shadow_key1.2~kU6uHlaCb7H_glr-2_mCblVsRxO8RqT.2_2 2024-09-14T11:38:45.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.583+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__multipart_key1.2~kU6uHlaCb7H_glr-2_mCblVsRxO8RqT.3 2024-09-14T11:38:45.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.587+0000 7f65348609c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:45.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.591+0000 7f65348609c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:38:45.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.591+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.591+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:45.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.591+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.595+0000 7f65348609c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:38:45.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.595+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.595+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:45.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.595+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:38:45.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.595+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.3379277388929096981', time=2024-09-14T13:38:13.764142+0000, chain.objs.size()=9 2024-09-14T11:38:45.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.595+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__multipart_key1.2~Kar-Qa32thNxeZd_yQ_ucBFaWVgpGEY.1 2024-09-14T11:38:45.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.595+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__shadow_key1.2~Kar-Qa32thNxeZd_yQ_ucBFaWVgpGEY.1_1 2024-09-14T11:38:45.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.595+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__multipart_key1.2~Kar-Qa32thNxeZd_yQ_ucBFaWVgpGEY.2 2024-09-14T11:38:45.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.595+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__shadow_key1.2~Kar-Qa32thNxeZd_yQ_ucBFaWVgpGEY.2_1 2024-09-14T11:38:45.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.595+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__multipart_key1.2~Kar-Qa32thNxeZd_yQ_ucBFaWVgpGEY.3 2024-09-14T11:38:45.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.595+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__shadow_key1.2~Kar-Qa32thNxeZd_yQ_ucBFaWVgpGEY.3_1 2024-09-14T11:38:45.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.595+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__multipart_key1.2~Kar-Qa32thNxeZd_yQ_ucBFaWVgpGEY.4 2024-09-14T11:38:45.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.595+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__shadow_key1.2~Kar-Qa32thNxeZd_yQ_ucBFaWVgpGEY.4_1 2024-09-14T11:38:45.596 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.595+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__multipart_key1.2~Kar-Qa32thNxeZd_yQ_ucBFaWVgpGEY.5 2024-09-14T11:38:45.599 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.599+0000 7f65348609c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:45.602 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.603+0000 7f65348609c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:38:45.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.603+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.607+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:45.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.607+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.607+0000 7f65348609c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:38:45.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.611+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.611+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:45.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.611+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.611+0000 7f65348609c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:38:45.612 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.615+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.615+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:45.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.615+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:38:45.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.615+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.1238914971751228274', time=2024-09-14T13:38:10.325554+0000, chain.objs.size()=9 2024-09-14T11:38:45.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.615+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.92__multipart_key1.2~tqz8sPtg0FtGTcbWqFcRKD7dB7fpRJf.1 2024-09-14T11:38:45.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.615+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.92__shadow_key1.2~tqz8sPtg0FtGTcbWqFcRKD7dB7fpRJf.1_1 2024-09-14T11:38:45.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.615+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.92__multipart_key1.2~tqz8sPtg0FtGTcbWqFcRKD7dB7fpRJf.2 2024-09-14T11:38:45.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.615+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.92__shadow_key1.2~tqz8sPtg0FtGTcbWqFcRKD7dB7fpRJf.2_1 2024-09-14T11:38:45.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.615+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.92__multipart_key1.2~tqz8sPtg0FtGTcbWqFcRKD7dB7fpRJf.3 2024-09-14T11:38:45.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.615+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.92__shadow_key1.2~tqz8sPtg0FtGTcbWqFcRKD7dB7fpRJf.3_1 2024-09-14T11:38:45.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.615+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.92__multipart_key1.2~tqz8sPtg0FtGTcbWqFcRKD7dB7fpRJf.4 2024-09-14T11:38:45.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.615+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.92__shadow_key1.2~tqz8sPtg0FtGTcbWqFcRKD7dB7fpRJf.4_1 2024-09-14T11:38:45.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.615+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.92__multipart_key1.2~tqz8sPtg0FtGTcbWqFcRKD7dB7fpRJf.5 2024-09-14T11:38:45.617 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.619+0000 7f65348609c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:45.619 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.619+0000 7f65348609c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:38:45.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.623+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.623+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:45.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.623+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.624 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.627+0000 7f65348609c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:38:45.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.627+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.627+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:45.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.627+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:38:45.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.627+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.13413099567484865420', time=2024-09-14T13:38:19.700668+0000, chain.objs.size()=9 2024-09-14T11:38:45.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.627+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.101__multipart_file.mpg.2~F4AagMvaNxP1IN8TZNM99D6HYkFoTpe.1 2024-09-14T11:38:45.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.627+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.101__shadow_file.mpg.2~F4AagMvaNxP1IN8TZNM99D6HYkFoTpe.1_1 2024-09-14T11:38:45.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.627+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.101__multipart_file.mpg.2~F4AagMvaNxP1IN8TZNM99D6HYkFoTpe.2 2024-09-14T11:38:45.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.627+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.101__shadow_file.mpg.2~F4AagMvaNxP1IN8TZNM99D6HYkFoTpe.2_1 2024-09-14T11:38:45.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.627+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.101__multipart_file.mpg.2~F4AagMvaNxP1IN8TZNM99D6HYkFoTpe.3 2024-09-14T11:38:45.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.627+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.101__shadow_file.mpg.2~F4AagMvaNxP1IN8TZNM99D6HYkFoTpe.3_1 2024-09-14T11:38:45.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.627+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.101__multipart_file.mpg.2~F4AagMvaNxP1IN8TZNM99D6HYkFoTpe.4 2024-09-14T11:38:45.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.627+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.101__shadow_file.mpg.2~F4AagMvaNxP1IN8TZNM99D6HYkFoTpe.4_1 2024-09-14T11:38:45.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.627+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.101__multipart_file.mpg.2~F4AagMvaNxP1IN8TZNM99D6HYkFoTpe.5 2024-09-14T11:38:45.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.627+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='2~oVxyta1QxhLCPn_1Z43xIr3ifzwrgBH', time=2024-09-14T13:38:20.835637+0000, chain.objs.size()=9 2024-09-14T11:38:45.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.627+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.102__multipart_key1.2~oVxyta1QxhLCPn_1Z43xIr3ifzwrgBH.7 2024-09-14T11:38:45.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.627+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.102__shadow_key1.2~oVxyta1QxhLCPn_1Z43xIr3ifzwrgBH.7_1 2024-09-14T11:38:45.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.627+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.102__multipart_key1.2~oVxyta1QxhLCPn_1Z43xIr3ifzwrgBH.8 2024-09-14T11:38:45.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.631+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.102__shadow_key1.2~oVxyta1QxhLCPn_1Z43xIr3ifzwrgBH.8_1 2024-09-14T11:38:45.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.631+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.102__multipart_key1.2~oVxyta1QxhLCPn_1Z43xIr3ifzwrgBH.9 2024-09-14T11:38:45.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.631+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.102__shadow_key1.2~oVxyta1QxhLCPn_1Z43xIr3ifzwrgBH.9_1 2024-09-14T11:38:45.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.635+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.102__multipart_key1.2~oVxyta1QxhLCPn_1Z43xIr3ifzwrgBH.10 2024-09-14T11:38:45.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.635+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.102__shadow_key1.2~oVxyta1QxhLCPn_1Z43xIr3ifzwrgBH.10_1 2024-09-14T11:38:45.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.635+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.102__multipart_key1.2~oVxyta1QxhLCPn_1Z43xIr3ifzwrgBH.11 2024-09-14T11:38:45.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.635+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.6237325809559222760', time=2024-09-14T13:38:22.274338+0000, chain.objs.size()=9 2024-09-14T11:38:45.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.635+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__multipart_key1.2~-NOpGfFCLCnvJwXbYhYdL80kd1fOrvH.1 2024-09-14T11:38:45.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.635+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__shadow_key1.2~-NOpGfFCLCnvJwXbYhYdL80kd1fOrvH.1_1 2024-09-14T11:38:45.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.635+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__multipart_key1.2~-NOpGfFCLCnvJwXbYhYdL80kd1fOrvH.2 2024-09-14T11:38:45.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.635+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__shadow_key1.2~-NOpGfFCLCnvJwXbYhYdL80kd1fOrvH.2_1 2024-09-14T11:38:45.634 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.635+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__multipart_key1.2~-NOpGfFCLCnvJwXbYhYdL80kd1fOrvH.3 2024-09-14T11:38:45.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.639+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__shadow_key1.2~-NOpGfFCLCnvJwXbYhYdL80kd1fOrvH.3_1 2024-09-14T11:38:45.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.639+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__multipart_key1.2~-NOpGfFCLCnvJwXbYhYdL80kd1fOrvH.4 2024-09-14T11:38:45.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.639+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__shadow_key1.2~-NOpGfFCLCnvJwXbYhYdL80kd1fOrvH.4_1 2024-09-14T11:38:45.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.639+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__multipart_key1.2~-NOpGfFCLCnvJwXbYhYdL80kd1fOrvH.5 2024-09-14T11:38:45.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.639+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.8523173859742678594', time=2024-09-14T13:38:22.880624+0000, chain.objs.size()=9 2024-09-14T11:38:45.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.639+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__multipart_key1.2~fM2hMlwHQ3_DYu_BT6GiGdvDeIWh0oB.1 2024-09-14T11:38:45.638 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.639+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__shadow_key1.2~fM2hMlwHQ3_DYu_BT6GiGdvDeIWh0oB.1_1 2024-09-14T11:38:45.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.639+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__multipart_key1.2~fM2hMlwHQ3_DYu_BT6GiGdvDeIWh0oB.2 2024-09-14T11:38:45.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.639+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__shadow_key1.2~fM2hMlwHQ3_DYu_BT6GiGdvDeIWh0oB.2_1 2024-09-14T11:38:45.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.639+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__multipart_key1.2~fM2hMlwHQ3_DYu_BT6GiGdvDeIWh0oB.3 2024-09-14T11:38:45.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.643+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__shadow_key1.2~fM2hMlwHQ3_DYu_BT6GiGdvDeIWh0oB.3_1 2024-09-14T11:38:45.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.643+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__multipart_key1.2~fM2hMlwHQ3_DYu_BT6GiGdvDeIWh0oB.4 2024-09-14T11:38:45.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.643+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__shadow_key1.2~fM2hMlwHQ3_DYu_BT6GiGdvDeIWh0oB.4_1 2024-09-14T11:38:45.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.643+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__multipart_key1.2~fM2hMlwHQ3_DYu_BT6GiGdvDeIWh0oB.5 2024-09-14T11:38:45.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.647+0000 7f65348609c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:45.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.647+0000 7f65348609c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:38:45.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.651+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.651+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:45.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.651+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.655+0000 7f65348609c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:38:45.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.659+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.659+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:45.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.659+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.659+0000 7f65348609c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:38:45.660 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.663+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.663+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:45.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.663+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:38:45.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.663+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.5698338097000577932', time=2024-09-14T13:38:12.872445+0000, chain.objs.size()=9 2024-09-14T11:38:45.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.663+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__multipart_key1.2~9j5z8YZ_kGF7rxgloHn-WlTeAzU1iG_.1 2024-09-14T11:38:45.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.663+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__shadow_key1.2~9j5z8YZ_kGF7rxgloHn-WlTeAzU1iG_.1_1 2024-09-14T11:38:45.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.663+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__multipart_key1.2~9j5z8YZ_kGF7rxgloHn-WlTeAzU1iG_.2 2024-09-14T11:38:45.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.663+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__shadow_key1.2~9j5z8YZ_kGF7rxgloHn-WlTeAzU1iG_.2_1 2024-09-14T11:38:45.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.663+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__multipart_key1.2~9j5z8YZ_kGF7rxgloHn-WlTeAzU1iG_.3 2024-09-14T11:38:45.662 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.663+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__shadow_key1.2~9j5z8YZ_kGF7rxgloHn-WlTeAzU1iG_.3_1 2024-09-14T11:38:45.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.663+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__multipart_key1.2~9j5z8YZ_kGF7rxgloHn-WlTeAzU1iG_.4 2024-09-14T11:38:45.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.663+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__shadow_key1.2~9j5z8YZ_kGF7rxgloHn-WlTeAzU1iG_.4_1 2024-09-14T11:38:45.663 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.663+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__multipart_key1.2~9j5z8YZ_kGF7rxgloHn-WlTeAzU1iG_.5 2024-09-14T11:38:45.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.667+0000 7f65348609c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:45.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.671+0000 7f65348609c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:38:45.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.671+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.671+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:45.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.675+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:38:45.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.675+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.9409827157367724492', time=2024-09-14T13:38:15.884070+0000, chain.objs.size()=7 2024-09-14T11:38:45.672 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.675+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__multipart_key1.2~naFXFlr1nhvwc6BqwvKHhZNwu1iq-2D.1 2024-09-14T11:38:45.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.675+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__shadow_key1.2~naFXFlr1nhvwc6BqwvKHhZNwu1iq-2D.1_1 2024-09-14T11:38:45.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.675+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__shadow_key1.2~naFXFlr1nhvwc6BqwvKHhZNwu1iq-2D.1_2 2024-09-14T11:38:45.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.675+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__multipart_key1.2~naFXFlr1nhvwc6BqwvKHhZNwu1iq-2D.2 2024-09-14T11:38:45.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.675+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__shadow_key1.2~naFXFlr1nhvwc6BqwvKHhZNwu1iq-2D.2_1 2024-09-14T11:38:45.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.675+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__shadow_key1.2~naFXFlr1nhvwc6BqwvKHhZNwu1iq-2D.2_2 2024-09-14T11:38:45.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.675+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__multipart_key1.2~naFXFlr1nhvwc6BqwvKHhZNwu1iq-2D.3 2024-09-14T11:38:45.677 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.679+0000 7f65348609c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:45.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.683+0000 7f65348609c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:38:45.682 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.683+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.683+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:45.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.683+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:38:45.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.683+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.4760208090371242394', time=2024-09-14T13:38:10.512904+0000, chain.objs.size()=9 2024-09-14T11:38:45.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.683+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.92__multipart_key1.2~tqz8sPtg0FtGTcbWqFcRKD7dB7fpRJf.1 2024-09-14T11:38:45.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.683+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.92__shadow_key1.2~tqz8sPtg0FtGTcbWqFcRKD7dB7fpRJf.1_1 2024-09-14T11:38:45.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.683+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.92__multipart_key1.2~tqz8sPtg0FtGTcbWqFcRKD7dB7fpRJf.2 2024-09-14T11:38:45.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.683+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.92__shadow_key1.2~tqz8sPtg0FtGTcbWqFcRKD7dB7fpRJf.2_1 2024-09-14T11:38:45.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.683+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.92__multipart_key1.2~tqz8sPtg0FtGTcbWqFcRKD7dB7fpRJf.3 2024-09-14T11:38:45.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.683+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.92__shadow_key1.2~tqz8sPtg0FtGTcbWqFcRKD7dB7fpRJf.3_1 2024-09-14T11:38:45.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.683+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.92__multipart_key1.2~tqz8sPtg0FtGTcbWqFcRKD7dB7fpRJf.4 2024-09-14T11:38:45.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.683+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.92__shadow_key1.2~tqz8sPtg0FtGTcbWqFcRKD7dB7fpRJf.4_1 2024-09-14T11:38:45.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.683+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.92__multipart_key1.2~tqz8sPtg0FtGTcbWqFcRKD7dB7fpRJf.5 2024-09-14T11:38:45.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.683+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.9467950485501991480', time=2024-09-14T13:38:16.244982+0000, chain.objs.size()=7 2024-09-14T11:38:45.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.683+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__multipart_key1.2~mUe_n_sH9yKQvJI7v_jCUCYIc2R38r3.1 2024-09-14T11:38:45.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.683+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__shadow_key1.2~mUe_n_sH9yKQvJI7v_jCUCYIc2R38r3.1_1 2024-09-14T11:38:45.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.683+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__shadow_key1.2~mUe_n_sH9yKQvJI7v_jCUCYIc2R38r3.1_2 2024-09-14T11:38:45.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.687+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__multipart_key1.2~mUe_n_sH9yKQvJI7v_jCUCYIc2R38r3.2 2024-09-14T11:38:45.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.691+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__shadow_key1.2~mUe_n_sH9yKQvJI7v_jCUCYIc2R38r3.2_1 2024-09-14T11:38:45.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.691+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__shadow_key1.2~mUe_n_sH9yKQvJI7v_jCUCYIc2R38r3.2_2 2024-09-14T11:38:45.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.691+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__multipart_key1.2~mUe_n_sH9yKQvJI7v_jCUCYIc2R38r3.3 2024-09-14T11:38:45.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.691+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.2324276625892044354', time=2024-09-14T13:38:18.943635+0000, chain.objs.size()=9 2024-09-14T11:38:45.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.691+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.100__multipart_key1.2~CM1kPFJefEBycYkyJA_Wvto39bU_TVu.1 2024-09-14T11:38:45.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.691+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.100__shadow_key1.2~CM1kPFJefEBycYkyJA_Wvto39bU_TVu.1_1 2024-09-14T11:38:45.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.691+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.100__multipart_key1.2~CM1kPFJefEBycYkyJA_Wvto39bU_TVu.2 2024-09-14T11:38:45.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.691+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.100__shadow_key1.2~CM1kPFJefEBycYkyJA_Wvto39bU_TVu.2_1 2024-09-14T11:38:45.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.691+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.100__multipart_key1.2~CM1kPFJefEBycYkyJA_Wvto39bU_TVu.3 2024-09-14T11:38:45.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.691+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.100__shadow_key1.2~CM1kPFJefEBycYkyJA_Wvto39bU_TVu.3_1 2024-09-14T11:38:45.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.691+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.100__multipart_key1.2~CM1kPFJefEBycYkyJA_Wvto39bU_TVu.4 2024-09-14T11:38:45.691 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.691+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.100__shadow_key1.2~CM1kPFJefEBycYkyJA_Wvto39bU_TVu.4_1 2024-09-14T11:38:45.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.695+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.100__multipart_key1.2~CM1kPFJefEBycYkyJA_Wvto39bU_TVu.5 2024-09-14T11:38:45.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.695+0000 7f65348609c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:45.699 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.699+0000 7f65348609c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:38:45.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.703+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.703+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:45.701 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.703+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.703 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.703+0000 7f65348609c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:38:45.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.707+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.707+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:45.705 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.707+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.707+0000 7f65348609c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:38:45.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.711+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.709 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.711+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:45.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.711+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:38:45.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.711+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.8510294337445044768', time=2024-09-14T13:38:16.054673+0000, chain.objs.size()=5 2024-09-14T11:38:45.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.711+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.94__shadow_.ClCKvU7TbQHoro-orIWJuB3UphaXBqv_1 2024-09-14T11:38:45.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.711+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.94__shadow_.ClCKvU7TbQHoro-orIWJuB3UphaXBqv_2 2024-09-14T11:38:45.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.711+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.94__shadow_.ClCKvU7TbQHoro-orIWJuB3UphaXBqv_3 2024-09-14T11:38:45.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.711+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.94__shadow_.ClCKvU7TbQHoro-orIWJuB3UphaXBqv_4 2024-09-14T11:38:45.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.711+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.94__shadow_.ClCKvU7TbQHoro-orIWJuB3UphaXBqv_5 2024-09-14T11:38:45.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.711+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.16825490058328470085', time=2024-09-14T13:38:26.284389+0000, chain.objs.size()=9 2024-09-14T11:38:45.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.711+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.104__multipart_key1.2~UlO3jUKfi5KnkCyWLBWCFTsWz6XmrHN.1 2024-09-14T11:38:45.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.711+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.104__shadow_key1.2~UlO3jUKfi5KnkCyWLBWCFTsWz6XmrHN.1_1 2024-09-14T11:38:45.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.711+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.104__multipart_key1.2~UlO3jUKfi5KnkCyWLBWCFTsWz6XmrHN.2 2024-09-14T11:38:45.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.711+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.104__shadow_key1.2~UlO3jUKfi5KnkCyWLBWCFTsWz6XmrHN.2_1 2024-09-14T11:38:45.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.711+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.104__multipart_key1.2~UlO3jUKfi5KnkCyWLBWCFTsWz6XmrHN.3 2024-09-14T11:38:45.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.711+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.104__shadow_key1.2~UlO3jUKfi5KnkCyWLBWCFTsWz6XmrHN.3_1 2024-09-14T11:38:45.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.711+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.104__multipart_key1.2~UlO3jUKfi5KnkCyWLBWCFTsWz6XmrHN.4 2024-09-14T11:38:45.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.715+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.104__shadow_key1.2~UlO3jUKfi5KnkCyWLBWCFTsWz6XmrHN.4_1 2024-09-14T11:38:45.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.715+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.104__multipart_key1.2~UlO3jUKfi5KnkCyWLBWCFTsWz6XmrHN.5 2024-09-14T11:38:45.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.719+0000 7f65348609c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:45.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.723+0000 7f65348609c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:38:45.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.723+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.727+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:45.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.727+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.727+0000 7f65348609c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:38:45.728 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.731+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.729 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.731+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:45.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.731+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:38:45.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.731+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.14979343778198926239', time=2024-09-14T13:38:15.147699+0000, chain.objs.size()=7 2024-09-14T11:38:45.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.731+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__multipart_key1.2~KXWf2qiMu1ptfsGzfcCkpTn3ZgiExn5.1 2024-09-14T11:38:45.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.731+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__shadow_key1.2~KXWf2qiMu1ptfsGzfcCkpTn3ZgiExn5.1_1 2024-09-14T11:38:45.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.731+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__shadow_key1.2~KXWf2qiMu1ptfsGzfcCkpTn3ZgiExn5.1_2 2024-09-14T11:38:45.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.731+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__multipart_key1.2~KXWf2qiMu1ptfsGzfcCkpTn3ZgiExn5.2 2024-09-14T11:38:45.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.731+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__shadow_key1.2~KXWf2qiMu1ptfsGzfcCkpTn3ZgiExn5.2_1 2024-09-14T11:38:45.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.731+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__shadow_key1.2~KXWf2qiMu1ptfsGzfcCkpTn3ZgiExn5.2_2 2024-09-14T11:38:45.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.731+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.95__multipart_key1.2~KXWf2qiMu1ptfsGzfcCkpTn3ZgiExn5.3 2024-09-14T11:38:45.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.735+0000 7f65348609c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:45.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.739+0000 7f65348609c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:38:45.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.743+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.743+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:45.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.743+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:38:45.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.743+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.16398860716242900813', time=2024-09-14T13:38:23.911747+0000, chain.objs.size()=7 2024-09-14T11:38:45.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.743+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__multipart_key1.2~KMLiHRyuZzjU4ZRgWy1xbCTA_BrSdvo.1 2024-09-14T11:38:45.742 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.743+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__shadow_key1.2~KMLiHRyuZzjU4ZRgWy1xbCTA_BrSdvo.1_1 2024-09-14T11:38:45.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.743+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__shadow_key1.2~KMLiHRyuZzjU4ZRgWy1xbCTA_BrSdvo.1_2 2024-09-14T11:38:45.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.743+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__multipart_key1.2~KMLiHRyuZzjU4ZRgWy1xbCTA_BrSdvo.2 2024-09-14T11:38:45.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.743+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__shadow_key1.2~KMLiHRyuZzjU4ZRgWy1xbCTA_BrSdvo.2_1 2024-09-14T11:38:45.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.743+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__shadow_key1.2~KMLiHRyuZzjU4ZRgWy1xbCTA_BrSdvo.2_2 2024-09-14T11:38:45.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.743+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__multipart_key1.2~KMLiHRyuZzjU4ZRgWy1xbCTA_BrSdvo.3 2024-09-14T11:38:45.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.747+0000 7f65348609c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:45.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.751+0000 7f65348609c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:38:45.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.751+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.751+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:45.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.755+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:38:45.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.755+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.1623710328547143533', time=2024-09-14T13:38:07.115178+0000, chain.objs.size()=2 2024-09-14T11:38:45.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.755+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.84__shadow_.4jL3GwdtWPjwRzntpQ7sxpS7M3DUY-W_1 2024-09-14T11:38:45.752 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.755+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.84__shadow_.4jL3GwdtWPjwRzntpQ7sxpS7M3DUY-W_2 2024-09-14T11:38:45.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.755+0000 7f65348609c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:45.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.759+0000 7f65348609c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:38:45.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.759+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.763+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:45.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.763+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.762 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.763+0000 7f65348609c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:38:45.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.767+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.764 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.767+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:45.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.767+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:38:45.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.767+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.2384355066356346073', time=2024-09-14T13:38:19.726242+0000, chain.objs.size()=9 2024-09-14T11:38:45.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.767+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.101__multipart_file2.mpg.2~AAvUAEqCcvK3m8e9mKfJRPgteSVqCPl.1 2024-09-14T11:38:45.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.767+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.101__shadow_file2.mpg.2~AAvUAEqCcvK3m8e9mKfJRPgteSVqCPl.1_1 2024-09-14T11:38:45.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.767+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.101__multipart_file2.mpg.2~AAvUAEqCcvK3m8e9mKfJRPgteSVqCPl.2 2024-09-14T11:38:45.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.767+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.101__shadow_file2.mpg.2~AAvUAEqCcvK3m8e9mKfJRPgteSVqCPl.2_1 2024-09-14T11:38:45.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.767+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.101__multipart_file2.mpg.2~AAvUAEqCcvK3m8e9mKfJRPgteSVqCPl.3 2024-09-14T11:38:45.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.767+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.101__shadow_file2.mpg.2~AAvUAEqCcvK3m8e9mKfJRPgteSVqCPl.3_1 2024-09-14T11:38:45.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.767+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.101__multipart_file2.mpg.2~AAvUAEqCcvK3m8e9mKfJRPgteSVqCPl.4 2024-09-14T11:38:45.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.767+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.101__shadow_file2.mpg.2~AAvUAEqCcvK3m8e9mKfJRPgteSVqCPl.4_1 2024-09-14T11:38:45.766 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.767+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.101__multipart_file2.mpg.2~AAvUAEqCcvK3m8e9mKfJRPgteSVqCPl.5 2024-09-14T11:38:45.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.771+0000 7f65348609c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:45.773 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.775+0000 7f65348609c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:38:45.775 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.775+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.779+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:45.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.779+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.778 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.779+0000 7f65348609c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:38:45.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.783+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:45.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.783+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:45.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.783+0000 7f65348609c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:38:45.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.783+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.1233739489216677601', time=2024-09-14T13:38:24.635807+0000, chain.objs.size()=7 2024-09-14T11:38:45.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.783+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__multipart_key1.2~kZJPlweR-6rd6qIi1VMZmwgwTfaFV1G.1 2024-09-14T11:38:45.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.783+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__shadow_key1.2~kZJPlweR-6rd6qIi1VMZmwgwTfaFV1G.1_1 2024-09-14T11:38:45.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.783+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__shadow_key1.2~kZJPlweR-6rd6qIi1VMZmwgwTfaFV1G.1_2 2024-09-14T11:38:45.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.783+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__multipart_key1.2~kZJPlweR-6rd6qIi1VMZmwgwTfaFV1G.2 2024-09-14T11:38:45.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.783+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__shadow_key1.2~kZJPlweR-6rd6qIi1VMZmwgwTfaFV1G.2_1 2024-09-14T11:38:45.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.783+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__shadow_key1.2~kZJPlweR-6rd6qIi1VMZmwgwTfaFV1G.2_2 2024-09-14T11:38:45.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.783+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.103__multipart_key1.2~kZJPlweR-6rd6qIi1VMZmwgwTfaFV1G.3 2024-09-14T11:38:45.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.783+0000 7f65348609c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.9188277882952396054', time=2024-09-14T13:38:28.179977+0000, chain.objs.size()=9 2024-09-14T11:38:45.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.783+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.105__multipart_key1.2~nsmXPuetZ7YNAwf5mRfPPgsrFdmCvq1.1 2024-09-14T11:38:45.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.783+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.105__shadow_key1.2~nsmXPuetZ7YNAwf5mRfPPgsrFdmCvq1.1_1 2024-09-14T11:38:45.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.783+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.105__multipart_key1.2~nsmXPuetZ7YNAwf5mRfPPgsrFdmCvq1.2 2024-09-14T11:38:45.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.783+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.105__shadow_key1.2~nsmXPuetZ7YNAwf5mRfPPgsrFdmCvq1.2_1 2024-09-14T11:38:45.783 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.783+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.105__multipart_key1.2~nsmXPuetZ7YNAwf5mRfPPgsrFdmCvq1.3 2024-09-14T11:38:45.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.787+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.105__shadow_key1.2~nsmXPuetZ7YNAwf5mRfPPgsrFdmCvq1.3_1 2024-09-14T11:38:45.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.787+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.105__multipart_key1.2~nsmXPuetZ7YNAwf5mRfPPgsrFdmCvq1.4 2024-09-14T11:38:45.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.787+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.105__shadow_key1.2~nsmXPuetZ7YNAwf5mRfPPgsrFdmCvq1.4_1 2024-09-14T11:38:45.788 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.787+0000 7f65348609c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.105__multipart_key1.2~nsmXPuetZ7YNAwf5mRfPPgsrFdmCvq1.5 2024-09-14T11:38:45.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.791+0000 7f65348609c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:45.796 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.799+0000 7f63e8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:45.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.799+0000 7f65348609c0 20 remove_watcher() i=0 2024-09-14T11:38:45.799 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.799+0000 7f65348609c0 2 removed watcher, disabling cache 2024-09-14T11:38:45.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.803+0000 7f65348609c0 20 remove_watcher() i=1 2024-09-14T11:38:45.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.803+0000 7f65348609c0 20 remove_watcher() i=2 2024-09-14T11:38:45.804 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.807+0000 7f65348609c0 20 remove_watcher() i=3 2024-09-14T11:38:45.805 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.807+0000 7f65348609c0 20 remove_watcher() i=4 2024-09-14T11:38:45.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.807+0000 7f65348609c0 20 remove_watcher() i=5 2024-09-14T11:38:45.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.811+0000 7f65348609c0 20 remove_watcher() i=6 2024-09-14T11:38:45.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.811+0000 7f65348609c0 20 remove_watcher() i=7 2024-09-14T11:38:45.826 DEBUG:teuthology.orchestra.run.smithi071:> radosgw-admin gc process --include-all 2024-09-14T11:38:45.899 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:45.899 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:45.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.947+0000 7f1d8a27d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:45.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.947+0000 7f1d8a27d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:45.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.947+0000 7f1d8a27d9c0 20 realm 2024-09-14T11:38:45.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.947+0000 7f1d8a27d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:45.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.947+0000 7f1d8a27d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:45.947 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.947+0000 7f1d8a27d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:45.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.947+0000 7f1d8a27d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:45.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.947+0000 7f1d8a27d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:45.948 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.947+0000 7f1d8a27d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:45.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.951+0000 7f1d8a27d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:45.949 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.951+0000 7f1d8a27d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:45.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.951+0000 7f1d8a27d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:45.950 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.951+0000 7f1d8a27d9c0 20 searching for the correct realm 2024-09-14T11:38:45.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.955+0000 7f1d88584640 0 -- 172.21.15.71:0/2159067998 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f1d7c047040 msgr2=0x7f1d7c02b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:45.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.963+0000 7f1d88584640 0 -- 172.21.15.71:0/2159067998 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55981c5aeeb0 msgr2=0x55981c5b12c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:45.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.971+0000 7f1d8a27d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:45.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.971+0000 7f1d8a27d9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:38:45.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.971+0000 7f1d8a27d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:45.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.971+0000 7f1d8a27d9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:38:45.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.971+0000 7f1d8a27d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:45.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.971+0000 7f1d8a27d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:45.970 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.971+0000 7f1d8a27d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:45.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.971+0000 7f1d8a27d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:45.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.971+0000 7f1d8a27d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:45.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.971+0000 7f1d8a27d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:45.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.971+0000 7f1d8a27d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:45.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.971+0000 7f1d8a27d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:45.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.971+0000 7f1d8a27d9c0 20 zone default found 2024-09-14T11:38:45.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.971+0000 7f1d8a27d9c0 4 Realm: () 2024-09-14T11:38:45.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.971+0000 7f1d8a27d9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:38:45.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.971+0000 7f1d8a27d9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:38:45.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.971+0000 7f1d8a27d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:45.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.971+0000 7f1d8a27d9c0 20 zonegroup default 2024-09-14T11:38:45.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.971+0000 7f1d8a27d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:45.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.971+0000 7f1d8a27d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:45.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.971+0000 7f1d8a27d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:45.972 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.975+0000 7f1d8a27d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:45.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.975+0000 7f1d8a27d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:45.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.975+0000 7f1d8a27d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:45.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.975+0000 7f1d8a27d9c0 20 started sync module instance, tier type = 2024-09-14T11:38:45.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.975+0000 7f1d8a27d9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:38:45.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.991+0000 7f1d8a27d9c0 20 add_watcher() i=0 2024-09-14T11:38:45.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.991+0000 7f1d8a27d9c0 20 add_watcher() i=1 2024-09-14T11:38:45.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.991+0000 7f1d8a27d9c0 20 add_watcher() i=2 2024-09-14T11:38:45.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.991+0000 7f1d8a27d9c0 20 add_watcher() i=3 2024-09-14T11:38:45.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.991+0000 7f1d8a27d9c0 20 add_watcher() i=4 2024-09-14T11:38:45.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.991+0000 7f1d8a27d9c0 20 add_watcher() i=5 2024-09-14T11:38:45.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.991+0000 7f1d8a27d9c0 20 add_watcher() i=6 2024-09-14T11:38:45.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.995+0000 7f1d8a27d9c0 20 add_watcher() i=7 2024-09-14T11:38:45.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.995+0000 7f1d8a27d9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:45.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.999+0000 7f1c3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:45.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.999+0000 7f1d8a27d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:45.997 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:45.999+0000 7f1d8a27d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:46.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.075+0000 7f1c3cfe1640 20 reqs_thread_entry: start 2024-09-14T11:38:46.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.075+0000 7f1d8a27d9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:46.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.075+0000 7f1d8a27d9c0 20 Filter name: none 2024-09-14T11:38:46.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.075+0000 7f1bb67fc640 20 reqs_thread_entry: start 2024-09-14T11:38:46.074 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.075+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:38:46.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.079+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.079+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:46.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.079+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.082 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.083+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:38:46.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.087+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.087+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:46.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.087+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.091+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:38:46.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.095+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.095+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:46.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.095+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.095 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.095+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:38:46.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.099+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.099+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:46.098 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.099+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.103+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:38:46.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.103+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.107+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:46.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.107+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.107+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:38:46.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.111+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.111+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:46.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.111+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.115+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:38:46.116 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.119+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.118 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.119+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:46.119 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.119+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.123+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:38:46.124 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.127+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.125 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.127+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:46.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.127+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.131+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:38:46.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.131+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.131+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:46.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.131+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.135+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:38:46.136 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.139+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.139+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:46.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.139+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.141 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.143+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:38:46.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.147+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.147+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:46.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.147+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.151+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:38:46.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.155+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.155 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.155+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:46.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.159+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.159+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:38:46.163 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.163+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.167+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:46.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.167+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.171+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:38:46.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.175+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.175+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:46.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.175+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.179+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:38:46.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.183+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.183+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:46.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.183+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.187+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:38:46.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.191+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.191+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:46.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.191+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.195+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:38:46.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.199+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.199+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:46.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.199+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.203+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:38:46.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.207+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.207+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:46.207 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.207+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.211+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:38:46.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.215+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.216 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.215+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:46.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.219+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.219+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:38:46.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.223+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.227+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:46.225 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.227+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.227+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:38:46.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.231+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.235+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:46.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.235+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.239+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:38:46.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.243+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.243+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:46.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.243+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.247 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.247+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:38:46.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.251+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.255+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:46.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.255+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.255+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:38:46.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.259+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.263+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:46.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.263+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.267+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:38:46.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.271+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.271+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:46.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.271+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.275+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:38:46.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.279+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.279+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:46.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.283+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.283+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:38:46.286 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.287+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.291+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:46.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.291+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.291+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:38:46.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.295+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.299+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:46.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.299+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.299+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:38:46.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.303+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.307+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:46.305 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.307+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.311+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:38:46.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.311+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.315+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:46.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.315+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.318 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.319+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:38:46.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.323+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.323+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:46.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.323+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.327+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:38:46.330 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.331+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.331+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:46.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.331+0000 7f1d8a27d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:46.336 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.339+0000 7f1c3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:46.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.343+0000 7f1d8a27d9c0 20 remove_watcher() i=0 2024-09-14T11:38:46.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.343+0000 7f1d8a27d9c0 2 removed watcher, disabling cache 2024-09-14T11:38:46.343 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.343+0000 7f1d8a27d9c0 20 remove_watcher() i=1 2024-09-14T11:38:46.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.347+0000 7f1d8a27d9c0 20 remove_watcher() i=2 2024-09-14T11:38:46.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.351+0000 7f1d8a27d9c0 20 remove_watcher() i=3 2024-09-14T11:38:46.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.351+0000 7f1d8a27d9c0 20 remove_watcher() i=4 2024-09-14T11:38:46.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.355+0000 7f1d8a27d9c0 20 remove_watcher() i=5 2024-09-14T11:38:46.357 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.359+0000 7f1d8a27d9c0 20 remove_watcher() i=6 2024-09-14T11:38:46.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:46.359+0000 7f1d8a27d9c0 20 remove_watcher() i=7 2024-09-14T11:38:46.380 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-14T11:38:46.396 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-14T11:38:46.397 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-14T11:38:46.397 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-14T11:38:46.397 DEBUG:teuthology.orchestra.run.smithi071:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T11:38:46.429 INFO:teuthology.orchestra.run.smithi071.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-14T11:38:47.281 INFO:tasks.s3tests:Creating rgw users... 2024-09-14T11:38:47.282 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW11111111111111111 --account-name Mr.RGW11111111111111111 --email RGW11111111111111111+test@test.test 2024-09-14T11:38:47.364 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:47.364 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:47.408 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.411+0000 7f682ae119c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.411+0000 7f682ae119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:47.410 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.411+0000 7f682ae119c0 20 realm 2024-09-14T11:38:47.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.411+0000 7f682ae119c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.411+0000 7f682ae119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:47.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.411+0000 7f682ae119c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:47.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.411+0000 7f682ae119c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.411+0000 7f682ae119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:47.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.411+0000 7f682ae119c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.415+0000 7f682ae119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:47.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.415+0000 7f682ae119c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.415+0000 7f682ae119c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:47.414 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.415+0000 7f682ae119c0 20 searching for the correct realm 2024-09-14T11:38:47.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.419+0000 7f6829118640 0 -- 172.21.15.71:0/2047338586 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f68180ea040 msgr2=0x7f68180d0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:47.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.631+0000 7f6829118640 0 -- 172.21.15.71:0/2047338586 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x5630bdc05a90 msgr2=0x5630bdc07e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:47.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.647+0000 7f682ae119c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:47.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.647+0000 7f682ae119c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:38:47.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.647+0000 7f682ae119c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:47.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.647+0000 7f682ae119c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:38:47.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.647+0000 7f682ae119c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:47.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.647+0000 7f682ae119c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:47.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.647+0000 7f682ae119c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.647+0000 7f682ae119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:47.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.647+0000 7f682ae119c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.647+0000 7f682ae119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:47.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.647+0000 7f682ae119c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.651+0000 7f682ae119c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:47.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.651+0000 7f682ae119c0 20 zone default found 2024-09-14T11:38:47.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.651+0000 7f682ae119c0 4 Realm: () 2024-09-14T11:38:47.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.651+0000 7f682ae119c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:38:47.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.651+0000 7f682ae119c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:38:47.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.651+0000 7f682ae119c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:47.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.651+0000 7f682ae119c0 20 zonegroup default 2024-09-14T11:38:47.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.651+0000 7f682ae119c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.651+0000 7f682ae119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:47.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.651+0000 7f682ae119c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.651+0000 7f682ae119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:47.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.651+0000 7f682ae119c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.651+0000 7f682ae119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:47.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.651+0000 7f682ae119c0 20 started sync module instance, tier type = 2024-09-14T11:38:47.651 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.651+0000 7f682ae119c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:38:47.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.675+0000 7f682ae119c0 20 add_watcher() i=0 2024-09-14T11:38:47.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.675+0000 7f682ae119c0 20 add_watcher() i=1 2024-09-14T11:38:47.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.675+0000 7f682ae119c0 20 add_watcher() i=2 2024-09-14T11:38:47.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.675+0000 7f682ae119c0 20 add_watcher() i=3 2024-09-14T11:38:47.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.675+0000 7f682ae119c0 20 add_watcher() i=4 2024-09-14T11:38:47.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.675+0000 7f682ae119c0 20 add_watcher() i=5 2024-09-14T11:38:47.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.675+0000 7f682ae119c0 20 add_watcher() i=6 2024-09-14T11:38:47.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.679+0000 7f682ae119c0 20 add_watcher() i=7 2024-09-14T11:38:47.678 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.679+0000 7f682ae119c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:47.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.683+0000 7f66ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:47.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.683+0000 7f682ae119c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:47.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.683+0000 7f682ae119c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:47.683 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.683+0000 7f682ae119c0 5 note: GC not initialized 2024-09-14T11:38:47.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.683+0000 7f66dcfe1640 20 reqs_thread_entry: start 2024-09-14T11:38:47.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.687+0000 7f682ae119c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:47.684 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.687+0000 7f682ae119c0 20 Filter name: none 2024-09-14T11:38:47.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.687+0000 7f66567fc640 20 reqs_thread_entry: start 2024-09-14T11:38:47.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.687+0000 7f682ae119c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 : miss 2024-09-14T11:38:47.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.687+0000 7f682ae119c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.687+0000 7f682ae119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:47.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.687+0000 7f682ae119c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x0 2024-09-14T11:38:47.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.687+0000 7f682ae119c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-14T11:38:47.685 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.687+0000 7f682ae119c0 20 failed to read name.$Mr.RGW11111111111111111 with: (2) No such file or directory 2024-09-14T11:38:47.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.687+0000 7f682ae119c0 10 cache get: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test : miss 2024-09-14T11:38:47.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.687+0000 7f682ae119c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.687+0000 7f682ae119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:47.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.687+0000 7f682ae119c0 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x0 2024-09-14T11:38:47.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.687+0000 7f682ae119c0 10 adding default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-14T11:38:47.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.687+0000 7f682ae119c0 20 failed to read rgw11111111111111111+test@test.test with: (2) No such file or directory 2024-09-14T11:38:47.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.691+0000 7f682ae119c0 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-14T11:38:47.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.691+0000 7f682ae119c0 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-14T11:38:47.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.691+0000 7f682ae119c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW11111111111111111, ofs0, ns] 2024-09-14T11:38:47.689 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.691+0000 7f6706ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464563 cookie 94767341951312 notifier 8913 bl.length()=384 2024-09-14T11:38:47.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.691+0000 7f6706ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-14T11:38:47.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.691+0000 7f6706ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-14T11:38:47.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.695+0000 7f682ae119c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-14T11:38:47.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.695+0000 7f682ae119c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-14T11:38:47.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.695+0000 7f682ae119c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW11111111111111111, ofs0, ns] 2024-09-14T11:38:47.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.695+0000 7f6706ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464564 cookie 94767341962496 notifier 8913 bl.length()=225 2024-09-14T11:38:47.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.695+0000 7f6706ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-14T11:38:47.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.695+0000 7f6706ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-14T11:38:47.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.699+0000 7f682ae119c0 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-14T11:38:47.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.699+0000 7f682ae119c0 10 moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-14T11:38:47.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.699+0000 7f682ae119c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw11111111111111111+test@test.test, ofs0, ns] 2024-09-14T11:38:47.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.699+0000 7f67067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464342 cookie 94767341958944 notifier 8913 bl.length()=234 2024-09-14T11:38:47.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.699+0000 7f67067fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-14T11:38:47.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.699+0000 7f67067fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-14T11:38:47.700 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.699+0000 7f66ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:47.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.707+0000 7f682ae119c0 20 remove_watcher() i=0 2024-09-14T11:38:47.704 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.707+0000 7f682ae119c0 2 removed watcher, disabling cache 2024-09-14T11:38:47.706 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.707+0000 7f682ae119c0 20 remove_watcher() i=1 2024-09-14T11:38:47.708 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.711+0000 7f682ae119c0 20 remove_watcher() i=2 2024-09-14T11:38:47.710 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.711+0000 7f682ae119c0 20 remove_watcher() i=3 2024-09-14T11:38:47.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.715+0000 7f682ae119c0 20 remove_watcher() i=4 2024-09-14T11:38:47.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.715+0000 7f682ae119c0 20 remove_watcher() i=5 2024-09-14T11:38:47.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.719+0000 7f682ae119c0 20 remove_watcher() i=6 2024-09-14T11:38:47.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.719+0000 7f682ae119c0 20 remove_watcher() i=7 2024-09-14T11:38:47.734 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T11:38:47.734 INFO:teuthology.orchestra.run.smithi071.stdout: "id": "RGW11111111111111111", 2024-09-14T11:38:47.734 INFO:teuthology.orchestra.run.smithi071.stdout: "tenant": "", 2024-09-14T11:38:47.734 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "Mr.RGW11111111111111111", 2024-09-14T11:38:47.734 INFO:teuthology.orchestra.run.smithi071.stdout: "email": "RGW11111111111111111+test@test.test", 2024-09-14T11:38:47.734 INFO:teuthology.orchestra.run.smithi071.stdout: "quota": { 2024-09-14T11:38:47.734 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": false, 2024-09-14T11:38:47.734 INFO:teuthology.orchestra.run.smithi071.stdout: "check_on_raw": false, 2024-09-14T11:38:47.734 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size": -1, 2024-09-14T11:38:47.735 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size_kb": 0, 2024-09-14T11:38:47.735 INFO:teuthology.orchestra.run.smithi071.stdout: "max_objects": -1 2024-09-14T11:38:47.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T11:38:47.735 INFO:teuthology.orchestra.run.smithi071.stdout: "bucket_quota": { 2024-09-14T11:38:47.735 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": false, 2024-09-14T11:38:47.735 INFO:teuthology.orchestra.run.smithi071.stdout: "check_on_raw": false, 2024-09-14T11:38:47.735 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size": -1, 2024-09-14T11:38:47.735 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size_kb": 0, 2024-09-14T11:38:47.735 INFO:teuthology.orchestra.run.smithi071.stdout: "max_objects": -1 2024-09-14T11:38:47.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T11:38:47.735 INFO:teuthology.orchestra.run.smithi071.stdout: "max_users": 1000, 2024-09-14T11:38:47.735 INFO:teuthology.orchestra.run.smithi071.stdout: "max_roles": 1000, 2024-09-14T11:38:47.735 INFO:teuthology.orchestra.run.smithi071.stdout: "max_groups": 1000, 2024-09-14T11:38:47.735 INFO:teuthology.orchestra.run.smithi071.stdout: "max_buckets": 1000, 2024-09-14T11:38:47.735 INFO:teuthology.orchestra.run.smithi071.stdout: "max_access_keys": 4 2024-09-14T11:38:47.735 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T11:38:47.737 DEBUG:tasks.s3tests:Creating user RGW11111111111111111 on client.0 2024-09-14T11:38:47.738 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.RGW11111111111111111 --email foo+test@test.test --access-key FLOOAJWHGHKLUPQWKTZB --secret V0o8ivuZ7defjHJ52n5F1+MjbCbT5MCWDbDIQF9jb5bTJ9sffR9+wQ== --cluster ceph --account-id RGW11111111111111111 --account-root 2024-09-14T11:38:47.828 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:47.828 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:47.868 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.871+0000 7f5ef4a3f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.871+0000 7f5ef4a3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:47.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.871+0000 7f5ef4a3f9c0 20 realm 2024-09-14T11:38:47.871 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.871+0000 7f5ef4a3f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.871+0000 7f5ef4a3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:47.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.871+0000 7f5ef4a3f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:47.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.871+0000 7f5ef4a3f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.872 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.875+0000 7f5ef4a3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:47.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.875+0000 7f5ef4a3f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.875+0000 7f5ef4a3f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:47.873 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.875+0000 7f5ef4a3f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.875+0000 7f5ef4a3f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:47.874 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.875+0000 7f5ef4a3f9c0 20 searching for the correct realm 2024-09-14T11:38:47.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:47.879+0000 7f5ef2d46640 0 -- 172.21.15.71:0/1352184111 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f5ee8008040 msgr2=0x7f5ee80710b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:48.092 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.095+0000 7f5ef2d46640 0 -- 172.21.15.71:0/1352184111 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55f46a53ba40 msgr2=0x55f46a53de30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:48.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.107+0000 7f5ef4a3f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:48.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.111+0000 7f5ef4a3f9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:38:48.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.111+0000 7f5ef4a3f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:48.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.111+0000 7f5ef4a3f9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:38:48.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.111+0000 7f5ef4a3f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:48.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.111+0000 7f5ef4a3f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:48.108 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.111+0000 7f5ef4a3f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:48.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.111+0000 7f5ef4a3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:48.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.111+0000 7f5ef4a3f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:48.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.111+0000 7f5ef4a3f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:48.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.111+0000 7f5ef4a3f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:48.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.111+0000 7f5ef4a3f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:48.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.111+0000 7f5ef4a3f9c0 20 zone default found 2024-09-14T11:38:48.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.111+0000 7f5ef4a3f9c0 4 Realm: () 2024-09-14T11:38:48.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.111+0000 7f5ef4a3f9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:38:48.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.111+0000 7f5ef4a3f9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:38:48.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.111+0000 7f5ef4a3f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:48.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.111+0000 7f5ef4a3f9c0 20 zonegroup default 2024-09-14T11:38:48.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.111+0000 7f5ef4a3f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:48.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.115+0000 7f5ef4a3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:48.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.115+0000 7f5ef4a3f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:48.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.115+0000 7f5ef4a3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:48.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.115+0000 7f5ef4a3f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:48.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.115+0000 7f5ef4a3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:48.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.115+0000 7f5ef4a3f9c0 20 started sync module instance, tier type = 2024-09-14T11:38:48.114 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.115+0000 7f5ef4a3f9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:38:48.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.139+0000 7f5ef4a3f9c0 20 add_watcher() i=0 2024-09-14T11:38:48.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.139+0000 7f5ef4a3f9c0 20 add_watcher() i=1 2024-09-14T11:38:48.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.139+0000 7f5ef4a3f9c0 20 add_watcher() i=2 2024-09-14T11:38:48.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.139+0000 7f5ef4a3f9c0 20 add_watcher() i=3 2024-09-14T11:38:48.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.139+0000 7f5ef4a3f9c0 20 add_watcher() i=4 2024-09-14T11:38:48.137 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.139+0000 7f5ef4a3f9c0 20 add_watcher() i=5 2024-09-14T11:38:48.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.139+0000 7f5ef4a3f9c0 20 add_watcher() i=6 2024-09-14T11:38:48.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.139+0000 7f5ef4a3f9c0 20 add_watcher() i=7 2024-09-14T11:38:48.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.139+0000 7f5ef4a3f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:48.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.143+0000 7f5da8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:48.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.143+0000 7f5ef4a3f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:48.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.143+0000 7f5ef4a3f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:48.144 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.147+0000 7f5ef4a3f9c0 5 note: GC not initialized 2024-09-14T11:38:48.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.147+0000 7f5d237fe640 20 reqs_thread_entry: start 2024-09-14T11:38:48.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.147+0000 7f5ef4a3f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:48.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.147+0000 7f5ef4a3f9c0 20 Filter name: none 2024-09-14T11:38:48.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.147+0000 7f5d217fa640 20 reqs_thread_entry: start 2024-09-14T11:38:48.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.147+0000 7f5ef4a3f9c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-14T11:38:48.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.147+0000 7f5ef4a3f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:48.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.147+0000 7f5ef4a3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:48.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.147+0000 7f5ef4a3f9c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-14T11:38:48.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.147+0000 7f5ef4a3f9c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:38:48.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.147+0000 7f5ef4a3f9c0 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-14T11:38:48.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.147+0000 7f5ef4a3f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:48.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.147+0000 7f5ef4a3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:48.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.147+0000 7f5ef4a3f9c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-14T11:38:48.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.147+0000 7f5ef4a3f9c0 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T11:38:48.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.147+0000 7f5ef4a3f9c0 10 cache get: name=default.rgw.meta+users.keys+FLOOAJWHGHKLUPQWKTZB : miss 2024-09-14T11:38:48.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.147+0000 7f5ef4a3f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:48.147 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.147+0000 7f5ef4a3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:48.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.147+0000 7f5ef4a3f9c0 10 cache put: name=default.rgw.meta+users.keys+FLOOAJWHGHKLUPQWKTZB info.flags=0x0 2024-09-14T11:38:48.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.147+0000 7f5ef4a3f9c0 10 adding default.rgw.meta+users.keys+FLOOAJWHGHKLUPQWKTZB to cache LRU end 2024-09-14T11:38:48.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.147+0000 7f5ef4a3f9c0 10 cache get: name=default.rgw.meta+accounts+account.RGW11111111111111111 : miss 2024-09-14T11:38:48.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.147+0000 7f5ef4a3f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:48.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.151+0000 7f5ef4a3f9c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-14T11:38:48.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.151+0000 7f5ef4a3f9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-14T11:38:48.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.151+0000 7f5ef4a3f9c0 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-14T11:38:48.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.151+0000 7f5ef4a3f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:48.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.151+0000 7f5ef4a3f9c0 10 cache get: name=default.rgw.meta+users.keys+FLOOAJWHGHKLUPQWKTZB : hit (negative entry) 2024-09-14T11:38:48.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.151+0000 7f5ef4a3f9c0 10 cache get: name=default.rgw.meta+users.keys+FLOOAJWHGHKLUPQWKTZB : hit (negative entry) 2024-09-14T11:38:48.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.155+0000 7f5ef4a3f9c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:38:48.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.155+0000 7f5ef4a3f9c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:38:48.152 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.155+0000 7f5ef4a3f9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-14T11:38:48.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.155+0000 7f5dd5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464329 cookie 94508244261280 notifier 8931 bl.length()=673 2024-09-14T11:38:48.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.155+0000 7f5dd5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:38:48.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.155+0000 7f5dd5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:38:48.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.159+0000 7f5ef4a3f9c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-14T11:38:48.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.159+0000 7f5ef4a3f9c0 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T11:38:48.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.159+0000 7f5ef4a3f9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-14T11:38:48.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.159+0000 7f5dd5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464565 cookie 94508244290992 notifier 8931 bl.length()=185 2024-09-14T11:38:48.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.159+0000 7f5dd5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-14T11:38:48.158 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.159+0000 7f5dd5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T11:38:48.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.163+0000 7f5ef4a3f9c0 10 cache put: name=default.rgw.meta+users.keys+FLOOAJWHGHKLUPQWKTZB info.flags=0x7 2024-09-14T11:38:48.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.163+0000 7f5ef4a3f9c0 10 moving default.rgw.meta+users.keys+FLOOAJWHGHKLUPQWKTZB to cache LRU end 2024-09-14T11:38:48.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.163+0000 7f5ef4a3f9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:FLOOAJWHGHKLUPQWKTZB, ofs0, ns] 2024-09-14T11:38:48.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.163+0000 7f5dd5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464365 cookie 94508244293488 notifier 8931 bl.length()=186 2024-09-14T11:38:48.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.163+0000 7f5dd5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+FLOOAJWHGHKLUPQWKTZB info.flags=0x7 2024-09-14T11:38:48.161 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.163+0000 7f5dd5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+FLOOAJWHGHKLUPQWKTZB to cache LRU end 2024-09-14T11:38:48.164 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.167+0000 7f5ef4a3f9c0 20 linked user foo.client.0 to account RGW11111111111111111 2024-09-14T11:38:48.165 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T11:38:48.165 INFO:teuthology.orchestra.run.smithi071.stdout: "user_id": "foo.client.0", 2024-09-14T11:38:48.165 INFO:teuthology.orchestra.run.smithi071.stdout: "display_name": "Mr.RGW11111111111111111", 2024-09-14T11:38:48.165 INFO:teuthology.orchestra.run.smithi071.stdout: "email": "foo+test@test.test", 2024-09-14T11:38:48.165 INFO:teuthology.orchestra.run.smithi071.stdout: "suspended": 0, 2024-09-14T11:38:48.165 INFO:teuthology.orchestra.run.smithi071.stdout: "max_buckets": 1000, 2024-09-14T11:38:48.165 INFO:teuthology.orchestra.run.smithi071.stdout: "subusers": [], 2024-09-14T11:38:48.165 INFO:teuthology.orchestra.run.smithi071.stdout: "keys": [ 2024-09-14T11:38:48.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T11:38:48.165 INFO:teuthology.orchestra.run.smithi071.stdout: "user": "foo.client.0", 2024-09-14T11:38:48.165 INFO:teuthology.orchestra.run.smithi071.stdout: "access_key": "FLOOAJWHGHKLUPQWKTZB", 2024-09-14T11:38:48.166 INFO:teuthology.orchestra.run.smithi071.stdout: "secret_key": "V0o8ivuZ7defjHJ52n5F1+MjbCbT5MCWDbDIQF9jb5bTJ9sffR9+wQ==", 2024-09-14T11:38:48.166 INFO:teuthology.orchestra.run.smithi071.stdout: "active": true, 2024-09-14T11:38:48.166 INFO:teuthology.orchestra.run.smithi071.stdout: "create_date": "2024-09-14T11:38:48.155006Z" 2024-09-14T11:38:48.166 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T11:38:48.166 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-14T11:38:48.166 INFO:teuthology.orchestra.run.smithi071.stdout: "swift_keys": [], 2024-09-14T11:38:48.166 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": [], 2024-09-14T11:38:48.166 INFO:teuthology.orchestra.run.smithi071.stdout: "op_mask": "read, write, delete", 2024-09-14T11:38:48.166 INFO:teuthology.orchestra.run.smithi071.stdout: "default_placement": "", 2024-09-14T11:38:48.166 INFO:teuthology.orchestra.run.smithi071.stdout: "default_storage_class": "", 2024-09-14T11:38:48.166 INFO:teuthology.orchestra.run.smithi071.stdout: "placement_tags": [], 2024-09-14T11:38:48.166 INFO:teuthology.orchestra.run.smithi071.stdout: "bucket_quota": { 2024-09-14T11:38:48.166 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": false, 2024-09-14T11:38:48.166 INFO:teuthology.orchestra.run.smithi071.stdout: "check_on_raw": false, 2024-09-14T11:38:48.167 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size": -1, 2024-09-14T11:38:48.167 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size_kb": 0, 2024-09-14T11:38:48.167 INFO:teuthology.orchestra.run.smithi071.stdout: "max_objects": -1 2024-09-14T11:38:48.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T11:38:48.167 INFO:teuthology.orchestra.run.smithi071.stdout: "user_quota": { 2024-09-14T11:38:48.167 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": false, 2024-09-14T11:38:48.167 INFO:teuthology.orchestra.run.smithi071.stdout: "check_on_raw": false, 2024-09-14T11:38:48.167 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size": -1, 2024-09-14T11:38:48.167 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size_kb": 0, 2024-09-14T11:38:48.167 INFO:teuthology.orchestra.run.smithi071.stdout: "max_objects": -1 2024-09-14T11:38:48.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T11:38:48.167 INFO:teuthology.orchestra.run.smithi071.stdout: "temp_url_keys": [], 2024-09-14T11:38:48.167 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "root", 2024-09-14T11:38:48.167 INFO:teuthology.orchestra.run.smithi071.stdout: "mfa_ids": [], 2024-09-14T11:38:48.167 INFO:teuthology.orchestra.run.smithi071.stdout: "account_id": "RGW11111111111111111", 2024-09-14T11:38:48.168 INFO:teuthology.orchestra.run.smithi071.stdout: "path": "/", 2024-09-14T11:38:48.168 INFO:teuthology.orchestra.run.smithi071.stdout: "create_date": "2024-09-14T11:38:48.154975Z", 2024-09-14T11:38:48.168 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-09-14T11:38:48.168 INFO:teuthology.orchestra.run.smithi071.stdout: "group_ids": [] 2024-09-14T11:38:48.168 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T11:38:48.168 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:48.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.167+0000 7f5da8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:48.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.171+0000 7f5ef4a3f9c0 20 remove_watcher() i=0 2024-09-14T11:38:48.171 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.171+0000 7f5ef4a3f9c0 2 removed watcher, disabling cache 2024-09-14T11:38:48.173 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.175+0000 7f5ef4a3f9c0 20 remove_watcher() i=1 2024-09-14T11:38:48.175 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.175+0000 7f5ef4a3f9c0 20 remove_watcher() i=2 2024-09-14T11:38:48.177 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.179+0000 7f5ef4a3f9c0 20 remove_watcher() i=3 2024-09-14T11:38:48.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.179+0000 7f5ef4a3f9c0 20 remove_watcher() i=4 2024-09-14T11:38:48.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.183+0000 7f5ef4a3f9c0 20 remove_watcher() i=5 2024-09-14T11:38:48.184 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.183+0000 7f5ef4a3f9c0 20 remove_watcher() i=6 2024-09-14T11:38:48.186 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.187+0000 7f5ef4a3f9c0 20 remove_watcher() i=7 2024-09-14T11:38:48.201 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 5860107394 --totp-seed PUUNUB57DZQESQ7EHH4JBJEVI7UYYFXVCUSYZRO3JCMEZCQCRFF6M6IPG25OH4AE --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:38:48.243 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:48.243 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:48.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.287+0000 7fa13b67c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:48.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.291+0000 7fa13b67c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:48.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.291+0000 7fa13b67c9c0 20 realm 2024-09-14T11:38:48.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.291+0000 7fa13b67c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:48.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.291+0000 7fa13b67c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:48.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.291+0000 7fa13b67c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:48.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.291+0000 7fa13b67c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:48.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.291+0000 7fa13b67c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:48.290 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.291+0000 7fa13b67c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:48.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.291+0000 7fa13b67c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:48.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.291+0000 7fa13b67c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:48.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.291+0000 7fa13b67c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:48.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.291+0000 7fa13b67c9c0 20 searching for the correct realm 2024-09-14T11:38:48.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.295+0000 7fa139983640 0 -- 172.21.15.71:0/1853915349 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fa12c01a040 msgr2=0x7fa12c027a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:48.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.511+0000 7fa139983640 0 -- 172.21.15.71:0/1853915349 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x555ac6c11150 msgr2=0x555ac6c13560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:48.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.523+0000 7fa13b67c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:48.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.523+0000 7fa13b67c9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:38:48.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.523+0000 7fa13b67c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:48.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.523+0000 7fa13b67c9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:38:48.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.523+0000 7fa13b67c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:48.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.523+0000 7fa13b67c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:48.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.523+0000 7fa13b67c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:48.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.527+0000 7fa13b67c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:48.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.527+0000 7fa13b67c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:48.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.527+0000 7fa13b67c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:48.525 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.527+0000 7fa13b67c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:48.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.527+0000 7fa13b67c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:48.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.527+0000 7fa13b67c9c0 20 zone default found 2024-09-14T11:38:48.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.527+0000 7fa13b67c9c0 4 Realm: () 2024-09-14T11:38:48.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.527+0000 7fa13b67c9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:38:48.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.527+0000 7fa13b67c9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:38:48.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.527+0000 7fa13b67c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:48.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.527+0000 7fa13b67c9c0 20 zonegroup default 2024-09-14T11:38:48.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.527+0000 7fa13b67c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:48.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.527+0000 7fa13b67c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:48.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.527+0000 7fa13b67c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:48.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.527+0000 7fa13b67c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:48.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.527+0000 7fa13b67c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:48.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.531+0000 7fa13b67c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:48.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.531+0000 7fa13b67c9c0 20 started sync module instance, tier type = 2024-09-14T11:38:48.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.531+0000 7fa13b67c9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:38:48.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.555+0000 7fa13b67c9c0 20 add_watcher() i=0 2024-09-14T11:38:48.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.555+0000 7fa13b67c9c0 20 add_watcher() i=1 2024-09-14T11:38:48.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.555+0000 7fa13b67c9c0 20 add_watcher() i=2 2024-09-14T11:38:48.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.555+0000 7fa13b67c9c0 20 add_watcher() i=3 2024-09-14T11:38:48.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.555+0000 7fa13b67c9c0 20 add_watcher() i=4 2024-09-14T11:38:48.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.555+0000 7fa13b67c9c0 20 add_watcher() i=5 2024-09-14T11:38:48.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.555+0000 7fa13b67c9c0 20 add_watcher() i=6 2024-09-14T11:38:48.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.555+0000 7fa13b67c9c0 20 add_watcher() i=7 2024-09-14T11:38:48.555 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.555+0000 7fa13b67c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:48.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.559+0000 7f9fef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:48.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.559+0000 7fa13b67c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:48.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.559+0000 7fa13b67c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:48.560 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.559+0000 7fa13b67c9c0 5 note: GC not initialized 2024-09-14T11:38:48.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.563+0000 7f9fee7e4640 20 reqs_thread_entry: start 2024-09-14T11:38:48.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.563+0000 7fa13b67c9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:48.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.563+0000 7fa13b67c9c0 20 Filter name: none 2024-09-14T11:38:48.561 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.563+0000 7f9f5ffff640 20 reqs_thread_entry: start 2024-09-14T11:38:48.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.563+0000 7fa13b67c9c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-14T11:38:48.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.563+0000 7fa13b67c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:48.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.563+0000 7fa13b67c9c0 20 rados_obj.operate() r=0 bl.length=488 2024-09-14T11:38:48.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.563+0000 7fa13b67c9c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-14T11:38:48.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.563+0000 7fa13b67c9c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:38:48.563 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:48.563+0000 7fa13b67c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:50.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.591+0000 7fa13b67c9c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:38:50.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.591+0000 7fa13b67c9c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:38:50.590 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.591+0000 7fa13b67c9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-14T11:38:50.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.591+0000 7fa00bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398922 cookie 93848369965104 notifier 8946 bl.length()=687 2024-09-14T11:38:50.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.591+0000 7fa00bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:38:50.591 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.591+0000 7fa00bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:38:50.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.595+0000 7f9fef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:50.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.599+0000 7fa13b67c9c0 20 remove_watcher() i=0 2024-09-14T11:38:50.598 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.599+0000 7fa13b67c9c0 2 removed watcher, disabling cache 2024-09-14T11:38:50.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.603+0000 7fa13b67c9c0 20 remove_watcher() i=1 2024-09-14T11:38:50.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.603+0000 7fa13b67c9c0 20 remove_watcher() i=2 2024-09-14T11:38:50.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.607+0000 7fa13b67c9c0 20 remove_watcher() i=3 2024-09-14T11:38:50.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.607+0000 7fa13b67c9c0 20 remove_watcher() i=4 2024-09-14T11:38:50.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.611+0000 7fa13b67c9c0 20 remove_watcher() i=5 2024-09-14T11:38:50.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.611+0000 7fa13b67c9c0 20 remove_watcher() i=6 2024-09-14T11:38:50.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.615+0000 7fa13b67c9c0 20 remove_watcher() i=7 2024-09-14T11:38:50.636 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-14T11:38:50.636 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key JKBOQHRVWOLSILLNNQBY --secret 6CF/SlIXyCaW/D3yXL9HaeazwHdHTZwNGk6eNvRUpa1BAM9kYXyAIw== --cluster ceph 2024-09-14T11:38:50.724 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:50.724 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:50.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.767+0000 7fd5c0f839c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.767+0000 7fd5c0f839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:50.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.767+0000 7fd5c0f839c0 20 realm 2024-09-14T11:38:50.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.767+0000 7fd5c0f839c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.771+0000 7fd5c0f839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:50.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.771+0000 7fd5c0f839c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:50.768 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.771+0000 7fd5c0f839c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.771+0000 7fd5c0f839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:50.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.771+0000 7fd5c0f839c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.771+0000 7fd5c0f839c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:50.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.771+0000 7fd5c0f839c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.771+0000 7fd5c0f839c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:50.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.771+0000 7fd5c0f839c0 20 searching for the correct realm 2024-09-14T11:38:50.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.775+0000 7fd5bf28a640 0 -- 172.21.15.71:0/3899220546 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fd5b4018070 msgr2=0x7fd5b4053080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:50.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.783+0000 7fd5bf28a640 0 -- 172.21.15.71:0/3899220546 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x56443968e770 msgr2=0x564439690b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:50.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.791+0000 7fd5c0f839c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:50.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.791+0000 7fd5c0f839c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:38:50.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.791+0000 7fd5c0f839c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:50.790 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.791+0000 7fd5c0f839c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:38:50.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.791+0000 7fd5c0f839c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:50.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.791+0000 7fd5c0f839c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:50.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.791+0000 7fd5c0f839c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.791+0000 7fd5c0f839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:50.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.791+0000 7fd5c0f839c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.791+0000 7fd5c0f839c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:50.791 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.791+0000 7fd5c0f839c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.791+0000 7fd5c0f839c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:50.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.791+0000 7fd5c0f839c0 20 zone default found 2024-09-14T11:38:50.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.791+0000 7fd5c0f839c0 4 Realm: () 2024-09-14T11:38:50.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.791+0000 7fd5c0f839c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:38:50.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.791+0000 7fd5c0f839c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:38:50.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.791+0000 7fd5c0f839c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:50.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.791+0000 7fd5c0f839c0 20 zonegroup default 2024-09-14T11:38:50.792 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.791+0000 7fd5c0f839c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.795+0000 7fd5c0f839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:50.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.795+0000 7fd5c0f839c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.795+0000 7fd5c0f839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:50.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.795+0000 7fd5c0f839c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.793 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.795+0000 7fd5c0f839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:50.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.795+0000 7fd5c0f839c0 20 started sync module instance, tier type = 2024-09-14T11:38:50.794 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.795+0000 7fd5c0f839c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:38:50.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.811+0000 7fd5c0f839c0 20 add_watcher() i=0 2024-09-14T11:38:50.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.811+0000 7fd5c0f839c0 20 add_watcher() i=1 2024-09-14T11:38:50.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.811+0000 7fd5c0f839c0 20 add_watcher() i=2 2024-09-14T11:38:50.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.811+0000 7fd5c0f839c0 20 add_watcher() i=3 2024-09-14T11:38:50.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.811+0000 7fd5c0f839c0 20 add_watcher() i=4 2024-09-14T11:38:50.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.811+0000 7fd5c0f839c0 20 add_watcher() i=5 2024-09-14T11:38:50.811 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.811+0000 7fd5c0f839c0 20 add_watcher() i=6 2024-09-14T11:38:50.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.815+0000 7fd5c0f839c0 20 add_watcher() i=7 2024-09-14T11:38:50.814 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.815+0000 7fd5c0f839c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:50.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.819+0000 7fd4757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:50.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.819+0000 7fd5c0f839c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:50.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.819+0000 7fd5c0f839c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:50.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.819+0000 7fd5c0f839c0 5 note: GC not initialized 2024-09-14T11:38:50.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.819+0000 7fd3effff640 20 reqs_thread_entry: start 2024-09-14T11:38:50.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.819+0000 7fd5c0f839c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:50.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.819+0000 7fd5c0f839c0 20 Filter name: none 2024-09-14T11:38:50.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.819+0000 7fd3edffb640 20 reqs_thread_entry: start 2024-09-14T11:38:50.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.819+0000 7fd5c0f839c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-14T11:38:50.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.819+0000 7fd5c0f839c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.819+0000 7fd5c0f839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:50.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.819+0000 7fd5c0f839c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-14T11:38:50.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.819+0000 7fd5c0f839c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:38:50.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.819+0000 7fd5c0f839c0 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-14T11:38:50.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.819+0000 7fd5c0f839c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.819+0000 7fd5c0f839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:50.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.819+0000 7fd5c0f839c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-14T11:38:50.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.819+0000 7fd5c0f839c0 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T11:38:50.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.819+0000 7fd5c0f839c0 10 cache get: name=default.rgw.meta+users.keys+JKBOQHRVWOLSILLNNQBY : miss 2024-09-14T11:38:50.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.819+0000 7fd5c0f839c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.819+0000 7fd5c0f839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:50.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.819+0000 7fd5c0f839c0 10 cache put: name=default.rgw.meta+users.keys+JKBOQHRVWOLSILLNNQBY info.flags=0x0 2024-09-14T11:38:50.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.819+0000 7fd5c0f839c0 10 adding default.rgw.meta+users.keys+JKBOQHRVWOLSILLNNQBY to cache LRU end 2024-09-14T11:38:50.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.819+0000 7fd5c0f839c0 10 cache get: name=default.rgw.meta+users.keys+JKBOQHRVWOLSILLNNQBY : hit (negative entry) 2024-09-14T11:38:50.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.819+0000 7fd5c0f839c0 10 cache get: name=default.rgw.meta+users.keys+JKBOQHRVWOLSILLNNQBY : hit (negative entry) 2024-09-14T11:38:50.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.823+0000 7fd5c0f839c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:38:50.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.823+0000 7fd5c0f839c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:38:50.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.823+0000 7fd5c0f839c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-14T11:38:50.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.823+0000 7fd4a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399158 cookie 94851020973680 notifier 8525 bl.length()=645 2024-09-14T11:38:50.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.823+0000 7fd4a27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:38:50.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.823+0000 7fd4a27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:38:50.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.827+0000 7fd5c0f839c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-14T11:38:50.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.827+0000 7fd5c0f839c0 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T11:38:50.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.827+0000 7fd5c0f839c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-14T11:38:50.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.827+0000 7fd4a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399126 cookie 94851020987616 notifier 8525 bl.length()=185 2024-09-14T11:38:50.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.827+0000 7fd4a27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-14T11:38:50.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.827+0000 7fd4a27fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T11:38:50.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.831+0000 7fd5c0f839c0 10 cache put: name=default.rgw.meta+users.keys+JKBOQHRVWOLSILLNNQBY info.flags=0x7 2024-09-14T11:38:50.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.831+0000 7fd5c0f839c0 10 moving default.rgw.meta+users.keys+JKBOQHRVWOLSILLNNQBY to cache LRU end 2024-09-14T11:38:50.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.831+0000 7fd5c0f839c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:JKBOQHRVWOLSILLNNQBY, ofs0, ns] 2024-09-14T11:38:50.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.831+0000 7fd4a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399159 cookie 94851020983744 notifier 8525 bl.length()=186 2024-09-14T11:38:50.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.831+0000 7fd4a27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+JKBOQHRVWOLSILLNNQBY info.flags=0x7 2024-09-14T11:38:50.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.831+0000 7fd4a27fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+JKBOQHRVWOLSILLNNQBY to cache LRU end 2024-09-14T11:38:50.830 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T11:38:50.830 INFO:teuthology.orchestra.run.smithi071.stdout: "user_id": "bar.client.0", 2024-09-14T11:38:50.830 INFO:teuthology.orchestra.run.smithi071.stdout: "display_name": "Mr.bar.client.0", 2024-09-14T11:38:50.830 INFO:teuthology.orchestra.run.smithi071.stdout: "email": "bar+test@test.test", 2024-09-14T11:38:50.830 INFO:teuthology.orchestra.run.smithi071.stdout: "suspended": 0, 2024-09-14T11:38:50.830 INFO:teuthology.orchestra.run.smithi071.stdout: "max_buckets": 1000, 2024-09-14T11:38:50.830 INFO:teuthology.orchestra.run.smithi071.stdout: "subusers": [], 2024-09-14T11:38:50.830 INFO:teuthology.orchestra.run.smithi071.stdout: "keys": [ 2024-09-14T11:38:50.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T11:38:50.830 INFO:teuthology.orchestra.run.smithi071.stdout: "user": "bar.client.0", 2024-09-14T11:38:50.830 INFO:teuthology.orchestra.run.smithi071.stdout: "access_key": "JKBOQHRVWOLSILLNNQBY", 2024-09-14T11:38:50.830 INFO:teuthology.orchestra.run.smithi071.stdout: "secret_key": "6CF/SlIXyCaW/D3yXL9HaeazwHdHTZwNGk6eNvRUpa1BAM9kYXyAIw==", 2024-09-14T11:38:50.830 INFO:teuthology.orchestra.run.smithi071.stdout: "active": true, 2024-09-14T11:38:50.831 INFO:teuthology.orchestra.run.smithi071.stdout: "create_date": "2024-09-14T11:38:50.825582Z" 2024-09-14T11:38:50.831 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T11:38:50.831 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-14T11:38:50.831 INFO:teuthology.orchestra.run.smithi071.stdout: "swift_keys": [], 2024-09-14T11:38:50.831 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": [], 2024-09-14T11:38:50.831 INFO:teuthology.orchestra.run.smithi071.stdout: "op_mask": "read, write, delete", 2024-09-14T11:38:50.831 INFO:teuthology.orchestra.run.smithi071.stdout: "default_placement": "", 2024-09-14T11:38:50.831 INFO:teuthology.orchestra.run.smithi071.stdout: "default_storage_class": "", 2024-09-14T11:38:50.831 INFO:teuthology.orchestra.run.smithi071.stdout: "placement_tags": [], 2024-09-14T11:38:50.831 INFO:teuthology.orchestra.run.smithi071.stdout: "bucket_quota": { 2024-09-14T11:38:50.831 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": false, 2024-09-14T11:38:50.831 INFO:teuthology.orchestra.run.smithi071.stdout: "check_on_raw": false, 2024-09-14T11:38:50.831 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size": -1, 2024-09-14T11:38:50.831 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size_kb": 0, 2024-09-14T11:38:50.831 INFO:teuthology.orchestra.run.smithi071.stdout: "max_objects": -1 2024-09-14T11:38:50.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T11:38:50.832 INFO:teuthology.orchestra.run.smithi071.stdout: "user_quota": { 2024-09-14T11:38:50.832 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": false, 2024-09-14T11:38:50.832 INFO:teuthology.orchestra.run.smithi071.stdout: "check_on_raw": false, 2024-09-14T11:38:50.832 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size": -1, 2024-09-14T11:38:50.832 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size_kb": 0, 2024-09-14T11:38:50.832 INFO:teuthology.orchestra.run.smithi071.stdout: "max_objects": -1 2024-09-14T11:38:50.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T11:38:50.832 INFO:teuthology.orchestra.run.smithi071.stdout: "temp_url_keys": [], 2024-09-14T11:38:50.832 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "rgw", 2024-09-14T11:38:50.832 INFO:teuthology.orchestra.run.smithi071.stdout: "mfa_ids": [], 2024-09-14T11:38:50.832 INFO:teuthology.orchestra.run.smithi071.stdout: "account_id": "", 2024-09-14T11:38:50.832 INFO:teuthology.orchestra.run.smithi071.stdout: "path": "/", 2024-09-14T11:38:50.832 INFO:teuthology.orchestra.run.smithi071.stdout: "create_date": "2024-09-14T11:38:50.825566Z", 2024-09-14T11:38:50.832 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-09-14T11:38:50.833 INFO:teuthology.orchestra.run.smithi071.stdout: "group_ids": [] 2024-09-14T11:38:50.833 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T11:38:50.833 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:50.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.831+0000 7fd4757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:50.834 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.835+0000 7fd5c0f839c0 20 remove_watcher() i=0 2024-09-14T11:38:50.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.835+0000 7fd5c0f839c0 2 removed watcher, disabling cache 2024-09-14T11:38:50.836 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.839+0000 7fd5c0f839c0 20 remove_watcher() i=1 2024-09-14T11:38:50.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.839+0000 7fd5c0f839c0 20 remove_watcher() i=2 2024-09-14T11:38:50.841 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.843+0000 7fd5c0f839c0 20 remove_watcher() i=3 2024-09-14T11:38:50.842 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.843+0000 7fd5c0f839c0 20 remove_watcher() i=4 2024-09-14T11:38:50.844 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.847+0000 7fd5c0f839c0 20 remove_watcher() i=5 2024-09-14T11:38:50.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.847+0000 7fd5c0f839c0 20 remove_watcher() i=6 2024-09-14T11:38:50.850 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.851+0000 7fd5c0f839c0 20 remove_watcher() i=7 2024-09-14T11:38:50.865 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 4046162813 --totp-seed 2NCSNM6MCZUELO3ZHH3H3NYX4Y7QTFYFRU4EBOPLYWV7NSUU6X5FBXD6AHRXCZZN --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:38:50.953 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:50.953 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:50.996 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.999+0000 7fc4767299c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.999+0000 7fc4767299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:50.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.999+0000 7fc4767299c0 20 realm 2024-09-14T11:38:50.998 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.999+0000 7fc4767299c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.999+0000 7fc4767299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:50.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.999+0000 7fc4767299c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:50.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.999+0000 7fc4767299c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.999+0000 7fc4767299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:50.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:50.999+0000 7fc4767299c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.003+0000 7fc4767299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:51.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.003+0000 7fc4767299c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.003+0000 7fc4767299c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:51.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.003+0000 7fc4767299c0 20 searching for the correct realm 2024-09-14T11:38:51.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.003+0000 7fc473a2e640 0 -- 172.21.15.71:0/4109581952 >> [v2:172.21.15.71:6824/2436891866,v1:172.21.15.71:6825/2436891866] conn(0x7fc464073940 msgr2=0x7fc464057a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:51.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.215+0000 7fc474a30640 0 -- 172.21.15.71:0/4109581952 >> [v2:172.21.15.157:6816/1231501119,v1:172.21.15.157:6817/1231501119] conn(0x562bf6ec3c80 msgr2=0x562bf6ec6120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:51.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.235+0000 7fc4767299c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:51.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.235+0000 7fc4767299c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:38:51.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.235+0000 7fc4767299c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:51.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.235+0000 7fc4767299c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:38:51.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.235+0000 7fc4767299c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:51.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.235+0000 7fc4767299c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:51.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.235+0000 7fc4767299c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.235+0000 7fc4767299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:51.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.235+0000 7fc4767299c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.235+0000 7fc4767299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:51.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.235+0000 7fc4767299c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.235+0000 7fc4767299c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:51.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.235+0000 7fc4767299c0 20 zone default found 2024-09-14T11:38:51.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.235+0000 7fc4767299c0 4 Realm: () 2024-09-14T11:38:51.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.235+0000 7fc4767299c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:38:51.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.235+0000 7fc4767299c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:38:51.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.235+0000 7fc4767299c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:51.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.235+0000 7fc4767299c0 20 zonegroup default 2024-09-14T11:38:51.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.235+0000 7fc4767299c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.235+0000 7fc4767299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:51.235 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.235+0000 7fc4767299c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.239+0000 7fc4767299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:51.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.239+0000 7fc4767299c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.239+0000 7fc4767299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:51.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.239+0000 7fc4767299c0 20 started sync module instance, tier type = 2024-09-14T11:38:51.237 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.239+0000 7fc4767299c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:38:51.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.259+0000 7fc4767299c0 20 add_watcher() i=0 2024-09-14T11:38:51.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.259+0000 7fc4767299c0 20 add_watcher() i=1 2024-09-14T11:38:51.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.259+0000 7fc4767299c0 20 add_watcher() i=2 2024-09-14T11:38:51.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.259+0000 7fc4767299c0 20 add_watcher() i=3 2024-09-14T11:38:51.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.259+0000 7fc4767299c0 20 add_watcher() i=4 2024-09-14T11:38:51.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.259+0000 7fc4767299c0 20 add_watcher() i=5 2024-09-14T11:38:51.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.263+0000 7fc4767299c0 20 add_watcher() i=6 2024-09-14T11:38:51.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.263+0000 7fc4767299c0 20 add_watcher() i=7 2024-09-14T11:38:51.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.263+0000 7fc4767299c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:51.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.267+0000 7fc32afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:51.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.267+0000 7fc4767299c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:51.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.267+0000 7fc4767299c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:51.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.267+0000 7fc4767299c0 5 note: GC not initialized 2024-09-14T11:38:51.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.267+0000 7fc329fdb640 20 reqs_thread_entry: start 2024-09-14T11:38:51.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.267+0000 7fc4767299c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:51.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.267+0000 7fc4767299c0 20 Filter name: none 2024-09-14T11:38:51.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.267+0000 7fc29b7fe640 20 reqs_thread_entry: start 2024-09-14T11:38:51.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.267+0000 7fc4767299c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-14T11:38:51.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.271+0000 7fc4767299c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.271+0000 7fc4767299c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T11:38:51.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.271+0000 7fc4767299c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-14T11:38:51.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.271+0000 7fc4767299c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:38:51.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.271+0000 7fc4767299c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:51.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.275+0000 7fc4767299c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:38:51.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.275+0000 7fc4767299c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:38:51.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.275+0000 7fc4767299c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-14T11:38:51.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.275+0000 7fc34b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399160 cookie 94746826265488 notifier 8540 bl.length()=659 2024-09-14T11:38:51.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.275+0000 7fc34b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:38:51.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.275+0000 7fc34b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:38:51.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.275+0000 7fc32afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:51.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.283+0000 7fc4767299c0 20 remove_watcher() i=0 2024-09-14T11:38:51.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.283+0000 7fc4767299c0 2 removed watcher, disabling cache 2024-09-14T11:38:51.282 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.283+0000 7fc4767299c0 20 remove_watcher() i=1 2024-09-14T11:38:51.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.287+0000 7fc4767299c0 20 remove_watcher() i=2 2024-09-14T11:38:51.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.287+0000 7fc4767299c0 20 remove_watcher() i=3 2024-09-14T11:38:51.289 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.291+0000 7fc4767299c0 20 remove_watcher() i=4 2024-09-14T11:38:51.291 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.291+0000 7fc4767299c0 20 remove_watcher() i=5 2024-09-14T11:38:51.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.295+0000 7fc4767299c0 20 remove_watcher() i=6 2024-09-14T11:38:51.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.299+0000 7fc4767299c0 20 remove_watcher() i=7 2024-09-14T11:38:51.313 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW33333333333333333 --account-name Mr.RGW33333333333333333 --email RGW33333333333333333+test@test.test --tenant testx 2024-09-14T11:38:51.397 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:51.397 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:51.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.439+0000 7f9567b759c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.443+0000 7f9567b759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:51.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.443+0000 7f9567b759c0 20 realm 2024-09-14T11:38:51.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.443+0000 7f9567b759c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.443+0000 7f9567b759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:51.442 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.443+0000 7f9567b759c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:51.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.443+0000 7f9567b759c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.443+0000 7f9567b759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:51.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.443+0000 7f9567b759c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.443+0000 7f9567b759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:51.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.443+0000 7f9567b759c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.447+0000 7f9567b759c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:51.444 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.447+0000 7f9567b759c0 20 searching for the correct realm 2024-09-14T11:38:51.448 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.451+0000 7f9565e7c640 0 -- 172.21.15.71:0/3419051774 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f9550028030 msgr2=0x7f9550093280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:51.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.695+0000 7f9565e7c640 0 -- 172.21.15.71:0/3419051774 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55a2d305b660 msgr2=0x55a2d305da50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:51.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.711+0000 7f9567b759c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:51.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.711+0000 7f9567b759c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:38:51.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.711+0000 7f9567b759c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:51.711 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.711+0000 7f9567b759c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:38:51.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.711+0000 7f9567b759c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:51.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.711+0000 7f9567b759c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:51.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.711+0000 7f9567b759c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.715+0000 7f9567b759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:51.712 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.715+0000 7f9567b759c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.715+0000 7f9567b759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:51.713 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.715+0000 7f9567b759c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.715+0000 7f9567b759c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:51.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.715+0000 7f9567b759c0 20 zone default found 2024-09-14T11:38:51.714 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.715+0000 7f9567b759c0 4 Realm: () 2024-09-14T11:38:51.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.715+0000 7f9567b759c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:38:51.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.715+0000 7f9567b759c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:38:51.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.715+0000 7f9567b759c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:51.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.715+0000 7f9567b759c0 20 zonegroup default 2024-09-14T11:38:51.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.715+0000 7f9567b759c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.715 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.715+0000 7f9567b759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:51.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.715+0000 7f9567b759c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.715+0000 7f9567b759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:51.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.715+0000 7f9567b759c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.719+0000 7f9567b759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:51.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.719+0000 7f9567b759c0 20 started sync module instance, tier type = 2024-09-14T11:38:51.717 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.719+0000 7f9567b759c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:38:51.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.739+0000 7f9567b759c0 20 add_watcher() i=0 2024-09-14T11:38:51.737 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.739+0000 7f9567b759c0 20 add_watcher() i=1 2024-09-14T11:38:51.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.739+0000 7f9567b759c0 20 add_watcher() i=2 2024-09-14T11:38:51.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.739+0000 7f9567b759c0 20 add_watcher() i=3 2024-09-14T11:38:51.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.739+0000 7f9567b759c0 20 add_watcher() i=4 2024-09-14T11:38:51.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.739+0000 7f9567b759c0 20 add_watcher() i=5 2024-09-14T11:38:51.738 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.739+0000 7f9567b759c0 20 add_watcher() i=6 2024-09-14T11:38:51.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.739+0000 7f9567b759c0 20 add_watcher() i=7 2024-09-14T11:38:51.740 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.739+0000 7f9567b759c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:51.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.743+0000 7f941bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:51.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.743+0000 7f9567b759c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:51.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.743+0000 7f9567b759c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:51.744 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.747+0000 7f9567b759c0 5 note: GC not initialized 2024-09-14T11:38:51.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.747+0000 7f941afe5640 20 reqs_thread_entry: start 2024-09-14T11:38:51.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.747+0000 7f9567b759c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:51.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.747+0000 7f9567b759c0 20 Filter name: none 2024-09-14T11:38:51.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.747+0000 7f9418fe1640 20 reqs_thread_entry: start 2024-09-14T11:38:51.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.747+0000 7f9567b759c0 10 cache get: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 : miss 2024-09-14T11:38:51.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.747+0000 7f9567b759c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.747+0000 7f9567b759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:51.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.747+0000 7f9567b759c0 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x0 2024-09-14T11:38:51.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.747+0000 7f9567b759c0 10 adding default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-14T11:38:51.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.747+0000 7f9567b759c0 20 failed to read name.testx$Mr.RGW33333333333333333 with: (2) No such file or directory 2024-09-14T11:38:51.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.747+0000 7f9567b759c0 10 cache get: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test : miss 2024-09-14T11:38:51.746 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.747+0000 7f9567b759c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.747+0000 7f9567b759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:51.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.747+0000 7f9567b759c0 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x0 2024-09-14T11:38:51.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.747+0000 7f9567b759c0 10 adding default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-14T11:38:51.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.747+0000 7f9567b759c0 20 failed to read rgw33333333333333333+test@test.test with: (2) No such file or directory 2024-09-14T11:38:51.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.751+0000 7f9567b759c0 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-14T11:38:51.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.751+0000 7f9567b759c0 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-14T11:38:51.748 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.751+0000 7f9567b759c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW33333333333333333, ofs0, ns] 2024-09-14T11:38:51.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.751+0000 7f9448ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366457 cookie 94157813435584 notifier 8555 bl.length()=389 2024-09-14T11:38:51.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.751+0000 7f9448ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-14T11:38:51.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.751+0000 7f9448ff9640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-14T11:38:51.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.751+0000 7f9567b759c0 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-14T11:38:51.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.751+0000 7f9567b759c0 10 moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-14T11:38:51.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.751+0000 7f9567b759c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.testx$Mr.RGW33333333333333333, ofs0, ns] 2024-09-14T11:38:51.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.751+0000 7f9448ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366458 cookie 94157813473520 notifier 8555 bl.length()=230 2024-09-14T11:38:51.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.751+0000 7f9448ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-14T11:38:51.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.751+0000 7f9448ff9640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-14T11:38:51.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.755+0000 7f9567b759c0 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-14T11:38:51.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.755+0000 7f9567b759c0 10 moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-14T11:38:51.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.755+0000 7f9567b759c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw33333333333333333+test@test.test, ofs0, ns] 2024-09-14T11:38:51.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.755+0000 7f9448ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366231 cookie 94157813470096 notifier 8555 bl.length()=234 2024-09-14T11:38:51.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.755+0000 7f9448ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-14T11:38:51.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.755+0000 7f9448ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-14T11:38:51.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.759+0000 7f941bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:51.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.763+0000 7f9567b759c0 20 remove_watcher() i=0 2024-09-14T11:38:51.761 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.763+0000 7f9567b759c0 2 removed watcher, disabling cache 2024-09-14T11:38:51.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.763+0000 7f9567b759c0 20 remove_watcher() i=1 2024-09-14T11:38:51.765 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.767+0000 7f9567b759c0 20 remove_watcher() i=2 2024-09-14T11:38:51.767 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.767+0000 7f9567b759c0 20 remove_watcher() i=3 2024-09-14T11:38:51.769 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.771+0000 7f9567b759c0 20 remove_watcher() i=4 2024-09-14T11:38:51.771 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.771+0000 7f9567b759c0 20 remove_watcher() i=5 2024-09-14T11:38:51.774 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.775+0000 7f9567b759c0 20 remove_watcher() i=6 2024-09-14T11:38:51.776 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.779+0000 7f9567b759c0 20 remove_watcher() i=7 2024-09-14T11:38:51.790 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T11:38:51.790 INFO:teuthology.orchestra.run.smithi071.stdout: "id": "RGW33333333333333333", 2024-09-14T11:38:51.790 INFO:teuthology.orchestra.run.smithi071.stdout: "tenant": "testx", 2024-09-14T11:38:51.790 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "Mr.RGW33333333333333333", 2024-09-14T11:38:51.790 INFO:teuthology.orchestra.run.smithi071.stdout: "email": "RGW33333333333333333+test@test.test", 2024-09-14T11:38:51.790 INFO:teuthology.orchestra.run.smithi071.stdout: "quota": { 2024-09-14T11:38:51.790 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": false, 2024-09-14T11:38:51.791 INFO:teuthology.orchestra.run.smithi071.stdout: "check_on_raw": false, 2024-09-14T11:38:51.791 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size": -1, 2024-09-14T11:38:51.791 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size_kb": 0, 2024-09-14T11:38:51.791 INFO:teuthology.orchestra.run.smithi071.stdout: "max_objects": -1 2024-09-14T11:38:51.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T11:38:51.791 INFO:teuthology.orchestra.run.smithi071.stdout: "bucket_quota": { 2024-09-14T11:38:51.791 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": false, 2024-09-14T11:38:51.791 INFO:teuthology.orchestra.run.smithi071.stdout: "check_on_raw": false, 2024-09-14T11:38:51.791 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size": -1, 2024-09-14T11:38:51.791 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size_kb": 0, 2024-09-14T11:38:51.791 INFO:teuthology.orchestra.run.smithi071.stdout: "max_objects": -1 2024-09-14T11:38:51.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T11:38:51.791 INFO:teuthology.orchestra.run.smithi071.stdout: "max_users": 1000, 2024-09-14T11:38:51.791 INFO:teuthology.orchestra.run.smithi071.stdout: "max_roles": 1000, 2024-09-14T11:38:51.792 INFO:teuthology.orchestra.run.smithi071.stdout: "max_groups": 1000, 2024-09-14T11:38:51.792 INFO:teuthology.orchestra.run.smithi071.stdout: "max_buckets": 1000, 2024-09-14T11:38:51.792 INFO:teuthology.orchestra.run.smithi071.stdout: "max_access_keys": 4 2024-09-14T11:38:51.792 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T11:38:51.793 DEBUG:tasks.s3tests:Creating user RGW33333333333333333 on client.0 2024-09-14T11:38:51.793 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name Mr.RGW33333333333333333 --email 'testx$tenanteduser+test@test.test' --access-key IKCZWEIICJQCWNDGPCEM --secret OhEaDkSuac2UNmKEp2jwlOoDL9AUT12wILnoYWmMfFUWHmtqmKZTrA== --cluster ceph --account-id RGW33333333333333333 --account-root 2024-09-14T11:38:51.883 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:51.883 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:51.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.927+0000 7fb15a8c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.927+0000 7fb15a8c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:51.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.927+0000 7fb15a8c79c0 20 realm 2024-09-14T11:38:51.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.927+0000 7fb15a8c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.927+0000 7fb15a8c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:51.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.927+0000 7fb15a8c79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:51.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.927+0000 7fb15a8c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.931+0000 7fb15a8c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:51.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.931+0000 7fb15a8c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.931+0000 7fb15a8c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:51.929 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.931+0000 7fb15a8c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.931+0000 7fb15a8c79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:51.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.931+0000 7fb15a8c79c0 20 searching for the correct realm 2024-09-14T11:38:51.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:51.935+0000 7fb157bcc640 0 -- 172.21.15.71:0/3880032797 >> [v2:172.21.15.71:6824/2436891866,v1:172.21.15.71:6825/2436891866] conn(0x7fb150008050 msgr2=0x7fb15005c310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:52.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.147+0000 7fb1583cd640 0 -- 172.21.15.71:0/3880032797 >> [v2:172.21.15.157:6816/1231501119,v1:172.21.15.157:6817/1231501119] conn(0x563ecc6bd970 msgr2=0x563ecc6bfe00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:52.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.167+0000 7fb15a8c79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:52.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.167+0000 7fb15a8c79c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:38:52.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.167+0000 7fb15a8c79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:52.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.167+0000 7fb15a8c79c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:38:52.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.167+0000 7fb15a8c79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:52.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.167+0000 7fb15a8c79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:52.165 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.167+0000 7fb15a8c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.167+0000 7fb15a8c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.167+0000 7fb15a8c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.167+0000 7fb15a8c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:52.166 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.167+0000 7fb15a8c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.167+0000 7fb15a8c79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:52.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.167+0000 7fb15a8c79c0 20 zone default found 2024-09-14T11:38:52.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.167+0000 7fb15a8c79c0 4 Realm: () 2024-09-14T11:38:52.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.167+0000 7fb15a8c79c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:38:52.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.167+0000 7fb15a8c79c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:38:52.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.167+0000 7fb15a8c79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:52.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.167+0000 7fb15a8c79c0 20 zonegroup default 2024-09-14T11:38:52.168 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.167+0000 7fb15a8c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.167+0000 7fb15a8c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.167+0000 7fb15a8c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.171+0000 7fb15a8c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.171+0000 7fb15a8c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.169 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.171+0000 7fb15a8c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.171+0000 7fb15a8c79c0 20 started sync module instance, tier type = 2024-09-14T11:38:52.170 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.171+0000 7fb15a8c79c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:38:52.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.195+0000 7fb15a8c79c0 20 add_watcher() i=0 2024-09-14T11:38:52.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.195+0000 7fb15a8c79c0 20 add_watcher() i=1 2024-09-14T11:38:52.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.195+0000 7fb15a8c79c0 20 add_watcher() i=2 2024-09-14T11:38:52.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.195+0000 7fb15a8c79c0 20 add_watcher() i=3 2024-09-14T11:38:52.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.195+0000 7fb15a8c79c0 20 add_watcher() i=4 2024-09-14T11:38:52.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.195+0000 7fb15a8c79c0 20 add_watcher() i=5 2024-09-14T11:38:52.194 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.195+0000 7fb15a8c79c0 20 add_watcher() i=6 2024-09-14T11:38:52.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.195+0000 7fb15a8c79c0 20 add_watcher() i=7 2024-09-14T11:38:52.196 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.195+0000 7fb15a8c79c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:52.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.203+0000 7fb00afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:52.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.203+0000 7fb15a8c79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:52.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.203+0000 7fb15a8c79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:52.201 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.203+0000 7fb15a8c79c0 5 note: GC not initialized 2024-09-14T11:38:52.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.203+0000 7fb009fdb640 20 reqs_thread_entry: start 2024-09-14T11:38:52.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.203+0000 7fb15a8c79c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:52.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.203+0000 7fb15a8c79c0 20 Filter name: none 2024-09-14T11:38:52.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.203+0000 7faf7b7fe640 20 reqs_thread_entry: start 2024-09-14T11:38:52.202 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.203+0000 7fb15a8c79c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-14T11:38:52.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.203+0000 7fb15a8c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.203+0000 7fb15a8c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.203+0000 7fb15a8c79c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-14T11:38:52.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.203+0000 7fb15a8c79c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:38:52.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.203+0000 7fb15a8c79c0 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-14T11:38:52.203 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.203+0000 7fb15a8c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.203+0000 7fb15a8c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.203+0000 7fb15a8c79c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-14T11:38:52.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.203+0000 7fb15a8c79c0 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T11:38:52.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.203+0000 7fb15a8c79c0 10 cache get: name=default.rgw.meta+users.keys+IKCZWEIICJQCWNDGPCEM : miss 2024-09-14T11:38:52.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.203+0000 7fb15a8c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.207+0000 7fb15a8c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.207+0000 7fb15a8c79c0 10 cache put: name=default.rgw.meta+users.keys+IKCZWEIICJQCWNDGPCEM info.flags=0x0 2024-09-14T11:38:52.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.207+0000 7fb15a8c79c0 10 adding default.rgw.meta+users.keys+IKCZWEIICJQCWNDGPCEM to cache LRU end 2024-09-14T11:38:52.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.207+0000 7fb15a8c79c0 10 cache get: name=default.rgw.meta+accounts+account.RGW33333333333333333 : miss 2024-09-14T11:38:52.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.207+0000 7fb15a8c79c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.207+0000 7fb15a8c79c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:38:52.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.207+0000 7fb15a8c79c0 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-14T11:38:52.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.207+0000 7fb15a8c79c0 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-14T11:38:52.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.207+0000 7fb15a8c79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:52.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.207+0000 7fb15a8c79c0 10 cache get: name=default.rgw.meta+users.keys+IKCZWEIICJQCWNDGPCEM : hit (negative entry) 2024-09-14T11:38:52.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.207+0000 7fb15a8c79c0 10 cache get: name=default.rgw.meta+users.keys+IKCZWEIICJQCWNDGPCEM : hit (negative entry) 2024-09-14T11:38:52.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.211+0000 7fb15a8c79c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:38:52.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.211+0000 7fb15a8c79c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:38:52.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.211+0000 7fb15a8c79c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-14T11:38:52.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.211+0000 7fb02f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366423 cookie 94827717648656 notifier 9024 bl.length()=732 2024-09-14T11:38:52.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.211+0000 7fb02f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:38:52.211 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.211+0000 7fb02f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:38:52.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.215+0000 7fb15a8c79c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-14T11:38:52.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.215+0000 7fb15a8c79c0 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T11:38:52.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.215+0000 7fb15a8c79c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-14T11:38:52.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.215+0000 7fb02f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366424 cookie 94827717661152 notifier 9024 bl.length()=215 2024-09-14T11:38:52.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.215+0000 7fb02f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-14T11:38:52.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.215+0000 7fb02f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T11:38:52.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.219+0000 7fb15a8c79c0 10 cache put: name=default.rgw.meta+users.keys+IKCZWEIICJQCWNDGPCEM info.flags=0x7 2024-09-14T11:38:52.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.219+0000 7fb15a8c79c0 10 moving default.rgw.meta+users.keys+IKCZWEIICJQCWNDGPCEM to cache LRU end 2024-09-14T11:38:52.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.219+0000 7fb15a8c79c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:IKCZWEIICJQCWNDGPCEM, ofs0, ns] 2024-09-14T11:38:52.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.219+0000 7fb02f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366459 cookie 94827717654752 notifier 9024 bl.length()=201 2024-09-14T11:38:52.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.219+0000 7fb02f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+IKCZWEIICJQCWNDGPCEM info.flags=0x7 2024-09-14T11:38:52.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.219+0000 7fb02f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+IKCZWEIICJQCWNDGPCEM to cache LRU end 2024-09-14T11:38:52.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.223+0000 7fb15a8c79c0 20 linked user testx$tenanteduser.client.0 to account RGW33333333333333333 2024-09-14T11:38:52.223 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T11:38:52.223 INFO:teuthology.orchestra.run.smithi071.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-14T11:38:52.223 INFO:teuthology.orchestra.run.smithi071.stdout: "display_name": "Mr.RGW33333333333333333", 2024-09-14T11:38:52.223 INFO:teuthology.orchestra.run.smithi071.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-14T11:38:52.223 INFO:teuthology.orchestra.run.smithi071.stdout: "suspended": 0, 2024-09-14T11:38:52.223 INFO:teuthology.orchestra.run.smithi071.stdout: "max_buckets": 1000, 2024-09-14T11:38:52.223 INFO:teuthology.orchestra.run.smithi071.stdout: "subusers": [], 2024-09-14T11:38:52.223 INFO:teuthology.orchestra.run.smithi071.stdout: "keys": [ 2024-09-14T11:38:52.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T11:38:52.223 INFO:teuthology.orchestra.run.smithi071.stdout: "user": "testx$tenanteduser.client.0", 2024-09-14T11:38:52.224 INFO:teuthology.orchestra.run.smithi071.stdout: "access_key": "IKCZWEIICJQCWNDGPCEM", 2024-09-14T11:38:52.224 INFO:teuthology.orchestra.run.smithi071.stdout: "secret_key": "OhEaDkSuac2UNmKEp2jwlOoDL9AUT12wILnoYWmMfFUWHmtqmKZTrA==", 2024-09-14T11:38:52.224 INFO:teuthology.orchestra.run.smithi071.stdout: "active": true, 2024-09-14T11:38:52.224 INFO:teuthology.orchestra.run.smithi071.stdout: "create_date": "2024-09-14T11:38:52.211652Z" 2024-09-14T11:38:52.224 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T11:38:52.224 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-14T11:38:52.224 INFO:teuthology.orchestra.run.smithi071.stdout: "swift_keys": [], 2024-09-14T11:38:52.224 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": [], 2024-09-14T11:38:52.224 INFO:teuthology.orchestra.run.smithi071.stdout: "op_mask": "read, write, delete", 2024-09-14T11:38:52.224 INFO:teuthology.orchestra.run.smithi071.stdout: "default_placement": "", 2024-09-14T11:38:52.224 INFO:teuthology.orchestra.run.smithi071.stdout: "default_storage_class": "", 2024-09-14T11:38:52.225 INFO:teuthology.orchestra.run.smithi071.stdout: "placement_tags": [], 2024-09-14T11:38:52.225 INFO:teuthology.orchestra.run.smithi071.stdout: "bucket_quota": { 2024-09-14T11:38:52.225 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": false, 2024-09-14T11:38:52.225 INFO:teuthology.orchestra.run.smithi071.stdout: "check_on_raw": false, 2024-09-14T11:38:52.225 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size": -1, 2024-09-14T11:38:52.225 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size_kb": 0, 2024-09-14T11:38:52.225 INFO:teuthology.orchestra.run.smithi071.stdout: "max_objects": -1 2024-09-14T11:38:52.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T11:38:52.225 INFO:teuthology.orchestra.run.smithi071.stdout: "user_quota": { 2024-09-14T11:38:52.225 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": false, 2024-09-14T11:38:52.225 INFO:teuthology.orchestra.run.smithi071.stdout: "check_on_raw": false, 2024-09-14T11:38:52.225 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size": -1, 2024-09-14T11:38:52.226 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size_kb": 0, 2024-09-14T11:38:52.226 INFO:teuthology.orchestra.run.smithi071.stdout: "max_objects": -1 2024-09-14T11:38:52.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T11:38:52.226 INFO:teuthology.orchestra.run.smithi071.stdout: "temp_url_keys": [], 2024-09-14T11:38:52.226 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "root", 2024-09-14T11:38:52.226 INFO:teuthology.orchestra.run.smithi071.stdout: "mfa_ids": [], 2024-09-14T11:38:52.226 INFO:teuthology.orchestra.run.smithi071.stdout: "account_id": "RGW33333333333333333", 2024-09-14T11:38:52.226 INFO:teuthology.orchestra.run.smithi071.stdout: "path": "/", 2024-09-14T11:38:52.226 INFO:teuthology.orchestra.run.smithi071.stdout: "create_date": "2024-09-14T11:38:52.211618Z", 2024-09-14T11:38:52.226 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-09-14T11:38:52.226 INFO:teuthology.orchestra.run.smithi071.stdout: "group_ids": [] 2024-09-14T11:38:52.226 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T11:38:52.226 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:52.227 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.223+0000 7fb00afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:52.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.231+0000 7fb15a8c79c0 20 remove_watcher() i=0 2024-09-14T11:38:52.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.231+0000 7fb15a8c79c0 2 removed watcher, disabling cache 2024-09-14T11:38:52.230 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.231+0000 7fb15a8c79c0 20 remove_watcher() i=1 2024-09-14T11:38:52.232 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.235+0000 7fb15a8c79c0 20 remove_watcher() i=2 2024-09-14T11:38:52.234 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.235+0000 7fb15a8c79c0 20 remove_watcher() i=3 2024-09-14T11:38:52.236 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.239+0000 7fb15a8c79c0 20 remove_watcher() i=4 2024-09-14T11:38:52.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.239+0000 7fb15a8c79c0 20 remove_watcher() i=5 2024-09-14T11:38:52.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.243+0000 7fb15a8c79c0 20 remove_watcher() i=6 2024-09-14T11:38:52.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.243+0000 7fb15a8c79c0 20 remove_watcher() i=7 2024-09-14T11:38:52.260 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 9759042195 --totp-seed 7AYD7YQMWD6YYA4PMDXEA5NFL5LPVZUPAGCKOT4UA7VFOOVAWFBT3TVXQ7MI26AV --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:38:52.307 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:52.307 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:52.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.347+0000 7f6f064469c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.351+0000 7f6f064469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.351+0000 7f6f064469c0 20 realm 2024-09-14T11:38:52.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.351+0000 7f6f064469c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.351+0000 7f6f064469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.351+0000 7f6f064469c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:52.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.351+0000 7f6f064469c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.351+0000 7f6f064469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.351+0000 7f6f064469c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.351+0000 7f6f064469c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:52.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.351+0000 7f6f064469c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.355+0000 7f6f064469c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:52.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.355+0000 7f6f064469c0 20 searching for the correct realm 2024-09-14T11:38:52.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.359+0000 7f6f03f4c640 0 -- 172.21.15.71:0/3635694825 >> [v2:172.21.15.157:6808/527702018,v1:172.21.15.157:6809/527702018] conn(0x7f6ef40aa3d0 msgr2=0x7f6ef40aa850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:52.574 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.575+0000 7f6f03f4c640 0 -- 172.21.15.71:0/3635694825 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x55cd2770e450 msgr2=0x55cd27710910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:52.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.583+0000 7f6f064469c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:52.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.583+0000 7f6f064469c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:38:52.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.583+0000 7f6f064469c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:52.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.583+0000 7f6f064469c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:38:52.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.583+0000 7f6f064469c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:52.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.583+0000 7f6f064469c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:52.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.583+0000 7f6f064469c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.587+0000 7f6f064469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.585 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.587+0000 7f6f064469c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.587+0000 7f6f064469c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:52.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.587+0000 7f6f064469c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.587+0000 7f6f064469c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:52.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.587+0000 7f6f064469c0 20 zone default found 2024-09-14T11:38:52.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.587+0000 7f6f064469c0 4 Realm: () 2024-09-14T11:38:52.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.587+0000 7f6f064469c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:38:52.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.587+0000 7f6f064469c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:38:52.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.587+0000 7f6f064469c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:52.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.587+0000 7f6f064469c0 20 zonegroup default 2024-09-14T11:38:52.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.587+0000 7f6f064469c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.587+0000 7f6f064469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.587+0000 7f6f064469c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.591+0000 7f6f064469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.591+0000 7f6f064469c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.591+0000 7f6f064469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.591+0000 7f6f064469c0 20 started sync module instance, tier type = 2024-09-14T11:38:52.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.591+0000 7f6f064469c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:38:52.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.615+0000 7f6f064469c0 20 add_watcher() i=0 2024-09-14T11:38:52.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.615+0000 7f6f064469c0 20 add_watcher() i=1 2024-09-14T11:38:52.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.615+0000 7f6f064469c0 20 add_watcher() i=2 2024-09-14T11:38:52.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.615+0000 7f6f064469c0 20 add_watcher() i=3 2024-09-14T11:38:52.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.615+0000 7f6f064469c0 20 add_watcher() i=4 2024-09-14T11:38:52.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.615+0000 7f6f064469c0 20 add_watcher() i=5 2024-09-14T11:38:52.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.615+0000 7f6f064469c0 20 add_watcher() i=6 2024-09-14T11:38:52.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.615+0000 7f6f064469c0 20 add_watcher() i=7 2024-09-14T11:38:52.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.615+0000 7f6f064469c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:52.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.619+0000 7f6db9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:52.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.619+0000 7f6f064469c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:52.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.619+0000 7f6f064469c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:52.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.623+0000 7f6f064469c0 5 note: GC not initialized 2024-09-14T11:38:52.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.623+0000 7f6db8fe1640 20 reqs_thread_entry: start 2024-09-14T11:38:52.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.623+0000 7f6f064469c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:52.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.623+0000 7f6f064469c0 20 Filter name: none 2024-09-14T11:38:52.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.623+0000 7f6d327fc640 20 reqs_thread_entry: start 2024-09-14T11:38:52.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.623+0000 7f6f064469c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-14T11:38:52.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.623+0000 7f6f064469c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.623+0000 7f6f064469c0 20 rados_obj.operate() r=0 bl.length=532 2024-09-14T11:38:52.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.623+0000 7f6f064469c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-14T11:38:52.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.623+0000 7f6f064469c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:38:52.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.623+0000 7f6f064469c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:52.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.631+0000 7f6f064469c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:38:52.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.631+0000 7f6f064469c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:38:52.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.631+0000 7f6f064469c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-14T11:38:52.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.631+0000 7f6de27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366425 cookie 94339618394176 notifier 9039 bl.length()=746 2024-09-14T11:38:52.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.631+0000 7f6de27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:38:52.631 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.631+0000 7f6de27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:38:52.633 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.635+0000 7f6db9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:52.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.639+0000 7f6f064469c0 20 remove_watcher() i=0 2024-09-14T11:38:52.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.639+0000 7f6f064469c0 2 removed watcher, disabling cache 2024-09-14T11:38:52.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.639+0000 7f6f064469c0 20 remove_watcher() i=1 2024-09-14T11:38:52.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.643+0000 7f6f064469c0 20 remove_watcher() i=2 2024-09-14T11:38:52.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.643+0000 7f6f064469c0 20 remove_watcher() i=3 2024-09-14T11:38:52.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.647+0000 7f6f064469c0 20 remove_watcher() i=4 2024-09-14T11:38:52.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.647+0000 7f6f064469c0 20 remove_watcher() i=5 2024-09-14T11:38:52.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.651+0000 7f6f064469c0 20 remove_watcher() i=6 2024-09-14T11:38:52.653 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.655+0000 7f6f064469c0 20 remove_watcher() i=7 2024-09-14T11:38:52.669 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-14T11:38:52.669 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key NRJBEHEPTBQSMMSSJFNH --secret IcDel8iUIc9yhkzZr5GdZIbjT3nRk/hd5krnT3l6nAkeXxvti5HT3g== --cluster ceph 2024-09-14T11:38:52.713 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:52.713 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:52.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.755+0000 7fb7963aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.759+0000 7fb7963aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.759+0000 7fb7963aa9c0 20 realm 2024-09-14T11:38:52.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.759+0000 7fb7963aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.759+0000 7fb7963aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.759+0000 7fb7963aa9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:52.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.759+0000 7fb7963aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.759+0000 7fb7963aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.759+0000 7fb7963aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.759+0000 7fb7963aa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:52.758 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.759+0000 7fb7963aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.759+0000 7fb7963aa9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:52.759 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.759+0000 7fb7963aa9c0 20 searching for the correct realm 2024-09-14T11:38:52.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.763+0000 7fb7946b1640 0 -- 172.21.15.71:0/2779967657 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fb788069370 msgr2=0x7fb78808a9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:52.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.771+0000 7fb7946b1640 0 -- 172.21.15.71:0/2779967657 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x558e22c11da0 msgr2=0x558e22c141b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:52.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.779+0000 7fb7963aa9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:52.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.779+0000 7fb7963aa9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:38:52.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.779+0000 7fb7963aa9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:52.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.779+0000 7fb7963aa9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:38:52.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.779+0000 7fb7963aa9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:52.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.779+0000 7fb7963aa9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:52.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.779+0000 7fb7963aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.779 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.779+0000 7fb7963aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.779+0000 7fb7963aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.779+0000 7fb7963aa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:52.780 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.779+0000 7fb7963aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.783+0000 7fb7963aa9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:52.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.783+0000 7fb7963aa9c0 20 zone default found 2024-09-14T11:38:52.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.783+0000 7fb7963aa9c0 4 Realm: () 2024-09-14T11:38:52.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.783+0000 7fb7963aa9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:38:52.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.783+0000 7fb7963aa9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:38:52.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.783+0000 7fb7963aa9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:52.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.783+0000 7fb7963aa9c0 20 zonegroup default 2024-09-14T11:38:52.781 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.783+0000 7fb7963aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.783+0000 7fb7963aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.783+0000 7fb7963aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.783+0000 7fb7963aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.783+0000 7fb7963aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.783+0000 7fb7963aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.783+0000 7fb7963aa9c0 20 started sync module instance, tier type = 2024-09-14T11:38:52.782 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.783+0000 7fb7963aa9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:38:52.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.803+0000 7fb7963aa9c0 20 add_watcher() i=0 2024-09-14T11:38:52.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.803+0000 7fb7963aa9c0 20 add_watcher() i=1 2024-09-14T11:38:52.800 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.803+0000 7fb7963aa9c0 20 add_watcher() i=2 2024-09-14T11:38:52.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.803+0000 7fb7963aa9c0 20 add_watcher() i=3 2024-09-14T11:38:52.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.803+0000 7fb7963aa9c0 20 add_watcher() i=4 2024-09-14T11:38:52.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.803+0000 7fb7963aa9c0 20 add_watcher() i=5 2024-09-14T11:38:52.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.803+0000 7fb7963aa9c0 20 add_watcher() i=6 2024-09-14T11:38:52.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.803+0000 7fb7963aa9c0 20 add_watcher() i=7 2024-09-14T11:38:52.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.803+0000 7fb7963aa9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:52.807 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.807+0000 7fb649fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:52.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.807+0000 7fb7963aa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:52.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.807+0000 7fb7963aa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:52.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.807+0000 7fb7963aa9c0 5 note: GC not initialized 2024-09-14T11:38:52.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.807+0000 7fb648fe1640 20 reqs_thread_entry: start 2024-09-14T11:38:52.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.807+0000 7fb7963aa9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:52.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.807+0000 7fb7963aa9c0 20 Filter name: none 2024-09-14T11:38:52.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.807+0000 7fb5c27fc640 20 reqs_thread_entry: start 2024-09-14T11:38:52.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.807+0000 7fb7963aa9c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T11:38:52.808 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.807+0000 7fb7963aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.811+0000 7fb7963aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.811+0000 7fb7963aa9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-14T11:38:52.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.811+0000 7fb7963aa9c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:38:52.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.811+0000 7fb7963aa9c0 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-14T11:38:52.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.811+0000 7fb7963aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.809 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.811+0000 7fb7963aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.811+0000 7fb7963aa9c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-14T11:38:52.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.811+0000 7fb7963aa9c0 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T11:38:52.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.811+0000 7fb7963aa9c0 10 cache get: name=default.rgw.meta+users.keys+NRJBEHEPTBQSMMSSJFNH : miss 2024-09-14T11:38:52.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.811+0000 7fb7963aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.811+0000 7fb7963aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.811+0000 7fb7963aa9c0 10 cache put: name=default.rgw.meta+users.keys+NRJBEHEPTBQSMMSSJFNH info.flags=0x0 2024-09-14T11:38:52.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.811+0000 7fb7963aa9c0 10 adding default.rgw.meta+users.keys+NRJBEHEPTBQSMMSSJFNH to cache LRU end 2024-09-14T11:38:52.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.811+0000 7fb7963aa9c0 10 cache get: name=default.rgw.meta+users.keys+NRJBEHEPTBQSMMSSJFNH : hit (negative entry) 2024-09-14T11:38:52.810 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.811+0000 7fb7963aa9c0 10 cache get: name=default.rgw.meta+users.keys+NRJBEHEPTBQSMMSSJFNH : hit (negative entry) 2024-09-14T11:38:52.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.815+0000 7fb7963aa9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:38:52.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.815+0000 7fb7963aa9c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:38:52.812 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.815+0000 7fb7963aa9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T11:38:52.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.815+0000 7fb672ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366426 cookie 94068956851552 notifier 9057 bl.length()=660 2024-09-14T11:38:52.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.815+0000 7fb672ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:38:52.813 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.815+0000 7fb672ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:38:52.815 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.815+0000 7fb7963aa9c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-14T11:38:52.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.815+0000 7fb7963aa9c0 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T11:38:52.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.815+0000 7fb7963aa9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-14T11:38:52.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.819+0000 7fb6727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366460 cookie 94068956834976 notifier 9057 bl.length()=191 2024-09-14T11:38:52.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.819+0000 7fb6727fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-14T11:38:52.816 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.819+0000 7fb6727fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T11:38:52.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.819+0000 7fb7963aa9c0 10 cache put: name=default.rgw.meta+users.keys+NRJBEHEPTBQSMMSSJFNH info.flags=0x7 2024-09-14T11:38:52.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.819+0000 7fb7963aa9c0 10 moving default.rgw.meta+users.keys+NRJBEHEPTBQSMMSSJFNH to cache LRU end 2024-09-14T11:38:52.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.819+0000 7fb7963aa9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:NRJBEHEPTBQSMMSSJFNH, ofs0, ns] 2024-09-14T11:38:52.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.819+0000 7fb672ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366461 cookie 94068956845136 notifier 9057 bl.length()=189 2024-09-14T11:38:52.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.819+0000 7fb672ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NRJBEHEPTBQSMMSSJFNH info.flags=0x7 2024-09-14T11:38:52.819 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.819+0000 7fb672ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NRJBEHEPTBQSMMSSJFNH to cache LRU end 2024-09-14T11:38:52.820 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T11:38:52.820 INFO:teuthology.orchestra.run.smithi071.stdout: "user_id": "foobar.client.0", 2024-09-14T11:38:52.820 INFO:teuthology.orchestra.run.smithi071.stdout: "display_name": "Mr.foobar.client.0", 2024-09-14T11:38:52.820 INFO:teuthology.orchestra.run.smithi071.stdout: "email": "foobar+test@test.test", 2024-09-14T11:38:52.820 INFO:teuthology.orchestra.run.smithi071.stdout: "suspended": 0, 2024-09-14T11:38:52.820 INFO:teuthology.orchestra.run.smithi071.stdout: "max_buckets": 1000, 2024-09-14T11:38:52.820 INFO:teuthology.orchestra.run.smithi071.stdout: "subusers": [], 2024-09-14T11:38:52.820 INFO:teuthology.orchestra.run.smithi071.stdout: "keys": [ 2024-09-14T11:38:52.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T11:38:52.821 INFO:teuthology.orchestra.run.smithi071.stdout: "user": "foobar.client.0", 2024-09-14T11:38:52.821 INFO:teuthology.orchestra.run.smithi071.stdout: "access_key": "NRJBEHEPTBQSMMSSJFNH", 2024-09-14T11:38:52.821 INFO:teuthology.orchestra.run.smithi071.stdout: "secret_key": "IcDel8iUIc9yhkzZr5GdZIbjT3nRk/hd5krnT3l6nAkeXxvti5HT3g==", 2024-09-14T11:38:52.821 INFO:teuthology.orchestra.run.smithi071.stdout: "active": true, 2024-09-14T11:38:52.821 INFO:teuthology.orchestra.run.smithi071.stdout: "create_date": "2024-09-14T11:38:52.815452Z" 2024-09-14T11:38:52.821 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T11:38:52.821 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-14T11:38:52.821 INFO:teuthology.orchestra.run.smithi071.stdout: "swift_keys": [], 2024-09-14T11:38:52.821 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": [], 2024-09-14T11:38:52.821 INFO:teuthology.orchestra.run.smithi071.stdout: "op_mask": "read, write, delete", 2024-09-14T11:38:52.821 INFO:teuthology.orchestra.run.smithi071.stdout: "default_placement": "", 2024-09-14T11:38:52.821 INFO:teuthology.orchestra.run.smithi071.stdout: "default_storage_class": "", 2024-09-14T11:38:52.821 INFO:teuthology.orchestra.run.smithi071.stdout: "placement_tags": [], 2024-09-14T11:38:52.822 INFO:teuthology.orchestra.run.smithi071.stdout: "bucket_quota": { 2024-09-14T11:38:52.822 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": false, 2024-09-14T11:38:52.822 INFO:teuthology.orchestra.run.smithi071.stdout: "check_on_raw": false, 2024-09-14T11:38:52.822 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size": -1, 2024-09-14T11:38:52.822 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size_kb": 0, 2024-09-14T11:38:52.822 INFO:teuthology.orchestra.run.smithi071.stdout: "max_objects": -1 2024-09-14T11:38:52.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T11:38:52.822 INFO:teuthology.orchestra.run.smithi071.stdout: "user_quota": { 2024-09-14T11:38:52.822 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": false, 2024-09-14T11:38:52.822 INFO:teuthology.orchestra.run.smithi071.stdout: "check_on_raw": false, 2024-09-14T11:38:52.822 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size": -1, 2024-09-14T11:38:52.822 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size_kb": 0, 2024-09-14T11:38:52.822 INFO:teuthology.orchestra.run.smithi071.stdout: "max_objects": -1 2024-09-14T11:38:52.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T11:38:52.822 INFO:teuthology.orchestra.run.smithi071.stdout: "temp_url_keys": [], 2024-09-14T11:38:52.823 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "rgw", 2024-09-14T11:38:52.823 INFO:teuthology.orchestra.run.smithi071.stdout: "mfa_ids": [], 2024-09-14T11:38:52.823 INFO:teuthology.orchestra.run.smithi071.stdout: "account_id": "", 2024-09-14T11:38:52.823 INFO:teuthology.orchestra.run.smithi071.stdout: "path": "/", 2024-09-14T11:38:52.823 INFO:teuthology.orchestra.run.smithi071.stdout: "create_date": "2024-09-14T11:38:52.815436Z", 2024-09-14T11:38:52.823 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-09-14T11:38:52.823 INFO:teuthology.orchestra.run.smithi071.stdout: "group_ids": [] 2024-09-14T11:38:52.823 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T11:38:52.823 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:52.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.823+0000 7fb649fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:52.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.827+0000 7fb7963aa9c0 20 remove_watcher() i=0 2024-09-14T11:38:52.825 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.827+0000 7fb7963aa9c0 2 removed watcher, disabling cache 2024-09-14T11:38:52.827 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.827+0000 7fb7963aa9c0 20 remove_watcher() i=1 2024-09-14T11:38:52.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.831+0000 7fb7963aa9c0 20 remove_watcher() i=2 2024-09-14T11:38:52.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.831+0000 7fb7963aa9c0 20 remove_watcher() i=3 2024-09-14T11:38:52.833 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.835+0000 7fb7963aa9c0 20 remove_watcher() i=4 2024-09-14T11:38:52.835 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.835+0000 7fb7963aa9c0 20 remove_watcher() i=5 2024-09-14T11:38:52.838 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.839+0000 7fb7963aa9c0 20 remove_watcher() i=6 2024-09-14T11:38:52.840 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.843+0000 7fb7963aa9c0 20 remove_watcher() i=7 2024-09-14T11:38:52.855 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 3101707587 --totp-seed RI34IMGIPGJISKX34U7WGFZSSDFYZONNCYNVZKNXWTYLFVL5FMMDHE6LNJUFC347 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:38:52.942 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:52.942 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:52.982 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.983+0000 7f72afc269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.987+0000 7f72afc269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.984 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.987+0000 7f72afc269c0 20 realm 2024-09-14T11:38:52.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.987+0000 7f72afc269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.987+0000 7f72afc269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.987+0000 7f72afc269c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:52.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.987+0000 7f72afc269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.987+0000 7f72afc269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.985 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.987+0000 7f72afc269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.987+0000 7f72afc269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:52.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.987+0000 7f72afc269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.987+0000 7f72afc269c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:52.987 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.987+0000 7f72afc269c0 20 searching for the correct realm 2024-09-14T11:38:52.991 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:52.991+0000 7f72adf2d640 0 -- 172.21.15.71:0/2769070492 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f72a404c040 msgr2=0x7f72a404c930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:53.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.203+0000 7f72adf2d640 0 -- 172.21.15.71:0/2769070492 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55f0cd62d7f0 msgr2=0x55f0cd62fbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:53.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.219+0000 7f72afc269c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:53.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.219+0000 7f72afc269c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:38:53.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.219+0000 7f72afc269c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:53.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.219+0000 7f72afc269c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:38:53.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.219+0000 7f72afc269c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:53.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.219+0000 7f72afc269c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:53.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.219+0000 7f72afc269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:53.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.219+0000 7f72afc269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:53.218 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.219+0000 7f72afc269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:53.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.219+0000 7f72afc269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:53.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.219+0000 7f72afc269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:53.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.219+0000 7f72afc269c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:53.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.223+0000 7f72afc269c0 20 zone default found 2024-09-14T11:38:53.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.223+0000 7f72afc269c0 4 Realm: () 2024-09-14T11:38:53.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.223+0000 7f72afc269c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:38:53.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.223+0000 7f72afc269c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:38:53.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.223+0000 7f72afc269c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:53.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.223+0000 7f72afc269c0 20 zonegroup default 2024-09-14T11:38:53.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.223+0000 7f72afc269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:53.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.223+0000 7f72afc269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:53.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.223+0000 7f72afc269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:53.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.223+0000 7f72afc269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:53.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.223+0000 7f72afc269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:53.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.223+0000 7f72afc269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:53.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.223+0000 7f72afc269c0 20 started sync module instance, tier type = 2024-09-14T11:38:53.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.223+0000 7f72afc269c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:38:53.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.243+0000 7f72afc269c0 20 add_watcher() i=0 2024-09-14T11:38:53.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.243+0000 7f72afc269c0 20 add_watcher() i=1 2024-09-14T11:38:53.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.243+0000 7f72afc269c0 20 add_watcher() i=2 2024-09-14T11:38:53.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.243+0000 7f72afc269c0 20 add_watcher() i=3 2024-09-14T11:38:53.243 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.243+0000 7f72afc269c0 20 add_watcher() i=4 2024-09-14T11:38:53.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.243+0000 7f72afc269c0 20 add_watcher() i=5 2024-09-14T11:38:53.244 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.243+0000 7f72afc269c0 20 add_watcher() i=6 2024-09-14T11:38:53.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.247+0000 7f72afc269c0 20 add_watcher() i=7 2024-09-14T11:38:53.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.247+0000 7f72afc269c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:53.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.251+0000 7f71637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:53.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.251+0000 7f72afc269c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:53.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.251+0000 7f72afc269c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:53.250 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.251+0000 7f72afc269c0 5 note: GC not initialized 2024-09-14T11:38:53.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.251+0000 7f71627e4640 20 reqs_thread_entry: start 2024-09-14T11:38:53.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.251+0000 7f72afc269c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:53.251 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.251+0000 7f72afc269c0 20 Filter name: none 2024-09-14T11:38:53.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.251+0000 7f70d3fff640 20 reqs_thread_entry: start 2024-09-14T11:38:53.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.251+0000 7f72afc269c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T11:38:53.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.251+0000 7f72afc269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:53.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.255+0000 7f72afc269c0 20 rados_obj.operate() r=0 bl.length=472 2024-09-14T11:38:53.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.255+0000 7f72afc269c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-14T11:38:53.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.255+0000 7f72afc269c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:38:53.253 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.255+0000 7f72afc269c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:53.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.259+0000 7f72afc269c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:38:53.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.259+0000 7f72afc269c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:38:53.258 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.259+0000 7f72afc269c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T11:38:53.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.259+0000 7f7190ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366427 cookie 94492726365168 notifier 8627 bl.length()=674 2024-09-14T11:38:53.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.259+0000 7f7190ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:38:53.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.259+0000 7f7190ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:38:53.261 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.263+0000 7f71637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:53.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.267+0000 7f72afc269c0 20 remove_watcher() i=0 2024-09-14T11:38:53.265 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.267+0000 7f72afc269c0 2 removed watcher, disabling cache 2024-09-14T11:38:53.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.267+0000 7f72afc269c0 20 remove_watcher() i=1 2024-09-14T11:38:53.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.271+0000 7f72afc269c0 20 remove_watcher() i=2 2024-09-14T11:38:53.271 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.271+0000 7f72afc269c0 20 remove_watcher() i=3 2024-09-14T11:38:53.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.275+0000 7f72afc269c0 20 remove_watcher() i=4 2024-09-14T11:38:53.275 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.275+0000 7f72afc269c0 20 remove_watcher() i=5 2024-09-14T11:38:53.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.279+0000 7f72afc269c0 20 remove_watcher() i=6 2024-09-14T11:38:53.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.283+0000 7f72afc269c0 20 remove_watcher() i=7 2024-09-14T11:38:53.297 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-14T11:38:53.330 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:53.330 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:53.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.371+0000 7fce0abe19c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:53.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.375+0000 7fce0abe19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:53.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.375+0000 7fce0abe19c0 20 realm 2024-09-14T11:38:53.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.375+0000 7fce0abe19c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:53.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.375+0000 7fce0abe19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:53.373 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.375+0000 7fce0abe19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:53.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.375+0000 7fce0abe19c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:53.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.375+0000 7fce0abe19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:53.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.375+0000 7fce0abe19c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:53.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.375+0000 7fce0abe19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:53.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.375+0000 7fce0abe19c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:53.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.375+0000 7fce0abe19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:53.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.375+0000 7fce0abe19c0 20 searching for the correct realm 2024-09-14T11:38:53.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.379+0000 7fce08ee8640 0 -- 172.21.15.71:0/780403479 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fcdfc031060 msgr2=0x7fcdfc062fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:53.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.595+0000 7fce08ee8640 0 -- 172.21.15.71:0/780403479 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x564e73aeb060 msgr2=0x564e73aed450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:53.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.607+0000 7fce0abe19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:53.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.607+0000 7fce0abe19c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:38:53.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.607+0000 7fce0abe19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:53.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.607+0000 7fce0abe19c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:38:53.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.607+0000 7fce0abe19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:53.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.607+0000 7fce0abe19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:53.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.607+0000 7fce0abe19c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:53.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.607+0000 7fce0abe19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:53.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.607+0000 7fce0abe19c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:53.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.611+0000 7fce0abe19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:53.608 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.611+0000 7fce0abe19c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:53.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.611+0000 7fce0abe19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:53.609 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.611+0000 7fce0abe19c0 20 zone default found 2024-09-14T11:38:53.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.611+0000 7fce0abe19c0 4 Realm: () 2024-09-14T11:38:53.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.611+0000 7fce0abe19c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:38:53.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.611+0000 7fce0abe19c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:38:53.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.611+0000 7fce0abe19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:53.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.611+0000 7fce0abe19c0 20 zonegroup default 2024-09-14T11:38:53.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.611+0000 7fce0abe19c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:53.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.611+0000 7fce0abe19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:53.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.611+0000 7fce0abe19c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:53.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.611+0000 7fce0abe19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:53.611 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.611+0000 7fce0abe19c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:53.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.615+0000 7fce0abe19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:53.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.615+0000 7fce0abe19c0 20 started sync module instance, tier type = 2024-09-14T11:38:53.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.615+0000 7fce0abe19c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:38:53.636 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.639+0000 7fce0abe19c0 20 add_watcher() i=0 2024-09-14T11:38:53.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.639+0000 7fce0abe19c0 20 add_watcher() i=1 2024-09-14T11:38:53.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.639+0000 7fce0abe19c0 20 add_watcher() i=2 2024-09-14T11:38:53.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.639+0000 7fce0abe19c0 20 add_watcher() i=3 2024-09-14T11:38:53.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.639+0000 7fce0abe19c0 20 add_watcher() i=4 2024-09-14T11:38:53.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.639+0000 7fce0abe19c0 20 add_watcher() i=5 2024-09-14T11:38:53.637 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.639+0000 7fce0abe19c0 20 add_watcher() i=6 2024-09-14T11:38:53.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.639+0000 7fce0abe19c0 20 add_watcher() i=7 2024-09-14T11:38:53.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.639+0000 7fce0abe19c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:53.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.643+0000 7fccbefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:53.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.643+0000 7fce0abe19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:53.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.643+0000 7fce0abe19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:53.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.643+0000 7fce0abe19c0 5 note: GC not initialized 2024-09-14T11:38:53.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.643+0000 7fccbdfdb640 20 reqs_thread_entry: start 2024-09-14T11:38:53.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.647+0000 7fce0abe19c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:53.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.647+0000 7fce0abe19c0 20 Filter name: none 2024-09-14T11:38:53.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.647+0000 7fcc2f7fe640 20 reqs_thread_entry: start 2024-09-14T11:38:53.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.647+0000 7fce0abe19c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T11:38:53.645 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.647+0000 7fce0abe19c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:53.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.647+0000 7fce0abe19c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:38:53.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.647+0000 7fce0abe19c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-14T11:38:53.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.647+0000 7fce0abe19c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:38:53.646 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.647+0000 7fce0abe19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:53.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.651+0000 7fce0abe19c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:38:53.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.651+0000 7fce0abe19c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:38:53.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.651+0000 7fce0abe19c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T11:38:53.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.651+0000 7fccdf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366428 cookie 94894948307216 notifier 9096 bl.length()=727 2024-09-14T11:38:53.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.651+0000 7fccdf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:38:53.650 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.651+0000 7fccdf7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:38:53.651 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T11:38:53.652 INFO:teuthology.orchestra.run.smithi071.stdout: "user_id": "foobar.client.0", 2024-09-14T11:38:53.652 INFO:teuthology.orchestra.run.smithi071.stdout: "display_name": "Mr.foobar.client.0", 2024-09-14T11:38:53.652 INFO:teuthology.orchestra.run.smithi071.stdout: "email": "foobar+test@test.test", 2024-09-14T11:38:53.652 INFO:teuthology.orchestra.run.smithi071.stdout: "suspended": 0, 2024-09-14T11:38:53.652 INFO:teuthology.orchestra.run.smithi071.stdout: "max_buckets": 1000, 2024-09-14T11:38:53.652 INFO:teuthology.orchestra.run.smithi071.stdout: "subusers": [], 2024-09-14T11:38:53.652 INFO:teuthology.orchestra.run.smithi071.stdout: "keys": [ 2024-09-14T11:38:53.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T11:38:53.652 INFO:teuthology.orchestra.run.smithi071.stdout: "user": "foobar.client.0", 2024-09-14T11:38:53.652 INFO:teuthology.orchestra.run.smithi071.stdout: "access_key": "NRJBEHEPTBQSMMSSJFNH", 2024-09-14T11:38:53.652 INFO:teuthology.orchestra.run.smithi071.stdout: "secret_key": "IcDel8iUIc9yhkzZr5GdZIbjT3nRk/hd5krnT3l6nAkeXxvti5HT3g==", 2024-09-14T11:38:53.653 INFO:teuthology.orchestra.run.smithi071.stdout: "active": true, 2024-09-14T11:38:53.653 INFO:teuthology.orchestra.run.smithi071.stdout: "create_date": "2024-09-14T11:38:52.815452Z" 2024-09-14T11:38:53.653 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T11:38:53.653 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-14T11:38:53.653 INFO:teuthology.orchestra.run.smithi071.stdout: "swift_keys": [], 2024-09-14T11:38:53.653 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": [ 2024-09-14T11:38:53.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T11:38:53.653 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "oidc-provider", 2024-09-14T11:38:53.653 INFO:teuthology.orchestra.run.smithi071.stdout: "perm": "*" 2024-09-14T11:38:53.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T11:38:53.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T11:38:53.653 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "roles", 2024-09-14T11:38:53.654 INFO:teuthology.orchestra.run.smithi071.stdout: "perm": "*" 2024-09-14T11:38:53.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T11:38:53.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T11:38:53.654 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "user-policy", 2024-09-14T11:38:53.654 INFO:teuthology.orchestra.run.smithi071.stdout: "perm": "*" 2024-09-14T11:38:53.654 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T11:38:53.654 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-14T11:38:53.654 INFO:teuthology.orchestra.run.smithi071.stdout: "op_mask": "read, write, delete", 2024-09-14T11:38:53.654 INFO:teuthology.orchestra.run.smithi071.stdout: "default_placement": "", 2024-09-14T11:38:53.654 INFO:teuthology.orchestra.run.smithi071.stdout: "default_storage_class": "", 2024-09-14T11:38:53.654 INFO:teuthology.orchestra.run.smithi071.stdout: "placement_tags": [], 2024-09-14T11:38:53.654 INFO:teuthology.orchestra.run.smithi071.stdout: "bucket_quota": { 2024-09-14T11:38:53.654 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": false, 2024-09-14T11:38:53.655 INFO:teuthology.orchestra.run.smithi071.stdout: "check_on_raw": false, 2024-09-14T11:38:53.655 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size": -1, 2024-09-14T11:38:53.655 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size_kb": 0, 2024-09-14T11:38:53.655 INFO:teuthology.orchestra.run.smithi071.stdout: "max_objects": -1 2024-09-14T11:38:53.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T11:38:53.655 INFO:teuthology.orchestra.run.smithi071.stdout: "user_quota": { 2024-09-14T11:38:53.655 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": false, 2024-09-14T11:38:53.655 INFO:teuthology.orchestra.run.smithi071.stdout: "check_on_raw": false, 2024-09-14T11:38:53.655 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size": -1, 2024-09-14T11:38:53.655 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size_kb": 0, 2024-09-14T11:38:53.655 INFO:teuthology.orchestra.run.smithi071.stdout: "max_objects": -1 2024-09-14T11:38:53.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T11:38:53.655 INFO:teuthology.orchestra.run.smithi071.stdout: "temp_url_keys": [], 2024-09-14T11:38:53.655 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "rgw", 2024-09-14T11:38:53.655 INFO:teuthology.orchestra.run.smithi071.stdout: "mfa_ids": [ 2024-09-14T11:38:53.656 INFO:teuthology.orchestra.run.smithi071.stdout: "3101707587" 2024-09-14T11:38:53.656 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-14T11:38:53.656 INFO:teuthology.orchestra.run.smithi071.stdout: "account_id": "", 2024-09-14T11:38:53.656 INFO:teuthology.orchestra.run.smithi071.stdout: "path": "/", 2024-09-14T11:38:53.656 INFO:teuthology.orchestra.run.smithi071.stdout: "create_date": "2024-09-14T11:38:52.815436Z", 2024-09-14T11:38:53.656 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-09-14T11:38:53.656 INFO:teuthology.orchestra.run.smithi071.stdout: "group_ids": [] 2024-09-14T11:38:53.656 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T11:38:53.656 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:53.657 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.655+0000 7fccbefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:53.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.659+0000 7fce0abe19c0 20 remove_watcher() i=0 2024-09-14T11:38:53.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.659+0000 7fce0abe19c0 2 removed watcher, disabling cache 2024-09-14T11:38:53.659 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.659+0000 7fce0abe19c0 20 remove_watcher() i=1 2024-09-14T11:38:53.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.663+0000 7fce0abe19c0 20 remove_watcher() i=2 2024-09-14T11:38:53.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.663+0000 7fce0abe19c0 20 remove_watcher() i=3 2024-09-14T11:38:53.666 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.667+0000 7fce0abe19c0 20 remove_watcher() i=4 2024-09-14T11:38:53.668 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.671+0000 7fce0abe19c0 20 remove_watcher() i=5 2024-09-14T11:38:53.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.671+0000 7fce0abe19c0 20 remove_watcher() i=6 2024-09-14T11:38:53.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.675+0000 7fce0abe19c0 20 remove_watcher() i=7 2024-09-14T11:38:53.690 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-14T11:38:53.776 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:53.776 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:53.818 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.819+0000 7f398c78b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:53.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.823+0000 7f398c78b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:53.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.823+0000 7f398c78b9c0 20 realm 2024-09-14T11:38:53.820 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.823+0000 7f398c78b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:53.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.823+0000 7f398c78b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:53.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.823+0000 7f398c78b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:53.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.823+0000 7f398c78b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:53.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.823+0000 7f398c78b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:53.821 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.823+0000 7f398c78b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:53.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.823+0000 7f398c78b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:53.822 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.823+0000 7f398c78b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:53.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.823+0000 7f398c78b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:53.823 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.823+0000 7f398c78b9c0 20 searching for the correct realm 2024-09-14T11:38:53.828 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:53.827+0000 7f398a291640 0 -- 172.21.15.71:0/3557494434 >> [v2:172.21.15.157:6808/527702018,v1:172.21.15.157:6809/527702018] conn(0x7f398401b3c0 msgr2=0x7f398401b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:54.041 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.043+0000 7f398a291640 0 -- 172.21.15.71:0/3557494434 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x558708777910 msgr2=0x558708779dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:54.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.051+0000 7f398c78b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:54.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.051+0000 7f398c78b9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:38:54.050 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.051+0000 7f398c78b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:54.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.051+0000 7f398c78b9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:38:54.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.051+0000 7f398c78b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:54.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.051+0000 7f398c78b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:54.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.051+0000 7f398c78b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.051+0000 7f398c78b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.051+0000 7f398c78b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.051+0000 7f398c78b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:54.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.055+0000 7f398c78b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.055+0000 7f398c78b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:54.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.055+0000 7f398c78b9c0 20 zone default found 2024-09-14T11:38:54.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.055+0000 7f398c78b9c0 4 Realm: () 2024-09-14T11:38:54.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.055+0000 7f398c78b9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:38:54.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.055+0000 7f398c78b9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:38:54.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.055+0000 7f398c78b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:54.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.055+0000 7f398c78b9c0 20 zonegroup default 2024-09-14T11:38:54.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.055+0000 7f398c78b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.055+0000 7f398c78b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.055+0000 7f398c78b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.055+0000 7f398c78b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.055+0000 7f398c78b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.055+0000 7f398c78b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.055+0000 7f398c78b9c0 20 started sync module instance, tier type = 2024-09-14T11:38:54.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.055+0000 7f398c78b9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:38:54.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.079+0000 7f398c78b9c0 20 add_watcher() i=0 2024-09-14T11:38:54.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.079+0000 7f398c78b9c0 20 add_watcher() i=1 2024-09-14T11:38:54.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.079+0000 7f398c78b9c0 20 add_watcher() i=2 2024-09-14T11:38:54.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.079+0000 7f398c78b9c0 20 add_watcher() i=3 2024-09-14T11:38:54.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.079+0000 7f398c78b9c0 20 add_watcher() i=4 2024-09-14T11:38:54.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.079+0000 7f398c78b9c0 20 add_watcher() i=5 2024-09-14T11:38:54.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.079+0000 7f398c78b9c0 20 add_watcher() i=6 2024-09-14T11:38:54.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.083+0000 7f398c78b9c0 20 add_watcher() i=7 2024-09-14T11:38:54.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.083+0000 7f398c78b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:54.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.087+0000 7f3840fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:54.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.087+0000 7f398c78b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:54.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.087+0000 7f398c78b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:54.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.087+0000 7f398c78b9c0 5 note: GC not initialized 2024-09-14T11:38:54.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.087+0000 7f37bb7fe640 20 reqs_thread_entry: start 2024-09-14T11:38:54.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.087+0000 7f398c78b9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:54.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.087+0000 7f398c78b9c0 20 Filter name: none 2024-09-14T11:38:54.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.087+0000 7f37b97fa640 20 reqs_thread_entry: start 2024-09-14T11:38:54.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.087+0000 7f398c78b9c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-14T11:38:54.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.087+0000 7f398c78b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.087+0000 7f398c78b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.087+0000 7f398c78b9c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-14T11:38:54.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.087+0000 7f398c78b9c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T11:38:54.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.087+0000 7f398c78b9c0 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-14T11:38:54.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.087+0000 7f398c78b9c0 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-14T11:38:54.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.087+0000 7f398c78b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.087+0000 7f398c78b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.087+0000 7f398c78b9c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-14T11:38:54.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.087+0000 7f398c78b9c0 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T11:38:54.088 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.087+0000 7f398c78b9c0 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-14T11:38:54.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.091+0000 7f398c78b9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T11:38:54.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.091+0000 7f398c78b9c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T11:38:54.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.091+0000 7f398c78b9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-14T11:38:54.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.091+0000 7f386dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366462 cookie 94038451005584 notifier 8663 bl.length()=384 2024-09-14T11:38:54.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.091+0000 7f386dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T11:38:54.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.091+0000 7f386dffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T11:38:54.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.095+0000 7f398c78b9c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-14T11:38:54.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.095+0000 7f398c78b9c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T11:38:54.093 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.095+0000 7f398c78b9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-14T11:38:54.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.095+0000 7f386dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366463 cookie 94038451021136 notifier 8663 bl.length()=225 2024-09-14T11:38:54.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.095+0000 7f386dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-14T11:38:54.094 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.095+0000 7f386dffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T11:38:54.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.099+0000 7f398c78b9c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-14T11:38:54.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.099+0000 7f398c78b9c0 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T11:38:54.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.099+0000 7f398c78b9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-14T11:38:54.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.099+0000 7f386d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366232 cookie 94038451016368 notifier 8663 bl.length()=234 2024-09-14T11:38:54.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.099+0000 7f386d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-14T11:38:54.097 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.099+0000 7f386d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T11:38:54.099 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.099+0000 7f3840fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:54.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.103+0000 7f398c78b9c0 20 remove_watcher() i=0 2024-09-14T11:38:54.103 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.103+0000 7f398c78b9c0 2 removed watcher, disabling cache 2024-09-14T11:38:54.105 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.107+0000 7f398c78b9c0 20 remove_watcher() i=1 2024-09-14T11:38:54.107 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.107+0000 7f398c78b9c0 20 remove_watcher() i=2 2024-09-14T11:38:54.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.111+0000 7f398c78b9c0 20 remove_watcher() i=3 2024-09-14T11:38:54.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.111+0000 7f398c78b9c0 20 remove_watcher() i=4 2024-09-14T11:38:54.113 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.115+0000 7f398c78b9c0 20 remove_watcher() i=5 2024-09-14T11:38:54.115 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.115+0000 7f398c78b9c0 20 remove_watcher() i=6 2024-09-14T11:38:54.117 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.119+0000 7f398c78b9c0 20 remove_watcher() i=7 2024-09-14T11:38:54.132 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T11:38:54.132 INFO:teuthology.orchestra.run.smithi071.stdout: "id": "RGW88888888888888888", 2024-09-14T11:38:54.132 INFO:teuthology.orchestra.run.smithi071.stdout: "tenant": "", 2024-09-14T11:38:54.132 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "Mr.RGW88888888888888888", 2024-09-14T11:38:54.132 INFO:teuthology.orchestra.run.smithi071.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-14T11:38:54.132 INFO:teuthology.orchestra.run.smithi071.stdout: "quota": { 2024-09-14T11:38:54.132 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": false, 2024-09-14T11:38:54.132 INFO:teuthology.orchestra.run.smithi071.stdout: "check_on_raw": false, 2024-09-14T11:38:54.132 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size": -1, 2024-09-14T11:38:54.132 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size_kb": 0, 2024-09-14T11:38:54.132 INFO:teuthology.orchestra.run.smithi071.stdout: "max_objects": -1 2024-09-14T11:38:54.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T11:38:54.133 INFO:teuthology.orchestra.run.smithi071.stdout: "bucket_quota": { 2024-09-14T11:38:54.133 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": false, 2024-09-14T11:38:54.133 INFO:teuthology.orchestra.run.smithi071.stdout: "check_on_raw": false, 2024-09-14T11:38:54.133 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size": -1, 2024-09-14T11:38:54.133 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size_kb": 0, 2024-09-14T11:38:54.133 INFO:teuthology.orchestra.run.smithi071.stdout: "max_objects": -1 2024-09-14T11:38:54.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T11:38:54.133 INFO:teuthology.orchestra.run.smithi071.stdout: "max_users": 1000, 2024-09-14T11:38:54.133 INFO:teuthology.orchestra.run.smithi071.stdout: "max_roles": 1000, 2024-09-14T11:38:54.133 INFO:teuthology.orchestra.run.smithi071.stdout: "max_groups": 1000, 2024-09-14T11:38:54.133 INFO:teuthology.orchestra.run.smithi071.stdout: "max_buckets": 1000, 2024-09-14T11:38:54.133 INFO:teuthology.orchestra.run.smithi071.stdout: "max_access_keys": 4 2024-09-14T11:38:54.133 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T11:38:54.134 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-14T11:38:54.135 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key FPVPUXKHDJYYGOCEUIAV --secret bOvofiT7tR0lF8eCvcKHy8yMomx/ch3/W/giu1ICZPwPV6xzHm+VbA== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-14T11:38:54.228 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:54.228 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:54.270 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.271+0000 7f9dee7849c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.271+0000 7f9dee7849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.271+0000 7f9dee7849c0 20 realm 2024-09-14T11:38:54.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.271+0000 7f9dee7849c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.275+0000 7f9dee7849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.272 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.275+0000 7f9dee7849c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:54.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.275+0000 7f9dee7849c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.275+0000 7f9dee7849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.275+0000 7f9dee7849c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.275+0000 7f9dee7849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:54.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.275+0000 7f9dee7849c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.275+0000 7f9dee7849c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:54.274 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.275+0000 7f9dee7849c0 20 searching for the correct realm 2024-09-14T11:38:54.279 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.279+0000 7f9deca8b640 0 -- 172.21.15.71:0/2884626987 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f9de0046040 msgr2=0x7f9de0046930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:54.285 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.287+0000 7f9deca8b640 0 -- 172.21.15.71:0/2884626987 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55f6e64046d0 msgr2=0x55f6e6406b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:54.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.295+0000 7f9dee7849c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:54.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.295+0000 7f9dee7849c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:38:54.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.295+0000 7f9dee7849c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:54.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.295+0000 7f9dee7849c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:38:54.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.295+0000 7f9dee7849c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:54.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.295+0000 7f9dee7849c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:54.294 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.295+0000 7f9dee7849c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.295+0000 7f9dee7849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.295+0000 7f9dee7849c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.295+0000 7f9dee7849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:54.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.295+0000 7f9dee7849c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.295+0000 7f9dee7849c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:54.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.295+0000 7f9dee7849c0 20 zone default found 2024-09-14T11:38:54.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.295+0000 7f9dee7849c0 4 Realm: () 2024-09-14T11:38:54.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.295+0000 7f9dee7849c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:38:54.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.295+0000 7f9dee7849c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:38:54.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.295+0000 7f9dee7849c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:54.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.295+0000 7f9dee7849c0 20 zonegroup default 2024-09-14T11:38:54.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.295+0000 7f9dee7849c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.295+0000 7f9dee7849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.295+0000 7f9dee7849c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.299+0000 7f9dee7849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.299+0000 7f9dee7849c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.299+0000 7f9dee7849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.299+0000 7f9dee7849c0 20 started sync module instance, tier type = 2024-09-14T11:38:54.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.299+0000 7f9dee7849c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:38:54.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.315+0000 7f9dee7849c0 20 add_watcher() i=0 2024-09-14T11:38:54.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.315+0000 7f9dee7849c0 20 add_watcher() i=1 2024-09-14T11:38:54.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.315+0000 7f9dee7849c0 20 add_watcher() i=2 2024-09-14T11:38:54.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.315+0000 7f9dee7849c0 20 add_watcher() i=3 2024-09-14T11:38:54.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.315+0000 7f9dee7849c0 20 add_watcher() i=4 2024-09-14T11:38:54.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.315+0000 7f9dee7849c0 20 add_watcher() i=5 2024-09-14T11:38:54.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.315+0000 7f9dee7849c0 20 add_watcher() i=6 2024-09-14T11:38:54.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.319+0000 7f9dee7849c0 20 add_watcher() i=7 2024-09-14T11:38:54.317 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.319+0000 7f9dee7849c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:54.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.323+0000 7f9ca2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:54.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.323+0000 7f9dee7849c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:54.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.323+0000 7f9dee7849c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:54.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.323+0000 7f9dee7849c0 5 note: GC not initialized 2024-09-14T11:38:54.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.323+0000 7f9ca1fdb640 20 reqs_thread_entry: start 2024-09-14T11:38:54.321 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.323+0000 7f9dee7849c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:54.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.323+0000 7f9dee7849c0 20 Filter name: none 2024-09-14T11:38:54.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.323+0000 7f9c137fe640 20 reqs_thread_entry: start 2024-09-14T11:38:54.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.323+0000 7f9dee7849c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-14T11:38:54.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.323+0000 7f9dee7849c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.323+0000 7f9dee7849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.323+0000 7f9dee7849c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-14T11:38:54.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.323+0000 7f9dee7849c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:38:54.322 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.323+0000 7f9dee7849c0 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-14T11:38:54.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.323+0000 7f9dee7849c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.323+0000 7f9dee7849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.323+0000 7f9dee7849c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-14T11:38:54.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.323+0000 7f9dee7849c0 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T11:38:54.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.323+0000 7f9dee7849c0 10 cache get: name=default.rgw.meta+users.keys+FPVPUXKHDJYYGOCEUIAV : miss 2024-09-14T11:38:54.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.323+0000 7f9dee7849c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.323+0000 7f9dee7849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.323+0000 7f9dee7849c0 10 cache put: name=default.rgw.meta+users.keys+FPVPUXKHDJYYGOCEUIAV info.flags=0x0 2024-09-14T11:38:54.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.323+0000 7f9dee7849c0 10 adding default.rgw.meta+users.keys+FPVPUXKHDJYYGOCEUIAV to cache LRU end 2024-09-14T11:38:54.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.323+0000 7f9dee7849c0 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-14T11:38:54.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.323+0000 7f9dee7849c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.324 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.327+0000 7f9dee7849c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-14T11:38:54.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.327+0000 7f9dee7849c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T11:38:54.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.327+0000 7f9dee7849c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T11:38:54.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.327+0000 7f9dee7849c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:54.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.327+0000 7f9dee7849c0 10 cache get: name=default.rgw.meta+users.keys+FPVPUXKHDJYYGOCEUIAV : hit (negative entry) 2024-09-14T11:38:54.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.327+0000 7f9dee7849c0 10 cache get: name=default.rgw.meta+users.keys+FPVPUXKHDJYYGOCEUIAV : hit (negative entry) 2024-09-14T11:38:54.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.327+0000 7f9dee7849c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:38:54.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.327+0000 7f9dee7849c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:38:54.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.327+0000 7f9dee7849c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-14T11:38:54.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.331+0000 7f9cc37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366464 cookie 94518913293808 notifier 9132 bl.length()=681 2024-09-14T11:38:54.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.331+0000 7f9cc37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:38:54.328 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.331+0000 7f9cc37fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:38:54.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.331+0000 7f9dee7849c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-14T11:38:54.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.331+0000 7f9dee7849c0 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T11:38:54.332 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.331+0000 7f9dee7849c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-14T11:38:54.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.335+0000 7f9cc37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366429 cookie 94518913334048 notifier 9132 bl.length()=189 2024-09-14T11:38:54.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.335+0000 7f9cc37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-14T11:38:54.333 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.335+0000 7f9cc37fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T11:38:54.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.339+0000 7f9dee7849c0 10 cache put: name=default.rgw.meta+users.keys+FPVPUXKHDJYYGOCEUIAV info.flags=0x7 2024-09-14T11:38:54.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.339+0000 7f9dee7849c0 10 moving default.rgw.meta+users.keys+FPVPUXKHDJYYGOCEUIAV to cache LRU end 2024-09-14T11:38:54.337 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.339+0000 7f9dee7849c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:FPVPUXKHDJYYGOCEUIAV, ofs0, ns] 2024-09-14T11:38:54.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.339+0000 7f9cc37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366219 cookie 94518913296016 notifier 9132 bl.length()=188 2024-09-14T11:38:54.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.339+0000 7f9cc37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+FPVPUXKHDJYYGOCEUIAV info.flags=0x7 2024-09-14T11:38:54.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.339+0000 7f9cc37fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+FPVPUXKHDJYYGOCEUIAV to cache LRU end 2024-09-14T11:38:54.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.343+0000 7f9dee7849c0 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-14T11:38:54.341 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T11:38:54.341 INFO:teuthology.orchestra.run.smithi071.stdout: "user_id": "root1.client.0", 2024-09-14T11:38:54.341 INFO:teuthology.orchestra.run.smithi071.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-14T11:38:54.341 INFO:teuthology.orchestra.run.smithi071.stdout: "email": "root1+test@test.test", 2024-09-14T11:38:54.341 INFO:teuthology.orchestra.run.smithi071.stdout: "suspended": 0, 2024-09-14T11:38:54.341 INFO:teuthology.orchestra.run.smithi071.stdout: "max_buckets": 1000, 2024-09-14T11:38:54.341 INFO:teuthology.orchestra.run.smithi071.stdout: "subusers": [], 2024-09-14T11:38:54.341 INFO:teuthology.orchestra.run.smithi071.stdout: "keys": [ 2024-09-14T11:38:54.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T11:38:54.341 INFO:teuthology.orchestra.run.smithi071.stdout: "user": "root1.client.0", 2024-09-14T11:38:54.341 INFO:teuthology.orchestra.run.smithi071.stdout: "access_key": "FPVPUXKHDJYYGOCEUIAV", 2024-09-14T11:38:54.341 INFO:teuthology.orchestra.run.smithi071.stdout: "secret_key": "bOvofiT7tR0lF8eCvcKHy8yMomx/ch3/W/giu1ICZPwPV6xzHm+VbA==", 2024-09-14T11:38:54.342 INFO:teuthology.orchestra.run.smithi071.stdout: "active": true, 2024-09-14T11:38:54.342 INFO:teuthology.orchestra.run.smithi071.stdout: "create_date": "2024-09-14T11:38:54.330587Z" 2024-09-14T11:38:54.342 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T11:38:54.342 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-14T11:38:54.342 INFO:teuthology.orchestra.run.smithi071.stdout: "swift_keys": [], 2024-09-14T11:38:54.342 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": [], 2024-09-14T11:38:54.342 INFO:teuthology.orchestra.run.smithi071.stdout: "op_mask": "read, write, delete", 2024-09-14T11:38:54.342 INFO:teuthology.orchestra.run.smithi071.stdout: "default_placement": "", 2024-09-14T11:38:54.342 INFO:teuthology.orchestra.run.smithi071.stdout: "default_storage_class": "", 2024-09-14T11:38:54.342 INFO:teuthology.orchestra.run.smithi071.stdout: "placement_tags": [], 2024-09-14T11:38:54.342 INFO:teuthology.orchestra.run.smithi071.stdout: "bucket_quota": { 2024-09-14T11:38:54.342 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": false, 2024-09-14T11:38:54.342 INFO:teuthology.orchestra.run.smithi071.stdout: "check_on_raw": false, 2024-09-14T11:38:54.343 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size": -1, 2024-09-14T11:38:54.343 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size_kb": 0, 2024-09-14T11:38:54.343 INFO:teuthology.orchestra.run.smithi071.stdout: "max_objects": -1 2024-09-14T11:38:54.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T11:38:54.343 INFO:teuthology.orchestra.run.smithi071.stdout: "user_quota": { 2024-09-14T11:38:54.343 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": false, 2024-09-14T11:38:54.343 INFO:teuthology.orchestra.run.smithi071.stdout: "check_on_raw": false, 2024-09-14T11:38:54.343 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size": -1, 2024-09-14T11:38:54.343 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size_kb": 0, 2024-09-14T11:38:54.343 INFO:teuthology.orchestra.run.smithi071.stdout: "max_objects": -1 2024-09-14T11:38:54.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T11:38:54.343 INFO:teuthology.orchestra.run.smithi071.stdout: "temp_url_keys": [], 2024-09-14T11:38:54.343 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "root", 2024-09-14T11:38:54.343 INFO:teuthology.orchestra.run.smithi071.stdout: "mfa_ids": [], 2024-09-14T11:38:54.344 INFO:teuthology.orchestra.run.smithi071.stdout: "account_id": "RGW88888888888888888", 2024-09-14T11:38:54.344 INFO:teuthology.orchestra.run.smithi071.stdout: "path": "/", 2024-09-14T11:38:54.344 INFO:teuthology.orchestra.run.smithi071.stdout: "create_date": "2024-09-14T11:38:54.330572Z", 2024-09-14T11:38:54.344 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-09-14T11:38:54.344 INFO:teuthology.orchestra.run.smithi071.stdout: "group_ids": [] 2024-09-14T11:38:54.344 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T11:38:54.344 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:54.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.343+0000 7f9ca2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:54.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.351+0000 7f9dee7849c0 20 remove_watcher() i=0 2024-09-14T11:38:54.348 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.351+0000 7f9dee7849c0 2 removed watcher, disabling cache 2024-09-14T11:38:54.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.351+0000 7f9dee7849c0 20 remove_watcher() i=1 2024-09-14T11:38:54.352 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.351+0000 7f9dee7849c0 20 remove_watcher() i=2 2024-09-14T11:38:54.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.355+0000 7f9dee7849c0 20 remove_watcher() i=3 2024-09-14T11:38:54.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.355+0000 7f9dee7849c0 20 remove_watcher() i=4 2024-09-14T11:38:54.358 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.359+0000 7f9dee7849c0 20 remove_watcher() i=5 2024-09-14T11:38:54.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.363+0000 7f9dee7849c0 20 remove_watcher() i=6 2024-09-14T11:38:54.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.363+0000 7f9dee7849c0 20 remove_watcher() i=7 2024-09-14T11:38:54.378 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 0512132974 --totp-seed DY6QECDIT5HQFT2Z6JZAFQGMJJZLDUDAFSERM4724GH4W5ICV4RSUA7JPKOCM2GH --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:38:54.417 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:54.418 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:54.457 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.459+0000 7f5e56a2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.459+0000 7f5e56a2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.459+0000 7f5e56a2f9c0 20 realm 2024-09-14T11:38:54.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.459+0000 7f5e56a2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.459+0000 7f5e56a2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.459+0000 7f5e56a2f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:54.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.459+0000 7f5e56a2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.460 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.463+0000 7f5e56a2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.463+0000 7f5e56a2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.463+0000 7f5e56a2f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:54.461 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.463+0000 7f5e56a2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.463+0000 7f5e56a2f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:54.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.463+0000 7f5e56a2f9c0 20 searching for the correct realm 2024-09-14T11:38:54.465 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.467+0000 7f5e54d36640 0 -- 172.21.15.71:0/1916423546 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f5e48019040 msgr2=0x7f5e48071970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:54.473 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.475+0000 7f5e54d36640 0 -- 172.21.15.71:0/1916423546 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55a6cc3c91c0 msgr2=0x55a6cc3cb5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:54.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.483+0000 7f5e56a2f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:54.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.483+0000 7f5e56a2f9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:38:54.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.483+0000 7f5e56a2f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:54.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.483+0000 7f5e56a2f9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:38:54.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.483+0000 7f5e56a2f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:54.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.483+0000 7f5e56a2f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:54.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.483+0000 7f5e56a2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.483+0000 7f5e56a2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.483+0000 7f5e56a2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.483+0000 7f5e56a2f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:54.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.483+0000 7f5e56a2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.483+0000 7f5e56a2f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:54.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.483+0000 7f5e56a2f9c0 20 zone default found 2024-09-14T11:38:54.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.483+0000 7f5e56a2f9c0 4 Realm: () 2024-09-14T11:38:54.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.483+0000 7f5e56a2f9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:38:54.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.483+0000 7f5e56a2f9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:38:54.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.483+0000 7f5e56a2f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:54.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.483+0000 7f5e56a2f9c0 20 zonegroup default 2024-09-14T11:38:54.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.483+0000 7f5e56a2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.483+0000 7f5e56a2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.483+0000 7f5e56a2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.487+0000 7f5e56a2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.487+0000 7f5e56a2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.487+0000 7f5e56a2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.487+0000 7f5e56a2f9c0 20 started sync module instance, tier type = 2024-09-14T11:38:54.485 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.487+0000 7f5e56a2f9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:38:54.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.503+0000 7f5e56a2f9c0 20 add_watcher() i=0 2024-09-14T11:38:54.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.503+0000 7f5e56a2f9c0 20 add_watcher() i=1 2024-09-14T11:38:54.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.503+0000 7f5e56a2f9c0 20 add_watcher() i=2 2024-09-14T11:38:54.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.503+0000 7f5e56a2f9c0 20 add_watcher() i=3 2024-09-14T11:38:54.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.503+0000 7f5e56a2f9c0 20 add_watcher() i=4 2024-09-14T11:38:54.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.503+0000 7f5e56a2f9c0 20 add_watcher() i=5 2024-09-14T11:38:54.502 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.503+0000 7f5e56a2f9c0 20 add_watcher() i=6 2024-09-14T11:38:54.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.507+0000 7f5e56a2f9c0 20 add_watcher() i=7 2024-09-14T11:38:54.504 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.507+0000 7f5e56a2f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:54.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.511+0000 7f5d0afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:54.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.511+0000 7f5e56a2f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:54.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.511+0000 7f5e56a2f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:54.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.511+0000 7f5e56a2f9c0 5 note: GC not initialized 2024-09-14T11:38:54.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.511+0000 7f5d09fdb640 20 reqs_thread_entry: start 2024-09-14T11:38:54.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.511+0000 7f5e56a2f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:54.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.511+0000 7f5e56a2f9c0 20 Filter name: none 2024-09-14T11:38:54.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.511+0000 7f5c7b7fe640 20 reqs_thread_entry: start 2024-09-14T11:38:54.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.511+0000 7f5e56a2f9c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-14T11:38:54.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.511+0000 7f5e56a2f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.511+0000 7f5e56a2f9c0 20 rados_obj.operate() r=0 bl.length=494 2024-09-14T11:38:54.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.511+0000 7f5e56a2f9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-14T11:38:54.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.511+0000 7f5e56a2f9c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:38:54.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.511+0000 7f5e56a2f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:54.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.515+0000 7f5e56a2f9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:38:54.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.515+0000 7f5e56a2f9c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:38:54.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.515+0000 7f5e56a2f9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-14T11:38:54.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.519+0000 7f5d2b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366465 cookie 94174879459264 notifier 9147 bl.length()=695 2024-09-14T11:38:54.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.519+0000 7f5d2b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:38:54.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.519+0000 7f5d2b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:38:54.518 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.519+0000 7f5d0afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:54.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.523+0000 7f5e56a2f9c0 20 remove_watcher() i=0 2024-09-14T11:38:54.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.523+0000 7f5e56a2f9c0 2 removed watcher, disabling cache 2024-09-14T11:38:54.524 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.527+0000 7f5e56a2f9c0 20 remove_watcher() i=1 2024-09-14T11:38:54.526 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.527+0000 7f5e56a2f9c0 20 remove_watcher() i=2 2024-09-14T11:38:54.528 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.531+0000 7f5e56a2f9c0 20 remove_watcher() i=3 2024-09-14T11:38:54.530 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.531+0000 7f5e56a2f9c0 20 remove_watcher() i=4 2024-09-14T11:38:54.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.531+0000 7f5e56a2f9c0 20 remove_watcher() i=5 2024-09-14T11:38:54.534 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.535+0000 7f5e56a2f9c0 20 remove_watcher() i=6 2024-09-14T11:38:54.537 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.539+0000 7f5e56a2f9c0 20 remove_watcher() i=7 2024-09-14T11:38:54.551 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-14T11:38:54.631 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:54.631 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:54.671 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.671+0000 7ff94b0639c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.675+0000 7ff94b0639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.675+0000 7ff94b0639c0 20 realm 2024-09-14T11:38:54.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.675+0000 7ff94b0639c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.675+0000 7ff94b0639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.675+0000 7ff94b0639c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:54.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.675+0000 7ff94b0639c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.675+0000 7ff94b0639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.675+0000 7ff94b0639c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.675+0000 7ff94b0639c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:54.675 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.675+0000 7ff94b0639c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.675+0000 7ff94b0639c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:54.676 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.675+0000 7ff94b0639c0 20 searching for the correct realm 2024-09-14T11:38:54.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.683+0000 7ff948b69640 0 -- 172.21.15.71:0/1590965362 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x565174e9fb60 msgr2=0x565174ea2020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:54.686 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.687+0000 7ff94936a640 0 -- 172.21.15.71:0/1590965362 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x565174e9ac80 msgr2=0x565174e9d090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:54.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.695+0000 7ff94b0639c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:54.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.695+0000 7ff94b0639c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:38:54.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.695+0000 7ff94b0639c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:54.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.695+0000 7ff94b0639c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:38:54.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.695+0000 7ff94b0639c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:54.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.695+0000 7ff94b0639c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:54.694 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.695+0000 7ff94b0639c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.695+0000 7ff94b0639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.695+0000 7ff94b0639c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.695+0000 7ff94b0639c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:54.695 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.695+0000 7ff94b0639c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.695+0000 7ff94b0639c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:54.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.695+0000 7ff94b0639c0 20 zone default found 2024-09-14T11:38:54.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.695+0000 7ff94b0639c0 4 Realm: () 2024-09-14T11:38:54.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.695+0000 7ff94b0639c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:38:54.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.695+0000 7ff94b0639c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:38:54.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.695+0000 7ff94b0639c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:54.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.695+0000 7ff94b0639c0 20 zonegroup default 2024-09-14T11:38:54.696 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.695+0000 7ff94b0639c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.699+0000 7ff94b0639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.699+0000 7ff94b0639c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.699+0000 7ff94b0639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.699+0000 7ff94b0639c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.699+0000 7ff94b0639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.699+0000 7ff94b0639c0 20 started sync module instance, tier type = 2024-09-14T11:38:54.697 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.699+0000 7ff94b0639c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:38:54.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.719+0000 7ff94b0639c0 20 add_watcher() i=0 2024-09-14T11:38:54.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.719+0000 7ff94b0639c0 20 add_watcher() i=1 2024-09-14T11:38:54.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.719+0000 7ff94b0639c0 20 add_watcher() i=2 2024-09-14T11:38:54.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.719+0000 7ff94b0639c0 20 add_watcher() i=3 2024-09-14T11:38:54.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.719+0000 7ff94b0639c0 20 add_watcher() i=4 2024-09-14T11:38:54.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.719+0000 7ff94b0639c0 20 add_watcher() i=5 2024-09-14T11:38:54.716 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.719+0000 7ff94b0639c0 20 add_watcher() i=6 2024-09-14T11:38:54.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.719+0000 7ff94b0639c0 20 add_watcher() i=7 2024-09-14T11:38:54.719 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.719+0000 7ff94b0639c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:54.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.723+0000 7ff7ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:54.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.723+0000 7ff94b0639c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:54.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.723+0000 7ff94b0639c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:54.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.723+0000 7ff94b0639c0 5 note: GC not initialized 2024-09-14T11:38:54.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.723+0000 7ff7fe7e4640 20 reqs_thread_entry: start 2024-09-14T11:38:54.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.723+0000 7ff94b0639c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:54.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.723+0000 7ff94b0639c0 20 Filter name: none 2024-09-14T11:38:54.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.723+0000 7ff7f77fe640 20 reqs_thread_entry: start 2024-09-14T11:38:54.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.723+0000 7ff94b0639c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-14T11:38:54.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.723+0000 7ff94b0639c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.723+0000 7ff94b0639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.723+0000 7ff94b0639c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-14T11:38:54.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.723+0000 7ff94b0639c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T11:38:54.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.723+0000 7ff94b0639c0 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-14T11:38:54.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.723+0000 7ff94b0639c0 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-14T11:38:54.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.723+0000 7ff94b0639c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.727+0000 7ff94b0639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.727+0000 7ff94b0639c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-14T11:38:54.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.727+0000 7ff94b0639c0 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T11:38:54.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.727+0000 7ff94b0639c0 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-14T11:38:54.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.727+0000 7ff94b0639c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T11:38:54.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.727+0000 7ff94b0639c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T11:38:54.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.727+0000 7ff94b0639c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-14T11:38:54.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.727+0000 7ff81ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366466 cookie 94907853833296 notifier 8717 bl.length()=384 2024-09-14T11:38:54.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.727+0000 7ff81ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T11:38:54.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.727+0000 7ff81ffff640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T11:38:54.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.731+0000 7ff94b0639c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-14T11:38:54.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.731+0000 7ff94b0639c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T11:38:54.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.731+0000 7ff94b0639c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-14T11:38:54.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.731+0000 7ff81ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366467 cookie 94907853816528 notifier 8717 bl.length()=225 2024-09-14T11:38:54.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.731+0000 7ff81ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-14T11:38:54.730 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.731+0000 7ff81ffff640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T11:38:54.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.731+0000 7ff94b0639c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-14T11:38:54.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.731+0000 7ff94b0639c0 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T11:38:54.732 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.731+0000 7ff94b0639c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-14T11:38:54.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.735+0000 7ff81f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366233 cookie 94907853843168 notifier 8717 bl.length()=234 2024-09-14T11:38:54.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.735+0000 7ff81f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-14T11:38:54.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.735+0000 7ff81f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T11:38:54.735 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.735+0000 7ff7ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:54.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.739+0000 7ff94b0639c0 20 remove_watcher() i=0 2024-09-14T11:38:54.739 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.739+0000 7ff94b0639c0 2 removed watcher, disabling cache 2024-09-14T11:38:54.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.743+0000 7ff94b0639c0 20 remove_watcher() i=1 2024-09-14T11:38:54.743 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.743+0000 7ff94b0639c0 20 remove_watcher() i=2 2024-09-14T11:38:54.745 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.747+0000 7ff94b0639c0 20 remove_watcher() i=3 2024-09-14T11:38:54.747 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.747+0000 7ff94b0639c0 20 remove_watcher() i=4 2024-09-14T11:38:54.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.751+0000 7ff94b0639c0 20 remove_watcher() i=5 2024-09-14T11:38:54.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.751+0000 7ff94b0639c0 20 remove_watcher() i=6 2024-09-14T11:38:54.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.755+0000 7ff94b0639c0 20 remove_watcher() i=7 2024-09-14T11:38:54.766 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T11:38:54.766 INFO:teuthology.orchestra.run.smithi071.stdout: "id": "RGW99999999999999999", 2024-09-14T11:38:54.766 INFO:teuthology.orchestra.run.smithi071.stdout: "tenant": "", 2024-09-14T11:38:54.766 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "Mr.RGW99999999999999999", 2024-09-14T11:38:54.766 INFO:teuthology.orchestra.run.smithi071.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-14T11:38:54.766 INFO:teuthology.orchestra.run.smithi071.stdout: "quota": { 2024-09-14T11:38:54.766 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": false, 2024-09-14T11:38:54.766 INFO:teuthology.orchestra.run.smithi071.stdout: "check_on_raw": false, 2024-09-14T11:38:54.767 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size": -1, 2024-09-14T11:38:54.767 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size_kb": 0, 2024-09-14T11:38:54.767 INFO:teuthology.orchestra.run.smithi071.stdout: "max_objects": -1 2024-09-14T11:38:54.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T11:38:54.767 INFO:teuthology.orchestra.run.smithi071.stdout: "bucket_quota": { 2024-09-14T11:38:54.767 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": false, 2024-09-14T11:38:54.767 INFO:teuthology.orchestra.run.smithi071.stdout: "check_on_raw": false, 2024-09-14T11:38:54.767 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size": -1, 2024-09-14T11:38:54.767 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size_kb": 0, 2024-09-14T11:38:54.767 INFO:teuthology.orchestra.run.smithi071.stdout: "max_objects": -1 2024-09-14T11:38:54.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T11:38:54.767 INFO:teuthology.orchestra.run.smithi071.stdout: "max_users": 1000, 2024-09-14T11:38:54.767 INFO:teuthology.orchestra.run.smithi071.stdout: "max_roles": 1000, 2024-09-14T11:38:54.767 INFO:teuthology.orchestra.run.smithi071.stdout: "max_groups": 1000, 2024-09-14T11:38:54.767 INFO:teuthology.orchestra.run.smithi071.stdout: "max_buckets": 1000, 2024-09-14T11:38:54.767 INFO:teuthology.orchestra.run.smithi071.stdout: "max_access_keys": 4 2024-09-14T11:38:54.768 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T11:38:54.768 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-14T11:38:54.769 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key ADOIOWGXZVSJFKWSPBZC --secret k4tWY7ZDmOXRga5e2Vhk7DPsRleCP4UZmjJNuri9k3abydn0euXNkA== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-14T11:38:54.856 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:54.856 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:54.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.899+0000 7f84df4599c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.899+0000 7f84df4599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.899+0000 7f84df4599c0 20 realm 2024-09-14T11:38:54.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.899+0000 7f84df4599c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.903+0000 7f84df4599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.903+0000 7f84df4599c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:54.900 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.903+0000 7f84df4599c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.903+0000 7f84df4599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.903+0000 7f84df4599c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.903+0000 7f84df4599c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:54.901 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.903+0000 7f84df4599c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.902 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.903+0000 7f84df4599c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:54.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.903+0000 7f84df4599c0 20 searching for the correct realm 2024-09-14T11:38:54.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.907+0000 7f84dcf5f640 0 -- 172.21.15.71:0/2164998942 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x55eaadae97e0 msgr2=0x55eaadaebca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:54.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.915+0000 7f84dd760640 0 -- 172.21.15.71:0/2164998942 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55eaadae4940 msgr2=0x55eaadae6d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:54.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.923+0000 7f84df4599c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:54.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.923+0000 7f84df4599c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:38:54.921 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.923+0000 7f84df4599c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:54.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.923+0000 7f84df4599c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:38:54.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.923+0000 7f84df4599c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:54.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.923+0000 7f84df4599c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:54.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.923+0000 7f84df4599c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.923+0000 7f84df4599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.923+0000 7f84df4599c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.923+0000 7f84df4599c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:54.922 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.923+0000 7f84df4599c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.923+0000 7f84df4599c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:54.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.923+0000 7f84df4599c0 20 zone default found 2024-09-14T11:38:54.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.923+0000 7f84df4599c0 4 Realm: () 2024-09-14T11:38:54.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.923+0000 7f84df4599c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:38:54.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.923+0000 7f84df4599c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:38:54.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.923+0000 7f84df4599c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:54.923 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.923+0000 7f84df4599c0 20 zonegroup default 2024-09-14T11:38:54.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.923+0000 7f84df4599c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.924 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.923+0000 7f84df4599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.923+0000 7f84df4599c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.923+0000 7f84df4599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.923+0000 7f84df4599c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.927+0000 7f84df4599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.927+0000 7f84df4599c0 20 started sync module instance, tier type = 2024-09-14T11:38:54.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.927+0000 7f84df4599c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:38:54.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.943+0000 7f84df4599c0 20 add_watcher() i=0 2024-09-14T11:38:54.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.943+0000 7f84df4599c0 20 add_watcher() i=1 2024-09-14T11:38:54.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.943+0000 7f84df4599c0 20 add_watcher() i=2 2024-09-14T11:38:54.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.943+0000 7f84df4599c0 20 add_watcher() i=3 2024-09-14T11:38:54.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.943+0000 7f84df4599c0 20 add_watcher() i=4 2024-09-14T11:38:54.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.943+0000 7f84df4599c0 20 add_watcher() i=5 2024-09-14T11:38:54.943 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.943+0000 7f84df4599c0 20 add_watcher() i=6 2024-09-14T11:38:54.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.947+0000 7f84df4599c0 20 add_watcher() i=7 2024-09-14T11:38:54.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.947+0000 7f84df4599c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:54.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.951+0000 7f8392fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:54.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.951+0000 7f84df4599c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:54.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.951+0000 7f84df4599c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:54.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.951+0000 7f84df4599c0 5 note: GC not initialized 2024-09-14T11:38:54.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.951+0000 7f8391fe3640 20 reqs_thread_entry: start 2024-09-14T11:38:54.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.951+0000 7f84df4599c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:54.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.951+0000 7f84df4599c0 20 Filter name: none 2024-09-14T11:38:54.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.951+0000 7f83037fe640 20 reqs_thread_entry: start 2024-09-14T11:38:54.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.951+0000 7f84df4599c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-14T11:38:54.951 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.951+0000 7f84df4599c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.951+0000 7f84df4599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.951+0000 7f84df4599c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-14T11:38:54.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.951+0000 7f84df4599c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:38:54.952 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.951+0000 7f84df4599c0 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-14T11:38:54.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.951+0000 7f84df4599c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.955+0000 7f84df4599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.955+0000 7f84df4599c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-14T11:38:54.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.955+0000 7f84df4599c0 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T11:38:54.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.955+0000 7f84df4599c0 10 cache get: name=default.rgw.meta+users.keys+ADOIOWGXZVSJFKWSPBZC : miss 2024-09-14T11:38:54.953 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.955+0000 7f84df4599c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.955+0000 7f84df4599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:54.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.955+0000 7f84df4599c0 10 cache put: name=default.rgw.meta+users.keys+ADOIOWGXZVSJFKWSPBZC info.flags=0x0 2024-09-14T11:38:54.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.955+0000 7f84df4599c0 10 adding default.rgw.meta+users.keys+ADOIOWGXZVSJFKWSPBZC to cache LRU end 2024-09-14T11:38:54.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.955+0000 7f84df4599c0 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-14T11:38:54.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.955+0000 7f84df4599c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:54.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.955+0000 7f84df4599c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-14T11:38:54.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.955+0000 7f84df4599c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T11:38:54.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.955+0000 7f84df4599c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T11:38:54.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.955+0000 7f84df4599c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:54.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.955+0000 7f84df4599c0 10 cache get: name=default.rgw.meta+users.keys+ADOIOWGXZVSJFKWSPBZC : hit (negative entry) 2024-09-14T11:38:54.954 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.955+0000 7f84df4599c0 10 cache get: name=default.rgw.meta+users.keys+ADOIOWGXZVSJFKWSPBZC : hit (negative entry) 2024-09-14T11:38:54.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.959+0000 7f84df4599c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:38:54.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.959+0000 7f84df4599c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:38:54.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.959+0000 7f84df4599c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-14T11:38:54.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.959+0000 7f83b3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366468 cookie 94466424595392 notifier 8735 bl.length()=681 2024-09-14T11:38:54.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.959+0000 7f83b3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:38:54.957 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.959+0000 7f83b3fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:38:54.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.959+0000 7f84df4599c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-14T11:38:54.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.959+0000 7f84df4599c0 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T11:38:54.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.959+0000 7f84df4599c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-14T11:38:54.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.963+0000 7f83b3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366430 cookie 94466424625696 notifier 8735 bl.length()=189 2024-09-14T11:38:54.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.963+0000 7f83b3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-14T11:38:54.960 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.963+0000 7f83b3fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T11:38:54.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.967+0000 7f84df4599c0 10 cache put: name=default.rgw.meta+users.keys+ADOIOWGXZVSJFKWSPBZC info.flags=0x7 2024-09-14T11:38:54.964 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.967+0000 7f84df4599c0 10 moving default.rgw.meta+users.keys+ADOIOWGXZVSJFKWSPBZC to cache LRU end 2024-09-14T11:38:54.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.967+0000 7f84df4599c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:ADOIOWGXZVSJFKWSPBZC, ofs0, ns] 2024-09-14T11:38:54.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.967+0000 7f83b37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366431 cookie 94466424616976 notifier 8735 bl.length()=188 2024-09-14T11:38:54.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.967+0000 7f83b37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ADOIOWGXZVSJFKWSPBZC info.flags=0x7 2024-09-14T11:38:54.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.967+0000 7f83b37fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ADOIOWGXZVSJFKWSPBZC to cache LRU end 2024-09-14T11:38:54.968 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.967+0000 7f84df4599c0 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-14T11:38:54.968 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T11:38:54.968 INFO:teuthology.orchestra.run.smithi071.stdout: "user_id": "root2.client.0", 2024-09-14T11:38:54.968 INFO:teuthology.orchestra.run.smithi071.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-14T11:38:54.968 INFO:teuthology.orchestra.run.smithi071.stdout: "email": "root2+test@test.test", 2024-09-14T11:38:54.968 INFO:teuthology.orchestra.run.smithi071.stdout: "suspended": 0, 2024-09-14T11:38:54.968 INFO:teuthology.orchestra.run.smithi071.stdout: "max_buckets": 1000, 2024-09-14T11:38:54.968 INFO:teuthology.orchestra.run.smithi071.stdout: "subusers": [], 2024-09-14T11:38:54.968 INFO:teuthology.orchestra.run.smithi071.stdout: "keys": [ 2024-09-14T11:38:54.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-09-14T11:38:54.968 INFO:teuthology.orchestra.run.smithi071.stdout: "user": "root2.client.0", 2024-09-14T11:38:54.969 INFO:teuthology.orchestra.run.smithi071.stdout: "access_key": "ADOIOWGXZVSJFKWSPBZC", 2024-09-14T11:38:54.969 INFO:teuthology.orchestra.run.smithi071.stdout: "secret_key": "k4tWY7ZDmOXRga5e2Vhk7DPsRleCP4UZmjJNuri9k3abydn0euXNkA==", 2024-09-14T11:38:54.969 INFO:teuthology.orchestra.run.smithi071.stdout: "active": true, 2024-09-14T11:38:54.969 INFO:teuthology.orchestra.run.smithi071.stdout: "create_date": "2024-09-14T11:38:54.959730Z" 2024-09-14T11:38:54.969 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-14T11:38:54.969 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-09-14T11:38:54.969 INFO:teuthology.orchestra.run.smithi071.stdout: "swift_keys": [], 2024-09-14T11:38:54.969 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": [], 2024-09-14T11:38:54.969 INFO:teuthology.orchestra.run.smithi071.stdout: "op_mask": "read, write, delete", 2024-09-14T11:38:54.969 INFO:teuthology.orchestra.run.smithi071.stdout: "default_placement": "", 2024-09-14T11:38:54.969 INFO:teuthology.orchestra.run.smithi071.stdout: "default_storage_class": "", 2024-09-14T11:38:54.969 INFO:teuthology.orchestra.run.smithi071.stdout: "placement_tags": [], 2024-09-14T11:38:54.969 INFO:teuthology.orchestra.run.smithi071.stdout: "bucket_quota": { 2024-09-14T11:38:54.969 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": false, 2024-09-14T11:38:54.970 INFO:teuthology.orchestra.run.smithi071.stdout: "check_on_raw": false, 2024-09-14T11:38:54.970 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size": -1, 2024-09-14T11:38:54.970 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size_kb": 0, 2024-09-14T11:38:54.970 INFO:teuthology.orchestra.run.smithi071.stdout: "max_objects": -1 2024-09-14T11:38:54.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T11:38:54.970 INFO:teuthology.orchestra.run.smithi071.stdout: "user_quota": { 2024-09-14T11:38:54.970 INFO:teuthology.orchestra.run.smithi071.stdout: "enabled": false, 2024-09-14T11:38:54.970 INFO:teuthology.orchestra.run.smithi071.stdout: "check_on_raw": false, 2024-09-14T11:38:54.970 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size": -1, 2024-09-14T11:38:54.970 INFO:teuthology.orchestra.run.smithi071.stdout: "max_size_kb": 0, 2024-09-14T11:38:54.970 INFO:teuthology.orchestra.run.smithi071.stdout: "max_objects": -1 2024-09-14T11:38:54.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-14T11:38:54.970 INFO:teuthology.orchestra.run.smithi071.stdout: "temp_url_keys": [], 2024-09-14T11:38:54.970 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "root", 2024-09-14T11:38:54.970 INFO:teuthology.orchestra.run.smithi071.stdout: "mfa_ids": [], 2024-09-14T11:38:54.970 INFO:teuthology.orchestra.run.smithi071.stdout: "account_id": "RGW99999999999999999", 2024-09-14T11:38:54.971 INFO:teuthology.orchestra.run.smithi071.stdout: "path": "/", 2024-09-14T11:38:54.971 INFO:teuthology.orchestra.run.smithi071.stdout: "create_date": "2024-09-14T11:38:54.959715Z", 2024-09-14T11:38:54.971 INFO:teuthology.orchestra.run.smithi071.stdout: "tags": [], 2024-09-14T11:38:54.971 INFO:teuthology.orchestra.run.smithi071.stdout: "group_ids": [] 2024-09-14T11:38:54.971 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T11:38:54.971 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:38:54.971 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.971+0000 7f8392fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:54.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.975+0000 7f84df4599c0 20 remove_watcher() i=0 2024-09-14T11:38:54.973 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.975+0000 7f84df4599c0 2 removed watcher, disabling cache 2024-09-14T11:38:54.974 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.975+0000 7f84df4599c0 20 remove_watcher() i=1 2024-09-14T11:38:54.977 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.979+0000 7f84df4599c0 20 remove_watcher() i=2 2024-09-14T11:38:54.979 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.979+0000 7f84df4599c0 20 remove_watcher() i=3 2024-09-14T11:38:54.981 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.983+0000 7f84df4599c0 20 remove_watcher() i=4 2024-09-14T11:38:54.983 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.983+0000 7f84df4599c0 20 remove_watcher() i=5 2024-09-14T11:38:54.986 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.987+0000 7f84df4599c0 20 remove_watcher() i=6 2024-09-14T11:38:54.989 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:54.991+0000 7f84df4599c0 20 remove_watcher() i=7 2024-09-14T11:38:55.004 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 6151957409 --totp-seed CCQEUIGYES67A65TTOZOVX3ZSAXE77W32K7V42YAFALM2DRGDPS3JEZCEKTRYMPV --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:38:55.090 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:55.090 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:55.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.131+0000 7f8f4cff29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:55.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.131+0000 7f8f4cff29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:55.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.131+0000 7f8f4cff29c0 20 realm 2024-09-14T11:38:55.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.131+0000 7f8f4cff29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:55.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.135+0000 7f8f4cff29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:55.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.135+0000 7f8f4cff29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:55.132 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.135+0000 7f8f4cff29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:55.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.135+0000 7f8f4cff29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:55.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.135+0000 7f8f4cff29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:55.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.135+0000 7f8f4cff29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:55.133 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.135+0000 7f8f4cff29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:55.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.135+0000 7f8f4cff29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:55.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.135+0000 7f8f4cff29c0 20 searching for the correct realm 2024-09-14T11:38:55.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.139+0000 7f8f4b2f9640 0 -- 172.21.15.71:0/1234385949 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f8f40018070 msgr2=0x7f8f400743d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:55.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.351+0000 7f8f4b2f9640 0 -- 172.21.15.71:0/1234385949 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55638d218430 msgr2=0x55638d21a840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:55.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.367+0000 7f8f4cff29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:55.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.367+0000 7f8f4cff29c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:38:55.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.367+0000 7f8f4cff29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:55.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.367+0000 7f8f4cff29c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:38:55.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.367+0000 7f8f4cff29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:55.366 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.367+0000 7f8f4cff29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:55.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.367+0000 7f8f4cff29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:55.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.367+0000 7f8f4cff29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:55.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.367+0000 7f8f4cff29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:55.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.367+0000 7f8f4cff29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:55.367 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.367+0000 7f8f4cff29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:55.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.371+0000 7f8f4cff29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:55.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.371+0000 7f8f4cff29c0 20 zone default found 2024-09-14T11:38:55.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.371+0000 7f8f4cff29c0 4 Realm: () 2024-09-14T11:38:55.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.371+0000 7f8f4cff29c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:38:55.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.371+0000 7f8f4cff29c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:38:55.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.371+0000 7f8f4cff29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:55.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.371+0000 7f8f4cff29c0 20 zonegroup default 2024-09-14T11:38:55.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.371+0000 7f8f4cff29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:55.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.371+0000 7f8f4cff29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:55.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.371+0000 7f8f4cff29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:55.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.371+0000 7f8f4cff29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:55.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.371+0000 7f8f4cff29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:55.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.371+0000 7f8f4cff29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:55.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.371+0000 7f8f4cff29c0 20 started sync module instance, tier type = 2024-09-14T11:38:55.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.371+0000 7f8f4cff29c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:38:55.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.399+0000 7f8f4cff29c0 20 add_watcher() i=0 2024-09-14T11:38:55.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.399+0000 7f8f4cff29c0 20 add_watcher() i=1 2024-09-14T11:38:55.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.399+0000 7f8f4cff29c0 20 add_watcher() i=2 2024-09-14T11:38:55.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.399+0000 7f8f4cff29c0 20 add_watcher() i=3 2024-09-14T11:38:55.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.399+0000 7f8f4cff29c0 20 add_watcher() i=4 2024-09-14T11:38:55.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.399+0000 7f8f4cff29c0 20 add_watcher() i=5 2024-09-14T11:38:55.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.399+0000 7f8f4cff29c0 20 add_watcher() i=6 2024-09-14T11:38:55.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.399+0000 7f8f4cff29c0 20 add_watcher() i=7 2024-09-14T11:38:55.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.399+0000 7f8f4cff29c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:55.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.407+0000 7f8e017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:55.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.407+0000 7f8f4cff29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:55.404 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.407+0000 7f8f4cff29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:55.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.407+0000 7f8f4cff29c0 5 note: GC not initialized 2024-09-14T11:38:55.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.407+0000 7f8d7bfff640 20 reqs_thread_entry: start 2024-09-14T11:38:55.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.407+0000 7f8f4cff29c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:55.405 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.407+0000 7f8f4cff29c0 20 Filter name: none 2024-09-14T11:38:55.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.407+0000 7f8d79ffb640 20 reqs_thread_entry: start 2024-09-14T11:38:55.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.407+0000 7f8f4cff29c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-14T11:38:55.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.407+0000 7f8f4cff29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:55.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.407+0000 7f8f4cff29c0 20 rados_obj.operate() r=0 bl.length=494 2024-09-14T11:38:55.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.407+0000 7f8f4cff29c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-14T11:38:55.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.407+0000 7f8f4cff29c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:38:55.407 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.407+0000 7f8f4cff29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:55.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.415+0000 7f8f4cff29c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:38:55.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.415+0000 7f8f4cff29c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:38:55.412 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.415+0000 7f8f4cff29c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-14T11:38:55.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.415+0000 7f8e2e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366469 cookie 93886057940528 notifier 8750 bl.length()=695 2024-09-14T11:38:55.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.415+0000 7f8e2e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:38:55.413 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.415+0000 7f8e2e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:38:55.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.415+0000 7f8e017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:55.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.419+0000 7f8f4cff29c0 20 remove_watcher() i=0 2024-09-14T11:38:55.419 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.419+0000 7f8f4cff29c0 2 removed watcher, disabling cache 2024-09-14T11:38:55.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.423+0000 7f8f4cff29c0 20 remove_watcher() i=1 2024-09-14T11:38:55.423 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.423+0000 7f8f4cff29c0 20 remove_watcher() i=2 2024-09-14T11:38:55.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.427+0000 7f8f4cff29c0 20 remove_watcher() i=3 2024-09-14T11:38:55.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.427+0000 7f8f4cff29c0 20 remove_watcher() i=4 2024-09-14T11:38:55.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.431+0000 7f8f4cff29c0 20 remove_watcher() i=5 2024-09-14T11:38:55.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.435+0000 7f8f4cff29c0 20 remove_watcher() i=6 2024-09-14T11:38:55.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:38:55.435+0000 7f8f4cff29c0 20 remove_watcher() i=7 2024-09-14T11:38:55.449 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-14T11:38:55.450 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T11:38:55.450 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-14T11:38:55.497 INFO:tasks.s3tests:Configuring boto... 2024-09-14T11:38:55.497 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T11:38:55.497 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-14T11:38:55.545 DEBUG:teuthology.orchestra.run.smithi071:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-14T11:38:55.719 INFO:teuthology.orchestra.run.smithi071.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-14T11:38:55.914 INFO:teuthology.orchestra.run.smithi071.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-14T11:38:56.240 INFO:teuthology.orchestra.run.smithi071.stdout:py installdeps: -rrequirements.txt 2024-09-14T11:40:49.476 INFO:teuthology.orchestra.run.smithi071.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-14T11:40:51.341 INFO:teuthology.orchestra.run.smithi071.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.9,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.3,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=1d7704f43f7dbfe5611235d0e00fe91d3ee5fb6bd30139404b7e55cfe174a394,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-14T11:40:51.341 INFO:teuthology.orchestra.run.smithi071.stdout:py run-test-pre: PYTHONHASHSEED='970700202' 2024-09-14T11:40:51.342 INFO:teuthology.orchestra.run.smithi071.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-14T11:40:51.505 INFO:teuthology.orchestra.run.smithi071.stdout:============================= test session starts ============================== 2024-09-14T11:40:51.505 INFO:teuthology.orchestra.run.smithi071.stdout:platform linux -- Python 3.10.6, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-14T11:40:51.506 INFO:teuthology.orchestra.run.smithi071.stdout:cachedir: .tox/py/.pytest_cache 2024-09-14T11:40:51.506 INFO:teuthology.orchestra.run.smithi071.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T11:40:51.506 INFO:teuthology.orchestra.run.smithi071.stdout:configfile: pytest.ini 2024-09-14T11:40:53.291 INFO:teuthology.orchestra.run.smithi071.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-14T11:40:53.291 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:40:53.490 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-14T11:40:53.686 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-14T11:40:53.940 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-14T11:40:54.190 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-14T11:40:54.389 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-14T11:40:54.586 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-14T11:40:54.842 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-14T11:40:55.038 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-14T11:40:55.135 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-14T11:40:55.232 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-14T11:40:55.427 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-14T11:40:55.626 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-14T11:40:55.821 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-14T11:40:56.019 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-14T11:40:56.115 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-14T11:40:56.212 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-14T11:40:56.267 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-14T11:40:56.319 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-14T11:40:56.371 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-14T11:40:56.427 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-14T11:40:56.479 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-14T11:40:56.531 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-14T11:40:56.583 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-14T11:40:56.639 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-14T11:40:56.691 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-14T11:40:56.751 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-14T11:40:56.811 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-14T11:40:56.863 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-14T11:40:56.915 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-14T11:40:56.967 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-14T11:40:57.019 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-14T11:40:57.072 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-14T11:40:57.127 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-14T11:40:57.179 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-14T11:40:57.232 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-14T11:40:57.288 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-14T11:40:57.343 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-14T11:40:57.395 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-14T11:40:57.447 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-14T11:40:57.499 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-14T11:40:57.551 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-14T11:40:57.603 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-14T11:40:57.655 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-14T11:40:57.707 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-14T11:40:57.759 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-14T11:40:57.811 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-14T11:40:57.863 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-14T11:40:57.915 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-14T11:40:57.967 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-14T11:40:58.020 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-14T11:40:58.071 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-14T11:40:58.123 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-14T11:40:58.179 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-14T11:40:58.563 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-14T11:40:59.464 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-14T11:41:01.135 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-14T11:41:02.646 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-14T11:41:05.355 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-14T11:41:06.155 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-14T11:41:07.173 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-14T11:41:07.553 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-14T11:41:07.707 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-14T11:41:07.988 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-14T11:41:08.281 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-14T11:41:08.567 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-14T11:41:08.801 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-14T11:41:08.960 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-14T11:41:08.963 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-14T11:41:08.965 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-14T11:41:08.967 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-14T11:41:08.969 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-14T11:41:08.971 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-14T11:41:08.974 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-14T11:41:08.976 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-14T11:41:08.978 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-14T11:41:08.980 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-14T11:41:08.982 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-14T11:41:08.984 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:41:08.986 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-14T11:41:08.989 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:41:08.991 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:41:08.994 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:41:08.996 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:41:08.998 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:41:09.000 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:41:09.002 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:41:09.004 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-14T11:41:09.006 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-14T11:41:09.008 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-14T11:41:09.009 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-14T11:41:09.011 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-14T11:41:09.013 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-14T11:41:09.014 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-14T11:41:09.016 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-14T11:41:09.120 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-14T11:41:09.132 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-14T11:41:09.603 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-14T11:41:18.383 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-14T11:41:18.735 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-14T11:41:19.179 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-14T11:41:19.607 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-14T11:41:20.044 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-14T11:41:20.480 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-14T11:41:20.828 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-14T11:41:21.304 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-14T11:41:21.711 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-14T11:41:22.112 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-14T11:41:22.467 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-14T11:41:22.799 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-14T11:41:23.131 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-14T11:41:23.307 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-14T11:41:23.655 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-14T11:41:24.071 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-14T11:41:24.527 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-14T11:41:24.875 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-14T11:41:25.227 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-14T11:41:25.579 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-14T11:41:25.935 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-14T11:41:26.283 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-14T11:41:26.612 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-14T11:41:26.947 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-14T11:41:27.131 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-14T11:41:27.339 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-14T11:41:27.499 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-14T11:41:27.675 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-14T11:41:27.856 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-14T11:41:28.176 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-14T11:41:28.363 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-14T11:41:28.563 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-14T11:41:28.891 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-14T11:41:29.204 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-14T11:41:29.419 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-14T11:41:29.727 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-14T11:41:30.043 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-14T11:41:30.472 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-14T11:41:30.747 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-14T11:41:31.055 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-14T11:41:31.364 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-14T11:41:31.923 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-14T11:41:32.311 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-14T11:41:32.771 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-14T11:41:33.216 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:41:33.811 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:41:34.428 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:41:35.076 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:41:35.575 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:41:36.127 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:41:36.563 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-14T11:41:37.127 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-14T11:41:37.447 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-14T11:41:38.448 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-14T11:41:39.120 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-14T11:41:39.948 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-14T11:41:41.712 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-14T11:41:44.108 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-14T11:41:45.428 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-14T11:41:46.596 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-14T11:41:47.436 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-14T11:41:47.952 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-14T11:41:48.992 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-14T11:41:49.716 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-14T11:41:50.696 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-14T11:41:51.360 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-14T11:41:52.707 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-14T11:41:53.640 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-14T11:41:55.052 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-14T11:41:56.444 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-14T11:41:57.372 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-14T11:41:58.204 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-14T11:41:58.884 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-14T11:42:00.644 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-14T11:42:01.896 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-14T11:42:03.328 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-14T11:42:04.680 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-14T11:42:05.932 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-14T11:42:07.196 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-14T11:42:08.160 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-14T11:42:09.056 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-14T11:42:09.864 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-14T11:42:11.495 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-14T11:42:13.604 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-14T11:42:14.432 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-14T11:42:15.748 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-14T11:42:17.052 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-14T11:42:18.188 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-14T11:42:19.364 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-14T11:42:20.660 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-14T11:42:21.811 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-14T11:42:22.956 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-14T11:42:23.764 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-14T11:42:24.424 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-14T11:42:25.077 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-14T11:42:25.731 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-14T11:42:26.832 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-14T11:42:27.964 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-14T11:42:29.092 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-14T11:42:30.196 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-14T11:42:31.336 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-14T11:42:32.472 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-14T11:42:33.540 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-14T11:42:34.676 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-14T11:42:35.772 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-14T11:42:36.904 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-14T11:42:38.036 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-14T11:42:39.164 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-14T11:42:39.844 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-14T11:42:40.521 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-14T11:42:41.164 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-14T11:42:41.808 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-14T11:42:42.283 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-14T11:42:42.911 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-14T11:42:43.432 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-14T11:42:43.935 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-14T11:42:44.444 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-14T11:42:44.912 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-14T11:42:45.380 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-14T11:42:45.883 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-14T11:42:46.351 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-14T11:42:46.943 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-14T11:42:47.531 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-14T11:42:47.955 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-14T11:42:48.419 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-14T11:42:48.887 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-14T11:42:49.359 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-14T11:42:49.956 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-14T11:42:50.491 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-14T11:42:50.959 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-14T11:42:51.467 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-14T11:42:51.940 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-14T11:42:52.407 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-14T11:42:52.879 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-14T11:42:53.343 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-14T11:42:53.819 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-14T11:42:54.343 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-14T11:42:54.799 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-14T11:42:55.271 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-14T11:42:55.743 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-14T11:42:56.207 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-14T11:42:56.664 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-14T11:42:57.112 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-14T11:42:57.619 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-14T11:42:58.099 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-14T11:42:58.564 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-14T11:43:16.076 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-14T11:43:16.524 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-14T11:43:16.980 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-14T11:43:17.436 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-14T11:43:17.871 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-14T11:43:18.328 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-14T11:43:18.788 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-14T11:43:19.283 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-14T11:43:19.735 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-14T11:43:20.195 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-14T11:43:20.647 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-14T11:43:21.715 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-14T11:43:22.163 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-14T11:43:22.692 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-14T11:43:23.135 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-14T11:43:23.603 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-14T11:43:24.076 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-14T11:43:24.547 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-14T11:43:25.019 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-14T11:43:25.496 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:43:26.007 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:43:26.472 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:43:26.947 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:43:27.480 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-14T11:43:28.203 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-14T11:43:28.675 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-14T11:43:29.207 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-14T11:43:29.663 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-14T11:43:30.132 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-14T11:43:30.323 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-14T11:43:30.756 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-14T11:43:31.799 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-14T11:43:32.875 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-14T11:43:33.351 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-14T11:43:33.823 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-14T11:43:34.279 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-14T11:43:34.756 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-14T11:43:35.275 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-14T11:43:35.847 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-14T11:43:36.315 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-14T11:43:36.791 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-14T11:43:37.255 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-14T11:43:37.739 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-14T11:43:38.208 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-14T11:43:38.755 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-14T11:43:39.480 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-14T11:43:40.324 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-14T11:43:40.691 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-14T11:43:41.067 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-14T11:43:41.419 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-14T11:43:41.771 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-14T11:43:41.956 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-14T11:43:42.135 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-14T11:43:42.315 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-14T11:43:42.811 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-14T11:43:43.228 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-14T11:43:43.411 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-14T11:43:43.827 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-14T11:43:44.171 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-14T11:43:44.528 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-14T11:43:44.884 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-14T11:43:45.663 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-14T11:43:46.271 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-14T11:43:46.927 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-14T11:44:04.015 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-14T11:44:21.107 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-14T11:44:21.527 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-14T11:44:21.940 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-14T11:44:22.367 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-14T11:44:22.779 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-14T11:44:23.280 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-14T11:44:23.711 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-14T11:44:24.127 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-14T11:44:24.644 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-14T11:44:25.071 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-14T11:44:25.539 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-14T11:44:25.992 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-14T11:44:26.411 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-14T11:44:26.867 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-14T11:44:27.207 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-14T11:44:27.608 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-14T11:44:28.016 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-14T11:44:28.464 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-14T11:44:28.916 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-14T11:44:29.320 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-14T11:44:29.723 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-14T11:44:30.148 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-14T11:44:30.603 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-14T11:44:30.951 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-14T11:44:31.303 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-14T11:44:31.647 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-14T11:44:31.995 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-14T11:44:32.384 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-14T11:44:32.731 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-14T11:44:33.148 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-14T11:44:33.499 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-14T11:44:33.843 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-14T11:44:34.195 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-14T11:44:34.539 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-14T11:44:35.055 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-14T11:44:35.407 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-14T11:44:35.791 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-14T11:44:36.136 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-14T11:44:36.491 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-14T11:44:36.839 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-14T11:44:37.183 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-14T11:44:37.539 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-14T11:44:38.019 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-14T11:44:38.363 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-14T11:44:38.824 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-14T11:44:39.339 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-14T11:44:39.759 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-14T11:44:40.227 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-14T11:44:40.699 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-14T11:44:42.143 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-14T11:44:42.615 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-14T11:44:43.092 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-14T11:44:43.619 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-14T11:44:44.232 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-14T11:44:44.755 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-14T11:44:45.203 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-14T11:44:45.735 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-14T11:44:46.311 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-14T11:44:46.780 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-14T11:44:47.343 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-14T11:44:47.759 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-14T11:44:48.143 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-14T11:44:48.475 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-14T11:44:48.859 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-14T11:44:49.204 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-14T11:44:49.391 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-14T11:44:49.915 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-14T11:44:50.328 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-14T11:44:50.747 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-14T11:44:53.483 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-14T11:44:53.903 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-14T11:44:54.355 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-14T11:44:54.767 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-14T11:44:55.184 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-14T11:44:55.571 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-14T11:44:56.007 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-14T11:44:56.419 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-14T11:44:56.831 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-14T11:44:57.255 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-14T11:44:57.715 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-14T11:44:58.131 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-14T11:44:58.563 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-14T11:44:59.003 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-14T11:44:59.415 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-14T11:44:59.827 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-14T11:45:00.232 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-14T11:45:00.647 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-14T11:45:00.831 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-14T11:45:01.019 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-14T11:45:01.244 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-14T11:45:01.571 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-14T11:45:01.911 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-14T11:45:02.248 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-14T11:45:02.579 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-14T11:45:02.971 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-14T11:45:03.159 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-14T11:45:03.347 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-14T11:45:03.683 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-14T11:45:03.871 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-14T11:45:04.099 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-14T11:45:04.279 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-14T11:45:04.467 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-14T11:45:04.843 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-14T11:45:05.231 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-14T11:45:05.595 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-14T11:45:05.983 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-14T11:45:06.371 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-14T11:45:06.731 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-14T11:45:07.115 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-14T11:45:07.555 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-14T11:45:07.991 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-14T11:45:08.379 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-14T11:45:08.843 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-14T11:45:09.299 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-14T11:45:09.823 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-14T11:45:10.288 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-14T11:45:10.751 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-14T11:45:11.300 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-14T11:45:11.883 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-14T11:45:12.367 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-14T11:45:12.827 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-14T11:45:13.179 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-14T11:45:13.887 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-14T11:45:14.419 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-14T11:45:14.939 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-14T11:45:15.467 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-14T11:45:15.995 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-14T11:45:16.579 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-14T11:45:17.064 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-14T11:45:17.548 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-14T11:45:18.103 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-14T11:45:18.646 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-14T11:45:18.983 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-14T11:45:19.451 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-14T11:45:19.927 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-14T11:45:20.351 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-14T11:45:20.719 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-14T11:45:21.255 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-14T11:45:21.987 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-14T11:45:22.711 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-14T11:45:23.383 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-14T11:45:24.043 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-14T11:45:24.719 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-14T11:45:25.392 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-14T11:45:26.119 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-14T11:45:26.783 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-14T11:45:27.444 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-14T11:45:28.067 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-14T11:45:28.707 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-14T11:45:29.339 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-14T11:45:30.383 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-14T11:45:31.363 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-14T11:45:31.543 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-14T11:45:31.727 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-14T11:45:31.911 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-14T11:45:32.287 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-14T11:45:32.667 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-14T11:45:33.011 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-14T11:45:33.355 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-14T11:45:33.871 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-14T11:45:35.167 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-14T11:45:35.703 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-14T11:45:36.211 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-14T11:45:37.104 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-14T11:45:37.635 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-14T11:45:38.171 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-14T11:45:38.648 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-14T11:45:39.136 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-14T11:45:39.923 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-14T11:45:40.508 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-14T11:45:41.059 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-14T11:45:41.627 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-14T11:45:42.512 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-14T11:45:43.339 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-14T11:45:43.751 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-14T11:45:44.079 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-14T11:45:45.556 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-14T11:45:46.147 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-14T11:45:49.432 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-14T11:45:49.815 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-14T11:45:50.320 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-14T11:45:51.352 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-14T11:45:51.867 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-14T11:45:52.743 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-14T11:45:55.055 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-14T11:45:56.975 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-14T11:46:00.571 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-14T11:46:09.891 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-14T11:46:12.163 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-14T11:46:15.263 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-14T11:46:15.919 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-14T11:46:17.007 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-14T11:46:18.080 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-14T11:46:18.843 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-14T11:46:19.311 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-14T11:46:20.331 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-14T11:46:20.871 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-14T11:46:21.343 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-14T11:46:21.819 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-14T11:46:36.596 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-14T11:46:38.767 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-14T11:46:39.279 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-14T11:46:39.623 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-14T11:46:40.103 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-14T11:46:43.599 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-14T11:46:46.983 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-14T11:46:50.359 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-14T11:46:50.787 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-14T11:46:51.215 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-14T11:46:51.639 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-14T11:46:52.063 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-14T11:46:52.479 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-14T11:46:52.951 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-14T11:46:53.419 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-14T11:46:54.007 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-14T11:46:54.711 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-14T11:46:55.631 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-14T11:46:56.303 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-14T11:46:57.148 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-14T11:46:58.131 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-14T11:46:58.771 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-14T11:46:59.679 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-14T11:47:00.911 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-14T11:47:01.475 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-14T11:47:02.063 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-14T11:47:02.875 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-14T11:47:03.336 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-14T11:47:07.871 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-14T11:47:08.335 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-14T11:47:08.803 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-14T11:47:09.275 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-14T11:47:09.743 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-14T11:47:10.431 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-14T11:47:18.327 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-14T11:47:19.084 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-14T11:47:19.679 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-14T11:47:20.439 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-14T11:47:21.227 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-14T11:47:24.627 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-14T11:47:25.383 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-14T11:47:29.483 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-14T11:47:44.683 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-14T11:47:48.292 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-14T11:47:49.635 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-14T11:47:51.175 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-14T11:47:51.920 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-14T11:47:52.619 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-14T11:47:53.167 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-14T11:47:53.939 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-14T11:47:54.607 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-14T11:47:55.319 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-14T11:47:55.703 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-14T11:47:56.127 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-14T11:47:56.603 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-14T11:47:56.967 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-14T11:47:57.315 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-14T11:47:57.772 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-14T11:47:58.155 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-14T11:47:58.519 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-14T11:47:58.987 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-14T11:47:59.367 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-14T11:47:59.751 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-14T11:48:00.179 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-14T11:48:00.539 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-14T11:48:00.895 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-14T11:48:01.371 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-14T11:48:01.835 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-14T11:48:02.303 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-14T11:48:02.771 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-14T11:48:03.219 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-14T11:48:03.691 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-14T11:48:04.159 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-14T11:48:04.603 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-14T11:48:04.959 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-14T11:48:05.359 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-14T11:48:05.771 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-14T11:48:08.515 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-14T11:48:11.499 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-14T11:48:13.259 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-14T11:48:13.679 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-14T11:49:14.983 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-14T11:50:16.315 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-14T11:50:16.759 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-14T11:50:17.231 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-14T11:50:17.639 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-14T11:50:17.991 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-14T11:50:20.235 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-14T11:50:21.707 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-14T11:50:23.278 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-14T11:50:23.695 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-14T11:50:24.159 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-14T11:50:24.631 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-14T11:50:25.111 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-14T11:50:25.575 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-14T11:50:26.047 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-14T11:50:26.499 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-14T11:50:26.999 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-14T11:50:27.487 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-14T11:50:27.971 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-14T11:50:28.415 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-14T11:50:28.847 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-14T11:50:29.603 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-14T11:50:30.347 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-14T11:50:31.067 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-14T11:50:31.687 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-14T11:50:32.348 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-14T11:50:33.035 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-14T11:50:33.667 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-14T11:50:34.319 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-14T11:50:34.959 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-14T11:50:35.679 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-14T11:50:36.479 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-14T11:50:36.979 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-14T11:50:37.407 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-14T11:50:37.919 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-14T11:50:38.491 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-14T11:50:39.107 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-14T11:50:39.767 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-14T11:50:40.915 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-14T11:50:44.783 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-14T11:50:45.370 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-14T11:50:46.059 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-14T11:50:46.699 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-14T11:50:47.627 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-14T11:50:48.463 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-14T11:50:48.951 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-14T11:50:49.683 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-14T11:50:50.043 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-14T11:50:50.399 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-14T11:50:50.763 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-14T11:50:51.123 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-14T11:50:51.667 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-14T11:50:52.066 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-14T11:50:52.751 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-14T11:50:53.162 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-14T11:50:53.551 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-14T11:50:53.951 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-14T11:50:54.347 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-14T11:50:54.739 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-14T11:50:55.187 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-14T11:50:55.634 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-14T11:50:56.015 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-14T11:50:56.411 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-14T11:50:56.803 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-14T11:50:57.275 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-14T11:50:57.747 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-14T11:50:58.270 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-14T11:50:58.738 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-14T11:50:59.182 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-14T11:50:59.639 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-14T11:51:00.246 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-14T11:51:00.738 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-14T11:51:01.234 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-14T11:51:01.714 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-14T11:51:02.203 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-14T11:51:02.675 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-14T11:51:03.274 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-14T11:51:03.838 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-14T11:51:04.359 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-14T11:51:04.871 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-14T11:51:05.331 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-14T11:51:05.803 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-14T11:51:06.359 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-14T11:51:06.823 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-14T11:51:07.327 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-14T11:51:07.959 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-14T11:51:08.375 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-14T11:51:08.839 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-14T11:51:09.267 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-14T11:51:19.654 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-14T11:51:20.131 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-14T11:51:30.267 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-14T11:51:30.795 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-14T11:51:31.327 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-14T11:51:31.683 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-14T11:51:32.090 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T11:51:32.499 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T11:51:32.911 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T11:51:33.387 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-14T11:51:33.783 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-14T11:51:34.139 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-14T11:51:34.550 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-14T11:51:35.023 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-14T11:51:35.431 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-14T11:51:35.983 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-14T11:51:36.495 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-14T11:51:36.922 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-14T11:51:37.343 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-14T11:51:37.963 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-14T11:51:40.174 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-14T11:51:40.531 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-14T11:51:40.943 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-14T11:51:41.391 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-14T11:51:41.867 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-14T11:51:42.511 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-14T11:51:43.003 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-14T11:51:43.870 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-14T11:51:44.794 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-14T11:51:45.279 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-14T11:51:46.987 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-14T11:51:48.475 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-14T11:51:48.959 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-14T11:51:49.523 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-14T11:51:51.171 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-14T11:51:52.891 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-14T11:51:53.842 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-14T11:51:54.475 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-14T11:51:55.142 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-14T11:51:55.882 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-14T11:51:56.370 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-14T11:51:57.423 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-14T11:51:58.618 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-14T11:52:00.854 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-14T11:52:01.647 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-14T11:52:02.287 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-14T11:52:02.883 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-14T11:52:03.419 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-14T11:52:04.202 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-14T11:52:05.039 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-14T11:52:05.575 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-14T11:52:06.291 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-14T11:52:07.031 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-14T11:52:07.759 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-14T11:52:08.563 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-14T11:52:09.154 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-14T11:52:09.327 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-14T11:52:10.122 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-14T11:52:10.983 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-14T11:52:11.623 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-14T11:52:12.323 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-14T11:52:12.966 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-14T11:52:27.330 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-14T11:52:27.502 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-14T11:52:28.190 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-14T11:52:28.758 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-14T11:52:29.294 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-14T11:52:29.959 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-14T11:52:30.001 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-14T11:52:30.001 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:52:30.001 INFO:teuthology.orchestra.run.smithi071.stdout:=============================== warnings summary =============================== 2024-09-14T11:52:30.002 INFO:teuthology.orchestra.run.smithi071.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-14T11:52:30.002 INFO:teuthology.orchestra.run.smithi071.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-14T11:52:30.002 INFO:teuthology.orchestra.run.smithi071.stdout: import imp 2024-09-14T11:52:30.002 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:52:30.002 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py:120 2024-09-14T11:52:30.002 INFO:teuthology.orchestra.run.smithi071.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T11:52:30.002 INFO:teuthology.orchestra.run.smithi071.stdout: if boto_type is 'S3Connection': 2024-09-14T11:52:30.002 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:52:30.002 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_headers.py:124 2024-09-14T11:52:30.002 INFO:teuthology.orchestra.run.smithi071.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T11:52:30.002 INFO:teuthology.orchestra.run.smithi071.stdout: elif boto_type is 'HTTPRequest': 2024-09-14T11:52:30.002 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:52:30.003 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3.py:359 2024-09-14T11:52:30.003 INFO:teuthology.orchestra.run.smithi071.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence '\W' 2024-09-14T11:52:30.003 INFO:teuthology.orchestra.run.smithi071.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-14T11:52:30.003 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:52:30.003 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3_website.py:176 2024-09-14T11:52:30.003 INFO:teuthology.orchestra.run.smithi071.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T11:52:30.003 INFO:teuthology.orchestra.run.smithi071.stdout: if k is 'BucketName': 2024-09-14T11:52:30.003 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:52:30.003 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3_website.py:253 2024-09-14T11:52:30.003 INFO:teuthology.orchestra.run.smithi071.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-14T11:52:30.003 INFO:teuthology.orchestra.run.smithi071.stdout: @pytest.mark.timeout(10) 2024-09-14T11:52:30.003 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:52:30.003 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-14T11:52:30.003 INFO:teuthology.orchestra.run.smithi071.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-14T11:52:30.004 INFO:teuthology.orchestra.run.smithi071.stdout: @pytest.mark.s3website_routing_rules 2024-09-14T11:52:30.004 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:52:30.004 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-14T11:52:30.004 INFO:teuthology.orchestra.run.smithi071.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T11:52:30.004 INFO:teuthology.orchestra.run.smithi071.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:52:30.004 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:52:30.004 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-14T11:52:30.004 INFO:teuthology.orchestra.run.smithi071.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T11:52:30.004 INFO:teuthology.orchestra.run.smithi071.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T11:52:30.004 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:52:30.004 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-14T11:52:30.004 INFO:teuthology.orchestra.run.smithi071.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T11:52:30.004 INFO:teuthology.orchestra.run.smithi071.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-14T11:52:30.004 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:52:30.005 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-14T11:52:30.005 INFO:teuthology.orchestra.run.smithi071.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T11:52:30.005 INFO:teuthology.orchestra.run.smithi071.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:52:30.005 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:52:30.005 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-14T11:52:30.005 INFO:teuthology.orchestra.run.smithi071.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T11:52:30.005 INFO:teuthology.orchestra.run.smithi071.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T11:52:30.005 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:52:30.005 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-14T11:52:30.005 INFO:teuthology.orchestra.run.smithi071.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T11:52:30.005 INFO:teuthology.orchestra.run.smithi071.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:52:30.005 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:52:30.005 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-14T11:52:30.005 INFO:teuthology.orchestra.run.smithi071.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T11:52:30.005 INFO:teuthology.orchestra.run.smithi071.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-14T11:52:30.006 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:52:30.006 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-14T11:52:30.006 INFO:teuthology.orchestra.run.smithi071.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T11:52:30.006 INFO:teuthology.orchestra.run.smithi071.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:52:30.006 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:52:30.006 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-14T11:52:30.006 INFO:teuthology.orchestra.run.smithi071.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T11:52:30.006 INFO:teuthology.orchestra.run.smithi071.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T11:52:30.006 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:52:30.006 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-14T11:52:30.006 INFO:teuthology.orchestra.run.smithi071.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T11:52:30.006 INFO:teuthology.orchestra.run.smithi071.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:52:30.007 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:52:30.007 INFO:teuthology.orchestra.run.smithi071.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-14T11:52:30.007 INFO:teuthology.orchestra.run.smithi071.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T11:52:30.007 INFO:teuthology.orchestra.run.smithi071.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:52:30.007 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:52:30.007 INFO:teuthology.orchestra.run.smithi071.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-14T11:52:30.007 INFO:teuthology.orchestra.run.smithi071.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 18 warnings in 698.50s (0:11:38) = 2024-09-14T11:52:30.176 INFO:teuthology.orchestra.run.smithi071.stdout:___________________________________ summary ____________________________________ 2024-09-14T11:52:30.177 INFO:teuthology.orchestra.run.smithi071.stdout: py: commands succeeded 2024-09-14T11:52:30.177 INFO:teuthology.orchestra.run.smithi071.stdout: congratulations :) 2024-09-14T11:52:30.196 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-14T11:52:30.196 DEBUG:teuthology.orchestra.run.smithi071:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-14T11:52:30.297 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:52:30.297 INFO:tasks.s3tests:Cleaning up boto... 2024-09-14T11:52:30.297 DEBUG:teuthology.orchestra.run.smithi071:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-14T11:52:30.302 INFO:tasks.s3tests:Removing s3-tests... 2024-09-14T11:52:30.302 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T11:52:30.483 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:52:30.495 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:52:30.495 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:52:30.496 DEBUG:teuthology.orchestra.run.smithi071:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:52:30.501 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:52:30.502 INFO:teuthology.orchestra.run.smithi071.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:52:30.502 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:52:30.547 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:52:30.547 DEBUG:teuthology.orchestra.run.smithi071:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:52:30.600 INFO:tasks.workunit:timeout=3h 2024-09-14T11:52:30.600 INFO:tasks.workunit:cleanup=True 2024-09-14T11:52:30.601 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:52:30.650 INFO:tasks.workunit.client.0.smithi071.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:53:24.305 INFO:tasks.workunit.client.0.smithi071.stderr:Updating files: 99% (12809/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T11:53:24.612 INFO:tasks.workunit.client.0.smithi071.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:53:24.612 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:53:24.612 INFO:tasks.workunit.client.0.smithi071.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:53:24.612 INFO:tasks.workunit.client.0.smithi071.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:53:24.613 INFO:tasks.workunit.client.0.smithi071.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:53:24.613 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:53:24.613 INFO:tasks.workunit.client.0.smithi071.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:53:24.613 INFO:tasks.workunit.client.0.smithi071.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:53:24.613 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:53:24.613 INFO:tasks.workunit.client.0.smithi071.stderr: git switch -c 2024-09-14T11:53:24.613 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:53:24.613 INFO:tasks.workunit.client.0.smithi071.stderr:Or undo this operation with: 2024-09-14T11:53:24.613 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:53:24.613 INFO:tasks.workunit.client.0.smithi071.stderr: git switch - 2024-09-14T11:53:24.613 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:53:24.613 INFO:tasks.workunit.client.0.smithi071.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:53:24.614 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:53:24.614 INFO:tasks.workunit.client.0.smithi071.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:53:24.615 DEBUG:teuthology.orchestra.run.smithi071:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:53:24.665 INFO:tasks.workunit.client.0.smithi071.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:53:24.668 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:53:24.668 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:53:24.723 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:53:24.776 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:53:24.818 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:53:24.819 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:53:24.820 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:53:24.861 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:53:24.864 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-14T11:53:24.864 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:53:24.911 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-14T11:53:24.913 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-14T11:53:24.913 DEBUG:teuthology.orchestra.run.smithi071:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-14T11:53:24.963 INFO:tasks.workunit.client.0.smithi071.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-14T11:53:24.963 INFO:tasks.workunit.client.0.smithi071.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:53:24.963 INFO:tasks.workunit.client.0.smithi071.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:53:27.877 INFO:tasks.workunit.client.0.smithi071.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T11:53:27.877 INFO:tasks.workunit.client.0.smithi071.stderr:++ deactivate nondestructive 2024-09-14T11:53:27.877 INFO:tasks.workunit.client.0.smithi071.stderr:++ '[' -n '' ']' 2024-09-14T11:53:27.877 INFO:tasks.workunit.client.0.smithi071.stderr:++ '[' -n '' ']' 2024-09-14T11:53:27.877 INFO:tasks.workunit.client.0.smithi071.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:53:27.877 INFO:tasks.workunit.client.0.smithi071.stderr:++ hash -r 2024-09-14T11:53:27.877 INFO:tasks.workunit.client.0.smithi071.stderr:++ '[' -n '' ']' 2024-09-14T11:53:27.878 INFO:tasks.workunit.client.0.smithi071.stderr:++ unset VIRTUAL_ENV 2024-09-14T11:53:27.878 INFO:tasks.workunit.client.0.smithi071.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-14T11:53:27.878 INFO:tasks.workunit.client.0.smithi071.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T11:53:27.878 INFO:tasks.workunit.client.0.smithi071.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:53:27.878 INFO:tasks.workunit.client.0.smithi071.stderr:++ export VIRTUAL_ENV 2024-09-14T11:53:27.878 INFO:tasks.workunit.client.0.smithi071.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T11:53:27.878 INFO:tasks.workunit.client.0.smithi071.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T11:53:27.878 INFO:tasks.workunit.client.0.smithi071.stderr:++ export PATH 2024-09-14T11:53:27.878 INFO:tasks.workunit.client.0.smithi071.stderr:++ '[' -n '' ']' 2024-09-14T11:53:27.878 INFO:tasks.workunit.client.0.smithi071.stderr:++ '[' -z '' ']' 2024-09-14T11:53:27.878 INFO:tasks.workunit.client.0.smithi071.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T11:53:27.878 INFO:tasks.workunit.client.0.smithi071.stderr:++ PS1='(rgw) ' 2024-09-14T11:53:27.878 INFO:tasks.workunit.client.0.smithi071.stderr:++ export PS1 2024-09-14T11:53:27.879 INFO:tasks.workunit.client.0.smithi071.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-14T11:53:27.879 INFO:tasks.workunit.client.0.smithi071.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-14T11:53:27.879 INFO:tasks.workunit.client.0.smithi071.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:53:27.879 INFO:tasks.workunit.client.0.smithi071.stderr:++ hash -r 2024-09-14T11:53:27.879 INFO:tasks.workunit.client.0.smithi071.stderr:+ pip install pip --upgrade 2024-09-14T11:53:28.263 INFO:tasks.workunit.client.0.smithi071.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-14T11:53:28.466 INFO:tasks.workunit.client.0.smithi071.stdout:Collecting pip 2024-09-14T11:53:28.472 INFO:tasks.workunit.client.0.smithi071.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:53:28.506 INFO:tasks.workunit.client.0.smithi071.stdout:Installing collected packages: pip 2024-09-14T11:53:28.506 INFO:tasks.workunit.client.0.smithi071.stdout: Attempting uninstall: pip 2024-09-14T11:53:28.507 INFO:tasks.workunit.client.0.smithi071.stdout: Found existing installation: pip 22.0.2 2024-09-14T11:53:28.762 INFO:tasks.workunit.client.0.smithi071.stdout: Uninstalling pip-22.0.2: 2024-09-14T11:53:28.769 INFO:tasks.workunit.client.0.smithi071.stdout: Successfully uninstalled pip-22.0.2 2024-09-14T11:53:29.794 INFO:tasks.workunit.client.0.smithi071.stdout:Successfully installed pip-24.2 2024-09-14T11:53:29.866 INFO:tasks.workunit.client.0.smithi071.stderr:+ pip install boto3 2024-09-14T11:53:30.875 INFO:tasks.workunit.client.0.smithi071.stdout:Collecting boto3 2024-09-14T11:53:30.876 INFO:tasks.workunit.client.0.smithi071.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:53:31.399 INFO:tasks.workunit.client.0.smithi071.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:53:31.400 INFO:tasks.workunit.client.0.smithi071.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:53:31.465 INFO:tasks.workunit.client.0.smithi071.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:53:31.466 INFO:tasks.workunit.client.0.smithi071.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:53:31.512 INFO:tasks.workunit.client.0.smithi071.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:53:31.513 INFO:tasks.workunit.client.0.smithi071.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:53:31.564 INFO:tasks.workunit.client.0.smithi071.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:53:31.565 INFO:tasks.workunit.client.0.smithi071.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:53:31.635 INFO:tasks.workunit.client.0.smithi071.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:53:31.636 INFO:tasks.workunit.client.0.smithi071.stdout: Using cached urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-14T11:53:31.819 INFO:tasks.workunit.client.0.smithi071.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:53:31.820 INFO:tasks.workunit.client.0.smithi071.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:53:31.824 INFO:tasks.workunit.client.0.smithi071.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:53:31.825 INFO:tasks.workunit.client.0.smithi071.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:53:31.835 INFO:tasks.workunit.client.0.smithi071.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:53:31.836 INFO:tasks.workunit.client.0.smithi071.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:53:31.837 INFO:tasks.workunit.client.0.smithi071.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:53:31.838 INFO:tasks.workunit.client.0.smithi071.stdout:Using cached urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-14T11:53:31.840 INFO:tasks.workunit.client.0.smithi071.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:53:31.908 INFO:tasks.workunit.client.0.smithi071.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:53:32.950 INFO:tasks.workunit.client.0.smithi071.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-14T11:53:33.142 INFO:tasks.workunit.client.0.smithi071.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-14T11:53:33.282 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-14T11:53:33.319 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:53:33.319 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:53:33.362 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.364+0000 7fe86414a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:33.365 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.368+0000 7fe86414a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:33.365 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.368+0000 7fe86414a9c0 20 realm 2024-09-14T11:53:33.365 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.368+0000 7fe86414a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:33.365 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.368+0000 7fe86414a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:33.366 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.368+0000 7fe86414a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:53:33.366 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.368+0000 7fe86414a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:33.366 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.368+0000 7fe86414a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:33.366 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.368+0000 7fe86414a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:33.366 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.368+0000 7fe86414a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:53:33.366 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.368+0000 7fe86414a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:33.367 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.372+0000 7fe86414a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:53:33.367 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.372+0000 7fe86414a9c0 20 searching for the correct realm 2024-09-14T11:53:33.369 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.372+0000 7fe86144f640 0 -- 172.21.15.71:0/1777110917 >> [v2:172.21.15.71:6824/2436891866,v1:172.21.15.71:6825/2436891866] conn(0x7fe8540ba430 msgr2=0x7fe8540ba870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:53:33.375 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.380+0000 7fe861c50640 0 -- 172.21.15.71:0/1777110917 >> [v2:172.21.15.157:6816/1231501119,v1:172.21.15.157:6817/1231501119] conn(0x563acf714c30 msgr2=0x563acf7170c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:53:33.385 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.388+0000 7fe86414a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:53:33.385 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.388+0000 7fe86414a9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:53:33.385 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.388+0000 7fe86414a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:53:33.385 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.388+0000 7fe86414a9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:53:33.385 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.388+0000 7fe86414a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:53:33.385 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.388+0000 7fe86414a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:53:33.385 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.388+0000 7fe86414a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:33.385 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.388+0000 7fe86414a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:33.386 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.388+0000 7fe86414a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:33.386 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.388+0000 7fe86414a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:53:33.386 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.388+0000 7fe86414a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:33.386 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.388+0000 7fe86414a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:53:33.386 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.388+0000 7fe86414a9c0 20 zone default found 2024-09-14T11:53:33.387 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.388+0000 7fe86414a9c0 4 Realm: () 2024-09-14T11:53:33.387 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.388+0000 7fe86414a9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:53:33.387 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.388+0000 7fe86414a9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:53:33.387 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.388+0000 7fe86414a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:53:33.387 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.388+0000 7fe86414a9c0 20 zonegroup default 2024-09-14T11:53:33.387 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.388+0000 7fe86414a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:33.387 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.388+0000 7fe86414a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:33.387 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.388+0000 7fe86414a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:33.388 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.392+0000 7fe86414a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:33.388 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.392+0000 7fe86414a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:33.388 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.392+0000 7fe86414a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:33.388 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.392+0000 7fe86414a9c0 20 started sync module instance, tier type = 2024-09-14T11:53:33.388 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.392+0000 7fe86414a9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:53:33.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.408+0000 7fe86414a9c0 20 add_watcher() i=0 2024-09-14T11:53:33.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.408+0000 7fe86414a9c0 20 add_watcher() i=1 2024-09-14T11:53:33.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.408+0000 7fe86414a9c0 20 add_watcher() i=2 2024-09-14T11:53:33.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.408+0000 7fe86414a9c0 20 add_watcher() i=3 2024-09-14T11:53:33.406 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.408+0000 7fe86414a9c0 20 add_watcher() i=4 2024-09-14T11:53:33.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.408+0000 7fe86414a9c0 20 add_watcher() i=5 2024-09-14T11:53:33.407 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.408+0000 7fe86414a9c0 20 add_watcher() i=6 2024-09-14T11:53:33.409 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.412+0000 7fe86414a9c0 20 add_watcher() i=7 2024-09-14T11:53:33.409 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.412+0000 7fe86414a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:53:33.412 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.416+0000 7fe7137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:53:33.413 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.416+0000 7fe86414a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:53:33.413 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.416+0000 7fe86414a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:53:33.413 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.416+0000 7fe86414a9c0 5 note: GC not initialized 2024-09-14T11:53:33.413 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.416+0000 7fe7127fc640 20 reqs_thread_entry: start 2024-09-14T11:53:33.414 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.416+0000 7fe86414a9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:53:33.414 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.416+0000 7fe86414a9c0 20 Filter name: none 2024-09-14T11:53:33.414 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.416+0000 7fe683fff640 20 reqs_thread_entry: start 2024-09-14T11:53:33.414 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.416+0000 7fe86414a9c0 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-14T11:53:33.414 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.416+0000 7fe86414a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:33.414 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.416+0000 7fe86414a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:33.414 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.416+0000 7fe86414a9c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-14T11:53:33.414 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.416+0000 7fe86414a9c0 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T11:53:33.414 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.416+0000 7fe86414a9c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-14T11:53:33.414 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.416+0000 7fe86414a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:33.415 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.416+0000 7fe86414a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:33.415 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.416+0000 7fe86414a9c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-14T11:53:33.415 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.416+0000 7fe86414a9c0 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T11:53:33.415 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.416+0000 7fe86414a9c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-14T11:53:33.415 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.416+0000 7fe86414a9c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-14T11:53:33.415 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.420+0000 7fe86414a9c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-14T11:53:33.416 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.420+0000 7fe86414a9c0 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T11:53:33.416 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.420+0000 7fe86414a9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-14T11:53:33.416 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.420+0000 7fe7457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366835 cookie 94810588482160 notifier 8765 bl.length()=613 2024-09-14T11:53:33.416 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.420+0000 7fe7457fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-14T11:53:33.416 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.420+0000 7fe7457fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T11:53:33.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.424+0000 7fe86414a9c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-14T11:53:33.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.424+0000 7fe86414a9c0 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T11:53:33.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.424+0000 7fe86414a9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-14T11:53:33.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.424+0000 7fe744ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366836 cookie 94810588478160 notifier 8765 bl.length()=191 2024-09-14T11:53:33.421 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.424+0000 7fe744ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-14T11:53:33.421 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.424+0000 7fe744ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T11:53:33.422 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.424+0000 7fe7137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:53:33.426 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.428+0000 7fe86414a9c0 20 remove_watcher() i=0 2024-09-14T11:53:33.426 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.428+0000 7fe86414a9c0 2 removed watcher, disabling cache 2024-09-14T11:53:33.427 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.432+0000 7fe86414a9c0 20 remove_watcher() i=1 2024-09-14T11:53:33.429 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.432+0000 7fe86414a9c0 20 remove_watcher() i=2 2024-09-14T11:53:33.431 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.436+0000 7fe86414a9c0 20 remove_watcher() i=3 2024-09-14T11:53:33.433 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.436+0000 7fe86414a9c0 20 remove_watcher() i=4 2024-09-14T11:53:33.435 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.440+0000 7fe86414a9c0 20 remove_watcher() i=5 2024-09-14T11:53:33.437 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.440+0000 7fe86414a9c0 20 remove_watcher() i=6 2024-09-14T11:53:33.440 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.444+0000 7fe86414a9c0 20 remove_watcher() i=7 2024-09-14T11:53:33.657 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-14T11:53:33.657 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:53:33.716 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-14T11:53:33.748 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:53:33.749 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:53:33.792 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.796+0000 7f9f7ab5d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:33.795 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.800+0000 7f9f7ab5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:33.795 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.800+0000 7f9f7ab5d9c0 20 realm 2024-09-14T11:53:33.795 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.800+0000 7f9f7ab5d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:33.796 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.800+0000 7f9f7ab5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:33.796 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.800+0000 7f9f7ab5d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:53:33.796 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.800+0000 7f9f7ab5d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:33.797 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.800+0000 7f9f7ab5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:33.797 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.800+0000 7f9f7ab5d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:33.798 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.800+0000 7f9f7ab5d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:53:33.798 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.800+0000 7f9f7ab5d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:33.799 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.800+0000 7f9f7ab5d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:53:33.799 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.804+0000 7f9f7ab5d9c0 20 searching for the correct realm 2024-09-14T11:53:33.802 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:33.804+0000 7f9f78e64640 0 -- 172.21.15.71:0/629384896 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7f9f600c2060 msgr2=0x7f9f600a5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:53:34.016 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.020+0000 7f9f78e64640 0 -- 172.21.15.71:0/629384896 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55f83cfc37a0 msgr2=0x55f83cfc9090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:53:34.031 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.032+0000 7f9f7ab5d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:53:34.031 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.032+0000 7f9f7ab5d9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:53:34.031 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.032+0000 7f9f7ab5d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:53:34.031 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.032+0000 7f9f7ab5d9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:53:34.031 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.032+0000 7f9f7ab5d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:53:34.031 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.032+0000 7f9f7ab5d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:53:34.031 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.032+0000 7f9f7ab5d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:34.032 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.036+0000 7f9f7ab5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:34.032 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.036+0000 7f9f7ab5d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:34.032 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.036+0000 7f9f7ab5d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:53:34.032 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.036+0000 7f9f7ab5d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:34.033 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.036+0000 7f9f7ab5d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:53:34.034 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.036+0000 7f9f7ab5d9c0 20 zone default found 2024-09-14T11:53:34.034 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.036+0000 7f9f7ab5d9c0 4 Realm: () 2024-09-14T11:53:34.034 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.036+0000 7f9f7ab5d9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:53:34.034 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.036+0000 7f9f7ab5d9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:53:34.034 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.036+0000 7f9f7ab5d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:53:34.034 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.036+0000 7f9f7ab5d9c0 20 zonegroup default 2024-09-14T11:53:34.034 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.036+0000 7f9f7ab5d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:34.035 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.036+0000 7f9f7ab5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:34.035 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.036+0000 7f9f7ab5d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:34.035 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.036+0000 7f9f7ab5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:34.035 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.036+0000 7f9f7ab5d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:34.036 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.040+0000 7f9f7ab5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:34.036 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.040+0000 7f9f7ab5d9c0 20 started sync module instance, tier type = 2024-09-14T11:53:34.036 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.040+0000 7f9f7ab5d9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:53:34.060 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.064+0000 7f9f7ab5d9c0 20 add_watcher() i=0 2024-09-14T11:53:34.060 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.064+0000 7f9f7ab5d9c0 20 add_watcher() i=1 2024-09-14T11:53:34.060 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.064+0000 7f9f7ab5d9c0 20 add_watcher() i=2 2024-09-14T11:53:34.060 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.064+0000 7f9f7ab5d9c0 20 add_watcher() i=3 2024-09-14T11:53:34.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.064+0000 7f9f7ab5d9c0 20 add_watcher() i=4 2024-09-14T11:53:34.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.064+0000 7f9f7ab5d9c0 20 add_watcher() i=5 2024-09-14T11:53:34.061 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.064+0000 7f9f7ab5d9c0 20 add_watcher() i=6 2024-09-14T11:53:34.063 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.064+0000 7f9f7ab5d9c0 20 add_watcher() i=7 2024-09-14T11:53:34.063 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.064+0000 7f9f7ab5d9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:53:34.067 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.068+0000 7f9e2efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:53:34.068 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.072+0000 7f9f7ab5d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:53:34.068 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.072+0000 7f9f7ab5d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:53:34.068 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.072+0000 7f9f7ab5d9c0 5 note: GC not initialized 2024-09-14T11:53:34.069 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.072+0000 7f9e2dfdb640 20 reqs_thread_entry: start 2024-09-14T11:53:34.069 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.072+0000 7f9f7ab5d9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:53:34.069 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.072+0000 7f9f7ab5d9c0 20 Filter name: none 2024-09-14T11:53:34.069 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.072+0000 7f9d9f7fe640 20 reqs_thread_entry: start 2024-09-14T11:53:34.069 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.072+0000 7f9f7ab5d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:34.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.072+0000 7f9f7ab5d9c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T11:53:34.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.072+0000 7f9f7ab5d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:34.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.076+0000 7f9f7ab5d9c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T11:53:34.071 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.076+0000 7f9f7ab5d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:53:34.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.076+0000 7f9f7ab5d9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:53:34.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.076+0000 7f9f7ab5d9c0 20 INFO: main: starting shard=0 2024-09-14T11:53:34.072 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.076+0000 7f9f7ab5d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.783.0 2024-09-14T11:53:34.073 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.076+0000 7f9f7ab5d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:53:34.073 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.076+0000 7f9f7ab5d9c0 20 INFO: main: starting shard=1 2024-09-14T11:53:34.073 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.076+0000 7f9f7ab5d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.783.1 2024-09-14T11:53:34.073 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.076+0000 7f9f7ab5d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:53:34.074 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.076+0000 7f9f7ab5d9c0 20 INFO: main: starting shard=2 2024-09-14T11:53:34.074 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.076+0000 7f9f7ab5d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.783.2 2024-09-14T11:53:34.075 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.080+0000 7f9f7ab5d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:53:34.075 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.080+0000 7f9f7ab5d9c0 20 INFO: main: starting shard=3 2024-09-14T11:53:34.076 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.080+0000 7f9f7ab5d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.783.3 2024-09-14T11:53:34.076 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.080+0000 7f9f7ab5d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:53:34.076 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.080+0000 7f9f7ab5d9c0 20 INFO: main: starting shard=4 2024-09-14T11:53:34.076 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.080+0000 7f9f7ab5d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.783.4 2024-09-14T11:53:34.077 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.080+0000 7f9f7ab5d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:53:34.077 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.080+0000 7f9f7ab5d9c0 20 INFO: main: starting shard=5 2024-09-14T11:53:34.077 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.080+0000 7f9f7ab5d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.783.5 2024-09-14T11:53:34.077 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.080+0000 7f9f7ab5d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:53:34.077 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.080+0000 7f9f7ab5d9c0 20 INFO: main: starting shard=6 2024-09-14T11:53:34.077 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.080+0000 7f9f7ab5d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.783.6 2024-09-14T11:53:34.078 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.080+0000 7f9f7ab5d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:53:34.078 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.080+0000 7f9f7ab5d9c0 20 INFO: main: starting shard=7 2024-09-14T11:53:34.078 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.080+0000 7f9f7ab5d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.783.7 2024-09-14T11:53:34.080 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.084+0000 7f9f7ab5d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:53:34.080 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.084+0000 7f9f7ab5d9c0 20 INFO: main: starting shard=8 2024-09-14T11:53:34.080 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.084+0000 7f9f7ab5d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.783.8 2024-09-14T11:53:34.080 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.084+0000 7f9f7ab5d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:53:34.081 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.084+0000 7f9f7ab5d9c0 20 INFO: main: starting shard=9 2024-09-14T11:53:34.081 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.084+0000 7f9f7ab5d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.783.9 2024-09-14T11:53:34.081 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.084+0000 7f9f7ab5d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:53:34.081 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.084+0000 7f9f7ab5d9c0 20 INFO: main: starting shard=10 2024-09-14T11:53:34.081 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.084+0000 7f9f7ab5d9c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.783.10 2024-09-14T11:53:34.082 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.084+0000 7f9f7ab5d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:53:34.083 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.084+0000 7f9f7ab5d9c0 20 INFO: main: done 2024-09-14T11:53:34.084 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.088+0000 7f9e2efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:53:34.088 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.092+0000 7f9f7ab5d9c0 20 remove_watcher() i=0 2024-09-14T11:53:34.088 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.092+0000 7f9f7ab5d9c0 2 removed watcher, disabling cache 2024-09-14T11:53:34.090 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.092+0000 7f9f7ab5d9c0 20 remove_watcher() i=1 2024-09-14T11:53:34.092 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.096+0000 7f9f7ab5d9c0 20 remove_watcher() i=2 2024-09-14T11:53:34.094 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.096+0000 7f9f7ab5d9c0 20 remove_watcher() i=3 2024-09-14T11:53:34.096 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.100+0000 7f9f7ab5d9c0 20 remove_watcher() i=4 2024-09-14T11:53:34.098 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.100+0000 7f9f7ab5d9c0 20 remove_watcher() i=5 2024-09-14T11:53:34.101 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.104+0000 7f9f7ab5d9c0 20 remove_watcher() i=6 2024-09-14T11:53:34.104 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.108+0000 7f9f7ab5d9c0 20 remove_watcher() i=7 2024-09-14T11:53:34.119 INFO:tasks.workunit.client.0.smithi071.stderr:rados -p default.rgw.buckets.data ls | grep 7252c5b0-6d5d-4143-90f6-717b698dabc1 2024-09-14T11:53:34.146 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:53:34.146 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:53:34.211 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:34.216+0000 7f24fc5ad640 0 -- 172.21.15.71:0/2121540449 >> [v2:172.21.15.157:6808/527702018,v1:172.21.15.157:6809/527702018] conn(0x561557b0f250 msgr2=0x561557b11640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:53:34.219 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-14T11:53:34.219 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:53:34.219 INFO:tasks.workunit.client.0.smithi071.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:53:35.664 INFO:tasks.workunit.client.0.smithi071.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:53:36.111 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-14T11:53:36.140 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:53:36.140 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:53:36.182 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.184+0000 7fa958f099c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:36.185 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.188+0000 7fa958f099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:36.185 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.188+0000 7fa958f099c0 20 realm 2024-09-14T11:53:36.185 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.188+0000 7fa958f099c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:36.186 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.188+0000 7fa958f099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:36.186 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.188+0000 7fa958f099c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:53:36.186 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.188+0000 7fa958f099c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:36.186 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.188+0000 7fa958f099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:36.186 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.188+0000 7fa958f099c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:36.186 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.188+0000 7fa958f099c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:53:36.186 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.188+0000 7fa958f099c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:36.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.192+0000 7fa958f099c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:53:36.187 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.192+0000 7fa958f099c0 20 searching for the correct realm 2024-09-14T11:53:36.192 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.196+0000 7fa956a0f640 0 -- 172.21.15.71:0/664251722 >> [v2:172.21.15.157:6808/527702018,v1:172.21.15.157:6809/527702018] conn(0x7fa948054080 msgr2=0x7fa948074a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:53:36.409 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.412+0000 7fa956a0f640 0 -- 172.21.15.71:0/664251722 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x55acd7926940 msgr2=0x55acd7928de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:53:36.417 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.420+0000 7fa958f099c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:53:36.418 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.420+0000 7fa958f099c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:53:36.418 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.420+0000 7fa958f099c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:53:36.418 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.420+0000 7fa958f099c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:53:36.418 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.420+0000 7fa958f099c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:53:36.418 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.420+0000 7fa958f099c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:53:36.418 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.420+0000 7fa958f099c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:36.418 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.420+0000 7fa958f099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:36.418 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.420+0000 7fa958f099c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:36.419 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.420+0000 7fa958f099c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:53:36.419 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.420+0000 7fa958f099c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:36.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.424+0000 7fa958f099c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:53:36.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.424+0000 7fa958f099c0 20 zone default found 2024-09-14T11:53:36.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.424+0000 7fa958f099c0 4 Realm: () 2024-09-14T11:53:36.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.424+0000 7fa958f099c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:53:36.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.424+0000 7fa958f099c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:53:36.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.424+0000 7fa958f099c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:53:36.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.424+0000 7fa958f099c0 20 zonegroup default 2024-09-14T11:53:36.420 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.424+0000 7fa958f099c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:36.421 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.424+0000 7fa958f099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:36.421 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.424+0000 7fa958f099c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:36.421 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.424+0000 7fa958f099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:36.421 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.424+0000 7fa958f099c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:36.421 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.424+0000 7fa958f099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:36.421 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.424+0000 7fa958f099c0 20 started sync module instance, tier type = 2024-09-14T11:53:36.422 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.424+0000 7fa958f099c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:53:36.444 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.448+0000 7fa958f099c0 20 add_watcher() i=0 2024-09-14T11:53:36.444 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.448+0000 7fa958f099c0 20 add_watcher() i=1 2024-09-14T11:53:36.444 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.448+0000 7fa958f099c0 20 add_watcher() i=2 2024-09-14T11:53:36.444 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.448+0000 7fa958f099c0 20 add_watcher() i=3 2024-09-14T11:53:36.444 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.448+0000 7fa958f099c0 20 add_watcher() i=4 2024-09-14T11:53:36.444 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.448+0000 7fa958f099c0 20 add_watcher() i=5 2024-09-14T11:53:36.444 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.448+0000 7fa958f099c0 20 add_watcher() i=6 2024-09-14T11:53:36.446 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.448+0000 7fa958f099c0 20 add_watcher() i=7 2024-09-14T11:53:36.447 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.448+0000 7fa958f099c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:53:36.450 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.452+0000 7fa80d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:53:36.451 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.456+0000 7fa958f099c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:53:36.451 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.456+0000 7fa958f099c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:53:36.452 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.456+0000 7fa958f099c0 5 note: GC not initialized 2024-09-14T11:53:36.452 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.456+0000 7fa787fff640 20 reqs_thread_entry: start 2024-09-14T11:53:36.452 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.456+0000 7fa958f099c0 20 init_complete bucket index max shards: 11 2024-09-14T11:53:36.452 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.456+0000 7fa958f099c0 20 Filter name: none 2024-09-14T11:53:36.453 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.456+0000 7fa785ffb640 20 reqs_thread_entry: start 2024-09-14T11:53:36.453 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.456+0000 7fa958f099c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:36.454 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.456+0000 7fa958f099c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T11:53:36.454 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.456+0000 7fa958f099c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:36.455 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.456+0000 7fa958f099c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T11:53:36.455 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.456+0000 7fa958f099c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:53:36.455 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.456+0000 7fa958f099c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:53:36.455 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.456+0000 7fa958f099c0 20 INFO: main: starting shard=0 2024-09-14T11:53:36.455 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.456+0000 7fa958f099c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.783.0 2024-09-14T11:53:36.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.460+0000 7fa958f099c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:53:36.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.460+0000 7fa958f099c0 20 INFO: main: starting shard=1 2024-09-14T11:53:36.456 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.460+0000 7fa958f099c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.783.1 2024-09-14T11:53:36.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.460+0000 7fa958f099c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:53:36.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.460+0000 7fa958f099c0 20 INFO: main: starting shard=2 2024-09-14T11:53:36.457 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.460+0000 7fa958f099c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.783.2 2024-09-14T11:53:36.458 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.460+0000 7fa958f099c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:53:36.458 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.460+0000 7fa958f099c0 20 INFO: main: starting shard=3 2024-09-14T11:53:36.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.460+0000 7fa958f099c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.783.3 2024-09-14T11:53:36.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.464+0000 7fa958f099c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:53:36.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.464+0000 7fa958f099c0 20 INFO: main: starting shard=4 2024-09-14T11:53:36.459 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.464+0000 7fa958f099c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.783.4 2024-09-14T11:53:36.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.464+0000 7fa958f099c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:53:36.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.464+0000 7fa958f099c0 20 INFO: main: starting shard=5 2024-09-14T11:53:36.460 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.464+0000 7fa958f099c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.783.5 2024-09-14T11:53:36.461 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.464+0000 7fa958f099c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:53:36.461 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.464+0000 7fa958f099c0 20 INFO: main: starting shard=6 2024-09-14T11:53:36.461 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.464+0000 7fa958f099c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.783.6 2024-09-14T11:53:36.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.464+0000 7fa958f099c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:53:36.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.464+0000 7fa958f099c0 20 INFO: main: starting shard=7 2024-09-14T11:53:36.462 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.464+0000 7fa958f099c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.783.7 2024-09-14T11:53:36.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.468+0000 7fa958f099c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:53:36.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.468+0000 7fa958f099c0 20 INFO: main: starting shard=8 2024-09-14T11:53:36.463 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.468+0000 7fa958f099c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.783.8 2024-09-14T11:53:36.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.468+0000 7fa958f099c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:53:36.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.468+0000 7fa958f099c0 20 INFO: main: starting shard=9 2024-09-14T11:53:36.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.468+0000 7fa958f099c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.783.9 2024-09-14T11:53:36.465 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.468+0000 7fa958f099c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:53:36.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.468+0000 7fa958f099c0 20 INFO: main: starting shard=10 2024-09-14T11:53:36.466 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.468+0000 7fa958f099c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.783.10 2024-09-14T11:53:36.468 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.472+0000 7fa958f099c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:53:36.468 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.472+0000 7fa958f099c0 20 INFO: main: done 2024-09-14T11:53:36.469 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.472+0000 7fa80d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:53:36.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.476+0000 7fa958f099c0 20 remove_watcher() i=0 2024-09-14T11:53:36.473 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.476+0000 7fa958f099c0 2 removed watcher, disabling cache 2024-09-14T11:53:36.475 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.480+0000 7fa958f099c0 20 remove_watcher() i=1 2024-09-14T11:53:36.477 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.480+0000 7fa958f099c0 20 remove_watcher() i=2 2024-09-14T11:53:36.479 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.484+0000 7fa958f099c0 20 remove_watcher() i=3 2024-09-14T11:53:36.481 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.484+0000 7fa958f099c0 20 remove_watcher() i=4 2024-09-14T11:53:36.483 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.488+0000 7fa958f099c0 20 remove_watcher() i=5 2024-09-14T11:53:36.486 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.488+0000 7fa958f099c0 20 remove_watcher() i=6 2024-09-14T11:53:36.489 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.492+0000 7fa958f099c0 20 remove_watcher() i=7 2024-09-14T11:53:36.506 INFO:tasks.workunit.client.0.smithi071.stderr:rados -p default.rgw.buckets.data ls | grep b77cac94-411b-46de-a68e-b2c676b7552a 2024-09-14T11:53:36.535 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:53:36.535 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:53:36.816 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:36.820+0000 7f6a8a134640 0 -- 172.21.15.71:0/1405732637 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x7f6a84016360 msgr2=0x7f6a840167c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:53:36.833 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-14T11:53:36.833 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:53:36.865 INFO:tasks.workunit.client.0.smithi071.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:53:38.388 INFO:tasks.workunit.client.0.smithi071.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:53:38.389 INFO:tasks.workunit.client.0.smithi071.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:53:38.833 INFO:tasks.workunit.client.0.smithi071.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-14T11:53:38.834 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-09-14T11:53:38.961 INFO:tasks.workunit.client.0.smithi071.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-14T11:53:42.435 INFO:tasks.workunit.client.0.smithi071.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-14T11:53:42.888 INFO:tasks.workunit.client.0.smithi071.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-14T11:53:42.921 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:53:42.921 INFO:tasks.workunit.client.0.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:53:42.963 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.968+0000 7fb8d07289c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:42.965 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.968+0000 7fb8d07289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:42.965 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.968+0000 7fb8d07289c0 20 realm 2024-09-14T11:53:42.965 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.968+0000 7fb8d07289c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:42.966 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.968+0000 7fb8d07289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:42.966 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.968+0000 7fb8d07289c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:53:42.966 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.968+0000 7fb8d07289c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:42.966 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.968+0000 7fb8d07289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:42.966 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.968+0000 7fb8d07289c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:42.967 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.972+0000 7fb8d07289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:53:42.967 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.972+0000 7fb8d07289c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:42.968 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.972+0000 7fb8d07289c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:53:42.968 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.972+0000 7fb8d07289c0 20 searching for the correct realm 2024-09-14T11:53:42.972 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.976+0000 7fb8cea2f640 0 -- 172.21.15.71:0/1686005401 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fb8c4049040 msgr2=0x7fb8c403a420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:53:42.978 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.980+0000 7fb8cea2f640 0 -- 172.21.15.71:0/1686005401 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x55c2700c1b60 msgr2=0x55c2700c3f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:53:42.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.988+0000 7fb8d07289c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:53:42.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.988+0000 7fb8d07289c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:53:42.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.988+0000 7fb8d07289c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:53:42.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.988+0000 7fb8d07289c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:53:42.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.988+0000 7fb8d07289c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:53:42.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.988+0000 7fb8d07289c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:53:42.987 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.988+0000 7fb8d07289c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:42.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.992+0000 7fb8d07289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:42.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.992+0000 7fb8d07289c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:42.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.992+0000 7fb8d07289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:53:42.988 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.992+0000 7fb8d07289c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:42.989 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.992+0000 7fb8d07289c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:53:42.989 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.992+0000 7fb8d07289c0 20 zone default found 2024-09-14T11:53:42.989 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.992+0000 7fb8d07289c0 4 Realm: () 2024-09-14T11:53:42.989 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.992+0000 7fb8d07289c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:53:42.989 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.992+0000 7fb8d07289c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:53:42.989 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.992+0000 7fb8d07289c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:53:42.989 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.992+0000 7fb8d07289c0 20 zonegroup default 2024-09-14T11:53:42.989 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.992+0000 7fb8d07289c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:42.990 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.992+0000 7fb8d07289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:42.990 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.992+0000 7fb8d07289c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:42.990 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.992+0000 7fb8d07289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:42.990 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.992+0000 7fb8d07289c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:42.990 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.992+0000 7fb8d07289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:42.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.992+0000 7fb8d07289c0 20 started sync module instance, tier type = 2024-09-14T11:53:42.991 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:42.992+0000 7fb8d07289c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:53:43.009 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.012+0000 7fb8d07289c0 20 add_watcher() i=0 2024-09-14T11:53:43.009 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.012+0000 7fb8d07289c0 20 add_watcher() i=1 2024-09-14T11:53:43.009 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.012+0000 7fb8d07289c0 20 add_watcher() i=2 2024-09-14T11:53:43.009 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.012+0000 7fb8d07289c0 20 add_watcher() i=3 2024-09-14T11:53:43.009 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.012+0000 7fb8d07289c0 20 add_watcher() i=4 2024-09-14T11:53:43.009 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.012+0000 7fb8d07289c0 20 add_watcher() i=5 2024-09-14T11:53:43.010 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.012+0000 7fb8d07289c0 20 add_watcher() i=6 2024-09-14T11:53:43.011 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.016+0000 7fb8d07289c0 20 add_watcher() i=7 2024-09-14T11:53:43.011 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.016+0000 7fb8d07289c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:53:43.014 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.016+0000 7fb784fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:53:43.016 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.020+0000 7fb8d07289c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:53:43.016 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.020+0000 7fb8d07289c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:53:43.016 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.020+0000 7fb8d07289c0 5 note: GC not initialized 2024-09-14T11:53:43.016 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.020+0000 7fb6ff7fe640 20 reqs_thread_entry: start 2024-09-14T11:53:43.016 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.020+0000 7fb8d07289c0 20 init_complete bucket index max shards: 11 2024-09-14T11:53:43.017 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.020+0000 7fb8d07289c0 20 Filter name: none 2024-09-14T11:53:43.017 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.020+0000 7fb6fd7fa640 20 reqs_thread_entry: start 2024-09-14T11:53:43.017 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.020+0000 7fb8d07289c0 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-14T11:53:43.017 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.020+0000 7fb8d07289c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:43.018 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.020+0000 7fb8d07289c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T11:53:43.018 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.020+0000 7fb8d07289c0 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-14T11:53:43.019 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.020+0000 7fb8d07289c0 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-14T11:53:43.019 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.020+0000 7fb8d07289c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.783 : miss 2024-09-14T11:53:43.019 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.020+0000 7fb8d07289c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:43.019 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.020+0000 7fb8d07289c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T11:53:43.019 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.020+0000 7fb8d07289c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.783 info.flags=0x17 2024-09-14T11:53:43.019 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.020+0000 7fb8d07289c0 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.783 to cache LRU end 2024-09-14T11:53:43.019 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.020+0000 7fb8d07289c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:53:43.019 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.020+0000 7fb8d07289c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:53:43.019 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.020+0000 7fb8d07289c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:4444f441-0c56-48df-a905-d49e7e44d629.4596.783 2024-09-14T11:53:43.019 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.020+0000 7fb8d07289c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.783.0 2024-09-14T11:53:43.019 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.020+0000 7fb8d07289c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:53:43.019 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.020+0000 7fb8d07289c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.783.1 2024-09-14T11:53:43.020 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.024+0000 7fb8d07289c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:53:43.020 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.024+0000 7fb8d07289c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.783.2 2024-09-14T11:53:43.021 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.024+0000 7fb8d07289c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:53:43.021 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.024+0000 7fb8d07289c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.783.3 2024-09-14T11:53:43.022 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.024+0000 7fb8d07289c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:53:43.022 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.024+0000 7fb8d07289c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.783.4 2024-09-14T11:53:43.022 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.024+0000 7fb8d07289c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:53:43.022 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.024+0000 7fb8d07289c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.783.5 2024-09-14T11:53:43.023 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.028+0000 7fb8d07289c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T11:53:43.023 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.028+0000 7fb8d07289c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.783.6 2024-09-14T11:53:43.024 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.028+0000 7fb8d07289c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:53:43.024 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.028+0000 7fb8d07289c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.783.7 2024-09-14T11:53:43.025 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.028+0000 7fb8d07289c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:53:43.025 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.028+0000 7fb8d07289c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.783.8 2024-09-14T11:53:43.026 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.028+0000 7fb8d07289c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T11:53:43.026 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.028+0000 7fb8d07289c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.783.9 2024-09-14T11:53:43.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.028+0000 7fb8d07289c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:53:43.027 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.028+0000 7fb8d07289c0 20 bucket index object: :.dir.4444f441-0c56-48df-a905-d49e7e44d629.4596.783.10 2024-09-14T11:53:43.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.032+0000 7fb8d07289c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:53:43.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.032+0000 7fb8d07289c0 1 NOTICE: finished all shards (0 entries found) 2024-09-14T11:53:43.028 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.032+0000 7fb784fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:53:43.032 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.036+0000 7fb8d07289c0 20 remove_watcher() i=0 2024-09-14T11:53:43.033 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.036+0000 7fb8d07289c0 2 removed watcher, disabling cache 2024-09-14T11:53:43.034 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.036+0000 7fb8d07289c0 20 remove_watcher() i=1 2024-09-14T11:53:43.036 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.040+0000 7fb8d07289c0 20 remove_watcher() i=2 2024-09-14T11:53:43.039 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.044+0000 7fb8d07289c0 20 remove_watcher() i=3 2024-09-14T11:53:43.041 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.044+0000 7fb8d07289c0 20 remove_watcher() i=4 2024-09-14T11:53:43.043 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.044+0000 7fb8d07289c0 20 remove_watcher() i=5 2024-09-14T11:53:43.045 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.048+0000 7fb8d07289c0 20 remove_watcher() i=6 2024-09-14T11:53:43.048 INFO:tasks.workunit.client.0.smithi071.stderr:2024-09-14T11:53:43.052+0000 7fb8d07289c0 20 remove_watcher() i=7 2024-09-14T11:53:43.061 INFO:tasks.workunit.client.0.smithi071.stderr:Deleting bucket versioning-bucket 2024-09-14T11:53:43.121 INFO:tasks.workunit.client.0.smithi071.stderr:Completed bucket versioning tests 2024-09-14T11:53:43.121 INFO:tasks.workunit.client.0.smithi071.stdout:connected to http://localhost:80 2024-09-14T11:53:43.203 INFO:tasks.workunit.client.0.smithi071.stderr:+ deactivate 2024-09-14T11:53:43.203 INFO:tasks.workunit.client.0.smithi071.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-14T11:53:43.203 INFO:tasks.workunit.client.0.smithi071.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T11:53:43.203 INFO:tasks.workunit.client.0.smithi071.stderr:+ export PATH 2024-09-14T11:53:43.203 INFO:tasks.workunit.client.0.smithi071.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T11:53:43.203 INFO:tasks.workunit.client.0.smithi071.stderr:+ '[' -n '' ']' 2024-09-14T11:53:43.203 INFO:tasks.workunit.client.0.smithi071.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:53:43.203 INFO:tasks.workunit.client.0.smithi071.stderr:+ hash -r 2024-09-14T11:53:43.203 INFO:tasks.workunit.client.0.smithi071.stderr:+ '[' -n '' ']' 2024-09-14T11:53:43.203 INFO:tasks.workunit.client.0.smithi071.stderr:+ unset VIRTUAL_ENV 2024-09-14T11:53:43.204 INFO:tasks.workunit.client.0.smithi071.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-14T11:53:43.204 INFO:tasks.workunit.client.0.smithi071.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T11:53:43.204 INFO:tasks.workunit.client.0.smithi071.stderr:+ unset -f deactivate 2024-09-14T11:53:43.204 INFO:tasks.workunit.client.0.smithi071.stderr:+ echo OK. 2024-09-14T11:53:43.204 INFO:tasks.workunit.client.0.smithi071.stdout:OK. 2024-09-14T11:53:43.205 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:53:43.205 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:53:43.258 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-14T11:53:43.259 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:53:43.664 DEBUG:teuthology.parallel:result is None 2024-09-14T11:53:43.664 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:53:43.677 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:53:43.677 DEBUG:teuthology.orchestra.run.smithi071:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:53:43.723 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:53:43.723 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-14T11:53:43.736 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-14T11:53:43.791 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-14T11:53:43.791 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-14T11:53:43.792 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-14T11:53:43.841 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-14T11:53:43.841 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-14T11:53:43.877 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:53:43.877 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:53:43.915 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.920+0000 7f1dfa2ae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:43.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.920+0000 7f1dfa2ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:43.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.920+0000 7f1dfa2ae9c0 20 realm 2024-09-14T11:53:43.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.920+0000 7f1dfa2ae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:43.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.920+0000 7f1dfa2ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:43.918 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.920+0000 7f1dfa2ae9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:53:43.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.920+0000 7f1dfa2ae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:43.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.920+0000 7f1dfa2ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:43.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.920+0000 7f1dfa2ae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:43.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.924+0000 7f1dfa2ae9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:53:43.919 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.924+0000 7f1dfa2ae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:43.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.924+0000 7f1dfa2ae9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:53:43.920 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.924+0000 7f1dfa2ae9c0 20 searching for the correct realm 2024-09-14T11:53:43.925 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.928+0000 7f1df7db4640 0 -- 172.21.15.71:0/297057377 >> [v2:172.21.15.157:6824/2449482389,v1:172.21.15.157:6825/2449482389] conn(0x555b65980500 msgr2=0x555b659829c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:53:43.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.932+0000 7f1df85b5640 0 -- 172.21.15.71:0/297057377 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x555b6597b620 msgr2=0x555b6597da30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:53:43.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.940+0000 7f1dfa2ae9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:53:43.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.940+0000 7f1dfa2ae9c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:53:43.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.940+0000 7f1dfa2ae9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:53:43.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.940+0000 7f1dfa2ae9c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:53:43.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.940+0000 7f1dfa2ae9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:53:43.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.940+0000 7f1dfa2ae9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:53:43.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.940+0000 7f1dfa2ae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:43.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.944+0000 7f1dfa2ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:43.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.944+0000 7f1dfa2ae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:43.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.944+0000 7f1dfa2ae9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:53:43.939 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.944+0000 7f1dfa2ae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:43.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.944+0000 7f1dfa2ae9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:53:43.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.944+0000 7f1dfa2ae9c0 20 zone default found 2024-09-14T11:53:43.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.944+0000 7f1dfa2ae9c0 4 Realm: () 2024-09-14T11:53:43.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.944+0000 7f1dfa2ae9c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:53:43.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.944+0000 7f1dfa2ae9c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:53:43.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.944+0000 7f1dfa2ae9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:53:43.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.944+0000 7f1dfa2ae9c0 20 zonegroup default 2024-09-14T11:53:43.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.944+0000 7f1dfa2ae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:43.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.944+0000 7f1dfa2ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:43.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.944+0000 7f1dfa2ae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:43.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.944+0000 7f1dfa2ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:43.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.944+0000 7f1dfa2ae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:43.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.944+0000 7f1dfa2ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:43.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.944+0000 7f1dfa2ae9c0 20 started sync module instance, tier type = 2024-09-14T11:53:43.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.944+0000 7f1dfa2ae9c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:53:43.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.960+0000 7f1dfa2ae9c0 20 add_watcher() i=0 2024-09-14T11:53:43.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.960+0000 7f1dfa2ae9c0 20 add_watcher() i=1 2024-09-14T11:53:43.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.960+0000 7f1dfa2ae9c0 20 add_watcher() i=2 2024-09-14T11:53:43.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.960+0000 7f1dfa2ae9c0 20 add_watcher() i=3 2024-09-14T11:53:43.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.960+0000 7f1dfa2ae9c0 20 add_watcher() i=4 2024-09-14T11:53:43.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.960+0000 7f1dfa2ae9c0 20 add_watcher() i=5 2024-09-14T11:53:43.959 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.960+0000 7f1dfa2ae9c0 20 add_watcher() i=6 2024-09-14T11:53:43.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.964+0000 7f1dfa2ae9c0 20 add_watcher() i=7 2024-09-14T11:53:43.961 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.964+0000 7f1dfa2ae9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:53:43.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.968+0000 7f1cadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:53:43.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.968+0000 7f1dfa2ae9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:53:43.965 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:43.968+0000 7f1dfa2ae9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:53:44.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:44.040+0000 7f1cacfe1640 20 reqs_thread_entry: start 2024-09-14T11:53:44.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:44.040+0000 7f1dfa2ae9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:53:44.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:44.040+0000 7f1dfa2ae9c0 20 Filter name: none 2024-09-14T11:53:44.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:44.044+0000 7f1c267fc640 20 reqs_thread_entry: start 2024-09-14T11:53:44.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:44.044+0000 7f1dfa2ae9c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-14T11:53:44.039 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:44.044+0000 7f1dfa2ae9c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:44.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:44.044+0000 7f1dfa2ae9c0 20 rados_obj.operate() r=0 bl.length=482 2024-09-14T11:53:44.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:44.044+0000 7f1dfa2ae9c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-14T11:53:44.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:44.044+0000 7f1dfa2ae9c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:53:44.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:44.044+0000 7f1dfa2ae9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:53:44.040 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:44.044+0000 7f1dfa2ae9c0 10 removing key index: TVXFEPYIKEKJZDICOLMF 2024-09-14T11:53:44.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:44.044+0000 7f1dfa2ae9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.keys:TVXFEPYIKEKJZDICOLMF, ofs0, ns] 2024-09-14T11:53:44.043 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:44.048+0000 7f1cd6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366839 cookie 93851034865872 notifier 9342 bl.length()=170 2024-09-14T11:53:44.044 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:44.048+0000 7f1dfa2ae9c0 10 removing email index: tester.client.0_test@test.test 2024-09-14T11:53:44.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:44.052+0000 7f1dfa2ae9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-14T11:53:44.047 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:44.052+0000 7f1cd67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366423 cookie 93851034858624 notifier 9342 bl.length()=181 2024-09-14T11:53:44.049 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:44.052+0000 7f1dfa2ae9c0 10 removing user buckets index 2024-09-14T11:53:44.051 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:44.056+0000 7f1dfa2ae9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-14T11:53:44.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:44.056+0000 7f1cd67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366840 cookie 93851034865872 notifier 9342 bl.length()=172 2024-09-14T11:53:44.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:44.056+0000 7f1dfa2ae9c0 10 removing user index: tester.client.0 2024-09-14T11:53:44.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:44.056+0000 7f1dfa2ae9c0 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-14T11:53:44.054 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:44.056+0000 7f1dfa2ae9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-14T11:53:44.055 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:44.060+0000 7f1cd6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366841 cookie 93851034863376 notifier 9342 bl.length()=164 2024-09-14T11:53:44.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:44.060+0000 7f1cadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:53:44.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:44.064+0000 7f1dfa2ae9c0 20 remove_watcher() i=0 2024-09-14T11:53:44.062 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:44.064+0000 7f1dfa2ae9c0 2 removed watcher, disabling cache 2024-09-14T11:53:44.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:44.068+0000 7f1dfa2ae9c0 20 remove_watcher() i=1 2024-09-14T11:53:44.066 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:44.068+0000 7f1dfa2ae9c0 20 remove_watcher() i=2 2024-09-14T11:53:44.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:44.072+0000 7f1dfa2ae9c0 20 remove_watcher() i=3 2024-09-14T11:53:44.070 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:44.072+0000 7f1dfa2ae9c0 20 remove_watcher() i=4 2024-09-14T11:53:44.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:44.076+0000 7f1dfa2ae9c0 20 remove_watcher() i=5 2024-09-14T11:53:44.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:44.080+0000 7f1dfa2ae9c0 20 remove_watcher() i=6 2024-09-14T11:53:44.077 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:44.080+0000 7f1dfa2ae9c0 20 remove_watcher() i=7 2024-09-14T11:53:44.092 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-14T11:53:44.101 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-14T11:53:44.109 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-14T11:53:44.183 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-14T11:53:44.192 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-14T11:53:44.192 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:53:44.227 INFO:tasks.rgw.client.0.smithi071.stdout:2024-09-14T11:53:44.232+0000 7f0aa902b640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 36910) UID: 0 2024-09-14T11:53:44.227 INFO:tasks.rgw.client.0.smithi071.stdout:2024-09-14T11:53:44.232+0000 7f0aac873a40 -1 shutting down 2024-09-14T11:53:56.396 INFO:tasks.rgw.client.0:Stopped 2024-09-14T11:53:56.396 DEBUG:teuthology.orchestra.run.smithi071:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-14T11:53:56.402 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f /etc/ceph/vault-root-token 2024-09-14T11:53:56.460 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-14T11:53:56.515 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-14T11:53:56.515 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-14T11:53:56.515 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-14T11:53:56.597 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:53:56.597 INFO:teuthology.orchestra.run.smithi071.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:53:56.639 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.644+0000 7fd0826299c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:56.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.644+0000 7fd0826299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:56.641 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.644+0000 7fd0826299c0 20 realm 2024-09-14T11:53:56.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.644+0000 7fd0826299c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:56.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.644+0000 7fd0826299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:56.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.644+0000 7fd0826299c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:53:56.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.644+0000 7fd0826299c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:56.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.644+0000 7fd0826299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:56.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.644+0000 7fd0826299c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:56.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.648+0000 7fd0826299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:53:56.643 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.648+0000 7fd0826299c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:56.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.648+0000 7fd0826299c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:53:56.644 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.648+0000 7fd0826299c0 20 searching for the correct realm 2024-09-14T11:53:56.648 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.652+0000 7fd080930640 0 -- 172.21.15.71:0/1219371331 >> [v2:172.21.15.71:6800/1986152349,v1:172.21.15.71:6801/1986152349] conn(0x7fd068033060 msgr2=0x7fd06809bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:53:56.862 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.864+0000 7fd080930640 0 -- 172.21.15.71:0/1219371331 >> [v2:172.21.15.71:6816/60654820,v1:172.21.15.71:6817/60654820] conn(0x56163e3e6430 msgr2=0x56163e3e8820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:53:56.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.880+0000 7fd0826299c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:53:56.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.880+0000 7fd0826299c0 20 RGWRados::pool_iterate: got zone_info.4444f441-0c56-48df-a905-d49e7e44d629 2024-09-14T11:53:56.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.880+0000 7fd0826299c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:53:56.877 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.880+0000 7fd0826299c0 20 RGWRados::pool_iterate: got zonegroup_info.7c1e5828-0ea7-4b59-8c7b-cfc83df40d17 2024-09-14T11:53:56.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.880+0000 7fd0826299c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:53:56.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.880+0000 7fd0826299c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:53:56.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.880+0000 7fd0826299c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:56.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.880+0000 7fd0826299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:56.878 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.880+0000 7fd0826299c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:56.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.880+0000 7fd0826299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:53:56.879 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.880+0000 7fd0826299c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:56.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.884+0000 7fd0826299c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:53:56.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.884+0000 7fd0826299c0 20 zone default found 2024-09-14T11:53:56.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.884+0000 7fd0826299c0 4 Realm: () 2024-09-14T11:53:56.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.884+0000 7fd0826299c0 4 ZoneGroup: default (7c1e5828-0ea7-4b59-8c7b-cfc83df40d17) 2024-09-14T11:53:56.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.884+0000 7fd0826299c0 4 Zone: default (4444f441-0c56-48df-a905-d49e7e44d629) 2024-09-14T11:53:56.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.884+0000 7fd0826299c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:53:56.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.884+0000 7fd0826299c0 20 zonegroup default 2024-09-14T11:53:56.880 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.884+0000 7fd0826299c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:56.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.884+0000 7fd0826299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:56.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.884+0000 7fd0826299c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:56.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.884+0000 7fd0826299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:56.881 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.884+0000 7fd0826299c0 20 rados->read ofs=0 len=0 2024-09-14T11:53:56.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.884+0000 7fd0826299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:53:56.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.884+0000 7fd0826299c0 20 started sync module instance, tier type = 2024-09-14T11:53:56.882 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.884+0000 7fd0826299c0 20 started zone id=4444f441-0c56-48df-a905-d49e7e44d629 (name=default) with tier type = 2024-09-14T11:53:56.906 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.908+0000 7fd0826299c0 20 add_watcher() i=0 2024-09-14T11:53:56.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.908+0000 7fd0826299c0 20 add_watcher() i=1 2024-09-14T11:53:56.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.908+0000 7fd0826299c0 20 add_watcher() i=2 2024-09-14T11:53:56.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.908+0000 7fd0826299c0 20 add_watcher() i=3 2024-09-14T11:53:56.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.908+0000 7fd0826299c0 20 add_watcher() i=4 2024-09-14T11:53:56.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.908+0000 7fd0826299c0 20 add_watcher() i=5 2024-09-14T11:53:56.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.908+0000 7fd0826299c0 20 add_watcher() i=6 2024-09-14T11:53:56.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.912+0000 7fd0826299c0 20 add_watcher() i=7 2024-09-14T11:53:56.909 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.912+0000 7fd0826299c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:53:56.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.916+0000 7fcf36fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:53:56.913 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.916+0000 7fd0826299c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:53:56.914 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:56.916+0000 7fd0826299c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:53:57.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.012+0000 7fcf35fdb640 20 reqs_thread_entry: start 2024-09-14T11:53:57.008 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.012+0000 7fd0826299c0 20 init_complete bucket index max shards: 11 2024-09-14T11:53:57.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.012+0000 7fd0826299c0 20 Filter name: none 2024-09-14T11:53:57.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.012+0000 7fcea77fe640 20 reqs_thread_entry: start 2024-09-14T11:53:57.009 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.012+0000 7fd0826299c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:53:57.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.016+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:53:57.014 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.016+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:53:57.016 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.020+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:53:57.019 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.020+0000 7fd0826299c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:53:57.022 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.024+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:53:57.024 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.028+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:53:57.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.028+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:53:57.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.028+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.14548625382648048030', time=2024-09-14T13:41:04.114810+0000, chain.objs.size()=5 2024-09-14T11:53:57.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.028+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.162__multipart_foo-LUKEWARM.2~Ay2xG1EWJ-5rTxcvPxKZFPlEIoXjwYy.1 2024-09-14T11:53:57.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.028+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.162__shadow_foo-LUKEWARM.2~Ay2xG1EWJ-5rTxcvPxKZFPlEIoXjwYy.1_1 2024-09-14T11:53:57.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.028+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.162__multipart_foo-LUKEWARM.2~Ay2xG1EWJ-5rTxcvPxKZFPlEIoXjwYy.2 2024-09-14T11:53:57.026 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.028+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.162__shadow_foo-LUKEWARM.2~Ay2xG1EWJ-5rTxcvPxKZFPlEIoXjwYy.2_1 2024-09-14T11:53:57.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.028+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.162__multipart_foo-LUKEWARM.2~Ay2xG1EWJ-5rTxcvPxKZFPlEIoXjwYy.3 2024-09-14T11:53:57.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.028+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='2~KWmVnowZ9Jk096muzlxWNEj8kfj-8Vf', time=2024-09-14T13:46:05.420660+0000, chain.objs.size()=2 2024-09-14T11:53:57.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.028+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.2~KWmVnowZ9Jk096muzlxWNEj8kfj-8Vf.3 2024-09-14T11:53:57.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.028+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__shadow_mymultipart.2~KWmVnowZ9Jk096muzlxWNEj8kfj-8Vf.3_1 2024-09-14T11:53:57.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.032+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.13795161385986492090', time=2024-09-14T13:46:14.261033+0000, chain.objs.size()=3 2024-09-14T11:53:57.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.032+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.526__multipart_mymultipart.2~uAfhvn61fx64fCafxQQs85jv0MPkHcO.1 2024-09-14T11:53:57.027 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.032+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.526__multipart_mymultipart.2~uAfhvn61fx64fCafxQQs85jv0MPkHcO.2 2024-09-14T11:53:57.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.032+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.526__multipart_mymultipart.2~uAfhvn61fx64fCafxQQs85jv0MPkHcO.3 2024-09-14T11:53:57.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.032+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.6054465785195003860', time=2024-09-14T13:52:27.111539+0000, chain.objs.size()=4 2024-09-14T11:53:57.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.032+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.780__shadow_.QpKhdyQbXOOcr_yiK_WoTWxP3bmAhUs_1 2024-09-14T11:53:57.028 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.032+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.780__shadow_.QpKhdyQbXOOcr_yiK_WoTWxP3bmAhUs_2 2024-09-14T11:53:57.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.036+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.780__shadow_.QpKhdyQbXOOcr_yiK_WoTWxP3bmAhUs_3 2024-09-14T11:53:57.031 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.036+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.780__shadow_.QpKhdyQbXOOcr_yiK_WoTWxP3bmAhUs_4 2024-09-14T11:53:57.037 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.040+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:53:57.042 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.044+0000 7fd0826299c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:53:57.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.048+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:53:57.046 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.048+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:53:57.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.052+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:53:57.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.052+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.9428881510125764771', time=2024-09-14T13:46:17.837084+0000, chain.objs.size()=2 2024-09-14T11:53:57.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.052+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.529__multipart_mymultipart.2~oimTMeim85188P3ITAcdBRaqZVkoHVr.1 2024-09-14T11:53:57.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.052+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.529__multipart_mymultipart.2~oimTMeim85188P3ITAcdBRaqZVkoHVr.2 2024-09-14T11:53:57.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.052+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.9071211628840923304', time=2024-09-14T13:46:55.235188+0000, chain.objs.size()=1 2024-09-14T11:53:57.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.052+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.553__shadow_.-vJBMa_79hGXaZ0JmgpzLlPB5F2aYwk_1 2024-09-14T11:53:57.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.052+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.8689047997342803098', time=2024-09-14T13:50:32.797836+0000, chain.objs.size()=1 2024-09-14T11:53:57.048 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.052+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.646__shadow_.QKODd7djsMxUJjQOn1zUi7HEYg2aHOm_1 2024-09-14T11:53:57.052 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.056+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:53:57.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.060+0000 7fd0826299c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:53:57.060 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.064+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:53:57.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.064+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:53:57.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.064+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:53:57.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.064+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='2~qBw79TAActKJieNTTAhCL2oNytGldlW', time=2024-09-14T13:46:21.634719+0000, chain.objs.size()=1 2024-09-14T11:53:57.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.064+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.535__multipart_mymultipart.2~qBw79TAActKJieNTTAhCL2oNytGldlW.1 2024-09-14T11:53:57.064 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.068+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:53:57.068 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.072+0000 7fd0826299c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:53:57.072 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.076+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:53:57.073 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.076+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:53:57.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.076+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-14T11:53:57.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.076+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='_dYgoU_4kKmEnRzVsdSUBeoWsZu-ca71', time=2024-09-14T13:41:01.993600+0000, chain.objs.size()=2 2024-09-14T11:53:57.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.076+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.161__shadow_.IVBYCvaPdHlise6z5mfwSECIDq24Rpq_1 2024-09-14T11:53:57.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.076+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.161__shadow_.IVBYCvaPdHlise6z5mfwSECIDq24Rpq_2 2024-09-14T11:53:57.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.076+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.9263462896026763333', time=2024-09-14T13:45:48.848761+0000, chain.objs.size()=12 2024-09-14T11:53:57.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.076+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__multipart_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.1 2024-09-14T11:53:57.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.076+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__shadow_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.1_1 2024-09-14T11:53:57.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.076+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__multipart_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.2 2024-09-14T11:53:57.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.076+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__shadow_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.2_1 2024-09-14T11:53:57.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.076+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__multipart_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.3 2024-09-14T11:53:57.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.076+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__shadow_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.3_1 2024-09-14T11:53:57.075 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.076+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__multipart_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.4 2024-09-14T11:53:57.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.076+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__shadow_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.4_1 2024-09-14T11:53:57.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.076+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__multipart_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.5 2024-09-14T11:53:57.076 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.076+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__shadow_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.5_1 2024-09-14T11:53:57.078 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.080+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__multipart_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.6 2024-09-14T11:53:57.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.080+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__shadow_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.6_1 2024-09-14T11:53:57.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.080+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.8235243108625581079', time=2024-09-14T13:45:49.191608+0000, chain.objs.size()=12 2024-09-14T11:53:57.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.080+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__multipart_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.1 2024-09-14T11:53:57.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.080+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__shadow_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.1_1 2024-09-14T11:53:57.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.080+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__multipart_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.2 2024-09-14T11:53:57.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.080+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__shadow_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.2_1 2024-09-14T11:53:57.079 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.080+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__multipart_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.3 2024-09-14T11:53:57.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.084+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__shadow_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.3_1 2024-09-14T11:53:57.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.084+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__multipart_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.4 2024-09-14T11:53:57.080 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.084+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__shadow_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.4_1 2024-09-14T11:53:57.081 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.084+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__multipart_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.5 2024-09-14T11:53:57.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.084+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__shadow_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.5_1 2024-09-14T11:53:57.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.084+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__multipart_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.6 2024-09-14T11:53:57.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.084+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__shadow_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.6_1 2024-09-14T11:53:57.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.088+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.11483477054206476006', time=2024-09-14T13:45:56.785390+0000, chain.objs.size()=6 2024-09-14T11:53:57.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.088+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.520__multipart_mymultipart.2~2BRtxVY7ChHbgGUvoCF76lufYiKssBp.1 2024-09-14T11:53:57.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.088+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.520__multipart_mymultipart.2~2BRtxVY7ChHbgGUvoCF76lufYiKssBp.2 2024-09-14T11:53:57.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.088+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.520__multipart_mymultipart.2~2BRtxVY7ChHbgGUvoCF76lufYiKssBp.3 2024-09-14T11:53:57.083 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.088+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.520__multipart_mymultipart.2~2BRtxVY7ChHbgGUvoCF76lufYiKssBp.4 2024-09-14T11:53:57.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.088+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.520__multipart_mymultipart.2~2BRtxVY7ChHbgGUvoCF76lufYiKssBp.5 2024-09-14T11:53:57.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.088+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.520__multipart_mymultipart.2~2BRtxVY7ChHbgGUvoCF76lufYiKssBp.6 2024-09-14T11:53:57.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.088+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='2~muo5jX6db-wo8U_XNbGx8mZpEez88MO', time=2024-09-14T13:46:21.160719+0000, chain.objs.size()=1 2024-09-14T11:53:57.084 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.088+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.534__multipart_mymultipart.2~muo5jX6db-wo8U_XNbGx8mZpEez88MO.1 2024-09-14T11:53:57.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.088+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.648120526613644059', time=2024-09-14T13:48:08.275750+0000, chain.objs.size()=12 2024-09-14T11:53:57.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.088+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.614__multipart_multipart_enc.2~UCHU9vsk22xSq2zJGDPQ3Rq7D_VKzJx.1 2024-09-14T11:53:57.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.092+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.614__shadow_multipart_enc.2~UCHU9vsk22xSq2zJGDPQ3Rq7D_VKzJx.1_1 2024-09-14T11:53:57.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.092+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.614__multipart_multipart_enc.2~UCHU9vsk22xSq2zJGDPQ3Rq7D_VKzJx.2 2024-09-14T11:53:57.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.092+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.614__shadow_multipart_enc.2~UCHU9vsk22xSq2zJGDPQ3Rq7D_VKzJx.2_1 2024-09-14T11:53:57.089 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.092+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.614__multipart_multipart_enc.2~UCHU9vsk22xSq2zJGDPQ3Rq7D_VKzJx.3 2024-09-14T11:53:57.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.092+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.614__shadow_multipart_enc.2~UCHU9vsk22xSq2zJGDPQ3Rq7D_VKzJx.3_1 2024-09-14T11:53:57.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.092+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.614__multipart_multipart_enc.2~UCHU9vsk22xSq2zJGDPQ3Rq7D_VKzJx.4 2024-09-14T11:53:57.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.092+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.614__shadow_multipart_enc.2~UCHU9vsk22xSq2zJGDPQ3Rq7D_VKzJx.4_1 2024-09-14T11:53:57.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.092+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.614__multipart_multipart_enc.2~UCHU9vsk22xSq2zJGDPQ3Rq7D_VKzJx.5 2024-09-14T11:53:57.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.092+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.614__shadow_multipart_enc.2~UCHU9vsk22xSq2zJGDPQ3Rq7D_VKzJx.5_1 2024-09-14T11:53:57.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.092+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.614__multipart_multipart_enc.2~UCHU9vsk22xSq2zJGDPQ3Rq7D_VKzJx.6 2024-09-14T11:53:57.090 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.092+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.614__shadow_multipart_enc.2~UCHU9vsk22xSq2zJGDPQ3Rq7D_VKzJx.6_1 2024-09-14T11:53:57.100 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.104+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:53:57.106 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.108+0000 7fd0826299c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:53:57.109 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.112+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:53:57.110 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.112+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:53:57.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.116+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:53:57.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.116+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.8347025880257221333', time=2024-09-14T13:46:11.917507+0000, chain.objs.size()=4 2024-09-14T11:53:57.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.116+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.524__multipart_mymultipart.2~UjadXHIo4M-VYgNEQrBHzyRFDAti2mT.1 2024-09-14T11:53:57.111 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.116+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.524__shadow_mymultipart.2~UjadXHIo4M-VYgNEQrBHzyRFDAti2mT.1_1 2024-09-14T11:53:57.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.116+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.524__multipart_mymultipart.2~UjadXHIo4M-VYgNEQrBHzyRFDAti2mT.2 2024-09-14T11:53:57.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.116+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.524__shadow_mymultipart.2~UjadXHIo4M-VYgNEQrBHzyRFDAti2mT.2_1 2024-09-14T11:53:57.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.116+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.17303261829497798212', time=2024-09-14T13:48:11.263310+0000, chain.objs.size()=12 2024-09-14T11:53:57.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.116+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.615__multipart_multipart_enc.2~xOYiN64Fw0YwekFw4HMCtRexA6ByC8f.1 2024-09-14T11:53:57.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.116+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.615__shadow_multipart_enc.2~xOYiN64Fw0YwekFw4HMCtRexA6ByC8f.1_1 2024-09-14T11:53:57.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.116+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.615__multipart_multipart_enc.2~xOYiN64Fw0YwekFw4HMCtRexA6ByC8f.2 2024-09-14T11:53:57.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.116+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.615__shadow_multipart_enc.2~xOYiN64Fw0YwekFw4HMCtRexA6ByC8f.2_1 2024-09-14T11:53:57.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.116+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.615__multipart_multipart_enc.2~xOYiN64Fw0YwekFw4HMCtRexA6ByC8f.3 2024-09-14T11:53:57.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.116+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.615__shadow_multipart_enc.2~xOYiN64Fw0YwekFw4HMCtRexA6ByC8f.3_1 2024-09-14T11:53:57.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.116+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.615__multipart_multipart_enc.2~xOYiN64Fw0YwekFw4HMCtRexA6ByC8f.4 2024-09-14T11:53:57.112 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.116+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.615__shadow_multipart_enc.2~xOYiN64Fw0YwekFw4HMCtRexA6ByC8f.4_1 2024-09-14T11:53:57.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.124+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.615__multipart_multipart_enc.2~xOYiN64Fw0YwekFw4HMCtRexA6ByC8f.5 2024-09-14T11:53:57.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.124+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.615__shadow_multipart_enc.2~xOYiN64Fw0YwekFw4HMCtRexA6ByC8f.5_1 2024-09-14T11:53:57.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.124+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.615__multipart_multipart_enc.2~xOYiN64Fw0YwekFw4HMCtRexA6ByC8f.6 2024-09-14T11:53:57.120 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.124+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.615__shadow_multipart_enc.2~xOYiN64Fw0YwekFw4HMCtRexA6ByC8f.6_1 2024-09-14T11:53:57.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.124+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='2~MCwfUo6fq3kTxyS7VIa-8z5kHSX-znD', time=2024-09-14T13:50:21.518901+0000, chain.objs.size()=12 2024-09-14T11:53:57.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.124+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.625__multipart_multipart_enc.2~MCwfUo6fq3kTxyS7VIa-8z5kHSX-znD.1 2024-09-14T11:53:57.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.124+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.625__shadow_multipart_enc.2~MCwfUo6fq3kTxyS7VIa-8z5kHSX-znD.1_1 2024-09-14T11:53:57.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.124+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.625__multipart_multipart_enc.2~MCwfUo6fq3kTxyS7VIa-8z5kHSX-znD.2 2024-09-14T11:53:57.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.124+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.625__shadow_multipart_enc.2~MCwfUo6fq3kTxyS7VIa-8z5kHSX-znD.2_1 2024-09-14T11:53:57.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.124+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.625__multipart_multipart_enc.2~MCwfUo6fq3kTxyS7VIa-8z5kHSX-znD.3 2024-09-14T11:53:57.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.124+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.625__shadow_multipart_enc.2~MCwfUo6fq3kTxyS7VIa-8z5kHSX-znD.3_1 2024-09-14T11:53:57.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.124+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.625__multipart_multipart_enc.2~MCwfUo6fq3kTxyS7VIa-8z5kHSX-znD.4 2024-09-14T11:53:57.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.128+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.625__shadow_multipart_enc.2~MCwfUo6fq3kTxyS7VIa-8z5kHSX-znD.4_1 2024-09-14T11:53:57.126 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.128+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.625__multipart_multipart_enc.2~MCwfUo6fq3kTxyS7VIa-8z5kHSX-znD.5 2024-09-14T11:53:57.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.132+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.625__shadow_multipart_enc.2~MCwfUo6fq3kTxyS7VIa-8z5kHSX-znD.5_1 2024-09-14T11:53:57.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.132+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.625__multipart_multipart_enc.2~MCwfUo6fq3kTxyS7VIa-8z5kHSX-znD.6 2024-09-14T11:53:57.129 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.132+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.625__shadow_multipart_enc.2~MCwfUo6fq3kTxyS7VIa-8z5kHSX-znD.6_1 2024-09-14T11:53:57.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.136+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:53:57.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.140+0000 7fd0826299c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:53:57.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.144+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:53:57.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.148+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:53:57.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.148+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:53:57.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.148+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.1525608592954761166', time=2024-09-14T13:45:53.617277+0000, chain.objs.size()=1 2024-09-14T11:53:57.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.148+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.519__multipart_mymultipart.2~5FA_Y3DjL2WvTREznwGakyKaJj432t8.1 2024-09-14T11:53:57.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.148+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.15960953964507752859', time=2024-09-14T13:47:02.301267+0000, chain.objs.size()=1 2024-09-14T11:53:57.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.148+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.562__multipart_mymultipart.2~pMJU3M_etZcfQJE2IapTYfQgwm21fjg.1 2024-09-14T11:53:57.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.148+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.9436257959432228233', time=2024-09-14T13:47:02.642773+0000, chain.objs.size()=1 2024-09-14T11:53:57.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.148+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.562__multipart_mymultipart.lAQ3MXls8PrXexoPWhsV9doItZvbzLFI.1 2024-09-14T11:53:57.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.152+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:53:57.153 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.156+0000 7fd0826299c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:53:57.156 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.160+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:53:57.157 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.160+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:53:57.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.160+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:53:57.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.160+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.16632009488868267037', time=2024-09-14T13:41:02.287026+0000, chain.objs.size()=3 2024-09-14T11:53:57.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.160+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.161__shadow_.ndv2ONptk7ytjx3aSkIrb-ZD31TPrJe_0 2024-09-14T11:53:57.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.160+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.161__shadow_.ndv2ONptk7ytjx3aSkIrb-ZD31TPrJe_1 2024-09-14T11:53:57.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.160+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.161__shadow_.ndv2ONptk7ytjx3aSkIrb-ZD31TPrJe_2 2024-09-14T11:53:57.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.160+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='2~bKjA4TnX--ufUubeAR8W4GN1DnNtKZQ', time=2024-09-14T13:46:03.675794+0000, chain.objs.size()=1 2024-09-14T11:53:57.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.160+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.2~bKjA4TnX--ufUubeAR8W4GN1DnNtKZQ.2 2024-09-14T11:53:57.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.160+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='2~X4yLE1NVVwzcGPkjHR4B08oi3I1Fvia', time=2024-09-14T13:50:23.106573+0000, chain.objs.size()=12 2024-09-14T11:53:57.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.160+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.626__multipart_multipart_enc.2~X4yLE1NVVwzcGPkjHR4B08oi3I1Fvia.1 2024-09-14T11:53:57.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.160+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.626__shadow_multipart_enc.2~X4yLE1NVVwzcGPkjHR4B08oi3I1Fvia.1_1 2024-09-14T11:53:57.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.160+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.626__multipart_multipart_enc.2~X4yLE1NVVwzcGPkjHR4B08oi3I1Fvia.2 2024-09-14T11:53:57.159 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.160+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.626__shadow_multipart_enc.2~X4yLE1NVVwzcGPkjHR4B08oi3I1Fvia.2_1 2024-09-14T11:53:57.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.160+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.626__multipart_multipart_enc.2~X4yLE1NVVwzcGPkjHR4B08oi3I1Fvia.3 2024-09-14T11:53:57.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.160+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.626__shadow_multipart_enc.2~X4yLE1NVVwzcGPkjHR4B08oi3I1Fvia.3_1 2024-09-14T11:53:57.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.160+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.626__multipart_multipart_enc.2~X4yLE1NVVwzcGPkjHR4B08oi3I1Fvia.4 2024-09-14T11:53:57.160 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.160+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.626__shadow_multipart_enc.2~X4yLE1NVVwzcGPkjHR4B08oi3I1Fvia.4_1 2024-09-14T11:53:57.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.168+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.626__multipart_multipart_enc.2~X4yLE1NVVwzcGPkjHR4B08oi3I1Fvia.5 2024-09-14T11:53:57.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.168+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.626__shadow_multipart_enc.2~X4yLE1NVVwzcGPkjHR4B08oi3I1Fvia.5_1 2024-09-14T11:53:57.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.168+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.626__multipart_multipart_enc.2~X4yLE1NVVwzcGPkjHR4B08oi3I1Fvia.6 2024-09-14T11:53:57.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.168+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.626__shadow_multipart_enc.2~X4yLE1NVVwzcGPkjHR4B08oi3I1Fvia.6_1 2024-09-14T11:53:57.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.168+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.3274867677848222161', time=2024-09-14T13:51:02.968959+0000, chain.objs.size()=1 2024-09-14T11:53:57.167 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.168+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.703__multipart_file1.2~itM9_UFCvBK8ZhIXq9FPWeMUv786fDH.1 2024-09-14T11:53:57.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.176+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:53:57.176 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.180+0000 7fd0826299c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:53:57.178 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.180+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:53:57.179 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.184+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:53:57.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.184+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:53:57.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.184+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.15007684328793895539', time=2024-09-14T13:51:07.727766+0000, chain.objs.size()=1 2024-09-14T11:53:57.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.184+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.712__multipart_file1.2~KCY-Pio6AqCzXnfoUVZMGKz78P7HQjT.1 2024-09-14T11:53:57.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.184+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:53:57.185 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.188+0000 7fd0826299c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:53:57.188 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.192+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:53:57.190 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.192+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:53:57.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.192+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-14T11:53:57.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.192+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='_w4SXsUUj99Vq0It3jnPq8dl-BvX5mgZ', time=2024-09-14T13:41:02.571488+0000, chain.objs.size()=1 2024-09-14T11:53:57.191 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.192+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.161__shadow_.QeralV-1pLnBkhcSoc5L7ihqnPKIBnc_0 2024-09-14T11:53:57.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.192+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='_W5kH8T1fMfeqLne8SGerekhiKzXOcy_', time=2024-09-14T13:41:05.249947+0000, chain.objs.size()=3 2024-09-14T11:53:57.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.192+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.162__shadow_.lRU0XyqRUJC1zwizI03S0EL6nIQiOI0_0 2024-09-14T11:53:57.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.192+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.162__shadow_.lRU0XyqRUJC1zwizI03S0EL6nIQiOI0_1 2024-09-14T11:53:57.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.192+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.162__shadow_.lRU0XyqRUJC1zwizI03S0EL6nIQiOI0_2 2024-09-14T11:53:57.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.192+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='2~Jg8-pFOXb7w_H3ql38SlwuS0JtXOLBO', time=2024-09-14T13:46:07.092748+0000, chain.objs.size()=1 2024-09-14T11:53:57.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.192+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.2~Jg8-pFOXb7w_H3ql38SlwuS0JtXOLBO.2 2024-09-14T11:53:57.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.192+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='2~Jg8-pFOXb7w_H3ql38SlwuS0JtXOLBO', time=2024-09-14T13:46:07.096353+0000, chain.objs.size()=1 2024-09-14T11:53:57.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.192+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.2~Jg8-pFOXb7w_H3ql38SlwuS0JtXOLBO.3 2024-09-14T11:53:57.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.196+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.8151274161562784197', time=2024-09-14T13:50:31.449577+0000, chain.objs.size()=1 2024-09-14T11:53:57.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.196+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.644__shadow_.Q7iHPNLidBXSKobtFtQxw1L8yu8GhDH_1 2024-09-14T11:53:57.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.196+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.5140375856423214482', time=2024-09-14T13:51:39.940007+0000, chain.objs.size()=20 2024-09-14T11:53:57.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.196+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.736__multipart_foo.2~x9ShwCRuFZ_jTh-99jUEzGPEwIgGTUm.1 2024-09-14T11:53:57.192 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.196+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.736__shadow_foo.2~x9ShwCRuFZ_jTh-99jUEzGPEwIgGTUm.1_1 2024-09-14T11:53:57.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.196+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.736__multipart_foo.2~x9ShwCRuFZ_jTh-99jUEzGPEwIgGTUm.2 2024-09-14T11:53:57.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.196+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.736__shadow_foo.2~x9ShwCRuFZ_jTh-99jUEzGPEwIgGTUm.2_1 2024-09-14T11:53:57.193 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.196+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.736__multipart_foo.2~x9ShwCRuFZ_jTh-99jUEzGPEwIgGTUm.3 2024-09-14T11:53:57.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.200+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.736__shadow_foo.2~x9ShwCRuFZ_jTh-99jUEzGPEwIgGTUm.3_1 2024-09-14T11:53:57.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.200+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.736__multipart_foo.2~x9ShwCRuFZ_jTh-99jUEzGPEwIgGTUm.4 2024-09-14T11:53:57.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.200+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.736__shadow_foo.2~x9ShwCRuFZ_jTh-99jUEzGPEwIgGTUm.4_1 2024-09-14T11:53:57.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.200+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.736__multipart_foo.2~x9ShwCRuFZ_jTh-99jUEzGPEwIgGTUm.5 2024-09-14T11:53:57.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.200+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.736__shadow_foo.2~x9ShwCRuFZ_jTh-99jUEzGPEwIgGTUm.5_1 2024-09-14T11:53:57.197 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.200+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.736__multipart_foo.2~x9ShwCRuFZ_jTh-99jUEzGPEwIgGTUm.6 2024-09-14T11:53:57.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.200+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.736__shadow_foo.2~x9ShwCRuFZ_jTh-99jUEzGPEwIgGTUm.6_1 2024-09-14T11:53:57.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.200+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.736__multipart_foo.2~x9ShwCRuFZ_jTh-99jUEzGPEwIgGTUm.7 2024-09-14T11:53:57.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.200+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.736__shadow_foo.2~x9ShwCRuFZ_jTh-99jUEzGPEwIgGTUm.7_1 2024-09-14T11:53:57.198 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.200+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.736__multipart_foo.2~x9ShwCRuFZ_jTh-99jUEzGPEwIgGTUm.8 2024-09-14T11:53:57.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.208+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.736__shadow_foo.2~x9ShwCRuFZ_jTh-99jUEzGPEwIgGTUm.8_1 2024-09-14T11:53:57.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.208+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.736__multipart_foo.2~x9ShwCRuFZ_jTh-99jUEzGPEwIgGTUm.9 2024-09-14T11:53:57.204 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.208+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.736__shadow_foo.2~x9ShwCRuFZ_jTh-99jUEzGPEwIgGTUm.9_1 2024-09-14T11:53:57.205 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.208+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.736__multipart_foo.2~x9ShwCRuFZ_jTh-99jUEzGPEwIgGTUm.10 2024-09-14T11:53:57.206 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.208+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.736__shadow_foo.2~x9ShwCRuFZ_jTh-99jUEzGPEwIgGTUm.10_1 2024-09-14T11:53:57.209 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.212+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:53:57.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.216+0000 7fd0826299c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:53:57.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.220+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:53:57.217 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.220+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:53:57.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.220+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-14T11:53:57.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.220+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='2~zmJU1YgX-ojCiySroau2YHHnwVFjsFo', time=2024-09-14T13:41:34.164201+0000, chain.objs.size()=1 2024-09-14T11:53:57.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.220+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.202__multipart_mymultipart.2~zmJU1YgX-ojCiySroau2YHHnwVFjsFo.1 2024-09-14T11:53:57.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.220+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.9919598192834036927', time=2024-09-14T13:45:51.113020+0000, chain.objs.size()=1 2024-09-14T11:53:57.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.220+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.514__multipart_mymultipart.2~0ilHr_fgAjCYndz_N2dl5Izxd5_h6WK.1 2024-09-14T11:53:57.219 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.220+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.11648669081237680508', time=2024-09-14T13:46:03.690240+0000, chain.objs.size()=6 2024-09-14T11:53:57.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.220+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.8Ptxq2LQysiY4jhPWNk7GMbm99bCG1en.1 2024-09-14T11:53:57.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.220+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.2~3vwhMXs3tIqDxihvtUeHvDdxFt9XlYf.2 2024-09-14T11:53:57.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.220+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.2~3vwhMXs3tIqDxihvtUeHvDdxFt9XlYf.3 2024-09-14T11:53:57.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.220+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.2~3vwhMXs3tIqDxihvtUeHvDdxFt9XlYf.4 2024-09-14T11:53:57.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.220+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.2~3vwhMXs3tIqDxihvtUeHvDdxFt9XlYf.5 2024-09-14T11:53:57.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.220+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.2~3vwhMXs3tIqDxihvtUeHvDdxFt9XlYf.6 2024-09-14T11:53:57.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.220+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='2~8Vlh7sdKQWPS5oxoL2ZRo9RsSwRgAK0', time=2024-09-14T13:46:09.078016+0000, chain.objs.size()=1 2024-09-14T11:53:57.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.220+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.2~8Vlh7sdKQWPS5oxoL2ZRo9RsSwRgAK0.1 2024-09-14T11:53:57.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.224+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='2~8Vlh7sdKQWPS5oxoL2ZRo9RsSwRgAK0', time=2024-09-14T13:46:09.081264+0000, chain.objs.size()=1 2024-09-14T11:53:57.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.224+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.2~8Vlh7sdKQWPS5oxoL2ZRo9RsSwRgAK0.2 2024-09-14T11:53:57.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.224+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='2~8Vlh7sdKQWPS5oxoL2ZRo9RsSwRgAK0', time=2024-09-14T13:46:09.084453+0000, chain.objs.size()=1 2024-09-14T11:53:57.220 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.224+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.2~8Vlh7sdKQWPS5oxoL2ZRo9RsSwRgAK0.3 2024-09-14T11:53:57.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.224+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='2~8Vlh7sdKQWPS5oxoL2ZRo9RsSwRgAK0', time=2024-09-14T13:46:09.087407+0000, chain.objs.size()=1 2024-09-14T11:53:57.221 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.224+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.2~8Vlh7sdKQWPS5oxoL2ZRo9RsSwRgAK0.4 2024-09-14T11:53:57.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.224+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='2~8Vlh7sdKQWPS5oxoL2ZRo9RsSwRgAK0', time=2024-09-14T13:46:09.091580+0000, chain.objs.size()=1 2024-09-14T11:53:57.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.224+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.2~8Vlh7sdKQWPS5oxoL2ZRo9RsSwRgAK0.5 2024-09-14T11:53:57.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.224+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='2~8Vlh7sdKQWPS5oxoL2ZRo9RsSwRgAK0', time=2024-09-14T13:46:09.094365+0000, chain.objs.size()=1 2024-09-14T11:53:57.222 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.224+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.2~8Vlh7sdKQWPS5oxoL2ZRo9RsSwRgAK0.6 2024-09-14T11:53:57.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.228+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='2~B6OCAfeFVaL9ZOF8KRuvagfn0Dg-Sh9', time=2024-09-14T13:46:19.956594+0000, chain.objs.size()=1 2024-09-14T11:53:57.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.228+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.532__multipart_mymultipart.2~B6OCAfeFVaL9ZOF8KRuvagfn0Dg-Sh9.1 2024-09-14T11:53:57.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.228+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.4192537704625409511', time=2024-09-14T13:51:43.606526+0000, chain.objs.size()=1 2024-09-14T11:53:57.224 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.228+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.743__multipart_mymultipart3.2~kBX0blNtQMrxnmAy-Qew1ZouOjQzlqk.1 2024-09-14T11:53:57.228 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.232+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:53:57.233 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.236+0000 7fd0826299c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:53:57.238 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.240+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:53:57.239 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.244+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:53:57.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.244+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:53:57.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.244+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.5587223769244991594', time=2024-09-14T13:40:59.361185+0000, chain.objs.size()=3 2024-09-14T11:53:57.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.244+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.159__shadow_.7azkNI5y84-mdIrmwQlD34r-z0bcK_r_0 2024-09-14T11:53:57.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.244+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.159__shadow_.7azkNI5y84-mdIrmwQlD34r-z0bcK_r_1 2024-09-14T11:53:57.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.244+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.159__shadow_.7azkNI5y84-mdIrmwQlD34r-z0bcK_r_2 2024-09-14T11:53:57.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.244+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='_dqcbuuxqVwfCFmg6e_pzwBNefUjfgtG', time=2024-09-14T13:41:07.096553+0000, chain.objs.size()=1 2024-09-14T11:53:57.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.244+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.166__shadow_.ZCoGLt7LEHC-ogrrIkcy83KjvDmVIPh_0 2024-09-14T11:53:57.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.244+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='2~whSjRsHSJfcEE3DwfQSPN9PMVkb3ejc', time=2024-09-14T13:41:34.840812+0000, chain.objs.size()=1 2024-09-14T11:53:57.241 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.244+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.203__multipart_mymultipart.2~whSjRsHSJfcEE3DwfQSPN9PMVkb3ejc.1 2024-09-14T11:53:57.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.244+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.14746652298615056353', time=2024-09-14T13:45:49.018630+0000, chain.objs.size()=12 2024-09-14T11:53:57.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.244+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__multipart_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.1 2024-09-14T11:53:57.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.244+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__shadow_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.1_1 2024-09-14T11:53:57.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.244+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__multipart_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.2 2024-09-14T11:53:57.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.244+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__shadow_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.2_1 2024-09-14T11:53:57.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.244+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__multipart_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.3 2024-09-14T11:53:57.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.244+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__shadow_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.3_1 2024-09-14T11:53:57.242 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.244+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__multipart_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.4 2024-09-14T11:53:57.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.248+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__shadow_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.4_1 2024-09-14T11:53:57.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.248+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__multipart_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.5 2024-09-14T11:53:57.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.248+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__shadow_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.5_1 2024-09-14T11:53:57.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.248+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__multipart_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.6 2024-09-14T11:53:57.246 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.248+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__shadow_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.6_1 2024-09-14T11:53:57.252 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.256+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:53:57.256 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.260+0000 7fd0826299c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:53:57.259 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.264+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:53:57.260 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.264+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:53:57.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.264+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:53:57.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.264+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='_6e381JCG3tCYSmmep10qKx0W71TlV8_', time=2024-09-14T13:41:01.556022+0000, chain.objs.size()=1 2024-09-14T11:53:57.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.264+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.161__shadow_.xpw2W-7JHGM39IQ7TMrU6E3-Zudsfpp_0 2024-09-14T11:53:57.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.264+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.147835260496358841', time=2024-09-14T13:41:03.349811+0000, chain.objs.size()=3 2024-09-14T11:53:57.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.264+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.162__multipart_foo-STANDARD.2~UPZLyJ3O1CcYwrmoTUFNUVcDxoCxcc7.1 2024-09-14T11:53:57.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.264+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.162__multipart_foo-STANDARD.2~UPZLyJ3O1CcYwrmoTUFNUVcDxoCxcc7.2 2024-09-14T11:53:57.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.264+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.162__multipart_foo-STANDARD.2~UPZLyJ3O1CcYwrmoTUFNUVcDxoCxcc7.3 2024-09-14T11:53:57.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.264+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.11944180423054303665', time=2024-09-14T13:46:13.364044+0000, chain.objs.size()=2 2024-09-14T11:53:57.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.264+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.526__multipart_mymultipart.2~bEVP-v2gvEUsoDCso9ijqL7p2OPQMCP.1 2024-09-14T11:53:57.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.264+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.526__multipart_mymultipart.2~bEVP-v2gvEUsoDCso9ijqL7p2OPQMCP.2 2024-09-14T11:53:57.262 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.264+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='2~RcjbFyNf2skdtK2bWcLjAcUyrqGDiMA', time=2024-09-14T13:46:19.985384+0000, chain.objs.size()=1 2024-09-14T11:53:57.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.264+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.532__multipart_mymultipart2.2~RcjbFyNf2skdtK2bWcLjAcUyrqGDiMA.1 2024-09-14T11:53:57.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.264+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.12764751642048253191', time=2024-09-14T13:47:47.954880+0000, chain.objs.size()=4 2024-09-14T11:53:57.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.264+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.579__multipart_testobj.2~aluFsgj76oAyDiehd3nB6SE75tLWDK3.1 2024-09-14T11:53:57.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.264+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.579__multipart_testobj.2~aluFsgj76oAyDiehd3nB6SE75tLWDK3.2 2024-09-14T11:53:57.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.264+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.579__multipart_testobj.2~aluFsgj76oAyDiehd3nB6SE75tLWDK3.3 2024-09-14T11:53:57.263 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.264+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.579__multipart_testobj.2~aluFsgj76oAyDiehd3nB6SE75tLWDK3.4 2024-09-14T11:53:57.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.272+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:53:57.273 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.276+0000 7fd0826299c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:53:57.277 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.280+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:53:57.278 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.280+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:53:57.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.284+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:53:57.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.284+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='_KwrTy-X2jrXlPvSHgjwiHyq3WZPpqM5', time=2024-09-14T13:41:05.278939+0000, chain.objs.size()=1 2024-09-14T11:53:57.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.284+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.162__shadow_.lzrNoUgWD9rBYHbHxbppehAekGmLjQQ_0 2024-09-14T11:53:57.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.284+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.7590264443894908994', time=2024-09-14T13:45:48.847135+0000, chain.objs.size()=12 2024-09-14T11:53:57.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.284+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__multipart_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.1 2024-09-14T11:53:57.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.284+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__shadow_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.1_1 2024-09-14T11:53:57.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.284+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__multipart_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.2 2024-09-14T11:53:57.280 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.284+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__shadow_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.2_1 2024-09-14T11:53:57.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.284+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__multipart_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.3 2024-09-14T11:53:57.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.284+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__shadow_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.3_1 2024-09-14T11:53:57.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.284+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__multipart_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.4 2024-09-14T11:53:57.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.284+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__shadow_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.4_1 2024-09-14T11:53:57.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.284+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__multipart_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.5 2024-09-14T11:53:57.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.284+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__shadow_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.5_1 2024-09-14T11:53:57.281 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.284+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__multipart_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.6 2024-09-14T11:53:57.283 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.288+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__shadow_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.6_1 2024-09-14T11:53:57.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.288+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.17768730480376130849', time=2024-09-14T13:45:54.817110+0000, chain.objs.size()=1 2024-09-14T11:53:57.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.288+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.519__multipart_mymultipart.2~yD3olPBUKRsYgMs8qbDm1jjSzTW4Pk_.1 2024-09-14T11:53:57.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.288+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.13717734049576504955', time=2024-09-14T13:47:07.627234+0000, chain.objs.size()=2 2024-09-14T11:53:57.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.288+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.564__shadow_.OSPaF4BM_yaD6CRwLjkj0JoJJAY_rM6_1 2024-09-14T11:53:57.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.288+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.564__shadow_.OSPaF4BM_yaD6CRwLjkj0JoJJAY_rM6_2 2024-09-14T11:53:57.292 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.296+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:53:57.297 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.300+0000 7fd0826299c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:53:57.299 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.304+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:53:57.300 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.304+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:53:57.301 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.304+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:53:57.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.304+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.8435181188325853488', time=2024-09-14T13:41:01.061216+0000, chain.objs.size()=3 2024-09-14T11:53:57.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.304+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.160__multipart_mymultipart-STANDARD.2~zuCumfrkYnrE9vtnXLNyxBnnhGPTtMf.1 2024-09-14T11:53:57.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.304+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.160__multipart_mymultipart-STANDARD.2~zuCumfrkYnrE9vtnXLNyxBnnhGPTtMf.2 2024-09-14T11:53:57.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.304+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.160__multipart_mymultipart-STANDARD.2~zuCumfrkYnrE9vtnXLNyxBnnhGPTtMf.3 2024-09-14T11:53:57.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.304+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.7222202047702201538', time=2024-09-14T13:46:07.110995+0000, chain.objs.size()=12 2024-09-14T11:53:57.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.304+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.2~KWmVnowZ9Jk096muzlxWNEj8kfj-8Vf.1 2024-09-14T11:53:57.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.304+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__shadow_mymultipart.2~KWmVnowZ9Jk096muzlxWNEj8kfj-8Vf.1_1 2024-09-14T11:53:57.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.304+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.2~KWmVnowZ9Jk096muzlxWNEj8kfj-8Vf.2 2024-09-14T11:53:57.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.304+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__shadow_mymultipart.2~KWmVnowZ9Jk096muzlxWNEj8kfj-8Vf.2_1 2024-09-14T11:53:57.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.304+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.SBGFJT3Q1RsJTzNzRLfzgNJPK61Hq00C.3 2024-09-14T11:53:57.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.304+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__shadow_mymultipart.SBGFJT3Q1RsJTzNzRLfzgNJPK61Hq00C.3_1 2024-09-14T11:53:57.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.304+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.2~KWmVnowZ9Jk096muzlxWNEj8kfj-8Vf.4 2024-09-14T11:53:57.302 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.304+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__shadow_mymultipart.2~KWmVnowZ9Jk096muzlxWNEj8kfj-8Vf.4_1 2024-09-14T11:53:57.303 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.304+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.2~KWmVnowZ9Jk096muzlxWNEj8kfj-8Vf.5 2024-09-14T11:53:57.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.308+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__shadow_mymultipart.2~KWmVnowZ9Jk096muzlxWNEj8kfj-8Vf.5_1 2024-09-14T11:53:57.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.312+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.2~KWmVnowZ9Jk096muzlxWNEj8kfj-8Vf.6 2024-09-14T11:53:57.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.312+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__shadow_mymultipart.2~KWmVnowZ9Jk096muzlxWNEj8kfj-8Vf.6_1 2024-09-14T11:53:57.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.312+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='2~JVS2m9TEI4IjzySP3qr8OB2ND93lf7R', time=2024-09-14T13:46:15.741122+0000, chain.objs.size()=10 2024-09-14T11:53:57.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.312+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.527__multipart_mymultipart.2~JVS2m9TEI4IjzySP3qr8OB2ND93lf7R.1 2024-09-14T11:53:57.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.312+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.527__multipart_mymultipart.2~JVS2m9TEI4IjzySP3qr8OB2ND93lf7R.2 2024-09-14T11:53:57.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.316+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.527__multipart_mymultipart.2~JVS2m9TEI4IjzySP3qr8OB2ND93lf7R.3 2024-09-14T11:53:57.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.316+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.527__multipart_mymultipart.2~JVS2m9TEI4IjzySP3qr8OB2ND93lf7R.4 2024-09-14T11:53:57.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.316+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.527__multipart_mymultipart.2~JVS2m9TEI4IjzySP3qr8OB2ND93lf7R.5 2024-09-14T11:53:57.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.316+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.527__multipart_mymultipart.2~JVS2m9TEI4IjzySP3qr8OB2ND93lf7R.6 2024-09-14T11:53:57.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.316+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.527__multipart_mymultipart.2~JVS2m9TEI4IjzySP3qr8OB2ND93lf7R.7 2024-09-14T11:53:57.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.316+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.527__multipart_mymultipart.2~JVS2m9TEI4IjzySP3qr8OB2ND93lf7R.8 2024-09-14T11:53:57.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.316+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.527__multipart_mymultipart.2~JVS2m9TEI4IjzySP3qr8OB2ND93lf7R.9 2024-09-14T11:53:57.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.316+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.527__multipart_mymultipart.2~JVS2m9TEI4IjzySP3qr8OB2ND93lf7R.10 2024-09-14T11:53:57.316 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.320+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:53:57.320 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.324+0000 7fd0826299c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:53:57.323 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.328+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:53:57.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.328+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:53:57.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.328+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:53:57.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.328+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='_KRhO04dow9mhV4unc9ldMza6pBb20Qh', time=2024-09-14T13:41:07.081645+0000, chain.objs.size()=1 2024-09-14T11:53:57.325 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.328+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.166__shadow_.ROB3Wr6PcLVPzIyjflkyIymx8uqP6Wr_0 2024-09-14T11:53:57.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.328+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.9870763695372254338', time=2024-09-14T13:46:15.020102+0000, chain.objs.size()=4 2024-09-14T11:53:57.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.328+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.526__multipart_mymultipart.2~bXzUWl2IkqA5b2s3FRX1UoyEvcngNqE.1 2024-09-14T11:53:57.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.328+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.526__shadow_mymultipart.2~bXzUWl2IkqA5b2s3FRX1UoyEvcngNqE.1_1 2024-09-14T11:53:57.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.328+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.526__multipart_mymultipart.2~bXzUWl2IkqA5b2s3FRX1UoyEvcngNqE.2 2024-09-14T11:53:57.326 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.328+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.526__shadow_mymultipart.2~bXzUWl2IkqA5b2s3FRX1UoyEvcngNqE.2_1 2024-09-14T11:53:57.331 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.336+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:53:57.335 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.340+0000 7fd0826299c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:53:57.338 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.340+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:53:57.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.344+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:53:57.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.344+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:53:57.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.344+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.11701934411156884696', time=2024-09-14T13:41:01.033942+0000, chain.objs.size()=5 2024-09-14T11:53:57.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.344+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.160__multipart_mymultipart-FROZEN.2~UQEh_Yp9cbVYsRi0z214OxOrgRYByy-.1 2024-09-14T11:53:57.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.344+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.160__shadow_mymultipart-FROZEN.2~UQEh_Yp9cbVYsRi0z214OxOrgRYByy-.1_1 2024-09-14T11:53:57.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.344+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.160__multipart_mymultipart-FROZEN.2~UQEh_Yp9cbVYsRi0z214OxOrgRYByy-.2 2024-09-14T11:53:57.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.344+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.160__shadow_mymultipart-FROZEN.2~UQEh_Yp9cbVYsRi0z214OxOrgRYByy-.2_1 2024-09-14T11:53:57.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.344+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.160__multipart_mymultipart-FROZEN.2~UQEh_Yp9cbVYsRi0z214OxOrgRYByy-.3 2024-09-14T11:53:57.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.344+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.9758838937453163083', time=2024-09-14T13:46:10.640896+0000, chain.objs.size()=2 2024-09-14T11:53:57.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.344+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.524__multipart_mymultipart.2~IRLzB5bbdPk6vQcW7Ix6gIsuBSfAqq5.1 2024-09-14T11:53:57.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.344+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.524__multipart_mymultipart.2~IRLzB5bbdPk6vQcW7Ix6gIsuBSfAqq5.2 2024-09-14T11:53:57.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.348+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:53:57.349 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.352+0000 7fd0826299c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:53:57.353 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.356+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:53:57.354 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.356+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:53:57.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.360+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:53:57.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.360+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.15524789374662719250', time=2024-09-14T13:41:01.886001+0000, chain.objs.size()=3 2024-09-14T11:53:57.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.360+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.161__shadow_.TwrzMlUKQVBT8DNA3aKxdt2bRwEQJsL_0 2024-09-14T11:53:57.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.360+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.161__shadow_.TwrzMlUKQVBT8DNA3aKxdt2bRwEQJsL_1 2024-09-14T11:53:57.355 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.360+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.161__shadow_.TwrzMlUKQVBT8DNA3aKxdt2bRwEQJsL_2 2024-09-14T11:53:57.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.360+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='_s52EYB6IllrxRjpL-ShmEpojJfcbuGs', time=2024-09-14T13:41:02.544636+0000, chain.objs.size()=3 2024-09-14T11:53:57.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.360+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.161__shadow_.YCtJocDIg8gYq1QuP2qchSIZDkVTEHv_0 2024-09-14T11:53:57.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.360+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.161__shadow_.YCtJocDIg8gYq1QuP2qchSIZDkVTEHv_1 2024-09-14T11:53:57.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.360+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.161__shadow_.YCtJocDIg8gYq1QuP2qchSIZDkVTEHv_2 2024-09-14T11:53:57.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.360+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.2134067163482059826', time=2024-09-14T13:46:09.107320+0000, chain.objs.size()=6 2024-09-14T11:53:57.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.360+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.2~Jg8-pFOXb7w_H3ql38SlwuS0JtXOLBO.1 2024-09-14T11:53:57.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.360+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.8k-mlG4SxfgJA_7PwckbUClLA7qkXH6C.2 2024-09-14T11:53:57.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.360+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.SR6b7uwwEIGgvghBAHQTXTobWtxxM2CO.3 2024-09-14T11:53:57.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.360+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.2~Jg8-pFOXb7w_H3ql38SlwuS0JtXOLBO.4 2024-09-14T11:53:57.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.360+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.2~Jg8-pFOXb7w_H3ql38SlwuS0JtXOLBO.5 2024-09-14T11:53:57.356 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.360+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.2~Jg8-pFOXb7w_H3ql38SlwuS0JtXOLBO.6 2024-09-14T11:53:57.360 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.364+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='2~86-T8mvSg8b9EaWEi5hQjeYsgnBMsx-', time=2024-09-14T13:46:22.502552+0000, chain.objs.size()=1 2024-09-14T11:53:57.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.364+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.536__multipart_mymultipart.2~86-T8mvSg8b9EaWEi5hQjeYsgnBMsx-.3 2024-09-14T11:53:57.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.364+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.5661775175195636716', time=2024-09-14T13:51:42.276397+0000, chain.objs.size()=1 2024-09-14T11:53:57.361 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.364+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.741__shadow_.78NBtF7c3fXOzhMfO7Y29otI3nOC2Xx_1 2024-09-14T11:53:57.364 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.368+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:53:57.370 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.372+0000 7fd0826299c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:53:57.374 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.376+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:53:57.376 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.380+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:53:57.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.380+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-14T11:53:57.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.380+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.5523766024215147856', time=2024-09-14T13:45:36.866087+0000, chain.objs.size()=3 2024-09-14T11:53:57.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.380+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.487__shadow_.ukoKTZzPdMRM85_bhUssb0nCBqts_OP_1 2024-09-14T11:53:57.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.380+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.487__shadow_.ukoKTZzPdMRM85_bhUssb0nCBqts_OP_2 2024-09-14T11:53:57.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.380+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.487__shadow_.ukoKTZzPdMRM85_bhUssb0nCBqts_OP_3 2024-09-14T11:53:57.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.380+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.17777993835250724503', time=2024-09-14T13:45:54.639324+0000, chain.objs.size()=1 2024-09-14T11:53:57.378 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.380+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.518__shadow_.C5JYWz2RZJWxHPoTXo3mEilgIZeQLa-_1 2024-09-14T11:53:57.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.380+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.16722688142181832241', time=2024-09-14T13:46:09.651402+0000, chain.objs.size()=6 2024-09-14T11:53:57.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.380+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.hTBv7xYauMNQ0mVkC7b31ZK9aqnyNHoS.1 2024-09-14T11:53:57.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.380+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart._nwySZFjWJiPnUMnDnkcYRAYRuJsO5lX.2 2024-09-14T11:53:57.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.380+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.DocX99-EijmdxTE9Olkgq6PEqxmaYp7H.3 2024-09-14T11:53:57.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.380+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.2LbL_OGTHxZbpr2c-KFxJR2-fbyx-_5P.4 2024-09-14T11:53:57.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.380+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.AAgfGdVPAT8vgIpUtxLPhDr0iOg_8XEb.5 2024-09-14T11:53:57.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.380+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.0qBJanIFjMfL8BQ4orA6qTZml1rLkuPe.6 2024-09-14T11:53:57.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.380+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.5748866499869778697', time=2024-09-14T13:46:11.049372+0000, chain.objs.size()=2 2024-09-14T11:53:57.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.380+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.524__multipart_mymultipart.2~tBxETat25BtSm-Xi5pySd8ivsxr9Rk6.1 2024-09-14T11:53:57.379 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.380+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.524__multipart_mymultipart.2~tBxETat25BtSm-Xi5pySd8ivsxr9Rk6.2 2024-09-14T11:53:57.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.384+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='2~PoVOl1ChcL6l_htIWfSlNHNkqxnUXuj', time=2024-09-14T13:46:18.484244+0000, chain.objs.size()=4 2024-09-14T11:53:57.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.384+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.530__multipart_mymultipart.2~PoVOl1ChcL6l_htIWfSlNHNkqxnUXuj.1 2024-09-14T11:53:57.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.384+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.530__shadow_mymultipart.2~PoVOl1ChcL6l_htIWfSlNHNkqxnUXuj.1_1 2024-09-14T11:53:57.382 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.384+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.530__multipart_mymultipart.2~PoVOl1ChcL6l_htIWfSlNHNkqxnUXuj.2 2024-09-14T11:53:57.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.384+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.530__shadow_mymultipart.2~PoVOl1ChcL6l_htIWfSlNHNkqxnUXuj.2_1 2024-09-14T11:53:57.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.384+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.3739128052629093489', time=2024-09-14T13:46:38.552492+0000, chain.objs.size()=1 2024-09-14T11:53:57.383 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.384+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.537__multipart_mymultipart.2~GjrCiqK0UZqjGCihgGLGjLM0ZoBhYIj.1 2024-09-14T11:53:57.388 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.392+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:53:57.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.396+0000 7fd0826299c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:53:57.395 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.400+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:53:57.396 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.400+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:53:57.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.400+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:53:57.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.400+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='_-n_izCWZw7tZ7rQxOr9yZlVImgt5gph', time=2024-09-14T13:41:05.262863+0000, chain.objs.size()=3 2024-09-14T11:53:57.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.400+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.162__shadow_.UHinitNmMFgHLPVOnEYkij14x90c17K_0 2024-09-14T11:53:57.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.400+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.162__shadow_.UHinitNmMFgHLPVOnEYkij14x90c17K_1 2024-09-14T11:53:57.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.400+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.162__shadow_.UHinitNmMFgHLPVOnEYkij14x90c17K_2 2024-09-14T11:53:57.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.400+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.10357631838223452198', time=2024-09-14T13:45:54.432575+0000, chain.objs.size()=1 2024-09-14T11:53:57.397 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.400+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.519__multipart_mymultipart.2~ENsOr_P9N4jz_nG4RDWO9IVZEoH4-S8.1 2024-09-14T11:53:57.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.400+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.4376704317657828060', time=2024-09-14T13:45:54.641252+0000, chain.objs.size()=1 2024-09-14T11:53:57.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.400+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.518__shadow_.FSW8EDaGQuRiy4Xou8Cpk8fUvp7MvWN_1 2024-09-14T11:53:57.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.400+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.3116671401980641934', time=2024-09-14T13:46:11.814684+0000, chain.objs.size()=3 2024-09-14T11:53:57.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.400+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.524__multipart_mymultipart.2~FH0TJcAG0u0gw3ACMwbVyJSol9NAX17.1 2024-09-14T11:53:57.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.400+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.524__multipart_mymultipart.2~FH0TJcAG0u0gw3ACMwbVyJSol9NAX17.2 2024-09-14T11:53:57.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.400+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.524__multipart_mymultipart.2~FH0TJcAG0u0gw3ACMwbVyJSol9NAX17.3 2024-09-14T11:53:57.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.400+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.5623269538580792744', time=2024-09-14T13:47:47.740673+0000, chain.objs.size()=4 2024-09-14T11:53:57.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.400+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.579__multipart_testobj.2~wK3Zy_8Po2l7azB2b8gNlXSrcAVr9GW.1 2024-09-14T11:53:57.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.400+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.579__multipart_testobj.2~wK3Zy_8Po2l7azB2b8gNlXSrcAVr9GW.2 2024-09-14T11:53:57.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.400+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.579__multipart_testobj.2~wK3Zy_8Po2l7azB2b8gNlXSrcAVr9GW.3 2024-09-14T11:53:57.399 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.400+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.579__multipart_testobj.2~wK3Zy_8Po2l7azB2b8gNlXSrcAVr9GW.4 2024-09-14T11:53:57.406 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.408+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:53:57.411 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.416+0000 7fd0826299c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:53:57.415 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.416+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:53:57.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.420+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:53:57.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.420+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:53:57.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.420+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='_qy42EqXzQSN-pNBOKfYruBbP25xZrSk', time=2024-09-14T13:41:06.082509+0000, chain.objs.size()=1 2024-09-14T11:53:57.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.420+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.164__shadow_.xo_2jJXe0pyxkLt2UmuaHYR4YIA6jQm_0 2024-09-14T11:53:57.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.420+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.10513973869857275104', time=2024-09-14T13:45:50.086975+0000, chain.objs.size()=1 2024-09-14T11:53:57.417 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.420+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.512__multipart_mymultipart.2~wukMPcVYRlbmNEEcpoh5yQUNGZ9nAbR.1 2024-09-14T11:53:57.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.420+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.9529220653425246884', time=2024-09-14T13:48:13.015633+0000, chain.objs.size()=12 2024-09-14T11:53:57.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.420+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.616__multipart_multipart_enc.2~VtKPlq-6VhA5dJfTR1iTk6lBL0d3yEg.1 2024-09-14T11:53:57.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.420+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.616__shadow_multipart_enc.2~VtKPlq-6VhA5dJfTR1iTk6lBL0d3yEg.1_1 2024-09-14T11:53:57.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.420+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.616__multipart_multipart_enc.2~VtKPlq-6VhA5dJfTR1iTk6lBL0d3yEg.2 2024-09-14T11:53:57.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.420+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.616__shadow_multipart_enc.2~VtKPlq-6VhA5dJfTR1iTk6lBL0d3yEg.2_1 2024-09-14T11:53:57.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.420+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.616__multipart_multipart_enc.2~VtKPlq-6VhA5dJfTR1iTk6lBL0d3yEg.3 2024-09-14T11:53:57.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.420+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.616__shadow_multipart_enc.2~VtKPlq-6VhA5dJfTR1iTk6lBL0d3yEg.3_1 2024-09-14T11:53:57.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.420+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.616__multipart_multipart_enc.2~VtKPlq-6VhA5dJfTR1iTk6lBL0d3yEg.4 2024-09-14T11:53:57.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.420+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.616__shadow_multipart_enc.2~VtKPlq-6VhA5dJfTR1iTk6lBL0d3yEg.4_1 2024-09-14T11:53:57.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.420+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.616__multipart_multipart_enc.2~VtKPlq-6VhA5dJfTR1iTk6lBL0d3yEg.5 2024-09-14T11:53:57.418 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.420+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.616__shadow_multipart_enc.2~VtKPlq-6VhA5dJfTR1iTk6lBL0d3yEg.5_1 2024-09-14T11:53:57.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.424+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.616__multipart_multipart_enc.2~VtKPlq-6VhA5dJfTR1iTk6lBL0d3yEg.6 2024-09-14T11:53:57.425 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.428+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.616__shadow_multipart_enc.2~VtKPlq-6VhA5dJfTR1iTk6lBL0d3yEg.6_1 2024-09-14T11:53:57.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.432+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:53:57.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.436+0000 7fd0826299c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:53:57.438 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.440+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:53:57.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.444+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:53:57.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.444+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:53:57.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.444+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='_PyHynWyg8exQJHPnnG7m35KpOGY_yLl', time=2024-09-14T13:41:02.558554+0000, chain.objs.size()=3 2024-09-14T11:53:57.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.444+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.161__shadow_.A6vXG3ZwTt4q6DCu0T4028zrf669g6V_0 2024-09-14T11:53:57.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.444+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.161__shadow_.A6vXG3ZwTt4q6DCu0T4028zrf669g6V_1 2024-09-14T11:53:57.440 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.444+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.161__shadow_.A6vXG3ZwTt4q6DCu0T4028zrf669g6V_2 2024-09-14T11:53:57.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.444+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='_6LQnNVg_Wfedj0p2bvsCt39k0KNIHjf', time=2024-09-14T13:41:04.238577+0000, chain.objs.size()=2 2024-09-14T11:53:57.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.444+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.162__shadow_.uMqiq33VIoJ4gFgnvjpbwEWXead7fHB_1 2024-09-14T11:53:57.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.444+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.162__shadow_.uMqiq33VIoJ4gFgnvjpbwEWXead7fHB_2 2024-09-14T11:53:57.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.444+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.4245676572537937435', time=2024-09-14T13:46:16.766075+0000, chain.objs.size()=4 2024-09-14T11:53:57.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.444+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.528__multipart_mymultipart.2~9R7hQlR5qk5YCfEDW-0Q741dkqQArng.1 2024-09-14T11:53:57.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.444+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.528__multipart_mymultipart.2~9R7hQlR5qk5YCfEDW-0Q741dkqQArng.2 2024-09-14T11:53:57.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.444+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.528__multipart_mymultipart.2~9R7hQlR5qk5YCfEDW-0Q741dkqQArng.3 2024-09-14T11:53:57.441 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.444+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.528__multipart_mymultipart.2~9R7hQlR5qk5YCfEDW-0Q741dkqQArng.4 2024-09-14T11:53:57.446 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.448+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:53:57.451 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.456+0000 7fd0826299c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:53:57.454 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.456+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:53:57.456 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.460+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:53:57.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.460+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-14T11:53:57.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.460+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='_RaBCeEPcH6C2xPIOulA3nC7FrsWGS4o', time=2024-09-14T13:41:03.436090+0000, chain.objs.size()=1 2024-09-14T11:53:57.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.460+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.162__shadow_.5Rn3GFtel3NLF1pdY2etHuXStN9093f_0 2024-09-14T11:53:57.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.460+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.6529889490106372798', time=2024-09-14T13:41:04.930027+0000, chain.objs.size()=5 2024-09-14T11:53:57.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.460+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.162__multipart_foo-FROZEN.2~Vy5m6ehr449FAJrlXPvnBka1_JuEL7w.1 2024-09-14T11:53:57.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.460+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.162__shadow_foo-FROZEN.2~Vy5m6ehr449FAJrlXPvnBka1_JuEL7w.1_1 2024-09-14T11:53:57.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.460+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.162__multipart_foo-FROZEN.2~Vy5m6ehr449FAJrlXPvnBka1_JuEL7w.2 2024-09-14T11:53:57.458 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.460+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.162__shadow_foo-FROZEN.2~Vy5m6ehr449FAJrlXPvnBka1_JuEL7w.2_1 2024-09-14T11:53:57.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.460+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.162__multipart_foo-FROZEN.2~Vy5m6ehr449FAJrlXPvnBka1_JuEL7w.3 2024-09-14T11:53:57.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.460+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.6391667734433519679', time=2024-09-14T13:45:36.870274+0000, chain.objs.size()=3 2024-09-14T11:53:57.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.460+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.487__shadow_.ukoKTZzPdMRM85_bhUssb0nCBqts_OP_1 2024-09-14T11:53:57.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.460+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.487__shadow_.ukoKTZzPdMRM85_bhUssb0nCBqts_OP_2 2024-09-14T11:53:57.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.460+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.487__shadow_.ukoKTZzPdMRM85_bhUssb0nCBqts_OP_3 2024-09-14T11:53:57.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.460+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.2497786461200852545', time=2024-09-14T13:45:59.435125+0000, chain.objs.size()=3 2024-09-14T11:53:57.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.460+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.522__multipart_mymultipart.2~cmwpVXSUG0qyQ48t4gyA3a66Q3mCTx6.1 2024-09-14T11:53:57.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.460+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.522__multipart_mymultipart.2~cmwpVXSUG0qyQ48t4gyA3a66Q3mCTx6.2 2024-09-14T11:53:57.459 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.460+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.522__multipart_mymultipart.2~cmwpVXSUG0qyQ48t4gyA3a66Q3mCTx6.3 2024-09-14T11:53:57.462 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.464+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.5401474585818640201', time=2024-09-14T13:50:36.242905+0000, chain.objs.size()=1 2024-09-14T11:53:57.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.464+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.651__shadow_.NtCnpx5I0SFX9NCuX3u8gXh9XjrEFVK_1 2024-09-14T11:53:57.463 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.468+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.6867039860679008463', time=2024-09-14T13:50:44.377793+0000, chain.objs.size()=6 2024-09-14T11:53:57.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.468+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.662__multipart_baz.2~gb6uA7YKVq8jRoHl2j9uMa8dd9MwJPF.1 2024-09-14T11:53:57.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.468+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.662__multipart_baz.2~gb6uA7YKVq8jRoHl2j9uMa8dd9MwJPF.2 2024-09-14T11:53:57.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.468+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.662__multipart_baz.2~gb6uA7YKVq8jRoHl2j9uMa8dd9MwJPF.3 2024-09-14T11:53:57.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.468+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.662__multipart_baz.2~gb6uA7YKVq8jRoHl2j9uMa8dd9MwJPF.4 2024-09-14T11:53:57.464 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.468+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.662__multipart_baz.2~gb6uA7YKVq8jRoHl2j9uMa8dd9MwJPF.5 2024-09-14T11:53:57.466 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.468+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.662__multipart_baz.2~gb6uA7YKVq8jRoHl2j9uMa8dd9MwJPF.6 2024-09-14T11:53:57.469 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.472+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:53:57.474 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.476+0000 7fd0826299c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:53:57.477 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.480+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:53:57.478 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.480+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:53:57.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.480+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:53:57.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.480+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.12720270926875139014', time=2024-09-14T13:45:48.847622+0000, chain.objs.size()=12 2024-09-14T11:53:57.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.480+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__multipart_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.1 2024-09-14T11:53:57.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.480+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__shadow_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.1_1 2024-09-14T11:53:57.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.480+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__multipart_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.2 2024-09-14T11:53:57.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.480+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__shadow_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.2_1 2024-09-14T11:53:57.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.480+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__multipart_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.3 2024-09-14T11:53:57.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.480+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__shadow_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.3_1 2024-09-14T11:53:57.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.480+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__multipart_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.4 2024-09-14T11:53:57.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.480+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__shadow_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.4_1 2024-09-14T11:53:57.479 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.480+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__multipart_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.5 2024-09-14T11:53:57.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.480+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__shadow_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.5_1 2024-09-14T11:53:57.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.480+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__multipart_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.6 2024-09-14T11:53:57.480 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.480+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__shadow_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.6_1 2024-09-14T11:53:57.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.488+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.13165255339736189569', time=2024-09-14T13:45:59.966183+0000, chain.objs.size()=3 2024-09-14T11:53:57.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.488+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.522__multipart_mymultipart.2~672wZpUg5G84mCjeQI6uUdBS85qxDMn.1 2024-09-14T11:53:57.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.488+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.522__multipart_mymultipart.2~672wZpUg5G84mCjeQI6uUdBS85qxDMn.2 2024-09-14T11:53:57.483 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.488+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.522__multipart_mymultipart.2~672wZpUg5G84mCjeQI6uUdBS85qxDMn.3 2024-09-14T11:53:57.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.488+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.17266252390808650618', time=2024-09-14T13:46:05.436206+0000, chain.objs.size()=6 2024-09-14T11:53:57.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.488+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.2~bKjA4TnX--ufUubeAR8W4GN1DnNtKZQ.1 2024-09-14T11:53:57.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.488+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.8ViKQvPlJAXNK8erHBMMsYu-INrSDRbf.2 2024-09-14T11:53:57.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.488+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.2~bKjA4TnX--ufUubeAR8W4GN1DnNtKZQ.3 2024-09-14T11:53:57.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.488+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.2~bKjA4TnX--ufUubeAR8W4GN1DnNtKZQ.4 2024-09-14T11:53:57.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.488+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.2~bKjA4TnX--ufUubeAR8W4GN1DnNtKZQ.5 2024-09-14T11:53:57.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.488+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.2~bKjA4TnX--ufUubeAR8W4GN1DnNtKZQ.6 2024-09-14T11:53:57.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.488+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='2~xK83aQ1gVH4DMXeW9Iqyrg8dSp-TyuT', time=2024-09-14T13:51:43.677590+0000, chain.objs.size()=1 2024-09-14T11:53:57.484 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.488+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.743__multipart_mymultipart.2~xK83aQ1gVH4DMXeW9Iqyrg8dSp-TyuT.1 2024-09-14T11:53:57.489 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.492+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:53:57.494 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.496+0000 7fd0826299c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:53:57.496 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.500+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:53:57.498 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.500+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:53:57.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.500+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-14T11:53:57.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.500+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.4080820509067618871', time=2024-09-14T13:40:59.375021+0000, chain.objs.size()=3 2024-09-14T11:53:57.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.500+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.159__shadow_.MwYNu3-IlHUdWrhI8IhZgm3erfn2GTk_0 2024-09-14T11:53:57.499 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.500+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.159__shadow_.MwYNu3-IlHUdWrhI8IhZgm3erfn2GTk_1 2024-09-14T11:53:57.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.500+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.159__shadow_.MwYNu3-IlHUdWrhI8IhZgm3erfn2GTk_2 2024-09-14T11:53:57.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.504+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='_e3S9lPmVYXMfo0WnzUgsOGNMpEMa-PJ', time=2024-09-14T13:41:06.069833+0000, chain.objs.size()=1 2024-09-14T11:53:57.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.504+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:4444f441-0c56-48df-a905-d49e7e44d629.4596.164__shadow_.pWj9V1rBEg5PMh3Zp5TBeiSNtfm0hEA_0 2024-09-14T11:53:57.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.504+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.10283994719853219979', time=2024-09-14T13:45:52.504957+0000, chain.objs.size()=1 2024-09-14T11:53:57.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.504+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.517__multipart_mymultipartcopy.2~Ofz036Zk3wKI2bBtFutvXyIwL6rDQYE.1 2024-09-14T11:53:57.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.504+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.5549436634741744162', time=2024-09-14T13:46:11.398293+0000, chain.objs.size()=5 2024-09-14T11:53:57.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.504+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.524__multipart_mymultipart.2~9lMJAxJd7mI4iEDXhscEL79ciWfVNUM.1 2024-09-14T11:53:57.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.504+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.524__shadow_mymultipart.2~9lMJAxJd7mI4iEDXhscEL79ciWfVNUM.1_1 2024-09-14T11:53:57.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.504+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.524__multipart_mymultipart.2~9lMJAxJd7mI4iEDXhscEL79ciWfVNUM.2 2024-09-14T11:53:57.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.504+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.524__shadow_mymultipart.2~9lMJAxJd7mI4iEDXhscEL79ciWfVNUM.2_1 2024-09-14T11:53:57.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.504+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.524__multipart_mymultipart.2~9lMJAxJd7mI4iEDXhscEL79ciWfVNUM.3 2024-09-14T11:53:57.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.504+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.14738845223927721907', time=2024-09-14T13:46:14.665466+0000, chain.objs.size()=3 2024-09-14T11:53:57.500 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.504+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.526__multipart_mymultipart.2~9oNZ_jG1DGUAwia2oDNx6JB3ofCDCtD.1 2024-09-14T11:53:57.501 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.504+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.526__multipart_mymultipart.2~9oNZ_jG1DGUAwia2oDNx6JB3ofCDCtD.2 2024-09-14T11:53:57.508 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.512+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.526__multipart_mymultipart.2~9oNZ_jG1DGUAwia2oDNx6JB3ofCDCtD.3 2024-09-14T11:53:57.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.512+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.8970461668704765485', time=2024-09-14T13:50:44.223783+0000, chain.objs.size()=6 2024-09-14T11:53:57.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.512+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.661__multipart_bar.2~ayBoVT6DcjI9a2ztKSv2DFP5eyRbn8O.1 2024-09-14T11:53:57.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.512+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.661__multipart_bar.2~ayBoVT6DcjI9a2ztKSv2DFP5eyRbn8O.2 2024-09-14T11:53:57.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.512+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.661__multipart_bar.2~ayBoVT6DcjI9a2ztKSv2DFP5eyRbn8O.3 2024-09-14T11:53:57.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.512+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.661__multipart_bar.2~ayBoVT6DcjI9a2ztKSv2DFP5eyRbn8O.4 2024-09-14T11:53:57.509 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.512+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.661__multipart_bar.2~ayBoVT6DcjI9a2ztKSv2DFP5eyRbn8O.5 2024-09-14T11:53:57.510 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.512+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.661__multipart_bar.2~ayBoVT6DcjI9a2ztKSv2DFP5eyRbn8O.6 2024-09-14T11:53:57.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.516+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:53:57.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.520+0000 7fd0826299c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:53:57.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.524+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:53:57.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.524+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:53:57.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.524+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:53:57.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.524+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.17578515309909925441', time=2024-09-14T13:41:01.047534+0000, chain.objs.size()=5 2024-09-14T11:53:57.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.524+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.160__multipart_mymultipart-LUKEWARM.2~QSBQP4N1R3wZjBFjURVMKXOQrQkLSQu.1 2024-09-14T11:53:57.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.524+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.160__shadow_mymultipart-LUKEWARM.2~QSBQP4N1R3wZjBFjURVMKXOQrQkLSQu.1_1 2024-09-14T11:53:57.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.524+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.160__multipart_mymultipart-LUKEWARM.2~QSBQP4N1R3wZjBFjURVMKXOQrQkLSQu.2 2024-09-14T11:53:57.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.524+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.160__shadow_mymultipart-LUKEWARM.2~QSBQP4N1R3wZjBFjURVMKXOQrQkLSQu.2_1 2024-09-14T11:53:57.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.524+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:4444f441-0c56-48df-a905-d49e7e44d629.4596.160__multipart_mymultipart-LUKEWARM.2~QSBQP4N1R3wZjBFjURVMKXOQrQkLSQu.3 2024-09-14T11:53:57.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.524+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FtASqKY1vz3xfapX-Fhjf6QZlAYK6l4', time=2024-09-14T13:46:19.969791+0000, chain.objs.size()=2 2024-09-14T11:53:57.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.524+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.532__multipart_mymultipart.2~FtASqKY1vz3xfapX-Fhjf6QZlAYK6l4.1 2024-09-14T11:53:57.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.524+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.532__multipart_mymultipart.2~FtASqKY1vz3xfapX-Fhjf6QZlAYK6l4.2 2024-09-14T11:53:57.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.524+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.16440352576792852425', time=2024-09-14T13:46:57.896543+0000, chain.objs.size()=1 2024-09-14T11:53:57.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.524+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.556__shadow_.yjxT5qnFeIq95afWMAyODAN66m_3MB__1 2024-09-14T11:53:57.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.524+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.11448448109155233956', time=2024-09-14T13:50:19.994832+0000, chain.objs.size()=12 2024-09-14T11:53:57.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.524+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.624__multipart_multipart_enc.2~wuRdLuidqbn_H5DRq2H9PfJxKx1Onsf.1 2024-09-14T11:53:57.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.524+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.624__shadow_multipart_enc.2~wuRdLuidqbn_H5DRq2H9PfJxKx1Onsf.1_1 2024-09-14T11:53:57.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.524+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.624__multipart_multipart_enc.2~wuRdLuidqbn_H5DRq2H9PfJxKx1Onsf.2 2024-09-14T11:53:57.523 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.524+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.624__shadow_multipart_enc.2~wuRdLuidqbn_H5DRq2H9PfJxKx1Onsf.2_1 2024-09-14T11:53:57.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.532+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.624__multipart_multipart_enc.2~wuRdLuidqbn_H5DRq2H9PfJxKx1Onsf.3 2024-09-14T11:53:57.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.532+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.624__shadow_multipart_enc.2~wuRdLuidqbn_H5DRq2H9PfJxKx1Onsf.3_1 2024-09-14T11:53:57.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.532+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.624__multipart_multipart_enc.2~wuRdLuidqbn_H5DRq2H9PfJxKx1Onsf.4 2024-09-14T11:53:57.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.532+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.624__shadow_multipart_enc.2~wuRdLuidqbn_H5DRq2H9PfJxKx1Onsf.4_1 2024-09-14T11:53:57.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.532+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.624__multipart_multipart_enc.2~wuRdLuidqbn_H5DRq2H9PfJxKx1Onsf.5 2024-09-14T11:53:57.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.532+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.624__shadow_multipart_enc.2~wuRdLuidqbn_H5DRq2H9PfJxKx1Onsf.5_1 2024-09-14T11:53:57.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.532+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.624__multipart_multipart_enc.2~wuRdLuidqbn_H5DRq2H9PfJxKx1Onsf.6 2024-09-14T11:53:57.529 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.532+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.624__shadow_multipart_enc.2~wuRdLuidqbn_H5DRq2H9PfJxKx1Onsf.6_1 2024-09-14T11:53:57.535 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.540+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:53:57.539 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.544+0000 7fd0826299c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:53:57.542 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.544+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:53:57.543 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.548+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:53:57.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.548+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:53:57.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.548+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.460532657594317330', time=2024-09-14T13:46:00.328576+0000, chain.objs.size()=3 2024-09-14T11:53:57.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.548+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.522__multipart_mymultipart.2~GsN_lxGZn7uzZAkXMoN0V0VKgAYfgHj.1 2024-09-14T11:53:57.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.548+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.522__multipart_mymultipart.2~GsN_lxGZn7uzZAkXMoN0V0VKgAYfgHj.2 2024-09-14T11:53:57.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.548+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.522__multipart_mymultipart.2~GsN_lxGZn7uzZAkXMoN0V0VKgAYfgHj.3 2024-09-14T11:53:57.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.548+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='2~3vwhMXs3tIqDxihvtUeHvDdxFt9XlYf', time=2024-09-14T13:46:01.783595+0000, chain.objs.size()=1 2024-09-14T11:53:57.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.548+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.523__multipart_mymultipart.2~3vwhMXs3tIqDxihvtUeHvDdxFt9XlYf.1 2024-09-14T11:53:57.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.548+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.2116966950236349069', time=2024-09-14T13:46:13.055456+0000, chain.objs.size()=1 2024-09-14T11:53:57.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.548+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.526__multipart_mymultipart.2~0BsUQTUDdGiCKelVq_o9Zv6P-eGMbA4.1 2024-09-14T11:53:57.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.552+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:53:57.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.556+0000 7fd0826299c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:53:57.556 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.560+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:53:57.557 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.560+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:53:57.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.560+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:53:57.558 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.560+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.7498428167577067392', time=2024-09-14T13:47:47.461015+0000, chain.objs.size()=4 2024-09-14T11:53:57.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.560+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.579__multipart_testobj.2~0DzW7LLIARt6HXi7XxKkh4L3mbHc62v.1 2024-09-14T11:53:57.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.560+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.579__multipart_testobj.2~0DzW7LLIARt6HXi7XxKkh4L3mbHc62v.2 2024-09-14T11:53:57.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.560+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.579__multipart_testobj.2~0DzW7LLIARt6HXi7XxKkh4L3mbHc62v.3 2024-09-14T11:53:57.559 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.560+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.579__multipart_testobj.2~0DzW7LLIARt6HXi7XxKkh4L3mbHc62v.4 2024-09-14T11:53:57.562 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.564+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:53:57.567 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.572+0000 7fd0826299c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:53:57.570 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.572+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:53:57.571 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.576+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:53:57.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.576+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:53:57.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.576+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='_4VFaXdM-10-_3exZA_qlcryeq_DjXXQ', time=2024-09-14T13:41:02.387442+0000, chain.objs.size()=2 2024-09-14T11:53:57.572 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.576+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.161__shadow_.QFrKvprj0Nyuj9EnAQse0I9uLm6aslR_1 2024-09-14T11:53:57.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.576+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.161__shadow_.QFrKvprj0Nyuj9EnAQse0I9uLm6aslR_2 2024-09-14T11:53:57.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.576+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.220994899320853328', time=2024-09-14T13:45:54.016378+0000, chain.objs.size()=1 2024-09-14T11:53:57.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.576+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.519__multipart_mymultipart.2~Jtu0honiDOQLN7Tf1yNcDemubDrmHhq.1 2024-09-14T11:53:57.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.576+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.16138773861143490029', time=2024-09-14T13:46:10.370213+0000, chain.objs.size()=2 2024-09-14T11:53:57.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.576+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.524__multipart_mymultipart.2~wOiXExlyFIX4VvKN9lmxEfoDhfVn-7N.1 2024-09-14T11:53:57.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.576+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.524__shadow_mymultipart.2~wOiXExlyFIX4VvKN9lmxEfoDhfVn-7N.1_1 2024-09-14T11:53:57.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.576+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.5163455623618139496', time=2024-09-14T13:46:57.769520+0000, chain.objs.size()=1 2024-09-14T11:53:57.573 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.576+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.556__shadow_.eclkUsN-J1Tqcl0bhgeaXhdRSk1wpEx_1 2024-09-14T11:53:57.578 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.580+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:53:57.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.588+0000 7fd0826299c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:53:57.586 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.588+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:53:57.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.592+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:53:57.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.592+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:53:57.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.592+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='_NPylAWTWhM0Ce2raBeIGLLsxfGQ_AM1', time=2024-09-14T13:41:05.067597+0000, chain.objs.size()=2 2024-09-14T11:53:57.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.592+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.162__shadow_.uym9eiRTNWLL8GPs3zTT4-v2EAKK9y5_1 2024-09-14T11:53:57.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.592+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.162__shadow_.uym9eiRTNWLL8GPs3zTT4-v2EAKK9y5_2 2024-09-14T11:53:57.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.592+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.17680078023805078323', time=2024-09-14T13:50:44.556040+0000, chain.objs.size()=6 2024-09-14T11:53:57.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.592+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.663__multipart_foo.2~FlZoWW5jsDnBL4A9ie7HRhadaXdcN2a.1 2024-09-14T11:53:57.588 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.592+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.663__multipart_foo.2~FlZoWW5jsDnBL4A9ie7HRhadaXdcN2a.2 2024-09-14T11:53:57.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.592+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.663__multipart_foo.2~FlZoWW5jsDnBL4A9ie7HRhadaXdcN2a.3 2024-09-14T11:53:57.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.592+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.663__multipart_foo.2~FlZoWW5jsDnBL4A9ie7HRhadaXdcN2a.4 2024-09-14T11:53:57.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.592+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.663__multipart_foo.2~FlZoWW5jsDnBL4A9ie7HRhadaXdcN2a.5 2024-09-14T11:53:57.589 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.592+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.663__multipart_foo.2~FlZoWW5jsDnBL4A9ie7HRhadaXdcN2a.6 2024-09-14T11:53:57.594 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.596+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:53:57.601 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.604+0000 7fd0826299c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:53:57.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.608+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:53:57.605 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.608+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:53:57.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.608+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:53:57.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.608+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.2304254452662281982', time=2024-09-14T13:46:13.822561+0000, chain.objs.size()=2 2024-09-14T11:53:57.606 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.608+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.526__multipart_mymultipart.2~g2SOe_acAAiF8xSA78tmwgHEBzPM7m-.1 2024-09-14T11:53:57.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.608+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.526__multipart_mymultipart.2~g2SOe_acAAiF8xSA78tmwgHEBzPM7m-.2 2024-09-14T11:53:57.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.608+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.8484964990510435598', time=2024-09-14T13:46:36.360113+0000, chain.objs.size()=4 2024-09-14T11:53:57.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.608+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.536__multipart_mymultipart.2~86-T8mvSg8b9EaWEi5hQjeYsgnBMsx-.1 2024-09-14T11:53:57.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.608+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.536__multipart_mymultipart.2~86-T8mvSg8b9EaWEi5hQjeYsgnBMsx-.2 2024-09-14T11:53:57.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.608+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.536__multipart_mymultipart.WibVRKfMT1K88O4AkcN0DSJTihN0-26c.3 2024-09-14T11:53:57.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.608+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.536__multipart_mymultipart.2~86-T8mvSg8b9EaWEi5hQjeYsgnBMsx-.4 2024-09-14T11:53:57.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.608+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='2~4mG6MSN-MKiP-esgIyx7FSCZFLZq-Kq', time=2024-09-14T13:51:43.690454+0000, chain.objs.size()=1 2024-09-14T11:53:57.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.608+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.743__multipart_mymultipart2.2~4mG6MSN-MKiP-esgIyx7FSCZFLZq-Kq.1 2024-09-14T11:53:57.610 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.612+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:53:57.616 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.620+0000 7fd0826299c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:53:57.618 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.620+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:53:57.620 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.624+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:53:57.621 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.624+0000 7fd0826299c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:53:57.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.624+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.18010278425776247220', time=2024-09-14T13:41:06.948560+0000, chain.objs.size()=2 2024-09-14T11:53:57.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.624+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.165__multipart_foo.2~S04aXI9PRt7kEi7P7af5JGADrlts2Z_.1 2024-09-14T11:53:57.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.624+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.165__multipart_foo.2~S04aXI9PRt7kEi7P7af5JGADrlts2Z_.2 2024-09-14T11:53:57.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.624+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.18314939500365996254', time=2024-09-14T13:45:49.190977+0000, chain.objs.size()=12 2024-09-14T11:53:57.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.624+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__multipart_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.1 2024-09-14T11:53:57.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.624+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__shadow_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.1_1 2024-09-14T11:53:57.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.624+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__multipart_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.2 2024-09-14T11:53:57.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.624+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__shadow_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.2_1 2024-09-14T11:53:57.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.624+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__multipart_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.3 2024-09-14T11:53:57.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.624+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__shadow_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.3_1 2024-09-14T11:53:57.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.624+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__multipart_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.4 2024-09-14T11:53:57.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.624+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__shadow_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.4_1 2024-09-14T11:53:57.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.624+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__multipart_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.5 2024-09-14T11:53:57.623 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.624+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__shadow_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.5_1 2024-09-14T11:53:57.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.632+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__multipart_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.6 2024-09-14T11:53:57.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.632+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.508__shadow_srcmultipart.2~afO91tmQoJ91GCS3NglNxXYHwhAnLkj.6_1 2024-09-14T11:53:57.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.632+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='2~1bnXP90hQJhezkASdgR8Lz5DLs2vEjW', time=2024-09-14T13:47:02.410377+0000, chain.objs.size()=1 2024-09-14T11:53:57.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.632+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.562__multipart_mymultipart.2~1bnXP90hQJhezkASdgR8Lz5DLs2vEjW.1 2024-09-14T11:53:57.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.632+0000 7fd0826299c0 20 garbage collection: RGWGC::process iterating over entry tag='4444f441-0c56-48df-a905-d49e7e44d629.4596.16364448166099216512', time=2024-09-14T13:51:44.551628+0000, chain.objs.size()=3 2024-09-14T11:53:57.628 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.632+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.744__multipart_mymultipart3.2~net8cVQujUMPH3pD2dAdsIHpvdo2-dE.1 2024-09-14T11:53:57.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.632+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.744__multipart_mymultipart3.2~net8cVQujUMPH3pD2dAdsIHpvdo2-dE.2 2024-09-14T11:53:57.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.632+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4444f441-0c56-48df-a905-d49e7e44d629.4596.744__multipart_mymultipart3.2~net8cVQujUMPH3pD2dAdsIHpvdo2-dE.3 2024-09-14T11:53:57.635 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.640+0000 7fd0826299c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:53:57.642 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.644+0000 7fcf36fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:53:57.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.652+0000 7fd0826299c0 20 remove_watcher() i=0 2024-09-14T11:53:57.647 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.652+0000 7fd0826299c0 2 removed watcher, disabling cache 2024-09-14T11:53:57.649 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.652+0000 7fd0826299c0 20 remove_watcher() i=1 2024-09-14T11:53:57.652 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.656+0000 7fd0826299c0 20 remove_watcher() i=2 2024-09-14T11:53:57.654 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.656+0000 7fd0826299c0 20 remove_watcher() i=3 2024-09-14T11:53:57.656 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.660+0000 7fd0826299c0 20 remove_watcher() i=4 2024-09-14T11:53:57.658 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.660+0000 7fd0826299c0 20 remove_watcher() i=5 2024-09-14T11:53:57.661 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.664+0000 7fd0826299c0 20 remove_watcher() i=6 2024-09-14T11:53:57.664 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-14T11:53:57.668+0000 7fd0826299c0 20 remove_watcher() i=7 2024-09-14T11:53:57.683 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-14T11:53:57.696 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-14T11:53:57.711 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T11:53:57.711 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:53:58.095 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:53:58.108 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-14T11:53:58.113 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":1591,"stamp":"2024-09-14T11:53:56.526025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":620056911,"num_objects":1004,"num_object_clones":0,"num_object_copies":2008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1004,"num_whiteouts":0,"num_read":295904,"num_read_kb":2619727,"num_write":146204,"num_write_kb":2444603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":200,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13750,"ondisk_log_size":13750,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2524384,"kb_used_data":1240800,"kb_used_omap":12,"kb_used_meta":1283443,"kb_avail":752450336,"statfs":{"total":773094113280,"available":770509144064,"internally_reserved":0,"allocated":1270579200,"data_stored":1256220526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1314246193},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-38,"num_objects":-2,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009372"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.294070+0000","last_change":"2024-09-14T11:38:50.585610+0000","last_active":"2024-09-14T11:51:23.294070+0000","last_peered":"2024-09-14T11:51:23.294070+0000","last_clean":"2024-09-14T11:51:23.294070+0000","last_became_active":"2024-09-14T11:38:50.585084+0000","last_became_peered":"2024-09-14T11:38:50.585084+0000","last_unstale":"2024-09-14T11:51:23.294070+0000","last_undegraded":"2024-09-14T11:51:23.294070+0000","last_fullsized":"2024-09-14T11:51:23.294070+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:50.511838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.261823+0000","last_change":"2024-09-14T11:27:41.641807+0000","last_active":"2024-09-14T11:50:13.261823+0000","last_peered":"2024-09-14T11:50:13.261823+0000","last_clean":"2024-09-14T11:50:13.261823+0000","last_became_active":"2024-09-14T11:27:41.641034+0000","last_became_peered":"2024-09-14T11:27:41.641034+0000","last_unstale":"2024-09-14T11:50:13.261823+0000","last_undegraded":"2024-09-14T11:50:13.261823+0000","last_fullsized":"2024-09-14T11:50:13.261823+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:01.125992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"261'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.288469+0000","last_change":"2024-09-14T11:27:38.617636+0000","last_active":"2024-09-14T11:50:08.288469+0000","last_peered":"2024-09-14T11:50:08.288469+0000","last_clean":"2024-09-14T11:50:08.288469+0000","last_became_active":"2024-09-14T11:27:38.617019+0000","last_became_peered":"2024-09-14T11:27:38.617019+0000","last_unstale":"2024-09-14T11:50:08.288469+0000","last_undegraded":"2024-09-14T11:50:08.288469+0000","last_fullsized":"2024-09-14T11:50:08.288469+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:02.190657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"264'17","reported_seq":90,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.122298+0000","last_change":"2024-09-14T11:26:04.263404+0000","last_active":"2024-09-14T11:51:08.122298+0000","last_peered":"2024-09-14T11:51:08.122298+0000","last_clean":"2024-09-14T11:51:08.122298+0000","last_became_active":"2024-09-14T11:26:04.262003+0000","last_became_peered":"2024-09-14T11:26:04.262003+0000","last_unstale":"2024-09-14T11:51:08.122298+0000","last_undegraded":"2024-09-14T11:51:08.122298+0000","last_fullsized":"2024-09-14T11:51:08.122298+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:19.974639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":88,"num_write":45,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.127863+0000","last_change":"2024-09-14T11:38:50.592796+0000","last_active":"2024-09-14T11:51:23.127863+0000","last_peered":"2024-09-14T11:51:23.127863+0000","last_clean":"2024-09-14T11:51:23.127863+0000","last_became_active":"2024-09-14T11:38:50.592015+0000","last_became_peered":"2024-09-14T11:38:50.592015+0000","last_unstale":"2024-09-14T11:51:23.127863+0000","last_undegraded":"2024-09-14T11:51:23.127863+0000","last_fullsized":"2024-09-14T11:51:23.127863+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:43.698723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"264'3","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.091293+0000","last_change":"2024-09-14T11:27:41.643113+0000","last_active":"2024-09-14T11:50:14.091293+0000","last_peered":"2024-09-14T11:50:14.091293+0000","last_clean":"2024-09-14T11:50:14.091293+0000","last_became_active":"2024-09-14T11:27:41.642359+0000","last_became_peered":"2024-09-14T11:27:41.642359+0000","last_unstale":"2024-09-14T11:50:14.091293+0000","last_undegraded":"2024-09-14T11:50:14.091293+0000","last_fullsized":"2024-09-14T11:50:14.091293+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:14.671551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3072,"num_write":3,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"264'4","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.113914+0000","last_change":"2024-09-14T11:27:38.602923+0000","last_active":"2024-09-14T11:50:08.113914+0000","last_peered":"2024-09-14T11:50:08.113914+0000","last_clean":"2024-09-14T11:50:08.113914+0000","last_became_active":"2024-09-14T11:27:38.597816+0000","last_became_peered":"2024-09-14T11:27:38.597816+0000","last_unstale":"2024-09-14T11:50:08.113914+0000","last_undegraded":"2024-09-14T11:50:08.113914+0000","last_fullsized":"2024-09-14T11:50:08.113914+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:36.668640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3216,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":1028,"num_write":9,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"264'31","reported_seq":127,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.109991+0000","last_change":"2024-09-14T11:26:04.283737+0000","last_active":"2024-09-14T11:50:13.109991+0000","last_peered":"2024-09-14T11:50:13.109991+0000","last_clean":"2024-09-14T11:50:13.109991+0000","last_became_active":"2024-09-14T11:26:04.280237+0000","last_became_peered":"2024-09-14T11:26:04.280237+0000","last_unstale":"2024-09-14T11:50:13.109991+0000","last_undegraded":"2024-09-14T11:50:13.109991+0000","last_fullsized":"2024-09-14T11:50:13.109991+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:15.981498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":150,"num_write":82,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.271146+0000","last_change":"2024-09-14T11:38:50.574799+0000","last_active":"2024-09-14T11:50:58.271146+0000","last_peered":"2024-09-14T11:50:58.271146+0000","last_clean":"2024-09-14T11:50:58.271146+0000","last_became_active":"2024-09-14T11:38:50.574020+0000","last_became_peered":"2024-09-14T11:38:50.574020+0000","last_unstale":"2024-09-14T11:50:58.271146+0000","last_undegraded":"2024-09-14T11:50:58.271146+0000","last_fullsized":"2024-09-14T11:50:58.271146+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:52.985985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.120898+0000","last_change":"2024-09-14T11:27:41.646451+0000","last_active":"2024-09-14T11:50:38.120898+0000","last_peered":"2024-09-14T11:50:38.120898+0000","last_clean":"2024-09-14T11:50:38.120898+0000","last_became_active":"2024-09-14T11:27:41.645143+0000","last_became_peered":"2024-09-14T11:27:41.645143+0000","last_unstale":"2024-09-14T11:50:38.120898+0000","last_undegraded":"2024-09-14T11:50:38.120898+0000","last_fullsized":"2024-09-14T11:50:38.120898+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:34.278570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:38.314219+0000","last_change":"2024-09-14T11:27:38.620069+0000","last_active":"2024-09-14T11:51:38.314219+0000","last_peered":"2024-09-14T11:51:38.314219+0000","last_clean":"2024-09-14T11:51:38.314219+0000","last_became_active":"2024-09-14T11:27:38.619537+0000","last_became_peered":"2024-09-14T11:27:38.619537+0000","last_unstale":"2024-09-14T11:51:38.314219+0000","last_undegraded":"2024-09-14T11:51:38.314219+0000","last_fullsized":"2024-09-14T11:51:38.314219+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:49.847960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"264'124","reported_seq":411,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.124673+0000","last_change":"2024-09-14T11:26:04.282980+0000","last_active":"2024-09-14T11:51:08.124673+0000","last_peered":"2024-09-14T11:51:08.124673+0000","last_clean":"2024-09-14T11:51:08.124673+0000","last_became_active":"2024-09-14T11:26:04.279472+0000","last_became_peered":"2024-09-14T11:26:04.279472+0000","last_unstale":"2024-09-14T11:51:08.124673+0000","last_undegraded":"2024-09-14T11:51:08.124673+0000","last_fullsized":"2024-09-14T11:51:08.124673+0000","mapping_epoch":253,"log_start":"261'100","ondisk_log_start":"261'100","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:01.809787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1140,"num_read_kb":1229,"num_write":251,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.126235+0000","last_change":"2024-09-14T11:38:50.588516+0000","last_active":"2024-09-14T11:51:03.126235+0000","last_peered":"2024-09-14T11:51:03.126235+0000","last_clean":"2024-09-14T11:51:03.126235+0000","last_became_active":"2024-09-14T11:38:50.587700+0000","last_became_peered":"2024-09-14T11:38:50.587700+0000","last_unstale":"2024-09-14T11:51:03.126235+0000","last_undegraded":"2024-09-14T11:51:03.126235+0000","last_fullsized":"2024-09-14T11:51:03.126235+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:40.939286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"264'6","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:48.136805+0000","last_change":"2024-09-14T11:27:41.645646+0000","last_active":"2024-09-14T11:51:48.136805+0000","last_peered":"2024-09-14T11:51:48.136805+0000","last_clean":"2024-09-14T11:51:48.136805+0000","last_became_active":"2024-09-14T11:27:41.644919+0000","last_became_peered":"2024-09-14T11:27:41.644919+0000","last_unstale":"2024-09-14T11:51:48.136805+0000","last_undegraded":"2024-09-14T11:51:48.136805+0000","last_fullsized":"2024-09-14T11:51:48.136805+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:48.076358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":8194,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"264'1","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:33.266087+0000","last_change":"2024-09-14T11:27:38.610209+0000","last_active":"2024-09-14T11:50:33.266087+0000","last_peered":"2024-09-14T11:50:33.266087+0000","last_clean":"2024-09-14T11:50:33.266087+0000","last_became_active":"2024-09-14T11:27:38.609445+0000","last_became_peered":"2024-09-14T11:27:38.609445+0000","last_unstale":"2024-09-14T11:50:33.266087+0000","last_undegraded":"2024-09-14T11:50:33.266087+0000","last_fullsized":"2024-09-14T11:50:33.266087+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:01.517926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"264'61","reported_seq":213,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.124618+0000","last_change":"2024-09-14T11:26:04.283422+0000","last_active":"2024-09-14T11:51:08.124618+0000","last_peered":"2024-09-14T11:51:08.124618+0000","last_clean":"2024-09-14T11:51:08.124618+0000","last_became_active":"2024-09-14T11:26:04.282662+0000","last_became_peered":"2024-09-14T11:26:04.282662+0000","last_unstale":"2024-09-14T11:51:08.124618+0000","last_undegraded":"2024-09-14T11:51:08.124618+0000","last_fullsized":"2024-09-14T11:51:08.124618+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:05.753210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":527,"num_read_kb":359,"num_write":147,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.298593+0000","last_change":"2024-09-14T11:38:50.586486+0000","last_active":"2024-09-14T11:50:53.298593+0000","last_peered":"2024-09-14T11:50:53.298593+0000","last_clean":"2024-09-14T11:50:53.298593+0000","last_became_active":"2024-09-14T11:38:50.582489+0000","last_became_peered":"2024-09-14T11:38:50.582489+0000","last_unstale":"2024-09-14T11:50:53.298593+0000","last_undegraded":"2024-09-14T11:50:53.298593+0000","last_fullsized":"2024-09-14T11:50:53.298593+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:07.012027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.269333+0000","last_change":"2024-09-14T11:27:41.647192+0000","last_active":"2024-09-14T11:49:28.269333+0000","last_peered":"2024-09-14T11:49:28.269333+0000","last_clean":"2024-09-14T11:49:28.269333+0000","last_became_active":"2024-09-14T11:27:41.645724+0000","last_became_peered":"2024-09-14T11:27:41.645724+0000","last_unstale":"2024-09-14T11:49:28.269333+0000","last_undegraded":"2024-09-14T11:49:28.269333+0000","last_fullsized":"2024-09-14T11:49:28.269333+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:16.835815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.103071+0000","last_change":"2024-09-14T11:27:38.606708+0000","last_active":"2024-09-14T11:49:23.103071+0000","last_peered":"2024-09-14T11:49:23.103071+0000","last_clean":"2024-09-14T11:49:23.103071+0000","last_became_active":"2024-09-14T11:27:38.605937+0000","last_became_peered":"2024-09-14T11:27:38.605937+0000","last_unstale":"2024-09-14T11:49:23.103071+0000","last_undegraded":"2024-09-14T11:49:23.103071+0000","last_fullsized":"2024-09-14T11:49:23.103071+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:01.152788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"264'12","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.124495+0000","last_change":"2024-09-14T11:26:04.279565+0000","last_active":"2024-09-14T11:51:08.124495+0000","last_peered":"2024-09-14T11:51:08.124495+0000","last_clean":"2024-09-14T11:51:08.124495+0000","last_became_active":"2024-09-14T11:26:04.278457+0000","last_became_peered":"2024-09-14T11:26:04.278457+0000","last_unstale":"2024-09-14T11:51:08.124495+0000","last_undegraded":"2024-09-14T11:51:08.124495+0000","last_fullsized":"2024-09-14T11:51:08.124495+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:36.957690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":56,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.125380+0000","last_change":"2024-09-14T11:38:50.576845+0000","last_active":"2024-09-14T11:51:23.125380+0000","last_peered":"2024-09-14T11:51:23.125380+0000","last_clean":"2024-09-14T11:51:23.125380+0000","last_became_active":"2024-09-14T11:38:50.576125+0000","last_became_peered":"2024-09-14T11:38:50.576125+0000","last_unstale":"2024-09-14T11:51:23.125380+0000","last_undegraded":"2024-09-14T11:51:23.125380+0000","last_fullsized":"2024-09-14T11:51:23.125380+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:08.428909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"264'3","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:29.295860+0000","last_change":"2024-09-14T11:27:41.661526+0000","last_active":"2024-09-14T11:49:29.295860+0000","last_peered":"2024-09-14T11:49:29.295860+0000","last_clean":"2024-09-14T11:49:29.295860+0000","last_became_active":"2024-09-14T11:27:41.660702+0000","last_became_peered":"2024-09-14T11:27:41.660702+0000","last_unstale":"2024-09-14T11:49:29.295860+0000","last_undegraded":"2024-09-14T11:49:29.295860+0000","last_fullsized":"2024-09-14T11:49:29.295860+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:11.563164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"264'8","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:29.296048+0000","last_change":"2024-09-14T11:27:38.603652+0000","last_active":"2024-09-14T11:49:29.296048+0000","last_peered":"2024-09-14T11:49:29.296048+0000","last_clean":"2024-09-14T11:49:29.296048+0000","last_became_active":"2024-09-14T11:27:38.602908+0000","last_became_peered":"2024-09-14T11:27:38.602908+0000","last_unstale":"2024-09-14T11:49:29.296048+0000","last_undegraded":"2024-09-14T11:49:29.296048+0000","last_fullsized":"2024-09-14T11:49:29.296048+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:54.757602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":13,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"264'30","reported_seq":126,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:04.102933+0000","last_change":"2024-09-14T11:26:04.259271+0000","last_active":"2024-09-14T11:51:04.102933+0000","last_peered":"2024-09-14T11:51:04.102933+0000","last_clean":"2024-09-14T11:51:04.102933+0000","last_became_active":"2024-09-14T11:26:04.258048+0000","last_became_peered":"2024-09-14T11:26:04.258048+0000","last_unstale":"2024-09-14T11:51:04.102933+0000","last_undegraded":"2024-09-14T11:51:04.102933+0000","last_fullsized":"2024-09-14T11:51:04.102933+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:36.508914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":248,"num_read_kb":161,"num_write":75,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:24.107804+0000","last_change":"2024-09-14T11:38:50.591472+0000","last_active":"2024-09-14T11:51:24.107804+0000","last_peered":"2024-09-14T11:51:24.107804+0000","last_clean":"2024-09-14T11:51:24.107804+0000","last_became_active":"2024-09-14T11:38:50.590496+0000","last_became_peered":"2024-09-14T11:38:50.590496+0000","last_unstale":"2024-09-14T11:51:24.107804+0000","last_undegraded":"2024-09-14T11:51:24.107804+0000","last_fullsized":"2024-09-14T11:51:24.107804+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:59.200308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"264'9","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.091257+0000","last_change":"2024-09-14T11:27:41.637007+0000","last_active":"2024-09-14T11:50:14.091257+0000","last_peered":"2024-09-14T11:50:14.091257+0000","last_clean":"2024-09-14T11:50:14.091257+0000","last_became_active":"2024-09-14T11:27:41.635495+0000","last_became_peered":"2024-09-14T11:27:41.635495+0000","last_unstale":"2024-09-14T11:50:14.091257+0000","last_undegraded":"2024-09-14T11:50:14.091257+0000","last_fullsized":"2024-09-14T11:50:14.091257+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:07.509871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":12817,"num_write":24,"num_write_kb":12817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"264'1","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.277793+0000","last_change":"2024-09-14T11:27:38.594325+0000","last_active":"2024-09-14T11:50:08.277793+0000","last_peered":"2024-09-14T11:50:08.277793+0000","last_clean":"2024-09-14T11:50:08.277793+0000","last_became_active":"2024-09-14T11:27:38.593507+0000","last_became_peered":"2024-09-14T11:27:38.593507+0000","last_unstale":"2024-09-14T11:50:08.277793+0000","last_undegraded":"2024-09-14T11:50:08.277793+0000","last_fullsized":"2024-09-14T11:50:08.277793+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:04.519402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"264'31","reported_seq":121,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.290822+0000","last_change":"2024-09-14T11:26:04.281451+0000","last_active":"2024-09-14T11:50:18.290822+0000","last_peered":"2024-09-14T11:50:18.290822+0000","last_clean":"2024-09-14T11:50:18.290822+0000","last_became_active":"2024-09-14T11:26:04.280799+0000","last_became_peered":"2024-09-14T11:26:04.280799+0000","last_unstale":"2024-09-14T11:50:18.290822+0000","last_undegraded":"2024-09-14T11:50:18.290822+0000","last_fullsized":"2024-09-14T11:50:18.290822+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:13.145315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":229,"num_read_kb":151,"num_write":83,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.294155+0000","last_change":"2024-09-14T11:38:50.588826+0000","last_active":"2024-09-14T11:51:23.294155+0000","last_peered":"2024-09-14T11:51:23.294155+0000","last_clean":"2024-09-14T11:51:23.294155+0000","last_became_active":"2024-09-14T11:38:50.588260+0000","last_became_peered":"2024-09-14T11:38:50.588260+0000","last_unstale":"2024-09-14T11:51:23.294155+0000","last_undegraded":"2024-09-14T11:51:23.294155+0000","last_fullsized":"2024-09-14T11:51:23.294155+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:00.597152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"261'2","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.289709+0000","last_change":"2024-09-14T11:27:41.650374+0000","last_active":"2024-09-14T11:50:13.289709+0000","last_peered":"2024-09-14T11:50:13.289709+0000","last_clean":"2024-09-14T11:50:13.289709+0000","last_became_active":"2024-09-14T11:27:41.649448+0000","last_became_peered":"2024-09-14T11:27:41.649448+0000","last_unstale":"2024-09-14T11:50:13.289709+0000","last_undegraded":"2024-09-14T11:50:13.289709+0000","last_fullsized":"2024-09-14T11:50:13.289709+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:46.465272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"264'2","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.110832+0000","last_change":"2024-09-14T11:27:38.599731+0000","last_active":"2024-09-14T11:50:08.110832+0000","last_peered":"2024-09-14T11:50:08.110832+0000","last_clean":"2024-09-14T11:50:08.110832+0000","last_became_active":"2024-09-14T11:27:38.598992+0000","last_became_peered":"2024-09-14T11:27:38.598992+0000","last_unstale":"2024-09-14T11:50:08.110832+0000","last_undegraded":"2024-09-14T11:50:08.110832+0000","last_fullsized":"2024-09-14T11:50:08.110832+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:16.033655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"264'245","reported_seq":783,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:44.404892+0000","last_change":"2024-09-14T11:26:04.283762+0000","last_active":"2024-09-14T11:51:44.404892+0000","last_peered":"2024-09-14T11:51:44.404892+0000","last_clean":"2024-09-14T11:51:44.404892+0000","last_became_active":"2024-09-14T11:26:04.283058+0000","last_became_peered":"2024-09-14T11:26:04.283058+0000","last_unstale":"2024-09-14T11:51:44.404892+0000","last_undegraded":"2024-09-14T11:51:44.404892+0000","last_fullsized":"2024-09-14T11:51:44.404892+0000","mapping_epoch":253,"log_start":"261'200","ondisk_log_start":"261'200","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:43.404343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2337,"num_read_kb":3061,"num_write":470,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:33.119635+0000","last_change":"2024-09-14T11:38:50.588284+0000","last_active":"2024-09-14T11:50:33.119635+0000","last_peered":"2024-09-14T11:50:33.119635+0000","last_clean":"2024-09-14T11:50:33.119635+0000","last_became_active":"2024-09-14T11:38:50.587593+0000","last_became_peered":"2024-09-14T11:38:50.587593+0000","last_unstale":"2024-09-14T11:50:33.119635+0000","last_undegraded":"2024-09-14T11:50:33.119635+0000","last_fullsized":"2024-09-14T11:50:33.119635+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:30.104550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"261'2","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.279905+0000","last_change":"2024-09-14T11:27:41.650094+0000","last_active":"2024-09-14T11:49:28.279905+0000","last_peered":"2024-09-14T11:49:28.279905+0000","last_clean":"2024-09-14T11:49:28.279905+0000","last_became_active":"2024-09-14T11:27:41.649297+0000","last_became_peered":"2024-09-14T11:27:41.649297+0000","last_unstale":"2024-09-14T11:49:28.279905+0000","last_undegraded":"2024-09-14T11:49:28.279905+0000","last_fullsized":"2024-09-14T11:49:28.279905+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:37.683430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"261'3","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:04.321677+0000","last_change":"2024-09-14T11:27:38.608702+0000","last_active":"2024-09-14T11:51:04.321677+0000","last_peered":"2024-09-14T11:51:04.321677+0000","last_clean":"2024-09-14T11:51:04.321677+0000","last_became_active":"2024-09-14T11:27:38.607929+0000","last_became_peered":"2024-09-14T11:27:38.607929+0000","last_unstale":"2024-09-14T11:51:04.321677+0000","last_undegraded":"2024-09-14T11:51:04.321677+0000","last_fullsized":"2024-09-14T11:51:04.321677+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:02.938378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"264'16","reported_seq":85,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.111235+0000","last_change":"2024-09-14T11:26:04.262715+0000","last_active":"2024-09-14T11:50:18.111235+0000","last_peered":"2024-09-14T11:50:18.111235+0000","last_clean":"2024-09-14T11:50:18.111235+0000","last_became_active":"2024-09-14T11:26:04.261101+0000","last_became_peered":"2024-09-14T11:26:04.261101+0000","last_unstale":"2024-09-14T11:50:18.111235+0000","last_undegraded":"2024-09-14T11:50:18.111235+0000","last_fullsized":"2024-09-14T11:50:18.111235+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:32.177932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":70,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:33.116264+0000","last_change":"2024-09-14T11:38:50.566716+0000","last_active":"2024-09-14T11:50:33.116264+0000","last_peered":"2024-09-14T11:50:33.116264+0000","last_clean":"2024-09-14T11:50:33.116264+0000","last_became_active":"2024-09-14T11:38:50.565980+0000","last_became_peered":"2024-09-14T11:38:50.565980+0000","last_unstale":"2024-09-14T11:50:33.116264+0000","last_undegraded":"2024-09-14T11:50:33.116264+0000","last_fullsized":"2024-09-14T11:50:33.116264+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:42.634974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"264'4","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.127479+0000","last_change":"2024-09-14T11:27:41.660949+0000","last_active":"2024-09-14T11:51:08.127479+0000","last_peered":"2024-09-14T11:51:08.127479+0000","last_clean":"2024-09-14T11:51:08.127479+0000","last_became_active":"2024-09-14T11:27:41.660264+0000","last_became_peered":"2024-09-14T11:27:41.660264+0000","last_unstale":"2024-09-14T11:51:08.127479+0000","last_undegraded":"2024-09-14T11:51:08.127479+0000","last_fullsized":"2024-09-14T11:51:08.127479+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:36.720927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":9,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"261'4","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.268176+0000","last_change":"2024-09-14T11:27:38.596650+0000","last_active":"2024-09-14T11:49:23.268176+0000","last_peered":"2024-09-14T11:49:23.268176+0000","last_clean":"2024-09-14T11:49:23.268176+0000","last_became_active":"2024-09-14T11:27:38.595788+0000","last_became_peered":"2024-09-14T11:27:38.595788+0000","last_unstale":"2024-09-14T11:49:23.268176+0000","last_undegraded":"2024-09-14T11:49:23.268176+0000","last_fullsized":"2024-09-14T11:49:23.268176+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:09.671865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"264'35","reported_seq":135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.111154+0000","last_change":"2024-09-14T11:26:04.283254+0000","last_active":"2024-09-14T11:50:18.111154+0000","last_peered":"2024-09-14T11:50:18.111154+0000","last_clean":"2024-09-14T11:50:18.111154+0000","last_became_active":"2024-09-14T11:26:04.279281+0000","last_became_peered":"2024-09-14T11:26:04.279281+0000","last_unstale":"2024-09-14T11:50:18.111154+0000","last_undegraded":"2024-09-14T11:50:18.111154+0000","last_fullsized":"2024-09-14T11:50:18.111154+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:14.087866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":194,"num_write":86,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:34.095673+0000","last_change":"2024-09-14T11:38:50.574673+0000","last_active":"2024-09-14T11:50:34.095673+0000","last_peered":"2024-09-14T11:50:34.095673+0000","last_clean":"2024-09-14T11:50:34.095673+0000","last_became_active":"2024-09-14T11:38:50.573912+0000","last_became_peered":"2024-09-14T11:38:50.573912+0000","last_unstale":"2024-09-14T11:50:34.095673+0000","last_undegraded":"2024-09-14T11:50:34.095673+0000","last_fullsized":"2024-09-14T11:50:34.095673+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:20.437626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"264'8","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.280015+0000","last_change":"2024-09-14T11:27:41.633217+0000","last_active":"2024-09-14T11:49:28.280015+0000","last_peered":"2024-09-14T11:49:28.280015+0000","last_clean":"2024-09-14T11:49:28.280015+0000","last_became_active":"2024-09-14T11:27:41.632456+0000","last_became_peered":"2024-09-14T11:27:41.632456+0000","last_unstale":"2024-09-14T11:49:28.280015+0000","last_undegraded":"2024-09-14T11:49:28.280015+0000","last_fullsized":"2024-09-14T11:49:28.280015+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:59.393656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":15362,"num_write":8,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"261'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.278697+0000","last_change":"2024-09-14T11:27:38.617576+0000","last_active":"2024-09-14T11:49:23.278697+0000","last_peered":"2024-09-14T11:49:23.278697+0000","last_clean":"2024-09-14T11:49:23.278697+0000","last_became_active":"2024-09-14T11:27:38.616935+0000","last_became_peered":"2024-09-14T11:27:38.616935+0000","last_unstale":"2024-09-14T11:49:23.278697+0000","last_undegraded":"2024-09-14T11:49:23.278697+0000","last_fullsized":"2024-09-14T11:49:23.278697+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:02.566121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"264'38","reported_seq":144,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.290967+0000","last_change":"2024-09-14T11:26:04.268951+0000","last_active":"2024-09-14T11:50:18.290967+0000","last_peered":"2024-09-14T11:50:18.290967+0000","last_clean":"2024-09-14T11:50:18.290967+0000","last_became_active":"2024-09-14T11:26:04.268202+0000","last_became_peered":"2024-09-14T11:26:04.268202+0000","last_unstale":"2024-09-14T11:50:18.290967+0000","last_undegraded":"2024-09-14T11:50:18.290967+0000","last_fullsized":"2024-09-14T11:50:18.290967+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:01.258492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":294,"num_read_kb":198,"num_write":96,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:33.283228+0000","last_change":"2024-09-14T11:38:50.586123+0000","last_active":"2024-09-14T11:50:33.283228+0000","last_peered":"2024-09-14T11:50:33.283228+0000","last_clean":"2024-09-14T11:50:33.283228+0000","last_became_active":"2024-09-14T11:38:50.585324+0000","last_became_peered":"2024-09-14T11:38:50.585324+0000","last_unstale":"2024-09-14T11:50:33.283228+0000","last_undegraded":"2024-09-14T11:50:33.283228+0000","last_fullsized":"2024-09-14T11:50:33.283228+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:21.296327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"264'3","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.269472+0000","last_change":"2024-09-14T11:27:41.653603+0000","last_active":"2024-09-14T11:49:28.269472+0000","last_peered":"2024-09-14T11:49:28.269472+0000","last_clean":"2024-09-14T11:49:28.269472+0000","last_became_active":"2024-09-14T11:27:41.652940+0000","last_became_peered":"2024-09-14T11:27:41.652940+0000","last_unstale":"2024-09-14T11:49:28.269472+0000","last_undegraded":"2024-09-14T11:49:28.269472+0000","last_fullsized":"2024-09-14T11:49:28.269472+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:52.835060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5246096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":10244,"num_write":3,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"261'5","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.103799+0000","last_change":"2024-09-14T11:27:38.603632+0000","last_active":"2024-09-14T11:49:23.103799+0000","last_peered":"2024-09-14T11:49:23.103799+0000","last_clean":"2024-09-14T11:49:23.103799+0000","last_became_active":"2024-09-14T11:27:38.603013+0000","last_became_peered":"2024-09-14T11:27:38.603013+0000","last_unstale":"2024-09-14T11:49:23.103799+0000","last_undegraded":"2024-09-14T11:49:23.103799+0000","last_fullsized":"2024-09-14T11:49:23.103799+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:31.898272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:29.296282+0000","last_change":"2024-09-14T11:26:04.263990+0000","last_active":"2024-09-14T11:49:29.296282+0000","last_peered":"2024-09-14T11:49:29.296282+0000","last_clean":"2024-09-14T11:49:29.296282+0000","last_became_active":"2024-09-14T11:26:04.263245+0000","last_became_peered":"2024-09-14T11:26:04.263245+0000","last_unstale":"2024-09-14T11:49:29.296282+0000","last_undegraded":"2024-09-14T11:49:29.296282+0000","last_fullsized":"2024-09-14T11:49:29.296282+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:32.096751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.125221+0000","last_change":"2024-09-14T11:38:50.591827+0000","last_active":"2024-09-14T11:50:58.125221+0000","last_peered":"2024-09-14T11:50:58.125221+0000","last_clean":"2024-09-14T11:50:58.125221+0000","last_became_active":"2024-09-14T11:38:50.591033+0000","last_became_peered":"2024-09-14T11:38:50.591033+0000","last_unstale":"2024-09-14T11:50:58.125221+0000","last_undegraded":"2024-09-14T11:50:58.125221+0000","last_fullsized":"2024-09-14T11:50:58.125221+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:09.654882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"264'1","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.126264+0000","last_change":"2024-09-14T11:27:41.645102+0000","last_active":"2024-09-14T11:51:03.126264+0000","last_peered":"2024-09-14T11:51:03.126264+0000","last_clean":"2024-09-14T11:51:03.126264+0000","last_became_active":"2024-09-14T11:27:41.634584+0000","last_became_peered":"2024-09-14T11:27:41.634584+0000","last_unstale":"2024-09-14T11:51:03.126264+0000","last_undegraded":"2024-09-14T11:51:03.126264+0000","last_fullsized":"2024-09-14T11:51:03.126264+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:33.590598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.271195+0000","last_change":"2024-09-14T11:27:38.612360+0000","last_active":"2024-09-14T11:50:58.271195+0000","last_peered":"2024-09-14T11:50:58.271195+0000","last_clean":"2024-09-14T11:50:58.271195+0000","last_became_active":"2024-09-14T11:27:38.611912+0000","last_became_peered":"2024-09-14T11:27:38.611912+0000","last_unstale":"2024-09-14T11:50:58.271195+0000","last_undegraded":"2024-09-14T11:50:58.271195+0000","last_fullsized":"2024-09-14T11:50:58.271195+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:31.632951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"264'32","reported_seq":134,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.294532+0000","last_change":"2024-09-14T11:26:04.264797+0000","last_active":"2024-09-14T11:49:24.294532+0000","last_peered":"2024-09-14T11:49:24.294532+0000","last_clean":"2024-09-14T11:49:24.294532+0000","last_became_active":"2024-09-14T11:26:04.264179+0000","last_became_peered":"2024-09-14T11:26:04.264179+0000","last_unstale":"2024-09-14T11:49:24.294532+0000","last_undegraded":"2024-09-14T11:49:24.294532+0000","last_fullsized":"2024-09-14T11:49:24.294532+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:19.434829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":260,"num_read_kb":165,"num_write":79,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.122121+0000","last_change":"2024-09-14T11:38:50.553543+0000","last_active":"2024-09-14T11:50:58.122121+0000","last_peered":"2024-09-14T11:50:58.122121+0000","last_clean":"2024-09-14T11:50:58.122121+0000","last_became_active":"2024-09-14T11:38:50.552891+0000","last_became_peered":"2024-09-14T11:38:50.552891+0000","last_unstale":"2024-09-14T11:50:58.122121+0000","last_undegraded":"2024-09-14T11:50:58.122121+0000","last_fullsized":"2024-09-14T11:50:58.122121+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:10.586101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"261'4","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.126156+0000","last_change":"2024-09-14T11:27:41.643791+0000","last_active":"2024-09-14T11:51:03.126156+0000","last_peered":"2024-09-14T11:51:03.126156+0000","last_clean":"2024-09-14T11:51:03.126156+0000","last_became_active":"2024-09-14T11:27:41.634824+0000","last_became_peered":"2024-09-14T11:27:41.634824+0000","last_unstale":"2024-09-14T11:51:03.126156+0000","last_undegraded":"2024-09-14T11:51:03.126156+0000","last_fullsized":"2024-09-14T11:51:03.126156+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:45.655086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"264'1","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.125060+0000","last_change":"2024-09-14T11:27:38.609347+0000","last_active":"2024-09-14T11:50:58.125060+0000","last_peered":"2024-09-14T11:50:58.125060+0000","last_clean":"2024-09-14T11:50:58.125060+0000","last_became_active":"2024-09-14T11:27:38.608412+0000","last_became_peered":"2024-09-14T11:27:38.608412+0000","last_unstale":"2024-09-14T11:50:58.125060+0000","last_undegraded":"2024-09-14T11:50:58.125060+0000","last_fullsized":"2024-09-14T11:50:58.125060+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:24.685660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"264'44","reported_seq":157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:39.785907+0000","last_change":"2024-09-14T11:26:04.272788+0000","last_active":"2024-09-14T11:51:39.785907+0000","last_peered":"2024-09-14T11:51:39.785907+0000","last_clean":"2024-09-14T11:51:39.785907+0000","last_became_active":"2024-09-14T11:26:04.272026+0000","last_became_peered":"2024-09-14T11:26:04.272026+0000","last_unstale":"2024-09-14T11:51:39.785907+0000","last_undegraded":"2024-09-14T11:51:39.785907+0000","last_fullsized":"2024-09-14T11:51:39.785907+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:03.282735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":232,"num_write":112,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.115743+0000","last_change":"2024-09-14T11:38:50.576604+0000","last_active":"2024-09-14T11:50:38.115743+0000","last_peered":"2024-09-14T11:50:38.115743+0000","last_clean":"2024-09-14T11:50:38.115743+0000","last_became_active":"2024-09-14T11:38:50.575796+0000","last_became_peered":"2024-09-14T11:38:50.575796+0000","last_unstale":"2024-09-14T11:50:38.115743+0000","last_undegraded":"2024-09-14T11:50:38.115743+0000","last_fullsized":"2024-09-14T11:50:38.115743+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:03.217316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"264'4","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.306173+0000","last_change":"2024-09-14T11:27:41.635521+0000","last_active":"2024-09-14T11:51:03.306173+0000","last_peered":"2024-09-14T11:51:03.306173+0000","last_clean":"2024-09-14T11:51:03.306173+0000","last_became_active":"2024-09-14T11:27:41.634402+0000","last_became_peered":"2024-09-14T11:27:41.634402+0000","last_unstale":"2024-09-14T11:51:03.306173+0000","last_undegraded":"2024-09-14T11:51:03.306173+0000","last_fullsized":"2024-09-14T11:51:03.306173+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:27.030127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.271311+0000","last_change":"2024-09-14T11:27:38.610277+0000","last_active":"2024-09-14T11:50:58.271311+0000","last_peered":"2024-09-14T11:50:58.271311+0000","last_clean":"2024-09-14T11:50:58.271311+0000","last_became_active":"2024-09-14T11:27:38.609363+0000","last_became_peered":"2024-09-14T11:27:38.609363+0000","last_unstale":"2024-09-14T11:50:58.271311+0000","last_undegraded":"2024-09-14T11:50:58.271311+0000","last_fullsized":"2024-09-14T11:50:58.271311+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:44.061754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"264'17","reported_seq":87,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.079749+0000","last_change":"2024-09-14T11:26:04.262270+0000","last_active":"2024-09-14T11:49:24.079749+0000","last_peered":"2024-09-14T11:49:24.079749+0000","last_clean":"2024-09-14T11:49:24.079749+0000","last_became_active":"2024-09-14T11:26:04.261498+0000","last_became_peered":"2024-09-14T11:26:04.261498+0000","last_unstale":"2024-09-14T11:49:24.079749+0000","last_undegraded":"2024-09-14T11:49:24.079749+0000","last_fullsized":"2024-09-14T11:49:24.079749+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:31.069079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":93,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.122005+0000","last_change":"2024-09-14T11:38:50.576965+0000","last_active":"2024-09-14T11:50:58.122005+0000","last_peered":"2024-09-14T11:50:58.122005+0000","last_clean":"2024-09-14T11:50:58.122005+0000","last_became_active":"2024-09-14T11:38:50.576165+0000","last_became_peered":"2024-09-14T11:38:50.576165+0000","last_unstale":"2024-09-14T11:50:58.122005+0000","last_undegraded":"2024-09-14T11:50:58.122005+0000","last_fullsized":"2024-09-14T11:50:58.122005+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:25.583158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"264'1","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:04.321580+0000","last_change":"2024-09-14T11:27:41.650299+0000","last_active":"2024-09-14T11:51:04.321580+0000","last_peered":"2024-09-14T11:51:04.321580+0000","last_clean":"2024-09-14T11:51:04.321580+0000","last_became_active":"2024-09-14T11:27:41.649598+0000","last_became_peered":"2024-09-14T11:27:41.649598+0000","last_unstale":"2024-09-14T11:51:04.321580+0000","last_undegraded":"2024-09-14T11:51:04.321580+0000","last_fullsized":"2024-09-14T11:51:04.321580+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:10.114521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.271350+0000","last_change":"2024-09-14T11:27:38.599118+0000","last_active":"2024-09-14T11:50:58.271350+0000","last_peered":"2024-09-14T11:50:58.271350+0000","last_clean":"2024-09-14T11:50:58.271350+0000","last_became_active":"2024-09-14T11:27:38.598429+0000","last_became_peered":"2024-09-14T11:27:38.598429+0000","last_unstale":"2024-09-14T11:50:58.271350+0000","last_undegraded":"2024-09-14T11:50:58.271350+0000","last_fullsized":"2024-09-14T11:50:58.271350+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:20.260448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"264'26","reported_seq":114,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.279763+0000","last_change":"2024-09-14T11:26:04.272989+0000","last_active":"2024-09-14T11:49:28.279763+0000","last_peered":"2024-09-14T11:49:28.279763+0000","last_clean":"2024-09-14T11:49:28.279763+0000","last_became_active":"2024-09-14T11:26:04.272216+0000","last_became_peered":"2024-09-14T11:26:04.272216+0000","last_unstale":"2024-09-14T11:49:28.279763+0000","last_undegraded":"2024-09-14T11:49:28.279763+0000","last_fullsized":"2024-09-14T11:49:28.279763+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:52.021930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":141,"num_write":65,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.109357+0000","last_change":"2024-09-14T11:38:50.589752+0000","last_active":"2024-09-14T11:49:48.109357+0000","last_peered":"2024-09-14T11:49:48.109357+0000","last_clean":"2024-09-14T11:49:48.109357+0000","last_became_active":"2024-09-14T11:38:50.589121+0000","last_became_peered":"2024-09-14T11:38:50.589121+0000","last_unstale":"2024-09-14T11:49:48.109357+0000","last_undegraded":"2024-09-14T11:49:48.109357+0000","last_fullsized":"2024-09-14T11:49:48.109357+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:46.246907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"261'4","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.289832+0000","last_change":"2024-09-14T11:27:41.631708+0000","last_active":"2024-09-14T11:50:13.289832+0000","last_peered":"2024-09-14T11:50:13.289832+0000","last_clean":"2024-09-14T11:50:13.289832+0000","last_became_active":"2024-09-14T11:27:41.630970+0000","last_became_peered":"2024-09-14T11:27:41.630970+0000","last_unstale":"2024-09-14T11:50:13.289832+0000","last_undegraded":"2024-09-14T11:50:13.289832+0000","last_fullsized":"2024-09-14T11:50:13.289832+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:10.321213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:09.090171+0000","last_change":"2024-09-14T11:27:38.598988+0000","last_active":"2024-09-14T11:50:09.090171+0000","last_peered":"2024-09-14T11:50:09.090171+0000","last_clean":"2024-09-14T11:50:09.090171+0000","last_became_active":"2024-09-14T11:27:38.580979+0000","last_became_peered":"2024-09-14T11:27:38.580979+0000","last_unstale":"2024-09-14T11:50:09.090171+0000","last_undegraded":"2024-09-14T11:50:09.090171+0000","last_fullsized":"2024-09-14T11:50:09.090171+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:07.399468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"261'22","reported_seq":106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.298654+0000","last_change":"2024-09-14T11:26:04.275780+0000","last_active":"2024-09-14T11:50:53.298654+0000","last_peered":"2024-09-14T11:50:53.298654+0000","last_clean":"2024-09-14T11:50:53.298654+0000","last_became_active":"2024-09-14T11:26:04.275034+0000","last_became_peered":"2024-09-14T11:26:04.275034+0000","last_unstale":"2024-09-14T11:50:53.298654+0000","last_undegraded":"2024-09-14T11:50:53.298654+0000","last_fullsized":"2024-09-14T11:50:53.298654+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:53.668220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":117,"num_write":55,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.260860+0000","last_change":"2024-09-14T11:38:50.596985+0000","last_active":"2024-09-14T11:50:08.260860+0000","last_peered":"2024-09-14T11:50:08.260860+0000","last_clean":"2024-09-14T11:50:08.260860+0000","last_became_active":"2024-09-14T11:38:50.596395+0000","last_became_peered":"2024-09-14T11:38:50.596395+0000","last_unstale":"2024-09-14T11:50:08.260860+0000","last_undegraded":"2024-09-14T11:50:08.260860+0000","last_fullsized":"2024-09-14T11:50:08.260860+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:15.646487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"264'2","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.289784+0000","last_change":"2024-09-14T11:27:41.657302+0000","last_active":"2024-09-14T11:50:13.289784+0000","last_peered":"2024-09-14T11:50:13.289784+0000","last_clean":"2024-09-14T11:50:13.289784+0000","last_became_active":"2024-09-14T11:27:41.656659+0000","last_became_peered":"2024-09-14T11:27:41.656659+0000","last_unstale":"2024-09-14T11:50:13.289784+0000","last_undegraded":"2024-09-14T11:50:13.289784+0000","last_fullsized":"2024-09-14T11:50:13.289784+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:57.077639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51634,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":100,"num_write":2,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.110964+0000","last_change":"2024-09-14T11:27:38.605497+0000","last_active":"2024-09-14T11:50:08.110964+0000","last_peered":"2024-09-14T11:50:08.110964+0000","last_clean":"2024-09-14T11:50:08.110964+0000","last_became_active":"2024-09-14T11:27:38.604732+0000","last_became_peered":"2024-09-14T11:27:38.604732+0000","last_unstale":"2024-09-14T11:50:08.110964+0000","last_undegraded":"2024-09-14T11:50:08.110964+0000","last_fullsized":"2024-09-14T11:50:08.110964+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:10.544829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"264'35","reported_seq":134,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:49.317370+0000","last_change":"2024-09-14T11:26:04.280000+0000","last_active":"2024-09-14T11:50:49.317370+0000","last_peered":"2024-09-14T11:50:49.317370+0000","last_clean":"2024-09-14T11:50:49.317370+0000","last_became_active":"2024-09-14T11:26:04.279402+0000","last_became_peered":"2024-09-14T11:26:04.279402+0000","last_unstale":"2024-09-14T11:50:49.317370+0000","last_undegraded":"2024-09-14T11:50:49.317370+0000","last_fullsized":"2024-09-14T11:50:49.317370+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:08.691450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":174,"num_write":94,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:44.299867+0000","last_change":"2024-09-14T11:38:50.573603+0000","last_active":"2024-09-14T11:49:44.299867+0000","last_peered":"2024-09-14T11:49:44.299867+0000","last_clean":"2024-09-14T11:49:44.299867+0000","last_became_active":"2024-09-14T11:38:50.573062+0000","last_became_peered":"2024-09-14T11:38:50.573062+0000","last_unstale":"2024-09-14T11:49:44.299867+0000","last_undegraded":"2024-09-14T11:49:44.299867+0000","last_fullsized":"2024-09-14T11:49:44.299867+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:58.483156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"264'6","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.289927+0000","last_change":"2024-09-14T11:27:41.639765+0000","last_active":"2024-09-14T11:50:13.289927+0000","last_peered":"2024-09-14T11:50:13.289927+0000","last_clean":"2024-09-14T11:50:13.289927+0000","last_became_active":"2024-09-14T11:27:41.639051+0000","last_became_peered":"2024-09-14T11:27:41.639051+0000","last_unstale":"2024-09-14T11:50:13.289927+0000","last_undegraded":"2024-09-14T11:50:13.289927+0000","last_fullsized":"2024-09-14T11:50:13.289927+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:41.947643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":20482,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"264'3","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.288625+0000","last_change":"2024-09-14T11:27:38.620255+0000","last_active":"2024-09-14T11:50:08.288625+0000","last_peered":"2024-09-14T11:50:08.288625+0000","last_clean":"2024-09-14T11:50:08.288625+0000","last_became_active":"2024-09-14T11:27:38.619608+0000","last_became_peered":"2024-09-14T11:27:38.619608+0000","last_unstale":"2024-09-14T11:50:08.288625+0000","last_undegraded":"2024-09-14T11:50:08.288625+0000","last_fullsized":"2024-09-14T11:50:08.288625+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:13.155452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":3,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"264'28","reported_seq":116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.270192+0000","last_change":"2024-09-14T11:26:04.273757+0000","last_active":"2024-09-14T11:50:53.270192+0000","last_peered":"2024-09-14T11:50:53.270192+0000","last_clean":"2024-09-14T11:50:53.270192+0000","last_became_active":"2024-09-14T11:26:04.272960+0000","last_became_peered":"2024-09-14T11:26:04.272960+0000","last_unstale":"2024-09-14T11:50:53.270192+0000","last_undegraded":"2024-09-14T11:50:53.270192+0000","last_fullsized":"2024-09-14T11:50:53.270192+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:56.581662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":136,"num_write":79,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:43.255430+0000","last_change":"2024-09-14T11:38:50.570309+0000","last_active":"2024-09-14T11:49:43.255430+0000","last_peered":"2024-09-14T11:49:43.255430+0000","last_clean":"2024-09-14T11:49:43.255430+0000","last_became_active":"2024-09-14T11:38:50.569743+0000","last_became_peered":"2024-09-14T11:38:50.569743+0000","last_unstale":"2024-09-14T11:49:43.255430+0000","last_undegraded":"2024-09-14T11:49:43.255430+0000","last_fullsized":"2024-09-14T11:49:43.255430+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:37.993575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"264'3","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.115144+0000","last_change":"2024-09-14T11:27:41.654827+0000","last_active":"2024-09-14T11:50:13.115144+0000","last_peered":"2024-09-14T11:50:13.115144+0000","last_clean":"2024-09-14T11:50:13.115144+0000","last_became_active":"2024-09-14T11:27:41.653929+0000","last_became_peered":"2024-09-14T11:27:41.653929+0000","last_unstale":"2024-09-14T11:50:13.115144+0000","last_undegraded":"2024-09-14T11:50:13.115144+0000","last_fullsized":"2024-09-14T11:50:13.115144+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:11.356458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4254673,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":118,"num_write":8,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"264'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.288702+0000","last_change":"2024-09-14T11:27:38.620107+0000","last_active":"2024-09-14T11:50:08.288702+0000","last_peered":"2024-09-14T11:50:08.288702+0000","last_clean":"2024-09-14T11:50:08.288702+0000","last_became_active":"2024-09-14T11:27:38.619441+0000","last_became_peered":"2024-09-14T11:27:38.619441+0000","last_unstale":"2024-09-14T11:50:08.288702+0000","last_undegraded":"2024-09-14T11:50:08.288702+0000","last_fullsized":"2024-09-14T11:50:08.288702+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:37.692951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13631488,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":21504,"num_write":10,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"264'28","reported_seq":115,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.120811+0000","last_change":"2024-09-14T11:26:04.272552+0000","last_active":"2024-09-14T11:50:53.120811+0000","last_peered":"2024-09-14T11:50:53.120811+0000","last_clean":"2024-09-14T11:50:53.120811+0000","last_became_active":"2024-09-14T11:26:04.271747+0000","last_became_peered":"2024-09-14T11:26:04.271747+0000","last_unstale":"2024-09-14T11:50:53.120811+0000","last_undegraded":"2024-09-14T11:50:53.120811+0000","last_fullsized":"2024-09-14T11:50:53.120811+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:55.732123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":132,"num_write":73,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.113971+0000","last_change":"2024-09-14T11:38:50.590185+0000","last_active":"2024-09-14T11:50:08.113971+0000","last_peered":"2024-09-14T11:50:08.113971+0000","last_clean":"2024-09-14T11:50:08.113971+0000","last_became_active":"2024-09-14T11:38:50.589444+0000","last_became_peered":"2024-09-14T11:38:50.589444+0000","last_unstale":"2024-09-14T11:50:08.113971+0000","last_undegraded":"2024-09-14T11:50:08.113971+0000","last_fullsized":"2024-09-14T11:50:08.113971+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:57.453301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"261'2","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:34.329581+0000","last_change":"2024-09-14T11:27:41.641002+0000","last_active":"2024-09-14T11:51:34.329581+0000","last_peered":"2024-09-14T11:51:34.329581+0000","last_clean":"2024-09-14T11:51:34.329581+0000","last_became_active":"2024-09-14T11:27:41.640105+0000","last_became_peered":"2024-09-14T11:27:41.640105+0000","last_unstale":"2024-09-14T11:51:34.329581+0000","last_undegraded":"2024-09-14T11:51:34.329581+0000","last_fullsized":"2024-09-14T11:51:34.329581+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:12.987982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"264'10","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:28.311556+0000","last_change":"2024-09-14T11:27:38.613505+0000","last_active":"2024-09-14T11:51:28.311556+0000","last_peered":"2024-09-14T11:51:28.311556+0000","last_clean":"2024-09-14T11:51:28.311556+0000","last_became_active":"2024-09-14T11:27:38.612745+0000","last_became_peered":"2024-09-14T11:27:38.612745+0000","last_unstale":"2024-09-14T11:51:28.311556+0000","last_undegraded":"2024-09-14T11:51:28.311556+0000","last_fullsized":"2024-09-14T11:51:28.311556+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:41.780008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60369,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":6207,"num_write":15,"num_write_kb":2107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"264'45","reported_seq":170,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.120656+0000","last_change":"2024-09-14T11:26:04.277466+0000","last_active":"2024-09-14T11:50:53.120656+0000","last_peered":"2024-09-14T11:50:53.120656+0000","last_clean":"2024-09-14T11:50:53.120656+0000","last_became_active":"2024-09-14T11:26:04.273309+0000","last_became_peered":"2024-09-14T11:26:04.273309+0000","last_unstale":"2024-09-14T11:50:53.120656+0000","last_undegraded":"2024-09-14T11:50:53.120656+0000","last_fullsized":"2024-09-14T11:50:53.120656+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:24.875502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":376,"num_read_kb":242,"num_write":121,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.091371+0000","last_change":"2024-09-14T11:38:50.597053+0000","last_active":"2024-09-14T11:50:14.091371+0000","last_peered":"2024-09-14T11:50:14.091371+0000","last_clean":"2024-09-14T11:50:14.091371+0000","last_became_active":"2024-09-14T11:38:50.596495+0000","last_became_peered":"2024-09-14T11:38:50.596495+0000","last_unstale":"2024-09-14T11:50:14.091371+0000","last_undegraded":"2024-09-14T11:50:14.091371+0000","last_fullsized":"2024-09-14T11:50:14.091371+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:54.445153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"264'3","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:34.110109+0000","last_change":"2024-09-14T11:27:41.650790+0000","last_active":"2024-09-14T11:51:34.110109+0000","last_peered":"2024-09-14T11:51:34.110109+0000","last_clean":"2024-09-14T11:51:34.110109+0000","last_became_active":"2024-09-14T11:27:41.650311+0000","last_became_peered":"2024-09-14T11:27:41.650311+0000","last_unstale":"2024-09-14T11:51:34.110109+0000","last_undegraded":"2024-09-14T11:51:34.110109+0000","last_fullsized":"2024-09-14T11:51:34.110109+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:02.760791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"264'6","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:28.131798+0000","last_change":"2024-09-14T11:27:38.600875+0000","last_active":"2024-09-14T11:51:28.131798+0000","last_peered":"2024-09-14T11:51:28.131798+0000","last_clean":"2024-09-14T11:51:28.131798+0000","last_became_active":"2024-09-14T11:27:38.600043+0000","last_became_peered":"2024-09-14T11:27:38.600043+0000","last_unstale":"2024-09-14T11:51:28.131798+0000","last_undegraded":"2024-09-14T11:51:28.131798+0000","last_fullsized":"2024-09-14T11:51:28.131798+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:38.547858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":7170,"num_write":6,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"264'31","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:21.529004+0000","last_change":"2024-09-14T11:26:04.274470+0000","last_active":"2024-09-14T11:50:21.529004+0000","last_peered":"2024-09-14T11:50:21.529004+0000","last_clean":"2024-09-14T11:50:21.529004+0000","last_became_active":"2024-09-14T11:26:04.274089+0000","last_became_peered":"2024-09-14T11:26:04.274089+0000","last_unstale":"2024-09-14T11:50:21.529004+0000","last_undegraded":"2024-09-14T11:50:21.529004+0000","last_fullsized":"2024-09-14T11:50:21.529004+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:02.147109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":254,"num_read_kb":164,"num_write":92,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.277870+0000","last_change":"2024-09-14T11:38:50.593374+0000","last_active":"2024-09-14T11:50:08.277870+0000","last_peered":"2024-09-14T11:50:08.277870+0000","last_clean":"2024-09-14T11:50:08.277870+0000","last_became_active":"2024-09-14T11:38:50.592765+0000","last_became_peered":"2024-09-14T11:38:50.592765+0000","last_unstale":"2024-09-14T11:50:08.277870+0000","last_undegraded":"2024-09-14T11:50:08.277870+0000","last_fullsized":"2024-09-14T11:50:08.277870+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:12.739637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"261'2","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.111954+0000","last_change":"2024-09-14T11:27:41.647748+0000","last_active":"2024-09-14T11:50:13.111954+0000","last_peered":"2024-09-14T11:50:13.111954+0000","last_clean":"2024-09-14T11:50:13.111954+0000","last_became_active":"2024-09-14T11:27:41.646962+0000","last_became_peered":"2024-09-14T11:27:41.646962+0000","last_unstale":"2024-09-14T11:50:13.111954+0000","last_undegraded":"2024-09-14T11:50:13.111954+0000","last_fullsized":"2024-09-14T11:50:13.111954+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:41.449801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:28.311711+0000","last_change":"2024-09-14T11:27:38.616699+0000","last_active":"2024-09-14T11:51:28.311711+0000","last_peered":"2024-09-14T11:51:28.311711+0000","last_clean":"2024-09-14T11:51:28.311711+0000","last_became_active":"2024-09-14T11:27:38.612131+0000","last_became_peered":"2024-09-14T11:27:38.612131+0000","last_unstale":"2024-09-14T11:51:28.311711+0000","last_undegraded":"2024-09-14T11:51:28.311711+0000","last_fullsized":"2024-09-14T11:51:28.311711+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:28.127453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"264'14","reported_seq":79,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:58.111733+0000","last_change":"2024-09-14T11:26:04.259922+0000","last_active":"2024-09-14T11:49:58.111733+0000","last_peered":"2024-09-14T11:49:58.111733+0000","last_clean":"2024-09-14T11:49:58.111733+0000","last_became_active":"2024-09-14T11:26:04.258976+0000","last_became_peered":"2024-09-14T11:26:04.258976+0000","last_unstale":"2024-09-14T11:49:58.111733+0000","last_undegraded":"2024-09-14T11:49:58.111733+0000","last_fullsized":"2024-09-14T11:49:58.111733+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:45.204426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":72,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.288544+0000","last_change":"2024-09-14T11:38:50.594382+0000","last_active":"2024-09-14T11:50:08.288544+0000","last_peered":"2024-09-14T11:50:08.288544+0000","last_clean":"2024-09-14T11:50:08.288544+0000","last_became_active":"2024-09-14T11:38:50.593641+0000","last_became_peered":"2024-09-14T11:38:50.593641+0000","last_unstale":"2024-09-14T11:50:08.288544+0000","last_undegraded":"2024-09-14T11:50:08.288544+0000","last_fullsized":"2024-09-14T11:50:08.288544+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:19.832637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"261'7","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:33.296159+0000","last_change":"2024-09-14T11:27:41.657817+0000","last_active":"2024-09-14T11:51:33.296159+0000","last_peered":"2024-09-14T11:51:33.296159+0000","last_clean":"2024-09-14T11:51:33.296159+0000","last_became_active":"2024-09-14T11:27:41.657112+0000","last_became_peered":"2024-09-14T11:27:41.657112+0000","last_unstale":"2024-09-14T11:51:33.296159+0000","last_undegraded":"2024-09-14T11:51:33.296159+0000","last_fullsized":"2024-09-14T11:51:33.296159+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:00.412523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":6146,"num_write":12,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"264'2","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:09.306261+0000","last_change":"2024-09-14T11:27:38.605512+0000","last_active":"2024-09-14T11:50:09.306261+0000","last_peered":"2024-09-14T11:50:09.306261+0000","last_clean":"2024-09-14T11:50:09.306261+0000","last_became_active":"2024-09-14T11:27:38.602864+0000","last_became_peered":"2024-09-14T11:27:38.602864+0000","last_unstale":"2024-09-14T11:50:09.306261+0000","last_undegraded":"2024-09-14T11:50:09.306261+0000","last_fullsized":"2024-09-14T11:50:09.306261+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:31.418858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"264'39","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:58.275660+0000","last_change":"2024-09-14T11:26:04.272287+0000","last_active":"2024-09-14T11:49:58.275660+0000","last_peered":"2024-09-14T11:49:58.275660+0000","last_clean":"2024-09-14T11:49:58.275660+0000","last_became_active":"2024-09-14T11:26:04.271893+0000","last_became_peered":"2024-09-14T11:26:04.271893+0000","last_unstale":"2024-09-14T11:49:58.275660+0000","last_undegraded":"2024-09-14T11:49:58.275660+0000","last_fullsized":"2024-09-14T11:49:58.275660+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:19.118538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":319,"num_read_kb":212,"num_write":95,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.294000+0000","last_change":"2024-09-14T11:38:50.589623+0000","last_active":"2024-09-14T11:51:23.294000+0000","last_peered":"2024-09-14T11:51:23.294000+0000","last_clean":"2024-09-14T11:51:23.294000+0000","last_became_active":"2024-09-14T11:38:50.587827+0000","last_became_peered":"2024-09-14T11:38:50.587827+0000","last_unstale":"2024-09-14T11:51:23.294000+0000","last_undegraded":"2024-09-14T11:51:23.294000+0000","last_fullsized":"2024-09-14T11:51:23.294000+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:20.578713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"261'5","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:43.121925+0000","last_change":"2024-09-14T11:27:41.652540+0000","last_active":"2024-09-14T11:50:43.121925+0000","last_peered":"2024-09-14T11:50:43.121925+0000","last_clean":"2024-09-14T11:50:43.121925+0000","last_became_active":"2024-09-14T11:27:41.651778+0000","last_became_peered":"2024-09-14T11:27:41.651778+0000","last_unstale":"2024-09-14T11:50:43.121925+0000","last_undegraded":"2024-09-14T11:50:43.121925+0000","last_fullsized":"2024-09-14T11:50:43.121925+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:35.794859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:34.313081+0000","last_change":"2024-09-14T11:27:38.604820+0000","last_active":"2024-09-14T11:50:34.313081+0000","last_peered":"2024-09-14T11:50:34.313081+0000","last_clean":"2024-09-14T11:50:34.313081+0000","last_became_active":"2024-09-14T11:27:38.603954+0000","last_became_peered":"2024-09-14T11:27:38.603954+0000","last_unstale":"2024-09-14T11:50:34.313081+0000","last_undegraded":"2024-09-14T11:50:34.313081+0000","last_fullsized":"2024-09-14T11:50:34.313081+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:26.741673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"264'59","reported_seq":200,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:58.106856+0000","last_change":"2024-09-14T11:26:04.270170+0000","last_active":"2024-09-14T11:49:58.106856+0000","last_peered":"2024-09-14T11:49:58.106856+0000","last_clean":"2024-09-14T11:49:58.106856+0000","last_became_active":"2024-09-14T11:26:04.269206+0000","last_became_peered":"2024-09-14T11:26:04.269206+0000","last_unstale":"2024-09-14T11:49:58.106856+0000","last_undegraded":"2024-09-14T11:49:58.106856+0000","last_fullsized":"2024-09-14T11:49:58.106856+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:12.185033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":473,"num_read_kb":330,"num_write":140,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.294101+0000","last_change":"2024-09-14T11:38:50.585754+0000","last_active":"2024-09-14T11:51:23.294101+0000","last_peered":"2024-09-14T11:51:23.294101+0000","last_clean":"2024-09-14T11:51:23.294101+0000","last_became_active":"2024-09-14T11:38:50.585233+0000","last_became_peered":"2024-09-14T11:38:50.585233+0000","last_unstale":"2024-09-14T11:51:23.294101+0000","last_undegraded":"2024-09-14T11:51:23.294101+0000","last_fullsized":"2024-09-14T11:51:23.294101+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:13.891277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"261'4","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.120790+0000","last_change":"2024-09-14T11:27:41.660945+0000","last_active":"2024-09-14T11:50:38.120790+0000","last_peered":"2024-09-14T11:50:38.120790+0000","last_clean":"2024-09-14T11:50:38.120790+0000","last_became_active":"2024-09-14T11:27:41.660286+0000","last_became_peered":"2024-09-14T11:27:41.660286+0000","last_unstale":"2024-09-14T11:50:38.120790+0000","last_undegraded":"2024-09-14T11:50:38.120790+0000","last_fullsized":"2024-09-14T11:50:38.120790+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:47.102264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"261'2","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.115783+0000","last_change":"2024-09-14T11:27:38.594963+0000","last_active":"2024-09-14T11:50:38.115783+0000","last_peered":"2024-09-14T11:50:38.115783+0000","last_clean":"2024-09-14T11:50:38.115783+0000","last_became_active":"2024-09-14T11:27:38.591485+0000","last_became_peered":"2024-09-14T11:27:38.591485+0000","last_unstale":"2024-09-14T11:50:38.115783+0000","last_undegraded":"2024-09-14T11:50:38.115783+0000","last_fullsized":"2024-09-14T11:50:38.115783+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:00.325087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"261'8","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:54.302809+0000","last_change":"2024-09-14T11:26:04.284721+0000","last_active":"2024-09-14T11:49:54.302809+0000","last_peered":"2024-09-14T11:49:54.302809+0000","last_clean":"2024-09-14T11:49:54.302809+0000","last_became_active":"2024-09-14T11:26:04.280724+0000","last_became_peered":"2024-09-14T11:26:04.280724+0000","last_unstale":"2024-09-14T11:49:54.302809+0000","last_undegraded":"2024-09-14T11:49:54.302809+0000","last_fullsized":"2024-09-14T11:49:54.302809+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:06.079319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":39,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.124982+0000","last_change":"2024-09-14T11:38:50.586522+0000","last_active":"2024-09-14T11:50:58.124982+0000","last_peered":"2024-09-14T11:50:58.124982+0000","last_clean":"2024-09-14T11:50:58.124982+0000","last_became_active":"2024-09-14T11:38:50.586004+0000","last_became_peered":"2024-09-14T11:38:50.586004+0000","last_unstale":"2024-09-14T11:50:58.124982+0000","last_undegraded":"2024-09-14T11:50:58.124982+0000","last_fullsized":"2024-09-14T11:50:58.124982+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:21.529496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"264'3","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:33.296409+0000","last_change":"2024-09-14T11:27:41.657751+0000","last_active":"2024-09-14T11:51:33.296409+0000","last_peered":"2024-09-14T11:51:33.296409+0000","last_clean":"2024-09-14T11:51:33.296409+0000","last_became_active":"2024-09-14T11:27:41.656864+0000","last_became_peered":"2024-09-14T11:27:41.656864+0000","last_unstale":"2024-09-14T11:51:33.296409+0000","last_undegraded":"2024-09-14T11:51:33.296409+0000","last_fullsized":"2024-09-14T11:51:33.296409+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:54.203821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4123,"num_write":3,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"264'10","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:29.109079+0000","last_change":"2024-09-14T11:27:38.598139+0000","last_active":"2024-09-14T11:51:29.109079+0000","last_peered":"2024-09-14T11:51:29.109079+0000","last_clean":"2024-09-14T11:51:29.109079+0000","last_became_active":"2024-09-14T11:27:38.597416+0000","last_became_peered":"2024-09-14T11:27:38.597416+0000","last_unstale":"2024-09-14T11:51:29.109079+0000","last_undegraded":"2024-09-14T11:51:29.109079+0000","last_fullsized":"2024-09-14T11:51:29.109079+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:43.572595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1097003,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":16434,"num_write":20,"num_write_kb":9264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"264'34","reported_seq":138,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:14.105634+0000","last_change":"2024-09-14T11:26:04.275339+0000","last_active":"2024-09-14T11:51:14.105634+0000","last_peered":"2024-09-14T11:51:14.105634+0000","last_clean":"2024-09-14T11:51:14.105634+0000","last_became_active":"2024-09-14T11:26:04.274720+0000","last_became_peered":"2024-09-14T11:26:04.274720+0000","last_unstale":"2024-09-14T11:51:14.105634+0000","last_undegraded":"2024-09-14T11:51:14.105634+0000","last_fullsized":"2024-09-14T11:51:14.105634+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:36.983364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":267,"num_read_kb":161,"num_write":92,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:24.326912+0000","last_change":"2024-09-14T11:38:50.576319+0000","last_active":"2024-09-14T11:51:24.326912+0000","last_peered":"2024-09-14T11:51:24.326912+0000","last_clean":"2024-09-14T11:51:24.326912+0000","last_became_active":"2024-09-14T11:38:50.575662+0000","last_became_peered":"2024-09-14T11:38:50.575662+0000","last_unstale":"2024-09-14T11:51:24.326912+0000","last_undegraded":"2024-09-14T11:51:24.326912+0000","last_fullsized":"2024-09-14T11:51:24.326912+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:49.815419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:34.329826+0000","last_change":"2024-09-14T11:27:41.653202+0000","last_active":"2024-09-14T11:51:34.329826+0000","last_peered":"2024-09-14T11:51:34.329826+0000","last_clean":"2024-09-14T11:51:34.329826+0000","last_became_active":"2024-09-14T11:27:41.652132+0000","last_became_peered":"2024-09-14T11:27:41.652132+0000","last_unstale":"2024-09-14T11:51:34.329826+0000","last_undegraded":"2024-09-14T11:51:34.329826+0000","last_fullsized":"2024-09-14T11:51:34.329826+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:58.896733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"264'2","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:29.328518+0000","last_change":"2024-09-14T11:27:38.603010+0000","last_active":"2024-09-14T11:51:29.328518+0000","last_peered":"2024-09-14T11:51:29.328518+0000","last_clean":"2024-09-14T11:51:29.328518+0000","last_became_active":"2024-09-14T11:27:38.602099+0000","last_became_peered":"2024-09-14T11:27:38.602099+0000","last_unstale":"2024-09-14T11:51:29.328518+0000","last_undegraded":"2024-09-14T11:51:29.328518+0000","last_fullsized":"2024-09-14T11:51:29.328518+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:51.969381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"264'30","reported_seq":125,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.307396+0000","last_change":"2024-09-14T11:26:04.266535+0000","last_active":"2024-09-14T11:51:08.307396+0000","last_peered":"2024-09-14T11:51:08.307396+0000","last_clean":"2024-09-14T11:51:08.307396+0000","last_became_active":"2024-09-14T11:26:04.265553+0000","last_became_peered":"2024-09-14T11:26:04.265553+0000","last_unstale":"2024-09-14T11:51:08.307396+0000","last_undegraded":"2024-09-14T11:51:08.307396+0000","last_fullsized":"2024-09-14T11:51:08.307396+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:39.882235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":163,"num_write":75,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:43.283196+0000","last_change":"2024-09-14T11:38:50.587405+0000","last_active":"2024-09-14T11:49:43.283196+0000","last_peered":"2024-09-14T11:49:43.283196+0000","last_clean":"2024-09-14T11:49:43.283196+0000","last_became_active":"2024-09-14T11:38:50.583172+0000","last_became_peered":"2024-09-14T11:38:50.583172+0000","last_unstale":"2024-09-14T11:49:43.283196+0000","last_undegraded":"2024-09-14T11:49:43.283196+0000","last_fullsized":"2024-09-14T11:49:43.283196+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:06.394703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"264'2","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.115615+0000","last_change":"2024-09-14T11:27:41.646437+0000","last_active":"2024-09-14T11:50:38.115615+0000","last_peered":"2024-09-14T11:50:38.115615+0000","last_clean":"2024-09-14T11:50:38.115615+0000","last_became_active":"2024-09-14T11:27:41.645631+0000","last_became_peered":"2024-09-14T11:27:41.645631+0000","last_unstale":"2024-09-14T11:50:38.115615+0000","last_undegraded":"2024-09-14T11:50:38.115615+0000","last_fullsized":"2024-09-14T11:50:38.115615+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:11.944240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"261'6","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:49.114182+0000","last_change":"2024-09-14T11:27:38.598601+0000","last_active":"2024-09-14T11:51:49.114182+0000","last_peered":"2024-09-14T11:51:49.114182+0000","last_clean":"2024-09-14T11:51:49.114182+0000","last_became_active":"2024-09-14T11:27:38.597788+0000","last_became_peered":"2024-09-14T11:27:38.597788+0000","last_unstale":"2024-09-14T11:51:49.114182+0000","last_undegraded":"2024-09-14T11:51:49.114182+0000","last_fullsized":"2024-09-14T11:51:49.114182+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:42.681971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4123,"num_write":6,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"264'31","reported_seq":122,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.496327+0000","last_change":"2024-09-14T11:26:04.258522+0000","last_active":"2024-09-14T11:51:07.496327+0000","last_peered":"2024-09-14T11:51:07.496327+0000","last_clean":"2024-09-14T11:51:07.496327+0000","last_became_active":"2024-09-14T11:26:04.257219+0000","last_became_peered":"2024-09-14T11:26:04.257219+0000","last_unstale":"2024-09-14T11:51:07.496327+0000","last_undegraded":"2024-09-14T11:51:07.496327+0000","last_fullsized":"2024-09-14T11:51:07.496327+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:20.764816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":127,"num_write":83,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:43.103145+0000","last_change":"2024-09-14T11:38:50.581794+0000","last_active":"2024-09-14T11:49:43.103145+0000","last_peered":"2024-09-14T11:49:43.103145+0000","last_clean":"2024-09-14T11:49:43.103145+0000","last_became_active":"2024-09-14T11:38:50.581128+0000","last_became_peered":"2024-09-14T11:38:50.581128+0000","last_unstale":"2024-09-14T11:49:43.103145+0000","last_undegraded":"2024-09-14T11:49:43.103145+0000","last_fullsized":"2024-09-14T11:49:43.103145+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:55.010648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"264'2","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:49.333156+0000","last_change":"2024-09-14T11:27:41.653209+0000","last_active":"2024-09-14T11:51:49.333156+0000","last_peered":"2024-09-14T11:51:49.333156+0000","last_clean":"2024-09-14T11:51:49.333156+0000","last_became_active":"2024-09-14T11:27:41.652549+0000","last_became_peered":"2024-09-14T11:27:41.652549+0000","last_unstale":"2024-09-14T11:51:49.333156+0000","last_undegraded":"2024-09-14T11:51:49.333156+0000","last_fullsized":"2024-09-14T11:51:49.333156+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:00.987136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"264'4","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:34.312953+0000","last_change":"2024-09-14T11:27:38.610165+0000","last_active":"2024-09-14T11:50:34.312953+0000","last_peered":"2024-09-14T11:50:34.312953+0000","last_clean":"2024-09-14T11:50:34.312953+0000","last_became_active":"2024-09-14T11:27:38.609483+0000","last_became_peered":"2024-09-14T11:27:38.609483+0000","last_unstale":"2024-09-14T11:50:34.312953+0000","last_undegraded":"2024-09-14T11:50:34.312953+0000","last_fullsized":"2024-09-14T11:50:34.312953+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:29:33.493298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4197511,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":12292,"num_write":4,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"264'27","reported_seq":114,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:43.442305+0000","last_change":"2024-09-14T11:26:04.269191+0000","last_active":"2024-09-14T11:51:43.442305+0000","last_peered":"2024-09-14T11:51:43.442305+0000","last_clean":"2024-09-14T11:51:43.442305+0000","last_became_active":"2024-09-14T11:26:04.268338+0000","last_became_peered":"2024-09-14T11:26:04.268338+0000","last_unstale":"2024-09-14T11:51:43.442305+0000","last_undegraded":"2024-09-14T11:51:43.442305+0000","last_fullsized":"2024-09-14T11:51:43.442305+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:41.961353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":125,"num_write":73,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.130723+0000","last_change":"2024-09-14T11:38:50.590316+0000","last_active":"2024-09-14T11:51:23.130723+0000","last_peered":"2024-09-14T11:51:23.130723+0000","last_clean":"2024-09-14T11:51:23.130723+0000","last_became_active":"2024-09-14T11:38:50.589588+0000","last_became_peered":"2024-09-14T11:38:50.589588+0000","last_unstale":"2024-09-14T11:51:23.130723+0000","last_undegraded":"2024-09-14T11:51:23.130723+0000","last_fullsized":"2024-09-14T11:51:23.130723+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:24.259049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"264'1","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:39.096899+0000","last_change":"2024-09-14T11:27:41.644387+0000","last_active":"2024-09-14T11:50:39.096899+0000","last_peered":"2024-09-14T11:50:39.096899+0000","last_clean":"2024-09-14T11:50:39.096899+0000","last_became_active":"2024-09-14T11:27:41.642400+0000","last_became_peered":"2024-09-14T11:27:41.642400+0000","last_unstale":"2024-09-14T11:50:39.096899+0000","last_undegraded":"2024-09-14T11:50:39.096899+0000","last_fullsized":"2024-09-14T11:50:39.096899+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:58.652273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"261'5","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:33.116188+0000","last_change":"2024-09-14T11:27:38.590088+0000","last_active":"2024-09-14T11:50:33.116188+0000","last_peered":"2024-09-14T11:50:33.116188+0000","last_clean":"2024-09-14T11:50:33.116188+0000","last_became_active":"2024-09-14T11:27:38.587990+0000","last_became_peered":"2024-09-14T11:27:38.587990+0000","last_unstale":"2024-09-14T11:50:33.116188+0000","last_undegraded":"2024-09-14T11:50:33.116188+0000","last_fullsized":"2024-09-14T11:50:33.116188+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:09.675601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"264'55","reported_seq":192,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:43.699139+0000","last_change":"2024-09-14T11:26:04.258664+0000","last_active":"2024-09-14T11:51:43.699139+0000","last_peered":"2024-09-14T11:51:43.699139+0000","last_clean":"2024-09-14T11:51:43.699139+0000","last_became_active":"2024-09-14T11:26:04.257926+0000","last_became_peered":"2024-09-14T11:26:04.257926+0000","last_unstale":"2024-09-14T11:51:43.699139+0000","last_undegraded":"2024-09-14T11:51:43.699139+0000","last_fullsized":"2024-09-14T11:51:43.699139+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:33.436039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":423,"num_read_kb":280,"num_write":136,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:24.327084+0000","last_change":"2024-09-14T11:38:50.587747+0000","last_active":"2024-09-14T11:51:24.327084+0000","last_peered":"2024-09-14T11:51:24.327084+0000","last_clean":"2024-09-14T11:51:24.327084+0000","last_became_active":"2024-09-14T11:38:50.581923+0000","last_became_peered":"2024-09-14T11:38:50.581923+0000","last_unstale":"2024-09-14T11:51:24.327084+0000","last_undegraded":"2024-09-14T11:51:24.327084+0000","last_fullsized":"2024-09-14T11:51:24.327084+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:40.481426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:39.096845+0000","last_change":"2024-09-14T11:27:41.635443+0000","last_active":"2024-09-14T11:50:39.096845+0000","last_peered":"2024-09-14T11:50:39.096845+0000","last_clean":"2024-09-14T11:50:39.096845+0000","last_became_active":"2024-09-14T11:27:41.634692+0000","last_became_peered":"2024-09-14T11:27:41.634692+0000","last_unstale":"2024-09-14T11:50:39.096845+0000","last_undegraded":"2024-09-14T11:50:39.096845+0000","last_fullsized":"2024-09-14T11:50:39.096845+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:40.891329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"264'6","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:33.265987+0000","last_change":"2024-09-14T11:27:38.613089+0000","last_active":"2024-09-14T11:50:33.265987+0000","last_peered":"2024-09-14T11:50:33.265987+0000","last_clean":"2024-09-14T11:50:33.265987+0000","last_became_active":"2024-09-14T11:27:38.612443+0000","last_became_peered":"2024-09-14T11:27:38.612443+0000","last_unstale":"2024-09-14T11:50:33.265987+0000","last_undegraded":"2024-09-14T11:50:33.265987+0000","last_fullsized":"2024-09-14T11:50:33.265987+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:03.608324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"264'61","reported_seq":208,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.091151+0000","last_change":"2024-09-14T11:26:04.264319+0000","last_active":"2024-09-14T11:50:14.091151+0000","last_peered":"2024-09-14T11:50:14.091151+0000","last_clean":"2024-09-14T11:50:14.091151+0000","last_became_active":"2024-09-14T11:26:04.263498+0000","last_became_peered":"2024-09-14T11:26:04.263498+0000","last_unstale":"2024-09-14T11:50:14.091151+0000","last_undegraded":"2024-09-14T11:50:14.091151+0000","last_fullsized":"2024-09-14T11:50:14.091151+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:15.140217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":491,"num_read_kb":357,"num_write":145,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"264'195","reported_seq":915,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:00.618454+0000","last_change":"2024-09-14T11:09:45.213450+0000","last_active":"2024-09-14T11:52:00.618454+0000","last_peered":"2024-09-14T11:52:00.618454+0000","last_clean":"2024-09-14T11:52:00.618454+0000","last_became_active":"2024-09-14T11:09:45.212881+0000","last_became_peered":"2024-09-14T11:09:45.212881+0000","last_unstale":"2024-09-14T11:52:00.618454+0000","last_undegraded":"2024-09-14T11:52:00.618454+0000","last_fullsized":"2024-09-14T11:52:00.618454+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:30.710132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":928,"num_read_kb":39441,"num_write":967,"num_write_kb":29636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"264'507","reported_seq":2106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:10.846453+0000","last_change":"2024-09-14T11:09:46.960384+0000","last_active":"2024-09-14T11:52:10.846453+0000","last_peered":"2024-09-14T11:52:10.846453+0000","last_clean":"2024-09-14T11:52:10.846453+0000","last_became_active":"2024-09-14T11:09:46.960069+0000","last_became_peered":"2024-09-14T11:09:46.960069+0000","last_unstale":"2024-09-14T11:52:10.846453+0000","last_undegraded":"2024-09-14T11:52:10.846453+0000","last_fullsized":"2024-09-14T11:52:10.846453+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:31.331846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2624,"num_read_kb":2455,"num_write":621,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"264'206","reported_seq":854,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:28.131954+0000","last_change":"2024-09-14T11:09:45.211773+0000","last_active":"2024-09-14T11:51:28.131954+0000","last_peered":"2024-09-14T11:51:28.131954+0000","last_clean":"2024-09-14T11:51:28.131954+0000","last_became_active":"2024-09-14T11:09:45.211049+0000","last_became_peered":"2024-09-14T11:09:45.211049+0000","last_unstale":"2024-09-14T11:51:28.131954+0000","last_undegraded":"2024-09-14T11:51:28.131954+0000","last_fullsized":"2024-09-14T11:51:28.131954+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:23.782528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145754,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":535,"num_read_kb":70257,"num_write":1013,"num_write_kb":34950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"264'757","reported_seq":2283,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.019646+0000","last_change":"2024-09-14T11:09:46.957857+0000","last_active":"2024-09-14T11:52:29.019646+0000","last_peered":"2024-09-14T11:52:29.019646+0000","last_clean":"2024-09-14T11:52:29.019646+0000","last_became_active":"2024-09-14T11:09:46.957446+0000","last_became_peered":"2024-09-14T11:09:46.957446+0000","last_unstale":"2024-09-14T11:52:29.019646+0000","last_undegraded":"2024-09-14T11:52:29.019646+0000","last_fullsized":"2024-09-14T11:52:29.019646+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:59.796579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3644,"num_read_kb":3296,"num_write":998,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"264'176","reported_seq":798,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:28.131916+0000","last_change":"2024-09-14T11:09:45.209713+0000","last_active":"2024-09-14T11:51:28.131916+0000","last_peered":"2024-09-14T11:51:28.131916+0000","last_clean":"2024-09-14T11:51:28.131916+0000","last_became_active":"2024-09-14T11:09:45.207458+0000","last_became_peered":"2024-09-14T11:09:45.207458+0000","last_unstale":"2024-09-14T11:51:28.131916+0000","last_undegraded":"2024-09-14T11:51:28.131916+0000","last_fullsized":"2024-09-14T11:51:28.131916+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:49.539522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12655459,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":473,"num_read_kb":12475,"num_write":819,"num_write_kb":33777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"264'372","reported_seq":1895,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:27.204477+0000","last_change":"2024-09-14T11:09:46.950941+0000","last_active":"2024-09-14T11:52:27.204477+0000","last_peered":"2024-09-14T11:52:27.204477+0000","last_clean":"2024-09-14T11:52:27.204477+0000","last_became_active":"2024-09-14T11:09:46.950652+0000","last_became_peered":"2024-09-14T11:09:46.950652+0000","last_unstale":"2024-09-14T11:52:27.204477+0000","last_undegraded":"2024-09-14T11:52:27.204477+0000","last_fullsized":"2024-09-14T11:52:27.204477+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:34.170365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2108,"num_read_kb":2030,"num_write":424,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"264'202","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:23.993626+0000","last_change":"2024-09-14T11:09:45.186739+0000","last_active":"2024-09-14T11:52:23.993626+0000","last_peered":"2024-09-14T11:52:23.993626+0000","last_clean":"2024-09-14T11:52:23.993626+0000","last_became_active":"2024-09-14T11:09:45.185702+0000","last_became_peered":"2024-09-14T11:09:45.185702+0000","last_unstale":"2024-09-14T11:52:23.993626+0000","last_undegraded":"2024-09-14T11:52:23.993626+0000","last_fullsized":"2024-09-14T11:52:23.993626+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:56.963707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9438224,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":491,"num_read_kb":15356,"num_write":914,"num_write_kb":51388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"264'414","reported_seq":1970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.623964+0000","last_change":"2024-09-14T11:09:46.954424+0000","last_active":"2024-09-14T11:52:29.623964+0000","last_peered":"2024-09-14T11:52:29.623964+0000","last_clean":"2024-09-14T11:52:29.623964+0000","last_became_active":"2024-09-14T11:09:46.952230+0000","last_became_peered":"2024-09-14T11:09:46.952230+0000","last_unstale":"2024-09-14T11:52:29.623964+0000","last_undegraded":"2024-09-14T11:52:29.623964+0000","last_fullsized":"2024-09-14T11:52:29.623964+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:20.602131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2399,"num_read_kb":2276,"num_write":503,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"264'172","reported_seq":741,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.686181+0000","last_change":"2024-09-14T11:10:22.255380+0000","last_active":"2024-09-14T11:52:24.686181+0000","last_peered":"2024-09-14T11:52:24.686181+0000","last_clean":"2024-09-14T11:52:24.686181+0000","last_became_active":"2024-09-14T11:10:22.254947+0000","last_became_peered":"2024-09-14T11:10:22.254947+0000","last_unstale":"2024-09-14T11:52:24.686181+0000","last_undegraded":"2024-09-14T11:52:24.686181+0000","last_fullsized":"2024-09-14T11:52:24.686181+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:02.851190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437213,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":438,"num_read_kb":20000,"num_write":785,"num_write_kb":32213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'366","reported_seq":1751,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.120430+0000","last_change":"2024-09-14T11:09:46.962966+0000","last_active":"2024-09-14T11:53:43.120430+0000","last_peered":"2024-09-14T11:53:43.120430+0000","last_clean":"2024-09-14T11:53:43.120430+0000","last_became_active":"2024-09-14T11:09:46.962586+0000","last_became_peered":"2024-09-14T11:09:46.962586+0000","last_unstale":"2024-09-14T11:53:43.120430+0000","last_undegraded":"2024-09-14T11:53:43.120430+0000","last_fullsized":"2024-09-14T11:53:43.120430+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:16.752782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1989,"num_read_kb":1876,"num_write":428,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"264'202","reported_seq":829,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:08.329811+0000","last_change":"2024-09-14T11:09:45.187610+0000","last_active":"2024-09-14T11:52:08.329811+0000","last_peered":"2024-09-14T11:52:08.329811+0000","last_clean":"2024-09-14T11:52:08.329811+0000","last_became_active":"2024-09-14T11:09:45.187149+0000","last_became_peered":"2024-09-14T11:09:45.187149+0000","last_unstale":"2024-09-14T11:52:08.329811+0000","last_undegraded":"2024-09-14T11:52:08.329811+0000","last_fullsized":"2024-09-14T11:52:08.329811+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:27.216240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2451109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":550,"num_read_kb":3965,"num_write":970,"num_write_kb":31222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"264'786","reported_seq":2321,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.037515+0000","last_change":"2024-09-14T11:09:46.990395+0000","last_active":"2024-09-14T11:52:29.037515+0000","last_peered":"2024-09-14T11:52:29.037515+0000","last_clean":"2024-09-14T11:52:29.037515+0000","last_became_active":"2024-09-14T11:09:46.990102+0000","last_became_peered":"2024-09-14T11:09:46.990102+0000","last_unstale":"2024-09-14T11:52:29.037515+0000","last_undegraded":"2024-09-14T11:52:29.037515+0000","last_fullsized":"2024-09-14T11:52:29.037515+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:13.567778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3903,"num_read_kb":3531,"num_write":1063,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"264'331","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.668251+0000","last_change":"2024-09-14T11:09:45.205649+0000","last_active":"2024-09-14T11:52:12.668251+0000","last_peered":"2024-09-14T11:52:12.668251+0000","last_clean":"2024-09-14T11:52:12.668251+0000","last_became_active":"2024-09-14T11:09:45.204885+0000","last_became_peered":"2024-09-14T11:09:45.204885+0000","last_unstale":"2024-09-14T11:52:12.668251+0000","last_undegraded":"2024-09-14T11:52:12.668251+0000","last_fullsized":"2024-09-14T11:52:12.668251+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:37.591233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1071253,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":902,"num_read_kb":1363,"num_write":1216,"num_write_kb":28416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"264'784","reported_seq":2358,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.184843+0000","last_change":"2024-09-14T11:09:46.951375+0000","last_active":"2024-09-14T11:52:12.184843+0000","last_peered":"2024-09-14T11:52:12.184843+0000","last_clean":"2024-09-14T11:52:12.184843+0000","last_became_active":"2024-09-14T11:09:46.951098+0000","last_became_peered":"2024-09-14T11:09:46.951098+0000","last_unstale":"2024-09-14T11:52:12.184843+0000","last_undegraded":"2024-09-14T11:52:12.184843+0000","last_fullsized":"2024-09-14T11:52:12.184843+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:32.686431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3820,"num_read_kb":3459,"num_write":1035,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"264'206","reported_seq":835,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:42.039065+0000","last_change":"2024-09-14T11:09:45.208652+0000","last_active":"2024-09-14T11:50:42.039065+0000","last_peered":"2024-09-14T11:50:42.039065+0000","last_clean":"2024-09-14T11:50:42.039065+0000","last_became_active":"2024-09-14T11:09:45.207406+0000","last_became_peered":"2024-09-14T11:09:45.207406+0000","last_unstale":"2024-09-14T11:50:42.039065+0000","last_undegraded":"2024-09-14T11:50:42.039065+0000","last_fullsized":"2024-09-14T11:50:42.039065+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:23.047694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12984645,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":504,"num_read_kb":35143,"num_write":947,"num_write_kb":45963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"264'416","reported_seq":1956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.102644+0000","last_change":"2024-09-14T11:09:46.996557+0000","last_active":"2024-09-14T11:53:43.102644+0000","last_peered":"2024-09-14T11:53:43.102644+0000","last_clean":"2024-09-14T11:53:43.102644+0000","last_became_active":"2024-09-14T11:09:46.995237+0000","last_became_peered":"2024-09-14T11:09:46.995237+0000","last_unstale":"2024-09-14T11:53:43.102644+0000","last_undegraded":"2024-09-14T11:53:43.102644+0000","last_fullsized":"2024-09-14T11:53:43.102644+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:43.227391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2305,"num_read_kb":2183,"num_write":489,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"264'597","reported_seq":2214,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:11.470546+0000","last_change":"2024-09-14T11:09:46.960536+0000","last_active":"2024-09-14T11:52:11.470546+0000","last_peered":"2024-09-14T11:52:11.470546+0000","last_clean":"2024-09-14T11:52:11.470546+0000","last_became_active":"2024-09-14T11:09:46.959477+0000","last_became_peered":"2024-09-14T11:09:46.959477+0000","last_unstale":"2024-09-14T11:52:11.470546+0000","last_undegraded":"2024-09-14T11:52:11.470546+0000","last_fullsized":"2024-09-14T11:52:11.470546+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":500,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:02.226766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3034,"num_read_kb":2795,"num_write":758,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"264'213","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:43.283335+0000","last_change":"2024-09-14T11:09:45.204285+0000","last_active":"2024-09-14T11:51:43.283335+0000","last_peered":"2024-09-14T11:51:43.283335+0000","last_clean":"2024-09-14T11:51:43.283335+0000","last_became_active":"2024-09-14T11:09:45.204030+0000","last_became_peered":"2024-09-14T11:09:45.204030+0000","last_unstale":"2024-09-14T11:51:43.283335+0000","last_undegraded":"2024-09-14T11:51:43.283335+0000","last_fullsized":"2024-09-14T11:51:43.283335+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:18.332566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1706918,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":525,"num_read_kb":23907,"num_write":1073,"num_write_kb":37253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"264'520","reported_seq":2130,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:03.265916+0000","last_change":"2024-09-14T11:09:46.971107+0000","last_active":"2024-09-14T11:52:03.265916+0000","last_peered":"2024-09-14T11:52:03.265916+0000","last_clean":"2024-09-14T11:52:03.265916+0000","last_became_active":"2024-09-14T11:09:46.970750+0000","last_became_peered":"2024-09-14T11:09:46.970750+0000","last_unstale":"2024-09-14T11:52:03.265916+0000","last_undegraded":"2024-09-14T11:52:03.265916+0000","last_fullsized":"2024-09-14T11:52:03.265916+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:57.060428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2805,"num_read_kb":2599,"num_write":647,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"264'214","reported_seq":852,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:06.053261+0000","last_change":"2024-09-14T11:09:45.207509+0000","last_active":"2024-09-14T11:52:06.053261+0000","last_peered":"2024-09-14T11:52:06.053261+0000","last_clean":"2024-09-14T11:52:06.053261+0000","last_became_active":"2024-09-14T11:09:45.206812+0000","last_became_peered":"2024-09-14T11:09:45.206812+0000","last_unstale":"2024-09-14T11:52:06.053261+0000","last_undegraded":"2024-09-14T11:52:06.053261+0000","last_fullsized":"2024-09-14T11:52:06.053261+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:33.731635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6941833,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":561,"num_read_kb":32523,"num_write":991,"num_write_kb":41963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"264'850","reported_seq":2574,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.110359+0000","last_change":"2024-09-14T11:09:46.975448+0000","last_active":"2024-09-14T11:51:53.110359+0000","last_peered":"2024-09-14T11:51:53.110359+0000","last_clean":"2024-09-14T11:51:53.110359+0000","last_became_active":"2024-09-14T11:09:46.975135+0000","last_became_peered":"2024-09-14T11:09:46.975135+0000","last_unstale":"2024-09-14T11:51:53.110359+0000","last_undegraded":"2024-09-14T11:51:53.110359+0000","last_fullsized":"2024-09-14T11:51:53.110359+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":800,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:04.676118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4353,"num_read_kb":3966,"num_write":1152,"num_write_kb":464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"264'176","reported_seq":776,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:38.919195+0000","last_change":"2024-09-14T11:09:45.213110+0000","last_active":"2024-09-14T11:53:38.919195+0000","last_peered":"2024-09-14T11:53:38.919195+0000","last_clean":"2024-09-14T11:53:38.919195+0000","last_became_active":"2024-09-14T11:09:45.208314+0000","last_became_peered":"2024-09-14T11:09:45.208314+0000","last_unstale":"2024-09-14T11:53:38.919195+0000","last_undegraded":"2024-09-14T11:53:38.919195+0000","last_fullsized":"2024-09-14T11:53:38.919195+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:20.110568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5282222,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":411,"num_read_kb":7778,"num_write":835,"num_write_kb":25761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"264'900","reported_seq":2658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:02.153104+0000","last_change":"2024-09-14T11:09:46.995957+0000","last_active":"2024-09-14T11:52:02.153104+0000","last_peered":"2024-09-14T11:52:02.153104+0000","last_clean":"2024-09-14T11:52:02.153104+0000","last_became_active":"2024-09-14T11:09:46.995182+0000","last_became_peered":"2024-09-14T11:09:46.995182+0000","last_unstale":"2024-09-14T11:52:02.153104+0000","last_undegraded":"2024-09-14T11:52:02.153104+0000","last_fullsized":"2024-09-14T11:52:02.153104+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":800,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:35.861209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4411,"num_read_kb":3995,"num_write":1182,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"264'208","reported_seq":800,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.726835+0000","last_change":"2024-09-14T11:09:45.220362+0000","last_active":"2024-09-14T11:51:07.726835+0000","last_peered":"2024-09-14T11:51:07.726835+0000","last_clean":"2024-09-14T11:51:07.726835+0000","last_became_active":"2024-09-14T11:09:45.215301+0000","last_became_peered":"2024-09-14T11:09:45.215301+0000","last_unstale":"2024-09-14T11:51:07.726835+0000","last_undegraded":"2024-09-14T11:51:07.726835+0000","last_fullsized":"2024-09-14T11:51:07.726835+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:10.063540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388638,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":443,"num_read_kb":16967,"num_write":895,"num_write_kb":40194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"264'431","reported_seq":1974,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.766412+0000","last_change":"2024-09-14T11:09:46.975235+0000","last_active":"2024-09-14T11:52:12.766412+0000","last_peered":"2024-09-14T11:52:12.766412+0000","last_clean":"2024-09-14T11:52:12.766412+0000","last_became_active":"2024-09-14T11:09:46.974465+0000","last_became_peered":"2024-09-14T11:09:46.974465+0000","last_unstale":"2024-09-14T11:52:12.766412+0000","last_undegraded":"2024-09-14T11:52:12.766412+0000","last_fullsized":"2024-09-14T11:52:12.766412+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:52.589199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2378,"num_read_kb":2237,"num_write":500,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"264'219","reported_seq":880,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:06.796955+0000","last_change":"2024-09-14T11:09:45.211590+0000","last_active":"2024-09-14T11:52:06.796955+0000","last_peered":"2024-09-14T11:52:06.796955+0000","last_clean":"2024-09-14T11:52:06.796955+0000","last_became_active":"2024-09-14T11:09:45.210875+0000","last_became_peered":"2024-09-14T11:09:45.210875+0000","last_unstale":"2024-09-14T11:52:06.796955+0000","last_undegraded":"2024-09-14T11:52:06.796955+0000","last_fullsized":"2024-09-14T11:52:06.796955+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:21.188914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12954907,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":583,"num_read_kb":73873,"num_write":1083,"num_write_kb":38947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"264'414","reported_seq":1942,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.988375+0000","last_change":"2024-09-14T11:09:46.959048+0000","last_active":"2024-09-14T11:52:09.988375+0000","last_peered":"2024-09-14T11:52:09.988375+0000","last_clean":"2024-09-14T11:52:09.988375+0000","last_became_active":"2024-09-14T11:09:46.958694+0000","last_became_peered":"2024-09-14T11:09:46.958694+0000","last_unstale":"2024-09-14T11:52:09.988375+0000","last_undegraded":"2024-09-14T11:52:09.988375+0000","last_fullsized":"2024-09-14T11:52:09.988375+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:35.009340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2265,"num_read_kb":2144,"num_write":479,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"264'195","reported_seq":819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:27.099041+0000","last_change":"2024-09-14T11:09:45.221734+0000","last_active":"2024-09-14T11:52:27.099041+0000","last_peered":"2024-09-14T11:52:27.099041+0000","last_clean":"2024-09-14T11:52:27.099041+0000","last_became_active":"2024-09-14T11:09:45.220968+0000","last_became_peered":"2024-09-14T11:09:45.220968+0000","last_unstale":"2024-09-14T11:52:27.099041+0000","last_undegraded":"2024-09-14T11:52:27.099041+0000","last_fullsized":"2024-09-14T11:52:27.099041+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:09.918507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5574302,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":530,"num_read_kb":44269,"num_write":996,"num_write_kb":27179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"264'134","reported_seq":639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.738672+0000","last_change":"2024-09-14T11:09:55.027528+0000","last_active":"2024-09-14T11:52:29.738672+0000","last_peered":"2024-09-14T11:52:29.738672+0000","last_clean":"2024-09-14T11:52:29.738672+0000","last_became_active":"2024-09-14T11:09:55.026753+0000","last_became_peered":"2024-09-14T11:09:55.026753+0000","last_unstale":"2024-09-14T11:52:29.738672+0000","last_undegraded":"2024-09-14T11:52:29.738672+0000","last_fullsized":"2024-09-14T11:52:29.738672+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:49.050538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":178,"num_read_kb":167,"num_write":319,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"264'372","reported_seq":1902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:00.697892+0000","last_change":"2024-09-14T11:09:46.985537+0000","last_active":"2024-09-14T11:52:00.697892+0000","last_peered":"2024-09-14T11:52:00.697892+0000","last_clean":"2024-09-14T11:52:00.697892+0000","last_became_active":"2024-09-14T11:09:46.985016+0000","last_became_peered":"2024-09-14T11:09:46.985016+0000","last_unstale":"2024-09-14T11:52:00.697892+0000","last_undegraded":"2024-09-14T11:52:00.697892+0000","last_fullsized":"2024-09-14T11:52:00.697892+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:37.173683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2187,"num_read_kb":2090,"num_write":422,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"264'238","reported_seq":880,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:38.924555+0000","last_change":"2024-09-14T11:09:45.209122+0000","last_active":"2024-09-14T11:51:38.924555+0000","last_peered":"2024-09-14T11:51:38.924555+0000","last_clean":"2024-09-14T11:51:38.924555+0000","last_became_active":"2024-09-14T11:09:45.208756+0000","last_became_peered":"2024-09-14T11:09:45.208756+0000","last_unstale":"2024-09-14T11:51:38.924555+0000","last_undegraded":"2024-09-14T11:51:38.924555+0000","last_fullsized":"2024-09-14T11:51:38.924555+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:05.011185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13693930,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":592,"num_read_kb":30329,"num_write":1156,"num_write_kb":41189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:54.318570+0000","last_change":"2024-09-14T11:09:48.970253+0000","last_active":"2024-09-14T11:50:54.318570+0000","last_peered":"2024-09-14T11:50:54.318570+0000","last_clean":"2024-09-14T11:50:54.318570+0000","last_became_active":"2024-09-14T11:09:48.969807+0000","last_became_peered":"2024-09-14T11:09:48.969807+0000","last_unstale":"2024-09-14T11:50:54.318570+0000","last_undegraded":"2024-09-14T11:50:54.318570+0000","last_fullsized":"2024-09-14T11:50:54.318570+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:20.729118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"264'192","reported_seq":788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:23.152637+0000","last_change":"2024-09-14T11:09:50.989686+0000","last_active":"2024-09-14T11:53:23.152637+0000","last_peered":"2024-09-14T11:53:23.152637+0000","last_clean":"2024-09-14T11:53:23.152637+0000","last_became_active":"2024-09-14T11:09:50.988903+0000","last_became_peered":"2024-09-14T11:09:50.988903+0000","last_unstale":"2024-09-14T11:53:23.152637+0000","last_undegraded":"2024-09-14T11:53:23.152637+0000","last_fullsized":"2024-09-14T11:53:23.152637+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:40.383215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25048,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":260,"num_read_kb":342,"num_write":158,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.271486+0000","last_change":"2024-09-14T11:09:53.012712+0000","last_active":"2024-09-14T11:50:58.271486+0000","last_peered":"2024-09-14T11:50:58.271486+0000","last_clean":"2024-09-14T11:50:58.271486+0000","last_became_active":"2024-09-14T11:09:53.010617+0000","last_became_peered":"2024-09-14T11:09:53.010617+0000","last_unstale":"2024-09-14T11:50:58.271486+0000","last_undegraded":"2024-09-14T11:50:58.271486+0000","last_fullsized":"2024-09-14T11:50:58.271486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:10.722614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"264'139","reported_seq":635,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:57.272034+0000","last_change":"2024-09-14T11:09:55.023108+0000","last_active":"2024-09-14T11:51:57.272034+0000","last_peered":"2024-09-14T11:51:57.272034+0000","last_clean":"2024-09-14T11:51:57.272034+0000","last_became_active":"2024-09-14T11:09:55.020070+0000","last_became_peered":"2024-09-14T11:09:55.020070+0000","last_unstale":"2024-09-14T11:51:57.272034+0000","last_undegraded":"2024-09-14T11:51:57.272034+0000","last_fullsized":"2024-09-14T11:51:57.272034+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:06.571541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":142,"num_write":346,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"264'927","reported_seq":2709,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.646957+0000","last_change":"2024-09-14T11:09:46.960339+0000","last_active":"2024-09-14T11:52:29.646957+0000","last_peered":"2024-09-14T11:52:29.646957+0000","last_clean":"2024-09-14T11:52:29.646957+0000","last_became_active":"2024-09-14T11:09:46.957383+0000","last_became_peered":"2024-09-14T11:09:46.957383+0000","last_unstale":"2024-09-14T11:52:29.646957+0000","last_undegraded":"2024-09-14T11:52:29.646957+0000","last_fullsized":"2024-09-14T11:52:29.646957+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:50.357529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4732,"num_read_kb":4281,"num_write":1231,"num_write_kb":469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"264'201","reported_seq":848,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:39.566556+0000","last_change":"2024-09-14T11:09:45.225975+0000","last_active":"2024-09-14T11:51:39.566556+0000","last_peered":"2024-09-14T11:51:39.566556+0000","last_clean":"2024-09-14T11:51:39.566556+0000","last_became_active":"2024-09-14T11:09:45.220059+0000","last_became_peered":"2024-09-14T11:09:45.220059+0000","last_unstale":"2024-09-14T11:51:39.566556+0000","last_undegraded":"2024-09-14T11:51:39.566556+0000","last_fullsized":"2024-09-14T11:51:39.566556+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:05.527234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6898712,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":631,"num_read_kb":15714,"num_write":932,"num_write_kb":28935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:33.101046+0000","last_change":"2024-09-14T11:09:48.950741+0000","last_active":"2024-09-14T11:49:33.101046+0000","last_peered":"2024-09-14T11:49:33.101046+0000","last_clean":"2024-09-14T11:49:33.101046+0000","last_became_active":"2024-09-14T11:09:48.950055+0000","last_became_peered":"2024-09-14T11:09:48.950055+0000","last_unstale":"2024-09-14T11:49:33.101046+0000","last_undegraded":"2024-09-14T11:49:33.101046+0000","last_fullsized":"2024-09-14T11:49:33.101046+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:57.249708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"264'83","reported_seq":604,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.188762+0000","last_change":"2024-09-14T11:09:50.989886+0000","last_active":"2024-09-14T11:52:12.188762+0000","last_peered":"2024-09-14T11:52:12.188762+0000","last_clean":"2024-09-14T11:52:12.188762+0000","last_became_active":"2024-09-14T11:09:50.989174+0000","last_became_peered":"2024-09-14T11:09:50.989174+0000","last_unstale":"2024-09-14T11:52:12.188762+0000","last_undegraded":"2024-09-14T11:52:12.188762+0000","last_fullsized":"2024-09-14T11:52:12.188762+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:37.575700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":97,"num_read_kb":91,"num_write":68,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.271407+0000","last_change":"2024-09-14T11:09:53.019238+0000","last_active":"2024-09-14T11:50:58.271407+0000","last_peered":"2024-09-14T11:50:58.271407+0000","last_clean":"2024-09-14T11:50:58.271407+0000","last_became_active":"2024-09-14T11:09:53.018290+0000","last_became_peered":"2024-09-14T11:09:53.018290+0000","last_unstale":"2024-09-14T11:50:58.271407+0000","last_undegraded":"2024-09-14T11:50:58.271407+0000","last_fullsized":"2024-09-14T11:50:58.271407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:48.018030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"264'93","reported_seq":588,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:08.416231+0000","last_change":"2024-09-14T11:09:55.019556+0000","last_active":"2024-09-14T11:52:08.416231+0000","last_peered":"2024-09-14T11:52:08.416231+0000","last_clean":"2024-09-14T11:52:08.416231+0000","last_became_active":"2024-09-14T11:09:55.018855+0000","last_became_peered":"2024-09-14T11:09:55.018855+0000","last_unstale":"2024-09-14T11:52:08.416231+0000","last_undegraded":"2024-09-14T11:52:08.416231+0000","last_fullsized":"2024-09-14T11:52:08.416231+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:52.671096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":100,"num_read_kb":99,"num_write":210,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"264'508","reported_seq":2252,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:10.847271+0000","last_change":"2024-09-14T11:09:46.987477+0000","last_active":"2024-09-14T11:52:10.847271+0000","last_peered":"2024-09-14T11:52:10.847271+0000","last_clean":"2024-09-14T11:52:10.847271+0000","last_became_active":"2024-09-14T11:09:46.975175+0000","last_became_peered":"2024-09-14T11:09:46.975175+0000","last_unstale":"2024-09-14T11:52:10.847271+0000","last_undegraded":"2024-09-14T11:52:10.847271+0000","last_fullsized":"2024-09-14T11:52:10.847271+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:10.227238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2885,"num_read_kb":2717,"num_write":615,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"264'235","reported_seq":851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:05.090009+0000","last_change":"2024-09-14T11:09:45.205362+0000","last_active":"2024-09-14T11:51:05.090009+0000","last_peered":"2024-09-14T11:51:05.090009+0000","last_clean":"2024-09-14T11:51:05.090009+0000","last_became_active":"2024-09-14T11:09:45.205019+0000","last_became_peered":"2024-09-14T11:09:45.205019+0000","last_unstale":"2024-09-14T11:51:05.090009+0000","last_undegraded":"2024-09-14T11:51:05.090009+0000","last_fullsized":"2024-09-14T11:51:05.090009+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:50.482486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4202036,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":561,"num_read_kb":1571,"num_write":1127,"num_write_kb":22204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.118825+0000","last_change":"2024-09-14T11:09:48.951014+0000","last_active":"2024-09-14T11:50:53.118825+0000","last_peered":"2024-09-14T11:50:53.118825+0000","last_clean":"2024-09-14T11:50:53.118825+0000","last_became_active":"2024-09-14T11:09:48.950260+0000","last_became_peered":"2024-09-14T11:09:48.950260+0000","last_unstale":"2024-09-14T11:50:53.118825+0000","last_undegraded":"2024-09-14T11:50:53.118825+0000","last_fullsized":"2024-09-14T11:50:53.118825+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:26.673899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"264'107","reported_seq":639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:54.342568+0000","last_change":"2024-09-14T11:09:50.978554+0000","last_active":"2024-09-14T11:51:54.342568+0000","last_peered":"2024-09-14T11:51:54.342568+0000","last_clean":"2024-09-14T11:51:54.342568+0000","last_became_active":"2024-09-14T11:09:50.977685+0000","last_became_peered":"2024-09-14T11:09:50.977685+0000","last_unstale":"2024-09-14T11:51:54.342568+0000","last_undegraded":"2024-09-14T11:51:54.342568+0000","last_fullsized":"2024-09-14T11:51:54.342568+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:18:08.590005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"264'786","reported_seq":2365,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.073795+0000","last_change":"2024-09-14T11:09:53.022562+0000","last_active":"2024-09-14T11:53:44.073795+0000","last_peered":"2024-09-14T11:53:44.073795+0000","last_clean":"2024-09-14T11:53:44.073795+0000","last_became_active":"2024-09-14T11:09:53.021212+0000","last_became_peered":"2024-09-14T11:09:53.021212+0000","last_unstale":"2024-09-14T11:53:44.073795+0000","last_undegraded":"2024-09-14T11:53:44.073795+0000","last_fullsized":"2024-09-14T11:53:44.073795+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:48.852973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"264'221","reported_seq":1056,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.124563+0000","last_change":"2024-09-14T11:09:55.014805+0000","last_active":"2024-09-14T11:52:29.124563+0000","last_peered":"2024-09-14T11:52:29.124563+0000","last_clean":"2024-09-14T11:52:29.124563+0000","last_became_active":"2024-09-14T11:09:55.013994+0000","last_became_peered":"2024-09-14T11:09:55.013994+0000","last_unstale":"2024-09-14T11:52:29.124563+0000","last_undegraded":"2024-09-14T11:52:29.124563+0000","last_fullsized":"2024-09-14T11:52:29.124563+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:49.818762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":446,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":657,"num_read_kb":640,"num_write":481,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"264'1912","reported_seq":3548,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.647332+0000","last_change":"2024-09-14T11:09:46.996404+0000","last_active":"2024-09-14T11:52:29.647332+0000","last_peered":"2024-09-14T11:52:29.647332+0000","last_clean":"2024-09-14T11:52:29.647332+0000","last_became_active":"2024-09-14T11:09:46.994623+0000","last_became_peered":"2024-09-14T11:09:46.994623+0000","last_unstale":"2024-09-14T11:52:29.647332+0000","last_undegraded":"2024-09-14T11:52:29.647332+0000","last_fullsized":"2024-09-14T11:52:29.647332+0000","mapping_epoch":25,"log_start":"264'1900","ondisk_log_start":"264'1900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":1900,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:51.392243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8495,"num_read_kb":7411,"num_write":2703,"num_write_kb":1197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"264'206","reported_seq":835,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:23.988653+0000","last_change":"2024-09-14T11:09:45.208803+0000","last_active":"2024-09-14T11:52:23.988653+0000","last_peered":"2024-09-14T11:52:23.988653+0000","last_clean":"2024-09-14T11:52:23.988653+0000","last_became_active":"2024-09-14T11:09:45.208282+0000","last_became_peered":"2024-09-14T11:09:45.208282+0000","last_unstale":"2024-09-14T11:52:23.988653+0000","last_undegraded":"2024-09-14T11:52:23.988653+0000","last_fullsized":"2024-09-14T11:52:23.988653+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:23.782528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12039070,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":514,"num_read_kb":14610,"num_write":969,"num_write_kb":27594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:54.318600+0000","last_change":"2024-09-14T11:09:48.959777+0000","last_active":"2024-09-14T11:50:54.318600+0000","last_peered":"2024-09-14T11:50:54.318600+0000","last_clean":"2024-09-14T11:50:54.318600+0000","last_became_active":"2024-09-14T11:09:48.959355+0000","last_became_peered":"2024-09-14T11:09:48.959355+0000","last_unstale":"2024-09-14T11:50:54.318600+0000","last_undegraded":"2024-09-14T11:50:54.318600+0000","last_fullsized":"2024-09-14T11:50:54.318600+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:29.593248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"264'117","reported_seq":682,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.135145+0000","last_change":"2024-09-14T11:09:50.984714+0000","last_active":"2024-09-14T11:53:24.135145+0000","last_peered":"2024-09-14T11:53:24.135145+0000","last_clean":"2024-09-14T11:53:24.135145+0000","last_became_active":"2024-09-14T11:09:50.984035+0000","last_became_peered":"2024-09-14T11:09:50.984035+0000","last_unstale":"2024-09-14T11:53:24.135145+0000","last_undegraded":"2024-09-14T11:53:24.135145+0000","last_fullsized":"2024-09-14T11:53:24.135145+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:31.803088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13272,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":211,"num_write":78,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"264'799","reported_seq":2128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.082670+0000","last_change":"2024-09-14T11:09:53.006772+0000","last_active":"2024-09-14T11:53:44.082670+0000","last_peered":"2024-09-14T11:53:44.082670+0000","last_clean":"2024-09-14T11:53:44.082670+0000","last_became_active":"2024-09-14T11:09:53.004265+0000","last_became_peered":"2024-09-14T11:09:53.004265+0000","last_unstale":"2024-09-14T11:53:44.082670+0000","last_undegraded":"2024-09-14T11:53:44.082670+0000","last_fullsized":"2024-09-14T11:53:44.082670+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:25.054903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"264'520","reported_seq":2229,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.108065+0000","last_change":"2024-09-14T11:09:46.963218+0000","last_active":"2024-09-14T11:53:43.108065+0000","last_peered":"2024-09-14T11:53:43.108065+0000","last_clean":"2024-09-14T11:53:43.108065+0000","last_became_active":"2024-09-14T11:09:46.962838+0000","last_became_peered":"2024-09-14T11:09:46.962838+0000","last_unstale":"2024-09-14T11:53:43.108065+0000","last_undegraded":"2024-09-14T11:53:43.108065+0000","last_fullsized":"2024-09-14T11:53:43.108065+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:16.557469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2791,"num_read_kb":2616,"num_write":587,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"264'269","reported_seq":931,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.885107+0000","last_change":"2024-09-14T11:09:45.219933+0000","last_active":"2024-09-14T11:52:09.885107+0000","last_peered":"2024-09-14T11:52:09.885107+0000","last_clean":"2024-09-14T11:52:09.885107+0000","last_became_active":"2024-09-14T11:09:45.219674+0000","last_became_peered":"2024-09-14T11:09:45.219674+0000","last_unstale":"2024-09-14T11:52:09.885107+0000","last_undegraded":"2024-09-14T11:52:09.885107+0000","last_fullsized":"2024-09-14T11:52:09.885107+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:05.295609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11390083,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":692,"num_read_kb":41266,"num_write":1211,"num_write_kb":49932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.271280+0000","last_change":"2024-09-14T11:09:48.958749+0000","last_active":"2024-09-14T11:50:58.271280+0000","last_peered":"2024-09-14T11:50:58.271280+0000","last_clean":"2024-09-14T11:50:58.271280+0000","last_became_active":"2024-09-14T11:09:48.958254+0000","last_became_peered":"2024-09-14T11:09:48.958254+0000","last_unstale":"2024-09-14T11:50:58.271280+0000","last_undegraded":"2024-09-14T11:50:58.271280+0000","last_fullsized":"2024-09-14T11:50:58.271280+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:42.595913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"264'188","reported_seq":788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:18.316228+0000","last_change":"2024-09-14T11:09:50.993372+0000","last_active":"2024-09-14T11:53:18.316228+0000","last_peered":"2024-09-14T11:53:18.316228+0000","last_clean":"2024-09-14T11:53:18.316228+0000","last_became_active":"2024-09-14T11:09:50.992673+0000","last_became_peered":"2024-09-14T11:09:50.992673+0000","last_unstale":"2024-09-14T11:53:18.316228+0000","last_undegraded":"2024-09-14T11:53:18.316228+0000","last_fullsized":"2024-09-14T11:53:18.316228+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:50.616252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11616,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":264,"num_read_kb":310,"num_write":150,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:23.114246+0000","last_change":"2024-09-14T11:09:53.008438+0000","last_active":"2024-09-14T11:50:23.114246+0000","last_peered":"2024-09-14T11:50:23.114246+0000","last_clean":"2024-09-14T11:50:23.114246+0000","last_became_active":"2024-09-14T11:09:53.007694+0000","last_became_peered":"2024-09-14T11:09:53.007694+0000","last_unstale":"2024-09-14T11:50:23.114246+0000","last_undegraded":"2024-09-14T11:50:23.114246+0000","last_fullsized":"2024-09-14T11:50:23.114246+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:56.147296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"264'565","reported_seq":1399,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.058548+0000","last_change":"2024-09-14T11:09:55.031185+0000","last_active":"2024-09-14T11:53:44.058548+0000","last_peered":"2024-09-14T11:53:44.058548+0000","last_clean":"2024-09-14T11:53:44.058548+0000","last_became_active":"2024-09-14T11:09:55.030659+0000","last_became_peered":"2024-09-14T11:09:55.030659+0000","last_unstale":"2024-09-14T11:53:44.058548+0000","last_undegraded":"2024-09-14T11:53:44.058548+0000","last_fullsized":"2024-09-14T11:53:44.058548+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:47.236046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1371,"num_read_kb":1346,"num_write":1205,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"264'1071","reported_seq":2641,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.646289+0000","last_change":"2024-09-14T11:09:46.990492+0000","last_active":"2024-09-14T11:52:29.646289+0000","last_peered":"2024-09-14T11:52:29.646289+0000","last_clean":"2024-09-14T11:52:29.646289+0000","last_became_active":"2024-09-14T11:09:46.990046+0000","last_became_peered":"2024-09-14T11:09:46.990046+0000","last_unstale":"2024-09-14T11:52:29.646289+0000","last_undegraded":"2024-09-14T11:52:29.646289+0000","last_fullsized":"2024-09-14T11:52:29.646289+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":1000,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:03.248978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5673,"num_read_kb":5118,"num_write":1579,"num_write_kb":694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"264'258","reported_seq":955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:42.758281+0000","last_change":"2024-09-14T11:09:45.211546+0000","last_active":"2024-09-14T11:51:42.758281+0000","last_peered":"2024-09-14T11:51:42.758281+0000","last_clean":"2024-09-14T11:51:42.758281+0000","last_became_active":"2024-09-14T11:09:45.210020+0000","last_became_peered":"2024-09-14T11:09:45.210020+0000","last_unstale":"2024-09-14T11:51:42.758281+0000","last_undegraded":"2024-09-14T11:51:42.758281+0000","last_fullsized":"2024-09-14T11:51:42.758281+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:40.715640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8411325,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":883,"num_read_kb":725,"num_write":1126,"num_write_kb":36716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.121796+0000","last_change":"2024-09-14T11:09:48.974766+0000","last_active":"2024-09-14T11:50:58.121796+0000","last_peered":"2024-09-14T11:50:58.121796+0000","last_clean":"2024-09-14T11:50:58.121796+0000","last_became_active":"2024-09-14T11:09:48.973945+0000","last_became_peered":"2024-09-14T11:09:48.973945+0000","last_unstale":"2024-09-14T11:50:58.121796+0000","last_undegraded":"2024-09-14T11:50:58.121796+0000","last_fullsized":"2024-09-14T11:50:58.121796+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:44.397689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"264'138","reported_seq":701,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:38.142497+0000","last_change":"2024-09-14T11:09:50.986632+0000","last_active":"2024-09-14T11:52:38.142497+0000","last_peered":"2024-09-14T11:52:38.142497+0000","last_clean":"2024-09-14T11:52:38.142497+0000","last_became_active":"2024-09-14T11:09:50.985800+0000","last_became_peered":"2024-09-14T11:09:50.985800+0000","last_unstale":"2024-09-14T11:52:38.142497+0000","last_undegraded":"2024-09-14T11:52:38.142497+0000","last_fullsized":"2024-09-14T11:52:38.142497+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:10:20.302521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17223,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":164,"num_read_kb":249,"num_write":92,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.122118+0000","last_change":"2024-09-14T11:09:53.003609+0000","last_active":"2024-09-14T11:51:08.122118+0000","last_peered":"2024-09-14T11:51:08.122118+0000","last_clean":"2024-09-14T11:51:08.122118+0000","last_became_active":"2024-09-14T11:09:53.002739+0000","last_became_peered":"2024-09-14T11:09:53.002739+0000","last_unstale":"2024-09-14T11:51:08.122118+0000","last_undegraded":"2024-09-14T11:51:08.122118+0000","last_fullsized":"2024-09-14T11:51:08.122118+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:34.134964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"264'2501","reported_seq":4368,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:33.422769+0000","last_change":"2024-09-14T11:09:55.020086+0000","last_active":"2024-09-14T11:53:33.422769+0000","last_peered":"2024-09-14T11:53:33.422769+0000","last_clean":"2024-09-14T11:53:33.422769+0000","last_became_active":"2024-09-14T11:09:55.017307+0000","last_became_peered":"2024-09-14T11:09:55.017307+0000","last_unstale":"2024-09-14T11:53:33.422769+0000","last_undegraded":"2024-09-14T11:53:33.422769+0000","last_fullsized":"2024-09-14T11:53:33.422769+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":2400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:26.762655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6356,"num_read_kb":6314,"num_write":5042,"num_write_kb":1853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"264'347","reported_seq":1756,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:03.283453+0000","last_change":"2024-09-14T11:09:46.953211+0000","last_active":"2024-09-14T11:52:03.283453+0000","last_peered":"2024-09-14T11:52:03.283453+0000","last_clean":"2024-09-14T11:52:03.283453+0000","last_became_active":"2024-09-14T11:09:46.952951+0000","last_became_peered":"2024-09-14T11:09:46.952951+0000","last_unstale":"2024-09-14T11:52:03.283453+0000","last_undegraded":"2024-09-14T11:52:03.283453+0000","last_fullsized":"2024-09-14T11:52:03.283453+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:11.659997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1860,"num_read_kb":1783,"num_write":380,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"264'219","reported_seq":855,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:05.334018+0000","last_change":"2024-09-14T11:09:45.211474+0000","last_active":"2024-09-14T11:52:05.334018+0000","last_peered":"2024-09-14T11:52:05.334018+0000","last_clean":"2024-09-14T11:52:05.334018+0000","last_became_active":"2024-09-14T11:09:45.211217+0000","last_became_peered":"2024-09-14T11:09:45.211217+0000","last_unstale":"2024-09-14T11:52:05.334018+0000","last_undegraded":"2024-09-14T11:52:05.334018+0000","last_fullsized":"2024-09-14T11:52:05.334018+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:46.779002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4541653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":596,"num_read_kb":7544,"num_write":1090,"num_write_kb":12612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.116225+0000","last_change":"2024-09-14T11:09:48.957986+0000","last_active":"2024-09-14T11:50:18.116225+0000","last_peered":"2024-09-14T11:50:18.116225+0000","last_clean":"2024-09-14T11:50:18.116225+0000","last_became_active":"2024-09-14T11:09:48.957275+0000","last_became_peered":"2024-09-14T11:09:48.957275+0000","last_unstale":"2024-09-14T11:50:18.116225+0000","last_undegraded":"2024-09-14T11:50:18.116225+0000","last_fullsized":"2024-09-14T11:50:18.116225+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:40.815434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"264'166","reported_seq":741,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.355017+0000","last_change":"2024-09-14T11:09:51.000566+0000","last_active":"2024-09-14T11:53:14.355017+0000","last_peered":"2024-09-14T11:53:14.355017+0000","last_clean":"2024-09-14T11:53:14.355017+0000","last_became_active":"2024-09-14T11:09:50.999759+0000","last_became_peered":"2024-09-14T11:09:50.999759+0000","last_unstale":"2024-09-14T11:53:14.355017+0000","last_undegraded":"2024-09-14T11:53:14.355017+0000","last_fullsized":"2024-09-14T11:53:14.355017+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:34.933664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11621,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":207,"num_read_kb":243,"num_write":122,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"264'799","reported_seq":2347,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.085022+0000","last_change":"2024-09-14T11:09:53.003439+0000","last_active":"2024-09-14T11:53:44.085022+0000","last_peered":"2024-09-14T11:53:44.085022+0000","last_clean":"2024-09-14T11:53:44.085022+0000","last_became_active":"2024-09-14T11:09:53.002667+0000","last_became_peered":"2024-09-14T11:09:53.002667+0000","last_unstale":"2024-09-14T11:53:44.085022+0000","last_undegraded":"2024-09-14T11:53:44.085022+0000","last_fullsized":"2024-09-14T11:53:44.085022+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:44.486567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"264'125","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.024032+0000","last_change":"2024-09-14T11:09:55.017516+0000","last_active":"2024-09-14T11:53:43.024032+0000","last_peered":"2024-09-14T11:53:43.024032+0000","last_clean":"2024-09-14T11:53:43.024032+0000","last_became_active":"2024-09-14T11:09:55.016802+0000","last_became_peered":"2024-09-14T11:09:55.016802+0000","last_unstale":"2024-09-14T11:53:43.024032+0000","last_undegraded":"2024-09-14T11:53:43.024032+0000","last_fullsized":"2024-09-14T11:53:43.024032+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:17.432120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":820,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":114,"num_write":311,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"264'746","reported_seq":2274,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.185022+0000","last_change":"2024-09-14T11:09:46.990182+0000","last_active":"2024-09-14T11:52:12.185022+0000","last_peered":"2024-09-14T11:52:12.185022+0000","last_clean":"2024-09-14T11:52:12.185022+0000","last_became_active":"2024-09-14T11:09:46.987523+0000","last_became_peered":"2024-09-14T11:09:46.987523+0000","last_unstale":"2024-09-14T11:52:12.185022+0000","last_undegraded":"2024-09-14T11:52:12.185022+0000","last_fullsized":"2024-09-14T11:52:12.185022+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":700,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:03.328090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3699,"num_read_kb":3347,"num_write":991,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"264'225","reported_seq":876,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:10.749350+0000","last_change":"2024-09-14T11:09:45.219279+0000","last_active":"2024-09-14T11:52:10.749350+0000","last_peered":"2024-09-14T11:52:10.749350+0000","last_clean":"2024-09-14T11:52:10.749350+0000","last_became_active":"2024-09-14T11:09:45.213648+0000","last_became_peered":"2024-09-14T11:09:45.213648+0000","last_unstale":"2024-09-14T11:52:10.749350+0000","last_undegraded":"2024-09-14T11:52:10.749350+0000","last_fullsized":"2024-09-14T11:52:10.749350+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:46.955930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10291031,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":590,"num_read_kb":9438,"num_write":1103,"num_write_kb":42718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.124431+0000","last_change":"2024-09-14T11:09:48.965750+0000","last_active":"2024-09-14T11:51:08.124431+0000","last_peered":"2024-09-14T11:51:08.124431+0000","last_clean":"2024-09-14T11:51:08.124431+0000","last_became_active":"2024-09-14T11:09:48.965014+0000","last_became_peered":"2024-09-14T11:09:48.965014+0000","last_unstale":"2024-09-14T11:51:08.124431+0000","last_undegraded":"2024-09-14T11:51:08.124431+0000","last_fullsized":"2024-09-14T11:51:08.124431+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:17.069310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"264'192","reported_seq":812,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.986030+0000","last_change":"2024-09-14T11:09:50.989754+0000","last_active":"2024-09-14T11:53:43.986030+0000","last_peered":"2024-09-14T11:53:43.986030+0000","last_clean":"2024-09-14T11:53:43.986030+0000","last_became_active":"2024-09-14T11:09:50.988991+0000","last_became_peered":"2024-09-14T11:09:50.988991+0000","last_unstale":"2024-09-14T11:53:43.986030+0000","last_undegraded":"2024-09-14T11:53:43.986030+0000","last_fullsized":"2024-09-14T11:53:43.986030+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:49.153350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25183,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":269,"num_read_kb":404,"num_write":140,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.126208+0000","last_change":"2024-09-14T11:09:53.011570+0000","last_active":"2024-09-14T11:51:03.126208+0000","last_peered":"2024-09-14T11:51:03.126208+0000","last_clean":"2024-09-14T11:51:03.126208+0000","last_became_active":"2024-09-14T11:09:53.010817+0000","last_became_peered":"2024-09-14T11:09:53.010817+0000","last_unstale":"2024-09-14T11:51:03.126208+0000","last_undegraded":"2024-09-14T11:51:03.126208+0000","last_fullsized":"2024-09-14T11:51:03.126208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:43.873697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"264'117","reported_seq":613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.729606+0000","last_change":"2024-09-14T11:09:55.026555+0000","last_active":"2024-09-14T11:52:29.729606+0000","last_peered":"2024-09-14T11:52:29.729606+0000","last_clean":"2024-09-14T11:52:29.729606+0000","last_became_active":"2024-09-14T11:09:55.025490+0000","last_became_peered":"2024-09-14T11:09:55.025490+0000","last_unstale":"2024-09-14T11:52:29.729606+0000","last_undegraded":"2024-09-14T11:52:29.729606+0000","last_fullsized":"2024-09-14T11:52:29.729606+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:27.983692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":533,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":108,"num_write":255,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"264'475","reported_seq":2021,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.038564+0000","last_change":"2024-09-14T11:09:46.971174+0000","last_active":"2024-09-14T11:52:29.038564+0000","last_peered":"2024-09-14T11:52:29.038564+0000","last_clean":"2024-09-14T11:52:29.038564+0000","last_became_active":"2024-09-14T11:09:46.970824+0000","last_became_peered":"2024-09-14T11:09:46.970824+0000","last_unstale":"2024-09-14T11:52:29.038564+0000","last_undegraded":"2024-09-14T11:52:29.038564+0000","last_fullsized":"2024-09-14T11:52:29.038564+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:12.281927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2551,"num_read_kb":2376,"num_write":583,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"264'192","reported_seq":783,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:39.530023+0000","last_change":"2024-09-14T11:09:45.217112+0000","last_active":"2024-09-14T11:50:39.530023+0000","last_peered":"2024-09-14T11:50:39.530023+0000","last_clean":"2024-09-14T11:50:39.530023+0000","last_became_active":"2024-09-14T11:09:45.216305+0000","last_became_peered":"2024-09-14T11:09:45.216305+0000","last_unstale":"2024-09-14T11:50:39.530023+0000","last_undegraded":"2024-09-14T11:50:39.530023+0000","last_fullsized":"2024-09-14T11:50:39.530023+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:30.530616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1791178,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":429,"num_read_kb":2004,"num_write":915,"num_write_kb":29719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.290996+0000","last_change":"2024-09-14T11:09:48.969005+0000","last_active":"2024-09-14T11:50:18.290996+0000","last_peered":"2024-09-14T11:50:18.290996+0000","last_clean":"2024-09-14T11:50:18.290996+0000","last_became_active":"2024-09-14T11:09:48.968263+0000","last_became_peered":"2024-09-14T11:09:48.968263+0000","last_unstale":"2024-09-14T11:50:18.290996+0000","last_undegraded":"2024-09-14T11:50:18.290996+0000","last_fullsized":"2024-09-14T11:50:18.290996+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:06.145563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"264'142","reported_seq":709,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:38.292857+0000","last_change":"2024-09-14T11:09:50.998839+0000","last_active":"2024-09-14T11:52:38.292857+0000","last_peered":"2024-09-14T11:52:38.292857+0000","last_clean":"2024-09-14T11:52:38.292857+0000","last_became_active":"2024-09-14T11:09:50.998098+0000","last_became_peered":"2024-09-14T11:09:50.998098+0000","last_unstale":"2024-09-14T11:52:38.292857+0000","last_undegraded":"2024-09-14T11:52:38.292857+0000","last_fullsized":"2024-09-14T11:52:38.292857+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:51.979698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16755,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":206,"num_read_kb":271,"num_write":164,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:28.293305+0000","last_change":"2024-09-14T11:09:53.004485+0000","last_active":"2024-09-14T11:50:28.293305+0000","last_peered":"2024-09-14T11:50:28.293305+0000","last_clean":"2024-09-14T11:50:28.293305+0000","last_became_active":"2024-09-14T11:09:53.003759+0000","last_became_peered":"2024-09-14T11:09:53.003759+0000","last_unstale":"2024-09-14T11:50:28.293305+0000","last_undegraded":"2024-09-14T11:50:28.293305+0000","last_fullsized":"2024-09-14T11:50:28.293305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:37.578578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"264'125","reported_seq":611,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.978197+0000","last_change":"2024-09-14T11:09:55.034286+0000","last_active":"2024-09-14T11:52:09.978197+0000","last_peered":"2024-09-14T11:52:09.978197+0000","last_clean":"2024-09-14T11:52:09.978197+0000","last_became_active":"2024-09-14T11:09:55.033844+0000","last_became_peered":"2024-09-14T11:09:55.033844+0000","last_unstale":"2024-09-14T11:52:09.978197+0000","last_undegraded":"2024-09-14T11:52:09.978197+0000","last_fullsized":"2024-09-14T11:52:09.978197+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:07.504626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":100,"num_write":302,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"264'542","reported_seq":2213,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:27.203748+0000","last_change":"2024-09-14T11:09:46.961567+0000","last_active":"2024-09-14T11:52:27.203748+0000","last_peered":"2024-09-14T11:52:27.203748+0000","last_clean":"2024-09-14T11:52:27.203748+0000","last_became_active":"2024-09-14T11:09:46.961100+0000","last_became_peered":"2024-09-14T11:09:46.961100+0000","last_unstale":"2024-09-14T11:52:27.203748+0000","last_undegraded":"2024-09-14T11:52:27.203748+0000","last_fullsized":"2024-09-14T11:52:27.203748+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:01.729846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2788,"num_read_kb":2597,"num_write":616,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"264'216","reported_seq":828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:07.521658+0000","last_change":"2024-09-14T11:09:45.199153+0000","last_active":"2024-09-14T11:52:07.521658+0000","last_peered":"2024-09-14T11:52:07.521658+0000","last_clean":"2024-09-14T11:52:07.521658+0000","last_became_active":"2024-09-14T11:09:45.198569+0000","last_became_peered":"2024-09-14T11:09:45.198569+0000","last_unstale":"2024-09-14T11:52:07.521658+0000","last_undegraded":"2024-09-14T11:52:07.521658+0000","last_fullsized":"2024-09-14T11:52:07.521658+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:01.792464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12605563,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":582,"num_read_kb":15211,"num_write":897,"num_write_kb":32712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.116267+0000","last_change":"2024-09-14T11:09:48.953393+0000","last_active":"2024-09-14T11:50:18.116267+0000","last_peered":"2024-09-14T11:50:18.116267+0000","last_clean":"2024-09-14T11:50:18.116267+0000","last_became_active":"2024-09-14T11:09:48.952531+0000","last_became_peered":"2024-09-14T11:09:48.952531+0000","last_unstale":"2024-09-14T11:50:18.116267+0000","last_undegraded":"2024-09-14T11:50:18.116267+0000","last_fullsized":"2024-09-14T11:50:18.116267+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:01.263241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"264'154","reported_seq":730,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:43.149322+0000","last_change":"2024-09-14T11:09:50.976197+0000","last_active":"2024-09-14T11:52:43.149322+0000","last_peered":"2024-09-14T11:52:43.149322+0000","last_clean":"2024-09-14T11:52:43.149322+0000","last_became_active":"2024-09-14T11:09:50.975455+0000","last_became_peered":"2024-09-14T11:09:50.975455+0000","last_unstale":"2024-09-14T11:52:43.149322+0000","last_undegraded":"2024-09-14T11:52:43.149322+0000","last_fullsized":"2024-09-14T11:52:43.149322+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:53.261559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21253,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":210,"num_read_kb":302,"num_write":120,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"264'770","reported_seq":2360,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.076095+0000","last_change":"2024-09-14T11:09:53.014808+0000","last_active":"2024-09-14T11:53:44.076095+0000","last_peered":"2024-09-14T11:53:44.076095+0000","last_clean":"2024-09-14T11:53:44.076095+0000","last_became_active":"2024-09-14T11:09:53.013805+0000","last_became_peered":"2024-09-14T11:09:53.013805+0000","last_unstale":"2024-09-14T11:53:44.076095+0000","last_undegraded":"2024-09-14T11:53:44.076095+0000","last_fullsized":"2024-09-14T11:53:44.076095+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:29.501003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"264'151","reported_seq":656,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:27.197059+0000","last_change":"2024-09-14T11:09:55.027376+0000","last_active":"2024-09-14T11:52:27.197059+0000","last_peered":"2024-09-14T11:52:27.197059+0000","last_clean":"2024-09-14T11:52:27.197059+0000","last_became_active":"2024-09-14T11:09:55.026656+0000","last_became_peered":"2024-09-14T11:09:55.026656+0000","last_unstale":"2024-09-14T11:52:27.197059+0000","last_undegraded":"2024-09-14T11:52:27.197059+0000","last_fullsized":"2024-09-14T11:52:27.197059+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:05.576224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1884,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":197,"num_read_kb":178,"num_write":396,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"264'507","reported_seq":2081,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.766264+0000","last_change":"2024-09-14T11:09:46.950232+0000","last_active":"2024-09-14T11:52:12.766264+0000","last_peered":"2024-09-14T11:52:12.766264+0000","last_clean":"2024-09-14T11:52:12.766264+0000","last_became_active":"2024-09-14T11:09:46.949867+0000","last_became_peered":"2024-09-14T11:09:46.949867+0000","last_unstale":"2024-09-14T11:52:12.766264+0000","last_undegraded":"2024-09-14T11:52:12.766264+0000","last_fullsized":"2024-09-14T11:52:12.766264+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:05.177389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2605,"num_read_kb":2418,"num_write":602,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"264'269","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.606829+0000","last_change":"2024-09-14T11:09:45.208220+0000","last_active":"2024-09-14T11:51:53.606829+0000","last_peered":"2024-09-14T11:51:53.606829+0000","last_clean":"2024-09-14T11:51:53.606829+0000","last_became_active":"2024-09-14T11:09:45.207969+0000","last_became_peered":"2024-09-14T11:09:45.207969+0000","last_unstale":"2024-09-14T11:51:53.606829+0000","last_undegraded":"2024-09-14T11:51:53.606829+0000","last_fullsized":"2024-09-14T11:51:53.606829+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:49.056243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9444878,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":712,"num_read_kb":90988,"num_write":1208,"num_write_kb":64456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1451,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.926866+0000","last_change":"2024-09-14T11:09:48.963010+0000","last_active":"2024-09-14T11:53:43.926866+0000","last_peered":"2024-09-14T11:53:43.926866+0000","last_clean":"2024-09-14T11:53:43.926866+0000","last_became_active":"2024-09-14T11:09:48.961946+0000","last_became_peered":"2024-09-14T11:09:48.961946+0000","last_unstale":"2024-09-14T11:53:43.926866+0000","last_undegraded":"2024-09-14T11:53:43.926866+0000","last_fullsized":"2024-09-14T11:53:43.926866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:33.499961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":954,"num_read_kb":954,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"264'82","reported_seq":597,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:06.162254+0000","last_change":"2024-09-14T11:09:50.997985+0000","last_active":"2024-09-14T11:52:06.162254+0000","last_peered":"2024-09-14T11:52:06.162254+0000","last_clean":"2024-09-14T11:52:06.162254+0000","last_became_active":"2024-09-14T11:09:50.997281+0000","last_became_peered":"2024-09-14T11:09:50.997281+0000","last_unstale":"2024-09-14T11:52:06.162254+0000","last_undegraded":"2024-09-14T11:52:06.162254+0000","last_fullsized":"2024-09-14T11:52:06.162254+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:22.957216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"264'798","reported_seq":4458,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.077976+0000","last_change":"2024-09-14T11:09:53.012817+0000","last_active":"2024-09-14T11:53:44.077976+0000","last_peered":"2024-09-14T11:53:44.077976+0000","last_clean":"2024-09-14T11:53:44.077976+0000","last_became_active":"2024-09-14T11:09:53.010631+0000","last_became_peered":"2024-09-14T11:09:53.010631+0000","last_unstale":"2024-09-14T11:53:44.077976+0000","last_undegraded":"2024-09-14T11:53:44.077976+0000","last_fullsized":"2024-09-14T11:53:44.077976+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:56.772893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"264'178","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:07.609486+0000","last_change":"2024-09-14T11:09:55.011221+0000","last_active":"2024-09-14T11:52:07.609486+0000","last_peered":"2024-09-14T11:52:07.609486+0000","last_clean":"2024-09-14T11:52:07.609486+0000","last_became_active":"2024-09-14T11:09:55.010215+0000","last_became_peered":"2024-09-14T11:09:55.010215+0000","last_unstale":"2024-09-14T11:52:07.609486+0000","last_undegraded":"2024-09-14T11:52:07.609486+0000","last_fullsized":"2024-09-14T11:52:07.609486+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:33.289296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":123,"num_read_kb":114,"num_write":415,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"264'410","reported_seq":1885,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.991420+0000","last_change":"2024-09-14T11:09:46.967866+0000","last_active":"2024-09-14T11:52:09.991420+0000","last_peered":"2024-09-14T11:52:09.991420+0000","last_clean":"2024-09-14T11:52:09.991420+0000","last_became_active":"2024-09-14T11:09:46.966876+0000","last_became_peered":"2024-09-14T11:09:46.966876+0000","last_unstale":"2024-09-14T11:52:09.991420+0000","last_undegraded":"2024-09-14T11:52:09.991420+0000","last_fullsized":"2024-09-14T11:52:09.991420+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:28.146124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2150,"num_read_kb":2036,"num_write":469,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"264'260","reported_seq":1010,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:04.801946+0000","last_change":"2024-09-14T11:09:45.200742+0000","last_active":"2024-09-14T11:52:04.801946+0000","last_peered":"2024-09-14T11:52:04.801946+0000","last_clean":"2024-09-14T11:52:04.801946+0000","last_became_active":"2024-09-14T11:09:45.200039+0000","last_became_peered":"2024-09-14T11:09:45.200039+0000","last_unstale":"2024-09-14T11:52:04.801946+0000","last_undegraded":"2024-09-14T11:52:04.801946+0000","last_fullsized":"2024-09-14T11:52:04.801946+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:15.438388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11536473,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":989,"num_read_kb":201012,"num_write":1225,"num_write_kb":37853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:19.309093+0000","last_change":"2024-09-14T11:09:48.973340+0000","last_active":"2024-09-14T11:50:19.309093+0000","last_peered":"2024-09-14T11:50:19.309093+0000","last_clean":"2024-09-14T11:50:19.309093+0000","last_became_active":"2024-09-14T11:09:48.972957+0000","last_became_peered":"2024-09-14T11:09:48.972957+0000","last_unstale":"2024-09-14T11:50:19.309093+0000","last_undegraded":"2024-09-14T11:50:19.309093+0000","last_fullsized":"2024-09-14T11:50:19.309093+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:18.626799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"264'193","reported_seq":791,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:38.292800+0000","last_change":"2024-09-14T11:09:50.992659+0000","last_active":"2024-09-14T11:52:38.292800+0000","last_peered":"2024-09-14T11:52:38.292800+0000","last_clean":"2024-09-14T11:52:38.292800+0000","last_became_active":"2024-09-14T11:09:50.991938+0000","last_became_peered":"2024-09-14T11:09:50.991938+0000","last_unstale":"2024-09-14T11:52:38.292800+0000","last_undegraded":"2024-09-14T11:52:38.292800+0000","last_fullsized":"2024-09-14T11:52:38.292800+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:19.906727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19285,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":253,"num_read_kb":314,"num_write":144,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:24.093470+0000","last_change":"2024-09-14T11:09:53.007158+0000","last_active":"2024-09-14T11:50:24.093470+0000","last_peered":"2024-09-14T11:50:24.093470+0000","last_clean":"2024-09-14T11:50:24.093470+0000","last_became_active":"2024-09-14T11:09:53.006350+0000","last_became_peered":"2024-09-14T11:09:53.006350+0000","last_unstale":"2024-09-14T11:50:24.093470+0000","last_undegraded":"2024-09-14T11:50:24.093470+0000","last_fullsized":"2024-09-14T11:50:24.093470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:53.484128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"264'117","reported_seq":602,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.069500+0000","last_change":"2024-09-14T11:09:55.013765+0000","last_active":"2024-09-14T11:52:29.069500+0000","last_peered":"2024-09-14T11:52:29.069500+0000","last_clean":"2024-09-14T11:52:29.069500+0000","last_became_active":"2024-09-14T11:09:55.012954+0000","last_became_peered":"2024-09-14T11:09:55.012954+0000","last_unstale":"2024-09-14T11:52:29.069500+0000","last_undegraded":"2024-09-14T11:52:29.069500+0000","last_fullsized":"2024-09-14T11:52:29.069500+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:40.472347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":106,"num_write":256,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"264'403","reported_seq":2070,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.038508+0000","last_change":"2024-09-14T11:09:46.961019+0000","last_active":"2024-09-14T11:52:29.038508+0000","last_peered":"2024-09-14T11:52:29.038508+0000","last_clean":"2024-09-14T11:52:29.038508+0000","last_became_active":"2024-09-14T11:09:46.960461+0000","last_became_peered":"2024-09-14T11:09:46.960461+0000","last_unstale":"2024-09-14T11:52:29.038508+0000","last_undegraded":"2024-09-14T11:52:29.038508+0000","last_fullsized":"2024-09-14T11:52:29.038508+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:23.203399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2438,"num_read_kb":2343,"num_write":447,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:38.279655+0000","last_change":"2024-09-14T11:09:30.311475+0000","last_active":"2024-09-14T11:51:38.279655+0000","last_peered":"2024-09-14T11:51:38.279655+0000","last_clean":"2024-09-14T11:51:38.279655+0000","last_became_active":"2024-09-14T11:09:30.309524+0000","last_became_peered":"2024-09-14T11:09:30.309524+0000","last_unstale":"2024-09-14T11:51:38.279655+0000","last_undegraded":"2024-09-14T11:51:38.279655+0000","last_fullsized":"2024-09-14T11:51:38.279655+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:29.042524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:29.042524+0000","last_clean_scrub_stamp":"2024-09-14T11:09:29.042524+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:30.098592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.325699+0000","last_change":"2024-09-14T11:09:38.138631+0000","last_active":"2024-09-14T11:51:19.325699+0000","last_peered":"2024-09-14T11:51:19.325699+0000","last_clean":"2024-09-14T11:51:19.325699+0000","last_became_active":"2024-09-14T11:09:36.264768+0000","last_became_peered":"2024-09-14T11:09:36.264768+0000","last_unstale":"2024-09-14T11:51:19.325699+0000","last_undegraded":"2024-09-14T11:51:19.325699+0000","last_fullsized":"2024-09-14T11:51:19.325699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:42.835248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092723999999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"264'260","reported_seq":1067,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:46.758886+0000","last_change":"2024-09-14T11:09:45.193906+0000","last_active":"2024-09-14T11:51:46.758886+0000","last_peered":"2024-09-14T11:51:46.758886+0000","last_clean":"2024-09-14T11:51:46.758886+0000","last_became_active":"2024-09-14T11:09:45.193131+0000","last_became_peered":"2024-09-14T11:09:45.193131+0000","last_unstale":"2024-09-14T11:51:46.758886+0000","last_undegraded":"2024-09-14T11:51:46.758886+0000","last_fullsized":"2024-09-14T11:51:46.758886+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:48.612008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5310725,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1118,"num_read_kb":141056,"num_write":1035,"num_write_kb":44809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:28.295205+0000","last_change":"2024-09-14T11:09:48.970982+0000","last_active":"2024-09-14T11:51:28.295205+0000","last_peered":"2024-09-14T11:51:28.295205+0000","last_clean":"2024-09-14T11:51:28.295205+0000","last_became_active":"2024-09-14T11:09:48.970541+0000","last_became_peered":"2024-09-14T11:09:48.970541+0000","last_unstale":"2024-09-14T11:51:28.295205+0000","last_undegraded":"2024-09-14T11:51:28.295205+0000","last_fullsized":"2024-09-14T11:51:28.295205+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:59.863519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"264'287","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.018200+0000","last_change":"2024-09-14T11:09:50.994191+0000","last_active":"2024-09-14T11:53:44.018200+0000","last_peered":"2024-09-14T11:53:44.018200+0000","last_clean":"2024-09-14T11:53:44.018200+0000","last_became_active":"2024-09-14T11:09:50.993231+0000","last_became_peered":"2024-09-14T11:09:50.993231+0000","last_unstale":"2024-09-14T11:53:44.018200+0000","last_undegraded":"2024-09-14T11:53:44.018200+0000","last_fullsized":"2024-09-14T11:53:44.018200+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:10.493181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30416,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":522,"num_read_kb":647,"num_write":472,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.126495+0000","last_change":"2024-09-14T11:09:53.006544+0000","last_active":"2024-09-14T11:51:03.126495+0000","last_peered":"2024-09-14T11:51:03.126495+0000","last_clean":"2024-09-14T11:51:03.126495+0000","last_became_active":"2024-09-14T11:09:53.004338+0000","last_became_peered":"2024-09-14T11:09:53.004338+0000","last_unstale":"2024-09-14T11:51:03.126495+0000","last_undegraded":"2024-09-14T11:51:03.126495+0000","last_fullsized":"2024-09-14T11:51:03.126495+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:24.238705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"264'234","reported_seq":943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.660948+0000","last_change":"2024-09-14T11:09:55.016385+0000","last_active":"2024-09-14T11:52:29.660948+0000","last_peered":"2024-09-14T11:52:29.660948+0000","last_clean":"2024-09-14T11:52:29.660948+0000","last_became_active":"2024-09-14T11:09:55.015569+0000","last_became_peered":"2024-09-14T11:09:55.015569+0000","last_unstale":"2024-09-14T11:52:29.660948+0000","last_undegraded":"2024-09-14T11:52:29.660948+0000","last_fullsized":"2024-09-14T11:52:29.660948+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:05.577627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1424,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":528,"num_read_kb":505,"num_write":525,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"264'793","reported_seq":2248,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.037887+0000","last_change":"2024-09-14T11:09:46.975255+0000","last_active":"2024-09-14T11:52:29.037887+0000","last_peered":"2024-09-14T11:52:29.037887+0000","last_clean":"2024-09-14T11:52:29.037887+0000","last_became_active":"2024-09-14T11:09:46.974517+0000","last_became_peered":"2024-09-14T11:09:46.974517+0000","last_unstale":"2024-09-14T11:52:29.037887+0000","last_undegraded":"2024-09-14T11:52:29.037887+0000","last_fullsized":"2024-09-14T11:52:29.037887+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:37.949762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3876,"num_read_kb":3470,"num_write":1072,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:44.331934+0000","last_change":"2024-09-14T11:09:38.138820+0000","last_active":"2024-09-14T11:51:44.331934+0000","last_peered":"2024-09-14T11:51:44.331934+0000","last_clean":"2024-09-14T11:51:44.331934+0000","last_became_active":"2024-09-14T11:09:36.110037+0000","last_became_peered":"2024-09-14T11:09:36.110037+0000","last_unstale":"2024-09-14T11:51:44.331934+0000","last_undegraded":"2024-09-14T11:51:44.331934+0000","last_fullsized":"2024-09-14T11:51:44.331934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:29.413375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001043441,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"264'222","reported_seq":873,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:28.129009+0000","last_change":"2024-09-14T11:09:45.212152+0000","last_active":"2024-09-14T11:51:28.129009+0000","last_peered":"2024-09-14T11:51:28.129009+0000","last_clean":"2024-09-14T11:51:28.129009+0000","last_became_active":"2024-09-14T11:09:45.211579+0000","last_became_peered":"2024-09-14T11:09:45.211579+0000","last_unstale":"2024-09-14T11:51:28.129009+0000","last_undegraded":"2024-09-14T11:51:28.129009+0000","last_fullsized":"2024-09-14T11:51:28.129009+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:17.532123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6898702,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":624,"num_read_kb":58466,"num_write":934,"num_write_kb":31030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:59.320409+0000","last_change":"2024-09-14T11:09:48.970703+0000","last_active":"2024-09-14T11:50:59.320409+0000","last_peered":"2024-09-14T11:50:59.320409+0000","last_clean":"2024-09-14T11:50:59.320409+0000","last_became_active":"2024-09-14T11:09:48.970218+0000","last_became_peered":"2024-09-14T11:09:48.970218+0000","last_unstale":"2024-09-14T11:50:59.320409+0000","last_undegraded":"2024-09-14T11:50:59.320409+0000","last_fullsized":"2024-09-14T11:50:59.320409+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:45.534332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"264'851","reported_seq":2297,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.067742+0000","last_change":"2024-09-14T11:09:50.997084+0000","last_active":"2024-09-14T11:53:44.067742+0000","last_peered":"2024-09-14T11:53:44.067742+0000","last_clean":"2024-09-14T11:53:44.067742+0000","last_became_active":"2024-09-14T11:09:50.996406+0000","last_became_peered":"2024-09-14T11:09:50.996406+0000","last_unstale":"2024-09-14T11:53:44.067742+0000","last_undegraded":"2024-09-14T11:53:44.067742+0000","last_fullsized":"2024-09-14T11:53:44.067742+0000","mapping_epoch":29,"log_start":"264'800","ondisk_log_start":"264'800","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:20.571461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44447,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1154,"num_read_kb":1341,"num_write":276,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:39.330945+0000","last_change":"2024-09-14T11:09:53.022628+0000","last_active":"2024-09-14T11:51:39.330945+0000","last_peered":"2024-09-14T11:51:39.330945+0000","last_clean":"2024-09-14T11:51:39.330945+0000","last_became_active":"2024-09-14T11:09:53.022006+0000","last_became_peered":"2024-09-14T11:09:53.022006+0000","last_unstale":"2024-09-14T11:51:39.330945+0000","last_undegraded":"2024-09-14T11:51:39.330945+0000","last_fullsized":"2024-09-14T11:51:39.330945+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:49.069626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"264'217","reported_seq":744,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.027091+0000","last_change":"2024-09-14T11:09:55.024709+0000","last_active":"2024-09-14T11:52:29.027091+0000","last_peered":"2024-09-14T11:52:29.027091+0000","last_clean":"2024-09-14T11:52:29.027091+0000","last_became_active":"2024-09-14T11:09:55.023966+0000","last_became_peered":"2024-09-14T11:09:55.023966+0000","last_unstale":"2024-09-14T11:52:29.027091+0000","last_undegraded":"2024-09-14T11:52:29.027091+0000","last_fullsized":"2024-09-14T11:52:29.027091+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:34.668812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":224,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":295,"num_read_kb":259,"num_write":448,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"264'464","reported_seq":2168,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.103565+0000","last_change":"2024-09-14T11:09:46.982064+0000","last_active":"2024-09-14T11:53:43.103565+0000","last_peered":"2024-09-14T11:53:43.103565+0000","last_clean":"2024-09-14T11:53:43.103565+0000","last_became_active":"2024-09-14T11:09:46.981472+0000","last_became_peered":"2024-09-14T11:09:46.981472+0000","last_unstale":"2024-09-14T11:53:43.103565+0000","last_undegraded":"2024-09-14T11:53:43.103565+0000","last_fullsized":"2024-09-14T11:53:43.103565+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:06.355503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2625,"num_read_kb":2493,"num_write":542,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:18.309372+0000","last_change":"2024-09-14T11:09:38.679236+0000","last_active":"2024-09-14T11:51:18.309372+0000","last_peered":"2024-09-14T11:51:18.309372+0000","last_clean":"2024-09-14T11:51:18.309372+0000","last_became_active":"2024-09-14T11:09:36.110778+0000","last_became_peered":"2024-09-14T11:09:36.110778+0000","last_unstale":"2024-09-14T11:51:18.309372+0000","last_undegraded":"2024-09-14T11:51:18.309372+0000","last_fullsized":"2024-09-14T11:51:18.309372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:49.202249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001188634,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"264'177","reported_seq":774,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.137745+0000","last_change":"2024-09-14T11:09:45.215379+0000","last_active":"2024-09-14T11:51:53.137745+0000","last_peered":"2024-09-14T11:51:53.137745+0000","last_clean":"2024-09-14T11:51:53.137745+0000","last_became_active":"2024-09-14T11:09:45.214670+0000","last_became_peered":"2024-09-14T11:09:45.214670+0000","last_unstale":"2024-09-14T11:51:53.137745+0000","last_undegraded":"2024-09-14T11:51:53.137745+0000","last_fullsized":"2024-09-14T11:51:53.137745+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:31.182118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":423,"num_read_kb":11641,"num_write":791,"num_write_kb":32063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.300064+0000","last_change":"2024-09-14T11:09:48.969846+0000","last_active":"2024-09-14T11:50:58.300064+0000","last_peered":"2024-09-14T11:50:58.300064+0000","last_clean":"2024-09-14T11:50:58.300064+0000","last_became_active":"2024-09-14T11:09:48.968973+0000","last_became_peered":"2024-09-14T11:09:48.968973+0000","last_unstale":"2024-09-14T11:50:58.300064+0000","last_undegraded":"2024-09-14T11:50:58.300064+0000","last_fullsized":"2024-09-14T11:50:58.300064+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:16.223050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"264'234","reported_seq":1305,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.321387+0000","last_change":"2024-09-14T11:09:50.993349+0000","last_active":"2024-09-14T11:53:43.321387+0000","last_peered":"2024-09-14T11:53:43.321387+0000","last_clean":"2024-09-14T11:53:43.321387+0000","last_became_active":"2024-09-14T11:09:50.992589+0000","last_became_peered":"2024-09-14T11:09:50.992589+0000","last_unstale":"2024-09-14T11:53:43.321387+0000","last_undegraded":"2024-09-14T11:53:43.321387+0000","last_fullsized":"2024-09-14T11:53:43.321387+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:20.023339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":182,"num_read_kb":171,"num_write":149,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:33.127635+0000","last_change":"2024-09-14T11:09:53.008567+0000","last_active":"2024-09-14T11:51:33.127635+0000","last_peered":"2024-09-14T11:51:33.127635+0000","last_clean":"2024-09-14T11:51:33.127635+0000","last_became_active":"2024-09-14T11:09:53.007705+0000","last_became_peered":"2024-09-14T11:09:53.007705+0000","last_unstale":"2024-09-14T11:51:33.127635+0000","last_undegraded":"2024-09-14T11:51:33.127635+0000","last_fullsized":"2024-09-14T11:51:33.127635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:31.442222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"264'272","reported_seq":868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.845028+0000","last_change":"2024-09-14T11:09:55.014709+0000","last_active":"2024-09-14T11:52:29.845028+0000","last_peered":"2024-09-14T11:52:29.845028+0000","last_clean":"2024-09-14T11:52:29.845028+0000","last_became_active":"2024-09-14T11:09:55.013944+0000","last_became_peered":"2024-09-14T11:09:55.013944+0000","last_unstale":"2024-09-14T11:52:29.845028+0000","last_undegraded":"2024-09-14T11:52:29.845028+0000","last_fullsized":"2024-09-14T11:52:29.845028+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:31.373231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":495,"num_read_kb":519,"num_write":596,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"264'931","reported_seq":2815,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.038263+0000","last_change":"2024-09-14T11:09:46.982912+0000","last_active":"2024-09-14T11:52:29.038263+0000","last_peered":"2024-09-14T11:52:29.038263+0000","last_clean":"2024-09-14T11:52:29.038263+0000","last_became_active":"2024-09-14T11:09:46.982027+0000","last_became_peered":"2024-09-14T11:09:46.982027+0000","last_unstale":"2024-09-14T11:52:29.038263+0000","last_undegraded":"2024-09-14T11:52:29.038263+0000","last_fullsized":"2024-09-14T11:52:29.038263+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":900,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:07.510355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4697,"num_read_kb":4271,"num_write":1214,"num_write_kb":435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.325611+0000","last_change":"2024-09-14T11:09:38.140129+0000","last_active":"2024-09-14T11:51:19.325611+0000","last_peered":"2024-09-14T11:51:19.325611+0000","last_clean":"2024-09-14T11:51:19.325611+0000","last_became_active":"2024-09-14T11:09:36.887391+0000","last_became_peered":"2024-09-14T11:09:36.887391+0000","last_unstale":"2024-09-14T11:51:19.325611+0000","last_undegraded":"2024-09-14T11:51:19.325611+0000","last_fullsized":"2024-09-14T11:51:19.325611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:23.561067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023357849999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"264'258","reported_seq":903,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:35.668869+0000","last_change":"2024-09-14T11:09:45.206950+0000","last_active":"2024-09-14T11:53:35.668869+0000","last_peered":"2024-09-14T11:53:35.668869+0000","last_clean":"2024-09-14T11:53:35.668869+0000","last_became_active":"2024-09-14T11:09:45.206492+0000","last_became_peered":"2024-09-14T11:09:45.206492+0000","last_unstale":"2024-09-14T11:53:35.668869+0000","last_undegraded":"2024-09-14T11:53:35.668869+0000","last_fullsized":"2024-09-14T11:53:35.668869+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:09.076068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1375633,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":652,"num_read_kb":889,"num_write":1194,"num_write_kb":16465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:33.313136+0000","last_change":"2024-09-14T11:09:48.977354+0000","last_active":"2024-09-14T11:51:33.313136+0000","last_peered":"2024-09-14T11:51:33.313136+0000","last_clean":"2024-09-14T11:51:33.313136+0000","last_became_active":"2024-09-14T11:09:48.976315+0000","last_became_peered":"2024-09-14T11:09:48.976315+0000","last_unstale":"2024-09-14T11:51:33.313136+0000","last_undegraded":"2024-09-14T11:51:33.313136+0000","last_fullsized":"2024-09-14T11:51:33.313136+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:11:27.454227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"264'121","reported_seq":658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:13.156135+0000","last_change":"2024-09-14T11:09:50.983682+0000","last_active":"2024-09-14T11:53:13.156135+0000","last_peered":"2024-09-14T11:53:13.156135+0000","last_clean":"2024-09-14T11:53:13.156135+0000","last_became_active":"2024-09-14T11:09:50.983126+0000","last_became_peered":"2024-09-14T11:09:50.983126+0000","last_unstale":"2024-09-14T11:53:13.156135+0000","last_undegraded":"2024-09-14T11:53:13.156135+0000","last_fullsized":"2024-09-14T11:53:13.156135+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:01.407533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:04.321826+0000","last_change":"2024-09-14T11:09:53.015879+0000","last_active":"2024-09-14T11:51:04.321826+0000","last_peered":"2024-09-14T11:51:04.321826+0000","last_clean":"2024-09-14T11:51:04.321826+0000","last_became_active":"2024-09-14T11:09:53.015100+0000","last_became_peered":"2024-09-14T11:09:53.015100+0000","last_unstale":"2024-09-14T11:51:04.321826+0000","last_undegraded":"2024-09-14T11:51:04.321826+0000","last_fullsized":"2024-09-14T11:51:04.321826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:14:31.622686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"264'126","reported_seq":676,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:27.192089+0000","last_change":"2024-09-14T11:09:55.025662+0000","last_active":"2024-09-14T11:52:27.192089+0000","last_peered":"2024-09-14T11:52:27.192089+0000","last_clean":"2024-09-14T11:52:27.192089+0000","last_became_active":"2024-09-14T11:09:55.025030+0000","last_became_peered":"2024-09-14T11:09:55.025030+0000","last_unstale":"2024-09-14T11:52:27.192089+0000","last_undegraded":"2024-09-14T11:52:27.192089+0000","last_fullsized":"2024-09-14T11:52:27.192089+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:47.329558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":244,"num_read_kb":234,"num_write":307,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"264'430","reported_seq":1972,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.026058+0000","last_change":"2024-09-14T11:09:46.982402+0000","last_active":"2024-09-14T11:52:09.026058+0000","last_peered":"2024-09-14T11:52:09.026058+0000","last_clean":"2024-09-14T11:52:09.026058+0000","last_became_active":"2024-09-14T11:09:46.981578+0000","last_became_peered":"2024-09-14T11:09:46.981578+0000","last_unstale":"2024-09-14T11:52:09.026058+0000","last_undegraded":"2024-09-14T11:52:09.026058+0000","last_fullsized":"2024-09-14T11:52:09.026058+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:46.587772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2336,"num_read_kb":2209,"num_write":501,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"264'234","reported_seq":872,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:50.925761+0000","last_change":"2024-09-14T11:09:45.216526+0000","last_active":"2024-09-14T11:51:50.925761+0000","last_peered":"2024-09-14T11:51:50.925761+0000","last_clean":"2024-09-14T11:51:50.925761+0000","last_became_active":"2024-09-14T11:09:45.216168+0000","last_became_peered":"2024-09-14T11:09:45.216168+0000","last_unstale":"2024-09-14T11:51:50.925761+0000","last_undegraded":"2024-09-14T11:51:50.925761+0000","last_fullsized":"2024-09-14T11:51:50.925761+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:50.757149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9476046,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":591,"num_read_kb":12394,"num_write":1036,"num_write_kb":24779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:18.129696+0000","last_change":"2024-09-14T11:09:38.679466+0000","last_active":"2024-09-14T11:51:18.129696+0000","last_peered":"2024-09-14T11:51:18.129696+0000","last_clean":"2024-09-14T11:51:18.129696+0000","last_became_active":"2024-09-14T11:09:36.887411+0000","last_became_peered":"2024-09-14T11:09:36.887411+0000","last_unstale":"2024-09-14T11:51:18.129696+0000","last_undegraded":"2024-09-14T11:51:18.129696+0000","last_fullsized":"2024-09-14T11:51:18.129696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:17.852943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001210341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:28.126561+0000","last_change":"2024-09-14T11:09:48.973058+0000","last_active":"2024-09-14T11:51:28.126561+0000","last_peered":"2024-09-14T11:51:28.126561+0000","last_clean":"2024-09-14T11:51:28.126561+0000","last_became_active":"2024-09-14T11:09:48.969262+0000","last_became_peered":"2024-09-14T11:09:48.969262+0000","last_unstale":"2024-09-14T11:51:28.126561+0000","last_undegraded":"2024-09-14T11:51:28.126561+0000","last_fullsized":"2024-09-14T11:51:28.126561+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:26.478140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"264'274","reported_seq":920,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.001396+0000","last_change":"2024-09-14T11:09:50.992720+0000","last_active":"2024-09-14T11:53:44.001396+0000","last_peered":"2024-09-14T11:53:44.001396+0000","last_clean":"2024-09-14T11:53:44.001396+0000","last_became_active":"2024-09-14T11:09:50.991958+0000","last_became_peered":"2024-09-14T11:09:50.991958+0000","last_unstale":"2024-09-14T11:53:44.001396+0000","last_undegraded":"2024-09-14T11:53:44.001396+0000","last_fullsized":"2024-09-14T11:53:44.001396+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:06.240758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30144,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1020,"num_read_kb":1155,"num_write":1528,"num_write_kb":1391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:34.110192+0000","last_change":"2024-09-14T11:09:53.002718+0000","last_active":"2024-09-14T11:51:34.110192+0000","last_peered":"2024-09-14T11:51:34.110192+0000","last_clean":"2024-09-14T11:51:34.110192+0000","last_became_active":"2024-09-14T11:09:53.001945+0000","last_became_peered":"2024-09-14T11:09:53.001945+0000","last_unstale":"2024-09-14T11:51:34.110192+0000","last_undegraded":"2024-09-14T11:51:34.110192+0000","last_fullsized":"2024-09-14T11:51:34.110192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:52.861043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"264'176","reported_seq":711,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:08.421243+0000","last_change":"2024-09-14T11:09:55.019726+0000","last_active":"2024-09-14T11:52:08.421243+0000","last_peered":"2024-09-14T11:52:08.421243+0000","last_clean":"2024-09-14T11:52:08.421243+0000","last_became_active":"2024-09-14T11:09:55.019043+0000","last_became_peered":"2024-09-14T11:09:55.019043+0000","last_unstale":"2024-09-14T11:52:08.421243+0000","last_undegraded":"2024-09-14T11:52:08.421243+0000","last_fullsized":"2024-09-14T11:52:08.421243+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:33.587845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":311,"num_read_kb":271,"num_write":434,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"264'392","reported_seq":1909,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.024097+0000","last_change":"2024-09-14T11:09:46.980131+0000","last_active":"2024-09-14T11:52:09.024097+0000","last_peered":"2024-09-14T11:52:09.024097+0000","last_clean":"2024-09-14T11:52:09.024097+0000","last_became_active":"2024-09-14T11:09:46.979673+0000","last_became_peered":"2024-09-14T11:09:46.979673+0000","last_unstale":"2024-09-14T11:52:09.024097+0000","last_undegraded":"2024-09-14T11:52:09.024097+0000","last_fullsized":"2024-09-14T11:52:09.024097+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:23.116963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2181,"num_read_kb":2077,"num_write":440,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"264'169","reported_seq":740,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:43.411940+0000","last_change":"2024-09-14T11:09:45.222105+0000","last_active":"2024-09-14T11:51:43.411940+0000","last_peered":"2024-09-14T11:51:43.411940+0000","last_clean":"2024-09-14T11:51:43.411940+0000","last_became_active":"2024-09-14T11:09:45.220512+0000","last_became_peered":"2024-09-14T11:09:45.220512+0000","last_unstale":"2024-09-14T11:51:43.411940+0000","last_undegraded":"2024-09-14T11:51:43.411940+0000","last_fullsized":"2024-09-14T11:51:43.411940+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:34.422225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2704449,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":335,"num_read_kb":1928,"num_write":797,"num_write_kb":32938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:24.327126+0000","last_change":"2024-09-14T11:09:38.140706+0000","last_active":"2024-09-14T11:51:24.327126+0000","last_peered":"2024-09-14T11:51:24.327126+0000","last_clean":"2024-09-14T11:51:24.327126+0000","last_became_active":"2024-09-14T11:09:36.110624+0000","last_became_peered":"2024-09-14T11:09:36.110624+0000","last_unstale":"2024-09-14T11:51:24.327126+0000","last_undegraded":"2024-09-14T11:51:24.327126+0000","last_fullsized":"2024-09-14T11:51:24.327126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:03.769383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002569127,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:28.295129+0000","last_change":"2024-09-14T11:09:48.968649+0000","last_active":"2024-09-14T11:51:28.295129+0000","last_peered":"2024-09-14T11:51:28.295129+0000","last_clean":"2024-09-14T11:51:28.295129+0000","last_became_active":"2024-09-14T11:09:48.968130+0000","last_became_peered":"2024-09-14T11:09:48.968130+0000","last_unstale":"2024-09-14T11:51:28.295129+0000","last_undegraded":"2024-09-14T11:51:28.295129+0000","last_fullsized":"2024-09-14T11:51:28.295129+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:38.760974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"264'157","reported_seq":716,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:33.130356+0000","last_change":"2024-09-14T11:09:50.998266+0000","last_active":"2024-09-14T11:51:33.130356+0000","last_peered":"2024-09-14T11:51:33.130356+0000","last_clean":"2024-09-14T11:51:33.130356+0000","last_became_active":"2024-09-14T11:09:50.997665+0000","last_became_peered":"2024-09-14T11:09:50.997665+0000","last_unstale":"2024-09-14T11:51:33.130356+0000","last_undegraded":"2024-09-14T11:51:33.130356+0000","last_fullsized":"2024-09-14T11:51:33.130356+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:11.749451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":193,"num_read_kb":186,"num_write":126,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"264'799","reported_seq":2768,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.071772+0000","last_change":"2024-09-14T11:09:53.019274+0000","last_active":"2024-09-14T11:53:44.071772+0000","last_peered":"2024-09-14T11:53:44.071772+0000","last_clean":"2024-09-14T11:53:44.071772+0000","last_became_active":"2024-09-14T11:09:53.018558+0000","last_became_peered":"2024-09-14T11:09:53.018558+0000","last_unstale":"2024-09-14T11:53:44.071772+0000","last_undegraded":"2024-09-14T11:53:44.071772+0000","last_fullsized":"2024-09-14T11:53:44.071772+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:50.014596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"264'101","reported_seq":592,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:48.332986+0000","last_change":"2024-09-14T11:09:55.024161+0000","last_active":"2024-09-14T11:52:48.332986+0000","last_peered":"2024-09-14T11:52:48.332986+0000","last_clean":"2024-09-14T11:52:48.332986+0000","last_became_active":"2024-09-14T11:09:55.017739+0000","last_became_peered":"2024-09-14T11:09:55.017739+0000","last_unstale":"2024-09-14T11:52:48.332986+0000","last_undegraded":"2024-09-14T11:52:48.332986+0000","last_fullsized":"2024-09-14T11:52:48.332986+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:11.037869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":97,"num_read_kb":96,"num_write":232,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"264'1040","reported_seq":2573,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.647300+0000","last_change":"2024-09-14T11:09:46.963627+0000","last_active":"2024-09-14T11:52:29.647300+0000","last_peered":"2024-09-14T11:52:29.647300+0000","last_clean":"2024-09-14T11:52:29.647300+0000","last_became_active":"2024-09-14T11:09:46.958507+0000","last_became_peered":"2024-09-14T11:09:46.958507+0000","last_unstale":"2024-09-14T11:52:29.647300+0000","last_undegraded":"2024-09-14T11:52:29.647300+0000","last_fullsized":"2024-09-14T11:52:29.647300+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":1000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:27.643352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4784,"num_read_kb":4190,"num_write":1482,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"264'206","reported_seq":840,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.083280+0000","last_change":"2024-09-14T11:09:45.217672+0000","last_active":"2024-09-14T11:52:12.083280+0000","last_peered":"2024-09-14T11:52:12.083280+0000","last_clean":"2024-09-14T11:52:12.083280+0000","last_became_active":"2024-09-14T11:09:45.217039+0000","last_became_peered":"2024-09-14T11:09:45.217039+0000","last_unstale":"2024-09-14T11:52:12.083280+0000","last_undegraded":"2024-09-14T11:52:12.083280+0000","last_fullsized":"2024-09-14T11:52:12.083280+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:21.713459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3515727,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":528,"num_read_kb":14758,"num_write":970,"num_write_kb":31870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:48.117767+0000","last_change":"2024-09-14T11:09:38.679232+0000","last_active":"2024-09-14T11:50:48.117767+0000","last_peered":"2024-09-14T11:50:48.117767+0000","last_clean":"2024-09-14T11:50:48.117767+0000","last_became_active":"2024-09-14T11:09:36.106073+0000","last_became_peered":"2024-09-14T11:09:36.106073+0000","last_unstale":"2024-09-14T11:50:48.117767+0000","last_undegraded":"2024-09-14T11:50:48.117767+0000","last_fullsized":"2024-09-14T11:50:48.117767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:12.720860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012975129999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:29.328220+0000","last_change":"2024-09-14T11:09:48.970814+0000","last_active":"2024-09-14T11:51:29.328220+0000","last_peered":"2024-09-14T11:51:29.328220+0000","last_clean":"2024-09-14T11:51:29.328220+0000","last_became_active":"2024-09-14T11:09:48.970339+0000","last_became_peered":"2024-09-14T11:09:48.970339+0000","last_unstale":"2024-09-14T11:51:29.328220+0000","last_undegraded":"2024-09-14T11:51:29.328220+0000","last_fullsized":"2024-09-14T11:51:29.328220+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:13.911012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"264'121","reported_seq":652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:56.240192+0000","last_change":"2024-09-14T11:09:50.980619+0000","last_active":"2024-09-14T11:51:56.240192+0000","last_peered":"2024-09-14T11:51:56.240192+0000","last_clean":"2024-09-14T11:51:56.240192+0000","last_became_active":"2024-09-14T11:09:50.979827+0000","last_became_peered":"2024-09-14T11:09:50.979827+0000","last_unstale":"2024-09-14T11:51:56.240192+0000","last_undegraded":"2024-09-14T11:51:56.240192+0000","last_fullsized":"2024-09-14T11:51:56.240192+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:48.508635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":133,"num_read_kb":122,"num_write":94,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"264'799","reported_seq":2476,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.080222+0000","last_change":"2024-09-14T11:09:53.008348+0000","last_active":"2024-09-14T11:53:44.080222+0000","last_peered":"2024-09-14T11:53:44.080222+0000","last_clean":"2024-09-14T11:53:44.080222+0000","last_became_active":"2024-09-14T11:09:53.007337+0000","last_became_peered":"2024-09-14T11:09:53.007337+0000","last_unstale":"2024-09-14T11:53:44.080222+0000","last_undegraded":"2024-09-14T11:53:44.080222+0000","last_fullsized":"2024-09-14T11:53:44.080222+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:03.521459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"264'267","reported_seq":793,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:02.141641+0000","last_change":"2024-09-14T11:09:55.012569+0000","last_active":"2024-09-14T11:52:02.141641+0000","last_peered":"2024-09-14T11:52:02.141641+0000","last_clean":"2024-09-14T11:52:02.141641+0000","last_became_active":"2024-09-14T11:09:55.011828+0000","last_became_peered":"2024-09-14T11:09:55.011828+0000","last_unstale":"2024-09-14T11:52:02.141641+0000","last_undegraded":"2024-09-14T11:52:02.141641+0000","last_fullsized":"2024-09-14T11:52:02.141641+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:06.262186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":359,"num_read_kb":349,"num_write":571,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"264'1160","reported_seq":2657,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.647384+0000","last_change":"2024-09-14T11:09:46.946333+0000","last_active":"2024-09-14T11:52:29.647384+0000","last_peered":"2024-09-14T11:52:29.647384+0000","last_clean":"2024-09-14T11:52:29.647384+0000","last_became_active":"2024-09-14T11:09:46.946010+0000","last_became_peered":"2024-09-14T11:09:46.946010+0000","last_unstale":"2024-09-14T11:52:29.647384+0000","last_undegraded":"2024-09-14T11:52:29.647384+0000","last_fullsized":"2024-09-14T11:52:29.647384+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":1100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:45.329444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5209,"num_read_kb":4587,"num_write":1598,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"264'202","reported_seq":872,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:02.372313+0000","last_change":"2024-09-14T11:09:45.213246+0000","last_active":"2024-09-14T11:51:02.372313+0000","last_peered":"2024-09-14T11:51:02.372313+0000","last_clean":"2024-09-14T11:51:02.372313+0000","last_became_active":"2024-09-14T11:09:45.212500+0000","last_became_peered":"2024-09-14T11:09:45.212500+0000","last_unstale":"2024-09-14T11:51:02.372313+0000","last_undegraded":"2024-09-14T11:51:02.372313+0000","last_fullsized":"2024-09-14T11:51:02.372313+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:35:58.594042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1450334,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":650,"num_read_kb":3804,"num_write":895,"num_write_kb":25360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:49.317464+0000","last_change":"2024-09-14T11:09:38.140326+0000","last_active":"2024-09-14T11:50:49.317464+0000","last_peered":"2024-09-14T11:50:49.317464+0000","last_clean":"2024-09-14T11:50:49.317464+0000","last_became_active":"2024-09-14T11:09:36.108781+0000","last_became_peered":"2024-09-14T11:09:36.108781+0000","last_unstale":"2024-09-14T11:50:49.317464+0000","last_undegraded":"2024-09-14T11:50:49.317464+0000","last_fullsized":"2024-09-14T11:50:49.317464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:06.040461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002510581,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.132003+0000","last_change":"2024-09-14T11:09:48.971810+0000","last_active":"2024-09-14T11:51:53.132003+0000","last_peered":"2024-09-14T11:51:53.132003+0000","last_clean":"2024-09-14T11:51:53.132003+0000","last_became_active":"2024-09-14T11:09:48.970940+0000","last_became_peered":"2024-09-14T11:09:48.970940+0000","last_unstale":"2024-09-14T11:51:53.132003+0000","last_undegraded":"2024-09-14T11:51:53.132003+0000","last_fullsized":"2024-09-14T11:51:53.132003+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:57.505239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"264'299","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.994858+0000","last_change":"2024-09-14T11:09:50.993096+0000","last_active":"2024-09-14T11:53:43.994858+0000","last_peered":"2024-09-14T11:53:43.994858+0000","last_clean":"2024-09-14T11:53:43.994858+0000","last_became_active":"2024-09-14T11:09:50.992374+0000","last_became_peered":"2024-09-14T11:09:50.992374+0000","last_unstale":"2024-09-14T11:53:43.994858+0000","last_undegraded":"2024-09-14T11:53:43.994858+0000","last_fullsized":"2024-09-14T11:53:43.994858+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:36.668946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29162,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":417,"num_read_kb":536,"num_write":204,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:33.127557+0000","last_change":"2024-09-14T11:09:53.004011+0000","last_active":"2024-09-14T11:51:33.127557+0000","last_peered":"2024-09-14T11:51:33.127557+0000","last_clean":"2024-09-14T11:51:33.127557+0000","last_became_active":"2024-09-14T11:09:53.002904+0000","last_became_peered":"2024-09-14T11:09:53.002904+0000","last_unstale":"2024-09-14T11:51:33.127557+0000","last_undegraded":"2024-09-14T11:51:33.127557+0000","last_fullsized":"2024-09-14T11:51:33.127557+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:43.359087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"264'131","reported_seq":631,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.024565+0000","last_change":"2024-09-14T11:09:55.014957+0000","last_active":"2024-09-14T11:53:43.024565+0000","last_peered":"2024-09-14T11:53:43.024565+0000","last_clean":"2024-09-14T11:53:43.024565+0000","last_became_active":"2024-09-14T11:09:55.014192+0000","last_became_peered":"2024-09-14T11:09:55.014192+0000","last_unstale":"2024-09-14T11:53:43.024565+0000","last_undegraded":"2024-09-14T11:53:43.024565+0000","last_fullsized":"2024-09-14T11:53:43.024565+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:45.779974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":303,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"264'162","reported_seq":744,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.795176+0000","last_change":"2024-09-14T11:09:55.015877+0000","last_active":"2024-09-14T11:52:29.795176+0000","last_peered":"2024-09-14T11:52:29.795176+0000","last_clean":"2024-09-14T11:52:29.795176+0000","last_became_active":"2024-09-14T11:09:55.015127+0000","last_became_peered":"2024-09-14T11:09:55.015127+0000","last_unstale":"2024-09-14T11:52:29.795176+0000","last_undegraded":"2024-09-14T11:52:29.795176+0000","last_fullsized":"2024-09-14T11:52:29.795176+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:49.733188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":313,"num_read_kb":285,"num_write":384,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"264'821","reported_seq":2478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.015985+0000","last_change":"2024-09-14T11:09:46.949040+0000","last_active":"2024-09-14T11:52:29.015985+0000","last_peered":"2024-09-14T11:52:29.015985+0000","last_clean":"2024-09-14T11:52:29.015985+0000","last_became_active":"2024-09-14T11:09:46.948706+0000","last_became_peered":"2024-09-14T11:09:46.948706+0000","last_unstale":"2024-09-14T11:52:29.015985+0000","last_undegraded":"2024-09-14T11:52:29.015985+0000","last_fullsized":"2024-09-14T11:52:29.015985+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":800,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:18.066498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4239,"num_read_kb":3866,"num_write":1097,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"264'188","reported_seq":829,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.876240+0000","last_change":"2024-09-14T11:09:45.201897+0000","last_active":"2024-09-14T11:50:58.876240+0000","last_peered":"2024-09-14T11:50:58.876240+0000","last_clean":"2024-09-14T11:50:58.876240+0000","last_became_active":"2024-09-14T11:09:45.201562+0000","last_became_peered":"2024-09-14T11:09:45.201562+0000","last_unstale":"2024-09-14T11:50:58.876240+0000","last_undegraded":"2024-09-14T11:50:58.876240+0000","last_fullsized":"2024-09-14T11:50:58.876240+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:04.521022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5904577,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":502,"num_read_kb":86083,"num_write":866,"num_write_kb":49236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.102271+0000","last_change":"2024-09-14T11:09:48.963401+0000","last_active":"2024-09-14T11:49:28.102271+0000","last_peered":"2024-09-14T11:49:28.102271+0000","last_clean":"2024-09-14T11:49:28.102271+0000","last_became_active":"2024-09-14T11:09:48.962619+0000","last_became_peered":"2024-09-14T11:09:48.962619+0000","last_unstale":"2024-09-14T11:49:28.102271+0000","last_undegraded":"2024-09-14T11:49:28.102271+0000","last_fullsized":"2024-09-14T11:49:28.102271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:52.738701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"264'167","reported_seq":732,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:55.755784+0000","last_change":"2024-09-14T11:09:50.996731+0000","last_active":"2024-09-14T11:51:55.755784+0000","last_peered":"2024-09-14T11:51:55.755784+0000","last_clean":"2024-09-14T11:51:55.755784+0000","last_became_active":"2024-09-14T11:09:50.996047+0000","last_became_peered":"2024-09-14T11:09:50.996047+0000","last_unstale":"2024-09-14T11:51:55.755784+0000","last_undegraded":"2024-09-14T11:51:55.755784+0000","last_fullsized":"2024-09-14T11:51:55.755784+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:30.833822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35819,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":196,"num_read_kb":314,"num_write":122,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:33.280880+0000","last_change":"2024-09-14T11:09:53.001072+0000","last_active":"2024-09-14T11:49:33.280880+0000","last_peered":"2024-09-14T11:49:33.280880+0000","last_clean":"2024-09-14T11:49:33.280880+0000","last_became_active":"2024-09-14T11:09:53.000339+0000","last_became_peered":"2024-09-14T11:09:53.000339+0000","last_unstale":"2024-09-14T11:49:33.280880+0000","last_undegraded":"2024-09-14T11:49:33.280880+0000","last_fullsized":"2024-09-14T11:49:33.280880+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:15.810620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"264'95","reported_seq":580,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:03.319786+0000","last_change":"2024-09-14T11:09:55.023250+0000","last_active":"2024-09-14T11:52:03.319786+0000","last_peered":"2024-09-14T11:52:03.319786+0000","last_clean":"2024-09-14T11:52:03.319786+0000","last_became_active":"2024-09-14T11:09:55.022477+0000","last_became_peered":"2024-09-14T11:09:55.022477+0000","last_unstale":"2024-09-14T11:52:03.319786+0000","last_undegraded":"2024-09-14T11:52:03.319786+0000","last_fullsized":"2024-09-14T11:52:03.319786+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:48.971105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":73,"num_write":206,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"264'413","reported_seq":1945,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.021893+0000","last_change":"2024-09-14T11:09:46.949256+0000","last_active":"2024-09-14T11:52:29.021893+0000","last_peered":"2024-09-14T11:52:29.021893+0000","last_clean":"2024-09-14T11:52:29.021893+0000","last_became_active":"2024-09-14T11:09:46.948572+0000","last_became_peered":"2024-09-14T11:09:46.948572+0000","last_unstale":"2024-09-14T11:52:29.021893+0000","last_undegraded":"2024-09-14T11:52:29.021893+0000","last_fullsized":"2024-09-14T11:52:29.021893+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:03.770405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2176,"num_read_kb":2078,"num_write":464,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"264'231","reported_seq":847,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.287509+0000","last_change":"2024-09-14T11:09:45.224440+0000","last_active":"2024-09-14T11:50:53.287509+0000","last_peered":"2024-09-14T11:50:53.287509+0000","last_clean":"2024-09-14T11:50:53.287509+0000","last_became_active":"2024-09-14T11:09:45.223324+0000","last_became_peered":"2024-09-14T11:09:45.223324+0000","last_unstale":"2024-09-14T11:50:53.287509+0000","last_undegraded":"2024-09-14T11:50:53.287509+0000","last_fullsized":"2024-09-14T11:50:53.287509+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:46.914684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1666108,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":553,"num_read_kb":7834,"num_write":1126,"num_write_kb":26023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"35'3","reported_seq":976,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.914843+0000","last_change":"2024-09-14T11:09:48.969925+0000","last_active":"2024-09-14T11:53:43.914843+0000","last_peered":"2024-09-14T11:53:43.914843+0000","last_clean":"2024-09-14T11:53:43.914843+0000","last_became_active":"2024-09-14T11:09:48.968561+0000","last_became_peered":"2024-09-14T11:09:48.968561+0000","last_unstale":"2024-09-14T11:53:43.914843+0000","last_undegraded":"2024-09-14T11:53:43.914843+0000","last_fullsized":"2024-09-14T11:53:43.914843+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:29.015385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":725,"num_read_kb":723,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"264'44","reported_seq":545,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.132030+0000","last_change":"2024-09-14T11:09:50.981928+0000","last_active":"2024-09-14T11:51:53.132030+0000","last_peered":"2024-09-14T11:51:53.132030+0000","last_clean":"2024-09-14T11:51:53.132030+0000","last_became_active":"2024-09-14T11:09:50.981128+0000","last_became_peered":"2024-09-14T11:09:50.981128+0000","last_unstale":"2024-09-14T11:51:53.132030+0000","last_undegraded":"2024-09-14T11:51:53.132030+0000","last_fullsized":"2024-09-14T11:51:53.132030+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:25.003185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:34.082103+0000","last_change":"2024-09-14T11:09:53.007173+0000","last_active":"2024-09-14T11:49:34.082103+0000","last_peered":"2024-09-14T11:49:34.082103+0000","last_clean":"2024-09-14T11:49:34.082103+0000","last_became_active":"2024-09-14T11:09:53.006292+0000","last_became_peered":"2024-09-14T11:09:53.006292+0000","last_unstale":"2024-09-14T11:49:34.082103+0000","last_undegraded":"2024-09-14T11:49:34.082103+0000","last_fullsized":"2024-09-14T11:49:34.082103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:01.689414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"264'206","reported_seq":723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.013495+0000","last_change":"2024-09-14T11:09:55.015153+0000","last_active":"2024-09-14T11:52:29.013495+0000","last_peered":"2024-09-14T11:52:29.013495+0000","last_clean":"2024-09-14T11:52:29.013495+0000","last_became_active":"2024-09-14T11:09:55.014414+0000","last_became_peered":"2024-09-14T11:09:55.014414+0000","last_unstale":"2024-09-14T11:52:29.013495+0000","last_undegraded":"2024-09-14T11:52:29.013495+0000","last_fullsized":"2024-09-14T11:52:29.013495+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:10.146075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":294,"num_read_kb":289,"num_write":451,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"264'673","reported_seq":2427,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.161127+0000","last_change":"2024-09-14T11:09:46.963397+0000","last_active":"2024-09-14T11:52:12.161127+0000","last_peered":"2024-09-14T11:52:12.161127+0000","last_clean":"2024-09-14T11:52:12.161127+0000","last_became_active":"2024-09-14T11:09:46.962508+0000","last_became_peered":"2024-09-14T11:09:46.962508+0000","last_unstale":"2024-09-14T11:52:12.161127+0000","last_undegraded":"2024-09-14T11:52:12.161127+0000","last_fullsized":"2024-09-14T11:52:12.161127+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":600,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:44.240688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3732,"num_read_kb":3415,"num_write":933,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"264'180","reported_seq":781,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:54.100781+0000","last_change":"2024-09-14T11:09:45.207817+0000","last_active":"2024-09-14T11:50:54.100781+0000","last_peered":"2024-09-14T11:50:54.100781+0000","last_clean":"2024-09-14T11:50:54.100781+0000","last_became_active":"2024-09-14T11:09:45.206901+0000","last_became_peered":"2024-09-14T11:09:45.206901+0000","last_unstale":"2024-09-14T11:50:54.100781+0000","last_undegraded":"2024-09-14T11:50:54.100781+0000","last_fullsized":"2024-09-14T11:50:54.100781+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:29.534278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2134615,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":433,"num_read_kb":9258,"num_write":854,"num_write_kb":15949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:29.080988+0000","last_change":"2024-09-14T11:09:48.960157+0000","last_active":"2024-09-14T11:49:29.080988+0000","last_peered":"2024-09-14T11:49:29.080988+0000","last_clean":"2024-09-14T11:49:29.080988+0000","last_became_active":"2024-09-14T11:09:48.959413+0000","last_became_peered":"2024-09-14T11:09:48.959413+0000","last_unstale":"2024-09-14T11:49:29.080988+0000","last_undegraded":"2024-09-14T11:49:29.080988+0000","last_fullsized":"2024-09-14T11:49:29.080988+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:19.014844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"264'155","reported_seq":732,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.044674+0000","last_change":"2024-09-14T11:09:51.000219+0000","last_active":"2024-09-14T11:52:29.044674+0000","last_peered":"2024-09-14T11:52:29.044674+0000","last_clean":"2024-09-14T11:52:29.044674+0000","last_became_active":"2024-09-14T11:09:50.999585+0000","last_became_peered":"2024-09-14T11:09:50.999585+0000","last_unstale":"2024-09-14T11:52:29.044674+0000","last_undegraded":"2024-09-14T11:52:29.044674+0000","last_fullsized":"2024-09-14T11:52:29.044674+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:27.217391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9157,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":208,"num_read_kb":262,"num_write":114,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:33.253171+0000","last_change":"2024-09-14T11:09:53.019246+0000","last_active":"2024-09-14T11:49:33.253171+0000","last_peered":"2024-09-14T11:49:33.253171+0000","last_clean":"2024-09-14T11:49:33.253171+0000","last_became_active":"2024-09-14T11:09:53.018479+0000","last_became_peered":"2024-09-14T11:09:53.018479+0000","last_unstale":"2024-09-14T11:49:33.253171+0000","last_undegraded":"2024-09-14T11:49:33.253171+0000","last_fullsized":"2024-09-14T11:49:33.253171+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:01.598876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"264'128","reported_seq":631,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.390381+0000","last_change":"2024-09-14T11:09:55.029326+0000","last_active":"2024-09-14T11:52:29.390381+0000","last_peered":"2024-09-14T11:52:29.390381+0000","last_clean":"2024-09-14T11:52:29.390381+0000","last_became_active":"2024-09-14T11:09:55.028633+0000","last_became_peered":"2024-09-14T11:09:55.028633+0000","last_unstale":"2024-09-14T11:52:29.390381+0000","last_undegraded":"2024-09-14T11:52:29.390381+0000","last_fullsized":"2024-09-14T11:52:29.390381+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:48.218210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":141,"num_write":296,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"264'503","reported_seq":2213,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:10.824533+0000","last_change":"2024-09-14T11:09:46.964085+0000","last_active":"2024-09-14T11:52:10.824533+0000","last_peered":"2024-09-14T11:52:10.824533+0000","last_clean":"2024-09-14T11:52:10.824533+0000","last_became_active":"2024-09-14T11:09:46.962364+0000","last_became_peered":"2024-09-14T11:09:46.962364+0000","last_unstale":"2024-09-14T11:52:10.824533+0000","last_undegraded":"2024-09-14T11:52:10.824533+0000","last_fullsized":"2024-09-14T11:52:10.824533+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:39.362696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2859,"num_read_kb":2685,"num_write":625,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"264'225","reported_seq":845,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.883215+0000","last_change":"2024-09-14T11:09:45.208047+0000","last_active":"2024-09-14T11:50:58.883215+0000","last_peered":"2024-09-14T11:50:58.883215+0000","last_clean":"2024-09-14T11:50:58.883215+0000","last_became_active":"2024-09-14T11:09:45.206145+0000","last_became_peered":"2024-09-14T11:09:45.206145+0000","last_unstale":"2024-09-14T11:50:58.883215+0000","last_undegraded":"2024-09-14T11:50:58.883215+0000","last_fullsized":"2024-09-14T11:50:58.883215+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:19.451341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4518966,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":551,"num_read_kb":30372,"num_write":892,"num_write_kb":16933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"35'4","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.912643+0000","last_change":"2024-09-14T11:09:48.964002+0000","last_active":"2024-09-14T11:53:43.912643+0000","last_peered":"2024-09-14T11:53:43.912643+0000","last_clean":"2024-09-14T11:53:43.912643+0000","last_became_active":"2024-09-14T11:09:48.963563+0000","last_became_peered":"2024-09-14T11:09:48.963563+0000","last_unstale":"2024-09-14T11:53:43.912643+0000","last_undegraded":"2024-09-14T11:53:43.912643+0000","last_fullsized":"2024-09-14T11:53:43.912643+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:45.473064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":1192,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"264'121","reported_seq":678,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.300854+0000","last_change":"2024-09-14T11:09:50.989001+0000","last_active":"2024-09-14T11:51:53.300854+0000","last_peered":"2024-09-14T11:51:53.300854+0000","last_clean":"2024-09-14T11:51:53.300854+0000","last_became_active":"2024-09-14T11:09:50.988286+0000","last_became_peered":"2024-09-14T11:09:50.988286+0000","last_unstale":"2024-09-14T11:51:53.300854+0000","last_undegraded":"2024-09-14T11:51:53.300854+0000","last_fullsized":"2024-09-14T11:51:53.300854+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:38.798725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":138,"num_read_kb":176,"num_write":66,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:33.280996+0000","last_change":"2024-09-14T11:09:53.007660+0000","last_active":"2024-09-14T11:49:33.280996+0000","last_peered":"2024-09-14T11:49:33.280996+0000","last_clean":"2024-09-14T11:49:33.280996+0000","last_became_active":"2024-09-14T11:09:53.006975+0000","last_became_peered":"2024-09-14T11:09:53.006975+0000","last_unstale":"2024-09-14T11:49:33.280996+0000","last_undegraded":"2024-09-14T11:49:33.280996+0000","last_fullsized":"2024-09-14T11:49:33.280996+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:46.501395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"264'597","reported_seq":2244,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.185358+0000","last_change":"2024-09-14T11:09:46.975318+0000","last_active":"2024-09-14T11:52:12.185358+0000","last_peered":"2024-09-14T11:52:12.185358+0000","last_clean":"2024-09-14T11:52:12.185358+0000","last_became_active":"2024-09-14T11:09:46.975017+0000","last_became_peered":"2024-09-14T11:09:46.975017+0000","last_unstale":"2024-09-14T11:52:12.185358+0000","last_undegraded":"2024-09-14T11:52:12.185358+0000","last_fullsized":"2024-09-14T11:52:12.185358+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":500,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:58.187359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3191,"num_read_kb":2927,"num_write":756,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"264'271","reported_seq":952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:39.404770+0000","last_change":"2024-09-14T11:09:45.217804+0000","last_active":"2024-09-14T11:51:39.404770+0000","last_peered":"2024-09-14T11:51:39.404770+0000","last_clean":"2024-09-14T11:51:39.404770+0000","last_became_active":"2024-09-14T11:09:45.216742+0000","last_became_peered":"2024-09-14T11:09:45.216742+0000","last_unstale":"2024-09-14T11:51:39.404770+0000","last_undegraded":"2024-09-14T11:51:39.404770+0000","last_fullsized":"2024-09-14T11:51:39.404770+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:35.991962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24441949,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":734,"num_read_kb":84606,"num_write":1202,"num_write_kb":44892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:58.108916+0000","last_change":"2024-09-14T11:09:48.966915+0000","last_active":"2024-09-14T11:49:58.108916+0000","last_peered":"2024-09-14T11:49:58.108916+0000","last_clean":"2024-09-14T11:49:58.108916+0000","last_became_active":"2024-09-14T11:09:48.966112+0000","last_became_peered":"2024-09-14T11:09:48.966112+0000","last_unstale":"2024-09-14T11:49:58.108916+0000","last_undegraded":"2024-09-14T11:49:58.108916+0000","last_fullsized":"2024-09-14T11:49:58.108916+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:36.703419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"264'201","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.990059+0000","last_change":"2024-09-14T11:09:50.996090+0000","last_active":"2024-09-14T11:53:43.990059+0000","last_peered":"2024-09-14T11:53:43.990059+0000","last_clean":"2024-09-14T11:53:43.990059+0000","last_became_active":"2024-09-14T11:09:50.995279+0000","last_became_peered":"2024-09-14T11:09:50.995279+0000","last_unstale":"2024-09-14T11:53:43.990059+0000","last_undegraded":"2024-09-14T11:53:43.990059+0000","last_fullsized":"2024-09-14T11:53:43.990059+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:02.160055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30499,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":293,"num_read_kb":452,"num_write":190,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:54.086888+0000","last_change":"2024-09-14T11:09:53.003946+0000","last_active":"2024-09-14T11:49:54.086888+0000","last_peered":"2024-09-14T11:49:54.086888+0000","last_clean":"2024-09-14T11:49:54.086888+0000","last_became_active":"2024-09-14T11:09:53.002862+0000","last_became_peered":"2024-09-14T11:09:53.002862+0000","last_unstale":"2024-09-14T11:49:54.086888+0000","last_undegraded":"2024-09-14T11:49:54.086888+0000","last_fullsized":"2024-09-14T11:49:54.086888+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:50.669809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"264'167","reported_seq":666,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:33.637848+0000","last_change":"2024-09-14T11:09:55.024496+0000","last_active":"2024-09-14T11:51:33.637848+0000","last_peered":"2024-09-14T11:51:33.637848+0000","last_clean":"2024-09-14T11:51:33.637848+0000","last_became_active":"2024-09-14T11:09:55.023821+0000","last_became_peered":"2024-09-14T11:09:55.023821+0000","last_unstale":"2024-09-14T11:51:33.637848+0000","last_undegraded":"2024-09-14T11:51:33.637848+0000","last_fullsized":"2024-09-14T11:51:33.637848+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:18.416018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":195,"num_read_kb":205,"num_write":392,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"264'861","reported_seq":2612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:11.486672+0000","last_change":"2024-09-14T11:09:46.968180+0000","last_active":"2024-09-14T11:52:11.486672+0000","last_peered":"2024-09-14T11:52:11.486672+0000","last_clean":"2024-09-14T11:52:11.486672+0000","last_became_active":"2024-09-14T11:09:46.967144+0000","last_became_peered":"2024-09-14T11:09:46.967144+0000","last_unstale":"2024-09-14T11:52:11.486672+0000","last_undegraded":"2024-09-14T11:52:11.486672+0000","last_fullsized":"2024-09-14T11:52:11.486672+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":800,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:12.513360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4422,"num_read_kb":4033,"num_write":1158,"num_write_kb":453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"264'185","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:02.637290+0000","last_change":"2024-09-14T11:09:45.187524+0000","last_active":"2024-09-14T11:52:02.637290+0000","last_peered":"2024-09-14T11:52:02.637290+0000","last_clean":"2024-09-14T11:52:02.637290+0000","last_became_active":"2024-09-14T11:09:45.186745+0000","last_became_peered":"2024-09-14T11:09:45.186745+0000","last_unstale":"2024-09-14T11:52:02.637290+0000","last_undegraded":"2024-09-14T11:52:02.637290+0000","last_fullsized":"2024-09-14T11:52:02.637290+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:52.434620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7947278,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":533,"num_read_kb":5513,"num_write":843,"num_write_kb":29456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:29.109137+0000","last_change":"2024-09-14T11:09:48.952351+0000","last_active":"2024-09-14T11:51:29.109137+0000","last_peered":"2024-09-14T11:51:29.109137+0000","last_clean":"2024-09-14T11:51:29.109137+0000","last_became_active":"2024-09-14T11:09:48.951908+0000","last_became_peered":"2024-09-14T11:09:48.951908+0000","last_unstale":"2024-09-14T11:51:29.109137+0000","last_undegraded":"2024-09-14T11:51:29.109137+0000","last_fullsized":"2024-09-14T11:51:29.109137+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:14:06.155760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"264'162","reported_seq":734,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.124733+0000","last_change":"2024-09-14T11:09:50.986099+0000","last_active":"2024-09-14T11:53:43.124733+0000","last_peered":"2024-09-14T11:53:43.124733+0000","last_clean":"2024-09-14T11:53:43.124733+0000","last_became_active":"2024-09-14T11:09:50.983553+0000","last_became_peered":"2024-09-14T11:09:50.983553+0000","last_unstale":"2024-09-14T11:53:43.124733+0000","last_undegraded":"2024-09-14T11:53:43.124733+0000","last_fullsized":"2024-09-14T11:53:43.124733+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:45.407677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15672,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":216,"num_read_kb":289,"num_write":140,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.110650+0000","last_change":"2024-09-14T11:09:53.024431+0000","last_active":"2024-09-14T11:49:53.110650+0000","last_peered":"2024-09-14T11:49:53.110650+0000","last_clean":"2024-09-14T11:49:53.110650+0000","last_became_active":"2024-09-14T11:09:53.023609+0000","last_became_peered":"2024-09-14T11:09:53.023609+0000","last_unstale":"2024-09-14T11:49:53.110650+0000","last_undegraded":"2024-09-14T11:49:53.110650+0000","last_fullsized":"2024-09-14T11:49:53.110650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:43.568040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"264'155","reported_seq":651,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:28.256688+0000","last_change":"2024-09-14T11:09:55.029184+0000","last_active":"2024-09-14T11:52:28.256688+0000","last_peered":"2024-09-14T11:52:28.256688+0000","last_clean":"2024-09-14T11:52:28.256688+0000","last_became_active":"2024-09-14T11:09:55.028344+0000","last_became_peered":"2024-09-14T11:09:55.028344+0000","last_unstale":"2024-09-14T11:52:28.256688+0000","last_undegraded":"2024-09-14T11:52:28.256688+0000","last_fullsized":"2024-09-14T11:52:28.256688+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:09.622914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1619,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":178,"num_read_kb":177,"num_write":459,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"264'844","reported_seq":2442,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.991688+0000","last_change":"2024-09-14T11:09:46.991793+0000","last_active":"2024-09-14T11:52:09.991688+0000","last_peered":"2024-09-14T11:52:09.991688+0000","last_clean":"2024-09-14T11:52:09.991688+0000","last_became_active":"2024-09-14T11:09:46.990923+0000","last_became_peered":"2024-09-14T11:09:46.990923+0000","last_unstale":"2024-09-14T11:52:09.991688+0000","last_undegraded":"2024-09-14T11:52:09.991688+0000","last_fullsized":"2024-09-14T11:52:09.991688+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":800,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:14.204773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4067,"num_read_kb":3661,"num_write":1092,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"264'154","reported_seq":739,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:03.182820+0000","last_change":"2024-09-14T11:09:45.201353+0000","last_active":"2024-09-14T11:52:03.182820+0000","last_peered":"2024-09-14T11:52:03.182820+0000","last_clean":"2024-09-14T11:52:03.182820+0000","last_became_active":"2024-09-14T11:09:45.201058+0000","last_became_peered":"2024-09-14T11:09:45.201058+0000","last_unstale":"2024-09-14T11:52:03.182820+0000","last_undegraded":"2024-09-14T11:52:03.182820+0000","last_fullsized":"2024-09-14T11:52:03.182820+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:57.653038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3191097,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":348,"num_read_kb":4081,"num_write":725,"num_write_kb":11722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:49.085664+0000","last_change":"2024-09-14T11:09:48.969192+0000","last_active":"2024-09-14T11:49:49.085664+0000","last_peered":"2024-09-14T11:49:49.085664+0000","last_clean":"2024-09-14T11:49:49.085664+0000","last_became_active":"2024-09-14T11:09:48.968770+0000","last_became_peered":"2024-09-14T11:09:48.968770+0000","last_unstale":"2024-09-14T11:49:49.085664+0000","last_undegraded":"2024-09-14T11:49:49.085664+0000","last_fullsized":"2024-09-14T11:49:49.085664+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:32.471236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"264'129","reported_seq":697,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:38.157556+0000","last_change":"2024-09-14T11:09:50.999804+0000","last_active":"2024-09-14T11:53:38.157556+0000","last_peered":"2024-09-14T11:53:38.157556+0000","last_clean":"2024-09-14T11:53:38.157556+0000","last_became_active":"2024-09-14T11:09:50.999079+0000","last_became_peered":"2024-09-14T11:09:50.999079+0000","last_unstale":"2024-09-14T11:53:38.157556+0000","last_undegraded":"2024-09-14T11:53:38.157556+0000","last_fullsized":"2024-09-14T11:53:38.157556+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:44.334838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11391,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":166,"num_read_kb":224,"num_write":88,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:58.286481+0000","last_change":"2024-09-14T11:09:53.009600+0000","last_active":"2024-09-14T11:49:58.286481+0000","last_peered":"2024-09-14T11:49:58.286481+0000","last_clean":"2024-09-14T11:49:58.286481+0000","last_became_active":"2024-09-14T11:09:53.008952+0000","last_became_peered":"2024-09-14T11:09:53.008952+0000","last_unstale":"2024-09-14T11:49:58.286481+0000","last_undegraded":"2024-09-14T11:49:58.286481+0000","last_fullsized":"2024-09-14T11:49:58.286481+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:04.350006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"264'141","reported_seq":633,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.047202+0000","last_change":"2024-09-14T11:09:55.029152+0000","last_active":"2024-09-14T11:53:44.047202+0000","last_peered":"2024-09-14T11:53:44.047202+0000","last_clean":"2024-09-14T11:53:44.047202+0000","last_became_active":"2024-09-14T11:09:55.028413+0000","last_became_peered":"2024-09-14T11:09:55.028413+0000","last_unstale":"2024-09-14T11:53:44.047202+0000","last_undegraded":"2024-09-14T11:53:44.047202+0000","last_fullsized":"2024-09-14T11:53:44.047202+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:42.297511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":142,"num_write":355,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"264'420","reported_seq":1977,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.106262+0000","last_change":"2024-09-14T11:09:46.987394+0000","last_active":"2024-09-14T11:53:43.106262+0000","last_peered":"2024-09-14T11:53:43.106262+0000","last_clean":"2024-09-14T11:53:43.106262+0000","last_became_active":"2024-09-14T11:09:46.986721+0000","last_became_peered":"2024-09-14T11:09:46.986721+0000","last_unstale":"2024-09-14T11:53:43.106262+0000","last_undegraded":"2024-09-14T11:53:43.106262+0000","last_fullsized":"2024-09-14T11:53:43.106262+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:07.328123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2241,"num_read_kb":2140,"num_write":472,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"264'223","reported_seq":827,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:23.995381+0000","last_change":"2024-09-14T11:09:45.212627+0000","last_active":"2024-09-14T11:52:23.995381+0000","last_peered":"2024-09-14T11:52:23.995381+0000","last_clean":"2024-09-14T11:52:23.995381+0000","last_became_active":"2024-09-14T11:09:45.211984+0000","last_became_peered":"2024-09-14T11:09:45.211984+0000","last_unstale":"2024-09-14T11:52:23.995381+0000","last_undegraded":"2024-09-14T11:52:23.995381+0000","last_fullsized":"2024-09-14T11:52:23.995381+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:55.366169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4547637,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":501,"num_read_kb":8662,"num_write":1128,"num_write_kb":22372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.104342+0000","last_change":"2024-09-14T11:09:48.969193+0000","last_active":"2024-09-14T11:49:48.104342+0000","last_peered":"2024-09-14T11:49:48.104342+0000","last_clean":"2024-09-14T11:49:48.104342+0000","last_became_active":"2024-09-14T11:09:48.968459+0000","last_became_peered":"2024-09-14T11:09:48.968459+0000","last_unstale":"2024-09-14T11:49:48.104342+0000","last_undegraded":"2024-09-14T11:49:48.104342+0000","last_fullsized":"2024-09-14T11:49:48.104342+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:25.826727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"264'96","reported_seq":611,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:59.338693+0000","last_change":"2024-09-14T11:09:50.980469+0000","last_active":"2024-09-14T11:51:59.338693+0000","last_peered":"2024-09-14T11:51:59.338693+0000","last_clean":"2024-09-14T11:51:59.338693+0000","last_became_active":"2024-09-14T11:09:50.979749+0000","last_became_peered":"2024-09-14T11:09:50.979749+0000","last_unstale":"2024-09-14T11:51:59.338693+0000","last_undegraded":"2024-09-14T11:51:59.338693+0000","last_fullsized":"2024-09-14T11:51:59.338693+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:58.555300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":88,"num_read_kb":80,"num_write":70,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"264'780","reported_seq":4297,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.069817+0000","last_change":"2024-09-14T11:09:53.017293+0000","last_active":"2024-09-14T11:53:44.069817+0000","last_peered":"2024-09-14T11:53:44.069817+0000","last_clean":"2024-09-14T11:53:44.069817+0000","last_became_active":"2024-09-14T11:09:53.014955+0000","last_became_peered":"2024-09-14T11:09:53.014955+0000","last_unstale":"2024-09-14T11:53:44.069817+0000","last_undegraded":"2024-09-14T11:53:44.069817+0000","last_fullsized":"2024-09-14T11:53:44.069817+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:13.437678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"264'92","reported_seq":581,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.473000+0000","last_change":"2024-09-14T11:09:55.030910+0000","last_active":"2024-09-14T11:52:29.473000+0000","last_peered":"2024-09-14T11:52:29.473000+0000","last_clean":"2024-09-14T11:52:29.473000+0000","last_became_active":"2024-09-14T11:09:55.030211+0000","last_became_peered":"2024-09-14T11:09:55.030211+0000","last_unstale":"2024-09-14T11:52:29.473000+0000","last_undegraded":"2024-09-14T11:52:29.473000+0000","last_fullsized":"2024-09-14T11:52:29.473000+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:19.664371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":87,"num_write":222,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"264'455","reported_seq":1998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:27.186133+0000","last_change":"2024-09-14T11:09:46.975329+0000","last_active":"2024-09-14T11:52:27.186133+0000","last_peered":"2024-09-14T11:52:27.186133+0000","last_clean":"2024-09-14T11:52:27.186133+0000","last_became_active":"2024-09-14T11:09:46.974957+0000","last_became_peered":"2024-09-14T11:09:46.974957+0000","last_unstale":"2024-09-14T11:52:27.186133+0000","last_undegraded":"2024-09-14T11:52:27.186133+0000","last_fullsized":"2024-09-14T11:52:27.186133+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:48.632851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2398,"num_read_kb":2260,"num_write":532,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"264'297","reported_seq":989,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:38.249897+0000","last_change":"2024-09-14T11:09:45.205274+0000","last_active":"2024-09-14T11:51:38.249897+0000","last_peered":"2024-09-14T11:51:38.249897+0000","last_clean":"2024-09-14T11:51:38.249897+0000","last_became_active":"2024-09-14T11:09:45.204014+0000","last_became_peered":"2024-09-14T11:09:45.204014+0000","last_unstale":"2024-09-14T11:51:38.249897+0000","last_undegraded":"2024-09-14T11:51:38.249897+0000","last_fullsized":"2024-09-14T11:51:38.249897+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:53.629440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5292169,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":838,"num_read_kb":35877,"num_write":1468,"num_write_kb":50924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.256593+0000","last_change":"2024-09-14T11:09:48.950935+0000","last_active":"2024-09-14T11:49:48.256593+0000","last_peered":"2024-09-14T11:49:48.256593+0000","last_clean":"2024-09-14T11:49:48.256593+0000","last_became_active":"2024-09-14T11:09:48.950445+0000","last_became_peered":"2024-09-14T11:09:48.950445+0000","last_unstale":"2024-09-14T11:49:48.256593+0000","last_undegraded":"2024-09-14T11:49:48.256593+0000","last_fullsized":"2024-09-14T11:49:48.256593+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:53.596593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"264'163","reported_seq":735,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:28.318140+0000","last_change":"2024-09-14T11:09:50.992957+0000","last_active":"2024-09-14T11:53:28.318140+0000","last_peered":"2024-09-14T11:53:28.318140+0000","last_clean":"2024-09-14T11:53:28.318140+0000","last_became_active":"2024-09-14T11:09:50.992216+0000","last_became_peered":"2024-09-14T11:09:50.992216+0000","last_unstale":"2024-09-14T11:53:28.318140+0000","last_undegraded":"2024-09-14T11:53:28.318140+0000","last_fullsized":"2024-09-14T11:53:28.318140+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:17.396343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63403,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":228,"num_read_kb":431,"num_write":140,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.119821+0000","last_change":"2024-09-14T11:09:53.024153+0000","last_active":"2024-09-14T11:50:58.119821+0000","last_peered":"2024-09-14T11:50:58.119821+0000","last_clean":"2024-09-14T11:50:58.119821+0000","last_became_active":"2024-09-14T11:09:53.023492+0000","last_became_peered":"2024-09-14T11:09:53.023492+0000","last_unstale":"2024-09-14T11:50:58.119821+0000","last_undegraded":"2024-09-14T11:50:58.119821+0000","last_fullsized":"2024-09-14T11:50:58.119821+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:38.239379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"264'112","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.759177+0000","last_change":"2024-09-14T11:09:55.027867+0000","last_active":"2024-09-14T11:52:12.759177+0000","last_peered":"2024-09-14T11:52:12.759177+0000","last_clean":"2024-09-14T11:52:12.759177+0000","last_became_active":"2024-09-14T11:09:55.027044+0000","last_became_peered":"2024-09-14T11:09:55.027044+0000","last_unstale":"2024-09-14T11:52:12.759177+0000","last_undegraded":"2024-09-14T11:52:12.759177+0000","last_fullsized":"2024-09-14T11:52:12.759177+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:52.809691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":137,"num_read_kb":126,"num_write":268,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"264'782","reported_seq":2408,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.105257+0000","last_change":"2024-09-14T11:09:46.981979+0000","last_active":"2024-09-14T11:53:43.105257+0000","last_peered":"2024-09-14T11:53:43.105257+0000","last_clean":"2024-09-14T11:53:43.105257+0000","last_became_active":"2024-09-14T11:09:46.981651+0000","last_became_peered":"2024-09-14T11:09:46.981651+0000","last_unstale":"2024-09-14T11:53:43.105257+0000","last_undegraded":"2024-09-14T11:53:43.105257+0000","last_fullsized":"2024-09-14T11:53:43.105257+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:26.806380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3785,"num_read_kb":3457,"num_write":1011,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"264'234","reported_seq":873,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.448644+0000","last_change":"2024-09-14T11:09:45.215434+0000","last_active":"2024-09-14T11:51:07.448644+0000","last_peered":"2024-09-14T11:51:07.448644+0000","last_clean":"2024-09-14T11:51:07.448644+0000","last_became_active":"2024-09-14T11:09:45.215127+0000","last_became_peered":"2024-09-14T11:09:45.215127+0000","last_unstale":"2024-09-14T11:51:07.448644+0000","last_undegraded":"2024-09-14T11:51:07.448644+0000","last_fullsized":"2024-09-14T11:51:07.448644+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:09.892252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10094310,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":577,"num_read_kb":34627,"num_write":1008,"num_write_kb":52307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:49.085600+0000","last_change":"2024-09-14T11:09:48.960423+0000","last_active":"2024-09-14T11:49:49.085600+0000","last_peered":"2024-09-14T11:49:49.085600+0000","last_clean":"2024-09-14T11:49:49.085600+0000","last_became_active":"2024-09-14T11:09:48.960006+0000","last_became_peered":"2024-09-14T11:09:48.960006+0000","last_unstale":"2024-09-14T11:49:49.085600+0000","last_undegraded":"2024-09-14T11:49:49.085600+0000","last_fullsized":"2024-09-14T11:49:49.085600+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:12.246125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"264'113","reported_seq":675,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:23.152415+0000","last_change":"2024-09-14T11:09:50.976371+0000","last_active":"2024-09-14T11:53:23.152415+0000","last_peered":"2024-09-14T11:53:23.152415+0000","last_clean":"2024-09-14T11:53:23.152415+0000","last_became_active":"2024-09-14T11:09:50.975555+0000","last_became_peered":"2024-09-14T11:09:50.975555+0000","last_unstale":"2024-09-14T11:53:23.152415+0000","last_undegraded":"2024-09-14T11:53:23.152415+0000","last_fullsized":"2024-09-14T11:53:23.152415+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:50.238466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9691,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":147,"num_read_kb":200,"num_write":74,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:04.321551+0000","last_change":"2024-09-14T11:09:53.015898+0000","last_active":"2024-09-14T11:51:04.321551+0000","last_peered":"2024-09-14T11:51:04.321551+0000","last_clean":"2024-09-14T11:51:04.321551+0000","last_became_active":"2024-09-14T11:09:53.015039+0000","last_became_peered":"2024-09-14T11:09:53.015039+0000","last_unstale":"2024-09-14T11:51:04.321551+0000","last_undegraded":"2024-09-14T11:51:04.321551+0000","last_fullsized":"2024-09-14T11:51:04.321551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:00.423028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"264'92","reported_seq":601,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:02.725541+0000","last_change":"2024-09-14T11:09:55.014762+0000","last_active":"2024-09-14T11:52:02.725541+0000","last_peered":"2024-09-14T11:52:02.725541+0000","last_clean":"2024-09-14T11:52:02.725541+0000","last_became_active":"2024-09-14T11:09:55.013997+0000","last_became_peered":"2024-09-14T11:09:55.013997+0000","last_unstale":"2024-09-14T11:52:02.725541+0000","last_undegraded":"2024-09-14T11:52:02.725541+0000","last_fullsized":"2024-09-14T11:52:02.725541+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:30.820459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":557,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":129,"num_write":227,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"264'1274","reported_seq":2882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.101805+0000","last_change":"2024-09-14T11:09:46.983515+0000","last_active":"2024-09-14T11:53:43.101805+0000","last_peered":"2024-09-14T11:53:43.101805+0000","last_clean":"2024-09-14T11:53:43.101805+0000","last_became_active":"2024-09-14T11:09:46.982770+0000","last_became_peered":"2024-09-14T11:09:46.982770+0000","last_unstale":"2024-09-14T11:53:43.101805+0000","last_undegraded":"2024-09-14T11:53:43.101805+0000","last_fullsized":"2024-09-14T11:53:43.101805+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":1200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:32.470386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5800,"num_read_kb":5089,"num_write":1775,"num_write_kb":736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"264'197","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.137925+0000","last_change":"2024-09-14T11:09:45.202528+0000","last_active":"2024-09-14T11:51:53.137925+0000","last_peered":"2024-09-14T11:51:53.137925+0000","last_clean":"2024-09-14T11:51:53.137925+0000","last_became_active":"2024-09-14T11:09:45.200971+0000","last_became_peered":"2024-09-14T11:09:45.200971+0000","last_unstale":"2024-09-14T11:51:53.137925+0000","last_undegraded":"2024-09-14T11:51:53.137925+0000","last_fullsized":"2024-09-14T11:51:53.137925+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:27.327496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16352802,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":495,"num_read_kb":61081,"num_write":898,"num_write_kb":39968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.270083+0000","last_change":"2024-09-14T11:09:48.958590+0000","last_active":"2024-09-14T11:50:53.270083+0000","last_peered":"2024-09-14T11:50:53.270083+0000","last_clean":"2024-09-14T11:50:53.270083+0000","last_became_active":"2024-09-14T11:09:48.958168+0000","last_became_peered":"2024-09-14T11:09:48.958168+0000","last_unstale":"2024-09-14T11:50:53.270083+0000","last_undegraded":"2024-09-14T11:50:53.270083+0000","last_fullsized":"2024-09-14T11:50:53.270083+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:39.133475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"264'101","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:23.140946+0000","last_change":"2024-09-14T11:09:50.999672+0000","last_active":"2024-09-14T11:52:23.140946+0000","last_peered":"2024-09-14T11:52:23.140946+0000","last_clean":"2024-09-14T11:52:23.140946+0000","last_became_active":"2024-09-14T11:09:50.998951+0000","last_became_peered":"2024-09-14T11:09:50.998951+0000","last_unstale":"2024-09-14T11:52:23.140946+0000","last_undegraded":"2024-09-14T11:52:23.140946+0000","last_fullsized":"2024-09-14T11:52:23.140946+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:34.380499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8841,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":118,"num_write":56,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:54.302639+0000","last_change":"2024-09-14T11:09:53.022344+0000","last_active":"2024-09-14T11:49:54.302639+0000","last_peered":"2024-09-14T11:49:54.302639+0000","last_clean":"2024-09-14T11:49:54.302639+0000","last_became_active":"2024-09-14T11:09:53.021595+0000","last_became_peered":"2024-09-14T11:09:53.021595+0000","last_unstale":"2024-09-14T11:49:54.302639+0000","last_undegraded":"2024-09-14T11:49:54.302639+0000","last_fullsized":"2024-09-14T11:49:54.302639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:34.894553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"264'187","reported_seq":1643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:27.560080+0000","last_change":"2024-09-14T11:09:55.029111+0000","last_active":"2024-09-14T11:52:27.560080+0000","last_peered":"2024-09-14T11:52:27.560080+0000","last_clean":"2024-09-14T11:52:27.560080+0000","last_became_active":"2024-09-14T11:09:55.028374+0000","last_became_peered":"2024-09-14T11:09:55.028374+0000","last_unstale":"2024-09-14T11:52:27.560080+0000","last_undegraded":"2024-09-14T11:52:27.560080+0000","last_fullsized":"2024-09-14T11:52:27.560080+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:11.828167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":650,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1185,"num_read_kb":1180,"num_write":425,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"264'675","reported_seq":2433,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.024596+0000","last_change":"2024-09-14T11:09:46.946536+0000","last_active":"2024-09-14T11:52:09.024596+0000","last_peered":"2024-09-14T11:52:09.024596+0000","last_clean":"2024-09-14T11:52:09.024596+0000","last_became_active":"2024-09-14T11:09:46.946243+0000","last_became_peered":"2024-09-14T11:09:46.946243+0000","last_unstale":"2024-09-14T11:52:09.024596+0000","last_undegraded":"2024-09-14T11:52:09.024596+0000","last_fullsized":"2024-09-14T11:52:09.024596+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":600,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:11.897413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3815,"num_read_kb":3478,"num_write":980,"num_write_kb":450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"264'176","reported_seq":802,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:28.132006+0000","last_change":"2024-09-14T11:09:45.204307+0000","last_active":"2024-09-14T11:51:28.132006+0000","last_peered":"2024-09-14T11:51:28.132006+0000","last_clean":"2024-09-14T11:51:28.132006+0000","last_became_active":"2024-09-14T11:09:45.201929+0000","last_became_peered":"2024-09-14T11:09:45.201929+0000","last_unstale":"2024-09-14T11:51:28.132006+0000","last_undegraded":"2024-09-14T11:51:28.132006+0000","last_fullsized":"2024-09-14T11:51:28.132006+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:36.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10510500,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":506,"num_read_kb":13055,"num_write":798,"num_write_kb":29760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.119882+0000","last_change":"2024-09-14T11:09:48.963841+0000","last_active":"2024-09-14T11:50:58.119882+0000","last_peered":"2024-09-14T11:50:58.119882+0000","last_clean":"2024-09-14T11:50:58.119882+0000","last_became_active":"2024-09-14T11:09:48.963104+0000","last_became_peered":"2024-09-14T11:09:48.963104+0000","last_unstale":"2024-09-14T11:50:58.119882+0000","last_undegraded":"2024-09-14T11:50:58.119882+0000","last_fullsized":"2024-09-14T11:50:58.119882+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:46.912247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"264'160","reported_seq":733,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.650625+0000","last_change":"2024-09-14T11:09:50.984507+0000","last_active":"2024-09-14T11:52:29.650625+0000","last_peered":"2024-09-14T11:52:29.650625+0000","last_clean":"2024-09-14T11:52:29.650625+0000","last_became_active":"2024-09-14T11:09:50.983753+0000","last_became_peered":"2024-09-14T11:09:50.983753+0000","last_unstale":"2024-09-14T11:52:29.650625+0000","last_undegraded":"2024-09-14T11:52:29.650625+0000","last_fullsized":"2024-09-14T11:52:29.650625+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:29.921471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":197,"num_read_kb":235,"num_write":112,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.105515+0000","last_change":"2024-09-14T11:09:53.011871+0000","last_active":"2024-09-14T11:49:53.105515+0000","last_peered":"2024-09-14T11:49:53.105515+0000","last_clean":"2024-09-14T11:49:53.105515+0000","last_became_active":"2024-09-14T11:09:53.011077+0000","last_became_peered":"2024-09-14T11:09:53.011077+0000","last_unstale":"2024-09-14T11:49:53.105515+0000","last_undegraded":"2024-09-14T11:49:53.105515+0000","last_fullsized":"2024-09-14T11:49:53.105515+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:50.394891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"264'163","reported_seq":662,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.100745+0000","last_change":"2024-09-14T11:09:55.022425+0000","last_active":"2024-09-14T11:53:43.100745+0000","last_peered":"2024-09-14T11:53:43.100745+0000","last_clean":"2024-09-14T11:53:43.100745+0000","last_became_active":"2024-09-14T11:09:55.021523+0000","last_became_peered":"2024-09-14T11:09:55.021523+0000","last_unstale":"2024-09-14T11:53:43.100745+0000","last_undegraded":"2024-09-14T11:53:43.100745+0000","last_fullsized":"2024-09-14T11:53:43.100745+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:10.987076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1072,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":209,"num_read_kb":183,"num_write":413,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"264'928","reported_seq":2647,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:05.437021+0000","last_change":"2024-09-14T11:09:46.957177+0000","last_active":"2024-09-14T11:52:05.437021+0000","last_peered":"2024-09-14T11:52:05.437021+0000","last_clean":"2024-09-14T11:52:05.437021+0000","last_became_active":"2024-09-14T11:09:46.951108+0000","last_became_peered":"2024-09-14T11:09:46.951108+0000","last_unstale":"2024-09-14T11:52:05.437021+0000","last_undegraded":"2024-09-14T11:52:05.437021+0000","last_fullsized":"2024-09-14T11:52:05.437021+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":900,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:15.810066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6915,"num_read_kb":6425,"num_write":1478,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"264'226","reported_seq":909,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:03.957306+0000","last_change":"2024-09-14T11:09:45.211877+0000","last_active":"2024-09-14T11:52:03.957306+0000","last_peered":"2024-09-14T11:52:03.957306+0000","last_clean":"2024-09-14T11:52:03.957306+0000","last_became_active":"2024-09-14T11:09:45.211372+0000","last_became_peered":"2024-09-14T11:09:45.211372+0000","last_unstale":"2024-09-14T11:52:03.957306+0000","last_undegraded":"2024-09-14T11:52:03.957306+0000","last_fullsized":"2024-09-14T11:52:03.957306+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:24.226008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485807,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":696,"num_read_kb":62622,"num_write":1038,"num_write_kb":26227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"264'1160","reported_seq":2864,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.122773+0000","last_change":"2024-09-14T11:09:46.972638+0000","last_active":"2024-09-14T11:53:43.122773+0000","last_peered":"2024-09-14T11:53:43.122773+0000","last_clean":"2024-09-14T11:53:43.122773+0000","last_became_active":"2024-09-14T11:09:46.970185+0000","last_became_peered":"2024-09-14T11:09:46.970185+0000","last_unstale":"2024-09-14T11:53:43.122773+0000","last_undegraded":"2024-09-14T11:53:43.122773+0000","last_fullsized":"2024-09-14T11:53:43.122773+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":1100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:13.563147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5490,"num_read_kb":4916,"num_write":1574,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"264'225","reported_seq":841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:39.752105+0000","last_change":"2024-09-14T11:09:45.213947+0000","last_active":"2024-09-14T11:51:39.752105+0000","last_peered":"2024-09-14T11:51:39.752105+0000","last_clean":"2024-09-14T11:51:39.752105+0000","last_became_active":"2024-09-14T11:09:45.213238+0000","last_became_peered":"2024-09-14T11:09:45.213238+0000","last_unstale":"2024-09-14T11:51:39.752105+0000","last_undegraded":"2024-09-14T11:51:39.752105+0000","last_fullsized":"2024-09-14T11:51:39.752105+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:01.403575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4345424,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":549,"num_read_kb":930,"num_write":1097,"num_write_kb":31959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"264'418","reported_seq":1946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.040689+0000","last_change":"2024-09-14T11:09:46.958429+0000","last_active":"2024-09-14T11:52:29.040689+0000","last_peered":"2024-09-14T11:52:29.040689+0000","last_clean":"2024-09-14T11:52:29.040689+0000","last_became_active":"2024-09-14T11:09:46.958063+0000","last_became_peered":"2024-09-14T11:09:46.958063+0000","last_unstale":"2024-09-14T11:52:29.040689+0000","last_undegraded":"2024-09-14T11:52:29.040689+0000","last_fullsized":"2024-09-14T11:52:29.040689+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:19.646752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2247,"num_read_kb":2131,"num_write":481,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"264'218","reported_seq":1029,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:41.626756+0000","last_change":"2024-09-14T11:09:45.217514+0000","last_active":"2024-09-14T11:51:41.626756+0000","last_peered":"2024-09-14T11:51:41.626756+0000","last_clean":"2024-09-14T11:51:41.626756+0000","last_became_active":"2024-09-14T11:09:45.217258+0000","last_became_peered":"2024-09-14T11:09:45.217258+0000","last_unstale":"2024-09-14T11:51:41.626756+0000","last_undegraded":"2024-09-14T11:51:41.626756+0000","last_fullsized":"2024-09-14T11:51:41.626756+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:19.368373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5739023,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1087,"num_read_kb":14899,"num_write":1040,"num_write_kb":43826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"264'404","reported_seq":1918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:01.518761+0000","last_change":"2024-09-14T11:09:46.988480+0000","last_active":"2024-09-14T11:52:01.518761+0000","last_peered":"2024-09-14T11:52:01.518761+0000","last_clean":"2024-09-14T11:52:01.518761+0000","last_became_active":"2024-09-14T11:09:46.987465+0000","last_became_peered":"2024-09-14T11:09:46.987465+0000","last_unstale":"2024-09-14T11:52:01.518761+0000","last_undegraded":"2024-09-14T11:52:01.518761+0000","last_fullsized":"2024-09-14T11:52:01.518761+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:19.420609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2188,"num_read_kb":2091,"num_write":479,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"264'206","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:42.436145+0000","last_change":"2024-09-14T11:09:45.211461+0000","last_active":"2024-09-14T11:53:42.436145+0000","last_peered":"2024-09-14T11:53:42.436145+0000","last_clean":"2024-09-14T11:53:42.436145+0000","last_became_active":"2024-09-14T11:09:45.210754+0000","last_became_peered":"2024-09-14T11:09:45.210754+0000","last_unstale":"2024-09-14T11:53:42.436145+0000","last_undegraded":"2024-09-14T11:53:42.436145+0000","last_fullsized":"2024-09-14T11:53:42.436145+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:08.664534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4800463,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":504,"num_read_kb":979,"num_write":952,"num_write_kb":15237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"264'391","reported_seq":1908,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.025531+0000","last_change":"2024-09-14T11:09:46.975727+0000","last_active":"2024-09-14T11:52:09.025531+0000","last_peered":"2024-09-14T11:52:09.025531+0000","last_clean":"2024-09-14T11:52:09.025531+0000","last_became_active":"2024-09-14T11:09:46.975006+0000","last_became_peered":"2024-09-14T11:09:46.975006+0000","last_unstale":"2024-09-14T11:52:09.025531+0000","last_undegraded":"2024-09-14T11:52:09.025531+0000","last_fullsized":"2024-09-14T11:52:09.025531+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:24:31.291575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2194,"num_read_kb":2087,"num_write":454,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"264'200","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.121949+0000","last_change":"2024-09-14T11:09:45.211325+0000","last_active":"2024-09-14T11:50:58.121949+0000","last_peered":"2024-09-14T11:50:58.121949+0000","last_clean":"2024-09-14T11:50:58.121949+0000","last_became_active":"2024-09-14T11:09:45.210639+0000","last_became_peered":"2024-09-14T11:09:45.210639+0000","last_unstale":"2024-09-14T11:50:58.121949+0000","last_undegraded":"2024-09-14T11:50:58.121949+0000","last_fullsized":"2024-09-14T11:50:58.121949+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:20.581618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4805200,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":484,"num_read_kb":12081,"num_write":973,"num_write_kb":34333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"264'842","reported_seq":2510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.040766+0000","last_change":"2024-09-14T11:09:46.961466+0000","last_active":"2024-09-14T11:52:29.040766+0000","last_peered":"2024-09-14T11:52:29.040766+0000","last_clean":"2024-09-14T11:52:29.040766+0000","last_became_active":"2024-09-14T11:09:46.961185+0000","last_became_peered":"2024-09-14T11:09:46.961185+0000","last_unstale":"2024-09-14T11:52:29.040766+0000","last_undegraded":"2024-09-14T11:52:29.040766+0000","last_fullsized":"2024-09-14T11:52:29.040766+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:08.248591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4099,"num_read_kb":3707,"num_write":1108,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"264'185","reported_seq":793,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.122073+0000","last_change":"2024-09-14T11:09:45.220791+0000","last_active":"2024-09-14T11:50:58.122073+0000","last_peered":"2024-09-14T11:50:58.122073+0000","last_clean":"2024-09-14T11:50:58.122073+0000","last_became_active":"2024-09-14T11:09:45.220246+0000","last_became_peered":"2024-09-14T11:09:45.220246+0000","last_unstale":"2024-09-14T11:50:58.122073+0000","last_undegraded":"2024-09-14T11:50:58.122073+0000","last_fullsized":"2024-09-14T11:50:58.122073+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:36.399604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9461910,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":447,"num_read_kb":10292,"num_write":860,"num_write_kb":29061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"264'671","reported_seq":2011,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.647214+0000","last_change":"2024-09-14T11:09:46.991359+0000","last_active":"2024-09-14T11:52:29.647214+0000","last_peered":"2024-09-14T11:52:29.647214+0000","last_clean":"2024-09-14T11:52:29.647214+0000","last_became_active":"2024-09-14T11:09:46.990649+0000","last_became_peered":"2024-09-14T11:09:46.990649+0000","last_unstale":"2024-09-14T11:52:29.647214+0000","last_undegraded":"2024-09-14T11:52:29.647214+0000","last_fullsized":"2024-09-14T11:52:29.647214+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":600,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:23.410718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3174,"num_read_kb":2866,"num_write":894,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"264'229","reported_seq":888,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:30.553802+0000","last_change":"2024-09-14T11:09:45.208096+0000","last_active":"2024-09-14T11:51:30.553802+0000","last_peered":"2024-09-14T11:51:30.553802+0000","last_clean":"2024-09-14T11:51:30.553802+0000","last_became_active":"2024-09-14T11:09:45.207500+0000","last_became_peered":"2024-09-14T11:09:45.207500+0000","last_unstale":"2024-09-14T11:51:30.553802+0000","last_undegraded":"2024-09-14T11:51:30.553802+0000","last_fullsized":"2024-09-14T11:51:30.553802+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:22.993861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5269028,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":639,"num_read_kb":28771,"num_write":1106,"num_write_kb":28685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"264'2088","reported_seq":3859,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:56.236839+0000","last_change":"2024-09-14T11:09:46.965260+0000","last_active":"2024-09-14T11:51:56.236839+0000","last_peered":"2024-09-14T11:51:56.236839+0000","last_clean":"2024-09-14T11:51:56.236839+0000","last_became_active":"2024-09-14T11:09:46.964893+0000","last_became_peered":"2024-09-14T11:09:46.964893+0000","last_unstale":"2024-09-14T11:51:56.236839+0000","last_undegraded":"2024-09-14T11:51:56.236839+0000","last_fullsized":"2024-09-14T11:51:56.236839+0000","mapping_epoch":25,"log_start":"264'2000","ondisk_log_start":"264'2000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":2000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:34.137174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9234,"num_read_kb":7993,"num_write":3022,"num_write_kb":1347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"264'273","reported_seq":972,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:44.371191+0000","last_change":"2024-09-14T11:09:45.204674+0000","last_active":"2024-09-14T11:51:44.371191+0000","last_peered":"2024-09-14T11:51:44.371191+0000","last_clean":"2024-09-14T11:51:44.371191+0000","last_became_active":"2024-09-14T11:09:45.201951+0000","last_became_peered":"2024-09-14T11:09:45.201951+0000","last_unstale":"2024-09-14T11:51:44.371191+0000","last_undegraded":"2024-09-14T11:51:44.371191+0000","last_fullsized":"2024-09-14T11:51:44.371191+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:52.455396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8461868,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":871,"num_read_kb":20954,"num_write":1188,"num_write_kb":48388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"264'393","reported_seq":1898,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:11.468367+0000","last_change":"2024-09-14T11:09:46.983040+0000","last_active":"2024-09-14T11:52:11.468367+0000","last_peered":"2024-09-14T11:52:11.468367+0000","last_clean":"2024-09-14T11:52:11.468367+0000","last_became_active":"2024-09-14T11:09:46.982125+0000","last_became_peered":"2024-09-14T11:09:46.982125+0000","last_unstale":"2024-09-14T11:52:11.468367+0000","last_undegraded":"2024-09-14T11:52:11.468367+0000","last_fullsized":"2024-09-14T11:52:11.468367+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:20.751819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2124,"num_read_kb":2027,"num_write":431,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"264'241","reported_seq":918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:11.388203+0000","last_change":"2024-09-14T11:09:45.220108+0000","last_active":"2024-09-14T11:52:11.388203+0000","last_peered":"2024-09-14T11:52:11.388203+0000","last_clean":"2024-09-14T11:52:11.388203+0000","last_became_active":"2024-09-14T11:09:45.219634+0000","last_became_peered":"2024-09-14T11:09:45.219634+0000","last_unstale":"2024-09-14T11:52:11.388203+0000","last_undegraded":"2024-09-14T11:52:11.388203+0000","last_fullsized":"2024-09-14T11:52:11.388203+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:17.207975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14933608,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":695,"num_read_kb":35580,"num_write":1134,"num_write_kb":63455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"264'544","reported_seq":2093,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:11.466077+0000","last_change":"2024-09-14T11:09:46.962608+0000","last_active":"2024-09-14T11:52:11.466077+0000","last_peered":"2024-09-14T11:52:11.466077+0000","last_clean":"2024-09-14T11:52:11.466077+0000","last_became_active":"2024-09-14T11:09:46.962261+0000","last_became_peered":"2024-09-14T11:09:46.962261+0000","last_unstale":"2024-09-14T11:52:11.466077+0000","last_undegraded":"2024-09-14T11:52:11.466077+0000","last_fullsized":"2024-09-14T11:52:11.466077+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:09.235080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2646,"num_read_kb":2439,"num_write":661,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"264'213","reported_seq":848,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:38.568110+0000","last_change":"2024-09-14T11:09:45.202616+0000","last_active":"2024-09-14T11:51:38.568110+0000","last_peered":"2024-09-14T11:51:38.568110+0000","last_clean":"2024-09-14T11:51:38.568110+0000","last_became_active":"2024-09-14T11:09:45.200775+0000","last_became_peered":"2024-09-14T11:09:45.200775+0000","last_unstale":"2024-09-14T11:51:38.568110+0000","last_undegraded":"2024-09-14T11:51:38.568110+0000","last_fullsized":"2024-09-14T11:51:38.568110+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:14:20.167362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5571647,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":532,"num_read_kb":33597,"num_write":1019,"num_write_kb":35359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"264'563","reported_seq":2409,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.766645+0000","last_change":"2024-09-14T11:09:46.975288+0000","last_active":"2024-09-14T11:52:12.766645+0000","last_peered":"2024-09-14T11:52:12.766645+0000","last_clean":"2024-09-14T11:52:12.766645+0000","last_became_active":"2024-09-14T11:09:46.974543+0000","last_became_peered":"2024-09-14T11:09:46.974543+0000","last_unstale":"2024-09-14T11:52:12.766645+0000","last_undegraded":"2024-09-14T11:52:12.766645+0000","last_fullsized":"2024-09-14T11:52:12.766645+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:10.907592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3309,"num_read_kb":3115,"num_write":715,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"264'205","reported_seq":836,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:39.573155+0000","last_change":"2024-09-14T11:09:45.205037+0000","last_active":"2024-09-14T11:51:39.573155+0000","last_peered":"2024-09-14T11:51:39.573155+0000","last_clean":"2024-09-14T11:51:39.573155+0000","last_became_active":"2024-09-14T11:09:45.204754+0000","last_became_peered":"2024-09-14T11:09:45.204754+0000","last_unstale":"2024-09-14T11:51:39.573155+0000","last_undegraded":"2024-09-14T11:51:39.573155+0000","last_fullsized":"2024-09-14T11:51:39.573155+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:21.492270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10518114,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":518,"num_read_kb":30401,"num_write":974,"num_write_kb":24964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"264'575","reported_seq":2323,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.768055+0000","last_change":"2024-09-14T11:09:46.965280+0000","last_active":"2024-09-14T11:52:12.768055+0000","last_peered":"2024-09-14T11:52:12.768055+0000","last_clean":"2024-09-14T11:52:12.768055+0000","last_became_active":"2024-09-14T11:09:46.964946+0000","last_became_peered":"2024-09-14T11:09:46.964946+0000","last_unstale":"2024-09-14T11:52:12.768055+0000","last_undegraded":"2024-09-14T11:52:12.768055+0000","last_fullsized":"2024-09-14T11:52:12.768055+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":500,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:37.727246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3099,"num_read_kb":2896,"num_write":721,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"264'207","reported_seq":894,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:01.407951+0000","last_change":"2024-09-14T11:09:45.192015+0000","last_active":"2024-09-14T11:51:01.407951+0000","last_peered":"2024-09-14T11:51:01.407951+0000","last_clean":"2024-09-14T11:51:01.407951+0000","last_became_active":"2024-09-14T11:09:45.191314+0000","last_became_peered":"2024-09-14T11:09:45.191314+0000","last_unstale":"2024-09-14T11:51:01.407951+0000","last_undegraded":"2024-09-14T11:51:01.407951+0000","last_fullsized":"2024-09-14T11:51:01.407951+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:59.041601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9515410,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":689,"num_read_kb":24382,"num_write":1010,"num_write_kb":29533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"264'551","reported_seq":2029,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.646131+0000","last_change":"2024-09-14T11:09:46.994591+0000","last_active":"2024-09-14T11:52:29.646131+0000","last_peered":"2024-09-14T11:52:29.646131+0000","last_clean":"2024-09-14T11:52:29.646131+0000","last_became_active":"2024-09-14T11:09:46.994113+0000","last_became_peered":"2024-09-14T11:09:46.994113+0000","last_unstale":"2024-09-14T11:52:29.646131+0000","last_undegraded":"2024-09-14T11:52:29.646131+0000","last_fullsized":"2024-09-14T11:52:29.646131+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:14.044249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2807,"num_read_kb":2558,"num_write":736,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"264'218","reported_seq":812,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:29.188758+0000","last_change":"2024-09-14T11:09:45.219322+0000","last_active":"2024-09-14T11:50:29.188758+0000","last_peered":"2024-09-14T11:50:29.188758+0000","last_clean":"2024-09-14T11:50:29.188758+0000","last_became_active":"2024-09-14T11:09:45.214511+0000","last_became_peered":"2024-09-14T11:09:45.214511+0000","last_unstale":"2024-09-14T11:50:29.188758+0000","last_undegraded":"2024-09-14T11:50:29.188758+0000","last_fullsized":"2024-09-14T11:50:29.188758+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:52.501892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388621,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":481,"num_read_kb":9687,"num_write":1029,"num_write_kb":43578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"264'462","reported_seq":1938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.646695+0000","last_change":"2024-09-14T11:09:46.975025+0000","last_active":"2024-09-14T11:52:29.646695+0000","last_peered":"2024-09-14T11:52:29.646695+0000","last_clean":"2024-09-14T11:52:29.646695+0000","last_became_active":"2024-09-14T11:09:46.974152+0000","last_became_peered":"2024-09-14T11:09:46.974152+0000","last_unstale":"2024-09-14T11:52:29.646695+0000","last_undegraded":"2024-09-14T11:52:29.646695+0000","last_fullsized":"2024-09-14T11:52:29.646695+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:18.882062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2413,"num_read_kb":2245,"num_write":556,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"264'238","reported_seq":890,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:56.134617+0000","last_change":"2024-09-14T11:09:45.203506+0000","last_active":"2024-09-14T11:51:56.134617+0000","last_peered":"2024-09-14T11:51:56.134617+0000","last_clean":"2024-09-14T11:51:56.134617+0000","last_became_active":"2024-09-14T11:09:45.202934+0000","last_became_peered":"2024-09-14T11:09:45.202934+0000","last_unstale":"2024-09-14T11:51:56.134617+0000","last_undegraded":"2024-09-14T11:51:56.134617+0000","last_fullsized":"2024-09-14T11:51:56.134617+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:23.806980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8453539,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":629,"num_read_kb":75174,"num_write":1102,"num_write_kb":32522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"264'394","reported_seq":1908,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:10.846557+0000","last_change":"2024-09-14T11:09:46.947793+0000","last_active":"2024-09-14T11:52:10.846557+0000","last_peered":"2024-09-14T11:52:10.846557+0000","last_clean":"2024-09-14T11:52:10.846557+0000","last_became_active":"2024-09-14T11:09:46.946993+0000","last_became_peered":"2024-09-14T11:09:46.946993+0000","last_unstale":"2024-09-14T11:52:10.846557+0000","last_undegraded":"2024-09-14T11:52:10.846557+0000","last_fullsized":"2024-09-14T11:52:10.846557+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:47.133049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2163,"num_read_kb":2058,"num_write":443,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"264'184","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:08.916279+0000","last_change":"2024-09-14T11:09:45.217891+0000","last_active":"2024-09-14T11:52:08.916279+0000","last_peered":"2024-09-14T11:52:08.916279+0000","last_clean":"2024-09-14T11:52:08.916279+0000","last_became_active":"2024-09-14T11:09:45.217119+0000","last_became_peered":"2024-09-14T11:09:45.217119+0000","last_unstale":"2024-09-14T11:52:08.916279+0000","last_undegraded":"2024-09-14T11:52:08.916279+0000","last_fullsized":"2024-09-14T11:52:08.916279+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:40.436809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8785782,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":474,"num_read_kb":19832,"num_write":841,"num_write_kb":31579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"264'827","reported_seq":2382,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:04.903866+0000","last_change":"2024-09-14T11:09:46.991150+0000","last_active":"2024-09-14T11:52:04.903866+0000","last_peered":"2024-09-14T11:52:04.903866+0000","last_clean":"2024-09-14T11:52:04.903866+0000","last_became_active":"2024-09-14T11:09:46.990899+0000","last_became_peered":"2024-09-14T11:09:46.990899+0000","last_unstale":"2024-09-14T11:52:04.903866+0000","last_undegraded":"2024-09-14T11:52:04.903866+0000","last_fullsized":"2024-09-14T11:52:04.903866+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:34:32.141931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3995,"num_read_kb":3582,"num_write":1122,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"264'238","reported_seq":939,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:54.900653+0000","last_change":"2024-09-14T11:09:45.215275+0000","last_active":"2024-09-14T11:51:54.900653+0000","last_peered":"2024-09-14T11:51:54.900653+0000","last_clean":"2024-09-14T11:51:54.900653+0000","last_became_active":"2024-09-14T11:09:45.214713+0000","last_became_peered":"2024-09-14T11:09:45.214713+0000","last_unstale":"2024-09-14T11:51:54.900653+0000","last_undegraded":"2024-09-14T11:51:54.900653+0000","last_fullsized":"2024-09-14T11:51:54.900653+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:49.671679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19529015,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":732,"num_read_kb":73896,"num_write":1169,"num_write_kb":36295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"264'146","reported_seq":837,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:06.135658+0000","last_change":"2024-09-14T11:09:45.202592+0000","last_active":"2024-09-14T11:51:06.135658+0000","last_peered":"2024-09-14T11:51:06.135658+0000","last_clean":"2024-09-14T11:51:06.135658+0000","last_became_active":"2024-09-14T11:09:45.202270+0000","last_became_peered":"2024-09-14T11:09:45.202270+0000","last_unstale":"2024-09-14T11:51:06.135658+0000","last_undegraded":"2024-09-14T11:51:06.135658+0000","last_fullsized":"2024-09-14T11:51:06.135658+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:26.117626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9789022,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":689,"num_read_kb":138365,"num_write":721,"num_write_kb":22161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"264'887","reported_seq":2644,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.109063+0000","last_change":"2024-09-14T11:09:46.947818+0000","last_active":"2024-09-14T11:53:43.109063+0000","last_peered":"2024-09-14T11:53:43.109063+0000","last_clean":"2024-09-14T11:53:43.109063+0000","last_became_active":"2024-09-14T11:09:46.947102+0000","last_became_peered":"2024-09-14T11:09:46.947102+0000","last_unstale":"2024-09-14T11:53:43.109063+0000","last_undegraded":"2024-09-14T11:53:43.109063+0000","last_fullsized":"2024-09-14T11:53:43.109063+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":800,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:59.879613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4492,"num_read_kb":4074,"num_write":1171,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"264'212","reported_seq":896,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:01.411621+0000","last_change":"2024-09-14T11:09:45.207476+0000","last_active":"2024-09-14T11:52:01.411621+0000","last_peered":"2024-09-14T11:52:01.411621+0000","last_clean":"2024-09-14T11:52:01.411621+0000","last_became_active":"2024-09-14T11:09:45.204922+0000","last_became_peered":"2024-09-14T11:09:45.204922+0000","last_unstale":"2024-09-14T11:52:01.411621+0000","last_undegraded":"2024-09-14T11:52:01.411621+0000","last_fullsized":"2024-09-14T11:52:01.411621+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:11.013663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388673,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":759,"num_read_kb":17799,"num_write":1013,"num_write_kb":50816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"264'494","reported_seq":2052,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.104268+0000","last_change":"2024-09-14T11:09:46.982184+0000","last_active":"2024-09-14T11:53:43.104268+0000","last_peered":"2024-09-14T11:53:43.104268+0000","last_clean":"2024-09-14T11:53:43.104268+0000","last_became_active":"2024-09-14T11:09:46.981819+0000","last_became_peered":"2024-09-14T11:09:46.981819+0000","last_unstale":"2024-09-14T11:53:43.104268+0000","last_undegraded":"2024-09-14T11:53:43.104268+0000","last_fullsized":"2024-09-14T11:53:43.104268+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:29:11.574907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2560,"num_read_kb":2380,"num_write":586,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10857,"num_read_kb":9179,"num_write":3115,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1006,"ondisk_log_size":1006,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15755,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":15151,"num_read_kb":14810,"num_write":17052,"num_write_kb":4979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1790,"ondisk_log_size":1790,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":730,"ondisk_log_size":730,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":497938,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":8067,"num_read_kb":10027,"num_write":5515,"num_write_kb":2781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":794624,"data_stored":253076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2010,"ondisk_log_size":2010,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2869,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":220474,"num_read_kb":201951,"num_write":55880,"num_write_kb":19076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3974,"ondisk_log_size":3974,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":492891480,"num_objects":484,"num_object_clones":0,"num_object_copies":968,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":484,"num_whiteouts":0,"num_read":38612,"num_read_kb":2063955,"num_write":64189,"num_write_kb":2182336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":987561984,"data_stored":985782960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3956,"ondisk_log_size":3956,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":63029779,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":132,"num_read_kb":158488,"num_write":156,"num_write_kb":116383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":126066688,"data_stored":126059558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":63029779,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":130,"num_read_kb":158381,"num_write":156,"num_write_kb":116383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":126066688,"data_stored":126059558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509978,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":385064,"kb_used_data":183128,"kb_used_omap":1,"kb_used_meta":201918,"kb_avail":93986776,"statfs":{"total":96636764160,"available":96242458624,"internally_reserved":0,"allocated":187523072,"data_stored":185739153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":206764487},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509980,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":262316,"kb_used_data":154780,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94109524,"statfs":{"total":96636764160,"available":96368152576,"internally_reserved":0,"allocated":158494720,"data_stored":156702545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542682,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316608,"kb_used_data":118896,"kb_used_omap":1,"kb_used_meta":197694,"kb_avail":94055232,"statfs":{"total":96636764160,"available":96312557568,"internally_reserved":0,"allocated":121749504,"data_stored":120047947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":202439114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542680,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":195124,"kb_used_data":123684,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94176716,"statfs":{"total":96636764160,"available":96436957184,"internally_reserved":0,"allocated":126652416,"data_stored":124894584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542680,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":446900,"kb_used_data":208868,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":93924940,"statfs":{"total":96636764160,"available":96179138560,"internally_reserved":0,"allocated":213880832,"data_stored":212001872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243726789},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542681,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":256224,"kb_used_data":112656,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94115616,"statfs":{"total":96636764160,"available":96374390784,"internally_reserved":0,"allocated":115359744,"data_stored":113612321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542681,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":407156,"kb_used_data":155236,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":93964684,"statfs":{"total":96636764160,"available":96219836416,"internally_reserved":0,"allocated":158961664,"data_stored":157171577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257948101},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542682,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":254992,"kb_used_data":183552,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94116848,"statfs":{"total":96636764160,"available":96375652352,"internally_reserved":0,"allocated":187957248,"data_stored":186050527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":166322176,"data_stored":166015456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":109527040,"data_stored":109326996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":128544768,"data_stored":128314323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":144977920,"data_stored":144741724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":87502848,"data_stored":87338046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":169623552,"data_stored":169314370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":103993344,"data_stored":103820751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77070336,"data_stored":76911294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":34588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":56458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":12044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":22743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":45185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":30262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":33348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":18448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":6024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":5138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":2784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7401472,"data_stored":7400401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32505856,"data_stored":32505856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5292032,"data_stored":5291307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26218496,"data_stored":26217607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":14733312,"data_stored":14731707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4198400,"data_stored":4197520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":27328512,"data_stored":27326552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10489856,"data_stored":10488976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12648448,"data_stored":12646497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25227264,"data_stored":25226193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14733312,"data_stored":14731698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13684736,"data_stored":13683122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:53:58.127 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:53:58.483 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:53:58.495 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-14T11:53:58.501 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":1591,"stamp":"2024-09-14T11:53:56.526025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":620056911,"num_objects":1004,"num_object_clones":0,"num_object_copies":2008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1004,"num_whiteouts":0,"num_read":295904,"num_read_kb":2619727,"num_write":146204,"num_write_kb":2444603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":200,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13750,"ondisk_log_size":13750,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2524384,"kb_used_data":1240800,"kb_used_omap":12,"kb_used_meta":1283443,"kb_avail":752450336,"statfs":{"total":773094113280,"available":770509144064,"internally_reserved":0,"allocated":1270579200,"data_stored":1256220526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1314246193},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-38,"num_objects":-2,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009372"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.294070+0000","last_change":"2024-09-14T11:38:50.585610+0000","last_active":"2024-09-14T11:51:23.294070+0000","last_peered":"2024-09-14T11:51:23.294070+0000","last_clean":"2024-09-14T11:51:23.294070+0000","last_became_active":"2024-09-14T11:38:50.585084+0000","last_became_peered":"2024-09-14T11:38:50.585084+0000","last_unstale":"2024-09-14T11:51:23.294070+0000","last_undegraded":"2024-09-14T11:51:23.294070+0000","last_fullsized":"2024-09-14T11:51:23.294070+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:50.511838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.261823+0000","last_change":"2024-09-14T11:27:41.641807+0000","last_active":"2024-09-14T11:50:13.261823+0000","last_peered":"2024-09-14T11:50:13.261823+0000","last_clean":"2024-09-14T11:50:13.261823+0000","last_became_active":"2024-09-14T11:27:41.641034+0000","last_became_peered":"2024-09-14T11:27:41.641034+0000","last_unstale":"2024-09-14T11:50:13.261823+0000","last_undegraded":"2024-09-14T11:50:13.261823+0000","last_fullsized":"2024-09-14T11:50:13.261823+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:01.125992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"261'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.288469+0000","last_change":"2024-09-14T11:27:38.617636+0000","last_active":"2024-09-14T11:50:08.288469+0000","last_peered":"2024-09-14T11:50:08.288469+0000","last_clean":"2024-09-14T11:50:08.288469+0000","last_became_active":"2024-09-14T11:27:38.617019+0000","last_became_peered":"2024-09-14T11:27:38.617019+0000","last_unstale":"2024-09-14T11:50:08.288469+0000","last_undegraded":"2024-09-14T11:50:08.288469+0000","last_fullsized":"2024-09-14T11:50:08.288469+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:02.190657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"264'17","reported_seq":90,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.122298+0000","last_change":"2024-09-14T11:26:04.263404+0000","last_active":"2024-09-14T11:51:08.122298+0000","last_peered":"2024-09-14T11:51:08.122298+0000","last_clean":"2024-09-14T11:51:08.122298+0000","last_became_active":"2024-09-14T11:26:04.262003+0000","last_became_peered":"2024-09-14T11:26:04.262003+0000","last_unstale":"2024-09-14T11:51:08.122298+0000","last_undegraded":"2024-09-14T11:51:08.122298+0000","last_fullsized":"2024-09-14T11:51:08.122298+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:19.974639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":88,"num_write":45,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.127863+0000","last_change":"2024-09-14T11:38:50.592796+0000","last_active":"2024-09-14T11:51:23.127863+0000","last_peered":"2024-09-14T11:51:23.127863+0000","last_clean":"2024-09-14T11:51:23.127863+0000","last_became_active":"2024-09-14T11:38:50.592015+0000","last_became_peered":"2024-09-14T11:38:50.592015+0000","last_unstale":"2024-09-14T11:51:23.127863+0000","last_undegraded":"2024-09-14T11:51:23.127863+0000","last_fullsized":"2024-09-14T11:51:23.127863+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:43.698723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"264'3","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.091293+0000","last_change":"2024-09-14T11:27:41.643113+0000","last_active":"2024-09-14T11:50:14.091293+0000","last_peered":"2024-09-14T11:50:14.091293+0000","last_clean":"2024-09-14T11:50:14.091293+0000","last_became_active":"2024-09-14T11:27:41.642359+0000","last_became_peered":"2024-09-14T11:27:41.642359+0000","last_unstale":"2024-09-14T11:50:14.091293+0000","last_undegraded":"2024-09-14T11:50:14.091293+0000","last_fullsized":"2024-09-14T11:50:14.091293+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:14.671551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3072,"num_write":3,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"264'4","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.113914+0000","last_change":"2024-09-14T11:27:38.602923+0000","last_active":"2024-09-14T11:50:08.113914+0000","last_peered":"2024-09-14T11:50:08.113914+0000","last_clean":"2024-09-14T11:50:08.113914+0000","last_became_active":"2024-09-14T11:27:38.597816+0000","last_became_peered":"2024-09-14T11:27:38.597816+0000","last_unstale":"2024-09-14T11:50:08.113914+0000","last_undegraded":"2024-09-14T11:50:08.113914+0000","last_fullsized":"2024-09-14T11:50:08.113914+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:36.668640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3216,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":1028,"num_write":9,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"264'31","reported_seq":127,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.109991+0000","last_change":"2024-09-14T11:26:04.283737+0000","last_active":"2024-09-14T11:50:13.109991+0000","last_peered":"2024-09-14T11:50:13.109991+0000","last_clean":"2024-09-14T11:50:13.109991+0000","last_became_active":"2024-09-14T11:26:04.280237+0000","last_became_peered":"2024-09-14T11:26:04.280237+0000","last_unstale":"2024-09-14T11:50:13.109991+0000","last_undegraded":"2024-09-14T11:50:13.109991+0000","last_fullsized":"2024-09-14T11:50:13.109991+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:15.981498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":150,"num_write":82,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.271146+0000","last_change":"2024-09-14T11:38:50.574799+0000","last_active":"2024-09-14T11:50:58.271146+0000","last_peered":"2024-09-14T11:50:58.271146+0000","last_clean":"2024-09-14T11:50:58.271146+0000","last_became_active":"2024-09-14T11:38:50.574020+0000","last_became_peered":"2024-09-14T11:38:50.574020+0000","last_unstale":"2024-09-14T11:50:58.271146+0000","last_undegraded":"2024-09-14T11:50:58.271146+0000","last_fullsized":"2024-09-14T11:50:58.271146+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:52.985985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.120898+0000","last_change":"2024-09-14T11:27:41.646451+0000","last_active":"2024-09-14T11:50:38.120898+0000","last_peered":"2024-09-14T11:50:38.120898+0000","last_clean":"2024-09-14T11:50:38.120898+0000","last_became_active":"2024-09-14T11:27:41.645143+0000","last_became_peered":"2024-09-14T11:27:41.645143+0000","last_unstale":"2024-09-14T11:50:38.120898+0000","last_undegraded":"2024-09-14T11:50:38.120898+0000","last_fullsized":"2024-09-14T11:50:38.120898+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:34.278570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:38.314219+0000","last_change":"2024-09-14T11:27:38.620069+0000","last_active":"2024-09-14T11:51:38.314219+0000","last_peered":"2024-09-14T11:51:38.314219+0000","last_clean":"2024-09-14T11:51:38.314219+0000","last_became_active":"2024-09-14T11:27:38.619537+0000","last_became_peered":"2024-09-14T11:27:38.619537+0000","last_unstale":"2024-09-14T11:51:38.314219+0000","last_undegraded":"2024-09-14T11:51:38.314219+0000","last_fullsized":"2024-09-14T11:51:38.314219+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:49.847960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"264'124","reported_seq":411,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.124673+0000","last_change":"2024-09-14T11:26:04.282980+0000","last_active":"2024-09-14T11:51:08.124673+0000","last_peered":"2024-09-14T11:51:08.124673+0000","last_clean":"2024-09-14T11:51:08.124673+0000","last_became_active":"2024-09-14T11:26:04.279472+0000","last_became_peered":"2024-09-14T11:26:04.279472+0000","last_unstale":"2024-09-14T11:51:08.124673+0000","last_undegraded":"2024-09-14T11:51:08.124673+0000","last_fullsized":"2024-09-14T11:51:08.124673+0000","mapping_epoch":253,"log_start":"261'100","ondisk_log_start":"261'100","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:01.809787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1140,"num_read_kb":1229,"num_write":251,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.126235+0000","last_change":"2024-09-14T11:38:50.588516+0000","last_active":"2024-09-14T11:51:03.126235+0000","last_peered":"2024-09-14T11:51:03.126235+0000","last_clean":"2024-09-14T11:51:03.126235+0000","last_became_active":"2024-09-14T11:38:50.587700+0000","last_became_peered":"2024-09-14T11:38:50.587700+0000","last_unstale":"2024-09-14T11:51:03.126235+0000","last_undegraded":"2024-09-14T11:51:03.126235+0000","last_fullsized":"2024-09-14T11:51:03.126235+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:40.939286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"264'6","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:48.136805+0000","last_change":"2024-09-14T11:27:41.645646+0000","last_active":"2024-09-14T11:51:48.136805+0000","last_peered":"2024-09-14T11:51:48.136805+0000","last_clean":"2024-09-14T11:51:48.136805+0000","last_became_active":"2024-09-14T11:27:41.644919+0000","last_became_peered":"2024-09-14T11:27:41.644919+0000","last_unstale":"2024-09-14T11:51:48.136805+0000","last_undegraded":"2024-09-14T11:51:48.136805+0000","last_fullsized":"2024-09-14T11:51:48.136805+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:48.076358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":8194,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"264'1","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:33.266087+0000","last_change":"2024-09-14T11:27:38.610209+0000","last_active":"2024-09-14T11:50:33.266087+0000","last_peered":"2024-09-14T11:50:33.266087+0000","last_clean":"2024-09-14T11:50:33.266087+0000","last_became_active":"2024-09-14T11:27:38.609445+0000","last_became_peered":"2024-09-14T11:27:38.609445+0000","last_unstale":"2024-09-14T11:50:33.266087+0000","last_undegraded":"2024-09-14T11:50:33.266087+0000","last_fullsized":"2024-09-14T11:50:33.266087+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:01.517926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"264'61","reported_seq":213,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.124618+0000","last_change":"2024-09-14T11:26:04.283422+0000","last_active":"2024-09-14T11:51:08.124618+0000","last_peered":"2024-09-14T11:51:08.124618+0000","last_clean":"2024-09-14T11:51:08.124618+0000","last_became_active":"2024-09-14T11:26:04.282662+0000","last_became_peered":"2024-09-14T11:26:04.282662+0000","last_unstale":"2024-09-14T11:51:08.124618+0000","last_undegraded":"2024-09-14T11:51:08.124618+0000","last_fullsized":"2024-09-14T11:51:08.124618+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:05.753210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":527,"num_read_kb":359,"num_write":147,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.298593+0000","last_change":"2024-09-14T11:38:50.586486+0000","last_active":"2024-09-14T11:50:53.298593+0000","last_peered":"2024-09-14T11:50:53.298593+0000","last_clean":"2024-09-14T11:50:53.298593+0000","last_became_active":"2024-09-14T11:38:50.582489+0000","last_became_peered":"2024-09-14T11:38:50.582489+0000","last_unstale":"2024-09-14T11:50:53.298593+0000","last_undegraded":"2024-09-14T11:50:53.298593+0000","last_fullsized":"2024-09-14T11:50:53.298593+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:07.012027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.269333+0000","last_change":"2024-09-14T11:27:41.647192+0000","last_active":"2024-09-14T11:49:28.269333+0000","last_peered":"2024-09-14T11:49:28.269333+0000","last_clean":"2024-09-14T11:49:28.269333+0000","last_became_active":"2024-09-14T11:27:41.645724+0000","last_became_peered":"2024-09-14T11:27:41.645724+0000","last_unstale":"2024-09-14T11:49:28.269333+0000","last_undegraded":"2024-09-14T11:49:28.269333+0000","last_fullsized":"2024-09-14T11:49:28.269333+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:16.835815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.103071+0000","last_change":"2024-09-14T11:27:38.606708+0000","last_active":"2024-09-14T11:49:23.103071+0000","last_peered":"2024-09-14T11:49:23.103071+0000","last_clean":"2024-09-14T11:49:23.103071+0000","last_became_active":"2024-09-14T11:27:38.605937+0000","last_became_peered":"2024-09-14T11:27:38.605937+0000","last_unstale":"2024-09-14T11:49:23.103071+0000","last_undegraded":"2024-09-14T11:49:23.103071+0000","last_fullsized":"2024-09-14T11:49:23.103071+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:01.152788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"264'12","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.124495+0000","last_change":"2024-09-14T11:26:04.279565+0000","last_active":"2024-09-14T11:51:08.124495+0000","last_peered":"2024-09-14T11:51:08.124495+0000","last_clean":"2024-09-14T11:51:08.124495+0000","last_became_active":"2024-09-14T11:26:04.278457+0000","last_became_peered":"2024-09-14T11:26:04.278457+0000","last_unstale":"2024-09-14T11:51:08.124495+0000","last_undegraded":"2024-09-14T11:51:08.124495+0000","last_fullsized":"2024-09-14T11:51:08.124495+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:36.957690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":56,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.125380+0000","last_change":"2024-09-14T11:38:50.576845+0000","last_active":"2024-09-14T11:51:23.125380+0000","last_peered":"2024-09-14T11:51:23.125380+0000","last_clean":"2024-09-14T11:51:23.125380+0000","last_became_active":"2024-09-14T11:38:50.576125+0000","last_became_peered":"2024-09-14T11:38:50.576125+0000","last_unstale":"2024-09-14T11:51:23.125380+0000","last_undegraded":"2024-09-14T11:51:23.125380+0000","last_fullsized":"2024-09-14T11:51:23.125380+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:08.428909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"264'3","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:29.295860+0000","last_change":"2024-09-14T11:27:41.661526+0000","last_active":"2024-09-14T11:49:29.295860+0000","last_peered":"2024-09-14T11:49:29.295860+0000","last_clean":"2024-09-14T11:49:29.295860+0000","last_became_active":"2024-09-14T11:27:41.660702+0000","last_became_peered":"2024-09-14T11:27:41.660702+0000","last_unstale":"2024-09-14T11:49:29.295860+0000","last_undegraded":"2024-09-14T11:49:29.295860+0000","last_fullsized":"2024-09-14T11:49:29.295860+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:11.563164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"264'8","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:29.296048+0000","last_change":"2024-09-14T11:27:38.603652+0000","last_active":"2024-09-14T11:49:29.296048+0000","last_peered":"2024-09-14T11:49:29.296048+0000","last_clean":"2024-09-14T11:49:29.296048+0000","last_became_active":"2024-09-14T11:27:38.602908+0000","last_became_peered":"2024-09-14T11:27:38.602908+0000","last_unstale":"2024-09-14T11:49:29.296048+0000","last_undegraded":"2024-09-14T11:49:29.296048+0000","last_fullsized":"2024-09-14T11:49:29.296048+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:54.757602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":13,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"264'30","reported_seq":126,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:04.102933+0000","last_change":"2024-09-14T11:26:04.259271+0000","last_active":"2024-09-14T11:51:04.102933+0000","last_peered":"2024-09-14T11:51:04.102933+0000","last_clean":"2024-09-14T11:51:04.102933+0000","last_became_active":"2024-09-14T11:26:04.258048+0000","last_became_peered":"2024-09-14T11:26:04.258048+0000","last_unstale":"2024-09-14T11:51:04.102933+0000","last_undegraded":"2024-09-14T11:51:04.102933+0000","last_fullsized":"2024-09-14T11:51:04.102933+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:36.508914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":248,"num_read_kb":161,"num_write":75,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:24.107804+0000","last_change":"2024-09-14T11:38:50.591472+0000","last_active":"2024-09-14T11:51:24.107804+0000","last_peered":"2024-09-14T11:51:24.107804+0000","last_clean":"2024-09-14T11:51:24.107804+0000","last_became_active":"2024-09-14T11:38:50.590496+0000","last_became_peered":"2024-09-14T11:38:50.590496+0000","last_unstale":"2024-09-14T11:51:24.107804+0000","last_undegraded":"2024-09-14T11:51:24.107804+0000","last_fullsized":"2024-09-14T11:51:24.107804+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:59.200308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"264'9","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.091257+0000","last_change":"2024-09-14T11:27:41.637007+0000","last_active":"2024-09-14T11:50:14.091257+0000","last_peered":"2024-09-14T11:50:14.091257+0000","last_clean":"2024-09-14T11:50:14.091257+0000","last_became_active":"2024-09-14T11:27:41.635495+0000","last_became_peered":"2024-09-14T11:27:41.635495+0000","last_unstale":"2024-09-14T11:50:14.091257+0000","last_undegraded":"2024-09-14T11:50:14.091257+0000","last_fullsized":"2024-09-14T11:50:14.091257+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:07.509871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":12817,"num_write":24,"num_write_kb":12817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"264'1","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.277793+0000","last_change":"2024-09-14T11:27:38.594325+0000","last_active":"2024-09-14T11:50:08.277793+0000","last_peered":"2024-09-14T11:50:08.277793+0000","last_clean":"2024-09-14T11:50:08.277793+0000","last_became_active":"2024-09-14T11:27:38.593507+0000","last_became_peered":"2024-09-14T11:27:38.593507+0000","last_unstale":"2024-09-14T11:50:08.277793+0000","last_undegraded":"2024-09-14T11:50:08.277793+0000","last_fullsized":"2024-09-14T11:50:08.277793+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:04.519402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"264'31","reported_seq":121,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.290822+0000","last_change":"2024-09-14T11:26:04.281451+0000","last_active":"2024-09-14T11:50:18.290822+0000","last_peered":"2024-09-14T11:50:18.290822+0000","last_clean":"2024-09-14T11:50:18.290822+0000","last_became_active":"2024-09-14T11:26:04.280799+0000","last_became_peered":"2024-09-14T11:26:04.280799+0000","last_unstale":"2024-09-14T11:50:18.290822+0000","last_undegraded":"2024-09-14T11:50:18.290822+0000","last_fullsized":"2024-09-14T11:50:18.290822+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:13.145315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":229,"num_read_kb":151,"num_write":83,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.294155+0000","last_change":"2024-09-14T11:38:50.588826+0000","last_active":"2024-09-14T11:51:23.294155+0000","last_peered":"2024-09-14T11:51:23.294155+0000","last_clean":"2024-09-14T11:51:23.294155+0000","last_became_active":"2024-09-14T11:38:50.588260+0000","last_became_peered":"2024-09-14T11:38:50.588260+0000","last_unstale":"2024-09-14T11:51:23.294155+0000","last_undegraded":"2024-09-14T11:51:23.294155+0000","last_fullsized":"2024-09-14T11:51:23.294155+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:00.597152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"261'2","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.289709+0000","last_change":"2024-09-14T11:27:41.650374+0000","last_active":"2024-09-14T11:50:13.289709+0000","last_peered":"2024-09-14T11:50:13.289709+0000","last_clean":"2024-09-14T11:50:13.289709+0000","last_became_active":"2024-09-14T11:27:41.649448+0000","last_became_peered":"2024-09-14T11:27:41.649448+0000","last_unstale":"2024-09-14T11:50:13.289709+0000","last_undegraded":"2024-09-14T11:50:13.289709+0000","last_fullsized":"2024-09-14T11:50:13.289709+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:46.465272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"264'2","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.110832+0000","last_change":"2024-09-14T11:27:38.599731+0000","last_active":"2024-09-14T11:50:08.110832+0000","last_peered":"2024-09-14T11:50:08.110832+0000","last_clean":"2024-09-14T11:50:08.110832+0000","last_became_active":"2024-09-14T11:27:38.598992+0000","last_became_peered":"2024-09-14T11:27:38.598992+0000","last_unstale":"2024-09-14T11:50:08.110832+0000","last_undegraded":"2024-09-14T11:50:08.110832+0000","last_fullsized":"2024-09-14T11:50:08.110832+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:16.033655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"264'245","reported_seq":783,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:44.404892+0000","last_change":"2024-09-14T11:26:04.283762+0000","last_active":"2024-09-14T11:51:44.404892+0000","last_peered":"2024-09-14T11:51:44.404892+0000","last_clean":"2024-09-14T11:51:44.404892+0000","last_became_active":"2024-09-14T11:26:04.283058+0000","last_became_peered":"2024-09-14T11:26:04.283058+0000","last_unstale":"2024-09-14T11:51:44.404892+0000","last_undegraded":"2024-09-14T11:51:44.404892+0000","last_fullsized":"2024-09-14T11:51:44.404892+0000","mapping_epoch":253,"log_start":"261'200","ondisk_log_start":"261'200","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:43.404343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2337,"num_read_kb":3061,"num_write":470,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:33.119635+0000","last_change":"2024-09-14T11:38:50.588284+0000","last_active":"2024-09-14T11:50:33.119635+0000","last_peered":"2024-09-14T11:50:33.119635+0000","last_clean":"2024-09-14T11:50:33.119635+0000","last_became_active":"2024-09-14T11:38:50.587593+0000","last_became_peered":"2024-09-14T11:38:50.587593+0000","last_unstale":"2024-09-14T11:50:33.119635+0000","last_undegraded":"2024-09-14T11:50:33.119635+0000","last_fullsized":"2024-09-14T11:50:33.119635+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:30.104550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"261'2","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.279905+0000","last_change":"2024-09-14T11:27:41.650094+0000","last_active":"2024-09-14T11:49:28.279905+0000","last_peered":"2024-09-14T11:49:28.279905+0000","last_clean":"2024-09-14T11:49:28.279905+0000","last_became_active":"2024-09-14T11:27:41.649297+0000","last_became_peered":"2024-09-14T11:27:41.649297+0000","last_unstale":"2024-09-14T11:49:28.279905+0000","last_undegraded":"2024-09-14T11:49:28.279905+0000","last_fullsized":"2024-09-14T11:49:28.279905+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:37.683430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"261'3","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:04.321677+0000","last_change":"2024-09-14T11:27:38.608702+0000","last_active":"2024-09-14T11:51:04.321677+0000","last_peered":"2024-09-14T11:51:04.321677+0000","last_clean":"2024-09-14T11:51:04.321677+0000","last_became_active":"2024-09-14T11:27:38.607929+0000","last_became_peered":"2024-09-14T11:27:38.607929+0000","last_unstale":"2024-09-14T11:51:04.321677+0000","last_undegraded":"2024-09-14T11:51:04.321677+0000","last_fullsized":"2024-09-14T11:51:04.321677+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:02.938378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"264'16","reported_seq":85,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.111235+0000","last_change":"2024-09-14T11:26:04.262715+0000","last_active":"2024-09-14T11:50:18.111235+0000","last_peered":"2024-09-14T11:50:18.111235+0000","last_clean":"2024-09-14T11:50:18.111235+0000","last_became_active":"2024-09-14T11:26:04.261101+0000","last_became_peered":"2024-09-14T11:26:04.261101+0000","last_unstale":"2024-09-14T11:50:18.111235+0000","last_undegraded":"2024-09-14T11:50:18.111235+0000","last_fullsized":"2024-09-14T11:50:18.111235+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:32.177932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":70,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:33.116264+0000","last_change":"2024-09-14T11:38:50.566716+0000","last_active":"2024-09-14T11:50:33.116264+0000","last_peered":"2024-09-14T11:50:33.116264+0000","last_clean":"2024-09-14T11:50:33.116264+0000","last_became_active":"2024-09-14T11:38:50.565980+0000","last_became_peered":"2024-09-14T11:38:50.565980+0000","last_unstale":"2024-09-14T11:50:33.116264+0000","last_undegraded":"2024-09-14T11:50:33.116264+0000","last_fullsized":"2024-09-14T11:50:33.116264+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:42.634974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"264'4","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.127479+0000","last_change":"2024-09-14T11:27:41.660949+0000","last_active":"2024-09-14T11:51:08.127479+0000","last_peered":"2024-09-14T11:51:08.127479+0000","last_clean":"2024-09-14T11:51:08.127479+0000","last_became_active":"2024-09-14T11:27:41.660264+0000","last_became_peered":"2024-09-14T11:27:41.660264+0000","last_unstale":"2024-09-14T11:51:08.127479+0000","last_undegraded":"2024-09-14T11:51:08.127479+0000","last_fullsized":"2024-09-14T11:51:08.127479+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:36.720927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":9,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"261'4","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.268176+0000","last_change":"2024-09-14T11:27:38.596650+0000","last_active":"2024-09-14T11:49:23.268176+0000","last_peered":"2024-09-14T11:49:23.268176+0000","last_clean":"2024-09-14T11:49:23.268176+0000","last_became_active":"2024-09-14T11:27:38.595788+0000","last_became_peered":"2024-09-14T11:27:38.595788+0000","last_unstale":"2024-09-14T11:49:23.268176+0000","last_undegraded":"2024-09-14T11:49:23.268176+0000","last_fullsized":"2024-09-14T11:49:23.268176+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:09.671865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"264'35","reported_seq":135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.111154+0000","last_change":"2024-09-14T11:26:04.283254+0000","last_active":"2024-09-14T11:50:18.111154+0000","last_peered":"2024-09-14T11:50:18.111154+0000","last_clean":"2024-09-14T11:50:18.111154+0000","last_became_active":"2024-09-14T11:26:04.279281+0000","last_became_peered":"2024-09-14T11:26:04.279281+0000","last_unstale":"2024-09-14T11:50:18.111154+0000","last_undegraded":"2024-09-14T11:50:18.111154+0000","last_fullsized":"2024-09-14T11:50:18.111154+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:14.087866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":194,"num_write":86,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:34.095673+0000","last_change":"2024-09-14T11:38:50.574673+0000","last_active":"2024-09-14T11:50:34.095673+0000","last_peered":"2024-09-14T11:50:34.095673+0000","last_clean":"2024-09-14T11:50:34.095673+0000","last_became_active":"2024-09-14T11:38:50.573912+0000","last_became_peered":"2024-09-14T11:38:50.573912+0000","last_unstale":"2024-09-14T11:50:34.095673+0000","last_undegraded":"2024-09-14T11:50:34.095673+0000","last_fullsized":"2024-09-14T11:50:34.095673+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:20.437626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"264'8","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.280015+0000","last_change":"2024-09-14T11:27:41.633217+0000","last_active":"2024-09-14T11:49:28.280015+0000","last_peered":"2024-09-14T11:49:28.280015+0000","last_clean":"2024-09-14T11:49:28.280015+0000","last_became_active":"2024-09-14T11:27:41.632456+0000","last_became_peered":"2024-09-14T11:27:41.632456+0000","last_unstale":"2024-09-14T11:49:28.280015+0000","last_undegraded":"2024-09-14T11:49:28.280015+0000","last_fullsized":"2024-09-14T11:49:28.280015+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:59.393656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":15362,"num_write":8,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"261'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.278697+0000","last_change":"2024-09-14T11:27:38.617576+0000","last_active":"2024-09-14T11:49:23.278697+0000","last_peered":"2024-09-14T11:49:23.278697+0000","last_clean":"2024-09-14T11:49:23.278697+0000","last_became_active":"2024-09-14T11:27:38.616935+0000","last_became_peered":"2024-09-14T11:27:38.616935+0000","last_unstale":"2024-09-14T11:49:23.278697+0000","last_undegraded":"2024-09-14T11:49:23.278697+0000","last_fullsized":"2024-09-14T11:49:23.278697+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:02.566121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"264'38","reported_seq":144,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.290967+0000","last_change":"2024-09-14T11:26:04.268951+0000","last_active":"2024-09-14T11:50:18.290967+0000","last_peered":"2024-09-14T11:50:18.290967+0000","last_clean":"2024-09-14T11:50:18.290967+0000","last_became_active":"2024-09-14T11:26:04.268202+0000","last_became_peered":"2024-09-14T11:26:04.268202+0000","last_unstale":"2024-09-14T11:50:18.290967+0000","last_undegraded":"2024-09-14T11:50:18.290967+0000","last_fullsized":"2024-09-14T11:50:18.290967+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:01.258492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":294,"num_read_kb":198,"num_write":96,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:33.283228+0000","last_change":"2024-09-14T11:38:50.586123+0000","last_active":"2024-09-14T11:50:33.283228+0000","last_peered":"2024-09-14T11:50:33.283228+0000","last_clean":"2024-09-14T11:50:33.283228+0000","last_became_active":"2024-09-14T11:38:50.585324+0000","last_became_peered":"2024-09-14T11:38:50.585324+0000","last_unstale":"2024-09-14T11:50:33.283228+0000","last_undegraded":"2024-09-14T11:50:33.283228+0000","last_fullsized":"2024-09-14T11:50:33.283228+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:21.296327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"264'3","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.269472+0000","last_change":"2024-09-14T11:27:41.653603+0000","last_active":"2024-09-14T11:49:28.269472+0000","last_peered":"2024-09-14T11:49:28.269472+0000","last_clean":"2024-09-14T11:49:28.269472+0000","last_became_active":"2024-09-14T11:27:41.652940+0000","last_became_peered":"2024-09-14T11:27:41.652940+0000","last_unstale":"2024-09-14T11:49:28.269472+0000","last_undegraded":"2024-09-14T11:49:28.269472+0000","last_fullsized":"2024-09-14T11:49:28.269472+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:52.835060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5246096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":10244,"num_write":3,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"261'5","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.103799+0000","last_change":"2024-09-14T11:27:38.603632+0000","last_active":"2024-09-14T11:49:23.103799+0000","last_peered":"2024-09-14T11:49:23.103799+0000","last_clean":"2024-09-14T11:49:23.103799+0000","last_became_active":"2024-09-14T11:27:38.603013+0000","last_became_peered":"2024-09-14T11:27:38.603013+0000","last_unstale":"2024-09-14T11:49:23.103799+0000","last_undegraded":"2024-09-14T11:49:23.103799+0000","last_fullsized":"2024-09-14T11:49:23.103799+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:31.898272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:29.296282+0000","last_change":"2024-09-14T11:26:04.263990+0000","last_active":"2024-09-14T11:49:29.296282+0000","last_peered":"2024-09-14T11:49:29.296282+0000","last_clean":"2024-09-14T11:49:29.296282+0000","last_became_active":"2024-09-14T11:26:04.263245+0000","last_became_peered":"2024-09-14T11:26:04.263245+0000","last_unstale":"2024-09-14T11:49:29.296282+0000","last_undegraded":"2024-09-14T11:49:29.296282+0000","last_fullsized":"2024-09-14T11:49:29.296282+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:32.096751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.125221+0000","last_change":"2024-09-14T11:38:50.591827+0000","last_active":"2024-09-14T11:50:58.125221+0000","last_peered":"2024-09-14T11:50:58.125221+0000","last_clean":"2024-09-14T11:50:58.125221+0000","last_became_active":"2024-09-14T11:38:50.591033+0000","last_became_peered":"2024-09-14T11:38:50.591033+0000","last_unstale":"2024-09-14T11:50:58.125221+0000","last_undegraded":"2024-09-14T11:50:58.125221+0000","last_fullsized":"2024-09-14T11:50:58.125221+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:09.654882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"264'1","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.126264+0000","last_change":"2024-09-14T11:27:41.645102+0000","last_active":"2024-09-14T11:51:03.126264+0000","last_peered":"2024-09-14T11:51:03.126264+0000","last_clean":"2024-09-14T11:51:03.126264+0000","last_became_active":"2024-09-14T11:27:41.634584+0000","last_became_peered":"2024-09-14T11:27:41.634584+0000","last_unstale":"2024-09-14T11:51:03.126264+0000","last_undegraded":"2024-09-14T11:51:03.126264+0000","last_fullsized":"2024-09-14T11:51:03.126264+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:33.590598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.271195+0000","last_change":"2024-09-14T11:27:38.612360+0000","last_active":"2024-09-14T11:50:58.271195+0000","last_peered":"2024-09-14T11:50:58.271195+0000","last_clean":"2024-09-14T11:50:58.271195+0000","last_became_active":"2024-09-14T11:27:38.611912+0000","last_became_peered":"2024-09-14T11:27:38.611912+0000","last_unstale":"2024-09-14T11:50:58.271195+0000","last_undegraded":"2024-09-14T11:50:58.271195+0000","last_fullsized":"2024-09-14T11:50:58.271195+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:31.632951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"264'32","reported_seq":134,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.294532+0000","last_change":"2024-09-14T11:26:04.264797+0000","last_active":"2024-09-14T11:49:24.294532+0000","last_peered":"2024-09-14T11:49:24.294532+0000","last_clean":"2024-09-14T11:49:24.294532+0000","last_became_active":"2024-09-14T11:26:04.264179+0000","last_became_peered":"2024-09-14T11:26:04.264179+0000","last_unstale":"2024-09-14T11:49:24.294532+0000","last_undegraded":"2024-09-14T11:49:24.294532+0000","last_fullsized":"2024-09-14T11:49:24.294532+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:19.434829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":260,"num_read_kb":165,"num_write":79,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.122121+0000","last_change":"2024-09-14T11:38:50.553543+0000","last_active":"2024-09-14T11:50:58.122121+0000","last_peered":"2024-09-14T11:50:58.122121+0000","last_clean":"2024-09-14T11:50:58.122121+0000","last_became_active":"2024-09-14T11:38:50.552891+0000","last_became_peered":"2024-09-14T11:38:50.552891+0000","last_unstale":"2024-09-14T11:50:58.122121+0000","last_undegraded":"2024-09-14T11:50:58.122121+0000","last_fullsized":"2024-09-14T11:50:58.122121+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:10.586101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"261'4","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.126156+0000","last_change":"2024-09-14T11:27:41.643791+0000","last_active":"2024-09-14T11:51:03.126156+0000","last_peered":"2024-09-14T11:51:03.126156+0000","last_clean":"2024-09-14T11:51:03.126156+0000","last_became_active":"2024-09-14T11:27:41.634824+0000","last_became_peered":"2024-09-14T11:27:41.634824+0000","last_unstale":"2024-09-14T11:51:03.126156+0000","last_undegraded":"2024-09-14T11:51:03.126156+0000","last_fullsized":"2024-09-14T11:51:03.126156+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:45.655086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"264'1","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.125060+0000","last_change":"2024-09-14T11:27:38.609347+0000","last_active":"2024-09-14T11:50:58.125060+0000","last_peered":"2024-09-14T11:50:58.125060+0000","last_clean":"2024-09-14T11:50:58.125060+0000","last_became_active":"2024-09-14T11:27:38.608412+0000","last_became_peered":"2024-09-14T11:27:38.608412+0000","last_unstale":"2024-09-14T11:50:58.125060+0000","last_undegraded":"2024-09-14T11:50:58.125060+0000","last_fullsized":"2024-09-14T11:50:58.125060+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:24.685660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"264'44","reported_seq":157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:39.785907+0000","last_change":"2024-09-14T11:26:04.272788+0000","last_active":"2024-09-14T11:51:39.785907+0000","last_peered":"2024-09-14T11:51:39.785907+0000","last_clean":"2024-09-14T11:51:39.785907+0000","last_became_active":"2024-09-14T11:26:04.272026+0000","last_became_peered":"2024-09-14T11:26:04.272026+0000","last_unstale":"2024-09-14T11:51:39.785907+0000","last_undegraded":"2024-09-14T11:51:39.785907+0000","last_fullsized":"2024-09-14T11:51:39.785907+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:03.282735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":232,"num_write":112,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.115743+0000","last_change":"2024-09-14T11:38:50.576604+0000","last_active":"2024-09-14T11:50:38.115743+0000","last_peered":"2024-09-14T11:50:38.115743+0000","last_clean":"2024-09-14T11:50:38.115743+0000","last_became_active":"2024-09-14T11:38:50.575796+0000","last_became_peered":"2024-09-14T11:38:50.575796+0000","last_unstale":"2024-09-14T11:50:38.115743+0000","last_undegraded":"2024-09-14T11:50:38.115743+0000","last_fullsized":"2024-09-14T11:50:38.115743+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:03.217316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"264'4","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.306173+0000","last_change":"2024-09-14T11:27:41.635521+0000","last_active":"2024-09-14T11:51:03.306173+0000","last_peered":"2024-09-14T11:51:03.306173+0000","last_clean":"2024-09-14T11:51:03.306173+0000","last_became_active":"2024-09-14T11:27:41.634402+0000","last_became_peered":"2024-09-14T11:27:41.634402+0000","last_unstale":"2024-09-14T11:51:03.306173+0000","last_undegraded":"2024-09-14T11:51:03.306173+0000","last_fullsized":"2024-09-14T11:51:03.306173+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:27.030127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.271311+0000","last_change":"2024-09-14T11:27:38.610277+0000","last_active":"2024-09-14T11:50:58.271311+0000","last_peered":"2024-09-14T11:50:58.271311+0000","last_clean":"2024-09-14T11:50:58.271311+0000","last_became_active":"2024-09-14T11:27:38.609363+0000","last_became_peered":"2024-09-14T11:27:38.609363+0000","last_unstale":"2024-09-14T11:50:58.271311+0000","last_undegraded":"2024-09-14T11:50:58.271311+0000","last_fullsized":"2024-09-14T11:50:58.271311+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:44.061754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"264'17","reported_seq":87,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.079749+0000","last_change":"2024-09-14T11:26:04.262270+0000","last_active":"2024-09-14T11:49:24.079749+0000","last_peered":"2024-09-14T11:49:24.079749+0000","last_clean":"2024-09-14T11:49:24.079749+0000","last_became_active":"2024-09-14T11:26:04.261498+0000","last_became_peered":"2024-09-14T11:26:04.261498+0000","last_unstale":"2024-09-14T11:49:24.079749+0000","last_undegraded":"2024-09-14T11:49:24.079749+0000","last_fullsized":"2024-09-14T11:49:24.079749+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:31.069079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":93,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.122005+0000","last_change":"2024-09-14T11:38:50.576965+0000","last_active":"2024-09-14T11:50:58.122005+0000","last_peered":"2024-09-14T11:50:58.122005+0000","last_clean":"2024-09-14T11:50:58.122005+0000","last_became_active":"2024-09-14T11:38:50.576165+0000","last_became_peered":"2024-09-14T11:38:50.576165+0000","last_unstale":"2024-09-14T11:50:58.122005+0000","last_undegraded":"2024-09-14T11:50:58.122005+0000","last_fullsized":"2024-09-14T11:50:58.122005+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:25.583158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"264'1","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:04.321580+0000","last_change":"2024-09-14T11:27:41.650299+0000","last_active":"2024-09-14T11:51:04.321580+0000","last_peered":"2024-09-14T11:51:04.321580+0000","last_clean":"2024-09-14T11:51:04.321580+0000","last_became_active":"2024-09-14T11:27:41.649598+0000","last_became_peered":"2024-09-14T11:27:41.649598+0000","last_unstale":"2024-09-14T11:51:04.321580+0000","last_undegraded":"2024-09-14T11:51:04.321580+0000","last_fullsized":"2024-09-14T11:51:04.321580+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:10.114521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.271350+0000","last_change":"2024-09-14T11:27:38.599118+0000","last_active":"2024-09-14T11:50:58.271350+0000","last_peered":"2024-09-14T11:50:58.271350+0000","last_clean":"2024-09-14T11:50:58.271350+0000","last_became_active":"2024-09-14T11:27:38.598429+0000","last_became_peered":"2024-09-14T11:27:38.598429+0000","last_unstale":"2024-09-14T11:50:58.271350+0000","last_undegraded":"2024-09-14T11:50:58.271350+0000","last_fullsized":"2024-09-14T11:50:58.271350+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:20.260448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"264'26","reported_seq":114,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.279763+0000","last_change":"2024-09-14T11:26:04.272989+0000","last_active":"2024-09-14T11:49:28.279763+0000","last_peered":"2024-09-14T11:49:28.279763+0000","last_clean":"2024-09-14T11:49:28.279763+0000","last_became_active":"2024-09-14T11:26:04.272216+0000","last_became_peered":"2024-09-14T11:26:04.272216+0000","last_unstale":"2024-09-14T11:49:28.279763+0000","last_undegraded":"2024-09-14T11:49:28.279763+0000","last_fullsized":"2024-09-14T11:49:28.279763+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:52.021930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":141,"num_write":65,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.109357+0000","last_change":"2024-09-14T11:38:50.589752+0000","last_active":"2024-09-14T11:49:48.109357+0000","last_peered":"2024-09-14T11:49:48.109357+0000","last_clean":"2024-09-14T11:49:48.109357+0000","last_became_active":"2024-09-14T11:38:50.589121+0000","last_became_peered":"2024-09-14T11:38:50.589121+0000","last_unstale":"2024-09-14T11:49:48.109357+0000","last_undegraded":"2024-09-14T11:49:48.109357+0000","last_fullsized":"2024-09-14T11:49:48.109357+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:46.246907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"261'4","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.289832+0000","last_change":"2024-09-14T11:27:41.631708+0000","last_active":"2024-09-14T11:50:13.289832+0000","last_peered":"2024-09-14T11:50:13.289832+0000","last_clean":"2024-09-14T11:50:13.289832+0000","last_became_active":"2024-09-14T11:27:41.630970+0000","last_became_peered":"2024-09-14T11:27:41.630970+0000","last_unstale":"2024-09-14T11:50:13.289832+0000","last_undegraded":"2024-09-14T11:50:13.289832+0000","last_fullsized":"2024-09-14T11:50:13.289832+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:10.321213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:09.090171+0000","last_change":"2024-09-14T11:27:38.598988+0000","last_active":"2024-09-14T11:50:09.090171+0000","last_peered":"2024-09-14T11:50:09.090171+0000","last_clean":"2024-09-14T11:50:09.090171+0000","last_became_active":"2024-09-14T11:27:38.580979+0000","last_became_peered":"2024-09-14T11:27:38.580979+0000","last_unstale":"2024-09-14T11:50:09.090171+0000","last_undegraded":"2024-09-14T11:50:09.090171+0000","last_fullsized":"2024-09-14T11:50:09.090171+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:07.399468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"261'22","reported_seq":106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.298654+0000","last_change":"2024-09-14T11:26:04.275780+0000","last_active":"2024-09-14T11:50:53.298654+0000","last_peered":"2024-09-14T11:50:53.298654+0000","last_clean":"2024-09-14T11:50:53.298654+0000","last_became_active":"2024-09-14T11:26:04.275034+0000","last_became_peered":"2024-09-14T11:26:04.275034+0000","last_unstale":"2024-09-14T11:50:53.298654+0000","last_undegraded":"2024-09-14T11:50:53.298654+0000","last_fullsized":"2024-09-14T11:50:53.298654+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:53.668220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":117,"num_write":55,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.260860+0000","last_change":"2024-09-14T11:38:50.596985+0000","last_active":"2024-09-14T11:50:08.260860+0000","last_peered":"2024-09-14T11:50:08.260860+0000","last_clean":"2024-09-14T11:50:08.260860+0000","last_became_active":"2024-09-14T11:38:50.596395+0000","last_became_peered":"2024-09-14T11:38:50.596395+0000","last_unstale":"2024-09-14T11:50:08.260860+0000","last_undegraded":"2024-09-14T11:50:08.260860+0000","last_fullsized":"2024-09-14T11:50:08.260860+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:15.646487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"264'2","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.289784+0000","last_change":"2024-09-14T11:27:41.657302+0000","last_active":"2024-09-14T11:50:13.289784+0000","last_peered":"2024-09-14T11:50:13.289784+0000","last_clean":"2024-09-14T11:50:13.289784+0000","last_became_active":"2024-09-14T11:27:41.656659+0000","last_became_peered":"2024-09-14T11:27:41.656659+0000","last_unstale":"2024-09-14T11:50:13.289784+0000","last_undegraded":"2024-09-14T11:50:13.289784+0000","last_fullsized":"2024-09-14T11:50:13.289784+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:57.077639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51634,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":100,"num_write":2,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.110964+0000","last_change":"2024-09-14T11:27:38.605497+0000","last_active":"2024-09-14T11:50:08.110964+0000","last_peered":"2024-09-14T11:50:08.110964+0000","last_clean":"2024-09-14T11:50:08.110964+0000","last_became_active":"2024-09-14T11:27:38.604732+0000","last_became_peered":"2024-09-14T11:27:38.604732+0000","last_unstale":"2024-09-14T11:50:08.110964+0000","last_undegraded":"2024-09-14T11:50:08.110964+0000","last_fullsized":"2024-09-14T11:50:08.110964+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:10.544829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"264'35","reported_seq":134,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:49.317370+0000","last_change":"2024-09-14T11:26:04.280000+0000","last_active":"2024-09-14T11:50:49.317370+0000","last_peered":"2024-09-14T11:50:49.317370+0000","last_clean":"2024-09-14T11:50:49.317370+0000","last_became_active":"2024-09-14T11:26:04.279402+0000","last_became_peered":"2024-09-14T11:26:04.279402+0000","last_unstale":"2024-09-14T11:50:49.317370+0000","last_undegraded":"2024-09-14T11:50:49.317370+0000","last_fullsized":"2024-09-14T11:50:49.317370+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:08.691450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":174,"num_write":94,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:44.299867+0000","last_change":"2024-09-14T11:38:50.573603+0000","last_active":"2024-09-14T11:49:44.299867+0000","last_peered":"2024-09-14T11:49:44.299867+0000","last_clean":"2024-09-14T11:49:44.299867+0000","last_became_active":"2024-09-14T11:38:50.573062+0000","last_became_peered":"2024-09-14T11:38:50.573062+0000","last_unstale":"2024-09-14T11:49:44.299867+0000","last_undegraded":"2024-09-14T11:49:44.299867+0000","last_fullsized":"2024-09-14T11:49:44.299867+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:58.483156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"264'6","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.289927+0000","last_change":"2024-09-14T11:27:41.639765+0000","last_active":"2024-09-14T11:50:13.289927+0000","last_peered":"2024-09-14T11:50:13.289927+0000","last_clean":"2024-09-14T11:50:13.289927+0000","last_became_active":"2024-09-14T11:27:41.639051+0000","last_became_peered":"2024-09-14T11:27:41.639051+0000","last_unstale":"2024-09-14T11:50:13.289927+0000","last_undegraded":"2024-09-14T11:50:13.289927+0000","last_fullsized":"2024-09-14T11:50:13.289927+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:41.947643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":20482,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"264'3","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.288625+0000","last_change":"2024-09-14T11:27:38.620255+0000","last_active":"2024-09-14T11:50:08.288625+0000","last_peered":"2024-09-14T11:50:08.288625+0000","last_clean":"2024-09-14T11:50:08.288625+0000","last_became_active":"2024-09-14T11:27:38.619608+0000","last_became_peered":"2024-09-14T11:27:38.619608+0000","last_unstale":"2024-09-14T11:50:08.288625+0000","last_undegraded":"2024-09-14T11:50:08.288625+0000","last_fullsized":"2024-09-14T11:50:08.288625+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:13.155452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":3,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"264'28","reported_seq":116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.270192+0000","last_change":"2024-09-14T11:26:04.273757+0000","last_active":"2024-09-14T11:50:53.270192+0000","last_peered":"2024-09-14T11:50:53.270192+0000","last_clean":"2024-09-14T11:50:53.270192+0000","last_became_active":"2024-09-14T11:26:04.272960+0000","last_became_peered":"2024-09-14T11:26:04.272960+0000","last_unstale":"2024-09-14T11:50:53.270192+0000","last_undegraded":"2024-09-14T11:50:53.270192+0000","last_fullsized":"2024-09-14T11:50:53.270192+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:56.581662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":136,"num_write":79,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:43.255430+0000","last_change":"2024-09-14T11:38:50.570309+0000","last_active":"2024-09-14T11:49:43.255430+0000","last_peered":"2024-09-14T11:49:43.255430+0000","last_clean":"2024-09-14T11:49:43.255430+0000","last_became_active":"2024-09-14T11:38:50.569743+0000","last_became_peered":"2024-09-14T11:38:50.569743+0000","last_unstale":"2024-09-14T11:49:43.255430+0000","last_undegraded":"2024-09-14T11:49:43.255430+0000","last_fullsized":"2024-09-14T11:49:43.255430+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:37.993575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"264'3","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.115144+0000","last_change":"2024-09-14T11:27:41.654827+0000","last_active":"2024-09-14T11:50:13.115144+0000","last_peered":"2024-09-14T11:50:13.115144+0000","last_clean":"2024-09-14T11:50:13.115144+0000","last_became_active":"2024-09-14T11:27:41.653929+0000","last_became_peered":"2024-09-14T11:27:41.653929+0000","last_unstale":"2024-09-14T11:50:13.115144+0000","last_undegraded":"2024-09-14T11:50:13.115144+0000","last_fullsized":"2024-09-14T11:50:13.115144+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:11.356458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4254673,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":118,"num_write":8,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"264'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.288702+0000","last_change":"2024-09-14T11:27:38.620107+0000","last_active":"2024-09-14T11:50:08.288702+0000","last_peered":"2024-09-14T11:50:08.288702+0000","last_clean":"2024-09-14T11:50:08.288702+0000","last_became_active":"2024-09-14T11:27:38.619441+0000","last_became_peered":"2024-09-14T11:27:38.619441+0000","last_unstale":"2024-09-14T11:50:08.288702+0000","last_undegraded":"2024-09-14T11:50:08.288702+0000","last_fullsized":"2024-09-14T11:50:08.288702+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:37.692951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13631488,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":21504,"num_write":10,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"264'28","reported_seq":115,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.120811+0000","last_change":"2024-09-14T11:26:04.272552+0000","last_active":"2024-09-14T11:50:53.120811+0000","last_peered":"2024-09-14T11:50:53.120811+0000","last_clean":"2024-09-14T11:50:53.120811+0000","last_became_active":"2024-09-14T11:26:04.271747+0000","last_became_peered":"2024-09-14T11:26:04.271747+0000","last_unstale":"2024-09-14T11:50:53.120811+0000","last_undegraded":"2024-09-14T11:50:53.120811+0000","last_fullsized":"2024-09-14T11:50:53.120811+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:55.732123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":132,"num_write":73,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.113971+0000","last_change":"2024-09-14T11:38:50.590185+0000","last_active":"2024-09-14T11:50:08.113971+0000","last_peered":"2024-09-14T11:50:08.113971+0000","last_clean":"2024-09-14T11:50:08.113971+0000","last_became_active":"2024-09-14T11:38:50.589444+0000","last_became_peered":"2024-09-14T11:38:50.589444+0000","last_unstale":"2024-09-14T11:50:08.113971+0000","last_undegraded":"2024-09-14T11:50:08.113971+0000","last_fullsized":"2024-09-14T11:50:08.113971+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:57.453301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"261'2","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:34.329581+0000","last_change":"2024-09-14T11:27:41.641002+0000","last_active":"2024-09-14T11:51:34.329581+0000","last_peered":"2024-09-14T11:51:34.329581+0000","last_clean":"2024-09-14T11:51:34.329581+0000","last_became_active":"2024-09-14T11:27:41.640105+0000","last_became_peered":"2024-09-14T11:27:41.640105+0000","last_unstale":"2024-09-14T11:51:34.329581+0000","last_undegraded":"2024-09-14T11:51:34.329581+0000","last_fullsized":"2024-09-14T11:51:34.329581+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:12.987982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"264'10","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:28.311556+0000","last_change":"2024-09-14T11:27:38.613505+0000","last_active":"2024-09-14T11:51:28.311556+0000","last_peered":"2024-09-14T11:51:28.311556+0000","last_clean":"2024-09-14T11:51:28.311556+0000","last_became_active":"2024-09-14T11:27:38.612745+0000","last_became_peered":"2024-09-14T11:27:38.612745+0000","last_unstale":"2024-09-14T11:51:28.311556+0000","last_undegraded":"2024-09-14T11:51:28.311556+0000","last_fullsized":"2024-09-14T11:51:28.311556+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:41.780008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60369,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":6207,"num_write":15,"num_write_kb":2107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"264'45","reported_seq":170,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.120656+0000","last_change":"2024-09-14T11:26:04.277466+0000","last_active":"2024-09-14T11:50:53.120656+0000","last_peered":"2024-09-14T11:50:53.120656+0000","last_clean":"2024-09-14T11:50:53.120656+0000","last_became_active":"2024-09-14T11:26:04.273309+0000","last_became_peered":"2024-09-14T11:26:04.273309+0000","last_unstale":"2024-09-14T11:50:53.120656+0000","last_undegraded":"2024-09-14T11:50:53.120656+0000","last_fullsized":"2024-09-14T11:50:53.120656+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:24.875502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":376,"num_read_kb":242,"num_write":121,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.091371+0000","last_change":"2024-09-14T11:38:50.597053+0000","last_active":"2024-09-14T11:50:14.091371+0000","last_peered":"2024-09-14T11:50:14.091371+0000","last_clean":"2024-09-14T11:50:14.091371+0000","last_became_active":"2024-09-14T11:38:50.596495+0000","last_became_peered":"2024-09-14T11:38:50.596495+0000","last_unstale":"2024-09-14T11:50:14.091371+0000","last_undegraded":"2024-09-14T11:50:14.091371+0000","last_fullsized":"2024-09-14T11:50:14.091371+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:54.445153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"264'3","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:34.110109+0000","last_change":"2024-09-14T11:27:41.650790+0000","last_active":"2024-09-14T11:51:34.110109+0000","last_peered":"2024-09-14T11:51:34.110109+0000","last_clean":"2024-09-14T11:51:34.110109+0000","last_became_active":"2024-09-14T11:27:41.650311+0000","last_became_peered":"2024-09-14T11:27:41.650311+0000","last_unstale":"2024-09-14T11:51:34.110109+0000","last_undegraded":"2024-09-14T11:51:34.110109+0000","last_fullsized":"2024-09-14T11:51:34.110109+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:02.760791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"264'6","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:28.131798+0000","last_change":"2024-09-14T11:27:38.600875+0000","last_active":"2024-09-14T11:51:28.131798+0000","last_peered":"2024-09-14T11:51:28.131798+0000","last_clean":"2024-09-14T11:51:28.131798+0000","last_became_active":"2024-09-14T11:27:38.600043+0000","last_became_peered":"2024-09-14T11:27:38.600043+0000","last_unstale":"2024-09-14T11:51:28.131798+0000","last_undegraded":"2024-09-14T11:51:28.131798+0000","last_fullsized":"2024-09-14T11:51:28.131798+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:38.547858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":7170,"num_write":6,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"264'31","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:21.529004+0000","last_change":"2024-09-14T11:26:04.274470+0000","last_active":"2024-09-14T11:50:21.529004+0000","last_peered":"2024-09-14T11:50:21.529004+0000","last_clean":"2024-09-14T11:50:21.529004+0000","last_became_active":"2024-09-14T11:26:04.274089+0000","last_became_peered":"2024-09-14T11:26:04.274089+0000","last_unstale":"2024-09-14T11:50:21.529004+0000","last_undegraded":"2024-09-14T11:50:21.529004+0000","last_fullsized":"2024-09-14T11:50:21.529004+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:02.147109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":254,"num_read_kb":164,"num_write":92,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.277870+0000","last_change":"2024-09-14T11:38:50.593374+0000","last_active":"2024-09-14T11:50:08.277870+0000","last_peered":"2024-09-14T11:50:08.277870+0000","last_clean":"2024-09-14T11:50:08.277870+0000","last_became_active":"2024-09-14T11:38:50.592765+0000","last_became_peered":"2024-09-14T11:38:50.592765+0000","last_unstale":"2024-09-14T11:50:08.277870+0000","last_undegraded":"2024-09-14T11:50:08.277870+0000","last_fullsized":"2024-09-14T11:50:08.277870+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:12.739637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"261'2","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.111954+0000","last_change":"2024-09-14T11:27:41.647748+0000","last_active":"2024-09-14T11:50:13.111954+0000","last_peered":"2024-09-14T11:50:13.111954+0000","last_clean":"2024-09-14T11:50:13.111954+0000","last_became_active":"2024-09-14T11:27:41.646962+0000","last_became_peered":"2024-09-14T11:27:41.646962+0000","last_unstale":"2024-09-14T11:50:13.111954+0000","last_undegraded":"2024-09-14T11:50:13.111954+0000","last_fullsized":"2024-09-14T11:50:13.111954+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:41.449801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:28.311711+0000","last_change":"2024-09-14T11:27:38.616699+0000","last_active":"2024-09-14T11:51:28.311711+0000","last_peered":"2024-09-14T11:51:28.311711+0000","last_clean":"2024-09-14T11:51:28.311711+0000","last_became_active":"2024-09-14T11:27:38.612131+0000","last_became_peered":"2024-09-14T11:27:38.612131+0000","last_unstale":"2024-09-14T11:51:28.311711+0000","last_undegraded":"2024-09-14T11:51:28.311711+0000","last_fullsized":"2024-09-14T11:51:28.311711+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:28.127453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"264'14","reported_seq":79,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:58.111733+0000","last_change":"2024-09-14T11:26:04.259922+0000","last_active":"2024-09-14T11:49:58.111733+0000","last_peered":"2024-09-14T11:49:58.111733+0000","last_clean":"2024-09-14T11:49:58.111733+0000","last_became_active":"2024-09-14T11:26:04.258976+0000","last_became_peered":"2024-09-14T11:26:04.258976+0000","last_unstale":"2024-09-14T11:49:58.111733+0000","last_undegraded":"2024-09-14T11:49:58.111733+0000","last_fullsized":"2024-09-14T11:49:58.111733+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:45.204426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":72,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.288544+0000","last_change":"2024-09-14T11:38:50.594382+0000","last_active":"2024-09-14T11:50:08.288544+0000","last_peered":"2024-09-14T11:50:08.288544+0000","last_clean":"2024-09-14T11:50:08.288544+0000","last_became_active":"2024-09-14T11:38:50.593641+0000","last_became_peered":"2024-09-14T11:38:50.593641+0000","last_unstale":"2024-09-14T11:50:08.288544+0000","last_undegraded":"2024-09-14T11:50:08.288544+0000","last_fullsized":"2024-09-14T11:50:08.288544+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:19.832637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"261'7","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:33.296159+0000","last_change":"2024-09-14T11:27:41.657817+0000","last_active":"2024-09-14T11:51:33.296159+0000","last_peered":"2024-09-14T11:51:33.296159+0000","last_clean":"2024-09-14T11:51:33.296159+0000","last_became_active":"2024-09-14T11:27:41.657112+0000","last_became_peered":"2024-09-14T11:27:41.657112+0000","last_unstale":"2024-09-14T11:51:33.296159+0000","last_undegraded":"2024-09-14T11:51:33.296159+0000","last_fullsized":"2024-09-14T11:51:33.296159+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:00.412523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":6146,"num_write":12,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"264'2","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:09.306261+0000","last_change":"2024-09-14T11:27:38.605512+0000","last_active":"2024-09-14T11:50:09.306261+0000","last_peered":"2024-09-14T11:50:09.306261+0000","last_clean":"2024-09-14T11:50:09.306261+0000","last_became_active":"2024-09-14T11:27:38.602864+0000","last_became_peered":"2024-09-14T11:27:38.602864+0000","last_unstale":"2024-09-14T11:50:09.306261+0000","last_undegraded":"2024-09-14T11:50:09.306261+0000","last_fullsized":"2024-09-14T11:50:09.306261+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:31.418858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"264'39","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:58.275660+0000","last_change":"2024-09-14T11:26:04.272287+0000","last_active":"2024-09-14T11:49:58.275660+0000","last_peered":"2024-09-14T11:49:58.275660+0000","last_clean":"2024-09-14T11:49:58.275660+0000","last_became_active":"2024-09-14T11:26:04.271893+0000","last_became_peered":"2024-09-14T11:26:04.271893+0000","last_unstale":"2024-09-14T11:49:58.275660+0000","last_undegraded":"2024-09-14T11:49:58.275660+0000","last_fullsized":"2024-09-14T11:49:58.275660+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:19.118538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":319,"num_read_kb":212,"num_write":95,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.294000+0000","last_change":"2024-09-14T11:38:50.589623+0000","last_active":"2024-09-14T11:51:23.294000+0000","last_peered":"2024-09-14T11:51:23.294000+0000","last_clean":"2024-09-14T11:51:23.294000+0000","last_became_active":"2024-09-14T11:38:50.587827+0000","last_became_peered":"2024-09-14T11:38:50.587827+0000","last_unstale":"2024-09-14T11:51:23.294000+0000","last_undegraded":"2024-09-14T11:51:23.294000+0000","last_fullsized":"2024-09-14T11:51:23.294000+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:20.578713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"261'5","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:43.121925+0000","last_change":"2024-09-14T11:27:41.652540+0000","last_active":"2024-09-14T11:50:43.121925+0000","last_peered":"2024-09-14T11:50:43.121925+0000","last_clean":"2024-09-14T11:50:43.121925+0000","last_became_active":"2024-09-14T11:27:41.651778+0000","last_became_peered":"2024-09-14T11:27:41.651778+0000","last_unstale":"2024-09-14T11:50:43.121925+0000","last_undegraded":"2024-09-14T11:50:43.121925+0000","last_fullsized":"2024-09-14T11:50:43.121925+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:35.794859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:34.313081+0000","last_change":"2024-09-14T11:27:38.604820+0000","last_active":"2024-09-14T11:50:34.313081+0000","last_peered":"2024-09-14T11:50:34.313081+0000","last_clean":"2024-09-14T11:50:34.313081+0000","last_became_active":"2024-09-14T11:27:38.603954+0000","last_became_peered":"2024-09-14T11:27:38.603954+0000","last_unstale":"2024-09-14T11:50:34.313081+0000","last_undegraded":"2024-09-14T11:50:34.313081+0000","last_fullsized":"2024-09-14T11:50:34.313081+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:26.741673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"264'59","reported_seq":200,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:58.106856+0000","last_change":"2024-09-14T11:26:04.270170+0000","last_active":"2024-09-14T11:49:58.106856+0000","last_peered":"2024-09-14T11:49:58.106856+0000","last_clean":"2024-09-14T11:49:58.106856+0000","last_became_active":"2024-09-14T11:26:04.269206+0000","last_became_peered":"2024-09-14T11:26:04.269206+0000","last_unstale":"2024-09-14T11:49:58.106856+0000","last_undegraded":"2024-09-14T11:49:58.106856+0000","last_fullsized":"2024-09-14T11:49:58.106856+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:12.185033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":473,"num_read_kb":330,"num_write":140,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.294101+0000","last_change":"2024-09-14T11:38:50.585754+0000","last_active":"2024-09-14T11:51:23.294101+0000","last_peered":"2024-09-14T11:51:23.294101+0000","last_clean":"2024-09-14T11:51:23.294101+0000","last_became_active":"2024-09-14T11:38:50.585233+0000","last_became_peered":"2024-09-14T11:38:50.585233+0000","last_unstale":"2024-09-14T11:51:23.294101+0000","last_undegraded":"2024-09-14T11:51:23.294101+0000","last_fullsized":"2024-09-14T11:51:23.294101+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:13.891277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"261'4","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.120790+0000","last_change":"2024-09-14T11:27:41.660945+0000","last_active":"2024-09-14T11:50:38.120790+0000","last_peered":"2024-09-14T11:50:38.120790+0000","last_clean":"2024-09-14T11:50:38.120790+0000","last_became_active":"2024-09-14T11:27:41.660286+0000","last_became_peered":"2024-09-14T11:27:41.660286+0000","last_unstale":"2024-09-14T11:50:38.120790+0000","last_undegraded":"2024-09-14T11:50:38.120790+0000","last_fullsized":"2024-09-14T11:50:38.120790+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:47.102264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"261'2","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.115783+0000","last_change":"2024-09-14T11:27:38.594963+0000","last_active":"2024-09-14T11:50:38.115783+0000","last_peered":"2024-09-14T11:50:38.115783+0000","last_clean":"2024-09-14T11:50:38.115783+0000","last_became_active":"2024-09-14T11:27:38.591485+0000","last_became_peered":"2024-09-14T11:27:38.591485+0000","last_unstale":"2024-09-14T11:50:38.115783+0000","last_undegraded":"2024-09-14T11:50:38.115783+0000","last_fullsized":"2024-09-14T11:50:38.115783+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:00.325087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"261'8","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:54.302809+0000","last_change":"2024-09-14T11:26:04.284721+0000","last_active":"2024-09-14T11:49:54.302809+0000","last_peered":"2024-09-14T11:49:54.302809+0000","last_clean":"2024-09-14T11:49:54.302809+0000","last_became_active":"2024-09-14T11:26:04.280724+0000","last_became_peered":"2024-09-14T11:26:04.280724+0000","last_unstale":"2024-09-14T11:49:54.302809+0000","last_undegraded":"2024-09-14T11:49:54.302809+0000","last_fullsized":"2024-09-14T11:49:54.302809+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:06.079319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":39,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.124982+0000","last_change":"2024-09-14T11:38:50.586522+0000","last_active":"2024-09-14T11:50:58.124982+0000","last_peered":"2024-09-14T11:50:58.124982+0000","last_clean":"2024-09-14T11:50:58.124982+0000","last_became_active":"2024-09-14T11:38:50.586004+0000","last_became_peered":"2024-09-14T11:38:50.586004+0000","last_unstale":"2024-09-14T11:50:58.124982+0000","last_undegraded":"2024-09-14T11:50:58.124982+0000","last_fullsized":"2024-09-14T11:50:58.124982+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:21.529496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"264'3","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:33.296409+0000","last_change":"2024-09-14T11:27:41.657751+0000","last_active":"2024-09-14T11:51:33.296409+0000","last_peered":"2024-09-14T11:51:33.296409+0000","last_clean":"2024-09-14T11:51:33.296409+0000","last_became_active":"2024-09-14T11:27:41.656864+0000","last_became_peered":"2024-09-14T11:27:41.656864+0000","last_unstale":"2024-09-14T11:51:33.296409+0000","last_undegraded":"2024-09-14T11:51:33.296409+0000","last_fullsized":"2024-09-14T11:51:33.296409+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:54.203821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4123,"num_write":3,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"264'10","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:29.109079+0000","last_change":"2024-09-14T11:27:38.598139+0000","last_active":"2024-09-14T11:51:29.109079+0000","last_peered":"2024-09-14T11:51:29.109079+0000","last_clean":"2024-09-14T11:51:29.109079+0000","last_became_active":"2024-09-14T11:27:38.597416+0000","last_became_peered":"2024-09-14T11:27:38.597416+0000","last_unstale":"2024-09-14T11:51:29.109079+0000","last_undegraded":"2024-09-14T11:51:29.109079+0000","last_fullsized":"2024-09-14T11:51:29.109079+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:43.572595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1097003,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":16434,"num_write":20,"num_write_kb":9264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"264'34","reported_seq":138,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:14.105634+0000","last_change":"2024-09-14T11:26:04.275339+0000","last_active":"2024-09-14T11:51:14.105634+0000","last_peered":"2024-09-14T11:51:14.105634+0000","last_clean":"2024-09-14T11:51:14.105634+0000","last_became_active":"2024-09-14T11:26:04.274720+0000","last_became_peered":"2024-09-14T11:26:04.274720+0000","last_unstale":"2024-09-14T11:51:14.105634+0000","last_undegraded":"2024-09-14T11:51:14.105634+0000","last_fullsized":"2024-09-14T11:51:14.105634+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:36.983364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":267,"num_read_kb":161,"num_write":92,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:24.326912+0000","last_change":"2024-09-14T11:38:50.576319+0000","last_active":"2024-09-14T11:51:24.326912+0000","last_peered":"2024-09-14T11:51:24.326912+0000","last_clean":"2024-09-14T11:51:24.326912+0000","last_became_active":"2024-09-14T11:38:50.575662+0000","last_became_peered":"2024-09-14T11:38:50.575662+0000","last_unstale":"2024-09-14T11:51:24.326912+0000","last_undegraded":"2024-09-14T11:51:24.326912+0000","last_fullsized":"2024-09-14T11:51:24.326912+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:49.815419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:34.329826+0000","last_change":"2024-09-14T11:27:41.653202+0000","last_active":"2024-09-14T11:51:34.329826+0000","last_peered":"2024-09-14T11:51:34.329826+0000","last_clean":"2024-09-14T11:51:34.329826+0000","last_became_active":"2024-09-14T11:27:41.652132+0000","last_became_peered":"2024-09-14T11:27:41.652132+0000","last_unstale":"2024-09-14T11:51:34.329826+0000","last_undegraded":"2024-09-14T11:51:34.329826+0000","last_fullsized":"2024-09-14T11:51:34.329826+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:58.896733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"264'2","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:29.328518+0000","last_change":"2024-09-14T11:27:38.603010+0000","last_active":"2024-09-14T11:51:29.328518+0000","last_peered":"2024-09-14T11:51:29.328518+0000","last_clean":"2024-09-14T11:51:29.328518+0000","last_became_active":"2024-09-14T11:27:38.602099+0000","last_became_peered":"2024-09-14T11:27:38.602099+0000","last_unstale":"2024-09-14T11:51:29.328518+0000","last_undegraded":"2024-09-14T11:51:29.328518+0000","last_fullsized":"2024-09-14T11:51:29.328518+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:51.969381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"264'30","reported_seq":125,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.307396+0000","last_change":"2024-09-14T11:26:04.266535+0000","last_active":"2024-09-14T11:51:08.307396+0000","last_peered":"2024-09-14T11:51:08.307396+0000","last_clean":"2024-09-14T11:51:08.307396+0000","last_became_active":"2024-09-14T11:26:04.265553+0000","last_became_peered":"2024-09-14T11:26:04.265553+0000","last_unstale":"2024-09-14T11:51:08.307396+0000","last_undegraded":"2024-09-14T11:51:08.307396+0000","last_fullsized":"2024-09-14T11:51:08.307396+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:39.882235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":163,"num_write":75,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:43.283196+0000","last_change":"2024-09-14T11:38:50.587405+0000","last_active":"2024-09-14T11:49:43.283196+0000","last_peered":"2024-09-14T11:49:43.283196+0000","last_clean":"2024-09-14T11:49:43.283196+0000","last_became_active":"2024-09-14T11:38:50.583172+0000","last_became_peered":"2024-09-14T11:38:50.583172+0000","last_unstale":"2024-09-14T11:49:43.283196+0000","last_undegraded":"2024-09-14T11:49:43.283196+0000","last_fullsized":"2024-09-14T11:49:43.283196+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:06.394703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"264'2","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.115615+0000","last_change":"2024-09-14T11:27:41.646437+0000","last_active":"2024-09-14T11:50:38.115615+0000","last_peered":"2024-09-14T11:50:38.115615+0000","last_clean":"2024-09-14T11:50:38.115615+0000","last_became_active":"2024-09-14T11:27:41.645631+0000","last_became_peered":"2024-09-14T11:27:41.645631+0000","last_unstale":"2024-09-14T11:50:38.115615+0000","last_undegraded":"2024-09-14T11:50:38.115615+0000","last_fullsized":"2024-09-14T11:50:38.115615+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:11.944240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"261'6","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:49.114182+0000","last_change":"2024-09-14T11:27:38.598601+0000","last_active":"2024-09-14T11:51:49.114182+0000","last_peered":"2024-09-14T11:51:49.114182+0000","last_clean":"2024-09-14T11:51:49.114182+0000","last_became_active":"2024-09-14T11:27:38.597788+0000","last_became_peered":"2024-09-14T11:27:38.597788+0000","last_unstale":"2024-09-14T11:51:49.114182+0000","last_undegraded":"2024-09-14T11:51:49.114182+0000","last_fullsized":"2024-09-14T11:51:49.114182+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:42.681971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4123,"num_write":6,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"264'31","reported_seq":122,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.496327+0000","last_change":"2024-09-14T11:26:04.258522+0000","last_active":"2024-09-14T11:51:07.496327+0000","last_peered":"2024-09-14T11:51:07.496327+0000","last_clean":"2024-09-14T11:51:07.496327+0000","last_became_active":"2024-09-14T11:26:04.257219+0000","last_became_peered":"2024-09-14T11:26:04.257219+0000","last_unstale":"2024-09-14T11:51:07.496327+0000","last_undegraded":"2024-09-14T11:51:07.496327+0000","last_fullsized":"2024-09-14T11:51:07.496327+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:20.764816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":127,"num_write":83,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:43.103145+0000","last_change":"2024-09-14T11:38:50.581794+0000","last_active":"2024-09-14T11:49:43.103145+0000","last_peered":"2024-09-14T11:49:43.103145+0000","last_clean":"2024-09-14T11:49:43.103145+0000","last_became_active":"2024-09-14T11:38:50.581128+0000","last_became_peered":"2024-09-14T11:38:50.581128+0000","last_unstale":"2024-09-14T11:49:43.103145+0000","last_undegraded":"2024-09-14T11:49:43.103145+0000","last_fullsized":"2024-09-14T11:49:43.103145+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:55.010648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"264'2","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:49.333156+0000","last_change":"2024-09-14T11:27:41.653209+0000","last_active":"2024-09-14T11:51:49.333156+0000","last_peered":"2024-09-14T11:51:49.333156+0000","last_clean":"2024-09-14T11:51:49.333156+0000","last_became_active":"2024-09-14T11:27:41.652549+0000","last_became_peered":"2024-09-14T11:27:41.652549+0000","last_unstale":"2024-09-14T11:51:49.333156+0000","last_undegraded":"2024-09-14T11:51:49.333156+0000","last_fullsized":"2024-09-14T11:51:49.333156+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:00.987136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"264'4","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:34.312953+0000","last_change":"2024-09-14T11:27:38.610165+0000","last_active":"2024-09-14T11:50:34.312953+0000","last_peered":"2024-09-14T11:50:34.312953+0000","last_clean":"2024-09-14T11:50:34.312953+0000","last_became_active":"2024-09-14T11:27:38.609483+0000","last_became_peered":"2024-09-14T11:27:38.609483+0000","last_unstale":"2024-09-14T11:50:34.312953+0000","last_undegraded":"2024-09-14T11:50:34.312953+0000","last_fullsized":"2024-09-14T11:50:34.312953+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:29:33.493298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4197511,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":12292,"num_write":4,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"264'27","reported_seq":114,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:43.442305+0000","last_change":"2024-09-14T11:26:04.269191+0000","last_active":"2024-09-14T11:51:43.442305+0000","last_peered":"2024-09-14T11:51:43.442305+0000","last_clean":"2024-09-14T11:51:43.442305+0000","last_became_active":"2024-09-14T11:26:04.268338+0000","last_became_peered":"2024-09-14T11:26:04.268338+0000","last_unstale":"2024-09-14T11:51:43.442305+0000","last_undegraded":"2024-09-14T11:51:43.442305+0000","last_fullsized":"2024-09-14T11:51:43.442305+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:41.961353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":125,"num_write":73,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.130723+0000","last_change":"2024-09-14T11:38:50.590316+0000","last_active":"2024-09-14T11:51:23.130723+0000","last_peered":"2024-09-14T11:51:23.130723+0000","last_clean":"2024-09-14T11:51:23.130723+0000","last_became_active":"2024-09-14T11:38:50.589588+0000","last_became_peered":"2024-09-14T11:38:50.589588+0000","last_unstale":"2024-09-14T11:51:23.130723+0000","last_undegraded":"2024-09-14T11:51:23.130723+0000","last_fullsized":"2024-09-14T11:51:23.130723+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:24.259049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"264'1","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:39.096899+0000","last_change":"2024-09-14T11:27:41.644387+0000","last_active":"2024-09-14T11:50:39.096899+0000","last_peered":"2024-09-14T11:50:39.096899+0000","last_clean":"2024-09-14T11:50:39.096899+0000","last_became_active":"2024-09-14T11:27:41.642400+0000","last_became_peered":"2024-09-14T11:27:41.642400+0000","last_unstale":"2024-09-14T11:50:39.096899+0000","last_undegraded":"2024-09-14T11:50:39.096899+0000","last_fullsized":"2024-09-14T11:50:39.096899+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:58.652273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"261'5","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:33.116188+0000","last_change":"2024-09-14T11:27:38.590088+0000","last_active":"2024-09-14T11:50:33.116188+0000","last_peered":"2024-09-14T11:50:33.116188+0000","last_clean":"2024-09-14T11:50:33.116188+0000","last_became_active":"2024-09-14T11:27:38.587990+0000","last_became_peered":"2024-09-14T11:27:38.587990+0000","last_unstale":"2024-09-14T11:50:33.116188+0000","last_undegraded":"2024-09-14T11:50:33.116188+0000","last_fullsized":"2024-09-14T11:50:33.116188+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:09.675601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"264'55","reported_seq":192,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:43.699139+0000","last_change":"2024-09-14T11:26:04.258664+0000","last_active":"2024-09-14T11:51:43.699139+0000","last_peered":"2024-09-14T11:51:43.699139+0000","last_clean":"2024-09-14T11:51:43.699139+0000","last_became_active":"2024-09-14T11:26:04.257926+0000","last_became_peered":"2024-09-14T11:26:04.257926+0000","last_unstale":"2024-09-14T11:51:43.699139+0000","last_undegraded":"2024-09-14T11:51:43.699139+0000","last_fullsized":"2024-09-14T11:51:43.699139+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:33.436039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":423,"num_read_kb":280,"num_write":136,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:24.327084+0000","last_change":"2024-09-14T11:38:50.587747+0000","last_active":"2024-09-14T11:51:24.327084+0000","last_peered":"2024-09-14T11:51:24.327084+0000","last_clean":"2024-09-14T11:51:24.327084+0000","last_became_active":"2024-09-14T11:38:50.581923+0000","last_became_peered":"2024-09-14T11:38:50.581923+0000","last_unstale":"2024-09-14T11:51:24.327084+0000","last_undegraded":"2024-09-14T11:51:24.327084+0000","last_fullsized":"2024-09-14T11:51:24.327084+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:40.481426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:39.096845+0000","last_change":"2024-09-14T11:27:41.635443+0000","last_active":"2024-09-14T11:50:39.096845+0000","last_peered":"2024-09-14T11:50:39.096845+0000","last_clean":"2024-09-14T11:50:39.096845+0000","last_became_active":"2024-09-14T11:27:41.634692+0000","last_became_peered":"2024-09-14T11:27:41.634692+0000","last_unstale":"2024-09-14T11:50:39.096845+0000","last_undegraded":"2024-09-14T11:50:39.096845+0000","last_fullsized":"2024-09-14T11:50:39.096845+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:40.891329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"264'6","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:33.265987+0000","last_change":"2024-09-14T11:27:38.613089+0000","last_active":"2024-09-14T11:50:33.265987+0000","last_peered":"2024-09-14T11:50:33.265987+0000","last_clean":"2024-09-14T11:50:33.265987+0000","last_became_active":"2024-09-14T11:27:38.612443+0000","last_became_peered":"2024-09-14T11:27:38.612443+0000","last_unstale":"2024-09-14T11:50:33.265987+0000","last_undegraded":"2024-09-14T11:50:33.265987+0000","last_fullsized":"2024-09-14T11:50:33.265987+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:03.608324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"264'61","reported_seq":208,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.091151+0000","last_change":"2024-09-14T11:26:04.264319+0000","last_active":"2024-09-14T11:50:14.091151+0000","last_peered":"2024-09-14T11:50:14.091151+0000","last_clean":"2024-09-14T11:50:14.091151+0000","last_became_active":"2024-09-14T11:26:04.263498+0000","last_became_peered":"2024-09-14T11:26:04.263498+0000","last_unstale":"2024-09-14T11:50:14.091151+0000","last_undegraded":"2024-09-14T11:50:14.091151+0000","last_fullsized":"2024-09-14T11:50:14.091151+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:15.140217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":491,"num_read_kb":357,"num_write":145,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"264'195","reported_seq":915,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:00.618454+0000","last_change":"2024-09-14T11:09:45.213450+0000","last_active":"2024-09-14T11:52:00.618454+0000","last_peered":"2024-09-14T11:52:00.618454+0000","last_clean":"2024-09-14T11:52:00.618454+0000","last_became_active":"2024-09-14T11:09:45.212881+0000","last_became_peered":"2024-09-14T11:09:45.212881+0000","last_unstale":"2024-09-14T11:52:00.618454+0000","last_undegraded":"2024-09-14T11:52:00.618454+0000","last_fullsized":"2024-09-14T11:52:00.618454+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:30.710132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":928,"num_read_kb":39441,"num_write":967,"num_write_kb":29636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"264'507","reported_seq":2106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:10.846453+0000","last_change":"2024-09-14T11:09:46.960384+0000","last_active":"2024-09-14T11:52:10.846453+0000","last_peered":"2024-09-14T11:52:10.846453+0000","last_clean":"2024-09-14T11:52:10.846453+0000","last_became_active":"2024-09-14T11:09:46.960069+0000","last_became_peered":"2024-09-14T11:09:46.960069+0000","last_unstale":"2024-09-14T11:52:10.846453+0000","last_undegraded":"2024-09-14T11:52:10.846453+0000","last_fullsized":"2024-09-14T11:52:10.846453+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:31.331846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2624,"num_read_kb":2455,"num_write":621,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"264'206","reported_seq":854,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:28.131954+0000","last_change":"2024-09-14T11:09:45.211773+0000","last_active":"2024-09-14T11:51:28.131954+0000","last_peered":"2024-09-14T11:51:28.131954+0000","last_clean":"2024-09-14T11:51:28.131954+0000","last_became_active":"2024-09-14T11:09:45.211049+0000","last_became_peered":"2024-09-14T11:09:45.211049+0000","last_unstale":"2024-09-14T11:51:28.131954+0000","last_undegraded":"2024-09-14T11:51:28.131954+0000","last_fullsized":"2024-09-14T11:51:28.131954+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:23.782528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145754,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":535,"num_read_kb":70257,"num_write":1013,"num_write_kb":34950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"264'757","reported_seq":2283,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.019646+0000","last_change":"2024-09-14T11:09:46.957857+0000","last_active":"2024-09-14T11:52:29.019646+0000","last_peered":"2024-09-14T11:52:29.019646+0000","last_clean":"2024-09-14T11:52:29.019646+0000","last_became_active":"2024-09-14T11:09:46.957446+0000","last_became_peered":"2024-09-14T11:09:46.957446+0000","last_unstale":"2024-09-14T11:52:29.019646+0000","last_undegraded":"2024-09-14T11:52:29.019646+0000","last_fullsized":"2024-09-14T11:52:29.019646+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:59.796579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3644,"num_read_kb":3296,"num_write":998,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"264'176","reported_seq":798,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:28.131916+0000","last_change":"2024-09-14T11:09:45.209713+0000","last_active":"2024-09-14T11:51:28.131916+0000","last_peered":"2024-09-14T11:51:28.131916+0000","last_clean":"2024-09-14T11:51:28.131916+0000","last_became_active":"2024-09-14T11:09:45.207458+0000","last_became_peered":"2024-09-14T11:09:45.207458+0000","last_unstale":"2024-09-14T11:51:28.131916+0000","last_undegraded":"2024-09-14T11:51:28.131916+0000","last_fullsized":"2024-09-14T11:51:28.131916+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:49.539522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12655459,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":473,"num_read_kb":12475,"num_write":819,"num_write_kb":33777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"264'372","reported_seq":1895,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:27.204477+0000","last_change":"2024-09-14T11:09:46.950941+0000","last_active":"2024-09-14T11:52:27.204477+0000","last_peered":"2024-09-14T11:52:27.204477+0000","last_clean":"2024-09-14T11:52:27.204477+0000","last_became_active":"2024-09-14T11:09:46.950652+0000","last_became_peered":"2024-09-14T11:09:46.950652+0000","last_unstale":"2024-09-14T11:52:27.204477+0000","last_undegraded":"2024-09-14T11:52:27.204477+0000","last_fullsized":"2024-09-14T11:52:27.204477+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:34.170365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2108,"num_read_kb":2030,"num_write":424,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"264'202","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:23.993626+0000","last_change":"2024-09-14T11:09:45.186739+0000","last_active":"2024-09-14T11:52:23.993626+0000","last_peered":"2024-09-14T11:52:23.993626+0000","last_clean":"2024-09-14T11:52:23.993626+0000","last_became_active":"2024-09-14T11:09:45.185702+0000","last_became_peered":"2024-09-14T11:09:45.185702+0000","last_unstale":"2024-09-14T11:52:23.993626+0000","last_undegraded":"2024-09-14T11:52:23.993626+0000","last_fullsized":"2024-09-14T11:52:23.993626+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:56.963707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9438224,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":491,"num_read_kb":15356,"num_write":914,"num_write_kb":51388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"264'414","reported_seq":1970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.623964+0000","last_change":"2024-09-14T11:09:46.954424+0000","last_active":"2024-09-14T11:52:29.623964+0000","last_peered":"2024-09-14T11:52:29.623964+0000","last_clean":"2024-09-14T11:52:29.623964+0000","last_became_active":"2024-09-14T11:09:46.952230+0000","last_became_peered":"2024-09-14T11:09:46.952230+0000","last_unstale":"2024-09-14T11:52:29.623964+0000","last_undegraded":"2024-09-14T11:52:29.623964+0000","last_fullsized":"2024-09-14T11:52:29.623964+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:20.602131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2399,"num_read_kb":2276,"num_write":503,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"264'172","reported_seq":741,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.686181+0000","last_change":"2024-09-14T11:10:22.255380+0000","last_active":"2024-09-14T11:52:24.686181+0000","last_peered":"2024-09-14T11:52:24.686181+0000","last_clean":"2024-09-14T11:52:24.686181+0000","last_became_active":"2024-09-14T11:10:22.254947+0000","last_became_peered":"2024-09-14T11:10:22.254947+0000","last_unstale":"2024-09-14T11:52:24.686181+0000","last_undegraded":"2024-09-14T11:52:24.686181+0000","last_fullsized":"2024-09-14T11:52:24.686181+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:02.851190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437213,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":438,"num_read_kb":20000,"num_write":785,"num_write_kb":32213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'366","reported_seq":1751,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.120430+0000","last_change":"2024-09-14T11:09:46.962966+0000","last_active":"2024-09-14T11:53:43.120430+0000","last_peered":"2024-09-14T11:53:43.120430+0000","last_clean":"2024-09-14T11:53:43.120430+0000","last_became_active":"2024-09-14T11:09:46.962586+0000","last_became_peered":"2024-09-14T11:09:46.962586+0000","last_unstale":"2024-09-14T11:53:43.120430+0000","last_undegraded":"2024-09-14T11:53:43.120430+0000","last_fullsized":"2024-09-14T11:53:43.120430+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:16.752782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1989,"num_read_kb":1876,"num_write":428,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"264'202","reported_seq":829,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:08.329811+0000","last_change":"2024-09-14T11:09:45.187610+0000","last_active":"2024-09-14T11:52:08.329811+0000","last_peered":"2024-09-14T11:52:08.329811+0000","last_clean":"2024-09-14T11:52:08.329811+0000","last_became_active":"2024-09-14T11:09:45.187149+0000","last_became_peered":"2024-09-14T11:09:45.187149+0000","last_unstale":"2024-09-14T11:52:08.329811+0000","last_undegraded":"2024-09-14T11:52:08.329811+0000","last_fullsized":"2024-09-14T11:52:08.329811+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:27.216240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2451109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":550,"num_read_kb":3965,"num_write":970,"num_write_kb":31222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"264'786","reported_seq":2321,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.037515+0000","last_change":"2024-09-14T11:09:46.990395+0000","last_active":"2024-09-14T11:52:29.037515+0000","last_peered":"2024-09-14T11:52:29.037515+0000","last_clean":"2024-09-14T11:52:29.037515+0000","last_became_active":"2024-09-14T11:09:46.990102+0000","last_became_peered":"2024-09-14T11:09:46.990102+0000","last_unstale":"2024-09-14T11:52:29.037515+0000","last_undegraded":"2024-09-14T11:52:29.037515+0000","last_fullsized":"2024-09-14T11:52:29.037515+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:13.567778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3903,"num_read_kb":3531,"num_write":1063,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"264'331","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.668251+0000","last_change":"2024-09-14T11:09:45.205649+0000","last_active":"2024-09-14T11:52:12.668251+0000","last_peered":"2024-09-14T11:52:12.668251+0000","last_clean":"2024-09-14T11:52:12.668251+0000","last_became_active":"2024-09-14T11:09:45.204885+0000","last_became_peered":"2024-09-14T11:09:45.204885+0000","last_unstale":"2024-09-14T11:52:12.668251+0000","last_undegraded":"2024-09-14T11:52:12.668251+0000","last_fullsized":"2024-09-14T11:52:12.668251+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:37.591233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1071253,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":902,"num_read_kb":1363,"num_write":1216,"num_write_kb":28416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"264'784","reported_seq":2358,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.184843+0000","last_change":"2024-09-14T11:09:46.951375+0000","last_active":"2024-09-14T11:52:12.184843+0000","last_peered":"2024-09-14T11:52:12.184843+0000","last_clean":"2024-09-14T11:52:12.184843+0000","last_became_active":"2024-09-14T11:09:46.951098+0000","last_became_peered":"2024-09-14T11:09:46.951098+0000","last_unstale":"2024-09-14T11:52:12.184843+0000","last_undegraded":"2024-09-14T11:52:12.184843+0000","last_fullsized":"2024-09-14T11:52:12.184843+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:32.686431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3820,"num_read_kb":3459,"num_write":1035,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"264'206","reported_seq":835,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:42.039065+0000","last_change":"2024-09-14T11:09:45.208652+0000","last_active":"2024-09-14T11:50:42.039065+0000","last_peered":"2024-09-14T11:50:42.039065+0000","last_clean":"2024-09-14T11:50:42.039065+0000","last_became_active":"2024-09-14T11:09:45.207406+0000","last_became_peered":"2024-09-14T11:09:45.207406+0000","last_unstale":"2024-09-14T11:50:42.039065+0000","last_undegraded":"2024-09-14T11:50:42.039065+0000","last_fullsized":"2024-09-14T11:50:42.039065+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:23.047694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12984645,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":504,"num_read_kb":35143,"num_write":947,"num_write_kb":45963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"264'416","reported_seq":1956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.102644+0000","last_change":"2024-09-14T11:09:46.996557+0000","last_active":"2024-09-14T11:53:43.102644+0000","last_peered":"2024-09-14T11:53:43.102644+0000","last_clean":"2024-09-14T11:53:43.102644+0000","last_became_active":"2024-09-14T11:09:46.995237+0000","last_became_peered":"2024-09-14T11:09:46.995237+0000","last_unstale":"2024-09-14T11:53:43.102644+0000","last_undegraded":"2024-09-14T11:53:43.102644+0000","last_fullsized":"2024-09-14T11:53:43.102644+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:43.227391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2305,"num_read_kb":2183,"num_write":489,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"264'597","reported_seq":2214,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:11.470546+0000","last_change":"2024-09-14T11:09:46.960536+0000","last_active":"2024-09-14T11:52:11.470546+0000","last_peered":"2024-09-14T11:52:11.470546+0000","last_clean":"2024-09-14T11:52:11.470546+0000","last_became_active":"2024-09-14T11:09:46.959477+0000","last_became_peered":"2024-09-14T11:09:46.959477+0000","last_unstale":"2024-09-14T11:52:11.470546+0000","last_undegraded":"2024-09-14T11:52:11.470546+0000","last_fullsized":"2024-09-14T11:52:11.470546+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":500,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:02.226766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3034,"num_read_kb":2795,"num_write":758,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"264'213","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:43.283335+0000","last_change":"2024-09-14T11:09:45.204285+0000","last_active":"2024-09-14T11:51:43.283335+0000","last_peered":"2024-09-14T11:51:43.283335+0000","last_clean":"2024-09-14T11:51:43.283335+0000","last_became_active":"2024-09-14T11:09:45.204030+0000","last_became_peered":"2024-09-14T11:09:45.204030+0000","last_unstale":"2024-09-14T11:51:43.283335+0000","last_undegraded":"2024-09-14T11:51:43.283335+0000","last_fullsized":"2024-09-14T11:51:43.283335+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:18.332566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1706918,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":525,"num_read_kb":23907,"num_write":1073,"num_write_kb":37253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"264'520","reported_seq":2130,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:03.265916+0000","last_change":"2024-09-14T11:09:46.971107+0000","last_active":"2024-09-14T11:52:03.265916+0000","last_peered":"2024-09-14T11:52:03.265916+0000","last_clean":"2024-09-14T11:52:03.265916+0000","last_became_active":"2024-09-14T11:09:46.970750+0000","last_became_peered":"2024-09-14T11:09:46.970750+0000","last_unstale":"2024-09-14T11:52:03.265916+0000","last_undegraded":"2024-09-14T11:52:03.265916+0000","last_fullsized":"2024-09-14T11:52:03.265916+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:57.060428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2805,"num_read_kb":2599,"num_write":647,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"264'214","reported_seq":852,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:06.053261+0000","last_change":"2024-09-14T11:09:45.207509+0000","last_active":"2024-09-14T11:52:06.053261+0000","last_peered":"2024-09-14T11:52:06.053261+0000","last_clean":"2024-09-14T11:52:06.053261+0000","last_became_active":"2024-09-14T11:09:45.206812+0000","last_became_peered":"2024-09-14T11:09:45.206812+0000","last_unstale":"2024-09-14T11:52:06.053261+0000","last_undegraded":"2024-09-14T11:52:06.053261+0000","last_fullsized":"2024-09-14T11:52:06.053261+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:33.731635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6941833,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":561,"num_read_kb":32523,"num_write":991,"num_write_kb":41963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"264'850","reported_seq":2574,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.110359+0000","last_change":"2024-09-14T11:09:46.975448+0000","last_active":"2024-09-14T11:51:53.110359+0000","last_peered":"2024-09-14T11:51:53.110359+0000","last_clean":"2024-09-14T11:51:53.110359+0000","last_became_active":"2024-09-14T11:09:46.975135+0000","last_became_peered":"2024-09-14T11:09:46.975135+0000","last_unstale":"2024-09-14T11:51:53.110359+0000","last_undegraded":"2024-09-14T11:51:53.110359+0000","last_fullsized":"2024-09-14T11:51:53.110359+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":800,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:04.676118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4353,"num_read_kb":3966,"num_write":1152,"num_write_kb":464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"264'176","reported_seq":776,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:38.919195+0000","last_change":"2024-09-14T11:09:45.213110+0000","last_active":"2024-09-14T11:53:38.919195+0000","last_peered":"2024-09-14T11:53:38.919195+0000","last_clean":"2024-09-14T11:53:38.919195+0000","last_became_active":"2024-09-14T11:09:45.208314+0000","last_became_peered":"2024-09-14T11:09:45.208314+0000","last_unstale":"2024-09-14T11:53:38.919195+0000","last_undegraded":"2024-09-14T11:53:38.919195+0000","last_fullsized":"2024-09-14T11:53:38.919195+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:20.110568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5282222,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":411,"num_read_kb":7778,"num_write":835,"num_write_kb":25761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"264'900","reported_seq":2658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:02.153104+0000","last_change":"2024-09-14T11:09:46.995957+0000","last_active":"2024-09-14T11:52:02.153104+0000","last_peered":"2024-09-14T11:52:02.153104+0000","last_clean":"2024-09-14T11:52:02.153104+0000","last_became_active":"2024-09-14T11:09:46.995182+0000","last_became_peered":"2024-09-14T11:09:46.995182+0000","last_unstale":"2024-09-14T11:52:02.153104+0000","last_undegraded":"2024-09-14T11:52:02.153104+0000","last_fullsized":"2024-09-14T11:52:02.153104+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":800,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:35.861209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4411,"num_read_kb":3995,"num_write":1182,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"264'208","reported_seq":800,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.726835+0000","last_change":"2024-09-14T11:09:45.220362+0000","last_active":"2024-09-14T11:51:07.726835+0000","last_peered":"2024-09-14T11:51:07.726835+0000","last_clean":"2024-09-14T11:51:07.726835+0000","last_became_active":"2024-09-14T11:09:45.215301+0000","last_became_peered":"2024-09-14T11:09:45.215301+0000","last_unstale":"2024-09-14T11:51:07.726835+0000","last_undegraded":"2024-09-14T11:51:07.726835+0000","last_fullsized":"2024-09-14T11:51:07.726835+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:10.063540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388638,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":443,"num_read_kb":16967,"num_write":895,"num_write_kb":40194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"264'431","reported_seq":1974,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.766412+0000","last_change":"2024-09-14T11:09:46.975235+0000","last_active":"2024-09-14T11:52:12.766412+0000","last_peered":"2024-09-14T11:52:12.766412+0000","last_clean":"2024-09-14T11:52:12.766412+0000","last_became_active":"2024-09-14T11:09:46.974465+0000","last_became_peered":"2024-09-14T11:09:46.974465+0000","last_unstale":"2024-09-14T11:52:12.766412+0000","last_undegraded":"2024-09-14T11:52:12.766412+0000","last_fullsized":"2024-09-14T11:52:12.766412+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:52.589199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2378,"num_read_kb":2237,"num_write":500,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"264'219","reported_seq":880,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:06.796955+0000","last_change":"2024-09-14T11:09:45.211590+0000","last_active":"2024-09-14T11:52:06.796955+0000","last_peered":"2024-09-14T11:52:06.796955+0000","last_clean":"2024-09-14T11:52:06.796955+0000","last_became_active":"2024-09-14T11:09:45.210875+0000","last_became_peered":"2024-09-14T11:09:45.210875+0000","last_unstale":"2024-09-14T11:52:06.796955+0000","last_undegraded":"2024-09-14T11:52:06.796955+0000","last_fullsized":"2024-09-14T11:52:06.796955+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:21.188914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12954907,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":583,"num_read_kb":73873,"num_write":1083,"num_write_kb":38947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"264'414","reported_seq":1942,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.988375+0000","last_change":"2024-09-14T11:09:46.959048+0000","last_active":"2024-09-14T11:52:09.988375+0000","last_peered":"2024-09-14T11:52:09.988375+0000","last_clean":"2024-09-14T11:52:09.988375+0000","last_became_active":"2024-09-14T11:09:46.958694+0000","last_became_peered":"2024-09-14T11:09:46.958694+0000","last_unstale":"2024-09-14T11:52:09.988375+0000","last_undegraded":"2024-09-14T11:52:09.988375+0000","last_fullsized":"2024-09-14T11:52:09.988375+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:35.009340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2265,"num_read_kb":2144,"num_write":479,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"264'195","reported_seq":819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:27.099041+0000","last_change":"2024-09-14T11:09:45.221734+0000","last_active":"2024-09-14T11:52:27.099041+0000","last_peered":"2024-09-14T11:52:27.099041+0000","last_clean":"2024-09-14T11:52:27.099041+0000","last_became_active":"2024-09-14T11:09:45.220968+0000","last_became_peered":"2024-09-14T11:09:45.220968+0000","last_unstale":"2024-09-14T11:52:27.099041+0000","last_undegraded":"2024-09-14T11:52:27.099041+0000","last_fullsized":"2024-09-14T11:52:27.099041+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:09.918507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5574302,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":530,"num_read_kb":44269,"num_write":996,"num_write_kb":27179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"264'134","reported_seq":639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.738672+0000","last_change":"2024-09-14T11:09:55.027528+0000","last_active":"2024-09-14T11:52:29.738672+0000","last_peered":"2024-09-14T11:52:29.738672+0000","last_clean":"2024-09-14T11:52:29.738672+0000","last_became_active":"2024-09-14T11:09:55.026753+0000","last_became_peered":"2024-09-14T11:09:55.026753+0000","last_unstale":"2024-09-14T11:52:29.738672+0000","last_undegraded":"2024-09-14T11:52:29.738672+0000","last_fullsized":"2024-09-14T11:52:29.738672+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:49.050538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":178,"num_read_kb":167,"num_write":319,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"264'372","reported_seq":1902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:00.697892+0000","last_change":"2024-09-14T11:09:46.985537+0000","last_active":"2024-09-14T11:52:00.697892+0000","last_peered":"2024-09-14T11:52:00.697892+0000","last_clean":"2024-09-14T11:52:00.697892+0000","last_became_active":"2024-09-14T11:09:46.985016+0000","last_became_peered":"2024-09-14T11:09:46.985016+0000","last_unstale":"2024-09-14T11:52:00.697892+0000","last_undegraded":"2024-09-14T11:52:00.697892+0000","last_fullsized":"2024-09-14T11:52:00.697892+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:37.173683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2187,"num_read_kb":2090,"num_write":422,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"264'238","reported_seq":880,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:38.924555+0000","last_change":"2024-09-14T11:09:45.209122+0000","last_active":"2024-09-14T11:51:38.924555+0000","last_peered":"2024-09-14T11:51:38.924555+0000","last_clean":"2024-09-14T11:51:38.924555+0000","last_became_active":"2024-09-14T11:09:45.208756+0000","last_became_peered":"2024-09-14T11:09:45.208756+0000","last_unstale":"2024-09-14T11:51:38.924555+0000","last_undegraded":"2024-09-14T11:51:38.924555+0000","last_fullsized":"2024-09-14T11:51:38.924555+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:05.011185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13693930,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":592,"num_read_kb":30329,"num_write":1156,"num_write_kb":41189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:54.318570+0000","last_change":"2024-09-14T11:09:48.970253+0000","last_active":"2024-09-14T11:50:54.318570+0000","last_peered":"2024-09-14T11:50:54.318570+0000","last_clean":"2024-09-14T11:50:54.318570+0000","last_became_active":"2024-09-14T11:09:48.969807+0000","last_became_peered":"2024-09-14T11:09:48.969807+0000","last_unstale":"2024-09-14T11:50:54.318570+0000","last_undegraded":"2024-09-14T11:50:54.318570+0000","last_fullsized":"2024-09-14T11:50:54.318570+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:20.729118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"264'192","reported_seq":788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:23.152637+0000","last_change":"2024-09-14T11:09:50.989686+0000","last_active":"2024-09-14T11:53:23.152637+0000","last_peered":"2024-09-14T11:53:23.152637+0000","last_clean":"2024-09-14T11:53:23.152637+0000","last_became_active":"2024-09-14T11:09:50.988903+0000","last_became_peered":"2024-09-14T11:09:50.988903+0000","last_unstale":"2024-09-14T11:53:23.152637+0000","last_undegraded":"2024-09-14T11:53:23.152637+0000","last_fullsized":"2024-09-14T11:53:23.152637+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:40.383215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25048,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":260,"num_read_kb":342,"num_write":158,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.271486+0000","last_change":"2024-09-14T11:09:53.012712+0000","last_active":"2024-09-14T11:50:58.271486+0000","last_peered":"2024-09-14T11:50:58.271486+0000","last_clean":"2024-09-14T11:50:58.271486+0000","last_became_active":"2024-09-14T11:09:53.010617+0000","last_became_peered":"2024-09-14T11:09:53.010617+0000","last_unstale":"2024-09-14T11:50:58.271486+0000","last_undegraded":"2024-09-14T11:50:58.271486+0000","last_fullsized":"2024-09-14T11:50:58.271486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:10.722614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"264'139","reported_seq":635,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:57.272034+0000","last_change":"2024-09-14T11:09:55.023108+0000","last_active":"2024-09-14T11:51:57.272034+0000","last_peered":"2024-09-14T11:51:57.272034+0000","last_clean":"2024-09-14T11:51:57.272034+0000","last_became_active":"2024-09-14T11:09:55.020070+0000","last_became_peered":"2024-09-14T11:09:55.020070+0000","last_unstale":"2024-09-14T11:51:57.272034+0000","last_undegraded":"2024-09-14T11:51:57.272034+0000","last_fullsized":"2024-09-14T11:51:57.272034+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:06.571541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":142,"num_write":346,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"264'927","reported_seq":2709,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.646957+0000","last_change":"2024-09-14T11:09:46.960339+0000","last_active":"2024-09-14T11:52:29.646957+0000","last_peered":"2024-09-14T11:52:29.646957+0000","last_clean":"2024-09-14T11:52:29.646957+0000","last_became_active":"2024-09-14T11:09:46.957383+0000","last_became_peered":"2024-09-14T11:09:46.957383+0000","last_unstale":"2024-09-14T11:52:29.646957+0000","last_undegraded":"2024-09-14T11:52:29.646957+0000","last_fullsized":"2024-09-14T11:52:29.646957+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:50.357529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4732,"num_read_kb":4281,"num_write":1231,"num_write_kb":469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"264'201","reported_seq":848,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:39.566556+0000","last_change":"2024-09-14T11:09:45.225975+0000","last_active":"2024-09-14T11:51:39.566556+0000","last_peered":"2024-09-14T11:51:39.566556+0000","last_clean":"2024-09-14T11:51:39.566556+0000","last_became_active":"2024-09-14T11:09:45.220059+0000","last_became_peered":"2024-09-14T11:09:45.220059+0000","last_unstale":"2024-09-14T11:51:39.566556+0000","last_undegraded":"2024-09-14T11:51:39.566556+0000","last_fullsized":"2024-09-14T11:51:39.566556+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:05.527234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6898712,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":631,"num_read_kb":15714,"num_write":932,"num_write_kb":28935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:33.101046+0000","last_change":"2024-09-14T11:09:48.950741+0000","last_active":"2024-09-14T11:49:33.101046+0000","last_peered":"2024-09-14T11:49:33.101046+0000","last_clean":"2024-09-14T11:49:33.101046+0000","last_became_active":"2024-09-14T11:09:48.950055+0000","last_became_peered":"2024-09-14T11:09:48.950055+0000","last_unstale":"2024-09-14T11:49:33.101046+0000","last_undegraded":"2024-09-14T11:49:33.101046+0000","last_fullsized":"2024-09-14T11:49:33.101046+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:57.249708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"264'83","reported_seq":604,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.188762+0000","last_change":"2024-09-14T11:09:50.989886+0000","last_active":"2024-09-14T11:52:12.188762+0000","last_peered":"2024-09-14T11:52:12.188762+0000","last_clean":"2024-09-14T11:52:12.188762+0000","last_became_active":"2024-09-14T11:09:50.989174+0000","last_became_peered":"2024-09-14T11:09:50.989174+0000","last_unstale":"2024-09-14T11:52:12.188762+0000","last_undegraded":"2024-09-14T11:52:12.188762+0000","last_fullsized":"2024-09-14T11:52:12.188762+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:37.575700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":97,"num_read_kb":91,"num_write":68,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.271407+0000","last_change":"2024-09-14T11:09:53.019238+0000","last_active":"2024-09-14T11:50:58.271407+0000","last_peered":"2024-09-14T11:50:58.271407+0000","last_clean":"2024-09-14T11:50:58.271407+0000","last_became_active":"2024-09-14T11:09:53.018290+0000","last_became_peered":"2024-09-14T11:09:53.018290+0000","last_unstale":"2024-09-14T11:50:58.271407+0000","last_undegraded":"2024-09-14T11:50:58.271407+0000","last_fullsized":"2024-09-14T11:50:58.271407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:48.018030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"264'93","reported_seq":588,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:08.416231+0000","last_change":"2024-09-14T11:09:55.019556+0000","last_active":"2024-09-14T11:52:08.416231+0000","last_peered":"2024-09-14T11:52:08.416231+0000","last_clean":"2024-09-14T11:52:08.416231+0000","last_became_active":"2024-09-14T11:09:55.018855+0000","last_became_peered":"2024-09-14T11:09:55.018855+0000","last_unstale":"2024-09-14T11:52:08.416231+0000","last_undegraded":"2024-09-14T11:52:08.416231+0000","last_fullsized":"2024-09-14T11:52:08.416231+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:52.671096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":100,"num_read_kb":99,"num_write":210,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"264'508","reported_seq":2252,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:10.847271+0000","last_change":"2024-09-14T11:09:46.987477+0000","last_active":"2024-09-14T11:52:10.847271+0000","last_peered":"2024-09-14T11:52:10.847271+0000","last_clean":"2024-09-14T11:52:10.847271+0000","last_became_active":"2024-09-14T11:09:46.975175+0000","last_became_peered":"2024-09-14T11:09:46.975175+0000","last_unstale":"2024-09-14T11:52:10.847271+0000","last_undegraded":"2024-09-14T11:52:10.847271+0000","last_fullsized":"2024-09-14T11:52:10.847271+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:10.227238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2885,"num_read_kb":2717,"num_write":615,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"264'235","reported_seq":851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:05.090009+0000","last_change":"2024-09-14T11:09:45.205362+0000","last_active":"2024-09-14T11:51:05.090009+0000","last_peered":"2024-09-14T11:51:05.090009+0000","last_clean":"2024-09-14T11:51:05.090009+0000","last_became_active":"2024-09-14T11:09:45.205019+0000","last_became_peered":"2024-09-14T11:09:45.205019+0000","last_unstale":"2024-09-14T11:51:05.090009+0000","last_undegraded":"2024-09-14T11:51:05.090009+0000","last_fullsized":"2024-09-14T11:51:05.090009+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:50.482486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4202036,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":561,"num_read_kb":1571,"num_write":1127,"num_write_kb":22204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.118825+0000","last_change":"2024-09-14T11:09:48.951014+0000","last_active":"2024-09-14T11:50:53.118825+0000","last_peered":"2024-09-14T11:50:53.118825+0000","last_clean":"2024-09-14T11:50:53.118825+0000","last_became_active":"2024-09-14T11:09:48.950260+0000","last_became_peered":"2024-09-14T11:09:48.950260+0000","last_unstale":"2024-09-14T11:50:53.118825+0000","last_undegraded":"2024-09-14T11:50:53.118825+0000","last_fullsized":"2024-09-14T11:50:53.118825+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:26.673899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"264'107","reported_seq":639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:54.342568+0000","last_change":"2024-09-14T11:09:50.978554+0000","last_active":"2024-09-14T11:51:54.342568+0000","last_peered":"2024-09-14T11:51:54.342568+0000","last_clean":"2024-09-14T11:51:54.342568+0000","last_became_active":"2024-09-14T11:09:50.977685+0000","last_became_peered":"2024-09-14T11:09:50.977685+0000","last_unstale":"2024-09-14T11:51:54.342568+0000","last_undegraded":"2024-09-14T11:51:54.342568+0000","last_fullsized":"2024-09-14T11:51:54.342568+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:18:08.590005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"264'786","reported_seq":2365,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.073795+0000","last_change":"2024-09-14T11:09:53.022562+0000","last_active":"2024-09-14T11:53:44.073795+0000","last_peered":"2024-09-14T11:53:44.073795+0000","last_clean":"2024-09-14T11:53:44.073795+0000","last_became_active":"2024-09-14T11:09:53.021212+0000","last_became_peered":"2024-09-14T11:09:53.021212+0000","last_unstale":"2024-09-14T11:53:44.073795+0000","last_undegraded":"2024-09-14T11:53:44.073795+0000","last_fullsized":"2024-09-14T11:53:44.073795+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:48.852973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"264'221","reported_seq":1056,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.124563+0000","last_change":"2024-09-14T11:09:55.014805+0000","last_active":"2024-09-14T11:52:29.124563+0000","last_peered":"2024-09-14T11:52:29.124563+0000","last_clean":"2024-09-14T11:52:29.124563+0000","last_became_active":"2024-09-14T11:09:55.013994+0000","last_became_peered":"2024-09-14T11:09:55.013994+0000","last_unstale":"2024-09-14T11:52:29.124563+0000","last_undegraded":"2024-09-14T11:52:29.124563+0000","last_fullsized":"2024-09-14T11:52:29.124563+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:49.818762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":446,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":657,"num_read_kb":640,"num_write":481,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"264'1912","reported_seq":3548,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.647332+0000","last_change":"2024-09-14T11:09:46.996404+0000","last_active":"2024-09-14T11:52:29.647332+0000","last_peered":"2024-09-14T11:52:29.647332+0000","last_clean":"2024-09-14T11:52:29.647332+0000","last_became_active":"2024-09-14T11:09:46.994623+0000","last_became_peered":"2024-09-14T11:09:46.994623+0000","last_unstale":"2024-09-14T11:52:29.647332+0000","last_undegraded":"2024-09-14T11:52:29.647332+0000","last_fullsized":"2024-09-14T11:52:29.647332+0000","mapping_epoch":25,"log_start":"264'1900","ondisk_log_start":"264'1900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":1900,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:51.392243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8495,"num_read_kb":7411,"num_write":2703,"num_write_kb":1197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"264'206","reported_seq":835,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:23.988653+0000","last_change":"2024-09-14T11:09:45.208803+0000","last_active":"2024-09-14T11:52:23.988653+0000","last_peered":"2024-09-14T11:52:23.988653+0000","last_clean":"2024-09-14T11:52:23.988653+0000","last_became_active":"2024-09-14T11:09:45.208282+0000","last_became_peered":"2024-09-14T11:09:45.208282+0000","last_unstale":"2024-09-14T11:52:23.988653+0000","last_undegraded":"2024-09-14T11:52:23.988653+0000","last_fullsized":"2024-09-14T11:52:23.988653+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:23.782528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12039070,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":514,"num_read_kb":14610,"num_write":969,"num_write_kb":27594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:54.318600+0000","last_change":"2024-09-14T11:09:48.959777+0000","last_active":"2024-09-14T11:50:54.318600+0000","last_peered":"2024-09-14T11:50:54.318600+0000","last_clean":"2024-09-14T11:50:54.318600+0000","last_became_active":"2024-09-14T11:09:48.959355+0000","last_became_peered":"2024-09-14T11:09:48.959355+0000","last_unstale":"2024-09-14T11:50:54.318600+0000","last_undegraded":"2024-09-14T11:50:54.318600+0000","last_fullsized":"2024-09-14T11:50:54.318600+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:29.593248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"264'117","reported_seq":682,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.135145+0000","last_change":"2024-09-14T11:09:50.984714+0000","last_active":"2024-09-14T11:53:24.135145+0000","last_peered":"2024-09-14T11:53:24.135145+0000","last_clean":"2024-09-14T11:53:24.135145+0000","last_became_active":"2024-09-14T11:09:50.984035+0000","last_became_peered":"2024-09-14T11:09:50.984035+0000","last_unstale":"2024-09-14T11:53:24.135145+0000","last_undegraded":"2024-09-14T11:53:24.135145+0000","last_fullsized":"2024-09-14T11:53:24.135145+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:31.803088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13272,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":211,"num_write":78,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"264'799","reported_seq":2128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.082670+0000","last_change":"2024-09-14T11:09:53.006772+0000","last_active":"2024-09-14T11:53:44.082670+0000","last_peered":"2024-09-14T11:53:44.082670+0000","last_clean":"2024-09-14T11:53:44.082670+0000","last_became_active":"2024-09-14T11:09:53.004265+0000","last_became_peered":"2024-09-14T11:09:53.004265+0000","last_unstale":"2024-09-14T11:53:44.082670+0000","last_undegraded":"2024-09-14T11:53:44.082670+0000","last_fullsized":"2024-09-14T11:53:44.082670+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:25.054903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"264'520","reported_seq":2229,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.108065+0000","last_change":"2024-09-14T11:09:46.963218+0000","last_active":"2024-09-14T11:53:43.108065+0000","last_peered":"2024-09-14T11:53:43.108065+0000","last_clean":"2024-09-14T11:53:43.108065+0000","last_became_active":"2024-09-14T11:09:46.962838+0000","last_became_peered":"2024-09-14T11:09:46.962838+0000","last_unstale":"2024-09-14T11:53:43.108065+0000","last_undegraded":"2024-09-14T11:53:43.108065+0000","last_fullsized":"2024-09-14T11:53:43.108065+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:16.557469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2791,"num_read_kb":2616,"num_write":587,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"264'269","reported_seq":931,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.885107+0000","last_change":"2024-09-14T11:09:45.219933+0000","last_active":"2024-09-14T11:52:09.885107+0000","last_peered":"2024-09-14T11:52:09.885107+0000","last_clean":"2024-09-14T11:52:09.885107+0000","last_became_active":"2024-09-14T11:09:45.219674+0000","last_became_peered":"2024-09-14T11:09:45.219674+0000","last_unstale":"2024-09-14T11:52:09.885107+0000","last_undegraded":"2024-09-14T11:52:09.885107+0000","last_fullsized":"2024-09-14T11:52:09.885107+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:05.295609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11390083,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":692,"num_read_kb":41266,"num_write":1211,"num_write_kb":49932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.271280+0000","last_change":"2024-09-14T11:09:48.958749+0000","last_active":"2024-09-14T11:50:58.271280+0000","last_peered":"2024-09-14T11:50:58.271280+0000","last_clean":"2024-09-14T11:50:58.271280+0000","last_became_active":"2024-09-14T11:09:48.958254+0000","last_became_peered":"2024-09-14T11:09:48.958254+0000","last_unstale":"2024-09-14T11:50:58.271280+0000","last_undegraded":"2024-09-14T11:50:58.271280+0000","last_fullsized":"2024-09-14T11:50:58.271280+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:42.595913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"264'188","reported_seq":788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:18.316228+0000","last_change":"2024-09-14T11:09:50.993372+0000","last_active":"2024-09-14T11:53:18.316228+0000","last_peered":"2024-09-14T11:53:18.316228+0000","last_clean":"2024-09-14T11:53:18.316228+0000","last_became_active":"2024-09-14T11:09:50.992673+0000","last_became_peered":"2024-09-14T11:09:50.992673+0000","last_unstale":"2024-09-14T11:53:18.316228+0000","last_undegraded":"2024-09-14T11:53:18.316228+0000","last_fullsized":"2024-09-14T11:53:18.316228+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:50.616252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11616,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":264,"num_read_kb":310,"num_write":150,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:23.114246+0000","last_change":"2024-09-14T11:09:53.008438+0000","last_active":"2024-09-14T11:50:23.114246+0000","last_peered":"2024-09-14T11:50:23.114246+0000","last_clean":"2024-09-14T11:50:23.114246+0000","last_became_active":"2024-09-14T11:09:53.007694+0000","last_became_peered":"2024-09-14T11:09:53.007694+0000","last_unstale":"2024-09-14T11:50:23.114246+0000","last_undegraded":"2024-09-14T11:50:23.114246+0000","last_fullsized":"2024-09-14T11:50:23.114246+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:56.147296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"264'565","reported_seq":1399,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.058548+0000","last_change":"2024-09-14T11:09:55.031185+0000","last_active":"2024-09-14T11:53:44.058548+0000","last_peered":"2024-09-14T11:53:44.058548+0000","last_clean":"2024-09-14T11:53:44.058548+0000","last_became_active":"2024-09-14T11:09:55.030659+0000","last_became_peered":"2024-09-14T11:09:55.030659+0000","last_unstale":"2024-09-14T11:53:44.058548+0000","last_undegraded":"2024-09-14T11:53:44.058548+0000","last_fullsized":"2024-09-14T11:53:44.058548+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:47.236046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1371,"num_read_kb":1346,"num_write":1205,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"264'1071","reported_seq":2641,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.646289+0000","last_change":"2024-09-14T11:09:46.990492+0000","last_active":"2024-09-14T11:52:29.646289+0000","last_peered":"2024-09-14T11:52:29.646289+0000","last_clean":"2024-09-14T11:52:29.646289+0000","last_became_active":"2024-09-14T11:09:46.990046+0000","last_became_peered":"2024-09-14T11:09:46.990046+0000","last_unstale":"2024-09-14T11:52:29.646289+0000","last_undegraded":"2024-09-14T11:52:29.646289+0000","last_fullsized":"2024-09-14T11:52:29.646289+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":1000,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:03.248978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5673,"num_read_kb":5118,"num_write":1579,"num_write_kb":694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"264'258","reported_seq":955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:42.758281+0000","last_change":"2024-09-14T11:09:45.211546+0000","last_active":"2024-09-14T11:51:42.758281+0000","last_peered":"2024-09-14T11:51:42.758281+0000","last_clean":"2024-09-14T11:51:42.758281+0000","last_became_active":"2024-09-14T11:09:45.210020+0000","last_became_peered":"2024-09-14T11:09:45.210020+0000","last_unstale":"2024-09-14T11:51:42.758281+0000","last_undegraded":"2024-09-14T11:51:42.758281+0000","last_fullsized":"2024-09-14T11:51:42.758281+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:40.715640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8411325,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":883,"num_read_kb":725,"num_write":1126,"num_write_kb":36716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.121796+0000","last_change":"2024-09-14T11:09:48.974766+0000","last_active":"2024-09-14T11:50:58.121796+0000","last_peered":"2024-09-14T11:50:58.121796+0000","last_clean":"2024-09-14T11:50:58.121796+0000","last_became_active":"2024-09-14T11:09:48.973945+0000","last_became_peered":"2024-09-14T11:09:48.973945+0000","last_unstale":"2024-09-14T11:50:58.121796+0000","last_undegraded":"2024-09-14T11:50:58.121796+0000","last_fullsized":"2024-09-14T11:50:58.121796+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:44.397689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"264'138","reported_seq":701,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:38.142497+0000","last_change":"2024-09-14T11:09:50.986632+0000","last_active":"2024-09-14T11:52:38.142497+0000","last_peered":"2024-09-14T11:52:38.142497+0000","last_clean":"2024-09-14T11:52:38.142497+0000","last_became_active":"2024-09-14T11:09:50.985800+0000","last_became_peered":"2024-09-14T11:09:50.985800+0000","last_unstale":"2024-09-14T11:52:38.142497+0000","last_undegraded":"2024-09-14T11:52:38.142497+0000","last_fullsized":"2024-09-14T11:52:38.142497+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:10:20.302521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17223,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":164,"num_read_kb":249,"num_write":92,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.122118+0000","last_change":"2024-09-14T11:09:53.003609+0000","last_active":"2024-09-14T11:51:08.122118+0000","last_peered":"2024-09-14T11:51:08.122118+0000","last_clean":"2024-09-14T11:51:08.122118+0000","last_became_active":"2024-09-14T11:09:53.002739+0000","last_became_peered":"2024-09-14T11:09:53.002739+0000","last_unstale":"2024-09-14T11:51:08.122118+0000","last_undegraded":"2024-09-14T11:51:08.122118+0000","last_fullsized":"2024-09-14T11:51:08.122118+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:34.134964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"264'2501","reported_seq":4368,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:33.422769+0000","last_change":"2024-09-14T11:09:55.020086+0000","last_active":"2024-09-14T11:53:33.422769+0000","last_peered":"2024-09-14T11:53:33.422769+0000","last_clean":"2024-09-14T11:53:33.422769+0000","last_became_active":"2024-09-14T11:09:55.017307+0000","last_became_peered":"2024-09-14T11:09:55.017307+0000","last_unstale":"2024-09-14T11:53:33.422769+0000","last_undegraded":"2024-09-14T11:53:33.422769+0000","last_fullsized":"2024-09-14T11:53:33.422769+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":2400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:26.762655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6356,"num_read_kb":6314,"num_write":5042,"num_write_kb":1853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"264'347","reported_seq":1756,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:03.283453+0000","last_change":"2024-09-14T11:09:46.953211+0000","last_active":"2024-09-14T11:52:03.283453+0000","last_peered":"2024-09-14T11:52:03.283453+0000","last_clean":"2024-09-14T11:52:03.283453+0000","last_became_active":"2024-09-14T11:09:46.952951+0000","last_became_peered":"2024-09-14T11:09:46.952951+0000","last_unstale":"2024-09-14T11:52:03.283453+0000","last_undegraded":"2024-09-14T11:52:03.283453+0000","last_fullsized":"2024-09-14T11:52:03.283453+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:11.659997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1860,"num_read_kb":1783,"num_write":380,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"264'219","reported_seq":855,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:05.334018+0000","last_change":"2024-09-14T11:09:45.211474+0000","last_active":"2024-09-14T11:52:05.334018+0000","last_peered":"2024-09-14T11:52:05.334018+0000","last_clean":"2024-09-14T11:52:05.334018+0000","last_became_active":"2024-09-14T11:09:45.211217+0000","last_became_peered":"2024-09-14T11:09:45.211217+0000","last_unstale":"2024-09-14T11:52:05.334018+0000","last_undegraded":"2024-09-14T11:52:05.334018+0000","last_fullsized":"2024-09-14T11:52:05.334018+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:46.779002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4541653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":596,"num_read_kb":7544,"num_write":1090,"num_write_kb":12612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.116225+0000","last_change":"2024-09-14T11:09:48.957986+0000","last_active":"2024-09-14T11:50:18.116225+0000","last_peered":"2024-09-14T11:50:18.116225+0000","last_clean":"2024-09-14T11:50:18.116225+0000","last_became_active":"2024-09-14T11:09:48.957275+0000","last_became_peered":"2024-09-14T11:09:48.957275+0000","last_unstale":"2024-09-14T11:50:18.116225+0000","last_undegraded":"2024-09-14T11:50:18.116225+0000","last_fullsized":"2024-09-14T11:50:18.116225+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:40.815434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"264'166","reported_seq":741,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.355017+0000","last_change":"2024-09-14T11:09:51.000566+0000","last_active":"2024-09-14T11:53:14.355017+0000","last_peered":"2024-09-14T11:53:14.355017+0000","last_clean":"2024-09-14T11:53:14.355017+0000","last_became_active":"2024-09-14T11:09:50.999759+0000","last_became_peered":"2024-09-14T11:09:50.999759+0000","last_unstale":"2024-09-14T11:53:14.355017+0000","last_undegraded":"2024-09-14T11:53:14.355017+0000","last_fullsized":"2024-09-14T11:53:14.355017+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:34.933664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11621,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":207,"num_read_kb":243,"num_write":122,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"264'799","reported_seq":2347,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.085022+0000","last_change":"2024-09-14T11:09:53.003439+0000","last_active":"2024-09-14T11:53:44.085022+0000","last_peered":"2024-09-14T11:53:44.085022+0000","last_clean":"2024-09-14T11:53:44.085022+0000","last_became_active":"2024-09-14T11:09:53.002667+0000","last_became_peered":"2024-09-14T11:09:53.002667+0000","last_unstale":"2024-09-14T11:53:44.085022+0000","last_undegraded":"2024-09-14T11:53:44.085022+0000","last_fullsized":"2024-09-14T11:53:44.085022+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:44.486567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"264'125","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.024032+0000","last_change":"2024-09-14T11:09:55.017516+0000","last_active":"2024-09-14T11:53:43.024032+0000","last_peered":"2024-09-14T11:53:43.024032+0000","last_clean":"2024-09-14T11:53:43.024032+0000","last_became_active":"2024-09-14T11:09:55.016802+0000","last_became_peered":"2024-09-14T11:09:55.016802+0000","last_unstale":"2024-09-14T11:53:43.024032+0000","last_undegraded":"2024-09-14T11:53:43.024032+0000","last_fullsized":"2024-09-14T11:53:43.024032+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:17.432120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":820,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":114,"num_write":311,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"264'746","reported_seq":2274,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.185022+0000","last_change":"2024-09-14T11:09:46.990182+0000","last_active":"2024-09-14T11:52:12.185022+0000","last_peered":"2024-09-14T11:52:12.185022+0000","last_clean":"2024-09-14T11:52:12.185022+0000","last_became_active":"2024-09-14T11:09:46.987523+0000","last_became_peered":"2024-09-14T11:09:46.987523+0000","last_unstale":"2024-09-14T11:52:12.185022+0000","last_undegraded":"2024-09-14T11:52:12.185022+0000","last_fullsized":"2024-09-14T11:52:12.185022+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":700,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:03.328090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3699,"num_read_kb":3347,"num_write":991,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"264'225","reported_seq":876,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:10.749350+0000","last_change":"2024-09-14T11:09:45.219279+0000","last_active":"2024-09-14T11:52:10.749350+0000","last_peered":"2024-09-14T11:52:10.749350+0000","last_clean":"2024-09-14T11:52:10.749350+0000","last_became_active":"2024-09-14T11:09:45.213648+0000","last_became_peered":"2024-09-14T11:09:45.213648+0000","last_unstale":"2024-09-14T11:52:10.749350+0000","last_undegraded":"2024-09-14T11:52:10.749350+0000","last_fullsized":"2024-09-14T11:52:10.749350+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:46.955930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10291031,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":590,"num_read_kb":9438,"num_write":1103,"num_write_kb":42718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.124431+0000","last_change":"2024-09-14T11:09:48.965750+0000","last_active":"2024-09-14T11:51:08.124431+0000","last_peered":"2024-09-14T11:51:08.124431+0000","last_clean":"2024-09-14T11:51:08.124431+0000","last_became_active":"2024-09-14T11:09:48.965014+0000","last_became_peered":"2024-09-14T11:09:48.965014+0000","last_unstale":"2024-09-14T11:51:08.124431+0000","last_undegraded":"2024-09-14T11:51:08.124431+0000","last_fullsized":"2024-09-14T11:51:08.124431+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:17.069310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"264'192","reported_seq":812,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.986030+0000","last_change":"2024-09-14T11:09:50.989754+0000","last_active":"2024-09-14T11:53:43.986030+0000","last_peered":"2024-09-14T11:53:43.986030+0000","last_clean":"2024-09-14T11:53:43.986030+0000","last_became_active":"2024-09-14T11:09:50.988991+0000","last_became_peered":"2024-09-14T11:09:50.988991+0000","last_unstale":"2024-09-14T11:53:43.986030+0000","last_undegraded":"2024-09-14T11:53:43.986030+0000","last_fullsized":"2024-09-14T11:53:43.986030+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:49.153350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25183,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":269,"num_read_kb":404,"num_write":140,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.126208+0000","last_change":"2024-09-14T11:09:53.011570+0000","last_active":"2024-09-14T11:51:03.126208+0000","last_peered":"2024-09-14T11:51:03.126208+0000","last_clean":"2024-09-14T11:51:03.126208+0000","last_became_active":"2024-09-14T11:09:53.010817+0000","last_became_peered":"2024-09-14T11:09:53.010817+0000","last_unstale":"2024-09-14T11:51:03.126208+0000","last_undegraded":"2024-09-14T11:51:03.126208+0000","last_fullsized":"2024-09-14T11:51:03.126208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:43.873697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"264'117","reported_seq":613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.729606+0000","last_change":"2024-09-14T11:09:55.026555+0000","last_active":"2024-09-14T11:52:29.729606+0000","last_peered":"2024-09-14T11:52:29.729606+0000","last_clean":"2024-09-14T11:52:29.729606+0000","last_became_active":"2024-09-14T11:09:55.025490+0000","last_became_peered":"2024-09-14T11:09:55.025490+0000","last_unstale":"2024-09-14T11:52:29.729606+0000","last_undegraded":"2024-09-14T11:52:29.729606+0000","last_fullsized":"2024-09-14T11:52:29.729606+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:27.983692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":533,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":108,"num_write":255,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"264'475","reported_seq":2021,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.038564+0000","last_change":"2024-09-14T11:09:46.971174+0000","last_active":"2024-09-14T11:52:29.038564+0000","last_peered":"2024-09-14T11:52:29.038564+0000","last_clean":"2024-09-14T11:52:29.038564+0000","last_became_active":"2024-09-14T11:09:46.970824+0000","last_became_peered":"2024-09-14T11:09:46.970824+0000","last_unstale":"2024-09-14T11:52:29.038564+0000","last_undegraded":"2024-09-14T11:52:29.038564+0000","last_fullsized":"2024-09-14T11:52:29.038564+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:12.281927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2551,"num_read_kb":2376,"num_write":583,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"264'192","reported_seq":783,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:39.530023+0000","last_change":"2024-09-14T11:09:45.217112+0000","last_active":"2024-09-14T11:50:39.530023+0000","last_peered":"2024-09-14T11:50:39.530023+0000","last_clean":"2024-09-14T11:50:39.530023+0000","last_became_active":"2024-09-14T11:09:45.216305+0000","last_became_peered":"2024-09-14T11:09:45.216305+0000","last_unstale":"2024-09-14T11:50:39.530023+0000","last_undegraded":"2024-09-14T11:50:39.530023+0000","last_fullsized":"2024-09-14T11:50:39.530023+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:30.530616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1791178,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":429,"num_read_kb":2004,"num_write":915,"num_write_kb":29719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.290996+0000","last_change":"2024-09-14T11:09:48.969005+0000","last_active":"2024-09-14T11:50:18.290996+0000","last_peered":"2024-09-14T11:50:18.290996+0000","last_clean":"2024-09-14T11:50:18.290996+0000","last_became_active":"2024-09-14T11:09:48.968263+0000","last_became_peered":"2024-09-14T11:09:48.968263+0000","last_unstale":"2024-09-14T11:50:18.290996+0000","last_undegraded":"2024-09-14T11:50:18.290996+0000","last_fullsized":"2024-09-14T11:50:18.290996+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:06.145563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"264'142","reported_seq":709,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:38.292857+0000","last_change":"2024-09-14T11:09:50.998839+0000","last_active":"2024-09-14T11:52:38.292857+0000","last_peered":"2024-09-14T11:52:38.292857+0000","last_clean":"2024-09-14T11:52:38.292857+0000","last_became_active":"2024-09-14T11:09:50.998098+0000","last_became_peered":"2024-09-14T11:09:50.998098+0000","last_unstale":"2024-09-14T11:52:38.292857+0000","last_undegraded":"2024-09-14T11:52:38.292857+0000","last_fullsized":"2024-09-14T11:52:38.292857+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:51.979698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16755,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":206,"num_read_kb":271,"num_write":164,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:28.293305+0000","last_change":"2024-09-14T11:09:53.004485+0000","last_active":"2024-09-14T11:50:28.293305+0000","last_peered":"2024-09-14T11:50:28.293305+0000","last_clean":"2024-09-14T11:50:28.293305+0000","last_became_active":"2024-09-14T11:09:53.003759+0000","last_became_peered":"2024-09-14T11:09:53.003759+0000","last_unstale":"2024-09-14T11:50:28.293305+0000","last_undegraded":"2024-09-14T11:50:28.293305+0000","last_fullsized":"2024-09-14T11:50:28.293305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:37.578578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"264'125","reported_seq":611,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.978197+0000","last_change":"2024-09-14T11:09:55.034286+0000","last_active":"2024-09-14T11:52:09.978197+0000","last_peered":"2024-09-14T11:52:09.978197+0000","last_clean":"2024-09-14T11:52:09.978197+0000","last_became_active":"2024-09-14T11:09:55.033844+0000","last_became_peered":"2024-09-14T11:09:55.033844+0000","last_unstale":"2024-09-14T11:52:09.978197+0000","last_undegraded":"2024-09-14T11:52:09.978197+0000","last_fullsized":"2024-09-14T11:52:09.978197+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:07.504626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":100,"num_write":302,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"264'542","reported_seq":2213,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:27.203748+0000","last_change":"2024-09-14T11:09:46.961567+0000","last_active":"2024-09-14T11:52:27.203748+0000","last_peered":"2024-09-14T11:52:27.203748+0000","last_clean":"2024-09-14T11:52:27.203748+0000","last_became_active":"2024-09-14T11:09:46.961100+0000","last_became_peered":"2024-09-14T11:09:46.961100+0000","last_unstale":"2024-09-14T11:52:27.203748+0000","last_undegraded":"2024-09-14T11:52:27.203748+0000","last_fullsized":"2024-09-14T11:52:27.203748+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:01.729846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2788,"num_read_kb":2597,"num_write":616,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"264'216","reported_seq":828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:07.521658+0000","last_change":"2024-09-14T11:09:45.199153+0000","last_active":"2024-09-14T11:52:07.521658+0000","last_peered":"2024-09-14T11:52:07.521658+0000","last_clean":"2024-09-14T11:52:07.521658+0000","last_became_active":"2024-09-14T11:09:45.198569+0000","last_became_peered":"2024-09-14T11:09:45.198569+0000","last_unstale":"2024-09-14T11:52:07.521658+0000","last_undegraded":"2024-09-14T11:52:07.521658+0000","last_fullsized":"2024-09-14T11:52:07.521658+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:01.792464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12605563,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":582,"num_read_kb":15211,"num_write":897,"num_write_kb":32712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.116267+0000","last_change":"2024-09-14T11:09:48.953393+0000","last_active":"2024-09-14T11:50:18.116267+0000","last_peered":"2024-09-14T11:50:18.116267+0000","last_clean":"2024-09-14T11:50:18.116267+0000","last_became_active":"2024-09-14T11:09:48.952531+0000","last_became_peered":"2024-09-14T11:09:48.952531+0000","last_unstale":"2024-09-14T11:50:18.116267+0000","last_undegraded":"2024-09-14T11:50:18.116267+0000","last_fullsized":"2024-09-14T11:50:18.116267+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:01.263241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"264'154","reported_seq":730,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:43.149322+0000","last_change":"2024-09-14T11:09:50.976197+0000","last_active":"2024-09-14T11:52:43.149322+0000","last_peered":"2024-09-14T11:52:43.149322+0000","last_clean":"2024-09-14T11:52:43.149322+0000","last_became_active":"2024-09-14T11:09:50.975455+0000","last_became_peered":"2024-09-14T11:09:50.975455+0000","last_unstale":"2024-09-14T11:52:43.149322+0000","last_undegraded":"2024-09-14T11:52:43.149322+0000","last_fullsized":"2024-09-14T11:52:43.149322+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:53.261559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21253,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":210,"num_read_kb":302,"num_write":120,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"264'770","reported_seq":2360,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.076095+0000","last_change":"2024-09-14T11:09:53.014808+0000","last_active":"2024-09-14T11:53:44.076095+0000","last_peered":"2024-09-14T11:53:44.076095+0000","last_clean":"2024-09-14T11:53:44.076095+0000","last_became_active":"2024-09-14T11:09:53.013805+0000","last_became_peered":"2024-09-14T11:09:53.013805+0000","last_unstale":"2024-09-14T11:53:44.076095+0000","last_undegraded":"2024-09-14T11:53:44.076095+0000","last_fullsized":"2024-09-14T11:53:44.076095+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:29.501003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"264'151","reported_seq":656,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:27.197059+0000","last_change":"2024-09-14T11:09:55.027376+0000","last_active":"2024-09-14T11:52:27.197059+0000","last_peered":"2024-09-14T11:52:27.197059+0000","last_clean":"2024-09-14T11:52:27.197059+0000","last_became_active":"2024-09-14T11:09:55.026656+0000","last_became_peered":"2024-09-14T11:09:55.026656+0000","last_unstale":"2024-09-14T11:52:27.197059+0000","last_undegraded":"2024-09-14T11:52:27.197059+0000","last_fullsized":"2024-09-14T11:52:27.197059+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:05.576224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1884,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":197,"num_read_kb":178,"num_write":396,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"264'507","reported_seq":2081,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.766264+0000","last_change":"2024-09-14T11:09:46.950232+0000","last_active":"2024-09-14T11:52:12.766264+0000","last_peered":"2024-09-14T11:52:12.766264+0000","last_clean":"2024-09-14T11:52:12.766264+0000","last_became_active":"2024-09-14T11:09:46.949867+0000","last_became_peered":"2024-09-14T11:09:46.949867+0000","last_unstale":"2024-09-14T11:52:12.766264+0000","last_undegraded":"2024-09-14T11:52:12.766264+0000","last_fullsized":"2024-09-14T11:52:12.766264+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:05.177389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2605,"num_read_kb":2418,"num_write":602,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"264'269","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.606829+0000","last_change":"2024-09-14T11:09:45.208220+0000","last_active":"2024-09-14T11:51:53.606829+0000","last_peered":"2024-09-14T11:51:53.606829+0000","last_clean":"2024-09-14T11:51:53.606829+0000","last_became_active":"2024-09-14T11:09:45.207969+0000","last_became_peered":"2024-09-14T11:09:45.207969+0000","last_unstale":"2024-09-14T11:51:53.606829+0000","last_undegraded":"2024-09-14T11:51:53.606829+0000","last_fullsized":"2024-09-14T11:51:53.606829+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:49.056243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9444878,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":712,"num_read_kb":90988,"num_write":1208,"num_write_kb":64456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1451,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.926866+0000","last_change":"2024-09-14T11:09:48.963010+0000","last_active":"2024-09-14T11:53:43.926866+0000","last_peered":"2024-09-14T11:53:43.926866+0000","last_clean":"2024-09-14T11:53:43.926866+0000","last_became_active":"2024-09-14T11:09:48.961946+0000","last_became_peered":"2024-09-14T11:09:48.961946+0000","last_unstale":"2024-09-14T11:53:43.926866+0000","last_undegraded":"2024-09-14T11:53:43.926866+0000","last_fullsized":"2024-09-14T11:53:43.926866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:33.499961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":954,"num_read_kb":954,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"264'82","reported_seq":597,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:06.162254+0000","last_change":"2024-09-14T11:09:50.997985+0000","last_active":"2024-09-14T11:52:06.162254+0000","last_peered":"2024-09-14T11:52:06.162254+0000","last_clean":"2024-09-14T11:52:06.162254+0000","last_became_active":"2024-09-14T11:09:50.997281+0000","last_became_peered":"2024-09-14T11:09:50.997281+0000","last_unstale":"2024-09-14T11:52:06.162254+0000","last_undegraded":"2024-09-14T11:52:06.162254+0000","last_fullsized":"2024-09-14T11:52:06.162254+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:22.957216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"264'798","reported_seq":4458,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.077976+0000","last_change":"2024-09-14T11:09:53.012817+0000","last_active":"2024-09-14T11:53:44.077976+0000","last_peered":"2024-09-14T11:53:44.077976+0000","last_clean":"2024-09-14T11:53:44.077976+0000","last_became_active":"2024-09-14T11:09:53.010631+0000","last_became_peered":"2024-09-14T11:09:53.010631+0000","last_unstale":"2024-09-14T11:53:44.077976+0000","last_undegraded":"2024-09-14T11:53:44.077976+0000","last_fullsized":"2024-09-14T11:53:44.077976+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:56.772893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"264'178","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:07.609486+0000","last_change":"2024-09-14T11:09:55.011221+0000","last_active":"2024-09-14T11:52:07.609486+0000","last_peered":"2024-09-14T11:52:07.609486+0000","last_clean":"2024-09-14T11:52:07.609486+0000","last_became_active":"2024-09-14T11:09:55.010215+0000","last_became_peered":"2024-09-14T11:09:55.010215+0000","last_unstale":"2024-09-14T11:52:07.609486+0000","last_undegraded":"2024-09-14T11:52:07.609486+0000","last_fullsized":"2024-09-14T11:52:07.609486+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:33.289296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":123,"num_read_kb":114,"num_write":415,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"264'410","reported_seq":1885,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.991420+0000","last_change":"2024-09-14T11:09:46.967866+0000","last_active":"2024-09-14T11:52:09.991420+0000","last_peered":"2024-09-14T11:52:09.991420+0000","last_clean":"2024-09-14T11:52:09.991420+0000","last_became_active":"2024-09-14T11:09:46.966876+0000","last_became_peered":"2024-09-14T11:09:46.966876+0000","last_unstale":"2024-09-14T11:52:09.991420+0000","last_undegraded":"2024-09-14T11:52:09.991420+0000","last_fullsized":"2024-09-14T11:52:09.991420+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:28.146124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2150,"num_read_kb":2036,"num_write":469,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"264'260","reported_seq":1010,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:04.801946+0000","last_change":"2024-09-14T11:09:45.200742+0000","last_active":"2024-09-14T11:52:04.801946+0000","last_peered":"2024-09-14T11:52:04.801946+0000","last_clean":"2024-09-14T11:52:04.801946+0000","last_became_active":"2024-09-14T11:09:45.200039+0000","last_became_peered":"2024-09-14T11:09:45.200039+0000","last_unstale":"2024-09-14T11:52:04.801946+0000","last_undegraded":"2024-09-14T11:52:04.801946+0000","last_fullsized":"2024-09-14T11:52:04.801946+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:15.438388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11536473,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":989,"num_read_kb":201012,"num_write":1225,"num_write_kb":37853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:19.309093+0000","last_change":"2024-09-14T11:09:48.973340+0000","last_active":"2024-09-14T11:50:19.309093+0000","last_peered":"2024-09-14T11:50:19.309093+0000","last_clean":"2024-09-14T11:50:19.309093+0000","last_became_active":"2024-09-14T11:09:48.972957+0000","last_became_peered":"2024-09-14T11:09:48.972957+0000","last_unstale":"2024-09-14T11:50:19.309093+0000","last_undegraded":"2024-09-14T11:50:19.309093+0000","last_fullsized":"2024-09-14T11:50:19.309093+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:18.626799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"264'193","reported_seq":791,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:38.292800+0000","last_change":"2024-09-14T11:09:50.992659+0000","last_active":"2024-09-14T11:52:38.292800+0000","last_peered":"2024-09-14T11:52:38.292800+0000","last_clean":"2024-09-14T11:52:38.292800+0000","last_became_active":"2024-09-14T11:09:50.991938+0000","last_became_peered":"2024-09-14T11:09:50.991938+0000","last_unstale":"2024-09-14T11:52:38.292800+0000","last_undegraded":"2024-09-14T11:52:38.292800+0000","last_fullsized":"2024-09-14T11:52:38.292800+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:19.906727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19285,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":253,"num_read_kb":314,"num_write":144,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:24.093470+0000","last_change":"2024-09-14T11:09:53.007158+0000","last_active":"2024-09-14T11:50:24.093470+0000","last_peered":"2024-09-14T11:50:24.093470+0000","last_clean":"2024-09-14T11:50:24.093470+0000","last_became_active":"2024-09-14T11:09:53.006350+0000","last_became_peered":"2024-09-14T11:09:53.006350+0000","last_unstale":"2024-09-14T11:50:24.093470+0000","last_undegraded":"2024-09-14T11:50:24.093470+0000","last_fullsized":"2024-09-14T11:50:24.093470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:53.484128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"264'117","reported_seq":602,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.069500+0000","last_change":"2024-09-14T11:09:55.013765+0000","last_active":"2024-09-14T11:52:29.069500+0000","last_peered":"2024-09-14T11:52:29.069500+0000","last_clean":"2024-09-14T11:52:29.069500+0000","last_became_active":"2024-09-14T11:09:55.012954+0000","last_became_peered":"2024-09-14T11:09:55.012954+0000","last_unstale":"2024-09-14T11:52:29.069500+0000","last_undegraded":"2024-09-14T11:52:29.069500+0000","last_fullsized":"2024-09-14T11:52:29.069500+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:40.472347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":106,"num_write":256,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"264'403","reported_seq":2070,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.038508+0000","last_change":"2024-09-14T11:09:46.961019+0000","last_active":"2024-09-14T11:52:29.038508+0000","last_peered":"2024-09-14T11:52:29.038508+0000","last_clean":"2024-09-14T11:52:29.038508+0000","last_became_active":"2024-09-14T11:09:46.960461+0000","last_became_peered":"2024-09-14T11:09:46.960461+0000","last_unstale":"2024-09-14T11:52:29.038508+0000","last_undegraded":"2024-09-14T11:52:29.038508+0000","last_fullsized":"2024-09-14T11:52:29.038508+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:23.203399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2438,"num_read_kb":2343,"num_write":447,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:38.279655+0000","last_change":"2024-09-14T11:09:30.311475+0000","last_active":"2024-09-14T11:51:38.279655+0000","last_peered":"2024-09-14T11:51:38.279655+0000","last_clean":"2024-09-14T11:51:38.279655+0000","last_became_active":"2024-09-14T11:09:30.309524+0000","last_became_peered":"2024-09-14T11:09:30.309524+0000","last_unstale":"2024-09-14T11:51:38.279655+0000","last_undegraded":"2024-09-14T11:51:38.279655+0000","last_fullsized":"2024-09-14T11:51:38.279655+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:29.042524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:29.042524+0000","last_clean_scrub_stamp":"2024-09-14T11:09:29.042524+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:30.098592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.325699+0000","last_change":"2024-09-14T11:09:38.138631+0000","last_active":"2024-09-14T11:51:19.325699+0000","last_peered":"2024-09-14T11:51:19.325699+0000","last_clean":"2024-09-14T11:51:19.325699+0000","last_became_active":"2024-09-14T11:09:36.264768+0000","last_became_peered":"2024-09-14T11:09:36.264768+0000","last_unstale":"2024-09-14T11:51:19.325699+0000","last_undegraded":"2024-09-14T11:51:19.325699+0000","last_fullsized":"2024-09-14T11:51:19.325699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:42.835248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092723999999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"264'260","reported_seq":1067,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:46.758886+0000","last_change":"2024-09-14T11:09:45.193906+0000","last_active":"2024-09-14T11:51:46.758886+0000","last_peered":"2024-09-14T11:51:46.758886+0000","last_clean":"2024-09-14T11:51:46.758886+0000","last_became_active":"2024-09-14T11:09:45.193131+0000","last_became_peered":"2024-09-14T11:09:45.193131+0000","last_unstale":"2024-09-14T11:51:46.758886+0000","last_undegraded":"2024-09-14T11:51:46.758886+0000","last_fullsized":"2024-09-14T11:51:46.758886+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:48.612008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5310725,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1118,"num_read_kb":141056,"num_write":1035,"num_write_kb":44809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:28.295205+0000","last_change":"2024-09-14T11:09:48.970982+0000","last_active":"2024-09-14T11:51:28.295205+0000","last_peered":"2024-09-14T11:51:28.295205+0000","last_clean":"2024-09-14T11:51:28.295205+0000","last_became_active":"2024-09-14T11:09:48.970541+0000","last_became_peered":"2024-09-14T11:09:48.970541+0000","last_unstale":"2024-09-14T11:51:28.295205+0000","last_undegraded":"2024-09-14T11:51:28.295205+0000","last_fullsized":"2024-09-14T11:51:28.295205+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:59.863519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"264'287","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.018200+0000","last_change":"2024-09-14T11:09:50.994191+0000","last_active":"2024-09-14T11:53:44.018200+0000","last_peered":"2024-09-14T11:53:44.018200+0000","last_clean":"2024-09-14T11:53:44.018200+0000","last_became_active":"2024-09-14T11:09:50.993231+0000","last_became_peered":"2024-09-14T11:09:50.993231+0000","last_unstale":"2024-09-14T11:53:44.018200+0000","last_undegraded":"2024-09-14T11:53:44.018200+0000","last_fullsized":"2024-09-14T11:53:44.018200+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:10.493181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30416,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":522,"num_read_kb":647,"num_write":472,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.126495+0000","last_change":"2024-09-14T11:09:53.006544+0000","last_active":"2024-09-14T11:51:03.126495+0000","last_peered":"2024-09-14T11:51:03.126495+0000","last_clean":"2024-09-14T11:51:03.126495+0000","last_became_active":"2024-09-14T11:09:53.004338+0000","last_became_peered":"2024-09-14T11:09:53.004338+0000","last_unstale":"2024-09-14T11:51:03.126495+0000","last_undegraded":"2024-09-14T11:51:03.126495+0000","last_fullsized":"2024-09-14T11:51:03.126495+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:24.238705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"264'234","reported_seq":943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.660948+0000","last_change":"2024-09-14T11:09:55.016385+0000","last_active":"2024-09-14T11:52:29.660948+0000","last_peered":"2024-09-14T11:52:29.660948+0000","last_clean":"2024-09-14T11:52:29.660948+0000","last_became_active":"2024-09-14T11:09:55.015569+0000","last_became_peered":"2024-09-14T11:09:55.015569+0000","last_unstale":"2024-09-14T11:52:29.660948+0000","last_undegraded":"2024-09-14T11:52:29.660948+0000","last_fullsized":"2024-09-14T11:52:29.660948+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:05.577627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1424,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":528,"num_read_kb":505,"num_write":525,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"264'793","reported_seq":2248,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.037887+0000","last_change":"2024-09-14T11:09:46.975255+0000","last_active":"2024-09-14T11:52:29.037887+0000","last_peered":"2024-09-14T11:52:29.037887+0000","last_clean":"2024-09-14T11:52:29.037887+0000","last_became_active":"2024-09-14T11:09:46.974517+0000","last_became_peered":"2024-09-14T11:09:46.974517+0000","last_unstale":"2024-09-14T11:52:29.037887+0000","last_undegraded":"2024-09-14T11:52:29.037887+0000","last_fullsized":"2024-09-14T11:52:29.037887+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:37.949762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3876,"num_read_kb":3470,"num_write":1072,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:44.331934+0000","last_change":"2024-09-14T11:09:38.138820+0000","last_active":"2024-09-14T11:51:44.331934+0000","last_peered":"2024-09-14T11:51:44.331934+0000","last_clean":"2024-09-14T11:51:44.331934+0000","last_became_active":"2024-09-14T11:09:36.110037+0000","last_became_peered":"2024-09-14T11:09:36.110037+0000","last_unstale":"2024-09-14T11:51:44.331934+0000","last_undegraded":"2024-09-14T11:51:44.331934+0000","last_fullsized":"2024-09-14T11:51:44.331934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:29.413375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001043441,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"264'222","reported_seq":873,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:28.129009+0000","last_change":"2024-09-14T11:09:45.212152+0000","last_active":"2024-09-14T11:51:28.129009+0000","last_peered":"2024-09-14T11:51:28.129009+0000","last_clean":"2024-09-14T11:51:28.129009+0000","last_became_active":"2024-09-14T11:09:45.211579+0000","last_became_peered":"2024-09-14T11:09:45.211579+0000","last_unstale":"2024-09-14T11:51:28.129009+0000","last_undegraded":"2024-09-14T11:51:28.129009+0000","last_fullsized":"2024-09-14T11:51:28.129009+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:17.532123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6898702,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":624,"num_read_kb":58466,"num_write":934,"num_write_kb":31030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:59.320409+0000","last_change":"2024-09-14T11:09:48.970703+0000","last_active":"2024-09-14T11:50:59.320409+0000","last_peered":"2024-09-14T11:50:59.320409+0000","last_clean":"2024-09-14T11:50:59.320409+0000","last_became_active":"2024-09-14T11:09:48.970218+0000","last_became_peered":"2024-09-14T11:09:48.970218+0000","last_unstale":"2024-09-14T11:50:59.320409+0000","last_undegraded":"2024-09-14T11:50:59.320409+0000","last_fullsized":"2024-09-14T11:50:59.320409+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:45.534332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"264'851","reported_seq":2297,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.067742+0000","last_change":"2024-09-14T11:09:50.997084+0000","last_active":"2024-09-14T11:53:44.067742+0000","last_peered":"2024-09-14T11:53:44.067742+0000","last_clean":"2024-09-14T11:53:44.067742+0000","last_became_active":"2024-09-14T11:09:50.996406+0000","last_became_peered":"2024-09-14T11:09:50.996406+0000","last_unstale":"2024-09-14T11:53:44.067742+0000","last_undegraded":"2024-09-14T11:53:44.067742+0000","last_fullsized":"2024-09-14T11:53:44.067742+0000","mapping_epoch":29,"log_start":"264'800","ondisk_log_start":"264'800","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:20.571461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44447,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1154,"num_read_kb":1341,"num_write":276,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:39.330945+0000","last_change":"2024-09-14T11:09:53.022628+0000","last_active":"2024-09-14T11:51:39.330945+0000","last_peered":"2024-09-14T11:51:39.330945+0000","last_clean":"2024-09-14T11:51:39.330945+0000","last_became_active":"2024-09-14T11:09:53.022006+0000","last_became_peered":"2024-09-14T11:09:53.022006+0000","last_unstale":"2024-09-14T11:51:39.330945+0000","last_undegraded":"2024-09-14T11:51:39.330945+0000","last_fullsized":"2024-09-14T11:51:39.330945+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:49.069626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"264'217","reported_seq":744,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.027091+0000","last_change":"2024-09-14T11:09:55.024709+0000","last_active":"2024-09-14T11:52:29.027091+0000","last_peered":"2024-09-14T11:52:29.027091+0000","last_clean":"2024-09-14T11:52:29.027091+0000","last_became_active":"2024-09-14T11:09:55.023966+0000","last_became_peered":"2024-09-14T11:09:55.023966+0000","last_unstale":"2024-09-14T11:52:29.027091+0000","last_undegraded":"2024-09-14T11:52:29.027091+0000","last_fullsized":"2024-09-14T11:52:29.027091+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:34.668812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":224,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":295,"num_read_kb":259,"num_write":448,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"264'464","reported_seq":2168,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.103565+0000","last_change":"2024-09-14T11:09:46.982064+0000","last_active":"2024-09-14T11:53:43.103565+0000","last_peered":"2024-09-14T11:53:43.103565+0000","last_clean":"2024-09-14T11:53:43.103565+0000","last_became_active":"2024-09-14T11:09:46.981472+0000","last_became_peered":"2024-09-14T11:09:46.981472+0000","last_unstale":"2024-09-14T11:53:43.103565+0000","last_undegraded":"2024-09-14T11:53:43.103565+0000","last_fullsized":"2024-09-14T11:53:43.103565+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:06.355503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2625,"num_read_kb":2493,"num_write":542,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:18.309372+0000","last_change":"2024-09-14T11:09:38.679236+0000","last_active":"2024-09-14T11:51:18.309372+0000","last_peered":"2024-09-14T11:51:18.309372+0000","last_clean":"2024-09-14T11:51:18.309372+0000","last_became_active":"2024-09-14T11:09:36.110778+0000","last_became_peered":"2024-09-14T11:09:36.110778+0000","last_unstale":"2024-09-14T11:51:18.309372+0000","last_undegraded":"2024-09-14T11:51:18.309372+0000","last_fullsized":"2024-09-14T11:51:18.309372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:49.202249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001188634,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"264'177","reported_seq":774,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.137745+0000","last_change":"2024-09-14T11:09:45.215379+0000","last_active":"2024-09-14T11:51:53.137745+0000","last_peered":"2024-09-14T11:51:53.137745+0000","last_clean":"2024-09-14T11:51:53.137745+0000","last_became_active":"2024-09-14T11:09:45.214670+0000","last_became_peered":"2024-09-14T11:09:45.214670+0000","last_unstale":"2024-09-14T11:51:53.137745+0000","last_undegraded":"2024-09-14T11:51:53.137745+0000","last_fullsized":"2024-09-14T11:51:53.137745+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:31.182118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":423,"num_read_kb":11641,"num_write":791,"num_write_kb":32063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.300064+0000","last_change":"2024-09-14T11:09:48.969846+0000","last_active":"2024-09-14T11:50:58.300064+0000","last_peered":"2024-09-14T11:50:58.300064+0000","last_clean":"2024-09-14T11:50:58.300064+0000","last_became_active":"2024-09-14T11:09:48.968973+0000","last_became_peered":"2024-09-14T11:09:48.968973+0000","last_unstale":"2024-09-14T11:50:58.300064+0000","last_undegraded":"2024-09-14T11:50:58.300064+0000","last_fullsized":"2024-09-14T11:50:58.300064+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:16.223050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"264'234","reported_seq":1305,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.321387+0000","last_change":"2024-09-14T11:09:50.993349+0000","last_active":"2024-09-14T11:53:43.321387+0000","last_peered":"2024-09-14T11:53:43.321387+0000","last_clean":"2024-09-14T11:53:43.321387+0000","last_became_active":"2024-09-14T11:09:50.992589+0000","last_became_peered":"2024-09-14T11:09:50.992589+0000","last_unstale":"2024-09-14T11:53:43.321387+0000","last_undegraded":"2024-09-14T11:53:43.321387+0000","last_fullsized":"2024-09-14T11:53:43.321387+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:20.023339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":182,"num_read_kb":171,"num_write":149,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:33.127635+0000","last_change":"2024-09-14T11:09:53.008567+0000","last_active":"2024-09-14T11:51:33.127635+0000","last_peered":"2024-09-14T11:51:33.127635+0000","last_clean":"2024-09-14T11:51:33.127635+0000","last_became_active":"2024-09-14T11:09:53.007705+0000","last_became_peered":"2024-09-14T11:09:53.007705+0000","last_unstale":"2024-09-14T11:51:33.127635+0000","last_undegraded":"2024-09-14T11:51:33.127635+0000","last_fullsized":"2024-09-14T11:51:33.127635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:31.442222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"264'272","reported_seq":868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.845028+0000","last_change":"2024-09-14T11:09:55.014709+0000","last_active":"2024-09-14T11:52:29.845028+0000","last_peered":"2024-09-14T11:52:29.845028+0000","last_clean":"2024-09-14T11:52:29.845028+0000","last_became_active":"2024-09-14T11:09:55.013944+0000","last_became_peered":"2024-09-14T11:09:55.013944+0000","last_unstale":"2024-09-14T11:52:29.845028+0000","last_undegraded":"2024-09-14T11:52:29.845028+0000","last_fullsized":"2024-09-14T11:52:29.845028+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:31.373231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":495,"num_read_kb":519,"num_write":596,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"264'931","reported_seq":2815,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.038263+0000","last_change":"2024-09-14T11:09:46.982912+0000","last_active":"2024-09-14T11:52:29.038263+0000","last_peered":"2024-09-14T11:52:29.038263+0000","last_clean":"2024-09-14T11:52:29.038263+0000","last_became_active":"2024-09-14T11:09:46.982027+0000","last_became_peered":"2024-09-14T11:09:46.982027+0000","last_unstale":"2024-09-14T11:52:29.038263+0000","last_undegraded":"2024-09-14T11:52:29.038263+0000","last_fullsized":"2024-09-14T11:52:29.038263+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":900,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:07.510355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4697,"num_read_kb":4271,"num_write":1214,"num_write_kb":435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.325611+0000","last_change":"2024-09-14T11:09:38.140129+0000","last_active":"2024-09-14T11:51:19.325611+0000","last_peered":"2024-09-14T11:51:19.325611+0000","last_clean":"2024-09-14T11:51:19.325611+0000","last_became_active":"2024-09-14T11:09:36.887391+0000","last_became_peered":"2024-09-14T11:09:36.887391+0000","last_unstale":"2024-09-14T11:51:19.325611+0000","last_undegraded":"2024-09-14T11:51:19.325611+0000","last_fullsized":"2024-09-14T11:51:19.325611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:23.561067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023357849999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"264'258","reported_seq":903,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:35.668869+0000","last_change":"2024-09-14T11:09:45.206950+0000","last_active":"2024-09-14T11:53:35.668869+0000","last_peered":"2024-09-14T11:53:35.668869+0000","last_clean":"2024-09-14T11:53:35.668869+0000","last_became_active":"2024-09-14T11:09:45.206492+0000","last_became_peered":"2024-09-14T11:09:45.206492+0000","last_unstale":"2024-09-14T11:53:35.668869+0000","last_undegraded":"2024-09-14T11:53:35.668869+0000","last_fullsized":"2024-09-14T11:53:35.668869+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:09.076068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1375633,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":652,"num_read_kb":889,"num_write":1194,"num_write_kb":16465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:33.313136+0000","last_change":"2024-09-14T11:09:48.977354+0000","last_active":"2024-09-14T11:51:33.313136+0000","last_peered":"2024-09-14T11:51:33.313136+0000","last_clean":"2024-09-14T11:51:33.313136+0000","last_became_active":"2024-09-14T11:09:48.976315+0000","last_became_peered":"2024-09-14T11:09:48.976315+0000","last_unstale":"2024-09-14T11:51:33.313136+0000","last_undegraded":"2024-09-14T11:51:33.313136+0000","last_fullsized":"2024-09-14T11:51:33.313136+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:11:27.454227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"264'121","reported_seq":658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:13.156135+0000","last_change":"2024-09-14T11:09:50.983682+0000","last_active":"2024-09-14T11:53:13.156135+0000","last_peered":"2024-09-14T11:53:13.156135+0000","last_clean":"2024-09-14T11:53:13.156135+0000","last_became_active":"2024-09-14T11:09:50.983126+0000","last_became_peered":"2024-09-14T11:09:50.983126+0000","last_unstale":"2024-09-14T11:53:13.156135+0000","last_undegraded":"2024-09-14T11:53:13.156135+0000","last_fullsized":"2024-09-14T11:53:13.156135+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:01.407533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:04.321826+0000","last_change":"2024-09-14T11:09:53.015879+0000","last_active":"2024-09-14T11:51:04.321826+0000","last_peered":"2024-09-14T11:51:04.321826+0000","last_clean":"2024-09-14T11:51:04.321826+0000","last_became_active":"2024-09-14T11:09:53.015100+0000","last_became_peered":"2024-09-14T11:09:53.015100+0000","last_unstale":"2024-09-14T11:51:04.321826+0000","last_undegraded":"2024-09-14T11:51:04.321826+0000","last_fullsized":"2024-09-14T11:51:04.321826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:14:31.622686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"264'126","reported_seq":676,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:27.192089+0000","last_change":"2024-09-14T11:09:55.025662+0000","last_active":"2024-09-14T11:52:27.192089+0000","last_peered":"2024-09-14T11:52:27.192089+0000","last_clean":"2024-09-14T11:52:27.192089+0000","last_became_active":"2024-09-14T11:09:55.025030+0000","last_became_peered":"2024-09-14T11:09:55.025030+0000","last_unstale":"2024-09-14T11:52:27.192089+0000","last_undegraded":"2024-09-14T11:52:27.192089+0000","last_fullsized":"2024-09-14T11:52:27.192089+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:47.329558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":244,"num_read_kb":234,"num_write":307,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"264'430","reported_seq":1972,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.026058+0000","last_change":"2024-09-14T11:09:46.982402+0000","last_active":"2024-09-14T11:52:09.026058+0000","last_peered":"2024-09-14T11:52:09.026058+0000","last_clean":"2024-09-14T11:52:09.026058+0000","last_became_active":"2024-09-14T11:09:46.981578+0000","last_became_peered":"2024-09-14T11:09:46.981578+0000","last_unstale":"2024-09-14T11:52:09.026058+0000","last_undegraded":"2024-09-14T11:52:09.026058+0000","last_fullsized":"2024-09-14T11:52:09.026058+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:46.587772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2336,"num_read_kb":2209,"num_write":501,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"264'234","reported_seq":872,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:50.925761+0000","last_change":"2024-09-14T11:09:45.216526+0000","last_active":"2024-09-14T11:51:50.925761+0000","last_peered":"2024-09-14T11:51:50.925761+0000","last_clean":"2024-09-14T11:51:50.925761+0000","last_became_active":"2024-09-14T11:09:45.216168+0000","last_became_peered":"2024-09-14T11:09:45.216168+0000","last_unstale":"2024-09-14T11:51:50.925761+0000","last_undegraded":"2024-09-14T11:51:50.925761+0000","last_fullsized":"2024-09-14T11:51:50.925761+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:50.757149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9476046,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":591,"num_read_kb":12394,"num_write":1036,"num_write_kb":24779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:18.129696+0000","last_change":"2024-09-14T11:09:38.679466+0000","last_active":"2024-09-14T11:51:18.129696+0000","last_peered":"2024-09-14T11:51:18.129696+0000","last_clean":"2024-09-14T11:51:18.129696+0000","last_became_active":"2024-09-14T11:09:36.887411+0000","last_became_peered":"2024-09-14T11:09:36.887411+0000","last_unstale":"2024-09-14T11:51:18.129696+0000","last_undegraded":"2024-09-14T11:51:18.129696+0000","last_fullsized":"2024-09-14T11:51:18.129696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:17.852943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001210341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:28.126561+0000","last_change":"2024-09-14T11:09:48.973058+0000","last_active":"2024-09-14T11:51:28.126561+0000","last_peered":"2024-09-14T11:51:28.126561+0000","last_clean":"2024-09-14T11:51:28.126561+0000","last_became_active":"2024-09-14T11:09:48.969262+0000","last_became_peered":"2024-09-14T11:09:48.969262+0000","last_unstale":"2024-09-14T11:51:28.126561+0000","last_undegraded":"2024-09-14T11:51:28.126561+0000","last_fullsized":"2024-09-14T11:51:28.126561+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:26.478140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"264'274","reported_seq":920,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.001396+0000","last_change":"2024-09-14T11:09:50.992720+0000","last_active":"2024-09-14T11:53:44.001396+0000","last_peered":"2024-09-14T11:53:44.001396+0000","last_clean":"2024-09-14T11:53:44.001396+0000","last_became_active":"2024-09-14T11:09:50.991958+0000","last_became_peered":"2024-09-14T11:09:50.991958+0000","last_unstale":"2024-09-14T11:53:44.001396+0000","last_undegraded":"2024-09-14T11:53:44.001396+0000","last_fullsized":"2024-09-14T11:53:44.001396+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:06.240758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30144,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1020,"num_read_kb":1155,"num_write":1528,"num_write_kb":1391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:34.110192+0000","last_change":"2024-09-14T11:09:53.002718+0000","last_active":"2024-09-14T11:51:34.110192+0000","last_peered":"2024-09-14T11:51:34.110192+0000","last_clean":"2024-09-14T11:51:34.110192+0000","last_became_active":"2024-09-14T11:09:53.001945+0000","last_became_peered":"2024-09-14T11:09:53.001945+0000","last_unstale":"2024-09-14T11:51:34.110192+0000","last_undegraded":"2024-09-14T11:51:34.110192+0000","last_fullsized":"2024-09-14T11:51:34.110192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:52.861043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"264'176","reported_seq":711,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:08.421243+0000","last_change":"2024-09-14T11:09:55.019726+0000","last_active":"2024-09-14T11:52:08.421243+0000","last_peered":"2024-09-14T11:52:08.421243+0000","last_clean":"2024-09-14T11:52:08.421243+0000","last_became_active":"2024-09-14T11:09:55.019043+0000","last_became_peered":"2024-09-14T11:09:55.019043+0000","last_unstale":"2024-09-14T11:52:08.421243+0000","last_undegraded":"2024-09-14T11:52:08.421243+0000","last_fullsized":"2024-09-14T11:52:08.421243+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:33.587845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":311,"num_read_kb":271,"num_write":434,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"264'392","reported_seq":1909,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.024097+0000","last_change":"2024-09-14T11:09:46.980131+0000","last_active":"2024-09-14T11:52:09.024097+0000","last_peered":"2024-09-14T11:52:09.024097+0000","last_clean":"2024-09-14T11:52:09.024097+0000","last_became_active":"2024-09-14T11:09:46.979673+0000","last_became_peered":"2024-09-14T11:09:46.979673+0000","last_unstale":"2024-09-14T11:52:09.024097+0000","last_undegraded":"2024-09-14T11:52:09.024097+0000","last_fullsized":"2024-09-14T11:52:09.024097+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:23.116963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2181,"num_read_kb":2077,"num_write":440,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"264'169","reported_seq":740,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:43.411940+0000","last_change":"2024-09-14T11:09:45.222105+0000","last_active":"2024-09-14T11:51:43.411940+0000","last_peered":"2024-09-14T11:51:43.411940+0000","last_clean":"2024-09-14T11:51:43.411940+0000","last_became_active":"2024-09-14T11:09:45.220512+0000","last_became_peered":"2024-09-14T11:09:45.220512+0000","last_unstale":"2024-09-14T11:51:43.411940+0000","last_undegraded":"2024-09-14T11:51:43.411940+0000","last_fullsized":"2024-09-14T11:51:43.411940+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:34.422225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2704449,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":335,"num_read_kb":1928,"num_write":797,"num_write_kb":32938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:24.327126+0000","last_change":"2024-09-14T11:09:38.140706+0000","last_active":"2024-09-14T11:51:24.327126+0000","last_peered":"2024-09-14T11:51:24.327126+0000","last_clean":"2024-09-14T11:51:24.327126+0000","last_became_active":"2024-09-14T11:09:36.110624+0000","last_became_peered":"2024-09-14T11:09:36.110624+0000","last_unstale":"2024-09-14T11:51:24.327126+0000","last_undegraded":"2024-09-14T11:51:24.327126+0000","last_fullsized":"2024-09-14T11:51:24.327126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:03.769383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002569127,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:28.295129+0000","last_change":"2024-09-14T11:09:48.968649+0000","last_active":"2024-09-14T11:51:28.295129+0000","last_peered":"2024-09-14T11:51:28.295129+0000","last_clean":"2024-09-14T11:51:28.295129+0000","last_became_active":"2024-09-14T11:09:48.968130+0000","last_became_peered":"2024-09-14T11:09:48.968130+0000","last_unstale":"2024-09-14T11:51:28.295129+0000","last_undegraded":"2024-09-14T11:51:28.295129+0000","last_fullsized":"2024-09-14T11:51:28.295129+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:38.760974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"264'157","reported_seq":716,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:33.130356+0000","last_change":"2024-09-14T11:09:50.998266+0000","last_active":"2024-09-14T11:51:33.130356+0000","last_peered":"2024-09-14T11:51:33.130356+0000","last_clean":"2024-09-14T11:51:33.130356+0000","last_became_active":"2024-09-14T11:09:50.997665+0000","last_became_peered":"2024-09-14T11:09:50.997665+0000","last_unstale":"2024-09-14T11:51:33.130356+0000","last_undegraded":"2024-09-14T11:51:33.130356+0000","last_fullsized":"2024-09-14T11:51:33.130356+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:11.749451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":193,"num_read_kb":186,"num_write":126,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"264'799","reported_seq":2768,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.071772+0000","last_change":"2024-09-14T11:09:53.019274+0000","last_active":"2024-09-14T11:53:44.071772+0000","last_peered":"2024-09-14T11:53:44.071772+0000","last_clean":"2024-09-14T11:53:44.071772+0000","last_became_active":"2024-09-14T11:09:53.018558+0000","last_became_peered":"2024-09-14T11:09:53.018558+0000","last_unstale":"2024-09-14T11:53:44.071772+0000","last_undegraded":"2024-09-14T11:53:44.071772+0000","last_fullsized":"2024-09-14T11:53:44.071772+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:50.014596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"264'101","reported_seq":592,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:48.332986+0000","last_change":"2024-09-14T11:09:55.024161+0000","last_active":"2024-09-14T11:52:48.332986+0000","last_peered":"2024-09-14T11:52:48.332986+0000","last_clean":"2024-09-14T11:52:48.332986+0000","last_became_active":"2024-09-14T11:09:55.017739+0000","last_became_peered":"2024-09-14T11:09:55.017739+0000","last_unstale":"2024-09-14T11:52:48.332986+0000","last_undegraded":"2024-09-14T11:52:48.332986+0000","last_fullsized":"2024-09-14T11:52:48.332986+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:11.037869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":97,"num_read_kb":96,"num_write":232,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"264'1040","reported_seq":2573,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.647300+0000","last_change":"2024-09-14T11:09:46.963627+0000","last_active":"2024-09-14T11:52:29.647300+0000","last_peered":"2024-09-14T11:52:29.647300+0000","last_clean":"2024-09-14T11:52:29.647300+0000","last_became_active":"2024-09-14T11:09:46.958507+0000","last_became_peered":"2024-09-14T11:09:46.958507+0000","last_unstale":"2024-09-14T11:52:29.647300+0000","last_undegraded":"2024-09-14T11:52:29.647300+0000","last_fullsized":"2024-09-14T11:52:29.647300+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":1000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:27.643352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4784,"num_read_kb":4190,"num_write":1482,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"264'206","reported_seq":840,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.083280+0000","last_change":"2024-09-14T11:09:45.217672+0000","last_active":"2024-09-14T11:52:12.083280+0000","last_peered":"2024-09-14T11:52:12.083280+0000","last_clean":"2024-09-14T11:52:12.083280+0000","last_became_active":"2024-09-14T11:09:45.217039+0000","last_became_peered":"2024-09-14T11:09:45.217039+0000","last_unstale":"2024-09-14T11:52:12.083280+0000","last_undegraded":"2024-09-14T11:52:12.083280+0000","last_fullsized":"2024-09-14T11:52:12.083280+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:21.713459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3515727,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":528,"num_read_kb":14758,"num_write":970,"num_write_kb":31870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:48.117767+0000","last_change":"2024-09-14T11:09:38.679232+0000","last_active":"2024-09-14T11:50:48.117767+0000","last_peered":"2024-09-14T11:50:48.117767+0000","last_clean":"2024-09-14T11:50:48.117767+0000","last_became_active":"2024-09-14T11:09:36.106073+0000","last_became_peered":"2024-09-14T11:09:36.106073+0000","last_unstale":"2024-09-14T11:50:48.117767+0000","last_undegraded":"2024-09-14T11:50:48.117767+0000","last_fullsized":"2024-09-14T11:50:48.117767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:12.720860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012975129999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:29.328220+0000","last_change":"2024-09-14T11:09:48.970814+0000","last_active":"2024-09-14T11:51:29.328220+0000","last_peered":"2024-09-14T11:51:29.328220+0000","last_clean":"2024-09-14T11:51:29.328220+0000","last_became_active":"2024-09-14T11:09:48.970339+0000","last_became_peered":"2024-09-14T11:09:48.970339+0000","last_unstale":"2024-09-14T11:51:29.328220+0000","last_undegraded":"2024-09-14T11:51:29.328220+0000","last_fullsized":"2024-09-14T11:51:29.328220+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:13.911012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"264'121","reported_seq":652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:56.240192+0000","last_change":"2024-09-14T11:09:50.980619+0000","last_active":"2024-09-14T11:51:56.240192+0000","last_peered":"2024-09-14T11:51:56.240192+0000","last_clean":"2024-09-14T11:51:56.240192+0000","last_became_active":"2024-09-14T11:09:50.979827+0000","last_became_peered":"2024-09-14T11:09:50.979827+0000","last_unstale":"2024-09-14T11:51:56.240192+0000","last_undegraded":"2024-09-14T11:51:56.240192+0000","last_fullsized":"2024-09-14T11:51:56.240192+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:48.508635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":133,"num_read_kb":122,"num_write":94,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"264'799","reported_seq":2476,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.080222+0000","last_change":"2024-09-14T11:09:53.008348+0000","last_active":"2024-09-14T11:53:44.080222+0000","last_peered":"2024-09-14T11:53:44.080222+0000","last_clean":"2024-09-14T11:53:44.080222+0000","last_became_active":"2024-09-14T11:09:53.007337+0000","last_became_peered":"2024-09-14T11:09:53.007337+0000","last_unstale":"2024-09-14T11:53:44.080222+0000","last_undegraded":"2024-09-14T11:53:44.080222+0000","last_fullsized":"2024-09-14T11:53:44.080222+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:03.521459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"264'267","reported_seq":793,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:02.141641+0000","last_change":"2024-09-14T11:09:55.012569+0000","last_active":"2024-09-14T11:52:02.141641+0000","last_peered":"2024-09-14T11:52:02.141641+0000","last_clean":"2024-09-14T11:52:02.141641+0000","last_became_active":"2024-09-14T11:09:55.011828+0000","last_became_peered":"2024-09-14T11:09:55.011828+0000","last_unstale":"2024-09-14T11:52:02.141641+0000","last_undegraded":"2024-09-14T11:52:02.141641+0000","last_fullsized":"2024-09-14T11:52:02.141641+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:06.262186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":359,"num_read_kb":349,"num_write":571,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"264'1160","reported_seq":2657,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.647384+0000","last_change":"2024-09-14T11:09:46.946333+0000","last_active":"2024-09-14T11:52:29.647384+0000","last_peered":"2024-09-14T11:52:29.647384+0000","last_clean":"2024-09-14T11:52:29.647384+0000","last_became_active":"2024-09-14T11:09:46.946010+0000","last_became_peered":"2024-09-14T11:09:46.946010+0000","last_unstale":"2024-09-14T11:52:29.647384+0000","last_undegraded":"2024-09-14T11:52:29.647384+0000","last_fullsized":"2024-09-14T11:52:29.647384+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":1100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:45.329444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5209,"num_read_kb":4587,"num_write":1598,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"264'202","reported_seq":872,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:02.372313+0000","last_change":"2024-09-14T11:09:45.213246+0000","last_active":"2024-09-14T11:51:02.372313+0000","last_peered":"2024-09-14T11:51:02.372313+0000","last_clean":"2024-09-14T11:51:02.372313+0000","last_became_active":"2024-09-14T11:09:45.212500+0000","last_became_peered":"2024-09-14T11:09:45.212500+0000","last_unstale":"2024-09-14T11:51:02.372313+0000","last_undegraded":"2024-09-14T11:51:02.372313+0000","last_fullsized":"2024-09-14T11:51:02.372313+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:35:58.594042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1450334,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":650,"num_read_kb":3804,"num_write":895,"num_write_kb":25360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:49.317464+0000","last_change":"2024-09-14T11:09:38.140326+0000","last_active":"2024-09-14T11:50:49.317464+0000","last_peered":"2024-09-14T11:50:49.317464+0000","last_clean":"2024-09-14T11:50:49.317464+0000","last_became_active":"2024-09-14T11:09:36.108781+0000","last_became_peered":"2024-09-14T11:09:36.108781+0000","last_unstale":"2024-09-14T11:50:49.317464+0000","last_undegraded":"2024-09-14T11:50:49.317464+0000","last_fullsized":"2024-09-14T11:50:49.317464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:06.040461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002510581,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.132003+0000","last_change":"2024-09-14T11:09:48.971810+0000","last_active":"2024-09-14T11:51:53.132003+0000","last_peered":"2024-09-14T11:51:53.132003+0000","last_clean":"2024-09-14T11:51:53.132003+0000","last_became_active":"2024-09-14T11:09:48.970940+0000","last_became_peered":"2024-09-14T11:09:48.970940+0000","last_unstale":"2024-09-14T11:51:53.132003+0000","last_undegraded":"2024-09-14T11:51:53.132003+0000","last_fullsized":"2024-09-14T11:51:53.132003+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:57.505239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"264'299","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.994858+0000","last_change":"2024-09-14T11:09:50.993096+0000","last_active":"2024-09-14T11:53:43.994858+0000","last_peered":"2024-09-14T11:53:43.994858+0000","last_clean":"2024-09-14T11:53:43.994858+0000","last_became_active":"2024-09-14T11:09:50.992374+0000","last_became_peered":"2024-09-14T11:09:50.992374+0000","last_unstale":"2024-09-14T11:53:43.994858+0000","last_undegraded":"2024-09-14T11:53:43.994858+0000","last_fullsized":"2024-09-14T11:53:43.994858+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:36.668946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29162,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":417,"num_read_kb":536,"num_write":204,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:33.127557+0000","last_change":"2024-09-14T11:09:53.004011+0000","last_active":"2024-09-14T11:51:33.127557+0000","last_peered":"2024-09-14T11:51:33.127557+0000","last_clean":"2024-09-14T11:51:33.127557+0000","last_became_active":"2024-09-14T11:09:53.002904+0000","last_became_peered":"2024-09-14T11:09:53.002904+0000","last_unstale":"2024-09-14T11:51:33.127557+0000","last_undegraded":"2024-09-14T11:51:33.127557+0000","last_fullsized":"2024-09-14T11:51:33.127557+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:43.359087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"264'131","reported_seq":631,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.024565+0000","last_change":"2024-09-14T11:09:55.014957+0000","last_active":"2024-09-14T11:53:43.024565+0000","last_peered":"2024-09-14T11:53:43.024565+0000","last_clean":"2024-09-14T11:53:43.024565+0000","last_became_active":"2024-09-14T11:09:55.014192+0000","last_became_peered":"2024-09-14T11:09:55.014192+0000","last_unstale":"2024-09-14T11:53:43.024565+0000","last_undegraded":"2024-09-14T11:53:43.024565+0000","last_fullsized":"2024-09-14T11:53:43.024565+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:45.779974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":303,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"264'162","reported_seq":744,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.795176+0000","last_change":"2024-09-14T11:09:55.015877+0000","last_active":"2024-09-14T11:52:29.795176+0000","last_peered":"2024-09-14T11:52:29.795176+0000","last_clean":"2024-09-14T11:52:29.795176+0000","last_became_active":"2024-09-14T11:09:55.015127+0000","last_became_peered":"2024-09-14T11:09:55.015127+0000","last_unstale":"2024-09-14T11:52:29.795176+0000","last_undegraded":"2024-09-14T11:52:29.795176+0000","last_fullsized":"2024-09-14T11:52:29.795176+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:49.733188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":313,"num_read_kb":285,"num_write":384,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"264'821","reported_seq":2478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.015985+0000","last_change":"2024-09-14T11:09:46.949040+0000","last_active":"2024-09-14T11:52:29.015985+0000","last_peered":"2024-09-14T11:52:29.015985+0000","last_clean":"2024-09-14T11:52:29.015985+0000","last_became_active":"2024-09-14T11:09:46.948706+0000","last_became_peered":"2024-09-14T11:09:46.948706+0000","last_unstale":"2024-09-14T11:52:29.015985+0000","last_undegraded":"2024-09-14T11:52:29.015985+0000","last_fullsized":"2024-09-14T11:52:29.015985+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":800,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:18.066498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4239,"num_read_kb":3866,"num_write":1097,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"264'188","reported_seq":829,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.876240+0000","last_change":"2024-09-14T11:09:45.201897+0000","last_active":"2024-09-14T11:50:58.876240+0000","last_peered":"2024-09-14T11:50:58.876240+0000","last_clean":"2024-09-14T11:50:58.876240+0000","last_became_active":"2024-09-14T11:09:45.201562+0000","last_became_peered":"2024-09-14T11:09:45.201562+0000","last_unstale":"2024-09-14T11:50:58.876240+0000","last_undegraded":"2024-09-14T11:50:58.876240+0000","last_fullsized":"2024-09-14T11:50:58.876240+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:04.521022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5904577,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":502,"num_read_kb":86083,"num_write":866,"num_write_kb":49236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.102271+0000","last_change":"2024-09-14T11:09:48.963401+0000","last_active":"2024-09-14T11:49:28.102271+0000","last_peered":"2024-09-14T11:49:28.102271+0000","last_clean":"2024-09-14T11:49:28.102271+0000","last_became_active":"2024-09-14T11:09:48.962619+0000","last_became_peered":"2024-09-14T11:09:48.962619+0000","last_unstale":"2024-09-14T11:49:28.102271+0000","last_undegraded":"2024-09-14T11:49:28.102271+0000","last_fullsized":"2024-09-14T11:49:28.102271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:52.738701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"264'167","reported_seq":732,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:55.755784+0000","last_change":"2024-09-14T11:09:50.996731+0000","last_active":"2024-09-14T11:51:55.755784+0000","last_peered":"2024-09-14T11:51:55.755784+0000","last_clean":"2024-09-14T11:51:55.755784+0000","last_became_active":"2024-09-14T11:09:50.996047+0000","last_became_peered":"2024-09-14T11:09:50.996047+0000","last_unstale":"2024-09-14T11:51:55.755784+0000","last_undegraded":"2024-09-14T11:51:55.755784+0000","last_fullsized":"2024-09-14T11:51:55.755784+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:30.833822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35819,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":196,"num_read_kb":314,"num_write":122,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:33.280880+0000","last_change":"2024-09-14T11:09:53.001072+0000","last_active":"2024-09-14T11:49:33.280880+0000","last_peered":"2024-09-14T11:49:33.280880+0000","last_clean":"2024-09-14T11:49:33.280880+0000","last_became_active":"2024-09-14T11:09:53.000339+0000","last_became_peered":"2024-09-14T11:09:53.000339+0000","last_unstale":"2024-09-14T11:49:33.280880+0000","last_undegraded":"2024-09-14T11:49:33.280880+0000","last_fullsized":"2024-09-14T11:49:33.280880+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:15.810620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"264'95","reported_seq":580,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:03.319786+0000","last_change":"2024-09-14T11:09:55.023250+0000","last_active":"2024-09-14T11:52:03.319786+0000","last_peered":"2024-09-14T11:52:03.319786+0000","last_clean":"2024-09-14T11:52:03.319786+0000","last_became_active":"2024-09-14T11:09:55.022477+0000","last_became_peered":"2024-09-14T11:09:55.022477+0000","last_unstale":"2024-09-14T11:52:03.319786+0000","last_undegraded":"2024-09-14T11:52:03.319786+0000","last_fullsized":"2024-09-14T11:52:03.319786+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:48.971105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":73,"num_write":206,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"264'413","reported_seq":1945,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.021893+0000","last_change":"2024-09-14T11:09:46.949256+0000","last_active":"2024-09-14T11:52:29.021893+0000","last_peered":"2024-09-14T11:52:29.021893+0000","last_clean":"2024-09-14T11:52:29.021893+0000","last_became_active":"2024-09-14T11:09:46.948572+0000","last_became_peered":"2024-09-14T11:09:46.948572+0000","last_unstale":"2024-09-14T11:52:29.021893+0000","last_undegraded":"2024-09-14T11:52:29.021893+0000","last_fullsized":"2024-09-14T11:52:29.021893+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:03.770405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2176,"num_read_kb":2078,"num_write":464,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"264'231","reported_seq":847,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.287509+0000","last_change":"2024-09-14T11:09:45.224440+0000","last_active":"2024-09-14T11:50:53.287509+0000","last_peered":"2024-09-14T11:50:53.287509+0000","last_clean":"2024-09-14T11:50:53.287509+0000","last_became_active":"2024-09-14T11:09:45.223324+0000","last_became_peered":"2024-09-14T11:09:45.223324+0000","last_unstale":"2024-09-14T11:50:53.287509+0000","last_undegraded":"2024-09-14T11:50:53.287509+0000","last_fullsized":"2024-09-14T11:50:53.287509+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:46.914684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1666108,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":553,"num_read_kb":7834,"num_write":1126,"num_write_kb":26023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"35'3","reported_seq":976,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.914843+0000","last_change":"2024-09-14T11:09:48.969925+0000","last_active":"2024-09-14T11:53:43.914843+0000","last_peered":"2024-09-14T11:53:43.914843+0000","last_clean":"2024-09-14T11:53:43.914843+0000","last_became_active":"2024-09-14T11:09:48.968561+0000","last_became_peered":"2024-09-14T11:09:48.968561+0000","last_unstale":"2024-09-14T11:53:43.914843+0000","last_undegraded":"2024-09-14T11:53:43.914843+0000","last_fullsized":"2024-09-14T11:53:43.914843+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:29.015385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":725,"num_read_kb":723,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"264'44","reported_seq":545,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.132030+0000","last_change":"2024-09-14T11:09:50.981928+0000","last_active":"2024-09-14T11:51:53.132030+0000","last_peered":"2024-09-14T11:51:53.132030+0000","last_clean":"2024-09-14T11:51:53.132030+0000","last_became_active":"2024-09-14T11:09:50.981128+0000","last_became_peered":"2024-09-14T11:09:50.981128+0000","last_unstale":"2024-09-14T11:51:53.132030+0000","last_undegraded":"2024-09-14T11:51:53.132030+0000","last_fullsized":"2024-09-14T11:51:53.132030+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:25.003185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:34.082103+0000","last_change":"2024-09-14T11:09:53.007173+0000","last_active":"2024-09-14T11:49:34.082103+0000","last_peered":"2024-09-14T11:49:34.082103+0000","last_clean":"2024-09-14T11:49:34.082103+0000","last_became_active":"2024-09-14T11:09:53.006292+0000","last_became_peered":"2024-09-14T11:09:53.006292+0000","last_unstale":"2024-09-14T11:49:34.082103+0000","last_undegraded":"2024-09-14T11:49:34.082103+0000","last_fullsized":"2024-09-14T11:49:34.082103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:01.689414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"264'206","reported_seq":723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.013495+0000","last_change":"2024-09-14T11:09:55.015153+0000","last_active":"2024-09-14T11:52:29.013495+0000","last_peered":"2024-09-14T11:52:29.013495+0000","last_clean":"2024-09-14T11:52:29.013495+0000","last_became_active":"2024-09-14T11:09:55.014414+0000","last_became_peered":"2024-09-14T11:09:55.014414+0000","last_unstale":"2024-09-14T11:52:29.013495+0000","last_undegraded":"2024-09-14T11:52:29.013495+0000","last_fullsized":"2024-09-14T11:52:29.013495+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:10.146075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":294,"num_read_kb":289,"num_write":451,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"264'673","reported_seq":2427,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.161127+0000","last_change":"2024-09-14T11:09:46.963397+0000","last_active":"2024-09-14T11:52:12.161127+0000","last_peered":"2024-09-14T11:52:12.161127+0000","last_clean":"2024-09-14T11:52:12.161127+0000","last_became_active":"2024-09-14T11:09:46.962508+0000","last_became_peered":"2024-09-14T11:09:46.962508+0000","last_unstale":"2024-09-14T11:52:12.161127+0000","last_undegraded":"2024-09-14T11:52:12.161127+0000","last_fullsized":"2024-09-14T11:52:12.161127+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":600,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:44.240688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3732,"num_read_kb":3415,"num_write":933,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"264'180","reported_seq":781,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:54.100781+0000","last_change":"2024-09-14T11:09:45.207817+0000","last_active":"2024-09-14T11:50:54.100781+0000","last_peered":"2024-09-14T11:50:54.100781+0000","last_clean":"2024-09-14T11:50:54.100781+0000","last_became_active":"2024-09-14T11:09:45.206901+0000","last_became_peered":"2024-09-14T11:09:45.206901+0000","last_unstale":"2024-09-14T11:50:54.100781+0000","last_undegraded":"2024-09-14T11:50:54.100781+0000","last_fullsized":"2024-09-14T11:50:54.100781+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:29.534278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2134615,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":433,"num_read_kb":9258,"num_write":854,"num_write_kb":15949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:29.080988+0000","last_change":"2024-09-14T11:09:48.960157+0000","last_active":"2024-09-14T11:49:29.080988+0000","last_peered":"2024-09-14T11:49:29.080988+0000","last_clean":"2024-09-14T11:49:29.080988+0000","last_became_active":"2024-09-14T11:09:48.959413+0000","last_became_peered":"2024-09-14T11:09:48.959413+0000","last_unstale":"2024-09-14T11:49:29.080988+0000","last_undegraded":"2024-09-14T11:49:29.080988+0000","last_fullsized":"2024-09-14T11:49:29.080988+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:19.014844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"264'155","reported_seq":732,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.044674+0000","last_change":"2024-09-14T11:09:51.000219+0000","last_active":"2024-09-14T11:52:29.044674+0000","last_peered":"2024-09-14T11:52:29.044674+0000","last_clean":"2024-09-14T11:52:29.044674+0000","last_became_active":"2024-09-14T11:09:50.999585+0000","last_became_peered":"2024-09-14T11:09:50.999585+0000","last_unstale":"2024-09-14T11:52:29.044674+0000","last_undegraded":"2024-09-14T11:52:29.044674+0000","last_fullsized":"2024-09-14T11:52:29.044674+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:27.217391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9157,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":208,"num_read_kb":262,"num_write":114,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:33.253171+0000","last_change":"2024-09-14T11:09:53.019246+0000","last_active":"2024-09-14T11:49:33.253171+0000","last_peered":"2024-09-14T11:49:33.253171+0000","last_clean":"2024-09-14T11:49:33.253171+0000","last_became_active":"2024-09-14T11:09:53.018479+0000","last_became_peered":"2024-09-14T11:09:53.018479+0000","last_unstale":"2024-09-14T11:49:33.253171+0000","last_undegraded":"2024-09-14T11:49:33.253171+0000","last_fullsized":"2024-09-14T11:49:33.253171+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:01.598876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"264'128","reported_seq":631,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.390381+0000","last_change":"2024-09-14T11:09:55.029326+0000","last_active":"2024-09-14T11:52:29.390381+0000","last_peered":"2024-09-14T11:52:29.390381+0000","last_clean":"2024-09-14T11:52:29.390381+0000","last_became_active":"2024-09-14T11:09:55.028633+0000","last_became_peered":"2024-09-14T11:09:55.028633+0000","last_unstale":"2024-09-14T11:52:29.390381+0000","last_undegraded":"2024-09-14T11:52:29.390381+0000","last_fullsized":"2024-09-14T11:52:29.390381+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:48.218210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":141,"num_write":296,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"264'503","reported_seq":2213,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:10.824533+0000","last_change":"2024-09-14T11:09:46.964085+0000","last_active":"2024-09-14T11:52:10.824533+0000","last_peered":"2024-09-14T11:52:10.824533+0000","last_clean":"2024-09-14T11:52:10.824533+0000","last_became_active":"2024-09-14T11:09:46.962364+0000","last_became_peered":"2024-09-14T11:09:46.962364+0000","last_unstale":"2024-09-14T11:52:10.824533+0000","last_undegraded":"2024-09-14T11:52:10.824533+0000","last_fullsized":"2024-09-14T11:52:10.824533+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:39.362696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2859,"num_read_kb":2685,"num_write":625,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"264'225","reported_seq":845,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.883215+0000","last_change":"2024-09-14T11:09:45.208047+0000","last_active":"2024-09-14T11:50:58.883215+0000","last_peered":"2024-09-14T11:50:58.883215+0000","last_clean":"2024-09-14T11:50:58.883215+0000","last_became_active":"2024-09-14T11:09:45.206145+0000","last_became_peered":"2024-09-14T11:09:45.206145+0000","last_unstale":"2024-09-14T11:50:58.883215+0000","last_undegraded":"2024-09-14T11:50:58.883215+0000","last_fullsized":"2024-09-14T11:50:58.883215+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:19.451341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4518966,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":551,"num_read_kb":30372,"num_write":892,"num_write_kb":16933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"35'4","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.912643+0000","last_change":"2024-09-14T11:09:48.964002+0000","last_active":"2024-09-14T11:53:43.912643+0000","last_peered":"2024-09-14T11:53:43.912643+0000","last_clean":"2024-09-14T11:53:43.912643+0000","last_became_active":"2024-09-14T11:09:48.963563+0000","last_became_peered":"2024-09-14T11:09:48.963563+0000","last_unstale":"2024-09-14T11:53:43.912643+0000","last_undegraded":"2024-09-14T11:53:43.912643+0000","last_fullsized":"2024-09-14T11:53:43.912643+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:45.473064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":1192,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"264'121","reported_seq":678,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.300854+0000","last_change":"2024-09-14T11:09:50.989001+0000","last_active":"2024-09-14T11:51:53.300854+0000","last_peered":"2024-09-14T11:51:53.300854+0000","last_clean":"2024-09-14T11:51:53.300854+0000","last_became_active":"2024-09-14T11:09:50.988286+0000","last_became_peered":"2024-09-14T11:09:50.988286+0000","last_unstale":"2024-09-14T11:51:53.300854+0000","last_undegraded":"2024-09-14T11:51:53.300854+0000","last_fullsized":"2024-09-14T11:51:53.300854+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:38.798725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":138,"num_read_kb":176,"num_write":66,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:33.280996+0000","last_change":"2024-09-14T11:09:53.007660+0000","last_active":"2024-09-14T11:49:33.280996+0000","last_peered":"2024-09-14T11:49:33.280996+0000","last_clean":"2024-09-14T11:49:33.280996+0000","last_became_active":"2024-09-14T11:09:53.006975+0000","last_became_peered":"2024-09-14T11:09:53.006975+0000","last_unstale":"2024-09-14T11:49:33.280996+0000","last_undegraded":"2024-09-14T11:49:33.280996+0000","last_fullsized":"2024-09-14T11:49:33.280996+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:46.501395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"264'597","reported_seq":2244,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.185358+0000","last_change":"2024-09-14T11:09:46.975318+0000","last_active":"2024-09-14T11:52:12.185358+0000","last_peered":"2024-09-14T11:52:12.185358+0000","last_clean":"2024-09-14T11:52:12.185358+0000","last_became_active":"2024-09-14T11:09:46.975017+0000","last_became_peered":"2024-09-14T11:09:46.975017+0000","last_unstale":"2024-09-14T11:52:12.185358+0000","last_undegraded":"2024-09-14T11:52:12.185358+0000","last_fullsized":"2024-09-14T11:52:12.185358+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":500,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:58.187359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3191,"num_read_kb":2927,"num_write":756,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"264'271","reported_seq":952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:39.404770+0000","last_change":"2024-09-14T11:09:45.217804+0000","last_active":"2024-09-14T11:51:39.404770+0000","last_peered":"2024-09-14T11:51:39.404770+0000","last_clean":"2024-09-14T11:51:39.404770+0000","last_became_active":"2024-09-14T11:09:45.216742+0000","last_became_peered":"2024-09-14T11:09:45.216742+0000","last_unstale":"2024-09-14T11:51:39.404770+0000","last_undegraded":"2024-09-14T11:51:39.404770+0000","last_fullsized":"2024-09-14T11:51:39.404770+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:35.991962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24441949,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":734,"num_read_kb":84606,"num_write":1202,"num_write_kb":44892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:58.108916+0000","last_change":"2024-09-14T11:09:48.966915+0000","last_active":"2024-09-14T11:49:58.108916+0000","last_peered":"2024-09-14T11:49:58.108916+0000","last_clean":"2024-09-14T11:49:58.108916+0000","last_became_active":"2024-09-14T11:09:48.966112+0000","last_became_peered":"2024-09-14T11:09:48.966112+0000","last_unstale":"2024-09-14T11:49:58.108916+0000","last_undegraded":"2024-09-14T11:49:58.108916+0000","last_fullsized":"2024-09-14T11:49:58.108916+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:36.703419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"264'201","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.990059+0000","last_change":"2024-09-14T11:09:50.996090+0000","last_active":"2024-09-14T11:53:43.990059+0000","last_peered":"2024-09-14T11:53:43.990059+0000","last_clean":"2024-09-14T11:53:43.990059+0000","last_became_active":"2024-09-14T11:09:50.995279+0000","last_became_peered":"2024-09-14T11:09:50.995279+0000","last_unstale":"2024-09-14T11:53:43.990059+0000","last_undegraded":"2024-09-14T11:53:43.990059+0000","last_fullsized":"2024-09-14T11:53:43.990059+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:02.160055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30499,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":293,"num_read_kb":452,"num_write":190,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:54.086888+0000","last_change":"2024-09-14T11:09:53.003946+0000","last_active":"2024-09-14T11:49:54.086888+0000","last_peered":"2024-09-14T11:49:54.086888+0000","last_clean":"2024-09-14T11:49:54.086888+0000","last_became_active":"2024-09-14T11:09:53.002862+0000","last_became_peered":"2024-09-14T11:09:53.002862+0000","last_unstale":"2024-09-14T11:49:54.086888+0000","last_undegraded":"2024-09-14T11:49:54.086888+0000","last_fullsized":"2024-09-14T11:49:54.086888+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:50.669809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"264'167","reported_seq":666,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:33.637848+0000","last_change":"2024-09-14T11:09:55.024496+0000","last_active":"2024-09-14T11:51:33.637848+0000","last_peered":"2024-09-14T11:51:33.637848+0000","last_clean":"2024-09-14T11:51:33.637848+0000","last_became_active":"2024-09-14T11:09:55.023821+0000","last_became_peered":"2024-09-14T11:09:55.023821+0000","last_unstale":"2024-09-14T11:51:33.637848+0000","last_undegraded":"2024-09-14T11:51:33.637848+0000","last_fullsized":"2024-09-14T11:51:33.637848+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:18.416018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":195,"num_read_kb":205,"num_write":392,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"264'861","reported_seq":2612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:11.486672+0000","last_change":"2024-09-14T11:09:46.968180+0000","last_active":"2024-09-14T11:52:11.486672+0000","last_peered":"2024-09-14T11:52:11.486672+0000","last_clean":"2024-09-14T11:52:11.486672+0000","last_became_active":"2024-09-14T11:09:46.967144+0000","last_became_peered":"2024-09-14T11:09:46.967144+0000","last_unstale":"2024-09-14T11:52:11.486672+0000","last_undegraded":"2024-09-14T11:52:11.486672+0000","last_fullsized":"2024-09-14T11:52:11.486672+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":800,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:12.513360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4422,"num_read_kb":4033,"num_write":1158,"num_write_kb":453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"264'185","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:02.637290+0000","last_change":"2024-09-14T11:09:45.187524+0000","last_active":"2024-09-14T11:52:02.637290+0000","last_peered":"2024-09-14T11:52:02.637290+0000","last_clean":"2024-09-14T11:52:02.637290+0000","last_became_active":"2024-09-14T11:09:45.186745+0000","last_became_peered":"2024-09-14T11:09:45.186745+0000","last_unstale":"2024-09-14T11:52:02.637290+0000","last_undegraded":"2024-09-14T11:52:02.637290+0000","last_fullsized":"2024-09-14T11:52:02.637290+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:52.434620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7947278,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":533,"num_read_kb":5513,"num_write":843,"num_write_kb":29456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:29.109137+0000","last_change":"2024-09-14T11:09:48.952351+0000","last_active":"2024-09-14T11:51:29.109137+0000","last_peered":"2024-09-14T11:51:29.109137+0000","last_clean":"2024-09-14T11:51:29.109137+0000","last_became_active":"2024-09-14T11:09:48.951908+0000","last_became_peered":"2024-09-14T11:09:48.951908+0000","last_unstale":"2024-09-14T11:51:29.109137+0000","last_undegraded":"2024-09-14T11:51:29.109137+0000","last_fullsized":"2024-09-14T11:51:29.109137+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:14:06.155760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"264'162","reported_seq":734,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.124733+0000","last_change":"2024-09-14T11:09:50.986099+0000","last_active":"2024-09-14T11:53:43.124733+0000","last_peered":"2024-09-14T11:53:43.124733+0000","last_clean":"2024-09-14T11:53:43.124733+0000","last_became_active":"2024-09-14T11:09:50.983553+0000","last_became_peered":"2024-09-14T11:09:50.983553+0000","last_unstale":"2024-09-14T11:53:43.124733+0000","last_undegraded":"2024-09-14T11:53:43.124733+0000","last_fullsized":"2024-09-14T11:53:43.124733+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:45.407677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15672,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":216,"num_read_kb":289,"num_write":140,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.110650+0000","last_change":"2024-09-14T11:09:53.024431+0000","last_active":"2024-09-14T11:49:53.110650+0000","last_peered":"2024-09-14T11:49:53.110650+0000","last_clean":"2024-09-14T11:49:53.110650+0000","last_became_active":"2024-09-14T11:09:53.023609+0000","last_became_peered":"2024-09-14T11:09:53.023609+0000","last_unstale":"2024-09-14T11:49:53.110650+0000","last_undegraded":"2024-09-14T11:49:53.110650+0000","last_fullsized":"2024-09-14T11:49:53.110650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:43.568040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"264'155","reported_seq":651,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:28.256688+0000","last_change":"2024-09-14T11:09:55.029184+0000","last_active":"2024-09-14T11:52:28.256688+0000","last_peered":"2024-09-14T11:52:28.256688+0000","last_clean":"2024-09-14T11:52:28.256688+0000","last_became_active":"2024-09-14T11:09:55.028344+0000","last_became_peered":"2024-09-14T11:09:55.028344+0000","last_unstale":"2024-09-14T11:52:28.256688+0000","last_undegraded":"2024-09-14T11:52:28.256688+0000","last_fullsized":"2024-09-14T11:52:28.256688+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:09.622914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1619,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":178,"num_read_kb":177,"num_write":459,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"264'844","reported_seq":2442,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.991688+0000","last_change":"2024-09-14T11:09:46.991793+0000","last_active":"2024-09-14T11:52:09.991688+0000","last_peered":"2024-09-14T11:52:09.991688+0000","last_clean":"2024-09-14T11:52:09.991688+0000","last_became_active":"2024-09-14T11:09:46.990923+0000","last_became_peered":"2024-09-14T11:09:46.990923+0000","last_unstale":"2024-09-14T11:52:09.991688+0000","last_undegraded":"2024-09-14T11:52:09.991688+0000","last_fullsized":"2024-09-14T11:52:09.991688+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":800,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:14.204773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4067,"num_read_kb":3661,"num_write":1092,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"264'154","reported_seq":739,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:03.182820+0000","last_change":"2024-09-14T11:09:45.201353+0000","last_active":"2024-09-14T11:52:03.182820+0000","last_peered":"2024-09-14T11:52:03.182820+0000","last_clean":"2024-09-14T11:52:03.182820+0000","last_became_active":"2024-09-14T11:09:45.201058+0000","last_became_peered":"2024-09-14T11:09:45.201058+0000","last_unstale":"2024-09-14T11:52:03.182820+0000","last_undegraded":"2024-09-14T11:52:03.182820+0000","last_fullsized":"2024-09-14T11:52:03.182820+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:57.653038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3191097,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":348,"num_read_kb":4081,"num_write":725,"num_write_kb":11722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:49.085664+0000","last_change":"2024-09-14T11:09:48.969192+0000","last_active":"2024-09-14T11:49:49.085664+0000","last_peered":"2024-09-14T11:49:49.085664+0000","last_clean":"2024-09-14T11:49:49.085664+0000","last_became_active":"2024-09-14T11:09:48.968770+0000","last_became_peered":"2024-09-14T11:09:48.968770+0000","last_unstale":"2024-09-14T11:49:49.085664+0000","last_undegraded":"2024-09-14T11:49:49.085664+0000","last_fullsized":"2024-09-14T11:49:49.085664+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:32.471236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"264'129","reported_seq":697,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:38.157556+0000","last_change":"2024-09-14T11:09:50.999804+0000","last_active":"2024-09-14T11:53:38.157556+0000","last_peered":"2024-09-14T11:53:38.157556+0000","last_clean":"2024-09-14T11:53:38.157556+0000","last_became_active":"2024-09-14T11:09:50.999079+0000","last_became_peered":"2024-09-14T11:09:50.999079+0000","last_unstale":"2024-09-14T11:53:38.157556+0000","last_undegraded":"2024-09-14T11:53:38.157556+0000","last_fullsized":"2024-09-14T11:53:38.157556+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:44.334838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11391,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":166,"num_read_kb":224,"num_write":88,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:58.286481+0000","last_change":"2024-09-14T11:09:53.009600+0000","last_active":"2024-09-14T11:49:58.286481+0000","last_peered":"2024-09-14T11:49:58.286481+0000","last_clean":"2024-09-14T11:49:58.286481+0000","last_became_active":"2024-09-14T11:09:53.008952+0000","last_became_peered":"2024-09-14T11:09:53.008952+0000","last_unstale":"2024-09-14T11:49:58.286481+0000","last_undegraded":"2024-09-14T11:49:58.286481+0000","last_fullsized":"2024-09-14T11:49:58.286481+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:04.350006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"264'141","reported_seq":633,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.047202+0000","last_change":"2024-09-14T11:09:55.029152+0000","last_active":"2024-09-14T11:53:44.047202+0000","last_peered":"2024-09-14T11:53:44.047202+0000","last_clean":"2024-09-14T11:53:44.047202+0000","last_became_active":"2024-09-14T11:09:55.028413+0000","last_became_peered":"2024-09-14T11:09:55.028413+0000","last_unstale":"2024-09-14T11:53:44.047202+0000","last_undegraded":"2024-09-14T11:53:44.047202+0000","last_fullsized":"2024-09-14T11:53:44.047202+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:42.297511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":142,"num_write":355,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"264'420","reported_seq":1977,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.106262+0000","last_change":"2024-09-14T11:09:46.987394+0000","last_active":"2024-09-14T11:53:43.106262+0000","last_peered":"2024-09-14T11:53:43.106262+0000","last_clean":"2024-09-14T11:53:43.106262+0000","last_became_active":"2024-09-14T11:09:46.986721+0000","last_became_peered":"2024-09-14T11:09:46.986721+0000","last_unstale":"2024-09-14T11:53:43.106262+0000","last_undegraded":"2024-09-14T11:53:43.106262+0000","last_fullsized":"2024-09-14T11:53:43.106262+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:07.328123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2241,"num_read_kb":2140,"num_write":472,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"264'223","reported_seq":827,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:23.995381+0000","last_change":"2024-09-14T11:09:45.212627+0000","last_active":"2024-09-14T11:52:23.995381+0000","last_peered":"2024-09-14T11:52:23.995381+0000","last_clean":"2024-09-14T11:52:23.995381+0000","last_became_active":"2024-09-14T11:09:45.211984+0000","last_became_peered":"2024-09-14T11:09:45.211984+0000","last_unstale":"2024-09-14T11:52:23.995381+0000","last_undegraded":"2024-09-14T11:52:23.995381+0000","last_fullsized":"2024-09-14T11:52:23.995381+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:55.366169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4547637,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":501,"num_read_kb":8662,"num_write":1128,"num_write_kb":22372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.104342+0000","last_change":"2024-09-14T11:09:48.969193+0000","last_active":"2024-09-14T11:49:48.104342+0000","last_peered":"2024-09-14T11:49:48.104342+0000","last_clean":"2024-09-14T11:49:48.104342+0000","last_became_active":"2024-09-14T11:09:48.968459+0000","last_became_peered":"2024-09-14T11:09:48.968459+0000","last_unstale":"2024-09-14T11:49:48.104342+0000","last_undegraded":"2024-09-14T11:49:48.104342+0000","last_fullsized":"2024-09-14T11:49:48.104342+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:25.826727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"264'96","reported_seq":611,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:59.338693+0000","last_change":"2024-09-14T11:09:50.980469+0000","last_active":"2024-09-14T11:51:59.338693+0000","last_peered":"2024-09-14T11:51:59.338693+0000","last_clean":"2024-09-14T11:51:59.338693+0000","last_became_active":"2024-09-14T11:09:50.979749+0000","last_became_peered":"2024-09-14T11:09:50.979749+0000","last_unstale":"2024-09-14T11:51:59.338693+0000","last_undegraded":"2024-09-14T11:51:59.338693+0000","last_fullsized":"2024-09-14T11:51:59.338693+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:58.555300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":88,"num_read_kb":80,"num_write":70,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"264'780","reported_seq":4297,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.069817+0000","last_change":"2024-09-14T11:09:53.017293+0000","last_active":"2024-09-14T11:53:44.069817+0000","last_peered":"2024-09-14T11:53:44.069817+0000","last_clean":"2024-09-14T11:53:44.069817+0000","last_became_active":"2024-09-14T11:09:53.014955+0000","last_became_peered":"2024-09-14T11:09:53.014955+0000","last_unstale":"2024-09-14T11:53:44.069817+0000","last_undegraded":"2024-09-14T11:53:44.069817+0000","last_fullsized":"2024-09-14T11:53:44.069817+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:13.437678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"264'92","reported_seq":581,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.473000+0000","last_change":"2024-09-14T11:09:55.030910+0000","last_active":"2024-09-14T11:52:29.473000+0000","last_peered":"2024-09-14T11:52:29.473000+0000","last_clean":"2024-09-14T11:52:29.473000+0000","last_became_active":"2024-09-14T11:09:55.030211+0000","last_became_peered":"2024-09-14T11:09:55.030211+0000","last_unstale":"2024-09-14T11:52:29.473000+0000","last_undegraded":"2024-09-14T11:52:29.473000+0000","last_fullsized":"2024-09-14T11:52:29.473000+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:19.664371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":87,"num_write":222,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"264'455","reported_seq":1998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:27.186133+0000","last_change":"2024-09-14T11:09:46.975329+0000","last_active":"2024-09-14T11:52:27.186133+0000","last_peered":"2024-09-14T11:52:27.186133+0000","last_clean":"2024-09-14T11:52:27.186133+0000","last_became_active":"2024-09-14T11:09:46.974957+0000","last_became_peered":"2024-09-14T11:09:46.974957+0000","last_unstale":"2024-09-14T11:52:27.186133+0000","last_undegraded":"2024-09-14T11:52:27.186133+0000","last_fullsized":"2024-09-14T11:52:27.186133+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:48.632851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2398,"num_read_kb":2260,"num_write":532,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"264'297","reported_seq":989,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:38.249897+0000","last_change":"2024-09-14T11:09:45.205274+0000","last_active":"2024-09-14T11:51:38.249897+0000","last_peered":"2024-09-14T11:51:38.249897+0000","last_clean":"2024-09-14T11:51:38.249897+0000","last_became_active":"2024-09-14T11:09:45.204014+0000","last_became_peered":"2024-09-14T11:09:45.204014+0000","last_unstale":"2024-09-14T11:51:38.249897+0000","last_undegraded":"2024-09-14T11:51:38.249897+0000","last_fullsized":"2024-09-14T11:51:38.249897+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:53.629440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5292169,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":838,"num_read_kb":35877,"num_write":1468,"num_write_kb":50924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.256593+0000","last_change":"2024-09-14T11:09:48.950935+0000","last_active":"2024-09-14T11:49:48.256593+0000","last_peered":"2024-09-14T11:49:48.256593+0000","last_clean":"2024-09-14T11:49:48.256593+0000","last_became_active":"2024-09-14T11:09:48.950445+0000","last_became_peered":"2024-09-14T11:09:48.950445+0000","last_unstale":"2024-09-14T11:49:48.256593+0000","last_undegraded":"2024-09-14T11:49:48.256593+0000","last_fullsized":"2024-09-14T11:49:48.256593+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:53.596593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"264'163","reported_seq":735,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:28.318140+0000","last_change":"2024-09-14T11:09:50.992957+0000","last_active":"2024-09-14T11:53:28.318140+0000","last_peered":"2024-09-14T11:53:28.318140+0000","last_clean":"2024-09-14T11:53:28.318140+0000","last_became_active":"2024-09-14T11:09:50.992216+0000","last_became_peered":"2024-09-14T11:09:50.992216+0000","last_unstale":"2024-09-14T11:53:28.318140+0000","last_undegraded":"2024-09-14T11:53:28.318140+0000","last_fullsized":"2024-09-14T11:53:28.318140+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:17.396343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63403,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":228,"num_read_kb":431,"num_write":140,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.119821+0000","last_change":"2024-09-14T11:09:53.024153+0000","last_active":"2024-09-14T11:50:58.119821+0000","last_peered":"2024-09-14T11:50:58.119821+0000","last_clean":"2024-09-14T11:50:58.119821+0000","last_became_active":"2024-09-14T11:09:53.023492+0000","last_became_peered":"2024-09-14T11:09:53.023492+0000","last_unstale":"2024-09-14T11:50:58.119821+0000","last_undegraded":"2024-09-14T11:50:58.119821+0000","last_fullsized":"2024-09-14T11:50:58.119821+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:38.239379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"264'112","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.759177+0000","last_change":"2024-09-14T11:09:55.027867+0000","last_active":"2024-09-14T11:52:12.759177+0000","last_peered":"2024-09-14T11:52:12.759177+0000","last_clean":"2024-09-14T11:52:12.759177+0000","last_became_active":"2024-09-14T11:09:55.027044+0000","last_became_peered":"2024-09-14T11:09:55.027044+0000","last_unstale":"2024-09-14T11:52:12.759177+0000","last_undegraded":"2024-09-14T11:52:12.759177+0000","last_fullsized":"2024-09-14T11:52:12.759177+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:52.809691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":137,"num_read_kb":126,"num_write":268,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"264'782","reported_seq":2408,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.105257+0000","last_change":"2024-09-14T11:09:46.981979+0000","last_active":"2024-09-14T11:53:43.105257+0000","last_peered":"2024-09-14T11:53:43.105257+0000","last_clean":"2024-09-14T11:53:43.105257+0000","last_became_active":"2024-09-14T11:09:46.981651+0000","last_became_peered":"2024-09-14T11:09:46.981651+0000","last_unstale":"2024-09-14T11:53:43.105257+0000","last_undegraded":"2024-09-14T11:53:43.105257+0000","last_fullsized":"2024-09-14T11:53:43.105257+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:26.806380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3785,"num_read_kb":3457,"num_write":1011,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"264'234","reported_seq":873,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.448644+0000","last_change":"2024-09-14T11:09:45.215434+0000","last_active":"2024-09-14T11:51:07.448644+0000","last_peered":"2024-09-14T11:51:07.448644+0000","last_clean":"2024-09-14T11:51:07.448644+0000","last_became_active":"2024-09-14T11:09:45.215127+0000","last_became_peered":"2024-09-14T11:09:45.215127+0000","last_unstale":"2024-09-14T11:51:07.448644+0000","last_undegraded":"2024-09-14T11:51:07.448644+0000","last_fullsized":"2024-09-14T11:51:07.448644+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:09.892252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10094310,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":577,"num_read_kb":34627,"num_write":1008,"num_write_kb":52307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:49.085600+0000","last_change":"2024-09-14T11:09:48.960423+0000","last_active":"2024-09-14T11:49:49.085600+0000","last_peered":"2024-09-14T11:49:49.085600+0000","last_clean":"2024-09-14T11:49:49.085600+0000","last_became_active":"2024-09-14T11:09:48.960006+0000","last_became_peered":"2024-09-14T11:09:48.960006+0000","last_unstale":"2024-09-14T11:49:49.085600+0000","last_undegraded":"2024-09-14T11:49:49.085600+0000","last_fullsized":"2024-09-14T11:49:49.085600+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:12.246125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"264'113","reported_seq":675,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:23.152415+0000","last_change":"2024-09-14T11:09:50.976371+0000","last_active":"2024-09-14T11:53:23.152415+0000","last_peered":"2024-09-14T11:53:23.152415+0000","last_clean":"2024-09-14T11:53:23.152415+0000","last_became_active":"2024-09-14T11:09:50.975555+0000","last_became_peered":"2024-09-14T11:09:50.975555+0000","last_unstale":"2024-09-14T11:53:23.152415+0000","last_undegraded":"2024-09-14T11:53:23.152415+0000","last_fullsized":"2024-09-14T11:53:23.152415+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:50.238466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9691,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":147,"num_read_kb":200,"num_write":74,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:04.321551+0000","last_change":"2024-09-14T11:09:53.015898+0000","last_active":"2024-09-14T11:51:04.321551+0000","last_peered":"2024-09-14T11:51:04.321551+0000","last_clean":"2024-09-14T11:51:04.321551+0000","last_became_active":"2024-09-14T11:09:53.015039+0000","last_became_peered":"2024-09-14T11:09:53.015039+0000","last_unstale":"2024-09-14T11:51:04.321551+0000","last_undegraded":"2024-09-14T11:51:04.321551+0000","last_fullsized":"2024-09-14T11:51:04.321551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:00.423028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"264'92","reported_seq":601,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:02.725541+0000","last_change":"2024-09-14T11:09:55.014762+0000","last_active":"2024-09-14T11:52:02.725541+0000","last_peered":"2024-09-14T11:52:02.725541+0000","last_clean":"2024-09-14T11:52:02.725541+0000","last_became_active":"2024-09-14T11:09:55.013997+0000","last_became_peered":"2024-09-14T11:09:55.013997+0000","last_unstale":"2024-09-14T11:52:02.725541+0000","last_undegraded":"2024-09-14T11:52:02.725541+0000","last_fullsized":"2024-09-14T11:52:02.725541+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:30.820459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":557,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":129,"num_write":227,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"264'1274","reported_seq":2882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.101805+0000","last_change":"2024-09-14T11:09:46.983515+0000","last_active":"2024-09-14T11:53:43.101805+0000","last_peered":"2024-09-14T11:53:43.101805+0000","last_clean":"2024-09-14T11:53:43.101805+0000","last_became_active":"2024-09-14T11:09:46.982770+0000","last_became_peered":"2024-09-14T11:09:46.982770+0000","last_unstale":"2024-09-14T11:53:43.101805+0000","last_undegraded":"2024-09-14T11:53:43.101805+0000","last_fullsized":"2024-09-14T11:53:43.101805+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":1200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:32.470386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5800,"num_read_kb":5089,"num_write":1775,"num_write_kb":736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"264'197","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.137925+0000","last_change":"2024-09-14T11:09:45.202528+0000","last_active":"2024-09-14T11:51:53.137925+0000","last_peered":"2024-09-14T11:51:53.137925+0000","last_clean":"2024-09-14T11:51:53.137925+0000","last_became_active":"2024-09-14T11:09:45.200971+0000","last_became_peered":"2024-09-14T11:09:45.200971+0000","last_unstale":"2024-09-14T11:51:53.137925+0000","last_undegraded":"2024-09-14T11:51:53.137925+0000","last_fullsized":"2024-09-14T11:51:53.137925+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:27.327496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16352802,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":495,"num_read_kb":61081,"num_write":898,"num_write_kb":39968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.270083+0000","last_change":"2024-09-14T11:09:48.958590+0000","last_active":"2024-09-14T11:50:53.270083+0000","last_peered":"2024-09-14T11:50:53.270083+0000","last_clean":"2024-09-14T11:50:53.270083+0000","last_became_active":"2024-09-14T11:09:48.958168+0000","last_became_peered":"2024-09-14T11:09:48.958168+0000","last_unstale":"2024-09-14T11:50:53.270083+0000","last_undegraded":"2024-09-14T11:50:53.270083+0000","last_fullsized":"2024-09-14T11:50:53.270083+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:39.133475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"264'101","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:23.140946+0000","last_change":"2024-09-14T11:09:50.999672+0000","last_active":"2024-09-14T11:52:23.140946+0000","last_peered":"2024-09-14T11:52:23.140946+0000","last_clean":"2024-09-14T11:52:23.140946+0000","last_became_active":"2024-09-14T11:09:50.998951+0000","last_became_peered":"2024-09-14T11:09:50.998951+0000","last_unstale":"2024-09-14T11:52:23.140946+0000","last_undegraded":"2024-09-14T11:52:23.140946+0000","last_fullsized":"2024-09-14T11:52:23.140946+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:34.380499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8841,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":118,"num_write":56,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:54.302639+0000","last_change":"2024-09-14T11:09:53.022344+0000","last_active":"2024-09-14T11:49:54.302639+0000","last_peered":"2024-09-14T11:49:54.302639+0000","last_clean":"2024-09-14T11:49:54.302639+0000","last_became_active":"2024-09-14T11:09:53.021595+0000","last_became_peered":"2024-09-14T11:09:53.021595+0000","last_unstale":"2024-09-14T11:49:54.302639+0000","last_undegraded":"2024-09-14T11:49:54.302639+0000","last_fullsized":"2024-09-14T11:49:54.302639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:34.894553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"264'187","reported_seq":1643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:27.560080+0000","last_change":"2024-09-14T11:09:55.029111+0000","last_active":"2024-09-14T11:52:27.560080+0000","last_peered":"2024-09-14T11:52:27.560080+0000","last_clean":"2024-09-14T11:52:27.560080+0000","last_became_active":"2024-09-14T11:09:55.028374+0000","last_became_peered":"2024-09-14T11:09:55.028374+0000","last_unstale":"2024-09-14T11:52:27.560080+0000","last_undegraded":"2024-09-14T11:52:27.560080+0000","last_fullsized":"2024-09-14T11:52:27.560080+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:11.828167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":650,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1185,"num_read_kb":1180,"num_write":425,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"264'675","reported_seq":2433,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.024596+0000","last_change":"2024-09-14T11:09:46.946536+0000","last_active":"2024-09-14T11:52:09.024596+0000","last_peered":"2024-09-14T11:52:09.024596+0000","last_clean":"2024-09-14T11:52:09.024596+0000","last_became_active":"2024-09-14T11:09:46.946243+0000","last_became_peered":"2024-09-14T11:09:46.946243+0000","last_unstale":"2024-09-14T11:52:09.024596+0000","last_undegraded":"2024-09-14T11:52:09.024596+0000","last_fullsized":"2024-09-14T11:52:09.024596+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":600,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:11.897413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3815,"num_read_kb":3478,"num_write":980,"num_write_kb":450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"264'176","reported_seq":802,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:28.132006+0000","last_change":"2024-09-14T11:09:45.204307+0000","last_active":"2024-09-14T11:51:28.132006+0000","last_peered":"2024-09-14T11:51:28.132006+0000","last_clean":"2024-09-14T11:51:28.132006+0000","last_became_active":"2024-09-14T11:09:45.201929+0000","last_became_peered":"2024-09-14T11:09:45.201929+0000","last_unstale":"2024-09-14T11:51:28.132006+0000","last_undegraded":"2024-09-14T11:51:28.132006+0000","last_fullsized":"2024-09-14T11:51:28.132006+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:36.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10510500,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":506,"num_read_kb":13055,"num_write":798,"num_write_kb":29760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.119882+0000","last_change":"2024-09-14T11:09:48.963841+0000","last_active":"2024-09-14T11:50:58.119882+0000","last_peered":"2024-09-14T11:50:58.119882+0000","last_clean":"2024-09-14T11:50:58.119882+0000","last_became_active":"2024-09-14T11:09:48.963104+0000","last_became_peered":"2024-09-14T11:09:48.963104+0000","last_unstale":"2024-09-14T11:50:58.119882+0000","last_undegraded":"2024-09-14T11:50:58.119882+0000","last_fullsized":"2024-09-14T11:50:58.119882+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:46.912247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"264'160","reported_seq":733,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.650625+0000","last_change":"2024-09-14T11:09:50.984507+0000","last_active":"2024-09-14T11:52:29.650625+0000","last_peered":"2024-09-14T11:52:29.650625+0000","last_clean":"2024-09-14T11:52:29.650625+0000","last_became_active":"2024-09-14T11:09:50.983753+0000","last_became_peered":"2024-09-14T11:09:50.983753+0000","last_unstale":"2024-09-14T11:52:29.650625+0000","last_undegraded":"2024-09-14T11:52:29.650625+0000","last_fullsized":"2024-09-14T11:52:29.650625+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:29.921471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":197,"num_read_kb":235,"num_write":112,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.105515+0000","last_change":"2024-09-14T11:09:53.011871+0000","last_active":"2024-09-14T11:49:53.105515+0000","last_peered":"2024-09-14T11:49:53.105515+0000","last_clean":"2024-09-14T11:49:53.105515+0000","last_became_active":"2024-09-14T11:09:53.011077+0000","last_became_peered":"2024-09-14T11:09:53.011077+0000","last_unstale":"2024-09-14T11:49:53.105515+0000","last_undegraded":"2024-09-14T11:49:53.105515+0000","last_fullsized":"2024-09-14T11:49:53.105515+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:50.394891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"264'163","reported_seq":662,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.100745+0000","last_change":"2024-09-14T11:09:55.022425+0000","last_active":"2024-09-14T11:53:43.100745+0000","last_peered":"2024-09-14T11:53:43.100745+0000","last_clean":"2024-09-14T11:53:43.100745+0000","last_became_active":"2024-09-14T11:09:55.021523+0000","last_became_peered":"2024-09-14T11:09:55.021523+0000","last_unstale":"2024-09-14T11:53:43.100745+0000","last_undegraded":"2024-09-14T11:53:43.100745+0000","last_fullsized":"2024-09-14T11:53:43.100745+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:10.987076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1072,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":209,"num_read_kb":183,"num_write":413,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"264'928","reported_seq":2647,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:05.437021+0000","last_change":"2024-09-14T11:09:46.957177+0000","last_active":"2024-09-14T11:52:05.437021+0000","last_peered":"2024-09-14T11:52:05.437021+0000","last_clean":"2024-09-14T11:52:05.437021+0000","last_became_active":"2024-09-14T11:09:46.951108+0000","last_became_peered":"2024-09-14T11:09:46.951108+0000","last_unstale":"2024-09-14T11:52:05.437021+0000","last_undegraded":"2024-09-14T11:52:05.437021+0000","last_fullsized":"2024-09-14T11:52:05.437021+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":900,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:15.810066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6915,"num_read_kb":6425,"num_write":1478,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"264'226","reported_seq":909,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:03.957306+0000","last_change":"2024-09-14T11:09:45.211877+0000","last_active":"2024-09-14T11:52:03.957306+0000","last_peered":"2024-09-14T11:52:03.957306+0000","last_clean":"2024-09-14T11:52:03.957306+0000","last_became_active":"2024-09-14T11:09:45.211372+0000","last_became_peered":"2024-09-14T11:09:45.211372+0000","last_unstale":"2024-09-14T11:52:03.957306+0000","last_undegraded":"2024-09-14T11:52:03.957306+0000","last_fullsized":"2024-09-14T11:52:03.957306+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:24.226008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485807,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":696,"num_read_kb":62622,"num_write":1038,"num_write_kb":26227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"264'1160","reported_seq":2864,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.122773+0000","last_change":"2024-09-14T11:09:46.972638+0000","last_active":"2024-09-14T11:53:43.122773+0000","last_peered":"2024-09-14T11:53:43.122773+0000","last_clean":"2024-09-14T11:53:43.122773+0000","last_became_active":"2024-09-14T11:09:46.970185+0000","last_became_peered":"2024-09-14T11:09:46.970185+0000","last_unstale":"2024-09-14T11:53:43.122773+0000","last_undegraded":"2024-09-14T11:53:43.122773+0000","last_fullsized":"2024-09-14T11:53:43.122773+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":1100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:13.563147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5490,"num_read_kb":4916,"num_write":1574,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"264'225","reported_seq":841,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:39.752105+0000","last_change":"2024-09-14T11:09:45.213947+0000","last_active":"2024-09-14T11:51:39.752105+0000","last_peered":"2024-09-14T11:51:39.752105+0000","last_clean":"2024-09-14T11:51:39.752105+0000","last_became_active":"2024-09-14T11:09:45.213238+0000","last_became_peered":"2024-09-14T11:09:45.213238+0000","last_unstale":"2024-09-14T11:51:39.752105+0000","last_undegraded":"2024-09-14T11:51:39.752105+0000","last_fullsized":"2024-09-14T11:51:39.752105+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:01.403575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4345424,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":549,"num_read_kb":930,"num_write":1097,"num_write_kb":31959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"264'418","reported_seq":1946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.040689+0000","last_change":"2024-09-14T11:09:46.958429+0000","last_active":"2024-09-14T11:52:29.040689+0000","last_peered":"2024-09-14T11:52:29.040689+0000","last_clean":"2024-09-14T11:52:29.040689+0000","last_became_active":"2024-09-14T11:09:46.958063+0000","last_became_peered":"2024-09-14T11:09:46.958063+0000","last_unstale":"2024-09-14T11:52:29.040689+0000","last_undegraded":"2024-09-14T11:52:29.040689+0000","last_fullsized":"2024-09-14T11:52:29.040689+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:19.646752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2247,"num_read_kb":2131,"num_write":481,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"264'218","reported_seq":1029,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:41.626756+0000","last_change":"2024-09-14T11:09:45.217514+0000","last_active":"2024-09-14T11:51:41.626756+0000","last_peered":"2024-09-14T11:51:41.626756+0000","last_clean":"2024-09-14T11:51:41.626756+0000","last_became_active":"2024-09-14T11:09:45.217258+0000","last_became_peered":"2024-09-14T11:09:45.217258+0000","last_unstale":"2024-09-14T11:51:41.626756+0000","last_undegraded":"2024-09-14T11:51:41.626756+0000","last_fullsized":"2024-09-14T11:51:41.626756+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:19.368373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5739023,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1087,"num_read_kb":14899,"num_write":1040,"num_write_kb":43826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"264'404","reported_seq":1918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:01.518761+0000","last_change":"2024-09-14T11:09:46.988480+0000","last_active":"2024-09-14T11:52:01.518761+0000","last_peered":"2024-09-14T11:52:01.518761+0000","last_clean":"2024-09-14T11:52:01.518761+0000","last_became_active":"2024-09-14T11:09:46.987465+0000","last_became_peered":"2024-09-14T11:09:46.987465+0000","last_unstale":"2024-09-14T11:52:01.518761+0000","last_undegraded":"2024-09-14T11:52:01.518761+0000","last_fullsized":"2024-09-14T11:52:01.518761+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:19.420609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2188,"num_read_kb":2091,"num_write":479,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"264'206","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:42.436145+0000","last_change":"2024-09-14T11:09:45.211461+0000","last_active":"2024-09-14T11:53:42.436145+0000","last_peered":"2024-09-14T11:53:42.436145+0000","last_clean":"2024-09-14T11:53:42.436145+0000","last_became_active":"2024-09-14T11:09:45.210754+0000","last_became_peered":"2024-09-14T11:09:45.210754+0000","last_unstale":"2024-09-14T11:53:42.436145+0000","last_undegraded":"2024-09-14T11:53:42.436145+0000","last_fullsized":"2024-09-14T11:53:42.436145+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:08.664534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4800463,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":504,"num_read_kb":979,"num_write":952,"num_write_kb":15237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"264'391","reported_seq":1908,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.025531+0000","last_change":"2024-09-14T11:09:46.975727+0000","last_active":"2024-09-14T11:52:09.025531+0000","last_peered":"2024-09-14T11:52:09.025531+0000","last_clean":"2024-09-14T11:52:09.025531+0000","last_became_active":"2024-09-14T11:09:46.975006+0000","last_became_peered":"2024-09-14T11:09:46.975006+0000","last_unstale":"2024-09-14T11:52:09.025531+0000","last_undegraded":"2024-09-14T11:52:09.025531+0000","last_fullsized":"2024-09-14T11:52:09.025531+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:24:31.291575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2194,"num_read_kb":2087,"num_write":454,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"264'200","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.121949+0000","last_change":"2024-09-14T11:09:45.211325+0000","last_active":"2024-09-14T11:50:58.121949+0000","last_peered":"2024-09-14T11:50:58.121949+0000","last_clean":"2024-09-14T11:50:58.121949+0000","last_became_active":"2024-09-14T11:09:45.210639+0000","last_became_peered":"2024-09-14T11:09:45.210639+0000","last_unstale":"2024-09-14T11:50:58.121949+0000","last_undegraded":"2024-09-14T11:50:58.121949+0000","last_fullsized":"2024-09-14T11:50:58.121949+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:20.581618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4805200,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":484,"num_read_kb":12081,"num_write":973,"num_write_kb":34333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"264'842","reported_seq":2510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.040766+0000","last_change":"2024-09-14T11:09:46.961466+0000","last_active":"2024-09-14T11:52:29.040766+0000","last_peered":"2024-09-14T11:52:29.040766+0000","last_clean":"2024-09-14T11:52:29.040766+0000","last_became_active":"2024-09-14T11:09:46.961185+0000","last_became_peered":"2024-09-14T11:09:46.961185+0000","last_unstale":"2024-09-14T11:52:29.040766+0000","last_undegraded":"2024-09-14T11:52:29.040766+0000","last_fullsized":"2024-09-14T11:52:29.040766+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:08.248591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4099,"num_read_kb":3707,"num_write":1108,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"264'185","reported_seq":793,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.122073+0000","last_change":"2024-09-14T11:09:45.220791+0000","last_active":"2024-09-14T11:50:58.122073+0000","last_peered":"2024-09-14T11:50:58.122073+0000","last_clean":"2024-09-14T11:50:58.122073+0000","last_became_active":"2024-09-14T11:09:45.220246+0000","last_became_peered":"2024-09-14T11:09:45.220246+0000","last_unstale":"2024-09-14T11:50:58.122073+0000","last_undegraded":"2024-09-14T11:50:58.122073+0000","last_fullsized":"2024-09-14T11:50:58.122073+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:36.399604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9461910,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":447,"num_read_kb":10292,"num_write":860,"num_write_kb":29061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"264'671","reported_seq":2011,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.647214+0000","last_change":"2024-09-14T11:09:46.991359+0000","last_active":"2024-09-14T11:52:29.647214+0000","last_peered":"2024-09-14T11:52:29.647214+0000","last_clean":"2024-09-14T11:52:29.647214+0000","last_became_active":"2024-09-14T11:09:46.990649+0000","last_became_peered":"2024-09-14T11:09:46.990649+0000","last_unstale":"2024-09-14T11:52:29.647214+0000","last_undegraded":"2024-09-14T11:52:29.647214+0000","last_fullsized":"2024-09-14T11:52:29.647214+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":600,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:23.410718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3174,"num_read_kb":2866,"num_write":894,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"264'229","reported_seq":888,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:30.553802+0000","last_change":"2024-09-14T11:09:45.208096+0000","last_active":"2024-09-14T11:51:30.553802+0000","last_peered":"2024-09-14T11:51:30.553802+0000","last_clean":"2024-09-14T11:51:30.553802+0000","last_became_active":"2024-09-14T11:09:45.207500+0000","last_became_peered":"2024-09-14T11:09:45.207500+0000","last_unstale":"2024-09-14T11:51:30.553802+0000","last_undegraded":"2024-09-14T11:51:30.553802+0000","last_fullsized":"2024-09-14T11:51:30.553802+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:22.993861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5269028,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":639,"num_read_kb":28771,"num_write":1106,"num_write_kb":28685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"264'2088","reported_seq":3859,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:56.236839+0000","last_change":"2024-09-14T11:09:46.965260+0000","last_active":"2024-09-14T11:51:56.236839+0000","last_peered":"2024-09-14T11:51:56.236839+0000","last_clean":"2024-09-14T11:51:56.236839+0000","last_became_active":"2024-09-14T11:09:46.964893+0000","last_became_peered":"2024-09-14T11:09:46.964893+0000","last_unstale":"2024-09-14T11:51:56.236839+0000","last_undegraded":"2024-09-14T11:51:56.236839+0000","last_fullsized":"2024-09-14T11:51:56.236839+0000","mapping_epoch":25,"log_start":"264'2000","ondisk_log_start":"264'2000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":2000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:34.137174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9234,"num_read_kb":7993,"num_write":3022,"num_write_kb":1347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"264'273","reported_seq":972,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:44.371191+0000","last_change":"2024-09-14T11:09:45.204674+0000","last_active":"2024-09-14T11:51:44.371191+0000","last_peered":"2024-09-14T11:51:44.371191+0000","last_clean":"2024-09-14T11:51:44.371191+0000","last_became_active":"2024-09-14T11:09:45.201951+0000","last_became_peered":"2024-09-14T11:09:45.201951+0000","last_unstale":"2024-09-14T11:51:44.371191+0000","last_undegraded":"2024-09-14T11:51:44.371191+0000","last_fullsized":"2024-09-14T11:51:44.371191+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:52.455396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8461868,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":871,"num_read_kb":20954,"num_write":1188,"num_write_kb":48388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"264'393","reported_seq":1898,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:11.468367+0000","last_change":"2024-09-14T11:09:46.983040+0000","last_active":"2024-09-14T11:52:11.468367+0000","last_peered":"2024-09-14T11:52:11.468367+0000","last_clean":"2024-09-14T11:52:11.468367+0000","last_became_active":"2024-09-14T11:09:46.982125+0000","last_became_peered":"2024-09-14T11:09:46.982125+0000","last_unstale":"2024-09-14T11:52:11.468367+0000","last_undegraded":"2024-09-14T11:52:11.468367+0000","last_fullsized":"2024-09-14T11:52:11.468367+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:20.751819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2124,"num_read_kb":2027,"num_write":431,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"264'241","reported_seq":918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:11.388203+0000","last_change":"2024-09-14T11:09:45.220108+0000","last_active":"2024-09-14T11:52:11.388203+0000","last_peered":"2024-09-14T11:52:11.388203+0000","last_clean":"2024-09-14T11:52:11.388203+0000","last_became_active":"2024-09-14T11:09:45.219634+0000","last_became_peered":"2024-09-14T11:09:45.219634+0000","last_unstale":"2024-09-14T11:52:11.388203+0000","last_undegraded":"2024-09-14T11:52:11.388203+0000","last_fullsized":"2024-09-14T11:52:11.388203+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:17.207975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14933608,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":695,"num_read_kb":35580,"num_write":1134,"num_write_kb":63455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"264'544","reported_seq":2093,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:11.466077+0000","last_change":"2024-09-14T11:09:46.962608+0000","last_active":"2024-09-14T11:52:11.466077+0000","last_peered":"2024-09-14T11:52:11.466077+0000","last_clean":"2024-09-14T11:52:11.466077+0000","last_became_active":"2024-09-14T11:09:46.962261+0000","last_became_peered":"2024-09-14T11:09:46.962261+0000","last_unstale":"2024-09-14T11:52:11.466077+0000","last_undegraded":"2024-09-14T11:52:11.466077+0000","last_fullsized":"2024-09-14T11:52:11.466077+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:09.235080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2646,"num_read_kb":2439,"num_write":661,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"264'213","reported_seq":848,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:38.568110+0000","last_change":"2024-09-14T11:09:45.202616+0000","last_active":"2024-09-14T11:51:38.568110+0000","last_peered":"2024-09-14T11:51:38.568110+0000","last_clean":"2024-09-14T11:51:38.568110+0000","last_became_active":"2024-09-14T11:09:45.200775+0000","last_became_peered":"2024-09-14T11:09:45.200775+0000","last_unstale":"2024-09-14T11:51:38.568110+0000","last_undegraded":"2024-09-14T11:51:38.568110+0000","last_fullsized":"2024-09-14T11:51:38.568110+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:14:20.167362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5571647,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":532,"num_read_kb":33597,"num_write":1019,"num_write_kb":35359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"264'563","reported_seq":2409,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.766645+0000","last_change":"2024-09-14T11:09:46.975288+0000","last_active":"2024-09-14T11:52:12.766645+0000","last_peered":"2024-09-14T11:52:12.766645+0000","last_clean":"2024-09-14T11:52:12.766645+0000","last_became_active":"2024-09-14T11:09:46.974543+0000","last_became_peered":"2024-09-14T11:09:46.974543+0000","last_unstale":"2024-09-14T11:52:12.766645+0000","last_undegraded":"2024-09-14T11:52:12.766645+0000","last_fullsized":"2024-09-14T11:52:12.766645+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:10.907592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3309,"num_read_kb":3115,"num_write":715,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"264'205","reported_seq":836,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:39.573155+0000","last_change":"2024-09-14T11:09:45.205037+0000","last_active":"2024-09-14T11:51:39.573155+0000","last_peered":"2024-09-14T11:51:39.573155+0000","last_clean":"2024-09-14T11:51:39.573155+0000","last_became_active":"2024-09-14T11:09:45.204754+0000","last_became_peered":"2024-09-14T11:09:45.204754+0000","last_unstale":"2024-09-14T11:51:39.573155+0000","last_undegraded":"2024-09-14T11:51:39.573155+0000","last_fullsized":"2024-09-14T11:51:39.573155+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:21.492270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10518114,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":518,"num_read_kb":30401,"num_write":974,"num_write_kb":24964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"264'575","reported_seq":2323,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.768055+0000","last_change":"2024-09-14T11:09:46.965280+0000","last_active":"2024-09-14T11:52:12.768055+0000","last_peered":"2024-09-14T11:52:12.768055+0000","last_clean":"2024-09-14T11:52:12.768055+0000","last_became_active":"2024-09-14T11:09:46.964946+0000","last_became_peered":"2024-09-14T11:09:46.964946+0000","last_unstale":"2024-09-14T11:52:12.768055+0000","last_undegraded":"2024-09-14T11:52:12.768055+0000","last_fullsized":"2024-09-14T11:52:12.768055+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":500,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:37.727246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3099,"num_read_kb":2896,"num_write":721,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"264'207","reported_seq":894,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:01.407951+0000","last_change":"2024-09-14T11:09:45.192015+0000","last_active":"2024-09-14T11:51:01.407951+0000","last_peered":"2024-09-14T11:51:01.407951+0000","last_clean":"2024-09-14T11:51:01.407951+0000","last_became_active":"2024-09-14T11:09:45.191314+0000","last_became_peered":"2024-09-14T11:09:45.191314+0000","last_unstale":"2024-09-14T11:51:01.407951+0000","last_undegraded":"2024-09-14T11:51:01.407951+0000","last_fullsized":"2024-09-14T11:51:01.407951+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:59.041601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9515410,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":689,"num_read_kb":24382,"num_write":1010,"num_write_kb":29533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"264'551","reported_seq":2029,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.646131+0000","last_change":"2024-09-14T11:09:46.994591+0000","last_active":"2024-09-14T11:52:29.646131+0000","last_peered":"2024-09-14T11:52:29.646131+0000","last_clean":"2024-09-14T11:52:29.646131+0000","last_became_active":"2024-09-14T11:09:46.994113+0000","last_became_peered":"2024-09-14T11:09:46.994113+0000","last_unstale":"2024-09-14T11:52:29.646131+0000","last_undegraded":"2024-09-14T11:52:29.646131+0000","last_fullsized":"2024-09-14T11:52:29.646131+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:14.044249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2807,"num_read_kb":2558,"num_write":736,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"264'218","reported_seq":812,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:29.188758+0000","last_change":"2024-09-14T11:09:45.219322+0000","last_active":"2024-09-14T11:50:29.188758+0000","last_peered":"2024-09-14T11:50:29.188758+0000","last_clean":"2024-09-14T11:50:29.188758+0000","last_became_active":"2024-09-14T11:09:45.214511+0000","last_became_peered":"2024-09-14T11:09:45.214511+0000","last_unstale":"2024-09-14T11:50:29.188758+0000","last_undegraded":"2024-09-14T11:50:29.188758+0000","last_fullsized":"2024-09-14T11:50:29.188758+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:52.501892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388621,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":481,"num_read_kb":9687,"num_write":1029,"num_write_kb":43578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"264'462","reported_seq":1938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.646695+0000","last_change":"2024-09-14T11:09:46.975025+0000","last_active":"2024-09-14T11:52:29.646695+0000","last_peered":"2024-09-14T11:52:29.646695+0000","last_clean":"2024-09-14T11:52:29.646695+0000","last_became_active":"2024-09-14T11:09:46.974152+0000","last_became_peered":"2024-09-14T11:09:46.974152+0000","last_unstale":"2024-09-14T11:52:29.646695+0000","last_undegraded":"2024-09-14T11:52:29.646695+0000","last_fullsized":"2024-09-14T11:52:29.646695+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:18.882062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2413,"num_read_kb":2245,"num_write":556,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"264'238","reported_seq":890,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:56.134617+0000","last_change":"2024-09-14T11:09:45.203506+0000","last_active":"2024-09-14T11:51:56.134617+0000","last_peered":"2024-09-14T11:51:56.134617+0000","last_clean":"2024-09-14T11:51:56.134617+0000","last_became_active":"2024-09-14T11:09:45.202934+0000","last_became_peered":"2024-09-14T11:09:45.202934+0000","last_unstale":"2024-09-14T11:51:56.134617+0000","last_undegraded":"2024-09-14T11:51:56.134617+0000","last_fullsized":"2024-09-14T11:51:56.134617+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:23.806980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8453539,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":629,"num_read_kb":75174,"num_write":1102,"num_write_kb":32522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"264'394","reported_seq":1908,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:10.846557+0000","last_change":"2024-09-14T11:09:46.947793+0000","last_active":"2024-09-14T11:52:10.846557+0000","last_peered":"2024-09-14T11:52:10.846557+0000","last_clean":"2024-09-14T11:52:10.846557+0000","last_became_active":"2024-09-14T11:09:46.946993+0000","last_became_peered":"2024-09-14T11:09:46.946993+0000","last_unstale":"2024-09-14T11:52:10.846557+0000","last_undegraded":"2024-09-14T11:52:10.846557+0000","last_fullsized":"2024-09-14T11:52:10.846557+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:47.133049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2163,"num_read_kb":2058,"num_write":443,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"264'184","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:08.916279+0000","last_change":"2024-09-14T11:09:45.217891+0000","last_active":"2024-09-14T11:52:08.916279+0000","last_peered":"2024-09-14T11:52:08.916279+0000","last_clean":"2024-09-14T11:52:08.916279+0000","last_became_active":"2024-09-14T11:09:45.217119+0000","last_became_peered":"2024-09-14T11:09:45.217119+0000","last_unstale":"2024-09-14T11:52:08.916279+0000","last_undegraded":"2024-09-14T11:52:08.916279+0000","last_fullsized":"2024-09-14T11:52:08.916279+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:40.436809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8785782,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":474,"num_read_kb":19832,"num_write":841,"num_write_kb":31579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"264'827","reported_seq":2382,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:04.903866+0000","last_change":"2024-09-14T11:09:46.991150+0000","last_active":"2024-09-14T11:52:04.903866+0000","last_peered":"2024-09-14T11:52:04.903866+0000","last_clean":"2024-09-14T11:52:04.903866+0000","last_became_active":"2024-09-14T11:09:46.990899+0000","last_became_peered":"2024-09-14T11:09:46.990899+0000","last_unstale":"2024-09-14T11:52:04.903866+0000","last_undegraded":"2024-09-14T11:52:04.903866+0000","last_fullsized":"2024-09-14T11:52:04.903866+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:34:32.141931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3995,"num_read_kb":3582,"num_write":1122,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"264'238","reported_seq":939,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:54.900653+0000","last_change":"2024-09-14T11:09:45.215275+0000","last_active":"2024-09-14T11:51:54.900653+0000","last_peered":"2024-09-14T11:51:54.900653+0000","last_clean":"2024-09-14T11:51:54.900653+0000","last_became_active":"2024-09-14T11:09:45.214713+0000","last_became_peered":"2024-09-14T11:09:45.214713+0000","last_unstale":"2024-09-14T11:51:54.900653+0000","last_undegraded":"2024-09-14T11:51:54.900653+0000","last_fullsized":"2024-09-14T11:51:54.900653+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:49.671679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19529015,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":732,"num_read_kb":73896,"num_write":1169,"num_write_kb":36295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"264'146","reported_seq":837,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:06.135658+0000","last_change":"2024-09-14T11:09:45.202592+0000","last_active":"2024-09-14T11:51:06.135658+0000","last_peered":"2024-09-14T11:51:06.135658+0000","last_clean":"2024-09-14T11:51:06.135658+0000","last_became_active":"2024-09-14T11:09:45.202270+0000","last_became_peered":"2024-09-14T11:09:45.202270+0000","last_unstale":"2024-09-14T11:51:06.135658+0000","last_undegraded":"2024-09-14T11:51:06.135658+0000","last_fullsized":"2024-09-14T11:51:06.135658+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:26.117626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9789022,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":689,"num_read_kb":138365,"num_write":721,"num_write_kb":22161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"264'887","reported_seq":2644,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.109063+0000","last_change":"2024-09-14T11:09:46.947818+0000","last_active":"2024-09-14T11:53:43.109063+0000","last_peered":"2024-09-14T11:53:43.109063+0000","last_clean":"2024-09-14T11:53:43.109063+0000","last_became_active":"2024-09-14T11:09:46.947102+0000","last_became_peered":"2024-09-14T11:09:46.947102+0000","last_unstale":"2024-09-14T11:53:43.109063+0000","last_undegraded":"2024-09-14T11:53:43.109063+0000","last_fullsized":"2024-09-14T11:53:43.109063+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":800,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:59.879613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4492,"num_read_kb":4074,"num_write":1171,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"264'212","reported_seq":896,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:01.411621+0000","last_change":"2024-09-14T11:09:45.207476+0000","last_active":"2024-09-14T11:52:01.411621+0000","last_peered":"2024-09-14T11:52:01.411621+0000","last_clean":"2024-09-14T11:52:01.411621+0000","last_became_active":"2024-09-14T11:09:45.204922+0000","last_became_peered":"2024-09-14T11:09:45.204922+0000","last_unstale":"2024-09-14T11:52:01.411621+0000","last_undegraded":"2024-09-14T11:52:01.411621+0000","last_fullsized":"2024-09-14T11:52:01.411621+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:11.013663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388673,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":759,"num_read_kb":17799,"num_write":1013,"num_write_kb":50816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"264'494","reported_seq":2052,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.104268+0000","last_change":"2024-09-14T11:09:46.982184+0000","last_active":"2024-09-14T11:53:43.104268+0000","last_peered":"2024-09-14T11:53:43.104268+0000","last_clean":"2024-09-14T11:53:43.104268+0000","last_became_active":"2024-09-14T11:09:46.981819+0000","last_became_peered":"2024-09-14T11:09:46.981819+0000","last_unstale":"2024-09-14T11:53:43.104268+0000","last_undegraded":"2024-09-14T11:53:43.104268+0000","last_fullsized":"2024-09-14T11:53:43.104268+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:29:11.574907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2560,"num_read_kb":2380,"num_write":586,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10857,"num_read_kb":9179,"num_write":3115,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1006,"ondisk_log_size":1006,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15755,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":15151,"num_read_kb":14810,"num_write":17052,"num_write_kb":4979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1790,"ondisk_log_size":1790,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":730,"ondisk_log_size":730,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":497938,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":8067,"num_read_kb":10027,"num_write":5515,"num_write_kb":2781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":794624,"data_stored":253076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2010,"ondisk_log_size":2010,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2869,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":220474,"num_read_kb":201951,"num_write":55880,"num_write_kb":19076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3974,"ondisk_log_size":3974,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":492891480,"num_objects":484,"num_object_clones":0,"num_object_copies":968,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":484,"num_whiteouts":0,"num_read":38612,"num_read_kb":2063955,"num_write":64189,"num_write_kb":2182336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":987561984,"data_stored":985782960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3956,"ondisk_log_size":3956,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":63029779,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":132,"num_read_kb":158488,"num_write":156,"num_write_kb":116383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":126066688,"data_stored":126059558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":63029779,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":130,"num_read_kb":158381,"num_write":156,"num_write_kb":116383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":126066688,"data_stored":126059558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509978,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":385064,"kb_used_data":183128,"kb_used_omap":1,"kb_used_meta":201918,"kb_avail":93986776,"statfs":{"total":96636764160,"available":96242458624,"internally_reserved":0,"allocated":187523072,"data_stored":185739153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":206764487},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509980,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":262316,"kb_used_data":154780,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94109524,"statfs":{"total":96636764160,"available":96368152576,"internally_reserved":0,"allocated":158494720,"data_stored":156702545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542682,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316608,"kb_used_data":118896,"kb_used_omap":1,"kb_used_meta":197694,"kb_avail":94055232,"statfs":{"total":96636764160,"available":96312557568,"internally_reserved":0,"allocated":121749504,"data_stored":120047947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":202439114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542680,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":195124,"kb_used_data":123684,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94176716,"statfs":{"total":96636764160,"available":96436957184,"internally_reserved":0,"allocated":126652416,"data_stored":124894584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542680,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":446900,"kb_used_data":208868,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":93924940,"statfs":{"total":96636764160,"available":96179138560,"internally_reserved":0,"allocated":213880832,"data_stored":212001872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243726789},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542681,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":256224,"kb_used_data":112656,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94115616,"statfs":{"total":96636764160,"available":96374390784,"internally_reserved":0,"allocated":115359744,"data_stored":113612321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542681,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":407156,"kb_used_data":155236,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":93964684,"statfs":{"total":96636764160,"available":96219836416,"internally_reserved":0,"allocated":158961664,"data_stored":157171577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257948101},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542682,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":254992,"kb_used_data":183552,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94116848,"statfs":{"total":96636764160,"available":96375652352,"internally_reserved":0,"allocated":187957248,"data_stored":186050527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":166322176,"data_stored":166015456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":109527040,"data_stored":109326996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":128544768,"data_stored":128314323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":144977920,"data_stored":144741724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":87502848,"data_stored":87338046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":169623552,"data_stored":169314370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":103993344,"data_stored":103820751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77070336,"data_stored":76911294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":34588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":56458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":12044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":22743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":45185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":30262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":33348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":18448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":6024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":5138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":2784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7401472,"data_stored":7400401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32505856,"data_stored":32505856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5292032,"data_stored":5291307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26218496,"data_stored":26217607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":14733312,"data_stored":14731707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4198400,"data_stored":4197520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":27328512,"data_stored":27326552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10489856,"data_stored":10488976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12648448,"data_stored":12646497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25227264,"data_stored":25226193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14733312,"data_stored":14731698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13684736,"data_stored":13683122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:53:58.513 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T11:53:58.514 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:53:58.890 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:53:58.906 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-14T11:53:58.919 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":1592,"stamp":"2024-09-14T11:53:58.526768+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":242073126,"num_objects":754,"num_object_clones":0,"num_object_copies":1508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":754,"num_whiteouts":0,"num_read":296424,"num_read_kb":2620319,"num_write":146589,"num_write_kb":2444627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":200,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13361,"ondisk_log_size":13361,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1825816,"kb_used_data":541980,"kb_used_omap":12,"kb_used_meta":1283443,"kb_avail":753148904,"statfs":{"total":773094113280,"available":771224477696,"internally_reserved":0,"allocated":554987520,"data_stored":541281546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1314246193},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-377983823,"num_objects":-252,"num_object_clones":0,"num_object_copies":-504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-252,"num_whiteouts":0,"num_read":533,"num_read_kb":605,"num_write":393,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007726"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.294070+0000","last_change":"2024-09-14T11:38:50.585610+0000","last_active":"2024-09-14T11:51:23.294070+0000","last_peered":"2024-09-14T11:51:23.294070+0000","last_clean":"2024-09-14T11:51:23.294070+0000","last_became_active":"2024-09-14T11:38:50.585084+0000","last_became_peered":"2024-09-14T11:38:50.585084+0000","last_unstale":"2024-09-14T11:51:23.294070+0000","last_undegraded":"2024-09-14T11:51:23.294070+0000","last_fullsized":"2024-09-14T11:51:23.294070+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:50.511838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.261823+0000","last_change":"2024-09-14T11:27:41.641807+0000","last_active":"2024-09-14T11:50:13.261823+0000","last_peered":"2024-09-14T11:50:13.261823+0000","last_clean":"2024-09-14T11:50:13.261823+0000","last_became_active":"2024-09-14T11:27:41.641034+0000","last_became_peered":"2024-09-14T11:27:41.641034+0000","last_unstale":"2024-09-14T11:50:13.261823+0000","last_undegraded":"2024-09-14T11:50:13.261823+0000","last_fullsized":"2024-09-14T11:50:13.261823+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:01.125992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"261'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.288469+0000","last_change":"2024-09-14T11:27:38.617636+0000","last_active":"2024-09-14T11:50:08.288469+0000","last_peered":"2024-09-14T11:50:08.288469+0000","last_clean":"2024-09-14T11:50:08.288469+0000","last_became_active":"2024-09-14T11:27:38.617019+0000","last_became_peered":"2024-09-14T11:27:38.617019+0000","last_unstale":"2024-09-14T11:50:08.288469+0000","last_undegraded":"2024-09-14T11:50:08.288469+0000","last_fullsized":"2024-09-14T11:50:08.288469+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:02.190657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"264'17","reported_seq":90,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.122298+0000","last_change":"2024-09-14T11:26:04.263404+0000","last_active":"2024-09-14T11:51:08.122298+0000","last_peered":"2024-09-14T11:51:08.122298+0000","last_clean":"2024-09-14T11:51:08.122298+0000","last_became_active":"2024-09-14T11:26:04.262003+0000","last_became_peered":"2024-09-14T11:26:04.262003+0000","last_unstale":"2024-09-14T11:51:08.122298+0000","last_undegraded":"2024-09-14T11:51:08.122298+0000","last_fullsized":"2024-09-14T11:51:08.122298+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:19.974639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":88,"num_write":45,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.127863+0000","last_change":"2024-09-14T11:38:50.592796+0000","last_active":"2024-09-14T11:51:23.127863+0000","last_peered":"2024-09-14T11:51:23.127863+0000","last_clean":"2024-09-14T11:51:23.127863+0000","last_became_active":"2024-09-14T11:38:50.592015+0000","last_became_peered":"2024-09-14T11:38:50.592015+0000","last_unstale":"2024-09-14T11:51:23.127863+0000","last_undegraded":"2024-09-14T11:51:23.127863+0000","last_fullsized":"2024-09-14T11:51:23.127863+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:43.698723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"264'3","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.091293+0000","last_change":"2024-09-14T11:27:41.643113+0000","last_active":"2024-09-14T11:50:14.091293+0000","last_peered":"2024-09-14T11:50:14.091293+0000","last_clean":"2024-09-14T11:50:14.091293+0000","last_became_active":"2024-09-14T11:27:41.642359+0000","last_became_peered":"2024-09-14T11:27:41.642359+0000","last_unstale":"2024-09-14T11:50:14.091293+0000","last_undegraded":"2024-09-14T11:50:14.091293+0000","last_fullsized":"2024-09-14T11:50:14.091293+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:14.671551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3072,"num_write":3,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"264'5","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:38.147879+0000","last_change":"2024-09-14T11:27:38.602923+0000","last_active":"2024-09-14T11:52:38.147879+0000","last_peered":"2024-09-14T11:52:38.147879+0000","last_clean":"2024-09-14T11:52:38.147879+0000","last_became_active":"2024-09-14T11:27:38.597816+0000","last_became_peered":"2024-09-14T11:27:38.597816+0000","last_unstale":"2024-09-14T11:52:38.147879+0000","last_undegraded":"2024-09-14T11:52:38.147879+0000","last_fullsized":"2024-09-14T11:52:38.147879+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:36.668640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1028,"num_write":10,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"264'31","reported_seq":127,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.109991+0000","last_change":"2024-09-14T11:26:04.283737+0000","last_active":"2024-09-14T11:50:13.109991+0000","last_peered":"2024-09-14T11:50:13.109991+0000","last_clean":"2024-09-14T11:50:13.109991+0000","last_became_active":"2024-09-14T11:26:04.280237+0000","last_became_peered":"2024-09-14T11:26:04.280237+0000","last_unstale":"2024-09-14T11:50:13.109991+0000","last_undegraded":"2024-09-14T11:50:13.109991+0000","last_fullsized":"2024-09-14T11:50:13.109991+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:15.981498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":150,"num_write":82,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.271146+0000","last_change":"2024-09-14T11:38:50.574799+0000","last_active":"2024-09-14T11:50:58.271146+0000","last_peered":"2024-09-14T11:50:58.271146+0000","last_clean":"2024-09-14T11:50:58.271146+0000","last_became_active":"2024-09-14T11:38:50.574020+0000","last_became_peered":"2024-09-14T11:38:50.574020+0000","last_unstale":"2024-09-14T11:50:58.271146+0000","last_undegraded":"2024-09-14T11:50:58.271146+0000","last_fullsized":"2024-09-14T11:50:58.271146+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:52.985985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.120898+0000","last_change":"2024-09-14T11:27:41.646451+0000","last_active":"2024-09-14T11:50:38.120898+0000","last_peered":"2024-09-14T11:50:38.120898+0000","last_clean":"2024-09-14T11:50:38.120898+0000","last_became_active":"2024-09-14T11:27:41.645143+0000","last_became_peered":"2024-09-14T11:27:41.645143+0000","last_unstale":"2024-09-14T11:50:38.120898+0000","last_undegraded":"2024-09-14T11:50:38.120898+0000","last_fullsized":"2024-09-14T11:50:38.120898+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:34.278570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:38.314219+0000","last_change":"2024-09-14T11:27:38.620069+0000","last_active":"2024-09-14T11:51:38.314219+0000","last_peered":"2024-09-14T11:51:38.314219+0000","last_clean":"2024-09-14T11:51:38.314219+0000","last_became_active":"2024-09-14T11:27:38.619537+0000","last_became_peered":"2024-09-14T11:27:38.619537+0000","last_unstale":"2024-09-14T11:51:38.314219+0000","last_undegraded":"2024-09-14T11:51:38.314219+0000","last_fullsized":"2024-09-14T11:51:38.314219+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:49.847960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"264'124","reported_seq":411,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.124673+0000","last_change":"2024-09-14T11:26:04.282980+0000","last_active":"2024-09-14T11:51:08.124673+0000","last_peered":"2024-09-14T11:51:08.124673+0000","last_clean":"2024-09-14T11:51:08.124673+0000","last_became_active":"2024-09-14T11:26:04.279472+0000","last_became_peered":"2024-09-14T11:26:04.279472+0000","last_unstale":"2024-09-14T11:51:08.124673+0000","last_undegraded":"2024-09-14T11:51:08.124673+0000","last_fullsized":"2024-09-14T11:51:08.124673+0000","mapping_epoch":253,"log_start":"261'100","ondisk_log_start":"261'100","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:01.809787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1140,"num_read_kb":1229,"num_write":251,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.126235+0000","last_change":"2024-09-14T11:38:50.588516+0000","last_active":"2024-09-14T11:51:03.126235+0000","last_peered":"2024-09-14T11:51:03.126235+0000","last_clean":"2024-09-14T11:51:03.126235+0000","last_became_active":"2024-09-14T11:38:50.587700+0000","last_became_peered":"2024-09-14T11:38:50.587700+0000","last_unstale":"2024-09-14T11:51:03.126235+0000","last_undegraded":"2024-09-14T11:51:03.126235+0000","last_fullsized":"2024-09-14T11:51:03.126235+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:40.939286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"264'8","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.513753+0000","last_change":"2024-09-14T11:27:41.645646+0000","last_active":"2024-09-14T11:53:57.513753+0000","last_peered":"2024-09-14T11:53:57.513753+0000","last_clean":"2024-09-14T11:53:57.513753+0000","last_became_active":"2024-09-14T11:27:41.644919+0000","last_became_peered":"2024-09-14T11:27:41.644919+0000","last_unstale":"2024-09-14T11:53:57.513753+0000","last_undegraded":"2024-09-14T11:53:57.513753+0000","last_fullsized":"2024-09-14T11:53:57.513753+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:48.076358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"264'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:38.292883+0000","last_change":"2024-09-14T11:27:38.610209+0000","last_active":"2024-09-14T11:52:38.292883+0000","last_peered":"2024-09-14T11:52:38.292883+0000","last_clean":"2024-09-14T11:52:38.292883+0000","last_became_active":"2024-09-14T11:27:38.609445+0000","last_became_peered":"2024-09-14T11:27:38.609445+0000","last_unstale":"2024-09-14T11:52:38.292883+0000","last_undegraded":"2024-09-14T11:52:38.292883+0000","last_fullsized":"2024-09-14T11:52:38.292883+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:01.517926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"264'61","reported_seq":213,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.124618+0000","last_change":"2024-09-14T11:26:04.283422+0000","last_active":"2024-09-14T11:51:08.124618+0000","last_peered":"2024-09-14T11:51:08.124618+0000","last_clean":"2024-09-14T11:51:08.124618+0000","last_became_active":"2024-09-14T11:26:04.282662+0000","last_became_peered":"2024-09-14T11:26:04.282662+0000","last_unstale":"2024-09-14T11:51:08.124618+0000","last_undegraded":"2024-09-14T11:51:08.124618+0000","last_fullsized":"2024-09-14T11:51:08.124618+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:05.753210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":527,"num_read_kb":359,"num_write":147,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.298593+0000","last_change":"2024-09-14T11:38:50.586486+0000","last_active":"2024-09-14T11:50:53.298593+0000","last_peered":"2024-09-14T11:50:53.298593+0000","last_clean":"2024-09-14T11:50:53.298593+0000","last_became_active":"2024-09-14T11:38:50.582489+0000","last_became_peered":"2024-09-14T11:38:50.582489+0000","last_unstale":"2024-09-14T11:50:53.298593+0000","last_undegraded":"2024-09-14T11:50:53.298593+0000","last_fullsized":"2024-09-14T11:50:53.298593+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:07.012027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.269333+0000","last_change":"2024-09-14T11:27:41.647192+0000","last_active":"2024-09-14T11:49:28.269333+0000","last_peered":"2024-09-14T11:49:28.269333+0000","last_clean":"2024-09-14T11:49:28.269333+0000","last_became_active":"2024-09-14T11:27:41.645724+0000","last_became_peered":"2024-09-14T11:27:41.645724+0000","last_unstale":"2024-09-14T11:49:28.269333+0000","last_undegraded":"2024-09-14T11:49:28.269333+0000","last_fullsized":"2024-09-14T11:49:28.269333+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:16.835815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"264'3","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:48.136550+0000","last_change":"2024-09-14T11:27:38.606708+0000","last_active":"2024-09-14T11:51:48.136550+0000","last_peered":"2024-09-14T11:51:48.136550+0000","last_clean":"2024-09-14T11:51:48.136550+0000","last_became_active":"2024-09-14T11:27:38.605937+0000","last_became_peered":"2024-09-14T11:27:38.605937+0000","last_unstale":"2024-09-14T11:51:48.136550+0000","last_undegraded":"2024-09-14T11:51:48.136550+0000","last_fullsized":"2024-09-14T11:51:48.136550+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:01.152788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"264'12","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.124495+0000","last_change":"2024-09-14T11:26:04.279565+0000","last_active":"2024-09-14T11:51:08.124495+0000","last_peered":"2024-09-14T11:51:08.124495+0000","last_clean":"2024-09-14T11:51:08.124495+0000","last_became_active":"2024-09-14T11:26:04.278457+0000","last_became_peered":"2024-09-14T11:26:04.278457+0000","last_unstale":"2024-09-14T11:51:08.124495+0000","last_undegraded":"2024-09-14T11:51:08.124495+0000","last_fullsized":"2024-09-14T11:51:08.124495+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:36.957690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":56,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.125380+0000","last_change":"2024-09-14T11:38:50.576845+0000","last_active":"2024-09-14T11:51:23.125380+0000","last_peered":"2024-09-14T11:51:23.125380+0000","last_clean":"2024-09-14T11:51:23.125380+0000","last_became_active":"2024-09-14T11:38:50.576125+0000","last_became_peered":"2024-09-14T11:38:50.576125+0000","last_unstale":"2024-09-14T11:51:23.125380+0000","last_undegraded":"2024-09-14T11:51:23.125380+0000","last_fullsized":"2024-09-14T11:51:23.125380+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:08.428909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"264'3","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:29.295860+0000","last_change":"2024-09-14T11:27:41.661526+0000","last_active":"2024-09-14T11:49:29.295860+0000","last_peered":"2024-09-14T11:49:29.295860+0000","last_clean":"2024-09-14T11:49:29.295860+0000","last_became_active":"2024-09-14T11:27:41.660702+0000","last_became_peered":"2024-09-14T11:27:41.660702+0000","last_unstale":"2024-09-14T11:49:29.295860+0000","last_undegraded":"2024-09-14T11:49:29.295860+0000","last_fullsized":"2024-09-14T11:49:29.295860+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:11.563164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"264'8","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:29.296048+0000","last_change":"2024-09-14T11:27:38.603652+0000","last_active":"2024-09-14T11:49:29.296048+0000","last_peered":"2024-09-14T11:49:29.296048+0000","last_clean":"2024-09-14T11:49:29.296048+0000","last_became_active":"2024-09-14T11:27:38.602908+0000","last_became_peered":"2024-09-14T11:27:38.602908+0000","last_unstale":"2024-09-14T11:49:29.296048+0000","last_undegraded":"2024-09-14T11:49:29.296048+0000","last_fullsized":"2024-09-14T11:49:29.296048+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:54.757602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":13,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"264'30","reported_seq":126,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:04.102933+0000","last_change":"2024-09-14T11:26:04.259271+0000","last_active":"2024-09-14T11:51:04.102933+0000","last_peered":"2024-09-14T11:51:04.102933+0000","last_clean":"2024-09-14T11:51:04.102933+0000","last_became_active":"2024-09-14T11:26:04.258048+0000","last_became_peered":"2024-09-14T11:26:04.258048+0000","last_unstale":"2024-09-14T11:51:04.102933+0000","last_undegraded":"2024-09-14T11:51:04.102933+0000","last_fullsized":"2024-09-14T11:51:04.102933+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:36.508914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":248,"num_read_kb":161,"num_write":75,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:24.107804+0000","last_change":"2024-09-14T11:38:50.591472+0000","last_active":"2024-09-14T11:51:24.107804+0000","last_peered":"2024-09-14T11:51:24.107804+0000","last_clean":"2024-09-14T11:51:24.107804+0000","last_became_active":"2024-09-14T11:38:50.590496+0000","last_became_peered":"2024-09-14T11:38:50.590496+0000","last_unstale":"2024-09-14T11:51:24.107804+0000","last_undegraded":"2024-09-14T11:51:24.107804+0000","last_fullsized":"2024-09-14T11:51:24.107804+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:59.200308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"264'9","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.091257+0000","last_change":"2024-09-14T11:27:41.637007+0000","last_active":"2024-09-14T11:50:14.091257+0000","last_peered":"2024-09-14T11:50:14.091257+0000","last_clean":"2024-09-14T11:50:14.091257+0000","last_became_active":"2024-09-14T11:27:41.635495+0000","last_became_peered":"2024-09-14T11:27:41.635495+0000","last_unstale":"2024-09-14T11:50:14.091257+0000","last_undegraded":"2024-09-14T11:50:14.091257+0000","last_fullsized":"2024-09-14T11:50:14.091257+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:07.509871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":12817,"num_write":24,"num_write_kb":12817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"264'2","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:38.309929+0000","last_change":"2024-09-14T11:27:38.594325+0000","last_active":"2024-09-14T11:52:38.309929+0000","last_peered":"2024-09-14T11:52:38.309929+0000","last_clean":"2024-09-14T11:52:38.309929+0000","last_became_active":"2024-09-14T11:27:38.593507+0000","last_became_peered":"2024-09-14T11:27:38.593507+0000","last_unstale":"2024-09-14T11:52:38.309929+0000","last_undegraded":"2024-09-14T11:52:38.309929+0000","last_fullsized":"2024-09-14T11:52:38.309929+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:04.519402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"264'31","reported_seq":121,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.290822+0000","last_change":"2024-09-14T11:26:04.281451+0000","last_active":"2024-09-14T11:50:18.290822+0000","last_peered":"2024-09-14T11:50:18.290822+0000","last_clean":"2024-09-14T11:50:18.290822+0000","last_became_active":"2024-09-14T11:26:04.280799+0000","last_became_peered":"2024-09-14T11:26:04.280799+0000","last_unstale":"2024-09-14T11:50:18.290822+0000","last_undegraded":"2024-09-14T11:50:18.290822+0000","last_fullsized":"2024-09-14T11:50:18.290822+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:13.145315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":229,"num_read_kb":151,"num_write":83,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.294155+0000","last_change":"2024-09-14T11:38:50.588826+0000","last_active":"2024-09-14T11:51:23.294155+0000","last_peered":"2024-09-14T11:51:23.294155+0000","last_clean":"2024-09-14T11:51:23.294155+0000","last_became_active":"2024-09-14T11:38:50.588260+0000","last_became_peered":"2024-09-14T11:38:50.588260+0000","last_unstale":"2024-09-14T11:51:23.294155+0000","last_undegraded":"2024-09-14T11:51:23.294155+0000","last_fullsized":"2024-09-14T11:51:23.294155+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:00.597152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"261'2","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.289709+0000","last_change":"2024-09-14T11:27:41.650374+0000","last_active":"2024-09-14T11:50:13.289709+0000","last_peered":"2024-09-14T11:50:13.289709+0000","last_clean":"2024-09-14T11:50:13.289709+0000","last_became_active":"2024-09-14T11:27:41.649448+0000","last_became_peered":"2024-09-14T11:27:41.649448+0000","last_unstale":"2024-09-14T11:50:13.289709+0000","last_undegraded":"2024-09-14T11:50:13.289709+0000","last_fullsized":"2024-09-14T11:50:13.289709+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:46.465272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"264'3","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:38.144322+0000","last_change":"2024-09-14T11:27:38.599731+0000","last_active":"2024-09-14T11:52:38.144322+0000","last_peered":"2024-09-14T11:52:38.144322+0000","last_clean":"2024-09-14T11:52:38.144322+0000","last_became_active":"2024-09-14T11:27:38.598992+0000","last_became_peered":"2024-09-14T11:27:38.598992+0000","last_unstale":"2024-09-14T11:52:38.144322+0000","last_undegraded":"2024-09-14T11:52:38.144322+0000","last_fullsized":"2024-09-14T11:52:38.144322+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:16.033655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"264'245","reported_seq":783,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:44.404892+0000","last_change":"2024-09-14T11:26:04.283762+0000","last_active":"2024-09-14T11:51:44.404892+0000","last_peered":"2024-09-14T11:51:44.404892+0000","last_clean":"2024-09-14T11:51:44.404892+0000","last_became_active":"2024-09-14T11:26:04.283058+0000","last_became_peered":"2024-09-14T11:26:04.283058+0000","last_unstale":"2024-09-14T11:51:44.404892+0000","last_undegraded":"2024-09-14T11:51:44.404892+0000","last_fullsized":"2024-09-14T11:51:44.404892+0000","mapping_epoch":253,"log_start":"261'200","ondisk_log_start":"261'200","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:43.404343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2337,"num_read_kb":3061,"num_write":470,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:33.119635+0000","last_change":"2024-09-14T11:38:50.588284+0000","last_active":"2024-09-14T11:50:33.119635+0000","last_peered":"2024-09-14T11:50:33.119635+0000","last_clean":"2024-09-14T11:50:33.119635+0000","last_became_active":"2024-09-14T11:38:50.587593+0000","last_became_peered":"2024-09-14T11:38:50.587593+0000","last_unstale":"2024-09-14T11:50:33.119635+0000","last_undegraded":"2024-09-14T11:50:33.119635+0000","last_fullsized":"2024-09-14T11:50:33.119635+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:30.104550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"261'2","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.279905+0000","last_change":"2024-09-14T11:27:41.650094+0000","last_active":"2024-09-14T11:49:28.279905+0000","last_peered":"2024-09-14T11:49:28.279905+0000","last_clean":"2024-09-14T11:49:28.279905+0000","last_became_active":"2024-09-14T11:27:41.649297+0000","last_became_peered":"2024-09-14T11:27:41.649297+0000","last_unstale":"2024-09-14T11:49:28.279905+0000","last_undegraded":"2024-09-14T11:49:28.279905+0000","last_fullsized":"2024-09-14T11:49:28.279905+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:37.683430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"261'3","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:04.321677+0000","last_change":"2024-09-14T11:27:38.608702+0000","last_active":"2024-09-14T11:51:04.321677+0000","last_peered":"2024-09-14T11:51:04.321677+0000","last_clean":"2024-09-14T11:51:04.321677+0000","last_became_active":"2024-09-14T11:27:38.607929+0000","last_became_peered":"2024-09-14T11:27:38.607929+0000","last_unstale":"2024-09-14T11:51:04.321677+0000","last_undegraded":"2024-09-14T11:51:04.321677+0000","last_fullsized":"2024-09-14T11:51:04.321677+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:02.938378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"264'16","reported_seq":85,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.111235+0000","last_change":"2024-09-14T11:26:04.262715+0000","last_active":"2024-09-14T11:50:18.111235+0000","last_peered":"2024-09-14T11:50:18.111235+0000","last_clean":"2024-09-14T11:50:18.111235+0000","last_became_active":"2024-09-14T11:26:04.261101+0000","last_became_peered":"2024-09-14T11:26:04.261101+0000","last_unstale":"2024-09-14T11:50:18.111235+0000","last_undegraded":"2024-09-14T11:50:18.111235+0000","last_fullsized":"2024-09-14T11:50:18.111235+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:32.177932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":70,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:33.116264+0000","last_change":"2024-09-14T11:38:50.566716+0000","last_active":"2024-09-14T11:50:33.116264+0000","last_peered":"2024-09-14T11:50:33.116264+0000","last_clean":"2024-09-14T11:50:33.116264+0000","last_became_active":"2024-09-14T11:38:50.565980+0000","last_became_peered":"2024-09-14T11:38:50.565980+0000","last_unstale":"2024-09-14T11:50:33.116264+0000","last_undegraded":"2024-09-14T11:50:33.116264+0000","last_fullsized":"2024-09-14T11:50:33.116264+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:42.634974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"264'5","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:28.159762+0000","last_change":"2024-09-14T11:27:41.660949+0000","last_active":"2024-09-14T11:53:28.159762+0000","last_peered":"2024-09-14T11:53:28.159762+0000","last_clean":"2024-09-14T11:53:28.159762+0000","last_became_active":"2024-09-14T11:27:41.660264+0000","last_became_peered":"2024-09-14T11:27:41.660264+0000","last_unstale":"2024-09-14T11:53:28.159762+0000","last_undegraded":"2024-09-14T11:53:28.159762+0000","last_fullsized":"2024-09-14T11:53:28.159762+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:36.720927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"261'4","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.268176+0000","last_change":"2024-09-14T11:27:38.596650+0000","last_active":"2024-09-14T11:49:23.268176+0000","last_peered":"2024-09-14T11:49:23.268176+0000","last_clean":"2024-09-14T11:49:23.268176+0000","last_became_active":"2024-09-14T11:27:38.595788+0000","last_became_peered":"2024-09-14T11:27:38.595788+0000","last_unstale":"2024-09-14T11:49:23.268176+0000","last_undegraded":"2024-09-14T11:49:23.268176+0000","last_fullsized":"2024-09-14T11:49:23.268176+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:09.671865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"264'35","reported_seq":135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.111154+0000","last_change":"2024-09-14T11:26:04.283254+0000","last_active":"2024-09-14T11:50:18.111154+0000","last_peered":"2024-09-14T11:50:18.111154+0000","last_clean":"2024-09-14T11:50:18.111154+0000","last_became_active":"2024-09-14T11:26:04.279281+0000","last_became_peered":"2024-09-14T11:26:04.279281+0000","last_unstale":"2024-09-14T11:50:18.111154+0000","last_undegraded":"2024-09-14T11:50:18.111154+0000","last_fullsized":"2024-09-14T11:50:18.111154+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:14.087866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":194,"num_write":86,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:34.095673+0000","last_change":"2024-09-14T11:38:50.574673+0000","last_active":"2024-09-14T11:50:34.095673+0000","last_peered":"2024-09-14T11:50:34.095673+0000","last_clean":"2024-09-14T11:50:34.095673+0000","last_became_active":"2024-09-14T11:38:50.573912+0000","last_became_peered":"2024-09-14T11:38:50.573912+0000","last_unstale":"2024-09-14T11:50:34.095673+0000","last_undegraded":"2024-09-14T11:50:34.095673+0000","last_fullsized":"2024-09-14T11:50:34.095673+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:20.437626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"264'10","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.368446+0000","last_change":"2024-09-14T11:27:41.633217+0000","last_active":"2024-09-14T11:53:57.368446+0000","last_peered":"2024-09-14T11:53:57.368446+0000","last_clean":"2024-09-14T11:53:57.368446+0000","last_became_active":"2024-09-14T11:27:41.632456+0000","last_became_peered":"2024-09-14T11:27:41.632456+0000","last_unstale":"2024-09-14T11:53:57.368446+0000","last_undegraded":"2024-09-14T11:53:57.368446+0000","last_fullsized":"2024-09-14T11:53:57.368446+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:59.393656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15362,"num_write":10,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"261'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.278697+0000","last_change":"2024-09-14T11:27:38.617576+0000","last_active":"2024-09-14T11:49:23.278697+0000","last_peered":"2024-09-14T11:49:23.278697+0000","last_clean":"2024-09-14T11:49:23.278697+0000","last_became_active":"2024-09-14T11:27:38.616935+0000","last_became_peered":"2024-09-14T11:27:38.616935+0000","last_unstale":"2024-09-14T11:49:23.278697+0000","last_undegraded":"2024-09-14T11:49:23.278697+0000","last_fullsized":"2024-09-14T11:49:23.278697+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:02.566121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"264'38","reported_seq":144,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.290967+0000","last_change":"2024-09-14T11:26:04.268951+0000","last_active":"2024-09-14T11:50:18.290967+0000","last_peered":"2024-09-14T11:50:18.290967+0000","last_clean":"2024-09-14T11:50:18.290967+0000","last_became_active":"2024-09-14T11:26:04.268202+0000","last_became_peered":"2024-09-14T11:26:04.268202+0000","last_unstale":"2024-09-14T11:50:18.290967+0000","last_undegraded":"2024-09-14T11:50:18.290967+0000","last_fullsized":"2024-09-14T11:50:18.290967+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:01.258492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":294,"num_read_kb":198,"num_write":96,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:33.283228+0000","last_change":"2024-09-14T11:38:50.586123+0000","last_active":"2024-09-14T11:50:33.283228+0000","last_peered":"2024-09-14T11:50:33.283228+0000","last_clean":"2024-09-14T11:50:33.283228+0000","last_became_active":"2024-09-14T11:38:50.585324+0000","last_became_peered":"2024-09-14T11:38:50.585324+0000","last_unstale":"2024-09-14T11:50:33.283228+0000","last_undegraded":"2024-09-14T11:50:33.283228+0000","last_fullsized":"2024-09-14T11:50:33.283228+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:21.296327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"264'6","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.366802+0000","last_change":"2024-09-14T11:27:41.653603+0000","last_active":"2024-09-14T11:53:57.366802+0000","last_peered":"2024-09-14T11:53:57.366802+0000","last_clean":"2024-09-14T11:53:57.366802+0000","last_became_active":"2024-09-14T11:27:41.652940+0000","last_became_peered":"2024-09-14T11:27:41.652940+0000","last_unstale":"2024-09-14T11:53:57.366802+0000","last_undegraded":"2024-09-14T11:53:57.366802+0000","last_fullsized":"2024-09-14T11:53:57.366802+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:52.835060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10244,"num_write":6,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"261'5","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.103799+0000","last_change":"2024-09-14T11:27:38.603632+0000","last_active":"2024-09-14T11:49:23.103799+0000","last_peered":"2024-09-14T11:49:23.103799+0000","last_clean":"2024-09-14T11:49:23.103799+0000","last_became_active":"2024-09-14T11:27:38.603013+0000","last_became_peered":"2024-09-14T11:27:38.603013+0000","last_unstale":"2024-09-14T11:49:23.103799+0000","last_undegraded":"2024-09-14T11:49:23.103799+0000","last_fullsized":"2024-09-14T11:49:23.103799+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:31.898272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:29.296282+0000","last_change":"2024-09-14T11:26:04.263990+0000","last_active":"2024-09-14T11:49:29.296282+0000","last_peered":"2024-09-14T11:49:29.296282+0000","last_clean":"2024-09-14T11:49:29.296282+0000","last_became_active":"2024-09-14T11:26:04.263245+0000","last_became_peered":"2024-09-14T11:26:04.263245+0000","last_unstale":"2024-09-14T11:49:29.296282+0000","last_undegraded":"2024-09-14T11:49:29.296282+0000","last_fullsized":"2024-09-14T11:49:29.296282+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:32.096751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.125221+0000","last_change":"2024-09-14T11:38:50.591827+0000","last_active":"2024-09-14T11:50:58.125221+0000","last_peered":"2024-09-14T11:50:58.125221+0000","last_clean":"2024-09-14T11:50:58.125221+0000","last_became_active":"2024-09-14T11:38:50.591033+0000","last_became_peered":"2024-09-14T11:38:50.591033+0000","last_unstale":"2024-09-14T11:50:58.125221+0000","last_undegraded":"2024-09-14T11:50:58.125221+0000","last_fullsized":"2024-09-14T11:50:58.125221+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:09.654882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"264'2","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:23.158433+0000","last_change":"2024-09-14T11:27:41.645102+0000","last_active":"2024-09-14T11:53:23.158433+0000","last_peered":"2024-09-14T11:53:23.158433+0000","last_clean":"2024-09-14T11:53:23.158433+0000","last_became_active":"2024-09-14T11:27:41.634584+0000","last_became_peered":"2024-09-14T11:27:41.634584+0000","last_unstale":"2024-09-14T11:53:23.158433+0000","last_undegraded":"2024-09-14T11:53:23.158433+0000","last_fullsized":"2024-09-14T11:53:23.158433+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:33.590598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.271195+0000","last_change":"2024-09-14T11:27:38.612360+0000","last_active":"2024-09-14T11:50:58.271195+0000","last_peered":"2024-09-14T11:50:58.271195+0000","last_clean":"2024-09-14T11:50:58.271195+0000","last_became_active":"2024-09-14T11:27:38.611912+0000","last_became_peered":"2024-09-14T11:27:38.611912+0000","last_unstale":"2024-09-14T11:50:58.271195+0000","last_undegraded":"2024-09-14T11:50:58.271195+0000","last_fullsized":"2024-09-14T11:50:58.271195+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:31.632951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"264'32","reported_seq":134,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.294532+0000","last_change":"2024-09-14T11:26:04.264797+0000","last_active":"2024-09-14T11:49:24.294532+0000","last_peered":"2024-09-14T11:49:24.294532+0000","last_clean":"2024-09-14T11:49:24.294532+0000","last_became_active":"2024-09-14T11:26:04.264179+0000","last_became_peered":"2024-09-14T11:26:04.264179+0000","last_unstale":"2024-09-14T11:49:24.294532+0000","last_undegraded":"2024-09-14T11:49:24.294532+0000","last_fullsized":"2024-09-14T11:49:24.294532+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:19.434829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":260,"num_read_kb":165,"num_write":79,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.122121+0000","last_change":"2024-09-14T11:38:50.553543+0000","last_active":"2024-09-14T11:50:58.122121+0000","last_peered":"2024-09-14T11:50:58.122121+0000","last_clean":"2024-09-14T11:50:58.122121+0000","last_became_active":"2024-09-14T11:38:50.552891+0000","last_became_peered":"2024-09-14T11:38:50.552891+0000","last_unstale":"2024-09-14T11:50:58.122121+0000","last_undegraded":"2024-09-14T11:50:58.122121+0000","last_fullsized":"2024-09-14T11:50:58.122121+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:10.586101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"261'4","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.126156+0000","last_change":"2024-09-14T11:27:41.643791+0000","last_active":"2024-09-14T11:51:03.126156+0000","last_peered":"2024-09-14T11:51:03.126156+0000","last_clean":"2024-09-14T11:51:03.126156+0000","last_became_active":"2024-09-14T11:27:41.634824+0000","last_became_peered":"2024-09-14T11:27:41.634824+0000","last_unstale":"2024-09-14T11:51:03.126156+0000","last_undegraded":"2024-09-14T11:51:03.126156+0000","last_fullsized":"2024-09-14T11:51:03.126156+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:45.655086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:18.157188+0000","last_change":"2024-09-14T11:27:38.609347+0000","last_active":"2024-09-14T11:53:18.157188+0000","last_peered":"2024-09-14T11:53:18.157188+0000","last_clean":"2024-09-14T11:53:18.157188+0000","last_became_active":"2024-09-14T11:27:38.608412+0000","last_became_peered":"2024-09-14T11:27:38.608412+0000","last_unstale":"2024-09-14T11:53:18.157188+0000","last_undegraded":"2024-09-14T11:53:18.157188+0000","last_fullsized":"2024-09-14T11:53:18.157188+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:24.685660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"264'44","reported_seq":157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:39.785907+0000","last_change":"2024-09-14T11:26:04.272788+0000","last_active":"2024-09-14T11:51:39.785907+0000","last_peered":"2024-09-14T11:51:39.785907+0000","last_clean":"2024-09-14T11:51:39.785907+0000","last_became_active":"2024-09-14T11:26:04.272026+0000","last_became_peered":"2024-09-14T11:26:04.272026+0000","last_unstale":"2024-09-14T11:51:39.785907+0000","last_undegraded":"2024-09-14T11:51:39.785907+0000","last_fullsized":"2024-09-14T11:51:39.785907+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:03.282735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":232,"num_write":112,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.115743+0000","last_change":"2024-09-14T11:38:50.576604+0000","last_active":"2024-09-14T11:50:38.115743+0000","last_peered":"2024-09-14T11:50:38.115743+0000","last_clean":"2024-09-14T11:50:38.115743+0000","last_became_active":"2024-09-14T11:38:50.575796+0000","last_became_peered":"2024-09-14T11:38:50.575796+0000","last_unstale":"2024-09-14T11:50:38.115743+0000","last_undegraded":"2024-09-14T11:50:38.115743+0000","last_fullsized":"2024-09-14T11:50:38.115743+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:03.217316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"264'5","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:23.340671+0000","last_change":"2024-09-14T11:27:41.635521+0000","last_active":"2024-09-14T11:53:23.340671+0000","last_peered":"2024-09-14T11:53:23.340671+0000","last_clean":"2024-09-14T11:53:23.340671+0000","last_became_active":"2024-09-14T11:27:41.634402+0000","last_became_peered":"2024-09-14T11:27:41.634402+0000","last_unstale":"2024-09-14T11:53:23.340671+0000","last_undegraded":"2024-09-14T11:53:23.340671+0000","last_fullsized":"2024-09-14T11:53:23.340671+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:27.030127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.271311+0000","last_change":"2024-09-14T11:27:38.610277+0000","last_active":"2024-09-14T11:50:58.271311+0000","last_peered":"2024-09-14T11:50:58.271311+0000","last_clean":"2024-09-14T11:50:58.271311+0000","last_became_active":"2024-09-14T11:27:38.609363+0000","last_became_peered":"2024-09-14T11:27:38.609363+0000","last_unstale":"2024-09-14T11:50:58.271311+0000","last_undegraded":"2024-09-14T11:50:58.271311+0000","last_fullsized":"2024-09-14T11:50:58.271311+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:44.061754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"264'17","reported_seq":87,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.079749+0000","last_change":"2024-09-14T11:26:04.262270+0000","last_active":"2024-09-14T11:49:24.079749+0000","last_peered":"2024-09-14T11:49:24.079749+0000","last_clean":"2024-09-14T11:49:24.079749+0000","last_became_active":"2024-09-14T11:26:04.261498+0000","last_became_peered":"2024-09-14T11:26:04.261498+0000","last_unstale":"2024-09-14T11:49:24.079749+0000","last_undegraded":"2024-09-14T11:49:24.079749+0000","last_fullsized":"2024-09-14T11:49:24.079749+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:31.069079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":93,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.122005+0000","last_change":"2024-09-14T11:38:50.576965+0000","last_active":"2024-09-14T11:50:58.122005+0000","last_peered":"2024-09-14T11:50:58.122005+0000","last_clean":"2024-09-14T11:50:58.122005+0000","last_became_active":"2024-09-14T11:38:50.576165+0000","last_became_peered":"2024-09-14T11:38:50.576165+0000","last_unstale":"2024-09-14T11:50:58.122005+0000","last_undegraded":"2024-09-14T11:50:58.122005+0000","last_fullsized":"2024-09-14T11:50:58.122005+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:25.583158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"264'1","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:04.321580+0000","last_change":"2024-09-14T11:27:41.650299+0000","last_active":"2024-09-14T11:51:04.321580+0000","last_peered":"2024-09-14T11:51:04.321580+0000","last_clean":"2024-09-14T11:51:04.321580+0000","last_became_active":"2024-09-14T11:27:41.649598+0000","last_became_peered":"2024-09-14T11:27:41.649598+0000","last_unstale":"2024-09-14T11:51:04.321580+0000","last_undegraded":"2024-09-14T11:51:04.321580+0000","last_fullsized":"2024-09-14T11:51:04.321580+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:10.114521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.271350+0000","last_change":"2024-09-14T11:27:38.599118+0000","last_active":"2024-09-14T11:50:58.271350+0000","last_peered":"2024-09-14T11:50:58.271350+0000","last_clean":"2024-09-14T11:50:58.271350+0000","last_became_active":"2024-09-14T11:27:38.598429+0000","last_became_peered":"2024-09-14T11:27:38.598429+0000","last_unstale":"2024-09-14T11:50:58.271350+0000","last_undegraded":"2024-09-14T11:50:58.271350+0000","last_fullsized":"2024-09-14T11:50:58.271350+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:20.260448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"264'26","reported_seq":114,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.279763+0000","last_change":"2024-09-14T11:26:04.272989+0000","last_active":"2024-09-14T11:49:28.279763+0000","last_peered":"2024-09-14T11:49:28.279763+0000","last_clean":"2024-09-14T11:49:28.279763+0000","last_became_active":"2024-09-14T11:26:04.272216+0000","last_became_peered":"2024-09-14T11:26:04.272216+0000","last_unstale":"2024-09-14T11:49:28.279763+0000","last_undegraded":"2024-09-14T11:49:28.279763+0000","last_fullsized":"2024-09-14T11:49:28.279763+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:52.021930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":141,"num_write":65,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.109357+0000","last_change":"2024-09-14T11:38:50.589752+0000","last_active":"2024-09-14T11:49:48.109357+0000","last_peered":"2024-09-14T11:49:48.109357+0000","last_clean":"2024-09-14T11:49:48.109357+0000","last_became_active":"2024-09-14T11:38:50.589121+0000","last_became_peered":"2024-09-14T11:38:50.589121+0000","last_unstale":"2024-09-14T11:49:48.109357+0000","last_undegraded":"2024-09-14T11:49:48.109357+0000","last_fullsized":"2024-09-14T11:49:48.109357+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:46.246907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"261'4","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.289832+0000","last_change":"2024-09-14T11:27:41.631708+0000","last_active":"2024-09-14T11:50:13.289832+0000","last_peered":"2024-09-14T11:50:13.289832+0000","last_clean":"2024-09-14T11:50:13.289832+0000","last_became_active":"2024-09-14T11:27:41.630970+0000","last_became_peered":"2024-09-14T11:27:41.630970+0000","last_unstale":"2024-09-14T11:50:13.289832+0000","last_undegraded":"2024-09-14T11:50:13.289832+0000","last_fullsized":"2024-09-14T11:50:13.289832+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:10.321213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:09.090171+0000","last_change":"2024-09-14T11:27:38.598988+0000","last_active":"2024-09-14T11:50:09.090171+0000","last_peered":"2024-09-14T11:50:09.090171+0000","last_clean":"2024-09-14T11:50:09.090171+0000","last_became_active":"2024-09-14T11:27:38.580979+0000","last_became_peered":"2024-09-14T11:27:38.580979+0000","last_unstale":"2024-09-14T11:50:09.090171+0000","last_undegraded":"2024-09-14T11:50:09.090171+0000","last_fullsized":"2024-09-14T11:50:09.090171+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:07.399468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"261'22","reported_seq":106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.298654+0000","last_change":"2024-09-14T11:26:04.275780+0000","last_active":"2024-09-14T11:50:53.298654+0000","last_peered":"2024-09-14T11:50:53.298654+0000","last_clean":"2024-09-14T11:50:53.298654+0000","last_became_active":"2024-09-14T11:26:04.275034+0000","last_became_peered":"2024-09-14T11:26:04.275034+0000","last_unstale":"2024-09-14T11:50:53.298654+0000","last_undegraded":"2024-09-14T11:50:53.298654+0000","last_fullsized":"2024-09-14T11:50:53.298654+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:53.668220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":117,"num_write":55,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.260860+0000","last_change":"2024-09-14T11:38:50.596985+0000","last_active":"2024-09-14T11:50:08.260860+0000","last_peered":"2024-09-14T11:50:08.260860+0000","last_clean":"2024-09-14T11:50:08.260860+0000","last_became_active":"2024-09-14T11:38:50.596395+0000","last_became_peered":"2024-09-14T11:38:50.596395+0000","last_unstale":"2024-09-14T11:50:08.260860+0000","last_undegraded":"2024-09-14T11:50:08.260860+0000","last_fullsized":"2024-09-14T11:50:08.260860+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:15.646487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"264'4","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.252289+0000","last_change":"2024-09-14T11:27:41.657302+0000","last_active":"2024-09-14T11:53:57.252289+0000","last_peered":"2024-09-14T11:53:57.252289+0000","last_clean":"2024-09-14T11:53:57.252289+0000","last_became_active":"2024-09-14T11:27:41.656659+0000","last_became_peered":"2024-09-14T11:27:41.656659+0000","last_unstale":"2024-09-14T11:53:57.252289+0000","last_undegraded":"2024-09-14T11:53:57.252289+0000","last_fullsized":"2024-09-14T11:53:57.252289+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:57.077639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":100,"num_write":4,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.110964+0000","last_change":"2024-09-14T11:27:38.605497+0000","last_active":"2024-09-14T11:50:08.110964+0000","last_peered":"2024-09-14T11:50:08.110964+0000","last_clean":"2024-09-14T11:50:08.110964+0000","last_became_active":"2024-09-14T11:27:38.604732+0000","last_became_peered":"2024-09-14T11:27:38.604732+0000","last_unstale":"2024-09-14T11:50:08.110964+0000","last_undegraded":"2024-09-14T11:50:08.110964+0000","last_fullsized":"2024-09-14T11:50:08.110964+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:10.544829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"264'35","reported_seq":134,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:49.317370+0000","last_change":"2024-09-14T11:26:04.280000+0000","last_active":"2024-09-14T11:50:49.317370+0000","last_peered":"2024-09-14T11:50:49.317370+0000","last_clean":"2024-09-14T11:50:49.317370+0000","last_became_active":"2024-09-14T11:26:04.279402+0000","last_became_peered":"2024-09-14T11:26:04.279402+0000","last_unstale":"2024-09-14T11:50:49.317370+0000","last_undegraded":"2024-09-14T11:50:49.317370+0000","last_fullsized":"2024-09-14T11:50:49.317370+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:08.691450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":174,"num_write":94,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:44.299867+0000","last_change":"2024-09-14T11:38:50.573603+0000","last_active":"2024-09-14T11:49:44.299867+0000","last_peered":"2024-09-14T11:49:44.299867+0000","last_clean":"2024-09-14T11:49:44.299867+0000","last_became_active":"2024-09-14T11:38:50.573062+0000","last_became_peered":"2024-09-14T11:38:50.573062+0000","last_unstale":"2024-09-14T11:49:44.299867+0000","last_undegraded":"2024-09-14T11:49:44.299867+0000","last_fullsized":"2024-09-14T11:49:44.299867+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:58.483156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"264'7","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:28.328447+0000","last_change":"2024-09-14T11:27:41.639765+0000","last_active":"2024-09-14T11:52:28.328447+0000","last_peered":"2024-09-14T11:52:28.328447+0000","last_clean":"2024-09-14T11:52:28.328447+0000","last_became_active":"2024-09-14T11:27:41.639051+0000","last_became_peered":"2024-09-14T11:27:41.639051+0000","last_unstale":"2024-09-14T11:52:28.328447+0000","last_undegraded":"2024-09-14T11:52:28.328447+0000","last_fullsized":"2024-09-14T11:52:28.328447+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:41.947643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"264'4","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:23.327205+0000","last_change":"2024-09-14T11:27:38.620255+0000","last_active":"2024-09-14T11:52:23.327205+0000","last_peered":"2024-09-14T11:52:23.327205+0000","last_clean":"2024-09-14T11:52:23.327205+0000","last_became_active":"2024-09-14T11:27:38.619608+0000","last_became_peered":"2024-09-14T11:27:38.619608+0000","last_unstale":"2024-09-14T11:52:23.327205+0000","last_undegraded":"2024-09-14T11:52:23.327205+0000","last_fullsized":"2024-09-14T11:52:23.327205+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:13.155452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"264'28","reported_seq":116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.270192+0000","last_change":"2024-09-14T11:26:04.273757+0000","last_active":"2024-09-14T11:50:53.270192+0000","last_peered":"2024-09-14T11:50:53.270192+0000","last_clean":"2024-09-14T11:50:53.270192+0000","last_became_active":"2024-09-14T11:26:04.272960+0000","last_became_peered":"2024-09-14T11:26:04.272960+0000","last_unstale":"2024-09-14T11:50:53.270192+0000","last_undegraded":"2024-09-14T11:50:53.270192+0000","last_fullsized":"2024-09-14T11:50:53.270192+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:56.581662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":136,"num_write":79,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:43.255430+0000","last_change":"2024-09-14T11:38:50.570309+0000","last_active":"2024-09-14T11:49:43.255430+0000","last_peered":"2024-09-14T11:49:43.255430+0000","last_clean":"2024-09-14T11:49:43.255430+0000","last_became_active":"2024-09-14T11:38:50.569743+0000","last_became_peered":"2024-09-14T11:38:50.569743+0000","last_unstale":"2024-09-14T11:49:43.255430+0000","last_undegraded":"2024-09-14T11:49:43.255430+0000","last_fullsized":"2024-09-14T11:49:43.255430+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:37.993575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"264'5","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.469969+0000","last_change":"2024-09-14T11:27:41.654827+0000","last_active":"2024-09-14T11:53:57.469969+0000","last_peered":"2024-09-14T11:53:57.469969+0000","last_clean":"2024-09-14T11:53:57.469969+0000","last_became_active":"2024-09-14T11:27:41.653929+0000","last_became_peered":"2024-09-14T11:27:41.653929+0000","last_unstale":"2024-09-14T11:53:57.469969+0000","last_undegraded":"2024-09-14T11:53:57.469969+0000","last_fullsized":"2024-09-14T11:53:57.469969+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:11.356458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":118,"num_write":10,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"264'9","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.452762+0000","last_change":"2024-09-14T11:27:38.620107+0000","last_active":"2024-09-14T11:53:57.452762+0000","last_peered":"2024-09-14T11:53:57.452762+0000","last_clean":"2024-09-14T11:53:57.452762+0000","last_became_active":"2024-09-14T11:27:38.619441+0000","last_became_peered":"2024-09-14T11:27:38.619441+0000","last_unstale":"2024-09-14T11:53:57.452762+0000","last_undegraded":"2024-09-14T11:53:57.452762+0000","last_fullsized":"2024-09-14T11:53:57.452762+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:37.692951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":21504,"num_write":14,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"264'28","reported_seq":115,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.120811+0000","last_change":"2024-09-14T11:26:04.272552+0000","last_active":"2024-09-14T11:50:53.120811+0000","last_peered":"2024-09-14T11:50:53.120811+0000","last_clean":"2024-09-14T11:50:53.120811+0000","last_became_active":"2024-09-14T11:26:04.271747+0000","last_became_peered":"2024-09-14T11:26:04.271747+0000","last_unstale":"2024-09-14T11:50:53.120811+0000","last_undegraded":"2024-09-14T11:50:53.120811+0000","last_fullsized":"2024-09-14T11:50:53.120811+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:55.732123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":132,"num_write":73,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.113971+0000","last_change":"2024-09-14T11:38:50.590185+0000","last_active":"2024-09-14T11:50:08.113971+0000","last_peered":"2024-09-14T11:50:08.113971+0000","last_clean":"2024-09-14T11:50:08.113971+0000","last_became_active":"2024-09-14T11:38:50.589444+0000","last_became_peered":"2024-09-14T11:38:50.589444+0000","last_unstale":"2024-09-14T11:50:08.113971+0000","last_undegraded":"2024-09-14T11:50:08.113971+0000","last_fullsized":"2024-09-14T11:50:08.113971+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:57.453301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"261'2","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:34.329581+0000","last_change":"2024-09-14T11:27:41.641002+0000","last_active":"2024-09-14T11:51:34.329581+0000","last_peered":"2024-09-14T11:51:34.329581+0000","last_clean":"2024-09-14T11:51:34.329581+0000","last_became_active":"2024-09-14T11:27:41.640105+0000","last_became_peered":"2024-09-14T11:27:41.640105+0000","last_unstale":"2024-09-14T11:51:34.329581+0000","last_undegraded":"2024-09-14T11:51:34.329581+0000","last_fullsized":"2024-09-14T11:51:34.329581+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:12.987982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"264'11","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:38.343675+0000","last_change":"2024-09-14T11:27:38.613505+0000","last_active":"2024-09-14T11:53:38.343675+0000","last_peered":"2024-09-14T11:53:38.343675+0000","last_clean":"2024-09-14T11:53:38.343675+0000","last_became_active":"2024-09-14T11:27:38.612745+0000","last_became_peered":"2024-09-14T11:27:38.612745+0000","last_unstale":"2024-09-14T11:53:38.343675+0000","last_undegraded":"2024-09-14T11:53:38.343675+0000","last_fullsized":"2024-09-14T11:53:38.343675+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:41.780008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6207,"num_write":16,"num_write_kb":2107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"264'45","reported_seq":170,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.120656+0000","last_change":"2024-09-14T11:26:04.277466+0000","last_active":"2024-09-14T11:50:53.120656+0000","last_peered":"2024-09-14T11:50:53.120656+0000","last_clean":"2024-09-14T11:50:53.120656+0000","last_became_active":"2024-09-14T11:26:04.273309+0000","last_became_peered":"2024-09-14T11:26:04.273309+0000","last_unstale":"2024-09-14T11:50:53.120656+0000","last_undegraded":"2024-09-14T11:50:53.120656+0000","last_fullsized":"2024-09-14T11:50:53.120656+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:24.875502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":376,"num_read_kb":242,"num_write":121,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.091371+0000","last_change":"2024-09-14T11:38:50.597053+0000","last_active":"2024-09-14T11:50:14.091371+0000","last_peered":"2024-09-14T11:50:14.091371+0000","last_clean":"2024-09-14T11:50:14.091371+0000","last_became_active":"2024-09-14T11:38:50.596495+0000","last_became_peered":"2024-09-14T11:38:50.596495+0000","last_unstale":"2024-09-14T11:50:14.091371+0000","last_undegraded":"2024-09-14T11:50:14.091371+0000","last_fullsized":"2024-09-14T11:50:14.091371+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:54.445153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"264'3","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:34.110109+0000","last_change":"2024-09-14T11:27:41.650790+0000","last_active":"2024-09-14T11:51:34.110109+0000","last_peered":"2024-09-14T11:51:34.110109+0000","last_clean":"2024-09-14T11:51:34.110109+0000","last_became_active":"2024-09-14T11:27:41.650311+0000","last_became_peered":"2024-09-14T11:27:41.650311+0000","last_unstale":"2024-09-14T11:51:34.110109+0000","last_undegraded":"2024-09-14T11:51:34.110109+0000","last_fullsized":"2024-09-14T11:51:34.110109+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:02.760791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"264'8","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.174095+0000","last_change":"2024-09-14T11:27:38.600875+0000","last_active":"2024-09-14T11:53:57.174095+0000","last_peered":"2024-09-14T11:53:57.174095+0000","last_clean":"2024-09-14T11:53:57.174095+0000","last_became_active":"2024-09-14T11:27:38.600043+0000","last_became_peered":"2024-09-14T11:27:38.600043+0000","last_unstale":"2024-09-14T11:53:57.174095+0000","last_undegraded":"2024-09-14T11:53:57.174095+0000","last_fullsized":"2024-09-14T11:53:57.174095+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:38.547858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":7170,"num_write":8,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"264'31","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:21.529004+0000","last_change":"2024-09-14T11:26:04.274470+0000","last_active":"2024-09-14T11:50:21.529004+0000","last_peered":"2024-09-14T11:50:21.529004+0000","last_clean":"2024-09-14T11:50:21.529004+0000","last_became_active":"2024-09-14T11:26:04.274089+0000","last_became_peered":"2024-09-14T11:26:04.274089+0000","last_unstale":"2024-09-14T11:50:21.529004+0000","last_undegraded":"2024-09-14T11:50:21.529004+0000","last_fullsized":"2024-09-14T11:50:21.529004+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:02.147109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":254,"num_read_kb":164,"num_write":92,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.277870+0000","last_change":"2024-09-14T11:38:50.593374+0000","last_active":"2024-09-14T11:50:08.277870+0000","last_peered":"2024-09-14T11:50:08.277870+0000","last_clean":"2024-09-14T11:50:08.277870+0000","last_became_active":"2024-09-14T11:38:50.592765+0000","last_became_peered":"2024-09-14T11:38:50.592765+0000","last_unstale":"2024-09-14T11:50:08.277870+0000","last_undegraded":"2024-09-14T11:50:08.277870+0000","last_fullsized":"2024-09-14T11:50:08.277870+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:12.739637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"261'2","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.111954+0000","last_change":"2024-09-14T11:27:41.647748+0000","last_active":"2024-09-14T11:50:13.111954+0000","last_peered":"2024-09-14T11:50:13.111954+0000","last_clean":"2024-09-14T11:50:13.111954+0000","last_became_active":"2024-09-14T11:27:41.646962+0000","last_became_peered":"2024-09-14T11:27:41.646962+0000","last_unstale":"2024-09-14T11:50:13.111954+0000","last_undegraded":"2024-09-14T11:50:13.111954+0000","last_fullsized":"2024-09-14T11:50:13.111954+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:41.449801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:28.311711+0000","last_change":"2024-09-14T11:27:38.616699+0000","last_active":"2024-09-14T11:51:28.311711+0000","last_peered":"2024-09-14T11:51:28.311711+0000","last_clean":"2024-09-14T11:51:28.311711+0000","last_became_active":"2024-09-14T11:27:38.612131+0000","last_became_peered":"2024-09-14T11:27:38.612131+0000","last_unstale":"2024-09-14T11:51:28.311711+0000","last_undegraded":"2024-09-14T11:51:28.311711+0000","last_fullsized":"2024-09-14T11:51:28.311711+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:28.127453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"264'14","reported_seq":79,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:58.111733+0000","last_change":"2024-09-14T11:26:04.259922+0000","last_active":"2024-09-14T11:49:58.111733+0000","last_peered":"2024-09-14T11:49:58.111733+0000","last_clean":"2024-09-14T11:49:58.111733+0000","last_became_active":"2024-09-14T11:26:04.258976+0000","last_became_peered":"2024-09-14T11:26:04.258976+0000","last_unstale":"2024-09-14T11:49:58.111733+0000","last_undegraded":"2024-09-14T11:49:58.111733+0000","last_fullsized":"2024-09-14T11:49:58.111733+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:45.204426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":72,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.288544+0000","last_change":"2024-09-14T11:38:50.594382+0000","last_active":"2024-09-14T11:50:08.288544+0000","last_peered":"2024-09-14T11:50:08.288544+0000","last_clean":"2024-09-14T11:50:08.288544+0000","last_became_active":"2024-09-14T11:38:50.593641+0000","last_became_peered":"2024-09-14T11:38:50.593641+0000","last_unstale":"2024-09-14T11:50:08.288544+0000","last_undegraded":"2024-09-14T11:50:08.288544+0000","last_fullsized":"2024-09-14T11:50:08.288544+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:19.832637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"261'7","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:33.296159+0000","last_change":"2024-09-14T11:27:41.657817+0000","last_active":"2024-09-14T11:51:33.296159+0000","last_peered":"2024-09-14T11:51:33.296159+0000","last_clean":"2024-09-14T11:51:33.296159+0000","last_became_active":"2024-09-14T11:27:41.657112+0000","last_became_peered":"2024-09-14T11:27:41.657112+0000","last_unstale":"2024-09-14T11:51:33.296159+0000","last_undegraded":"2024-09-14T11:51:33.296159+0000","last_fullsized":"2024-09-14T11:51:33.296159+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:00.412523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":6146,"num_write":12,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"264'2","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:09.306261+0000","last_change":"2024-09-14T11:27:38.605512+0000","last_active":"2024-09-14T11:50:09.306261+0000","last_peered":"2024-09-14T11:50:09.306261+0000","last_clean":"2024-09-14T11:50:09.306261+0000","last_became_active":"2024-09-14T11:27:38.602864+0000","last_became_peered":"2024-09-14T11:27:38.602864+0000","last_unstale":"2024-09-14T11:50:09.306261+0000","last_undegraded":"2024-09-14T11:50:09.306261+0000","last_fullsized":"2024-09-14T11:50:09.306261+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:31.418858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"264'39","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:58.275660+0000","last_change":"2024-09-14T11:26:04.272287+0000","last_active":"2024-09-14T11:49:58.275660+0000","last_peered":"2024-09-14T11:49:58.275660+0000","last_clean":"2024-09-14T11:49:58.275660+0000","last_became_active":"2024-09-14T11:26:04.271893+0000","last_became_peered":"2024-09-14T11:26:04.271893+0000","last_unstale":"2024-09-14T11:49:58.275660+0000","last_undegraded":"2024-09-14T11:49:58.275660+0000","last_fullsized":"2024-09-14T11:49:58.275660+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:19.118538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":319,"num_read_kb":212,"num_write":95,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.294000+0000","last_change":"2024-09-14T11:38:50.589623+0000","last_active":"2024-09-14T11:51:23.294000+0000","last_peered":"2024-09-14T11:51:23.294000+0000","last_clean":"2024-09-14T11:51:23.294000+0000","last_became_active":"2024-09-14T11:38:50.587827+0000","last_became_peered":"2024-09-14T11:38:50.587827+0000","last_unstale":"2024-09-14T11:51:23.294000+0000","last_undegraded":"2024-09-14T11:51:23.294000+0000","last_fullsized":"2024-09-14T11:51:23.294000+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:20.578713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"261'5","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:43.121925+0000","last_change":"2024-09-14T11:27:41.652540+0000","last_active":"2024-09-14T11:50:43.121925+0000","last_peered":"2024-09-14T11:50:43.121925+0000","last_clean":"2024-09-14T11:50:43.121925+0000","last_became_active":"2024-09-14T11:27:41.651778+0000","last_became_peered":"2024-09-14T11:27:41.651778+0000","last_unstale":"2024-09-14T11:50:43.121925+0000","last_undegraded":"2024-09-14T11:50:43.121925+0000","last_fullsized":"2024-09-14T11:50:43.121925+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:35.794859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:34.313081+0000","last_change":"2024-09-14T11:27:38.604820+0000","last_active":"2024-09-14T11:50:34.313081+0000","last_peered":"2024-09-14T11:50:34.313081+0000","last_clean":"2024-09-14T11:50:34.313081+0000","last_became_active":"2024-09-14T11:27:38.603954+0000","last_became_peered":"2024-09-14T11:27:38.603954+0000","last_unstale":"2024-09-14T11:50:34.313081+0000","last_undegraded":"2024-09-14T11:50:34.313081+0000","last_fullsized":"2024-09-14T11:50:34.313081+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:26.741673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"264'59","reported_seq":200,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:58.106856+0000","last_change":"2024-09-14T11:26:04.270170+0000","last_active":"2024-09-14T11:49:58.106856+0000","last_peered":"2024-09-14T11:49:58.106856+0000","last_clean":"2024-09-14T11:49:58.106856+0000","last_became_active":"2024-09-14T11:26:04.269206+0000","last_became_peered":"2024-09-14T11:26:04.269206+0000","last_unstale":"2024-09-14T11:49:58.106856+0000","last_undegraded":"2024-09-14T11:49:58.106856+0000","last_fullsized":"2024-09-14T11:49:58.106856+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:12.185033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":473,"num_read_kb":330,"num_write":140,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.294101+0000","last_change":"2024-09-14T11:38:50.585754+0000","last_active":"2024-09-14T11:51:23.294101+0000","last_peered":"2024-09-14T11:51:23.294101+0000","last_clean":"2024-09-14T11:51:23.294101+0000","last_became_active":"2024-09-14T11:38:50.585233+0000","last_became_peered":"2024-09-14T11:38:50.585233+0000","last_unstale":"2024-09-14T11:51:23.294101+0000","last_undegraded":"2024-09-14T11:51:23.294101+0000","last_fullsized":"2024-09-14T11:51:23.294101+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:13.891277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"261'4","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.120790+0000","last_change":"2024-09-14T11:27:41.660945+0000","last_active":"2024-09-14T11:50:38.120790+0000","last_peered":"2024-09-14T11:50:38.120790+0000","last_clean":"2024-09-14T11:50:38.120790+0000","last_became_active":"2024-09-14T11:27:41.660286+0000","last_became_peered":"2024-09-14T11:27:41.660286+0000","last_unstale":"2024-09-14T11:50:38.120790+0000","last_undegraded":"2024-09-14T11:50:38.120790+0000","last_fullsized":"2024-09-14T11:50:38.120790+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:47.102264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"261'2","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.115783+0000","last_change":"2024-09-14T11:27:38.594963+0000","last_active":"2024-09-14T11:50:38.115783+0000","last_peered":"2024-09-14T11:50:38.115783+0000","last_clean":"2024-09-14T11:50:38.115783+0000","last_became_active":"2024-09-14T11:27:38.591485+0000","last_became_peered":"2024-09-14T11:27:38.591485+0000","last_unstale":"2024-09-14T11:50:38.115783+0000","last_undegraded":"2024-09-14T11:50:38.115783+0000","last_fullsized":"2024-09-14T11:50:38.115783+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:00.325087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"261'8","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:54.302809+0000","last_change":"2024-09-14T11:26:04.284721+0000","last_active":"2024-09-14T11:49:54.302809+0000","last_peered":"2024-09-14T11:49:54.302809+0000","last_clean":"2024-09-14T11:49:54.302809+0000","last_became_active":"2024-09-14T11:26:04.280724+0000","last_became_peered":"2024-09-14T11:26:04.280724+0000","last_unstale":"2024-09-14T11:49:54.302809+0000","last_undegraded":"2024-09-14T11:49:54.302809+0000","last_fullsized":"2024-09-14T11:49:54.302809+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:06.079319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":39,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.124982+0000","last_change":"2024-09-14T11:38:50.586522+0000","last_active":"2024-09-14T11:50:58.124982+0000","last_peered":"2024-09-14T11:50:58.124982+0000","last_clean":"2024-09-14T11:50:58.124982+0000","last_became_active":"2024-09-14T11:38:50.586004+0000","last_became_peered":"2024-09-14T11:38:50.586004+0000","last_unstale":"2024-09-14T11:50:58.124982+0000","last_undegraded":"2024-09-14T11:50:58.124982+0000","last_fullsized":"2024-09-14T11:50:58.124982+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:21.529496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"264'4","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.321412+0000","last_change":"2024-09-14T11:27:41.657751+0000","last_active":"2024-09-14T11:53:43.321412+0000","last_peered":"2024-09-14T11:53:43.321412+0000","last_clean":"2024-09-14T11:53:43.321412+0000","last_became_active":"2024-09-14T11:27:41.656864+0000","last_became_peered":"2024-09-14T11:27:41.656864+0000","last_unstale":"2024-09-14T11:53:43.321412+0000","last_undegraded":"2024-09-14T11:53:43.321412+0000","last_fullsized":"2024-09-14T11:53:43.321412+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:54.203821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4123,"num_write":4,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"264'10","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:29.109079+0000","last_change":"2024-09-14T11:27:38.598139+0000","last_active":"2024-09-14T11:51:29.109079+0000","last_peered":"2024-09-14T11:51:29.109079+0000","last_clean":"2024-09-14T11:51:29.109079+0000","last_became_active":"2024-09-14T11:27:38.597416+0000","last_became_peered":"2024-09-14T11:27:38.597416+0000","last_unstale":"2024-09-14T11:51:29.109079+0000","last_undegraded":"2024-09-14T11:51:29.109079+0000","last_fullsized":"2024-09-14T11:51:29.109079+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:43.572595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1097003,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":16434,"num_write":20,"num_write_kb":9264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"264'34","reported_seq":138,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:14.105634+0000","last_change":"2024-09-14T11:26:04.275339+0000","last_active":"2024-09-14T11:51:14.105634+0000","last_peered":"2024-09-14T11:51:14.105634+0000","last_clean":"2024-09-14T11:51:14.105634+0000","last_became_active":"2024-09-14T11:26:04.274720+0000","last_became_peered":"2024-09-14T11:26:04.274720+0000","last_unstale":"2024-09-14T11:51:14.105634+0000","last_undegraded":"2024-09-14T11:51:14.105634+0000","last_fullsized":"2024-09-14T11:51:14.105634+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:36.983364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":267,"num_read_kb":161,"num_write":92,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:24.326912+0000","last_change":"2024-09-14T11:38:50.576319+0000","last_active":"2024-09-14T11:51:24.326912+0000","last_peered":"2024-09-14T11:51:24.326912+0000","last_clean":"2024-09-14T11:51:24.326912+0000","last_became_active":"2024-09-14T11:38:50.575662+0000","last_became_peered":"2024-09-14T11:38:50.575662+0000","last_unstale":"2024-09-14T11:51:24.326912+0000","last_undegraded":"2024-09-14T11:51:24.326912+0000","last_fullsized":"2024-09-14T11:51:24.326912+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:49.815419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:34.329826+0000","last_change":"2024-09-14T11:27:41.653202+0000","last_active":"2024-09-14T11:51:34.329826+0000","last_peered":"2024-09-14T11:51:34.329826+0000","last_clean":"2024-09-14T11:51:34.329826+0000","last_became_active":"2024-09-14T11:27:41.652132+0000","last_became_peered":"2024-09-14T11:27:41.652132+0000","last_unstale":"2024-09-14T11:51:34.329826+0000","last_undegraded":"2024-09-14T11:51:34.329826+0000","last_fullsized":"2024-09-14T11:51:34.329826+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:58.896733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"264'2","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:29.328518+0000","last_change":"2024-09-14T11:27:38.603010+0000","last_active":"2024-09-14T11:51:29.328518+0000","last_peered":"2024-09-14T11:51:29.328518+0000","last_clean":"2024-09-14T11:51:29.328518+0000","last_became_active":"2024-09-14T11:27:38.602099+0000","last_became_peered":"2024-09-14T11:27:38.602099+0000","last_unstale":"2024-09-14T11:51:29.328518+0000","last_undegraded":"2024-09-14T11:51:29.328518+0000","last_fullsized":"2024-09-14T11:51:29.328518+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:51.969381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"264'30","reported_seq":125,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.307396+0000","last_change":"2024-09-14T11:26:04.266535+0000","last_active":"2024-09-14T11:51:08.307396+0000","last_peered":"2024-09-14T11:51:08.307396+0000","last_clean":"2024-09-14T11:51:08.307396+0000","last_became_active":"2024-09-14T11:26:04.265553+0000","last_became_peered":"2024-09-14T11:26:04.265553+0000","last_unstale":"2024-09-14T11:51:08.307396+0000","last_undegraded":"2024-09-14T11:51:08.307396+0000","last_fullsized":"2024-09-14T11:51:08.307396+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:39.882235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":163,"num_write":75,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:43.283196+0000","last_change":"2024-09-14T11:38:50.587405+0000","last_active":"2024-09-14T11:49:43.283196+0000","last_peered":"2024-09-14T11:49:43.283196+0000","last_clean":"2024-09-14T11:49:43.283196+0000","last_became_active":"2024-09-14T11:38:50.583172+0000","last_became_peered":"2024-09-14T11:38:50.583172+0000","last_unstale":"2024-09-14T11:49:43.283196+0000","last_undegraded":"2024-09-14T11:49:43.283196+0000","last_fullsized":"2024-09-14T11:49:43.283196+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:06.394703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"264'3","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:43.143563+0000","last_change":"2024-09-14T11:27:41.646437+0000","last_active":"2024-09-14T11:52:43.143563+0000","last_peered":"2024-09-14T11:52:43.143563+0000","last_clean":"2024-09-14T11:52:43.143563+0000","last_became_active":"2024-09-14T11:27:41.645631+0000","last_became_peered":"2024-09-14T11:27:41.645631+0000","last_unstale":"2024-09-14T11:52:43.143563+0000","last_undegraded":"2024-09-14T11:52:43.143563+0000","last_fullsized":"2024-09-14T11:52:43.143563+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:11.944240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"261'6","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:49.114182+0000","last_change":"2024-09-14T11:27:38.598601+0000","last_active":"2024-09-14T11:51:49.114182+0000","last_peered":"2024-09-14T11:51:49.114182+0000","last_clean":"2024-09-14T11:51:49.114182+0000","last_became_active":"2024-09-14T11:27:38.597788+0000","last_became_peered":"2024-09-14T11:27:38.597788+0000","last_unstale":"2024-09-14T11:51:49.114182+0000","last_undegraded":"2024-09-14T11:51:49.114182+0000","last_fullsized":"2024-09-14T11:51:49.114182+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:42.681971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4123,"num_write":6,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"264'31","reported_seq":122,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.496327+0000","last_change":"2024-09-14T11:26:04.258522+0000","last_active":"2024-09-14T11:51:07.496327+0000","last_peered":"2024-09-14T11:51:07.496327+0000","last_clean":"2024-09-14T11:51:07.496327+0000","last_became_active":"2024-09-14T11:26:04.257219+0000","last_became_peered":"2024-09-14T11:26:04.257219+0000","last_unstale":"2024-09-14T11:51:07.496327+0000","last_undegraded":"2024-09-14T11:51:07.496327+0000","last_fullsized":"2024-09-14T11:51:07.496327+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:20.764816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":127,"num_write":83,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:43.103145+0000","last_change":"2024-09-14T11:38:50.581794+0000","last_active":"2024-09-14T11:49:43.103145+0000","last_peered":"2024-09-14T11:49:43.103145+0000","last_clean":"2024-09-14T11:49:43.103145+0000","last_became_active":"2024-09-14T11:38:50.581128+0000","last_became_peered":"2024-09-14T11:38:50.581128+0000","last_unstale":"2024-09-14T11:49:43.103145+0000","last_undegraded":"2024-09-14T11:49:43.103145+0000","last_fullsized":"2024-09-14T11:49:43.103145+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:55.010648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"264'2","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:49.333156+0000","last_change":"2024-09-14T11:27:41.653209+0000","last_active":"2024-09-14T11:51:49.333156+0000","last_peered":"2024-09-14T11:51:49.333156+0000","last_clean":"2024-09-14T11:51:49.333156+0000","last_became_active":"2024-09-14T11:27:41.652549+0000","last_became_peered":"2024-09-14T11:27:41.652549+0000","last_unstale":"2024-09-14T11:51:49.333156+0000","last_undegraded":"2024-09-14T11:51:49.333156+0000","last_fullsized":"2024-09-14T11:51:49.333156+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:00.987136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"264'4","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:34.312953+0000","last_change":"2024-09-14T11:27:38.610165+0000","last_active":"2024-09-14T11:50:34.312953+0000","last_peered":"2024-09-14T11:50:34.312953+0000","last_clean":"2024-09-14T11:50:34.312953+0000","last_became_active":"2024-09-14T11:27:38.609483+0000","last_became_peered":"2024-09-14T11:27:38.609483+0000","last_unstale":"2024-09-14T11:50:34.312953+0000","last_undegraded":"2024-09-14T11:50:34.312953+0000","last_fullsized":"2024-09-14T11:50:34.312953+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:29:33.493298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4197511,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":12292,"num_write":4,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"264'27","reported_seq":114,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:43.442305+0000","last_change":"2024-09-14T11:26:04.269191+0000","last_active":"2024-09-14T11:51:43.442305+0000","last_peered":"2024-09-14T11:51:43.442305+0000","last_clean":"2024-09-14T11:51:43.442305+0000","last_became_active":"2024-09-14T11:26:04.268338+0000","last_became_peered":"2024-09-14T11:26:04.268338+0000","last_unstale":"2024-09-14T11:51:43.442305+0000","last_undegraded":"2024-09-14T11:51:43.442305+0000","last_fullsized":"2024-09-14T11:51:43.442305+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:41.961353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":125,"num_write":73,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.130723+0000","last_change":"2024-09-14T11:38:50.590316+0000","last_active":"2024-09-14T11:51:23.130723+0000","last_peered":"2024-09-14T11:51:23.130723+0000","last_clean":"2024-09-14T11:51:23.130723+0000","last_became_active":"2024-09-14T11:38:50.589588+0000","last_became_peered":"2024-09-14T11:38:50.589588+0000","last_unstale":"2024-09-14T11:51:23.130723+0000","last_undegraded":"2024-09-14T11:51:23.130723+0000","last_fullsized":"2024-09-14T11:51:23.130723+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:24.259049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"264'1","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:39.096899+0000","last_change":"2024-09-14T11:27:41.644387+0000","last_active":"2024-09-14T11:50:39.096899+0000","last_peered":"2024-09-14T11:50:39.096899+0000","last_clean":"2024-09-14T11:50:39.096899+0000","last_became_active":"2024-09-14T11:27:41.642400+0000","last_became_peered":"2024-09-14T11:27:41.642400+0000","last_unstale":"2024-09-14T11:50:39.096899+0000","last_undegraded":"2024-09-14T11:50:39.096899+0000","last_fullsized":"2024-09-14T11:50:39.096899+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:58.652273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"261'5","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:33.116188+0000","last_change":"2024-09-14T11:27:38.590088+0000","last_active":"2024-09-14T11:50:33.116188+0000","last_peered":"2024-09-14T11:50:33.116188+0000","last_clean":"2024-09-14T11:50:33.116188+0000","last_became_active":"2024-09-14T11:27:38.587990+0000","last_became_peered":"2024-09-14T11:27:38.587990+0000","last_unstale":"2024-09-14T11:50:33.116188+0000","last_undegraded":"2024-09-14T11:50:33.116188+0000","last_fullsized":"2024-09-14T11:50:33.116188+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:09.675601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"264'55","reported_seq":192,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:43.699139+0000","last_change":"2024-09-14T11:26:04.258664+0000","last_active":"2024-09-14T11:51:43.699139+0000","last_peered":"2024-09-14T11:51:43.699139+0000","last_clean":"2024-09-14T11:51:43.699139+0000","last_became_active":"2024-09-14T11:26:04.257926+0000","last_became_peered":"2024-09-14T11:26:04.257926+0000","last_unstale":"2024-09-14T11:51:43.699139+0000","last_undegraded":"2024-09-14T11:51:43.699139+0000","last_fullsized":"2024-09-14T11:51:43.699139+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:33.436039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":423,"num_read_kb":280,"num_write":136,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:24.327084+0000","last_change":"2024-09-14T11:38:50.587747+0000","last_active":"2024-09-14T11:51:24.327084+0000","last_peered":"2024-09-14T11:51:24.327084+0000","last_clean":"2024-09-14T11:51:24.327084+0000","last_became_active":"2024-09-14T11:38:50.581923+0000","last_became_peered":"2024-09-14T11:38:50.581923+0000","last_unstale":"2024-09-14T11:51:24.327084+0000","last_undegraded":"2024-09-14T11:51:24.327084+0000","last_fullsized":"2024-09-14T11:51:24.327084+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:40.481426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:39.096845+0000","last_change":"2024-09-14T11:27:41.635443+0000","last_active":"2024-09-14T11:50:39.096845+0000","last_peered":"2024-09-14T11:50:39.096845+0000","last_clean":"2024-09-14T11:50:39.096845+0000","last_became_active":"2024-09-14T11:27:41.634692+0000","last_became_peered":"2024-09-14T11:27:41.634692+0000","last_unstale":"2024-09-14T11:50:39.096845+0000","last_undegraded":"2024-09-14T11:50:39.096845+0000","last_fullsized":"2024-09-14T11:50:39.096845+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:40.891329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"264'8","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.350192+0000","last_change":"2024-09-14T11:27:38.613089+0000","last_active":"2024-09-14T11:53:57.350192+0000","last_peered":"2024-09-14T11:53:57.350192+0000","last_clean":"2024-09-14T11:53:57.350192+0000","last_became_active":"2024-09-14T11:27:38.612443+0000","last_became_peered":"2024-09-14T11:27:38.612443+0000","last_unstale":"2024-09-14T11:53:57.350192+0000","last_undegraded":"2024-09-14T11:53:57.350192+0000","last_fullsized":"2024-09-14T11:53:57.350192+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:03.608324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16386,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"264'61","reported_seq":208,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.091151+0000","last_change":"2024-09-14T11:26:04.264319+0000","last_active":"2024-09-14T11:50:14.091151+0000","last_peered":"2024-09-14T11:50:14.091151+0000","last_clean":"2024-09-14T11:50:14.091151+0000","last_became_active":"2024-09-14T11:26:04.263498+0000","last_became_peered":"2024-09-14T11:26:04.263498+0000","last_unstale":"2024-09-14T11:50:14.091151+0000","last_undegraded":"2024-09-14T11:50:14.091151+0000","last_fullsized":"2024-09-14T11:50:14.091151+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:15.140217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":491,"num_read_kb":357,"num_write":145,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"264'195","reported_seq":915,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:00.618454+0000","last_change":"2024-09-14T11:09:45.213450+0000","last_active":"2024-09-14T11:52:00.618454+0000","last_peered":"2024-09-14T11:52:00.618454+0000","last_clean":"2024-09-14T11:52:00.618454+0000","last_became_active":"2024-09-14T11:09:45.212881+0000","last_became_peered":"2024-09-14T11:09:45.212881+0000","last_unstale":"2024-09-14T11:52:00.618454+0000","last_undegraded":"2024-09-14T11:52:00.618454+0000","last_fullsized":"2024-09-14T11:52:00.618454+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:30.710132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":928,"num_read_kb":39441,"num_write":967,"num_write_kb":29636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"264'507","reported_seq":2106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:10.846453+0000","last_change":"2024-09-14T11:09:46.960384+0000","last_active":"2024-09-14T11:52:10.846453+0000","last_peered":"2024-09-14T11:52:10.846453+0000","last_clean":"2024-09-14T11:52:10.846453+0000","last_became_active":"2024-09-14T11:09:46.960069+0000","last_became_peered":"2024-09-14T11:09:46.960069+0000","last_unstale":"2024-09-14T11:52:10.846453+0000","last_undegraded":"2024-09-14T11:52:10.846453+0000","last_fullsized":"2024-09-14T11:52:10.846453+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:31.331846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2624,"num_read_kb":2455,"num_write":621,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"264'211","reported_seq":859,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.432234+0000","last_change":"2024-09-14T11:09:45.211773+0000","last_active":"2024-09-14T11:53:57.432234+0000","last_peered":"2024-09-14T11:53:57.432234+0000","last_clean":"2024-09-14T11:53:57.432234+0000","last_became_active":"2024-09-14T11:09:45.211049+0000","last_became_peered":"2024-09-14T11:09:45.211049+0000","last_unstale":"2024-09-14T11:53:57.432234+0000","last_undegraded":"2024-09-14T11:53:57.432234+0000","last_fullsized":"2024-09-14T11:53:57.432234+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:23.782528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":540,"num_read_kb":70257,"num_write":1018,"num_write_kb":34950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"264'757","reported_seq":2283,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.019646+0000","last_change":"2024-09-14T11:09:46.957857+0000","last_active":"2024-09-14T11:52:29.019646+0000","last_peered":"2024-09-14T11:52:29.019646+0000","last_clean":"2024-09-14T11:52:29.019646+0000","last_became_active":"2024-09-14T11:09:46.957446+0000","last_became_peered":"2024-09-14T11:09:46.957446+0000","last_unstale":"2024-09-14T11:52:29.019646+0000","last_undegraded":"2024-09-14T11:52:29.019646+0000","last_fullsized":"2024-09-14T11:52:29.019646+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:59.796579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3644,"num_read_kb":3296,"num_write":998,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"264'183","reported_seq":805,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.496280+0000","last_change":"2024-09-14T11:09:45.209713+0000","last_active":"2024-09-14T11:53:57.496280+0000","last_peered":"2024-09-14T11:53:57.496280+0000","last_clean":"2024-09-14T11:53:57.496280+0000","last_became_active":"2024-09-14T11:09:45.207458+0000","last_became_peered":"2024-09-14T11:09:45.207458+0000","last_unstale":"2024-09-14T11:53:57.496280+0000","last_undegraded":"2024-09-14T11:53:57.496280+0000","last_fullsized":"2024-09-14T11:53:57.496280+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:49.539522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":12475,"num_write":826,"num_write_kb":33777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"264'372","reported_seq":1895,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:27.204477+0000","last_change":"2024-09-14T11:09:46.950941+0000","last_active":"2024-09-14T11:52:27.204477+0000","last_peered":"2024-09-14T11:52:27.204477+0000","last_clean":"2024-09-14T11:52:27.204477+0000","last_became_active":"2024-09-14T11:09:46.950652+0000","last_became_peered":"2024-09-14T11:09:46.950652+0000","last_unstale":"2024-09-14T11:52:27.204477+0000","last_undegraded":"2024-09-14T11:52:27.204477+0000","last_fullsized":"2024-09-14T11:52:27.204477+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:34.170365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2108,"num_read_kb":2030,"num_write":424,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"264'202","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:23.993626+0000","last_change":"2024-09-14T11:09:45.186739+0000","last_active":"2024-09-14T11:52:23.993626+0000","last_peered":"2024-09-14T11:52:23.993626+0000","last_clean":"2024-09-14T11:52:23.993626+0000","last_became_active":"2024-09-14T11:09:45.185702+0000","last_became_peered":"2024-09-14T11:09:45.185702+0000","last_unstale":"2024-09-14T11:52:23.993626+0000","last_undegraded":"2024-09-14T11:52:23.993626+0000","last_fullsized":"2024-09-14T11:52:23.993626+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:56.963707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9438224,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":491,"num_read_kb":15356,"num_write":914,"num_write_kb":51388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"264'414","reported_seq":1970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.623964+0000","last_change":"2024-09-14T11:09:46.954424+0000","last_active":"2024-09-14T11:52:29.623964+0000","last_peered":"2024-09-14T11:52:29.623964+0000","last_clean":"2024-09-14T11:52:29.623964+0000","last_became_active":"2024-09-14T11:09:46.952230+0000","last_became_peered":"2024-09-14T11:09:46.952230+0000","last_unstale":"2024-09-14T11:52:29.623964+0000","last_undegraded":"2024-09-14T11:52:29.623964+0000","last_fullsized":"2024-09-14T11:52:29.623964+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:20.602131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2399,"num_read_kb":2276,"num_write":503,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"264'175","reported_seq":744,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.540329+0000","last_change":"2024-09-14T11:10:22.255380+0000","last_active":"2024-09-14T11:53:57.540329+0000","last_peered":"2024-09-14T11:53:57.540329+0000","last_clean":"2024-09-14T11:53:57.540329+0000","last_became_active":"2024-09-14T11:10:22.254947+0000","last_became_peered":"2024-09-14T11:10:22.254947+0000","last_unstale":"2024-09-14T11:53:57.540329+0000","last_undegraded":"2024-09-14T11:53:57.540329+0000","last_fullsized":"2024-09-14T11:53:57.540329+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:02.851190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":441,"num_read_kb":20000,"num_write":788,"num_write_kb":32213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'366","reported_seq":1751,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.120430+0000","last_change":"2024-09-14T11:09:46.962966+0000","last_active":"2024-09-14T11:53:43.120430+0000","last_peered":"2024-09-14T11:53:43.120430+0000","last_clean":"2024-09-14T11:53:43.120430+0000","last_became_active":"2024-09-14T11:09:46.962586+0000","last_became_peered":"2024-09-14T11:09:46.962586+0000","last_unstale":"2024-09-14T11:53:43.120430+0000","last_undegraded":"2024-09-14T11:53:43.120430+0000","last_fullsized":"2024-09-14T11:53:43.120430+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:16.752782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1989,"num_read_kb":1876,"num_write":428,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"264'202","reported_seq":829,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:08.329811+0000","last_change":"2024-09-14T11:09:45.187610+0000","last_active":"2024-09-14T11:52:08.329811+0000","last_peered":"2024-09-14T11:52:08.329811+0000","last_clean":"2024-09-14T11:52:08.329811+0000","last_became_active":"2024-09-14T11:09:45.187149+0000","last_became_peered":"2024-09-14T11:09:45.187149+0000","last_unstale":"2024-09-14T11:52:08.329811+0000","last_undegraded":"2024-09-14T11:52:08.329811+0000","last_fullsized":"2024-09-14T11:52:08.329811+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:27.216240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2451109,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":550,"num_read_kb":3965,"num_write":970,"num_write_kb":31222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"264'786","reported_seq":2321,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.037515+0000","last_change":"2024-09-14T11:09:46.990395+0000","last_active":"2024-09-14T11:52:29.037515+0000","last_peered":"2024-09-14T11:52:29.037515+0000","last_clean":"2024-09-14T11:52:29.037515+0000","last_became_active":"2024-09-14T11:09:46.990102+0000","last_became_peered":"2024-09-14T11:09:46.990102+0000","last_unstale":"2024-09-14T11:52:29.037515+0000","last_undegraded":"2024-09-14T11:52:29.037515+0000","last_fullsized":"2024-09-14T11:52:29.037515+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:13.567778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3903,"num_read_kb":3531,"num_write":1063,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"264'333","reported_seq":994,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.388722+0000","last_change":"2024-09-14T11:09:45.205649+0000","last_active":"2024-09-14T11:53:57.388722+0000","last_peered":"2024-09-14T11:53:57.388722+0000","last_clean":"2024-09-14T11:53:57.388722+0000","last_became_active":"2024-09-14T11:09:45.204885+0000","last_became_peered":"2024-09-14T11:09:45.204885+0000","last_unstale":"2024-09-14T11:53:57.388722+0000","last_undegraded":"2024-09-14T11:53:57.388722+0000","last_fullsized":"2024-09-14T11:53:57.388722+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:37.591233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":904,"num_read_kb":1363,"num_write":1218,"num_write_kb":28416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"264'784","reported_seq":2358,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.184843+0000","last_change":"2024-09-14T11:09:46.951375+0000","last_active":"2024-09-14T11:52:12.184843+0000","last_peered":"2024-09-14T11:52:12.184843+0000","last_clean":"2024-09-14T11:52:12.184843+0000","last_became_active":"2024-09-14T11:09:46.951098+0000","last_became_peered":"2024-09-14T11:09:46.951098+0000","last_unstale":"2024-09-14T11:52:12.184843+0000","last_undegraded":"2024-09-14T11:52:12.184843+0000","last_fullsized":"2024-09-14T11:52:12.184843+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:32.686431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3820,"num_read_kb":3459,"num_write":1035,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"264'221","reported_seq":850,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.617091+0000","last_change":"2024-09-14T11:09:45.208652+0000","last_active":"2024-09-14T11:53:57.617091+0000","last_peered":"2024-09-14T11:53:57.617091+0000","last_clean":"2024-09-14T11:53:57.617091+0000","last_became_active":"2024-09-14T11:09:45.207406+0000","last_became_peered":"2024-09-14T11:09:45.207406+0000","last_unstale":"2024-09-14T11:53:57.617091+0000","last_undegraded":"2024-09-14T11:53:57.617091+0000","last_fullsized":"2024-09-14T11:53:57.617091+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:23.047694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":519,"num_read_kb":35149,"num_write":962,"num_write_kb":45963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"264'416","reported_seq":1956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.102644+0000","last_change":"2024-09-14T11:09:46.996557+0000","last_active":"2024-09-14T11:53:43.102644+0000","last_peered":"2024-09-14T11:53:43.102644+0000","last_clean":"2024-09-14T11:53:43.102644+0000","last_became_active":"2024-09-14T11:09:46.995237+0000","last_became_peered":"2024-09-14T11:09:46.995237+0000","last_unstale":"2024-09-14T11:53:43.102644+0000","last_undegraded":"2024-09-14T11:53:43.102644+0000","last_fullsized":"2024-09-14T11:53:43.102644+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:43.227391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2305,"num_read_kb":2183,"num_write":489,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"264'597","reported_seq":2214,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:11.470546+0000","last_change":"2024-09-14T11:09:46.960536+0000","last_active":"2024-09-14T11:52:11.470546+0000","last_peered":"2024-09-14T11:52:11.470546+0000","last_clean":"2024-09-14T11:52:11.470546+0000","last_became_active":"2024-09-14T11:09:46.959477+0000","last_became_peered":"2024-09-14T11:09:46.959477+0000","last_unstale":"2024-09-14T11:52:11.470546+0000","last_undegraded":"2024-09-14T11:52:11.470546+0000","last_fullsized":"2024-09-14T11:52:11.470546+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":500,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:02.226766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3034,"num_read_kb":2795,"num_write":758,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"264'217","reported_seq":846,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.616758+0000","last_change":"2024-09-14T11:09:45.204285+0000","last_active":"2024-09-14T11:53:57.616758+0000","last_peered":"2024-09-14T11:53:57.616758+0000","last_clean":"2024-09-14T11:53:57.616758+0000","last_became_active":"2024-09-14T11:09:45.204030+0000","last_became_peered":"2024-09-14T11:09:45.204030+0000","last_unstale":"2024-09-14T11:53:57.616758+0000","last_undegraded":"2024-09-14T11:53:57.616758+0000","last_fullsized":"2024-09-14T11:53:57.616758+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:18.332566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655875,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":529,"num_read_kb":23907,"num_write":1077,"num_write_kb":37253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"264'520","reported_seq":2130,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:03.265916+0000","last_change":"2024-09-14T11:09:46.971107+0000","last_active":"2024-09-14T11:52:03.265916+0000","last_peered":"2024-09-14T11:52:03.265916+0000","last_clean":"2024-09-14T11:52:03.265916+0000","last_became_active":"2024-09-14T11:09:46.970750+0000","last_became_peered":"2024-09-14T11:09:46.970750+0000","last_unstale":"2024-09-14T11:52:03.265916+0000","last_undegraded":"2024-09-14T11:52:03.265916+0000","last_fullsized":"2024-09-14T11:52:03.265916+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:57.060428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2805,"num_read_kb":2599,"num_write":647,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"264'219","reported_seq":857,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.542190+0000","last_change":"2024-09-14T11:09:45.207509+0000","last_active":"2024-09-14T11:53:57.542190+0000","last_peered":"2024-09-14T11:53:57.542190+0000","last_clean":"2024-09-14T11:53:57.542190+0000","last_became_active":"2024-09-14T11:09:45.206812+0000","last_became_peered":"2024-09-14T11:09:45.206812+0000","last_unstale":"2024-09-14T11:53:57.542190+0000","last_undegraded":"2024-09-14T11:53:57.542190+0000","last_fullsized":"2024-09-14T11:53:57.542190+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:33.731635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":566,"num_read_kb":32523,"num_write":996,"num_write_kb":41963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"264'850","reported_seq":2574,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.110359+0000","last_change":"2024-09-14T11:09:46.975448+0000","last_active":"2024-09-14T11:51:53.110359+0000","last_peered":"2024-09-14T11:51:53.110359+0000","last_clean":"2024-09-14T11:51:53.110359+0000","last_became_active":"2024-09-14T11:09:46.975135+0000","last_became_peered":"2024-09-14T11:09:46.975135+0000","last_unstale":"2024-09-14T11:51:53.110359+0000","last_undegraded":"2024-09-14T11:51:53.110359+0000","last_fullsized":"2024-09-14T11:51:53.110359+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":800,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:04.676118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4353,"num_read_kb":3966,"num_write":1152,"num_write_kb":464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"264'182","reported_seq":782,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.408931+0000","last_change":"2024-09-14T11:09:45.213110+0000","last_active":"2024-09-14T11:53:57.408931+0000","last_peered":"2024-09-14T11:53:57.408931+0000","last_clean":"2024-09-14T11:53:57.408931+0000","last_became_active":"2024-09-14T11:09:45.208314+0000","last_became_peered":"2024-09-14T11:09:45.208314+0000","last_unstale":"2024-09-14T11:53:57.408931+0000","last_undegraded":"2024-09-14T11:53:57.408931+0000","last_fullsized":"2024-09-14T11:53:57.408931+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:20.110568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":417,"num_read_kb":7778,"num_write":841,"num_write_kb":25761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"264'900","reported_seq":2658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:02.153104+0000","last_change":"2024-09-14T11:09:46.995957+0000","last_active":"2024-09-14T11:52:02.153104+0000","last_peered":"2024-09-14T11:52:02.153104+0000","last_clean":"2024-09-14T11:52:02.153104+0000","last_became_active":"2024-09-14T11:09:46.995182+0000","last_became_peered":"2024-09-14T11:09:46.995182+0000","last_unstale":"2024-09-14T11:52:02.153104+0000","last_undegraded":"2024-09-14T11:52:02.153104+0000","last_fullsized":"2024-09-14T11:52:02.153104+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":800,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:35.861209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4411,"num_read_kb":3995,"num_write":1182,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"264'215","reported_seq":807,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.585895+0000","last_change":"2024-09-14T11:09:45.220362+0000","last_active":"2024-09-14T11:53:57.585895+0000","last_peered":"2024-09-14T11:53:57.585895+0000","last_clean":"2024-09-14T11:53:57.585895+0000","last_became_active":"2024-09-14T11:09:45.215301+0000","last_became_peered":"2024-09-14T11:09:45.215301+0000","last_unstale":"2024-09-14T11:53:57.585895+0000","last_undegraded":"2024-09-14T11:53:57.585895+0000","last_fullsized":"2024-09-14T11:53:57.585895+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:10.063540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":450,"num_read_kb":16973,"num_write":902,"num_write_kb":40194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"264'431","reported_seq":1974,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.766412+0000","last_change":"2024-09-14T11:09:46.975235+0000","last_active":"2024-09-14T11:52:12.766412+0000","last_peered":"2024-09-14T11:52:12.766412+0000","last_clean":"2024-09-14T11:52:12.766412+0000","last_became_active":"2024-09-14T11:09:46.974465+0000","last_became_peered":"2024-09-14T11:09:46.974465+0000","last_unstale":"2024-09-14T11:52:12.766412+0000","last_undegraded":"2024-09-14T11:52:12.766412+0000","last_fullsized":"2024-09-14T11:52:12.766412+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:52.589199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2378,"num_read_kb":2237,"num_write":500,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"264'227","reported_seq":888,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.495483+0000","last_change":"2024-09-14T11:09:45.211590+0000","last_active":"2024-09-14T11:53:57.495483+0000","last_peered":"2024-09-14T11:53:57.495483+0000","last_clean":"2024-09-14T11:53:57.495483+0000","last_became_active":"2024-09-14T11:09:45.210875+0000","last_became_peered":"2024-09-14T11:09:45.210875+0000","last_unstale":"2024-09-14T11:53:57.495483+0000","last_undegraded":"2024-09-14T11:53:57.495483+0000","last_fullsized":"2024-09-14T11:53:57.495483+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:21.188914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":591,"num_read_kb":73875,"num_write":1091,"num_write_kb":38947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"264'414","reported_seq":1942,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.988375+0000","last_change":"2024-09-14T11:09:46.959048+0000","last_active":"2024-09-14T11:52:09.988375+0000","last_peered":"2024-09-14T11:52:09.988375+0000","last_clean":"2024-09-14T11:52:09.988375+0000","last_became_active":"2024-09-14T11:09:46.958694+0000","last_became_peered":"2024-09-14T11:09:46.958694+0000","last_unstale":"2024-09-14T11:52:09.988375+0000","last_undegraded":"2024-09-14T11:52:09.988375+0000","last_fullsized":"2024-09-14T11:52:09.988375+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:35.009340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2265,"num_read_kb":2144,"num_write":479,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"264'199","reported_seq":823,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.211385+0000","last_change":"2024-09-14T11:09:45.221734+0000","last_active":"2024-09-14T11:53:57.211385+0000","last_peered":"2024-09-14T11:53:57.211385+0000","last_clean":"2024-09-14T11:53:57.211385+0000","last_became_active":"2024-09-14T11:09:45.220968+0000","last_became_peered":"2024-09-14T11:09:45.220968+0000","last_unstale":"2024-09-14T11:53:57.211385+0000","last_undegraded":"2024-09-14T11:53:57.211385+0000","last_fullsized":"2024-09-14T11:53:57.211385+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:09.918507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":534,"num_read_kb":44269,"num_write":1000,"num_write_kb":27179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"264'134","reported_seq":639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.738672+0000","last_change":"2024-09-14T11:09:55.027528+0000","last_active":"2024-09-14T11:52:29.738672+0000","last_peered":"2024-09-14T11:52:29.738672+0000","last_clean":"2024-09-14T11:52:29.738672+0000","last_became_active":"2024-09-14T11:09:55.026753+0000","last_became_peered":"2024-09-14T11:09:55.026753+0000","last_unstale":"2024-09-14T11:52:29.738672+0000","last_undegraded":"2024-09-14T11:52:29.738672+0000","last_fullsized":"2024-09-14T11:52:29.738672+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:49.050538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":178,"num_read_kb":167,"num_write":319,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"264'372","reported_seq":1902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:00.697892+0000","last_change":"2024-09-14T11:09:46.985537+0000","last_active":"2024-09-14T11:52:00.697892+0000","last_peered":"2024-09-14T11:52:00.697892+0000","last_clean":"2024-09-14T11:52:00.697892+0000","last_became_active":"2024-09-14T11:09:46.985016+0000","last_became_peered":"2024-09-14T11:09:46.985016+0000","last_unstale":"2024-09-14T11:52:00.697892+0000","last_undegraded":"2024-09-14T11:52:00.697892+0000","last_fullsized":"2024-09-14T11:52:00.697892+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:37.173683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2187,"num_read_kb":2090,"num_write":422,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"264'238","reported_seq":880,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:38.924555+0000","last_change":"2024-09-14T11:09:45.209122+0000","last_active":"2024-09-14T11:51:38.924555+0000","last_peered":"2024-09-14T11:51:38.924555+0000","last_clean":"2024-09-14T11:51:38.924555+0000","last_became_active":"2024-09-14T11:09:45.208756+0000","last_became_peered":"2024-09-14T11:09:45.208756+0000","last_unstale":"2024-09-14T11:51:38.924555+0000","last_undegraded":"2024-09-14T11:51:38.924555+0000","last_fullsized":"2024-09-14T11:51:38.924555+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:05.011185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13693930,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":592,"num_read_kb":30329,"num_write":1156,"num_write_kb":41189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:54.318570+0000","last_change":"2024-09-14T11:09:48.970253+0000","last_active":"2024-09-14T11:50:54.318570+0000","last_peered":"2024-09-14T11:50:54.318570+0000","last_clean":"2024-09-14T11:50:54.318570+0000","last_became_active":"2024-09-14T11:09:48.969807+0000","last_became_peered":"2024-09-14T11:09:48.969807+0000","last_unstale":"2024-09-14T11:50:54.318570+0000","last_undegraded":"2024-09-14T11:50:54.318570+0000","last_fullsized":"2024-09-14T11:50:54.318570+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:20.729118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"264'196","reported_seq":796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.110588+0000","last_change":"2024-09-14T11:09:50.989686+0000","last_active":"2024-09-14T11:53:57.110588+0000","last_peered":"2024-09-14T11:53:57.110588+0000","last_clean":"2024-09-14T11:53:57.110588+0000","last_became_active":"2024-09-14T11:09:50.988903+0000","last_became_peered":"2024-09-14T11:09:50.988903+0000","last_unstale":"2024-09-14T11:53:57.110588+0000","last_undegraded":"2024-09-14T11:53:57.110588+0000","last_fullsized":"2024-09-14T11:53:57.110588+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:40.383215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12630,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":269,"num_read_kb":381,"num_write":162,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.271486+0000","last_change":"2024-09-14T11:09:53.012712+0000","last_active":"2024-09-14T11:50:58.271486+0000","last_peered":"2024-09-14T11:50:58.271486+0000","last_clean":"2024-09-14T11:50:58.271486+0000","last_became_active":"2024-09-14T11:09:53.010617+0000","last_became_peered":"2024-09-14T11:09:53.010617+0000","last_unstale":"2024-09-14T11:50:58.271486+0000","last_undegraded":"2024-09-14T11:50:58.271486+0000","last_fullsized":"2024-09-14T11:50:58.271486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:10.722614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"264'139","reported_seq":635,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:57.272034+0000","last_change":"2024-09-14T11:09:55.023108+0000","last_active":"2024-09-14T11:51:57.272034+0000","last_peered":"2024-09-14T11:51:57.272034+0000","last_clean":"2024-09-14T11:51:57.272034+0000","last_became_active":"2024-09-14T11:09:55.020070+0000","last_became_peered":"2024-09-14T11:09:55.020070+0000","last_unstale":"2024-09-14T11:51:57.272034+0000","last_undegraded":"2024-09-14T11:51:57.272034+0000","last_fullsized":"2024-09-14T11:51:57.272034+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:06.571541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":142,"num_write":346,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"264'927","reported_seq":2709,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.646957+0000","last_change":"2024-09-14T11:09:46.960339+0000","last_active":"2024-09-14T11:52:29.646957+0000","last_peered":"2024-09-14T11:52:29.646957+0000","last_clean":"2024-09-14T11:52:29.646957+0000","last_became_active":"2024-09-14T11:09:46.957383+0000","last_became_peered":"2024-09-14T11:09:46.957383+0000","last_unstale":"2024-09-14T11:52:29.646957+0000","last_undegraded":"2024-09-14T11:52:29.646957+0000","last_fullsized":"2024-09-14T11:52:29.646957+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:50.357529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4732,"num_read_kb":4281,"num_write":1231,"num_write_kb":469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"264'209","reported_seq":856,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.490065+0000","last_change":"2024-09-14T11:09:45.225975+0000","last_active":"2024-09-14T11:53:57.490065+0000","last_peered":"2024-09-14T11:53:57.490065+0000","last_clean":"2024-09-14T11:53:57.490065+0000","last_became_active":"2024-09-14T11:09:45.220059+0000","last_became_peered":"2024-09-14T11:09:45.220059+0000","last_unstale":"2024-09-14T11:53:57.490065+0000","last_undegraded":"2024-09-14T11:53:57.490065+0000","last_fullsized":"2024-09-14T11:53:57.490065+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:05.527234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":639,"num_read_kb":15720,"num_write":940,"num_write_kb":28935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:33.101046+0000","last_change":"2024-09-14T11:09:48.950741+0000","last_active":"2024-09-14T11:49:33.101046+0000","last_peered":"2024-09-14T11:49:33.101046+0000","last_clean":"2024-09-14T11:49:33.101046+0000","last_became_active":"2024-09-14T11:09:48.950055+0000","last_became_peered":"2024-09-14T11:09:48.950055+0000","last_unstale":"2024-09-14T11:49:33.101046+0000","last_undegraded":"2024-09-14T11:49:33.101046+0000","last_fullsized":"2024-09-14T11:49:33.101046+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:57.249708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"264'83","reported_seq":604,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.188762+0000","last_change":"2024-09-14T11:09:50.989886+0000","last_active":"2024-09-14T11:52:12.188762+0000","last_peered":"2024-09-14T11:52:12.188762+0000","last_clean":"2024-09-14T11:52:12.188762+0000","last_became_active":"2024-09-14T11:09:50.989174+0000","last_became_peered":"2024-09-14T11:09:50.989174+0000","last_unstale":"2024-09-14T11:52:12.188762+0000","last_undegraded":"2024-09-14T11:52:12.188762+0000","last_fullsized":"2024-09-14T11:52:12.188762+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:37.575700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":97,"num_read_kb":91,"num_write":68,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.271407+0000","last_change":"2024-09-14T11:09:53.019238+0000","last_active":"2024-09-14T11:50:58.271407+0000","last_peered":"2024-09-14T11:50:58.271407+0000","last_clean":"2024-09-14T11:50:58.271407+0000","last_became_active":"2024-09-14T11:09:53.018290+0000","last_became_peered":"2024-09-14T11:09:53.018290+0000","last_unstale":"2024-09-14T11:50:58.271407+0000","last_undegraded":"2024-09-14T11:50:58.271407+0000","last_fullsized":"2024-09-14T11:50:58.271407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:48.018030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"264'93","reported_seq":588,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:08.416231+0000","last_change":"2024-09-14T11:09:55.019556+0000","last_active":"2024-09-14T11:52:08.416231+0000","last_peered":"2024-09-14T11:52:08.416231+0000","last_clean":"2024-09-14T11:52:08.416231+0000","last_became_active":"2024-09-14T11:09:55.018855+0000","last_became_peered":"2024-09-14T11:09:55.018855+0000","last_unstale":"2024-09-14T11:52:08.416231+0000","last_undegraded":"2024-09-14T11:52:08.416231+0000","last_fullsized":"2024-09-14T11:52:08.416231+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:52.671096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":100,"num_read_kb":99,"num_write":210,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"264'508","reported_seq":2252,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:10.847271+0000","last_change":"2024-09-14T11:09:46.987477+0000","last_active":"2024-09-14T11:52:10.847271+0000","last_peered":"2024-09-14T11:52:10.847271+0000","last_clean":"2024-09-14T11:52:10.847271+0000","last_became_active":"2024-09-14T11:09:46.975175+0000","last_became_peered":"2024-09-14T11:09:46.975175+0000","last_unstale":"2024-09-14T11:52:10.847271+0000","last_undegraded":"2024-09-14T11:52:10.847271+0000","last_fullsized":"2024-09-14T11:52:10.847271+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:10.227238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2885,"num_read_kb":2717,"num_write":615,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"264'235","reported_seq":851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:05.090009+0000","last_change":"2024-09-14T11:09:45.205362+0000","last_active":"2024-09-14T11:51:05.090009+0000","last_peered":"2024-09-14T11:51:05.090009+0000","last_clean":"2024-09-14T11:51:05.090009+0000","last_became_active":"2024-09-14T11:09:45.205019+0000","last_became_peered":"2024-09-14T11:09:45.205019+0000","last_unstale":"2024-09-14T11:51:05.090009+0000","last_undegraded":"2024-09-14T11:51:05.090009+0000","last_fullsized":"2024-09-14T11:51:05.090009+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:50.482486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4202036,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":561,"num_read_kb":1571,"num_write":1127,"num_write_kb":22204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.118825+0000","last_change":"2024-09-14T11:09:48.951014+0000","last_active":"2024-09-14T11:50:53.118825+0000","last_peered":"2024-09-14T11:50:53.118825+0000","last_clean":"2024-09-14T11:50:53.118825+0000","last_became_active":"2024-09-14T11:09:48.950260+0000","last_became_peered":"2024-09-14T11:09:48.950260+0000","last_unstale":"2024-09-14T11:50:53.118825+0000","last_undegraded":"2024-09-14T11:50:53.118825+0000","last_fullsized":"2024-09-14T11:50:53.118825+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:26.673899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"264'107","reported_seq":639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:54.342568+0000","last_change":"2024-09-14T11:09:50.978554+0000","last_active":"2024-09-14T11:51:54.342568+0000","last_peered":"2024-09-14T11:51:54.342568+0000","last_clean":"2024-09-14T11:51:54.342568+0000","last_became_active":"2024-09-14T11:09:50.977685+0000","last_became_peered":"2024-09-14T11:09:50.977685+0000","last_unstale":"2024-09-14T11:51:54.342568+0000","last_undegraded":"2024-09-14T11:51:54.342568+0000","last_fullsized":"2024-09-14T11:51:54.342568+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:18:08.590005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"264'786","reported_seq":2365,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.073795+0000","last_change":"2024-09-14T11:09:53.022562+0000","last_active":"2024-09-14T11:53:44.073795+0000","last_peered":"2024-09-14T11:53:44.073795+0000","last_clean":"2024-09-14T11:53:44.073795+0000","last_became_active":"2024-09-14T11:09:53.021212+0000","last_became_peered":"2024-09-14T11:09:53.021212+0000","last_unstale":"2024-09-14T11:53:44.073795+0000","last_undegraded":"2024-09-14T11:53:44.073795+0000","last_fullsized":"2024-09-14T11:53:44.073795+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:48.852973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"264'221","reported_seq":1056,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.124563+0000","last_change":"2024-09-14T11:09:55.014805+0000","last_active":"2024-09-14T11:52:29.124563+0000","last_peered":"2024-09-14T11:52:29.124563+0000","last_clean":"2024-09-14T11:52:29.124563+0000","last_became_active":"2024-09-14T11:09:55.013994+0000","last_became_peered":"2024-09-14T11:09:55.013994+0000","last_unstale":"2024-09-14T11:52:29.124563+0000","last_undegraded":"2024-09-14T11:52:29.124563+0000","last_fullsized":"2024-09-14T11:52:29.124563+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:49.818762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":446,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":657,"num_read_kb":640,"num_write":481,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"264'1912","reported_seq":3548,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.647332+0000","last_change":"2024-09-14T11:09:46.996404+0000","last_active":"2024-09-14T11:52:29.647332+0000","last_peered":"2024-09-14T11:52:29.647332+0000","last_clean":"2024-09-14T11:52:29.647332+0000","last_became_active":"2024-09-14T11:09:46.994623+0000","last_became_peered":"2024-09-14T11:09:46.994623+0000","last_unstale":"2024-09-14T11:52:29.647332+0000","last_undegraded":"2024-09-14T11:52:29.647332+0000","last_fullsized":"2024-09-14T11:52:29.647332+0000","mapping_epoch":25,"log_start":"264'1900","ondisk_log_start":"264'1900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":1900,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:51.392243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8495,"num_read_kb":7411,"num_write":2703,"num_write_kb":1197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"264'213","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.473971+0000","last_change":"2024-09-14T11:09:45.208803+0000","last_active":"2024-09-14T11:53:57.473971+0000","last_peered":"2024-09-14T11:53:57.473971+0000","last_clean":"2024-09-14T11:53:57.473971+0000","last_became_active":"2024-09-14T11:09:45.208282+0000","last_became_peered":"2024-09-14T11:09:45.208282+0000","last_unstale":"2024-09-14T11:53:57.473971+0000","last_undegraded":"2024-09-14T11:53:57.473971+0000","last_fullsized":"2024-09-14T11:53:57.473971+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:23.782528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5850204,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":521,"num_read_kb":14610,"num_write":976,"num_write_kb":27594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:54.318600+0000","last_change":"2024-09-14T11:09:48.959777+0000","last_active":"2024-09-14T11:50:54.318600+0000","last_peered":"2024-09-14T11:50:54.318600+0000","last_clean":"2024-09-14T11:50:54.318600+0000","last_became_active":"2024-09-14T11:09:48.959355+0000","last_became_peered":"2024-09-14T11:09:48.959355+0000","last_unstale":"2024-09-14T11:50:54.318600+0000","last_undegraded":"2024-09-14T11:50:54.318600+0000","last_fullsized":"2024-09-14T11:50:54.318600+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:29.593248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"264'117","reported_seq":682,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.135145+0000","last_change":"2024-09-14T11:09:50.984714+0000","last_active":"2024-09-14T11:53:24.135145+0000","last_peered":"2024-09-14T11:53:24.135145+0000","last_clean":"2024-09-14T11:53:24.135145+0000","last_became_active":"2024-09-14T11:09:50.984035+0000","last_became_peered":"2024-09-14T11:09:50.984035+0000","last_unstale":"2024-09-14T11:53:24.135145+0000","last_undegraded":"2024-09-14T11:53:24.135145+0000","last_fullsized":"2024-09-14T11:53:24.135145+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:31.803088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13272,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":211,"num_write":78,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"264'802","reported_seq":2131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:56.913896+0000","last_change":"2024-09-14T11:09:53.006772+0000","last_active":"2024-09-14T11:53:56.913896+0000","last_peered":"2024-09-14T11:53:56.913896+0000","last_clean":"2024-09-14T11:53:56.913896+0000","last_became_active":"2024-09-14T11:09:53.004265+0000","last_became_peered":"2024-09-14T11:09:53.004265+0000","last_unstale":"2024-09-14T11:53:56.913896+0000","last_undegraded":"2024-09-14T11:53:56.913896+0000","last_fullsized":"2024-09-14T11:53:56.913896+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:25.054903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"264'520","reported_seq":2229,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.108065+0000","last_change":"2024-09-14T11:09:46.963218+0000","last_active":"2024-09-14T11:53:43.108065+0000","last_peered":"2024-09-14T11:53:43.108065+0000","last_clean":"2024-09-14T11:53:43.108065+0000","last_became_active":"2024-09-14T11:09:46.962838+0000","last_became_peered":"2024-09-14T11:09:46.962838+0000","last_unstale":"2024-09-14T11:53:43.108065+0000","last_undegraded":"2024-09-14T11:53:43.108065+0000","last_fullsized":"2024-09-14T11:53:43.108065+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:16.557469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2791,"num_read_kb":2616,"num_write":587,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"264'278","reported_seq":940,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.389378+0000","last_change":"2024-09-14T11:09:45.219933+0000","last_active":"2024-09-14T11:53:57.389378+0000","last_peered":"2024-09-14T11:53:57.389378+0000","last_clean":"2024-09-14T11:53:57.389378+0000","last_became_active":"2024-09-14T11:09:45.219674+0000","last_became_peered":"2024-09-14T11:09:45.219674+0000","last_unstale":"2024-09-14T11:53:57.389378+0000","last_undegraded":"2024-09-14T11:53:57.389378+0000","last_fullsized":"2024-09-14T11:53:57.389378+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:05.295609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":701,"num_read_kb":41266,"num_write":1220,"num_write_kb":49932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.271280+0000","last_change":"2024-09-14T11:09:48.958749+0000","last_active":"2024-09-14T11:50:58.271280+0000","last_peered":"2024-09-14T11:50:58.271280+0000","last_clean":"2024-09-14T11:50:58.271280+0000","last_became_active":"2024-09-14T11:09:48.958254+0000","last_became_peered":"2024-09-14T11:09:48.958254+0000","last_unstale":"2024-09-14T11:50:58.271280+0000","last_undegraded":"2024-09-14T11:50:58.271280+0000","last_fullsized":"2024-09-14T11:50:58.271280+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:42.595913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"264'192","reported_seq":796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.191251+0000","last_change":"2024-09-14T11:09:50.993372+0000","last_active":"2024-09-14T11:53:57.191251+0000","last_peered":"2024-09-14T11:53:57.191251+0000","last_clean":"2024-09-14T11:53:57.191251+0000","last_became_active":"2024-09-14T11:09:50.992673+0000","last_became_peered":"2024-09-14T11:09:50.992673+0000","last_unstale":"2024-09-14T11:53:57.191251+0000","last_undegraded":"2024-09-14T11:53:57.191251+0000","last_fullsized":"2024-09-14T11:53:57.191251+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:50.616252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11263,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":273,"num_read_kb":325,"num_write":154,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:23.114246+0000","last_change":"2024-09-14T11:09:53.008438+0000","last_active":"2024-09-14T11:50:23.114246+0000","last_peered":"2024-09-14T11:50:23.114246+0000","last_clean":"2024-09-14T11:50:23.114246+0000","last_became_active":"2024-09-14T11:09:53.007694+0000","last_became_peered":"2024-09-14T11:09:53.007694+0000","last_unstale":"2024-09-14T11:50:23.114246+0000","last_undegraded":"2024-09-14T11:50:23.114246+0000","last_fullsized":"2024-09-14T11:50:23.114246+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:56.147296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"264'565","reported_seq":1399,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.058548+0000","last_change":"2024-09-14T11:09:55.031185+0000","last_active":"2024-09-14T11:53:44.058548+0000","last_peered":"2024-09-14T11:53:44.058548+0000","last_clean":"2024-09-14T11:53:44.058548+0000","last_became_active":"2024-09-14T11:09:55.030659+0000","last_became_peered":"2024-09-14T11:09:55.030659+0000","last_unstale":"2024-09-14T11:53:44.058548+0000","last_undegraded":"2024-09-14T11:53:44.058548+0000","last_fullsized":"2024-09-14T11:53:44.058548+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:47.236046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1371,"num_read_kb":1346,"num_write":1205,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"264'1071","reported_seq":2641,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.646289+0000","last_change":"2024-09-14T11:09:46.990492+0000","last_active":"2024-09-14T11:52:29.646289+0000","last_peered":"2024-09-14T11:52:29.646289+0000","last_clean":"2024-09-14T11:52:29.646289+0000","last_became_active":"2024-09-14T11:09:46.990046+0000","last_became_peered":"2024-09-14T11:09:46.990046+0000","last_unstale":"2024-09-14T11:52:29.646289+0000","last_undegraded":"2024-09-14T11:52:29.646289+0000","last_fullsized":"2024-09-14T11:52:29.646289+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":1000,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:03.248978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5673,"num_read_kb":5118,"num_write":1579,"num_write_kb":694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"264'258","reported_seq":955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:42.758281+0000","last_change":"2024-09-14T11:09:45.211546+0000","last_active":"2024-09-14T11:51:42.758281+0000","last_peered":"2024-09-14T11:51:42.758281+0000","last_clean":"2024-09-14T11:51:42.758281+0000","last_became_active":"2024-09-14T11:09:45.210020+0000","last_became_peered":"2024-09-14T11:09:45.210020+0000","last_unstale":"2024-09-14T11:51:42.758281+0000","last_undegraded":"2024-09-14T11:51:42.758281+0000","last_fullsized":"2024-09-14T11:51:42.758281+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:40.715640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8411325,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":883,"num_read_kb":725,"num_write":1126,"num_write_kb":36716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.121796+0000","last_change":"2024-09-14T11:09:48.974766+0000","last_active":"2024-09-14T11:50:58.121796+0000","last_peered":"2024-09-14T11:50:58.121796+0000","last_clean":"2024-09-14T11:50:58.121796+0000","last_became_active":"2024-09-14T11:09:48.973945+0000","last_became_peered":"2024-09-14T11:09:48.973945+0000","last_unstale":"2024-09-14T11:50:58.121796+0000","last_undegraded":"2024-09-14T11:50:58.121796+0000","last_fullsized":"2024-09-14T11:50:58.121796+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:44.397689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"264'142","reported_seq":709,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.456731+0000","last_change":"2024-09-14T11:09:50.986632+0000","last_active":"2024-09-14T11:53:57.456731+0000","last_peered":"2024-09-14T11:53:57.456731+0000","last_clean":"2024-09-14T11:53:57.456731+0000","last_became_active":"2024-09-14T11:09:50.985800+0000","last_became_peered":"2024-09-14T11:09:50.985800+0000","last_unstale":"2024-09-14T11:53:57.456731+0000","last_undegraded":"2024-09-14T11:53:57.456731+0000","last_fullsized":"2024-09-14T11:53:57.456731+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:10:20.302521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14744,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":268,"num_write":96,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.122118+0000","last_change":"2024-09-14T11:09:53.003609+0000","last_active":"2024-09-14T11:51:08.122118+0000","last_peered":"2024-09-14T11:51:08.122118+0000","last_clean":"2024-09-14T11:51:08.122118+0000","last_became_active":"2024-09-14T11:09:53.002739+0000","last_became_peered":"2024-09-14T11:09:53.002739+0000","last_unstale":"2024-09-14T11:51:08.122118+0000","last_undegraded":"2024-09-14T11:51:08.122118+0000","last_fullsized":"2024-09-14T11:51:08.122118+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:34.134964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"264'2501","reported_seq":4368,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:33.422769+0000","last_change":"2024-09-14T11:09:55.020086+0000","last_active":"2024-09-14T11:53:33.422769+0000","last_peered":"2024-09-14T11:53:33.422769+0000","last_clean":"2024-09-14T11:53:33.422769+0000","last_became_active":"2024-09-14T11:09:55.017307+0000","last_became_peered":"2024-09-14T11:09:55.017307+0000","last_unstale":"2024-09-14T11:53:33.422769+0000","last_undegraded":"2024-09-14T11:53:33.422769+0000","last_fullsized":"2024-09-14T11:53:33.422769+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":2400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:26.762655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6356,"num_read_kb":6314,"num_write":5042,"num_write_kb":1853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"264'347","reported_seq":1756,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:03.283453+0000","last_change":"2024-09-14T11:09:46.953211+0000","last_active":"2024-09-14T11:52:03.283453+0000","last_peered":"2024-09-14T11:52:03.283453+0000","last_clean":"2024-09-14T11:52:03.283453+0000","last_became_active":"2024-09-14T11:09:46.952951+0000","last_became_peered":"2024-09-14T11:09:46.952951+0000","last_unstale":"2024-09-14T11:52:03.283453+0000","last_undegraded":"2024-09-14T11:52:03.283453+0000","last_fullsized":"2024-09-14T11:52:03.283453+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:11.659997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1860,"num_read_kb":1783,"num_write":380,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"264'219","reported_seq":855,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:05.334018+0000","last_change":"2024-09-14T11:09:45.211474+0000","last_active":"2024-09-14T11:52:05.334018+0000","last_peered":"2024-09-14T11:52:05.334018+0000","last_clean":"2024-09-14T11:52:05.334018+0000","last_became_active":"2024-09-14T11:09:45.211217+0000","last_became_peered":"2024-09-14T11:09:45.211217+0000","last_unstale":"2024-09-14T11:52:05.334018+0000","last_undegraded":"2024-09-14T11:52:05.334018+0000","last_fullsized":"2024-09-14T11:52:05.334018+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:46.779002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4541653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":596,"num_read_kb":7544,"num_write":1090,"num_write_kb":12612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.116225+0000","last_change":"2024-09-14T11:09:48.957986+0000","last_active":"2024-09-14T11:50:18.116225+0000","last_peered":"2024-09-14T11:50:18.116225+0000","last_clean":"2024-09-14T11:50:18.116225+0000","last_became_active":"2024-09-14T11:09:48.957275+0000","last_became_peered":"2024-09-14T11:09:48.957275+0000","last_unstale":"2024-09-14T11:50:18.116225+0000","last_undegraded":"2024-09-14T11:50:18.116225+0000","last_fullsized":"2024-09-14T11:50:18.116225+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:40.815434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"264'166","reported_seq":741,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.355017+0000","last_change":"2024-09-14T11:09:51.000566+0000","last_active":"2024-09-14T11:53:14.355017+0000","last_peered":"2024-09-14T11:53:14.355017+0000","last_clean":"2024-09-14T11:53:14.355017+0000","last_became_active":"2024-09-14T11:09:50.999759+0000","last_became_peered":"2024-09-14T11:09:50.999759+0000","last_unstale":"2024-09-14T11:53:14.355017+0000","last_undegraded":"2024-09-14T11:53:14.355017+0000","last_fullsized":"2024-09-14T11:53:14.355017+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:34.933664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11621,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":207,"num_read_kb":243,"num_write":122,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"264'802","reported_seq":2350,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:56.916551+0000","last_change":"2024-09-14T11:09:53.003439+0000","last_active":"2024-09-14T11:53:56.916551+0000","last_peered":"2024-09-14T11:53:56.916551+0000","last_clean":"2024-09-14T11:53:56.916551+0000","last_became_active":"2024-09-14T11:09:53.002667+0000","last_became_peered":"2024-09-14T11:09:53.002667+0000","last_unstale":"2024-09-14T11:53:56.916551+0000","last_undegraded":"2024-09-14T11:53:56.916551+0000","last_fullsized":"2024-09-14T11:53:56.916551+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:44.486567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"264'125","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.024032+0000","last_change":"2024-09-14T11:09:55.017516+0000","last_active":"2024-09-14T11:53:43.024032+0000","last_peered":"2024-09-14T11:53:43.024032+0000","last_clean":"2024-09-14T11:53:43.024032+0000","last_became_active":"2024-09-14T11:09:55.016802+0000","last_became_peered":"2024-09-14T11:09:55.016802+0000","last_unstale":"2024-09-14T11:53:43.024032+0000","last_undegraded":"2024-09-14T11:53:43.024032+0000","last_fullsized":"2024-09-14T11:53:43.024032+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:17.432120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":820,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":114,"num_write":311,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"264'746","reported_seq":2274,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.185022+0000","last_change":"2024-09-14T11:09:46.990182+0000","last_active":"2024-09-14T11:52:12.185022+0000","last_peered":"2024-09-14T11:52:12.185022+0000","last_clean":"2024-09-14T11:52:12.185022+0000","last_became_active":"2024-09-14T11:09:46.987523+0000","last_became_peered":"2024-09-14T11:09:46.987523+0000","last_unstale":"2024-09-14T11:52:12.185022+0000","last_undegraded":"2024-09-14T11:52:12.185022+0000","last_fullsized":"2024-09-14T11:52:12.185022+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":700,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:03.328090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3699,"num_read_kb":3347,"num_write":991,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"264'233","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.409636+0000","last_change":"2024-09-14T11:09:45.219279+0000","last_active":"2024-09-14T11:53:57.409636+0000","last_peered":"2024-09-14T11:53:57.409636+0000","last_clean":"2024-09-14T11:53:57.409636+0000","last_became_active":"2024-09-14T11:09:45.213648+0000","last_became_peered":"2024-09-14T11:09:45.213648+0000","last_unstale":"2024-09-14T11:53:57.409636+0000","last_undegraded":"2024-09-14T11:53:57.409636+0000","last_fullsized":"2024-09-14T11:53:57.409636+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:46.955930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1830584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":598,"num_read_kb":9438,"num_write":1111,"num_write_kb":42718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.124431+0000","last_change":"2024-09-14T11:09:48.965750+0000","last_active":"2024-09-14T11:51:08.124431+0000","last_peered":"2024-09-14T11:51:08.124431+0000","last_clean":"2024-09-14T11:51:08.124431+0000","last_became_active":"2024-09-14T11:09:48.965014+0000","last_became_peered":"2024-09-14T11:09:48.965014+0000","last_unstale":"2024-09-14T11:51:08.124431+0000","last_undegraded":"2024-09-14T11:51:08.124431+0000","last_fullsized":"2024-09-14T11:51:08.124431+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:17.069310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"264'200","reported_seq":828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.523160+0000","last_change":"2024-09-14T11:09:50.989754+0000","last_active":"2024-09-14T11:53:57.523160+0000","last_peered":"2024-09-14T11:53:57.523160+0000","last_clean":"2024-09-14T11:53:57.523160+0000","last_became_active":"2024-09-14T11:09:50.988991+0000","last_became_peered":"2024-09-14T11:09:50.988991+0000","last_unstale":"2024-09-14T11:53:57.523160+0000","last_undegraded":"2024-09-14T11:53:57.523160+0000","last_fullsized":"2024-09-14T11:53:57.523160+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:49.153350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16480,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":287,"num_read_kb":450,"num_write":148,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.126208+0000","last_change":"2024-09-14T11:09:53.011570+0000","last_active":"2024-09-14T11:51:03.126208+0000","last_peered":"2024-09-14T11:51:03.126208+0000","last_clean":"2024-09-14T11:51:03.126208+0000","last_became_active":"2024-09-14T11:09:53.010817+0000","last_became_peered":"2024-09-14T11:09:53.010817+0000","last_unstale":"2024-09-14T11:51:03.126208+0000","last_undegraded":"2024-09-14T11:51:03.126208+0000","last_fullsized":"2024-09-14T11:51:03.126208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:43.873697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"264'117","reported_seq":613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.729606+0000","last_change":"2024-09-14T11:09:55.026555+0000","last_active":"2024-09-14T11:52:29.729606+0000","last_peered":"2024-09-14T11:52:29.729606+0000","last_clean":"2024-09-14T11:52:29.729606+0000","last_became_active":"2024-09-14T11:09:55.025490+0000","last_became_peered":"2024-09-14T11:09:55.025490+0000","last_unstale":"2024-09-14T11:52:29.729606+0000","last_undegraded":"2024-09-14T11:52:29.729606+0000","last_fullsized":"2024-09-14T11:52:29.729606+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:27.983692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":533,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":108,"num_write":255,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"264'475","reported_seq":2021,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.038564+0000","last_change":"2024-09-14T11:09:46.971174+0000","last_active":"2024-09-14T11:52:29.038564+0000","last_peered":"2024-09-14T11:52:29.038564+0000","last_clean":"2024-09-14T11:52:29.038564+0000","last_became_active":"2024-09-14T11:09:46.970824+0000","last_became_peered":"2024-09-14T11:09:46.970824+0000","last_unstale":"2024-09-14T11:52:29.038564+0000","last_undegraded":"2024-09-14T11:52:29.038564+0000","last_fullsized":"2024-09-14T11:52:29.038564+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:12.281927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2551,"num_read_kb":2376,"num_write":583,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"264'195","reported_seq":786,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.318708+0000","last_change":"2024-09-14T11:09:45.217112+0000","last_active":"2024-09-14T11:53:57.318708+0000","last_peered":"2024-09-14T11:53:57.318708+0000","last_clean":"2024-09-14T11:53:57.318708+0000","last_became_active":"2024-09-14T11:09:45.216305+0000","last_became_peered":"2024-09-14T11:09:45.216305+0000","last_unstale":"2024-09-14T11:53:57.318708+0000","last_undegraded":"2024-09-14T11:53:57.318708+0000","last_fullsized":"2024-09-14T11:53:57.318708+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:30.530616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655887,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":432,"num_read_kb":2004,"num_write":918,"num_write_kb":29719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.290996+0000","last_change":"2024-09-14T11:09:48.969005+0000","last_active":"2024-09-14T11:50:18.290996+0000","last_peered":"2024-09-14T11:50:18.290996+0000","last_clean":"2024-09-14T11:50:18.290996+0000","last_became_active":"2024-09-14T11:09:48.968263+0000","last_became_peered":"2024-09-14T11:09:48.968263+0000","last_unstale":"2024-09-14T11:50:18.290996+0000","last_undegraded":"2024-09-14T11:50:18.290996+0000","last_fullsized":"2024-09-14T11:50:18.290996+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:06.145563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"264'146","reported_seq":717,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.545015+0000","last_change":"2024-09-14T11:09:50.998839+0000","last_active":"2024-09-14T11:53:57.545015+0000","last_peered":"2024-09-14T11:53:57.545015+0000","last_clean":"2024-09-14T11:53:57.545015+0000","last_became_active":"2024-09-14T11:09:50.998098+0000","last_became_peered":"2024-09-14T11:09:50.998098+0000","last_unstale":"2024-09-14T11:53:57.545015+0000","last_undegraded":"2024-09-14T11:53:57.545015+0000","last_fullsized":"2024-09-14T11:53:57.545015+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:51.979698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10966,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":215,"num_read_kb":296,"num_write":168,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:28.293305+0000","last_change":"2024-09-14T11:09:53.004485+0000","last_active":"2024-09-14T11:50:28.293305+0000","last_peered":"2024-09-14T11:50:28.293305+0000","last_clean":"2024-09-14T11:50:28.293305+0000","last_became_active":"2024-09-14T11:09:53.003759+0000","last_became_peered":"2024-09-14T11:09:53.003759+0000","last_unstale":"2024-09-14T11:50:28.293305+0000","last_undegraded":"2024-09-14T11:50:28.293305+0000","last_fullsized":"2024-09-14T11:50:28.293305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:37.578578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"264'125","reported_seq":611,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.978197+0000","last_change":"2024-09-14T11:09:55.034286+0000","last_active":"2024-09-14T11:52:09.978197+0000","last_peered":"2024-09-14T11:52:09.978197+0000","last_clean":"2024-09-14T11:52:09.978197+0000","last_became_active":"2024-09-14T11:09:55.033844+0000","last_became_peered":"2024-09-14T11:09:55.033844+0000","last_unstale":"2024-09-14T11:52:09.978197+0000","last_undegraded":"2024-09-14T11:52:09.978197+0000","last_fullsized":"2024-09-14T11:52:09.978197+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:07.504626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":100,"num_write":302,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"264'542","reported_seq":2213,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:27.203748+0000","last_change":"2024-09-14T11:09:46.961567+0000","last_active":"2024-09-14T11:52:27.203748+0000","last_peered":"2024-09-14T11:52:27.203748+0000","last_clean":"2024-09-14T11:52:27.203748+0000","last_became_active":"2024-09-14T11:09:46.961100+0000","last_became_peered":"2024-09-14T11:09:46.961100+0000","last_unstale":"2024-09-14T11:52:27.203748+0000","last_undegraded":"2024-09-14T11:52:27.203748+0000","last_fullsized":"2024-09-14T11:52:27.203748+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:01.729846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2788,"num_read_kb":2597,"num_write":616,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"264'216","reported_seq":828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:07.521658+0000","last_change":"2024-09-14T11:09:45.199153+0000","last_active":"2024-09-14T11:52:07.521658+0000","last_peered":"2024-09-14T11:52:07.521658+0000","last_clean":"2024-09-14T11:52:07.521658+0000","last_became_active":"2024-09-14T11:09:45.198569+0000","last_became_peered":"2024-09-14T11:09:45.198569+0000","last_unstale":"2024-09-14T11:52:07.521658+0000","last_undegraded":"2024-09-14T11:52:07.521658+0000","last_fullsized":"2024-09-14T11:52:07.521658+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:01.792464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12605563,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":582,"num_read_kb":15211,"num_write":897,"num_write_kb":32712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.116267+0000","last_change":"2024-09-14T11:09:48.953393+0000","last_active":"2024-09-14T11:50:18.116267+0000","last_peered":"2024-09-14T11:50:18.116267+0000","last_clean":"2024-09-14T11:50:18.116267+0000","last_became_active":"2024-09-14T11:09:48.952531+0000","last_became_peered":"2024-09-14T11:09:48.952531+0000","last_unstale":"2024-09-14T11:50:18.116267+0000","last_undegraded":"2024-09-14T11:50:18.116267+0000","last_fullsized":"2024-09-14T11:50:18.116267+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:01.263241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"264'158","reported_seq":738,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.398087+0000","last_change":"2024-09-14T11:09:50.976197+0000","last_active":"2024-09-14T11:53:57.398087+0000","last_peered":"2024-09-14T11:53:57.398087+0000","last_clean":"2024-09-14T11:53:57.398087+0000","last_became_active":"2024-09-14T11:09:50.975455+0000","last_became_peered":"2024-09-14T11:09:50.975455+0000","last_unstale":"2024-09-14T11:53:57.398087+0000","last_undegraded":"2024-09-14T11:53:57.398087+0000","last_fullsized":"2024-09-14T11:53:57.398087+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:53.261559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16336,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":219,"num_read_kb":325,"num_write":124,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"264'773","reported_seq":2363,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:56.904621+0000","last_change":"2024-09-14T11:09:53.014808+0000","last_active":"2024-09-14T11:53:56.904621+0000","last_peered":"2024-09-14T11:53:56.904621+0000","last_clean":"2024-09-14T11:53:56.904621+0000","last_became_active":"2024-09-14T11:09:53.013805+0000","last_became_peered":"2024-09-14T11:09:53.013805+0000","last_unstale":"2024-09-14T11:53:56.904621+0000","last_undegraded":"2024-09-14T11:53:56.904621+0000","last_fullsized":"2024-09-14T11:53:56.904621+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:29.501003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"264'151","reported_seq":656,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:27.197059+0000","last_change":"2024-09-14T11:09:55.027376+0000","last_active":"2024-09-14T11:52:27.197059+0000","last_peered":"2024-09-14T11:52:27.197059+0000","last_clean":"2024-09-14T11:52:27.197059+0000","last_became_active":"2024-09-14T11:09:55.026656+0000","last_became_peered":"2024-09-14T11:09:55.026656+0000","last_unstale":"2024-09-14T11:52:27.197059+0000","last_undegraded":"2024-09-14T11:52:27.197059+0000","last_fullsized":"2024-09-14T11:52:27.197059+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:05.576224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1884,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":197,"num_read_kb":178,"num_write":396,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"264'507","reported_seq":2081,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.766264+0000","last_change":"2024-09-14T11:09:46.950232+0000","last_active":"2024-09-14T11:52:12.766264+0000","last_peered":"2024-09-14T11:52:12.766264+0000","last_clean":"2024-09-14T11:52:12.766264+0000","last_became_active":"2024-09-14T11:09:46.949867+0000","last_became_peered":"2024-09-14T11:09:46.949867+0000","last_unstale":"2024-09-14T11:52:12.766264+0000","last_undegraded":"2024-09-14T11:52:12.766264+0000","last_fullsized":"2024-09-14T11:52:12.766264+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:05.177389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2605,"num_read_kb":2418,"num_write":602,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"264'269","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.606829+0000","last_change":"2024-09-14T11:09:45.208220+0000","last_active":"2024-09-14T11:51:53.606829+0000","last_peered":"2024-09-14T11:51:53.606829+0000","last_clean":"2024-09-14T11:51:53.606829+0000","last_became_active":"2024-09-14T11:09:45.207969+0000","last_became_peered":"2024-09-14T11:09:45.207969+0000","last_unstale":"2024-09-14T11:51:53.606829+0000","last_undegraded":"2024-09-14T11:51:53.606829+0000","last_fullsized":"2024-09-14T11:51:53.606829+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:49.056243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9444878,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":712,"num_read_kb":90988,"num_write":1208,"num_write_kb":64456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1455,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:56.650959+0000","last_change":"2024-09-14T11:09:48.963010+0000","last_active":"2024-09-14T11:53:56.650959+0000","last_peered":"2024-09-14T11:53:56.650959+0000","last_clean":"2024-09-14T11:53:56.650959+0000","last_became_active":"2024-09-14T11:09:48.961946+0000","last_became_peered":"2024-09-14T11:09:48.961946+0000","last_unstale":"2024-09-14T11:53:56.650959+0000","last_undegraded":"2024-09-14T11:53:56.650959+0000","last_fullsized":"2024-09-14T11:53:56.650959+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:33.499961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":958,"num_read_kb":958,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"264'82","reported_seq":597,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:06.162254+0000","last_change":"2024-09-14T11:09:50.997985+0000","last_active":"2024-09-14T11:52:06.162254+0000","last_peered":"2024-09-14T11:52:06.162254+0000","last_clean":"2024-09-14T11:52:06.162254+0000","last_became_active":"2024-09-14T11:09:50.997281+0000","last_became_peered":"2024-09-14T11:09:50.997281+0000","last_unstale":"2024-09-14T11:52:06.162254+0000","last_undegraded":"2024-09-14T11:52:06.162254+0000","last_fullsized":"2024-09-14T11:52:06.162254+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:22.957216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"264'802","reported_seq":4462,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.126548+0000","last_change":"2024-09-14T11:09:53.012817+0000","last_active":"2024-09-14T11:53:57.126548+0000","last_peered":"2024-09-14T11:53:57.126548+0000","last_clean":"2024-09-14T11:53:57.126548+0000","last_became_active":"2024-09-14T11:09:53.010631+0000","last_became_peered":"2024-09-14T11:09:53.010631+0000","last_unstale":"2024-09-14T11:53:57.126548+0000","last_undegraded":"2024-09-14T11:53:57.126548+0000","last_fullsized":"2024-09-14T11:53:57.126548+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:56.772893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"264'178","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:07.609486+0000","last_change":"2024-09-14T11:09:55.011221+0000","last_active":"2024-09-14T11:52:07.609486+0000","last_peered":"2024-09-14T11:52:07.609486+0000","last_clean":"2024-09-14T11:52:07.609486+0000","last_became_active":"2024-09-14T11:09:55.010215+0000","last_became_peered":"2024-09-14T11:09:55.010215+0000","last_unstale":"2024-09-14T11:52:07.609486+0000","last_undegraded":"2024-09-14T11:52:07.609486+0000","last_fullsized":"2024-09-14T11:52:07.609486+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:33.289296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":123,"num_read_kb":114,"num_write":415,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"264'410","reported_seq":1885,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.991420+0000","last_change":"2024-09-14T11:09:46.967866+0000","last_active":"2024-09-14T11:52:09.991420+0000","last_peered":"2024-09-14T11:52:09.991420+0000","last_clean":"2024-09-14T11:52:09.991420+0000","last_became_active":"2024-09-14T11:09:46.966876+0000","last_became_peered":"2024-09-14T11:09:46.966876+0000","last_unstale":"2024-09-14T11:52:09.991420+0000","last_undegraded":"2024-09-14T11:52:09.991420+0000","last_fullsized":"2024-09-14T11:52:09.991420+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:28.146124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2150,"num_read_kb":2036,"num_write":469,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"264'265","reported_seq":1015,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.433428+0000","last_change":"2024-09-14T11:09:45.200742+0000","last_active":"2024-09-14T11:53:57.433428+0000","last_peered":"2024-09-14T11:53:57.433428+0000","last_clean":"2024-09-14T11:53:57.433428+0000","last_became_active":"2024-09-14T11:09:45.200039+0000","last_became_peered":"2024-09-14T11:09:45.200039+0000","last_unstale":"2024-09-14T11:53:57.433428+0000","last_undegraded":"2024-09-14T11:53:57.433428+0000","last_fullsized":"2024-09-14T11:53:57.433428+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:15.438388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":994,"num_read_kb":201012,"num_write":1230,"num_write_kb":37853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:19.309093+0000","last_change":"2024-09-14T11:09:48.973340+0000","last_active":"2024-09-14T11:50:19.309093+0000","last_peered":"2024-09-14T11:50:19.309093+0000","last_clean":"2024-09-14T11:50:19.309093+0000","last_became_active":"2024-09-14T11:09:48.972957+0000","last_became_peered":"2024-09-14T11:09:48.972957+0000","last_unstale":"2024-09-14T11:50:19.309093+0000","last_undegraded":"2024-09-14T11:50:19.309093+0000","last_fullsized":"2024-09-14T11:50:19.309093+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:18.626799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"264'197","reported_seq":800,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.144002+0000","last_change":"2024-09-14T11:09:50.992659+0000","last_active":"2024-09-14T11:53:57.144002+0000","last_peered":"2024-09-14T11:53:57.144002+0000","last_clean":"2024-09-14T11:53:57.144002+0000","last_became_active":"2024-09-14T11:09:50.991938+0000","last_became_peered":"2024-09-14T11:09:50.991938+0000","last_unstale":"2024-09-14T11:53:57.144002+0000","last_undegraded":"2024-09-14T11:53:57.144002+0000","last_fullsized":"2024-09-14T11:53:57.144002+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:19.906727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11553,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":263,"num_read_kb":344,"num_write":148,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:24.093470+0000","last_change":"2024-09-14T11:09:53.007158+0000","last_active":"2024-09-14T11:50:24.093470+0000","last_peered":"2024-09-14T11:50:24.093470+0000","last_clean":"2024-09-14T11:50:24.093470+0000","last_became_active":"2024-09-14T11:09:53.006350+0000","last_became_peered":"2024-09-14T11:09:53.006350+0000","last_unstale":"2024-09-14T11:50:24.093470+0000","last_undegraded":"2024-09-14T11:50:24.093470+0000","last_fullsized":"2024-09-14T11:50:24.093470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:53.484128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"264'117","reported_seq":602,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.069500+0000","last_change":"2024-09-14T11:09:55.013765+0000","last_active":"2024-09-14T11:52:29.069500+0000","last_peered":"2024-09-14T11:52:29.069500+0000","last_clean":"2024-09-14T11:52:29.069500+0000","last_became_active":"2024-09-14T11:09:55.012954+0000","last_became_peered":"2024-09-14T11:09:55.012954+0000","last_unstale":"2024-09-14T11:52:29.069500+0000","last_undegraded":"2024-09-14T11:52:29.069500+0000","last_fullsized":"2024-09-14T11:52:29.069500+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:40.472347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":106,"num_write":256,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"264'403","reported_seq":2070,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.038508+0000","last_change":"2024-09-14T11:09:46.961019+0000","last_active":"2024-09-14T11:52:29.038508+0000","last_peered":"2024-09-14T11:52:29.038508+0000","last_clean":"2024-09-14T11:52:29.038508+0000","last_became_active":"2024-09-14T11:09:46.960461+0000","last_became_peered":"2024-09-14T11:09:46.960461+0000","last_unstale":"2024-09-14T11:52:29.038508+0000","last_undegraded":"2024-09-14T11:52:29.038508+0000","last_fullsized":"2024-09-14T11:52:29.038508+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:23.203399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2438,"num_read_kb":2343,"num_write":447,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:38.279655+0000","last_change":"2024-09-14T11:09:30.311475+0000","last_active":"2024-09-14T11:51:38.279655+0000","last_peered":"2024-09-14T11:51:38.279655+0000","last_clean":"2024-09-14T11:51:38.279655+0000","last_became_active":"2024-09-14T11:09:30.309524+0000","last_became_peered":"2024-09-14T11:09:30.309524+0000","last_unstale":"2024-09-14T11:51:38.279655+0000","last_undegraded":"2024-09-14T11:51:38.279655+0000","last_fullsized":"2024-09-14T11:51:38.279655+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:29.042524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:29.042524+0000","last_clean_scrub_stamp":"2024-09-14T11:09:29.042524+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:30.098592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.325699+0000","last_change":"2024-09-14T11:09:38.138631+0000","last_active":"2024-09-14T11:51:19.325699+0000","last_peered":"2024-09-14T11:51:19.325699+0000","last_clean":"2024-09-14T11:51:19.325699+0000","last_became_active":"2024-09-14T11:09:36.264768+0000","last_became_peered":"2024-09-14T11:09:36.264768+0000","last_unstale":"2024-09-14T11:51:19.325699+0000","last_undegraded":"2024-09-14T11:51:19.325699+0000","last_fullsized":"2024-09-14T11:51:19.325699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:42.835248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092723999999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"264'269","reported_seq":1076,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.452805+0000","last_change":"2024-09-14T11:09:45.193906+0000","last_active":"2024-09-14T11:53:57.452805+0000","last_peered":"2024-09-14T11:53:57.452805+0000","last_clean":"2024-09-14T11:53:57.452805+0000","last_became_active":"2024-09-14T11:09:45.193131+0000","last_became_peered":"2024-09-14T11:09:45.193131+0000","last_unstale":"2024-09-14T11:53:57.452805+0000","last_undegraded":"2024-09-14T11:53:57.452805+0000","last_fullsized":"2024-09-14T11:53:57.452805+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:48.612008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1127,"num_read_kb":141056,"num_write":1044,"num_write_kb":44809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:28.295205+0000","last_change":"2024-09-14T11:09:48.970982+0000","last_active":"2024-09-14T11:51:28.295205+0000","last_peered":"2024-09-14T11:51:28.295205+0000","last_clean":"2024-09-14T11:51:28.295205+0000","last_became_active":"2024-09-14T11:09:48.970541+0000","last_became_peered":"2024-09-14T11:09:48.970541+0000","last_unstale":"2024-09-14T11:51:28.295205+0000","last_undegraded":"2024-09-14T11:51:28.295205+0000","last_fullsized":"2024-09-14T11:51:28.295205+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:59.863519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"264'287","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.018200+0000","last_change":"2024-09-14T11:09:50.994191+0000","last_active":"2024-09-14T11:53:44.018200+0000","last_peered":"2024-09-14T11:53:44.018200+0000","last_clean":"2024-09-14T11:53:44.018200+0000","last_became_active":"2024-09-14T11:09:50.993231+0000","last_became_peered":"2024-09-14T11:09:50.993231+0000","last_unstale":"2024-09-14T11:53:44.018200+0000","last_undegraded":"2024-09-14T11:53:44.018200+0000","last_fullsized":"2024-09-14T11:53:44.018200+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:10.493181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30416,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":522,"num_read_kb":647,"num_write":472,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.126495+0000","last_change":"2024-09-14T11:09:53.006544+0000","last_active":"2024-09-14T11:51:03.126495+0000","last_peered":"2024-09-14T11:51:03.126495+0000","last_clean":"2024-09-14T11:51:03.126495+0000","last_became_active":"2024-09-14T11:09:53.004338+0000","last_became_peered":"2024-09-14T11:09:53.004338+0000","last_unstale":"2024-09-14T11:51:03.126495+0000","last_undegraded":"2024-09-14T11:51:03.126495+0000","last_fullsized":"2024-09-14T11:51:03.126495+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:24.238705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"264'234","reported_seq":943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.660948+0000","last_change":"2024-09-14T11:09:55.016385+0000","last_active":"2024-09-14T11:52:29.660948+0000","last_peered":"2024-09-14T11:52:29.660948+0000","last_clean":"2024-09-14T11:52:29.660948+0000","last_became_active":"2024-09-14T11:09:55.015569+0000","last_became_peered":"2024-09-14T11:09:55.015569+0000","last_unstale":"2024-09-14T11:52:29.660948+0000","last_undegraded":"2024-09-14T11:52:29.660948+0000","last_fullsized":"2024-09-14T11:52:29.660948+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:05.577627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1424,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":528,"num_read_kb":505,"num_write":525,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"264'793","reported_seq":2248,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.037887+0000","last_change":"2024-09-14T11:09:46.975255+0000","last_active":"2024-09-14T11:52:29.037887+0000","last_peered":"2024-09-14T11:52:29.037887+0000","last_clean":"2024-09-14T11:52:29.037887+0000","last_became_active":"2024-09-14T11:09:46.974517+0000","last_became_peered":"2024-09-14T11:09:46.974517+0000","last_unstale":"2024-09-14T11:52:29.037887+0000","last_undegraded":"2024-09-14T11:52:29.037887+0000","last_fullsized":"2024-09-14T11:52:29.037887+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:37.949762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3876,"num_read_kb":3470,"num_write":1072,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:44.331934+0000","last_change":"2024-09-14T11:09:38.138820+0000","last_active":"2024-09-14T11:51:44.331934+0000","last_peered":"2024-09-14T11:51:44.331934+0000","last_clean":"2024-09-14T11:51:44.331934+0000","last_became_active":"2024-09-14T11:09:36.110037+0000","last_became_peered":"2024-09-14T11:09:36.110037+0000","last_unstale":"2024-09-14T11:51:44.331934+0000","last_undegraded":"2024-09-14T11:51:44.331934+0000","last_fullsized":"2024-09-14T11:51:44.331934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:29.413375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001043441,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"264'224","reported_seq":875,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.177550+0000","last_change":"2024-09-14T11:09:45.212152+0000","last_active":"2024-09-14T11:53:57.177550+0000","last_peered":"2024-09-14T11:53:57.177550+0000","last_clean":"2024-09-14T11:53:57.177550+0000","last_became_active":"2024-09-14T11:09:45.211579+0000","last_became_peered":"2024-09-14T11:09:45.211579+0000","last_unstale":"2024-09-14T11:53:57.177550+0000","last_undegraded":"2024-09-14T11:53:57.177550+0000","last_fullsized":"2024-09-14T11:53:57.177550+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:17.532123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":626,"num_read_kb":58466,"num_write":936,"num_write_kb":31030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:59.320409+0000","last_change":"2024-09-14T11:09:48.970703+0000","last_active":"2024-09-14T11:50:59.320409+0000","last_peered":"2024-09-14T11:50:59.320409+0000","last_clean":"2024-09-14T11:50:59.320409+0000","last_became_active":"2024-09-14T11:09:48.970218+0000","last_became_peered":"2024-09-14T11:09:48.970218+0000","last_unstale":"2024-09-14T11:50:59.320409+0000","last_undegraded":"2024-09-14T11:50:59.320409+0000","last_fullsized":"2024-09-14T11:50:59.320409+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:45.534332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"264'865","reported_seq":2324,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.482064+0000","last_change":"2024-09-14T11:09:50.997084+0000","last_active":"2024-09-14T11:53:57.482064+0000","last_peered":"2024-09-14T11:53:57.482064+0000","last_clean":"2024-09-14T11:53:57.482064+0000","last_became_active":"2024-09-14T11:09:50.996406+0000","last_became_peered":"2024-09-14T11:09:50.996406+0000","last_unstale":"2024-09-14T11:53:57.482064+0000","last_undegraded":"2024-09-14T11:53:57.482064+0000","last_fullsized":"2024-09-14T11:53:57.482064+0000","mapping_epoch":29,"log_start":"264'800","ondisk_log_start":"264'800","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":800,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:20.571461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34005,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1184,"num_read_kb":1407,"num_write":288,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:39.330945+0000","last_change":"2024-09-14T11:09:53.022628+0000","last_active":"2024-09-14T11:51:39.330945+0000","last_peered":"2024-09-14T11:51:39.330945+0000","last_clean":"2024-09-14T11:51:39.330945+0000","last_became_active":"2024-09-14T11:09:53.022006+0000","last_became_peered":"2024-09-14T11:09:53.022006+0000","last_unstale":"2024-09-14T11:51:39.330945+0000","last_undegraded":"2024-09-14T11:51:39.330945+0000","last_fullsized":"2024-09-14T11:51:39.330945+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:49.069626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"264'217","reported_seq":744,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.027091+0000","last_change":"2024-09-14T11:09:55.024709+0000","last_active":"2024-09-14T11:52:29.027091+0000","last_peered":"2024-09-14T11:52:29.027091+0000","last_clean":"2024-09-14T11:52:29.027091+0000","last_became_active":"2024-09-14T11:09:55.023966+0000","last_became_peered":"2024-09-14T11:09:55.023966+0000","last_unstale":"2024-09-14T11:52:29.027091+0000","last_undegraded":"2024-09-14T11:52:29.027091+0000","last_fullsized":"2024-09-14T11:52:29.027091+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:34.668812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":224,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":295,"num_read_kb":259,"num_write":448,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"264'464","reported_seq":2168,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.103565+0000","last_change":"2024-09-14T11:09:46.982064+0000","last_active":"2024-09-14T11:53:43.103565+0000","last_peered":"2024-09-14T11:53:43.103565+0000","last_clean":"2024-09-14T11:53:43.103565+0000","last_became_active":"2024-09-14T11:09:46.981472+0000","last_became_peered":"2024-09-14T11:09:46.981472+0000","last_unstale":"2024-09-14T11:53:43.103565+0000","last_undegraded":"2024-09-14T11:53:43.103565+0000","last_fullsized":"2024-09-14T11:53:43.103565+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:06.355503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2625,"num_read_kb":2493,"num_write":542,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:18.309372+0000","last_change":"2024-09-14T11:09:38.679236+0000","last_active":"2024-09-14T11:51:18.309372+0000","last_peered":"2024-09-14T11:51:18.309372+0000","last_clean":"2024-09-14T11:51:18.309372+0000","last_became_active":"2024-09-14T11:09:36.110778+0000","last_became_peered":"2024-09-14T11:09:36.110778+0000","last_unstale":"2024-09-14T11:51:18.309372+0000","last_undegraded":"2024-09-14T11:51:18.309372+0000","last_fullsized":"2024-09-14T11:51:18.309372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:49.202249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001188634,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"264'181","reported_seq":778,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.516375+0000","last_change":"2024-09-14T11:09:45.215379+0000","last_active":"2024-09-14T11:53:57.516375+0000","last_peered":"2024-09-14T11:53:57.516375+0000","last_clean":"2024-09-14T11:53:57.516375+0000","last_became_active":"2024-09-14T11:09:45.214670+0000","last_became_peered":"2024-09-14T11:09:45.214670+0000","last_unstale":"2024-09-14T11:53:57.516375+0000","last_undegraded":"2024-09-14T11:53:57.516375+0000","last_fullsized":"2024-09-14T11:53:57.516375+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:31.182118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":427,"num_read_kb":11641,"num_write":795,"num_write_kb":32063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.300064+0000","last_change":"2024-09-14T11:09:48.969846+0000","last_active":"2024-09-14T11:50:58.300064+0000","last_peered":"2024-09-14T11:50:58.300064+0000","last_clean":"2024-09-14T11:50:58.300064+0000","last_became_active":"2024-09-14T11:09:48.968973+0000","last_became_peered":"2024-09-14T11:09:48.968973+0000","last_unstale":"2024-09-14T11:50:58.300064+0000","last_undegraded":"2024-09-14T11:50:58.300064+0000","last_fullsized":"2024-09-14T11:50:58.300064+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:16.223050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"264'234","reported_seq":1305,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.321387+0000","last_change":"2024-09-14T11:09:50.993349+0000","last_active":"2024-09-14T11:53:43.321387+0000","last_peered":"2024-09-14T11:53:43.321387+0000","last_clean":"2024-09-14T11:53:43.321387+0000","last_became_active":"2024-09-14T11:09:50.992589+0000","last_became_peered":"2024-09-14T11:09:50.992589+0000","last_unstale":"2024-09-14T11:53:43.321387+0000","last_undegraded":"2024-09-14T11:53:43.321387+0000","last_fullsized":"2024-09-14T11:53:43.321387+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:20.023339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":182,"num_read_kb":171,"num_write":149,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:33.127635+0000","last_change":"2024-09-14T11:09:53.008567+0000","last_active":"2024-09-14T11:51:33.127635+0000","last_peered":"2024-09-14T11:51:33.127635+0000","last_clean":"2024-09-14T11:51:33.127635+0000","last_became_active":"2024-09-14T11:09:53.007705+0000","last_became_peered":"2024-09-14T11:09:53.007705+0000","last_unstale":"2024-09-14T11:51:33.127635+0000","last_undegraded":"2024-09-14T11:51:33.127635+0000","last_fullsized":"2024-09-14T11:51:33.127635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:31.442222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"264'272","reported_seq":868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.845028+0000","last_change":"2024-09-14T11:09:55.014709+0000","last_active":"2024-09-14T11:52:29.845028+0000","last_peered":"2024-09-14T11:52:29.845028+0000","last_clean":"2024-09-14T11:52:29.845028+0000","last_became_active":"2024-09-14T11:09:55.013944+0000","last_became_peered":"2024-09-14T11:09:55.013944+0000","last_unstale":"2024-09-14T11:52:29.845028+0000","last_undegraded":"2024-09-14T11:52:29.845028+0000","last_fullsized":"2024-09-14T11:52:29.845028+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:31.373231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":495,"num_read_kb":519,"num_write":596,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"264'931","reported_seq":2815,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.038263+0000","last_change":"2024-09-14T11:09:46.982912+0000","last_active":"2024-09-14T11:52:29.038263+0000","last_peered":"2024-09-14T11:52:29.038263+0000","last_clean":"2024-09-14T11:52:29.038263+0000","last_became_active":"2024-09-14T11:09:46.982027+0000","last_became_peered":"2024-09-14T11:09:46.982027+0000","last_unstale":"2024-09-14T11:52:29.038263+0000","last_undegraded":"2024-09-14T11:52:29.038263+0000","last_fullsized":"2024-09-14T11:52:29.038263+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":900,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:07.510355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4697,"num_read_kb":4271,"num_write":1214,"num_write_kb":435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.325611+0000","last_change":"2024-09-14T11:09:38.140129+0000","last_active":"2024-09-14T11:51:19.325611+0000","last_peered":"2024-09-14T11:51:19.325611+0000","last_clean":"2024-09-14T11:51:19.325611+0000","last_became_active":"2024-09-14T11:09:36.887391+0000","last_became_peered":"2024-09-14T11:09:36.887391+0000","last_unstale":"2024-09-14T11:51:19.325611+0000","last_undegraded":"2024-09-14T11:51:19.325611+0000","last_fullsized":"2024-09-14T11:51:19.325611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:23.561067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023357849999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"264'262","reported_seq":907,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.452127+0000","last_change":"2024-09-14T11:09:45.206950+0000","last_active":"2024-09-14T11:53:57.452127+0000","last_peered":"2024-09-14T11:53:57.452127+0000","last_clean":"2024-09-14T11:53:57.452127+0000","last_became_active":"2024-09-14T11:09:45.206492+0000","last_became_peered":"2024-09-14T11:09:45.206492+0000","last_unstale":"2024-09-14T11:53:57.452127+0000","last_undegraded":"2024-09-14T11:53:57.452127+0000","last_fullsized":"2024-09-14T11:53:57.452127+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:09.076068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":656,"num_read_kb":889,"num_write":1198,"num_write_kb":16465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:33.313136+0000","last_change":"2024-09-14T11:09:48.977354+0000","last_active":"2024-09-14T11:51:33.313136+0000","last_peered":"2024-09-14T11:51:33.313136+0000","last_clean":"2024-09-14T11:51:33.313136+0000","last_became_active":"2024-09-14T11:09:48.976315+0000","last_became_peered":"2024-09-14T11:09:48.976315+0000","last_unstale":"2024-09-14T11:51:33.313136+0000","last_undegraded":"2024-09-14T11:51:33.313136+0000","last_fullsized":"2024-09-14T11:51:33.313136+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:11:27.454227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"264'121","reported_seq":658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:13.156135+0000","last_change":"2024-09-14T11:09:50.983682+0000","last_active":"2024-09-14T11:53:13.156135+0000","last_peered":"2024-09-14T11:53:13.156135+0000","last_clean":"2024-09-14T11:53:13.156135+0000","last_became_active":"2024-09-14T11:09:50.983126+0000","last_became_peered":"2024-09-14T11:09:50.983126+0000","last_unstale":"2024-09-14T11:53:13.156135+0000","last_undegraded":"2024-09-14T11:53:13.156135+0000","last_fullsized":"2024-09-14T11:53:13.156135+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:01.407533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:04.321826+0000","last_change":"2024-09-14T11:09:53.015879+0000","last_active":"2024-09-14T11:51:04.321826+0000","last_peered":"2024-09-14T11:51:04.321826+0000","last_clean":"2024-09-14T11:51:04.321826+0000","last_became_active":"2024-09-14T11:09:53.015100+0000","last_became_peered":"2024-09-14T11:09:53.015100+0000","last_unstale":"2024-09-14T11:51:04.321826+0000","last_undegraded":"2024-09-14T11:51:04.321826+0000","last_fullsized":"2024-09-14T11:51:04.321826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:14:31.622686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"264'126","reported_seq":676,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:27.192089+0000","last_change":"2024-09-14T11:09:55.025662+0000","last_active":"2024-09-14T11:52:27.192089+0000","last_peered":"2024-09-14T11:52:27.192089+0000","last_clean":"2024-09-14T11:52:27.192089+0000","last_became_active":"2024-09-14T11:09:55.025030+0000","last_became_peered":"2024-09-14T11:09:55.025030+0000","last_unstale":"2024-09-14T11:52:27.192089+0000","last_undegraded":"2024-09-14T11:52:27.192089+0000","last_fullsized":"2024-09-14T11:52:27.192089+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:47.329558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":244,"num_read_kb":234,"num_write":307,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"264'430","reported_seq":1972,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.026058+0000","last_change":"2024-09-14T11:09:46.982402+0000","last_active":"2024-09-14T11:52:09.026058+0000","last_peered":"2024-09-14T11:52:09.026058+0000","last_clean":"2024-09-14T11:52:09.026058+0000","last_became_active":"2024-09-14T11:09:46.981578+0000","last_became_peered":"2024-09-14T11:09:46.981578+0000","last_unstale":"2024-09-14T11:52:09.026058+0000","last_undegraded":"2024-09-14T11:52:09.026058+0000","last_fullsized":"2024-09-14T11:52:09.026058+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:46.587772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2336,"num_read_kb":2209,"num_write":501,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"264'234","reported_seq":872,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:50.925761+0000","last_change":"2024-09-14T11:09:45.216526+0000","last_active":"2024-09-14T11:51:50.925761+0000","last_peered":"2024-09-14T11:51:50.925761+0000","last_clean":"2024-09-14T11:51:50.925761+0000","last_became_active":"2024-09-14T11:09:45.216168+0000","last_became_peered":"2024-09-14T11:09:45.216168+0000","last_unstale":"2024-09-14T11:51:50.925761+0000","last_undegraded":"2024-09-14T11:51:50.925761+0000","last_fullsized":"2024-09-14T11:51:50.925761+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:50.757149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9476046,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":591,"num_read_kb":12394,"num_write":1036,"num_write_kb":24779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:18.129696+0000","last_change":"2024-09-14T11:09:38.679466+0000","last_active":"2024-09-14T11:51:18.129696+0000","last_peered":"2024-09-14T11:51:18.129696+0000","last_clean":"2024-09-14T11:51:18.129696+0000","last_became_active":"2024-09-14T11:09:36.887411+0000","last_became_peered":"2024-09-14T11:09:36.887411+0000","last_unstale":"2024-09-14T11:51:18.129696+0000","last_undegraded":"2024-09-14T11:51:18.129696+0000","last_fullsized":"2024-09-14T11:51:18.129696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:17.852943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001210341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:28.126561+0000","last_change":"2024-09-14T11:09:48.973058+0000","last_active":"2024-09-14T11:51:28.126561+0000","last_peered":"2024-09-14T11:51:28.126561+0000","last_clean":"2024-09-14T11:51:28.126561+0000","last_became_active":"2024-09-14T11:09:48.969262+0000","last_became_peered":"2024-09-14T11:09:48.969262+0000","last_unstale":"2024-09-14T11:51:28.126561+0000","last_undegraded":"2024-09-14T11:51:28.126561+0000","last_fullsized":"2024-09-14T11:51:28.126561+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:26.478140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"264'281","reported_seq":936,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.377807+0000","last_change":"2024-09-14T11:09:50.992720+0000","last_active":"2024-09-14T11:53:57.377807+0000","last_peered":"2024-09-14T11:53:57.377807+0000","last_clean":"2024-09-14T11:53:57.377807+0000","last_became_active":"2024-09-14T11:09:50.991958+0000","last_became_peered":"2024-09-14T11:09:50.991958+0000","last_unstale":"2024-09-14T11:53:57.377807+0000","last_undegraded":"2024-09-14T11:53:57.377807+0000","last_fullsized":"2024-09-14T11:53:57.377807+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:06.240758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26179,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1035,"num_read_kb":1185,"num_write":1534,"num_write_kb":1392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:34.110192+0000","last_change":"2024-09-14T11:09:53.002718+0000","last_active":"2024-09-14T11:51:34.110192+0000","last_peered":"2024-09-14T11:51:34.110192+0000","last_clean":"2024-09-14T11:51:34.110192+0000","last_became_active":"2024-09-14T11:09:53.001945+0000","last_became_peered":"2024-09-14T11:09:53.001945+0000","last_unstale":"2024-09-14T11:51:34.110192+0000","last_undegraded":"2024-09-14T11:51:34.110192+0000","last_fullsized":"2024-09-14T11:51:34.110192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:52.861043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"264'176","reported_seq":711,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:08.421243+0000","last_change":"2024-09-14T11:09:55.019726+0000","last_active":"2024-09-14T11:52:08.421243+0000","last_peered":"2024-09-14T11:52:08.421243+0000","last_clean":"2024-09-14T11:52:08.421243+0000","last_became_active":"2024-09-14T11:09:55.019043+0000","last_became_peered":"2024-09-14T11:09:55.019043+0000","last_unstale":"2024-09-14T11:52:08.421243+0000","last_undegraded":"2024-09-14T11:52:08.421243+0000","last_fullsized":"2024-09-14T11:52:08.421243+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:33.587845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":311,"num_read_kb":271,"num_write":434,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"264'392","reported_seq":1909,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.024097+0000","last_change":"2024-09-14T11:09:46.980131+0000","last_active":"2024-09-14T11:52:09.024097+0000","last_peered":"2024-09-14T11:52:09.024097+0000","last_clean":"2024-09-14T11:52:09.024097+0000","last_became_active":"2024-09-14T11:09:46.979673+0000","last_became_peered":"2024-09-14T11:09:46.979673+0000","last_unstale":"2024-09-14T11:52:09.024097+0000","last_undegraded":"2024-09-14T11:52:09.024097+0000","last_fullsized":"2024-09-14T11:52:09.024097+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:23.116963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2181,"num_read_kb":2077,"num_write":440,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"264'171","reported_seq":742,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.174113+0000","last_change":"2024-09-14T11:09:45.222105+0000","last_active":"2024-09-14T11:53:57.174113+0000","last_peered":"2024-09-14T11:53:57.174113+0000","last_clean":"2024-09-14T11:53:57.174113+0000","last_became_active":"2024-09-14T11:09:45.220512+0000","last_became_peered":"2024-09-14T11:09:45.220512+0000","last_unstale":"2024-09-14T11:53:57.174113+0000","last_undegraded":"2024-09-14T11:53:57.174113+0000","last_fullsized":"2024-09-14T11:53:57.174113+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:34.422225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655861,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":337,"num_read_kb":1928,"num_write":799,"num_write_kb":32938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:24.327126+0000","last_change":"2024-09-14T11:09:38.140706+0000","last_active":"2024-09-14T11:51:24.327126+0000","last_peered":"2024-09-14T11:51:24.327126+0000","last_clean":"2024-09-14T11:51:24.327126+0000","last_became_active":"2024-09-14T11:09:36.110624+0000","last_became_peered":"2024-09-14T11:09:36.110624+0000","last_unstale":"2024-09-14T11:51:24.327126+0000","last_undegraded":"2024-09-14T11:51:24.327126+0000","last_fullsized":"2024-09-14T11:51:24.327126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:03.769383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002569127,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:28.295129+0000","last_change":"2024-09-14T11:09:48.968649+0000","last_active":"2024-09-14T11:51:28.295129+0000","last_peered":"2024-09-14T11:51:28.295129+0000","last_clean":"2024-09-14T11:51:28.295129+0000","last_became_active":"2024-09-14T11:09:48.968130+0000","last_became_peered":"2024-09-14T11:09:48.968130+0000","last_unstale":"2024-09-14T11:51:28.295129+0000","last_undegraded":"2024-09-14T11:51:28.295129+0000","last_fullsized":"2024-09-14T11:51:28.295129+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:38.760974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"264'157","reported_seq":716,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:33.130356+0000","last_change":"2024-09-14T11:09:50.998266+0000","last_active":"2024-09-14T11:51:33.130356+0000","last_peered":"2024-09-14T11:51:33.130356+0000","last_clean":"2024-09-14T11:51:33.130356+0000","last_became_active":"2024-09-14T11:09:50.997665+0000","last_became_peered":"2024-09-14T11:09:50.997665+0000","last_unstale":"2024-09-14T11:51:33.130356+0000","last_undegraded":"2024-09-14T11:51:33.130356+0000","last_fullsized":"2024-09-14T11:51:33.130356+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:11.749451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":193,"num_read_kb":186,"num_write":126,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"264'803","reported_seq":2773,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.656674+0000","last_change":"2024-09-14T11:09:53.019274+0000","last_active":"2024-09-14T11:53:57.656674+0000","last_peered":"2024-09-14T11:53:57.656674+0000","last_clean":"2024-09-14T11:53:57.656674+0000","last_became_active":"2024-09-14T11:09:53.018558+0000","last_became_peered":"2024-09-14T11:09:53.018558+0000","last_unstale":"2024-09-14T11:53:57.656674+0000","last_undegraded":"2024-09-14T11:53:57.656674+0000","last_fullsized":"2024-09-14T11:53:57.656674+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:50.014596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"264'101","reported_seq":592,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:48.332986+0000","last_change":"2024-09-14T11:09:55.024161+0000","last_active":"2024-09-14T11:52:48.332986+0000","last_peered":"2024-09-14T11:52:48.332986+0000","last_clean":"2024-09-14T11:52:48.332986+0000","last_became_active":"2024-09-14T11:09:55.017739+0000","last_became_peered":"2024-09-14T11:09:55.017739+0000","last_unstale":"2024-09-14T11:52:48.332986+0000","last_undegraded":"2024-09-14T11:52:48.332986+0000","last_fullsized":"2024-09-14T11:52:48.332986+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:11.037869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":97,"num_read_kb":96,"num_write":232,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"264'1040","reported_seq":2573,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.647300+0000","last_change":"2024-09-14T11:09:46.963627+0000","last_active":"2024-09-14T11:52:29.647300+0000","last_peered":"2024-09-14T11:52:29.647300+0000","last_clean":"2024-09-14T11:52:29.647300+0000","last_became_active":"2024-09-14T11:09:46.958507+0000","last_became_peered":"2024-09-14T11:09:46.958507+0000","last_unstale":"2024-09-14T11:52:29.647300+0000","last_undegraded":"2024-09-14T11:52:29.647300+0000","last_fullsized":"2024-09-14T11:52:29.647300+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":1000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:27.643352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4784,"num_read_kb":4190,"num_write":1482,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"264'217","reported_seq":851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.496393+0000","last_change":"2024-09-14T11:09:45.217672+0000","last_active":"2024-09-14T11:53:57.496393+0000","last_peered":"2024-09-14T11:53:57.496393+0000","last_clean":"2024-09-14T11:53:57.496393+0000","last_became_active":"2024-09-14T11:09:45.217039+0000","last_became_peered":"2024-09-14T11:09:45.217039+0000","last_unstale":"2024-09-14T11:53:57.496393+0000","last_undegraded":"2024-09-14T11:53:57.496393+0000","last_fullsized":"2024-09-14T11:53:57.496393+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:21.713459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":539,"num_read_kb":14764,"num_write":981,"num_write_kb":31870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:48.117767+0000","last_change":"2024-09-14T11:09:38.679232+0000","last_active":"2024-09-14T11:50:48.117767+0000","last_peered":"2024-09-14T11:50:48.117767+0000","last_clean":"2024-09-14T11:50:48.117767+0000","last_became_active":"2024-09-14T11:09:36.106073+0000","last_became_peered":"2024-09-14T11:09:36.106073+0000","last_unstale":"2024-09-14T11:50:48.117767+0000","last_undegraded":"2024-09-14T11:50:48.117767+0000","last_fullsized":"2024-09-14T11:50:48.117767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:12.720860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012975129999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:29.328220+0000","last_change":"2024-09-14T11:09:48.970814+0000","last_active":"2024-09-14T11:51:29.328220+0000","last_peered":"2024-09-14T11:51:29.328220+0000","last_clean":"2024-09-14T11:51:29.328220+0000","last_became_active":"2024-09-14T11:09:48.970339+0000","last_became_peered":"2024-09-14T11:09:48.970339+0000","last_unstale":"2024-09-14T11:51:29.328220+0000","last_undegraded":"2024-09-14T11:51:29.328220+0000","last_fullsized":"2024-09-14T11:51:29.328220+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:13.911012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"264'121","reported_seq":652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:56.240192+0000","last_change":"2024-09-14T11:09:50.980619+0000","last_active":"2024-09-14T11:51:56.240192+0000","last_peered":"2024-09-14T11:51:56.240192+0000","last_clean":"2024-09-14T11:51:56.240192+0000","last_became_active":"2024-09-14T11:09:50.979827+0000","last_became_peered":"2024-09-14T11:09:50.979827+0000","last_unstale":"2024-09-14T11:51:56.240192+0000","last_undegraded":"2024-09-14T11:51:56.240192+0000","last_fullsized":"2024-09-14T11:51:56.240192+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:48.508635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":133,"num_read_kb":122,"num_write":94,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"264'802","reported_seq":2479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:56.910131+0000","last_change":"2024-09-14T11:09:53.008348+0000","last_active":"2024-09-14T11:53:56.910131+0000","last_peered":"2024-09-14T11:53:56.910131+0000","last_clean":"2024-09-14T11:53:56.910131+0000","last_became_active":"2024-09-14T11:09:53.007337+0000","last_became_peered":"2024-09-14T11:09:53.007337+0000","last_unstale":"2024-09-14T11:53:56.910131+0000","last_undegraded":"2024-09-14T11:53:56.910131+0000","last_fullsized":"2024-09-14T11:53:56.910131+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:03.521459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"264'267","reported_seq":793,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:02.141641+0000","last_change":"2024-09-14T11:09:55.012569+0000","last_active":"2024-09-14T11:52:02.141641+0000","last_peered":"2024-09-14T11:52:02.141641+0000","last_clean":"2024-09-14T11:52:02.141641+0000","last_became_active":"2024-09-14T11:09:55.011828+0000","last_became_peered":"2024-09-14T11:09:55.011828+0000","last_unstale":"2024-09-14T11:52:02.141641+0000","last_undegraded":"2024-09-14T11:52:02.141641+0000","last_fullsized":"2024-09-14T11:52:02.141641+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:06.262186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":359,"num_read_kb":349,"num_write":571,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"264'1160","reported_seq":2657,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.647384+0000","last_change":"2024-09-14T11:09:46.946333+0000","last_active":"2024-09-14T11:52:29.647384+0000","last_peered":"2024-09-14T11:52:29.647384+0000","last_clean":"2024-09-14T11:52:29.647384+0000","last_became_active":"2024-09-14T11:09:46.946010+0000","last_became_peered":"2024-09-14T11:09:46.946010+0000","last_unstale":"2024-09-14T11:52:29.647384+0000","last_undegraded":"2024-09-14T11:52:29.647384+0000","last_fullsized":"2024-09-14T11:52:29.647384+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":1100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:45.329444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5209,"num_read_kb":4587,"num_write":1598,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"264'207","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.520602+0000","last_change":"2024-09-14T11:09:45.213246+0000","last_active":"2024-09-14T11:53:57.520602+0000","last_peered":"2024-09-14T11:53:57.520602+0000","last_clean":"2024-09-14T11:53:57.520602+0000","last_became_active":"2024-09-14T11:09:45.212500+0000","last_became_peered":"2024-09-14T11:09:45.212500+0000","last_unstale":"2024-09-14T11:53:57.520602+0000","last_undegraded":"2024-09-14T11:53:57.520602+0000","last_fullsized":"2024-09-14T11:53:57.520602+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:35:58.594042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":655,"num_read_kb":3804,"num_write":900,"num_write_kb":25360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:49.317464+0000","last_change":"2024-09-14T11:09:38.140326+0000","last_active":"2024-09-14T11:50:49.317464+0000","last_peered":"2024-09-14T11:50:49.317464+0000","last_clean":"2024-09-14T11:50:49.317464+0000","last_became_active":"2024-09-14T11:09:36.108781+0000","last_became_peered":"2024-09-14T11:09:36.108781+0000","last_unstale":"2024-09-14T11:50:49.317464+0000","last_undegraded":"2024-09-14T11:50:49.317464+0000","last_fullsized":"2024-09-14T11:50:49.317464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:06.040461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002510581,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.132003+0000","last_change":"2024-09-14T11:09:48.971810+0000","last_active":"2024-09-14T11:51:53.132003+0000","last_peered":"2024-09-14T11:51:53.132003+0000","last_clean":"2024-09-14T11:51:53.132003+0000","last_became_active":"2024-09-14T11:09:48.970940+0000","last_became_peered":"2024-09-14T11:09:48.970940+0000","last_unstale":"2024-09-14T11:51:53.132003+0000","last_undegraded":"2024-09-14T11:51:53.132003+0000","last_fullsized":"2024-09-14T11:51:53.132003+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:57.505239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"264'311","reported_seq":1021,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.604156+0000","last_change":"2024-09-14T11:09:50.993096+0000","last_active":"2024-09-14T11:53:57.604156+0000","last_peered":"2024-09-14T11:53:57.604156+0000","last_clean":"2024-09-14T11:53:57.604156+0000","last_became_active":"2024-09-14T11:09:50.992374+0000","last_became_peered":"2024-09-14T11:09:50.992374+0000","last_unstale":"2024-09-14T11:53:57.604156+0000","last_undegraded":"2024-09-14T11:53:57.604156+0000","last_fullsized":"2024-09-14T11:53:57.604156+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:36.668946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20511,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":444,"num_read_kb":597,"num_write":216,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:33.127557+0000","last_change":"2024-09-14T11:09:53.004011+0000","last_active":"2024-09-14T11:51:33.127557+0000","last_peered":"2024-09-14T11:51:33.127557+0000","last_clean":"2024-09-14T11:51:33.127557+0000","last_became_active":"2024-09-14T11:09:53.002904+0000","last_became_peered":"2024-09-14T11:09:53.002904+0000","last_unstale":"2024-09-14T11:51:33.127557+0000","last_undegraded":"2024-09-14T11:51:33.127557+0000","last_fullsized":"2024-09-14T11:51:33.127557+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:43.359087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"264'131","reported_seq":631,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.024565+0000","last_change":"2024-09-14T11:09:55.014957+0000","last_active":"2024-09-14T11:53:43.024565+0000","last_peered":"2024-09-14T11:53:43.024565+0000","last_clean":"2024-09-14T11:53:43.024565+0000","last_became_active":"2024-09-14T11:09:55.014192+0000","last_became_peered":"2024-09-14T11:09:55.014192+0000","last_unstale":"2024-09-14T11:53:43.024565+0000","last_undegraded":"2024-09-14T11:53:43.024565+0000","last_fullsized":"2024-09-14T11:53:43.024565+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:45.779974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":303,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"264'162","reported_seq":744,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.795176+0000","last_change":"2024-09-14T11:09:55.015877+0000","last_active":"2024-09-14T11:52:29.795176+0000","last_peered":"2024-09-14T11:52:29.795176+0000","last_clean":"2024-09-14T11:52:29.795176+0000","last_became_active":"2024-09-14T11:09:55.015127+0000","last_became_peered":"2024-09-14T11:09:55.015127+0000","last_unstale":"2024-09-14T11:52:29.795176+0000","last_undegraded":"2024-09-14T11:52:29.795176+0000","last_fullsized":"2024-09-14T11:52:29.795176+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:49.733188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":313,"num_read_kb":285,"num_write":384,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"264'821","reported_seq":2478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.015985+0000","last_change":"2024-09-14T11:09:46.949040+0000","last_active":"2024-09-14T11:52:29.015985+0000","last_peered":"2024-09-14T11:52:29.015985+0000","last_clean":"2024-09-14T11:52:29.015985+0000","last_became_active":"2024-09-14T11:09:46.948706+0000","last_became_peered":"2024-09-14T11:09:46.948706+0000","last_unstale":"2024-09-14T11:52:29.015985+0000","last_undegraded":"2024-09-14T11:52:29.015985+0000","last_fullsized":"2024-09-14T11:52:29.015985+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":800,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:18.066498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4239,"num_read_kb":3866,"num_write":1097,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"264'188","reported_seq":829,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.876240+0000","last_change":"2024-09-14T11:09:45.201897+0000","last_active":"2024-09-14T11:50:58.876240+0000","last_peered":"2024-09-14T11:50:58.876240+0000","last_clean":"2024-09-14T11:50:58.876240+0000","last_became_active":"2024-09-14T11:09:45.201562+0000","last_became_peered":"2024-09-14T11:09:45.201562+0000","last_unstale":"2024-09-14T11:50:58.876240+0000","last_undegraded":"2024-09-14T11:50:58.876240+0000","last_fullsized":"2024-09-14T11:50:58.876240+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:04.521022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5904577,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":502,"num_read_kb":86083,"num_write":866,"num_write_kb":49236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.102271+0000","last_change":"2024-09-14T11:09:48.963401+0000","last_active":"2024-09-14T11:49:28.102271+0000","last_peered":"2024-09-14T11:49:28.102271+0000","last_clean":"2024-09-14T11:49:28.102271+0000","last_became_active":"2024-09-14T11:09:48.962619+0000","last_became_peered":"2024-09-14T11:09:48.962619+0000","last_unstale":"2024-09-14T11:49:28.102271+0000","last_undegraded":"2024-09-14T11:49:28.102271+0000","last_fullsized":"2024-09-14T11:49:28.102271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:52.738701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"264'171","reported_seq":740,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.219427+0000","last_change":"2024-09-14T11:09:50.996731+0000","last_active":"2024-09-14T11:53:57.219427+0000","last_peered":"2024-09-14T11:53:57.219427+0000","last_clean":"2024-09-14T11:53:57.219427+0000","last_became_active":"2024-09-14T11:09:50.996047+0000","last_became_peered":"2024-09-14T11:09:50.996047+0000","last_unstale":"2024-09-14T11:53:57.219427+0000","last_undegraded":"2024-09-14T11:53:57.219427+0000","last_fullsized":"2024-09-14T11:53:57.219427+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:30.833822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28669,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":205,"num_read_kb":341,"num_write":126,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:33.280880+0000","last_change":"2024-09-14T11:09:53.001072+0000","last_active":"2024-09-14T11:49:33.280880+0000","last_peered":"2024-09-14T11:49:33.280880+0000","last_clean":"2024-09-14T11:49:33.280880+0000","last_became_active":"2024-09-14T11:09:53.000339+0000","last_became_peered":"2024-09-14T11:09:53.000339+0000","last_unstale":"2024-09-14T11:49:33.280880+0000","last_undegraded":"2024-09-14T11:49:33.280880+0000","last_fullsized":"2024-09-14T11:49:33.280880+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:15.810620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"264'95","reported_seq":580,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:03.319786+0000","last_change":"2024-09-14T11:09:55.023250+0000","last_active":"2024-09-14T11:52:03.319786+0000","last_peered":"2024-09-14T11:52:03.319786+0000","last_clean":"2024-09-14T11:52:03.319786+0000","last_became_active":"2024-09-14T11:09:55.022477+0000","last_became_peered":"2024-09-14T11:09:55.022477+0000","last_unstale":"2024-09-14T11:52:03.319786+0000","last_undegraded":"2024-09-14T11:52:03.319786+0000","last_fullsized":"2024-09-14T11:52:03.319786+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:48.971105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":73,"num_write":206,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"264'413","reported_seq":1945,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.021893+0000","last_change":"2024-09-14T11:09:46.949256+0000","last_active":"2024-09-14T11:52:29.021893+0000","last_peered":"2024-09-14T11:52:29.021893+0000","last_clean":"2024-09-14T11:52:29.021893+0000","last_became_active":"2024-09-14T11:09:46.948572+0000","last_became_peered":"2024-09-14T11:09:46.948572+0000","last_unstale":"2024-09-14T11:52:29.021893+0000","last_undegraded":"2024-09-14T11:52:29.021893+0000","last_fullsized":"2024-09-14T11:52:29.021893+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:03.770405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2176,"num_read_kb":2078,"num_write":464,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"264'232","reported_seq":848,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:18.316297+0000","last_change":"2024-09-14T11:09:45.224440+0000","last_active":"2024-09-14T11:53:18.316297+0000","last_peered":"2024-09-14T11:53:18.316297+0000","last_clean":"2024-09-14T11:53:18.316297+0000","last_became_active":"2024-09-14T11:09:45.223324+0000","last_became_peered":"2024-09-14T11:09:45.223324+0000","last_unstale":"2024-09-14T11:53:18.316297+0000","last_undegraded":"2024-09-14T11:53:18.316297+0000","last_fullsized":"2024-09-14T11:53:18.316297+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:46.914684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655868,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":554,"num_read_kb":7834,"num_write":1127,"num_write_kb":26023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"35'3","reported_seq":978,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:56.637717+0000","last_change":"2024-09-14T11:09:48.969925+0000","last_active":"2024-09-14T11:53:56.637717+0000","last_peered":"2024-09-14T11:53:56.637717+0000","last_clean":"2024-09-14T11:53:56.637717+0000","last_became_active":"2024-09-14T11:09:48.968561+0000","last_became_peered":"2024-09-14T11:09:48.968561+0000","last_unstale":"2024-09-14T11:53:56.637717+0000","last_undegraded":"2024-09-14T11:53:56.637717+0000","last_fullsized":"2024-09-14T11:53:56.637717+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:29.015385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":728,"num_read_kb":726,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"264'44","reported_seq":545,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.132030+0000","last_change":"2024-09-14T11:09:50.981928+0000","last_active":"2024-09-14T11:51:53.132030+0000","last_peered":"2024-09-14T11:51:53.132030+0000","last_clean":"2024-09-14T11:51:53.132030+0000","last_became_active":"2024-09-14T11:09:50.981128+0000","last_became_peered":"2024-09-14T11:09:50.981128+0000","last_unstale":"2024-09-14T11:51:53.132030+0000","last_undegraded":"2024-09-14T11:51:53.132030+0000","last_fullsized":"2024-09-14T11:51:53.132030+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:25.003185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:34.082103+0000","last_change":"2024-09-14T11:09:53.007173+0000","last_active":"2024-09-14T11:49:34.082103+0000","last_peered":"2024-09-14T11:49:34.082103+0000","last_clean":"2024-09-14T11:49:34.082103+0000","last_became_active":"2024-09-14T11:09:53.006292+0000","last_became_peered":"2024-09-14T11:09:53.006292+0000","last_unstale":"2024-09-14T11:49:34.082103+0000","last_undegraded":"2024-09-14T11:49:34.082103+0000","last_fullsized":"2024-09-14T11:49:34.082103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:01.689414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"264'206","reported_seq":723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.013495+0000","last_change":"2024-09-14T11:09:55.015153+0000","last_active":"2024-09-14T11:52:29.013495+0000","last_peered":"2024-09-14T11:52:29.013495+0000","last_clean":"2024-09-14T11:52:29.013495+0000","last_became_active":"2024-09-14T11:09:55.014414+0000","last_became_peered":"2024-09-14T11:09:55.014414+0000","last_unstale":"2024-09-14T11:52:29.013495+0000","last_undegraded":"2024-09-14T11:52:29.013495+0000","last_fullsized":"2024-09-14T11:52:29.013495+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:10.146075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":294,"num_read_kb":289,"num_write":451,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"264'673","reported_seq":2427,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.161127+0000","last_change":"2024-09-14T11:09:46.963397+0000","last_active":"2024-09-14T11:52:12.161127+0000","last_peered":"2024-09-14T11:52:12.161127+0000","last_clean":"2024-09-14T11:52:12.161127+0000","last_became_active":"2024-09-14T11:09:46.962508+0000","last_became_peered":"2024-09-14T11:09:46.962508+0000","last_unstale":"2024-09-14T11:52:12.161127+0000","last_undegraded":"2024-09-14T11:52:12.161127+0000","last_fullsized":"2024-09-14T11:52:12.161127+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":600,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:44.240688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3732,"num_read_kb":3415,"num_write":933,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"264'180","reported_seq":781,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:54.100781+0000","last_change":"2024-09-14T11:09:45.207817+0000","last_active":"2024-09-14T11:50:54.100781+0000","last_peered":"2024-09-14T11:50:54.100781+0000","last_clean":"2024-09-14T11:50:54.100781+0000","last_became_active":"2024-09-14T11:09:45.206901+0000","last_became_peered":"2024-09-14T11:09:45.206901+0000","last_unstale":"2024-09-14T11:50:54.100781+0000","last_undegraded":"2024-09-14T11:50:54.100781+0000","last_fullsized":"2024-09-14T11:50:54.100781+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:29.534278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2134615,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":433,"num_read_kb":9258,"num_write":854,"num_write_kb":15949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:29.080988+0000","last_change":"2024-09-14T11:09:48.960157+0000","last_active":"2024-09-14T11:49:29.080988+0000","last_peered":"2024-09-14T11:49:29.080988+0000","last_clean":"2024-09-14T11:49:29.080988+0000","last_became_active":"2024-09-14T11:09:48.959413+0000","last_became_peered":"2024-09-14T11:09:48.959413+0000","last_unstale":"2024-09-14T11:49:29.080988+0000","last_undegraded":"2024-09-14T11:49:29.080988+0000","last_fullsized":"2024-09-14T11:49:29.080988+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:19.014844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"264'159","reported_seq":740,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.620906+0000","last_change":"2024-09-14T11:09:51.000219+0000","last_active":"2024-09-14T11:53:57.620906+0000","last_peered":"2024-09-14T11:53:57.620906+0000","last_clean":"2024-09-14T11:53:57.620906+0000","last_became_active":"2024-09-14T11:09:50.999585+0000","last_became_peered":"2024-09-14T11:09:50.999585+0000","last_unstale":"2024-09-14T11:53:57.620906+0000","last_undegraded":"2024-09-14T11:53:57.620906+0000","last_fullsized":"2024-09-14T11:53:57.620906+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:27.217391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7038,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":217,"num_read_kb":281,"num_write":118,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:33.253171+0000","last_change":"2024-09-14T11:09:53.019246+0000","last_active":"2024-09-14T11:49:33.253171+0000","last_peered":"2024-09-14T11:49:33.253171+0000","last_clean":"2024-09-14T11:49:33.253171+0000","last_became_active":"2024-09-14T11:09:53.018479+0000","last_became_peered":"2024-09-14T11:09:53.018479+0000","last_unstale":"2024-09-14T11:49:33.253171+0000","last_undegraded":"2024-09-14T11:49:33.253171+0000","last_fullsized":"2024-09-14T11:49:33.253171+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:01.598876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"264'128","reported_seq":631,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.390381+0000","last_change":"2024-09-14T11:09:55.029326+0000","last_active":"2024-09-14T11:52:29.390381+0000","last_peered":"2024-09-14T11:52:29.390381+0000","last_clean":"2024-09-14T11:52:29.390381+0000","last_became_active":"2024-09-14T11:09:55.028633+0000","last_became_peered":"2024-09-14T11:09:55.028633+0000","last_unstale":"2024-09-14T11:52:29.390381+0000","last_undegraded":"2024-09-14T11:52:29.390381+0000","last_fullsized":"2024-09-14T11:52:29.390381+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:48.218210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":141,"num_write":296,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"264'503","reported_seq":2213,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:10.824533+0000","last_change":"2024-09-14T11:09:46.964085+0000","last_active":"2024-09-14T11:52:10.824533+0000","last_peered":"2024-09-14T11:52:10.824533+0000","last_clean":"2024-09-14T11:52:10.824533+0000","last_became_active":"2024-09-14T11:09:46.962364+0000","last_became_peered":"2024-09-14T11:09:46.962364+0000","last_unstale":"2024-09-14T11:52:10.824533+0000","last_undegraded":"2024-09-14T11:52:10.824533+0000","last_fullsized":"2024-09-14T11:52:10.824533+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:39.362696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2859,"num_read_kb":2685,"num_write":625,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"264'227","reported_seq":847,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.102751+0000","last_change":"2024-09-14T11:09:45.208047+0000","last_active":"2024-09-14T11:53:57.102751+0000","last_peered":"2024-09-14T11:53:57.102751+0000","last_clean":"2024-09-14T11:53:57.102751+0000","last_became_active":"2024-09-14T11:09:45.206145+0000","last_became_peered":"2024-09-14T11:09:45.206145+0000","last_unstale":"2024-09-14T11:53:57.102751+0000","last_undegraded":"2024-09-14T11:53:57.102751+0000","last_fullsized":"2024-09-14T11:53:57.102751+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:19.451341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":553,"num_read_kb":30372,"num_write":894,"num_write_kb":16933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"35'4","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.912643+0000","last_change":"2024-09-14T11:09:48.964002+0000","last_active":"2024-09-14T11:53:43.912643+0000","last_peered":"2024-09-14T11:53:43.912643+0000","last_clean":"2024-09-14T11:53:43.912643+0000","last_became_active":"2024-09-14T11:09:48.963563+0000","last_became_peered":"2024-09-14T11:09:48.963563+0000","last_unstale":"2024-09-14T11:53:43.912643+0000","last_undegraded":"2024-09-14T11:53:43.912643+0000","last_fullsized":"2024-09-14T11:53:43.912643+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:45.473064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":1192,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"264'125","reported_seq":686,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.572726+0000","last_change":"2024-09-14T11:09:50.989001+0000","last_active":"2024-09-14T11:53:57.572726+0000","last_peered":"2024-09-14T11:53:57.572726+0000","last_clean":"2024-09-14T11:53:57.572726+0000","last_became_active":"2024-09-14T11:09:50.988286+0000","last_became_peered":"2024-09-14T11:09:50.988286+0000","last_unstale":"2024-09-14T11:53:57.572726+0000","last_undegraded":"2024-09-14T11:53:57.572726+0000","last_fullsized":"2024-09-14T11:53:57.572726+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:38.798725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5180,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":147,"num_read_kb":193,"num_write":70,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:33.280996+0000","last_change":"2024-09-14T11:09:53.007660+0000","last_active":"2024-09-14T11:49:33.280996+0000","last_peered":"2024-09-14T11:49:33.280996+0000","last_clean":"2024-09-14T11:49:33.280996+0000","last_became_active":"2024-09-14T11:09:53.006975+0000","last_became_peered":"2024-09-14T11:09:53.006975+0000","last_unstale":"2024-09-14T11:49:33.280996+0000","last_undegraded":"2024-09-14T11:49:33.280996+0000","last_fullsized":"2024-09-14T11:49:33.280996+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:46.501395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"264'597","reported_seq":2244,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.185358+0000","last_change":"2024-09-14T11:09:46.975318+0000","last_active":"2024-09-14T11:52:12.185358+0000","last_peered":"2024-09-14T11:52:12.185358+0000","last_clean":"2024-09-14T11:52:12.185358+0000","last_became_active":"2024-09-14T11:09:46.975017+0000","last_became_peered":"2024-09-14T11:09:46.975017+0000","last_unstale":"2024-09-14T11:52:12.185358+0000","last_undegraded":"2024-09-14T11:52:12.185358+0000","last_fullsized":"2024-09-14T11:52:12.185358+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":500,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:58.187359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3191,"num_read_kb":2927,"num_write":756,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"264'280","reported_seq":961,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.541700+0000","last_change":"2024-09-14T11:09:45.217804+0000","last_active":"2024-09-14T11:53:57.541700+0000","last_peered":"2024-09-14T11:53:57.541700+0000","last_clean":"2024-09-14T11:53:57.541700+0000","last_became_active":"2024-09-14T11:09:45.216742+0000","last_became_peered":"2024-09-14T11:09:45.216742+0000","last_unstale":"2024-09-14T11:53:57.541700+0000","last_undegraded":"2024-09-14T11:53:57.541700+0000","last_fullsized":"2024-09-14T11:53:57.541700+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:35.991962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":743,"num_read_kb":84606,"num_write":1211,"num_write_kb":44892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:58.135987+0000","last_change":"2024-09-14T11:09:48.966915+0000","last_active":"2024-09-14T11:51:58.135987+0000","last_peered":"2024-09-14T11:51:58.135987+0000","last_clean":"2024-09-14T11:51:58.135987+0000","last_became_active":"2024-09-14T11:09:48.966112+0000","last_became_peered":"2024-09-14T11:09:48.966112+0000","last_unstale":"2024-09-14T11:51:58.135987+0000","last_undegraded":"2024-09-14T11:51:58.135987+0000","last_fullsized":"2024-09-14T11:51:58.135987+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:36.703419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"264'209","reported_seq":832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.558418+0000","last_change":"2024-09-14T11:09:50.996090+0000","last_active":"2024-09-14T11:53:57.558418+0000","last_peered":"2024-09-14T11:53:57.558418+0000","last_clean":"2024-09-14T11:53:57.558418+0000","last_became_active":"2024-09-14T11:09:50.995279+0000","last_became_peered":"2024-09-14T11:09:50.995279+0000","last_unstale":"2024-09-14T11:53:57.558418+0000","last_undegraded":"2024-09-14T11:53:57.558418+0000","last_fullsized":"2024-09-14T11:53:57.558418+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:02.160055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27447,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":311,"num_read_kb":486,"num_write":198,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:54.086888+0000","last_change":"2024-09-14T11:09:53.003946+0000","last_active":"2024-09-14T11:49:54.086888+0000","last_peered":"2024-09-14T11:49:54.086888+0000","last_clean":"2024-09-14T11:49:54.086888+0000","last_became_active":"2024-09-14T11:09:53.002862+0000","last_became_peered":"2024-09-14T11:09:53.002862+0000","last_unstale":"2024-09-14T11:49:54.086888+0000","last_undegraded":"2024-09-14T11:49:54.086888+0000","last_fullsized":"2024-09-14T11:49:54.086888+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:50.669809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"264'167","reported_seq":666,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:33.637848+0000","last_change":"2024-09-14T11:09:55.024496+0000","last_active":"2024-09-14T11:51:33.637848+0000","last_peered":"2024-09-14T11:51:33.637848+0000","last_clean":"2024-09-14T11:51:33.637848+0000","last_became_active":"2024-09-14T11:09:55.023821+0000","last_became_peered":"2024-09-14T11:09:55.023821+0000","last_unstale":"2024-09-14T11:51:33.637848+0000","last_undegraded":"2024-09-14T11:51:33.637848+0000","last_fullsized":"2024-09-14T11:51:33.637848+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:18.416018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":195,"num_read_kb":205,"num_write":392,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"264'861","reported_seq":2612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:11.486672+0000","last_change":"2024-09-14T11:09:46.968180+0000","last_active":"2024-09-14T11:52:11.486672+0000","last_peered":"2024-09-14T11:52:11.486672+0000","last_clean":"2024-09-14T11:52:11.486672+0000","last_became_active":"2024-09-14T11:09:46.967144+0000","last_became_peered":"2024-09-14T11:09:46.967144+0000","last_unstale":"2024-09-14T11:52:11.486672+0000","last_undegraded":"2024-09-14T11:52:11.486672+0000","last_fullsized":"2024-09-14T11:52:11.486672+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":800,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:12.513360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4422,"num_read_kb":4033,"num_write":1158,"num_write_kb":453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"264'188","reported_seq":802,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.172773+0000","last_change":"2024-09-14T11:09:45.187524+0000","last_active":"2024-09-14T11:53:57.172773+0000","last_peered":"2024-09-14T11:53:57.172773+0000","last_clean":"2024-09-14T11:53:57.172773+0000","last_became_active":"2024-09-14T11:09:45.186745+0000","last_became_peered":"2024-09-14T11:09:45.186745+0000","last_unstale":"2024-09-14T11:53:57.172773+0000","last_undegraded":"2024-09-14T11:53:57.172773+0000","last_fullsized":"2024-09-14T11:53:57.172773+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:52.434620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":536,"num_read_kb":5513,"num_write":846,"num_write_kb":29456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:29.109137+0000","last_change":"2024-09-14T11:09:48.952351+0000","last_active":"2024-09-14T11:51:29.109137+0000","last_peered":"2024-09-14T11:51:29.109137+0000","last_clean":"2024-09-14T11:51:29.109137+0000","last_became_active":"2024-09-14T11:09:48.951908+0000","last_became_peered":"2024-09-14T11:09:48.951908+0000","last_unstale":"2024-09-14T11:51:29.109137+0000","last_undegraded":"2024-09-14T11:51:29.109137+0000","last_fullsized":"2024-09-14T11:51:29.109137+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:14:06.155760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"264'162","reported_seq":734,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.124733+0000","last_change":"2024-09-14T11:09:50.986099+0000","last_active":"2024-09-14T11:53:43.124733+0000","last_peered":"2024-09-14T11:53:43.124733+0000","last_clean":"2024-09-14T11:53:43.124733+0000","last_became_active":"2024-09-14T11:09:50.983553+0000","last_became_peered":"2024-09-14T11:09:50.983553+0000","last_unstale":"2024-09-14T11:53:43.124733+0000","last_undegraded":"2024-09-14T11:53:43.124733+0000","last_fullsized":"2024-09-14T11:53:43.124733+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:45.407677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15672,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":216,"num_read_kb":289,"num_write":140,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.110650+0000","last_change":"2024-09-14T11:09:53.024431+0000","last_active":"2024-09-14T11:49:53.110650+0000","last_peered":"2024-09-14T11:49:53.110650+0000","last_clean":"2024-09-14T11:49:53.110650+0000","last_became_active":"2024-09-14T11:09:53.023609+0000","last_became_peered":"2024-09-14T11:09:53.023609+0000","last_unstale":"2024-09-14T11:49:53.110650+0000","last_undegraded":"2024-09-14T11:49:53.110650+0000","last_fullsized":"2024-09-14T11:49:53.110650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:43.568040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"264'155","reported_seq":651,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:28.256688+0000","last_change":"2024-09-14T11:09:55.029184+0000","last_active":"2024-09-14T11:52:28.256688+0000","last_peered":"2024-09-14T11:52:28.256688+0000","last_clean":"2024-09-14T11:52:28.256688+0000","last_became_active":"2024-09-14T11:09:55.028344+0000","last_became_peered":"2024-09-14T11:09:55.028344+0000","last_unstale":"2024-09-14T11:52:28.256688+0000","last_undegraded":"2024-09-14T11:52:28.256688+0000","last_fullsized":"2024-09-14T11:52:28.256688+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:09.622914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1619,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":178,"num_read_kb":177,"num_write":459,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"264'844","reported_seq":2442,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.991688+0000","last_change":"2024-09-14T11:09:46.991793+0000","last_active":"2024-09-14T11:52:09.991688+0000","last_peered":"2024-09-14T11:52:09.991688+0000","last_clean":"2024-09-14T11:52:09.991688+0000","last_became_active":"2024-09-14T11:09:46.990923+0000","last_became_peered":"2024-09-14T11:09:46.990923+0000","last_unstale":"2024-09-14T11:52:09.991688+0000","last_undegraded":"2024-09-14T11:52:09.991688+0000","last_fullsized":"2024-09-14T11:52:09.991688+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":800,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:14.204773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4067,"num_read_kb":3661,"num_write":1092,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"264'164","reported_seq":749,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.511562+0000","last_change":"2024-09-14T11:09:45.201353+0000","last_active":"2024-09-14T11:53:57.511562+0000","last_peered":"2024-09-14T11:53:57.511562+0000","last_clean":"2024-09-14T11:53:57.511562+0000","last_became_active":"2024-09-14T11:09:45.201058+0000","last_became_peered":"2024-09-14T11:09:45.201058+0000","last_unstale":"2024-09-14T11:53:57.511562+0000","last_undegraded":"2024-09-14T11:53:57.511562+0000","last_fullsized":"2024-09-14T11:53:57.511562+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:57.653038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":358,"num_read_kb":4087,"num_write":735,"num_write_kb":11722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:49.085664+0000","last_change":"2024-09-14T11:09:48.969192+0000","last_active":"2024-09-14T11:49:49.085664+0000","last_peered":"2024-09-14T11:49:49.085664+0000","last_clean":"2024-09-14T11:49:49.085664+0000","last_became_active":"2024-09-14T11:09:48.968770+0000","last_became_peered":"2024-09-14T11:09:48.968770+0000","last_unstale":"2024-09-14T11:49:49.085664+0000","last_undegraded":"2024-09-14T11:49:49.085664+0000","last_fullsized":"2024-09-14T11:49:49.085664+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:32.471236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"264'133","reported_seq":705,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.302781+0000","last_change":"2024-09-14T11:09:50.999804+0000","last_active":"2024-09-14T11:53:57.302781+0000","last_peered":"2024-09-14T11:53:57.302781+0000","last_clean":"2024-09-14T11:53:57.302781+0000","last_became_active":"2024-09-14T11:09:50.999079+0000","last_became_peered":"2024-09-14T11:09:50.999079+0000","last_unstale":"2024-09-14T11:53:57.302781+0000","last_undegraded":"2024-09-14T11:53:57.302781+0000","last_fullsized":"2024-09-14T11:53:57.302781+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:44.334838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6871,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":175,"num_read_kb":247,"num_write":92,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:58.318675+0000","last_change":"2024-09-14T11:09:53.009600+0000","last_active":"2024-09-14T11:51:58.318675+0000","last_peered":"2024-09-14T11:51:58.318675+0000","last_clean":"2024-09-14T11:51:58.318675+0000","last_became_active":"2024-09-14T11:09:53.008952+0000","last_became_peered":"2024-09-14T11:09:53.008952+0000","last_unstale":"2024-09-14T11:51:58.318675+0000","last_undegraded":"2024-09-14T11:51:58.318675+0000","last_fullsized":"2024-09-14T11:51:58.318675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:04.350006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"264'141","reported_seq":633,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.047202+0000","last_change":"2024-09-14T11:09:55.029152+0000","last_active":"2024-09-14T11:53:44.047202+0000","last_peered":"2024-09-14T11:53:44.047202+0000","last_clean":"2024-09-14T11:53:44.047202+0000","last_became_active":"2024-09-14T11:09:55.028413+0000","last_became_peered":"2024-09-14T11:09:55.028413+0000","last_unstale":"2024-09-14T11:53:44.047202+0000","last_undegraded":"2024-09-14T11:53:44.047202+0000","last_fullsized":"2024-09-14T11:53:44.047202+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:42.297511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":142,"num_write":355,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"264'420","reported_seq":1977,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.106262+0000","last_change":"2024-09-14T11:09:46.987394+0000","last_active":"2024-09-14T11:53:43.106262+0000","last_peered":"2024-09-14T11:53:43.106262+0000","last_clean":"2024-09-14T11:53:43.106262+0000","last_became_active":"2024-09-14T11:09:46.986721+0000","last_became_peered":"2024-09-14T11:09:46.986721+0000","last_unstale":"2024-09-14T11:53:43.106262+0000","last_undegraded":"2024-09-14T11:53:43.106262+0000","last_fullsized":"2024-09-14T11:53:43.106262+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:07.328123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2241,"num_read_kb":2140,"num_write":472,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"264'227","reported_seq":831,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.554523+0000","last_change":"2024-09-14T11:09:45.212627+0000","last_active":"2024-09-14T11:53:57.554523+0000","last_peered":"2024-09-14T11:53:57.554523+0000","last_clean":"2024-09-14T11:53:57.554523+0000","last_became_active":"2024-09-14T11:09:45.211984+0000","last_became_peered":"2024-09-14T11:09:45.211984+0000","last_unstale":"2024-09-14T11:53:57.554523+0000","last_undegraded":"2024-09-14T11:53:57.554523+0000","last_fullsized":"2024-09-14T11:53:57.554523+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:55.366169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":505,"num_read_kb":8662,"num_write":1132,"num_write_kb":22372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.104342+0000","last_change":"2024-09-14T11:09:48.969193+0000","last_active":"2024-09-14T11:49:48.104342+0000","last_peered":"2024-09-14T11:49:48.104342+0000","last_clean":"2024-09-14T11:49:48.104342+0000","last_became_active":"2024-09-14T11:09:48.968459+0000","last_became_peered":"2024-09-14T11:09:48.968459+0000","last_unstale":"2024-09-14T11:49:48.104342+0000","last_undegraded":"2024-09-14T11:49:48.104342+0000","last_fullsized":"2024-09-14T11:49:48.104342+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:25.826727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"264'96","reported_seq":611,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:59.338693+0000","last_change":"2024-09-14T11:09:50.980469+0000","last_active":"2024-09-14T11:51:59.338693+0000","last_peered":"2024-09-14T11:51:59.338693+0000","last_clean":"2024-09-14T11:51:59.338693+0000","last_became_active":"2024-09-14T11:09:50.979749+0000","last_became_peered":"2024-09-14T11:09:50.979749+0000","last_unstale":"2024-09-14T11:51:59.338693+0000","last_undegraded":"2024-09-14T11:51:59.338693+0000","last_fullsized":"2024-09-14T11:51:59.338693+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:58.555300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":88,"num_read_kb":80,"num_write":70,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"264'783","reported_seq":4300,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:56.895525+0000","last_change":"2024-09-14T11:09:53.017293+0000","last_active":"2024-09-14T11:53:56.895525+0000","last_peered":"2024-09-14T11:53:56.895525+0000","last_clean":"2024-09-14T11:53:56.895525+0000","last_became_active":"2024-09-14T11:09:53.014955+0000","last_became_peered":"2024-09-14T11:09:53.014955+0000","last_unstale":"2024-09-14T11:53:56.895525+0000","last_undegraded":"2024-09-14T11:53:56.895525+0000","last_fullsized":"2024-09-14T11:53:56.895525+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:13.437678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"264'92","reported_seq":581,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.473000+0000","last_change":"2024-09-14T11:09:55.030910+0000","last_active":"2024-09-14T11:52:29.473000+0000","last_peered":"2024-09-14T11:52:29.473000+0000","last_clean":"2024-09-14T11:52:29.473000+0000","last_became_active":"2024-09-14T11:09:55.030211+0000","last_became_peered":"2024-09-14T11:09:55.030211+0000","last_unstale":"2024-09-14T11:52:29.473000+0000","last_undegraded":"2024-09-14T11:52:29.473000+0000","last_fullsized":"2024-09-14T11:52:29.473000+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:19.664371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":87,"num_write":222,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"264'455","reported_seq":1998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:27.186133+0000","last_change":"2024-09-14T11:09:46.975329+0000","last_active":"2024-09-14T11:52:27.186133+0000","last_peered":"2024-09-14T11:52:27.186133+0000","last_clean":"2024-09-14T11:52:27.186133+0000","last_became_active":"2024-09-14T11:09:46.974957+0000","last_became_peered":"2024-09-14T11:09:46.974957+0000","last_unstale":"2024-09-14T11:52:27.186133+0000","last_undegraded":"2024-09-14T11:52:27.186133+0000","last_fullsized":"2024-09-14T11:52:27.186133+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:48.632851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2398,"num_read_kb":2260,"num_write":532,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"264'303","reported_seq":995,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.473251+0000","last_change":"2024-09-14T11:09:45.205274+0000","last_active":"2024-09-14T11:53:57.473251+0000","last_peered":"2024-09-14T11:53:57.473251+0000","last_clean":"2024-09-14T11:53:57.473251+0000","last_became_active":"2024-09-14T11:09:45.204014+0000","last_became_peered":"2024-09-14T11:09:45.204014+0000","last_unstale":"2024-09-14T11:53:57.473251+0000","last_undegraded":"2024-09-14T11:53:57.473251+0000","last_fullsized":"2024-09-14T11:53:57.473251+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:53.629440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":844,"num_read_kb":35877,"num_write":1474,"num_write_kb":50924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.256593+0000","last_change":"2024-09-14T11:09:48.950935+0000","last_active":"2024-09-14T11:49:48.256593+0000","last_peered":"2024-09-14T11:49:48.256593+0000","last_clean":"2024-09-14T11:49:48.256593+0000","last_became_active":"2024-09-14T11:09:48.950445+0000","last_became_peered":"2024-09-14T11:09:48.950445+0000","last_unstale":"2024-09-14T11:49:48.256593+0000","last_undegraded":"2024-09-14T11:49:48.256593+0000","last_fullsized":"2024-09-14T11:49:48.256593+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:53.596593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"264'167","reported_seq":743,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.416290+0000","last_change":"2024-09-14T11:09:50.992957+0000","last_active":"2024-09-14T11:53:57.416290+0000","last_peered":"2024-09-14T11:53:57.416290+0000","last_clean":"2024-09-14T11:53:57.416290+0000","last_became_active":"2024-09-14T11:09:50.992216+0000","last_became_peered":"2024-09-14T11:09:50.992216+0000","last_unstale":"2024-09-14T11:53:57.416290+0000","last_undegraded":"2024-09-14T11:53:57.416290+0000","last_fullsized":"2024-09-14T11:53:57.416290+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:17.396343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59902,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":237,"num_read_kb":452,"num_write":144,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.119821+0000","last_change":"2024-09-14T11:09:53.024153+0000","last_active":"2024-09-14T11:50:58.119821+0000","last_peered":"2024-09-14T11:50:58.119821+0000","last_clean":"2024-09-14T11:50:58.119821+0000","last_became_active":"2024-09-14T11:09:53.023492+0000","last_became_peered":"2024-09-14T11:09:53.023492+0000","last_unstale":"2024-09-14T11:50:58.119821+0000","last_undegraded":"2024-09-14T11:50:58.119821+0000","last_fullsized":"2024-09-14T11:50:58.119821+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:38.239379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"264'112","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.759177+0000","last_change":"2024-09-14T11:09:55.027867+0000","last_active":"2024-09-14T11:52:12.759177+0000","last_peered":"2024-09-14T11:52:12.759177+0000","last_clean":"2024-09-14T11:52:12.759177+0000","last_became_active":"2024-09-14T11:09:55.027044+0000","last_became_peered":"2024-09-14T11:09:55.027044+0000","last_unstale":"2024-09-14T11:52:12.759177+0000","last_undegraded":"2024-09-14T11:52:12.759177+0000","last_fullsized":"2024-09-14T11:52:12.759177+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:52.809691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":137,"num_read_kb":126,"num_write":268,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"264'782","reported_seq":2408,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.105257+0000","last_change":"2024-09-14T11:09:46.981979+0000","last_active":"2024-09-14T11:53:43.105257+0000","last_peered":"2024-09-14T11:53:43.105257+0000","last_clean":"2024-09-14T11:53:43.105257+0000","last_became_active":"2024-09-14T11:09:46.981651+0000","last_became_peered":"2024-09-14T11:09:46.981651+0000","last_unstale":"2024-09-14T11:53:43.105257+0000","last_undegraded":"2024-09-14T11:53:43.105257+0000","last_fullsized":"2024-09-14T11:53:43.105257+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:26.806380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3785,"num_read_kb":3457,"num_write":1011,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"264'234","reported_seq":873,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.448644+0000","last_change":"2024-09-14T11:09:45.215434+0000","last_active":"2024-09-14T11:51:07.448644+0000","last_peered":"2024-09-14T11:51:07.448644+0000","last_clean":"2024-09-14T11:51:07.448644+0000","last_became_active":"2024-09-14T11:09:45.215127+0000","last_became_peered":"2024-09-14T11:09:45.215127+0000","last_unstale":"2024-09-14T11:51:07.448644+0000","last_undegraded":"2024-09-14T11:51:07.448644+0000","last_fullsized":"2024-09-14T11:51:07.448644+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:09.892252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10094310,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":577,"num_read_kb":34627,"num_write":1008,"num_write_kb":52307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:49.085600+0000","last_change":"2024-09-14T11:09:48.960423+0000","last_active":"2024-09-14T11:49:49.085600+0000","last_peered":"2024-09-14T11:49:49.085600+0000","last_clean":"2024-09-14T11:49:49.085600+0000","last_became_active":"2024-09-14T11:09:48.960006+0000","last_became_peered":"2024-09-14T11:09:48.960006+0000","last_unstale":"2024-09-14T11:49:49.085600+0000","last_undegraded":"2024-09-14T11:49:49.085600+0000","last_fullsized":"2024-09-14T11:49:49.085600+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:12.246125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"264'117","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.439357+0000","last_change":"2024-09-14T11:09:50.976371+0000","last_active":"2024-09-14T11:53:57.439357+0000","last_peered":"2024-09-14T11:53:57.439357+0000","last_clean":"2024-09-14T11:53:57.439357+0000","last_became_active":"2024-09-14T11:09:50.975555+0000","last_became_peered":"2024-09-14T11:09:50.975555+0000","last_unstale":"2024-09-14T11:53:57.439357+0000","last_undegraded":"2024-09-14T11:53:57.439357+0000","last_fullsized":"2024-09-14T11:53:57.439357+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:50.238466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5710,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":156,"num_read_kb":221,"num_write":78,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:04.321551+0000","last_change":"2024-09-14T11:09:53.015898+0000","last_active":"2024-09-14T11:51:04.321551+0000","last_peered":"2024-09-14T11:51:04.321551+0000","last_clean":"2024-09-14T11:51:04.321551+0000","last_became_active":"2024-09-14T11:09:53.015039+0000","last_became_peered":"2024-09-14T11:09:53.015039+0000","last_unstale":"2024-09-14T11:51:04.321551+0000","last_undegraded":"2024-09-14T11:51:04.321551+0000","last_fullsized":"2024-09-14T11:51:04.321551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:00.423028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"264'92","reported_seq":601,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:02.725541+0000","last_change":"2024-09-14T11:09:55.014762+0000","last_active":"2024-09-14T11:52:02.725541+0000","last_peered":"2024-09-14T11:52:02.725541+0000","last_clean":"2024-09-14T11:52:02.725541+0000","last_became_active":"2024-09-14T11:09:55.013997+0000","last_became_peered":"2024-09-14T11:09:55.013997+0000","last_unstale":"2024-09-14T11:52:02.725541+0000","last_undegraded":"2024-09-14T11:52:02.725541+0000","last_fullsized":"2024-09-14T11:52:02.725541+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:30.820459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":557,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":129,"num_write":227,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"264'1274","reported_seq":2882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.101805+0000","last_change":"2024-09-14T11:09:46.983515+0000","last_active":"2024-09-14T11:53:43.101805+0000","last_peered":"2024-09-14T11:53:43.101805+0000","last_clean":"2024-09-14T11:53:43.101805+0000","last_became_active":"2024-09-14T11:09:46.982770+0000","last_became_peered":"2024-09-14T11:09:46.982770+0000","last_unstale":"2024-09-14T11:53:43.101805+0000","last_undegraded":"2024-09-14T11:53:43.101805+0000","last_fullsized":"2024-09-14T11:53:43.101805+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":1200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:32.470386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5800,"num_read_kb":5089,"num_write":1775,"num_write_kb":736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"264'204","reported_seq":849,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.600404+0000","last_change":"2024-09-14T11:09:45.202528+0000","last_active":"2024-09-14T11:53:57.600404+0000","last_peered":"2024-09-14T11:53:57.600404+0000","last_clean":"2024-09-14T11:53:57.600404+0000","last_became_active":"2024-09-14T11:09:45.200971+0000","last_became_peered":"2024-09-14T11:09:45.200971+0000","last_unstale":"2024-09-14T11:53:57.600404+0000","last_undegraded":"2024-09-14T11:53:57.600404+0000","last_fullsized":"2024-09-14T11:53:57.600404+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:27.327496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3174623,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":502,"num_read_kb":61081,"num_write":905,"num_write_kb":39968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.270083+0000","last_change":"2024-09-14T11:09:48.958590+0000","last_active":"2024-09-14T11:50:53.270083+0000","last_peered":"2024-09-14T11:50:53.270083+0000","last_clean":"2024-09-14T11:50:53.270083+0000","last_became_active":"2024-09-14T11:09:48.958168+0000","last_became_peered":"2024-09-14T11:09:48.958168+0000","last_unstale":"2024-09-14T11:50:53.270083+0000","last_undegraded":"2024-09-14T11:50:53.270083+0000","last_fullsized":"2024-09-14T11:50:53.270083+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:39.133475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"264'105","reported_seq":658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.262062+0000","last_change":"2024-09-14T11:09:50.999672+0000","last_active":"2024-09-14T11:53:57.262062+0000","last_peered":"2024-09-14T11:53:57.262062+0000","last_clean":"2024-09-14T11:53:57.262062+0000","last_became_active":"2024-09-14T11:09:50.998951+0000","last_became_peered":"2024-09-14T11:09:50.998951+0000","last_unstale":"2024-09-14T11:53:57.262062+0000","last_undegraded":"2024-09-14T11:53:57.262062+0000","last_fullsized":"2024-09-14T11:53:57.262062+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:34.380499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":125,"num_read_kb":141,"num_write":60,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:54.302639+0000","last_change":"2024-09-14T11:09:53.022344+0000","last_active":"2024-09-14T11:49:54.302639+0000","last_peered":"2024-09-14T11:49:54.302639+0000","last_clean":"2024-09-14T11:49:54.302639+0000","last_became_active":"2024-09-14T11:09:53.021595+0000","last_became_peered":"2024-09-14T11:09:53.021595+0000","last_unstale":"2024-09-14T11:49:54.302639+0000","last_undegraded":"2024-09-14T11:49:54.302639+0000","last_fullsized":"2024-09-14T11:49:54.302639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:34.894553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"264'187","reported_seq":1643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:27.560080+0000","last_change":"2024-09-14T11:09:55.029111+0000","last_active":"2024-09-14T11:52:27.560080+0000","last_peered":"2024-09-14T11:52:27.560080+0000","last_clean":"2024-09-14T11:52:27.560080+0000","last_became_active":"2024-09-14T11:09:55.028374+0000","last_became_peered":"2024-09-14T11:09:55.028374+0000","last_unstale":"2024-09-14T11:52:27.560080+0000","last_undegraded":"2024-09-14T11:52:27.560080+0000","last_fullsized":"2024-09-14T11:52:27.560080+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:11.828167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":650,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1185,"num_read_kb":1180,"num_write":425,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"264'675","reported_seq":2433,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.024596+0000","last_change":"2024-09-14T11:09:46.946536+0000","last_active":"2024-09-14T11:52:09.024596+0000","last_peered":"2024-09-14T11:52:09.024596+0000","last_clean":"2024-09-14T11:52:09.024596+0000","last_became_active":"2024-09-14T11:09:46.946243+0000","last_became_peered":"2024-09-14T11:09:46.946243+0000","last_unstale":"2024-09-14T11:52:09.024596+0000","last_undegraded":"2024-09-14T11:52:09.024596+0000","last_fullsized":"2024-09-14T11:52:09.024596+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":600,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:11.897413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3815,"num_read_kb":3478,"num_write":980,"num_write_kb":450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"264'188","reported_seq":814,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.634720+0000","last_change":"2024-09-14T11:09:45.204307+0000","last_active":"2024-09-14T11:53:57.634720+0000","last_peered":"2024-09-14T11:53:57.634720+0000","last_clean":"2024-09-14T11:53:57.634720+0000","last_became_active":"2024-09-14T11:09:45.201929+0000","last_became_peered":"2024-09-14T11:09:45.201929+0000","last_unstale":"2024-09-14T11:53:57.634720+0000","last_undegraded":"2024-09-14T11:53:57.634720+0000","last_fullsized":"2024-09-14T11:53:57.634720+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:36.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":518,"num_read_kb":13061,"num_write":810,"num_write_kb":29760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.119882+0000","last_change":"2024-09-14T11:09:48.963841+0000","last_active":"2024-09-14T11:50:58.119882+0000","last_peered":"2024-09-14T11:50:58.119882+0000","last_clean":"2024-09-14T11:50:58.119882+0000","last_became_active":"2024-09-14T11:09:48.963104+0000","last_became_peered":"2024-09-14T11:09:48.963104+0000","last_unstale":"2024-09-14T11:50:58.119882+0000","last_undegraded":"2024-09-14T11:50:58.119882+0000","last_fullsized":"2024-09-14T11:50:58.119882+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:46.912247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"264'160","reported_seq":733,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.650625+0000","last_change":"2024-09-14T11:09:50.984507+0000","last_active":"2024-09-14T11:52:29.650625+0000","last_peered":"2024-09-14T11:52:29.650625+0000","last_clean":"2024-09-14T11:52:29.650625+0000","last_became_active":"2024-09-14T11:09:50.983753+0000","last_became_peered":"2024-09-14T11:09:50.983753+0000","last_unstale":"2024-09-14T11:52:29.650625+0000","last_undegraded":"2024-09-14T11:52:29.650625+0000","last_fullsized":"2024-09-14T11:52:29.650625+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:29.921471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":197,"num_read_kb":235,"num_write":112,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.105515+0000","last_change":"2024-09-14T11:09:53.011871+0000","last_active":"2024-09-14T11:49:53.105515+0000","last_peered":"2024-09-14T11:49:53.105515+0000","last_clean":"2024-09-14T11:49:53.105515+0000","last_became_active":"2024-09-14T11:09:53.011077+0000","last_became_peered":"2024-09-14T11:09:53.011077+0000","last_unstale":"2024-09-14T11:49:53.105515+0000","last_undegraded":"2024-09-14T11:49:53.105515+0000","last_fullsized":"2024-09-14T11:49:53.105515+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:50.394891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"264'163","reported_seq":662,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.100745+0000","last_change":"2024-09-14T11:09:55.022425+0000","last_active":"2024-09-14T11:53:43.100745+0000","last_peered":"2024-09-14T11:53:43.100745+0000","last_clean":"2024-09-14T11:53:43.100745+0000","last_became_active":"2024-09-14T11:09:55.021523+0000","last_became_peered":"2024-09-14T11:09:55.021523+0000","last_unstale":"2024-09-14T11:53:43.100745+0000","last_undegraded":"2024-09-14T11:53:43.100745+0000","last_fullsized":"2024-09-14T11:53:43.100745+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:10.987076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1072,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":209,"num_read_kb":183,"num_write":413,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"264'928","reported_seq":2647,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:05.437021+0000","last_change":"2024-09-14T11:09:46.957177+0000","last_active":"2024-09-14T11:52:05.437021+0000","last_peered":"2024-09-14T11:52:05.437021+0000","last_clean":"2024-09-14T11:52:05.437021+0000","last_became_active":"2024-09-14T11:09:46.951108+0000","last_became_peered":"2024-09-14T11:09:46.951108+0000","last_unstale":"2024-09-14T11:52:05.437021+0000","last_undegraded":"2024-09-14T11:52:05.437021+0000","last_fullsized":"2024-09-14T11:52:05.437021+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":900,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:15.810066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6915,"num_read_kb":6425,"num_write":1478,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"264'226","reported_seq":909,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:03.957306+0000","last_change":"2024-09-14T11:09:45.211877+0000","last_active":"2024-09-14T11:52:03.957306+0000","last_peered":"2024-09-14T11:52:03.957306+0000","last_clean":"2024-09-14T11:52:03.957306+0000","last_became_active":"2024-09-14T11:09:45.211372+0000","last_became_peered":"2024-09-14T11:09:45.211372+0000","last_unstale":"2024-09-14T11:52:03.957306+0000","last_undegraded":"2024-09-14T11:52:03.957306+0000","last_fullsized":"2024-09-14T11:52:03.957306+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:24.226008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485807,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":696,"num_read_kb":62622,"num_write":1038,"num_write_kb":26227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"264'1160","reported_seq":2864,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.122773+0000","last_change":"2024-09-14T11:09:46.972638+0000","last_active":"2024-09-14T11:53:43.122773+0000","last_peered":"2024-09-14T11:53:43.122773+0000","last_clean":"2024-09-14T11:53:43.122773+0000","last_became_active":"2024-09-14T11:09:46.970185+0000","last_became_peered":"2024-09-14T11:09:46.970185+0000","last_unstale":"2024-09-14T11:53:43.122773+0000","last_undegraded":"2024-09-14T11:53:43.122773+0000","last_fullsized":"2024-09-14T11:53:43.122773+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":1100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:13.563147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5490,"num_read_kb":4916,"num_write":1574,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"264'228","reported_seq":844,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.409706+0000","last_change":"2024-09-14T11:09:45.213947+0000","last_active":"2024-09-14T11:53:57.409706+0000","last_peered":"2024-09-14T11:53:57.409706+0000","last_clean":"2024-09-14T11:53:57.409706+0000","last_became_active":"2024-09-14T11:09:45.213238+0000","last_became_peered":"2024-09-14T11:09:45.213238+0000","last_unstale":"2024-09-14T11:53:57.409706+0000","last_undegraded":"2024-09-14T11:53:57.409706+0000","last_fullsized":"2024-09-14T11:53:57.409706+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:01.403575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":552,"num_read_kb":930,"num_write":1100,"num_write_kb":31959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"264'418","reported_seq":1946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.040689+0000","last_change":"2024-09-14T11:09:46.958429+0000","last_active":"2024-09-14T11:52:29.040689+0000","last_peered":"2024-09-14T11:52:29.040689+0000","last_clean":"2024-09-14T11:52:29.040689+0000","last_became_active":"2024-09-14T11:09:46.958063+0000","last_became_peered":"2024-09-14T11:09:46.958063+0000","last_unstale":"2024-09-14T11:52:29.040689+0000","last_undegraded":"2024-09-14T11:52:29.040689+0000","last_fullsized":"2024-09-14T11:52:29.040689+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:19.646752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2247,"num_read_kb":2131,"num_write":481,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"264'218","reported_seq":1029,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:41.626756+0000","last_change":"2024-09-14T11:09:45.217514+0000","last_active":"2024-09-14T11:51:41.626756+0000","last_peered":"2024-09-14T11:51:41.626756+0000","last_clean":"2024-09-14T11:51:41.626756+0000","last_became_active":"2024-09-14T11:09:45.217258+0000","last_became_peered":"2024-09-14T11:09:45.217258+0000","last_unstale":"2024-09-14T11:51:41.626756+0000","last_undegraded":"2024-09-14T11:51:41.626756+0000","last_fullsized":"2024-09-14T11:51:41.626756+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:19.368373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5739023,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1087,"num_read_kb":14899,"num_write":1040,"num_write_kb":43826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"264'404","reported_seq":1918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:01.518761+0000","last_change":"2024-09-14T11:09:46.988480+0000","last_active":"2024-09-14T11:52:01.518761+0000","last_peered":"2024-09-14T11:52:01.518761+0000","last_clean":"2024-09-14T11:52:01.518761+0000","last_became_active":"2024-09-14T11:09:46.987465+0000","last_became_peered":"2024-09-14T11:09:46.987465+0000","last_unstale":"2024-09-14T11:52:01.518761+0000","last_undegraded":"2024-09-14T11:52:01.518761+0000","last_fullsized":"2024-09-14T11:52:01.518761+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:19.420609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2188,"num_read_kb":2091,"num_write":479,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"264'210","reported_seq":821,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.435462+0000","last_change":"2024-09-14T11:09:45.211461+0000","last_active":"2024-09-14T11:53:57.435462+0000","last_peered":"2024-09-14T11:53:57.435462+0000","last_clean":"2024-09-14T11:53:57.435462+0000","last_became_active":"2024-09-14T11:09:45.210754+0000","last_became_peered":"2024-09-14T11:09:45.210754+0000","last_unstale":"2024-09-14T11:53:57.435462+0000","last_undegraded":"2024-09-14T11:53:57.435462+0000","last_fullsized":"2024-09-14T11:53:57.435462+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:08.664534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254321,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":979,"num_write":956,"num_write_kb":15237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"264'391","reported_seq":1908,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.025531+0000","last_change":"2024-09-14T11:09:46.975727+0000","last_active":"2024-09-14T11:52:09.025531+0000","last_peered":"2024-09-14T11:52:09.025531+0000","last_clean":"2024-09-14T11:52:09.025531+0000","last_became_active":"2024-09-14T11:09:46.975006+0000","last_became_peered":"2024-09-14T11:09:46.975006+0000","last_unstale":"2024-09-14T11:52:09.025531+0000","last_undegraded":"2024-09-14T11:52:09.025531+0000","last_fullsized":"2024-09-14T11:52:09.025531+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:24:31.291575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2194,"num_read_kb":2087,"num_write":454,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"264'203","reported_seq":819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.389057+0000","last_change":"2024-09-14T11:09:45.211325+0000","last_active":"2024-09-14T11:53:57.389057+0000","last_peered":"2024-09-14T11:53:57.389057+0000","last_clean":"2024-09-14T11:53:57.389057+0000","last_became_active":"2024-09-14T11:09:45.210639+0000","last_became_peered":"2024-09-14T11:09:45.210639+0000","last_unstale":"2024-09-14T11:53:57.389057+0000","last_undegraded":"2024-09-14T11:53:57.389057+0000","last_fullsized":"2024-09-14T11:53:57.389057+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:20.581618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655887,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":487,"num_read_kb":12081,"num_write":976,"num_write_kb":34333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"264'842","reported_seq":2510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.040766+0000","last_change":"2024-09-14T11:09:46.961466+0000","last_active":"2024-09-14T11:52:29.040766+0000","last_peered":"2024-09-14T11:52:29.040766+0000","last_clean":"2024-09-14T11:52:29.040766+0000","last_became_active":"2024-09-14T11:09:46.961185+0000","last_became_peered":"2024-09-14T11:09:46.961185+0000","last_unstale":"2024-09-14T11:52:29.040766+0000","last_undegraded":"2024-09-14T11:52:29.040766+0000","last_fullsized":"2024-09-14T11:52:29.040766+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:08.248591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4099,"num_read_kb":3707,"num_write":1108,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"264'190","reported_seq":798,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.410094+0000","last_change":"2024-09-14T11:09:45.220791+0000","last_active":"2024-09-14T11:53:57.410094+0000","last_peered":"2024-09-14T11:53:57.410094+0000","last_clean":"2024-09-14T11:53:57.410094+0000","last_became_active":"2024-09-14T11:09:45.220246+0000","last_became_peered":"2024-09-14T11:09:45.220246+0000","last_unstale":"2024-09-14T11:53:57.410094+0000","last_undegraded":"2024-09-14T11:53:57.410094+0000","last_fullsized":"2024-09-14T11:53:57.410094+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:36.399604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":452,"num_read_kb":10292,"num_write":865,"num_write_kb":29061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"264'671","reported_seq":2011,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.647214+0000","last_change":"2024-09-14T11:09:46.991359+0000","last_active":"2024-09-14T11:52:29.647214+0000","last_peered":"2024-09-14T11:52:29.647214+0000","last_clean":"2024-09-14T11:52:29.647214+0000","last_became_active":"2024-09-14T11:09:46.990649+0000","last_became_peered":"2024-09-14T11:09:46.990649+0000","last_unstale":"2024-09-14T11:52:29.647214+0000","last_undegraded":"2024-09-14T11:52:29.647214+0000","last_fullsized":"2024-09-14T11:52:29.647214+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":600,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:23.410718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3174,"num_read_kb":2866,"num_write":894,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"264'229","reported_seq":888,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:30.553802+0000","last_change":"2024-09-14T11:09:45.208096+0000","last_active":"2024-09-14T11:51:30.553802+0000","last_peered":"2024-09-14T11:51:30.553802+0000","last_clean":"2024-09-14T11:51:30.553802+0000","last_became_active":"2024-09-14T11:09:45.207500+0000","last_became_peered":"2024-09-14T11:09:45.207500+0000","last_unstale":"2024-09-14T11:51:30.553802+0000","last_undegraded":"2024-09-14T11:51:30.553802+0000","last_fullsized":"2024-09-14T11:51:30.553802+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:22.993861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5269028,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":639,"num_read_kb":28771,"num_write":1106,"num_write_kb":28685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"264'2088","reported_seq":3859,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:56.236839+0000","last_change":"2024-09-14T11:09:46.965260+0000","last_active":"2024-09-14T11:51:56.236839+0000","last_peered":"2024-09-14T11:51:56.236839+0000","last_clean":"2024-09-14T11:51:56.236839+0000","last_became_active":"2024-09-14T11:09:46.964893+0000","last_became_peered":"2024-09-14T11:09:46.964893+0000","last_unstale":"2024-09-14T11:51:56.236839+0000","last_undegraded":"2024-09-14T11:51:56.236839+0000","last_fullsized":"2024-09-14T11:51:56.236839+0000","mapping_epoch":25,"log_start":"264'2000","ondisk_log_start":"264'2000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":2000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:34.137174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9234,"num_read_kb":7993,"num_write":3022,"num_write_kb":1347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"264'280","reported_seq":979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.641420+0000","last_change":"2024-09-14T11:09:45.204674+0000","last_active":"2024-09-14T11:53:57.641420+0000","last_peered":"2024-09-14T11:53:57.641420+0000","last_clean":"2024-09-14T11:53:57.641420+0000","last_became_active":"2024-09-14T11:09:45.201951+0000","last_became_peered":"2024-09-14T11:09:45.201951+0000","last_unstale":"2024-09-14T11:53:57.641420+0000","last_undegraded":"2024-09-14T11:53:57.641420+0000","last_fullsized":"2024-09-14T11:53:57.641420+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:52.455396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655900,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":878,"num_read_kb":20954,"num_write":1195,"num_write_kb":48388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"264'393","reported_seq":1898,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:11.468367+0000","last_change":"2024-09-14T11:09:46.983040+0000","last_active":"2024-09-14T11:52:11.468367+0000","last_peered":"2024-09-14T11:52:11.468367+0000","last_clean":"2024-09-14T11:52:11.468367+0000","last_became_active":"2024-09-14T11:09:46.982125+0000","last_became_peered":"2024-09-14T11:09:46.982125+0000","last_unstale":"2024-09-14T11:52:11.468367+0000","last_undegraded":"2024-09-14T11:52:11.468367+0000","last_fullsized":"2024-09-14T11:52:11.468367+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:20.751819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2124,"num_read_kb":2027,"num_write":431,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"264'241","reported_seq":918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:11.388203+0000","last_change":"2024-09-14T11:09:45.220108+0000","last_active":"2024-09-14T11:52:11.388203+0000","last_peered":"2024-09-14T11:52:11.388203+0000","last_clean":"2024-09-14T11:52:11.388203+0000","last_became_active":"2024-09-14T11:09:45.219634+0000","last_became_peered":"2024-09-14T11:09:45.219634+0000","last_unstale":"2024-09-14T11:52:11.388203+0000","last_undegraded":"2024-09-14T11:52:11.388203+0000","last_fullsized":"2024-09-14T11:52:11.388203+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:17.207975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14933608,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":695,"num_read_kb":35580,"num_write":1134,"num_write_kb":63455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"264'544","reported_seq":2093,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:11.466077+0000","last_change":"2024-09-14T11:09:46.962608+0000","last_active":"2024-09-14T11:52:11.466077+0000","last_peered":"2024-09-14T11:52:11.466077+0000","last_clean":"2024-09-14T11:52:11.466077+0000","last_became_active":"2024-09-14T11:09:46.962261+0000","last_became_peered":"2024-09-14T11:09:46.962261+0000","last_unstale":"2024-09-14T11:52:11.466077+0000","last_undegraded":"2024-09-14T11:52:11.466077+0000","last_fullsized":"2024-09-14T11:52:11.466077+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:09.235080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2646,"num_read_kb":2439,"num_write":661,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"264'218","reported_seq":853,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.370857+0000","last_change":"2024-09-14T11:09:45.202616+0000","last_active":"2024-09-14T11:53:57.370857+0000","last_peered":"2024-09-14T11:53:57.370857+0000","last_clean":"2024-09-14T11:53:57.370857+0000","last_became_active":"2024-09-14T11:09:45.200775+0000","last_became_peered":"2024-09-14T11:09:45.200775+0000","last_unstale":"2024-09-14T11:53:57.370857+0000","last_undegraded":"2024-09-14T11:53:57.370857+0000","last_fullsized":"2024-09-14T11:53:57.370857+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:14:20.167362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":537,"num_read_kb":33597,"num_write":1024,"num_write_kb":35359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"264'563","reported_seq":2409,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.766645+0000","last_change":"2024-09-14T11:09:46.975288+0000","last_active":"2024-09-14T11:52:12.766645+0000","last_peered":"2024-09-14T11:52:12.766645+0000","last_clean":"2024-09-14T11:52:12.766645+0000","last_became_active":"2024-09-14T11:09:46.974543+0000","last_became_peered":"2024-09-14T11:09:46.974543+0000","last_unstale":"2024-09-14T11:52:12.766645+0000","last_undegraded":"2024-09-14T11:52:12.766645+0000","last_fullsized":"2024-09-14T11:52:12.766645+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:10.907592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3309,"num_read_kb":3115,"num_write":715,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"264'212","reported_seq":843,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.413859+0000","last_change":"2024-09-14T11:09:45.205037+0000","last_active":"2024-09-14T11:53:57.413859+0000","last_peered":"2024-09-14T11:53:57.413859+0000","last_clean":"2024-09-14T11:53:57.413859+0000","last_became_active":"2024-09-14T11:09:45.204754+0000","last_became_peered":"2024-09-14T11:09:45.204754+0000","last_unstale":"2024-09-14T11:53:57.413859+0000","last_undegraded":"2024-09-14T11:53:57.413859+0000","last_fullsized":"2024-09-14T11:53:57.413859+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:21.492270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":525,"num_read_kb":30401,"num_write":981,"num_write_kb":24964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"264'575","reported_seq":2323,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.768055+0000","last_change":"2024-09-14T11:09:46.965280+0000","last_active":"2024-09-14T11:52:12.768055+0000","last_peered":"2024-09-14T11:52:12.768055+0000","last_clean":"2024-09-14T11:52:12.768055+0000","last_became_active":"2024-09-14T11:09:46.964946+0000","last_became_peered":"2024-09-14T11:09:46.964946+0000","last_unstale":"2024-09-14T11:52:12.768055+0000","last_undegraded":"2024-09-14T11:52:12.768055+0000","last_fullsized":"2024-09-14T11:52:12.768055+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":500,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:37.727246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3099,"num_read_kb":2896,"num_write":721,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"264'213","reported_seq":900,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.494798+0000","last_change":"2024-09-14T11:09:45.192015+0000","last_active":"2024-09-14T11:53:57.494798+0000","last_peered":"2024-09-14T11:53:57.494798+0000","last_clean":"2024-09-14T11:53:57.494798+0000","last_became_active":"2024-09-14T11:09:45.191314+0000","last_became_peered":"2024-09-14T11:09:45.191314+0000","last_unstale":"2024-09-14T11:53:57.494798+0000","last_undegraded":"2024-09-14T11:53:57.494798+0000","last_fullsized":"2024-09-14T11:53:57.494798+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:59.041601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":695,"num_read_kb":24382,"num_write":1016,"num_write_kb":29533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"264'551","reported_seq":2029,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.646131+0000","last_change":"2024-09-14T11:09:46.994591+0000","last_active":"2024-09-14T11:52:29.646131+0000","last_peered":"2024-09-14T11:52:29.646131+0000","last_clean":"2024-09-14T11:52:29.646131+0000","last_became_active":"2024-09-14T11:09:46.994113+0000","last_became_peered":"2024-09-14T11:09:46.994113+0000","last_unstale":"2024-09-14T11:52:29.646131+0000","last_undegraded":"2024-09-14T11:52:29.646131+0000","last_fullsized":"2024-09-14T11:52:29.646131+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:14.044249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2807,"num_read_kb":2558,"num_write":736,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"264'221","reported_seq":815,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.452792+0000","last_change":"2024-09-14T11:09:45.219322+0000","last_active":"2024-09-14T11:53:57.452792+0000","last_peered":"2024-09-14T11:53:57.452792+0000","last_clean":"2024-09-14T11:53:57.452792+0000","last_became_active":"2024-09-14T11:09:45.214511+0000","last_became_peered":"2024-09-14T11:09:45.214511+0000","last_unstale":"2024-09-14T11:53:57.452792+0000","last_undegraded":"2024-09-14T11:53:57.452792+0000","last_fullsized":"2024-09-14T11:53:57.452792+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:52.501892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":484,"num_read_kb":9689,"num_write":1032,"num_write_kb":43578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"264'462","reported_seq":1938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.646695+0000","last_change":"2024-09-14T11:09:46.975025+0000","last_active":"2024-09-14T11:52:29.646695+0000","last_peered":"2024-09-14T11:52:29.646695+0000","last_clean":"2024-09-14T11:52:29.646695+0000","last_became_active":"2024-09-14T11:09:46.974152+0000","last_became_peered":"2024-09-14T11:09:46.974152+0000","last_unstale":"2024-09-14T11:52:29.646695+0000","last_undegraded":"2024-09-14T11:52:29.646695+0000","last_fullsized":"2024-09-14T11:52:29.646695+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:18.882062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2413,"num_read_kb":2245,"num_write":556,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"264'238","reported_seq":890,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:56.134617+0000","last_change":"2024-09-14T11:09:45.203506+0000","last_active":"2024-09-14T11:51:56.134617+0000","last_peered":"2024-09-14T11:51:56.134617+0000","last_clean":"2024-09-14T11:51:56.134617+0000","last_became_active":"2024-09-14T11:09:45.202934+0000","last_became_peered":"2024-09-14T11:09:45.202934+0000","last_unstale":"2024-09-14T11:51:56.134617+0000","last_undegraded":"2024-09-14T11:51:56.134617+0000","last_fullsized":"2024-09-14T11:51:56.134617+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:23.806980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8453539,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":629,"num_read_kb":75174,"num_write":1102,"num_write_kb":32522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"264'394","reported_seq":1908,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:10.846557+0000","last_change":"2024-09-14T11:09:46.947793+0000","last_active":"2024-09-14T11:52:10.846557+0000","last_peered":"2024-09-14T11:52:10.846557+0000","last_clean":"2024-09-14T11:52:10.846557+0000","last_became_active":"2024-09-14T11:09:46.946993+0000","last_became_peered":"2024-09-14T11:09:46.946993+0000","last_unstale":"2024-09-14T11:52:10.846557+0000","last_undegraded":"2024-09-14T11:52:10.846557+0000","last_fullsized":"2024-09-14T11:52:10.846557+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:47.133049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2163,"num_read_kb":2058,"num_write":443,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"264'190","reported_seq":805,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.321348+0000","last_change":"2024-09-14T11:09:45.217891+0000","last_active":"2024-09-14T11:53:57.321348+0000","last_peered":"2024-09-14T11:53:57.321348+0000","last_clean":"2024-09-14T11:53:57.321348+0000","last_became_active":"2024-09-14T11:09:45.217119+0000","last_became_peered":"2024-09-14T11:09:45.217119+0000","last_unstale":"2024-09-14T11:53:57.321348+0000","last_undegraded":"2024-09-14T11:53:57.321348+0000","last_fullsized":"2024-09-14T11:53:57.321348+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:40.436809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":19832,"num_write":847,"num_write_kb":31579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"264'827","reported_seq":2382,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:04.903866+0000","last_change":"2024-09-14T11:09:46.991150+0000","last_active":"2024-09-14T11:52:04.903866+0000","last_peered":"2024-09-14T11:52:04.903866+0000","last_clean":"2024-09-14T11:52:04.903866+0000","last_became_active":"2024-09-14T11:09:46.990899+0000","last_became_peered":"2024-09-14T11:09:46.990899+0000","last_unstale":"2024-09-14T11:52:04.903866+0000","last_undegraded":"2024-09-14T11:52:04.903866+0000","last_fullsized":"2024-09-14T11:52:04.903866+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:34:32.141931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3995,"num_read_kb":3582,"num_write":1122,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"264'238","reported_seq":939,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:54.900653+0000","last_change":"2024-09-14T11:09:45.215275+0000","last_active":"2024-09-14T11:51:54.900653+0000","last_peered":"2024-09-14T11:51:54.900653+0000","last_clean":"2024-09-14T11:51:54.900653+0000","last_became_active":"2024-09-14T11:09:45.214713+0000","last_became_peered":"2024-09-14T11:09:45.214713+0000","last_unstale":"2024-09-14T11:51:54.900653+0000","last_undegraded":"2024-09-14T11:51:54.900653+0000","last_fullsized":"2024-09-14T11:51:54.900653+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:49.671679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19529015,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":732,"num_read_kb":73896,"num_write":1169,"num_write_kb":36295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"264'146","reported_seq":837,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:06.135658+0000","last_change":"2024-09-14T11:09:45.202592+0000","last_active":"2024-09-14T11:51:06.135658+0000","last_peered":"2024-09-14T11:51:06.135658+0000","last_clean":"2024-09-14T11:51:06.135658+0000","last_became_active":"2024-09-14T11:09:45.202270+0000","last_became_peered":"2024-09-14T11:09:45.202270+0000","last_unstale":"2024-09-14T11:51:06.135658+0000","last_undegraded":"2024-09-14T11:51:06.135658+0000","last_fullsized":"2024-09-14T11:51:06.135658+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:26.117626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9789022,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":689,"num_read_kb":138365,"num_write":721,"num_write_kb":22161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"264'887","reported_seq":2644,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.109063+0000","last_change":"2024-09-14T11:09:46.947818+0000","last_active":"2024-09-14T11:53:43.109063+0000","last_peered":"2024-09-14T11:53:43.109063+0000","last_clean":"2024-09-14T11:53:43.109063+0000","last_became_active":"2024-09-14T11:09:46.947102+0000","last_became_peered":"2024-09-14T11:09:46.947102+0000","last_unstale":"2024-09-14T11:53:43.109063+0000","last_undegraded":"2024-09-14T11:53:43.109063+0000","last_fullsized":"2024-09-14T11:53:43.109063+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":800,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:59.879613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4492,"num_read_kb":4074,"num_write":1171,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"264'220","reported_seq":904,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.490553+0000","last_change":"2024-09-14T11:09:45.207476+0000","last_active":"2024-09-14T11:53:57.490553+0000","last_peered":"2024-09-14T11:53:57.490553+0000","last_clean":"2024-09-14T11:53:57.490553+0000","last_became_active":"2024-09-14T11:09:45.204922+0000","last_became_peered":"2024-09-14T11:09:45.204922+0000","last_unstale":"2024-09-14T11:53:57.490553+0000","last_undegraded":"2024-09-14T11:53:57.490553+0000","last_fullsized":"2024-09-14T11:53:57.490553+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:11.013663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":767,"num_read_kb":17805,"num_write":1021,"num_write_kb":50816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"264'494","reported_seq":2052,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.104268+0000","last_change":"2024-09-14T11:09:46.982184+0000","last_active":"2024-09-14T11:53:43.104268+0000","last_peered":"2024-09-14T11:53:43.104268+0000","last_clean":"2024-09-14T11:53:43.104268+0000","last_became_active":"2024-09-14T11:09:46.981819+0000","last_became_peered":"2024-09-14T11:09:46.981819+0000","last_unstale":"2024-09-14T11:53:43.104268+0000","last_undegraded":"2024-09-14T11:53:43.104268+0000","last_fullsized":"2024-09-14T11:53:43.104268+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:29:11.574907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2560,"num_read_kb":2380,"num_write":586,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10857,"num_read_kb":9179,"num_write":3115,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1006,"ondisk_log_size":1006,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15755,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":15151,"num_read_kb":14810,"num_write":17052,"num_write_kb":4979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1790,"ondisk_log_size":1790,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":753,"ondisk_log_size":753,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":402297,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":8293,"num_read_kb":10566,"num_write":5613,"num_write_kb":2805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":339968,"data_stored":41201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2011,"ondisk_log_size":2011,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2410,"num_read_kb":2876,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":220474,"num_read_kb":201951,"num_write":55880,"num_write_kb":19076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3974,"ondisk_log_size":3974,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":195922492,"num_objects":267,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":267,"num_whiteouts":0,"num_read":38866,"num_read_kb":2064001,"num_write":64443,"num_write_kb":2182336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":333086720,"data_stored":331843490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3510,"ondisk_log_size":3510,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":24117248,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":149,"num_read_kb":158488,"num_write":173,"num_write_kb":116383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33619968,"data_stored":33618017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":21023154,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":146,"num_read_kb":158381,"num_write":172,"num_write_kb":116383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":31510528,"data_stored":31508914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509978,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":385064,"kb_used_data":183128,"kb_used_omap":1,"kb_used_meta":201918,"kb_avail":93986776,"statfs":{"total":96636764160,"available":96242458624,"internally_reserved":0,"allocated":187523072,"data_stored":185739153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":206764487},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509980,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":262316,"kb_used_data":154780,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94109524,"statfs":{"total":96636764160,"available":96368152576,"internally_reserved":0,"allocated":158494720,"data_stored":156702545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542683,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":205048,"kb_used_data":7292,"kb_used_omap":1,"kb_used_meta":197694,"kb_avail":94166792,"statfs":{"total":96636764160,"available":96426795008,"internally_reserved":0,"allocated":7467008,"data_stored":5850366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":202439114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542681,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91608,"kb_used_data":20160,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94280232,"statfs":{"total":96636764160,"available":96542957568,"internally_reserved":0,"allocated":20643840,"data_stored":18990343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542681,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":377224,"kb_used_data":139176,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":93994616,"statfs":{"total":96636764160,"available":96250486784,"internally_reserved":0,"allocated":142516224,"data_stored":140684792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243726789},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542682,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148852,"kb_used_data":5284,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94222988,"statfs":{"total":96636764160,"available":96484339712,"internally_reserved":0,"allocated":5410816,"data_stored":3769131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542682,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":268940,"kb_used_data":16916,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94102900,"statfs":{"total":96636764160,"available":96361369600,"internally_reserved":0,"allocated":17321984,"data_stored":15666499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257948101},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542683,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":86764,"kb_used_data":15244,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94285076,"statfs":{"total":96636764160,"available":96547917824,"internally_reserved":0,"allocated":15609856,"data_stored":13878717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11948032,"data_stored":11766247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12473898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":128544768,"data_stored":128314323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":144977920,"data_stored":144741724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1753088,"data_stored":1656299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":19398656,"data_stored":19214635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10035200,"data_stored":9935327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3846144,"data_stored":3741037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":12044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":22743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":6024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":5138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":2784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5292032,"data_stored":5291307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26218496,"data_stored":26217607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12648448,"data_stored":12646497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:53:58.931 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T11:53:59.275 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:53:59.276 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":264,"fsid":"26f8926f-0d5e-4c48-adc1-d4f1601407fa","created":"2024-09-14T11:09:16.150194+0000","modified":"2024-09-14T11:38:51.541500+0000","last_up_change":"2024-09-14T11:09:28.039408+0000","last_in_change":"2024-09-14T11:09:18.416908+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":15,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T11:09:28.974599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T11:09:34.328460+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-14T11:09:43.342192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-14T11:09:45.533864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-14T11:09:47.085176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-14T11:09:49.061458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-14T11:09:51.008921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-14T11:09:53.150715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-14T11:26:02.907095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"255","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-14T11:27:37.368357+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"258","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-14T11:27:39.754995+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"261","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-14T11:38:48.577736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"264","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"164dcbb0-6fba-429d-99e1-e9cc27927100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1986152349},{"type":"v1","addr":"172.21.15.71:6801","nonce":1986152349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1986152349},{"type":"v1","addr":"172.21.15.71:6803","nonce":1986152349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":1986152349},{"type":"v1","addr":"172.21.15.71:6807","nonce":1986152349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1986152349},{"type":"v1","addr":"172.21.15.71:6805","nonce":1986152349}]},"public_addr":"172.21.15.71:6801/1986152349","cluster_addr":"172.21.15.71:6803/1986152349","heartbeat_back_addr":"172.21.15.71:6807/1986152349","heartbeat_front_addr":"172.21.15.71:6805/1986152349","state":["exists","up"]},{"osd":1,"uuid":"c5897a6a-29f0-4adf-bc9a-4bb3c6f1fef0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":1268087573},{"type":"v1","addr":"172.21.15.71:6809","nonce":1268087573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":1268087573},{"type":"v1","addr":"172.21.15.71:6811","nonce":1268087573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":1268087573},{"type":"v1","addr":"172.21.15.71:6815","nonce":1268087573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":1268087573},{"type":"v1","addr":"172.21.15.71:6813","nonce":1268087573}]},"public_addr":"172.21.15.71:6809/1268087573","cluster_addr":"172.21.15.71:6811/1268087573","heartbeat_back_addr":"172.21.15.71:6815/1268087573","heartbeat_front_addr":"172.21.15.71:6813/1268087573","state":["exists","up"]},{"osd":2,"uuid":"00e849be-fd02-41b9-8b44-96632fab0df7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2436891866},{"type":"v1","addr":"172.21.15.71:6825","nonce":2436891866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2436891866},{"type":"v1","addr":"172.21.15.71:6827","nonce":2436891866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2436891866},{"type":"v1","addr":"172.21.15.71:6831","nonce":2436891866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2436891866},{"type":"v1","addr":"172.21.15.71:6829","nonce":2436891866}]},"public_addr":"172.21.15.71:6825/2436891866","cluster_addr":"172.21.15.71:6827/2436891866","heartbeat_back_addr":"172.21.15.71:6831/2436891866","heartbeat_front_addr":"172.21.15.71:6829/2436891866","state":["exists","up"]},{"osd":3,"uuid":"10ac7c16-3217-45d5-8cba-e5009b98ec67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":60654820},{"type":"v1","addr":"172.21.15.71:6817","nonce":60654820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":60654820},{"type":"v1","addr":"172.21.15.71:6819","nonce":60654820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":60654820},{"type":"v1","addr":"172.21.15.71:6823","nonce":60654820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":60654820},{"type":"v1","addr":"172.21.15.71:6821","nonce":60654820}]},"public_addr":"172.21.15.71:6817/60654820","cluster_addr":"172.21.15.71:6819/60654820","heartbeat_back_addr":"172.21.15.71:6823/60654820","heartbeat_front_addr":"172.21.15.71:6821/60654820","state":["exists","up"]},{"osd":4,"uuid":"d6d6c280-cca0-40f4-9a37-ad61aad8553d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":2449482389},{"type":"v1","addr":"172.21.15.157:6825","nonce":2449482389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2449482389},{"type":"v1","addr":"172.21.15.157:6827","nonce":2449482389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":2449482389},{"type":"v1","addr":"172.21.15.157:6831","nonce":2449482389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":2449482389},{"type":"v1","addr":"172.21.15.157:6829","nonce":2449482389}]},"public_addr":"172.21.15.157:6825/2449482389","cluster_addr":"172.21.15.157:6827/2449482389","heartbeat_back_addr":"172.21.15.157:6831/2449482389","heartbeat_front_addr":"172.21.15.157:6829/2449482389","state":["exists","up"]},{"osd":5,"uuid":"4ba34dac-04b7-401f-80e4-17131ad5275f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":527702018},{"type":"v1","addr":"172.21.15.157:6809","nonce":527702018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":527702018},{"type":"v1","addr":"172.21.15.157:6811","nonce":527702018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":527702018},{"type":"v1","addr":"172.21.15.157:6815","nonce":527702018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":527702018},{"type":"v1","addr":"172.21.15.157:6813","nonce":527702018}]},"public_addr":"172.21.15.157:6809/527702018","cluster_addr":"172.21.15.157:6811/527702018","heartbeat_back_addr":"172.21.15.157:6815/527702018","heartbeat_front_addr":"172.21.15.157:6813/527702018","state":["exists","up"]},{"osd":6,"uuid":"93d2103c-c129-4a50-b6ed-adf9e62b7cac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1231501119},{"type":"v1","addr":"172.21.15.157:6817","nonce":1231501119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1231501119},{"type":"v1","addr":"172.21.15.157:6819","nonce":1231501119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1231501119},{"type":"v1","addr":"172.21.15.157:6823","nonce":1231501119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1231501119},{"type":"v1","addr":"172.21.15.157:6821","nonce":1231501119}]},"public_addr":"172.21.15.157:6817/1231501119","cluster_addr":"172.21.15.157:6819/1231501119","heartbeat_back_addr":"172.21.15.157:6823/1231501119","heartbeat_front_addr":"172.21.15.157:6821/1231501119","state":["exists","up"]},{"osd":7,"uuid":"87b80188-9ed1-428d-adbf-63102db355dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3420822707},{"type":"v1","addr":"172.21.15.157:6801","nonce":3420822707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3420822707},{"type":"v1","addr":"172.21.15.157:6803","nonce":3420822707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3420822707},{"type":"v1","addr":"172.21.15.157:6807","nonce":3420822707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3420822707},{"type":"v1","addr":"172.21.15.157:6805","nonce":3420822707}]},"public_addr":"172.21.15.157:6801/3420822707","cluster_addr":"172.21.15.157:6803/3420822707","heartbeat_back_addr":"172.21.15.157:6807/3420822707","heartbeat_front_addr":"172.21.15.157:6805/3420822707","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:09:24.750725+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:09:24.825357+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:09:25.213418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:09:25.473164+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:09:25.085301+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:09:24.874251+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:09:24.920771+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:09:25.051948+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3b","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:54:00.296 INFO:tasks.ceph:Scrubbing osd.0 2024-09-14T11:54:00.297 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:54:00.458 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T11:54:00.458 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:54:00.458 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T11:54:00.476 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-14T11:54:00.778 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 0 to deep-scrub 2024-09-14T11:54:00.798 INFO:tasks.ceph:Scrubbing osd.1 2024-09-14T11:54:00.798 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:54:00.944 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T11:54:00.944 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:54:00.944 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T11:54:00.959 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-14T11:54:01.234 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 1 to deep-scrub 2024-09-14T11:54:01.252 INFO:tasks.ceph:Scrubbing osd.2 2024-09-14T11:54:01.252 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:54:01.391 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T11:54:01.392 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:54:01.392 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T11:54:01.407 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-14T11:54:01.687 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 2 to deep-scrub 2024-09-14T11:54:01.706 INFO:tasks.ceph:Scrubbing osd.3 2024-09-14T11:54:01.706 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:54:01.850 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T11:54:01.850 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:54:01.850 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T11:54:01.866 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-14T11:54:02.151 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 3 to deep-scrub 2024-09-14T11:54:02.169 INFO:tasks.ceph:Scrubbing osd.4 2024-09-14T11:54:02.169 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:54:02.321 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T11:54:02.321 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:54:02.321 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T11:54:02.337 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-14T11:54:02.629 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 4 to deep-scrub 2024-09-14T11:54:02.650 INFO:tasks.ceph:Scrubbing osd.5 2024-09-14T11:54:02.650 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:54:02.794 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T11:54:02.794 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:54:02.794 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T11:54:02.809 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-14T11:54:03.102 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 5 to deep-scrub 2024-09-14T11:54:03.121 INFO:tasks.ceph:Scrubbing osd.6 2024-09-14T11:54:03.122 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:54:03.270 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T11:54:03.270 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:54:03.270 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T11:54:03.286 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-14T11:54:03.569 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 6 to deep-scrub 2024-09-14T11:54:03.587 INFO:tasks.ceph:Scrubbing osd.7 2024-09-14T11:54:03.588 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:54:03.733 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-14T11:54:03.733 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:54:03.733 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-14T11:54:03.749 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-14T11:54:04.030 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 7 to deep-scrub 2024-09-14T11:54:04.048 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:54:04.363 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:54:04.374 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-14T11:54:04.380 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":1594,"stamp":"2024-09-14T11:54:02.528599+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":41899528,"num_objects":636,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":636,"num_whiteouts":0,"num_read":296634,"num_read_kb":2620505,"num_write":146761,"num_write_kb":2444634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":200,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13536,"ondisk_log_size":13536,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1517852,"kb_used_data":233964,"kb_used_omap":12,"kb_used_meta":1283443,"kb_avail":753456868,"statfs":{"total":773094113280,"available":771539832832,"internally_reserved":0,"allocated":239579136,"data_stored":226110310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1314246193},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-578157383,"num_objects":-368,"num_object_clones":0,"num_object_copies":-736,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-368,"num_whiteouts":0,"num_read":730,"num_read_kb":778,"num_write":557,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006970"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.294070+0000","last_change":"2024-09-14T11:38:50.585610+0000","last_active":"2024-09-14T11:51:23.294070+0000","last_peered":"2024-09-14T11:51:23.294070+0000","last_clean":"2024-09-14T11:51:23.294070+0000","last_became_active":"2024-09-14T11:38:50.585084+0000","last_became_peered":"2024-09-14T11:38:50.585084+0000","last_unstale":"2024-09-14T11:51:23.294070+0000","last_undegraded":"2024-09-14T11:51:23.294070+0000","last_fullsized":"2024-09-14T11:51:23.294070+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:50.511838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.261823+0000","last_change":"2024-09-14T11:27:41.641807+0000","last_active":"2024-09-14T11:50:13.261823+0000","last_peered":"2024-09-14T11:50:13.261823+0000","last_clean":"2024-09-14T11:50:13.261823+0000","last_became_active":"2024-09-14T11:27:41.641034+0000","last_became_peered":"2024-09-14T11:27:41.641034+0000","last_unstale":"2024-09-14T11:50:13.261823+0000","last_undegraded":"2024-09-14T11:50:13.261823+0000","last_fullsized":"2024-09-14T11:50:13.261823+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:01.125992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"261'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.288469+0000","last_change":"2024-09-14T11:27:38.617636+0000","last_active":"2024-09-14T11:50:08.288469+0000","last_peered":"2024-09-14T11:50:08.288469+0000","last_clean":"2024-09-14T11:50:08.288469+0000","last_became_active":"2024-09-14T11:27:38.617019+0000","last_became_peered":"2024-09-14T11:27:38.617019+0000","last_unstale":"2024-09-14T11:50:08.288469+0000","last_undegraded":"2024-09-14T11:50:08.288469+0000","last_fullsized":"2024-09-14T11:50:08.288469+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:02.190657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"264'17","reported_seq":90,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.122298+0000","last_change":"2024-09-14T11:26:04.263404+0000","last_active":"2024-09-14T11:51:08.122298+0000","last_peered":"2024-09-14T11:51:08.122298+0000","last_clean":"2024-09-14T11:51:08.122298+0000","last_became_active":"2024-09-14T11:26:04.262003+0000","last_became_peered":"2024-09-14T11:26:04.262003+0000","last_unstale":"2024-09-14T11:51:08.122298+0000","last_undegraded":"2024-09-14T11:51:08.122298+0000","last_fullsized":"2024-09-14T11:51:08.122298+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:19.974639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":88,"num_write":45,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.127863+0000","last_change":"2024-09-14T11:38:50.592796+0000","last_active":"2024-09-14T11:51:23.127863+0000","last_peered":"2024-09-14T11:51:23.127863+0000","last_clean":"2024-09-14T11:51:23.127863+0000","last_became_active":"2024-09-14T11:38:50.592015+0000","last_became_peered":"2024-09-14T11:38:50.592015+0000","last_unstale":"2024-09-14T11:51:23.127863+0000","last_undegraded":"2024-09-14T11:51:23.127863+0000","last_fullsized":"2024-09-14T11:51:23.127863+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:43.698723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"264'4","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.126242+0000","last_change":"2024-09-14T11:27:41.643113+0000","last_active":"2024-09-14T11:52:44.126242+0000","last_peered":"2024-09-14T11:52:44.126242+0000","last_clean":"2024-09-14T11:52:44.126242+0000","last_became_active":"2024-09-14T11:27:41.642359+0000","last_became_peered":"2024-09-14T11:27:41.642359+0000","last_unstale":"2024-09-14T11:52:44.126242+0000","last_undegraded":"2024-09-14T11:52:44.126242+0000","last_fullsized":"2024-09-14T11:52:44.126242+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:14.671551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":4,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"264'5","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:38.147879+0000","last_change":"2024-09-14T11:27:38.602923+0000","last_active":"2024-09-14T11:52:38.147879+0000","last_peered":"2024-09-14T11:52:38.147879+0000","last_clean":"2024-09-14T11:52:38.147879+0000","last_became_active":"2024-09-14T11:27:38.597816+0000","last_became_peered":"2024-09-14T11:27:38.597816+0000","last_unstale":"2024-09-14T11:52:38.147879+0000","last_undegraded":"2024-09-14T11:52:38.147879+0000","last_fullsized":"2024-09-14T11:52:38.147879+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:36.668640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1028,"num_write":10,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"264'31","reported_seq":127,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.109991+0000","last_change":"2024-09-14T11:26:04.283737+0000","last_active":"2024-09-14T11:50:13.109991+0000","last_peered":"2024-09-14T11:50:13.109991+0000","last_clean":"2024-09-14T11:50:13.109991+0000","last_became_active":"2024-09-14T11:26:04.280237+0000","last_became_peered":"2024-09-14T11:26:04.280237+0000","last_unstale":"2024-09-14T11:50:13.109991+0000","last_undegraded":"2024-09-14T11:50:13.109991+0000","last_fullsized":"2024-09-14T11:50:13.109991+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:15.981498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":150,"num_write":82,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.271146+0000","last_change":"2024-09-14T11:38:50.574799+0000","last_active":"2024-09-14T11:50:58.271146+0000","last_peered":"2024-09-14T11:50:58.271146+0000","last_clean":"2024-09-14T11:50:58.271146+0000","last_became_active":"2024-09-14T11:38:50.574020+0000","last_became_peered":"2024-09-14T11:38:50.574020+0000","last_unstale":"2024-09-14T11:50:58.271146+0000","last_undegraded":"2024-09-14T11:50:58.271146+0000","last_fullsized":"2024-09-14T11:50:58.271146+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:52.985985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.120898+0000","last_change":"2024-09-14T11:27:41.646451+0000","last_active":"2024-09-14T11:50:38.120898+0000","last_peered":"2024-09-14T11:50:38.120898+0000","last_clean":"2024-09-14T11:50:38.120898+0000","last_became_active":"2024-09-14T11:27:41.645143+0000","last_became_peered":"2024-09-14T11:27:41.645143+0000","last_unstale":"2024-09-14T11:50:38.120898+0000","last_undegraded":"2024-09-14T11:50:38.120898+0000","last_fullsized":"2024-09-14T11:50:38.120898+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:34.278570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:38.314219+0000","last_change":"2024-09-14T11:27:38.620069+0000","last_active":"2024-09-14T11:51:38.314219+0000","last_peered":"2024-09-14T11:51:38.314219+0000","last_clean":"2024-09-14T11:51:38.314219+0000","last_became_active":"2024-09-14T11:27:38.619537+0000","last_became_peered":"2024-09-14T11:27:38.619537+0000","last_unstale":"2024-09-14T11:51:38.314219+0000","last_undegraded":"2024-09-14T11:51:38.314219+0000","last_fullsized":"2024-09-14T11:51:38.314219+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:49.847960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"264'124","reported_seq":411,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.124673+0000","last_change":"2024-09-14T11:26:04.282980+0000","last_active":"2024-09-14T11:51:08.124673+0000","last_peered":"2024-09-14T11:51:08.124673+0000","last_clean":"2024-09-14T11:51:08.124673+0000","last_became_active":"2024-09-14T11:26:04.279472+0000","last_became_peered":"2024-09-14T11:26:04.279472+0000","last_unstale":"2024-09-14T11:51:08.124673+0000","last_undegraded":"2024-09-14T11:51:08.124673+0000","last_fullsized":"2024-09-14T11:51:08.124673+0000","mapping_epoch":253,"log_start":"261'100","ondisk_log_start":"261'100","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:01.809787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1140,"num_read_kb":1229,"num_write":251,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.126235+0000","last_change":"2024-09-14T11:38:50.588516+0000","last_active":"2024-09-14T11:51:03.126235+0000","last_peered":"2024-09-14T11:51:03.126235+0000","last_clean":"2024-09-14T11:51:03.126235+0000","last_became_active":"2024-09-14T11:38:50.587700+0000","last_became_peered":"2024-09-14T11:38:50.587700+0000","last_unstale":"2024-09-14T11:51:03.126235+0000","last_undegraded":"2024-09-14T11:51:03.126235+0000","last_fullsized":"2024-09-14T11:51:03.126235+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:40.939286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"264'8","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.513753+0000","last_change":"2024-09-14T11:27:41.645646+0000","last_active":"2024-09-14T11:53:57.513753+0000","last_peered":"2024-09-14T11:53:57.513753+0000","last_clean":"2024-09-14T11:53:57.513753+0000","last_became_active":"2024-09-14T11:27:41.644919+0000","last_became_peered":"2024-09-14T11:27:41.644919+0000","last_unstale":"2024-09-14T11:53:57.513753+0000","last_undegraded":"2024-09-14T11:53:57.513753+0000","last_fullsized":"2024-09-14T11:53:57.513753+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:48.076358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"264'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:38.292883+0000","last_change":"2024-09-14T11:27:38.610209+0000","last_active":"2024-09-14T11:52:38.292883+0000","last_peered":"2024-09-14T11:52:38.292883+0000","last_clean":"2024-09-14T11:52:38.292883+0000","last_became_active":"2024-09-14T11:27:38.609445+0000","last_became_peered":"2024-09-14T11:27:38.609445+0000","last_unstale":"2024-09-14T11:52:38.292883+0000","last_undegraded":"2024-09-14T11:52:38.292883+0000","last_fullsized":"2024-09-14T11:52:38.292883+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:01.517926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"264'61","reported_seq":213,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.124618+0000","last_change":"2024-09-14T11:26:04.283422+0000","last_active":"2024-09-14T11:51:08.124618+0000","last_peered":"2024-09-14T11:51:08.124618+0000","last_clean":"2024-09-14T11:51:08.124618+0000","last_became_active":"2024-09-14T11:26:04.282662+0000","last_became_peered":"2024-09-14T11:26:04.282662+0000","last_unstale":"2024-09-14T11:51:08.124618+0000","last_undegraded":"2024-09-14T11:51:08.124618+0000","last_fullsized":"2024-09-14T11:51:08.124618+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:05.753210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":527,"num_read_kb":359,"num_write":147,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.298593+0000","last_change":"2024-09-14T11:38:50.586486+0000","last_active":"2024-09-14T11:50:53.298593+0000","last_peered":"2024-09-14T11:50:53.298593+0000","last_clean":"2024-09-14T11:50:53.298593+0000","last_became_active":"2024-09-14T11:38:50.582489+0000","last_became_peered":"2024-09-14T11:38:50.582489+0000","last_unstale":"2024-09-14T11:50:53.298593+0000","last_undegraded":"2024-09-14T11:50:53.298593+0000","last_fullsized":"2024-09-14T11:50:53.298593+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:07.012027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.269333+0000","last_change":"2024-09-14T11:27:41.647192+0000","last_active":"2024-09-14T11:49:28.269333+0000","last_peered":"2024-09-14T11:49:28.269333+0000","last_clean":"2024-09-14T11:49:28.269333+0000","last_became_active":"2024-09-14T11:27:41.645724+0000","last_became_peered":"2024-09-14T11:27:41.645724+0000","last_unstale":"2024-09-14T11:49:28.269333+0000","last_undegraded":"2024-09-14T11:49:28.269333+0000","last_fullsized":"2024-09-14T11:49:28.269333+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:16.835815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"264'3","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:48.136550+0000","last_change":"2024-09-14T11:27:38.606708+0000","last_active":"2024-09-14T11:51:48.136550+0000","last_peered":"2024-09-14T11:51:48.136550+0000","last_clean":"2024-09-14T11:51:48.136550+0000","last_became_active":"2024-09-14T11:27:38.605937+0000","last_became_peered":"2024-09-14T11:27:38.605937+0000","last_unstale":"2024-09-14T11:51:48.136550+0000","last_undegraded":"2024-09-14T11:51:48.136550+0000","last_fullsized":"2024-09-14T11:51:48.136550+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:01.152788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"264'12","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.124495+0000","last_change":"2024-09-14T11:26:04.279565+0000","last_active":"2024-09-14T11:51:08.124495+0000","last_peered":"2024-09-14T11:51:08.124495+0000","last_clean":"2024-09-14T11:51:08.124495+0000","last_became_active":"2024-09-14T11:26:04.278457+0000","last_became_peered":"2024-09-14T11:26:04.278457+0000","last_unstale":"2024-09-14T11:51:08.124495+0000","last_undegraded":"2024-09-14T11:51:08.124495+0000","last_fullsized":"2024-09-14T11:51:08.124495+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:36.957690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":56,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.125380+0000","last_change":"2024-09-14T11:38:50.576845+0000","last_active":"2024-09-14T11:51:23.125380+0000","last_peered":"2024-09-14T11:51:23.125380+0000","last_clean":"2024-09-14T11:51:23.125380+0000","last_became_active":"2024-09-14T11:38:50.576125+0000","last_became_peered":"2024-09-14T11:38:50.576125+0000","last_unstale":"2024-09-14T11:51:23.125380+0000","last_undegraded":"2024-09-14T11:51:23.125380+0000","last_fullsized":"2024-09-14T11:51:23.125380+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:08.428909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"264'4","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:54.336711+0000","last_change":"2024-09-14T11:27:41.661526+0000","last_active":"2024-09-14T11:51:54.336711+0000","last_peered":"2024-09-14T11:51:54.336711+0000","last_clean":"2024-09-14T11:51:54.336711+0000","last_became_active":"2024-09-14T11:27:41.660702+0000","last_became_peered":"2024-09-14T11:27:41.660702+0000","last_unstale":"2024-09-14T11:51:54.336711+0000","last_undegraded":"2024-09-14T11:51:54.336711+0000","last_fullsized":"2024-09-14T11:51:54.336711+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:11.563164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"264'11","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.350207+0000","last_change":"2024-09-14T11:27:38.603652+0000","last_active":"2024-09-14T11:53:57.350207+0000","last_peered":"2024-09-14T11:53:57.350207+0000","last_clean":"2024-09-14T11:53:57.350207+0000","last_became_active":"2024-09-14T11:27:38.602908+0000","last_became_peered":"2024-09-14T11:27:38.602908+0000","last_unstale":"2024-09-14T11:53:57.350207+0000","last_undegraded":"2024-09-14T11:53:57.350207+0000","last_fullsized":"2024-09-14T11:53:57.350207+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:54.757602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":15360,"num_write":16,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"264'30","reported_seq":126,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:04.102933+0000","last_change":"2024-09-14T11:26:04.259271+0000","last_active":"2024-09-14T11:51:04.102933+0000","last_peered":"2024-09-14T11:51:04.102933+0000","last_clean":"2024-09-14T11:51:04.102933+0000","last_became_active":"2024-09-14T11:26:04.258048+0000","last_became_peered":"2024-09-14T11:26:04.258048+0000","last_unstale":"2024-09-14T11:51:04.102933+0000","last_undegraded":"2024-09-14T11:51:04.102933+0000","last_fullsized":"2024-09-14T11:51:04.102933+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:36.508914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":248,"num_read_kb":161,"num_write":75,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:24.107804+0000","last_change":"2024-09-14T11:38:50.591472+0000","last_active":"2024-09-14T11:51:24.107804+0000","last_peered":"2024-09-14T11:51:24.107804+0000","last_clean":"2024-09-14T11:51:24.107804+0000","last_became_active":"2024-09-14T11:38:50.590496+0000","last_became_peered":"2024-09-14T11:38:50.590496+0000","last_unstale":"2024-09-14T11:51:24.107804+0000","last_undegraded":"2024-09-14T11:51:24.107804+0000","last_fullsized":"2024-09-14T11:51:24.107804+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:59.200308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"264'11","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.038662+0000","last_change":"2024-09-14T11:27:41.637007+0000","last_active":"2024-09-14T11:53:57.038662+0000","last_peered":"2024-09-14T11:53:57.038662+0000","last_clean":"2024-09-14T11:53:57.038662+0000","last_became_active":"2024-09-14T11:27:41.635495+0000","last_became_peered":"2024-09-14T11:27:41.635495+0000","last_unstale":"2024-09-14T11:53:57.038662+0000","last_undegraded":"2024-09-14T11:53:57.038662+0000","last_fullsized":"2024-09-14T11:53:57.038662+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:07.509871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":12817,"num_write":26,"num_write_kb":12817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"264'2","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:38.309929+0000","last_change":"2024-09-14T11:27:38.594325+0000","last_active":"2024-09-14T11:52:38.309929+0000","last_peered":"2024-09-14T11:52:38.309929+0000","last_clean":"2024-09-14T11:52:38.309929+0000","last_became_active":"2024-09-14T11:27:38.593507+0000","last_became_peered":"2024-09-14T11:27:38.593507+0000","last_unstale":"2024-09-14T11:52:38.309929+0000","last_undegraded":"2024-09-14T11:52:38.309929+0000","last_fullsized":"2024-09-14T11:52:38.309929+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:04.519402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"264'31","reported_seq":121,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.290822+0000","last_change":"2024-09-14T11:26:04.281451+0000","last_active":"2024-09-14T11:50:18.290822+0000","last_peered":"2024-09-14T11:50:18.290822+0000","last_clean":"2024-09-14T11:50:18.290822+0000","last_became_active":"2024-09-14T11:26:04.280799+0000","last_became_peered":"2024-09-14T11:26:04.280799+0000","last_unstale":"2024-09-14T11:50:18.290822+0000","last_undegraded":"2024-09-14T11:50:18.290822+0000","last_fullsized":"2024-09-14T11:50:18.290822+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:13.145315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":229,"num_read_kb":151,"num_write":83,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.294155+0000","last_change":"2024-09-14T11:38:50.588826+0000","last_active":"2024-09-14T11:51:23.294155+0000","last_peered":"2024-09-14T11:51:23.294155+0000","last_clean":"2024-09-14T11:51:23.294155+0000","last_became_active":"2024-09-14T11:38:50.588260+0000","last_became_peered":"2024-09-14T11:38:50.588260+0000","last_unstale":"2024-09-14T11:51:23.294155+0000","last_undegraded":"2024-09-14T11:51:23.294155+0000","last_fullsized":"2024-09-14T11:51:23.294155+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:00.597152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"261'2","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.289709+0000","last_change":"2024-09-14T11:27:41.650374+0000","last_active":"2024-09-14T11:50:13.289709+0000","last_peered":"2024-09-14T11:50:13.289709+0000","last_clean":"2024-09-14T11:50:13.289709+0000","last_became_active":"2024-09-14T11:27:41.649448+0000","last_became_peered":"2024-09-14T11:27:41.649448+0000","last_unstale":"2024-09-14T11:50:13.289709+0000","last_undegraded":"2024-09-14T11:50:13.289709+0000","last_fullsized":"2024-09-14T11:50:13.289709+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:46.465272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"264'3","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:38.144322+0000","last_change":"2024-09-14T11:27:38.599731+0000","last_active":"2024-09-14T11:52:38.144322+0000","last_peered":"2024-09-14T11:52:38.144322+0000","last_clean":"2024-09-14T11:52:38.144322+0000","last_became_active":"2024-09-14T11:27:38.598992+0000","last_became_peered":"2024-09-14T11:27:38.598992+0000","last_unstale":"2024-09-14T11:52:38.144322+0000","last_undegraded":"2024-09-14T11:52:38.144322+0000","last_fullsized":"2024-09-14T11:52:38.144322+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:16.033655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"264'245","reported_seq":783,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:44.404892+0000","last_change":"2024-09-14T11:26:04.283762+0000","last_active":"2024-09-14T11:51:44.404892+0000","last_peered":"2024-09-14T11:51:44.404892+0000","last_clean":"2024-09-14T11:51:44.404892+0000","last_became_active":"2024-09-14T11:26:04.283058+0000","last_became_peered":"2024-09-14T11:26:04.283058+0000","last_unstale":"2024-09-14T11:51:44.404892+0000","last_undegraded":"2024-09-14T11:51:44.404892+0000","last_fullsized":"2024-09-14T11:51:44.404892+0000","mapping_epoch":253,"log_start":"261'200","ondisk_log_start":"261'200","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:43.404343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2337,"num_read_kb":3061,"num_write":470,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:33.119635+0000","last_change":"2024-09-14T11:38:50.588284+0000","last_active":"2024-09-14T11:50:33.119635+0000","last_peered":"2024-09-14T11:50:33.119635+0000","last_clean":"2024-09-14T11:50:33.119635+0000","last_became_active":"2024-09-14T11:38:50.587593+0000","last_became_peered":"2024-09-14T11:38:50.587593+0000","last_unstale":"2024-09-14T11:50:33.119635+0000","last_undegraded":"2024-09-14T11:50:33.119635+0000","last_fullsized":"2024-09-14T11:50:33.119635+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:30.104550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"261'2","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.279905+0000","last_change":"2024-09-14T11:27:41.650094+0000","last_active":"2024-09-14T11:49:28.279905+0000","last_peered":"2024-09-14T11:49:28.279905+0000","last_clean":"2024-09-14T11:49:28.279905+0000","last_became_active":"2024-09-14T11:27:41.649297+0000","last_became_peered":"2024-09-14T11:27:41.649297+0000","last_unstale":"2024-09-14T11:49:28.279905+0000","last_undegraded":"2024-09-14T11:49:28.279905+0000","last_fullsized":"2024-09-14T11:49:28.279905+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:37.683430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"261'3","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:04.321677+0000","last_change":"2024-09-14T11:27:38.608702+0000","last_active":"2024-09-14T11:51:04.321677+0000","last_peered":"2024-09-14T11:51:04.321677+0000","last_clean":"2024-09-14T11:51:04.321677+0000","last_became_active":"2024-09-14T11:27:38.607929+0000","last_became_peered":"2024-09-14T11:27:38.607929+0000","last_unstale":"2024-09-14T11:51:04.321677+0000","last_undegraded":"2024-09-14T11:51:04.321677+0000","last_fullsized":"2024-09-14T11:51:04.321677+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:02.938378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"264'16","reported_seq":85,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.111235+0000","last_change":"2024-09-14T11:26:04.262715+0000","last_active":"2024-09-14T11:50:18.111235+0000","last_peered":"2024-09-14T11:50:18.111235+0000","last_clean":"2024-09-14T11:50:18.111235+0000","last_became_active":"2024-09-14T11:26:04.261101+0000","last_became_peered":"2024-09-14T11:26:04.261101+0000","last_unstale":"2024-09-14T11:50:18.111235+0000","last_undegraded":"2024-09-14T11:50:18.111235+0000","last_fullsized":"2024-09-14T11:50:18.111235+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:32.177932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":70,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:33.116264+0000","last_change":"2024-09-14T11:38:50.566716+0000","last_active":"2024-09-14T11:50:33.116264+0000","last_peered":"2024-09-14T11:50:33.116264+0000","last_clean":"2024-09-14T11:50:33.116264+0000","last_became_active":"2024-09-14T11:38:50.565980+0000","last_became_peered":"2024-09-14T11:38:50.565980+0000","last_unstale":"2024-09-14T11:50:33.116264+0000","last_undegraded":"2024-09-14T11:50:33.116264+0000","last_fullsized":"2024-09-14T11:50:33.116264+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:42.634974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"264'5","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:28.159762+0000","last_change":"2024-09-14T11:27:41.660949+0000","last_active":"2024-09-14T11:53:28.159762+0000","last_peered":"2024-09-14T11:53:28.159762+0000","last_clean":"2024-09-14T11:53:28.159762+0000","last_became_active":"2024-09-14T11:27:41.660264+0000","last_became_peered":"2024-09-14T11:27:41.660264+0000","last_unstale":"2024-09-14T11:53:28.159762+0000","last_undegraded":"2024-09-14T11:53:28.159762+0000","last_fullsized":"2024-09-14T11:53:28.159762+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:36.720927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"261'4","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.268176+0000","last_change":"2024-09-14T11:27:38.596650+0000","last_active":"2024-09-14T11:49:23.268176+0000","last_peered":"2024-09-14T11:49:23.268176+0000","last_clean":"2024-09-14T11:49:23.268176+0000","last_became_active":"2024-09-14T11:27:38.595788+0000","last_became_peered":"2024-09-14T11:27:38.595788+0000","last_unstale":"2024-09-14T11:49:23.268176+0000","last_undegraded":"2024-09-14T11:49:23.268176+0000","last_fullsized":"2024-09-14T11:49:23.268176+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:09.671865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"264'35","reported_seq":135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.111154+0000","last_change":"2024-09-14T11:26:04.283254+0000","last_active":"2024-09-14T11:50:18.111154+0000","last_peered":"2024-09-14T11:50:18.111154+0000","last_clean":"2024-09-14T11:50:18.111154+0000","last_became_active":"2024-09-14T11:26:04.279281+0000","last_became_peered":"2024-09-14T11:26:04.279281+0000","last_unstale":"2024-09-14T11:50:18.111154+0000","last_undegraded":"2024-09-14T11:50:18.111154+0000","last_fullsized":"2024-09-14T11:50:18.111154+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:14.087866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":194,"num_write":86,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:34.095673+0000","last_change":"2024-09-14T11:38:50.574673+0000","last_active":"2024-09-14T11:50:34.095673+0000","last_peered":"2024-09-14T11:50:34.095673+0000","last_clean":"2024-09-14T11:50:34.095673+0000","last_became_active":"2024-09-14T11:38:50.573912+0000","last_became_peered":"2024-09-14T11:38:50.573912+0000","last_unstale":"2024-09-14T11:50:34.095673+0000","last_undegraded":"2024-09-14T11:50:34.095673+0000","last_fullsized":"2024-09-14T11:50:34.095673+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:20.437626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"264'10","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.368446+0000","last_change":"2024-09-14T11:27:41.633217+0000","last_active":"2024-09-14T11:53:57.368446+0000","last_peered":"2024-09-14T11:53:57.368446+0000","last_clean":"2024-09-14T11:53:57.368446+0000","last_became_active":"2024-09-14T11:27:41.632456+0000","last_became_peered":"2024-09-14T11:27:41.632456+0000","last_unstale":"2024-09-14T11:53:57.368446+0000","last_undegraded":"2024-09-14T11:53:57.368446+0000","last_fullsized":"2024-09-14T11:53:57.368446+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:59.393656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15362,"num_write":10,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"261'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.278697+0000","last_change":"2024-09-14T11:27:38.617576+0000","last_active":"2024-09-14T11:49:23.278697+0000","last_peered":"2024-09-14T11:49:23.278697+0000","last_clean":"2024-09-14T11:49:23.278697+0000","last_became_active":"2024-09-14T11:27:38.616935+0000","last_became_peered":"2024-09-14T11:27:38.616935+0000","last_unstale":"2024-09-14T11:49:23.278697+0000","last_undegraded":"2024-09-14T11:49:23.278697+0000","last_fullsized":"2024-09-14T11:49:23.278697+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:02.566121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"264'38","reported_seq":144,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.290967+0000","last_change":"2024-09-14T11:26:04.268951+0000","last_active":"2024-09-14T11:50:18.290967+0000","last_peered":"2024-09-14T11:50:18.290967+0000","last_clean":"2024-09-14T11:50:18.290967+0000","last_became_active":"2024-09-14T11:26:04.268202+0000","last_became_peered":"2024-09-14T11:26:04.268202+0000","last_unstale":"2024-09-14T11:50:18.290967+0000","last_undegraded":"2024-09-14T11:50:18.290967+0000","last_fullsized":"2024-09-14T11:50:18.290967+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:01.258492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":294,"num_read_kb":198,"num_write":96,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:33.283228+0000","last_change":"2024-09-14T11:38:50.586123+0000","last_active":"2024-09-14T11:50:33.283228+0000","last_peered":"2024-09-14T11:50:33.283228+0000","last_clean":"2024-09-14T11:50:33.283228+0000","last_became_active":"2024-09-14T11:38:50.585324+0000","last_became_peered":"2024-09-14T11:38:50.585324+0000","last_unstale":"2024-09-14T11:50:33.283228+0000","last_undegraded":"2024-09-14T11:50:33.283228+0000","last_fullsized":"2024-09-14T11:50:33.283228+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:21.296327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"264'6","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.366802+0000","last_change":"2024-09-14T11:27:41.653603+0000","last_active":"2024-09-14T11:53:57.366802+0000","last_peered":"2024-09-14T11:53:57.366802+0000","last_clean":"2024-09-14T11:53:57.366802+0000","last_became_active":"2024-09-14T11:27:41.652940+0000","last_became_peered":"2024-09-14T11:27:41.652940+0000","last_unstale":"2024-09-14T11:53:57.366802+0000","last_undegraded":"2024-09-14T11:53:57.366802+0000","last_fullsized":"2024-09-14T11:53:57.366802+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:52.835060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10244,"num_write":6,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"261'5","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.103799+0000","last_change":"2024-09-14T11:27:38.603632+0000","last_active":"2024-09-14T11:49:23.103799+0000","last_peered":"2024-09-14T11:49:23.103799+0000","last_clean":"2024-09-14T11:49:23.103799+0000","last_became_active":"2024-09-14T11:27:38.603013+0000","last_became_peered":"2024-09-14T11:27:38.603013+0000","last_unstale":"2024-09-14T11:49:23.103799+0000","last_undegraded":"2024-09-14T11:49:23.103799+0000","last_fullsized":"2024-09-14T11:49:23.103799+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:31.898272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:29.296282+0000","last_change":"2024-09-14T11:26:04.263990+0000","last_active":"2024-09-14T11:49:29.296282+0000","last_peered":"2024-09-14T11:49:29.296282+0000","last_clean":"2024-09-14T11:49:29.296282+0000","last_became_active":"2024-09-14T11:26:04.263245+0000","last_became_peered":"2024-09-14T11:26:04.263245+0000","last_unstale":"2024-09-14T11:49:29.296282+0000","last_undegraded":"2024-09-14T11:49:29.296282+0000","last_fullsized":"2024-09-14T11:49:29.296282+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:32.096751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.125221+0000","last_change":"2024-09-14T11:38:50.591827+0000","last_active":"2024-09-14T11:50:58.125221+0000","last_peered":"2024-09-14T11:50:58.125221+0000","last_clean":"2024-09-14T11:50:58.125221+0000","last_became_active":"2024-09-14T11:38:50.591033+0000","last_became_peered":"2024-09-14T11:38:50.591033+0000","last_unstale":"2024-09-14T11:50:58.125221+0000","last_undegraded":"2024-09-14T11:50:58.125221+0000","last_fullsized":"2024-09-14T11:50:58.125221+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:09.654882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"264'2","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:23.158433+0000","last_change":"2024-09-14T11:27:41.645102+0000","last_active":"2024-09-14T11:53:23.158433+0000","last_peered":"2024-09-14T11:53:23.158433+0000","last_clean":"2024-09-14T11:53:23.158433+0000","last_became_active":"2024-09-14T11:27:41.634584+0000","last_became_peered":"2024-09-14T11:27:41.634584+0000","last_unstale":"2024-09-14T11:53:23.158433+0000","last_undegraded":"2024-09-14T11:53:23.158433+0000","last_fullsized":"2024-09-14T11:53:23.158433+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:33.590598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.271195+0000","last_change":"2024-09-14T11:27:38.612360+0000","last_active":"2024-09-14T11:50:58.271195+0000","last_peered":"2024-09-14T11:50:58.271195+0000","last_clean":"2024-09-14T11:50:58.271195+0000","last_became_active":"2024-09-14T11:27:38.611912+0000","last_became_peered":"2024-09-14T11:27:38.611912+0000","last_unstale":"2024-09-14T11:50:58.271195+0000","last_undegraded":"2024-09-14T11:50:58.271195+0000","last_fullsized":"2024-09-14T11:50:58.271195+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:31.632951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"264'32","reported_seq":134,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.294532+0000","last_change":"2024-09-14T11:26:04.264797+0000","last_active":"2024-09-14T11:49:24.294532+0000","last_peered":"2024-09-14T11:49:24.294532+0000","last_clean":"2024-09-14T11:49:24.294532+0000","last_became_active":"2024-09-14T11:26:04.264179+0000","last_became_peered":"2024-09-14T11:26:04.264179+0000","last_unstale":"2024-09-14T11:49:24.294532+0000","last_undegraded":"2024-09-14T11:49:24.294532+0000","last_fullsized":"2024-09-14T11:49:24.294532+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:19.434829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":260,"num_read_kb":165,"num_write":79,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.122121+0000","last_change":"2024-09-14T11:38:50.553543+0000","last_active":"2024-09-14T11:50:58.122121+0000","last_peered":"2024-09-14T11:50:58.122121+0000","last_clean":"2024-09-14T11:50:58.122121+0000","last_became_active":"2024-09-14T11:38:50.552891+0000","last_became_peered":"2024-09-14T11:38:50.552891+0000","last_unstale":"2024-09-14T11:50:58.122121+0000","last_undegraded":"2024-09-14T11:50:58.122121+0000","last_fullsized":"2024-09-14T11:50:58.122121+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:10.586101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"261'4","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.126156+0000","last_change":"2024-09-14T11:27:41.643791+0000","last_active":"2024-09-14T11:51:03.126156+0000","last_peered":"2024-09-14T11:51:03.126156+0000","last_clean":"2024-09-14T11:51:03.126156+0000","last_became_active":"2024-09-14T11:27:41.634824+0000","last_became_peered":"2024-09-14T11:27:41.634824+0000","last_unstale":"2024-09-14T11:51:03.126156+0000","last_undegraded":"2024-09-14T11:51:03.126156+0000","last_fullsized":"2024-09-14T11:51:03.126156+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:45.655086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:18.157188+0000","last_change":"2024-09-14T11:27:38.609347+0000","last_active":"2024-09-14T11:53:18.157188+0000","last_peered":"2024-09-14T11:53:18.157188+0000","last_clean":"2024-09-14T11:53:18.157188+0000","last_became_active":"2024-09-14T11:27:38.608412+0000","last_became_peered":"2024-09-14T11:27:38.608412+0000","last_unstale":"2024-09-14T11:53:18.157188+0000","last_undegraded":"2024-09-14T11:53:18.157188+0000","last_fullsized":"2024-09-14T11:53:18.157188+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:24.685660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"264'44","reported_seq":157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:39.785907+0000","last_change":"2024-09-14T11:26:04.272788+0000","last_active":"2024-09-14T11:51:39.785907+0000","last_peered":"2024-09-14T11:51:39.785907+0000","last_clean":"2024-09-14T11:51:39.785907+0000","last_became_active":"2024-09-14T11:26:04.272026+0000","last_became_peered":"2024-09-14T11:26:04.272026+0000","last_unstale":"2024-09-14T11:51:39.785907+0000","last_undegraded":"2024-09-14T11:51:39.785907+0000","last_fullsized":"2024-09-14T11:51:39.785907+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:03.282735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":232,"num_write":112,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.115743+0000","last_change":"2024-09-14T11:38:50.576604+0000","last_active":"2024-09-14T11:50:38.115743+0000","last_peered":"2024-09-14T11:50:38.115743+0000","last_clean":"2024-09-14T11:50:38.115743+0000","last_became_active":"2024-09-14T11:38:50.575796+0000","last_became_peered":"2024-09-14T11:38:50.575796+0000","last_unstale":"2024-09-14T11:50:38.115743+0000","last_undegraded":"2024-09-14T11:50:38.115743+0000","last_fullsized":"2024-09-14T11:50:38.115743+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:03.217316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"264'5","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:23.340671+0000","last_change":"2024-09-14T11:27:41.635521+0000","last_active":"2024-09-14T11:53:23.340671+0000","last_peered":"2024-09-14T11:53:23.340671+0000","last_clean":"2024-09-14T11:53:23.340671+0000","last_became_active":"2024-09-14T11:27:41.634402+0000","last_became_peered":"2024-09-14T11:27:41.634402+0000","last_unstale":"2024-09-14T11:53:23.340671+0000","last_undegraded":"2024-09-14T11:53:23.340671+0000","last_fullsized":"2024-09-14T11:53:23.340671+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:27.030127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.271311+0000","last_change":"2024-09-14T11:27:38.610277+0000","last_active":"2024-09-14T11:50:58.271311+0000","last_peered":"2024-09-14T11:50:58.271311+0000","last_clean":"2024-09-14T11:50:58.271311+0000","last_became_active":"2024-09-14T11:27:38.609363+0000","last_became_peered":"2024-09-14T11:27:38.609363+0000","last_unstale":"2024-09-14T11:50:58.271311+0000","last_undegraded":"2024-09-14T11:50:58.271311+0000","last_fullsized":"2024-09-14T11:50:58.271311+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:44.061754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"264'17","reported_seq":87,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.079749+0000","last_change":"2024-09-14T11:26:04.262270+0000","last_active":"2024-09-14T11:49:24.079749+0000","last_peered":"2024-09-14T11:49:24.079749+0000","last_clean":"2024-09-14T11:49:24.079749+0000","last_became_active":"2024-09-14T11:26:04.261498+0000","last_became_peered":"2024-09-14T11:26:04.261498+0000","last_unstale":"2024-09-14T11:49:24.079749+0000","last_undegraded":"2024-09-14T11:49:24.079749+0000","last_fullsized":"2024-09-14T11:49:24.079749+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:31.069079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":93,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.122005+0000","last_change":"2024-09-14T11:38:50.576965+0000","last_active":"2024-09-14T11:50:58.122005+0000","last_peered":"2024-09-14T11:50:58.122005+0000","last_clean":"2024-09-14T11:50:58.122005+0000","last_became_active":"2024-09-14T11:38:50.576165+0000","last_became_peered":"2024-09-14T11:38:50.576165+0000","last_unstale":"2024-09-14T11:50:58.122005+0000","last_undegraded":"2024-09-14T11:50:58.122005+0000","last_fullsized":"2024-09-14T11:50:58.122005+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:25.583158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"264'2","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.356430+0000","last_change":"2024-09-14T11:27:41.650299+0000","last_active":"2024-09-14T11:53:24.356430+0000","last_peered":"2024-09-14T11:53:24.356430+0000","last_clean":"2024-09-14T11:53:24.356430+0000","last_became_active":"2024-09-14T11:27:41.649598+0000","last_became_peered":"2024-09-14T11:27:41.649598+0000","last_unstale":"2024-09-14T11:53:24.356430+0000","last_undegraded":"2024-09-14T11:53:24.356430+0000","last_fullsized":"2024-09-14T11:53:24.356430+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:10.114521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.271350+0000","last_change":"2024-09-14T11:27:38.599118+0000","last_active":"2024-09-14T11:50:58.271350+0000","last_peered":"2024-09-14T11:50:58.271350+0000","last_clean":"2024-09-14T11:50:58.271350+0000","last_became_active":"2024-09-14T11:27:38.598429+0000","last_became_peered":"2024-09-14T11:27:38.598429+0000","last_unstale":"2024-09-14T11:50:58.271350+0000","last_undegraded":"2024-09-14T11:50:58.271350+0000","last_fullsized":"2024-09-14T11:50:58.271350+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:20.260448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"264'26","reported_seq":114,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.279763+0000","last_change":"2024-09-14T11:26:04.272989+0000","last_active":"2024-09-14T11:49:28.279763+0000","last_peered":"2024-09-14T11:49:28.279763+0000","last_clean":"2024-09-14T11:49:28.279763+0000","last_became_active":"2024-09-14T11:26:04.272216+0000","last_became_peered":"2024-09-14T11:26:04.272216+0000","last_unstale":"2024-09-14T11:49:28.279763+0000","last_undegraded":"2024-09-14T11:49:28.279763+0000","last_fullsized":"2024-09-14T11:49:28.279763+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:52.021930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":141,"num_write":65,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.109357+0000","last_change":"2024-09-14T11:38:50.589752+0000","last_active":"2024-09-14T11:49:48.109357+0000","last_peered":"2024-09-14T11:49:48.109357+0000","last_clean":"2024-09-14T11:49:48.109357+0000","last_became_active":"2024-09-14T11:38:50.589121+0000","last_became_peered":"2024-09-14T11:38:50.589121+0000","last_unstale":"2024-09-14T11:49:48.109357+0000","last_undegraded":"2024-09-14T11:49:48.109357+0000","last_fullsized":"2024-09-14T11:49:48.109357+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:46.246907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"261'4","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.289832+0000","last_change":"2024-09-14T11:27:41.631708+0000","last_active":"2024-09-14T11:50:13.289832+0000","last_peered":"2024-09-14T11:50:13.289832+0000","last_clean":"2024-09-14T11:50:13.289832+0000","last_became_active":"2024-09-14T11:27:41.630970+0000","last_became_peered":"2024-09-14T11:27:41.630970+0000","last_unstale":"2024-09-14T11:50:13.289832+0000","last_undegraded":"2024-09-14T11:50:13.289832+0000","last_fullsized":"2024-09-14T11:50:13.289832+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:10.321213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:09.090171+0000","last_change":"2024-09-14T11:27:38.598988+0000","last_active":"2024-09-14T11:50:09.090171+0000","last_peered":"2024-09-14T11:50:09.090171+0000","last_clean":"2024-09-14T11:50:09.090171+0000","last_became_active":"2024-09-14T11:27:38.580979+0000","last_became_peered":"2024-09-14T11:27:38.580979+0000","last_unstale":"2024-09-14T11:50:09.090171+0000","last_undegraded":"2024-09-14T11:50:09.090171+0000","last_fullsized":"2024-09-14T11:50:09.090171+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:07.399468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"261'22","reported_seq":106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.298654+0000","last_change":"2024-09-14T11:26:04.275780+0000","last_active":"2024-09-14T11:50:53.298654+0000","last_peered":"2024-09-14T11:50:53.298654+0000","last_clean":"2024-09-14T11:50:53.298654+0000","last_became_active":"2024-09-14T11:26:04.275034+0000","last_became_peered":"2024-09-14T11:26:04.275034+0000","last_unstale":"2024-09-14T11:50:53.298654+0000","last_undegraded":"2024-09-14T11:50:53.298654+0000","last_fullsized":"2024-09-14T11:50:53.298654+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:53.668220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":117,"num_write":55,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.260860+0000","last_change":"2024-09-14T11:38:50.596985+0000","last_active":"2024-09-14T11:50:08.260860+0000","last_peered":"2024-09-14T11:50:08.260860+0000","last_clean":"2024-09-14T11:50:08.260860+0000","last_became_active":"2024-09-14T11:38:50.596395+0000","last_became_peered":"2024-09-14T11:38:50.596395+0000","last_unstale":"2024-09-14T11:50:08.260860+0000","last_undegraded":"2024-09-14T11:50:08.260860+0000","last_fullsized":"2024-09-14T11:50:08.260860+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:15.646487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"264'4","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.252289+0000","last_change":"2024-09-14T11:27:41.657302+0000","last_active":"2024-09-14T11:53:57.252289+0000","last_peered":"2024-09-14T11:53:57.252289+0000","last_clean":"2024-09-14T11:53:57.252289+0000","last_became_active":"2024-09-14T11:27:41.656659+0000","last_became_peered":"2024-09-14T11:27:41.656659+0000","last_unstale":"2024-09-14T11:53:57.252289+0000","last_undegraded":"2024-09-14T11:53:57.252289+0000","last_fullsized":"2024-09-14T11:53:57.252289+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:57.077639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":100,"num_write":4,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.110964+0000","last_change":"2024-09-14T11:27:38.605497+0000","last_active":"2024-09-14T11:50:08.110964+0000","last_peered":"2024-09-14T11:50:08.110964+0000","last_clean":"2024-09-14T11:50:08.110964+0000","last_became_active":"2024-09-14T11:27:38.604732+0000","last_became_peered":"2024-09-14T11:27:38.604732+0000","last_unstale":"2024-09-14T11:50:08.110964+0000","last_undegraded":"2024-09-14T11:50:08.110964+0000","last_fullsized":"2024-09-14T11:50:08.110964+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:10.544829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"264'35","reported_seq":134,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:49.317370+0000","last_change":"2024-09-14T11:26:04.280000+0000","last_active":"2024-09-14T11:50:49.317370+0000","last_peered":"2024-09-14T11:50:49.317370+0000","last_clean":"2024-09-14T11:50:49.317370+0000","last_became_active":"2024-09-14T11:26:04.279402+0000","last_became_peered":"2024-09-14T11:26:04.279402+0000","last_unstale":"2024-09-14T11:50:49.317370+0000","last_undegraded":"2024-09-14T11:50:49.317370+0000","last_fullsized":"2024-09-14T11:50:49.317370+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:08.691450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":174,"num_write":94,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:44.299867+0000","last_change":"2024-09-14T11:38:50.573603+0000","last_active":"2024-09-14T11:49:44.299867+0000","last_peered":"2024-09-14T11:49:44.299867+0000","last_clean":"2024-09-14T11:49:44.299867+0000","last_became_active":"2024-09-14T11:38:50.573062+0000","last_became_peered":"2024-09-14T11:38:50.573062+0000","last_unstale":"2024-09-14T11:49:44.299867+0000","last_undegraded":"2024-09-14T11:49:44.299867+0000","last_fullsized":"2024-09-14T11:49:44.299867+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:58.483156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"264'7","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:28.328447+0000","last_change":"2024-09-14T11:27:41.639765+0000","last_active":"2024-09-14T11:52:28.328447+0000","last_peered":"2024-09-14T11:52:28.328447+0000","last_clean":"2024-09-14T11:52:28.328447+0000","last_became_active":"2024-09-14T11:27:41.639051+0000","last_became_peered":"2024-09-14T11:27:41.639051+0000","last_unstale":"2024-09-14T11:52:28.328447+0000","last_undegraded":"2024-09-14T11:52:28.328447+0000","last_fullsized":"2024-09-14T11:52:28.328447+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:41.947643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"264'4","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:23.327205+0000","last_change":"2024-09-14T11:27:38.620255+0000","last_active":"2024-09-14T11:52:23.327205+0000","last_peered":"2024-09-14T11:52:23.327205+0000","last_clean":"2024-09-14T11:52:23.327205+0000","last_became_active":"2024-09-14T11:27:38.619608+0000","last_became_peered":"2024-09-14T11:27:38.619608+0000","last_unstale":"2024-09-14T11:52:23.327205+0000","last_undegraded":"2024-09-14T11:52:23.327205+0000","last_fullsized":"2024-09-14T11:52:23.327205+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:13.155452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"264'28","reported_seq":116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.270192+0000","last_change":"2024-09-14T11:26:04.273757+0000","last_active":"2024-09-14T11:50:53.270192+0000","last_peered":"2024-09-14T11:50:53.270192+0000","last_clean":"2024-09-14T11:50:53.270192+0000","last_became_active":"2024-09-14T11:26:04.272960+0000","last_became_peered":"2024-09-14T11:26:04.272960+0000","last_unstale":"2024-09-14T11:50:53.270192+0000","last_undegraded":"2024-09-14T11:50:53.270192+0000","last_fullsized":"2024-09-14T11:50:53.270192+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:56.581662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":136,"num_write":79,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:43.255430+0000","last_change":"2024-09-14T11:38:50.570309+0000","last_active":"2024-09-14T11:49:43.255430+0000","last_peered":"2024-09-14T11:49:43.255430+0000","last_clean":"2024-09-14T11:49:43.255430+0000","last_became_active":"2024-09-14T11:38:50.569743+0000","last_became_peered":"2024-09-14T11:38:50.569743+0000","last_unstale":"2024-09-14T11:49:43.255430+0000","last_undegraded":"2024-09-14T11:49:43.255430+0000","last_fullsized":"2024-09-14T11:49:43.255430+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:37.993575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"264'5","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.469969+0000","last_change":"2024-09-14T11:27:41.654827+0000","last_active":"2024-09-14T11:53:57.469969+0000","last_peered":"2024-09-14T11:53:57.469969+0000","last_clean":"2024-09-14T11:53:57.469969+0000","last_became_active":"2024-09-14T11:27:41.653929+0000","last_became_peered":"2024-09-14T11:27:41.653929+0000","last_unstale":"2024-09-14T11:53:57.469969+0000","last_undegraded":"2024-09-14T11:53:57.469969+0000","last_fullsized":"2024-09-14T11:53:57.469969+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:11.356458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":118,"num_write":10,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"264'9","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.452762+0000","last_change":"2024-09-14T11:27:38.620107+0000","last_active":"2024-09-14T11:53:57.452762+0000","last_peered":"2024-09-14T11:53:57.452762+0000","last_clean":"2024-09-14T11:53:57.452762+0000","last_became_active":"2024-09-14T11:27:38.619441+0000","last_became_peered":"2024-09-14T11:27:38.619441+0000","last_unstale":"2024-09-14T11:53:57.452762+0000","last_undegraded":"2024-09-14T11:53:57.452762+0000","last_fullsized":"2024-09-14T11:53:57.452762+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:37.692951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":21504,"num_write":14,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"264'28","reported_seq":115,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.120811+0000","last_change":"2024-09-14T11:26:04.272552+0000","last_active":"2024-09-14T11:50:53.120811+0000","last_peered":"2024-09-14T11:50:53.120811+0000","last_clean":"2024-09-14T11:50:53.120811+0000","last_became_active":"2024-09-14T11:26:04.271747+0000","last_became_peered":"2024-09-14T11:26:04.271747+0000","last_unstale":"2024-09-14T11:50:53.120811+0000","last_undegraded":"2024-09-14T11:50:53.120811+0000","last_fullsized":"2024-09-14T11:50:53.120811+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:55.732123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":132,"num_write":73,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.113971+0000","last_change":"2024-09-14T11:38:50.590185+0000","last_active":"2024-09-14T11:50:08.113971+0000","last_peered":"2024-09-14T11:50:08.113971+0000","last_clean":"2024-09-14T11:50:08.113971+0000","last_became_active":"2024-09-14T11:38:50.589444+0000","last_became_peered":"2024-09-14T11:38:50.589444+0000","last_unstale":"2024-09-14T11:50:08.113971+0000","last_undegraded":"2024-09-14T11:50:08.113971+0000","last_fullsized":"2024-09-14T11:50:08.113971+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:57.453301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"261'2","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:34.329581+0000","last_change":"2024-09-14T11:27:41.641002+0000","last_active":"2024-09-14T11:51:34.329581+0000","last_peered":"2024-09-14T11:51:34.329581+0000","last_clean":"2024-09-14T11:51:34.329581+0000","last_became_active":"2024-09-14T11:27:41.640105+0000","last_became_peered":"2024-09-14T11:27:41.640105+0000","last_unstale":"2024-09-14T11:51:34.329581+0000","last_undegraded":"2024-09-14T11:51:34.329581+0000","last_fullsized":"2024-09-14T11:51:34.329581+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:12.987982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"264'11","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:38.343675+0000","last_change":"2024-09-14T11:27:38.613505+0000","last_active":"2024-09-14T11:53:38.343675+0000","last_peered":"2024-09-14T11:53:38.343675+0000","last_clean":"2024-09-14T11:53:38.343675+0000","last_became_active":"2024-09-14T11:27:38.612745+0000","last_became_peered":"2024-09-14T11:27:38.612745+0000","last_unstale":"2024-09-14T11:53:38.343675+0000","last_undegraded":"2024-09-14T11:53:38.343675+0000","last_fullsized":"2024-09-14T11:53:38.343675+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:41.780008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6207,"num_write":16,"num_write_kb":2107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"264'45","reported_seq":170,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.120656+0000","last_change":"2024-09-14T11:26:04.277466+0000","last_active":"2024-09-14T11:50:53.120656+0000","last_peered":"2024-09-14T11:50:53.120656+0000","last_clean":"2024-09-14T11:50:53.120656+0000","last_became_active":"2024-09-14T11:26:04.273309+0000","last_became_peered":"2024-09-14T11:26:04.273309+0000","last_unstale":"2024-09-14T11:50:53.120656+0000","last_undegraded":"2024-09-14T11:50:53.120656+0000","last_fullsized":"2024-09-14T11:50:53.120656+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:24.875502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":376,"num_read_kb":242,"num_write":121,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.091371+0000","last_change":"2024-09-14T11:38:50.597053+0000","last_active":"2024-09-14T11:50:14.091371+0000","last_peered":"2024-09-14T11:50:14.091371+0000","last_clean":"2024-09-14T11:50:14.091371+0000","last_became_active":"2024-09-14T11:38:50.596495+0000","last_became_peered":"2024-09-14T11:38:50.596495+0000","last_unstale":"2024-09-14T11:50:14.091371+0000","last_undegraded":"2024-09-14T11:50:14.091371+0000","last_fullsized":"2024-09-14T11:50:14.091371+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:54.445153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"264'5","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.038986+0000","last_change":"2024-09-14T11:27:41.650790+0000","last_active":"2024-09-14T11:53:57.038986+0000","last_peered":"2024-09-14T11:53:57.038986+0000","last_clean":"2024-09-14T11:53:57.038986+0000","last_became_active":"2024-09-14T11:27:41.650311+0000","last_became_peered":"2024-09-14T11:27:41.650311+0000","last_unstale":"2024-09-14T11:53:57.038986+0000","last_undegraded":"2024-09-14T11:53:57.038986+0000","last_fullsized":"2024-09-14T11:53:57.038986+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:02.760791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"264'8","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.174095+0000","last_change":"2024-09-14T11:27:38.600875+0000","last_active":"2024-09-14T11:53:57.174095+0000","last_peered":"2024-09-14T11:53:57.174095+0000","last_clean":"2024-09-14T11:53:57.174095+0000","last_became_active":"2024-09-14T11:27:38.600043+0000","last_became_peered":"2024-09-14T11:27:38.600043+0000","last_unstale":"2024-09-14T11:53:57.174095+0000","last_undegraded":"2024-09-14T11:53:57.174095+0000","last_fullsized":"2024-09-14T11:53:57.174095+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:38.547858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":7170,"num_write":8,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"264'31","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:21.529004+0000","last_change":"2024-09-14T11:26:04.274470+0000","last_active":"2024-09-14T11:50:21.529004+0000","last_peered":"2024-09-14T11:50:21.529004+0000","last_clean":"2024-09-14T11:50:21.529004+0000","last_became_active":"2024-09-14T11:26:04.274089+0000","last_became_peered":"2024-09-14T11:26:04.274089+0000","last_unstale":"2024-09-14T11:50:21.529004+0000","last_undegraded":"2024-09-14T11:50:21.529004+0000","last_fullsized":"2024-09-14T11:50:21.529004+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:02.147109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":254,"num_read_kb":164,"num_write":92,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.277870+0000","last_change":"2024-09-14T11:38:50.593374+0000","last_active":"2024-09-14T11:50:08.277870+0000","last_peered":"2024-09-14T11:50:08.277870+0000","last_clean":"2024-09-14T11:50:08.277870+0000","last_became_active":"2024-09-14T11:38:50.592765+0000","last_became_peered":"2024-09-14T11:38:50.592765+0000","last_unstale":"2024-09-14T11:50:08.277870+0000","last_undegraded":"2024-09-14T11:50:08.277870+0000","last_fullsized":"2024-09-14T11:50:08.277870+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:12.739637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"261'2","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.111954+0000","last_change":"2024-09-14T11:27:41.647748+0000","last_active":"2024-09-14T11:50:13.111954+0000","last_peered":"2024-09-14T11:50:13.111954+0000","last_clean":"2024-09-14T11:50:13.111954+0000","last_became_active":"2024-09-14T11:27:41.646962+0000","last_became_peered":"2024-09-14T11:27:41.646962+0000","last_unstale":"2024-09-14T11:50:13.111954+0000","last_undegraded":"2024-09-14T11:50:13.111954+0000","last_fullsized":"2024-09-14T11:50:13.111954+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:41.449801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:28.311711+0000","last_change":"2024-09-14T11:27:38.616699+0000","last_active":"2024-09-14T11:51:28.311711+0000","last_peered":"2024-09-14T11:51:28.311711+0000","last_clean":"2024-09-14T11:51:28.311711+0000","last_became_active":"2024-09-14T11:27:38.612131+0000","last_became_peered":"2024-09-14T11:27:38.612131+0000","last_unstale":"2024-09-14T11:51:28.311711+0000","last_undegraded":"2024-09-14T11:51:28.311711+0000","last_fullsized":"2024-09-14T11:51:28.311711+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:28.127453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"264'14","reported_seq":79,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:58.111733+0000","last_change":"2024-09-14T11:26:04.259922+0000","last_active":"2024-09-14T11:49:58.111733+0000","last_peered":"2024-09-14T11:49:58.111733+0000","last_clean":"2024-09-14T11:49:58.111733+0000","last_became_active":"2024-09-14T11:26:04.258976+0000","last_became_peered":"2024-09-14T11:26:04.258976+0000","last_unstale":"2024-09-14T11:49:58.111733+0000","last_undegraded":"2024-09-14T11:49:58.111733+0000","last_fullsized":"2024-09-14T11:49:58.111733+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:45.204426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":72,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.288544+0000","last_change":"2024-09-14T11:38:50.594382+0000","last_active":"2024-09-14T11:50:08.288544+0000","last_peered":"2024-09-14T11:50:08.288544+0000","last_clean":"2024-09-14T11:50:08.288544+0000","last_became_active":"2024-09-14T11:38:50.593641+0000","last_became_peered":"2024-09-14T11:38:50.593641+0000","last_unstale":"2024-09-14T11:50:08.288544+0000","last_undegraded":"2024-09-14T11:50:08.288544+0000","last_fullsized":"2024-09-14T11:50:08.288544+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:19.832637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"261'7","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:33.296159+0000","last_change":"2024-09-14T11:27:41.657817+0000","last_active":"2024-09-14T11:51:33.296159+0000","last_peered":"2024-09-14T11:51:33.296159+0000","last_clean":"2024-09-14T11:51:33.296159+0000","last_became_active":"2024-09-14T11:27:41.657112+0000","last_became_peered":"2024-09-14T11:27:41.657112+0000","last_unstale":"2024-09-14T11:51:33.296159+0000","last_undegraded":"2024-09-14T11:51:33.296159+0000","last_fullsized":"2024-09-14T11:51:33.296159+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:00.412523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":6146,"num_write":12,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"264'3","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.344446+0000","last_change":"2024-09-14T11:27:38.605512+0000","last_active":"2024-09-14T11:52:24.344446+0000","last_peered":"2024-09-14T11:52:24.344446+0000","last_clean":"2024-09-14T11:52:24.344446+0000","last_became_active":"2024-09-14T11:27:38.602864+0000","last_became_peered":"2024-09-14T11:27:38.602864+0000","last_unstale":"2024-09-14T11:52:24.344446+0000","last_undegraded":"2024-09-14T11:52:24.344446+0000","last_fullsized":"2024-09-14T11:52:24.344446+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:31.418858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"264'39","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:58.275660+0000","last_change":"2024-09-14T11:26:04.272287+0000","last_active":"2024-09-14T11:49:58.275660+0000","last_peered":"2024-09-14T11:49:58.275660+0000","last_clean":"2024-09-14T11:49:58.275660+0000","last_became_active":"2024-09-14T11:26:04.271893+0000","last_became_peered":"2024-09-14T11:26:04.271893+0000","last_unstale":"2024-09-14T11:49:58.275660+0000","last_undegraded":"2024-09-14T11:49:58.275660+0000","last_fullsized":"2024-09-14T11:49:58.275660+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:19.118538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":319,"num_read_kb":212,"num_write":95,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.294000+0000","last_change":"2024-09-14T11:38:50.589623+0000","last_active":"2024-09-14T11:51:23.294000+0000","last_peered":"2024-09-14T11:51:23.294000+0000","last_clean":"2024-09-14T11:51:23.294000+0000","last_became_active":"2024-09-14T11:38:50.587827+0000","last_became_peered":"2024-09-14T11:38:50.587827+0000","last_unstale":"2024-09-14T11:51:23.294000+0000","last_undegraded":"2024-09-14T11:51:23.294000+0000","last_fullsized":"2024-09-14T11:51:23.294000+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:20.578713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"261'5","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:43.121925+0000","last_change":"2024-09-14T11:27:41.652540+0000","last_active":"2024-09-14T11:50:43.121925+0000","last_peered":"2024-09-14T11:50:43.121925+0000","last_clean":"2024-09-14T11:50:43.121925+0000","last_became_active":"2024-09-14T11:27:41.651778+0000","last_became_peered":"2024-09-14T11:27:41.651778+0000","last_unstale":"2024-09-14T11:50:43.121925+0000","last_undegraded":"2024-09-14T11:50:43.121925+0000","last_fullsized":"2024-09-14T11:50:43.121925+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:35.794859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:34.313081+0000","last_change":"2024-09-14T11:27:38.604820+0000","last_active":"2024-09-14T11:50:34.313081+0000","last_peered":"2024-09-14T11:50:34.313081+0000","last_clean":"2024-09-14T11:50:34.313081+0000","last_became_active":"2024-09-14T11:27:38.603954+0000","last_became_peered":"2024-09-14T11:27:38.603954+0000","last_unstale":"2024-09-14T11:50:34.313081+0000","last_undegraded":"2024-09-14T11:50:34.313081+0000","last_fullsized":"2024-09-14T11:50:34.313081+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:26.741673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"264'59","reported_seq":200,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:58.106856+0000","last_change":"2024-09-14T11:26:04.270170+0000","last_active":"2024-09-14T11:49:58.106856+0000","last_peered":"2024-09-14T11:49:58.106856+0000","last_clean":"2024-09-14T11:49:58.106856+0000","last_became_active":"2024-09-14T11:26:04.269206+0000","last_became_peered":"2024-09-14T11:26:04.269206+0000","last_unstale":"2024-09-14T11:49:58.106856+0000","last_undegraded":"2024-09-14T11:49:58.106856+0000","last_fullsized":"2024-09-14T11:49:58.106856+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:12.185033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":473,"num_read_kb":330,"num_write":140,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.294101+0000","last_change":"2024-09-14T11:38:50.585754+0000","last_active":"2024-09-14T11:51:23.294101+0000","last_peered":"2024-09-14T11:51:23.294101+0000","last_clean":"2024-09-14T11:51:23.294101+0000","last_became_active":"2024-09-14T11:38:50.585233+0000","last_became_peered":"2024-09-14T11:38:50.585233+0000","last_unstale":"2024-09-14T11:51:23.294101+0000","last_undegraded":"2024-09-14T11:51:23.294101+0000","last_fullsized":"2024-09-14T11:51:23.294101+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:13.891277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"261'4","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.120790+0000","last_change":"2024-09-14T11:27:41.660945+0000","last_active":"2024-09-14T11:50:38.120790+0000","last_peered":"2024-09-14T11:50:38.120790+0000","last_clean":"2024-09-14T11:50:38.120790+0000","last_became_active":"2024-09-14T11:27:41.660286+0000","last_became_peered":"2024-09-14T11:27:41.660286+0000","last_unstale":"2024-09-14T11:50:38.120790+0000","last_undegraded":"2024-09-14T11:50:38.120790+0000","last_fullsized":"2024-09-14T11:50:38.120790+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:47.102264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"261'2","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.115783+0000","last_change":"2024-09-14T11:27:38.594963+0000","last_active":"2024-09-14T11:50:38.115783+0000","last_peered":"2024-09-14T11:50:38.115783+0000","last_clean":"2024-09-14T11:50:38.115783+0000","last_became_active":"2024-09-14T11:27:38.591485+0000","last_became_peered":"2024-09-14T11:27:38.591485+0000","last_unstale":"2024-09-14T11:50:38.115783+0000","last_undegraded":"2024-09-14T11:50:38.115783+0000","last_fullsized":"2024-09-14T11:50:38.115783+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:00.325087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"261'8","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:54.302809+0000","last_change":"2024-09-14T11:26:04.284721+0000","last_active":"2024-09-14T11:49:54.302809+0000","last_peered":"2024-09-14T11:49:54.302809+0000","last_clean":"2024-09-14T11:49:54.302809+0000","last_became_active":"2024-09-14T11:26:04.280724+0000","last_became_peered":"2024-09-14T11:26:04.280724+0000","last_unstale":"2024-09-14T11:49:54.302809+0000","last_undegraded":"2024-09-14T11:49:54.302809+0000","last_fullsized":"2024-09-14T11:49:54.302809+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:06.079319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":39,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.124982+0000","last_change":"2024-09-14T11:38:50.586522+0000","last_active":"2024-09-14T11:50:58.124982+0000","last_peered":"2024-09-14T11:50:58.124982+0000","last_clean":"2024-09-14T11:50:58.124982+0000","last_became_active":"2024-09-14T11:38:50.586004+0000","last_became_peered":"2024-09-14T11:38:50.586004+0000","last_unstale":"2024-09-14T11:50:58.124982+0000","last_undegraded":"2024-09-14T11:50:58.124982+0000","last_fullsized":"2024-09-14T11:50:58.124982+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:21.529496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"264'4","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.321412+0000","last_change":"2024-09-14T11:27:41.657751+0000","last_active":"2024-09-14T11:53:43.321412+0000","last_peered":"2024-09-14T11:53:43.321412+0000","last_clean":"2024-09-14T11:53:43.321412+0000","last_became_active":"2024-09-14T11:27:41.656864+0000","last_became_peered":"2024-09-14T11:27:41.656864+0000","last_unstale":"2024-09-14T11:53:43.321412+0000","last_undegraded":"2024-09-14T11:53:43.321412+0000","last_fullsized":"2024-09-14T11:53:43.321412+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:54.203821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4123,"num_write":4,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"264'12","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.203854+0000","last_change":"2024-09-14T11:27:38.598139+0000","last_active":"2024-09-14T11:53:57.203854+0000","last_peered":"2024-09-14T11:53:57.203854+0000","last_clean":"2024-09-14T11:53:57.203854+0000","last_became_active":"2024-09-14T11:27:38.597416+0000","last_became_peered":"2024-09-14T11:27:38.597416+0000","last_unstale":"2024-09-14T11:53:57.203854+0000","last_undegraded":"2024-09-14T11:53:57.203854+0000","last_fullsized":"2024-09-14T11:53:57.203854+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:43.572595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":16434,"num_write":22,"num_write_kb":9264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"264'34","reported_seq":138,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:14.105634+0000","last_change":"2024-09-14T11:26:04.275339+0000","last_active":"2024-09-14T11:51:14.105634+0000","last_peered":"2024-09-14T11:51:14.105634+0000","last_clean":"2024-09-14T11:51:14.105634+0000","last_became_active":"2024-09-14T11:26:04.274720+0000","last_became_peered":"2024-09-14T11:26:04.274720+0000","last_unstale":"2024-09-14T11:51:14.105634+0000","last_undegraded":"2024-09-14T11:51:14.105634+0000","last_fullsized":"2024-09-14T11:51:14.105634+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:36.983364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":267,"num_read_kb":161,"num_write":92,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:24.326912+0000","last_change":"2024-09-14T11:38:50.576319+0000","last_active":"2024-09-14T11:51:24.326912+0000","last_peered":"2024-09-14T11:51:24.326912+0000","last_clean":"2024-09-14T11:51:24.326912+0000","last_became_active":"2024-09-14T11:38:50.575662+0000","last_became_peered":"2024-09-14T11:38:50.575662+0000","last_unstale":"2024-09-14T11:51:24.326912+0000","last_undegraded":"2024-09-14T11:51:24.326912+0000","last_fullsized":"2024-09-14T11:51:24.326912+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:49.815419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:34.329826+0000","last_change":"2024-09-14T11:27:41.653202+0000","last_active":"2024-09-14T11:51:34.329826+0000","last_peered":"2024-09-14T11:51:34.329826+0000","last_clean":"2024-09-14T11:51:34.329826+0000","last_became_active":"2024-09-14T11:27:41.652132+0000","last_became_peered":"2024-09-14T11:27:41.652132+0000","last_unstale":"2024-09-14T11:51:34.329826+0000","last_undegraded":"2024-09-14T11:51:34.329826+0000","last_fullsized":"2024-09-14T11:51:34.329826+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:58.896733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"264'4","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.252163+0000","last_change":"2024-09-14T11:27:38.603010+0000","last_active":"2024-09-14T11:53:57.252163+0000","last_peered":"2024-09-14T11:53:57.252163+0000","last_clean":"2024-09-14T11:53:57.252163+0000","last_became_active":"2024-09-14T11:27:38.602099+0000","last_became_peered":"2024-09-14T11:27:38.602099+0000","last_unstale":"2024-09-14T11:53:57.252163+0000","last_undegraded":"2024-09-14T11:53:57.252163+0000","last_fullsized":"2024-09-14T11:53:57.252163+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:51.969381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"264'30","reported_seq":125,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.307396+0000","last_change":"2024-09-14T11:26:04.266535+0000","last_active":"2024-09-14T11:51:08.307396+0000","last_peered":"2024-09-14T11:51:08.307396+0000","last_clean":"2024-09-14T11:51:08.307396+0000","last_became_active":"2024-09-14T11:26:04.265553+0000","last_became_peered":"2024-09-14T11:26:04.265553+0000","last_unstale":"2024-09-14T11:51:08.307396+0000","last_undegraded":"2024-09-14T11:51:08.307396+0000","last_fullsized":"2024-09-14T11:51:08.307396+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:39.882235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":163,"num_write":75,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:43.283196+0000","last_change":"2024-09-14T11:38:50.587405+0000","last_active":"2024-09-14T11:49:43.283196+0000","last_peered":"2024-09-14T11:49:43.283196+0000","last_clean":"2024-09-14T11:49:43.283196+0000","last_became_active":"2024-09-14T11:38:50.583172+0000","last_became_peered":"2024-09-14T11:38:50.583172+0000","last_unstale":"2024-09-14T11:49:43.283196+0000","last_undegraded":"2024-09-14T11:49:43.283196+0000","last_fullsized":"2024-09-14T11:49:43.283196+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:06.394703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"264'3","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:43.143563+0000","last_change":"2024-09-14T11:27:41.646437+0000","last_active":"2024-09-14T11:52:43.143563+0000","last_peered":"2024-09-14T11:52:43.143563+0000","last_clean":"2024-09-14T11:52:43.143563+0000","last_became_active":"2024-09-14T11:27:41.645631+0000","last_became_peered":"2024-09-14T11:27:41.645631+0000","last_unstale":"2024-09-14T11:52:43.143563+0000","last_undegraded":"2024-09-14T11:52:43.143563+0000","last_fullsized":"2024-09-14T11:52:43.143563+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:11.944240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"261'6","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:49.114182+0000","last_change":"2024-09-14T11:27:38.598601+0000","last_active":"2024-09-14T11:51:49.114182+0000","last_peered":"2024-09-14T11:51:49.114182+0000","last_clean":"2024-09-14T11:51:49.114182+0000","last_became_active":"2024-09-14T11:27:38.597788+0000","last_became_peered":"2024-09-14T11:27:38.597788+0000","last_unstale":"2024-09-14T11:51:49.114182+0000","last_undegraded":"2024-09-14T11:51:49.114182+0000","last_fullsized":"2024-09-14T11:51:49.114182+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:42.681971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4123,"num_write":6,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"264'31","reported_seq":122,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.496327+0000","last_change":"2024-09-14T11:26:04.258522+0000","last_active":"2024-09-14T11:51:07.496327+0000","last_peered":"2024-09-14T11:51:07.496327+0000","last_clean":"2024-09-14T11:51:07.496327+0000","last_became_active":"2024-09-14T11:26:04.257219+0000","last_became_peered":"2024-09-14T11:26:04.257219+0000","last_unstale":"2024-09-14T11:51:07.496327+0000","last_undegraded":"2024-09-14T11:51:07.496327+0000","last_fullsized":"2024-09-14T11:51:07.496327+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:20.764816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":127,"num_write":83,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:43.103145+0000","last_change":"2024-09-14T11:38:50.581794+0000","last_active":"2024-09-14T11:49:43.103145+0000","last_peered":"2024-09-14T11:49:43.103145+0000","last_clean":"2024-09-14T11:49:43.103145+0000","last_became_active":"2024-09-14T11:38:50.581128+0000","last_became_peered":"2024-09-14T11:38:50.581128+0000","last_unstale":"2024-09-14T11:49:43.103145+0000","last_undegraded":"2024-09-14T11:49:43.103145+0000","last_fullsized":"2024-09-14T11:49:43.103145+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:55.010648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"264'3","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:54.138947+0000","last_change":"2024-09-14T11:27:41.653209+0000","last_active":"2024-09-14T11:53:54.138947+0000","last_peered":"2024-09-14T11:53:54.138947+0000","last_clean":"2024-09-14T11:53:54.138947+0000","last_became_active":"2024-09-14T11:27:41.652549+0000","last_became_peered":"2024-09-14T11:27:41.652549+0000","last_unstale":"2024-09-14T11:53:54.138947+0000","last_undegraded":"2024-09-14T11:53:54.138947+0000","last_fullsized":"2024-09-14T11:53:54.138947+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:00.987136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"264'6","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.174067+0000","last_change":"2024-09-14T11:27:38.610165+0000","last_active":"2024-09-14T11:53:57.174067+0000","last_peered":"2024-09-14T11:53:57.174067+0000","last_clean":"2024-09-14T11:53:57.174067+0000","last_became_active":"2024-09-14T11:27:38.609483+0000","last_became_peered":"2024-09-14T11:27:38.609483+0000","last_unstale":"2024-09-14T11:53:57.174067+0000","last_undegraded":"2024-09-14T11:53:57.174067+0000","last_fullsized":"2024-09-14T11:53:57.174067+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:29:33.493298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12292,"num_write":6,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"264'27","reported_seq":114,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:43.442305+0000","last_change":"2024-09-14T11:26:04.269191+0000","last_active":"2024-09-14T11:51:43.442305+0000","last_peered":"2024-09-14T11:51:43.442305+0000","last_clean":"2024-09-14T11:51:43.442305+0000","last_became_active":"2024-09-14T11:26:04.268338+0000","last_became_peered":"2024-09-14T11:26:04.268338+0000","last_unstale":"2024-09-14T11:51:43.442305+0000","last_undegraded":"2024-09-14T11:51:43.442305+0000","last_fullsized":"2024-09-14T11:51:43.442305+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:41.961353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":125,"num_write":73,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.130723+0000","last_change":"2024-09-14T11:38:50.590316+0000","last_active":"2024-09-14T11:51:23.130723+0000","last_peered":"2024-09-14T11:51:23.130723+0000","last_clean":"2024-09-14T11:51:23.130723+0000","last_became_active":"2024-09-14T11:38:50.589588+0000","last_became_peered":"2024-09-14T11:38:50.589588+0000","last_unstale":"2024-09-14T11:51:23.130723+0000","last_undegraded":"2024-09-14T11:51:23.130723+0000","last_fullsized":"2024-09-14T11:51:23.130723+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:24.259049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"264'2","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.126168+0000","last_change":"2024-09-14T11:27:41.644387+0000","last_active":"2024-09-14T11:52:44.126168+0000","last_peered":"2024-09-14T11:52:44.126168+0000","last_clean":"2024-09-14T11:52:44.126168+0000","last_became_active":"2024-09-14T11:27:41.642400+0000","last_became_peered":"2024-09-14T11:27:41.642400+0000","last_unstale":"2024-09-14T11:52:44.126168+0000","last_undegraded":"2024-09-14T11:52:44.126168+0000","last_fullsized":"2024-09-14T11:52:44.126168+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:58.652273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"261'5","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:33.116188+0000","last_change":"2024-09-14T11:27:38.590088+0000","last_active":"2024-09-14T11:50:33.116188+0000","last_peered":"2024-09-14T11:50:33.116188+0000","last_clean":"2024-09-14T11:50:33.116188+0000","last_became_active":"2024-09-14T11:27:38.587990+0000","last_became_peered":"2024-09-14T11:27:38.587990+0000","last_unstale":"2024-09-14T11:50:33.116188+0000","last_undegraded":"2024-09-14T11:50:33.116188+0000","last_fullsized":"2024-09-14T11:50:33.116188+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:09.675601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"264'55","reported_seq":192,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:43.699139+0000","last_change":"2024-09-14T11:26:04.258664+0000","last_active":"2024-09-14T11:51:43.699139+0000","last_peered":"2024-09-14T11:51:43.699139+0000","last_clean":"2024-09-14T11:51:43.699139+0000","last_became_active":"2024-09-14T11:26:04.257926+0000","last_became_peered":"2024-09-14T11:26:04.257926+0000","last_unstale":"2024-09-14T11:51:43.699139+0000","last_undegraded":"2024-09-14T11:51:43.699139+0000","last_fullsized":"2024-09-14T11:51:43.699139+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:33.436039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":423,"num_read_kb":280,"num_write":136,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:24.327084+0000","last_change":"2024-09-14T11:38:50.587747+0000","last_active":"2024-09-14T11:51:24.327084+0000","last_peered":"2024-09-14T11:51:24.327084+0000","last_clean":"2024-09-14T11:51:24.327084+0000","last_became_active":"2024-09-14T11:38:50.581923+0000","last_became_peered":"2024-09-14T11:38:50.581923+0000","last_unstale":"2024-09-14T11:51:24.327084+0000","last_undegraded":"2024-09-14T11:51:24.327084+0000","last_fullsized":"2024-09-14T11:51:24.327084+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:40.481426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:39.096845+0000","last_change":"2024-09-14T11:27:41.635443+0000","last_active":"2024-09-14T11:50:39.096845+0000","last_peered":"2024-09-14T11:50:39.096845+0000","last_clean":"2024-09-14T11:50:39.096845+0000","last_became_active":"2024-09-14T11:27:41.634692+0000","last_became_peered":"2024-09-14T11:27:41.634692+0000","last_unstale":"2024-09-14T11:50:39.096845+0000","last_undegraded":"2024-09-14T11:50:39.096845+0000","last_fullsized":"2024-09-14T11:50:39.096845+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:40.891329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"264'8","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.350192+0000","last_change":"2024-09-14T11:27:38.613089+0000","last_active":"2024-09-14T11:53:57.350192+0000","last_peered":"2024-09-14T11:53:57.350192+0000","last_clean":"2024-09-14T11:53:57.350192+0000","last_became_active":"2024-09-14T11:27:38.612443+0000","last_became_peered":"2024-09-14T11:27:38.612443+0000","last_unstale":"2024-09-14T11:53:57.350192+0000","last_undegraded":"2024-09-14T11:53:57.350192+0000","last_fullsized":"2024-09-14T11:53:57.350192+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:03.608324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16386,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"264'61","reported_seq":208,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.091151+0000","last_change":"2024-09-14T11:26:04.264319+0000","last_active":"2024-09-14T11:50:14.091151+0000","last_peered":"2024-09-14T11:50:14.091151+0000","last_clean":"2024-09-14T11:50:14.091151+0000","last_became_active":"2024-09-14T11:26:04.263498+0000","last_became_peered":"2024-09-14T11:26:04.263498+0000","last_unstale":"2024-09-14T11:50:14.091151+0000","last_undegraded":"2024-09-14T11:50:14.091151+0000","last_fullsized":"2024-09-14T11:50:14.091151+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:15.140217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":491,"num_read_kb":357,"num_write":145,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"264'195","reported_seq":915,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:00.618454+0000","last_change":"2024-09-14T11:09:45.213450+0000","last_active":"2024-09-14T11:52:00.618454+0000","last_peered":"2024-09-14T11:52:00.618454+0000","last_clean":"2024-09-14T11:52:00.618454+0000","last_became_active":"2024-09-14T11:09:45.212881+0000","last_became_peered":"2024-09-14T11:09:45.212881+0000","last_unstale":"2024-09-14T11:52:00.618454+0000","last_undegraded":"2024-09-14T11:52:00.618454+0000","last_fullsized":"2024-09-14T11:52:00.618454+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:30.710132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":928,"num_read_kb":39441,"num_write":967,"num_write_kb":29636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"264'507","reported_seq":2106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:10.846453+0000","last_change":"2024-09-14T11:09:46.960384+0000","last_active":"2024-09-14T11:52:10.846453+0000","last_peered":"2024-09-14T11:52:10.846453+0000","last_clean":"2024-09-14T11:52:10.846453+0000","last_became_active":"2024-09-14T11:09:46.960069+0000","last_became_peered":"2024-09-14T11:09:46.960069+0000","last_unstale":"2024-09-14T11:52:10.846453+0000","last_undegraded":"2024-09-14T11:52:10.846453+0000","last_fullsized":"2024-09-14T11:52:10.846453+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:31.331846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2624,"num_read_kb":2455,"num_write":621,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"264'211","reported_seq":859,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.432234+0000","last_change":"2024-09-14T11:09:45.211773+0000","last_active":"2024-09-14T11:53:57.432234+0000","last_peered":"2024-09-14T11:53:57.432234+0000","last_clean":"2024-09-14T11:53:57.432234+0000","last_became_active":"2024-09-14T11:09:45.211049+0000","last_became_peered":"2024-09-14T11:09:45.211049+0000","last_unstale":"2024-09-14T11:53:57.432234+0000","last_undegraded":"2024-09-14T11:53:57.432234+0000","last_fullsized":"2024-09-14T11:53:57.432234+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:23.782528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":540,"num_read_kb":70257,"num_write":1018,"num_write_kb":34950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"264'757","reported_seq":2283,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.019646+0000","last_change":"2024-09-14T11:09:46.957857+0000","last_active":"2024-09-14T11:52:29.019646+0000","last_peered":"2024-09-14T11:52:29.019646+0000","last_clean":"2024-09-14T11:52:29.019646+0000","last_became_active":"2024-09-14T11:09:46.957446+0000","last_became_peered":"2024-09-14T11:09:46.957446+0000","last_unstale":"2024-09-14T11:52:29.019646+0000","last_undegraded":"2024-09-14T11:52:29.019646+0000","last_fullsized":"2024-09-14T11:52:29.019646+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:59.796579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3644,"num_read_kb":3296,"num_write":998,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"264'183","reported_seq":805,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.496280+0000","last_change":"2024-09-14T11:09:45.209713+0000","last_active":"2024-09-14T11:53:57.496280+0000","last_peered":"2024-09-14T11:53:57.496280+0000","last_clean":"2024-09-14T11:53:57.496280+0000","last_became_active":"2024-09-14T11:09:45.207458+0000","last_became_peered":"2024-09-14T11:09:45.207458+0000","last_unstale":"2024-09-14T11:53:57.496280+0000","last_undegraded":"2024-09-14T11:53:57.496280+0000","last_fullsized":"2024-09-14T11:53:57.496280+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:49.539522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":12475,"num_write":826,"num_write_kb":33777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"264'372","reported_seq":1895,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:27.204477+0000","last_change":"2024-09-14T11:09:46.950941+0000","last_active":"2024-09-14T11:52:27.204477+0000","last_peered":"2024-09-14T11:52:27.204477+0000","last_clean":"2024-09-14T11:52:27.204477+0000","last_became_active":"2024-09-14T11:09:46.950652+0000","last_became_peered":"2024-09-14T11:09:46.950652+0000","last_unstale":"2024-09-14T11:52:27.204477+0000","last_undegraded":"2024-09-14T11:52:27.204477+0000","last_fullsized":"2024-09-14T11:52:27.204477+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:34.170365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2108,"num_read_kb":2030,"num_write":424,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"264'206","reported_seq":822,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.495810+0000","last_change":"2024-09-14T11:09:45.186739+0000","last_active":"2024-09-14T11:53:57.495810+0000","last_peered":"2024-09-14T11:53:57.495810+0000","last_clean":"2024-09-14T11:53:57.495810+0000","last_became_active":"2024-09-14T11:09:45.185702+0000","last_became_peered":"2024-09-14T11:09:45.185702+0000","last_unstale":"2024-09-14T11:53:57.495810+0000","last_undegraded":"2024-09-14T11:53:57.495810+0000","last_fullsized":"2024-09-14T11:53:57.495810+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:56.963707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":495,"num_read_kb":15356,"num_write":918,"num_write_kb":51388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"264'414","reported_seq":1970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.623964+0000","last_change":"2024-09-14T11:09:46.954424+0000","last_active":"2024-09-14T11:52:29.623964+0000","last_peered":"2024-09-14T11:52:29.623964+0000","last_clean":"2024-09-14T11:52:29.623964+0000","last_became_active":"2024-09-14T11:09:46.952230+0000","last_became_peered":"2024-09-14T11:09:46.952230+0000","last_unstale":"2024-09-14T11:52:29.623964+0000","last_undegraded":"2024-09-14T11:52:29.623964+0000","last_fullsized":"2024-09-14T11:52:29.623964+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:20.602131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2399,"num_read_kb":2276,"num_write":503,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"264'175","reported_seq":744,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.540329+0000","last_change":"2024-09-14T11:10:22.255380+0000","last_active":"2024-09-14T11:53:57.540329+0000","last_peered":"2024-09-14T11:53:57.540329+0000","last_clean":"2024-09-14T11:53:57.540329+0000","last_became_active":"2024-09-14T11:10:22.254947+0000","last_became_peered":"2024-09-14T11:10:22.254947+0000","last_unstale":"2024-09-14T11:53:57.540329+0000","last_undegraded":"2024-09-14T11:53:57.540329+0000","last_fullsized":"2024-09-14T11:53:57.540329+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:02.851190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":441,"num_read_kb":20000,"num_write":788,"num_write_kb":32213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'366","reported_seq":1751,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.120430+0000","last_change":"2024-09-14T11:09:46.962966+0000","last_active":"2024-09-14T11:53:43.120430+0000","last_peered":"2024-09-14T11:53:43.120430+0000","last_clean":"2024-09-14T11:53:43.120430+0000","last_became_active":"2024-09-14T11:09:46.962586+0000","last_became_peered":"2024-09-14T11:09:46.962586+0000","last_unstale":"2024-09-14T11:53:43.120430+0000","last_undegraded":"2024-09-14T11:53:43.120430+0000","last_fullsized":"2024-09-14T11:53:43.120430+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:16.752782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1989,"num_read_kb":1876,"num_write":428,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"264'207","reported_seq":834,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.617881+0000","last_change":"2024-09-14T11:09:45.187610+0000","last_active":"2024-09-14T11:53:57.617881+0000","last_peered":"2024-09-14T11:53:57.617881+0000","last_clean":"2024-09-14T11:53:57.617881+0000","last_became_active":"2024-09-14T11:09:45.187149+0000","last_became_peered":"2024-09-14T11:09:45.187149+0000","last_unstale":"2024-09-14T11:53:57.617881+0000","last_undegraded":"2024-09-14T11:53:57.617881+0000","last_fullsized":"2024-09-14T11:53:57.617881+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:27.216240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":555,"num_read_kb":3965,"num_write":975,"num_write_kb":31222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"264'786","reported_seq":2321,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.037515+0000","last_change":"2024-09-14T11:09:46.990395+0000","last_active":"2024-09-14T11:52:29.037515+0000","last_peered":"2024-09-14T11:52:29.037515+0000","last_clean":"2024-09-14T11:52:29.037515+0000","last_became_active":"2024-09-14T11:09:46.990102+0000","last_became_peered":"2024-09-14T11:09:46.990102+0000","last_unstale":"2024-09-14T11:52:29.037515+0000","last_undegraded":"2024-09-14T11:52:29.037515+0000","last_fullsized":"2024-09-14T11:52:29.037515+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:13.567778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3903,"num_read_kb":3531,"num_write":1063,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"264'333","reported_seq":994,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.388722+0000","last_change":"2024-09-14T11:09:45.205649+0000","last_active":"2024-09-14T11:53:57.388722+0000","last_peered":"2024-09-14T11:53:57.388722+0000","last_clean":"2024-09-14T11:53:57.388722+0000","last_became_active":"2024-09-14T11:09:45.204885+0000","last_became_peered":"2024-09-14T11:09:45.204885+0000","last_unstale":"2024-09-14T11:53:57.388722+0000","last_undegraded":"2024-09-14T11:53:57.388722+0000","last_fullsized":"2024-09-14T11:53:57.388722+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:37.591233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":904,"num_read_kb":1363,"num_write":1218,"num_write_kb":28416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"264'784","reported_seq":2358,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.184843+0000","last_change":"2024-09-14T11:09:46.951375+0000","last_active":"2024-09-14T11:52:12.184843+0000","last_peered":"2024-09-14T11:52:12.184843+0000","last_clean":"2024-09-14T11:52:12.184843+0000","last_became_active":"2024-09-14T11:09:46.951098+0000","last_became_peered":"2024-09-14T11:09:46.951098+0000","last_unstale":"2024-09-14T11:52:12.184843+0000","last_undegraded":"2024-09-14T11:52:12.184843+0000","last_fullsized":"2024-09-14T11:52:12.184843+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:32.686431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3820,"num_read_kb":3459,"num_write":1035,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"264'221","reported_seq":850,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.617091+0000","last_change":"2024-09-14T11:09:45.208652+0000","last_active":"2024-09-14T11:53:57.617091+0000","last_peered":"2024-09-14T11:53:57.617091+0000","last_clean":"2024-09-14T11:53:57.617091+0000","last_became_active":"2024-09-14T11:09:45.207406+0000","last_became_peered":"2024-09-14T11:09:45.207406+0000","last_unstale":"2024-09-14T11:53:57.617091+0000","last_undegraded":"2024-09-14T11:53:57.617091+0000","last_fullsized":"2024-09-14T11:53:57.617091+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:23.047694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":519,"num_read_kb":35149,"num_write":962,"num_write_kb":45963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"264'416","reported_seq":1956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.102644+0000","last_change":"2024-09-14T11:09:46.996557+0000","last_active":"2024-09-14T11:53:43.102644+0000","last_peered":"2024-09-14T11:53:43.102644+0000","last_clean":"2024-09-14T11:53:43.102644+0000","last_became_active":"2024-09-14T11:09:46.995237+0000","last_became_peered":"2024-09-14T11:09:46.995237+0000","last_unstale":"2024-09-14T11:53:43.102644+0000","last_undegraded":"2024-09-14T11:53:43.102644+0000","last_fullsized":"2024-09-14T11:53:43.102644+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:43.227391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2305,"num_read_kb":2183,"num_write":489,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"264'597","reported_seq":2214,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:11.470546+0000","last_change":"2024-09-14T11:09:46.960536+0000","last_active":"2024-09-14T11:52:11.470546+0000","last_peered":"2024-09-14T11:52:11.470546+0000","last_clean":"2024-09-14T11:52:11.470546+0000","last_became_active":"2024-09-14T11:09:46.959477+0000","last_became_peered":"2024-09-14T11:09:46.959477+0000","last_unstale":"2024-09-14T11:52:11.470546+0000","last_undegraded":"2024-09-14T11:52:11.470546+0000","last_fullsized":"2024-09-14T11:52:11.470546+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":500,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:02.226766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3034,"num_read_kb":2795,"num_write":758,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"264'217","reported_seq":846,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.616758+0000","last_change":"2024-09-14T11:09:45.204285+0000","last_active":"2024-09-14T11:53:57.616758+0000","last_peered":"2024-09-14T11:53:57.616758+0000","last_clean":"2024-09-14T11:53:57.616758+0000","last_became_active":"2024-09-14T11:09:45.204030+0000","last_became_peered":"2024-09-14T11:09:45.204030+0000","last_unstale":"2024-09-14T11:53:57.616758+0000","last_undegraded":"2024-09-14T11:53:57.616758+0000","last_fullsized":"2024-09-14T11:53:57.616758+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:18.332566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655875,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":529,"num_read_kb":23907,"num_write":1077,"num_write_kb":37253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"264'520","reported_seq":2130,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:03.265916+0000","last_change":"2024-09-14T11:09:46.971107+0000","last_active":"2024-09-14T11:52:03.265916+0000","last_peered":"2024-09-14T11:52:03.265916+0000","last_clean":"2024-09-14T11:52:03.265916+0000","last_became_active":"2024-09-14T11:09:46.970750+0000","last_became_peered":"2024-09-14T11:09:46.970750+0000","last_unstale":"2024-09-14T11:52:03.265916+0000","last_undegraded":"2024-09-14T11:52:03.265916+0000","last_fullsized":"2024-09-14T11:52:03.265916+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:57.060428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2805,"num_read_kb":2599,"num_write":647,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"264'219","reported_seq":857,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.542190+0000","last_change":"2024-09-14T11:09:45.207509+0000","last_active":"2024-09-14T11:53:57.542190+0000","last_peered":"2024-09-14T11:53:57.542190+0000","last_clean":"2024-09-14T11:53:57.542190+0000","last_became_active":"2024-09-14T11:09:45.206812+0000","last_became_peered":"2024-09-14T11:09:45.206812+0000","last_unstale":"2024-09-14T11:53:57.542190+0000","last_undegraded":"2024-09-14T11:53:57.542190+0000","last_fullsized":"2024-09-14T11:53:57.542190+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:33.731635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":566,"num_read_kb":32523,"num_write":996,"num_write_kb":41963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"264'850","reported_seq":2574,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.110359+0000","last_change":"2024-09-14T11:09:46.975448+0000","last_active":"2024-09-14T11:51:53.110359+0000","last_peered":"2024-09-14T11:51:53.110359+0000","last_clean":"2024-09-14T11:51:53.110359+0000","last_became_active":"2024-09-14T11:09:46.975135+0000","last_became_peered":"2024-09-14T11:09:46.975135+0000","last_unstale":"2024-09-14T11:51:53.110359+0000","last_undegraded":"2024-09-14T11:51:53.110359+0000","last_fullsized":"2024-09-14T11:51:53.110359+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":800,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:04.676118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4353,"num_read_kb":3966,"num_write":1152,"num_write_kb":464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"264'182","reported_seq":782,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.408931+0000","last_change":"2024-09-14T11:09:45.213110+0000","last_active":"2024-09-14T11:53:57.408931+0000","last_peered":"2024-09-14T11:53:57.408931+0000","last_clean":"2024-09-14T11:53:57.408931+0000","last_became_active":"2024-09-14T11:09:45.208314+0000","last_became_peered":"2024-09-14T11:09:45.208314+0000","last_unstale":"2024-09-14T11:53:57.408931+0000","last_undegraded":"2024-09-14T11:53:57.408931+0000","last_fullsized":"2024-09-14T11:53:57.408931+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:20.110568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":417,"num_read_kb":7778,"num_write":841,"num_write_kb":25761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"264'900","reported_seq":2658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:02.153104+0000","last_change":"2024-09-14T11:09:46.995957+0000","last_active":"2024-09-14T11:52:02.153104+0000","last_peered":"2024-09-14T11:52:02.153104+0000","last_clean":"2024-09-14T11:52:02.153104+0000","last_became_active":"2024-09-14T11:09:46.995182+0000","last_became_peered":"2024-09-14T11:09:46.995182+0000","last_unstale":"2024-09-14T11:52:02.153104+0000","last_undegraded":"2024-09-14T11:52:02.153104+0000","last_fullsized":"2024-09-14T11:52:02.153104+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":800,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:35.861209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4411,"num_read_kb":3995,"num_write":1182,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"264'215","reported_seq":807,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.585895+0000","last_change":"2024-09-14T11:09:45.220362+0000","last_active":"2024-09-14T11:53:57.585895+0000","last_peered":"2024-09-14T11:53:57.585895+0000","last_clean":"2024-09-14T11:53:57.585895+0000","last_became_active":"2024-09-14T11:09:45.215301+0000","last_became_peered":"2024-09-14T11:09:45.215301+0000","last_unstale":"2024-09-14T11:53:57.585895+0000","last_undegraded":"2024-09-14T11:53:57.585895+0000","last_fullsized":"2024-09-14T11:53:57.585895+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:10.063540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":450,"num_read_kb":16973,"num_write":902,"num_write_kb":40194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"264'431","reported_seq":1974,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.766412+0000","last_change":"2024-09-14T11:09:46.975235+0000","last_active":"2024-09-14T11:52:12.766412+0000","last_peered":"2024-09-14T11:52:12.766412+0000","last_clean":"2024-09-14T11:52:12.766412+0000","last_became_active":"2024-09-14T11:09:46.974465+0000","last_became_peered":"2024-09-14T11:09:46.974465+0000","last_unstale":"2024-09-14T11:52:12.766412+0000","last_undegraded":"2024-09-14T11:52:12.766412+0000","last_fullsized":"2024-09-14T11:52:12.766412+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:52.589199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2378,"num_read_kb":2237,"num_write":500,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"264'227","reported_seq":888,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.495483+0000","last_change":"2024-09-14T11:09:45.211590+0000","last_active":"2024-09-14T11:53:57.495483+0000","last_peered":"2024-09-14T11:53:57.495483+0000","last_clean":"2024-09-14T11:53:57.495483+0000","last_became_active":"2024-09-14T11:09:45.210875+0000","last_became_peered":"2024-09-14T11:09:45.210875+0000","last_unstale":"2024-09-14T11:53:57.495483+0000","last_undegraded":"2024-09-14T11:53:57.495483+0000","last_fullsized":"2024-09-14T11:53:57.495483+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:21.188914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":591,"num_read_kb":73875,"num_write":1091,"num_write_kb":38947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"264'414","reported_seq":1942,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.988375+0000","last_change":"2024-09-14T11:09:46.959048+0000","last_active":"2024-09-14T11:52:09.988375+0000","last_peered":"2024-09-14T11:52:09.988375+0000","last_clean":"2024-09-14T11:52:09.988375+0000","last_became_active":"2024-09-14T11:09:46.958694+0000","last_became_peered":"2024-09-14T11:09:46.958694+0000","last_unstale":"2024-09-14T11:52:09.988375+0000","last_undegraded":"2024-09-14T11:52:09.988375+0000","last_fullsized":"2024-09-14T11:52:09.988375+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:35.009340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2265,"num_read_kb":2144,"num_write":479,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"264'199","reported_seq":823,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.211385+0000","last_change":"2024-09-14T11:09:45.221734+0000","last_active":"2024-09-14T11:53:57.211385+0000","last_peered":"2024-09-14T11:53:57.211385+0000","last_clean":"2024-09-14T11:53:57.211385+0000","last_became_active":"2024-09-14T11:09:45.220968+0000","last_became_peered":"2024-09-14T11:09:45.220968+0000","last_unstale":"2024-09-14T11:53:57.211385+0000","last_undegraded":"2024-09-14T11:53:57.211385+0000","last_fullsized":"2024-09-14T11:53:57.211385+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:09.918507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":534,"num_read_kb":44269,"num_write":1000,"num_write_kb":27179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"264'134","reported_seq":639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.738672+0000","last_change":"2024-09-14T11:09:55.027528+0000","last_active":"2024-09-14T11:52:29.738672+0000","last_peered":"2024-09-14T11:52:29.738672+0000","last_clean":"2024-09-14T11:52:29.738672+0000","last_became_active":"2024-09-14T11:09:55.026753+0000","last_became_peered":"2024-09-14T11:09:55.026753+0000","last_unstale":"2024-09-14T11:52:29.738672+0000","last_undegraded":"2024-09-14T11:52:29.738672+0000","last_fullsized":"2024-09-14T11:52:29.738672+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:49.050538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":178,"num_read_kb":167,"num_write":319,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"264'372","reported_seq":1902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:00.697892+0000","last_change":"2024-09-14T11:09:46.985537+0000","last_active":"2024-09-14T11:52:00.697892+0000","last_peered":"2024-09-14T11:52:00.697892+0000","last_clean":"2024-09-14T11:52:00.697892+0000","last_became_active":"2024-09-14T11:09:46.985016+0000","last_became_peered":"2024-09-14T11:09:46.985016+0000","last_unstale":"2024-09-14T11:52:00.697892+0000","last_undegraded":"2024-09-14T11:52:00.697892+0000","last_fullsized":"2024-09-14T11:52:00.697892+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:37.173683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2187,"num_read_kb":2090,"num_write":422,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"264'246","reported_seq":888,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.519089+0000","last_change":"2024-09-14T11:09:45.209122+0000","last_active":"2024-09-14T11:53:57.519089+0000","last_peered":"2024-09-14T11:53:57.519089+0000","last_clean":"2024-09-14T11:53:57.519089+0000","last_became_active":"2024-09-14T11:09:45.208756+0000","last_became_peered":"2024-09-14T11:09:45.208756+0000","last_unstale":"2024-09-14T11:53:57.519089+0000","last_undegraded":"2024-09-14T11:53:57.519089+0000","last_fullsized":"2024-09-14T11:53:57.519089+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:05.011185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":600,"num_read_kb":30329,"num_write":1164,"num_write_kb":41189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:54.318570+0000","last_change":"2024-09-14T11:09:48.970253+0000","last_active":"2024-09-14T11:50:54.318570+0000","last_peered":"2024-09-14T11:50:54.318570+0000","last_clean":"2024-09-14T11:50:54.318570+0000","last_became_active":"2024-09-14T11:09:48.969807+0000","last_became_peered":"2024-09-14T11:09:48.969807+0000","last_unstale":"2024-09-14T11:50:54.318570+0000","last_undegraded":"2024-09-14T11:50:54.318570+0000","last_fullsized":"2024-09-14T11:50:54.318570+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:20.729118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"264'196","reported_seq":796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.110588+0000","last_change":"2024-09-14T11:09:50.989686+0000","last_active":"2024-09-14T11:53:57.110588+0000","last_peered":"2024-09-14T11:53:57.110588+0000","last_clean":"2024-09-14T11:53:57.110588+0000","last_became_active":"2024-09-14T11:09:50.988903+0000","last_became_peered":"2024-09-14T11:09:50.988903+0000","last_unstale":"2024-09-14T11:53:57.110588+0000","last_undegraded":"2024-09-14T11:53:57.110588+0000","last_fullsized":"2024-09-14T11:53:57.110588+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:40.383215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12630,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":269,"num_read_kb":381,"num_write":162,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.271486+0000","last_change":"2024-09-14T11:09:53.012712+0000","last_active":"2024-09-14T11:50:58.271486+0000","last_peered":"2024-09-14T11:50:58.271486+0000","last_clean":"2024-09-14T11:50:58.271486+0000","last_became_active":"2024-09-14T11:09:53.010617+0000","last_became_peered":"2024-09-14T11:09:53.010617+0000","last_unstale":"2024-09-14T11:50:58.271486+0000","last_undegraded":"2024-09-14T11:50:58.271486+0000","last_fullsized":"2024-09-14T11:50:58.271486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:10.722614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"264'139","reported_seq":635,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:57.272034+0000","last_change":"2024-09-14T11:09:55.023108+0000","last_active":"2024-09-14T11:51:57.272034+0000","last_peered":"2024-09-14T11:51:57.272034+0000","last_clean":"2024-09-14T11:51:57.272034+0000","last_became_active":"2024-09-14T11:09:55.020070+0000","last_became_peered":"2024-09-14T11:09:55.020070+0000","last_unstale":"2024-09-14T11:51:57.272034+0000","last_undegraded":"2024-09-14T11:51:57.272034+0000","last_fullsized":"2024-09-14T11:51:57.272034+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:06.571541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":142,"num_write":346,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"264'927","reported_seq":2709,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.646957+0000","last_change":"2024-09-14T11:09:46.960339+0000","last_active":"2024-09-14T11:52:29.646957+0000","last_peered":"2024-09-14T11:52:29.646957+0000","last_clean":"2024-09-14T11:52:29.646957+0000","last_became_active":"2024-09-14T11:09:46.957383+0000","last_became_peered":"2024-09-14T11:09:46.957383+0000","last_unstale":"2024-09-14T11:52:29.646957+0000","last_undegraded":"2024-09-14T11:52:29.646957+0000","last_fullsized":"2024-09-14T11:52:29.646957+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:50.357529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4732,"num_read_kb":4281,"num_write":1231,"num_write_kb":469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"264'209","reported_seq":856,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.490065+0000","last_change":"2024-09-14T11:09:45.225975+0000","last_active":"2024-09-14T11:53:57.490065+0000","last_peered":"2024-09-14T11:53:57.490065+0000","last_clean":"2024-09-14T11:53:57.490065+0000","last_became_active":"2024-09-14T11:09:45.220059+0000","last_became_peered":"2024-09-14T11:09:45.220059+0000","last_unstale":"2024-09-14T11:53:57.490065+0000","last_undegraded":"2024-09-14T11:53:57.490065+0000","last_fullsized":"2024-09-14T11:53:57.490065+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:05.527234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":639,"num_read_kb":15720,"num_write":940,"num_write_kb":28935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:33.101046+0000","last_change":"2024-09-14T11:09:48.950741+0000","last_active":"2024-09-14T11:49:33.101046+0000","last_peered":"2024-09-14T11:49:33.101046+0000","last_clean":"2024-09-14T11:49:33.101046+0000","last_became_active":"2024-09-14T11:09:48.950055+0000","last_became_peered":"2024-09-14T11:09:48.950055+0000","last_unstale":"2024-09-14T11:49:33.101046+0000","last_undegraded":"2024-09-14T11:49:33.101046+0000","last_fullsized":"2024-09-14T11:49:33.101046+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:57.249708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"264'83","reported_seq":604,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.188762+0000","last_change":"2024-09-14T11:09:50.989886+0000","last_active":"2024-09-14T11:52:12.188762+0000","last_peered":"2024-09-14T11:52:12.188762+0000","last_clean":"2024-09-14T11:52:12.188762+0000","last_became_active":"2024-09-14T11:09:50.989174+0000","last_became_peered":"2024-09-14T11:09:50.989174+0000","last_unstale":"2024-09-14T11:52:12.188762+0000","last_undegraded":"2024-09-14T11:52:12.188762+0000","last_fullsized":"2024-09-14T11:52:12.188762+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:37.575700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":97,"num_read_kb":91,"num_write":68,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.271407+0000","last_change":"2024-09-14T11:09:53.019238+0000","last_active":"2024-09-14T11:50:58.271407+0000","last_peered":"2024-09-14T11:50:58.271407+0000","last_clean":"2024-09-14T11:50:58.271407+0000","last_became_active":"2024-09-14T11:09:53.018290+0000","last_became_peered":"2024-09-14T11:09:53.018290+0000","last_unstale":"2024-09-14T11:50:58.271407+0000","last_undegraded":"2024-09-14T11:50:58.271407+0000","last_fullsized":"2024-09-14T11:50:58.271407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:48.018030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"264'93","reported_seq":588,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:08.416231+0000","last_change":"2024-09-14T11:09:55.019556+0000","last_active":"2024-09-14T11:52:08.416231+0000","last_peered":"2024-09-14T11:52:08.416231+0000","last_clean":"2024-09-14T11:52:08.416231+0000","last_became_active":"2024-09-14T11:09:55.018855+0000","last_became_peered":"2024-09-14T11:09:55.018855+0000","last_unstale":"2024-09-14T11:52:08.416231+0000","last_undegraded":"2024-09-14T11:52:08.416231+0000","last_fullsized":"2024-09-14T11:52:08.416231+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:52.671096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":100,"num_read_kb":99,"num_write":210,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"264'508","reported_seq":2252,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:10.847271+0000","last_change":"2024-09-14T11:09:46.987477+0000","last_active":"2024-09-14T11:52:10.847271+0000","last_peered":"2024-09-14T11:52:10.847271+0000","last_clean":"2024-09-14T11:52:10.847271+0000","last_became_active":"2024-09-14T11:09:46.975175+0000","last_became_peered":"2024-09-14T11:09:46.975175+0000","last_unstale":"2024-09-14T11:52:10.847271+0000","last_undegraded":"2024-09-14T11:52:10.847271+0000","last_fullsized":"2024-09-14T11:52:10.847271+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:10.227238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2885,"num_read_kb":2717,"num_write":615,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"264'237","reported_seq":853,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.132517+0000","last_change":"2024-09-14T11:09:45.205362+0000","last_active":"2024-09-14T11:53:57.132517+0000","last_peered":"2024-09-14T11:53:57.132517+0000","last_clean":"2024-09-14T11:53:57.132517+0000","last_became_active":"2024-09-14T11:09:45.205019+0000","last_became_peered":"2024-09-14T11:09:45.205019+0000","last_unstale":"2024-09-14T11:53:57.132517+0000","last_undegraded":"2024-09-14T11:53:57.132517+0000","last_fullsized":"2024-09-14T11:53:57.132517+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:50.482486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":563,"num_read_kb":1571,"num_write":1129,"num_write_kb":22204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.118825+0000","last_change":"2024-09-14T11:09:48.951014+0000","last_active":"2024-09-14T11:50:53.118825+0000","last_peered":"2024-09-14T11:50:53.118825+0000","last_clean":"2024-09-14T11:50:53.118825+0000","last_became_active":"2024-09-14T11:09:48.950260+0000","last_became_peered":"2024-09-14T11:09:48.950260+0000","last_unstale":"2024-09-14T11:50:53.118825+0000","last_undegraded":"2024-09-14T11:50:53.118825+0000","last_fullsized":"2024-09-14T11:50:53.118825+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:26.673899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"264'107","reported_seq":639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:54.342568+0000","last_change":"2024-09-14T11:09:50.978554+0000","last_active":"2024-09-14T11:51:54.342568+0000","last_peered":"2024-09-14T11:51:54.342568+0000","last_clean":"2024-09-14T11:51:54.342568+0000","last_became_active":"2024-09-14T11:09:50.977685+0000","last_became_peered":"2024-09-14T11:09:50.977685+0000","last_unstale":"2024-09-14T11:51:54.342568+0000","last_undegraded":"2024-09-14T11:51:54.342568+0000","last_fullsized":"2024-09-14T11:51:54.342568+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:18:08.590005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"264'789","reported_seq":2368,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:56.901355+0000","last_change":"2024-09-14T11:09:53.022562+0000","last_active":"2024-09-14T11:53:56.901355+0000","last_peered":"2024-09-14T11:53:56.901355+0000","last_clean":"2024-09-14T11:53:56.901355+0000","last_became_active":"2024-09-14T11:09:53.021212+0000","last_became_peered":"2024-09-14T11:09:53.021212+0000","last_unstale":"2024-09-14T11:53:56.901355+0000","last_undegraded":"2024-09-14T11:53:56.901355+0000","last_fullsized":"2024-09-14T11:53:56.901355+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:48.852973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"264'221","reported_seq":1056,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.124563+0000","last_change":"2024-09-14T11:09:55.014805+0000","last_active":"2024-09-14T11:52:29.124563+0000","last_peered":"2024-09-14T11:52:29.124563+0000","last_clean":"2024-09-14T11:52:29.124563+0000","last_became_active":"2024-09-14T11:09:55.013994+0000","last_became_peered":"2024-09-14T11:09:55.013994+0000","last_unstale":"2024-09-14T11:52:29.124563+0000","last_undegraded":"2024-09-14T11:52:29.124563+0000","last_fullsized":"2024-09-14T11:52:29.124563+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:49.818762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":446,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":657,"num_read_kb":640,"num_write":481,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"264'1912","reported_seq":3548,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.647332+0000","last_change":"2024-09-14T11:09:46.996404+0000","last_active":"2024-09-14T11:52:29.647332+0000","last_peered":"2024-09-14T11:52:29.647332+0000","last_clean":"2024-09-14T11:52:29.647332+0000","last_became_active":"2024-09-14T11:09:46.994623+0000","last_became_peered":"2024-09-14T11:09:46.994623+0000","last_unstale":"2024-09-14T11:52:29.647332+0000","last_undegraded":"2024-09-14T11:52:29.647332+0000","last_fullsized":"2024-09-14T11:52:29.647332+0000","mapping_epoch":25,"log_start":"264'1900","ondisk_log_start":"264'1900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":1900,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:51.392243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8495,"num_read_kb":7411,"num_write":2703,"num_write_kb":1197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"264'213","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.473971+0000","last_change":"2024-09-14T11:09:45.208803+0000","last_active":"2024-09-14T11:53:57.473971+0000","last_peered":"2024-09-14T11:53:57.473971+0000","last_clean":"2024-09-14T11:53:57.473971+0000","last_became_active":"2024-09-14T11:09:45.208282+0000","last_became_peered":"2024-09-14T11:09:45.208282+0000","last_unstale":"2024-09-14T11:53:57.473971+0000","last_undegraded":"2024-09-14T11:53:57.473971+0000","last_fullsized":"2024-09-14T11:53:57.473971+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:23.782528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5850204,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":521,"num_read_kb":14610,"num_write":976,"num_write_kb":27594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:54.318600+0000","last_change":"2024-09-14T11:09:48.959777+0000","last_active":"2024-09-14T11:50:54.318600+0000","last_peered":"2024-09-14T11:50:54.318600+0000","last_clean":"2024-09-14T11:50:54.318600+0000","last_became_active":"2024-09-14T11:09:48.959355+0000","last_became_peered":"2024-09-14T11:09:48.959355+0000","last_unstale":"2024-09-14T11:50:54.318600+0000","last_undegraded":"2024-09-14T11:50:54.318600+0000","last_fullsized":"2024-09-14T11:50:54.318600+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:29.593248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"264'121","reported_seq":690,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.645264+0000","last_change":"2024-09-14T11:09:50.984714+0000","last_active":"2024-09-14T11:53:57.645264+0000","last_peered":"2024-09-14T11:53:57.645264+0000","last_clean":"2024-09-14T11:53:57.645264+0000","last_became_active":"2024-09-14T11:09:50.984035+0000","last_became_peered":"2024-09-14T11:09:50.984035+0000","last_unstale":"2024-09-14T11:53:57.645264+0000","last_undegraded":"2024-09-14T11:53:57.645264+0000","last_fullsized":"2024-09-14T11:53:57.645264+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:31.803088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":160,"num_read_kb":234,"num_write":82,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"264'802","reported_seq":2131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:56.913896+0000","last_change":"2024-09-14T11:09:53.006772+0000","last_active":"2024-09-14T11:53:56.913896+0000","last_peered":"2024-09-14T11:53:56.913896+0000","last_clean":"2024-09-14T11:53:56.913896+0000","last_became_active":"2024-09-14T11:09:53.004265+0000","last_became_peered":"2024-09-14T11:09:53.004265+0000","last_unstale":"2024-09-14T11:53:56.913896+0000","last_undegraded":"2024-09-14T11:53:56.913896+0000","last_fullsized":"2024-09-14T11:53:56.913896+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:25.054903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"264'520","reported_seq":2229,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.108065+0000","last_change":"2024-09-14T11:09:46.963218+0000","last_active":"2024-09-14T11:53:43.108065+0000","last_peered":"2024-09-14T11:53:43.108065+0000","last_clean":"2024-09-14T11:53:43.108065+0000","last_became_active":"2024-09-14T11:09:46.962838+0000","last_became_peered":"2024-09-14T11:09:46.962838+0000","last_unstale":"2024-09-14T11:53:43.108065+0000","last_undegraded":"2024-09-14T11:53:43.108065+0000","last_fullsized":"2024-09-14T11:53:43.108065+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:16.557469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2791,"num_read_kb":2616,"num_write":587,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"264'278","reported_seq":940,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.389378+0000","last_change":"2024-09-14T11:09:45.219933+0000","last_active":"2024-09-14T11:53:57.389378+0000","last_peered":"2024-09-14T11:53:57.389378+0000","last_clean":"2024-09-14T11:53:57.389378+0000","last_became_active":"2024-09-14T11:09:45.219674+0000","last_became_peered":"2024-09-14T11:09:45.219674+0000","last_unstale":"2024-09-14T11:53:57.389378+0000","last_undegraded":"2024-09-14T11:53:57.389378+0000","last_fullsized":"2024-09-14T11:53:57.389378+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:05.295609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":701,"num_read_kb":41266,"num_write":1220,"num_write_kb":49932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.271280+0000","last_change":"2024-09-14T11:09:48.958749+0000","last_active":"2024-09-14T11:50:58.271280+0000","last_peered":"2024-09-14T11:50:58.271280+0000","last_clean":"2024-09-14T11:50:58.271280+0000","last_became_active":"2024-09-14T11:09:48.958254+0000","last_became_peered":"2024-09-14T11:09:48.958254+0000","last_unstale":"2024-09-14T11:50:58.271280+0000","last_undegraded":"2024-09-14T11:50:58.271280+0000","last_fullsized":"2024-09-14T11:50:58.271280+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:42.595913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"264'192","reported_seq":796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.191251+0000","last_change":"2024-09-14T11:09:50.993372+0000","last_active":"2024-09-14T11:53:57.191251+0000","last_peered":"2024-09-14T11:53:57.191251+0000","last_clean":"2024-09-14T11:53:57.191251+0000","last_became_active":"2024-09-14T11:09:50.992673+0000","last_became_peered":"2024-09-14T11:09:50.992673+0000","last_unstale":"2024-09-14T11:53:57.191251+0000","last_undegraded":"2024-09-14T11:53:57.191251+0000","last_fullsized":"2024-09-14T11:53:57.191251+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:50.616252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11263,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":273,"num_read_kb":325,"num_write":154,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:23.114246+0000","last_change":"2024-09-14T11:09:53.008438+0000","last_active":"2024-09-14T11:50:23.114246+0000","last_peered":"2024-09-14T11:50:23.114246+0000","last_clean":"2024-09-14T11:50:23.114246+0000","last_became_active":"2024-09-14T11:09:53.007694+0000","last_became_peered":"2024-09-14T11:09:53.007694+0000","last_unstale":"2024-09-14T11:50:23.114246+0000","last_undegraded":"2024-09-14T11:50:23.114246+0000","last_fullsized":"2024-09-14T11:50:23.114246+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:56.147296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"264'565","reported_seq":1399,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.058548+0000","last_change":"2024-09-14T11:09:55.031185+0000","last_active":"2024-09-14T11:53:44.058548+0000","last_peered":"2024-09-14T11:53:44.058548+0000","last_clean":"2024-09-14T11:53:44.058548+0000","last_became_active":"2024-09-14T11:09:55.030659+0000","last_became_peered":"2024-09-14T11:09:55.030659+0000","last_unstale":"2024-09-14T11:53:44.058548+0000","last_undegraded":"2024-09-14T11:53:44.058548+0000","last_fullsized":"2024-09-14T11:53:44.058548+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:47.236046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1371,"num_read_kb":1346,"num_write":1205,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"264'1071","reported_seq":2641,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.646289+0000","last_change":"2024-09-14T11:09:46.990492+0000","last_active":"2024-09-14T11:52:29.646289+0000","last_peered":"2024-09-14T11:52:29.646289+0000","last_clean":"2024-09-14T11:52:29.646289+0000","last_became_active":"2024-09-14T11:09:46.990046+0000","last_became_peered":"2024-09-14T11:09:46.990046+0000","last_unstale":"2024-09-14T11:52:29.646289+0000","last_undegraded":"2024-09-14T11:52:29.646289+0000","last_fullsized":"2024-09-14T11:52:29.646289+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":1000,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:03.248978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5673,"num_read_kb":5118,"num_write":1579,"num_write_kb":694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"264'263","reported_seq":960,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.232580+0000","last_change":"2024-09-14T11:09:45.211546+0000","last_active":"2024-09-14T11:53:57.232580+0000","last_peered":"2024-09-14T11:53:57.232580+0000","last_clean":"2024-09-14T11:53:57.232580+0000","last_became_active":"2024-09-14T11:09:45.210020+0000","last_became_peered":"2024-09-14T11:09:45.210020+0000","last_unstale":"2024-09-14T11:53:57.232580+0000","last_undegraded":"2024-09-14T11:53:57.232580+0000","last_fullsized":"2024-09-14T11:53:57.232580+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:40.715640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":888,"num_read_kb":725,"num_write":1131,"num_write_kb":36716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.121796+0000","last_change":"2024-09-14T11:09:48.974766+0000","last_active":"2024-09-14T11:50:58.121796+0000","last_peered":"2024-09-14T11:50:58.121796+0000","last_clean":"2024-09-14T11:50:58.121796+0000","last_became_active":"2024-09-14T11:09:48.973945+0000","last_became_peered":"2024-09-14T11:09:48.973945+0000","last_unstale":"2024-09-14T11:50:58.121796+0000","last_undegraded":"2024-09-14T11:50:58.121796+0000","last_fullsized":"2024-09-14T11:50:58.121796+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:44.397689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"264'142","reported_seq":709,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.456731+0000","last_change":"2024-09-14T11:09:50.986632+0000","last_active":"2024-09-14T11:53:57.456731+0000","last_peered":"2024-09-14T11:53:57.456731+0000","last_clean":"2024-09-14T11:53:57.456731+0000","last_became_active":"2024-09-14T11:09:50.985800+0000","last_became_peered":"2024-09-14T11:09:50.985800+0000","last_unstale":"2024-09-14T11:53:57.456731+0000","last_undegraded":"2024-09-14T11:53:57.456731+0000","last_fullsized":"2024-09-14T11:53:57.456731+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:10:20.302521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14744,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":268,"num_write":96,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.122118+0000","last_change":"2024-09-14T11:09:53.003609+0000","last_active":"2024-09-14T11:51:08.122118+0000","last_peered":"2024-09-14T11:51:08.122118+0000","last_clean":"2024-09-14T11:51:08.122118+0000","last_became_active":"2024-09-14T11:09:53.002739+0000","last_became_peered":"2024-09-14T11:09:53.002739+0000","last_unstale":"2024-09-14T11:51:08.122118+0000","last_undegraded":"2024-09-14T11:51:08.122118+0000","last_fullsized":"2024-09-14T11:51:08.122118+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:34.134964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"264'2501","reported_seq":4368,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:33.422769+0000","last_change":"2024-09-14T11:09:55.020086+0000","last_active":"2024-09-14T11:53:33.422769+0000","last_peered":"2024-09-14T11:53:33.422769+0000","last_clean":"2024-09-14T11:53:33.422769+0000","last_became_active":"2024-09-14T11:09:55.017307+0000","last_became_peered":"2024-09-14T11:09:55.017307+0000","last_unstale":"2024-09-14T11:53:33.422769+0000","last_undegraded":"2024-09-14T11:53:33.422769+0000","last_fullsized":"2024-09-14T11:53:33.422769+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":2400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:26.762655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6356,"num_read_kb":6314,"num_write":5042,"num_write_kb":1853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"264'347","reported_seq":1756,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:03.283453+0000","last_change":"2024-09-14T11:09:46.953211+0000","last_active":"2024-09-14T11:52:03.283453+0000","last_peered":"2024-09-14T11:52:03.283453+0000","last_clean":"2024-09-14T11:52:03.283453+0000","last_became_active":"2024-09-14T11:09:46.952951+0000","last_became_peered":"2024-09-14T11:09:46.952951+0000","last_unstale":"2024-09-14T11:52:03.283453+0000","last_undegraded":"2024-09-14T11:52:03.283453+0000","last_fullsized":"2024-09-14T11:52:03.283453+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:11.659997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1860,"num_read_kb":1783,"num_write":380,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"264'223","reported_seq":859,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.534610+0000","last_change":"2024-09-14T11:09:45.211474+0000","last_active":"2024-09-14T11:53:57.534610+0000","last_peered":"2024-09-14T11:53:57.534610+0000","last_clean":"2024-09-14T11:53:57.534610+0000","last_became_active":"2024-09-14T11:09:45.211217+0000","last_became_peered":"2024-09-14T11:09:45.211217+0000","last_unstale":"2024-09-14T11:53:57.534610+0000","last_undegraded":"2024-09-14T11:53:57.534610+0000","last_fullsized":"2024-09-14T11:53:57.534610+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:46.779002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":600,"num_read_kb":7544,"num_write":1094,"num_write_kb":12612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.116225+0000","last_change":"2024-09-14T11:09:48.957986+0000","last_active":"2024-09-14T11:50:18.116225+0000","last_peered":"2024-09-14T11:50:18.116225+0000","last_clean":"2024-09-14T11:50:18.116225+0000","last_became_active":"2024-09-14T11:09:48.957275+0000","last_became_peered":"2024-09-14T11:09:48.957275+0000","last_unstale":"2024-09-14T11:50:18.116225+0000","last_undegraded":"2024-09-14T11:50:18.116225+0000","last_fullsized":"2024-09-14T11:50:18.116225+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:40.815434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"264'170","reported_seq":749,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.237941+0000","last_change":"2024-09-14T11:09:51.000566+0000","last_active":"2024-09-14T11:53:57.237941+0000","last_peered":"2024-09-14T11:53:57.237941+0000","last_clean":"2024-09-14T11:53:57.237941+0000","last_became_active":"2024-09-14T11:09:50.999759+0000","last_became_peered":"2024-09-14T11:09:50.999759+0000","last_unstale":"2024-09-14T11:53:57.237941+0000","last_undegraded":"2024-09-14T11:53:57.237941+0000","last_fullsized":"2024-09-14T11:53:57.237941+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:34.933664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6528,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":216,"num_read_kb":266,"num_write":126,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"264'802","reported_seq":2350,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:56.916551+0000","last_change":"2024-09-14T11:09:53.003439+0000","last_active":"2024-09-14T11:53:56.916551+0000","last_peered":"2024-09-14T11:53:56.916551+0000","last_clean":"2024-09-14T11:53:56.916551+0000","last_became_active":"2024-09-14T11:09:53.002667+0000","last_became_peered":"2024-09-14T11:09:53.002667+0000","last_unstale":"2024-09-14T11:53:56.916551+0000","last_undegraded":"2024-09-14T11:53:56.916551+0000","last_fullsized":"2024-09-14T11:53:56.916551+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:44.486567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"264'125","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.024032+0000","last_change":"2024-09-14T11:09:55.017516+0000","last_active":"2024-09-14T11:53:43.024032+0000","last_peered":"2024-09-14T11:53:43.024032+0000","last_clean":"2024-09-14T11:53:43.024032+0000","last_became_active":"2024-09-14T11:09:55.016802+0000","last_became_peered":"2024-09-14T11:09:55.016802+0000","last_unstale":"2024-09-14T11:53:43.024032+0000","last_undegraded":"2024-09-14T11:53:43.024032+0000","last_fullsized":"2024-09-14T11:53:43.024032+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:17.432120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":820,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":114,"num_write":311,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"264'746","reported_seq":2274,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.185022+0000","last_change":"2024-09-14T11:09:46.990182+0000","last_active":"2024-09-14T11:52:12.185022+0000","last_peered":"2024-09-14T11:52:12.185022+0000","last_clean":"2024-09-14T11:52:12.185022+0000","last_became_active":"2024-09-14T11:09:46.987523+0000","last_became_peered":"2024-09-14T11:09:46.987523+0000","last_unstale":"2024-09-14T11:52:12.185022+0000","last_undegraded":"2024-09-14T11:52:12.185022+0000","last_fullsized":"2024-09-14T11:52:12.185022+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":700,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:03.328090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3699,"num_read_kb":3347,"num_write":991,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"264'233","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.409636+0000","last_change":"2024-09-14T11:09:45.219279+0000","last_active":"2024-09-14T11:53:57.409636+0000","last_peered":"2024-09-14T11:53:57.409636+0000","last_clean":"2024-09-14T11:53:57.409636+0000","last_became_active":"2024-09-14T11:09:45.213648+0000","last_became_peered":"2024-09-14T11:09:45.213648+0000","last_unstale":"2024-09-14T11:53:57.409636+0000","last_undegraded":"2024-09-14T11:53:57.409636+0000","last_fullsized":"2024-09-14T11:53:57.409636+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:46.955930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1830584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":598,"num_read_kb":9438,"num_write":1111,"num_write_kb":42718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.124431+0000","last_change":"2024-09-14T11:09:48.965750+0000","last_active":"2024-09-14T11:51:08.124431+0000","last_peered":"2024-09-14T11:51:08.124431+0000","last_clean":"2024-09-14T11:51:08.124431+0000","last_became_active":"2024-09-14T11:09:48.965014+0000","last_became_peered":"2024-09-14T11:09:48.965014+0000","last_unstale":"2024-09-14T11:51:08.124431+0000","last_undegraded":"2024-09-14T11:51:08.124431+0000","last_fullsized":"2024-09-14T11:51:08.124431+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:17.069310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"264'200","reported_seq":828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.523160+0000","last_change":"2024-09-14T11:09:50.989754+0000","last_active":"2024-09-14T11:53:57.523160+0000","last_peered":"2024-09-14T11:53:57.523160+0000","last_clean":"2024-09-14T11:53:57.523160+0000","last_became_active":"2024-09-14T11:09:50.988991+0000","last_became_peered":"2024-09-14T11:09:50.988991+0000","last_unstale":"2024-09-14T11:53:57.523160+0000","last_undegraded":"2024-09-14T11:53:57.523160+0000","last_fullsized":"2024-09-14T11:53:57.523160+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:49.153350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16480,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":287,"num_read_kb":450,"num_write":148,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.126208+0000","last_change":"2024-09-14T11:09:53.011570+0000","last_active":"2024-09-14T11:51:03.126208+0000","last_peered":"2024-09-14T11:51:03.126208+0000","last_clean":"2024-09-14T11:51:03.126208+0000","last_became_active":"2024-09-14T11:09:53.010817+0000","last_became_peered":"2024-09-14T11:09:53.010817+0000","last_unstale":"2024-09-14T11:51:03.126208+0000","last_undegraded":"2024-09-14T11:51:03.126208+0000","last_fullsized":"2024-09-14T11:51:03.126208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:43.873697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"264'117","reported_seq":613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.729606+0000","last_change":"2024-09-14T11:09:55.026555+0000","last_active":"2024-09-14T11:52:29.729606+0000","last_peered":"2024-09-14T11:52:29.729606+0000","last_clean":"2024-09-14T11:52:29.729606+0000","last_became_active":"2024-09-14T11:09:55.025490+0000","last_became_peered":"2024-09-14T11:09:55.025490+0000","last_unstale":"2024-09-14T11:52:29.729606+0000","last_undegraded":"2024-09-14T11:52:29.729606+0000","last_fullsized":"2024-09-14T11:52:29.729606+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:27.983692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":533,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":108,"num_write":255,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"264'475","reported_seq":2021,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.038564+0000","last_change":"2024-09-14T11:09:46.971174+0000","last_active":"2024-09-14T11:52:29.038564+0000","last_peered":"2024-09-14T11:52:29.038564+0000","last_clean":"2024-09-14T11:52:29.038564+0000","last_became_active":"2024-09-14T11:09:46.970824+0000","last_became_peered":"2024-09-14T11:09:46.970824+0000","last_unstale":"2024-09-14T11:52:29.038564+0000","last_undegraded":"2024-09-14T11:52:29.038564+0000","last_fullsized":"2024-09-14T11:52:29.038564+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:12.281927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2551,"num_read_kb":2376,"num_write":583,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"264'195","reported_seq":786,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.318708+0000","last_change":"2024-09-14T11:09:45.217112+0000","last_active":"2024-09-14T11:53:57.318708+0000","last_peered":"2024-09-14T11:53:57.318708+0000","last_clean":"2024-09-14T11:53:57.318708+0000","last_became_active":"2024-09-14T11:09:45.216305+0000","last_became_peered":"2024-09-14T11:09:45.216305+0000","last_unstale":"2024-09-14T11:53:57.318708+0000","last_undegraded":"2024-09-14T11:53:57.318708+0000","last_fullsized":"2024-09-14T11:53:57.318708+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:30.530616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655887,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":432,"num_read_kb":2004,"num_write":918,"num_write_kb":29719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.290996+0000","last_change":"2024-09-14T11:09:48.969005+0000","last_active":"2024-09-14T11:50:18.290996+0000","last_peered":"2024-09-14T11:50:18.290996+0000","last_clean":"2024-09-14T11:50:18.290996+0000","last_became_active":"2024-09-14T11:09:48.968263+0000","last_became_peered":"2024-09-14T11:09:48.968263+0000","last_unstale":"2024-09-14T11:50:18.290996+0000","last_undegraded":"2024-09-14T11:50:18.290996+0000","last_fullsized":"2024-09-14T11:50:18.290996+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:06.145563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"264'146","reported_seq":717,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.545015+0000","last_change":"2024-09-14T11:09:50.998839+0000","last_active":"2024-09-14T11:53:57.545015+0000","last_peered":"2024-09-14T11:53:57.545015+0000","last_clean":"2024-09-14T11:53:57.545015+0000","last_became_active":"2024-09-14T11:09:50.998098+0000","last_became_peered":"2024-09-14T11:09:50.998098+0000","last_unstale":"2024-09-14T11:53:57.545015+0000","last_undegraded":"2024-09-14T11:53:57.545015+0000","last_fullsized":"2024-09-14T11:53:57.545015+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:51.979698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10966,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":215,"num_read_kb":296,"num_write":168,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:28.293305+0000","last_change":"2024-09-14T11:09:53.004485+0000","last_active":"2024-09-14T11:50:28.293305+0000","last_peered":"2024-09-14T11:50:28.293305+0000","last_clean":"2024-09-14T11:50:28.293305+0000","last_became_active":"2024-09-14T11:09:53.003759+0000","last_became_peered":"2024-09-14T11:09:53.003759+0000","last_unstale":"2024-09-14T11:50:28.293305+0000","last_undegraded":"2024-09-14T11:50:28.293305+0000","last_fullsized":"2024-09-14T11:50:28.293305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:37.578578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"264'125","reported_seq":611,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.978197+0000","last_change":"2024-09-14T11:09:55.034286+0000","last_active":"2024-09-14T11:52:09.978197+0000","last_peered":"2024-09-14T11:52:09.978197+0000","last_clean":"2024-09-14T11:52:09.978197+0000","last_became_active":"2024-09-14T11:09:55.033844+0000","last_became_peered":"2024-09-14T11:09:55.033844+0000","last_unstale":"2024-09-14T11:52:09.978197+0000","last_undegraded":"2024-09-14T11:52:09.978197+0000","last_fullsized":"2024-09-14T11:52:09.978197+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:07.504626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":100,"num_write":302,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"264'542","reported_seq":2213,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:27.203748+0000","last_change":"2024-09-14T11:09:46.961567+0000","last_active":"2024-09-14T11:52:27.203748+0000","last_peered":"2024-09-14T11:52:27.203748+0000","last_clean":"2024-09-14T11:52:27.203748+0000","last_became_active":"2024-09-14T11:09:46.961100+0000","last_became_peered":"2024-09-14T11:09:46.961100+0000","last_unstale":"2024-09-14T11:52:27.203748+0000","last_undegraded":"2024-09-14T11:52:27.203748+0000","last_fullsized":"2024-09-14T11:52:27.203748+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:01.729846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2788,"num_read_kb":2597,"num_write":616,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"264'220","reported_seq":832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.208839+0000","last_change":"2024-09-14T11:09:45.199153+0000","last_active":"2024-09-14T11:53:57.208839+0000","last_peered":"2024-09-14T11:53:57.208839+0000","last_clean":"2024-09-14T11:53:57.208839+0000","last_became_active":"2024-09-14T11:09:45.198569+0000","last_became_peered":"2024-09-14T11:09:45.198569+0000","last_unstale":"2024-09-14T11:53:57.208839+0000","last_undegraded":"2024-09-14T11:53:57.208839+0000","last_fullsized":"2024-09-14T11:53:57.208839+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:01.792464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":586,"num_read_kb":15211,"num_write":901,"num_write_kb":32712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.116267+0000","last_change":"2024-09-14T11:09:48.953393+0000","last_active":"2024-09-14T11:50:18.116267+0000","last_peered":"2024-09-14T11:50:18.116267+0000","last_clean":"2024-09-14T11:50:18.116267+0000","last_became_active":"2024-09-14T11:09:48.952531+0000","last_became_peered":"2024-09-14T11:09:48.952531+0000","last_unstale":"2024-09-14T11:50:18.116267+0000","last_undegraded":"2024-09-14T11:50:18.116267+0000","last_fullsized":"2024-09-14T11:50:18.116267+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:01.263241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"264'158","reported_seq":738,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.398087+0000","last_change":"2024-09-14T11:09:50.976197+0000","last_active":"2024-09-14T11:53:57.398087+0000","last_peered":"2024-09-14T11:53:57.398087+0000","last_clean":"2024-09-14T11:53:57.398087+0000","last_became_active":"2024-09-14T11:09:50.975455+0000","last_became_peered":"2024-09-14T11:09:50.975455+0000","last_unstale":"2024-09-14T11:53:57.398087+0000","last_undegraded":"2024-09-14T11:53:57.398087+0000","last_fullsized":"2024-09-14T11:53:57.398087+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:53.261559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16336,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":219,"num_read_kb":325,"num_write":124,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"264'773","reported_seq":2363,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:56.904621+0000","last_change":"2024-09-14T11:09:53.014808+0000","last_active":"2024-09-14T11:53:56.904621+0000","last_peered":"2024-09-14T11:53:56.904621+0000","last_clean":"2024-09-14T11:53:56.904621+0000","last_became_active":"2024-09-14T11:09:53.013805+0000","last_became_peered":"2024-09-14T11:09:53.013805+0000","last_unstale":"2024-09-14T11:53:56.904621+0000","last_undegraded":"2024-09-14T11:53:56.904621+0000","last_fullsized":"2024-09-14T11:53:56.904621+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:29.501003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"264'151","reported_seq":656,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:27.197059+0000","last_change":"2024-09-14T11:09:55.027376+0000","last_active":"2024-09-14T11:52:27.197059+0000","last_peered":"2024-09-14T11:52:27.197059+0000","last_clean":"2024-09-14T11:52:27.197059+0000","last_became_active":"2024-09-14T11:09:55.026656+0000","last_became_peered":"2024-09-14T11:09:55.026656+0000","last_unstale":"2024-09-14T11:52:27.197059+0000","last_undegraded":"2024-09-14T11:52:27.197059+0000","last_fullsized":"2024-09-14T11:52:27.197059+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:05.576224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1884,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":197,"num_read_kb":178,"num_write":396,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"264'507","reported_seq":2081,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.766264+0000","last_change":"2024-09-14T11:09:46.950232+0000","last_active":"2024-09-14T11:52:12.766264+0000","last_peered":"2024-09-14T11:52:12.766264+0000","last_clean":"2024-09-14T11:52:12.766264+0000","last_became_active":"2024-09-14T11:09:46.949867+0000","last_became_peered":"2024-09-14T11:09:46.949867+0000","last_unstale":"2024-09-14T11:52:12.766264+0000","last_undegraded":"2024-09-14T11:52:12.766264+0000","last_fullsized":"2024-09-14T11:52:12.766264+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:05.177389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2605,"num_read_kb":2418,"num_write":602,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"264'273","reported_seq":961,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.319909+0000","last_change":"2024-09-14T11:09:45.208220+0000","last_active":"2024-09-14T11:53:57.319909+0000","last_peered":"2024-09-14T11:53:57.319909+0000","last_clean":"2024-09-14T11:53:57.319909+0000","last_became_active":"2024-09-14T11:09:45.207969+0000","last_became_peered":"2024-09-14T11:09:45.207969+0000","last_unstale":"2024-09-14T11:53:57.319909+0000","last_undegraded":"2024-09-14T11:53:57.319909+0000","last_fullsized":"2024-09-14T11:53:57.319909+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:49.056243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":716,"num_read_kb":90988,"num_write":1212,"num_write_kb":64456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1455,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:56.650959+0000","last_change":"2024-09-14T11:09:48.963010+0000","last_active":"2024-09-14T11:53:56.650959+0000","last_peered":"2024-09-14T11:53:56.650959+0000","last_clean":"2024-09-14T11:53:56.650959+0000","last_became_active":"2024-09-14T11:09:48.961946+0000","last_became_peered":"2024-09-14T11:09:48.961946+0000","last_unstale":"2024-09-14T11:53:56.650959+0000","last_undegraded":"2024-09-14T11:53:56.650959+0000","last_fullsized":"2024-09-14T11:53:56.650959+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:33.499961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":958,"num_read_kb":958,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"264'82","reported_seq":597,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:06.162254+0000","last_change":"2024-09-14T11:09:50.997985+0000","last_active":"2024-09-14T11:52:06.162254+0000","last_peered":"2024-09-14T11:52:06.162254+0000","last_clean":"2024-09-14T11:52:06.162254+0000","last_became_active":"2024-09-14T11:09:50.997281+0000","last_became_peered":"2024-09-14T11:09:50.997281+0000","last_unstale":"2024-09-14T11:52:06.162254+0000","last_undegraded":"2024-09-14T11:52:06.162254+0000","last_fullsized":"2024-09-14T11:52:06.162254+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:22.957216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"264'802","reported_seq":4462,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.126548+0000","last_change":"2024-09-14T11:09:53.012817+0000","last_active":"2024-09-14T11:53:57.126548+0000","last_peered":"2024-09-14T11:53:57.126548+0000","last_clean":"2024-09-14T11:53:57.126548+0000","last_became_active":"2024-09-14T11:09:53.010631+0000","last_became_peered":"2024-09-14T11:09:53.010631+0000","last_unstale":"2024-09-14T11:53:57.126548+0000","last_undegraded":"2024-09-14T11:53:57.126548+0000","last_fullsized":"2024-09-14T11:53:57.126548+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:56.772893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"264'178","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:07.609486+0000","last_change":"2024-09-14T11:09:55.011221+0000","last_active":"2024-09-14T11:52:07.609486+0000","last_peered":"2024-09-14T11:52:07.609486+0000","last_clean":"2024-09-14T11:52:07.609486+0000","last_became_active":"2024-09-14T11:09:55.010215+0000","last_became_peered":"2024-09-14T11:09:55.010215+0000","last_unstale":"2024-09-14T11:52:07.609486+0000","last_undegraded":"2024-09-14T11:52:07.609486+0000","last_fullsized":"2024-09-14T11:52:07.609486+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:33.289296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":123,"num_read_kb":114,"num_write":415,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"264'410","reported_seq":1885,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.991420+0000","last_change":"2024-09-14T11:09:46.967866+0000","last_active":"2024-09-14T11:52:09.991420+0000","last_peered":"2024-09-14T11:52:09.991420+0000","last_clean":"2024-09-14T11:52:09.991420+0000","last_became_active":"2024-09-14T11:09:46.966876+0000","last_became_peered":"2024-09-14T11:09:46.966876+0000","last_unstale":"2024-09-14T11:52:09.991420+0000","last_undegraded":"2024-09-14T11:52:09.991420+0000","last_fullsized":"2024-09-14T11:52:09.991420+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:28.146124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2150,"num_read_kb":2036,"num_write":469,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"264'265","reported_seq":1015,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.433428+0000","last_change":"2024-09-14T11:09:45.200742+0000","last_active":"2024-09-14T11:53:57.433428+0000","last_peered":"2024-09-14T11:53:57.433428+0000","last_clean":"2024-09-14T11:53:57.433428+0000","last_became_active":"2024-09-14T11:09:45.200039+0000","last_became_peered":"2024-09-14T11:09:45.200039+0000","last_unstale":"2024-09-14T11:53:57.433428+0000","last_undegraded":"2024-09-14T11:53:57.433428+0000","last_fullsized":"2024-09-14T11:53:57.433428+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:15.438388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":994,"num_read_kb":201012,"num_write":1230,"num_write_kb":37853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:19.309093+0000","last_change":"2024-09-14T11:09:48.973340+0000","last_active":"2024-09-14T11:50:19.309093+0000","last_peered":"2024-09-14T11:50:19.309093+0000","last_clean":"2024-09-14T11:50:19.309093+0000","last_became_active":"2024-09-14T11:09:48.972957+0000","last_became_peered":"2024-09-14T11:09:48.972957+0000","last_unstale":"2024-09-14T11:50:19.309093+0000","last_undegraded":"2024-09-14T11:50:19.309093+0000","last_fullsized":"2024-09-14T11:50:19.309093+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:18.626799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"264'197","reported_seq":800,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.144002+0000","last_change":"2024-09-14T11:09:50.992659+0000","last_active":"2024-09-14T11:53:57.144002+0000","last_peered":"2024-09-14T11:53:57.144002+0000","last_clean":"2024-09-14T11:53:57.144002+0000","last_became_active":"2024-09-14T11:09:50.991938+0000","last_became_peered":"2024-09-14T11:09:50.991938+0000","last_unstale":"2024-09-14T11:53:57.144002+0000","last_undegraded":"2024-09-14T11:53:57.144002+0000","last_fullsized":"2024-09-14T11:53:57.144002+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:19.906727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11553,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":263,"num_read_kb":344,"num_write":148,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:24.093470+0000","last_change":"2024-09-14T11:09:53.007158+0000","last_active":"2024-09-14T11:50:24.093470+0000","last_peered":"2024-09-14T11:50:24.093470+0000","last_clean":"2024-09-14T11:50:24.093470+0000","last_became_active":"2024-09-14T11:09:53.006350+0000","last_became_peered":"2024-09-14T11:09:53.006350+0000","last_unstale":"2024-09-14T11:50:24.093470+0000","last_undegraded":"2024-09-14T11:50:24.093470+0000","last_fullsized":"2024-09-14T11:50:24.093470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:53.484128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"264'117","reported_seq":602,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.069500+0000","last_change":"2024-09-14T11:09:55.013765+0000","last_active":"2024-09-14T11:52:29.069500+0000","last_peered":"2024-09-14T11:52:29.069500+0000","last_clean":"2024-09-14T11:52:29.069500+0000","last_became_active":"2024-09-14T11:09:55.012954+0000","last_became_peered":"2024-09-14T11:09:55.012954+0000","last_unstale":"2024-09-14T11:52:29.069500+0000","last_undegraded":"2024-09-14T11:52:29.069500+0000","last_fullsized":"2024-09-14T11:52:29.069500+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:40.472347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":106,"num_write":256,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"264'403","reported_seq":2070,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.038508+0000","last_change":"2024-09-14T11:09:46.961019+0000","last_active":"2024-09-14T11:52:29.038508+0000","last_peered":"2024-09-14T11:52:29.038508+0000","last_clean":"2024-09-14T11:52:29.038508+0000","last_became_active":"2024-09-14T11:09:46.960461+0000","last_became_peered":"2024-09-14T11:09:46.960461+0000","last_unstale":"2024-09-14T11:52:29.038508+0000","last_undegraded":"2024-09-14T11:52:29.038508+0000","last_fullsized":"2024-09-14T11:52:29.038508+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:23.203399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2438,"num_read_kb":2343,"num_write":447,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:38.279655+0000","last_change":"2024-09-14T11:09:30.311475+0000","last_active":"2024-09-14T11:51:38.279655+0000","last_peered":"2024-09-14T11:51:38.279655+0000","last_clean":"2024-09-14T11:51:38.279655+0000","last_became_active":"2024-09-14T11:09:30.309524+0000","last_became_peered":"2024-09-14T11:09:30.309524+0000","last_unstale":"2024-09-14T11:51:38.279655+0000","last_undegraded":"2024-09-14T11:51:38.279655+0000","last_fullsized":"2024-09-14T11:51:38.279655+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:29.042524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:29.042524+0000","last_clean_scrub_stamp":"2024-09-14T11:09:29.042524+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:30.098592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.325699+0000","last_change":"2024-09-14T11:09:38.138631+0000","last_active":"2024-09-14T11:51:19.325699+0000","last_peered":"2024-09-14T11:51:19.325699+0000","last_clean":"2024-09-14T11:51:19.325699+0000","last_became_active":"2024-09-14T11:09:36.264768+0000","last_became_peered":"2024-09-14T11:09:36.264768+0000","last_unstale":"2024-09-14T11:51:19.325699+0000","last_undegraded":"2024-09-14T11:51:19.325699+0000","last_fullsized":"2024-09-14T11:51:19.325699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:42.835248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092723999999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"264'269","reported_seq":1076,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.452805+0000","last_change":"2024-09-14T11:09:45.193906+0000","last_active":"2024-09-14T11:53:57.452805+0000","last_peered":"2024-09-14T11:53:57.452805+0000","last_clean":"2024-09-14T11:53:57.452805+0000","last_became_active":"2024-09-14T11:09:45.193131+0000","last_became_peered":"2024-09-14T11:09:45.193131+0000","last_unstale":"2024-09-14T11:53:57.452805+0000","last_undegraded":"2024-09-14T11:53:57.452805+0000","last_fullsized":"2024-09-14T11:53:57.452805+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:48.612008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1127,"num_read_kb":141056,"num_write":1044,"num_write_kb":44809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:28.295205+0000","last_change":"2024-09-14T11:09:48.970982+0000","last_active":"2024-09-14T11:51:28.295205+0000","last_peered":"2024-09-14T11:51:28.295205+0000","last_clean":"2024-09-14T11:51:28.295205+0000","last_became_active":"2024-09-14T11:09:48.970541+0000","last_became_peered":"2024-09-14T11:09:48.970541+0000","last_unstale":"2024-09-14T11:51:28.295205+0000","last_undegraded":"2024-09-14T11:51:28.295205+0000","last_fullsized":"2024-09-14T11:51:28.295205+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:59.863519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"264'299","reported_seq":995,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.354937+0000","last_change":"2024-09-14T11:09:50.994191+0000","last_active":"2024-09-14T11:53:57.354937+0000","last_peered":"2024-09-14T11:53:57.354937+0000","last_clean":"2024-09-14T11:53:57.354937+0000","last_became_active":"2024-09-14T11:09:50.993231+0000","last_became_peered":"2024-09-14T11:09:50.993231+0000","last_unstale":"2024-09-14T11:53:57.354937+0000","last_undegraded":"2024-09-14T11:53:57.354937+0000","last_fullsized":"2024-09-14T11:53:57.354937+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:10.493181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22194,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":549,"num_read_kb":706,"num_write":484,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.126495+0000","last_change":"2024-09-14T11:09:53.006544+0000","last_active":"2024-09-14T11:51:03.126495+0000","last_peered":"2024-09-14T11:51:03.126495+0000","last_clean":"2024-09-14T11:51:03.126495+0000","last_became_active":"2024-09-14T11:09:53.004338+0000","last_became_peered":"2024-09-14T11:09:53.004338+0000","last_unstale":"2024-09-14T11:51:03.126495+0000","last_undegraded":"2024-09-14T11:51:03.126495+0000","last_fullsized":"2024-09-14T11:51:03.126495+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:24.238705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"264'234","reported_seq":943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.660948+0000","last_change":"2024-09-14T11:09:55.016385+0000","last_active":"2024-09-14T11:52:29.660948+0000","last_peered":"2024-09-14T11:52:29.660948+0000","last_clean":"2024-09-14T11:52:29.660948+0000","last_became_active":"2024-09-14T11:09:55.015569+0000","last_became_peered":"2024-09-14T11:09:55.015569+0000","last_unstale":"2024-09-14T11:52:29.660948+0000","last_undegraded":"2024-09-14T11:52:29.660948+0000","last_fullsized":"2024-09-14T11:52:29.660948+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:05.577627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1424,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":528,"num_read_kb":505,"num_write":525,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"264'793","reported_seq":2248,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.037887+0000","last_change":"2024-09-14T11:09:46.975255+0000","last_active":"2024-09-14T11:52:29.037887+0000","last_peered":"2024-09-14T11:52:29.037887+0000","last_clean":"2024-09-14T11:52:29.037887+0000","last_became_active":"2024-09-14T11:09:46.974517+0000","last_became_peered":"2024-09-14T11:09:46.974517+0000","last_unstale":"2024-09-14T11:52:29.037887+0000","last_undegraded":"2024-09-14T11:52:29.037887+0000","last_fullsized":"2024-09-14T11:52:29.037887+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:37.949762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3876,"num_read_kb":3470,"num_write":1072,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:44.331934+0000","last_change":"2024-09-14T11:09:38.138820+0000","last_active":"2024-09-14T11:51:44.331934+0000","last_peered":"2024-09-14T11:51:44.331934+0000","last_clean":"2024-09-14T11:51:44.331934+0000","last_became_active":"2024-09-14T11:09:36.110037+0000","last_became_peered":"2024-09-14T11:09:36.110037+0000","last_unstale":"2024-09-14T11:51:44.331934+0000","last_undegraded":"2024-09-14T11:51:44.331934+0000","last_fullsized":"2024-09-14T11:51:44.331934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:29.413375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001043441,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"264'224","reported_seq":875,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.177550+0000","last_change":"2024-09-14T11:09:45.212152+0000","last_active":"2024-09-14T11:53:57.177550+0000","last_peered":"2024-09-14T11:53:57.177550+0000","last_clean":"2024-09-14T11:53:57.177550+0000","last_became_active":"2024-09-14T11:09:45.211579+0000","last_became_peered":"2024-09-14T11:09:45.211579+0000","last_unstale":"2024-09-14T11:53:57.177550+0000","last_undegraded":"2024-09-14T11:53:57.177550+0000","last_fullsized":"2024-09-14T11:53:57.177550+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:17.532123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":626,"num_read_kb":58466,"num_write":936,"num_write_kb":31030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:59.320409+0000","last_change":"2024-09-14T11:09:48.970703+0000","last_active":"2024-09-14T11:50:59.320409+0000","last_peered":"2024-09-14T11:50:59.320409+0000","last_clean":"2024-09-14T11:50:59.320409+0000","last_became_active":"2024-09-14T11:09:48.970218+0000","last_became_peered":"2024-09-14T11:09:48.970218+0000","last_unstale":"2024-09-14T11:50:59.320409+0000","last_undegraded":"2024-09-14T11:50:59.320409+0000","last_fullsized":"2024-09-14T11:50:59.320409+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:45.534332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"264'865","reported_seq":2324,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.482064+0000","last_change":"2024-09-14T11:09:50.997084+0000","last_active":"2024-09-14T11:53:57.482064+0000","last_peered":"2024-09-14T11:53:57.482064+0000","last_clean":"2024-09-14T11:53:57.482064+0000","last_became_active":"2024-09-14T11:09:50.996406+0000","last_became_peered":"2024-09-14T11:09:50.996406+0000","last_unstale":"2024-09-14T11:53:57.482064+0000","last_undegraded":"2024-09-14T11:53:57.482064+0000","last_fullsized":"2024-09-14T11:53:57.482064+0000","mapping_epoch":29,"log_start":"264'800","ondisk_log_start":"264'800","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":800,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:20.571461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34005,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1184,"num_read_kb":1407,"num_write":288,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:39.330945+0000","last_change":"2024-09-14T11:09:53.022628+0000","last_active":"2024-09-14T11:51:39.330945+0000","last_peered":"2024-09-14T11:51:39.330945+0000","last_clean":"2024-09-14T11:51:39.330945+0000","last_became_active":"2024-09-14T11:09:53.022006+0000","last_became_peered":"2024-09-14T11:09:53.022006+0000","last_unstale":"2024-09-14T11:51:39.330945+0000","last_undegraded":"2024-09-14T11:51:39.330945+0000","last_fullsized":"2024-09-14T11:51:39.330945+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:49.069626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"264'217","reported_seq":744,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.027091+0000","last_change":"2024-09-14T11:09:55.024709+0000","last_active":"2024-09-14T11:52:29.027091+0000","last_peered":"2024-09-14T11:52:29.027091+0000","last_clean":"2024-09-14T11:52:29.027091+0000","last_became_active":"2024-09-14T11:09:55.023966+0000","last_became_peered":"2024-09-14T11:09:55.023966+0000","last_unstale":"2024-09-14T11:52:29.027091+0000","last_undegraded":"2024-09-14T11:52:29.027091+0000","last_fullsized":"2024-09-14T11:52:29.027091+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:34.668812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":224,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":295,"num_read_kb":259,"num_write":448,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"264'464","reported_seq":2168,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.103565+0000","last_change":"2024-09-14T11:09:46.982064+0000","last_active":"2024-09-14T11:53:43.103565+0000","last_peered":"2024-09-14T11:53:43.103565+0000","last_clean":"2024-09-14T11:53:43.103565+0000","last_became_active":"2024-09-14T11:09:46.981472+0000","last_became_peered":"2024-09-14T11:09:46.981472+0000","last_unstale":"2024-09-14T11:53:43.103565+0000","last_undegraded":"2024-09-14T11:53:43.103565+0000","last_fullsized":"2024-09-14T11:53:43.103565+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:06.355503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2625,"num_read_kb":2493,"num_write":542,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:18.309372+0000","last_change":"2024-09-14T11:09:38.679236+0000","last_active":"2024-09-14T11:51:18.309372+0000","last_peered":"2024-09-14T11:51:18.309372+0000","last_clean":"2024-09-14T11:51:18.309372+0000","last_became_active":"2024-09-14T11:09:36.110778+0000","last_became_peered":"2024-09-14T11:09:36.110778+0000","last_unstale":"2024-09-14T11:51:18.309372+0000","last_undegraded":"2024-09-14T11:51:18.309372+0000","last_fullsized":"2024-09-14T11:51:18.309372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:49.202249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001188634,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"264'181","reported_seq":778,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.516375+0000","last_change":"2024-09-14T11:09:45.215379+0000","last_active":"2024-09-14T11:53:57.516375+0000","last_peered":"2024-09-14T11:53:57.516375+0000","last_clean":"2024-09-14T11:53:57.516375+0000","last_became_active":"2024-09-14T11:09:45.214670+0000","last_became_peered":"2024-09-14T11:09:45.214670+0000","last_unstale":"2024-09-14T11:53:57.516375+0000","last_undegraded":"2024-09-14T11:53:57.516375+0000","last_fullsized":"2024-09-14T11:53:57.516375+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:31.182118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":427,"num_read_kb":11641,"num_write":795,"num_write_kb":32063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.300064+0000","last_change":"2024-09-14T11:09:48.969846+0000","last_active":"2024-09-14T11:50:58.300064+0000","last_peered":"2024-09-14T11:50:58.300064+0000","last_clean":"2024-09-14T11:50:58.300064+0000","last_became_active":"2024-09-14T11:09:48.968973+0000","last_became_peered":"2024-09-14T11:09:48.968973+0000","last_unstale":"2024-09-14T11:50:58.300064+0000","last_undegraded":"2024-09-14T11:50:58.300064+0000","last_fullsized":"2024-09-14T11:50:58.300064+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:16.223050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"264'234","reported_seq":1305,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.321387+0000","last_change":"2024-09-14T11:09:50.993349+0000","last_active":"2024-09-14T11:53:43.321387+0000","last_peered":"2024-09-14T11:53:43.321387+0000","last_clean":"2024-09-14T11:53:43.321387+0000","last_became_active":"2024-09-14T11:09:50.992589+0000","last_became_peered":"2024-09-14T11:09:50.992589+0000","last_unstale":"2024-09-14T11:53:43.321387+0000","last_undegraded":"2024-09-14T11:53:43.321387+0000","last_fullsized":"2024-09-14T11:53:43.321387+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:20.023339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":182,"num_read_kb":171,"num_write":149,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:33.127635+0000","last_change":"2024-09-14T11:09:53.008567+0000","last_active":"2024-09-14T11:51:33.127635+0000","last_peered":"2024-09-14T11:51:33.127635+0000","last_clean":"2024-09-14T11:51:33.127635+0000","last_became_active":"2024-09-14T11:09:53.007705+0000","last_became_peered":"2024-09-14T11:09:53.007705+0000","last_unstale":"2024-09-14T11:51:33.127635+0000","last_undegraded":"2024-09-14T11:51:33.127635+0000","last_fullsized":"2024-09-14T11:51:33.127635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:31.442222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"264'272","reported_seq":868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.845028+0000","last_change":"2024-09-14T11:09:55.014709+0000","last_active":"2024-09-14T11:52:29.845028+0000","last_peered":"2024-09-14T11:52:29.845028+0000","last_clean":"2024-09-14T11:52:29.845028+0000","last_became_active":"2024-09-14T11:09:55.013944+0000","last_became_peered":"2024-09-14T11:09:55.013944+0000","last_unstale":"2024-09-14T11:52:29.845028+0000","last_undegraded":"2024-09-14T11:52:29.845028+0000","last_fullsized":"2024-09-14T11:52:29.845028+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:31.373231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":495,"num_read_kb":519,"num_write":596,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"264'931","reported_seq":2815,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.038263+0000","last_change":"2024-09-14T11:09:46.982912+0000","last_active":"2024-09-14T11:52:29.038263+0000","last_peered":"2024-09-14T11:52:29.038263+0000","last_clean":"2024-09-14T11:52:29.038263+0000","last_became_active":"2024-09-14T11:09:46.982027+0000","last_became_peered":"2024-09-14T11:09:46.982027+0000","last_unstale":"2024-09-14T11:52:29.038263+0000","last_undegraded":"2024-09-14T11:52:29.038263+0000","last_fullsized":"2024-09-14T11:52:29.038263+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":900,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:07.510355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4697,"num_read_kb":4271,"num_write":1214,"num_write_kb":435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.325611+0000","last_change":"2024-09-14T11:09:38.140129+0000","last_active":"2024-09-14T11:51:19.325611+0000","last_peered":"2024-09-14T11:51:19.325611+0000","last_clean":"2024-09-14T11:51:19.325611+0000","last_became_active":"2024-09-14T11:09:36.887391+0000","last_became_peered":"2024-09-14T11:09:36.887391+0000","last_unstale":"2024-09-14T11:51:19.325611+0000","last_undegraded":"2024-09-14T11:51:19.325611+0000","last_fullsized":"2024-09-14T11:51:19.325611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:23.561067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023357849999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"264'262","reported_seq":907,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.452127+0000","last_change":"2024-09-14T11:09:45.206950+0000","last_active":"2024-09-14T11:53:57.452127+0000","last_peered":"2024-09-14T11:53:57.452127+0000","last_clean":"2024-09-14T11:53:57.452127+0000","last_became_active":"2024-09-14T11:09:45.206492+0000","last_became_peered":"2024-09-14T11:09:45.206492+0000","last_unstale":"2024-09-14T11:53:57.452127+0000","last_undegraded":"2024-09-14T11:53:57.452127+0000","last_fullsized":"2024-09-14T11:53:57.452127+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:09.076068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":656,"num_read_kb":889,"num_write":1198,"num_write_kb":16465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:33.313136+0000","last_change":"2024-09-14T11:09:48.977354+0000","last_active":"2024-09-14T11:51:33.313136+0000","last_peered":"2024-09-14T11:51:33.313136+0000","last_clean":"2024-09-14T11:51:33.313136+0000","last_became_active":"2024-09-14T11:09:48.976315+0000","last_became_peered":"2024-09-14T11:09:48.976315+0000","last_unstale":"2024-09-14T11:51:33.313136+0000","last_undegraded":"2024-09-14T11:51:33.313136+0000","last_fullsized":"2024-09-14T11:51:33.313136+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:11:27.454227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"264'121","reported_seq":658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:13.156135+0000","last_change":"2024-09-14T11:09:50.983682+0000","last_active":"2024-09-14T11:53:13.156135+0000","last_peered":"2024-09-14T11:53:13.156135+0000","last_clean":"2024-09-14T11:53:13.156135+0000","last_became_active":"2024-09-14T11:09:50.983126+0000","last_became_peered":"2024-09-14T11:09:50.983126+0000","last_unstale":"2024-09-14T11:53:13.156135+0000","last_undegraded":"2024-09-14T11:53:13.156135+0000","last_fullsized":"2024-09-14T11:53:13.156135+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:01.407533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:04.321826+0000","last_change":"2024-09-14T11:09:53.015879+0000","last_active":"2024-09-14T11:51:04.321826+0000","last_peered":"2024-09-14T11:51:04.321826+0000","last_clean":"2024-09-14T11:51:04.321826+0000","last_became_active":"2024-09-14T11:09:53.015100+0000","last_became_peered":"2024-09-14T11:09:53.015100+0000","last_unstale":"2024-09-14T11:51:04.321826+0000","last_undegraded":"2024-09-14T11:51:04.321826+0000","last_fullsized":"2024-09-14T11:51:04.321826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:14:31.622686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"264'126","reported_seq":676,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:27.192089+0000","last_change":"2024-09-14T11:09:55.025662+0000","last_active":"2024-09-14T11:52:27.192089+0000","last_peered":"2024-09-14T11:52:27.192089+0000","last_clean":"2024-09-14T11:52:27.192089+0000","last_became_active":"2024-09-14T11:09:55.025030+0000","last_became_peered":"2024-09-14T11:09:55.025030+0000","last_unstale":"2024-09-14T11:52:27.192089+0000","last_undegraded":"2024-09-14T11:52:27.192089+0000","last_fullsized":"2024-09-14T11:52:27.192089+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:47.329558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":244,"num_read_kb":234,"num_write":307,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"264'430","reported_seq":1972,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.026058+0000","last_change":"2024-09-14T11:09:46.982402+0000","last_active":"2024-09-14T11:52:09.026058+0000","last_peered":"2024-09-14T11:52:09.026058+0000","last_clean":"2024-09-14T11:52:09.026058+0000","last_became_active":"2024-09-14T11:09:46.981578+0000","last_became_peered":"2024-09-14T11:09:46.981578+0000","last_unstale":"2024-09-14T11:52:09.026058+0000","last_undegraded":"2024-09-14T11:52:09.026058+0000","last_fullsized":"2024-09-14T11:52:09.026058+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:46.587772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2336,"num_read_kb":2209,"num_write":501,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"264'246","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.494469+0000","last_change":"2024-09-14T11:09:45.216526+0000","last_active":"2024-09-14T11:53:57.494469+0000","last_peered":"2024-09-14T11:53:57.494469+0000","last_clean":"2024-09-14T11:53:57.494469+0000","last_became_active":"2024-09-14T11:09:45.216168+0000","last_became_peered":"2024-09-14T11:09:45.216168+0000","last_unstale":"2024-09-14T11:53:57.494469+0000","last_undegraded":"2024-09-14T11:53:57.494469+0000","last_fullsized":"2024-09-14T11:53:57.494469+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:50.757149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":603,"num_read_kb":12400,"num_write":1048,"num_write_kb":24779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:18.129696+0000","last_change":"2024-09-14T11:09:38.679466+0000","last_active":"2024-09-14T11:51:18.129696+0000","last_peered":"2024-09-14T11:51:18.129696+0000","last_clean":"2024-09-14T11:51:18.129696+0000","last_became_active":"2024-09-14T11:09:36.887411+0000","last_became_peered":"2024-09-14T11:09:36.887411+0000","last_unstale":"2024-09-14T11:51:18.129696+0000","last_undegraded":"2024-09-14T11:51:18.129696+0000","last_fullsized":"2024-09-14T11:51:18.129696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:17.852943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001210341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:28.126561+0000","last_change":"2024-09-14T11:09:48.973058+0000","last_active":"2024-09-14T11:51:28.126561+0000","last_peered":"2024-09-14T11:51:28.126561+0000","last_clean":"2024-09-14T11:51:28.126561+0000","last_became_active":"2024-09-14T11:09:48.969262+0000","last_became_peered":"2024-09-14T11:09:48.969262+0000","last_unstale":"2024-09-14T11:51:28.126561+0000","last_undegraded":"2024-09-14T11:51:28.126561+0000","last_fullsized":"2024-09-14T11:51:28.126561+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:26.478140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"264'281","reported_seq":936,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.377807+0000","last_change":"2024-09-14T11:09:50.992720+0000","last_active":"2024-09-14T11:53:57.377807+0000","last_peered":"2024-09-14T11:53:57.377807+0000","last_clean":"2024-09-14T11:53:57.377807+0000","last_became_active":"2024-09-14T11:09:50.991958+0000","last_became_peered":"2024-09-14T11:09:50.991958+0000","last_unstale":"2024-09-14T11:53:57.377807+0000","last_undegraded":"2024-09-14T11:53:57.377807+0000","last_fullsized":"2024-09-14T11:53:57.377807+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:06.240758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26179,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1035,"num_read_kb":1185,"num_write":1534,"num_write_kb":1392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:34.110192+0000","last_change":"2024-09-14T11:09:53.002718+0000","last_active":"2024-09-14T11:51:34.110192+0000","last_peered":"2024-09-14T11:51:34.110192+0000","last_clean":"2024-09-14T11:51:34.110192+0000","last_became_active":"2024-09-14T11:09:53.001945+0000","last_became_peered":"2024-09-14T11:09:53.001945+0000","last_unstale":"2024-09-14T11:51:34.110192+0000","last_undegraded":"2024-09-14T11:51:34.110192+0000","last_fullsized":"2024-09-14T11:51:34.110192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:52.861043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"264'176","reported_seq":711,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:08.421243+0000","last_change":"2024-09-14T11:09:55.019726+0000","last_active":"2024-09-14T11:52:08.421243+0000","last_peered":"2024-09-14T11:52:08.421243+0000","last_clean":"2024-09-14T11:52:08.421243+0000","last_became_active":"2024-09-14T11:09:55.019043+0000","last_became_peered":"2024-09-14T11:09:55.019043+0000","last_unstale":"2024-09-14T11:52:08.421243+0000","last_undegraded":"2024-09-14T11:52:08.421243+0000","last_fullsized":"2024-09-14T11:52:08.421243+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:33.587845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":311,"num_read_kb":271,"num_write":434,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"264'392","reported_seq":1909,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.024097+0000","last_change":"2024-09-14T11:09:46.980131+0000","last_active":"2024-09-14T11:52:09.024097+0000","last_peered":"2024-09-14T11:52:09.024097+0000","last_clean":"2024-09-14T11:52:09.024097+0000","last_became_active":"2024-09-14T11:09:46.979673+0000","last_became_peered":"2024-09-14T11:09:46.979673+0000","last_unstale":"2024-09-14T11:52:09.024097+0000","last_undegraded":"2024-09-14T11:52:09.024097+0000","last_fullsized":"2024-09-14T11:52:09.024097+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:23.116963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2181,"num_read_kb":2077,"num_write":440,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"264'171","reported_seq":742,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.174113+0000","last_change":"2024-09-14T11:09:45.222105+0000","last_active":"2024-09-14T11:53:57.174113+0000","last_peered":"2024-09-14T11:53:57.174113+0000","last_clean":"2024-09-14T11:53:57.174113+0000","last_became_active":"2024-09-14T11:09:45.220512+0000","last_became_peered":"2024-09-14T11:09:45.220512+0000","last_unstale":"2024-09-14T11:53:57.174113+0000","last_undegraded":"2024-09-14T11:53:57.174113+0000","last_fullsized":"2024-09-14T11:53:57.174113+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:34.422225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655861,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":337,"num_read_kb":1928,"num_write":799,"num_write_kb":32938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:24.327126+0000","last_change":"2024-09-14T11:09:38.140706+0000","last_active":"2024-09-14T11:51:24.327126+0000","last_peered":"2024-09-14T11:51:24.327126+0000","last_clean":"2024-09-14T11:51:24.327126+0000","last_became_active":"2024-09-14T11:09:36.110624+0000","last_became_peered":"2024-09-14T11:09:36.110624+0000","last_unstale":"2024-09-14T11:51:24.327126+0000","last_undegraded":"2024-09-14T11:51:24.327126+0000","last_fullsized":"2024-09-14T11:51:24.327126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:03.769383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002569127,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:28.295129+0000","last_change":"2024-09-14T11:09:48.968649+0000","last_active":"2024-09-14T11:51:28.295129+0000","last_peered":"2024-09-14T11:51:28.295129+0000","last_clean":"2024-09-14T11:51:28.295129+0000","last_became_active":"2024-09-14T11:09:48.968130+0000","last_became_peered":"2024-09-14T11:09:48.968130+0000","last_unstale":"2024-09-14T11:51:28.295129+0000","last_undegraded":"2024-09-14T11:51:28.295129+0000","last_fullsized":"2024-09-14T11:51:28.295129+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:38.760974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"264'157","reported_seq":716,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:33.130356+0000","last_change":"2024-09-14T11:09:50.998266+0000","last_active":"2024-09-14T11:51:33.130356+0000","last_peered":"2024-09-14T11:51:33.130356+0000","last_clean":"2024-09-14T11:51:33.130356+0000","last_became_active":"2024-09-14T11:09:50.997665+0000","last_became_peered":"2024-09-14T11:09:50.997665+0000","last_unstale":"2024-09-14T11:51:33.130356+0000","last_undegraded":"2024-09-14T11:51:33.130356+0000","last_fullsized":"2024-09-14T11:51:33.130356+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:11.749451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":193,"num_read_kb":186,"num_write":126,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"264'803","reported_seq":2773,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.656674+0000","last_change":"2024-09-14T11:09:53.019274+0000","last_active":"2024-09-14T11:53:57.656674+0000","last_peered":"2024-09-14T11:53:57.656674+0000","last_clean":"2024-09-14T11:53:57.656674+0000","last_became_active":"2024-09-14T11:09:53.018558+0000","last_became_peered":"2024-09-14T11:09:53.018558+0000","last_unstale":"2024-09-14T11:53:57.656674+0000","last_undegraded":"2024-09-14T11:53:57.656674+0000","last_fullsized":"2024-09-14T11:53:57.656674+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:50.014596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"264'101","reported_seq":592,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:48.332986+0000","last_change":"2024-09-14T11:09:55.024161+0000","last_active":"2024-09-14T11:52:48.332986+0000","last_peered":"2024-09-14T11:52:48.332986+0000","last_clean":"2024-09-14T11:52:48.332986+0000","last_became_active":"2024-09-14T11:09:55.017739+0000","last_became_peered":"2024-09-14T11:09:55.017739+0000","last_unstale":"2024-09-14T11:52:48.332986+0000","last_undegraded":"2024-09-14T11:52:48.332986+0000","last_fullsized":"2024-09-14T11:52:48.332986+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:11.037869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":97,"num_read_kb":96,"num_write":232,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"264'1040","reported_seq":2573,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.647300+0000","last_change":"2024-09-14T11:09:46.963627+0000","last_active":"2024-09-14T11:52:29.647300+0000","last_peered":"2024-09-14T11:52:29.647300+0000","last_clean":"2024-09-14T11:52:29.647300+0000","last_became_active":"2024-09-14T11:09:46.958507+0000","last_became_peered":"2024-09-14T11:09:46.958507+0000","last_unstale":"2024-09-14T11:52:29.647300+0000","last_undegraded":"2024-09-14T11:52:29.647300+0000","last_fullsized":"2024-09-14T11:52:29.647300+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":1000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:27.643352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4784,"num_read_kb":4190,"num_write":1482,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"264'217","reported_seq":851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.496393+0000","last_change":"2024-09-14T11:09:45.217672+0000","last_active":"2024-09-14T11:53:57.496393+0000","last_peered":"2024-09-14T11:53:57.496393+0000","last_clean":"2024-09-14T11:53:57.496393+0000","last_became_active":"2024-09-14T11:09:45.217039+0000","last_became_peered":"2024-09-14T11:09:45.217039+0000","last_unstale":"2024-09-14T11:53:57.496393+0000","last_undegraded":"2024-09-14T11:53:57.496393+0000","last_fullsized":"2024-09-14T11:53:57.496393+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:21.713459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":539,"num_read_kb":14764,"num_write":981,"num_write_kb":31870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:48.117767+0000","last_change":"2024-09-14T11:09:38.679232+0000","last_active":"2024-09-14T11:50:48.117767+0000","last_peered":"2024-09-14T11:50:48.117767+0000","last_clean":"2024-09-14T11:50:48.117767+0000","last_became_active":"2024-09-14T11:09:36.106073+0000","last_became_peered":"2024-09-14T11:09:36.106073+0000","last_unstale":"2024-09-14T11:50:48.117767+0000","last_undegraded":"2024-09-14T11:50:48.117767+0000","last_fullsized":"2024-09-14T11:50:48.117767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:12.720860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012975129999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:29.328220+0000","last_change":"2024-09-14T11:09:48.970814+0000","last_active":"2024-09-14T11:51:29.328220+0000","last_peered":"2024-09-14T11:51:29.328220+0000","last_clean":"2024-09-14T11:51:29.328220+0000","last_became_active":"2024-09-14T11:09:48.970339+0000","last_became_peered":"2024-09-14T11:09:48.970339+0000","last_unstale":"2024-09-14T11:51:29.328220+0000","last_undegraded":"2024-09-14T11:51:29.328220+0000","last_fullsized":"2024-09-14T11:51:29.328220+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:13.911012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"264'121","reported_seq":652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:56.240192+0000","last_change":"2024-09-14T11:09:50.980619+0000","last_active":"2024-09-14T11:51:56.240192+0000","last_peered":"2024-09-14T11:51:56.240192+0000","last_clean":"2024-09-14T11:51:56.240192+0000","last_became_active":"2024-09-14T11:09:50.979827+0000","last_became_peered":"2024-09-14T11:09:50.979827+0000","last_unstale":"2024-09-14T11:51:56.240192+0000","last_undegraded":"2024-09-14T11:51:56.240192+0000","last_fullsized":"2024-09-14T11:51:56.240192+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:48.508635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":133,"num_read_kb":122,"num_write":94,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"264'802","reported_seq":2479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:56.910131+0000","last_change":"2024-09-14T11:09:53.008348+0000","last_active":"2024-09-14T11:53:56.910131+0000","last_peered":"2024-09-14T11:53:56.910131+0000","last_clean":"2024-09-14T11:53:56.910131+0000","last_became_active":"2024-09-14T11:09:53.007337+0000","last_became_peered":"2024-09-14T11:09:53.007337+0000","last_unstale":"2024-09-14T11:53:56.910131+0000","last_undegraded":"2024-09-14T11:53:56.910131+0000","last_fullsized":"2024-09-14T11:53:56.910131+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:03.521459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"264'267","reported_seq":793,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:02.141641+0000","last_change":"2024-09-14T11:09:55.012569+0000","last_active":"2024-09-14T11:52:02.141641+0000","last_peered":"2024-09-14T11:52:02.141641+0000","last_clean":"2024-09-14T11:52:02.141641+0000","last_became_active":"2024-09-14T11:09:55.011828+0000","last_became_peered":"2024-09-14T11:09:55.011828+0000","last_unstale":"2024-09-14T11:52:02.141641+0000","last_undegraded":"2024-09-14T11:52:02.141641+0000","last_fullsized":"2024-09-14T11:52:02.141641+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:06.262186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":359,"num_read_kb":349,"num_write":571,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"264'1160","reported_seq":2657,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.647384+0000","last_change":"2024-09-14T11:09:46.946333+0000","last_active":"2024-09-14T11:52:29.647384+0000","last_peered":"2024-09-14T11:52:29.647384+0000","last_clean":"2024-09-14T11:52:29.647384+0000","last_became_active":"2024-09-14T11:09:46.946010+0000","last_became_peered":"2024-09-14T11:09:46.946010+0000","last_unstale":"2024-09-14T11:52:29.647384+0000","last_undegraded":"2024-09-14T11:52:29.647384+0000","last_fullsized":"2024-09-14T11:52:29.647384+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":1100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:45.329444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5209,"num_read_kb":4587,"num_write":1598,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"264'207","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.520602+0000","last_change":"2024-09-14T11:09:45.213246+0000","last_active":"2024-09-14T11:53:57.520602+0000","last_peered":"2024-09-14T11:53:57.520602+0000","last_clean":"2024-09-14T11:53:57.520602+0000","last_became_active":"2024-09-14T11:09:45.212500+0000","last_became_peered":"2024-09-14T11:09:45.212500+0000","last_unstale":"2024-09-14T11:53:57.520602+0000","last_undegraded":"2024-09-14T11:53:57.520602+0000","last_fullsized":"2024-09-14T11:53:57.520602+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:35:58.594042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":655,"num_read_kb":3804,"num_write":900,"num_write_kb":25360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:49.317464+0000","last_change":"2024-09-14T11:09:38.140326+0000","last_active":"2024-09-14T11:50:49.317464+0000","last_peered":"2024-09-14T11:50:49.317464+0000","last_clean":"2024-09-14T11:50:49.317464+0000","last_became_active":"2024-09-14T11:09:36.108781+0000","last_became_peered":"2024-09-14T11:09:36.108781+0000","last_unstale":"2024-09-14T11:50:49.317464+0000","last_undegraded":"2024-09-14T11:50:49.317464+0000","last_fullsized":"2024-09-14T11:50:49.317464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:35.084767+0000","last_clean_scrub_stamp":"2024-09-14T11:09:35.084767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:06.040461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002510581,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.132003+0000","last_change":"2024-09-14T11:09:48.971810+0000","last_active":"2024-09-14T11:51:53.132003+0000","last_peered":"2024-09-14T11:51:53.132003+0000","last_clean":"2024-09-14T11:51:53.132003+0000","last_became_active":"2024-09-14T11:09:48.970940+0000","last_became_peered":"2024-09-14T11:09:48.970940+0000","last_unstale":"2024-09-14T11:51:53.132003+0000","last_undegraded":"2024-09-14T11:51:53.132003+0000","last_fullsized":"2024-09-14T11:51:53.132003+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:57.505239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"264'311","reported_seq":1021,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.604156+0000","last_change":"2024-09-14T11:09:50.993096+0000","last_active":"2024-09-14T11:53:57.604156+0000","last_peered":"2024-09-14T11:53:57.604156+0000","last_clean":"2024-09-14T11:53:57.604156+0000","last_became_active":"2024-09-14T11:09:50.992374+0000","last_became_peered":"2024-09-14T11:09:50.992374+0000","last_unstale":"2024-09-14T11:53:57.604156+0000","last_undegraded":"2024-09-14T11:53:57.604156+0000","last_fullsized":"2024-09-14T11:53:57.604156+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:36.668946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20511,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":444,"num_read_kb":597,"num_write":216,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:33.127557+0000","last_change":"2024-09-14T11:09:53.004011+0000","last_active":"2024-09-14T11:51:33.127557+0000","last_peered":"2024-09-14T11:51:33.127557+0000","last_clean":"2024-09-14T11:51:33.127557+0000","last_became_active":"2024-09-14T11:09:53.002904+0000","last_became_peered":"2024-09-14T11:09:53.002904+0000","last_unstale":"2024-09-14T11:51:33.127557+0000","last_undegraded":"2024-09-14T11:51:33.127557+0000","last_fullsized":"2024-09-14T11:51:33.127557+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:43.359087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"264'131","reported_seq":631,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.024565+0000","last_change":"2024-09-14T11:09:55.014957+0000","last_active":"2024-09-14T11:53:43.024565+0000","last_peered":"2024-09-14T11:53:43.024565+0000","last_clean":"2024-09-14T11:53:43.024565+0000","last_became_active":"2024-09-14T11:09:55.014192+0000","last_became_peered":"2024-09-14T11:09:55.014192+0000","last_unstale":"2024-09-14T11:53:43.024565+0000","last_undegraded":"2024-09-14T11:53:43.024565+0000","last_fullsized":"2024-09-14T11:53:43.024565+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:45.779974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":303,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"264'162","reported_seq":744,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.795176+0000","last_change":"2024-09-14T11:09:55.015877+0000","last_active":"2024-09-14T11:52:29.795176+0000","last_peered":"2024-09-14T11:52:29.795176+0000","last_clean":"2024-09-14T11:52:29.795176+0000","last_became_active":"2024-09-14T11:09:55.015127+0000","last_became_peered":"2024-09-14T11:09:55.015127+0000","last_unstale":"2024-09-14T11:52:29.795176+0000","last_undegraded":"2024-09-14T11:52:29.795176+0000","last_fullsized":"2024-09-14T11:52:29.795176+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:49.733188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":313,"num_read_kb":285,"num_write":384,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"264'821","reported_seq":2478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.015985+0000","last_change":"2024-09-14T11:09:46.949040+0000","last_active":"2024-09-14T11:52:29.015985+0000","last_peered":"2024-09-14T11:52:29.015985+0000","last_clean":"2024-09-14T11:52:29.015985+0000","last_became_active":"2024-09-14T11:09:46.948706+0000","last_became_peered":"2024-09-14T11:09:46.948706+0000","last_unstale":"2024-09-14T11:52:29.015985+0000","last_undegraded":"2024-09-14T11:52:29.015985+0000","last_fullsized":"2024-09-14T11:52:29.015985+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":800,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:18.066498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4239,"num_read_kb":3866,"num_write":1097,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"264'191","reported_seq":832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.230493+0000","last_change":"2024-09-14T11:09:45.201897+0000","last_active":"2024-09-14T11:53:57.230493+0000","last_peered":"2024-09-14T11:53:57.230493+0000","last_clean":"2024-09-14T11:53:57.230493+0000","last_became_active":"2024-09-14T11:09:45.201562+0000","last_became_peered":"2024-09-14T11:09:45.201562+0000","last_unstale":"2024-09-14T11:53:57.230493+0000","last_undegraded":"2024-09-14T11:53:57.230493+0000","last_fullsized":"2024-09-14T11:53:57.230493+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:04.521022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655874,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":505,"num_read_kb":86083,"num_write":869,"num_write_kb":49236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.102271+0000","last_change":"2024-09-14T11:09:48.963401+0000","last_active":"2024-09-14T11:49:28.102271+0000","last_peered":"2024-09-14T11:49:28.102271+0000","last_clean":"2024-09-14T11:49:28.102271+0000","last_became_active":"2024-09-14T11:09:48.962619+0000","last_became_peered":"2024-09-14T11:09:48.962619+0000","last_unstale":"2024-09-14T11:49:28.102271+0000","last_undegraded":"2024-09-14T11:49:28.102271+0000","last_fullsized":"2024-09-14T11:49:28.102271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:52.738701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"264'171","reported_seq":740,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.219427+0000","last_change":"2024-09-14T11:09:50.996731+0000","last_active":"2024-09-14T11:53:57.219427+0000","last_peered":"2024-09-14T11:53:57.219427+0000","last_clean":"2024-09-14T11:53:57.219427+0000","last_became_active":"2024-09-14T11:09:50.996047+0000","last_became_peered":"2024-09-14T11:09:50.996047+0000","last_unstale":"2024-09-14T11:53:57.219427+0000","last_undegraded":"2024-09-14T11:53:57.219427+0000","last_fullsized":"2024-09-14T11:53:57.219427+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:30.833822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28669,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":205,"num_read_kb":341,"num_write":126,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:33.280880+0000","last_change":"2024-09-14T11:09:53.001072+0000","last_active":"2024-09-14T11:49:33.280880+0000","last_peered":"2024-09-14T11:49:33.280880+0000","last_clean":"2024-09-14T11:49:33.280880+0000","last_became_active":"2024-09-14T11:09:53.000339+0000","last_became_peered":"2024-09-14T11:09:53.000339+0000","last_unstale":"2024-09-14T11:49:33.280880+0000","last_undegraded":"2024-09-14T11:49:33.280880+0000","last_fullsized":"2024-09-14T11:49:33.280880+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:15.810620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"264'95","reported_seq":580,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:03.319786+0000","last_change":"2024-09-14T11:09:55.023250+0000","last_active":"2024-09-14T11:52:03.319786+0000","last_peered":"2024-09-14T11:52:03.319786+0000","last_clean":"2024-09-14T11:52:03.319786+0000","last_became_active":"2024-09-14T11:09:55.022477+0000","last_became_peered":"2024-09-14T11:09:55.022477+0000","last_unstale":"2024-09-14T11:52:03.319786+0000","last_undegraded":"2024-09-14T11:52:03.319786+0000","last_fullsized":"2024-09-14T11:52:03.319786+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:48.971105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":73,"num_write":206,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"264'413","reported_seq":1945,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.021893+0000","last_change":"2024-09-14T11:09:46.949256+0000","last_active":"2024-09-14T11:52:29.021893+0000","last_peered":"2024-09-14T11:52:29.021893+0000","last_clean":"2024-09-14T11:52:29.021893+0000","last_became_active":"2024-09-14T11:09:46.948572+0000","last_became_peered":"2024-09-14T11:09:46.948572+0000","last_unstale":"2024-09-14T11:52:29.021893+0000","last_undegraded":"2024-09-14T11:52:29.021893+0000","last_fullsized":"2024-09-14T11:52:29.021893+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:03.770405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2176,"num_read_kb":2078,"num_write":464,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"264'232","reported_seq":848,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:18.316297+0000","last_change":"2024-09-14T11:09:45.224440+0000","last_active":"2024-09-14T11:53:18.316297+0000","last_peered":"2024-09-14T11:53:18.316297+0000","last_clean":"2024-09-14T11:53:18.316297+0000","last_became_active":"2024-09-14T11:09:45.223324+0000","last_became_peered":"2024-09-14T11:09:45.223324+0000","last_unstale":"2024-09-14T11:53:18.316297+0000","last_undegraded":"2024-09-14T11:53:18.316297+0000","last_fullsized":"2024-09-14T11:53:18.316297+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:46.914684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655868,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":554,"num_read_kb":7834,"num_write":1127,"num_write_kb":26023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"35'3","reported_seq":978,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:56.637717+0000","last_change":"2024-09-14T11:09:48.969925+0000","last_active":"2024-09-14T11:53:56.637717+0000","last_peered":"2024-09-14T11:53:56.637717+0000","last_clean":"2024-09-14T11:53:56.637717+0000","last_became_active":"2024-09-14T11:09:48.968561+0000","last_became_peered":"2024-09-14T11:09:48.968561+0000","last_unstale":"2024-09-14T11:53:56.637717+0000","last_undegraded":"2024-09-14T11:53:56.637717+0000","last_fullsized":"2024-09-14T11:53:56.637717+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:29.015385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":728,"num_read_kb":726,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"264'44","reported_seq":545,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.132030+0000","last_change":"2024-09-14T11:09:50.981928+0000","last_active":"2024-09-14T11:51:53.132030+0000","last_peered":"2024-09-14T11:51:53.132030+0000","last_clean":"2024-09-14T11:51:53.132030+0000","last_became_active":"2024-09-14T11:09:50.981128+0000","last_became_peered":"2024-09-14T11:09:50.981128+0000","last_unstale":"2024-09-14T11:51:53.132030+0000","last_undegraded":"2024-09-14T11:51:53.132030+0000","last_fullsized":"2024-09-14T11:51:53.132030+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:25.003185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:34.082103+0000","last_change":"2024-09-14T11:09:53.007173+0000","last_active":"2024-09-14T11:49:34.082103+0000","last_peered":"2024-09-14T11:49:34.082103+0000","last_clean":"2024-09-14T11:49:34.082103+0000","last_became_active":"2024-09-14T11:09:53.006292+0000","last_became_peered":"2024-09-14T11:09:53.006292+0000","last_unstale":"2024-09-14T11:49:34.082103+0000","last_undegraded":"2024-09-14T11:49:34.082103+0000","last_fullsized":"2024-09-14T11:49:34.082103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:01.689414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"264'206","reported_seq":723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.013495+0000","last_change":"2024-09-14T11:09:55.015153+0000","last_active":"2024-09-14T11:52:29.013495+0000","last_peered":"2024-09-14T11:52:29.013495+0000","last_clean":"2024-09-14T11:52:29.013495+0000","last_became_active":"2024-09-14T11:09:55.014414+0000","last_became_peered":"2024-09-14T11:09:55.014414+0000","last_unstale":"2024-09-14T11:52:29.013495+0000","last_undegraded":"2024-09-14T11:52:29.013495+0000","last_fullsized":"2024-09-14T11:52:29.013495+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:10.146075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":294,"num_read_kb":289,"num_write":451,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"264'673","reported_seq":2427,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.161127+0000","last_change":"2024-09-14T11:09:46.963397+0000","last_active":"2024-09-14T11:52:12.161127+0000","last_peered":"2024-09-14T11:52:12.161127+0000","last_clean":"2024-09-14T11:52:12.161127+0000","last_became_active":"2024-09-14T11:09:46.962508+0000","last_became_peered":"2024-09-14T11:09:46.962508+0000","last_unstale":"2024-09-14T11:52:12.161127+0000","last_undegraded":"2024-09-14T11:52:12.161127+0000","last_fullsized":"2024-09-14T11:52:12.161127+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":600,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:44.240688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3732,"num_read_kb":3415,"num_write":933,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"264'189","reported_seq":790,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.488745+0000","last_change":"2024-09-14T11:09:45.207817+0000","last_active":"2024-09-14T11:53:57.488745+0000","last_peered":"2024-09-14T11:53:57.488745+0000","last_clean":"2024-09-14T11:53:57.488745+0000","last_became_active":"2024-09-14T11:09:45.206901+0000","last_became_peered":"2024-09-14T11:09:45.206901+0000","last_unstale":"2024-09-14T11:53:57.488745+0000","last_undegraded":"2024-09-14T11:53:57.488745+0000","last_fullsized":"2024-09-14T11:53:57.488745+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:29.534278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":442,"num_read_kb":9264,"num_write":863,"num_write_kb":15949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:29.080988+0000","last_change":"2024-09-14T11:09:48.960157+0000","last_active":"2024-09-14T11:49:29.080988+0000","last_peered":"2024-09-14T11:49:29.080988+0000","last_clean":"2024-09-14T11:49:29.080988+0000","last_became_active":"2024-09-14T11:09:48.959413+0000","last_became_peered":"2024-09-14T11:09:48.959413+0000","last_unstale":"2024-09-14T11:49:29.080988+0000","last_undegraded":"2024-09-14T11:49:29.080988+0000","last_fullsized":"2024-09-14T11:49:29.080988+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:19.014844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"264'159","reported_seq":740,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.620906+0000","last_change":"2024-09-14T11:09:51.000219+0000","last_active":"2024-09-14T11:53:57.620906+0000","last_peered":"2024-09-14T11:53:57.620906+0000","last_clean":"2024-09-14T11:53:57.620906+0000","last_became_active":"2024-09-14T11:09:50.999585+0000","last_became_peered":"2024-09-14T11:09:50.999585+0000","last_unstale":"2024-09-14T11:53:57.620906+0000","last_undegraded":"2024-09-14T11:53:57.620906+0000","last_fullsized":"2024-09-14T11:53:57.620906+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:27.217391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7038,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":217,"num_read_kb":281,"num_write":118,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:33.253171+0000","last_change":"2024-09-14T11:09:53.019246+0000","last_active":"2024-09-14T11:49:33.253171+0000","last_peered":"2024-09-14T11:49:33.253171+0000","last_clean":"2024-09-14T11:49:33.253171+0000","last_became_active":"2024-09-14T11:09:53.018479+0000","last_became_peered":"2024-09-14T11:09:53.018479+0000","last_unstale":"2024-09-14T11:49:33.253171+0000","last_undegraded":"2024-09-14T11:49:33.253171+0000","last_fullsized":"2024-09-14T11:49:33.253171+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:01.598876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"264'128","reported_seq":631,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.390381+0000","last_change":"2024-09-14T11:09:55.029326+0000","last_active":"2024-09-14T11:52:29.390381+0000","last_peered":"2024-09-14T11:52:29.390381+0000","last_clean":"2024-09-14T11:52:29.390381+0000","last_became_active":"2024-09-14T11:09:55.028633+0000","last_became_peered":"2024-09-14T11:09:55.028633+0000","last_unstale":"2024-09-14T11:52:29.390381+0000","last_undegraded":"2024-09-14T11:52:29.390381+0000","last_fullsized":"2024-09-14T11:52:29.390381+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:48.218210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":141,"num_write":296,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"264'503","reported_seq":2213,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:10.824533+0000","last_change":"2024-09-14T11:09:46.964085+0000","last_active":"2024-09-14T11:52:10.824533+0000","last_peered":"2024-09-14T11:52:10.824533+0000","last_clean":"2024-09-14T11:52:10.824533+0000","last_became_active":"2024-09-14T11:09:46.962364+0000","last_became_peered":"2024-09-14T11:09:46.962364+0000","last_unstale":"2024-09-14T11:52:10.824533+0000","last_undegraded":"2024-09-14T11:52:10.824533+0000","last_fullsized":"2024-09-14T11:52:10.824533+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:39.362696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2859,"num_read_kb":2685,"num_write":625,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"264'227","reported_seq":847,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.102751+0000","last_change":"2024-09-14T11:09:45.208047+0000","last_active":"2024-09-14T11:53:57.102751+0000","last_peered":"2024-09-14T11:53:57.102751+0000","last_clean":"2024-09-14T11:53:57.102751+0000","last_became_active":"2024-09-14T11:09:45.206145+0000","last_became_peered":"2024-09-14T11:09:45.206145+0000","last_unstale":"2024-09-14T11:53:57.102751+0000","last_undegraded":"2024-09-14T11:53:57.102751+0000","last_fullsized":"2024-09-14T11:53:57.102751+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:19.451341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":553,"num_read_kb":30372,"num_write":894,"num_write_kb":16933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"35'4","reported_seq":973,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:56.635423+0000","last_change":"2024-09-14T11:09:48.964002+0000","last_active":"2024-09-14T11:53:56.635423+0000","last_peered":"2024-09-14T11:53:56.635423+0000","last_clean":"2024-09-14T11:53:56.635423+0000","last_became_active":"2024-09-14T11:09:48.963563+0000","last_became_peered":"2024-09-14T11:09:48.963563+0000","last_unstale":"2024-09-14T11:53:56.635423+0000","last_undegraded":"2024-09-14T11:53:56.635423+0000","last_fullsized":"2024-09-14T11:53:56.635423+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:45.473064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":1197,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"264'125","reported_seq":686,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.572726+0000","last_change":"2024-09-14T11:09:50.989001+0000","last_active":"2024-09-14T11:53:57.572726+0000","last_peered":"2024-09-14T11:53:57.572726+0000","last_clean":"2024-09-14T11:53:57.572726+0000","last_became_active":"2024-09-14T11:09:50.988286+0000","last_became_peered":"2024-09-14T11:09:50.988286+0000","last_unstale":"2024-09-14T11:53:57.572726+0000","last_undegraded":"2024-09-14T11:53:57.572726+0000","last_fullsized":"2024-09-14T11:53:57.572726+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:38.798725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5180,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":147,"num_read_kb":193,"num_write":70,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:33.280996+0000","last_change":"2024-09-14T11:09:53.007660+0000","last_active":"2024-09-14T11:49:33.280996+0000","last_peered":"2024-09-14T11:49:33.280996+0000","last_clean":"2024-09-14T11:49:33.280996+0000","last_became_active":"2024-09-14T11:09:53.006975+0000","last_became_peered":"2024-09-14T11:09:53.006975+0000","last_unstale":"2024-09-14T11:49:33.280996+0000","last_undegraded":"2024-09-14T11:49:33.280996+0000","last_fullsized":"2024-09-14T11:49:33.280996+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:46.501395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"264'597","reported_seq":2244,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.185358+0000","last_change":"2024-09-14T11:09:46.975318+0000","last_active":"2024-09-14T11:52:12.185358+0000","last_peered":"2024-09-14T11:52:12.185358+0000","last_clean":"2024-09-14T11:52:12.185358+0000","last_became_active":"2024-09-14T11:09:46.975017+0000","last_became_peered":"2024-09-14T11:09:46.975017+0000","last_unstale":"2024-09-14T11:52:12.185358+0000","last_undegraded":"2024-09-14T11:52:12.185358+0000","last_fullsized":"2024-09-14T11:52:12.185358+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":500,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:58.187359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3191,"num_read_kb":2927,"num_write":756,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"264'280","reported_seq":961,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.541700+0000","last_change":"2024-09-14T11:09:45.217804+0000","last_active":"2024-09-14T11:53:57.541700+0000","last_peered":"2024-09-14T11:53:57.541700+0000","last_clean":"2024-09-14T11:53:57.541700+0000","last_became_active":"2024-09-14T11:09:45.216742+0000","last_became_peered":"2024-09-14T11:09:45.216742+0000","last_unstale":"2024-09-14T11:53:57.541700+0000","last_undegraded":"2024-09-14T11:53:57.541700+0000","last_fullsized":"2024-09-14T11:53:57.541700+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:35.991962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":743,"num_read_kb":84606,"num_write":1211,"num_write_kb":44892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:58.135987+0000","last_change":"2024-09-14T11:09:48.966915+0000","last_active":"2024-09-14T11:51:58.135987+0000","last_peered":"2024-09-14T11:51:58.135987+0000","last_clean":"2024-09-14T11:51:58.135987+0000","last_became_active":"2024-09-14T11:09:48.966112+0000","last_became_peered":"2024-09-14T11:09:48.966112+0000","last_unstale":"2024-09-14T11:51:58.135987+0000","last_undegraded":"2024-09-14T11:51:58.135987+0000","last_fullsized":"2024-09-14T11:51:58.135987+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:36.703419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"264'209","reported_seq":832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.558418+0000","last_change":"2024-09-14T11:09:50.996090+0000","last_active":"2024-09-14T11:53:57.558418+0000","last_peered":"2024-09-14T11:53:57.558418+0000","last_clean":"2024-09-14T11:53:57.558418+0000","last_became_active":"2024-09-14T11:09:50.995279+0000","last_became_peered":"2024-09-14T11:09:50.995279+0000","last_unstale":"2024-09-14T11:53:57.558418+0000","last_undegraded":"2024-09-14T11:53:57.558418+0000","last_fullsized":"2024-09-14T11:53:57.558418+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:02.160055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27447,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":311,"num_read_kb":486,"num_write":198,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:54.086888+0000","last_change":"2024-09-14T11:09:53.003946+0000","last_active":"2024-09-14T11:49:54.086888+0000","last_peered":"2024-09-14T11:49:54.086888+0000","last_clean":"2024-09-14T11:49:54.086888+0000","last_became_active":"2024-09-14T11:09:53.002862+0000","last_became_peered":"2024-09-14T11:09:53.002862+0000","last_unstale":"2024-09-14T11:49:54.086888+0000","last_undegraded":"2024-09-14T11:49:54.086888+0000","last_fullsized":"2024-09-14T11:49:54.086888+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:50.669809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"264'167","reported_seq":666,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:33.637848+0000","last_change":"2024-09-14T11:09:55.024496+0000","last_active":"2024-09-14T11:51:33.637848+0000","last_peered":"2024-09-14T11:51:33.637848+0000","last_clean":"2024-09-14T11:51:33.637848+0000","last_became_active":"2024-09-14T11:09:55.023821+0000","last_became_peered":"2024-09-14T11:09:55.023821+0000","last_unstale":"2024-09-14T11:51:33.637848+0000","last_undegraded":"2024-09-14T11:51:33.637848+0000","last_fullsized":"2024-09-14T11:51:33.637848+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:18.416018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":195,"num_read_kb":205,"num_write":392,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"264'861","reported_seq":2612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:11.486672+0000","last_change":"2024-09-14T11:09:46.968180+0000","last_active":"2024-09-14T11:52:11.486672+0000","last_peered":"2024-09-14T11:52:11.486672+0000","last_clean":"2024-09-14T11:52:11.486672+0000","last_became_active":"2024-09-14T11:09:46.967144+0000","last_became_peered":"2024-09-14T11:09:46.967144+0000","last_unstale":"2024-09-14T11:52:11.486672+0000","last_undegraded":"2024-09-14T11:52:11.486672+0000","last_fullsized":"2024-09-14T11:52:11.486672+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":800,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:12.513360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4422,"num_read_kb":4033,"num_write":1158,"num_write_kb":453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"264'188","reported_seq":802,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.172773+0000","last_change":"2024-09-14T11:09:45.187524+0000","last_active":"2024-09-14T11:53:57.172773+0000","last_peered":"2024-09-14T11:53:57.172773+0000","last_clean":"2024-09-14T11:53:57.172773+0000","last_became_active":"2024-09-14T11:09:45.186745+0000","last_became_peered":"2024-09-14T11:09:45.186745+0000","last_unstale":"2024-09-14T11:53:57.172773+0000","last_undegraded":"2024-09-14T11:53:57.172773+0000","last_fullsized":"2024-09-14T11:53:57.172773+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:52.434620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":536,"num_read_kb":5513,"num_write":846,"num_write_kb":29456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:29.109137+0000","last_change":"2024-09-14T11:09:48.952351+0000","last_active":"2024-09-14T11:51:29.109137+0000","last_peered":"2024-09-14T11:51:29.109137+0000","last_clean":"2024-09-14T11:51:29.109137+0000","last_became_active":"2024-09-14T11:09:48.951908+0000","last_became_peered":"2024-09-14T11:09:48.951908+0000","last_unstale":"2024-09-14T11:51:29.109137+0000","last_undegraded":"2024-09-14T11:51:29.109137+0000","last_fullsized":"2024-09-14T11:51:29.109137+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:14:06.155760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"264'166","reported_seq":742,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.588421+0000","last_change":"2024-09-14T11:09:50.986099+0000","last_active":"2024-09-14T11:53:57.588421+0000","last_peered":"2024-09-14T11:53:57.588421+0000","last_clean":"2024-09-14T11:53:57.588421+0000","last_became_active":"2024-09-14T11:09:50.983553+0000","last_became_peered":"2024-09-14T11:09:50.983553+0000","last_unstale":"2024-09-14T11:53:57.588421+0000","last_undegraded":"2024-09-14T11:53:57.588421+0000","last_fullsized":"2024-09-14T11:53:57.588421+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:45.407677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13815,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":225,"num_read_kb":306,"num_write":144,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.110650+0000","last_change":"2024-09-14T11:09:53.024431+0000","last_active":"2024-09-14T11:49:53.110650+0000","last_peered":"2024-09-14T11:49:53.110650+0000","last_clean":"2024-09-14T11:49:53.110650+0000","last_became_active":"2024-09-14T11:09:53.023609+0000","last_became_peered":"2024-09-14T11:09:53.023609+0000","last_unstale":"2024-09-14T11:49:53.110650+0000","last_undegraded":"2024-09-14T11:49:53.110650+0000","last_fullsized":"2024-09-14T11:49:53.110650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:43.568040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"264'155","reported_seq":651,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:28.256688+0000","last_change":"2024-09-14T11:09:55.029184+0000","last_active":"2024-09-14T11:52:28.256688+0000","last_peered":"2024-09-14T11:52:28.256688+0000","last_clean":"2024-09-14T11:52:28.256688+0000","last_became_active":"2024-09-14T11:09:55.028344+0000","last_became_peered":"2024-09-14T11:09:55.028344+0000","last_unstale":"2024-09-14T11:52:28.256688+0000","last_undegraded":"2024-09-14T11:52:28.256688+0000","last_fullsized":"2024-09-14T11:52:28.256688+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:09.622914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1619,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":178,"num_read_kb":177,"num_write":459,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"264'844","reported_seq":2442,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.991688+0000","last_change":"2024-09-14T11:09:46.991793+0000","last_active":"2024-09-14T11:52:09.991688+0000","last_peered":"2024-09-14T11:52:09.991688+0000","last_clean":"2024-09-14T11:52:09.991688+0000","last_became_active":"2024-09-14T11:09:46.990923+0000","last_became_peered":"2024-09-14T11:09:46.990923+0000","last_unstale":"2024-09-14T11:52:09.991688+0000","last_undegraded":"2024-09-14T11:52:09.991688+0000","last_fullsized":"2024-09-14T11:52:09.991688+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":800,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:14.204773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4067,"num_read_kb":3661,"num_write":1092,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"264'164","reported_seq":749,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.511562+0000","last_change":"2024-09-14T11:09:45.201353+0000","last_active":"2024-09-14T11:53:57.511562+0000","last_peered":"2024-09-14T11:53:57.511562+0000","last_clean":"2024-09-14T11:53:57.511562+0000","last_became_active":"2024-09-14T11:09:45.201058+0000","last_became_peered":"2024-09-14T11:09:45.201058+0000","last_unstale":"2024-09-14T11:53:57.511562+0000","last_undegraded":"2024-09-14T11:53:57.511562+0000","last_fullsized":"2024-09-14T11:53:57.511562+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:57.653038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":358,"num_read_kb":4087,"num_write":735,"num_write_kb":11722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:49.085664+0000","last_change":"2024-09-14T11:09:48.969192+0000","last_active":"2024-09-14T11:49:49.085664+0000","last_peered":"2024-09-14T11:49:49.085664+0000","last_clean":"2024-09-14T11:49:49.085664+0000","last_became_active":"2024-09-14T11:09:48.968770+0000","last_became_peered":"2024-09-14T11:09:48.968770+0000","last_unstale":"2024-09-14T11:49:49.085664+0000","last_undegraded":"2024-09-14T11:49:49.085664+0000","last_fullsized":"2024-09-14T11:49:49.085664+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:32.471236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"264'133","reported_seq":705,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.302781+0000","last_change":"2024-09-14T11:09:50.999804+0000","last_active":"2024-09-14T11:53:57.302781+0000","last_peered":"2024-09-14T11:53:57.302781+0000","last_clean":"2024-09-14T11:53:57.302781+0000","last_became_active":"2024-09-14T11:09:50.999079+0000","last_became_peered":"2024-09-14T11:09:50.999079+0000","last_unstale":"2024-09-14T11:53:57.302781+0000","last_undegraded":"2024-09-14T11:53:57.302781+0000","last_fullsized":"2024-09-14T11:53:57.302781+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:44.334838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6871,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":175,"num_read_kb":247,"num_write":92,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:58.318675+0000","last_change":"2024-09-14T11:09:53.009600+0000","last_active":"2024-09-14T11:51:58.318675+0000","last_peered":"2024-09-14T11:51:58.318675+0000","last_clean":"2024-09-14T11:51:58.318675+0000","last_became_active":"2024-09-14T11:09:53.008952+0000","last_became_peered":"2024-09-14T11:09:53.008952+0000","last_unstale":"2024-09-14T11:51:58.318675+0000","last_undegraded":"2024-09-14T11:51:58.318675+0000","last_fullsized":"2024-09-14T11:51:58.318675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:04.350006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"264'141","reported_seq":633,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.047202+0000","last_change":"2024-09-14T11:09:55.029152+0000","last_active":"2024-09-14T11:53:44.047202+0000","last_peered":"2024-09-14T11:53:44.047202+0000","last_clean":"2024-09-14T11:53:44.047202+0000","last_became_active":"2024-09-14T11:09:55.028413+0000","last_became_peered":"2024-09-14T11:09:55.028413+0000","last_unstale":"2024-09-14T11:53:44.047202+0000","last_undegraded":"2024-09-14T11:53:44.047202+0000","last_fullsized":"2024-09-14T11:53:44.047202+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:42.297511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":142,"num_write":355,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"264'420","reported_seq":1977,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.106262+0000","last_change":"2024-09-14T11:09:46.987394+0000","last_active":"2024-09-14T11:53:43.106262+0000","last_peered":"2024-09-14T11:53:43.106262+0000","last_clean":"2024-09-14T11:53:43.106262+0000","last_became_active":"2024-09-14T11:09:46.986721+0000","last_became_peered":"2024-09-14T11:09:46.986721+0000","last_unstale":"2024-09-14T11:53:43.106262+0000","last_undegraded":"2024-09-14T11:53:43.106262+0000","last_fullsized":"2024-09-14T11:53:43.106262+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:07.328123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2241,"num_read_kb":2140,"num_write":472,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"264'227","reported_seq":831,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.554523+0000","last_change":"2024-09-14T11:09:45.212627+0000","last_active":"2024-09-14T11:53:57.554523+0000","last_peered":"2024-09-14T11:53:57.554523+0000","last_clean":"2024-09-14T11:53:57.554523+0000","last_became_active":"2024-09-14T11:09:45.211984+0000","last_became_peered":"2024-09-14T11:09:45.211984+0000","last_unstale":"2024-09-14T11:53:57.554523+0000","last_undegraded":"2024-09-14T11:53:57.554523+0000","last_fullsized":"2024-09-14T11:53:57.554523+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:55.366169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":505,"num_read_kb":8662,"num_write":1132,"num_write_kb":22372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.104342+0000","last_change":"2024-09-14T11:09:48.969193+0000","last_active":"2024-09-14T11:49:48.104342+0000","last_peered":"2024-09-14T11:49:48.104342+0000","last_clean":"2024-09-14T11:49:48.104342+0000","last_became_active":"2024-09-14T11:09:48.968459+0000","last_became_peered":"2024-09-14T11:09:48.968459+0000","last_unstale":"2024-09-14T11:49:48.104342+0000","last_undegraded":"2024-09-14T11:49:48.104342+0000","last_fullsized":"2024-09-14T11:49:48.104342+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:25.826727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"264'96","reported_seq":611,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:59.338693+0000","last_change":"2024-09-14T11:09:50.980469+0000","last_active":"2024-09-14T11:51:59.338693+0000","last_peered":"2024-09-14T11:51:59.338693+0000","last_clean":"2024-09-14T11:51:59.338693+0000","last_became_active":"2024-09-14T11:09:50.979749+0000","last_became_peered":"2024-09-14T11:09:50.979749+0000","last_unstale":"2024-09-14T11:51:59.338693+0000","last_undegraded":"2024-09-14T11:51:59.338693+0000","last_fullsized":"2024-09-14T11:51:59.338693+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:58.555300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":88,"num_read_kb":80,"num_write":70,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"264'783","reported_seq":4300,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:56.895525+0000","last_change":"2024-09-14T11:09:53.017293+0000","last_active":"2024-09-14T11:53:56.895525+0000","last_peered":"2024-09-14T11:53:56.895525+0000","last_clean":"2024-09-14T11:53:56.895525+0000","last_became_active":"2024-09-14T11:09:53.014955+0000","last_became_peered":"2024-09-14T11:09:53.014955+0000","last_unstale":"2024-09-14T11:53:56.895525+0000","last_undegraded":"2024-09-14T11:53:56.895525+0000","last_fullsized":"2024-09-14T11:53:56.895525+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:13.437678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"264'92","reported_seq":581,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.473000+0000","last_change":"2024-09-14T11:09:55.030910+0000","last_active":"2024-09-14T11:52:29.473000+0000","last_peered":"2024-09-14T11:52:29.473000+0000","last_clean":"2024-09-14T11:52:29.473000+0000","last_became_active":"2024-09-14T11:09:55.030211+0000","last_became_peered":"2024-09-14T11:09:55.030211+0000","last_unstale":"2024-09-14T11:52:29.473000+0000","last_undegraded":"2024-09-14T11:52:29.473000+0000","last_fullsized":"2024-09-14T11:52:29.473000+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:19.664371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":87,"num_write":222,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"264'455","reported_seq":1998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:27.186133+0000","last_change":"2024-09-14T11:09:46.975329+0000","last_active":"2024-09-14T11:52:27.186133+0000","last_peered":"2024-09-14T11:52:27.186133+0000","last_clean":"2024-09-14T11:52:27.186133+0000","last_became_active":"2024-09-14T11:09:46.974957+0000","last_became_peered":"2024-09-14T11:09:46.974957+0000","last_unstale":"2024-09-14T11:52:27.186133+0000","last_undegraded":"2024-09-14T11:52:27.186133+0000","last_fullsized":"2024-09-14T11:52:27.186133+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:48.632851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2398,"num_read_kb":2260,"num_write":532,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"264'303","reported_seq":995,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.473251+0000","last_change":"2024-09-14T11:09:45.205274+0000","last_active":"2024-09-14T11:53:57.473251+0000","last_peered":"2024-09-14T11:53:57.473251+0000","last_clean":"2024-09-14T11:53:57.473251+0000","last_became_active":"2024-09-14T11:09:45.204014+0000","last_became_peered":"2024-09-14T11:09:45.204014+0000","last_unstale":"2024-09-14T11:53:57.473251+0000","last_undegraded":"2024-09-14T11:53:57.473251+0000","last_fullsized":"2024-09-14T11:53:57.473251+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:53.629440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":844,"num_read_kb":35877,"num_write":1474,"num_write_kb":50924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.256593+0000","last_change":"2024-09-14T11:09:48.950935+0000","last_active":"2024-09-14T11:49:48.256593+0000","last_peered":"2024-09-14T11:49:48.256593+0000","last_clean":"2024-09-14T11:49:48.256593+0000","last_became_active":"2024-09-14T11:09:48.950445+0000","last_became_peered":"2024-09-14T11:09:48.950445+0000","last_unstale":"2024-09-14T11:49:48.256593+0000","last_undegraded":"2024-09-14T11:49:48.256593+0000","last_fullsized":"2024-09-14T11:49:48.256593+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:53.596593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"264'167","reported_seq":743,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.416290+0000","last_change":"2024-09-14T11:09:50.992957+0000","last_active":"2024-09-14T11:53:57.416290+0000","last_peered":"2024-09-14T11:53:57.416290+0000","last_clean":"2024-09-14T11:53:57.416290+0000","last_became_active":"2024-09-14T11:09:50.992216+0000","last_became_peered":"2024-09-14T11:09:50.992216+0000","last_unstale":"2024-09-14T11:53:57.416290+0000","last_undegraded":"2024-09-14T11:53:57.416290+0000","last_fullsized":"2024-09-14T11:53:57.416290+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:17.396343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59902,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":237,"num_read_kb":452,"num_write":144,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.119821+0000","last_change":"2024-09-14T11:09:53.024153+0000","last_active":"2024-09-14T11:50:58.119821+0000","last_peered":"2024-09-14T11:50:58.119821+0000","last_clean":"2024-09-14T11:50:58.119821+0000","last_became_active":"2024-09-14T11:09:53.023492+0000","last_became_peered":"2024-09-14T11:09:53.023492+0000","last_unstale":"2024-09-14T11:50:58.119821+0000","last_undegraded":"2024-09-14T11:50:58.119821+0000","last_fullsized":"2024-09-14T11:50:58.119821+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:38.239379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"264'112","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.759177+0000","last_change":"2024-09-14T11:09:55.027867+0000","last_active":"2024-09-14T11:52:12.759177+0000","last_peered":"2024-09-14T11:52:12.759177+0000","last_clean":"2024-09-14T11:52:12.759177+0000","last_became_active":"2024-09-14T11:09:55.027044+0000","last_became_peered":"2024-09-14T11:09:55.027044+0000","last_unstale":"2024-09-14T11:52:12.759177+0000","last_undegraded":"2024-09-14T11:52:12.759177+0000","last_fullsized":"2024-09-14T11:52:12.759177+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:52.809691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":137,"num_read_kb":126,"num_write":268,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"264'782","reported_seq":2408,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.105257+0000","last_change":"2024-09-14T11:09:46.981979+0000","last_active":"2024-09-14T11:53:43.105257+0000","last_peered":"2024-09-14T11:53:43.105257+0000","last_clean":"2024-09-14T11:53:43.105257+0000","last_became_active":"2024-09-14T11:09:46.981651+0000","last_became_peered":"2024-09-14T11:09:46.981651+0000","last_unstale":"2024-09-14T11:53:43.105257+0000","last_undegraded":"2024-09-14T11:53:43.105257+0000","last_fullsized":"2024-09-14T11:53:43.105257+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:26.806380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3785,"num_read_kb":3457,"num_write":1011,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"264'247","reported_seq":886,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.540796+0000","last_change":"2024-09-14T11:09:45.215434+0000","last_active":"2024-09-14T11:53:57.540796+0000","last_peered":"2024-09-14T11:53:57.540796+0000","last_clean":"2024-09-14T11:53:57.540796+0000","last_became_active":"2024-09-14T11:09:45.215127+0000","last_became_peered":"2024-09-14T11:09:45.215127+0000","last_unstale":"2024-09-14T11:53:57.540796+0000","last_undegraded":"2024-09-14T11:53:57.540796+0000","last_fullsized":"2024-09-14T11:53:57.540796+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:09.892252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655838,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":590,"num_read_kb":34633,"num_write":1021,"num_write_kb":52307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:49.085600+0000","last_change":"2024-09-14T11:09:48.960423+0000","last_active":"2024-09-14T11:49:49.085600+0000","last_peered":"2024-09-14T11:49:49.085600+0000","last_clean":"2024-09-14T11:49:49.085600+0000","last_became_active":"2024-09-14T11:09:48.960006+0000","last_became_peered":"2024-09-14T11:09:48.960006+0000","last_unstale":"2024-09-14T11:49:49.085600+0000","last_undegraded":"2024-09-14T11:49:49.085600+0000","last_fullsized":"2024-09-14T11:49:49.085600+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:12.246125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"264'117","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.439357+0000","last_change":"2024-09-14T11:09:50.976371+0000","last_active":"2024-09-14T11:53:57.439357+0000","last_peered":"2024-09-14T11:53:57.439357+0000","last_clean":"2024-09-14T11:53:57.439357+0000","last_became_active":"2024-09-14T11:09:50.975555+0000","last_became_peered":"2024-09-14T11:09:50.975555+0000","last_unstale":"2024-09-14T11:53:57.439357+0000","last_undegraded":"2024-09-14T11:53:57.439357+0000","last_fullsized":"2024-09-14T11:53:57.439357+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:50.238466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5710,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":156,"num_read_kb":221,"num_write":78,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:04.321551+0000","last_change":"2024-09-14T11:09:53.015898+0000","last_active":"2024-09-14T11:51:04.321551+0000","last_peered":"2024-09-14T11:51:04.321551+0000","last_clean":"2024-09-14T11:51:04.321551+0000","last_became_active":"2024-09-14T11:09:53.015039+0000","last_became_peered":"2024-09-14T11:09:53.015039+0000","last_unstale":"2024-09-14T11:51:04.321551+0000","last_undegraded":"2024-09-14T11:51:04.321551+0000","last_fullsized":"2024-09-14T11:51:04.321551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:00.423028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"264'92","reported_seq":601,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:02.725541+0000","last_change":"2024-09-14T11:09:55.014762+0000","last_active":"2024-09-14T11:52:02.725541+0000","last_peered":"2024-09-14T11:52:02.725541+0000","last_clean":"2024-09-14T11:52:02.725541+0000","last_became_active":"2024-09-14T11:09:55.013997+0000","last_became_peered":"2024-09-14T11:09:55.013997+0000","last_unstale":"2024-09-14T11:52:02.725541+0000","last_undegraded":"2024-09-14T11:52:02.725541+0000","last_fullsized":"2024-09-14T11:52:02.725541+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:30.820459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":557,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":129,"num_write":227,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"264'1274","reported_seq":2882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.101805+0000","last_change":"2024-09-14T11:09:46.983515+0000","last_active":"2024-09-14T11:53:43.101805+0000","last_peered":"2024-09-14T11:53:43.101805+0000","last_clean":"2024-09-14T11:53:43.101805+0000","last_became_active":"2024-09-14T11:09:46.982770+0000","last_became_peered":"2024-09-14T11:09:46.982770+0000","last_unstale":"2024-09-14T11:53:43.101805+0000","last_undegraded":"2024-09-14T11:53:43.101805+0000","last_fullsized":"2024-09-14T11:53:43.101805+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":1200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:32.470386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5800,"num_read_kb":5089,"num_write":1775,"num_write_kb":736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"264'204","reported_seq":849,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.600404+0000","last_change":"2024-09-14T11:09:45.202528+0000","last_active":"2024-09-14T11:53:57.600404+0000","last_peered":"2024-09-14T11:53:57.600404+0000","last_clean":"2024-09-14T11:53:57.600404+0000","last_became_active":"2024-09-14T11:09:45.200971+0000","last_became_peered":"2024-09-14T11:09:45.200971+0000","last_unstale":"2024-09-14T11:53:57.600404+0000","last_undegraded":"2024-09-14T11:53:57.600404+0000","last_fullsized":"2024-09-14T11:53:57.600404+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:27.327496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3174623,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":502,"num_read_kb":61081,"num_write":905,"num_write_kb":39968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.270083+0000","last_change":"2024-09-14T11:09:48.958590+0000","last_active":"2024-09-14T11:50:53.270083+0000","last_peered":"2024-09-14T11:50:53.270083+0000","last_clean":"2024-09-14T11:50:53.270083+0000","last_became_active":"2024-09-14T11:09:48.958168+0000","last_became_peered":"2024-09-14T11:09:48.958168+0000","last_unstale":"2024-09-14T11:50:53.270083+0000","last_undegraded":"2024-09-14T11:50:53.270083+0000","last_fullsized":"2024-09-14T11:50:53.270083+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:39.133475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"264'105","reported_seq":658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.262062+0000","last_change":"2024-09-14T11:09:50.999672+0000","last_active":"2024-09-14T11:53:57.262062+0000","last_peered":"2024-09-14T11:53:57.262062+0000","last_clean":"2024-09-14T11:53:57.262062+0000","last_became_active":"2024-09-14T11:09:50.998951+0000","last_became_peered":"2024-09-14T11:09:50.998951+0000","last_unstale":"2024-09-14T11:53:57.262062+0000","last_undegraded":"2024-09-14T11:53:57.262062+0000","last_fullsized":"2024-09-14T11:53:57.262062+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:34.380499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":125,"num_read_kb":141,"num_write":60,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:54.302639+0000","last_change":"2024-09-14T11:09:53.022344+0000","last_active":"2024-09-14T11:49:54.302639+0000","last_peered":"2024-09-14T11:49:54.302639+0000","last_clean":"2024-09-14T11:49:54.302639+0000","last_became_active":"2024-09-14T11:09:53.021595+0000","last_became_peered":"2024-09-14T11:09:53.021595+0000","last_unstale":"2024-09-14T11:49:54.302639+0000","last_undegraded":"2024-09-14T11:49:54.302639+0000","last_fullsized":"2024-09-14T11:49:54.302639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:34.894553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"264'187","reported_seq":1643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:27.560080+0000","last_change":"2024-09-14T11:09:55.029111+0000","last_active":"2024-09-14T11:52:27.560080+0000","last_peered":"2024-09-14T11:52:27.560080+0000","last_clean":"2024-09-14T11:52:27.560080+0000","last_became_active":"2024-09-14T11:09:55.028374+0000","last_became_peered":"2024-09-14T11:09:55.028374+0000","last_unstale":"2024-09-14T11:52:27.560080+0000","last_undegraded":"2024-09-14T11:52:27.560080+0000","last_fullsized":"2024-09-14T11:52:27.560080+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:11.828167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":650,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1185,"num_read_kb":1180,"num_write":425,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"264'675","reported_seq":2433,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.024596+0000","last_change":"2024-09-14T11:09:46.946536+0000","last_active":"2024-09-14T11:52:09.024596+0000","last_peered":"2024-09-14T11:52:09.024596+0000","last_clean":"2024-09-14T11:52:09.024596+0000","last_became_active":"2024-09-14T11:09:46.946243+0000","last_became_peered":"2024-09-14T11:09:46.946243+0000","last_unstale":"2024-09-14T11:52:09.024596+0000","last_undegraded":"2024-09-14T11:52:09.024596+0000","last_fullsized":"2024-09-14T11:52:09.024596+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":600,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:11.897413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3815,"num_read_kb":3478,"num_write":980,"num_write_kb":450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"264'188","reported_seq":814,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.634720+0000","last_change":"2024-09-14T11:09:45.204307+0000","last_active":"2024-09-14T11:53:57.634720+0000","last_peered":"2024-09-14T11:53:57.634720+0000","last_clean":"2024-09-14T11:53:57.634720+0000","last_became_active":"2024-09-14T11:09:45.201929+0000","last_became_peered":"2024-09-14T11:09:45.201929+0000","last_unstale":"2024-09-14T11:53:57.634720+0000","last_undegraded":"2024-09-14T11:53:57.634720+0000","last_fullsized":"2024-09-14T11:53:57.634720+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:36.673938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":518,"num_read_kb":13061,"num_write":810,"num_write_kb":29760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.119882+0000","last_change":"2024-09-14T11:09:48.963841+0000","last_active":"2024-09-14T11:50:58.119882+0000","last_peered":"2024-09-14T11:50:58.119882+0000","last_clean":"2024-09-14T11:50:58.119882+0000","last_became_active":"2024-09-14T11:09:48.963104+0000","last_became_peered":"2024-09-14T11:09:48.963104+0000","last_unstale":"2024-09-14T11:50:58.119882+0000","last_undegraded":"2024-09-14T11:50:58.119882+0000","last_fullsized":"2024-09-14T11:50:58.119882+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:46.912247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"264'164","reported_seq":741,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.325918+0000","last_change":"2024-09-14T11:09:50.984507+0000","last_active":"2024-09-14T11:53:57.325918+0000","last_peered":"2024-09-14T11:53:57.325918+0000","last_clean":"2024-09-14T11:53:57.325918+0000","last_became_active":"2024-09-14T11:09:50.983753+0000","last_became_peered":"2024-09-14T11:09:50.983753+0000","last_unstale":"2024-09-14T11:53:57.325918+0000","last_undegraded":"2024-09-14T11:53:57.325918+0000","last_fullsized":"2024-09-14T11:53:57.325918+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:29.921471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4671,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":206,"num_read_kb":262,"num_write":116,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.105515+0000","last_change":"2024-09-14T11:09:53.011871+0000","last_active":"2024-09-14T11:49:53.105515+0000","last_peered":"2024-09-14T11:49:53.105515+0000","last_clean":"2024-09-14T11:49:53.105515+0000","last_became_active":"2024-09-14T11:09:53.011077+0000","last_became_peered":"2024-09-14T11:09:53.011077+0000","last_unstale":"2024-09-14T11:49:53.105515+0000","last_undegraded":"2024-09-14T11:49:53.105515+0000","last_fullsized":"2024-09-14T11:49:53.105515+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:50.394891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"264'163","reported_seq":662,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.100745+0000","last_change":"2024-09-14T11:09:55.022425+0000","last_active":"2024-09-14T11:53:43.100745+0000","last_peered":"2024-09-14T11:53:43.100745+0000","last_clean":"2024-09-14T11:53:43.100745+0000","last_became_active":"2024-09-14T11:09:55.021523+0000","last_became_peered":"2024-09-14T11:09:55.021523+0000","last_unstale":"2024-09-14T11:53:43.100745+0000","last_undegraded":"2024-09-14T11:53:43.100745+0000","last_fullsized":"2024-09-14T11:53:43.100745+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:10.987076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1072,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":209,"num_read_kb":183,"num_write":413,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"264'928","reported_seq":2647,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:05.437021+0000","last_change":"2024-09-14T11:09:46.957177+0000","last_active":"2024-09-14T11:52:05.437021+0000","last_peered":"2024-09-14T11:52:05.437021+0000","last_clean":"2024-09-14T11:52:05.437021+0000","last_became_active":"2024-09-14T11:09:46.951108+0000","last_became_peered":"2024-09-14T11:09:46.951108+0000","last_unstale":"2024-09-14T11:52:05.437021+0000","last_undegraded":"2024-09-14T11:52:05.437021+0000","last_fullsized":"2024-09-14T11:52:05.437021+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":900,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:15.810066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6915,"num_read_kb":6425,"num_write":1478,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"264'231","reported_seq":914,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.542390+0000","last_change":"2024-09-14T11:09:45.211877+0000","last_active":"2024-09-14T11:53:57.542390+0000","last_peered":"2024-09-14T11:53:57.542390+0000","last_clean":"2024-09-14T11:53:57.542390+0000","last_became_active":"2024-09-14T11:09:45.211372+0000","last_became_peered":"2024-09-14T11:09:45.211372+0000","last_unstale":"2024-09-14T11:53:57.542390+0000","last_undegraded":"2024-09-14T11:53:57.542390+0000","last_fullsized":"2024-09-14T11:53:57.542390+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:24.226008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":701,"num_read_kb":62622,"num_write":1043,"num_write_kb":26227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"264'1160","reported_seq":2864,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.122773+0000","last_change":"2024-09-14T11:09:46.972638+0000","last_active":"2024-09-14T11:53:43.122773+0000","last_peered":"2024-09-14T11:53:43.122773+0000","last_clean":"2024-09-14T11:53:43.122773+0000","last_became_active":"2024-09-14T11:09:46.970185+0000","last_became_peered":"2024-09-14T11:09:46.970185+0000","last_unstale":"2024-09-14T11:53:43.122773+0000","last_undegraded":"2024-09-14T11:53:43.122773+0000","last_fullsized":"2024-09-14T11:53:43.122773+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":1100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:13.563147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5490,"num_read_kb":4916,"num_write":1574,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"264'228","reported_seq":844,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.409706+0000","last_change":"2024-09-14T11:09:45.213947+0000","last_active":"2024-09-14T11:53:57.409706+0000","last_peered":"2024-09-14T11:53:57.409706+0000","last_clean":"2024-09-14T11:53:57.409706+0000","last_became_active":"2024-09-14T11:09:45.213238+0000","last_became_peered":"2024-09-14T11:09:45.213238+0000","last_unstale":"2024-09-14T11:53:57.409706+0000","last_undegraded":"2024-09-14T11:53:57.409706+0000","last_fullsized":"2024-09-14T11:53:57.409706+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:01.403575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":552,"num_read_kb":930,"num_write":1100,"num_write_kb":31959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"264'418","reported_seq":1946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.040689+0000","last_change":"2024-09-14T11:09:46.958429+0000","last_active":"2024-09-14T11:52:29.040689+0000","last_peered":"2024-09-14T11:52:29.040689+0000","last_clean":"2024-09-14T11:52:29.040689+0000","last_became_active":"2024-09-14T11:09:46.958063+0000","last_became_peered":"2024-09-14T11:09:46.958063+0000","last_unstale":"2024-09-14T11:52:29.040689+0000","last_undegraded":"2024-09-14T11:52:29.040689+0000","last_fullsized":"2024-09-14T11:52:29.040689+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:19.646752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2247,"num_read_kb":2131,"num_write":481,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"264'224","reported_seq":1035,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.568581+0000","last_change":"2024-09-14T11:09:45.217514+0000","last_active":"2024-09-14T11:53:57.568581+0000","last_peered":"2024-09-14T11:53:57.568581+0000","last_clean":"2024-09-14T11:53:57.568581+0000","last_became_active":"2024-09-14T11:09:45.217258+0000","last_became_peered":"2024-09-14T11:09:45.217258+0000","last_unstale":"2024-09-14T11:53:57.568581+0000","last_undegraded":"2024-09-14T11:53:57.568581+0000","last_fullsized":"2024-09-14T11:53:57.568581+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:19.368373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311659,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1093,"num_read_kb":14899,"num_write":1046,"num_write_kb":43826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"264'404","reported_seq":1918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:01.518761+0000","last_change":"2024-09-14T11:09:46.988480+0000","last_active":"2024-09-14T11:52:01.518761+0000","last_peered":"2024-09-14T11:52:01.518761+0000","last_clean":"2024-09-14T11:52:01.518761+0000","last_became_active":"2024-09-14T11:09:46.987465+0000","last_became_peered":"2024-09-14T11:09:46.987465+0000","last_unstale":"2024-09-14T11:52:01.518761+0000","last_undegraded":"2024-09-14T11:52:01.518761+0000","last_fullsized":"2024-09-14T11:52:01.518761+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:19.420609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2188,"num_read_kb":2091,"num_write":479,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"264'210","reported_seq":821,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.435462+0000","last_change":"2024-09-14T11:09:45.211461+0000","last_active":"2024-09-14T11:53:57.435462+0000","last_peered":"2024-09-14T11:53:57.435462+0000","last_clean":"2024-09-14T11:53:57.435462+0000","last_became_active":"2024-09-14T11:09:45.210754+0000","last_became_peered":"2024-09-14T11:09:45.210754+0000","last_unstale":"2024-09-14T11:53:57.435462+0000","last_undegraded":"2024-09-14T11:53:57.435462+0000","last_fullsized":"2024-09-14T11:53:57.435462+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:08.664534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254321,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":979,"num_write":956,"num_write_kb":15237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"264'391","reported_seq":1908,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:09.025531+0000","last_change":"2024-09-14T11:09:46.975727+0000","last_active":"2024-09-14T11:52:09.025531+0000","last_peered":"2024-09-14T11:52:09.025531+0000","last_clean":"2024-09-14T11:52:09.025531+0000","last_became_active":"2024-09-14T11:09:46.975006+0000","last_became_peered":"2024-09-14T11:09:46.975006+0000","last_unstale":"2024-09-14T11:52:09.025531+0000","last_undegraded":"2024-09-14T11:52:09.025531+0000","last_fullsized":"2024-09-14T11:52:09.025531+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:24:31.291575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2194,"num_read_kb":2087,"num_write":454,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"264'203","reported_seq":819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.389057+0000","last_change":"2024-09-14T11:09:45.211325+0000","last_active":"2024-09-14T11:53:57.389057+0000","last_peered":"2024-09-14T11:53:57.389057+0000","last_clean":"2024-09-14T11:53:57.389057+0000","last_became_active":"2024-09-14T11:09:45.210639+0000","last_became_peered":"2024-09-14T11:09:45.210639+0000","last_unstale":"2024-09-14T11:53:57.389057+0000","last_undegraded":"2024-09-14T11:53:57.389057+0000","last_fullsized":"2024-09-14T11:53:57.389057+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:20.581618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655887,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":487,"num_read_kb":12081,"num_write":976,"num_write_kb":34333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"264'842","reported_seq":2510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.040766+0000","last_change":"2024-09-14T11:09:46.961466+0000","last_active":"2024-09-14T11:52:29.040766+0000","last_peered":"2024-09-14T11:52:29.040766+0000","last_clean":"2024-09-14T11:52:29.040766+0000","last_became_active":"2024-09-14T11:09:46.961185+0000","last_became_peered":"2024-09-14T11:09:46.961185+0000","last_unstale":"2024-09-14T11:52:29.040766+0000","last_undegraded":"2024-09-14T11:52:29.040766+0000","last_fullsized":"2024-09-14T11:52:29.040766+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:08.248591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4099,"num_read_kb":3707,"num_write":1108,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"264'190","reported_seq":798,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.410094+0000","last_change":"2024-09-14T11:09:45.220791+0000","last_active":"2024-09-14T11:53:57.410094+0000","last_peered":"2024-09-14T11:53:57.410094+0000","last_clean":"2024-09-14T11:53:57.410094+0000","last_became_active":"2024-09-14T11:09:45.220246+0000","last_became_peered":"2024-09-14T11:09:45.220246+0000","last_unstale":"2024-09-14T11:53:57.410094+0000","last_undegraded":"2024-09-14T11:53:57.410094+0000","last_fullsized":"2024-09-14T11:53:57.410094+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:36.399604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":452,"num_read_kb":10292,"num_write":865,"num_write_kb":29061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"264'671","reported_seq":2011,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.647214+0000","last_change":"2024-09-14T11:09:46.991359+0000","last_active":"2024-09-14T11:52:29.647214+0000","last_peered":"2024-09-14T11:52:29.647214+0000","last_clean":"2024-09-14T11:52:29.647214+0000","last_became_active":"2024-09-14T11:09:46.990649+0000","last_became_peered":"2024-09-14T11:09:46.990649+0000","last_unstale":"2024-09-14T11:52:29.647214+0000","last_undegraded":"2024-09-14T11:52:29.647214+0000","last_fullsized":"2024-09-14T11:52:29.647214+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":600,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:23.410718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3174,"num_read_kb":2866,"num_write":894,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"264'234","reported_seq":893,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.518992+0000","last_change":"2024-09-14T11:09:45.208096+0000","last_active":"2024-09-14T11:53:57.518992+0000","last_peered":"2024-09-14T11:53:57.518992+0000","last_clean":"2024-09-14T11:53:57.518992+0000","last_became_active":"2024-09-14T11:09:45.207500+0000","last_became_peered":"2024-09-14T11:09:45.207500+0000","last_unstale":"2024-09-14T11:53:57.518992+0000","last_undegraded":"2024-09-14T11:53:57.518992+0000","last_fullsized":"2024-09-14T11:53:57.518992+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:22.993861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":644,"num_read_kb":28771,"num_write":1111,"num_write_kb":28685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"264'2088","reported_seq":3859,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:56.236839+0000","last_change":"2024-09-14T11:09:46.965260+0000","last_active":"2024-09-14T11:51:56.236839+0000","last_peered":"2024-09-14T11:51:56.236839+0000","last_clean":"2024-09-14T11:51:56.236839+0000","last_became_active":"2024-09-14T11:09:46.964893+0000","last_became_peered":"2024-09-14T11:09:46.964893+0000","last_unstale":"2024-09-14T11:51:56.236839+0000","last_undegraded":"2024-09-14T11:51:56.236839+0000","last_fullsized":"2024-09-14T11:51:56.236839+0000","mapping_epoch":25,"log_start":"264'2000","ondisk_log_start":"264'2000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":2000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:34.137174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9234,"num_read_kb":7993,"num_write":3022,"num_write_kb":1347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"264'280","reported_seq":979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.641420+0000","last_change":"2024-09-14T11:09:45.204674+0000","last_active":"2024-09-14T11:53:57.641420+0000","last_peered":"2024-09-14T11:53:57.641420+0000","last_clean":"2024-09-14T11:53:57.641420+0000","last_became_active":"2024-09-14T11:09:45.201951+0000","last_became_peered":"2024-09-14T11:09:45.201951+0000","last_unstale":"2024-09-14T11:53:57.641420+0000","last_undegraded":"2024-09-14T11:53:57.641420+0000","last_fullsized":"2024-09-14T11:53:57.641420+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:52.455396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655900,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":878,"num_read_kb":20954,"num_write":1195,"num_write_kb":48388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"264'393","reported_seq":1898,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:11.468367+0000","last_change":"2024-09-14T11:09:46.983040+0000","last_active":"2024-09-14T11:52:11.468367+0000","last_peered":"2024-09-14T11:52:11.468367+0000","last_clean":"2024-09-14T11:52:11.468367+0000","last_became_active":"2024-09-14T11:09:46.982125+0000","last_became_peered":"2024-09-14T11:09:46.982125+0000","last_unstale":"2024-09-14T11:52:11.468367+0000","last_undegraded":"2024-09-14T11:52:11.468367+0000","last_fullsized":"2024-09-14T11:52:11.468367+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:20.751819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2124,"num_read_kb":2027,"num_write":431,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"264'250","reported_seq":927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.431160+0000","last_change":"2024-09-14T11:09:45.220108+0000","last_active":"2024-09-14T11:53:57.431160+0000","last_peered":"2024-09-14T11:53:57.431160+0000","last_clean":"2024-09-14T11:53:57.431160+0000","last_became_active":"2024-09-14T11:09:45.219634+0000","last_became_peered":"2024-09-14T11:09:45.219634+0000","last_unstale":"2024-09-14T11:53:57.431160+0000","last_undegraded":"2024-09-14T11:53:57.431160+0000","last_fullsized":"2024-09-14T11:53:57.431160+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:17.207975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311685,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":704,"num_read_kb":35580,"num_write":1143,"num_write_kb":63455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"264'544","reported_seq":2093,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:11.466077+0000","last_change":"2024-09-14T11:09:46.962608+0000","last_active":"2024-09-14T11:52:11.466077+0000","last_peered":"2024-09-14T11:52:11.466077+0000","last_clean":"2024-09-14T11:52:11.466077+0000","last_became_active":"2024-09-14T11:09:46.962261+0000","last_became_peered":"2024-09-14T11:09:46.962261+0000","last_unstale":"2024-09-14T11:52:11.466077+0000","last_undegraded":"2024-09-14T11:52:11.466077+0000","last_fullsized":"2024-09-14T11:52:11.466077+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:09.235080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2646,"num_read_kb":2439,"num_write":661,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"264'218","reported_seq":853,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.370857+0000","last_change":"2024-09-14T11:09:45.202616+0000","last_active":"2024-09-14T11:53:57.370857+0000","last_peered":"2024-09-14T11:53:57.370857+0000","last_clean":"2024-09-14T11:53:57.370857+0000","last_became_active":"2024-09-14T11:09:45.200775+0000","last_became_peered":"2024-09-14T11:09:45.200775+0000","last_unstale":"2024-09-14T11:53:57.370857+0000","last_undegraded":"2024-09-14T11:53:57.370857+0000","last_fullsized":"2024-09-14T11:53:57.370857+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:14:20.167362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":537,"num_read_kb":33597,"num_write":1024,"num_write_kb":35359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"264'563","reported_seq":2409,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.766645+0000","last_change":"2024-09-14T11:09:46.975288+0000","last_active":"2024-09-14T11:52:12.766645+0000","last_peered":"2024-09-14T11:52:12.766645+0000","last_clean":"2024-09-14T11:52:12.766645+0000","last_became_active":"2024-09-14T11:09:46.974543+0000","last_became_peered":"2024-09-14T11:09:46.974543+0000","last_unstale":"2024-09-14T11:52:12.766645+0000","last_undegraded":"2024-09-14T11:52:12.766645+0000","last_fullsized":"2024-09-14T11:52:12.766645+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:10.907592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3309,"num_read_kb":3115,"num_write":715,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"264'212","reported_seq":843,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.413859+0000","last_change":"2024-09-14T11:09:45.205037+0000","last_active":"2024-09-14T11:53:57.413859+0000","last_peered":"2024-09-14T11:53:57.413859+0000","last_clean":"2024-09-14T11:53:57.413859+0000","last_became_active":"2024-09-14T11:09:45.204754+0000","last_became_peered":"2024-09-14T11:09:45.204754+0000","last_unstale":"2024-09-14T11:53:57.413859+0000","last_undegraded":"2024-09-14T11:53:57.413859+0000","last_fullsized":"2024-09-14T11:53:57.413859+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:21.492270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":525,"num_read_kb":30401,"num_write":981,"num_write_kb":24964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"264'575","reported_seq":2323,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.768055+0000","last_change":"2024-09-14T11:09:46.965280+0000","last_active":"2024-09-14T11:52:12.768055+0000","last_peered":"2024-09-14T11:52:12.768055+0000","last_clean":"2024-09-14T11:52:12.768055+0000","last_became_active":"2024-09-14T11:09:46.964946+0000","last_became_peered":"2024-09-14T11:09:46.964946+0000","last_unstale":"2024-09-14T11:52:12.768055+0000","last_undegraded":"2024-09-14T11:52:12.768055+0000","last_fullsized":"2024-09-14T11:52:12.768055+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":500,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:37.727246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3099,"num_read_kb":2896,"num_write":721,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"264'213","reported_seq":900,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.494798+0000","last_change":"2024-09-14T11:09:45.192015+0000","last_active":"2024-09-14T11:53:57.494798+0000","last_peered":"2024-09-14T11:53:57.494798+0000","last_clean":"2024-09-14T11:53:57.494798+0000","last_became_active":"2024-09-14T11:09:45.191314+0000","last_became_peered":"2024-09-14T11:09:45.191314+0000","last_unstale":"2024-09-14T11:53:57.494798+0000","last_undegraded":"2024-09-14T11:53:57.494798+0000","last_fullsized":"2024-09-14T11:53:57.494798+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:59.041601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":695,"num_read_kb":24382,"num_write":1016,"num_write_kb":29533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"264'551","reported_seq":2029,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.646131+0000","last_change":"2024-09-14T11:09:46.994591+0000","last_active":"2024-09-14T11:52:29.646131+0000","last_peered":"2024-09-14T11:52:29.646131+0000","last_clean":"2024-09-14T11:52:29.646131+0000","last_became_active":"2024-09-14T11:09:46.994113+0000","last_became_peered":"2024-09-14T11:09:46.994113+0000","last_unstale":"2024-09-14T11:52:29.646131+0000","last_undegraded":"2024-09-14T11:52:29.646131+0000","last_fullsized":"2024-09-14T11:52:29.646131+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:14.044249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2807,"num_read_kb":2558,"num_write":736,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"264'221","reported_seq":815,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.452792+0000","last_change":"2024-09-14T11:09:45.219322+0000","last_active":"2024-09-14T11:53:57.452792+0000","last_peered":"2024-09-14T11:53:57.452792+0000","last_clean":"2024-09-14T11:53:57.452792+0000","last_became_active":"2024-09-14T11:09:45.214511+0000","last_became_peered":"2024-09-14T11:09:45.214511+0000","last_unstale":"2024-09-14T11:53:57.452792+0000","last_undegraded":"2024-09-14T11:53:57.452792+0000","last_fullsized":"2024-09-14T11:53:57.452792+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:52.501892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":484,"num_read_kb":9689,"num_write":1032,"num_write_kb":43578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"264'462","reported_seq":1938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.646695+0000","last_change":"2024-09-14T11:09:46.975025+0000","last_active":"2024-09-14T11:52:29.646695+0000","last_peered":"2024-09-14T11:52:29.646695+0000","last_clean":"2024-09-14T11:52:29.646695+0000","last_became_active":"2024-09-14T11:09:46.974152+0000","last_became_peered":"2024-09-14T11:09:46.974152+0000","last_unstale":"2024-09-14T11:52:29.646695+0000","last_undegraded":"2024-09-14T11:52:29.646695+0000","last_fullsized":"2024-09-14T11:52:29.646695+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:18.882062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2413,"num_read_kb":2245,"num_write":556,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"264'251","reported_seq":903,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.637544+0000","last_change":"2024-09-14T11:09:45.203506+0000","last_active":"2024-09-14T11:53:57.637544+0000","last_peered":"2024-09-14T11:53:57.637544+0000","last_clean":"2024-09-14T11:53:57.637544+0000","last_became_active":"2024-09-14T11:09:45.202934+0000","last_became_peered":"2024-09-14T11:09:45.202934+0000","last_unstale":"2024-09-14T11:53:57.637544+0000","last_undegraded":"2024-09-14T11:53:57.637544+0000","last_fullsized":"2024-09-14T11:53:57.637544+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:23.806980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":642,"num_read_kb":75186,"num_write":1115,"num_write_kb":32522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"264'394","reported_seq":1908,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:10.846557+0000","last_change":"2024-09-14T11:09:46.947793+0000","last_active":"2024-09-14T11:52:10.846557+0000","last_peered":"2024-09-14T11:52:10.846557+0000","last_clean":"2024-09-14T11:52:10.846557+0000","last_became_active":"2024-09-14T11:09:46.946993+0000","last_became_peered":"2024-09-14T11:09:46.946993+0000","last_unstale":"2024-09-14T11:52:10.846557+0000","last_undegraded":"2024-09-14T11:52:10.846557+0000","last_fullsized":"2024-09-14T11:52:10.846557+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:47.133049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2163,"num_read_kb":2058,"num_write":443,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"264'190","reported_seq":805,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.321348+0000","last_change":"2024-09-14T11:09:45.217891+0000","last_active":"2024-09-14T11:53:57.321348+0000","last_peered":"2024-09-14T11:53:57.321348+0000","last_clean":"2024-09-14T11:53:57.321348+0000","last_became_active":"2024-09-14T11:09:45.217119+0000","last_became_peered":"2024-09-14T11:09:45.217119+0000","last_unstale":"2024-09-14T11:53:57.321348+0000","last_undegraded":"2024-09-14T11:53:57.321348+0000","last_fullsized":"2024-09-14T11:53:57.321348+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:40.436809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":19832,"num_write":847,"num_write_kb":31579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"264'827","reported_seq":2382,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:04.903866+0000","last_change":"2024-09-14T11:09:46.991150+0000","last_active":"2024-09-14T11:52:04.903866+0000","last_peered":"2024-09-14T11:52:04.903866+0000","last_clean":"2024-09-14T11:52:04.903866+0000","last_became_active":"2024-09-14T11:09:46.990899+0000","last_became_peered":"2024-09-14T11:09:46.990899+0000","last_unstale":"2024-09-14T11:52:04.903866+0000","last_undegraded":"2024-09-14T11:52:04.903866+0000","last_fullsized":"2024-09-14T11:52:04.903866+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:34:32.141931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3995,"num_read_kb":3582,"num_write":1122,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"264'247","reported_seq":948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.470366+0000","last_change":"2024-09-14T11:09:45.215275+0000","last_active":"2024-09-14T11:53:57.470366+0000","last_peered":"2024-09-14T11:53:57.470366+0000","last_clean":"2024-09-14T11:53:57.470366+0000","last_became_active":"2024-09-14T11:09:45.214713+0000","last_became_peered":"2024-09-14T11:09:45.214713+0000","last_unstale":"2024-09-14T11:53:57.470366+0000","last_undegraded":"2024-09-14T11:53:57.470366+0000","last_fullsized":"2024-09-14T11:53:57.470366+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:49.671679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655874,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":741,"num_read_kb":73898,"num_write":1178,"num_write_kb":36295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"264'151","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.230289+0000","last_change":"2024-09-14T11:09:45.202592+0000","last_active":"2024-09-14T11:53:57.230289+0000","last_peered":"2024-09-14T11:53:57.230289+0000","last_clean":"2024-09-14T11:53:57.230289+0000","last_became_active":"2024-09-14T11:09:45.202270+0000","last_became_peered":"2024-09-14T11:09:45.202270+0000","last_unstale":"2024-09-14T11:53:57.230289+0000","last_undegraded":"2024-09-14T11:53:57.230289+0000","last_fullsized":"2024-09-14T11:53:57.230289+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:26.117626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":694,"num_read_kb":138365,"num_write":726,"num_write_kb":22161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"264'887","reported_seq":2644,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.109063+0000","last_change":"2024-09-14T11:09:46.947818+0000","last_active":"2024-09-14T11:53:43.109063+0000","last_peered":"2024-09-14T11:53:43.109063+0000","last_clean":"2024-09-14T11:53:43.109063+0000","last_became_active":"2024-09-14T11:09:46.947102+0000","last_became_peered":"2024-09-14T11:09:46.947102+0000","last_unstale":"2024-09-14T11:53:43.109063+0000","last_undegraded":"2024-09-14T11:53:43.109063+0000","last_fullsized":"2024-09-14T11:53:43.109063+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":800,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:59.879613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4492,"num_read_kb":4074,"num_write":1171,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"264'220","reported_seq":904,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.490553+0000","last_change":"2024-09-14T11:09:45.207476+0000","last_active":"2024-09-14T11:53:57.490553+0000","last_peered":"2024-09-14T11:53:57.490553+0000","last_clean":"2024-09-14T11:53:57.490553+0000","last_became_active":"2024-09-14T11:09:45.204922+0000","last_became_peered":"2024-09-14T11:09:45.204922+0000","last_unstale":"2024-09-14T11:53:57.490553+0000","last_undegraded":"2024-09-14T11:53:57.490553+0000","last_fullsized":"2024-09-14T11:53:57.490553+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:44.154141+0000","last_clean_scrub_stamp":"2024-09-14T11:09:44.154141+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:11.013663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":767,"num_read_kb":17805,"num_write":1021,"num_write_kb":50816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"264'494","reported_seq":2052,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.104268+0000","last_change":"2024-09-14T11:09:46.982184+0000","last_active":"2024-09-14T11:53:43.104268+0000","last_peered":"2024-09-14T11:53:43.104268+0000","last_clean":"2024-09-14T11:53:43.104268+0000","last_became_active":"2024-09-14T11:09:46.981819+0000","last_became_peered":"2024-09-14T11:09:46.981819+0000","last_unstale":"2024-09-14T11:53:43.104268+0000","last_undegraded":"2024-09-14T11:53:43.104268+0000","last_fullsized":"2024-09-14T11:53:43.104268+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:29:11.574907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2560,"num_read_kb":2380,"num_write":586,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10857,"num_read_kb":9179,"num_write":3115,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1006,"ondisk_log_size":1006,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15755,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":15151,"num_read_kb":14810,"num_write":17052,"num_write_kb":4979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1790,"ondisk_log_size":1790,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":756,"ondisk_log_size":756,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":375102,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":8356,"num_read_kb":10715,"num_write":5641,"num_write_kb":2812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2039,"ondisk_log_size":2039,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2413,"num_read_kb":2881,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":220474,"num_read_kb":201951,"num_write":55880,"num_write_kb":19076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3974,"ondisk_log_size":3974,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":40916491,"num_objects":168,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":0,"num_read":38991,"num_read_kb":2064033,"num_write":64568,"num_write_kb":2182336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":82870272,"data_stored":81832982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3635,"ondisk_log_size":3635,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":158488,"num_write":182,"num_write_kb":116383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":158381,"num_write":182,"num_write_kb":116383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509979,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220216,"kb_used_data":18244,"kb_used_omap":1,"kb_used_meta":201918,"kb_avail":94151624,"statfs":{"total":96636764160,"available":96411262976,"internally_reserved":0,"allocated":18681856,"data_stored":17014199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":206764487},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509981,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119200,"kb_used_data":11648,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94252640,"statfs":{"total":96636764160,"available":96514703360,"internally_reserved":0,"allocated":11927552,"data_stored":10256263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542683,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":205048,"kb_used_data":7292,"kb_used_omap":1,"kb_used_meta":197694,"kb_avail":94166792,"statfs":{"total":96636764160,"available":96426795008,"internally_reserved":0,"allocated":7467008,"data_stored":5850366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":202439114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542681,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91608,"kb_used_data":20160,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94280232,"statfs":{"total":96636764160,"available":96542957568,"internally_reserved":0,"allocated":20643840,"data_stored":18990343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542681,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":377224,"kb_used_data":139176,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":93994616,"statfs":{"total":96636764160,"available":96250486784,"internally_reserved":0,"allocated":142516224,"data_stored":140684792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243726789},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542682,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148852,"kb_used_data":5284,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94222988,"statfs":{"total":96636764160,"available":96484339712,"internally_reserved":0,"allocated":5410816,"data_stored":3769131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542682,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":268940,"kb_used_data":16916,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94102900,"statfs":{"total":96636764160,"available":96361369600,"internally_reserved":0,"allocated":17321984,"data_stored":15666499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257948101},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542683,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":86764,"kb_used_data":15244,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94285076,"statfs":{"total":96636764160,"available":96547917824,"internally_reserved":0,"allocated":15609856,"data_stored":13878717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11948032,"data_stored":11766247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12473898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8265728,"data_stored":8142582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15040512,"data_stored":14902957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1753088,"data_stored":1656299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":19398656,"data_stored":19214635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10035200,"data_stored":9935327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3846144,"data_stored":3741037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":6024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":5138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":2784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:54:04.442 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.442 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.442 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.442 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.442 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.442 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.443 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.443 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.443 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.443 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.443 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.443 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.443 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.443 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.443 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.444 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.444 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.444 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.444 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.444 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.444 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.444 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.444 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.444 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.445 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.445 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.445 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.445 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.445 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.445 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.445 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.445 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.445 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.446 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.446 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.446 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.446 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.446 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.446 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.446 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.446 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.446 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.447 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.447 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.447 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.447 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.447 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.447 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.447 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.447 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.447 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.448 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.448 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.448 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.448 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.448 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.448 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.448 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.448 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.448 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.448 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.449 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.449 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.449 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.449 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.449 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.449 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.449 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.449 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.449 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.450 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.450 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.450 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.450 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.450 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.450 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.450 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.450 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.450 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.451 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.451 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.451 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.451 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.451 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.451 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.451 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.451 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.451 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.452 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.452 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.452 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.452 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.452 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.452 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.452 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.452 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.452 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.453 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.453 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.453 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.453 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.453 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.453 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.453 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.453 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.453 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.454 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.454 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.454 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.454 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.454 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.454 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.454 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.454 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.454 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.454 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.455 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.455 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.455 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.455 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.455 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.455 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.455 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.455 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.455 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.456 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.456 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.456 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.456 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.456 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.456 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.456 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.456 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.456 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.456 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.457 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.457 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.457 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.457 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.457 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.457 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.457 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.457 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.457 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.458 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.458 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.458 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.458 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.458 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.458 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.458 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.458 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.458 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.459 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.459 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.459 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.459 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.459 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.459 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.459 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.459 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.459 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.459 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.460 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.460 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.460 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.460 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.460 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.460 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.460 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.460 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.460 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.461 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.461 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.461 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.461 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.461 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.461 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.461 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.461 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.461 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.462 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.462 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.462 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.462 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.462 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.462 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.462 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.462 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.462 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.462 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.463 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.463 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.463 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.463 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.463 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.463 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.463 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.463 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.463 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.463 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.464 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.464 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.464 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.464 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.464 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.464 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.464 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.464 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.464 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.465 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.465 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.465 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.465 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.465 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.465 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.465 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.465 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.465 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.465 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.466 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.466 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.466 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.466 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.466 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.466 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.466 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.466 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.466 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.466 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-14T11:09:29.042524+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.467 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-14T11:09:35.084767+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.467 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.467 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.467 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.467 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.467 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.467 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.467 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-14T11:09:35.084767+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.467 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.468 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.468 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.468 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.468 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.468 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.468 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-14T11:09:35.084767+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.468 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.468 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.468 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.468 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.469 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.469 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.469 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-14T11:09:35.084767+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.469 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.469 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.469 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.469 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.469 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.469 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.470 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.470 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-14T11:09:35.084767+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.470 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.470 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.470 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.470 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.470 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.470 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.470 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-14T11:09:35.084767+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.470 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.471 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.471 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.471 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.471 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.471 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.471 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-14T11:09:35.084767+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.471 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.471 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.471 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.471 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.472 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.472 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.472 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-14T11:09:35.084767+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.472 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.472 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.472 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.472 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.472 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.472 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.473 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.473 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.473 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.473 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.473 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.473 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.473 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.473 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.473 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.473 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.474 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.474 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.474 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.474 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.474 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.474 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.474 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.474 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.474 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.474 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.475 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.475 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.475 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.475 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.475 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.475 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.475 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.475 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.475 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.476 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.476 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.476 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.476 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.476 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.476 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.476 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.476 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.476 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.477 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.477 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.477 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.477 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.477 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.477 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.477 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.477 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.477 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.478 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.478 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.478 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.478 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.478 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.478 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.478 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.478 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.478 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.478 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.479 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.479 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.479 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.479 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.479 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.479 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.479 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.479 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.479 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.480 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.480 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.480 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.480 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.480 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.480 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.480 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.480 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.480 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.480 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.481 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.481 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.481 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.481 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.481 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.481 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.481 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.481 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.481 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.481 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.482 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.482 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.482 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.482 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.482 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.482 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.482 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.482 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.482 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.483 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.483 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.483 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.483 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.483 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.483 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.483 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.483 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.483 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.484 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-14T11:09:44.154141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.484 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:04.484 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T11:54:24.485 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:54:24.844 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:54:24.856 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-14T11:54:24.868 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":1605,"stamp":"2024-09-14T11:54:24.543045+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":41899528,"num_objects":636,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":636,"num_whiteouts":0,"num_read":296634,"num_read_kb":2620505,"num_write":146761,"num_write_kb":2444634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":200,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":579174,"num_omap_keys":1365,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13617,"ondisk_log_size":13617,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1394168,"kb_used_data":110584,"kb_used_omap":12,"kb_used_meta":1283443,"kb_avail":753580552,"statfs":{"total":773094113280,"available":771666485248,"internally_reserved":0,"allocated":113238016,"data_stored":99905760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1314246193},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":578902,"num_omap_keys":1364,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007537"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.294070+0000","last_change":"2024-09-14T11:38:50.585610+0000","last_active":"2024-09-14T11:51:23.294070+0000","last_peered":"2024-09-14T11:51:23.294070+0000","last_clean":"2024-09-14T11:51:23.294070+0000","last_became_active":"2024-09-14T11:38:50.585084+0000","last_became_peered":"2024-09-14T11:38:50.585084+0000","last_unstale":"2024-09-14T11:51:23.294070+0000","last_undegraded":"2024-09-14T11:51:23.294070+0000","last_fullsized":"2024-09-14T11:51:23.294070+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:50.511838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.261823+0000","last_change":"2024-09-14T11:27:41.641807+0000","last_active":"2024-09-14T11:50:13.261823+0000","last_peered":"2024-09-14T11:50:13.261823+0000","last_clean":"2024-09-14T11:50:13.261823+0000","last_became_active":"2024-09-14T11:27:41.641034+0000","last_became_peered":"2024-09-14T11:27:41.641034+0000","last_unstale":"2024-09-14T11:50:13.261823+0000","last_undegraded":"2024-09-14T11:50:13.261823+0000","last_fullsized":"2024-09-14T11:50:13.261823+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:01.125992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"261'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.288469+0000","last_change":"2024-09-14T11:27:38.617636+0000","last_active":"2024-09-14T11:50:08.288469+0000","last_peered":"2024-09-14T11:50:08.288469+0000","last_clean":"2024-09-14T11:50:08.288469+0000","last_became_active":"2024-09-14T11:27:38.617019+0000","last_became_peered":"2024-09-14T11:27:38.617019+0000","last_unstale":"2024-09-14T11:50:08.288469+0000","last_undegraded":"2024-09-14T11:50:08.288469+0000","last_fullsized":"2024-09-14T11:50:08.288469+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:02.190657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"264'17","reported_seq":90,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.122298+0000","last_change":"2024-09-14T11:26:04.263404+0000","last_active":"2024-09-14T11:51:08.122298+0000","last_peered":"2024-09-14T11:51:08.122298+0000","last_clean":"2024-09-14T11:51:08.122298+0000","last_became_active":"2024-09-14T11:26:04.262003+0000","last_became_peered":"2024-09-14T11:26:04.262003+0000","last_unstale":"2024-09-14T11:51:08.122298+0000","last_undegraded":"2024-09-14T11:51:08.122298+0000","last_fullsized":"2024-09-14T11:51:08.122298+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:19.974639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":88,"num_write":45,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.127863+0000","last_change":"2024-09-14T11:38:50.592796+0000","last_active":"2024-09-14T11:51:23.127863+0000","last_peered":"2024-09-14T11:51:23.127863+0000","last_clean":"2024-09-14T11:51:23.127863+0000","last_became_active":"2024-09-14T11:38:50.592015+0000","last_became_peered":"2024-09-14T11:38:50.592015+0000","last_unstale":"2024-09-14T11:51:23.127863+0000","last_undegraded":"2024-09-14T11:51:23.127863+0000","last_fullsized":"2024-09-14T11:51:23.127863+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:43.698723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"264'4","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.126242+0000","last_change":"2024-09-14T11:27:41.643113+0000","last_active":"2024-09-14T11:52:44.126242+0000","last_peered":"2024-09-14T11:52:44.126242+0000","last_clean":"2024-09-14T11:52:44.126242+0000","last_became_active":"2024-09-14T11:27:41.642359+0000","last_became_peered":"2024-09-14T11:27:41.642359+0000","last_unstale":"2024-09-14T11:52:44.126242+0000","last_undegraded":"2024-09-14T11:52:44.126242+0000","last_fullsized":"2024-09-14T11:52:44.126242+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:14.671551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":4,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"264'5","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:38.147879+0000","last_change":"2024-09-14T11:27:38.602923+0000","last_active":"2024-09-14T11:52:38.147879+0000","last_peered":"2024-09-14T11:52:38.147879+0000","last_clean":"2024-09-14T11:52:38.147879+0000","last_became_active":"2024-09-14T11:27:38.597816+0000","last_became_peered":"2024-09-14T11:27:38.597816+0000","last_unstale":"2024-09-14T11:52:38.147879+0000","last_undegraded":"2024-09-14T11:52:38.147879+0000","last_fullsized":"2024-09-14T11:52:38.147879+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:36.668640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1028,"num_write":10,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"264'31","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:13.136639+0000","last_change":"2024-09-14T11:26:04.283737+0000","last_active":"2024-09-14T11:52:13.136639+0000","last_peered":"2024-09-14T11:52:13.136639+0000","last_clean":"2024-09-14T11:52:13.136639+0000","last_became_active":"2024-09-14T11:26:04.280237+0000","last_became_peered":"2024-09-14T11:26:04.280237+0000","last_unstale":"2024-09-14T11:52:13.136639+0000","last_undegraded":"2024-09-14T11:52:13.136639+0000","last_fullsized":"2024-09-14T11:52:13.136639+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":150,"num_write":82,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.271146+0000","last_change":"2024-09-14T11:38:50.574799+0000","last_active":"2024-09-14T11:50:58.271146+0000","last_peered":"2024-09-14T11:50:58.271146+0000","last_clean":"2024-09-14T11:50:58.271146+0000","last_became_active":"2024-09-14T11:38:50.574020+0000","last_became_peered":"2024-09-14T11:38:50.574020+0000","last_unstale":"2024-09-14T11:50:58.271146+0000","last_undegraded":"2024-09-14T11:50:58.271146+0000","last_fullsized":"2024-09-14T11:50:58.271146+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:52.985985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.120898+0000","last_change":"2024-09-14T11:27:41.646451+0000","last_active":"2024-09-14T11:50:38.120898+0000","last_peered":"2024-09-14T11:50:38.120898+0000","last_clean":"2024-09-14T11:50:38.120898+0000","last_became_active":"2024-09-14T11:27:41.645143+0000","last_became_peered":"2024-09-14T11:27:41.645143+0000","last_unstale":"2024-09-14T11:50:38.120898+0000","last_undegraded":"2024-09-14T11:50:38.120898+0000","last_fullsized":"2024-09-14T11:50:38.120898+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:34.278570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:38.314219+0000","last_change":"2024-09-14T11:27:38.620069+0000","last_active":"2024-09-14T11:51:38.314219+0000","last_peered":"2024-09-14T11:51:38.314219+0000","last_clean":"2024-09-14T11:51:38.314219+0000","last_became_active":"2024-09-14T11:27:38.619537+0000","last_became_peered":"2024-09-14T11:27:38.619537+0000","last_unstale":"2024-09-14T11:51:38.314219+0000","last_undegraded":"2024-09-14T11:51:38.314219+0000","last_fullsized":"2024-09-14T11:51:38.314219+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:49.847960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"264'124","reported_seq":411,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.124673+0000","last_change":"2024-09-14T11:26:04.282980+0000","last_active":"2024-09-14T11:51:08.124673+0000","last_peered":"2024-09-14T11:51:08.124673+0000","last_clean":"2024-09-14T11:51:08.124673+0000","last_became_active":"2024-09-14T11:26:04.279472+0000","last_became_peered":"2024-09-14T11:26:04.279472+0000","last_unstale":"2024-09-14T11:51:08.124673+0000","last_undegraded":"2024-09-14T11:51:08.124673+0000","last_fullsized":"2024-09-14T11:51:08.124673+0000","mapping_epoch":253,"log_start":"261'100","ondisk_log_start":"261'100","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:01.809787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1140,"num_read_kb":1229,"num_write":251,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.126235+0000","last_change":"2024-09-14T11:38:50.588516+0000","last_active":"2024-09-14T11:51:03.126235+0000","last_peered":"2024-09-14T11:51:03.126235+0000","last_clean":"2024-09-14T11:51:03.126235+0000","last_became_active":"2024-09-14T11:38:50.587700+0000","last_became_peered":"2024-09-14T11:38:50.587700+0000","last_unstale":"2024-09-14T11:51:03.126235+0000","last_undegraded":"2024-09-14T11:51:03.126235+0000","last_fullsized":"2024-09-14T11:51:03.126235+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:40.939286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"264'8","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.513753+0000","last_change":"2024-09-14T11:27:41.645646+0000","last_active":"2024-09-14T11:53:57.513753+0000","last_peered":"2024-09-14T11:53:57.513753+0000","last_clean":"2024-09-14T11:53:57.513753+0000","last_became_active":"2024-09-14T11:27:41.644919+0000","last_became_peered":"2024-09-14T11:27:41.644919+0000","last_unstale":"2024-09-14T11:53:57.513753+0000","last_undegraded":"2024-09-14T11:53:57.513753+0000","last_fullsized":"2024-09-14T11:53:57.513753+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:48.076358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"264'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:38.292883+0000","last_change":"2024-09-14T11:27:38.610209+0000","last_active":"2024-09-14T11:52:38.292883+0000","last_peered":"2024-09-14T11:52:38.292883+0000","last_clean":"2024-09-14T11:52:38.292883+0000","last_became_active":"2024-09-14T11:27:38.609445+0000","last_became_peered":"2024-09-14T11:27:38.609445+0000","last_unstale":"2024-09-14T11:52:38.292883+0000","last_undegraded":"2024-09-14T11:52:38.292883+0000","last_fullsized":"2024-09-14T11:52:38.292883+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:01.517926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"264'61","reported_seq":213,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.124618+0000","last_change":"2024-09-14T11:26:04.283422+0000","last_active":"2024-09-14T11:51:08.124618+0000","last_peered":"2024-09-14T11:51:08.124618+0000","last_clean":"2024-09-14T11:51:08.124618+0000","last_became_active":"2024-09-14T11:26:04.282662+0000","last_became_peered":"2024-09-14T11:26:04.282662+0000","last_unstale":"2024-09-14T11:51:08.124618+0000","last_undegraded":"2024-09-14T11:51:08.124618+0000","last_fullsized":"2024-09-14T11:51:08.124618+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:05.753210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":527,"num_read_kb":359,"num_write":147,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.298593+0000","last_change":"2024-09-14T11:38:50.586486+0000","last_active":"2024-09-14T11:50:53.298593+0000","last_peered":"2024-09-14T11:50:53.298593+0000","last_clean":"2024-09-14T11:50:53.298593+0000","last_became_active":"2024-09-14T11:38:50.582489+0000","last_became_peered":"2024-09-14T11:38:50.582489+0000","last_unstale":"2024-09-14T11:50:53.298593+0000","last_undegraded":"2024-09-14T11:50:53.298593+0000","last_fullsized":"2024-09-14T11:50:53.298593+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:07.012027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.300762+0000","last_change":"2024-09-14T11:27:41.647192+0000","last_active":"2024-09-14T11:51:53.300762+0000","last_peered":"2024-09-14T11:51:53.300762+0000","last_clean":"2024-09-14T11:51:53.300762+0000","last_became_active":"2024-09-14T11:27:41.645724+0000","last_became_peered":"2024-09-14T11:27:41.645724+0000","last_unstale":"2024-09-14T11:51:53.300762+0000","last_undegraded":"2024-09-14T11:51:53.300762+0000","last_fullsized":"2024-09-14T11:51:53.300762+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"264'3","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.471030+0000","last_change":"2024-09-14T11:27:38.606708+0000","last_active":"2024-09-14T11:53:57.471030+0000","last_peered":"2024-09-14T11:53:57.471030+0000","last_clean":"2024-09-14T11:53:57.471030+0000","last_became_active":"2024-09-14T11:27:38.605937+0000","last_became_peered":"2024-09-14T11:27:38.605937+0000","last_unstale":"2024-09-14T11:53:57.471030+0000","last_undegraded":"2024-09-14T11:53:57.471030+0000","last_fullsized":"2024-09-14T11:53:57.471030+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"264'12","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.124495+0000","last_change":"2024-09-14T11:26:04.279565+0000","last_active":"2024-09-14T11:51:08.124495+0000","last_peered":"2024-09-14T11:51:08.124495+0000","last_clean":"2024-09-14T11:51:08.124495+0000","last_became_active":"2024-09-14T11:26:04.278457+0000","last_became_peered":"2024-09-14T11:26:04.278457+0000","last_unstale":"2024-09-14T11:51:08.124495+0000","last_undegraded":"2024-09-14T11:51:08.124495+0000","last_fullsized":"2024-09-14T11:51:08.124495+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:36.957690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":56,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.125380+0000","last_change":"2024-09-14T11:38:50.576845+0000","last_active":"2024-09-14T11:51:23.125380+0000","last_peered":"2024-09-14T11:51:23.125380+0000","last_clean":"2024-09-14T11:51:23.125380+0000","last_became_active":"2024-09-14T11:38:50.576125+0000","last_became_peered":"2024-09-14T11:38:50.576125+0000","last_unstale":"2024-09-14T11:51:23.125380+0000","last_undegraded":"2024-09-14T11:51:23.125380+0000","last_fullsized":"2024-09-14T11:51:23.125380+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:08.428909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"264'4","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.533800+0000","last_change":"2024-09-14T11:27:41.661526+0000","last_active":"2024-09-14T11:53:57.533800+0000","last_peered":"2024-09-14T11:53:57.533800+0000","last_clean":"2024-09-14T11:53:57.533800+0000","last_became_active":"2024-09-14T11:27:41.660702+0000","last_became_peered":"2024-09-14T11:27:41.660702+0000","last_unstale":"2024-09-14T11:53:57.533800+0000","last_undegraded":"2024-09-14T11:53:57.533800+0000","last_fullsized":"2024-09-14T11:53:57.533800+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"264'11","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.470658+0000","last_change":"2024-09-14T11:27:38.603652+0000","last_active":"2024-09-14T11:53:57.470658+0000","last_peered":"2024-09-14T11:53:57.470658+0000","last_clean":"2024-09-14T11:53:57.470658+0000","last_became_active":"2024-09-14T11:27:38.602908+0000","last_became_peered":"2024-09-14T11:27:38.602908+0000","last_unstale":"2024-09-14T11:53:57.470658+0000","last_undegraded":"2024-09-14T11:53:57.470658+0000","last_fullsized":"2024-09-14T11:53:57.470658+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":15360,"num_write":16,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"264'30","reported_seq":126,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:04.102933+0000","last_change":"2024-09-14T11:26:04.259271+0000","last_active":"2024-09-14T11:51:04.102933+0000","last_peered":"2024-09-14T11:51:04.102933+0000","last_clean":"2024-09-14T11:51:04.102933+0000","last_became_active":"2024-09-14T11:26:04.258048+0000","last_became_peered":"2024-09-14T11:26:04.258048+0000","last_unstale":"2024-09-14T11:51:04.102933+0000","last_undegraded":"2024-09-14T11:51:04.102933+0000","last_fullsized":"2024-09-14T11:51:04.102933+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:36.508914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":248,"num_read_kb":161,"num_write":75,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:24.107804+0000","last_change":"2024-09-14T11:38:50.591472+0000","last_active":"2024-09-14T11:51:24.107804+0000","last_peered":"2024-09-14T11:51:24.107804+0000","last_clean":"2024-09-14T11:51:24.107804+0000","last_became_active":"2024-09-14T11:38:50.590496+0000","last_became_peered":"2024-09-14T11:38:50.590496+0000","last_unstale":"2024-09-14T11:51:24.107804+0000","last_undegraded":"2024-09-14T11:51:24.107804+0000","last_fullsized":"2024-09-14T11:51:24.107804+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:59.200308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"264'11","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.038662+0000","last_change":"2024-09-14T11:27:41.637007+0000","last_active":"2024-09-14T11:53:57.038662+0000","last_peered":"2024-09-14T11:53:57.038662+0000","last_clean":"2024-09-14T11:53:57.038662+0000","last_became_active":"2024-09-14T11:27:41.635495+0000","last_became_peered":"2024-09-14T11:27:41.635495+0000","last_unstale":"2024-09-14T11:53:57.038662+0000","last_undegraded":"2024-09-14T11:53:57.038662+0000","last_fullsized":"2024-09-14T11:53:57.038662+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:07.509871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":12817,"num_write":26,"num_write_kb":12817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"264'2","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:38.309929+0000","last_change":"2024-09-14T11:27:38.594325+0000","last_active":"2024-09-14T11:52:38.309929+0000","last_peered":"2024-09-14T11:52:38.309929+0000","last_clean":"2024-09-14T11:52:38.309929+0000","last_became_active":"2024-09-14T11:27:38.593507+0000","last_became_peered":"2024-09-14T11:27:38.593507+0000","last_unstale":"2024-09-14T11:52:38.309929+0000","last_undegraded":"2024-09-14T11:52:38.309929+0000","last_fullsized":"2024-09-14T11:52:38.309929+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:04.519402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"264'31","reported_seq":121,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.290822+0000","last_change":"2024-09-14T11:26:04.281451+0000","last_active":"2024-09-14T11:50:18.290822+0000","last_peered":"2024-09-14T11:50:18.290822+0000","last_clean":"2024-09-14T11:50:18.290822+0000","last_became_active":"2024-09-14T11:26:04.280799+0000","last_became_peered":"2024-09-14T11:26:04.280799+0000","last_unstale":"2024-09-14T11:50:18.290822+0000","last_undegraded":"2024-09-14T11:50:18.290822+0000","last_fullsized":"2024-09-14T11:50:18.290822+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:13.145315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":229,"num_read_kb":151,"num_write":83,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.294155+0000","last_change":"2024-09-14T11:38:50.588826+0000","last_active":"2024-09-14T11:51:23.294155+0000","last_peered":"2024-09-14T11:51:23.294155+0000","last_clean":"2024-09-14T11:51:23.294155+0000","last_became_active":"2024-09-14T11:38:50.588260+0000","last_became_peered":"2024-09-14T11:38:50.588260+0000","last_unstale":"2024-09-14T11:51:23.294155+0000","last_undegraded":"2024-09-14T11:51:23.294155+0000","last_fullsized":"2024-09-14T11:51:23.294155+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:00.597152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"261'2","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.289709+0000","last_change":"2024-09-14T11:27:41.650374+0000","last_active":"2024-09-14T11:50:13.289709+0000","last_peered":"2024-09-14T11:50:13.289709+0000","last_clean":"2024-09-14T11:50:13.289709+0000","last_became_active":"2024-09-14T11:27:41.649448+0000","last_became_peered":"2024-09-14T11:27:41.649448+0000","last_unstale":"2024-09-14T11:50:13.289709+0000","last_undegraded":"2024-09-14T11:50:13.289709+0000","last_fullsized":"2024-09-14T11:50:13.289709+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:46.465272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"264'3","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:38.144322+0000","last_change":"2024-09-14T11:27:38.599731+0000","last_active":"2024-09-14T11:52:38.144322+0000","last_peered":"2024-09-14T11:52:38.144322+0000","last_clean":"2024-09-14T11:52:38.144322+0000","last_became_active":"2024-09-14T11:27:38.598992+0000","last_became_peered":"2024-09-14T11:27:38.598992+0000","last_unstale":"2024-09-14T11:52:38.144322+0000","last_undegraded":"2024-09-14T11:52:38.144322+0000","last_fullsized":"2024-09-14T11:52:38.144322+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:16.033655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"264'245","reported_seq":783,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:44.404892+0000","last_change":"2024-09-14T11:26:04.283762+0000","last_active":"2024-09-14T11:51:44.404892+0000","last_peered":"2024-09-14T11:51:44.404892+0000","last_clean":"2024-09-14T11:51:44.404892+0000","last_became_active":"2024-09-14T11:26:04.283058+0000","last_became_peered":"2024-09-14T11:26:04.283058+0000","last_unstale":"2024-09-14T11:51:44.404892+0000","last_undegraded":"2024-09-14T11:51:44.404892+0000","last_fullsized":"2024-09-14T11:51:44.404892+0000","mapping_epoch":253,"log_start":"261'200","ondisk_log_start":"261'200","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:43.404343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2337,"num_read_kb":3061,"num_write":470,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:33.119635+0000","last_change":"2024-09-14T11:38:50.588284+0000","last_active":"2024-09-14T11:50:33.119635+0000","last_peered":"2024-09-14T11:50:33.119635+0000","last_clean":"2024-09-14T11:50:33.119635+0000","last_became_active":"2024-09-14T11:38:50.587593+0000","last_became_peered":"2024-09-14T11:38:50.587593+0000","last_unstale":"2024-09-14T11:50:33.119635+0000","last_undegraded":"2024-09-14T11:50:33.119635+0000","last_fullsized":"2024-09-14T11:50:33.119635+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:30.104550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"261'2","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.317473+0000","last_change":"2024-09-14T11:27:41.650094+0000","last_active":"2024-09-14T11:51:53.317473+0000","last_peered":"2024-09-14T11:51:53.317473+0000","last_clean":"2024-09-14T11:51:53.317473+0000","last_became_active":"2024-09-14T11:27:41.649297+0000","last_became_peered":"2024-09-14T11:27:41.649297+0000","last_unstale":"2024-09-14T11:51:53.317473+0000","last_undegraded":"2024-09-14T11:51:53.317473+0000","last_fullsized":"2024-09-14T11:51:53.317473+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"261'3","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:04.321677+0000","last_change":"2024-09-14T11:27:38.608702+0000","last_active":"2024-09-14T11:51:04.321677+0000","last_peered":"2024-09-14T11:51:04.321677+0000","last_clean":"2024-09-14T11:51:04.321677+0000","last_became_active":"2024-09-14T11:27:38.607929+0000","last_became_peered":"2024-09-14T11:27:38.607929+0000","last_unstale":"2024-09-14T11:51:04.321677+0000","last_undegraded":"2024-09-14T11:51:04.321677+0000","last_fullsized":"2024-09-14T11:51:04.321677+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:02.938378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"264'16","reported_seq":85,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.111235+0000","last_change":"2024-09-14T11:26:04.262715+0000","last_active":"2024-09-14T11:50:18.111235+0000","last_peered":"2024-09-14T11:50:18.111235+0000","last_clean":"2024-09-14T11:50:18.111235+0000","last_became_active":"2024-09-14T11:26:04.261101+0000","last_became_peered":"2024-09-14T11:26:04.261101+0000","last_unstale":"2024-09-14T11:50:18.111235+0000","last_undegraded":"2024-09-14T11:50:18.111235+0000","last_fullsized":"2024-09-14T11:50:18.111235+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:32.177932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":70,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:33.116264+0000","last_change":"2024-09-14T11:38:50.566716+0000","last_active":"2024-09-14T11:50:33.116264+0000","last_peered":"2024-09-14T11:50:33.116264+0000","last_clean":"2024-09-14T11:50:33.116264+0000","last_became_active":"2024-09-14T11:38:50.565980+0000","last_became_peered":"2024-09-14T11:38:50.565980+0000","last_unstale":"2024-09-14T11:50:33.116264+0000","last_undegraded":"2024-09-14T11:50:33.116264+0000","last_fullsized":"2024-09-14T11:50:33.116264+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:42.634974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"264'5","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:28.159762+0000","last_change":"2024-09-14T11:27:41.660949+0000","last_active":"2024-09-14T11:53:28.159762+0000","last_peered":"2024-09-14T11:53:28.159762+0000","last_clean":"2024-09-14T11:53:28.159762+0000","last_became_active":"2024-09-14T11:27:41.660264+0000","last_became_peered":"2024-09-14T11:27:41.660264+0000","last_unstale":"2024-09-14T11:53:28.159762+0000","last_undegraded":"2024-09-14T11:53:28.159762+0000","last_fullsized":"2024-09-14T11:53:28.159762+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:36.720927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"261'4","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:48.299311+0000","last_change":"2024-09-14T11:27:38.596650+0000","last_active":"2024-09-14T11:51:48.299311+0000","last_peered":"2024-09-14T11:51:48.299311+0000","last_clean":"2024-09-14T11:51:48.299311+0000","last_became_active":"2024-09-14T11:27:38.595788+0000","last_became_peered":"2024-09-14T11:27:38.595788+0000","last_unstale":"2024-09-14T11:51:48.299311+0000","last_undegraded":"2024-09-14T11:51:48.299311+0000","last_fullsized":"2024-09-14T11:51:48.299311+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"264'35","reported_seq":135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.111154+0000","last_change":"2024-09-14T11:26:04.283254+0000","last_active":"2024-09-14T11:50:18.111154+0000","last_peered":"2024-09-14T11:50:18.111154+0000","last_clean":"2024-09-14T11:50:18.111154+0000","last_became_active":"2024-09-14T11:26:04.279281+0000","last_became_peered":"2024-09-14T11:26:04.279281+0000","last_unstale":"2024-09-14T11:50:18.111154+0000","last_undegraded":"2024-09-14T11:50:18.111154+0000","last_fullsized":"2024-09-14T11:50:18.111154+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:14.087866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":194,"num_write":86,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:34.095673+0000","last_change":"2024-09-14T11:38:50.574673+0000","last_active":"2024-09-14T11:50:34.095673+0000","last_peered":"2024-09-14T11:50:34.095673+0000","last_clean":"2024-09-14T11:50:34.095673+0000","last_became_active":"2024-09-14T11:38:50.573912+0000","last_became_peered":"2024-09-14T11:38:50.573912+0000","last_unstale":"2024-09-14T11:50:34.095673+0000","last_undegraded":"2024-09-14T11:50:34.095673+0000","last_fullsized":"2024-09-14T11:50:34.095673+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:20.437626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"264'10","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.515902+0000","last_change":"2024-09-14T11:27:41.633217+0000","last_active":"2024-09-14T11:53:57.515902+0000","last_peered":"2024-09-14T11:53:57.515902+0000","last_clean":"2024-09-14T11:53:57.515902+0000","last_became_active":"2024-09-14T11:27:41.632456+0000","last_became_peered":"2024-09-14T11:27:41.632456+0000","last_unstale":"2024-09-14T11:53:57.515902+0000","last_undegraded":"2024-09-14T11:53:57.515902+0000","last_fullsized":"2024-09-14T11:53:57.515902+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15362,"num_write":10,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"261'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:48.316290+0000","last_change":"2024-09-14T11:27:38.617576+0000","last_active":"2024-09-14T11:51:48.316290+0000","last_peered":"2024-09-14T11:51:48.316290+0000","last_clean":"2024-09-14T11:51:48.316290+0000","last_became_active":"2024-09-14T11:27:38.616935+0000","last_became_peered":"2024-09-14T11:27:38.616935+0000","last_unstale":"2024-09-14T11:51:48.316290+0000","last_undegraded":"2024-09-14T11:51:48.316290+0000","last_fullsized":"2024-09-14T11:51:48.316290+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"264'38","reported_seq":144,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.290967+0000","last_change":"2024-09-14T11:26:04.268951+0000","last_active":"2024-09-14T11:50:18.290967+0000","last_peered":"2024-09-14T11:50:18.290967+0000","last_clean":"2024-09-14T11:50:18.290967+0000","last_became_active":"2024-09-14T11:26:04.268202+0000","last_became_peered":"2024-09-14T11:26:04.268202+0000","last_unstale":"2024-09-14T11:50:18.290967+0000","last_undegraded":"2024-09-14T11:50:18.290967+0000","last_fullsized":"2024-09-14T11:50:18.290967+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:01.258492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":294,"num_read_kb":198,"num_write":96,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:33.283228+0000","last_change":"2024-09-14T11:38:50.586123+0000","last_active":"2024-09-14T11:50:33.283228+0000","last_peered":"2024-09-14T11:50:33.283228+0000","last_clean":"2024-09-14T11:50:33.283228+0000","last_became_active":"2024-09-14T11:38:50.585324+0000","last_became_peered":"2024-09-14T11:38:50.585324+0000","last_unstale":"2024-09-14T11:50:33.283228+0000","last_undegraded":"2024-09-14T11:50:33.283228+0000","last_fullsized":"2024-09-14T11:50:33.283228+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:21.296327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"264'6","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.428550+0000","last_change":"2024-09-14T11:27:41.653603+0000","last_active":"2024-09-14T11:53:57.428550+0000","last_peered":"2024-09-14T11:53:57.428550+0000","last_clean":"2024-09-14T11:53:57.428550+0000","last_became_active":"2024-09-14T11:27:41.652940+0000","last_became_peered":"2024-09-14T11:27:41.652940+0000","last_unstale":"2024-09-14T11:53:57.428550+0000","last_undegraded":"2024-09-14T11:53:57.428550+0000","last_fullsized":"2024-09-14T11:53:57.428550+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10244,"num_write":6,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"261'5","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:48.136858+0000","last_change":"2024-09-14T11:27:38.603632+0000","last_active":"2024-09-14T11:51:48.136858+0000","last_peered":"2024-09-14T11:51:48.136858+0000","last_clean":"2024-09-14T11:51:48.136858+0000","last_became_active":"2024-09-14T11:27:38.603013+0000","last_became_peered":"2024-09-14T11:27:38.603013+0000","last_unstale":"2024-09-14T11:51:48.136858+0000","last_undegraded":"2024-09-14T11:51:48.136858+0000","last_fullsized":"2024-09-14T11:51:48.136858+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:49.333416+0000","last_change":"2024-09-14T11:26:04.263990+0000","last_active":"2024-09-14T11:51:49.333416+0000","last_peered":"2024-09-14T11:51:49.333416+0000","last_clean":"2024-09-14T11:51:49.333416+0000","last_became_active":"2024-09-14T11:26:04.263245+0000","last_became_peered":"2024-09-14T11:26:04.263245+0000","last_unstale":"2024-09-14T11:51:49.333416+0000","last_undegraded":"2024-09-14T11:51:49.333416+0000","last_fullsized":"2024-09-14T11:51:49.333416+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.125221+0000","last_change":"2024-09-14T11:38:50.591827+0000","last_active":"2024-09-14T11:50:58.125221+0000","last_peered":"2024-09-14T11:50:58.125221+0000","last_clean":"2024-09-14T11:50:58.125221+0000","last_became_active":"2024-09-14T11:38:50.591033+0000","last_became_peered":"2024-09-14T11:38:50.591033+0000","last_unstale":"2024-09-14T11:50:58.125221+0000","last_undegraded":"2024-09-14T11:50:58.125221+0000","last_fullsized":"2024-09-14T11:50:58.125221+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:09.654882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"264'2","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:23.158433+0000","last_change":"2024-09-14T11:27:41.645102+0000","last_active":"2024-09-14T11:53:23.158433+0000","last_peered":"2024-09-14T11:53:23.158433+0000","last_clean":"2024-09-14T11:53:23.158433+0000","last_became_active":"2024-09-14T11:27:41.634584+0000","last_became_peered":"2024-09-14T11:27:41.634584+0000","last_unstale":"2024-09-14T11:53:23.158433+0000","last_undegraded":"2024-09-14T11:53:23.158433+0000","last_fullsized":"2024-09-14T11:53:23.158433+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:33.590598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.271195+0000","last_change":"2024-09-14T11:27:38.612360+0000","last_active":"2024-09-14T11:50:58.271195+0000","last_peered":"2024-09-14T11:50:58.271195+0000","last_clean":"2024-09-14T11:50:58.271195+0000","last_became_active":"2024-09-14T11:27:38.611912+0000","last_became_peered":"2024-09-14T11:27:38.611912+0000","last_unstale":"2024-09-14T11:50:58.271195+0000","last_undegraded":"2024-09-14T11:50:58.271195+0000","last_fullsized":"2024-09-14T11:50:58.271195+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:31.632951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"264'32","reported_seq":135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:44.332084+0000","last_change":"2024-09-14T11:26:04.264797+0000","last_active":"2024-09-14T11:51:44.332084+0000","last_peered":"2024-09-14T11:51:44.332084+0000","last_clean":"2024-09-14T11:51:44.332084+0000","last_became_active":"2024-09-14T11:26:04.264179+0000","last_became_peered":"2024-09-14T11:26:04.264179+0000","last_unstale":"2024-09-14T11:51:44.332084+0000","last_undegraded":"2024-09-14T11:51:44.332084+0000","last_fullsized":"2024-09-14T11:51:44.332084+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":260,"num_read_kb":165,"num_write":79,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.122121+0000","last_change":"2024-09-14T11:38:50.553543+0000","last_active":"2024-09-14T11:50:58.122121+0000","last_peered":"2024-09-14T11:50:58.122121+0000","last_clean":"2024-09-14T11:50:58.122121+0000","last_became_active":"2024-09-14T11:38:50.552891+0000","last_became_peered":"2024-09-14T11:38:50.552891+0000","last_unstale":"2024-09-14T11:50:58.122121+0000","last_undegraded":"2024-09-14T11:50:58.122121+0000","last_fullsized":"2024-09-14T11:50:58.122121+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:10.586101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"261'4","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.126156+0000","last_change":"2024-09-14T11:27:41.643791+0000","last_active":"2024-09-14T11:51:03.126156+0000","last_peered":"2024-09-14T11:51:03.126156+0000","last_clean":"2024-09-14T11:51:03.126156+0000","last_became_active":"2024-09-14T11:27:41.634824+0000","last_became_peered":"2024-09-14T11:27:41.634824+0000","last_unstale":"2024-09-14T11:51:03.126156+0000","last_undegraded":"2024-09-14T11:51:03.126156+0000","last_fullsized":"2024-09-14T11:51:03.126156+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:45.655086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:18.157188+0000","last_change":"2024-09-14T11:27:38.609347+0000","last_active":"2024-09-14T11:53:18.157188+0000","last_peered":"2024-09-14T11:53:18.157188+0000","last_clean":"2024-09-14T11:53:18.157188+0000","last_became_active":"2024-09-14T11:27:38.608412+0000","last_became_peered":"2024-09-14T11:27:38.608412+0000","last_unstale":"2024-09-14T11:53:18.157188+0000","last_undegraded":"2024-09-14T11:53:18.157188+0000","last_fullsized":"2024-09-14T11:53:18.157188+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:24.685660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"264'44","reported_seq":158,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:48.316195+0000","last_change":"2024-09-14T11:26:04.272788+0000","last_active":"2024-09-14T11:51:48.316195+0000","last_peered":"2024-09-14T11:51:48.316195+0000","last_clean":"2024-09-14T11:51:48.316195+0000","last_became_active":"2024-09-14T11:26:04.272026+0000","last_became_peered":"2024-09-14T11:26:04.272026+0000","last_unstale":"2024-09-14T11:51:48.316195+0000","last_undegraded":"2024-09-14T11:51:48.316195+0000","last_fullsized":"2024-09-14T11:51:48.316195+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":232,"num_write":112,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.115743+0000","last_change":"2024-09-14T11:38:50.576604+0000","last_active":"2024-09-14T11:50:38.115743+0000","last_peered":"2024-09-14T11:50:38.115743+0000","last_clean":"2024-09-14T11:50:38.115743+0000","last_became_active":"2024-09-14T11:38:50.575796+0000","last_became_peered":"2024-09-14T11:38:50.575796+0000","last_unstale":"2024-09-14T11:50:38.115743+0000","last_undegraded":"2024-09-14T11:50:38.115743+0000","last_fullsized":"2024-09-14T11:50:38.115743+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:03.217316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"264'5","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:23.340671+0000","last_change":"2024-09-14T11:27:41.635521+0000","last_active":"2024-09-14T11:53:23.340671+0000","last_peered":"2024-09-14T11:53:23.340671+0000","last_clean":"2024-09-14T11:53:23.340671+0000","last_became_active":"2024-09-14T11:27:41.634402+0000","last_became_peered":"2024-09-14T11:27:41.634402+0000","last_unstale":"2024-09-14T11:53:23.340671+0000","last_undegraded":"2024-09-14T11:53:23.340671+0000","last_fullsized":"2024-09-14T11:53:23.340671+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:27.030127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.271311+0000","last_change":"2024-09-14T11:27:38.610277+0000","last_active":"2024-09-14T11:50:58.271311+0000","last_peered":"2024-09-14T11:50:58.271311+0000","last_clean":"2024-09-14T11:50:58.271311+0000","last_became_active":"2024-09-14T11:27:38.609363+0000","last_became_peered":"2024-09-14T11:27:38.609363+0000","last_unstale":"2024-09-14T11:50:58.271311+0000","last_undegraded":"2024-09-14T11:50:58.271311+0000","last_fullsized":"2024-09-14T11:50:58.271311+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:44.061754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"264'17","reported_seq":88,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:44.113056+0000","last_change":"2024-09-14T11:26:04.262270+0000","last_active":"2024-09-14T11:51:44.113056+0000","last_peered":"2024-09-14T11:51:44.113056+0000","last_clean":"2024-09-14T11:51:44.113056+0000","last_became_active":"2024-09-14T11:26:04.261498+0000","last_became_peered":"2024-09-14T11:26:04.261498+0000","last_unstale":"2024-09-14T11:51:44.113056+0000","last_undegraded":"2024-09-14T11:51:44.113056+0000","last_fullsized":"2024-09-14T11:51:44.113056+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":93,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.122005+0000","last_change":"2024-09-14T11:38:50.576965+0000","last_active":"2024-09-14T11:50:58.122005+0000","last_peered":"2024-09-14T11:50:58.122005+0000","last_clean":"2024-09-14T11:50:58.122005+0000","last_became_active":"2024-09-14T11:38:50.576165+0000","last_became_peered":"2024-09-14T11:38:50.576165+0000","last_unstale":"2024-09-14T11:50:58.122005+0000","last_undegraded":"2024-09-14T11:50:58.122005+0000","last_fullsized":"2024-09-14T11:50:58.122005+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:25.583158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"264'2","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.356430+0000","last_change":"2024-09-14T11:27:41.650299+0000","last_active":"2024-09-14T11:53:24.356430+0000","last_peered":"2024-09-14T11:53:24.356430+0000","last_clean":"2024-09-14T11:53:24.356430+0000","last_became_active":"2024-09-14T11:27:41.649598+0000","last_became_peered":"2024-09-14T11:27:41.649598+0000","last_unstale":"2024-09-14T11:53:24.356430+0000","last_undegraded":"2024-09-14T11:53:24.356430+0000","last_fullsized":"2024-09-14T11:53:24.356430+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:10.114521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.271350+0000","last_change":"2024-09-14T11:27:38.599118+0000","last_active":"2024-09-14T11:50:58.271350+0000","last_peered":"2024-09-14T11:50:58.271350+0000","last_clean":"2024-09-14T11:50:58.271350+0000","last_became_active":"2024-09-14T11:27:38.598429+0000","last_became_peered":"2024-09-14T11:27:38.598429+0000","last_unstale":"2024-09-14T11:50:58.271350+0000","last_undegraded":"2024-09-14T11:50:58.271350+0000","last_fullsized":"2024-09-14T11:50:58.271350+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:20.260448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"264'26","reported_seq":115,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:48.316140+0000","last_change":"2024-09-14T11:26:04.272989+0000","last_active":"2024-09-14T11:51:48.316140+0000","last_peered":"2024-09-14T11:51:48.316140+0000","last_clean":"2024-09-14T11:51:48.316140+0000","last_became_active":"2024-09-14T11:26:04.272216+0000","last_became_peered":"2024-09-14T11:26:04.272216+0000","last_unstale":"2024-09-14T11:51:48.316140+0000","last_undegraded":"2024-09-14T11:51:48.316140+0000","last_fullsized":"2024-09-14T11:51:48.316140+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":141,"num_write":65,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:58.138877+0000","last_change":"2024-09-14T11:38:50.589752+0000","last_active":"2024-09-14T11:51:58.138877+0000","last_peered":"2024-09-14T11:51:58.138877+0000","last_clean":"2024-09-14T11:51:58.138877+0000","last_became_active":"2024-09-14T11:38:50.589121+0000","last_became_peered":"2024-09-14T11:38:50.589121+0000","last_unstale":"2024-09-14T11:51:58.138877+0000","last_undegraded":"2024-09-14T11:51:58.138877+0000","last_fullsized":"2024-09-14T11:51:58.138877+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"261'4","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.289832+0000","last_change":"2024-09-14T11:27:41.631708+0000","last_active":"2024-09-14T11:50:13.289832+0000","last_peered":"2024-09-14T11:50:13.289832+0000","last_clean":"2024-09-14T11:50:13.289832+0000","last_became_active":"2024-09-14T11:27:41.630970+0000","last_became_peered":"2024-09-14T11:27:41.630970+0000","last_unstale":"2024-09-14T11:50:13.289832+0000","last_undegraded":"2024-09-14T11:50:13.289832+0000","last_fullsized":"2024-09-14T11:50:13.289832+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:10.321213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:09.090171+0000","last_change":"2024-09-14T11:27:38.598988+0000","last_active":"2024-09-14T11:50:09.090171+0000","last_peered":"2024-09-14T11:50:09.090171+0000","last_clean":"2024-09-14T11:50:09.090171+0000","last_became_active":"2024-09-14T11:27:38.580979+0000","last_became_peered":"2024-09-14T11:27:38.580979+0000","last_unstale":"2024-09-14T11:50:09.090171+0000","last_undegraded":"2024-09-14T11:50:09.090171+0000","last_fullsized":"2024-09-14T11:50:09.090171+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:07.399468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"261'22","reported_seq":106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.298654+0000","last_change":"2024-09-14T11:26:04.275780+0000","last_active":"2024-09-14T11:50:53.298654+0000","last_peered":"2024-09-14T11:50:53.298654+0000","last_clean":"2024-09-14T11:50:53.298654+0000","last_became_active":"2024-09-14T11:26:04.275034+0000","last_became_peered":"2024-09-14T11:26:04.275034+0000","last_unstale":"2024-09-14T11:50:53.298654+0000","last_undegraded":"2024-09-14T11:50:53.298654+0000","last_fullsized":"2024-09-14T11:50:53.298654+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:53.668220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":117,"num_write":55,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.260860+0000","last_change":"2024-09-14T11:38:50.596985+0000","last_active":"2024-09-14T11:50:08.260860+0000","last_peered":"2024-09-14T11:50:08.260860+0000","last_clean":"2024-09-14T11:50:08.260860+0000","last_became_active":"2024-09-14T11:38:50.596395+0000","last_became_peered":"2024-09-14T11:38:50.596395+0000","last_unstale":"2024-09-14T11:50:08.260860+0000","last_undegraded":"2024-09-14T11:50:08.260860+0000","last_fullsized":"2024-09-14T11:50:08.260860+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:15.646487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"264'4","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.252289+0000","last_change":"2024-09-14T11:27:41.657302+0000","last_active":"2024-09-14T11:53:57.252289+0000","last_peered":"2024-09-14T11:53:57.252289+0000","last_clean":"2024-09-14T11:53:57.252289+0000","last_became_active":"2024-09-14T11:27:41.656659+0000","last_became_peered":"2024-09-14T11:27:41.656659+0000","last_unstale":"2024-09-14T11:53:57.252289+0000","last_undegraded":"2024-09-14T11:53:57.252289+0000","last_fullsized":"2024-09-14T11:53:57.252289+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:57.077639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":100,"num_write":4,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.110964+0000","last_change":"2024-09-14T11:27:38.605497+0000","last_active":"2024-09-14T11:50:08.110964+0000","last_peered":"2024-09-14T11:50:08.110964+0000","last_clean":"2024-09-14T11:50:08.110964+0000","last_became_active":"2024-09-14T11:27:38.604732+0000","last_became_peered":"2024-09-14T11:27:38.604732+0000","last_unstale":"2024-09-14T11:50:08.110964+0000","last_undegraded":"2024-09-14T11:50:08.110964+0000","last_fullsized":"2024-09-14T11:50:08.110964+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:10.544829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"264'35","reported_seq":134,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:49.317370+0000","last_change":"2024-09-14T11:26:04.280000+0000","last_active":"2024-09-14T11:50:49.317370+0000","last_peered":"2024-09-14T11:50:49.317370+0000","last_clean":"2024-09-14T11:50:49.317370+0000","last_became_active":"2024-09-14T11:26:04.279402+0000","last_became_peered":"2024-09-14T11:26:04.279402+0000","last_unstale":"2024-09-14T11:50:49.317370+0000","last_undegraded":"2024-09-14T11:50:49.317370+0000","last_fullsized":"2024-09-14T11:50:49.317370+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:08.691450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":174,"num_write":94,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:54.336661+0000","last_change":"2024-09-14T11:38:50.573603+0000","last_active":"2024-09-14T11:51:54.336661+0000","last_peered":"2024-09-14T11:51:54.336661+0000","last_clean":"2024-09-14T11:51:54.336661+0000","last_became_active":"2024-09-14T11:38:50.573062+0000","last_became_peered":"2024-09-14T11:38:50.573062+0000","last_unstale":"2024-09-14T11:51:54.336661+0000","last_undegraded":"2024-09-14T11:51:54.336661+0000","last_fullsized":"2024-09-14T11:51:54.336661+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"264'7","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:28.328447+0000","last_change":"2024-09-14T11:27:41.639765+0000","last_active":"2024-09-14T11:52:28.328447+0000","last_peered":"2024-09-14T11:52:28.328447+0000","last_clean":"2024-09-14T11:52:28.328447+0000","last_became_active":"2024-09-14T11:27:41.639051+0000","last_became_peered":"2024-09-14T11:27:41.639051+0000","last_unstale":"2024-09-14T11:52:28.328447+0000","last_undegraded":"2024-09-14T11:52:28.328447+0000","last_fullsized":"2024-09-14T11:52:28.328447+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:41.947643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"264'4","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:23.327205+0000","last_change":"2024-09-14T11:27:38.620255+0000","last_active":"2024-09-14T11:52:23.327205+0000","last_peered":"2024-09-14T11:52:23.327205+0000","last_clean":"2024-09-14T11:52:23.327205+0000","last_became_active":"2024-09-14T11:27:38.619608+0000","last_became_peered":"2024-09-14T11:27:38.619608+0000","last_unstale":"2024-09-14T11:52:23.327205+0000","last_undegraded":"2024-09-14T11:52:23.327205+0000","last_fullsized":"2024-09-14T11:52:23.327205+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:13.155452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"264'28","reported_seq":116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.270192+0000","last_change":"2024-09-14T11:26:04.273757+0000","last_active":"2024-09-14T11:50:53.270192+0000","last_peered":"2024-09-14T11:50:53.270192+0000","last_clean":"2024-09-14T11:50:53.270192+0000","last_became_active":"2024-09-14T11:26:04.272960+0000","last_became_peered":"2024-09-14T11:26:04.272960+0000","last_unstale":"2024-09-14T11:50:53.270192+0000","last_undegraded":"2024-09-14T11:50:53.270192+0000","last_fullsized":"2024-09-14T11:50:53.270192+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:56.581662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":136,"num_write":79,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.283134+0000","last_change":"2024-09-14T11:38:50.570309+0000","last_active":"2024-09-14T11:51:53.283134+0000","last_peered":"2024-09-14T11:51:53.283134+0000","last_clean":"2024-09-14T11:51:53.283134+0000","last_became_active":"2024-09-14T11:38:50.569743+0000","last_became_peered":"2024-09-14T11:38:50.569743+0000","last_unstale":"2024-09-14T11:51:53.283134+0000","last_undegraded":"2024-09-14T11:51:53.283134+0000","last_fullsized":"2024-09-14T11:51:53.283134+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"264'5","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.469969+0000","last_change":"2024-09-14T11:27:41.654827+0000","last_active":"2024-09-14T11:53:57.469969+0000","last_peered":"2024-09-14T11:53:57.469969+0000","last_clean":"2024-09-14T11:53:57.469969+0000","last_became_active":"2024-09-14T11:27:41.653929+0000","last_became_peered":"2024-09-14T11:27:41.653929+0000","last_unstale":"2024-09-14T11:53:57.469969+0000","last_undegraded":"2024-09-14T11:53:57.469969+0000","last_fullsized":"2024-09-14T11:53:57.469969+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:11.356458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":118,"num_write":10,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"264'9","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.452762+0000","last_change":"2024-09-14T11:27:38.620107+0000","last_active":"2024-09-14T11:53:57.452762+0000","last_peered":"2024-09-14T11:53:57.452762+0000","last_clean":"2024-09-14T11:53:57.452762+0000","last_became_active":"2024-09-14T11:27:38.619441+0000","last_became_peered":"2024-09-14T11:27:38.619441+0000","last_unstale":"2024-09-14T11:53:57.452762+0000","last_undegraded":"2024-09-14T11:53:57.452762+0000","last_fullsized":"2024-09-14T11:53:57.452762+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:37.692951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":21504,"num_write":14,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"264'28","reported_seq":115,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.120811+0000","last_change":"2024-09-14T11:26:04.272552+0000","last_active":"2024-09-14T11:50:53.120811+0000","last_peered":"2024-09-14T11:50:53.120811+0000","last_clean":"2024-09-14T11:50:53.120811+0000","last_became_active":"2024-09-14T11:26:04.271747+0000","last_became_peered":"2024-09-14T11:26:04.271747+0000","last_unstale":"2024-09-14T11:50:53.120811+0000","last_undegraded":"2024-09-14T11:50:53.120811+0000","last_fullsized":"2024-09-14T11:50:53.120811+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:55.732123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":132,"num_write":73,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.113971+0000","last_change":"2024-09-14T11:38:50.590185+0000","last_active":"2024-09-14T11:50:08.113971+0000","last_peered":"2024-09-14T11:50:08.113971+0000","last_clean":"2024-09-14T11:50:08.113971+0000","last_became_active":"2024-09-14T11:38:50.589444+0000","last_became_peered":"2024-09-14T11:38:50.589444+0000","last_unstale":"2024-09-14T11:50:08.113971+0000","last_undegraded":"2024-09-14T11:50:08.113971+0000","last_fullsized":"2024-09-14T11:50:08.113971+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:57.453301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"261'2","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:34.329581+0000","last_change":"2024-09-14T11:27:41.641002+0000","last_active":"2024-09-14T11:51:34.329581+0000","last_peered":"2024-09-14T11:51:34.329581+0000","last_clean":"2024-09-14T11:51:34.329581+0000","last_became_active":"2024-09-14T11:27:41.640105+0000","last_became_peered":"2024-09-14T11:27:41.640105+0000","last_unstale":"2024-09-14T11:51:34.329581+0000","last_undegraded":"2024-09-14T11:51:34.329581+0000","last_fullsized":"2024-09-14T11:51:34.329581+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:12.987982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"264'11","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:38.343675+0000","last_change":"2024-09-14T11:27:38.613505+0000","last_active":"2024-09-14T11:53:38.343675+0000","last_peered":"2024-09-14T11:53:38.343675+0000","last_clean":"2024-09-14T11:53:38.343675+0000","last_became_active":"2024-09-14T11:27:38.612745+0000","last_became_peered":"2024-09-14T11:27:38.612745+0000","last_unstale":"2024-09-14T11:53:38.343675+0000","last_undegraded":"2024-09-14T11:53:38.343675+0000","last_fullsized":"2024-09-14T11:53:38.343675+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:41.780008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6207,"num_write":16,"num_write_kb":2107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"264'45","reported_seq":170,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.120656+0000","last_change":"2024-09-14T11:26:04.277466+0000","last_active":"2024-09-14T11:50:53.120656+0000","last_peered":"2024-09-14T11:50:53.120656+0000","last_clean":"2024-09-14T11:50:53.120656+0000","last_became_active":"2024-09-14T11:26:04.273309+0000","last_became_peered":"2024-09-14T11:26:04.273309+0000","last_unstale":"2024-09-14T11:50:53.120656+0000","last_undegraded":"2024-09-14T11:50:53.120656+0000","last_fullsized":"2024-09-14T11:50:53.120656+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:24.875502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":376,"num_read_kb":242,"num_write":121,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.091371+0000","last_change":"2024-09-14T11:38:50.597053+0000","last_active":"2024-09-14T11:50:14.091371+0000","last_peered":"2024-09-14T11:50:14.091371+0000","last_clean":"2024-09-14T11:50:14.091371+0000","last_became_active":"2024-09-14T11:38:50.596495+0000","last_became_peered":"2024-09-14T11:38:50.596495+0000","last_unstale":"2024-09-14T11:50:14.091371+0000","last_undegraded":"2024-09-14T11:50:14.091371+0000","last_fullsized":"2024-09-14T11:50:14.091371+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:54.445153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"264'5","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.038986+0000","last_change":"2024-09-14T11:27:41.650790+0000","last_active":"2024-09-14T11:53:57.038986+0000","last_peered":"2024-09-14T11:53:57.038986+0000","last_clean":"2024-09-14T11:53:57.038986+0000","last_became_active":"2024-09-14T11:27:41.650311+0000","last_became_peered":"2024-09-14T11:27:41.650311+0000","last_unstale":"2024-09-14T11:53:57.038986+0000","last_undegraded":"2024-09-14T11:53:57.038986+0000","last_fullsized":"2024-09-14T11:53:57.038986+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:02.760791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"264'8","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.174095+0000","last_change":"2024-09-14T11:27:38.600875+0000","last_active":"2024-09-14T11:53:57.174095+0000","last_peered":"2024-09-14T11:53:57.174095+0000","last_clean":"2024-09-14T11:53:57.174095+0000","last_became_active":"2024-09-14T11:27:38.600043+0000","last_became_peered":"2024-09-14T11:27:38.600043+0000","last_unstale":"2024-09-14T11:53:57.174095+0000","last_undegraded":"2024-09-14T11:53:57.174095+0000","last_fullsized":"2024-09-14T11:53:57.174095+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:38.547858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":7170,"num_write":8,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"264'31","reported_seq":129,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:14.119408+0000","last_change":"2024-09-14T11:26:04.274470+0000","last_active":"2024-09-14T11:52:14.119408+0000","last_peered":"2024-09-14T11:52:14.119408+0000","last_clean":"2024-09-14T11:52:14.119408+0000","last_became_active":"2024-09-14T11:26:04.274089+0000","last_became_peered":"2024-09-14T11:26:04.274089+0000","last_unstale":"2024-09-14T11:52:14.119408+0000","last_undegraded":"2024-09-14T11:52:14.119408+0000","last_fullsized":"2024-09-14T11:52:14.119408+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":254,"num_read_kb":164,"num_write":92,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.277870+0000","last_change":"2024-09-14T11:38:50.593374+0000","last_active":"2024-09-14T11:50:08.277870+0000","last_peered":"2024-09-14T11:50:08.277870+0000","last_clean":"2024-09-14T11:50:08.277870+0000","last_became_active":"2024-09-14T11:38:50.592765+0000","last_became_peered":"2024-09-14T11:38:50.592765+0000","last_unstale":"2024-09-14T11:50:08.277870+0000","last_undegraded":"2024-09-14T11:50:08.277870+0000","last_fullsized":"2024-09-14T11:50:08.277870+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:12.739637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"261'2","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.111954+0000","last_change":"2024-09-14T11:27:41.647748+0000","last_active":"2024-09-14T11:50:13.111954+0000","last_peered":"2024-09-14T11:50:13.111954+0000","last_clean":"2024-09-14T11:50:13.111954+0000","last_became_active":"2024-09-14T11:27:41.646962+0000","last_became_peered":"2024-09-14T11:27:41.646962+0000","last_unstale":"2024-09-14T11:50:13.111954+0000","last_undegraded":"2024-09-14T11:50:13.111954+0000","last_fullsized":"2024-09-14T11:50:13.111954+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:41.449801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:28.311711+0000","last_change":"2024-09-14T11:27:38.616699+0000","last_active":"2024-09-14T11:51:28.311711+0000","last_peered":"2024-09-14T11:51:28.311711+0000","last_clean":"2024-09-14T11:51:28.311711+0000","last_became_active":"2024-09-14T11:27:38.612131+0000","last_became_peered":"2024-09-14T11:27:38.612131+0000","last_unstale":"2024-09-14T11:51:28.311711+0000","last_undegraded":"2024-09-14T11:51:28.311711+0000","last_fullsized":"2024-09-14T11:51:28.311711+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:28.127453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"264'14","reported_seq":80,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:08.141121+0000","last_change":"2024-09-14T11:26:04.259922+0000","last_active":"2024-09-14T11:52:08.141121+0000","last_peered":"2024-09-14T11:52:08.141121+0000","last_clean":"2024-09-14T11:52:08.141121+0000","last_became_active":"2024-09-14T11:26:04.258976+0000","last_became_peered":"2024-09-14T11:26:04.258976+0000","last_unstale":"2024-09-14T11:52:08.141121+0000","last_undegraded":"2024-09-14T11:52:08.141121+0000","last_fullsized":"2024-09-14T11:52:08.141121+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":72,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.288544+0000","last_change":"2024-09-14T11:38:50.594382+0000","last_active":"2024-09-14T11:50:08.288544+0000","last_peered":"2024-09-14T11:50:08.288544+0000","last_clean":"2024-09-14T11:50:08.288544+0000","last_became_active":"2024-09-14T11:38:50.593641+0000","last_became_peered":"2024-09-14T11:38:50.593641+0000","last_unstale":"2024-09-14T11:50:08.288544+0000","last_undegraded":"2024-09-14T11:50:08.288544+0000","last_fullsized":"2024-09-14T11:50:08.288544+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:19.832637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"261'7","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:33.296159+0000","last_change":"2024-09-14T11:27:41.657817+0000","last_active":"2024-09-14T11:51:33.296159+0000","last_peered":"2024-09-14T11:51:33.296159+0000","last_clean":"2024-09-14T11:51:33.296159+0000","last_became_active":"2024-09-14T11:27:41.657112+0000","last_became_peered":"2024-09-14T11:27:41.657112+0000","last_unstale":"2024-09-14T11:51:33.296159+0000","last_undegraded":"2024-09-14T11:51:33.296159+0000","last_fullsized":"2024-09-14T11:51:33.296159+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:00.412523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":6146,"num_write":12,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"264'3","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.344446+0000","last_change":"2024-09-14T11:27:38.605512+0000","last_active":"2024-09-14T11:52:24.344446+0000","last_peered":"2024-09-14T11:52:24.344446+0000","last_clean":"2024-09-14T11:52:24.344446+0000","last_became_active":"2024-09-14T11:27:38.602864+0000","last_became_peered":"2024-09-14T11:27:38.602864+0000","last_unstale":"2024-09-14T11:52:24.344446+0000","last_undegraded":"2024-09-14T11:52:24.344446+0000","last_fullsized":"2024-09-14T11:52:24.344446+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:31.418858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"264'39","reported_seq":153,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:08.303708+0000","last_change":"2024-09-14T11:26:04.272287+0000","last_active":"2024-09-14T11:52:08.303708+0000","last_peered":"2024-09-14T11:52:08.303708+0000","last_clean":"2024-09-14T11:52:08.303708+0000","last_became_active":"2024-09-14T11:26:04.271893+0000","last_became_peered":"2024-09-14T11:26:04.271893+0000","last_unstale":"2024-09-14T11:52:08.303708+0000","last_undegraded":"2024-09-14T11:52:08.303708+0000","last_fullsized":"2024-09-14T11:52:08.303708+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":319,"num_read_kb":212,"num_write":95,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.294000+0000","last_change":"2024-09-14T11:38:50.589623+0000","last_active":"2024-09-14T11:51:23.294000+0000","last_peered":"2024-09-14T11:51:23.294000+0000","last_clean":"2024-09-14T11:51:23.294000+0000","last_became_active":"2024-09-14T11:38:50.587827+0000","last_became_peered":"2024-09-14T11:38:50.587827+0000","last_unstale":"2024-09-14T11:51:23.294000+0000","last_undegraded":"2024-09-14T11:51:23.294000+0000","last_fullsized":"2024-09-14T11:51:23.294000+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:20.578713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"261'5","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:43.121925+0000","last_change":"2024-09-14T11:27:41.652540+0000","last_active":"2024-09-14T11:50:43.121925+0000","last_peered":"2024-09-14T11:50:43.121925+0000","last_clean":"2024-09-14T11:50:43.121925+0000","last_became_active":"2024-09-14T11:27:41.651778+0000","last_became_peered":"2024-09-14T11:27:41.651778+0000","last_unstale":"2024-09-14T11:50:43.121925+0000","last_undegraded":"2024-09-14T11:50:43.121925+0000","last_fullsized":"2024-09-14T11:50:43.121925+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:35.794859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:34.313081+0000","last_change":"2024-09-14T11:27:38.604820+0000","last_active":"2024-09-14T11:50:34.313081+0000","last_peered":"2024-09-14T11:50:34.313081+0000","last_clean":"2024-09-14T11:50:34.313081+0000","last_became_active":"2024-09-14T11:27:38.603954+0000","last_became_peered":"2024-09-14T11:27:38.603954+0000","last_unstale":"2024-09-14T11:50:34.313081+0000","last_undegraded":"2024-09-14T11:50:34.313081+0000","last_fullsized":"2024-09-14T11:50:34.313081+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:26.741673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"264'59","reported_seq":201,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:08.135501+0000","last_change":"2024-09-14T11:26:04.270170+0000","last_active":"2024-09-14T11:52:08.135501+0000","last_peered":"2024-09-14T11:52:08.135501+0000","last_clean":"2024-09-14T11:52:08.135501+0000","last_became_active":"2024-09-14T11:26:04.269206+0000","last_became_peered":"2024-09-14T11:26:04.269206+0000","last_unstale":"2024-09-14T11:52:08.135501+0000","last_undegraded":"2024-09-14T11:52:08.135501+0000","last_fullsized":"2024-09-14T11:52:08.135501+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":473,"num_read_kb":330,"num_write":140,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.294101+0000","last_change":"2024-09-14T11:38:50.585754+0000","last_active":"2024-09-14T11:51:23.294101+0000","last_peered":"2024-09-14T11:51:23.294101+0000","last_clean":"2024-09-14T11:51:23.294101+0000","last_became_active":"2024-09-14T11:38:50.585233+0000","last_became_peered":"2024-09-14T11:38:50.585233+0000","last_unstale":"2024-09-14T11:51:23.294101+0000","last_undegraded":"2024-09-14T11:51:23.294101+0000","last_fullsized":"2024-09-14T11:51:23.294101+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:13.891277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"261'4","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.120790+0000","last_change":"2024-09-14T11:27:41.660945+0000","last_active":"2024-09-14T11:50:38.120790+0000","last_peered":"2024-09-14T11:50:38.120790+0000","last_clean":"2024-09-14T11:50:38.120790+0000","last_became_active":"2024-09-14T11:27:41.660286+0000","last_became_peered":"2024-09-14T11:27:41.660286+0000","last_unstale":"2024-09-14T11:50:38.120790+0000","last_undegraded":"2024-09-14T11:50:38.120790+0000","last_fullsized":"2024-09-14T11:50:38.120790+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:47.102264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"261'2","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.115783+0000","last_change":"2024-09-14T11:27:38.594963+0000","last_active":"2024-09-14T11:50:38.115783+0000","last_peered":"2024-09-14T11:50:38.115783+0000","last_clean":"2024-09-14T11:50:38.115783+0000","last_became_active":"2024-09-14T11:27:38.591485+0000","last_became_peered":"2024-09-14T11:27:38.591485+0000","last_unstale":"2024-09-14T11:50:38.115783+0000","last_undegraded":"2024-09-14T11:50:38.115783+0000","last_fullsized":"2024-09-14T11:50:38.115783+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:00.325087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"261'8","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:04.339805+0000","last_change":"2024-09-14T11:26:04.284721+0000","last_active":"2024-09-14T11:52:04.339805+0000","last_peered":"2024-09-14T11:52:04.339805+0000","last_clean":"2024-09-14T11:52:04.339805+0000","last_became_active":"2024-09-14T11:26:04.280724+0000","last_became_peered":"2024-09-14T11:26:04.280724+0000","last_unstale":"2024-09-14T11:52:04.339805+0000","last_undegraded":"2024-09-14T11:52:04.339805+0000","last_fullsized":"2024-09-14T11:52:04.339805+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":39,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.124982+0000","last_change":"2024-09-14T11:38:50.586522+0000","last_active":"2024-09-14T11:50:58.124982+0000","last_peered":"2024-09-14T11:50:58.124982+0000","last_clean":"2024-09-14T11:50:58.124982+0000","last_became_active":"2024-09-14T11:38:50.586004+0000","last_became_peered":"2024-09-14T11:38:50.586004+0000","last_unstale":"2024-09-14T11:50:58.124982+0000","last_undegraded":"2024-09-14T11:50:58.124982+0000","last_fullsized":"2024-09-14T11:50:58.124982+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:21.529496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"264'4","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.321412+0000","last_change":"2024-09-14T11:27:41.657751+0000","last_active":"2024-09-14T11:53:43.321412+0000","last_peered":"2024-09-14T11:53:43.321412+0000","last_clean":"2024-09-14T11:53:43.321412+0000","last_became_active":"2024-09-14T11:27:41.656864+0000","last_became_peered":"2024-09-14T11:27:41.656864+0000","last_unstale":"2024-09-14T11:53:43.321412+0000","last_undegraded":"2024-09-14T11:53:43.321412+0000","last_fullsized":"2024-09-14T11:53:43.321412+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:54.203821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4123,"num_write":4,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"264'12","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.203854+0000","last_change":"2024-09-14T11:27:38.598139+0000","last_active":"2024-09-14T11:53:57.203854+0000","last_peered":"2024-09-14T11:53:57.203854+0000","last_clean":"2024-09-14T11:53:57.203854+0000","last_became_active":"2024-09-14T11:27:38.597416+0000","last_became_peered":"2024-09-14T11:27:38.597416+0000","last_unstale":"2024-09-14T11:53:57.203854+0000","last_undegraded":"2024-09-14T11:53:57.203854+0000","last_fullsized":"2024-09-14T11:53:57.203854+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:43.572595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":16434,"num_write":22,"num_write_kb":9264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"264'34","reported_seq":138,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:14.105634+0000","last_change":"2024-09-14T11:26:04.275339+0000","last_active":"2024-09-14T11:51:14.105634+0000","last_peered":"2024-09-14T11:51:14.105634+0000","last_clean":"2024-09-14T11:51:14.105634+0000","last_became_active":"2024-09-14T11:26:04.274720+0000","last_became_peered":"2024-09-14T11:26:04.274720+0000","last_unstale":"2024-09-14T11:51:14.105634+0000","last_undegraded":"2024-09-14T11:51:14.105634+0000","last_fullsized":"2024-09-14T11:51:14.105634+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:36.983364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":267,"num_read_kb":161,"num_write":92,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:24.326912+0000","last_change":"2024-09-14T11:38:50.576319+0000","last_active":"2024-09-14T11:51:24.326912+0000","last_peered":"2024-09-14T11:51:24.326912+0000","last_clean":"2024-09-14T11:51:24.326912+0000","last_became_active":"2024-09-14T11:38:50.575662+0000","last_became_peered":"2024-09-14T11:38:50.575662+0000","last_unstale":"2024-09-14T11:51:24.326912+0000","last_undegraded":"2024-09-14T11:51:24.326912+0000","last_fullsized":"2024-09-14T11:51:24.326912+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:49.815419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:34.329826+0000","last_change":"2024-09-14T11:27:41.653202+0000","last_active":"2024-09-14T11:51:34.329826+0000","last_peered":"2024-09-14T11:51:34.329826+0000","last_clean":"2024-09-14T11:51:34.329826+0000","last_became_active":"2024-09-14T11:27:41.652132+0000","last_became_peered":"2024-09-14T11:27:41.652132+0000","last_unstale":"2024-09-14T11:51:34.329826+0000","last_undegraded":"2024-09-14T11:51:34.329826+0000","last_fullsized":"2024-09-14T11:51:34.329826+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:58.896733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"264'4","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.252163+0000","last_change":"2024-09-14T11:27:38.603010+0000","last_active":"2024-09-14T11:53:57.252163+0000","last_peered":"2024-09-14T11:53:57.252163+0000","last_clean":"2024-09-14T11:53:57.252163+0000","last_became_active":"2024-09-14T11:27:38.602099+0000","last_became_peered":"2024-09-14T11:27:38.602099+0000","last_unstale":"2024-09-14T11:53:57.252163+0000","last_undegraded":"2024-09-14T11:53:57.252163+0000","last_fullsized":"2024-09-14T11:53:57.252163+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:51.969381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"264'30","reported_seq":125,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.307396+0000","last_change":"2024-09-14T11:26:04.266535+0000","last_active":"2024-09-14T11:51:08.307396+0000","last_peered":"2024-09-14T11:51:08.307396+0000","last_clean":"2024-09-14T11:51:08.307396+0000","last_became_active":"2024-09-14T11:26:04.265553+0000","last_became_peered":"2024-09-14T11:26:04.265553+0000","last_unstale":"2024-09-14T11:51:08.307396+0000","last_undegraded":"2024-09-14T11:51:08.307396+0000","last_fullsized":"2024-09-14T11:51:08.307396+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:39.882235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":163,"num_write":75,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.317511+0000","last_change":"2024-09-14T11:38:50.587405+0000","last_active":"2024-09-14T11:51:53.317511+0000","last_peered":"2024-09-14T11:51:53.317511+0000","last_clean":"2024-09-14T11:51:53.317511+0000","last_became_active":"2024-09-14T11:38:50.583172+0000","last_became_peered":"2024-09-14T11:38:50.583172+0000","last_unstale":"2024-09-14T11:51:53.317511+0000","last_undegraded":"2024-09-14T11:51:53.317511+0000","last_fullsized":"2024-09-14T11:51:53.317511+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:06.394703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"264'3","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:43.143563+0000","last_change":"2024-09-14T11:27:41.646437+0000","last_active":"2024-09-14T11:52:43.143563+0000","last_peered":"2024-09-14T11:52:43.143563+0000","last_clean":"2024-09-14T11:52:43.143563+0000","last_became_active":"2024-09-14T11:27:41.645631+0000","last_became_peered":"2024-09-14T11:27:41.645631+0000","last_unstale":"2024-09-14T11:52:43.143563+0000","last_undegraded":"2024-09-14T11:52:43.143563+0000","last_fullsized":"2024-09-14T11:52:43.143563+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:11.944240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"261'6","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:49.114182+0000","last_change":"2024-09-14T11:27:38.598601+0000","last_active":"2024-09-14T11:51:49.114182+0000","last_peered":"2024-09-14T11:51:49.114182+0000","last_clean":"2024-09-14T11:51:49.114182+0000","last_became_active":"2024-09-14T11:27:38.597788+0000","last_became_peered":"2024-09-14T11:27:38.597788+0000","last_unstale":"2024-09-14T11:51:49.114182+0000","last_undegraded":"2024-09-14T11:51:49.114182+0000","last_fullsized":"2024-09-14T11:51:49.114182+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:42.681971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4123,"num_write":6,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"264'31","reported_seq":122,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.496327+0000","last_change":"2024-09-14T11:26:04.258522+0000","last_active":"2024-09-14T11:51:07.496327+0000","last_peered":"2024-09-14T11:51:07.496327+0000","last_clean":"2024-09-14T11:51:07.496327+0000","last_became_active":"2024-09-14T11:26:04.257219+0000","last_became_peered":"2024-09-14T11:26:04.257219+0000","last_unstale":"2024-09-14T11:51:07.496327+0000","last_undegraded":"2024-09-14T11:51:07.496327+0000","last_fullsized":"2024-09-14T11:51:07.496327+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:20.764816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":127,"num_write":83,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.132228+0000","last_change":"2024-09-14T11:38:50.581794+0000","last_active":"2024-09-14T11:51:53.132228+0000","last_peered":"2024-09-14T11:51:53.132228+0000","last_clean":"2024-09-14T11:51:53.132228+0000","last_became_active":"2024-09-14T11:38:50.581128+0000","last_became_peered":"2024-09-14T11:38:50.581128+0000","last_unstale":"2024-09-14T11:51:53.132228+0000","last_undegraded":"2024-09-14T11:51:53.132228+0000","last_fullsized":"2024-09-14T11:51:53.132228+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"264'3","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:54.138947+0000","last_change":"2024-09-14T11:27:41.653209+0000","last_active":"2024-09-14T11:53:54.138947+0000","last_peered":"2024-09-14T11:53:54.138947+0000","last_clean":"2024-09-14T11:53:54.138947+0000","last_became_active":"2024-09-14T11:27:41.652549+0000","last_became_peered":"2024-09-14T11:27:41.652549+0000","last_unstale":"2024-09-14T11:53:54.138947+0000","last_undegraded":"2024-09-14T11:53:54.138947+0000","last_fullsized":"2024-09-14T11:53:54.138947+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:00.987136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"264'6","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.174067+0000","last_change":"2024-09-14T11:27:38.610165+0000","last_active":"2024-09-14T11:53:57.174067+0000","last_peered":"2024-09-14T11:53:57.174067+0000","last_clean":"2024-09-14T11:53:57.174067+0000","last_became_active":"2024-09-14T11:27:38.609483+0000","last_became_peered":"2024-09-14T11:27:38.609483+0000","last_unstale":"2024-09-14T11:53:57.174067+0000","last_undegraded":"2024-09-14T11:53:57.174067+0000","last_fullsized":"2024-09-14T11:53:57.174067+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:29:33.493298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12292,"num_write":6,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"264'27","reported_seq":114,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:43.442305+0000","last_change":"2024-09-14T11:26:04.269191+0000","last_active":"2024-09-14T11:51:43.442305+0000","last_peered":"2024-09-14T11:51:43.442305+0000","last_clean":"2024-09-14T11:51:43.442305+0000","last_became_active":"2024-09-14T11:26:04.268338+0000","last_became_peered":"2024-09-14T11:26:04.268338+0000","last_unstale":"2024-09-14T11:51:43.442305+0000","last_undegraded":"2024-09-14T11:51:43.442305+0000","last_fullsized":"2024-09-14T11:51:43.442305+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:41.961353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":125,"num_write":73,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.130723+0000","last_change":"2024-09-14T11:38:50.590316+0000","last_active":"2024-09-14T11:51:23.130723+0000","last_peered":"2024-09-14T11:51:23.130723+0000","last_clean":"2024-09-14T11:51:23.130723+0000","last_became_active":"2024-09-14T11:38:50.589588+0000","last_became_peered":"2024-09-14T11:38:50.589588+0000","last_unstale":"2024-09-14T11:51:23.130723+0000","last_undegraded":"2024-09-14T11:51:23.130723+0000","last_fullsized":"2024-09-14T11:51:23.130723+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:24.259049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"264'2","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.126168+0000","last_change":"2024-09-14T11:27:41.644387+0000","last_active":"2024-09-14T11:52:44.126168+0000","last_peered":"2024-09-14T11:52:44.126168+0000","last_clean":"2024-09-14T11:52:44.126168+0000","last_became_active":"2024-09-14T11:27:41.642400+0000","last_became_peered":"2024-09-14T11:27:41.642400+0000","last_unstale":"2024-09-14T11:52:44.126168+0000","last_undegraded":"2024-09-14T11:52:44.126168+0000","last_fullsized":"2024-09-14T11:52:44.126168+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:58.652273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"261'5","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:33.116188+0000","last_change":"2024-09-14T11:27:38.590088+0000","last_active":"2024-09-14T11:50:33.116188+0000","last_peered":"2024-09-14T11:50:33.116188+0000","last_clean":"2024-09-14T11:50:33.116188+0000","last_became_active":"2024-09-14T11:27:38.587990+0000","last_became_peered":"2024-09-14T11:27:38.587990+0000","last_unstale":"2024-09-14T11:50:33.116188+0000","last_undegraded":"2024-09-14T11:50:33.116188+0000","last_fullsized":"2024-09-14T11:50:33.116188+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:09.675601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"264'55","reported_seq":192,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:43.699139+0000","last_change":"2024-09-14T11:26:04.258664+0000","last_active":"2024-09-14T11:51:43.699139+0000","last_peered":"2024-09-14T11:51:43.699139+0000","last_clean":"2024-09-14T11:51:43.699139+0000","last_became_active":"2024-09-14T11:26:04.257926+0000","last_became_peered":"2024-09-14T11:26:04.257926+0000","last_unstale":"2024-09-14T11:51:43.699139+0000","last_undegraded":"2024-09-14T11:51:43.699139+0000","last_fullsized":"2024-09-14T11:51:43.699139+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:33.436039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":423,"num_read_kb":280,"num_write":136,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:24.327084+0000","last_change":"2024-09-14T11:38:50.587747+0000","last_active":"2024-09-14T11:51:24.327084+0000","last_peered":"2024-09-14T11:51:24.327084+0000","last_clean":"2024-09-14T11:51:24.327084+0000","last_became_active":"2024-09-14T11:38:50.581923+0000","last_became_peered":"2024-09-14T11:38:50.581923+0000","last_unstale":"2024-09-14T11:51:24.327084+0000","last_undegraded":"2024-09-14T11:51:24.327084+0000","last_fullsized":"2024-09-14T11:51:24.327084+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:40.481426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:39.096845+0000","last_change":"2024-09-14T11:27:41.635443+0000","last_active":"2024-09-14T11:50:39.096845+0000","last_peered":"2024-09-14T11:50:39.096845+0000","last_clean":"2024-09-14T11:50:39.096845+0000","last_became_active":"2024-09-14T11:27:41.634692+0000","last_became_peered":"2024-09-14T11:27:41.634692+0000","last_unstale":"2024-09-14T11:50:39.096845+0000","last_undegraded":"2024-09-14T11:50:39.096845+0000","last_fullsized":"2024-09-14T11:50:39.096845+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:40.891329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"264'8","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.350192+0000","last_change":"2024-09-14T11:27:38.613089+0000","last_active":"2024-09-14T11:53:57.350192+0000","last_peered":"2024-09-14T11:53:57.350192+0000","last_clean":"2024-09-14T11:53:57.350192+0000","last_became_active":"2024-09-14T11:27:38.612443+0000","last_became_peered":"2024-09-14T11:27:38.612443+0000","last_unstale":"2024-09-14T11:53:57.350192+0000","last_undegraded":"2024-09-14T11:53:57.350192+0000","last_fullsized":"2024-09-14T11:53:57.350192+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:03.608324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16386,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"264'61","reported_seq":209,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:14.119291+0000","last_change":"2024-09-14T11:26:04.264319+0000","last_active":"2024-09-14T11:52:14.119291+0000","last_peered":"2024-09-14T11:52:14.119291+0000","last_clean":"2024-09-14T11:52:14.119291+0000","last_became_active":"2024-09-14T11:26:04.263498+0000","last_became_peered":"2024-09-14T11:26:04.263498+0000","last_unstale":"2024-09-14T11:52:14.119291+0000","last_undegraded":"2024-09-14T11:52:14.119291+0000","last_fullsized":"2024-09-14T11:52:14.119291+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":491,"num_read_kb":357,"num_write":145,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"264'200","reported_seq":928,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.744180+0000","last_change":"2024-09-14T11:54:09.744180+0000","last_active":"2024-09-14T11:54:09.744180+0000","last_peered":"2024-09-14T11:54:09.744180+0000","last_clean":"2024-09-14T11:54:09.744180+0000","last_became_active":"2024-09-14T11:09:45.212881+0000","last_became_peered":"2024-09-14T11:09:45.212881+0000","last_unstale":"2024-09-14T11:54:09.744180+0000","last_undegraded":"2024-09-14T11:54:09.744180+0000","last_fullsized":"2024-09-14T11:54:09.744180+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'200","last_scrub_stamp":"2024-09-14T11:54:09.743907+0000","last_deep_scrub":"264'200","last_deep_scrub_stamp":"2024-09-14T11:54:09.743907+0000","last_clean_scrub_stamp":"2024-09-14T11:54:09.743907+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:12.346884+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":928,"num_read_kb":39441,"num_write":967,"num_write_kb":29636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"264'510","reported_seq":2117,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.589663+0000","last_change":"2024-09-14T11:54:15.589663+0000","last_active":"2024-09-14T11:54:15.589663+0000","last_peered":"2024-09-14T11:54:15.589663+0000","last_clean":"2024-09-14T11:54:15.589663+0000","last_became_active":"2024-09-14T11:09:46.960069+0000","last_became_peered":"2024-09-14T11:09:46.960069+0000","last_unstale":"2024-09-14T11:54:15.589663+0000","last_undegraded":"2024-09-14T11:54:15.589663+0000","last_fullsized":"2024-09-14T11:54:15.589663+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'510","last_scrub_stamp":"2024-09-14T11:54:15.589488+0000","last_deep_scrub":"264'510","last_deep_scrub_stamp":"2024-09-14T11:54:15.589488+0000","last_clean_scrub_stamp":"2024-09-14T11:54:15.589488+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:03.452431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2624,"num_read_kb":2455,"num_write":621,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"264'213","reported_seq":869,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:16.081574+0000","last_change":"2024-09-14T11:54:16.081574+0000","last_active":"2024-09-14T11:54:16.081574+0000","last_peered":"2024-09-14T11:54:16.081574+0000","last_clean":"2024-09-14T11:54:16.081574+0000","last_became_active":"2024-09-14T11:09:45.211049+0000","last_became_peered":"2024-09-14T11:09:45.211049+0000","last_unstale":"2024-09-14T11:54:16.081574+0000","last_undegraded":"2024-09-14T11:54:16.081574+0000","last_fullsized":"2024-09-14T11:54:16.081574+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'213","last_scrub_stamp":"2024-09-14T11:54:16.081321+0000","last_deep_scrub":"264'213","last_deep_scrub_stamp":"2024-09-14T11:54:16.081321+0000","last_clean_scrub_stamp":"2024-09-14T11:54:16.081321+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:38.768993+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":540,"num_read_kb":70257,"num_write":1018,"num_write_kb":34950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"264'757","reported_seq":2283,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.019646+0000","last_change":"2024-09-14T11:09:46.957857+0000","last_active":"2024-09-14T11:52:29.019646+0000","last_peered":"2024-09-14T11:52:29.019646+0000","last_clean":"2024-09-14T11:52:29.019646+0000","last_became_active":"2024-09-14T11:09:46.957446+0000","last_became_peered":"2024-09-14T11:09:46.957446+0000","last_unstale":"2024-09-14T11:52:29.019646+0000","last_undegraded":"2024-09-14T11:52:29.019646+0000","last_fullsized":"2024-09-14T11:52:29.019646+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:59.796579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3644,"num_read_kb":3296,"num_write":998,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"264'185","reported_seq":815,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.081219+0000","last_change":"2024-09-14T11:54:15.081219+0000","last_active":"2024-09-14T11:54:15.081219+0000","last_peered":"2024-09-14T11:54:15.081219+0000","last_clean":"2024-09-14T11:54:15.081219+0000","last_became_active":"2024-09-14T11:09:45.207458+0000","last_became_peered":"2024-09-14T11:09:45.207458+0000","last_unstale":"2024-09-14T11:54:15.081219+0000","last_undegraded":"2024-09-14T11:54:15.081219+0000","last_fullsized":"2024-09-14T11:54:15.081219+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'185","last_scrub_stamp":"2024-09-14T11:54:15.080970+0000","last_deep_scrub":"264'185","last_deep_scrub_stamp":"2024-09-14T11:54:15.080970+0000","last_clean_scrub_stamp":"2024-09-14T11:54:15.080970+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:43.319269+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":12475,"num_write":826,"num_write_kb":33777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"264'372","reported_seq":1895,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:27.204477+0000","last_change":"2024-09-14T11:09:46.950941+0000","last_active":"2024-09-14T11:52:27.204477+0000","last_peered":"2024-09-14T11:52:27.204477+0000","last_clean":"2024-09-14T11:52:27.204477+0000","last_became_active":"2024-09-14T11:09:46.950652+0000","last_became_peered":"2024-09-14T11:09:46.950652+0000","last_unstale":"2024-09-14T11:52:27.204477+0000","last_undegraded":"2024-09-14T11:52:27.204477+0000","last_fullsized":"2024-09-14T11:52:27.204477+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:34.170365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2108,"num_read_kb":2030,"num_write":424,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"264'209","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:16.405568+0000","last_change":"2024-09-14T11:54:16.405568+0000","last_active":"2024-09-14T11:54:16.405568+0000","last_peered":"2024-09-14T11:54:16.405568+0000","last_clean":"2024-09-14T11:54:16.405568+0000","last_became_active":"2024-09-14T11:09:45.185702+0000","last_became_peered":"2024-09-14T11:09:45.185702+0000","last_unstale":"2024-09-14T11:54:16.405568+0000","last_undegraded":"2024-09-14T11:54:16.405568+0000","last_fullsized":"2024-09-14T11:54:16.405568+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'209","last_scrub_stamp":"2024-09-14T11:54:16.405308+0000","last_deep_scrub":"264'209","last_deep_scrub_stamp":"2024-09-14T11:54:16.405308+0000","last_clean_scrub_stamp":"2024-09-14T11:54:16.405308+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:37.330840+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":495,"num_read_kb":15356,"num_write":918,"num_write_kb":51388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"264'416","reported_seq":1980,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.753329+0000","last_change":"2024-09-14T11:54:18.753329+0000","last_active":"2024-09-14T11:54:18.753329+0000","last_peered":"2024-09-14T11:54:18.753329+0000","last_clean":"2024-09-14T11:54:18.753329+0000","last_became_active":"2024-09-14T11:09:46.952230+0000","last_became_peered":"2024-09-14T11:09:46.952230+0000","last_unstale":"2024-09-14T11:54:18.753329+0000","last_undegraded":"2024-09-14T11:54:18.753329+0000","last_fullsized":"2024-09-14T11:54:18.753329+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'416","last_scrub_stamp":"2024-09-14T11:54:18.753111+0000","last_deep_scrub":"264'416","last_deep_scrub_stamp":"2024-09-14T11:54:18.753111+0000","last_clean_scrub_stamp":"2024-09-14T11:54:18.753111+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:38.004375+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2399,"num_read_kb":2276,"num_write":503,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"264'177","reported_seq":754,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.268410+0000","last_change":"2024-09-14T11:54:08.268410+0000","last_active":"2024-09-14T11:54:08.268410+0000","last_peered":"2024-09-14T11:54:08.268410+0000","last_clean":"2024-09-14T11:54:08.268410+0000","last_became_active":"2024-09-14T11:10:22.254947+0000","last_became_peered":"2024-09-14T11:10:22.254947+0000","last_unstale":"2024-09-14T11:54:08.268410+0000","last_undegraded":"2024-09-14T11:54:08.268410+0000","last_fullsized":"2024-09-14T11:54:08.268410+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-09-14T11:54:08.268210+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-09-14T11:54:08.268210+0000","last_clean_scrub_stamp":"2024-09-14T11:54:08.268210+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:14.156723+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":441,"num_read_kb":20000,"num_write":788,"num_write_kb":32213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'368","reported_seq":1761,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.799314+0000","last_change":"2024-09-14T11:54:17.799314+0000","last_active":"2024-09-14T11:54:17.799314+0000","last_peered":"2024-09-14T11:54:17.799314+0000","last_clean":"2024-09-14T11:54:17.799314+0000","last_became_active":"2024-09-14T11:09:46.962586+0000","last_became_peered":"2024-09-14T11:09:46.962586+0000","last_unstale":"2024-09-14T11:54:17.799314+0000","last_undegraded":"2024-09-14T11:54:17.799314+0000","last_fullsized":"2024-09-14T11:54:17.799314+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'368","last_scrub_stamp":"2024-09-14T11:54:17.799119+0000","last_deep_scrub":"264'368","last_deep_scrub_stamp":"2024-09-14T11:54:17.799119+0000","last_clean_scrub_stamp":"2024-09-14T11:54:17.799119+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:30:09.942238+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1989,"num_read_kb":1876,"num_write":428,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"264'210","reported_seq":845,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.412736+0000","last_change":"2024-09-14T11:54:10.412736+0000","last_active":"2024-09-14T11:54:10.412736+0000","last_peered":"2024-09-14T11:54:10.412736+0000","last_clean":"2024-09-14T11:54:10.412736+0000","last_became_active":"2024-09-14T11:09:45.187149+0000","last_became_peered":"2024-09-14T11:09:45.187149+0000","last_unstale":"2024-09-14T11:54:10.412736+0000","last_undegraded":"2024-09-14T11:54:10.412736+0000","last_fullsized":"2024-09-14T11:54:10.412736+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'210","last_scrub_stamp":"2024-09-14T11:54:10.412544+0000","last_deep_scrub":"264'210","last_deep_scrub_stamp":"2024-09-14T11:54:10.412544+0000","last_clean_scrub_stamp":"2024-09-14T11:54:10.412544+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:47.711478+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":555,"num_read_kb":3965,"num_write":975,"num_write_kb":31222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"264'787","reported_seq":2330,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.801159+0000","last_change":"2024-09-14T11:54:14.801159+0000","last_active":"2024-09-14T11:54:14.801159+0000","last_peered":"2024-09-14T11:54:14.801159+0000","last_clean":"2024-09-14T11:54:14.801159+0000","last_became_active":"2024-09-14T11:09:46.990102+0000","last_became_peered":"2024-09-14T11:09:46.990102+0000","last_unstale":"2024-09-14T11:54:14.801159+0000","last_undegraded":"2024-09-14T11:54:14.801159+0000","last_fullsized":"2024-09-14T11:54:14.801159+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'787","last_scrub_stamp":"2024-09-14T11:54:14.800969+0000","last_deep_scrub":"264'787","last_deep_scrub_stamp":"2024-09-14T11:54:14.800969+0000","last_clean_scrub_stamp":"2024-09-14T11:54:14.800969+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:44.286981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3903,"num_read_kb":3531,"num_write":1063,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"264'334","reported_seq":1003,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.759698+0000","last_change":"2024-09-14T11:54:10.759698+0000","last_active":"2024-09-14T11:54:10.759698+0000","last_peered":"2024-09-14T11:54:10.759698+0000","last_clean":"2024-09-14T11:54:10.759698+0000","last_became_active":"2024-09-14T11:09:45.204885+0000","last_became_peered":"2024-09-14T11:09:45.204885+0000","last_unstale":"2024-09-14T11:54:10.759698+0000","last_undegraded":"2024-09-14T11:54:10.759698+0000","last_fullsized":"2024-09-14T11:54:10.759698+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'334","last_scrub_stamp":"2024-09-14T11:54:10.759384+0000","last_deep_scrub":"264'334","last_deep_scrub_stamp":"2024-09-14T11:54:10.759384+0000","last_clean_scrub_stamp":"2024-09-14T11:54:10.759384+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:40.347879+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":904,"num_read_kb":1363,"num_write":1218,"num_write_kb":28416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"264'787","reported_seq":2369,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:12.434039+0000","last_change":"2024-09-14T11:54:12.434039+0000","last_active":"2024-09-14T11:54:12.434039+0000","last_peered":"2024-09-14T11:54:12.434039+0000","last_clean":"2024-09-14T11:54:12.434039+0000","last_became_active":"2024-09-14T11:09:46.951098+0000","last_became_peered":"2024-09-14T11:09:46.951098+0000","last_unstale":"2024-09-14T11:54:12.434039+0000","last_undegraded":"2024-09-14T11:54:12.434039+0000","last_fullsized":"2024-09-14T11:54:12.434039+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'787","last_scrub_stamp":"2024-09-14T11:54:12.433859+0000","last_deep_scrub":"264'787","last_deep_scrub_stamp":"2024-09-14T11:54:12.433859+0000","last_clean_scrub_stamp":"2024-09-14T11:54:12.433859+0000","objects_scrubbed":3,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:51.937141+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3820,"num_read_kb":3459,"num_write":1035,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"264'223","reported_seq":860,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.106645+0000","last_change":"2024-09-14T11:54:14.106645+0000","last_active":"2024-09-14T11:54:14.106645+0000","last_peered":"2024-09-14T11:54:14.106645+0000","last_clean":"2024-09-14T11:54:14.106645+0000","last_became_active":"2024-09-14T11:09:45.207406+0000","last_became_peered":"2024-09-14T11:09:45.207406+0000","last_unstale":"2024-09-14T11:54:14.106645+0000","last_undegraded":"2024-09-14T11:54:14.106645+0000","last_fullsized":"2024-09-14T11:54:14.106645+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'223","last_scrub_stamp":"2024-09-14T11:54:14.106465+0000","last_deep_scrub":"264'223","last_deep_scrub_stamp":"2024-09-14T11:54:14.106465+0000","last_clean_scrub_stamp":"2024-09-14T11:54:14.106465+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:53.896261+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":519,"num_read_kb":35149,"num_write":962,"num_write_kb":45963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"264'416","reported_seq":1956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.102644+0000","last_change":"2024-09-14T11:09:46.996557+0000","last_active":"2024-09-14T11:53:43.102644+0000","last_peered":"2024-09-14T11:53:43.102644+0000","last_clean":"2024-09-14T11:53:43.102644+0000","last_became_active":"2024-09-14T11:09:46.995237+0000","last_became_peered":"2024-09-14T11:09:46.995237+0000","last_unstale":"2024-09-14T11:53:43.102644+0000","last_undegraded":"2024-09-14T11:53:43.102644+0000","last_fullsized":"2024-09-14T11:53:43.102644+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:43.227391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2305,"num_read_kb":2183,"num_write":489,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"264'597","reported_seq":2215,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:11.486409+0000","last_change":"2024-09-14T11:09:46.960536+0000","last_active":"2024-09-14T11:52:11.486409+0000","last_peered":"2024-09-14T11:52:11.486409+0000","last_clean":"2024-09-14T11:52:11.486409+0000","last_became_active":"2024-09-14T11:09:46.959477+0000","last_became_peered":"2024-09-14T11:09:46.959477+0000","last_unstale":"2024-09-14T11:52:11.486409+0000","last_undegraded":"2024-09-14T11:52:11.486409+0000","last_fullsized":"2024-09-14T11:52:11.486409+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":500,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3034,"num_read_kb":2795,"num_write":758,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"264'221","reported_seq":858,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:03.641120+0000","last_change":"2024-09-14T11:54:03.641120+0000","last_active":"2024-09-14T11:54:03.641120+0000","last_peered":"2024-09-14T11:54:03.641120+0000","last_clean":"2024-09-14T11:54:03.641120+0000","last_became_active":"2024-09-14T11:09:45.204030+0000","last_became_peered":"2024-09-14T11:09:45.204030+0000","last_unstale":"2024-09-14T11:54:03.641120+0000","last_undegraded":"2024-09-14T11:54:03.641120+0000","last_fullsized":"2024-09-14T11:54:03.641120+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'221","last_scrub_stamp":"2024-09-14T11:54:03.641022+0000","last_deep_scrub":"264'221","last_deep_scrub_stamp":"2024-09-14T11:54:03.641022+0000","last_clean_scrub_stamp":"2024-09-14T11:54:03.641022+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:40.015512+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655875,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":529,"num_read_kb":23907,"num_write":1077,"num_write_kb":37253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"264'525","reported_seq":2144,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.763390+0000","last_change":"2024-09-14T11:54:13.763390+0000","last_active":"2024-09-14T11:54:13.763390+0000","last_peered":"2024-09-14T11:54:13.763390+0000","last_clean":"2024-09-14T11:54:13.763390+0000","last_became_active":"2024-09-14T11:09:46.970750+0000","last_became_peered":"2024-09-14T11:09:46.970750+0000","last_unstale":"2024-09-14T11:54:13.763390+0000","last_undegraded":"2024-09-14T11:54:13.763390+0000","last_fullsized":"2024-09-14T11:54:13.763390+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'525","last_scrub_stamp":"2024-09-14T11:54:13.763206+0000","last_deep_scrub":"264'525","last_deep_scrub_stamp":"2024-09-14T11:54:13.763206+0000","last_clean_scrub_stamp":"2024-09-14T11:54:13.763206+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:17.444401+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2805,"num_read_kb":2599,"num_write":647,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":501,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"264'221","reported_seq":867,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.776030+0000","last_change":"2024-09-14T11:54:11.776030+0000","last_active":"2024-09-14T11:54:11.776030+0000","last_peered":"2024-09-14T11:54:11.776030+0000","last_clean":"2024-09-14T11:54:11.776030+0000","last_became_active":"2024-09-14T11:09:45.206812+0000","last_became_peered":"2024-09-14T11:09:45.206812+0000","last_unstale":"2024-09-14T11:54:11.776030+0000","last_undegraded":"2024-09-14T11:54:11.776030+0000","last_fullsized":"2024-09-14T11:54:11.776030+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'221","last_scrub_stamp":"2024-09-14T11:54:11.775812+0000","last_deep_scrub":"264'221","last_deep_scrub_stamp":"2024-09-14T11:54:11.775812+0000","last_clean_scrub_stamp":"2024-09-14T11:54:11.775812+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:44.723127+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":566,"num_read_kb":32523,"num_write":996,"num_write_kb":41963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"264'854","reported_seq":2587,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:12.504366+0000","last_change":"2024-09-14T11:54:12.504111+0000","last_active":"2024-09-14T11:54:12.504366+0000","last_peered":"2024-09-14T11:54:12.504366+0000","last_clean":"2024-09-14T11:54:12.504366+0000","last_became_active":"2024-09-14T11:09:46.975135+0000","last_became_peered":"2024-09-14T11:09:46.975135+0000","last_unstale":"2024-09-14T11:54:12.504366+0000","last_undegraded":"2024-09-14T11:54:12.504366+0000","last_fullsized":"2024-09-14T11:54:12.504366+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'854","last_scrub_stamp":"2024-09-14T11:54:12.503845+0000","last_deep_scrub":"264'854","last_deep_scrub_stamp":"2024-09-14T11:54:12.503845+0000","last_clean_scrub_stamp":"2024-09-14T11:54:12.503845+0000","objects_scrubbed":4,"log_size":54,"log_dups_size":800,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:18.835875+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4353,"num_read_kb":3966,"num_write":1152,"num_write_kb":464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2705,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"264'182","reported_seq":790,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.665227+0000","last_change":"2024-09-14T11:54:07.665227+0000","last_active":"2024-09-14T11:54:07.665227+0000","last_peered":"2024-09-14T11:54:07.665227+0000","last_clean":"2024-09-14T11:54:07.665227+0000","last_became_active":"2024-09-14T11:09:45.208314+0000","last_became_peered":"2024-09-14T11:09:45.208314+0000","last_unstale":"2024-09-14T11:54:07.665227+0000","last_undegraded":"2024-09-14T11:54:07.665227+0000","last_fullsized":"2024-09-14T11:54:07.665227+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'182","last_scrub_stamp":"2024-09-14T11:54:07.665056+0000","last_deep_scrub":"264'182","last_deep_scrub_stamp":"2024-09-14T11:54:07.665056+0000","last_clean_scrub_stamp":"2024-09-14T11:54:07.665056+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:37.478334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":417,"num_read_kb":7778,"num_write":841,"num_write_kb":25761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"264'905","reported_seq":2671,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:16.634553+0000","last_change":"2024-09-14T11:54:16.634553+0000","last_active":"2024-09-14T11:54:16.634553+0000","last_peered":"2024-09-14T11:54:16.634553+0000","last_clean":"2024-09-14T11:54:16.634553+0000","last_became_active":"2024-09-14T11:09:46.995182+0000","last_became_peered":"2024-09-14T11:09:46.995182+0000","last_unstale":"2024-09-14T11:54:16.634553+0000","last_undegraded":"2024-09-14T11:54:16.634553+0000","last_fullsized":"2024-09-14T11:54:16.634553+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'905","last_scrub_stamp":"2024-09-14T11:54:16.634329+0000","last_deep_scrub":"264'905","last_deep_scrub_stamp":"2024-09-14T11:54:16.634329+0000","last_clean_scrub_stamp":"2024-09-14T11:54:16.634329+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":800,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:39.480551+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4411,"num_read_kb":3995,"num_write":1182,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2289,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"264'216","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:03.748922+0000","last_change":"2024-09-14T11:54:03.748922+0000","last_active":"2024-09-14T11:54:03.748922+0000","last_peered":"2024-09-14T11:54:03.748922+0000","last_clean":"2024-09-14T11:54:03.748922+0000","last_became_active":"2024-09-14T11:09:45.215301+0000","last_became_peered":"2024-09-14T11:09:45.215301+0000","last_unstale":"2024-09-14T11:54:03.748922+0000","last_undegraded":"2024-09-14T11:54:03.748922+0000","last_fullsized":"2024-09-14T11:54:03.748922+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'216","last_scrub_stamp":"2024-09-14T11:54:03.748839+0000","last_deep_scrub":"264'216","last_deep_scrub_stamp":"2024-09-14T11:54:03.748839+0000","last_clean_scrub_stamp":"2024-09-14T11:54:03.748839+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:24.385373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":450,"num_read_kb":16973,"num_write":902,"num_write_kb":40194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"264'431","reported_seq":1974,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.766412+0000","last_change":"2024-09-14T11:09:46.975235+0000","last_active":"2024-09-14T11:52:12.766412+0000","last_peered":"2024-09-14T11:52:12.766412+0000","last_clean":"2024-09-14T11:52:12.766412+0000","last_became_active":"2024-09-14T11:09:46.974465+0000","last_became_peered":"2024-09-14T11:09:46.974465+0000","last_unstale":"2024-09-14T11:52:12.766412+0000","last_undegraded":"2024-09-14T11:52:12.766412+0000","last_fullsized":"2024-09-14T11:52:12.766412+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:52.589199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2378,"num_read_kb":2237,"num_write":500,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"264'228","reported_seq":897,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.669285+0000","last_change":"2024-09-14T11:54:07.669285+0000","last_active":"2024-09-14T11:54:07.669285+0000","last_peered":"2024-09-14T11:54:07.669285+0000","last_clean":"2024-09-14T11:54:07.669285+0000","last_became_active":"2024-09-14T11:09:45.210875+0000","last_became_peered":"2024-09-14T11:09:45.210875+0000","last_unstale":"2024-09-14T11:54:07.669285+0000","last_undegraded":"2024-09-14T11:54:07.669285+0000","last_fullsized":"2024-09-14T11:54:07.669285+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'228","last_scrub_stamp":"2024-09-14T11:54:07.669103+0000","last_deep_scrub":"264'228","last_deep_scrub_stamp":"2024-09-14T11:54:07.669103+0000","last_clean_scrub_stamp":"2024-09-14T11:54:07.669103+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:09.366495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":591,"num_read_kb":73875,"num_write":1091,"num_write_kb":38947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"264'417","reported_seq":1953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.522720+0000","last_change":"2024-09-14T11:54:13.522720+0000","last_active":"2024-09-14T11:54:13.522720+0000","last_peered":"2024-09-14T11:54:13.522720+0000","last_clean":"2024-09-14T11:54:13.522720+0000","last_became_active":"2024-09-14T11:09:46.958694+0000","last_became_peered":"2024-09-14T11:09:46.958694+0000","last_unstale":"2024-09-14T11:54:13.522720+0000","last_undegraded":"2024-09-14T11:54:13.522720+0000","last_fullsized":"2024-09-14T11:54:13.522720+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'417","last_scrub_stamp":"2024-09-14T11:54:13.522502+0000","last_deep_scrub":"264'417","last_deep_scrub_stamp":"2024-09-14T11:54:13.522502+0000","last_clean_scrub_stamp":"2024-09-14T11:54:13.522502+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:46.905027+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2265,"num_read_kb":2144,"num_write":479,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"264'199","reported_seq":832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.589028+0000","last_change":"2024-09-14T11:54:09.588770+0000","last_active":"2024-09-14T11:54:09.589028+0000","last_peered":"2024-09-14T11:54:09.589028+0000","last_clean":"2024-09-14T11:54:09.589028+0000","last_became_active":"2024-09-14T11:09:45.220968+0000","last_became_peered":"2024-09-14T11:09:45.220968+0000","last_unstale":"2024-09-14T11:54:09.589028+0000","last_undegraded":"2024-09-14T11:54:09.589028+0000","last_fullsized":"2024-09-14T11:54:09.589028+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'199","last_scrub_stamp":"2024-09-14T11:54:09.588498+0000","last_deep_scrub":"264'199","last_deep_scrub_stamp":"2024-09-14T11:54:09.588498+0000","last_clean_scrub_stamp":"2024-09-14T11:54:09.588498+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:12.229625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":534,"num_read_kb":44269,"num_write":1000,"num_write_kb":27179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"264'134","reported_seq":639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.738672+0000","last_change":"2024-09-14T11:09:55.027528+0000","last_active":"2024-09-14T11:52:29.738672+0000","last_peered":"2024-09-14T11:52:29.738672+0000","last_clean":"2024-09-14T11:52:29.738672+0000","last_became_active":"2024-09-14T11:09:55.026753+0000","last_became_peered":"2024-09-14T11:09:55.026753+0000","last_unstale":"2024-09-14T11:52:29.738672+0000","last_undegraded":"2024-09-14T11:52:29.738672+0000","last_fullsized":"2024-09-14T11:52:29.738672+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:49.050538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":178,"num_read_kb":167,"num_write":319,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"264'372","reported_seq":1911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.554559+0000","last_change":"2024-09-14T11:54:14.554395+0000","last_active":"2024-09-14T11:54:14.554559+0000","last_peered":"2024-09-14T11:54:14.554559+0000","last_clean":"2024-09-14T11:54:14.554559+0000","last_became_active":"2024-09-14T11:09:46.985016+0000","last_became_peered":"2024-09-14T11:09:46.985016+0000","last_unstale":"2024-09-14T11:54:14.554559+0000","last_undegraded":"2024-09-14T11:54:14.554559+0000","last_fullsized":"2024-09-14T11:54:14.554559+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-09-14T11:54:14.554182+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-09-14T11:54:14.554182+0000","last_clean_scrub_stamp":"2024-09-14T11:54:14.554182+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:51.209068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2187,"num_read_kb":2090,"num_write":422,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"264'250","reported_seq":901,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.768228+0000","last_change":"2024-09-14T11:54:11.768228+0000","last_active":"2024-09-14T11:54:11.768228+0000","last_peered":"2024-09-14T11:54:11.768228+0000","last_clean":"2024-09-14T11:54:11.768228+0000","last_became_active":"2024-09-14T11:09:45.208756+0000","last_became_peered":"2024-09-14T11:09:45.208756+0000","last_unstale":"2024-09-14T11:54:11.768228+0000","last_undegraded":"2024-09-14T11:54:11.768228+0000","last_fullsized":"2024-09-14T11:54:11.768228+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'250","last_scrub_stamp":"2024-09-14T11:54:11.767918+0000","last_deep_scrub":"264'250","last_deep_scrub_stamp":"2024-09-14T11:54:11.767918+0000","last_clean_scrub_stamp":"2024-09-14T11:54:11.767918+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:36.187167+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":600,"num_read_kb":30329,"num_write":1164,"num_write_kb":41189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:54.318570+0000","last_change":"2024-09-14T11:09:48.970253+0000","last_active":"2024-09-14T11:50:54.318570+0000","last_peered":"2024-09-14T11:50:54.318570+0000","last_clean":"2024-09-14T11:50:54.318570+0000","last_became_active":"2024-09-14T11:09:48.969807+0000","last_became_peered":"2024-09-14T11:09:48.969807+0000","last_unstale":"2024-09-14T11:50:54.318570+0000","last_undegraded":"2024-09-14T11:50:54.318570+0000","last_fullsized":"2024-09-14T11:50:54.318570+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:20.729118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"264'196","reported_seq":796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.110588+0000","last_change":"2024-09-14T11:09:50.989686+0000","last_active":"2024-09-14T11:53:57.110588+0000","last_peered":"2024-09-14T11:53:57.110588+0000","last_clean":"2024-09-14T11:53:57.110588+0000","last_became_active":"2024-09-14T11:09:50.988903+0000","last_became_peered":"2024-09-14T11:09:50.988903+0000","last_unstale":"2024-09-14T11:53:57.110588+0000","last_undegraded":"2024-09-14T11:53:57.110588+0000","last_fullsized":"2024-09-14T11:53:57.110588+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:40.383215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12630,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":269,"num_read_kb":381,"num_write":162,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.271486+0000","last_change":"2024-09-14T11:09:53.012712+0000","last_active":"2024-09-14T11:50:58.271486+0000","last_peered":"2024-09-14T11:50:58.271486+0000","last_clean":"2024-09-14T11:50:58.271486+0000","last_became_active":"2024-09-14T11:09:53.010617+0000","last_became_peered":"2024-09-14T11:09:53.010617+0000","last_unstale":"2024-09-14T11:50:58.271486+0000","last_undegraded":"2024-09-14T11:50:58.271486+0000","last_fullsized":"2024-09-14T11:50:58.271486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:10.722614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"264'139","reported_seq":635,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:57.272034+0000","last_change":"2024-09-14T11:09:55.023108+0000","last_active":"2024-09-14T11:51:57.272034+0000","last_peered":"2024-09-14T11:51:57.272034+0000","last_clean":"2024-09-14T11:51:57.272034+0000","last_became_active":"2024-09-14T11:09:55.020070+0000","last_became_peered":"2024-09-14T11:09:55.020070+0000","last_unstale":"2024-09-14T11:51:57.272034+0000","last_undegraded":"2024-09-14T11:51:57.272034+0000","last_fullsized":"2024-09-14T11:51:57.272034+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:06.571541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":142,"num_write":346,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"264'927","reported_seq":2709,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.646957+0000","last_change":"2024-09-14T11:09:46.960339+0000","last_active":"2024-09-14T11:52:29.646957+0000","last_peered":"2024-09-14T11:52:29.646957+0000","last_clean":"2024-09-14T11:52:29.646957+0000","last_became_active":"2024-09-14T11:09:46.957383+0000","last_became_peered":"2024-09-14T11:09:46.957383+0000","last_unstale":"2024-09-14T11:52:29.646957+0000","last_undegraded":"2024-09-14T11:52:29.646957+0000","last_fullsized":"2024-09-14T11:52:29.646957+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:45.921885+0000","last_clean_scrub_stamp":"2024-09-14T11:09:45.921885+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:50.357529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4732,"num_read_kb":4281,"num_write":1231,"num_write_kb":469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"264'210","reported_seq":866,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.580780+0000","last_change":"2024-09-14T11:54:10.580780+0000","last_active":"2024-09-14T11:54:10.580780+0000","last_peered":"2024-09-14T11:54:10.580780+0000","last_clean":"2024-09-14T11:54:10.580780+0000","last_became_active":"2024-09-14T11:09:45.220059+0000","last_became_peered":"2024-09-14T11:09:45.220059+0000","last_unstale":"2024-09-14T11:54:10.580780+0000","last_undegraded":"2024-09-14T11:54:10.580780+0000","last_fullsized":"2024-09-14T11:54:10.580780+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'210","last_scrub_stamp":"2024-09-14T11:54:10.580574+0000","last_deep_scrub":"264'210","last_deep_scrub_stamp":"2024-09-14T11:54:10.580574+0000","last_clean_scrub_stamp":"2024-09-14T11:54:10.580574+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:31.836630+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":639,"num_read_kb":15720,"num_write":940,"num_write_kb":28935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:21.798898+0000","last_change":"2024-09-14T11:54:21.798898+0000","last_active":"2024-09-14T11:54:21.798898+0000","last_peered":"2024-09-14T11:54:21.798898+0000","last_clean":"2024-09-14T11:54:21.798898+0000","last_became_active":"2024-09-14T11:09:48.950055+0000","last_became_peered":"2024-09-14T11:09:48.950055+0000","last_unstale":"2024-09-14T11:54:21.798898+0000","last_undegraded":"2024-09-14T11:54:21.798898+0000","last_fullsized":"2024-09-14T11:54:21.798898+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:21.798715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:21.798715+0000","last_clean_scrub_stamp":"2024-09-14T11:54:21.798715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:05.334882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"264'87","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.663075+0000","last_change":"2024-09-14T11:54:20.663075+0000","last_active":"2024-09-14T11:54:20.663075+0000","last_peered":"2024-09-14T11:54:20.663075+0000","last_clean":"2024-09-14T11:54:20.663075+0000","last_became_active":"2024-09-14T11:09:50.989174+0000","last_became_peered":"2024-09-14T11:09:50.989174+0000","last_unstale":"2024-09-14T11:54:20.663075+0000","last_undegraded":"2024-09-14T11:54:20.663075+0000","last_fullsized":"2024-09-14T11:54:20.663075+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'87","last_scrub_stamp":"2024-09-14T11:54:20.662891+0000","last_deep_scrub":"264'87","last_deep_scrub_stamp":"2024-09-14T11:54:20.662891+0000","last_clean_scrub_stamp":"2024-09-14T11:54:20.662891+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:41.721701+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":97,"num_read_kb":91,"num_write":68,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.271407+0000","last_change":"2024-09-14T11:09:53.019238+0000","last_active":"2024-09-14T11:50:58.271407+0000","last_peered":"2024-09-14T11:50:58.271407+0000","last_clean":"2024-09-14T11:50:58.271407+0000","last_became_active":"2024-09-14T11:09:53.018290+0000","last_became_peered":"2024-09-14T11:09:53.018290+0000","last_unstale":"2024-09-14T11:50:58.271407+0000","last_undegraded":"2024-09-14T11:50:58.271407+0000","last_fullsized":"2024-09-14T11:50:58.271407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:48.018030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"264'93","reported_seq":588,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:08.416231+0000","last_change":"2024-09-14T11:09:55.019556+0000","last_active":"2024-09-14T11:52:08.416231+0000","last_peered":"2024-09-14T11:52:08.416231+0000","last_clean":"2024-09-14T11:52:08.416231+0000","last_became_active":"2024-09-14T11:09:55.018855+0000","last_became_peered":"2024-09-14T11:09:55.018855+0000","last_unstale":"2024-09-14T11:52:08.416231+0000","last_undegraded":"2024-09-14T11:52:08.416231+0000","last_fullsized":"2024-09-14T11:52:08.416231+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:52.671096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":100,"num_read_kb":99,"num_write":210,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"264'509","reported_seq":2261,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:21.075552+0000","last_change":"2024-09-14T11:54:21.075552+0000","last_active":"2024-09-14T11:54:21.075552+0000","last_peered":"2024-09-14T11:54:21.075552+0000","last_clean":"2024-09-14T11:54:21.075552+0000","last_became_active":"2024-09-14T11:09:46.975175+0000","last_became_peered":"2024-09-14T11:09:46.975175+0000","last_unstale":"2024-09-14T11:54:21.075552+0000","last_undegraded":"2024-09-14T11:54:21.075552+0000","last_fullsized":"2024-09-14T11:54:21.075552+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'509","last_scrub_stamp":"2024-09-14T11:54:21.075332+0000","last_deep_scrub":"264'509","last_deep_scrub_stamp":"2024-09-14T11:54:21.075332+0000","last_clean_scrub_stamp":"2024-09-14T11:54:21.075332+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:30:29.486556+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2885,"num_read_kb":2717,"num_write":615,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2551,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"264'240","reported_seq":865,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.759266+0000","last_change":"2024-09-14T11:54:10.759266+0000","last_active":"2024-09-14T11:54:10.759266+0000","last_peered":"2024-09-14T11:54:10.759266+0000","last_clean":"2024-09-14T11:54:10.759266+0000","last_became_active":"2024-09-14T11:09:45.205019+0000","last_became_peered":"2024-09-14T11:09:45.205019+0000","last_unstale":"2024-09-14T11:54:10.759266+0000","last_undegraded":"2024-09-14T11:54:10.759266+0000","last_fullsized":"2024-09-14T11:54:10.759266+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'240","last_scrub_stamp":"2024-09-14T11:54:10.759003+0000","last_deep_scrub":"264'240","last_deep_scrub_stamp":"2024-09-14T11:54:10.759003+0000","last_clean_scrub_stamp":"2024-09-14T11:54:10.759003+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:54.898617+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":563,"num_read_kb":1571,"num_write":1129,"num_write_kb":22204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.843171+0000","last_change":"2024-09-14T11:54:22.843171+0000","last_active":"2024-09-14T11:54:22.843171+0000","last_peered":"2024-09-14T11:54:22.843171+0000","last_clean":"2024-09-14T11:54:22.843171+0000","last_became_active":"2024-09-14T11:09:48.950260+0000","last_became_peered":"2024-09-14T11:09:48.950260+0000","last_unstale":"2024-09-14T11:54:22.843171+0000","last_undegraded":"2024-09-14T11:54:22.843171+0000","last_fullsized":"2024-09-14T11:54:22.843171+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:22.842969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:22.842969+0000","last_clean_scrub_stamp":"2024-09-14T11:54:22.842969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:18.066946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"264'107","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:58.133215+0000","last_change":"2024-09-14T11:09:50.978554+0000","last_active":"2024-09-14T11:51:58.133215+0000","last_peered":"2024-09-14T11:51:58.133215+0000","last_clean":"2024-09-14T11:51:58.133215+0000","last_became_active":"2024-09-14T11:09:50.977685+0000","last_became_peered":"2024-09-14T11:09:50.977685+0000","last_unstale":"2024-09-14T11:51:58.133215+0000","last_undegraded":"2024-09-14T11:51:58.133215+0000","last_fullsized":"2024-09-14T11:51:58.133215+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"264'789","reported_seq":2368,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:56.901355+0000","last_change":"2024-09-14T11:09:53.022562+0000","last_active":"2024-09-14T11:53:56.901355+0000","last_peered":"2024-09-14T11:53:56.901355+0000","last_clean":"2024-09-14T11:53:56.901355+0000","last_became_active":"2024-09-14T11:09:53.021212+0000","last_became_peered":"2024-09-14T11:09:53.021212+0000","last_unstale":"2024-09-14T11:53:56.901355+0000","last_undegraded":"2024-09-14T11:53:56.901355+0000","last_fullsized":"2024-09-14T11:53:56.901355+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:48.852973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"264'221","reported_seq":1056,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.124563+0000","last_change":"2024-09-14T11:09:55.014805+0000","last_active":"2024-09-14T11:52:29.124563+0000","last_peered":"2024-09-14T11:52:29.124563+0000","last_clean":"2024-09-14T11:52:29.124563+0000","last_became_active":"2024-09-14T11:09:55.013994+0000","last_became_peered":"2024-09-14T11:09:55.013994+0000","last_unstale":"2024-09-14T11:52:29.124563+0000","last_undegraded":"2024-09-14T11:52:29.124563+0000","last_fullsized":"2024-09-14T11:52:29.124563+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:49.818762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":446,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":657,"num_read_kb":640,"num_write":481,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"264'1913","reported_seq":3557,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.077459+0000","last_change":"2024-09-14T11:54:19.077459+0000","last_active":"2024-09-14T11:54:19.077459+0000","last_peered":"2024-09-14T11:54:19.077459+0000","last_clean":"2024-09-14T11:54:19.077459+0000","last_became_active":"2024-09-14T11:09:46.994623+0000","last_became_peered":"2024-09-14T11:09:46.994623+0000","last_unstale":"2024-09-14T11:54:19.077459+0000","last_undegraded":"2024-09-14T11:54:19.077459+0000","last_fullsized":"2024-09-14T11:54:19.077459+0000","mapping_epoch":25,"log_start":"264'1900","ondisk_log_start":"264'1900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1913","last_scrub_stamp":"2024-09-14T11:54:19.077195+0000","last_deep_scrub":"264'1913","last_deep_scrub_stamp":"2024-09-14T11:54:19.077195+0000","last_clean_scrub_stamp":"2024-09-14T11:54:19.077195+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":1900,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:38.527036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8495,"num_read_kb":7411,"num_write":2703,"num_write_kb":1197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"264'221","reported_seq":859,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.632086+0000","last_change":"2024-09-14T11:54:06.631924+0000","last_active":"2024-09-14T11:54:06.632086+0000","last_peered":"2024-09-14T11:54:06.632086+0000","last_clean":"2024-09-14T11:54:06.632086+0000","last_became_active":"2024-09-14T11:09:45.208282+0000","last_became_peered":"2024-09-14T11:09:45.208282+0000","last_unstale":"2024-09-14T11:54:06.632086+0000","last_undegraded":"2024-09-14T11:54:06.632086+0000","last_fullsized":"2024-09-14T11:54:06.632086+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'221","last_scrub_stamp":"2024-09-14T11:54:06.631656+0000","last_deep_scrub":"264'221","last_deep_scrub_stamp":"2024-09-14T11:54:06.631656+0000","last_clean_scrub_stamp":"2024-09-14T11:54:06.631656+0000","objects_scrubbed":8,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:03.012784+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5850204,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":521,"num_read_kb":14610,"num_write":976,"num_write_kb":27594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:54.318600+0000","last_change":"2024-09-14T11:09:48.959777+0000","last_active":"2024-09-14T11:50:54.318600+0000","last_peered":"2024-09-14T11:50:54.318600+0000","last_clean":"2024-09-14T11:50:54.318600+0000","last_became_active":"2024-09-14T11:09:48.959355+0000","last_became_peered":"2024-09-14T11:09:48.959355+0000","last_unstale":"2024-09-14T11:50:54.318600+0000","last_undegraded":"2024-09-14T11:50:54.318600+0000","last_fullsized":"2024-09-14T11:50:54.318600+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:29.593248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"264'124","reported_seq":701,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.337531+0000","last_change":"2024-09-14T11:54:22.337531+0000","last_active":"2024-09-14T11:54:22.337531+0000","last_peered":"2024-09-14T11:54:22.337531+0000","last_clean":"2024-09-14T11:54:22.337531+0000","last_became_active":"2024-09-14T11:09:50.984035+0000","last_became_peered":"2024-09-14T11:09:50.984035+0000","last_unstale":"2024-09-14T11:54:22.337531+0000","last_undegraded":"2024-09-14T11:54:22.337531+0000","last_fullsized":"2024-09-14T11:54:22.337531+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-09-14T11:54:22.337342+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-09-14T11:54:22.337342+0000","last_clean_scrub_stamp":"2024-09-14T11:54:22.337342+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:46.850427+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":160,"num_read_kb":234,"num_write":82,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"264'802","reported_seq":2132,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.668687+0000","last_change":"2024-09-14T11:09:53.006772+0000","last_active":"2024-09-14T11:53:57.668687+0000","last_peered":"2024-09-14T11:53:57.668687+0000","last_clean":"2024-09-14T11:53:57.668687+0000","last_became_active":"2024-09-14T11:09:53.004265+0000","last_became_peered":"2024-09-14T11:09:53.004265+0000","last_unstale":"2024-09-14T11:53:57.668687+0000","last_undegraded":"2024-09-14T11:53:57.668687+0000","last_fullsized":"2024-09-14T11:53:57.668687+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"264'523","reported_seq":2240,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.909509+0000","last_change":"2024-09-14T11:54:20.909509+0000","last_active":"2024-09-14T11:54:20.909509+0000","last_peered":"2024-09-14T11:54:20.909509+0000","last_clean":"2024-09-14T11:54:20.909509+0000","last_became_active":"2024-09-14T11:09:46.962838+0000","last_became_peered":"2024-09-14T11:09:46.962838+0000","last_unstale":"2024-09-14T11:54:20.909509+0000","last_undegraded":"2024-09-14T11:54:20.909509+0000","last_fullsized":"2024-09-14T11:54:20.909509+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'523","last_scrub_stamp":"2024-09-14T11:54:20.909319+0000","last_deep_scrub":"264'523","last_deep_scrub_stamp":"2024-09-14T11:54:20.909319+0000","last_clean_scrub_stamp":"2024-09-14T11:54:20.909319+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":500,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:08.391964+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2791,"num_read_kb":2616,"num_write":587,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"264'281","reported_seq":951,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.716443+0000","last_change":"2024-09-14T11:54:04.716443+0000","last_active":"2024-09-14T11:54:04.716443+0000","last_peered":"2024-09-14T11:54:04.716443+0000","last_clean":"2024-09-14T11:54:04.716443+0000","last_became_active":"2024-09-14T11:09:45.219674+0000","last_became_peered":"2024-09-14T11:09:45.219674+0000","last_unstale":"2024-09-14T11:54:04.716443+0000","last_undegraded":"2024-09-14T11:54:04.716443+0000","last_fullsized":"2024-09-14T11:54:04.716443+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'281","last_scrub_stamp":"2024-09-14T11:54:04.716246+0000","last_deep_scrub":"264'281","last_deep_scrub_stamp":"2024-09-14T11:54:04.716246+0000","last_clean_scrub_stamp":"2024-09-14T11:54:04.716246+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:35:04.002963+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":701,"num_read_kb":41266,"num_write":1220,"num_write_kb":49932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.565431+0000","last_change":"2024-09-14T11:54:14.565431+0000","last_active":"2024-09-14T11:54:14.565431+0000","last_peered":"2024-09-14T11:54:14.565431+0000","last_clean":"2024-09-14T11:54:14.565431+0000","last_became_active":"2024-09-14T11:09:48.958254+0000","last_became_peered":"2024-09-14T11:09:48.958254+0000","last_unstale":"2024-09-14T11:54:14.565431+0000","last_undegraded":"2024-09-14T11:54:14.565431+0000","last_fullsized":"2024-09-14T11:54:14.565431+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:14.565263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:14.565263+0000","last_clean_scrub_stamp":"2024-09-14T11:54:14.565263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:53.252174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"264'192","reported_seq":796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.191251+0000","last_change":"2024-09-14T11:09:50.993372+0000","last_active":"2024-09-14T11:53:57.191251+0000","last_peered":"2024-09-14T11:53:57.191251+0000","last_clean":"2024-09-14T11:53:57.191251+0000","last_became_active":"2024-09-14T11:09:50.992673+0000","last_became_peered":"2024-09-14T11:09:50.992673+0000","last_unstale":"2024-09-14T11:53:57.191251+0000","last_undegraded":"2024-09-14T11:53:57.191251+0000","last_fullsized":"2024-09-14T11:53:57.191251+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:50.616252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11263,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":273,"num_read_kb":325,"num_write":154,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:23.114246+0000","last_change":"2024-09-14T11:09:53.008438+0000","last_active":"2024-09-14T11:50:23.114246+0000","last_peered":"2024-09-14T11:50:23.114246+0000","last_clean":"2024-09-14T11:50:23.114246+0000","last_became_active":"2024-09-14T11:09:53.007694+0000","last_became_peered":"2024-09-14T11:09:53.007694+0000","last_unstale":"2024-09-14T11:50:23.114246+0000","last_undegraded":"2024-09-14T11:50:23.114246+0000","last_fullsized":"2024-09-14T11:50:23.114246+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:56.147296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"264'565","reported_seq":1399,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.058548+0000","last_change":"2024-09-14T11:09:55.031185+0000","last_active":"2024-09-14T11:53:44.058548+0000","last_peered":"2024-09-14T11:53:44.058548+0000","last_clean":"2024-09-14T11:53:44.058548+0000","last_became_active":"2024-09-14T11:09:55.030659+0000","last_became_peered":"2024-09-14T11:09:55.030659+0000","last_unstale":"2024-09-14T11:53:44.058548+0000","last_undegraded":"2024-09-14T11:53:44.058548+0000","last_fullsized":"2024-09-14T11:53:44.058548+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:47.236046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1371,"num_read_kb":1346,"num_write":1205,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"264'1072","reported_seq":2650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.617875+0000","last_change":"2024-09-14T11:54:08.617875+0000","last_active":"2024-09-14T11:54:08.617875+0000","last_peered":"2024-09-14T11:54:08.617875+0000","last_clean":"2024-09-14T11:54:08.617875+0000","last_became_active":"2024-09-14T11:09:46.990046+0000","last_became_peered":"2024-09-14T11:09:46.990046+0000","last_unstale":"2024-09-14T11:54:08.617875+0000","last_undegraded":"2024-09-14T11:54:08.617875+0000","last_fullsized":"2024-09-14T11:54:08.617875+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1072","last_scrub_stamp":"2024-09-14T11:54:08.617699+0000","last_deep_scrub":"264'1072","last_deep_scrub_stamp":"2024-09-14T11:54:08.617699+0000","last_clean_scrub_stamp":"2024-09-14T11:54:08.617699+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":1000,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:02.219078+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5673,"num_read_kb":5118,"num_write":1579,"num_write_kb":694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"264'267","reported_seq":972,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:03.349250+0000","last_change":"2024-09-14T11:54:03.349250+0000","last_active":"2024-09-14T11:54:03.349250+0000","last_peered":"2024-09-14T11:54:03.349250+0000","last_clean":"2024-09-14T11:54:03.349250+0000","last_became_active":"2024-09-14T11:09:45.210020+0000","last_became_peered":"2024-09-14T11:09:45.210020+0000","last_unstale":"2024-09-14T11:54:03.349250+0000","last_undegraded":"2024-09-14T11:54:03.349250+0000","last_fullsized":"2024-09-14T11:54:03.349250+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'267","last_scrub_stamp":"2024-09-14T11:54:03.349170+0000","last_deep_scrub":"264'267","last_deep_scrub_stamp":"2024-09-14T11:54:03.349170+0000","last_clean_scrub_stamp":"2024-09-14T11:54:03.349170+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:32.965016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":888,"num_read_kb":725,"num_write":1131,"num_write_kb":36716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.609158+0000","last_change":"2024-09-14T11:54:17.609158+0000","last_active":"2024-09-14T11:54:17.609158+0000","last_peered":"2024-09-14T11:54:17.609158+0000","last_clean":"2024-09-14T11:54:17.609158+0000","last_became_active":"2024-09-14T11:09:48.973945+0000","last_became_peered":"2024-09-14T11:09:48.973945+0000","last_unstale":"2024-09-14T11:54:17.609158+0000","last_undegraded":"2024-09-14T11:54:17.609158+0000","last_fullsized":"2024-09-14T11:54:17.609158+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:17.608988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:17.608988+0000","last_clean_scrub_stamp":"2024-09-14T11:54:17.608988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:32.743186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"264'142","reported_seq":709,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.456731+0000","last_change":"2024-09-14T11:09:50.986632+0000","last_active":"2024-09-14T11:53:57.456731+0000","last_peered":"2024-09-14T11:53:57.456731+0000","last_clean":"2024-09-14T11:53:57.456731+0000","last_became_active":"2024-09-14T11:09:50.985800+0000","last_became_peered":"2024-09-14T11:09:50.985800+0000","last_unstale":"2024-09-14T11:53:57.456731+0000","last_undegraded":"2024-09-14T11:53:57.456731+0000","last_fullsized":"2024-09-14T11:53:57.456731+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:10:20.302521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14744,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":268,"num_write":96,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.122118+0000","last_change":"2024-09-14T11:09:53.003609+0000","last_active":"2024-09-14T11:51:08.122118+0000","last_peered":"2024-09-14T11:51:08.122118+0000","last_clean":"2024-09-14T11:51:08.122118+0000","last_became_active":"2024-09-14T11:09:53.002739+0000","last_became_peered":"2024-09-14T11:09:53.002739+0000","last_unstale":"2024-09-14T11:51:08.122118+0000","last_undegraded":"2024-09-14T11:51:08.122118+0000","last_fullsized":"2024-09-14T11:51:08.122118+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:34.134964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"264'2501","reported_seq":4368,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:33.422769+0000","last_change":"2024-09-14T11:09:55.020086+0000","last_active":"2024-09-14T11:53:33.422769+0000","last_peered":"2024-09-14T11:53:33.422769+0000","last_clean":"2024-09-14T11:53:33.422769+0000","last_became_active":"2024-09-14T11:09:55.017307+0000","last_became_peered":"2024-09-14T11:09:55.017307+0000","last_unstale":"2024-09-14T11:53:33.422769+0000","last_undegraded":"2024-09-14T11:53:33.422769+0000","last_fullsized":"2024-09-14T11:53:33.422769+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":2400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:26.762655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6356,"num_read_kb":6314,"num_write":5042,"num_write_kb":1853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"264'347","reported_seq":1764,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.365181+0000","last_change":"2024-09-14T11:54:08.365181+0000","last_active":"2024-09-14T11:54:08.365181+0000","last_peered":"2024-09-14T11:54:08.365181+0000","last_clean":"2024-09-14T11:54:08.365181+0000","last_became_active":"2024-09-14T11:09:46.952951+0000","last_became_peered":"2024-09-14T11:09:46.952951+0000","last_unstale":"2024-09-14T11:54:08.365181+0000","last_undegraded":"2024-09-14T11:54:08.365181+0000","last_fullsized":"2024-09-14T11:54:08.365181+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'347","last_scrub_stamp":"2024-09-14T11:54:08.364954+0000","last_deep_scrub":"264'347","last_deep_scrub_stamp":"2024-09-14T11:54:08.364954+0000","last_clean_scrub_stamp":"2024-09-14T11:54:08.364954+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:07.453326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1860,"num_read_kb":1783,"num_write":380,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"264'226","reported_seq":870,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.749433+0000","last_change":"2024-09-14T11:54:09.749433+0000","last_active":"2024-09-14T11:54:09.749433+0000","last_peered":"2024-09-14T11:54:09.749433+0000","last_clean":"2024-09-14T11:54:09.749433+0000","last_became_active":"2024-09-14T11:09:45.211217+0000","last_became_peered":"2024-09-14T11:09:45.211217+0000","last_unstale":"2024-09-14T11:54:09.749433+0000","last_undegraded":"2024-09-14T11:54:09.749433+0000","last_fullsized":"2024-09-14T11:54:09.749433+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'226","last_scrub_stamp":"2024-09-14T11:54:09.749200+0000","last_deep_scrub":"264'226","last_deep_scrub_stamp":"2024-09-14T11:54:09.749200+0000","last_clean_scrub_stamp":"2024-09-14T11:54:09.749200+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:53.881634+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":600,"num_read_kb":7544,"num_write":1094,"num_write_kb":12612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.116225+0000","last_change":"2024-09-14T11:09:48.957986+0000","last_active":"2024-09-14T11:50:18.116225+0000","last_peered":"2024-09-14T11:50:18.116225+0000","last_clean":"2024-09-14T11:50:18.116225+0000","last_became_active":"2024-09-14T11:09:48.957275+0000","last_became_peered":"2024-09-14T11:09:48.957275+0000","last_unstale":"2024-09-14T11:50:18.116225+0000","last_undegraded":"2024-09-14T11:50:18.116225+0000","last_fullsized":"2024-09-14T11:50:18.116225+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:40.815434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"264'170","reported_seq":749,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.237941+0000","last_change":"2024-09-14T11:09:51.000566+0000","last_active":"2024-09-14T11:53:57.237941+0000","last_peered":"2024-09-14T11:53:57.237941+0000","last_clean":"2024-09-14T11:53:57.237941+0000","last_became_active":"2024-09-14T11:09:50.999759+0000","last_became_peered":"2024-09-14T11:09:50.999759+0000","last_unstale":"2024-09-14T11:53:57.237941+0000","last_undegraded":"2024-09-14T11:53:57.237941+0000","last_fullsized":"2024-09-14T11:53:57.237941+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:34.933664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6528,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":216,"num_read_kb":266,"num_write":126,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"264'802","reported_seq":2350,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:56.916551+0000","last_change":"2024-09-14T11:09:53.003439+0000","last_active":"2024-09-14T11:53:56.916551+0000","last_peered":"2024-09-14T11:53:56.916551+0000","last_clean":"2024-09-14T11:53:56.916551+0000","last_became_active":"2024-09-14T11:09:53.002667+0000","last_became_peered":"2024-09-14T11:09:53.002667+0000","last_unstale":"2024-09-14T11:53:56.916551+0000","last_undegraded":"2024-09-14T11:53:56.916551+0000","last_fullsized":"2024-09-14T11:53:56.916551+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:44.486567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"264'125","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.024032+0000","last_change":"2024-09-14T11:09:55.017516+0000","last_active":"2024-09-14T11:53:43.024032+0000","last_peered":"2024-09-14T11:53:43.024032+0000","last_clean":"2024-09-14T11:53:43.024032+0000","last_became_active":"2024-09-14T11:09:55.016802+0000","last_became_peered":"2024-09-14T11:09:55.016802+0000","last_unstale":"2024-09-14T11:53:43.024032+0000","last_undegraded":"2024-09-14T11:53:43.024032+0000","last_fullsized":"2024-09-14T11:53:43.024032+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:17.432120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":820,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":114,"num_write":311,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"264'748","reported_seq":2284,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.054187+0000","last_change":"2024-09-14T11:54:18.054187+0000","last_active":"2024-09-14T11:54:18.054187+0000","last_peered":"2024-09-14T11:54:18.054187+0000","last_clean":"2024-09-14T11:54:18.054187+0000","last_became_active":"2024-09-14T11:09:46.987523+0000","last_became_peered":"2024-09-14T11:09:46.987523+0000","last_unstale":"2024-09-14T11:54:18.054187+0000","last_undegraded":"2024-09-14T11:54:18.054187+0000","last_fullsized":"2024-09-14T11:54:18.054187+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'748","last_scrub_stamp":"2024-09-14T11:54:18.054011+0000","last_deep_scrub":"264'748","last_deep_scrub_stamp":"2024-09-14T11:54:18.054011+0000","last_clean_scrub_stamp":"2024-09-14T11:54:18.054011+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:45.880403+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3699,"num_read_kb":3347,"num_write":991,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"264'240","reported_seq":899,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:01.721039+0000","last_change":"2024-09-14T11:54:01.721039+0000","last_active":"2024-09-14T11:54:01.721039+0000","last_peered":"2024-09-14T11:54:01.721039+0000","last_clean":"2024-09-14T11:54:01.721039+0000","last_became_active":"2024-09-14T11:09:45.213648+0000","last_became_peered":"2024-09-14T11:09:45.213648+0000","last_unstale":"2024-09-14T11:54:01.721039+0000","last_undegraded":"2024-09-14T11:54:01.721039+0000","last_fullsized":"2024-09-14T11:54:01.721039+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'240","last_scrub_stamp":"2024-09-14T11:54:01.720967+0000","last_deep_scrub":"264'240","last_deep_scrub_stamp":"2024-09-14T11:54:01.720967+0000","last_clean_scrub_stamp":"2024-09-14T11:54:01.720967+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:13.876519+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1830584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":598,"num_read_kb":9438,"num_write":1111,"num_write_kb":42718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.656620+0000","last_change":"2024-09-14T11:54:18.656620+0000","last_active":"2024-09-14T11:54:18.656620+0000","last_peered":"2024-09-14T11:54:18.656620+0000","last_clean":"2024-09-14T11:54:18.656620+0000","last_became_active":"2024-09-14T11:09:48.965014+0000","last_became_peered":"2024-09-14T11:09:48.965014+0000","last_unstale":"2024-09-14T11:54:18.656620+0000","last_undegraded":"2024-09-14T11:54:18.656620+0000","last_fullsized":"2024-09-14T11:54:18.656620+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:18.656437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:18.656437+0000","last_clean_scrub_stamp":"2024-09-14T11:54:18.656437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:47.603996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"264'200","reported_seq":828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.523160+0000","last_change":"2024-09-14T11:09:50.989754+0000","last_active":"2024-09-14T11:53:57.523160+0000","last_peered":"2024-09-14T11:53:57.523160+0000","last_clean":"2024-09-14T11:53:57.523160+0000","last_became_active":"2024-09-14T11:09:50.988991+0000","last_became_peered":"2024-09-14T11:09:50.988991+0000","last_unstale":"2024-09-14T11:53:57.523160+0000","last_undegraded":"2024-09-14T11:53:57.523160+0000","last_fullsized":"2024-09-14T11:53:57.523160+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:49.153350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16480,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":287,"num_read_kb":450,"num_write":148,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.126208+0000","last_change":"2024-09-14T11:09:53.011570+0000","last_active":"2024-09-14T11:51:03.126208+0000","last_peered":"2024-09-14T11:51:03.126208+0000","last_clean":"2024-09-14T11:51:03.126208+0000","last_became_active":"2024-09-14T11:09:53.010817+0000","last_became_peered":"2024-09-14T11:09:53.010817+0000","last_unstale":"2024-09-14T11:51:03.126208+0000","last_undegraded":"2024-09-14T11:51:03.126208+0000","last_fullsized":"2024-09-14T11:51:03.126208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:43.873697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"264'117","reported_seq":613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.729606+0000","last_change":"2024-09-14T11:09:55.026555+0000","last_active":"2024-09-14T11:52:29.729606+0000","last_peered":"2024-09-14T11:52:29.729606+0000","last_clean":"2024-09-14T11:52:29.729606+0000","last_became_active":"2024-09-14T11:09:55.025490+0000","last_became_peered":"2024-09-14T11:09:55.025490+0000","last_unstale":"2024-09-14T11:52:29.729606+0000","last_undegraded":"2024-09-14T11:52:29.729606+0000","last_fullsized":"2024-09-14T11:52:29.729606+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:27.983692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":533,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":108,"num_write":255,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"264'476","reported_seq":2030,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.703197+0000","last_change":"2024-09-14T11:54:08.703197+0000","last_active":"2024-09-14T11:54:08.703197+0000","last_peered":"2024-09-14T11:54:08.703197+0000","last_clean":"2024-09-14T11:54:08.703197+0000","last_became_active":"2024-09-14T11:09:46.970824+0000","last_became_peered":"2024-09-14T11:09:46.970824+0000","last_unstale":"2024-09-14T11:54:08.703197+0000","last_undegraded":"2024-09-14T11:54:08.703197+0000","last_fullsized":"2024-09-14T11:54:08.703197+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'476","last_scrub_stamp":"2024-09-14T11:54:08.702969+0000","last_deep_scrub":"264'476","last_deep_scrub_stamp":"2024-09-14T11:54:08.702969+0000","last_clean_scrub_stamp":"2024-09-14T11:54:08.702969+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:56.765104+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2551,"num_read_kb":2376,"num_write":583,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"264'199","reported_seq":798,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.232828+0000","last_change":"2024-09-14T11:54:05.232828+0000","last_active":"2024-09-14T11:54:05.232828+0000","last_peered":"2024-09-14T11:54:05.232828+0000","last_clean":"2024-09-14T11:54:05.232828+0000","last_became_active":"2024-09-14T11:09:45.216305+0000","last_became_peered":"2024-09-14T11:09:45.216305+0000","last_unstale":"2024-09-14T11:54:05.232828+0000","last_undegraded":"2024-09-14T11:54:05.232828+0000","last_fullsized":"2024-09-14T11:54:05.232828+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'199","last_scrub_stamp":"2024-09-14T11:54:05.232517+0000","last_deep_scrub":"264'199","last_deep_scrub_stamp":"2024-09-14T11:54:05.232517+0000","last_clean_scrub_stamp":"2024-09-14T11:54:05.232517+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:34.729977+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655887,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":432,"num_read_kb":2004,"num_write":918,"num_write_kb":29719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.348901+0000","last_change":"2024-09-14T11:54:19.348901+0000","last_active":"2024-09-14T11:54:19.348901+0000","last_peered":"2024-09-14T11:54:19.348901+0000","last_clean":"2024-09-14T11:54:19.348901+0000","last_became_active":"2024-09-14T11:09:48.968263+0000","last_became_peered":"2024-09-14T11:09:48.968263+0000","last_unstale":"2024-09-14T11:54:19.348901+0000","last_undegraded":"2024-09-14T11:54:19.348901+0000","last_fullsized":"2024-09-14T11:54:19.348901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:19.348715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:19.348715+0000","last_clean_scrub_stamp":"2024-09-14T11:54:19.348715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:01.380009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"264'146","reported_seq":717,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.545015+0000","last_change":"2024-09-14T11:09:50.998839+0000","last_active":"2024-09-14T11:53:57.545015+0000","last_peered":"2024-09-14T11:53:57.545015+0000","last_clean":"2024-09-14T11:53:57.545015+0000","last_became_active":"2024-09-14T11:09:50.998098+0000","last_became_peered":"2024-09-14T11:09:50.998098+0000","last_unstale":"2024-09-14T11:53:57.545015+0000","last_undegraded":"2024-09-14T11:53:57.545015+0000","last_fullsized":"2024-09-14T11:53:57.545015+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:51.979698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10966,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":215,"num_read_kb":296,"num_write":168,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:28.293305+0000","last_change":"2024-09-14T11:09:53.004485+0000","last_active":"2024-09-14T11:50:28.293305+0000","last_peered":"2024-09-14T11:50:28.293305+0000","last_clean":"2024-09-14T11:50:28.293305+0000","last_became_active":"2024-09-14T11:09:53.003759+0000","last_became_peered":"2024-09-14T11:09:53.003759+0000","last_unstale":"2024-09-14T11:50:28.293305+0000","last_undegraded":"2024-09-14T11:50:28.293305+0000","last_fullsized":"2024-09-14T11:50:28.293305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:37.578578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"264'125","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:33.427515+0000","last_change":"2024-09-14T11:09:55.034286+0000","last_active":"2024-09-14T11:53:33.427515+0000","last_peered":"2024-09-14T11:53:33.427515+0000","last_clean":"2024-09-14T11:53:33.427515+0000","last_became_active":"2024-09-14T11:09:55.033844+0000","last_became_peered":"2024-09-14T11:09:55.033844+0000","last_unstale":"2024-09-14T11:53:33.427515+0000","last_undegraded":"2024-09-14T11:53:33.427515+0000","last_fullsized":"2024-09-14T11:53:33.427515+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":100,"num_write":302,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"264'542","reported_seq":2221,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:21.889015+0000","last_change":"2024-09-14T11:54:21.889015+0000","last_active":"2024-09-14T11:54:21.889015+0000","last_peered":"2024-09-14T11:54:21.889015+0000","last_clean":"2024-09-14T11:54:21.889015+0000","last_became_active":"2024-09-14T11:09:46.961100+0000","last_became_peered":"2024-09-14T11:09:46.961100+0000","last_unstale":"2024-09-14T11:54:21.889015+0000","last_undegraded":"2024-09-14T11:54:21.889015+0000","last_fullsized":"2024-09-14T11:54:21.889015+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'542","last_scrub_stamp":"2024-09-14T11:54:21.888836+0000","last_deep_scrub":"264'542","last_deep_scrub_stamp":"2024-09-14T11:54:21.888836+0000","last_clean_scrub_stamp":"2024-09-14T11:54:21.888836+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:17.653317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2788,"num_read_kb":2597,"num_write":616,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"264'220","reported_seq":840,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.775701+0000","last_change":"2024-09-14T11:54:08.775701+0000","last_active":"2024-09-14T11:54:08.775701+0000","last_peered":"2024-09-14T11:54:08.775701+0000","last_clean":"2024-09-14T11:54:08.775701+0000","last_became_active":"2024-09-14T11:09:45.198569+0000","last_became_peered":"2024-09-14T11:09:45.198569+0000","last_unstale":"2024-09-14T11:54:08.775701+0000","last_undegraded":"2024-09-14T11:54:08.775701+0000","last_fullsized":"2024-09-14T11:54:08.775701+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'220","last_scrub_stamp":"2024-09-14T11:54:08.775524+0000","last_deep_scrub":"264'220","last_deep_scrub_stamp":"2024-09-14T11:54:08.775524+0000","last_clean_scrub_stamp":"2024-09-14T11:54:08.775524+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:16.447398+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":586,"num_read_kb":15211,"num_write":901,"num_write_kb":32712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.116267+0000","last_change":"2024-09-14T11:09:48.953393+0000","last_active":"2024-09-14T11:50:18.116267+0000","last_peered":"2024-09-14T11:50:18.116267+0000","last_clean":"2024-09-14T11:50:18.116267+0000","last_became_active":"2024-09-14T11:09:48.952531+0000","last_became_peered":"2024-09-14T11:09:48.952531+0000","last_unstale":"2024-09-14T11:50:18.116267+0000","last_undegraded":"2024-09-14T11:50:18.116267+0000","last_fullsized":"2024-09-14T11:50:18.116267+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:01.263241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"264'158","reported_seq":738,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.398087+0000","last_change":"2024-09-14T11:09:50.976197+0000","last_active":"2024-09-14T11:53:57.398087+0000","last_peered":"2024-09-14T11:53:57.398087+0000","last_clean":"2024-09-14T11:53:57.398087+0000","last_became_active":"2024-09-14T11:09:50.975455+0000","last_became_peered":"2024-09-14T11:09:50.975455+0000","last_unstale":"2024-09-14T11:53:57.398087+0000","last_undegraded":"2024-09-14T11:53:57.398087+0000","last_fullsized":"2024-09-14T11:53:57.398087+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:53.261559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16336,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":219,"num_read_kb":325,"num_write":124,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"264'773","reported_seq":2371,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:21.345870+0000","last_change":"2024-09-14T11:54:21.345870+0000","last_active":"2024-09-14T11:54:21.345870+0000","last_peered":"2024-09-14T11:54:21.345870+0000","last_clean":"2024-09-14T11:54:21.345870+0000","last_became_active":"2024-09-14T11:09:53.013805+0000","last_became_peered":"2024-09-14T11:09:53.013805+0000","last_unstale":"2024-09-14T11:54:21.345870+0000","last_undegraded":"2024-09-14T11:54:21.345870+0000","last_fullsized":"2024-09-14T11:54:21.345870+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'773","last_scrub_stamp":"2024-09-14T11:54:21.345641+0000","last_deep_scrub":"264'773","last_deep_scrub_stamp":"2024-09-14T11:54:21.345641+0000","last_clean_scrub_stamp":"2024-09-14T11:54:21.345641+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:00.678060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"264'151","reported_seq":656,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:27.197059+0000","last_change":"2024-09-14T11:09:55.027376+0000","last_active":"2024-09-14T11:52:27.197059+0000","last_peered":"2024-09-14T11:52:27.197059+0000","last_clean":"2024-09-14T11:52:27.197059+0000","last_became_active":"2024-09-14T11:09:55.026656+0000","last_became_peered":"2024-09-14T11:09:55.026656+0000","last_unstale":"2024-09-14T11:52:27.197059+0000","last_undegraded":"2024-09-14T11:52:27.197059+0000","last_fullsized":"2024-09-14T11:52:27.197059+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:05.576224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1884,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":197,"num_read_kb":178,"num_write":396,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"264'509","reported_seq":2091,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.383975+0000","last_change":"2024-09-14T11:54:09.383975+0000","last_active":"2024-09-14T11:54:09.383975+0000","last_peered":"2024-09-14T11:54:09.383975+0000","last_clean":"2024-09-14T11:54:09.383975+0000","last_became_active":"2024-09-14T11:09:46.949867+0000","last_became_peered":"2024-09-14T11:09:46.949867+0000","last_unstale":"2024-09-14T11:54:09.383975+0000","last_undegraded":"2024-09-14T11:54:09.383975+0000","last_fullsized":"2024-09-14T11:54:09.383975+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'509","last_scrub_stamp":"2024-09-14T11:54:09.383770+0000","last_deep_scrub":"264'509","last_deep_scrub_stamp":"2024-09-14T11:54:09.383770+0000","last_clean_scrub_stamp":"2024-09-14T11:54:09.383770+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:39.270981+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2605,"num_read_kb":2418,"num_write":602,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"264'274","reported_seq":970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.730759+0000","last_change":"2024-09-14T11:54:07.730759+0000","last_active":"2024-09-14T11:54:07.730759+0000","last_peered":"2024-09-14T11:54:07.730759+0000","last_clean":"2024-09-14T11:54:07.730759+0000","last_became_active":"2024-09-14T11:09:45.207969+0000","last_became_peered":"2024-09-14T11:09:45.207969+0000","last_unstale":"2024-09-14T11:54:07.730759+0000","last_undegraded":"2024-09-14T11:54:07.730759+0000","last_fullsized":"2024-09-14T11:54:07.730759+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'274","last_scrub_stamp":"2024-09-14T11:54:07.730568+0000","last_deep_scrub":"264'274","last_deep_scrub_stamp":"2024-09-14T11:54:07.730568+0000","last_clean_scrub_stamp":"2024-09-14T11:54:07.730568+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:51.886568+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":716,"num_read_kb":90988,"num_write":1212,"num_write_kb":64456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"264'4","reported_seq":1465,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:16.581905+0000","last_change":"2024-09-14T11:54:16.581905+0000","last_active":"2024-09-14T11:54:16.581905+0000","last_peered":"2024-09-14T11:54:16.581905+0000","last_clean":"2024-09-14T11:54:16.581905+0000","last_became_active":"2024-09-14T11:09:48.961946+0000","last_became_peered":"2024-09-14T11:09:48.961946+0000","last_unstale":"2024-09-14T11:54:16.581905+0000","last_undegraded":"2024-09-14T11:54:16.581905+0000","last_fullsized":"2024-09-14T11:54:16.581905+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T11:54:16.581705+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T11:54:16.581705+0000","last_clean_scrub_stamp":"2024-09-14T11:54:16.581705+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:55.935557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":958,"num_read_kb":958,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"264'87","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.636698+0000","last_change":"2024-09-14T11:54:22.636698+0000","last_active":"2024-09-14T11:54:22.636698+0000","last_peered":"2024-09-14T11:54:22.636698+0000","last_clean":"2024-09-14T11:54:22.636698+0000","last_became_active":"2024-09-14T11:09:50.997281+0000","last_became_peered":"2024-09-14T11:09:50.997281+0000","last_unstale":"2024-09-14T11:54:22.636698+0000","last_undegraded":"2024-09-14T11:54:22.636698+0000","last_fullsized":"2024-09-14T11:54:22.636698+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'87","last_scrub_stamp":"2024-09-14T11:54:22.636343+0000","last_deep_scrub":"264'87","last_deep_scrub_stamp":"2024-09-14T11:54:22.636343+0000","last_clean_scrub_stamp":"2024-09-14T11:54:22.636343+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:32.101718+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"264'802","reported_seq":4462,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.126548+0000","last_change":"2024-09-14T11:09:53.012817+0000","last_active":"2024-09-14T11:53:57.126548+0000","last_peered":"2024-09-14T11:53:57.126548+0000","last_clean":"2024-09-14T11:53:57.126548+0000","last_became_active":"2024-09-14T11:09:53.010631+0000","last_became_peered":"2024-09-14T11:09:53.010631+0000","last_unstale":"2024-09-14T11:53:57.126548+0000","last_undegraded":"2024-09-14T11:53:57.126548+0000","last_fullsized":"2024-09-14T11:53:57.126548+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:56.772893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"264'178","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:07.609486+0000","last_change":"2024-09-14T11:09:55.011221+0000","last_active":"2024-09-14T11:52:07.609486+0000","last_peered":"2024-09-14T11:52:07.609486+0000","last_clean":"2024-09-14T11:52:07.609486+0000","last_became_active":"2024-09-14T11:09:55.010215+0000","last_became_peered":"2024-09-14T11:09:55.010215+0000","last_unstale":"2024-09-14T11:52:07.609486+0000","last_undegraded":"2024-09-14T11:52:07.609486+0000","last_fullsized":"2024-09-14T11:52:07.609486+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:33.289296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":123,"num_read_kb":114,"num_write":415,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"264'412","reported_seq":1895,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.272327+0000","last_change":"2024-09-14T11:54:09.272327+0000","last_active":"2024-09-14T11:54:09.272327+0000","last_peered":"2024-09-14T11:54:09.272327+0000","last_clean":"2024-09-14T11:54:09.272327+0000","last_became_active":"2024-09-14T11:09:46.966876+0000","last_became_peered":"2024-09-14T11:09:46.966876+0000","last_unstale":"2024-09-14T11:54:09.272327+0000","last_undegraded":"2024-09-14T11:54:09.272327+0000","last_fullsized":"2024-09-14T11:54:09.272327+0000","mapping_epoch":25,"log_start":"264'401","ondisk_log_start":"264'401","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'412","last_scrub_stamp":"2024-09-14T11:54:09.272144+0000","last_deep_scrub":"264'412","last_deep_scrub_stamp":"2024-09-14T11:54:09.272144+0000","last_clean_scrub_stamp":"2024-09-14T11:54:09.272144+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":401,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:51.396054+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2150,"num_read_kb":2036,"num_write":469,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"264'269","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.715548+0000","last_change":"2024-09-14T11:54:06.715548+0000","last_active":"2024-09-14T11:54:06.715548+0000","last_peered":"2024-09-14T11:54:06.715548+0000","last_clean":"2024-09-14T11:54:06.715548+0000","last_became_active":"2024-09-14T11:09:45.200039+0000","last_became_peered":"2024-09-14T11:09:45.200039+0000","last_unstale":"2024-09-14T11:54:06.715548+0000","last_undegraded":"2024-09-14T11:54:06.715548+0000","last_fullsized":"2024-09-14T11:54:06.715548+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'269","last_scrub_stamp":"2024-09-14T11:54:06.715283+0000","last_deep_scrub":"264'269","last_deep_scrub_stamp":"2024-09-14T11:54:06.715283+0000","last_clean_scrub_stamp":"2024-09-14T11:54:06.715283+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:06.417831+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":994,"num_read_kb":201012,"num_write":1230,"num_write_kb":37853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:19.309093+0000","last_change":"2024-09-14T11:09:48.973340+0000","last_active":"2024-09-14T11:50:19.309093+0000","last_peered":"2024-09-14T11:50:19.309093+0000","last_clean":"2024-09-14T11:50:19.309093+0000","last_became_active":"2024-09-14T11:09:48.972957+0000","last_became_peered":"2024-09-14T11:09:48.972957+0000","last_unstale":"2024-09-14T11:50:19.309093+0000","last_undegraded":"2024-09-14T11:50:19.309093+0000","last_fullsized":"2024-09-14T11:50:19.309093+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:18.626799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"264'204","reported_seq":815,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:21.644031+0000","last_change":"2024-09-14T11:54:21.644031+0000","last_active":"2024-09-14T11:54:21.644031+0000","last_peered":"2024-09-14T11:54:21.644031+0000","last_clean":"2024-09-14T11:54:21.644031+0000","last_became_active":"2024-09-14T11:09:50.991938+0000","last_became_peered":"2024-09-14T11:09:50.991938+0000","last_unstale":"2024-09-14T11:54:21.644031+0000","last_undegraded":"2024-09-14T11:54:21.644031+0000","last_fullsized":"2024-09-14T11:54:21.644031+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'204","last_scrub_stamp":"2024-09-14T11:54:21.643805+0000","last_deep_scrub":"264'204","last_deep_scrub_stamp":"2024-09-14T11:54:21.643805+0000","last_clean_scrub_stamp":"2024-09-14T11:54:21.643805+0000","objects_scrubbed":8,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:27.053278+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11553,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":263,"num_read_kb":344,"num_write":148,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:23.317788+0000","last_change":"2024-09-14T11:54:23.317788+0000","last_active":"2024-09-14T11:54:23.317788+0000","last_peered":"2024-09-14T11:54:23.317788+0000","last_clean":"2024-09-14T11:54:23.317788+0000","last_became_active":"2024-09-14T11:09:53.006350+0000","last_became_peered":"2024-09-14T11:09:53.006350+0000","last_unstale":"2024-09-14T11:54:23.317788+0000","last_undegraded":"2024-09-14T11:54:23.317788+0000","last_fullsized":"2024-09-14T11:54:23.317788+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:23.317603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:23.317603+0000","last_clean_scrub_stamp":"2024-09-14T11:54:23.317603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:23.634009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"264'117","reported_seq":602,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.069500+0000","last_change":"2024-09-14T11:09:55.013765+0000","last_active":"2024-09-14T11:52:29.069500+0000","last_peered":"2024-09-14T11:52:29.069500+0000","last_clean":"2024-09-14T11:52:29.069500+0000","last_became_active":"2024-09-14T11:09:55.012954+0000","last_became_peered":"2024-09-14T11:09:55.012954+0000","last_unstale":"2024-09-14T11:52:29.069500+0000","last_undegraded":"2024-09-14T11:52:29.069500+0000","last_fullsized":"2024-09-14T11:52:29.069500+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:40.472347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":106,"num_write":256,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"264'405","reported_seq":2080,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.883536+0000","last_change":"2024-09-14T11:54:19.883536+0000","last_active":"2024-09-14T11:54:19.883536+0000","last_peered":"2024-09-14T11:54:19.883536+0000","last_clean":"2024-09-14T11:54:19.883536+0000","last_became_active":"2024-09-14T11:09:46.960461+0000","last_became_peered":"2024-09-14T11:09:46.960461+0000","last_unstale":"2024-09-14T11:54:19.883536+0000","last_undegraded":"2024-09-14T11:54:19.883536+0000","last_fullsized":"2024-09-14T11:54:19.883536+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'405","last_scrub_stamp":"2024-09-14T11:54:19.883237+0000","last_deep_scrub":"264'405","last_deep_scrub_stamp":"2024-09-14T11:54:19.883237+0000","last_clean_scrub_stamp":"2024-09-14T11:54:19.883237+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:36.272832+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2438,"num_read_kb":2343,"num_write":447,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2036,"num_omap_keys":8,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"264'74","reported_seq":620,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:01.651107+0000","last_change":"2024-09-14T11:54:01.651107+0000","last_active":"2024-09-14T11:54:01.651107+0000","last_peered":"2024-09-14T11:54:01.651107+0000","last_clean":"2024-09-14T11:54:01.651107+0000","last_became_active":"2024-09-14T11:09:30.309524+0000","last_became_peered":"2024-09-14T11:09:30.309524+0000","last_unstale":"2024-09-14T11:54:01.651107+0000","last_undegraded":"2024-09-14T11:54:01.651107+0000","last_fullsized":"2024-09-14T11:54:01.651107+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'74","last_scrub_stamp":"2024-09-14T11:54:01.650935+0000","last_deep_scrub":"264'74","last_deep_scrub_stamp":"2024-09-14T11:54:01.650935+0000","last_clean_scrub_stamp":"2024-09-14T11:54:01.650935+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:53.062420+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"264'2","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.837336+0000","last_change":"2024-09-14T11:54:04.837336+0000","last_active":"2024-09-14T11:54:04.837336+0000","last_peered":"2024-09-14T11:54:04.837336+0000","last_clean":"2024-09-14T11:54:04.837336+0000","last_became_active":"2024-09-14T11:09:36.264768+0000","last_became_peered":"2024-09-14T11:09:36.264768+0000","last_unstale":"2024-09-14T11:54:04.837336+0000","last_undegraded":"2024-09-14T11:54:04.837336+0000","last_fullsized":"2024-09-14T11:54:04.837336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:04.837116+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:04.837116+0000","last_clean_scrub_stamp":"2024-09-14T11:54:04.837116+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:31.345731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00092723999999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"264'271","reported_seq":1086,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:03.714182+0000","last_change":"2024-09-14T11:54:03.714182+0000","last_active":"2024-09-14T11:54:03.714182+0000","last_peered":"2024-09-14T11:54:03.714182+0000","last_clean":"2024-09-14T11:54:03.714182+0000","last_became_active":"2024-09-14T11:09:45.193131+0000","last_became_peered":"2024-09-14T11:09:45.193131+0000","last_unstale":"2024-09-14T11:54:03.714182+0000","last_undegraded":"2024-09-14T11:54:03.714182+0000","last_fullsized":"2024-09-14T11:54:03.714182+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'271","last_scrub_stamp":"2024-09-14T11:54:03.713998+0000","last_deep_scrub":"264'271","last_deep_scrub_stamp":"2024-09-14T11:54:03.713998+0000","last_clean_scrub_stamp":"2024-09-14T11:54:03.713998+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:24.565125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1127,"num_read_kb":141056,"num_write":1044,"num_write_kb":44809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.830566+0000","last_change":"2024-09-14T11:54:20.830566+0000","last_active":"2024-09-14T11:54:20.830566+0000","last_peered":"2024-09-14T11:54:20.830566+0000","last_clean":"2024-09-14T11:54:20.830566+0000","last_became_active":"2024-09-14T11:09:48.970541+0000","last_became_peered":"2024-09-14T11:09:48.970541+0000","last_unstale":"2024-09-14T11:54:20.830566+0000","last_undegraded":"2024-09-14T11:54:20.830566+0000","last_fullsized":"2024-09-14T11:54:20.830566+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:20.830380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:20.830380+0000","last_clean_scrub_stamp":"2024-09-14T11:54:20.830380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:49.298720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"264'299","reported_seq":995,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.354937+0000","last_change":"2024-09-14T11:09:50.994191+0000","last_active":"2024-09-14T11:53:57.354937+0000","last_peered":"2024-09-14T11:53:57.354937+0000","last_clean":"2024-09-14T11:53:57.354937+0000","last_became_active":"2024-09-14T11:09:50.993231+0000","last_became_peered":"2024-09-14T11:09:50.993231+0000","last_unstale":"2024-09-14T11:53:57.354937+0000","last_undegraded":"2024-09-14T11:53:57.354937+0000","last_fullsized":"2024-09-14T11:53:57.354937+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:10.493181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22194,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":549,"num_read_kb":706,"num_write":484,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.126495+0000","last_change":"2024-09-14T11:09:53.006544+0000","last_active":"2024-09-14T11:51:03.126495+0000","last_peered":"2024-09-14T11:51:03.126495+0000","last_clean":"2024-09-14T11:51:03.126495+0000","last_became_active":"2024-09-14T11:09:53.004338+0000","last_became_peered":"2024-09-14T11:09:53.004338+0000","last_unstale":"2024-09-14T11:51:03.126495+0000","last_undegraded":"2024-09-14T11:51:03.126495+0000","last_fullsized":"2024-09-14T11:51:03.126495+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:24.238705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"264'239","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.880952+0000","last_change":"2024-09-14T11:54:22.880952+0000","last_active":"2024-09-14T11:54:22.880952+0000","last_peered":"2024-09-14T11:54:22.880952+0000","last_clean":"2024-09-14T11:54:22.880952+0000","last_became_active":"2024-09-14T11:09:55.015569+0000","last_became_peered":"2024-09-14T11:09:55.015569+0000","last_unstale":"2024-09-14T11:54:22.880952+0000","last_undegraded":"2024-09-14T11:54:22.880952+0000","last_fullsized":"2024-09-14T11:54:22.880952+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'239","last_scrub_stamp":"2024-09-14T11:54:22.880736+0000","last_deep_scrub":"264'239","last_deep_scrub_stamp":"2024-09-14T11:54:22.880736+0000","last_clean_scrub_stamp":"2024-09-14T11:54:22.880736+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:24.816809+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1424,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":528,"num_read_kb":505,"num_write":525,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"264'794","reported_seq":2257,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.038964+0000","last_change":"2024-09-14T11:54:17.038964+0000","last_active":"2024-09-14T11:54:17.038964+0000","last_peered":"2024-09-14T11:54:17.038964+0000","last_clean":"2024-09-14T11:54:17.038964+0000","last_became_active":"2024-09-14T11:09:46.974517+0000","last_became_peered":"2024-09-14T11:09:46.974517+0000","last_unstale":"2024-09-14T11:54:17.038964+0000","last_undegraded":"2024-09-14T11:54:17.038964+0000","last_fullsized":"2024-09-14T11:54:17.038964+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'794","last_scrub_stamp":"2024-09-14T11:54:17.038783+0000","last_deep_scrub":"264'794","last_deep_scrub_stamp":"2024-09-14T11:54:17.038783+0000","last_clean_scrub_stamp":"2024-09-14T11:54:17.038783+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:13.442249+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3876,"num_read_kb":3470,"num_write":1072,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:03.793921+0000","last_change":"2024-09-14T11:54:03.793921+0000","last_active":"2024-09-14T11:54:03.793921+0000","last_peered":"2024-09-14T11:54:03.793921+0000","last_clean":"2024-09-14T11:54:03.793921+0000","last_became_active":"2024-09-14T11:09:36.110037+0000","last_became_peered":"2024-09-14T11:09:36.110037+0000","last_unstale":"2024-09-14T11:54:03.793921+0000","last_undegraded":"2024-09-14T11:54:03.793921+0000","last_fullsized":"2024-09-14T11:54:03.793921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:03.793825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:03.793825+0000","last_clean_scrub_stamp":"2024-09-14T11:54:03.793825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:58.071609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001043441,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"264'225","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.624617+0000","last_change":"2024-09-14T11:54:05.624617+0000","last_active":"2024-09-14T11:54:05.624617+0000","last_peered":"2024-09-14T11:54:05.624617+0000","last_clean":"2024-09-14T11:54:05.624617+0000","last_became_active":"2024-09-14T11:09:45.211579+0000","last_became_peered":"2024-09-14T11:09:45.211579+0000","last_unstale":"2024-09-14T11:54:05.624617+0000","last_undegraded":"2024-09-14T11:54:05.624617+0000","last_fullsized":"2024-09-14T11:54:05.624617+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'225","last_scrub_stamp":"2024-09-14T11:54:05.624423+0000","last_deep_scrub":"264'225","last_deep_scrub_stamp":"2024-09-14T11:54:05.624423+0000","last_clean_scrub_stamp":"2024-09-14T11:54:05.624423+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:48.379755+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":626,"num_read_kb":58466,"num_write":936,"num_write_kb":31030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:59.320409+0000","last_change":"2024-09-14T11:09:48.970703+0000","last_active":"2024-09-14T11:50:59.320409+0000","last_peered":"2024-09-14T11:50:59.320409+0000","last_clean":"2024-09-14T11:50:59.320409+0000","last_became_active":"2024-09-14T11:09:48.970218+0000","last_became_peered":"2024-09-14T11:09:48.970218+0000","last_unstale":"2024-09-14T11:50:59.320409+0000","last_undegraded":"2024-09-14T11:50:59.320409+0000","last_fullsized":"2024-09-14T11:50:59.320409+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:45.534332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"264'872","reported_seq":2339,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.381488+0000","last_change":"2024-09-14T11:54:20.381488+0000","last_active":"2024-09-14T11:54:20.381488+0000","last_peered":"2024-09-14T11:54:20.381488+0000","last_clean":"2024-09-14T11:54:20.381488+0000","last_became_active":"2024-09-14T11:09:50.996406+0000","last_became_peered":"2024-09-14T11:09:50.996406+0000","last_unstale":"2024-09-14T11:54:20.381488+0000","last_undegraded":"2024-09-14T11:54:20.381488+0000","last_fullsized":"2024-09-14T11:54:20.381488+0000","mapping_epoch":29,"log_start":"264'800","ondisk_log_start":"264'800","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'872","last_scrub_stamp":"2024-09-14T11:54:20.381285+0000","last_deep_scrub":"264'872","last_deep_scrub_stamp":"2024-09-14T11:54:20.381285+0000","last_clean_scrub_stamp":"2024-09-14T11:54:20.381285+0000","objects_scrubbed":11,"log_size":72,"log_dups_size":800,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:34.362640+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34005,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1184,"num_read_kb":1407,"num_write":288,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:39.330945+0000","last_change":"2024-09-14T11:09:53.022628+0000","last_active":"2024-09-14T11:51:39.330945+0000","last_peered":"2024-09-14T11:51:39.330945+0000","last_clean":"2024-09-14T11:51:39.330945+0000","last_became_active":"2024-09-14T11:09:53.022006+0000","last_became_peered":"2024-09-14T11:09:53.022006+0000","last_unstale":"2024-09-14T11:51:39.330945+0000","last_undegraded":"2024-09-14T11:51:39.330945+0000","last_fullsized":"2024-09-14T11:51:39.330945+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:49.069626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"264'217","reported_seq":744,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.027091+0000","last_change":"2024-09-14T11:09:55.024709+0000","last_active":"2024-09-14T11:52:29.027091+0000","last_peered":"2024-09-14T11:52:29.027091+0000","last_clean":"2024-09-14T11:52:29.027091+0000","last_became_active":"2024-09-14T11:09:55.023966+0000","last_became_peered":"2024-09-14T11:09:55.023966+0000","last_unstale":"2024-09-14T11:52:29.027091+0000","last_undegraded":"2024-09-14T11:52:29.027091+0000","last_fullsized":"2024-09-14T11:52:29.027091+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:34.668812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":224,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":295,"num_read_kb":259,"num_write":448,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"264'467","reported_seq":2179,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:12.580698+0000","last_change":"2024-09-14T11:54:12.580698+0000","last_active":"2024-09-14T11:54:12.580698+0000","last_peered":"2024-09-14T11:54:12.580698+0000","last_clean":"2024-09-14T11:54:12.580698+0000","last_became_active":"2024-09-14T11:09:46.981472+0000","last_became_peered":"2024-09-14T11:09:46.981472+0000","last_unstale":"2024-09-14T11:54:12.580698+0000","last_undegraded":"2024-09-14T11:54:12.580698+0000","last_fullsized":"2024-09-14T11:54:12.580698+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'467","last_scrub_stamp":"2024-09-14T11:54:12.580519+0000","last_deep_scrub":"264'467","last_deep_scrub_stamp":"2024-09-14T11:54:12.580519+0000","last_clean_scrub_stamp":"2024-09-14T11:54:12.580519+0000","objects_scrubbed":3,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:18.230648+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2625,"num_read_kb":2493,"num_write":542,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":468,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":521,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.269223+0000","last_change":"2024-09-14T11:54:04.269223+0000","last_active":"2024-09-14T11:54:04.269223+0000","last_peered":"2024-09-14T11:54:04.269223+0000","last_clean":"2024-09-14T11:54:04.269223+0000","last_became_active":"2024-09-14T11:09:36.110778+0000","last_became_peered":"2024-09-14T11:09:36.110778+0000","last_unstale":"2024-09-14T11:54:04.269223+0000","last_undegraded":"2024-09-14T11:54:04.269223+0000","last_fullsized":"2024-09-14T11:54:04.269223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:04.269043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:04.269043+0000","last_clean_scrub_stamp":"2024-09-14T11:54:04.269043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:43.617127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001188634,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"264'181","reported_seq":786,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.103277+0000","last_change":"2024-09-14T11:54:11.103277+0000","last_active":"2024-09-14T11:54:11.103277+0000","last_peered":"2024-09-14T11:54:11.103277+0000","last_clean":"2024-09-14T11:54:11.103277+0000","last_became_active":"2024-09-14T11:09:45.214670+0000","last_became_peered":"2024-09-14T11:09:45.214670+0000","last_unstale":"2024-09-14T11:54:11.103277+0000","last_undegraded":"2024-09-14T11:54:11.103277+0000","last_fullsized":"2024-09-14T11:54:11.103277+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'181","last_scrub_stamp":"2024-09-14T11:54:11.103055+0000","last_deep_scrub":"264'181","last_deep_scrub_stamp":"2024-09-14T11:54:11.103055+0000","last_clean_scrub_stamp":"2024-09-14T11:54:11.103055+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:09.808494+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":427,"num_read_kb":11641,"num_write":795,"num_write_kb":32063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"264'2","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.410405+0000","last_change":"2024-09-14T11:54:17.410405+0000","last_active":"2024-09-14T11:54:17.410405+0000","last_peered":"2024-09-14T11:54:17.410405+0000","last_clean":"2024-09-14T11:54:17.410405+0000","last_became_active":"2024-09-14T11:09:48.968973+0000","last_became_peered":"2024-09-14T11:09:48.968973+0000","last_unstale":"2024-09-14T11:54:17.410405+0000","last_undegraded":"2024-09-14T11:54:17.410405+0000","last_fullsized":"2024-09-14T11:54:17.410405+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:17.410202+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:17.410202+0000","last_clean_scrub_stamp":"2024-09-14T11:54:17.410202+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:57.558922+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"264'243","reported_seq":1322,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.884841+0000","last_change":"2024-09-14T11:54:19.884841+0000","last_active":"2024-09-14T11:54:19.884841+0000","last_peered":"2024-09-14T11:54:19.884841+0000","last_clean":"2024-09-14T11:54:19.884841+0000","last_became_active":"2024-09-14T11:09:50.992589+0000","last_became_peered":"2024-09-14T11:09:50.992589+0000","last_unstale":"2024-09-14T11:54:19.884841+0000","last_undegraded":"2024-09-14T11:54:19.884841+0000","last_fullsized":"2024-09-14T11:54:19.884841+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'243","last_scrub_stamp":"2024-09-14T11:54:19.884635+0000","last_deep_scrub":"264'243","last_deep_scrub_stamp":"2024-09-14T11:54:19.884635+0000","last_clean_scrub_stamp":"2024-09-14T11:54:19.884635+0000","objects_scrubbed":9,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:08.377002+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":182,"num_read_kb":171,"num_write":149,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:33.127635+0000","last_change":"2024-09-14T11:09:53.008567+0000","last_active":"2024-09-14T11:51:33.127635+0000","last_peered":"2024-09-14T11:51:33.127635+0000","last_clean":"2024-09-14T11:51:33.127635+0000","last_became_active":"2024-09-14T11:09:53.007705+0000","last_became_peered":"2024-09-14T11:09:53.007705+0000","last_unstale":"2024-09-14T11:51:33.127635+0000","last_undegraded":"2024-09-14T11:51:33.127635+0000","last_fullsized":"2024-09-14T11:51:33.127635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:31.442222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"264'272","reported_seq":868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.845028+0000","last_change":"2024-09-14T11:09:55.014709+0000","last_active":"2024-09-14T11:52:29.845028+0000","last_peered":"2024-09-14T11:52:29.845028+0000","last_clean":"2024-09-14T11:52:29.845028+0000","last_became_active":"2024-09-14T11:09:55.013944+0000","last_became_peered":"2024-09-14T11:09:55.013944+0000","last_unstale":"2024-09-14T11:52:29.845028+0000","last_undegraded":"2024-09-14T11:52:29.845028+0000","last_fullsized":"2024-09-14T11:52:29.845028+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:31.373231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":495,"num_read_kb":519,"num_write":596,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"264'934","reported_seq":2826,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.609638+0000","last_change":"2024-09-14T11:54:11.609638+0000","last_active":"2024-09-14T11:54:11.609638+0000","last_peered":"2024-09-14T11:54:11.609638+0000","last_clean":"2024-09-14T11:54:11.609638+0000","last_became_active":"2024-09-14T11:09:46.982027+0000","last_became_peered":"2024-09-14T11:09:46.982027+0000","last_unstale":"2024-09-14T11:54:11.609638+0000","last_undegraded":"2024-09-14T11:54:11.609638+0000","last_fullsized":"2024-09-14T11:54:11.609638+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'934","last_scrub_stamp":"2024-09-14T11:54:11.609414+0000","last_deep_scrub":"264'934","last_deep_scrub_stamp":"2024-09-14T11:54:11.609414+0000","last_clean_scrub_stamp":"2024-09-14T11:54:11.609414+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":900,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:10.281778+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4697,"num_read_kb":4271,"num_write":1214,"num_write_kb":435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3500,"num_omap_keys":14,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"264'3","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:02.833788+0000","last_change":"2024-09-14T11:54:02.833788+0000","last_active":"2024-09-14T11:54:02.833788+0000","last_peered":"2024-09-14T11:54:02.833788+0000","last_clean":"2024-09-14T11:54:02.833788+0000","last_became_active":"2024-09-14T11:09:36.887391+0000","last_became_peered":"2024-09-14T11:09:36.887391+0000","last_unstale":"2024-09-14T11:54:02.833788+0000","last_undegraded":"2024-09-14T11:54:02.833788+0000","last_fullsized":"2024-09-14T11:54:02.833788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:54:02.833629+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:54:02.833629+0000","last_clean_scrub_stamp":"2024-09-14T11:54:02.833629+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:54.259925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0023357849999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"264'265","reported_seq":918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.668795+0000","last_change":"2024-09-14T11:54:06.668795+0000","last_active":"2024-09-14T11:54:06.668795+0000","last_peered":"2024-09-14T11:54:06.668795+0000","last_clean":"2024-09-14T11:54:06.668795+0000","last_became_active":"2024-09-14T11:09:45.206492+0000","last_became_peered":"2024-09-14T11:09:45.206492+0000","last_unstale":"2024-09-14T11:54:06.668795+0000","last_undegraded":"2024-09-14T11:54:06.668795+0000","last_fullsized":"2024-09-14T11:54:06.668795+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'265","last_scrub_stamp":"2024-09-14T11:54:06.668580+0000","last_deep_scrub":"264'265","last_deep_scrub_stamp":"2024-09-14T11:54:06.668580+0000","last_clean_scrub_stamp":"2024-09-14T11:54:06.668580+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:06.267313+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":656,"num_read_kb":889,"num_write":1198,"num_write_kb":16465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:16.415674+0000","last_change":"2024-09-14T11:54:16.415674+0000","last_active":"2024-09-14T11:54:16.415674+0000","last_peered":"2024-09-14T11:54:16.415674+0000","last_clean":"2024-09-14T11:54:16.415674+0000","last_became_active":"2024-09-14T11:09:48.976315+0000","last_became_peered":"2024-09-14T11:09:48.976315+0000","last_unstale":"2024-09-14T11:54:16.415674+0000","last_undegraded":"2024-09-14T11:54:16.415674+0000","last_fullsized":"2024-09-14T11:54:16.415674+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:16.415478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:16.415478+0000","last_clean_scrub_stamp":"2024-09-14T11:54:16.415478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:28.319046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"264'121","reported_seq":658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:13.156135+0000","last_change":"2024-09-14T11:09:50.983682+0000","last_active":"2024-09-14T11:53:13.156135+0000","last_peered":"2024-09-14T11:53:13.156135+0000","last_clean":"2024-09-14T11:53:13.156135+0000","last_became_active":"2024-09-14T11:09:50.983126+0000","last_became_peered":"2024-09-14T11:09:50.983126+0000","last_unstale":"2024-09-14T11:53:13.156135+0000","last_undegraded":"2024-09-14T11:53:13.156135+0000","last_fullsized":"2024-09-14T11:53:13.156135+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:01.407533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:04.321826+0000","last_change":"2024-09-14T11:09:53.015879+0000","last_active":"2024-09-14T11:51:04.321826+0000","last_peered":"2024-09-14T11:51:04.321826+0000","last_clean":"2024-09-14T11:51:04.321826+0000","last_became_active":"2024-09-14T11:09:53.015100+0000","last_became_peered":"2024-09-14T11:09:53.015100+0000","last_unstale":"2024-09-14T11:51:04.321826+0000","last_undegraded":"2024-09-14T11:51:04.321826+0000","last_fullsized":"2024-09-14T11:51:04.321826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:14:31.622686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"264'126","reported_seq":676,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:27.192089+0000","last_change":"2024-09-14T11:09:55.025662+0000","last_active":"2024-09-14T11:52:27.192089+0000","last_peered":"2024-09-14T11:52:27.192089+0000","last_clean":"2024-09-14T11:52:27.192089+0000","last_became_active":"2024-09-14T11:09:55.025030+0000","last_became_peered":"2024-09-14T11:09:55.025030+0000","last_unstale":"2024-09-14T11:52:27.192089+0000","last_undegraded":"2024-09-14T11:52:27.192089+0000","last_fullsized":"2024-09-14T11:52:27.192089+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:47.329558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":244,"num_read_kb":234,"num_write":307,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"264'432","reported_seq":1982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.590727+0000","last_change":"2024-09-14T11:54:13.590727+0000","last_active":"2024-09-14T11:54:13.590727+0000","last_peered":"2024-09-14T11:54:13.590727+0000","last_clean":"2024-09-14T11:54:13.590727+0000","last_became_active":"2024-09-14T11:09:46.981578+0000","last_became_peered":"2024-09-14T11:09:46.981578+0000","last_unstale":"2024-09-14T11:54:13.590727+0000","last_undegraded":"2024-09-14T11:54:13.590727+0000","last_fullsized":"2024-09-14T11:54:13.590727+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'432","last_scrub_stamp":"2024-09-14T11:54:13.590489+0000","last_deep_scrub":"264'432","last_deep_scrub_stamp":"2024-09-14T11:54:13.590489+0000","last_clean_scrub_stamp":"2024-09-14T11:54:13.590489+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:33.384996+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2336,"num_read_kb":2209,"num_write":501,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"264'246","reported_seq":892,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.337591+0000","last_change":"2024-09-14T11:54:06.337591+0000","last_active":"2024-09-14T11:54:06.337591+0000","last_peered":"2024-09-14T11:54:06.337591+0000","last_clean":"2024-09-14T11:54:06.337591+0000","last_became_active":"2024-09-14T11:09:45.216168+0000","last_became_peered":"2024-09-14T11:09:45.216168+0000","last_unstale":"2024-09-14T11:54:06.337591+0000","last_undegraded":"2024-09-14T11:54:06.337591+0000","last_fullsized":"2024-09-14T11:54:06.337591+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'246","last_scrub_stamp":"2024-09-14T11:54:06.337308+0000","last_deep_scrub":"264'246","last_deep_scrub_stamp":"2024-09-14T11:54:06.337308+0000","last_clean_scrub_stamp":"2024-09-14T11:54:06.337308+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:05.110637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":603,"num_read_kb":12400,"num_write":1048,"num_write_kb":24779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.160781+0000","last_change":"2024-09-14T11:54:04.160781+0000","last_active":"2024-09-14T11:54:04.160781+0000","last_peered":"2024-09-14T11:54:04.160781+0000","last_clean":"2024-09-14T11:54:04.160781+0000","last_became_active":"2024-09-14T11:09:36.887411+0000","last_became_peered":"2024-09-14T11:09:36.887411+0000","last_unstale":"2024-09-14T11:54:04.160781+0000","last_undegraded":"2024-09-14T11:54:04.160781+0000","last_fullsized":"2024-09-14T11:54:04.160781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:04.160581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:04.160581+0000","last_clean_scrub_stamp":"2024-09-14T11:54:04.160581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:54.717604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001210341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.809935+0000","last_change":"2024-09-14T11:54:20.809935+0000","last_active":"2024-09-14T11:54:20.809935+0000","last_peered":"2024-09-14T11:54:20.809935+0000","last_clean":"2024-09-14T11:54:20.809935+0000","last_became_active":"2024-09-14T11:09:48.969262+0000","last_became_peered":"2024-09-14T11:09:48.969262+0000","last_unstale":"2024-09-14T11:54:20.809935+0000","last_undegraded":"2024-09-14T11:54:20.809935+0000","last_fullsized":"2024-09-14T11:54:20.809935+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:20.809747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:20.809747+0000","last_clean_scrub_stamp":"2024-09-14T11:54:20.809747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:07.903941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"264'289","reported_seq":952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.417729+0000","last_change":"2024-09-14T11:54:18.417729+0000","last_active":"2024-09-14T11:54:18.417729+0000","last_peered":"2024-09-14T11:54:18.417729+0000","last_clean":"2024-09-14T11:54:18.417729+0000","last_became_active":"2024-09-14T11:09:50.991958+0000","last_became_peered":"2024-09-14T11:09:50.991958+0000","last_unstale":"2024-09-14T11:54:18.417729+0000","last_undegraded":"2024-09-14T11:54:18.417729+0000","last_fullsized":"2024-09-14T11:54:18.417729+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'289","last_scrub_stamp":"2024-09-14T11:54:18.417492+0000","last_deep_scrub":"264'289","last_deep_scrub_stamp":"2024-09-14T11:54:18.417492+0000","last_clean_scrub_stamp":"2024-09-14T11:54:18.417492+0000","objects_scrubbed":10,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:27.379177+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26179,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1035,"num_read_kb":1185,"num_write":1534,"num_write_kb":1392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":535828,"num_omap_keys":1208,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.328687+0000","last_change":"2024-09-14T11:54:18.328687+0000","last_active":"2024-09-14T11:54:18.328687+0000","last_peered":"2024-09-14T11:54:18.328687+0000","last_clean":"2024-09-14T11:54:18.328687+0000","last_became_active":"2024-09-14T11:09:53.001945+0000","last_became_peered":"2024-09-14T11:09:53.001945+0000","last_unstale":"2024-09-14T11:54:18.328687+0000","last_undegraded":"2024-09-14T11:54:18.328687+0000","last_fullsized":"2024-09-14T11:54:18.328687+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:18.328403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:18.328403+0000","last_clean_scrub_stamp":"2024-09-14T11:54:18.328403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:12.397430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"264'176","reported_seq":711,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:08.421243+0000","last_change":"2024-09-14T11:09:55.019726+0000","last_active":"2024-09-14T11:52:08.421243+0000","last_peered":"2024-09-14T11:52:08.421243+0000","last_clean":"2024-09-14T11:52:08.421243+0000","last_became_active":"2024-09-14T11:09:55.019043+0000","last_became_peered":"2024-09-14T11:09:55.019043+0000","last_unstale":"2024-09-14T11:52:08.421243+0000","last_undegraded":"2024-09-14T11:52:08.421243+0000","last_fullsized":"2024-09-14T11:52:08.421243+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:33.587845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":311,"num_read_kb":271,"num_write":434,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"264'394","reported_seq":1919,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.629013+0000","last_change":"2024-09-14T11:54:08.629013+0000","last_active":"2024-09-14T11:54:08.629013+0000","last_peered":"2024-09-14T11:54:08.629013+0000","last_clean":"2024-09-14T11:54:08.629013+0000","last_became_active":"2024-09-14T11:09:46.979673+0000","last_became_peered":"2024-09-14T11:09:46.979673+0000","last_unstale":"2024-09-14T11:54:08.629013+0000","last_undegraded":"2024-09-14T11:54:08.629013+0000","last_fullsized":"2024-09-14T11:54:08.629013+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'394","last_scrub_stamp":"2024-09-14T11:54:08.628827+0000","last_deep_scrub":"264'394","last_deep_scrub_stamp":"2024-09-14T11:54:08.628827+0000","last_clean_scrub_stamp":"2024-09-14T11:54:08.628827+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:41.485918+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2181,"num_read_kb":2077,"num_write":440,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":892,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"264'177","reported_seq":756,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:03.638455+0000","last_change":"2024-09-14T11:54:03.638455+0000","last_active":"2024-09-14T11:54:03.638455+0000","last_peered":"2024-09-14T11:54:03.638455+0000","last_clean":"2024-09-14T11:54:03.638455+0000","last_became_active":"2024-09-14T11:09:45.220512+0000","last_became_peered":"2024-09-14T11:09:45.220512+0000","last_unstale":"2024-09-14T11:54:03.638455+0000","last_undegraded":"2024-09-14T11:54:03.638455+0000","last_fullsized":"2024-09-14T11:54:03.638455+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-09-14T11:54:03.638201+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-09-14T11:54:03.638201+0000","last_clean_scrub_stamp":"2024-09-14T11:54:03.638201+0000","objects_scrubbed":6,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:08.150074+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655861,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":337,"num_read_kb":1928,"num_write":799,"num_write_kb":32938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.796853+0000","last_change":"2024-09-14T11:54:05.796853+0000","last_active":"2024-09-14T11:54:05.796853+0000","last_peered":"2024-09-14T11:54:05.796853+0000","last_clean":"2024-09-14T11:54:05.796853+0000","last_became_active":"2024-09-14T11:09:36.110624+0000","last_became_peered":"2024-09-14T11:09:36.110624+0000","last_unstale":"2024-09-14T11:54:05.796853+0000","last_undegraded":"2024-09-14T11:54:05.796853+0000","last_fullsized":"2024-09-14T11:54:05.796853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:05.796663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:05.796663+0000","last_clean_scrub_stamp":"2024-09-14T11:54:05.796663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:14.358427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.002569127,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:16.834905+0000","last_change":"2024-09-14T11:54:16.834905+0000","last_active":"2024-09-14T11:54:16.834905+0000","last_peered":"2024-09-14T11:54:16.834905+0000","last_clean":"2024-09-14T11:54:16.834905+0000","last_became_active":"2024-09-14T11:09:48.968130+0000","last_became_peered":"2024-09-14T11:09:48.968130+0000","last_unstale":"2024-09-14T11:54:16.834905+0000","last_undegraded":"2024-09-14T11:54:16.834905+0000","last_fullsized":"2024-09-14T11:54:16.834905+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:16.834719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:16.834719+0000","last_clean_scrub_stamp":"2024-09-14T11:54:16.834719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:03.396931+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"264'164","reported_seq":731,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:21.634619+0000","last_change":"2024-09-14T11:54:21.634619+0000","last_active":"2024-09-14T11:54:21.634619+0000","last_peered":"2024-09-14T11:54:21.634619+0000","last_clean":"2024-09-14T11:54:21.634619+0000","last_became_active":"2024-09-14T11:09:50.997665+0000","last_became_peered":"2024-09-14T11:09:50.997665+0000","last_unstale":"2024-09-14T11:54:21.634619+0000","last_undegraded":"2024-09-14T11:54:21.634619+0000","last_fullsized":"2024-09-14T11:54:21.634619+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'164","last_scrub_stamp":"2024-09-14T11:54:21.634404+0000","last_deep_scrub":"264'164","last_deep_scrub_stamp":"2024-09-14T11:54:21.634404+0000","last_clean_scrub_stamp":"2024-09-14T11:54:21.634404+0000","objects_scrubbed":7,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:42.569487+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":193,"num_read_kb":186,"num_write":126,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"264'803","reported_seq":2781,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.590790+0000","last_change":"2024-09-14T11:54:22.590790+0000","last_active":"2024-09-14T11:54:22.590790+0000","last_peered":"2024-09-14T11:54:22.590790+0000","last_clean":"2024-09-14T11:54:22.590790+0000","last_became_active":"2024-09-14T11:09:53.018558+0000","last_became_peered":"2024-09-14T11:09:53.018558+0000","last_unstale":"2024-09-14T11:54:22.590790+0000","last_undegraded":"2024-09-14T11:54:22.590790+0000","last_fullsized":"2024-09-14T11:54:22.590790+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'803","last_scrub_stamp":"2024-09-14T11:54:22.590509+0000","last_deep_scrub":"264'803","last_deep_scrub_stamp":"2024-09-14T11:54:22.590509+0000","last_clean_scrub_stamp":"2024-09-14T11:54:22.590509+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:46:00.083819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"264'101","reported_seq":592,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:48.332986+0000","last_change":"2024-09-14T11:09:55.024161+0000","last_active":"2024-09-14T11:52:48.332986+0000","last_peered":"2024-09-14T11:52:48.332986+0000","last_clean":"2024-09-14T11:52:48.332986+0000","last_became_active":"2024-09-14T11:09:55.017739+0000","last_became_peered":"2024-09-14T11:09:55.017739+0000","last_unstale":"2024-09-14T11:52:48.332986+0000","last_undegraded":"2024-09-14T11:52:48.332986+0000","last_fullsized":"2024-09-14T11:52:48.332986+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:11.037869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":97,"num_read_kb":96,"num_write":232,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"264'1042","reported_seq":2583,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.687055+0000","last_change":"2024-09-14T11:54:09.687055+0000","last_active":"2024-09-14T11:54:09.687055+0000","last_peered":"2024-09-14T11:54:09.687055+0000","last_clean":"2024-09-14T11:54:09.687055+0000","last_became_active":"2024-09-14T11:09:46.958507+0000","last_became_peered":"2024-09-14T11:09:46.958507+0000","last_unstale":"2024-09-14T11:54:09.687055+0000","last_undegraded":"2024-09-14T11:54:09.687055+0000","last_fullsized":"2024-09-14T11:54:09.687055+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1042","last_scrub_stamp":"2024-09-14T11:54:09.686859+0000","last_deep_scrub":"264'1042","last_deep_scrub_stamp":"2024-09-14T11:54:09.686859+0000","last_clean_scrub_stamp":"2024-09-14T11:54:09.686859+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":1000,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:03.681837+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4784,"num_read_kb":4190,"num_write":1482,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"264'220","reported_seq":862,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.762074+0000","last_change":"2024-09-14T11:54:05.762074+0000","last_active":"2024-09-14T11:54:05.762074+0000","last_peered":"2024-09-14T11:54:05.762074+0000","last_clean":"2024-09-14T11:54:05.762074+0000","last_became_active":"2024-09-14T11:09:45.217039+0000","last_became_peered":"2024-09-14T11:09:45.217039+0000","last_unstale":"2024-09-14T11:54:05.762074+0000","last_undegraded":"2024-09-14T11:54:05.762074+0000","last_fullsized":"2024-09-14T11:54:05.762074+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'220","last_scrub_stamp":"2024-09-14T11:54:05.761858+0000","last_deep_scrub":"264'220","last_deep_scrub_stamp":"2024-09-14T11:54:05.761858+0000","last_clean_scrub_stamp":"2024-09-14T11:54:05.761858+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:30.840271+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":539,"num_read_kb":14764,"num_write":981,"num_write_kb":31870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:02.752870+0000","last_change":"2024-09-14T11:54:02.752870+0000","last_active":"2024-09-14T11:54:02.752870+0000","last_peered":"2024-09-14T11:54:02.752870+0000","last_clean":"2024-09-14T11:54:02.752870+0000","last_became_active":"2024-09-14T11:09:36.106073+0000","last_became_peered":"2024-09-14T11:09:36.106073+0000","last_unstale":"2024-09-14T11:54:02.752870+0000","last_undegraded":"2024-09-14T11:54:02.752870+0000","last_fullsized":"2024-09-14T11:54:02.752870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:02.752684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:02.752684+0000","last_clean_scrub_stamp":"2024-09-14T11:54:02.752684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:30.079185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012975129999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:29.328220+0000","last_change":"2024-09-14T11:09:48.970814+0000","last_active":"2024-09-14T11:51:29.328220+0000","last_peered":"2024-09-14T11:51:29.328220+0000","last_clean":"2024-09-14T11:51:29.328220+0000","last_became_active":"2024-09-14T11:09:48.970339+0000","last_became_peered":"2024-09-14T11:09:48.970339+0000","last_unstale":"2024-09-14T11:51:29.328220+0000","last_undegraded":"2024-09-14T11:51:29.328220+0000","last_fullsized":"2024-09-14T11:51:29.328220+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:13.911012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"264'121","reported_seq":652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:56.240192+0000","last_change":"2024-09-14T11:09:50.980619+0000","last_active":"2024-09-14T11:51:56.240192+0000","last_peered":"2024-09-14T11:51:56.240192+0000","last_clean":"2024-09-14T11:51:56.240192+0000","last_became_active":"2024-09-14T11:09:50.979827+0000","last_became_peered":"2024-09-14T11:09:50.979827+0000","last_unstale":"2024-09-14T11:51:56.240192+0000","last_undegraded":"2024-09-14T11:51:56.240192+0000","last_fullsized":"2024-09-14T11:51:56.240192+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:48.508635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":133,"num_read_kb":122,"num_write":94,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"264'802","reported_seq":2479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:56.910131+0000","last_change":"2024-09-14T11:09:53.008348+0000","last_active":"2024-09-14T11:53:56.910131+0000","last_peered":"2024-09-14T11:53:56.910131+0000","last_clean":"2024-09-14T11:53:56.910131+0000","last_became_active":"2024-09-14T11:09:53.007337+0000","last_became_peered":"2024-09-14T11:09:53.007337+0000","last_unstale":"2024-09-14T11:53:56.910131+0000","last_undegraded":"2024-09-14T11:53:56.910131+0000","last_fullsized":"2024-09-14T11:53:56.910131+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:03.521459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"264'267","reported_seq":793,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:02.141641+0000","last_change":"2024-09-14T11:09:55.012569+0000","last_active":"2024-09-14T11:52:02.141641+0000","last_peered":"2024-09-14T11:52:02.141641+0000","last_clean":"2024-09-14T11:52:02.141641+0000","last_became_active":"2024-09-14T11:09:55.011828+0000","last_became_peered":"2024-09-14T11:09:55.011828+0000","last_unstale":"2024-09-14T11:52:02.141641+0000","last_undegraded":"2024-09-14T11:52:02.141641+0000","last_fullsized":"2024-09-14T11:52:02.141641+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:06.262186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":359,"num_read_kb":349,"num_write":571,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"264'1163","reported_seq":2668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.302504+0000","last_change":"2024-09-14T11:54:05.302504+0000","last_active":"2024-09-14T11:54:05.302504+0000","last_peered":"2024-09-14T11:54:05.302504+0000","last_clean":"2024-09-14T11:54:05.302504+0000","last_became_active":"2024-09-14T11:09:46.946010+0000","last_became_peered":"2024-09-14T11:09:46.946010+0000","last_unstale":"2024-09-14T11:54:05.302504+0000","last_undegraded":"2024-09-14T11:54:05.302504+0000","last_fullsized":"2024-09-14T11:54:05.302504+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1163","last_scrub_stamp":"2024-09-14T11:54:05.302255+0000","last_deep_scrub":"264'1163","last_deep_scrub_stamp":"2024-09-14T11:54:05.302255+0000","last_clean_scrub_stamp":"2024-09-14T11:54:05.302255+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":1100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:58.209905+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5209,"num_read_kb":4587,"num_write":1598,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":272,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"264'212","reported_seq":890,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.735457+0000","last_change":"2024-09-14T11:54:04.735457+0000","last_active":"2024-09-14T11:54:04.735457+0000","last_peered":"2024-09-14T11:54:04.735457+0000","last_clean":"2024-09-14T11:54:04.735457+0000","last_became_active":"2024-09-14T11:09:45.212500+0000","last_became_peered":"2024-09-14T11:09:45.212500+0000","last_unstale":"2024-09-14T11:54:04.735457+0000","last_undegraded":"2024-09-14T11:54:04.735457+0000","last_fullsized":"2024-09-14T11:54:04.735457+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'212","last_scrub_stamp":"2024-09-14T11:54:04.735162+0000","last_deep_scrub":"264'212","last_deep_scrub_stamp":"2024-09-14T11:54:04.735162+0000","last_clean_scrub_stamp":"2024-09-14T11:54:04.735162+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:20.313589+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":655,"num_read_kb":3804,"num_write":900,"num_write_kb":25360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.758528+0000","last_change":"2024-09-14T11:54:06.758528+0000","last_active":"2024-09-14T11:54:06.758528+0000","last_peered":"2024-09-14T11:54:06.758528+0000","last_clean":"2024-09-14T11:54:06.758528+0000","last_became_active":"2024-09-14T11:09:36.108781+0000","last_became_peered":"2024-09-14T11:09:36.108781+0000","last_unstale":"2024-09-14T11:54:06.758528+0000","last_undegraded":"2024-09-14T11:54:06.758528+0000","last_fullsized":"2024-09-14T11:54:06.758528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:06.758347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:06.758347+0000","last_clean_scrub_stamp":"2024-09-14T11:54:06.758347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:28:12.438815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002510581,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.798261+0000","last_change":"2024-09-14T11:54:19.798261+0000","last_active":"2024-09-14T11:54:19.798261+0000","last_peered":"2024-09-14T11:54:19.798261+0000","last_clean":"2024-09-14T11:54:19.798261+0000","last_became_active":"2024-09-14T11:09:48.970940+0000","last_became_peered":"2024-09-14T11:09:48.970940+0000","last_unstale":"2024-09-14T11:54:19.798261+0000","last_undegraded":"2024-09-14T11:54:19.798261+0000","last_fullsized":"2024-09-14T11:54:19.798261+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:19.798083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:19.798083+0000","last_clean_scrub_stamp":"2024-09-14T11:54:19.798083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:16.786632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"264'316","reported_seq":1034,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.851005+0000","last_change":"2024-09-14T11:54:18.851005+0000","last_active":"2024-09-14T11:54:18.851005+0000","last_peered":"2024-09-14T11:54:18.851005+0000","last_clean":"2024-09-14T11:54:18.851005+0000","last_became_active":"2024-09-14T11:09:50.992374+0000","last_became_peered":"2024-09-14T11:09:50.992374+0000","last_unstale":"2024-09-14T11:54:18.851005+0000","last_undegraded":"2024-09-14T11:54:18.851005+0000","last_fullsized":"2024-09-14T11:54:18.851005+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'316","last_scrub_stamp":"2024-09-14T11:54:18.850798+0000","last_deep_scrub":"264'316","last_deep_scrub_stamp":"2024-09-14T11:54:18.850798+0000","last_clean_scrub_stamp":"2024-09-14T11:54:18.850798+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:16.507010+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20511,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":444,"num_read_kb":597,"num_write":216,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:33.127557+0000","last_change":"2024-09-14T11:09:53.004011+0000","last_active":"2024-09-14T11:51:33.127557+0000","last_peered":"2024-09-14T11:51:33.127557+0000","last_clean":"2024-09-14T11:51:33.127557+0000","last_became_active":"2024-09-14T11:09:53.002904+0000","last_became_peered":"2024-09-14T11:09:53.002904+0000","last_unstale":"2024-09-14T11:51:33.127557+0000","last_undegraded":"2024-09-14T11:51:33.127557+0000","last_fullsized":"2024-09-14T11:51:33.127557+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:43.359087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"264'131","reported_seq":631,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.024565+0000","last_change":"2024-09-14T11:09:55.014957+0000","last_active":"2024-09-14T11:53:43.024565+0000","last_peered":"2024-09-14T11:53:43.024565+0000","last_clean":"2024-09-14T11:53:43.024565+0000","last_became_active":"2024-09-14T11:09:55.014192+0000","last_became_peered":"2024-09-14T11:09:55.014192+0000","last_unstale":"2024-09-14T11:53:43.024565+0000","last_undegraded":"2024-09-14T11:53:43.024565+0000","last_fullsized":"2024-09-14T11:53:43.024565+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:45.779974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":303,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"264'162","reported_seq":744,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.795176+0000","last_change":"2024-09-14T11:09:55.015877+0000","last_active":"2024-09-14T11:52:29.795176+0000","last_peered":"2024-09-14T11:52:29.795176+0000","last_clean":"2024-09-14T11:52:29.795176+0000","last_became_active":"2024-09-14T11:09:55.015127+0000","last_became_peered":"2024-09-14T11:09:55.015127+0000","last_unstale":"2024-09-14T11:52:29.795176+0000","last_undegraded":"2024-09-14T11:52:29.795176+0000","last_fullsized":"2024-09-14T11:52:29.795176+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:49.733188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":313,"num_read_kb":285,"num_write":384,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"264'825","reported_seq":2491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.394964+0000","last_change":"2024-09-14T11:54:13.394964+0000","last_active":"2024-09-14T11:54:13.394964+0000","last_peered":"2024-09-14T11:54:13.394964+0000","last_clean":"2024-09-14T11:54:13.394964+0000","last_became_active":"2024-09-14T11:09:46.948706+0000","last_became_peered":"2024-09-14T11:09:46.948706+0000","last_unstale":"2024-09-14T11:54:13.394964+0000","last_undegraded":"2024-09-14T11:54:13.394964+0000","last_fullsized":"2024-09-14T11:54:13.394964+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'825","last_scrub_stamp":"2024-09-14T11:54:13.394780+0000","last_deep_scrub":"264'825","last_deep_scrub_stamp":"2024-09-14T11:54:13.394780+0000","last_clean_scrub_stamp":"2024-09-14T11:54:13.394780+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:09.219229+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4239,"num_read_kb":3866,"num_write":1097,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2295,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"264'194","reported_seq":844,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.818862+0000","last_change":"2024-09-14T11:54:14.818716+0000","last_active":"2024-09-14T11:54:14.818862+0000","last_peered":"2024-09-14T11:54:14.818862+0000","last_clean":"2024-09-14T11:54:14.818862+0000","last_became_active":"2024-09-14T11:09:45.201562+0000","last_became_peered":"2024-09-14T11:09:45.201562+0000","last_unstale":"2024-09-14T11:54:14.818862+0000","last_undegraded":"2024-09-14T11:54:14.818862+0000","last_fullsized":"2024-09-14T11:54:14.818862+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'194","last_scrub_stamp":"2024-09-14T11:54:14.818523+0000","last_deep_scrub":"264'194","last_deep_scrub_stamp":"2024-09-14T11:54:14.818523+0000","last_clean_scrub_stamp":"2024-09-14T11:54:14.818523+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:51:40.122733+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655874,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":505,"num_read_kb":86083,"num_write":869,"num_write_kb":49236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.602327+0000","last_change":"2024-09-14T11:54:20.602327+0000","last_active":"2024-09-14T11:54:20.602327+0000","last_peered":"2024-09-14T11:54:20.602327+0000","last_clean":"2024-09-14T11:54:20.602327+0000","last_became_active":"2024-09-14T11:09:48.962619+0000","last_became_peered":"2024-09-14T11:09:48.962619+0000","last_unstale":"2024-09-14T11:54:20.602327+0000","last_undegraded":"2024-09-14T11:54:20.602327+0000","last_fullsized":"2024-09-14T11:54:20.602327+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:20.602135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:20.602135+0000","last_clean_scrub_stamp":"2024-09-14T11:54:20.602135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:46.015649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"264'171","reported_seq":741,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.221333+0000","last_change":"2024-09-14T11:09:50.996731+0000","last_active":"2024-09-14T11:53:57.221333+0000","last_peered":"2024-09-14T11:53:57.221333+0000","last_clean":"2024-09-14T11:53:57.221333+0000","last_became_active":"2024-09-14T11:09:50.996047+0000","last_became_peered":"2024-09-14T11:09:50.996047+0000","last_unstale":"2024-09-14T11:53:57.221333+0000","last_undegraded":"2024-09-14T11:53:57.221333+0000","last_fullsized":"2024-09-14T11:53:57.221333+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28669,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":205,"num_read_kb":341,"num_write":126,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:23.273840+0000","last_change":"2024-09-14T11:54:23.273840+0000","last_active":"2024-09-14T11:54:23.273840+0000","last_peered":"2024-09-14T11:54:23.273840+0000","last_clean":"2024-09-14T11:54:23.273840+0000","last_became_active":"2024-09-14T11:09:53.000339+0000","last_became_peered":"2024-09-14T11:09:53.000339+0000","last_unstale":"2024-09-14T11:54:23.273840+0000","last_undegraded":"2024-09-14T11:54:23.273840+0000","last_fullsized":"2024-09-14T11:54:23.273840+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:23.273658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:23.273658+0000","last_clean_scrub_stamp":"2024-09-14T11:54:23.273658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:38:03.101466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"264'95","reported_seq":581,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.050315+0000","last_change":"2024-09-14T11:09:55.023250+0000","last_active":"2024-09-14T11:53:44.050315+0000","last_peered":"2024-09-14T11:53:44.050315+0000","last_clean":"2024-09-14T11:53:44.050315+0000","last_became_active":"2024-09-14T11:09:55.022477+0000","last_became_peered":"2024-09-14T11:09:55.022477+0000","last_unstale":"2024-09-14T11:53:44.050315+0000","last_undegraded":"2024-09-14T11:53:44.050315+0000","last_fullsized":"2024-09-14T11:53:44.050315+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:48.971105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":73,"num_write":206,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"264'414","reported_seq":1955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.649873+0000","last_change":"2024-09-14T11:54:10.649873+0000","last_active":"2024-09-14T11:54:10.649873+0000","last_peered":"2024-09-14T11:54:10.649873+0000","last_clean":"2024-09-14T11:54:10.649873+0000","last_became_active":"2024-09-14T11:09:46.948572+0000","last_became_peered":"2024-09-14T11:09:46.948572+0000","last_unstale":"2024-09-14T11:54:10.649873+0000","last_undegraded":"2024-09-14T11:54:10.649873+0000","last_fullsized":"2024-09-14T11:54:10.649873+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'414","last_scrub_stamp":"2024-09-14T11:54:10.649705+0000","last_deep_scrub":"264'414","last_deep_scrub_stamp":"2024-09-14T11:54:10.649705+0000","last_clean_scrub_stamp":"2024-09-14T11:54:10.649705+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:12.848610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2176,"num_read_kb":2078,"num_write":464,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"264'236","reported_seq":860,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:02.763944+0000","last_change":"2024-09-14T11:54:02.763944+0000","last_active":"2024-09-14T11:54:02.763944+0000","last_peered":"2024-09-14T11:54:02.763944+0000","last_clean":"2024-09-14T11:54:02.763944+0000","last_became_active":"2024-09-14T11:09:45.223324+0000","last_became_peered":"2024-09-14T11:09:45.223324+0000","last_unstale":"2024-09-14T11:54:02.763944+0000","last_undegraded":"2024-09-14T11:54:02.763944+0000","last_fullsized":"2024-09-14T11:54:02.763944+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'236","last_scrub_stamp":"2024-09-14T11:54:02.763871+0000","last_deep_scrub":"264'236","last_deep_scrub_stamp":"2024-09-14T11:54:02.763871+0000","last_clean_scrub_stamp":"2024-09-14T11:54:02.763871+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:42.678734+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655868,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":554,"num_read_kb":7834,"num_write":1127,"num_write_kb":26023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"35'3","reported_seq":979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:56.887048+0000","last_change":"2024-09-14T11:09:48.969925+0000","last_active":"2024-09-14T11:53:56.887048+0000","last_peered":"2024-09-14T11:53:56.887048+0000","last_clean":"2024-09-14T11:53:56.887048+0000","last_became_active":"2024-09-14T11:09:48.968561+0000","last_became_peered":"2024-09-14T11:09:48.968561+0000","last_unstale":"2024-09-14T11:53:56.887048+0000","last_undegraded":"2024-09-14T11:53:56.887048+0000","last_fullsized":"2024-09-14T11:53:56.887048+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":728,"num_read_kb":726,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"264'44","reported_seq":546,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:07.624631+0000","last_change":"2024-09-14T11:09:50.981928+0000","last_active":"2024-09-14T11:52:07.624631+0000","last_peered":"2024-09-14T11:52:07.624631+0000","last_clean":"2024-09-14T11:52:07.624631+0000","last_became_active":"2024-09-14T11:09:50.981128+0000","last_became_peered":"2024-09-14T11:09:50.981128+0000","last_unstale":"2024-09-14T11:52:07.624631+0000","last_undegraded":"2024-09-14T11:52:07.624631+0000","last_fullsized":"2024-09-14T11:52:07.624631+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.306525+0000","last_change":"2024-09-14T11:54:20.306525+0000","last_active":"2024-09-14T11:54:20.306525+0000","last_peered":"2024-09-14T11:54:20.306525+0000","last_clean":"2024-09-14T11:54:20.306525+0000","last_became_active":"2024-09-14T11:09:53.006292+0000","last_became_peered":"2024-09-14T11:09:53.006292+0000","last_unstale":"2024-09-14T11:54:20.306525+0000","last_undegraded":"2024-09-14T11:54:20.306525+0000","last_fullsized":"2024-09-14T11:54:20.306525+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:20.306354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:20.306354+0000","last_clean_scrub_stamp":"2024-09-14T11:54:20.306354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:34.456657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"264'206","reported_seq":723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.013495+0000","last_change":"2024-09-14T11:09:55.015153+0000","last_active":"2024-09-14T11:52:29.013495+0000","last_peered":"2024-09-14T11:52:29.013495+0000","last_clean":"2024-09-14T11:52:29.013495+0000","last_became_active":"2024-09-14T11:09:55.014414+0000","last_became_peered":"2024-09-14T11:09:55.014414+0000","last_unstale":"2024-09-14T11:52:29.013495+0000","last_undegraded":"2024-09-14T11:52:29.013495+0000","last_fullsized":"2024-09-14T11:52:29.013495+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:10.146075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":294,"num_read_kb":289,"num_write":451,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"264'677","reported_seq":2440,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.681990+0000","last_change":"2024-09-14T11:54:14.681990+0000","last_active":"2024-09-14T11:54:14.681990+0000","last_peered":"2024-09-14T11:54:14.681990+0000","last_clean":"2024-09-14T11:54:14.681990+0000","last_became_active":"2024-09-14T11:09:46.962508+0000","last_became_peered":"2024-09-14T11:09:46.962508+0000","last_unstale":"2024-09-14T11:54:14.681990+0000","last_undegraded":"2024-09-14T11:54:14.681990+0000","last_fullsized":"2024-09-14T11:54:14.681990+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'677","last_scrub_stamp":"2024-09-14T11:54:14.681778+0000","last_deep_scrub":"264'677","last_deep_scrub_stamp":"2024-09-14T11:54:14.681778+0000","last_clean_scrub_stamp":"2024-09-14T11:54:14.681778+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":600,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:39.225516+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3732,"num_read_kb":3415,"num_write":933,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"264'190","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.341400+0000","last_change":"2024-09-14T11:54:04.341400+0000","last_active":"2024-09-14T11:54:04.341400+0000","last_peered":"2024-09-14T11:54:04.341400+0000","last_clean":"2024-09-14T11:54:04.341400+0000","last_became_active":"2024-09-14T11:09:45.206901+0000","last_became_peered":"2024-09-14T11:09:45.206901+0000","last_unstale":"2024-09-14T11:54:04.341400+0000","last_undegraded":"2024-09-14T11:54:04.341400+0000","last_fullsized":"2024-09-14T11:54:04.341400+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'190","last_scrub_stamp":"2024-09-14T11:54:04.341295+0000","last_deep_scrub":"264'190","last_deep_scrub_stamp":"2024-09-14T11:54:04.341295+0000","last_clean_scrub_stamp":"2024-09-14T11:54:04.341295+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:03.874799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":442,"num_read_kb":9264,"num_write":863,"num_write_kb":15949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:49.114225+0000","last_change":"2024-09-14T11:09:48.960157+0000","last_active":"2024-09-14T11:51:49.114225+0000","last_peered":"2024-09-14T11:51:49.114225+0000","last_clean":"2024-09-14T11:51:49.114225+0000","last_became_active":"2024-09-14T11:09:48.959413+0000","last_became_peered":"2024-09-14T11:09:48.959413+0000","last_unstale":"2024-09-14T11:51:49.114225+0000","last_undegraded":"2024-09-14T11:51:49.114225+0000","last_fullsized":"2024-09-14T11:51:49.114225+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"264'163","reported_seq":753,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.317507+0000","last_change":"2024-09-14T11:54:22.317507+0000","last_active":"2024-09-14T11:54:22.317507+0000","last_peered":"2024-09-14T11:54:22.317507+0000","last_clean":"2024-09-14T11:54:22.317507+0000","last_became_active":"2024-09-14T11:09:50.999585+0000","last_became_peered":"2024-09-14T11:09:50.999585+0000","last_unstale":"2024-09-14T11:54:22.317507+0000","last_undegraded":"2024-09-14T11:54:22.317507+0000","last_fullsized":"2024-09-14T11:54:22.317507+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'163","last_scrub_stamp":"2024-09-14T11:54:22.317312+0000","last_deep_scrub":"264'163","last_deep_scrub_stamp":"2024-09-14T11:54:22.317312+0000","last_clean_scrub_stamp":"2024-09-14T11:54:22.317312+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:12.615304+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7038,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":217,"num_read_kb":281,"num_write":118,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.283193+0000","last_change":"2024-09-14T11:09:53.019246+0000","last_active":"2024-09-14T11:51:53.283193+0000","last_peered":"2024-09-14T11:51:53.283193+0000","last_clean":"2024-09-14T11:51:53.283193+0000","last_became_active":"2024-09-14T11:09:53.018479+0000","last_became_peered":"2024-09-14T11:09:53.018479+0000","last_unstale":"2024-09-14T11:51:53.283193+0000","last_undegraded":"2024-09-14T11:51:53.283193+0000","last_fullsized":"2024-09-14T11:51:53.283193+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"264'128","reported_seq":631,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.390381+0000","last_change":"2024-09-14T11:09:55.029326+0000","last_active":"2024-09-14T11:52:29.390381+0000","last_peered":"2024-09-14T11:52:29.390381+0000","last_clean":"2024-09-14T11:52:29.390381+0000","last_became_active":"2024-09-14T11:09:55.028633+0000","last_became_peered":"2024-09-14T11:09:55.028633+0000","last_unstale":"2024-09-14T11:52:29.390381+0000","last_undegraded":"2024-09-14T11:52:29.390381+0000","last_fullsized":"2024-09-14T11:52:29.390381+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:48.218210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":141,"num_write":296,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"264'506","reported_seq":2225,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.325712+0000","last_change":"2024-09-14T11:54:11.325712+0000","last_active":"2024-09-14T11:54:11.325712+0000","last_peered":"2024-09-14T11:54:11.325712+0000","last_clean":"2024-09-14T11:54:11.325712+0000","last_became_active":"2024-09-14T11:09:46.962364+0000","last_became_peered":"2024-09-14T11:09:46.962364+0000","last_unstale":"2024-09-14T11:54:11.325712+0000","last_undegraded":"2024-09-14T11:54:11.325712+0000","last_fullsized":"2024-09-14T11:54:11.325712+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'506","last_scrub_stamp":"2024-09-14T11:54:11.325519+0000","last_deep_scrub":"264'506","last_deep_scrub_stamp":"2024-09-14T11:54:11.325519+0000","last_clean_scrub_stamp":"2024-09-14T11:54:11.325519+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:16.688907+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2859,"num_read_kb":2685,"num_write":625,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"264'228","reported_seq":856,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.151831+0000","last_change":"2024-09-14T11:54:05.151831+0000","last_active":"2024-09-14T11:54:05.151831+0000","last_peered":"2024-09-14T11:54:05.151831+0000","last_clean":"2024-09-14T11:54:05.151831+0000","last_became_active":"2024-09-14T11:09:45.206145+0000","last_became_peered":"2024-09-14T11:09:45.206145+0000","last_unstale":"2024-09-14T11:54:05.151831+0000","last_undegraded":"2024-09-14T11:54:05.151831+0000","last_fullsized":"2024-09-14T11:54:05.151831+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'228","last_scrub_stamp":"2024-09-14T11:54:05.151645+0000","last_deep_scrub":"264'228","last_deep_scrub_stamp":"2024-09-14T11:54:05.151645+0000","last_clean_scrub_stamp":"2024-09-14T11:54:05.151645+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:21.231443+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":553,"num_read_kb":30372,"num_write":894,"num_write_kb":16933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"35'4","reported_seq":974,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:56.651854+0000","last_change":"2024-09-14T11:09:48.964002+0000","last_active":"2024-09-14T11:53:56.651854+0000","last_peered":"2024-09-14T11:53:56.651854+0000","last_clean":"2024-09-14T11:53:56.651854+0000","last_became_active":"2024-09-14T11:09:48.963563+0000","last_became_peered":"2024-09-14T11:09:48.963563+0000","last_unstale":"2024-09-14T11:53:56.651854+0000","last_undegraded":"2024-09-14T11:53:56.651854+0000","last_fullsized":"2024-09-14T11:53:56.651854+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":1197,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"264'125","reported_seq":687,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.574629+0000","last_change":"2024-09-14T11:09:50.989001+0000","last_active":"2024-09-14T11:53:57.574629+0000","last_peered":"2024-09-14T11:53:57.574629+0000","last_clean":"2024-09-14T11:53:57.574629+0000","last_became_active":"2024-09-14T11:09:50.988286+0000","last_became_peered":"2024-09-14T11:09:50.988286+0000","last_unstale":"2024-09-14T11:53:57.574629+0000","last_undegraded":"2024-09-14T11:53:57.574629+0000","last_fullsized":"2024-09-14T11:53:57.574629+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5180,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":147,"num_read_kb":193,"num_write":70,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.317391+0000","last_change":"2024-09-14T11:09:53.007660+0000","last_active":"2024-09-14T11:51:53.317391+0000","last_peered":"2024-09-14T11:51:53.317391+0000","last_clean":"2024-09-14T11:51:53.317391+0000","last_became_active":"2024-09-14T11:09:53.006975+0000","last_became_peered":"2024-09-14T11:09:53.006975+0000","last_unstale":"2024-09-14T11:51:53.317391+0000","last_undegraded":"2024-09-14T11:51:53.317391+0000","last_fullsized":"2024-09-14T11:51:53.317391+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"264'601","reported_seq":2256,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.917264+0000","last_change":"2024-09-14T11:54:22.917264+0000","last_active":"2024-09-14T11:54:22.917264+0000","last_peered":"2024-09-14T11:54:22.917264+0000","last_clean":"2024-09-14T11:54:22.917264+0000","last_became_active":"2024-09-14T11:09:46.975017+0000","last_became_peered":"2024-09-14T11:09:46.975017+0000","last_unstale":"2024-09-14T11:54:22.917264+0000","last_undegraded":"2024-09-14T11:54:22.917264+0000","last_fullsized":"2024-09-14T11:54:22.917264+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'601","last_scrub_stamp":"2024-09-14T11:54:22.917071+0000","last_deep_scrub":"264'601","last_deep_scrub_stamp":"2024-09-14T11:54:22.917071+0000","last_clean_scrub_stamp":"2024-09-14T11:54:22.917071+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":500,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:52.422521+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3191,"num_read_kb":2927,"num_write":756,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"264'284","reported_seq":973,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.119049+0000","last_change":"2024-09-14T11:54:06.119049+0000","last_active":"2024-09-14T11:54:06.119049+0000","last_peered":"2024-09-14T11:54:06.119049+0000","last_clean":"2024-09-14T11:54:06.119049+0000","last_became_active":"2024-09-14T11:09:45.216742+0000","last_became_peered":"2024-09-14T11:09:45.216742+0000","last_unstale":"2024-09-14T11:54:06.119049+0000","last_undegraded":"2024-09-14T11:54:06.119049+0000","last_fullsized":"2024-09-14T11:54:06.119049+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'284","last_scrub_stamp":"2024-09-14T11:54:06.118835+0000","last_deep_scrub":"264'284","last_deep_scrub_stamp":"2024-09-14T11:54:06.118835+0000","last_clean_scrub_stamp":"2024-09-14T11:54:06.118835+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:00.653277+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":743,"num_read_kb":84606,"num_write":1211,"num_write_kb":44892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.642521+0000","last_change":"2024-09-14T11:54:19.642521+0000","last_active":"2024-09-14T11:54:19.642521+0000","last_peered":"2024-09-14T11:54:19.642521+0000","last_clean":"2024-09-14T11:54:19.642521+0000","last_became_active":"2024-09-14T11:09:48.966112+0000","last_became_peered":"2024-09-14T11:09:48.966112+0000","last_unstale":"2024-09-14T11:54:19.642521+0000","last_undegraded":"2024-09-14T11:54:19.642521+0000","last_fullsized":"2024-09-14T11:54:19.642521+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:19.642292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:19.642292+0000","last_clean_scrub_stamp":"2024-09-14T11:54:19.642292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:48.336482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"264'209","reported_seq":832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.558418+0000","last_change":"2024-09-14T11:09:50.996090+0000","last_active":"2024-09-14T11:53:57.558418+0000","last_peered":"2024-09-14T11:53:57.558418+0000","last_clean":"2024-09-14T11:53:57.558418+0000","last_became_active":"2024-09-14T11:09:50.995279+0000","last_became_peered":"2024-09-14T11:09:50.995279+0000","last_unstale":"2024-09-14T11:53:57.558418+0000","last_undegraded":"2024-09-14T11:53:57.558418+0000","last_fullsized":"2024-09-14T11:53:57.558418+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:02.160055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27447,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":311,"num_read_kb":486,"num_write":198,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:54.086888+0000","last_change":"2024-09-14T11:09:53.003946+0000","last_active":"2024-09-14T11:49:54.086888+0000","last_peered":"2024-09-14T11:49:54.086888+0000","last_clean":"2024-09-14T11:49:54.086888+0000","last_became_active":"2024-09-14T11:09:53.002862+0000","last_became_peered":"2024-09-14T11:09:53.002862+0000","last_unstale":"2024-09-14T11:49:54.086888+0000","last_undegraded":"2024-09-14T11:49:54.086888+0000","last_fullsized":"2024-09-14T11:49:54.086888+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:50.669809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"264'167","reported_seq":667,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:58.138935+0000","last_change":"2024-09-14T11:09:55.024496+0000","last_active":"2024-09-14T11:51:58.138935+0000","last_peered":"2024-09-14T11:51:58.138935+0000","last_clean":"2024-09-14T11:51:58.138935+0000","last_became_active":"2024-09-14T11:09:55.023821+0000","last_became_peered":"2024-09-14T11:09:55.023821+0000","last_unstale":"2024-09-14T11:51:58.138935+0000","last_undegraded":"2024-09-14T11:51:58.138935+0000","last_fullsized":"2024-09-14T11:51:58.138935+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":195,"num_read_kb":205,"num_write":392,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"264'863","reported_seq":2622,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.716452+0000","last_change":"2024-09-14T11:54:13.716452+0000","last_active":"2024-09-14T11:54:13.716452+0000","last_peered":"2024-09-14T11:54:13.716452+0000","last_clean":"2024-09-14T11:54:13.716452+0000","last_became_active":"2024-09-14T11:09:46.967144+0000","last_became_peered":"2024-09-14T11:09:46.967144+0000","last_unstale":"2024-09-14T11:54:13.716452+0000","last_undegraded":"2024-09-14T11:54:13.716452+0000","last_fullsized":"2024-09-14T11:54:13.716452+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'863","last_scrub_stamp":"2024-09-14T11:54:13.716280+0000","last_deep_scrub":"264'863","last_deep_scrub_stamp":"2024-09-14T11:54:13.716280+0000","last_clean_scrub_stamp":"2024-09-14T11:54:13.716280+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":800,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:40.233051+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4422,"num_read_kb":4033,"num_write":1158,"num_write_kb":453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"264'189","reported_seq":811,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.715232+0000","last_change":"2024-09-14T11:54:07.715232+0000","last_active":"2024-09-14T11:54:07.715232+0000","last_peered":"2024-09-14T11:54:07.715232+0000","last_clean":"2024-09-14T11:54:07.715232+0000","last_became_active":"2024-09-14T11:09:45.186745+0000","last_became_peered":"2024-09-14T11:09:45.186745+0000","last_unstale":"2024-09-14T11:54:07.715232+0000","last_undegraded":"2024-09-14T11:54:07.715232+0000","last_fullsized":"2024-09-14T11:54:07.715232+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'189","last_scrub_stamp":"2024-09-14T11:54:07.715044+0000","last_deep_scrub":"264'189","last_deep_scrub_stamp":"2024-09-14T11:54:07.715044+0000","last_clean_scrub_stamp":"2024-09-14T11:54:07.715044+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:02.047080+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":536,"num_read_kb":5513,"num_write":846,"num_write_kb":29456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.372960+0000","last_change":"2024-09-14T11:54:17.372960+0000","last_active":"2024-09-14T11:54:17.372960+0000","last_peered":"2024-09-14T11:54:17.372960+0000","last_clean":"2024-09-14T11:54:17.372960+0000","last_became_active":"2024-09-14T11:09:48.951908+0000","last_became_peered":"2024-09-14T11:09:48.951908+0000","last_unstale":"2024-09-14T11:54:17.372960+0000","last_undegraded":"2024-09-14T11:54:17.372960+0000","last_fullsized":"2024-09-14T11:54:17.372960+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:17.372741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:17.372741+0000","last_clean_scrub_stamp":"2024-09-14T11:54:17.372741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:12.820647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"264'166","reported_seq":742,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.588421+0000","last_change":"2024-09-14T11:09:50.986099+0000","last_active":"2024-09-14T11:53:57.588421+0000","last_peered":"2024-09-14T11:53:57.588421+0000","last_clean":"2024-09-14T11:53:57.588421+0000","last_became_active":"2024-09-14T11:09:50.983553+0000","last_became_peered":"2024-09-14T11:09:50.983553+0000","last_unstale":"2024-09-14T11:53:57.588421+0000","last_undegraded":"2024-09-14T11:53:57.588421+0000","last_fullsized":"2024-09-14T11:53:57.588421+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:45.407677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13815,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":225,"num_read_kb":306,"num_write":144,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.110650+0000","last_change":"2024-09-14T11:09:53.024431+0000","last_active":"2024-09-14T11:49:53.110650+0000","last_peered":"2024-09-14T11:49:53.110650+0000","last_clean":"2024-09-14T11:49:53.110650+0000","last_became_active":"2024-09-14T11:09:53.023609+0000","last_became_peered":"2024-09-14T11:09:53.023609+0000","last_unstale":"2024-09-14T11:49:53.110650+0000","last_undegraded":"2024-09-14T11:49:53.110650+0000","last_fullsized":"2024-09-14T11:49:53.110650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:43.568040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"264'155","reported_seq":652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:28.533458+0000","last_change":"2024-09-14T11:09:55.029184+0000","last_active":"2024-09-14T11:52:28.533458+0000","last_peered":"2024-09-14T11:52:28.533458+0000","last_clean":"2024-09-14T11:52:28.533458+0000","last_became_active":"2024-09-14T11:09:55.028344+0000","last_became_peered":"2024-09-14T11:09:55.028344+0000","last_unstale":"2024-09-14T11:52:28.533458+0000","last_undegraded":"2024-09-14T11:52:28.533458+0000","last_fullsized":"2024-09-14T11:52:28.533458+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1619,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":178,"num_read_kb":177,"num_write":459,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"264'848","reported_seq":2454,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.402985+0000","last_change":"2024-09-14T11:54:14.402985+0000","last_active":"2024-09-14T11:54:14.402985+0000","last_peered":"2024-09-14T11:54:14.402985+0000","last_clean":"2024-09-14T11:54:14.402985+0000","last_became_active":"2024-09-14T11:09:46.990923+0000","last_became_peered":"2024-09-14T11:09:46.990923+0000","last_unstale":"2024-09-14T11:54:14.402985+0000","last_undegraded":"2024-09-14T11:54:14.402985+0000","last_fullsized":"2024-09-14T11:54:14.402985+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'848","last_scrub_stamp":"2024-09-14T11:54:14.402785+0000","last_deep_scrub":"264'848","last_deep_scrub_stamp":"2024-09-14T11:54:14.402785+0000","last_clean_scrub_stamp":"2024-09-14T11:54:14.402785+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":800,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:06.689765+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4067,"num_read_kb":3661,"num_write":1092,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"264'168","reported_seq":761,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.622290+0000","last_change":"2024-09-14T11:54:04.622290+0000","last_active":"2024-09-14T11:54:04.622290+0000","last_peered":"2024-09-14T11:54:04.622290+0000","last_clean":"2024-09-14T11:54:04.622290+0000","last_became_active":"2024-09-14T11:09:45.201058+0000","last_became_peered":"2024-09-14T11:09:45.201058+0000","last_unstale":"2024-09-14T11:54:04.622290+0000","last_undegraded":"2024-09-14T11:54:04.622290+0000","last_fullsized":"2024-09-14T11:54:04.622290+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'168","last_scrub_stamp":"2024-09-14T11:54:04.622018+0000","last_deep_scrub":"264'168","last_deep_scrub_stamp":"2024-09-14T11:54:04.622018+0000","last_clean_scrub_stamp":"2024-09-14T11:54:04.622018+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:44.170656+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":358,"num_read_kb":4087,"num_write":735,"num_write_kb":11722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.418808+0000","last_change":"2024-09-14T11:54:15.418808+0000","last_active":"2024-09-14T11:54:15.418808+0000","last_peered":"2024-09-14T11:54:15.418808+0000","last_clean":"2024-09-14T11:54:15.418808+0000","last_became_active":"2024-09-14T11:09:48.968770+0000","last_became_peered":"2024-09-14T11:09:48.968770+0000","last_unstale":"2024-09-14T11:54:15.418808+0000","last_undegraded":"2024-09-14T11:54:15.418808+0000","last_fullsized":"2024-09-14T11:54:15.418808+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:15.418547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:15.418547+0000","last_clean_scrub_stamp":"2024-09-14T11:54:15.418547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:15.576692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"264'133","reported_seq":705,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.302781+0000","last_change":"2024-09-14T11:09:50.999804+0000","last_active":"2024-09-14T11:53:57.302781+0000","last_peered":"2024-09-14T11:53:57.302781+0000","last_clean":"2024-09-14T11:53:57.302781+0000","last_became_active":"2024-09-14T11:09:50.999079+0000","last_became_peered":"2024-09-14T11:09:50.999079+0000","last_unstale":"2024-09-14T11:53:57.302781+0000","last_undegraded":"2024-09-14T11:53:57.302781+0000","last_fullsized":"2024-09-14T11:53:57.302781+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:44.334838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6871,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":175,"num_read_kb":247,"num_write":92,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:58.318675+0000","last_change":"2024-09-14T11:09:53.009600+0000","last_active":"2024-09-14T11:51:58.318675+0000","last_peered":"2024-09-14T11:51:58.318675+0000","last_clean":"2024-09-14T11:51:58.318675+0000","last_became_active":"2024-09-14T11:09:53.008952+0000","last_became_peered":"2024-09-14T11:09:53.008952+0000","last_unstale":"2024-09-14T11:51:58.318675+0000","last_undegraded":"2024-09-14T11:51:58.318675+0000","last_fullsized":"2024-09-14T11:51:58.318675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:04.350006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"264'141","reported_seq":634,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.061750+0000","last_change":"2024-09-14T11:09:55.029152+0000","last_active":"2024-09-14T11:53:44.061750+0000","last_peered":"2024-09-14T11:53:44.061750+0000","last_clean":"2024-09-14T11:53:44.061750+0000","last_became_active":"2024-09-14T11:09:55.028413+0000","last_became_peered":"2024-09-14T11:09:55.028413+0000","last_unstale":"2024-09-14T11:53:44.061750+0000","last_undegraded":"2024-09-14T11:53:44.061750+0000","last_fullsized":"2024-09-14T11:53:44.061750+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":142,"num_write":355,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"264'425","reported_seq":1990,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:12.675564+0000","last_change":"2024-09-14T11:54:12.675564+0000","last_active":"2024-09-14T11:54:12.675564+0000","last_peered":"2024-09-14T11:54:12.675564+0000","last_clean":"2024-09-14T11:54:12.675564+0000","last_became_active":"2024-09-14T11:09:46.986721+0000","last_became_peered":"2024-09-14T11:09:46.986721+0000","last_unstale":"2024-09-14T11:54:12.675564+0000","last_undegraded":"2024-09-14T11:54:12.675564+0000","last_fullsized":"2024-09-14T11:54:12.675564+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'425","last_scrub_stamp":"2024-09-14T11:54:12.675309+0000","last_deep_scrub":"264'425","last_deep_scrub_stamp":"2024-09-14T11:54:12.675309+0000","last_clean_scrub_stamp":"2024-09-14T11:54:12.675309+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:42.450711+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2241,"num_read_kb":2140,"num_write":472,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"264'231","reported_seq":843,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.670061+0000","last_change":"2024-09-14T11:54:08.670061+0000","last_active":"2024-09-14T11:54:08.670061+0000","last_peered":"2024-09-14T11:54:08.670061+0000","last_clean":"2024-09-14T11:54:08.670061+0000","last_became_active":"2024-09-14T11:09:45.211984+0000","last_became_peered":"2024-09-14T11:09:45.211984+0000","last_unstale":"2024-09-14T11:54:08.670061+0000","last_undegraded":"2024-09-14T11:54:08.670061+0000","last_fullsized":"2024-09-14T11:54:08.670061+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'231","last_scrub_stamp":"2024-09-14T11:54:08.669862+0000","last_deep_scrub":"264'231","last_deep_scrub_stamp":"2024-09-14T11:54:08.669862+0000","last_clean_scrub_stamp":"2024-09-14T11:54:08.669862+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:46.692498+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":505,"num_read_kb":8662,"num_write":1132,"num_write_kb":22372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.104342+0000","last_change":"2024-09-14T11:09:48.969193+0000","last_active":"2024-09-14T11:49:48.104342+0000","last_peered":"2024-09-14T11:49:48.104342+0000","last_clean":"2024-09-14T11:49:48.104342+0000","last_became_active":"2024-09-14T11:09:48.968459+0000","last_became_peered":"2024-09-14T11:09:48.968459+0000","last_unstale":"2024-09-14T11:49:48.104342+0000","last_undegraded":"2024-09-14T11:49:48.104342+0000","last_fullsized":"2024-09-14T11:49:48.104342+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:25.826727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"264'96","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:02.742618+0000","last_change":"2024-09-14T11:09:50.980469+0000","last_active":"2024-09-14T11:52:02.742618+0000","last_peered":"2024-09-14T11:52:02.742618+0000","last_clean":"2024-09-14T11:52:02.742618+0000","last_became_active":"2024-09-14T11:09:50.979749+0000","last_became_peered":"2024-09-14T11:09:50.979749+0000","last_unstale":"2024-09-14T11:52:02.742618+0000","last_undegraded":"2024-09-14T11:52:02.742618+0000","last_fullsized":"2024-09-14T11:52:02.742618+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":88,"num_read_kb":80,"num_write":70,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"264'783","reported_seq":4300,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:56.895525+0000","last_change":"2024-09-14T11:09:53.017293+0000","last_active":"2024-09-14T11:53:56.895525+0000","last_peered":"2024-09-14T11:53:56.895525+0000","last_clean":"2024-09-14T11:53:56.895525+0000","last_became_active":"2024-09-14T11:09:53.014955+0000","last_became_peered":"2024-09-14T11:09:53.014955+0000","last_unstale":"2024-09-14T11:53:56.895525+0000","last_undegraded":"2024-09-14T11:53:56.895525+0000","last_fullsized":"2024-09-14T11:53:56.895525+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:13.437678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"264'92","reported_seq":582,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.640080+0000","last_change":"2024-09-14T11:09:55.030910+0000","last_active":"2024-09-14T11:52:29.640080+0000","last_peered":"2024-09-14T11:52:29.640080+0000","last_clean":"2024-09-14T11:52:29.640080+0000","last_became_active":"2024-09-14T11:09:55.030211+0000","last_became_peered":"2024-09-14T11:09:55.030211+0000","last_unstale":"2024-09-14T11:52:29.640080+0000","last_undegraded":"2024-09-14T11:52:29.640080+0000","last_fullsized":"2024-09-14T11:52:29.640080+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":87,"num_write":222,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"264'456","reported_seq":2007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.356863+0000","last_change":"2024-09-14T11:54:19.356863+0000","last_active":"2024-09-14T11:54:19.356863+0000","last_peered":"2024-09-14T11:54:19.356863+0000","last_clean":"2024-09-14T11:54:19.356863+0000","last_became_active":"2024-09-14T11:09:46.974957+0000","last_became_peered":"2024-09-14T11:09:46.974957+0000","last_unstale":"2024-09-14T11:54:19.356863+0000","last_undegraded":"2024-09-14T11:54:19.356863+0000","last_fullsized":"2024-09-14T11:54:19.356863+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'456","last_scrub_stamp":"2024-09-14T11:54:19.356645+0000","last_deep_scrub":"264'456","last_deep_scrub_stamp":"2024-09-14T11:54:19.356645+0000","last_clean_scrub_stamp":"2024-09-14T11:54:19.356645+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:51.238936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2398,"num_read_kb":2260,"num_write":532,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"264'307","reported_seq":1007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:02.648344+0000","last_change":"2024-09-14T11:54:02.648344+0000","last_active":"2024-09-14T11:54:02.648344+0000","last_peered":"2024-09-14T11:54:02.648344+0000","last_clean":"2024-09-14T11:54:02.648344+0000","last_became_active":"2024-09-14T11:09:45.204014+0000","last_became_peered":"2024-09-14T11:09:45.204014+0000","last_unstale":"2024-09-14T11:54:02.648344+0000","last_undegraded":"2024-09-14T11:54:02.648344+0000","last_fullsized":"2024-09-14T11:54:02.648344+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'307","last_scrub_stamp":"2024-09-14T11:54:02.648264+0000","last_deep_scrub":"264'307","last_deep_scrub_stamp":"2024-09-14T11:54:02.648264+0000","last_clean_scrub_stamp":"2024-09-14T11:54:02.648264+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:19.048576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":844,"num_read_kb":35877,"num_write":1474,"num_write_kb":50924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.685905+0000","last_change":"2024-09-14T11:54:19.685905+0000","last_active":"2024-09-14T11:54:19.685905+0000","last_peered":"2024-09-14T11:54:19.685905+0000","last_clean":"2024-09-14T11:54:19.685905+0000","last_became_active":"2024-09-14T11:09:48.950445+0000","last_became_peered":"2024-09-14T11:09:48.950445+0000","last_unstale":"2024-09-14T11:54:19.685905+0000","last_undegraded":"2024-09-14T11:54:19.685905+0000","last_fullsized":"2024-09-14T11:54:19.685905+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:19.685726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:19.685726+0000","last_clean_scrub_stamp":"2024-09-14T11:54:19.685726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:25.961511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"264'173","reported_seq":757,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:21.861599+0000","last_change":"2024-09-14T11:54:21.861599+0000","last_active":"2024-09-14T11:54:21.861599+0000","last_peered":"2024-09-14T11:54:21.861599+0000","last_clean":"2024-09-14T11:54:21.861599+0000","last_became_active":"2024-09-14T11:09:50.992216+0000","last_became_peered":"2024-09-14T11:09:50.992216+0000","last_unstale":"2024-09-14T11:54:21.861599+0000","last_undegraded":"2024-09-14T11:54:21.861599+0000","last_fullsized":"2024-09-14T11:54:21.861599+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'173","last_scrub_stamp":"2024-09-14T11:54:21.861380+0000","last_deep_scrub":"264'173","last_deep_scrub_stamp":"2024-09-14T11:54:21.861380+0000","last_clean_scrub_stamp":"2024-09-14T11:54:21.861380+0000","objects_scrubbed":7,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:17.222257+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59902,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":237,"num_read_kb":452,"num_write":144,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.119821+0000","last_change":"2024-09-14T11:09:53.024153+0000","last_active":"2024-09-14T11:50:58.119821+0000","last_peered":"2024-09-14T11:50:58.119821+0000","last_clean":"2024-09-14T11:50:58.119821+0000","last_became_active":"2024-09-14T11:09:53.023492+0000","last_became_peered":"2024-09-14T11:09:53.023492+0000","last_unstale":"2024-09-14T11:50:58.119821+0000","last_undegraded":"2024-09-14T11:50:58.119821+0000","last_fullsized":"2024-09-14T11:50:58.119821+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:38.239379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"264'112","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:12.759177+0000","last_change":"2024-09-14T11:09:55.027867+0000","last_active":"2024-09-14T11:52:12.759177+0000","last_peered":"2024-09-14T11:52:12.759177+0000","last_clean":"2024-09-14T11:52:12.759177+0000","last_became_active":"2024-09-14T11:09:55.027044+0000","last_became_peered":"2024-09-14T11:09:55.027044+0000","last_unstale":"2024-09-14T11:52:12.759177+0000","last_undegraded":"2024-09-14T11:52:12.759177+0000","last_fullsized":"2024-09-14T11:52:12.759177+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:52.809691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":137,"num_read_kb":126,"num_write":268,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"264'784","reported_seq":2418,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.425477+0000","last_change":"2024-09-14T11:54:11.425477+0000","last_active":"2024-09-14T11:54:11.425477+0000","last_peered":"2024-09-14T11:54:11.425477+0000","last_clean":"2024-09-14T11:54:11.425477+0000","last_became_active":"2024-09-14T11:09:46.981651+0000","last_became_peered":"2024-09-14T11:09:46.981651+0000","last_unstale":"2024-09-14T11:54:11.425477+0000","last_undegraded":"2024-09-14T11:54:11.425477+0000","last_fullsized":"2024-09-14T11:54:11.425477+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'784","last_scrub_stamp":"2024-09-14T11:54:11.425249+0000","last_deep_scrub":"264'784","last_deep_scrub_stamp":"2024-09-14T11:54:11.425249+0000","last_clean_scrub_stamp":"2024-09-14T11:54:11.425249+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:21.549218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3785,"num_read_kb":3457,"num_write":1011,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"264'249","reported_seq":896,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:12.758882+0000","last_change":"2024-09-14T11:54:12.758882+0000","last_active":"2024-09-14T11:54:12.758882+0000","last_peered":"2024-09-14T11:54:12.758882+0000","last_clean":"2024-09-14T11:54:12.758882+0000","last_became_active":"2024-09-14T11:09:45.215127+0000","last_became_peered":"2024-09-14T11:09:45.215127+0000","last_unstale":"2024-09-14T11:54:12.758882+0000","last_undegraded":"2024-09-14T11:54:12.758882+0000","last_fullsized":"2024-09-14T11:54:12.758882+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'249","last_scrub_stamp":"2024-09-14T11:54:12.758682+0000","last_deep_scrub":"264'249","last_deep_scrub_stamp":"2024-09-14T11:54:12.758682+0000","last_clean_scrub_stamp":"2024-09-14T11:54:12.758682+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:33.194428+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655838,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":590,"num_read_kb":34633,"num_write":1021,"num_write_kb":52307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:21.336091+0000","last_change":"2024-09-14T11:54:21.336091+0000","last_active":"2024-09-14T11:54:21.336091+0000","last_peered":"2024-09-14T11:54:21.336091+0000","last_clean":"2024-09-14T11:54:21.336091+0000","last_became_active":"2024-09-14T11:09:48.960006+0000","last_became_peered":"2024-09-14T11:09:48.960006+0000","last_unstale":"2024-09-14T11:54:21.336091+0000","last_undegraded":"2024-09-14T11:54:21.336091+0000","last_fullsized":"2024-09-14T11:54:21.336091+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:21.335912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:21.335912+0000","last_clean_scrub_stamp":"2024-09-14T11:54:21.335912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:58.931314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"264'117","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.439357+0000","last_change":"2024-09-14T11:09:50.976371+0000","last_active":"2024-09-14T11:53:57.439357+0000","last_peered":"2024-09-14T11:53:57.439357+0000","last_clean":"2024-09-14T11:53:57.439357+0000","last_became_active":"2024-09-14T11:09:50.975555+0000","last_became_peered":"2024-09-14T11:09:50.975555+0000","last_unstale":"2024-09-14T11:53:57.439357+0000","last_undegraded":"2024-09-14T11:53:57.439357+0000","last_fullsized":"2024-09-14T11:53:57.439357+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:50.238466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5710,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":156,"num_read_kb":221,"num_write":78,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:04.321551+0000","last_change":"2024-09-14T11:09:53.015898+0000","last_active":"2024-09-14T11:51:04.321551+0000","last_peered":"2024-09-14T11:51:04.321551+0000","last_clean":"2024-09-14T11:51:04.321551+0000","last_became_active":"2024-09-14T11:09:53.015039+0000","last_became_peered":"2024-09-14T11:09:53.015039+0000","last_unstale":"2024-09-14T11:51:04.321551+0000","last_undegraded":"2024-09-14T11:51:04.321551+0000","last_fullsized":"2024-09-14T11:51:04.321551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:00.423028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"264'92","reported_seq":601,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:02.725541+0000","last_change":"2024-09-14T11:09:55.014762+0000","last_active":"2024-09-14T11:52:02.725541+0000","last_peered":"2024-09-14T11:52:02.725541+0000","last_clean":"2024-09-14T11:52:02.725541+0000","last_became_active":"2024-09-14T11:09:55.013997+0000","last_became_peered":"2024-09-14T11:09:55.013997+0000","last_unstale":"2024-09-14T11:52:02.725541+0000","last_undegraded":"2024-09-14T11:52:02.725541+0000","last_fullsized":"2024-09-14T11:52:02.725541+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:30.820459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":557,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":129,"num_write":227,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"264'1275","reported_seq":2891,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.288870+0000","last_change":"2024-09-14T11:54:10.288870+0000","last_active":"2024-09-14T11:54:10.288870+0000","last_peered":"2024-09-14T11:54:10.288870+0000","last_clean":"2024-09-14T11:54:10.288870+0000","last_became_active":"2024-09-14T11:09:46.982770+0000","last_became_peered":"2024-09-14T11:09:46.982770+0000","last_unstale":"2024-09-14T11:54:10.288870+0000","last_undegraded":"2024-09-14T11:54:10.288870+0000","last_fullsized":"2024-09-14T11:54:10.288870+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1275","last_scrub_stamp":"2024-09-14T11:54:10.288683+0000","last_deep_scrub":"264'1275","last_deep_scrub_stamp":"2024-09-14T11:54:10.288683+0000","last_clean_scrub_stamp":"2024-09-14T11:54:10.288683+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":1200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:08.762030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5800,"num_read_kb":5089,"num_write":1775,"num_write_kb":736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"264'210","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.091928+0000","last_change":"2024-09-14T11:54:07.091928+0000","last_active":"2024-09-14T11:54:07.091928+0000","last_peered":"2024-09-14T11:54:07.091928+0000","last_clean":"2024-09-14T11:54:07.091928+0000","last_became_active":"2024-09-14T11:09:45.200971+0000","last_became_peered":"2024-09-14T11:09:45.200971+0000","last_unstale":"2024-09-14T11:54:07.091928+0000","last_undegraded":"2024-09-14T11:54:07.091928+0000","last_fullsized":"2024-09-14T11:54:07.091928+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'210","last_scrub_stamp":"2024-09-14T11:54:07.091775+0000","last_deep_scrub":"264'210","last_deep_scrub_stamp":"2024-09-14T11:54:07.091775+0000","last_clean_scrub_stamp":"2024-09-14T11:54:07.091775+0000","objects_scrubbed":6,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:25.105451+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3174623,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":502,"num_read_kb":61081,"num_write":905,"num_write_kb":39968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.657373+0000","last_change":"2024-09-14T11:54:18.657373+0000","last_active":"2024-09-14T11:54:18.657373+0000","last_peered":"2024-09-14T11:54:18.657373+0000","last_clean":"2024-09-14T11:54:18.657373+0000","last_became_active":"2024-09-14T11:09:48.958168+0000","last_became_peered":"2024-09-14T11:09:48.958168+0000","last_unstale":"2024-09-14T11:54:18.657373+0000","last_undegraded":"2024-09-14T11:54:18.657373+0000","last_fullsized":"2024-09-14T11:54:18.657373+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:18.657106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:18.657106+0000","last_clean_scrub_stamp":"2024-09-14T11:54:18.657106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:03.227051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"264'105","reported_seq":658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.262062+0000","last_change":"2024-09-14T11:09:50.999672+0000","last_active":"2024-09-14T11:53:57.262062+0000","last_peered":"2024-09-14T11:53:57.262062+0000","last_clean":"2024-09-14T11:53:57.262062+0000","last_became_active":"2024-09-14T11:09:50.998951+0000","last_became_peered":"2024-09-14T11:09:50.998951+0000","last_unstale":"2024-09-14T11:53:57.262062+0000","last_undegraded":"2024-09-14T11:53:57.262062+0000","last_fullsized":"2024-09-14T11:53:57.262062+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:34.380499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":125,"num_read_kb":141,"num_write":60,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:54.302639+0000","last_change":"2024-09-14T11:09:53.022344+0000","last_active":"2024-09-14T11:49:54.302639+0000","last_peered":"2024-09-14T11:49:54.302639+0000","last_clean":"2024-09-14T11:49:54.302639+0000","last_became_active":"2024-09-14T11:09:53.021595+0000","last_became_peered":"2024-09-14T11:09:53.021595+0000","last_unstale":"2024-09-14T11:49:54.302639+0000","last_undegraded":"2024-09-14T11:49:54.302639+0000","last_fullsized":"2024-09-14T11:49:54.302639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:34.894553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"264'187","reported_seq":1643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:27.560080+0000","last_change":"2024-09-14T11:09:55.029111+0000","last_active":"2024-09-14T11:52:27.560080+0000","last_peered":"2024-09-14T11:52:27.560080+0000","last_clean":"2024-09-14T11:52:27.560080+0000","last_became_active":"2024-09-14T11:09:55.028374+0000","last_became_peered":"2024-09-14T11:09:55.028374+0000","last_unstale":"2024-09-14T11:52:27.560080+0000","last_undegraded":"2024-09-14T11:52:27.560080+0000","last_fullsized":"2024-09-14T11:52:27.560080+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:11.828167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":650,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1185,"num_read_kb":1180,"num_write":425,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"264'678","reported_seq":2444,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.384340+0000","last_change":"2024-09-14T11:54:14.384340+0000","last_active":"2024-09-14T11:54:14.384340+0000","last_peered":"2024-09-14T11:54:14.384340+0000","last_clean":"2024-09-14T11:54:14.384340+0000","last_became_active":"2024-09-14T11:09:46.946243+0000","last_became_peered":"2024-09-14T11:09:46.946243+0000","last_unstale":"2024-09-14T11:54:14.384340+0000","last_undegraded":"2024-09-14T11:54:14.384340+0000","last_fullsized":"2024-09-14T11:54:14.384340+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'678","last_scrub_stamp":"2024-09-14T11:54:14.384140+0000","last_deep_scrub":"264'678","last_deep_scrub_stamp":"2024-09-14T11:54:14.384140+0000","last_clean_scrub_stamp":"2024-09-14T11:54:14.384140+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":600,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:37.864132+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3815,"num_read_kb":3478,"num_write":980,"num_write_kb":450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"264'190","reported_seq":824,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.123338+0000","last_change":"2024-09-14T11:54:08.123338+0000","last_active":"2024-09-14T11:54:08.123338+0000","last_peered":"2024-09-14T11:54:08.123338+0000","last_clean":"2024-09-14T11:54:08.123338+0000","last_became_active":"2024-09-14T11:09:45.201929+0000","last_became_peered":"2024-09-14T11:09:45.201929+0000","last_unstale":"2024-09-14T11:54:08.123338+0000","last_undegraded":"2024-09-14T11:54:08.123338+0000","last_fullsized":"2024-09-14T11:54:08.123338+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'190","last_scrub_stamp":"2024-09-14T11:54:08.123135+0000","last_deep_scrub":"264'190","last_deep_scrub_stamp":"2024-09-14T11:54:08.123135+0000","last_clean_scrub_stamp":"2024-09-14T11:54:08.123135+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:22.215301+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":518,"num_read_kb":13061,"num_write":810,"num_write_kb":29760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.119882+0000","last_change":"2024-09-14T11:09:48.963841+0000","last_active":"2024-09-14T11:50:58.119882+0000","last_peered":"2024-09-14T11:50:58.119882+0000","last_clean":"2024-09-14T11:50:58.119882+0000","last_became_active":"2024-09-14T11:09:48.963104+0000","last_became_peered":"2024-09-14T11:09:48.963104+0000","last_unstale":"2024-09-14T11:50:58.119882+0000","last_undegraded":"2024-09-14T11:50:58.119882+0000","last_fullsized":"2024-09-14T11:50:58.119882+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:47.928877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:47.928877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:46.912247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"264'164","reported_seq":741,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.325918+0000","last_change":"2024-09-14T11:09:50.984507+0000","last_active":"2024-09-14T11:53:57.325918+0000","last_peered":"2024-09-14T11:53:57.325918+0000","last_clean":"2024-09-14T11:53:57.325918+0000","last_became_active":"2024-09-14T11:09:50.983753+0000","last_became_peered":"2024-09-14T11:09:50.983753+0000","last_unstale":"2024-09-14T11:53:57.325918+0000","last_undegraded":"2024-09-14T11:53:57.325918+0000","last_fullsized":"2024-09-14T11:53:57.325918+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:49.935877+0000","last_clean_scrub_stamp":"2024-09-14T11:09:49.935877+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:29.921471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4671,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":206,"num_read_kb":262,"num_write":116,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.105515+0000","last_change":"2024-09-14T11:09:53.011871+0000","last_active":"2024-09-14T11:49:53.105515+0000","last_peered":"2024-09-14T11:49:53.105515+0000","last_clean":"2024-09-14T11:49:53.105515+0000","last_became_active":"2024-09-14T11:09:53.011077+0000","last_became_peered":"2024-09-14T11:09:53.011077+0000","last_unstale":"2024-09-14T11:49:53.105515+0000","last_undegraded":"2024-09-14T11:49:53.105515+0000","last_fullsized":"2024-09-14T11:49:53.105515+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:50.394891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"264'163","reported_seq":663,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.126562+0000","last_change":"2024-09-14T11:09:55.022425+0000","last_active":"2024-09-14T11:53:43.126562+0000","last_peered":"2024-09-14T11:53:43.126562+0000","last_clean":"2024-09-14T11:53:43.126562+0000","last_became_active":"2024-09-14T11:09:55.021523+0000","last_became_peered":"2024-09-14T11:09:55.021523+0000","last_unstale":"2024-09-14T11:53:43.126562+0000","last_undegraded":"2024-09-14T11:53:43.126562+0000","last_fullsized":"2024-09-14T11:53:43.126562+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1072,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":209,"num_read_kb":183,"num_write":413,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"264'931","reported_seq":2658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.708900+0000","last_change":"2024-09-14T11:54:15.708900+0000","last_active":"2024-09-14T11:54:15.708900+0000","last_peered":"2024-09-14T11:54:15.708900+0000","last_clean":"2024-09-14T11:54:15.708900+0000","last_became_active":"2024-09-14T11:09:46.951108+0000","last_became_peered":"2024-09-14T11:09:46.951108+0000","last_unstale":"2024-09-14T11:54:15.708900+0000","last_undegraded":"2024-09-14T11:54:15.708900+0000","last_fullsized":"2024-09-14T11:54:15.708900+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'931","last_scrub_stamp":"2024-09-14T11:54:15.708652+0000","last_deep_scrub":"264'931","last_deep_scrub_stamp":"2024-09-14T11:54:15.708652+0000","last_clean_scrub_stamp":"2024-09-14T11:54:15.708652+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":900,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:05.702799+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6915,"num_read_kb":6425,"num_write":1478,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"264'233","reported_seq":924,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:02.380470+0000","last_change":"2024-09-14T11:54:02.380470+0000","last_active":"2024-09-14T11:54:02.380470+0000","last_peered":"2024-09-14T11:54:02.380470+0000","last_clean":"2024-09-14T11:54:02.380470+0000","last_became_active":"2024-09-14T11:09:45.211372+0000","last_became_peered":"2024-09-14T11:09:45.211372+0000","last_unstale":"2024-09-14T11:54:02.380470+0000","last_undegraded":"2024-09-14T11:54:02.380470+0000","last_fullsized":"2024-09-14T11:54:02.380470+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'233","last_scrub_stamp":"2024-09-14T11:54:02.380386+0000","last_deep_scrub":"264'233","last_deep_scrub_stamp":"2024-09-14T11:54:02.380386+0000","last_clean_scrub_stamp":"2024-09-14T11:54:02.380386+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:14.254836+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":701,"num_read_kb":62622,"num_write":1043,"num_write_kb":26227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"264'1162","reported_seq":2874,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:12.335584+0000","last_change":"2024-09-14T11:54:12.335584+0000","last_active":"2024-09-14T11:54:12.335584+0000","last_peered":"2024-09-14T11:54:12.335584+0000","last_clean":"2024-09-14T11:54:12.335584+0000","last_became_active":"2024-09-14T11:09:46.970185+0000","last_became_peered":"2024-09-14T11:09:46.970185+0000","last_unstale":"2024-09-14T11:54:12.335584+0000","last_undegraded":"2024-09-14T11:54:12.335584+0000","last_fullsized":"2024-09-14T11:54:12.335584+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1162","last_scrub_stamp":"2024-09-14T11:54:12.335362+0000","last_deep_scrub":"264'1162","last_deep_scrub_stamp":"2024-09-14T11:54:12.335362+0000","last_clean_scrub_stamp":"2024-09-14T11:54:12.335362+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":1100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:35:56.805295+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5490,"num_read_kb":4916,"num_write":1574,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3025,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"264'229","reported_seq":853,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.253331+0000","last_change":"2024-09-14T11:54:06.253331+0000","last_active":"2024-09-14T11:54:06.253331+0000","last_peered":"2024-09-14T11:54:06.253331+0000","last_clean":"2024-09-14T11:54:06.253331+0000","last_became_active":"2024-09-14T11:09:45.213238+0000","last_became_peered":"2024-09-14T11:09:45.213238+0000","last_unstale":"2024-09-14T11:54:06.253331+0000","last_undegraded":"2024-09-14T11:54:06.253331+0000","last_fullsized":"2024-09-14T11:54:06.253331+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'229","last_scrub_stamp":"2024-09-14T11:54:06.253133+0000","last_deep_scrub":"264'229","last_deep_scrub_stamp":"2024-09-14T11:54:06.253133+0000","last_clean_scrub_stamp":"2024-09-14T11:54:06.253133+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:05.425833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":552,"num_read_kb":930,"num_write":1100,"num_write_kb":31959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"264'418","reported_seq":1954,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:23.955913+0000","last_change":"2024-09-14T11:54:23.955913+0000","last_active":"2024-09-14T11:54:23.955913+0000","last_peered":"2024-09-14T11:54:23.955913+0000","last_clean":"2024-09-14T11:54:23.955913+0000","last_became_active":"2024-09-14T11:09:46.958063+0000","last_became_peered":"2024-09-14T11:09:46.958063+0000","last_unstale":"2024-09-14T11:54:23.955913+0000","last_undegraded":"2024-09-14T11:54:23.955913+0000","last_fullsized":"2024-09-14T11:54:23.955913+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'418","last_scrub_stamp":"2024-09-14T11:54:23.955735+0000","last_deep_scrub":"264'418","last_deep_scrub_stamp":"2024-09-14T11:54:23.955735+0000","last_clean_scrub_stamp":"2024-09-14T11:54:23.955735+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:30:58.368408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2247,"num_read_kb":2131,"num_write":481,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"264'227","reported_seq":1046,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.795526+0000","last_change":"2024-09-14T11:54:13.795526+0000","last_active":"2024-09-14T11:54:13.795526+0000","last_peered":"2024-09-14T11:54:13.795526+0000","last_clean":"2024-09-14T11:54:13.795526+0000","last_became_active":"2024-09-14T11:09:45.217258+0000","last_became_peered":"2024-09-14T11:09:45.217258+0000","last_unstale":"2024-09-14T11:54:13.795526+0000","last_undegraded":"2024-09-14T11:54:13.795526+0000","last_fullsized":"2024-09-14T11:54:13.795526+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'227","last_scrub_stamp":"2024-09-14T11:54:13.795287+0000","last_deep_scrub":"264'227","last_deep_scrub_stamp":"2024-09-14T11:54:13.795287+0000","last_clean_scrub_stamp":"2024-09-14T11:54:13.795287+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:59.198774+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311659,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1093,"num_read_kb":14899,"num_write":1046,"num_write_kb":43826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"264'406","reported_seq":1928,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:23.077918+0000","last_change":"2024-09-14T11:54:23.077918+0000","last_active":"2024-09-14T11:54:23.077918+0000","last_peered":"2024-09-14T11:54:23.077918+0000","last_clean":"2024-09-14T11:54:23.077918+0000","last_became_active":"2024-09-14T11:09:46.987465+0000","last_became_peered":"2024-09-14T11:09:46.987465+0000","last_unstale":"2024-09-14T11:54:23.077918+0000","last_undegraded":"2024-09-14T11:54:23.077918+0000","last_fullsized":"2024-09-14T11:54:23.077918+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'406","last_scrub_stamp":"2024-09-14T11:54:23.077727+0000","last_deep_scrub":"264'406","last_deep_scrub_stamp":"2024-09-14T11:54:23.077727+0000","last_clean_scrub_stamp":"2024-09-14T11:54:23.077727+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:59.683153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2188,"num_read_kb":2091,"num_write":479,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"264'214","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.155990+0000","last_change":"2024-09-14T11:54:09.155990+0000","last_active":"2024-09-14T11:54:09.155990+0000","last_peered":"2024-09-14T11:54:09.155990+0000","last_clean":"2024-09-14T11:54:09.155990+0000","last_became_active":"2024-09-14T11:09:45.210754+0000","last_became_peered":"2024-09-14T11:09:45.210754+0000","last_unstale":"2024-09-14T11:54:09.155990+0000","last_undegraded":"2024-09-14T11:54:09.155990+0000","last_fullsized":"2024-09-14T11:54:09.155990+0000","mapping_epoch":23,"log_start":"264'201","ondisk_log_start":"264'201","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'214","last_scrub_stamp":"2024-09-14T11:54:09.155714+0000","last_deep_scrub":"264'214","last_deep_scrub_stamp":"2024-09-14T11:54:09.155714+0000","last_clean_scrub_stamp":"2024-09-14T11:54:09.155714+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":201,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:16.447066+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254321,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":979,"num_write":956,"num_write_kb":15237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"264'393","reported_seq":1918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.113285+0000","last_change":"2024-09-14T11:54:20.113285+0000","last_active":"2024-09-14T11:54:20.113285+0000","last_peered":"2024-09-14T11:54:20.113285+0000","last_clean":"2024-09-14T11:54:20.113285+0000","last_became_active":"2024-09-14T11:09:46.975006+0000","last_became_peered":"2024-09-14T11:09:46.975006+0000","last_unstale":"2024-09-14T11:54:20.113285+0000","last_undegraded":"2024-09-14T11:54:20.113285+0000","last_fullsized":"2024-09-14T11:54:20.113285+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'393","last_scrub_stamp":"2024-09-14T11:54:20.113113+0000","last_deep_scrub":"264'393","last_deep_scrub_stamp":"2024-09-14T11:54:20.113113+0000","last_clean_scrub_stamp":"2024-09-14T11:54:20.113113+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:34.432992+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2194,"num_read_kb":2087,"num_write":454,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"264'207","reported_seq":831,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.669688+0000","last_change":"2024-09-14T11:54:04.669688+0000","last_active":"2024-09-14T11:54:04.669688+0000","last_peered":"2024-09-14T11:54:04.669688+0000","last_clean":"2024-09-14T11:54:04.669688+0000","last_became_active":"2024-09-14T11:09:45.210639+0000","last_became_peered":"2024-09-14T11:09:45.210639+0000","last_unstale":"2024-09-14T11:54:04.669688+0000","last_undegraded":"2024-09-14T11:54:04.669688+0000","last_fullsized":"2024-09-14T11:54:04.669688+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'207","last_scrub_stamp":"2024-09-14T11:54:04.669386+0000","last_deep_scrub":"264'207","last_deep_scrub_stamp":"2024-09-14T11:54:04.669386+0000","last_clean_scrub_stamp":"2024-09-14T11:54:04.669386+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:45.645744+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655887,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":487,"num_read_kb":12081,"num_write":976,"num_write_kb":34333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"264'844","reported_seq":2520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:12.797196+0000","last_change":"2024-09-14T11:54:12.797196+0000","last_active":"2024-09-14T11:54:12.797196+0000","last_peered":"2024-09-14T11:54:12.797196+0000","last_clean":"2024-09-14T11:54:12.797196+0000","last_became_active":"2024-09-14T11:09:46.961185+0000","last_became_peered":"2024-09-14T11:09:46.961185+0000","last_unstale":"2024-09-14T11:54:12.797196+0000","last_undegraded":"2024-09-14T11:54:12.797196+0000","last_fullsized":"2024-09-14T11:54:12.797196+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'844","last_scrub_stamp":"2024-09-14T11:54:12.796991+0000","last_deep_scrub":"264'844","last_deep_scrub_stamp":"2024-09-14T11:54:12.796991+0000","last_clean_scrub_stamp":"2024-09-14T11:54:12.796991+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":800,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:51.293229+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4099,"num_read_kb":3707,"num_write":1108,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"264'193","reported_seq":809,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.672295+0000","last_change":"2024-09-14T11:54:06.672295+0000","last_active":"2024-09-14T11:54:06.672295+0000","last_peered":"2024-09-14T11:54:06.672295+0000","last_clean":"2024-09-14T11:54:06.672295+0000","last_became_active":"2024-09-14T11:09:45.220246+0000","last_became_peered":"2024-09-14T11:09:45.220246+0000","last_unstale":"2024-09-14T11:54:06.672295+0000","last_undegraded":"2024-09-14T11:54:06.672295+0000","last_fullsized":"2024-09-14T11:54:06.672295+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'193","last_scrub_stamp":"2024-09-14T11:54:06.672104+0000","last_deep_scrub":"264'193","last_deep_scrub_stamp":"2024-09-14T11:54:06.672104+0000","last_clean_scrub_stamp":"2024-09-14T11:54:06.672104+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:13.489184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":452,"num_read_kb":10292,"num_write":865,"num_write_kb":29061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"264'673","reported_seq":2021,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.583120+0000","last_change":"2024-09-14T11:54:15.583120+0000","last_active":"2024-09-14T11:54:15.583120+0000","last_peered":"2024-09-14T11:54:15.583120+0000","last_clean":"2024-09-14T11:54:15.583120+0000","last_became_active":"2024-09-14T11:09:46.990649+0000","last_became_peered":"2024-09-14T11:09:46.990649+0000","last_unstale":"2024-09-14T11:54:15.583120+0000","last_undegraded":"2024-09-14T11:54:15.583120+0000","last_fullsized":"2024-09-14T11:54:15.583120+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'673","last_scrub_stamp":"2024-09-14T11:54:15.582941+0000","last_deep_scrub":"264'673","last_deep_scrub_stamp":"2024-09-14T11:54:15.582941+0000","last_clean_scrub_stamp":"2024-09-14T11:54:15.582941+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":600,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:20.316004+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3174,"num_read_kb":2866,"num_write":894,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"264'236","reported_seq":903,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.320327+0000","last_change":"2024-09-14T11:54:07.320327+0000","last_active":"2024-09-14T11:54:07.320327+0000","last_peered":"2024-09-14T11:54:07.320327+0000","last_clean":"2024-09-14T11:54:07.320327+0000","last_became_active":"2024-09-14T11:09:45.207500+0000","last_became_peered":"2024-09-14T11:09:45.207500+0000","last_unstale":"2024-09-14T11:54:07.320327+0000","last_undegraded":"2024-09-14T11:54:07.320327+0000","last_fullsized":"2024-09-14T11:54:07.320327+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'236","last_scrub_stamp":"2024-09-14T11:54:07.320137+0000","last_deep_scrub":"264'236","last_deep_scrub_stamp":"2024-09-14T11:54:07.320137+0000","last_clean_scrub_stamp":"2024-09-14T11:54:07.320137+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:25.724756+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":644,"num_read_kb":28771,"num_write":1111,"num_write_kb":28685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"264'2091","reported_seq":3870,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.573339+0000","last_change":"2024-09-14T11:54:09.573339+0000","last_active":"2024-09-14T11:54:09.573339+0000","last_peered":"2024-09-14T11:54:09.573339+0000","last_clean":"2024-09-14T11:54:09.573339+0000","last_became_active":"2024-09-14T11:09:46.964893+0000","last_became_peered":"2024-09-14T11:09:46.964893+0000","last_unstale":"2024-09-14T11:54:09.573339+0000","last_undegraded":"2024-09-14T11:54:09.573339+0000","last_fullsized":"2024-09-14T11:54:09.573339+0000","mapping_epoch":25,"log_start":"264'2000","ondisk_log_start":"264'2000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2091","last_scrub_stamp":"2024-09-14T11:54:09.573154+0000","last_deep_scrub":"264'2091","last_deep_scrub_stamp":"2024-09-14T11:54:09.573154+0000","last_clean_scrub_stamp":"2024-09-14T11:54:09.573154+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":2000,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:09.033740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9234,"num_read_kb":7993,"num_write":3022,"num_write_kb":1347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"264'284","reported_seq":991,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.154261+0000","last_change":"2024-09-14T11:54:10.154261+0000","last_active":"2024-09-14T11:54:10.154261+0000","last_peered":"2024-09-14T11:54:10.154261+0000","last_clean":"2024-09-14T11:54:10.154261+0000","last_became_active":"2024-09-14T11:09:45.201951+0000","last_became_peered":"2024-09-14T11:09:45.201951+0000","last_unstale":"2024-09-14T11:54:10.154261+0000","last_undegraded":"2024-09-14T11:54:10.154261+0000","last_fullsized":"2024-09-14T11:54:10.154261+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'284","last_scrub_stamp":"2024-09-14T11:54:10.154062+0000","last_deep_scrub":"264'284","last_deep_scrub_stamp":"2024-09-14T11:54:10.154062+0000","last_clean_scrub_stamp":"2024-09-14T11:54:10.154062+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:54.648794+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655900,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":878,"num_read_kb":20954,"num_write":1195,"num_write_kb":48388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"264'393","reported_seq":1907,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.436438+0000","last_change":"2024-09-14T11:54:15.436438+0000","last_active":"2024-09-14T11:54:15.436438+0000","last_peered":"2024-09-14T11:54:15.436438+0000","last_clean":"2024-09-14T11:54:15.436438+0000","last_became_active":"2024-09-14T11:09:46.982125+0000","last_became_peered":"2024-09-14T11:09:46.982125+0000","last_unstale":"2024-09-14T11:54:15.436438+0000","last_undegraded":"2024-09-14T11:54:15.436438+0000","last_fullsized":"2024-09-14T11:54:15.436438+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'393","last_scrub_stamp":"2024-09-14T11:54:15.436260+0000","last_deep_scrub":"264'393","last_deep_scrub_stamp":"2024-09-14T11:54:15.436260+0000","last_clean_scrub_stamp":"2024-09-14T11:54:15.436260+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:35.766474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2124,"num_read_kb":2027,"num_write":431,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"264'254","reported_seq":939,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.887775+0000","last_change":"2024-09-14T11:54:18.887775+0000","last_active":"2024-09-14T11:54:18.887775+0000","last_peered":"2024-09-14T11:54:18.887775+0000","last_clean":"2024-09-14T11:54:18.887775+0000","last_became_active":"2024-09-14T11:09:45.219634+0000","last_became_peered":"2024-09-14T11:09:45.219634+0000","last_unstale":"2024-09-14T11:54:18.887775+0000","last_undegraded":"2024-09-14T11:54:18.887775+0000","last_fullsized":"2024-09-14T11:54:18.887775+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'254","last_scrub_stamp":"2024-09-14T11:54:18.887539+0000","last_deep_scrub":"264'254","last_deep_scrub_stamp":"2024-09-14T11:54:18.887539+0000","last_clean_scrub_stamp":"2024-09-14T11:54:18.887539+0000","objects_scrubbed":4,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:50.094040+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311685,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":704,"num_read_kb":35580,"num_write":1143,"num_write_kb":63455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"264'547","reported_seq":2105,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.794085+0000","last_change":"2024-09-14T11:54:15.794085+0000","last_active":"2024-09-14T11:54:15.794085+0000","last_peered":"2024-09-14T11:54:15.794085+0000","last_clean":"2024-09-14T11:54:15.794085+0000","last_became_active":"2024-09-14T11:09:46.962261+0000","last_became_peered":"2024-09-14T11:09:46.962261+0000","last_unstale":"2024-09-14T11:54:15.794085+0000","last_undegraded":"2024-09-14T11:54:15.794085+0000","last_fullsized":"2024-09-14T11:54:15.794085+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'547","last_scrub_stamp":"2024-09-14T11:54:15.793906+0000","last_deep_scrub":"264'547","last_deep_scrub_stamp":"2024-09-14T11:54:15.793906+0000","last_clean_scrub_stamp":"2024-09-14T11:54:15.793906+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:35.613525+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2646,"num_read_kb":2439,"num_write":661,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"264'219","reported_seq":862,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:12.137906+0000","last_change":"2024-09-14T11:54:12.137906+0000","last_active":"2024-09-14T11:54:12.137906+0000","last_peered":"2024-09-14T11:54:12.137906+0000","last_clean":"2024-09-14T11:54:12.137906+0000","last_became_active":"2024-09-14T11:09:45.200775+0000","last_became_peered":"2024-09-14T11:09:45.200775+0000","last_unstale":"2024-09-14T11:54:12.137906+0000","last_undegraded":"2024-09-14T11:54:12.137906+0000","last_fullsized":"2024-09-14T11:54:12.137906+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'219","last_scrub_stamp":"2024-09-14T11:54:12.137682+0000","last_deep_scrub":"264'219","last_deep_scrub_stamp":"2024-09-14T11:54:12.137682+0000","last_clean_scrub_stamp":"2024-09-14T11:54:12.137682+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:03.171120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":537,"num_read_kb":33597,"num_write":1024,"num_write_kb":35359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"264'568","reported_seq":2422,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.068157+0000","last_change":"2024-09-14T11:54:22.068157+0000","last_active":"2024-09-14T11:54:22.068157+0000","last_peered":"2024-09-14T11:54:22.068157+0000","last_clean":"2024-09-14T11:54:22.068157+0000","last_became_active":"2024-09-14T11:09:46.974543+0000","last_became_peered":"2024-09-14T11:09:46.974543+0000","last_unstale":"2024-09-14T11:54:22.068157+0000","last_undegraded":"2024-09-14T11:54:22.068157+0000","last_fullsized":"2024-09-14T11:54:22.068157+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'568","last_scrub_stamp":"2024-09-14T11:54:22.067970+0000","last_deep_scrub":"264'568","last_deep_scrub_stamp":"2024-09-14T11:54:22.067970+0000","last_clean_scrub_stamp":"2024-09-14T11:54:22.067970+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":500,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:18.404651+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3309,"num_read_kb":3115,"num_write":715,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2991,"num_omap_keys":12,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"264'214","reported_seq":853,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.652966+0000","last_change":"2024-09-14T11:54:05.652966+0000","last_active":"2024-09-14T11:54:05.652966+0000","last_peered":"2024-09-14T11:54:05.652966+0000","last_clean":"2024-09-14T11:54:05.652966+0000","last_became_active":"2024-09-14T11:09:45.204754+0000","last_became_peered":"2024-09-14T11:09:45.204754+0000","last_unstale":"2024-09-14T11:54:05.652966+0000","last_undegraded":"2024-09-14T11:54:05.652966+0000","last_fullsized":"2024-09-14T11:54:05.652966+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'214","last_scrub_stamp":"2024-09-14T11:54:05.652763+0000","last_deep_scrub":"264'214","last_deep_scrub_stamp":"2024-09-14T11:54:05.652763+0000","last_clean_scrub_stamp":"2024-09-14T11:54:05.652763+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:57.152636+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":525,"num_read_kb":30401,"num_write":981,"num_write_kb":24964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"264'575","reported_seq":2331,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.609313+0000","last_change":"2024-09-14T11:54:07.609313+0000","last_active":"2024-09-14T11:54:07.609313+0000","last_peered":"2024-09-14T11:54:07.609313+0000","last_clean":"2024-09-14T11:54:07.609313+0000","last_became_active":"2024-09-14T11:09:46.964946+0000","last_became_peered":"2024-09-14T11:09:46.964946+0000","last_unstale":"2024-09-14T11:54:07.609313+0000","last_undegraded":"2024-09-14T11:54:07.609313+0000","last_fullsized":"2024-09-14T11:54:07.609313+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'575","last_scrub_stamp":"2024-09-14T11:54:07.609118+0000","last_deep_scrub":"264'575","last_deep_scrub_stamp":"2024-09-14T11:54:07.609118+0000","last_clean_scrub_stamp":"2024-09-14T11:54:07.609118+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":500,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:14.923150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3099,"num_read_kb":2896,"num_write":721,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"264'213","reported_seq":908,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.691374+0000","last_change":"2024-09-14T11:54:11.691374+0000","last_active":"2024-09-14T11:54:11.691374+0000","last_peered":"2024-09-14T11:54:11.691374+0000","last_clean":"2024-09-14T11:54:11.691374+0000","last_became_active":"2024-09-14T11:09:45.191314+0000","last_became_peered":"2024-09-14T11:09:45.191314+0000","last_unstale":"2024-09-14T11:54:11.691374+0000","last_undegraded":"2024-09-14T11:54:11.691374+0000","last_fullsized":"2024-09-14T11:54:11.691374+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'213","last_scrub_stamp":"2024-09-14T11:54:11.691188+0000","last_deep_scrub":"264'213","last_deep_scrub_stamp":"2024-09-14T11:54:11.691188+0000","last_clean_scrub_stamp":"2024-09-14T11:54:11.691188+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:08.058246+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":695,"num_read_kb":24382,"num_write":1016,"num_write_kb":29533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"264'553","reported_seq":2039,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.538890+0000","last_change":"2024-09-14T11:54:11.538890+0000","last_active":"2024-09-14T11:54:11.538890+0000","last_peered":"2024-09-14T11:54:11.538890+0000","last_clean":"2024-09-14T11:54:11.538890+0000","last_became_active":"2024-09-14T11:09:46.994113+0000","last_became_peered":"2024-09-14T11:09:46.994113+0000","last_unstale":"2024-09-14T11:54:11.538890+0000","last_undegraded":"2024-09-14T11:54:11.538890+0000","last_fullsized":"2024-09-14T11:54:11.538890+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'553","last_scrub_stamp":"2024-09-14T11:54:11.538649+0000","last_deep_scrub":"264'553","last_deep_scrub_stamp":"2024-09-14T11:54:11.538649+0000","last_clean_scrub_stamp":"2024-09-14T11:54:11.538649+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:53.524362+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2807,"num_read_kb":2558,"num_write":736,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"264'224","reported_seq":826,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.714480+0000","last_change":"2024-09-14T11:54:05.714480+0000","last_active":"2024-09-14T11:54:05.714480+0000","last_peered":"2024-09-14T11:54:05.714480+0000","last_clean":"2024-09-14T11:54:05.714480+0000","last_became_active":"2024-09-14T11:09:45.214511+0000","last_became_peered":"2024-09-14T11:09:45.214511+0000","last_unstale":"2024-09-14T11:54:05.714480+0000","last_undegraded":"2024-09-14T11:54:05.714480+0000","last_fullsized":"2024-09-14T11:54:05.714480+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'224","last_scrub_stamp":"2024-09-14T11:54:05.714278+0000","last_deep_scrub":"264'224","last_deep_scrub_stamp":"2024-09-14T11:54:05.714278+0000","last_clean_scrub_stamp":"2024-09-14T11:54:05.714278+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:43.486418+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":484,"num_read_kb":9689,"num_write":1032,"num_write_kb":43578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"264'466","reported_seq":1950,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.375439+0000","last_change":"2024-09-14T11:54:13.375439+0000","last_active":"2024-09-14T11:54:13.375439+0000","last_peered":"2024-09-14T11:54:13.375439+0000","last_clean":"2024-09-14T11:54:13.375439+0000","last_became_active":"2024-09-14T11:09:46.974152+0000","last_became_peered":"2024-09-14T11:09:46.974152+0000","last_unstale":"2024-09-14T11:54:13.375439+0000","last_undegraded":"2024-09-14T11:54:13.375439+0000","last_fullsized":"2024-09-14T11:54:13.375439+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'466","last_scrub_stamp":"2024-09-14T11:54:13.375253+0000","last_deep_scrub":"264'466","last_deep_scrub_stamp":"2024-09-14T11:54:13.375253+0000","last_clean_scrub_stamp":"2024-09-14T11:54:13.375253+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:27.247012+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2413,"num_read_kb":2245,"num_write":556,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":963,"num_omap_keys":4,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"264'251","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.840451+0000","last_change":"2024-09-14T11:54:15.840451+0000","last_active":"2024-09-14T11:54:15.840451+0000","last_peered":"2024-09-14T11:54:15.840451+0000","last_clean":"2024-09-14T11:54:15.840451+0000","last_became_active":"2024-09-14T11:09:45.202934+0000","last_became_peered":"2024-09-14T11:09:45.202934+0000","last_unstale":"2024-09-14T11:54:15.840451+0000","last_undegraded":"2024-09-14T11:54:15.840451+0000","last_fullsized":"2024-09-14T11:54:15.840451+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'251","last_scrub_stamp":"2024-09-14T11:54:15.840262+0000","last_deep_scrub":"264'251","last_deep_scrub_stamp":"2024-09-14T11:54:15.840262+0000","last_clean_scrub_stamp":"2024-09-14T11:54:15.840262+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:52.093309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":642,"num_read_kb":75186,"num_write":1115,"num_write_kb":32522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"264'400","reported_seq":1922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:16.663245+0000","last_change":"2024-09-14T11:54:16.663245+0000","last_active":"2024-09-14T11:54:16.663245+0000","last_peered":"2024-09-14T11:54:16.663245+0000","last_clean":"2024-09-14T11:54:16.663245+0000","last_became_active":"2024-09-14T11:09:46.946993+0000","last_became_peered":"2024-09-14T11:09:46.946993+0000","last_unstale":"2024-09-14T11:54:16.663245+0000","last_undegraded":"2024-09-14T11:54:16.663245+0000","last_fullsized":"2024-09-14T11:54:16.663245+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'400","last_scrub_stamp":"2024-09-14T11:54:16.663026+0000","last_deep_scrub":"264'400","last_deep_scrub_stamp":"2024-09-14T11:54:16.663026+0000","last_clean_scrub_stamp":"2024-09-14T11:54:16.663026+0000","objects_scrubbed":6,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:18.854555+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2163,"num_read_kb":2058,"num_write":443,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"264'192","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.273980+0000","last_change":"2024-09-14T11:54:07.273839+0000","last_active":"2024-09-14T11:54:07.273980+0000","last_peered":"2024-09-14T11:54:07.273980+0000","last_clean":"2024-09-14T11:54:07.273980+0000","last_became_active":"2024-09-14T11:09:45.217119+0000","last_became_peered":"2024-09-14T11:09:45.217119+0000","last_unstale":"2024-09-14T11:54:07.273980+0000","last_undegraded":"2024-09-14T11:54:07.273980+0000","last_fullsized":"2024-09-14T11:54:07.273980+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'192","last_scrub_stamp":"2024-09-14T11:54:07.273623+0000","last_deep_scrub":"264'192","last_deep_scrub_stamp":"2024-09-14T11:54:07.273623+0000","last_clean_scrub_stamp":"2024-09-14T11:54:07.273623+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:44:27.235610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":19832,"num_write":847,"num_write_kb":31579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"264'831","reported_seq":2394,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.633118+0000","last_change":"2024-09-14T11:54:17.633118+0000","last_active":"2024-09-14T11:54:17.633118+0000","last_peered":"2024-09-14T11:54:17.633118+0000","last_clean":"2024-09-14T11:54:17.633118+0000","last_became_active":"2024-09-14T11:09:46.990899+0000","last_became_peered":"2024-09-14T11:09:46.990899+0000","last_unstale":"2024-09-14T11:54:17.633118+0000","last_undegraded":"2024-09-14T11:54:17.633118+0000","last_fullsized":"2024-09-14T11:54:17.633118+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'831","last_scrub_stamp":"2024-09-14T11:54:17.632872+0000","last_deep_scrub":"264'831","last_deep_scrub_stamp":"2024-09-14T11:54:17.632872+0000","last_clean_scrub_stamp":"2024-09-14T11:54:17.632872+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:11.212125+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3995,"num_read_kb":3582,"num_write":1122,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":246,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"264'250","reported_seq":960,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:16.871805+0000","last_change":"2024-09-14T11:54:16.871805+0000","last_active":"2024-09-14T11:54:16.871805+0000","last_peered":"2024-09-14T11:54:16.871805+0000","last_clean":"2024-09-14T11:54:16.871805+0000","last_became_active":"2024-09-14T11:09:45.214713+0000","last_became_peered":"2024-09-14T11:09:45.214713+0000","last_unstale":"2024-09-14T11:54:16.871805+0000","last_undegraded":"2024-09-14T11:54:16.871805+0000","last_fullsized":"2024-09-14T11:54:16.871805+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'250","last_scrub_stamp":"2024-09-14T11:54:16.871571+0000","last_deep_scrub":"264'250","last_deep_scrub_stamp":"2024-09-14T11:54:16.871571+0000","last_clean_scrub_stamp":"2024-09-14T11:54:16.871571+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:01.834473+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655874,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":741,"num_read_kb":73898,"num_write":1178,"num_write_kb":36295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"264'151","reported_seq":851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.901832+0000","last_change":"2024-09-14T11:54:17.901832+0000","last_active":"2024-09-14T11:54:17.901832+0000","last_peered":"2024-09-14T11:54:17.901832+0000","last_clean":"2024-09-14T11:54:17.901832+0000","last_became_active":"2024-09-14T11:09:45.202270+0000","last_became_peered":"2024-09-14T11:09:45.202270+0000","last_unstale":"2024-09-14T11:54:17.901832+0000","last_undegraded":"2024-09-14T11:54:17.901832+0000","last_fullsized":"2024-09-14T11:54:17.901832+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'151","last_scrub_stamp":"2024-09-14T11:54:17.901656+0000","last_deep_scrub":"264'151","last_deep_scrub_stamp":"2024-09-14T11:54:17.901656+0000","last_clean_scrub_stamp":"2024-09-14T11:54:17.901656+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:35.985077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":694,"num_read_kb":138365,"num_write":726,"num_write_kb":22161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"264'890","reported_seq":2655,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.708210+0000","last_change":"2024-09-14T11:54:17.708210+0000","last_active":"2024-09-14T11:54:17.708210+0000","last_peered":"2024-09-14T11:54:17.708210+0000","last_clean":"2024-09-14T11:54:17.708210+0000","last_became_active":"2024-09-14T11:09:46.947102+0000","last_became_peered":"2024-09-14T11:09:46.947102+0000","last_unstale":"2024-09-14T11:54:17.708210+0000","last_undegraded":"2024-09-14T11:54:17.708210+0000","last_fullsized":"2024-09-14T11:54:17.708210+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'890","last_scrub_stamp":"2024-09-14T11:54:17.707983+0000","last_deep_scrub":"264'890","last_deep_scrub_stamp":"2024-09-14T11:54:17.707983+0000","last_clean_scrub_stamp":"2024-09-14T11:54:17.707983+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":800,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:08.415593+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4492,"num_read_kb":4074,"num_write":1171,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"264'223","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.123278+0000","last_change":"2024-09-14T11:54:13.123278+0000","last_active":"2024-09-14T11:54:13.123278+0000","last_peered":"2024-09-14T11:54:13.123278+0000","last_clean":"2024-09-14T11:54:13.123278+0000","last_became_active":"2024-09-14T11:09:45.204922+0000","last_became_peered":"2024-09-14T11:09:45.204922+0000","last_unstale":"2024-09-14T11:54:13.123278+0000","last_undegraded":"2024-09-14T11:54:13.123278+0000","last_fullsized":"2024-09-14T11:54:13.123278+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'223","last_scrub_stamp":"2024-09-14T11:54:13.123032+0000","last_deep_scrub":"264'223","last_deep_scrub_stamp":"2024-09-14T11:54:13.123032+0000","last_clean_scrub_stamp":"2024-09-14T11:54:13.123032+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:16.567257+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":767,"num_read_kb":17805,"num_write":1021,"num_write_kb":50816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"264'497","reported_seq":2063,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.551499+0000","last_change":"2024-09-14T11:54:10.551499+0000","last_active":"2024-09-14T11:54:10.551499+0000","last_peered":"2024-09-14T11:54:10.551499+0000","last_clean":"2024-09-14T11:54:10.551499+0000","last_became_active":"2024-09-14T11:09:46.981819+0000","last_became_peered":"2024-09-14T11:09:46.981819+0000","last_unstale":"2024-09-14T11:54:10.551499+0000","last_undegraded":"2024-09-14T11:54:10.551499+0000","last_fullsized":"2024-09-14T11:54:10.551499+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'497","last_scrub_stamp":"2024-09-14T11:54:10.551288+0000","last_deep_scrub":"264'497","last_deep_scrub_stamp":"2024-09-14T11:54:10.551288+0000","last_clean_scrub_stamp":"2024-09-14T11:54:10.551288+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:02.481867+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2560,"num_read_kb":2380,"num_write":586,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10857,"num_read_kb":9179,"num_write":3115,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1006,"ondisk_log_size":1006,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15755,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":15151,"num_read_kb":14810,"num_write":17052,"num_write_kb":4979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1795,"ondisk_log_size":1795,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":756,"ondisk_log_size":756,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":375102,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":8356,"num_read_kb":10715,"num_write":5641,"num_write_kb":2812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":547166,"num_omap_keys":1236,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2104,"ondisk_log_size":2104,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2413,"num_read_kb":2881,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":220474,"num_read_kb":201951,"num_write":55880,"num_write_kb":19076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":31942,"num_omap_keys":128,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4012,"ondisk_log_size":4012,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":40916491,"num_objects":168,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":0,"num_read":38991,"num_read_kb":2064033,"num_write":64568,"num_write_kb":2182336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":82870272,"data_stored":81832982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3601,"ondisk_log_size":3601,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":158488,"num_write":182,"num_write_kb":116383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":158381,"num_write":182,"num_write_kb":116383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509984,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220180,"kb_used_data":18244,"kb_used_omap":1,"kb_used_meta":201918,"kb_avail":94151660,"statfs":{"total":96636764160,"available":96411299840,"internally_reserved":0,"allocated":18681856,"data_stored":17014199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":206764487},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509986,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119184,"kb_used_data":11648,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94252656,"statfs":{"total":96636764160,"available":96514719744,"internally_reserved":0,"allocated":11927552,"data_stored":10256263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542688,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":205004,"kb_used_data":7292,"kb_used_omap":1,"kb_used_meta":197694,"kb_avail":94166836,"statfs":{"total":96636764160,"available":96426840064,"internally_reserved":0,"allocated":7467008,"data_stored":5850366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":202439114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542686,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84808,"kb_used_data":13368,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94287032,"statfs":{"total":96636764160,"available":96549920768,"internally_reserved":0,"allocated":13688832,"data_stored":12047474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542686,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":261108,"kb_used_data":23076,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94110732,"statfs":{"total":96636764160,"available":96369389568,"internally_reserved":0,"allocated":23629824,"data_stored":21914965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243726789},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542687,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148852,"kb_used_data":5284,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94222988,"statfs":{"total":96636764160,"available":96484339712,"internally_reserved":0,"allocated":5410816,"data_stored":3769131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542687,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":268348,"kb_used_data":16428,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94103492,"statfs":{"total":96636764160,"available":96361975808,"internally_reserved":0,"allocated":16822272,"data_stored":15174645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257948101},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542688,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":86684,"kb_used_data":15244,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94285156,"statfs":{"total":96636764160,"available":96547999744,"internally_reserved":0,"allocated":15609856,"data_stored":13878717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11948032,"data_stored":11766247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12473898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8265728,"data_stored":8142582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15040512,"data_stored":14902957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1753088,"data_stored":1656299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":19398656,"data_stored":19214635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10035200,"data_stored":9935327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3846144,"data_stored":3741037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":6024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":5138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":2784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:54:24.881 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.881 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.882 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.882 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.882 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.882 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.882 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.882 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.882 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.882 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.882 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.882 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.883 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.883 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.883 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.883 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.883 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.883 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.883 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.883 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.883 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.884 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.884 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.884 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.884 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.884 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.884 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.884 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.884 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.885 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.885 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.885 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.885 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.885 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.885 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.885 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.885 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.885 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.886 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.886 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.886 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.886 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.886 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.886 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.886 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.886 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.886 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.886 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.887 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.887 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.887 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.887 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.887 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.887 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.887 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.887 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.887 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.887 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.888 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.888 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.888 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.888 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.888 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.888 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.888 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.888 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.888 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.888 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.889 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.889 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.889 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.889 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.889 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.889 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.889 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.889 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.889 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.890 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.890 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.890 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.890 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.890 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.890 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.890 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.890 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.890 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.890 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.891 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.891 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.891 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.891 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.891 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.891 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.891 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.891 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.891 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.891 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.892 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.892 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.892 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.892 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.892 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.892 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.892 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.892 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.892 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.893 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.893 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.893 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.893 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.893 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.893 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.893 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.893 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.893 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.894 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.894 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.894 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.894 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.894 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.894 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.894 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.894 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.894 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.894 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.895 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.895 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.895 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.895 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.895 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.895 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.895 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.895 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.896 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.896 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.896 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.896 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.896 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.896 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-14T11:09:45.921885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.896 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.896 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.896 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.897 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.897 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.897 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.897 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.897 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.897 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.897 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.897 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.897 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.898 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.898 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.898 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.898 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.898 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.898 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.898 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.898 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.898 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.899 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.899 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.899 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.899 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.899 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.899 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.899 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.899 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.900 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.900 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.900 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.900 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.900 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.900 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.900 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.901 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.901 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.901 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.901 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.901 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.901 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.901 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.901 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.902 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.902 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.902 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.902 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.902 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.902 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.902 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.902 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.902 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.903 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.903 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.903 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.903 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.903 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.903 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.903 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.903 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.903 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.904 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.904 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.904 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.904 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.904 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.904 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.904 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.904 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.904 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.905 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.905 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.905 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.905 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.905 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.905 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.905 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.905 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.905 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.906 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.906 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-14T11:09:47.928877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.906 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-14T11:09:49.935877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.906 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.906 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:24.907 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T11:54:44.908 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:54:45.272 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:54:45.287 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-14T11:54:45.304 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":1615,"stamp":"2024-09-14T11:54:44.556207+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":41899528,"num_objects":636,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":636,"num_whiteouts":0,"num_read":296634,"num_read_kb":2620505,"num_write":146761,"num_write_kb":2444634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":200,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":749912,"num_omap_keys":1782,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13623,"ondisk_log_size":13623,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1394168,"kb_used_data":110584,"kb_used_omap":12,"kb_used_meta":1283443,"kb_avail":753580552,"statfs":{"total":773094113280,"available":771666485248,"internally_reserved":0,"allocated":113238016,"data_stored":99905760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1314246193},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":122746,"num_omap_keys":305,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007540"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:40.907917+0000","last_change":"2024-09-14T11:54:40.907917+0000","last_active":"2024-09-14T11:54:40.907917+0000","last_peered":"2024-09-14T11:54:40.907917+0000","last_clean":"2024-09-14T11:54:40.907917+0000","last_became_active":"2024-09-14T11:38:50.585084+0000","last_became_peered":"2024-09-14T11:38:50.585084+0000","last_unstale":"2024-09-14T11:54:40.907917+0000","last_undegraded":"2024-09-14T11:54:40.907917+0000","last_fullsized":"2024-09-14T11:54:40.907917+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:40.907643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:40.907643+0000","last_clean_scrub_stamp":"2024-09-14T11:54:40.907643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:17:22.077501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:40.791499+0000","last_change":"2024-09-14T11:54:40.791499+0000","last_active":"2024-09-14T11:54:40.791499+0000","last_peered":"2024-09-14T11:54:40.791499+0000","last_clean":"2024-09-14T11:54:40.791499+0000","last_became_active":"2024-09-14T11:27:41.641034+0000","last_became_peered":"2024-09-14T11:27:41.641034+0000","last_unstale":"2024-09-14T11:54:40.791499+0000","last_undegraded":"2024-09-14T11:54:40.791499+0000","last_fullsized":"2024-09-14T11:54:40.791499+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:40.791318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:40.791318+0000","last_clean_scrub_stamp":"2024-09-14T11:54:40.791318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:54:19.134485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"261'2","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.449358+0000","last_change":"2024-09-14T11:54:42.449358+0000","last_active":"2024-09-14T11:54:42.449358+0000","last_peered":"2024-09-14T11:54:42.449358+0000","last_clean":"2024-09-14T11:54:42.449358+0000","last_became_active":"2024-09-14T11:27:38.617019+0000","last_became_peered":"2024-09-14T11:27:38.617019+0000","last_unstale":"2024-09-14T11:54:42.449358+0000","last_undegraded":"2024-09-14T11:54:42.449358+0000","last_fullsized":"2024-09-14T11:54:42.449358+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-14T11:54:42.449165+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-14T11:54:42.449165+0000","last_clean_scrub_stamp":"2024-09-14T11:54:42.449165+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:04.980679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"264'17","reported_seq":90,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.122298+0000","last_change":"2024-09-14T11:26:04.263404+0000","last_active":"2024-09-14T11:51:08.122298+0000","last_peered":"2024-09-14T11:51:08.122298+0000","last_clean":"2024-09-14T11:51:08.122298+0000","last_became_active":"2024-09-14T11:26:04.262003+0000","last_became_peered":"2024-09-14T11:26:04.262003+0000","last_unstale":"2024-09-14T11:51:08.122298+0000","last_undegraded":"2024-09-14T11:51:08.122298+0000","last_fullsized":"2024-09-14T11:51:08.122298+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:19.974639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":88,"num_write":45,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.127863+0000","last_change":"2024-09-14T11:38:50.592796+0000","last_active":"2024-09-14T11:51:23.127863+0000","last_peered":"2024-09-14T11:51:23.127863+0000","last_clean":"2024-09-14T11:51:23.127863+0000","last_became_active":"2024-09-14T11:38:50.592015+0000","last_became_peered":"2024-09-14T11:38:50.592015+0000","last_unstale":"2024-09-14T11:51:23.127863+0000","last_undegraded":"2024-09-14T11:51:23.127863+0000","last_fullsized":"2024-09-14T11:51:23.127863+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:43.698723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"264'4","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.126242+0000","last_change":"2024-09-14T11:27:41.643113+0000","last_active":"2024-09-14T11:52:44.126242+0000","last_peered":"2024-09-14T11:52:44.126242+0000","last_clean":"2024-09-14T11:52:44.126242+0000","last_became_active":"2024-09-14T11:27:41.642359+0000","last_became_peered":"2024-09-14T11:27:41.642359+0000","last_unstale":"2024-09-14T11:52:44.126242+0000","last_undegraded":"2024-09-14T11:52:44.126242+0000","last_fullsized":"2024-09-14T11:52:44.126242+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:14.671551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":4,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"264'5","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:38.147879+0000","last_change":"2024-09-14T11:27:38.602923+0000","last_active":"2024-09-14T11:52:38.147879+0000","last_peered":"2024-09-14T11:52:38.147879+0000","last_clean":"2024-09-14T11:52:38.147879+0000","last_became_active":"2024-09-14T11:27:38.597816+0000","last_became_peered":"2024-09-14T11:27:38.597816+0000","last_unstale":"2024-09-14T11:52:38.147879+0000","last_undegraded":"2024-09-14T11:52:38.147879+0000","last_fullsized":"2024-09-14T11:52:38.147879+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:36.668640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1028,"num_write":10,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"264'31","reported_seq":136,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.128943+0000","last_change":"2024-09-14T11:54:42.128943+0000","last_active":"2024-09-14T11:54:42.128943+0000","last_peered":"2024-09-14T11:54:42.128943+0000","last_clean":"2024-09-14T11:54:42.128943+0000","last_became_active":"2024-09-14T11:26:04.280237+0000","last_became_peered":"2024-09-14T11:26:04.280237+0000","last_unstale":"2024-09-14T11:54:42.128943+0000","last_undegraded":"2024-09-14T11:54:42.128943+0000","last_fullsized":"2024-09-14T11:54:42.128943+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'31","last_scrub_stamp":"2024-09-14T11:54:42.128731+0000","last_deep_scrub":"264'31","last_deep_scrub_stamp":"2024-09-14T11:54:42.128731+0000","last_clean_scrub_stamp":"2024-09-14T11:54:42.128731+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:49.358269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":150,"num_write":82,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.752663+0000","last_change":"2024-09-14T11:54:38.752663+0000","last_active":"2024-09-14T11:54:38.752663+0000","last_peered":"2024-09-14T11:54:38.752663+0000","last_clean":"2024-09-14T11:54:38.752663+0000","last_became_active":"2024-09-14T11:38:50.574020+0000","last_became_peered":"2024-09-14T11:38:50.574020+0000","last_unstale":"2024-09-14T11:54:38.752663+0000","last_undegraded":"2024-09-14T11:54:38.752663+0000","last_fullsized":"2024-09-14T11:54:38.752663+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:38.752434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:38.752434+0000","last_clean_scrub_stamp":"2024-09-14T11:54:38.752434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:14.441214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.120898+0000","last_change":"2024-09-14T11:27:41.646451+0000","last_active":"2024-09-14T11:50:38.120898+0000","last_peered":"2024-09-14T11:50:38.120898+0000","last_clean":"2024-09-14T11:50:38.120898+0000","last_became_active":"2024-09-14T11:27:41.645143+0000","last_became_peered":"2024-09-14T11:27:41.645143+0000","last_unstale":"2024-09-14T11:50:38.120898+0000","last_undegraded":"2024-09-14T11:50:38.120898+0000","last_fullsized":"2024-09-14T11:50:38.120898+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:34.278570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:41.469037+0000","last_change":"2024-09-14T11:54:41.469037+0000","last_active":"2024-09-14T11:54:41.469037+0000","last_peered":"2024-09-14T11:54:41.469037+0000","last_clean":"2024-09-14T11:54:41.469037+0000","last_became_active":"2024-09-14T11:27:38.619537+0000","last_became_peered":"2024-09-14T11:27:38.619537+0000","last_unstale":"2024-09-14T11:54:41.469037+0000","last_undegraded":"2024-09-14T11:54:41.469037+0000","last_fullsized":"2024-09-14T11:54:41.469037+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:41.468860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:41.468860+0000","last_clean_scrub_stamp":"2024-09-14T11:54:41.468860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:01.665027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"264'124","reported_seq":419,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:37.701474+0000","last_change":"2024-09-14T11:54:37.701474+0000","last_active":"2024-09-14T11:54:37.701474+0000","last_peered":"2024-09-14T11:54:37.701474+0000","last_clean":"2024-09-14T11:54:37.701474+0000","last_became_active":"2024-09-14T11:26:04.279472+0000","last_became_peered":"2024-09-14T11:26:04.279472+0000","last_unstale":"2024-09-14T11:54:37.701474+0000","last_undegraded":"2024-09-14T11:54:37.701474+0000","last_fullsized":"2024-09-14T11:54:37.701474+0000","mapping_epoch":253,"log_start":"261'100","ondisk_log_start":"261'100","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-09-14T11:54:37.701268+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-09-14T11:54:37.701268+0000","last_clean_scrub_stamp":"2024-09-14T11:54:37.701268+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:11.487369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1140,"num_read_kb":1229,"num_write":251,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.126235+0000","last_change":"2024-09-14T11:38:50.588516+0000","last_active":"2024-09-14T11:51:03.126235+0000","last_peered":"2024-09-14T11:51:03.126235+0000","last_clean":"2024-09-14T11:51:03.126235+0000","last_became_active":"2024-09-14T11:38:50.587700+0000","last_became_peered":"2024-09-14T11:38:50.587700+0000","last_unstale":"2024-09-14T11:51:03.126235+0000","last_undegraded":"2024-09-14T11:51:03.126235+0000","last_fullsized":"2024-09-14T11:51:03.126235+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:40.939286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"264'8","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.513753+0000","last_change":"2024-09-14T11:27:41.645646+0000","last_active":"2024-09-14T11:53:57.513753+0000","last_peered":"2024-09-14T11:53:57.513753+0000","last_clean":"2024-09-14T11:53:57.513753+0000","last_became_active":"2024-09-14T11:27:41.644919+0000","last_became_peered":"2024-09-14T11:27:41.644919+0000","last_unstale":"2024-09-14T11:53:57.513753+0000","last_undegraded":"2024-09-14T11:53:57.513753+0000","last_fullsized":"2024-09-14T11:53:57.513753+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:48.076358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"264'2","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:36.784410+0000","last_change":"2024-09-14T11:54:36.784259+0000","last_active":"2024-09-14T11:54:36.784410+0000","last_peered":"2024-09-14T11:54:36.784410+0000","last_clean":"2024-09-14T11:54:36.784410+0000","last_became_active":"2024-09-14T11:27:38.609445+0000","last_became_peered":"2024-09-14T11:27:38.609445+0000","last_unstale":"2024-09-14T11:54:36.784410+0000","last_undegraded":"2024-09-14T11:54:36.784410+0000","last_fullsized":"2024-09-14T11:54:36.784410+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:36.784067+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:36.784067+0000","last_clean_scrub_stamp":"2024-09-14T11:54:36.784067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:03.982460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"264'61","reported_seq":221,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:35.620211+0000","last_change":"2024-09-14T11:54:35.620211+0000","last_active":"2024-09-14T11:54:35.620211+0000","last_peered":"2024-09-14T11:54:35.620211+0000","last_clean":"2024-09-14T11:54:35.620211+0000","last_became_active":"2024-09-14T11:26:04.282662+0000","last_became_peered":"2024-09-14T11:26:04.282662+0000","last_unstale":"2024-09-14T11:54:35.620211+0000","last_undegraded":"2024-09-14T11:54:35.620211+0000","last_fullsized":"2024-09-14T11:54:35.620211+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'61","last_scrub_stamp":"2024-09-14T11:54:35.620026+0000","last_deep_scrub":"264'61","last_deep_scrub_stamp":"2024-09-14T11:54:35.620026+0000","last_clean_scrub_stamp":"2024-09-14T11:54:35.620026+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:17.224367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":527,"num_read_kb":359,"num_write":147,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.298593+0000","last_change":"2024-09-14T11:38:50.586486+0000","last_active":"2024-09-14T11:50:53.298593+0000","last_peered":"2024-09-14T11:50:53.298593+0000","last_clean":"2024-09-14T11:50:53.298593+0000","last_became_active":"2024-09-14T11:38:50.582489+0000","last_became_peered":"2024-09-14T11:38:50.582489+0000","last_unstale":"2024-09-14T11:50:53.298593+0000","last_undegraded":"2024-09-14T11:50:53.298593+0000","last_fullsized":"2024-09-14T11:50:53.298593+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:07.012027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:30.947800+0000","last_change":"2024-09-14T11:54:30.947800+0000","last_active":"2024-09-14T11:54:30.947800+0000","last_peered":"2024-09-14T11:54:30.947800+0000","last_clean":"2024-09-14T11:54:30.947800+0000","last_became_active":"2024-09-14T11:27:41.645724+0000","last_became_peered":"2024-09-14T11:27:41.645724+0000","last_unstale":"2024-09-14T11:54:30.947800+0000","last_undegraded":"2024-09-14T11:54:30.947800+0000","last_fullsized":"2024-09-14T11:54:30.947800+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:30.947615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:30.947615+0000","last_clean_scrub_stamp":"2024-09-14T11:54:30.947615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:51.069389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"264'3","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.471030+0000","last_change":"2024-09-14T11:27:38.606708+0000","last_active":"2024-09-14T11:53:57.471030+0000","last_peered":"2024-09-14T11:53:57.471030+0000","last_clean":"2024-09-14T11:53:57.471030+0000","last_became_active":"2024-09-14T11:27:38.605937+0000","last_became_peered":"2024-09-14T11:27:38.605937+0000","last_unstale":"2024-09-14T11:53:57.471030+0000","last_undegraded":"2024-09-14T11:53:57.471030+0000","last_fullsized":"2024-09-14T11:53:57.471030+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"264'12","reported_seq":80,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:36.664998+0000","last_change":"2024-09-14T11:54:36.664998+0000","last_active":"2024-09-14T11:54:36.664998+0000","last_peered":"2024-09-14T11:54:36.664998+0000","last_clean":"2024-09-14T11:54:36.664998+0000","last_became_active":"2024-09-14T11:26:04.278457+0000","last_became_peered":"2024-09-14T11:26:04.278457+0000","last_unstale":"2024-09-14T11:54:36.664998+0000","last_undegraded":"2024-09-14T11:54:36.664998+0000","last_fullsized":"2024-09-14T11:54:36.664998+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'12","last_scrub_stamp":"2024-09-14T11:54:36.664780+0000","last_deep_scrub":"264'12","last_deep_scrub_stamp":"2024-09-14T11:54:36.664780+0000","last_clean_scrub_stamp":"2024-09-14T11:54:36.664780+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:47.163712+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":56,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.125380+0000","last_change":"2024-09-14T11:38:50.576845+0000","last_active":"2024-09-14T11:51:23.125380+0000","last_peered":"2024-09-14T11:51:23.125380+0000","last_clean":"2024-09-14T11:51:23.125380+0000","last_became_active":"2024-09-14T11:38:50.576125+0000","last_became_peered":"2024-09-14T11:38:50.576125+0000","last_unstale":"2024-09-14T11:51:23.125380+0000","last_undegraded":"2024-09-14T11:51:23.125380+0000","last_fullsized":"2024-09-14T11:51:23.125380+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:08.428909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"264'4","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.533800+0000","last_change":"2024-09-14T11:27:41.661526+0000","last_active":"2024-09-14T11:53:57.533800+0000","last_peered":"2024-09-14T11:53:57.533800+0000","last_clean":"2024-09-14T11:53:57.533800+0000","last_became_active":"2024-09-14T11:27:41.660702+0000","last_became_peered":"2024-09-14T11:27:41.660702+0000","last_unstale":"2024-09-14T11:53:57.533800+0000","last_undegraded":"2024-09-14T11:53:57.533800+0000","last_fullsized":"2024-09-14T11:53:57.533800+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"264'11","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.470658+0000","last_change":"2024-09-14T11:27:38.603652+0000","last_active":"2024-09-14T11:53:57.470658+0000","last_peered":"2024-09-14T11:53:57.470658+0000","last_clean":"2024-09-14T11:53:57.470658+0000","last_became_active":"2024-09-14T11:27:38.602908+0000","last_became_peered":"2024-09-14T11:27:38.602908+0000","last_unstale":"2024-09-14T11:53:57.470658+0000","last_undegraded":"2024-09-14T11:53:57.470658+0000","last_fullsized":"2024-09-14T11:53:57.470658+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":15360,"num_write":16,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"264'30","reported_seq":134,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:33.236269+0000","last_change":"2024-09-14T11:54:33.236269+0000","last_active":"2024-09-14T11:54:33.236269+0000","last_peered":"2024-09-14T11:54:33.236269+0000","last_clean":"2024-09-14T11:54:33.236269+0000","last_became_active":"2024-09-14T11:26:04.258048+0000","last_became_peered":"2024-09-14T11:26:04.258048+0000","last_unstale":"2024-09-14T11:54:33.236269+0000","last_undegraded":"2024-09-14T11:54:33.236269+0000","last_fullsized":"2024-09-14T11:54:33.236269+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'30","last_scrub_stamp":"2024-09-14T11:54:33.236050+0000","last_deep_scrub":"264'30","last_deep_scrub_stamp":"2024-09-14T11:54:33.236050+0000","last_clean_scrub_stamp":"2024-09-14T11:54:33.236050+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:59.884986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":248,"num_read_kb":161,"num_write":75,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:24.107804+0000","last_change":"2024-09-14T11:38:50.591472+0000","last_active":"2024-09-14T11:51:24.107804+0000","last_peered":"2024-09-14T11:51:24.107804+0000","last_clean":"2024-09-14T11:51:24.107804+0000","last_became_active":"2024-09-14T11:38:50.590496+0000","last_became_peered":"2024-09-14T11:38:50.590496+0000","last_unstale":"2024-09-14T11:51:24.107804+0000","last_undegraded":"2024-09-14T11:51:24.107804+0000","last_fullsized":"2024-09-14T11:51:24.107804+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:59.200308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"264'11","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:41.128414+0000","last_change":"2024-09-14T11:54:41.128414+0000","last_active":"2024-09-14T11:54:41.128414+0000","last_peered":"2024-09-14T11:54:41.128414+0000","last_clean":"2024-09-14T11:54:41.128414+0000","last_became_active":"2024-09-14T11:27:41.635495+0000","last_became_peered":"2024-09-14T11:27:41.635495+0000","last_unstale":"2024-09-14T11:54:41.128414+0000","last_undegraded":"2024-09-14T11:54:41.128414+0000","last_fullsized":"2024-09-14T11:54:41.128414+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'11","last_scrub_stamp":"2024-09-14T11:54:41.128137+0000","last_deep_scrub":"264'11","last_deep_scrub_stamp":"2024-09-14T11:54:41.128137+0000","last_clean_scrub_stamp":"2024-09-14T11:54:41.128137+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:54:06.188677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":12817,"num_write":26,"num_write_kb":12817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"264'2","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:32.889714+0000","last_change":"2024-09-14T11:54:32.889714+0000","last_active":"2024-09-14T11:54:32.889714+0000","last_peered":"2024-09-14T11:54:32.889714+0000","last_clean":"2024-09-14T11:54:32.889714+0000","last_became_active":"2024-09-14T11:27:38.593507+0000","last_became_peered":"2024-09-14T11:27:38.593507+0000","last_unstale":"2024-09-14T11:54:32.889714+0000","last_undegraded":"2024-09-14T11:54:32.889714+0000","last_fullsized":"2024-09-14T11:54:32.889714+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:32.889523+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:32.889523+0000","last_clean_scrub_stamp":"2024-09-14T11:54:32.889523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:27.863989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"264'31","reported_seq":121,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.290822+0000","last_change":"2024-09-14T11:26:04.281451+0000","last_active":"2024-09-14T11:50:18.290822+0000","last_peered":"2024-09-14T11:50:18.290822+0000","last_clean":"2024-09-14T11:50:18.290822+0000","last_became_active":"2024-09-14T11:26:04.280799+0000","last_became_peered":"2024-09-14T11:26:04.280799+0000","last_unstale":"2024-09-14T11:50:18.290822+0000","last_undegraded":"2024-09-14T11:50:18.290822+0000","last_fullsized":"2024-09-14T11:50:18.290822+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:13.145315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":229,"num_read_kb":151,"num_write":83,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:37.911419+0000","last_change":"2024-09-14T11:54:37.911419+0000","last_active":"2024-09-14T11:54:37.911419+0000","last_peered":"2024-09-14T11:54:37.911419+0000","last_clean":"2024-09-14T11:54:37.911419+0000","last_became_active":"2024-09-14T11:38:50.588260+0000","last_became_peered":"2024-09-14T11:38:50.588260+0000","last_unstale":"2024-09-14T11:54:37.911419+0000","last_undegraded":"2024-09-14T11:54:37.911419+0000","last_fullsized":"2024-09-14T11:54:37.911419+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:37.911196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:37.911196+0000","last_clean_scrub_stamp":"2024-09-14T11:54:37.911196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:48.971042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"261'2","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.289709+0000","last_change":"2024-09-14T11:27:41.650374+0000","last_active":"2024-09-14T11:50:13.289709+0000","last_peered":"2024-09-14T11:50:13.289709+0000","last_clean":"2024-09-14T11:50:13.289709+0000","last_became_active":"2024-09-14T11:27:41.649448+0000","last_became_peered":"2024-09-14T11:27:41.649448+0000","last_unstale":"2024-09-14T11:50:13.289709+0000","last_undegraded":"2024-09-14T11:50:13.289709+0000","last_fullsized":"2024-09-14T11:50:13.289709+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:46.465272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"264'3","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:40.705695+0000","last_change":"2024-09-14T11:54:40.705695+0000","last_active":"2024-09-14T11:54:40.705695+0000","last_peered":"2024-09-14T11:54:40.705695+0000","last_clean":"2024-09-14T11:54:40.705695+0000","last_became_active":"2024-09-14T11:27:38.598992+0000","last_became_peered":"2024-09-14T11:27:38.598992+0000","last_unstale":"2024-09-14T11:54:40.705695+0000","last_undegraded":"2024-09-14T11:54:40.705695+0000","last_fullsized":"2024-09-14T11:54:40.705695+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:54:40.705524+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:54:40.705524+0000","last_clean_scrub_stamp":"2024-09-14T11:54:40.705524+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:31.817310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"264'245","reported_seq":791,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:34.623337+0000","last_change":"2024-09-14T11:54:34.623337+0000","last_active":"2024-09-14T11:54:34.623337+0000","last_peered":"2024-09-14T11:54:34.623337+0000","last_clean":"2024-09-14T11:54:34.623337+0000","last_became_active":"2024-09-14T11:26:04.283058+0000","last_became_peered":"2024-09-14T11:26:04.283058+0000","last_unstale":"2024-09-14T11:54:34.623337+0000","last_undegraded":"2024-09-14T11:54:34.623337+0000","last_fullsized":"2024-09-14T11:54:34.623337+0000","mapping_epoch":253,"log_start":"261'200","ondisk_log_start":"261'200","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'245","last_scrub_stamp":"2024-09-14T11:54:34.623091+0000","last_deep_scrub":"264'245","last_deep_scrub_stamp":"2024-09-14T11:54:34.623091+0000","last_clean_scrub_stamp":"2024-09-14T11:54:34.623091+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:07.735348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2337,"num_read_kb":3061,"num_write":470,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:33.119635+0000","last_change":"2024-09-14T11:38:50.588284+0000","last_active":"2024-09-14T11:50:33.119635+0000","last_peered":"2024-09-14T11:50:33.119635+0000","last_clean":"2024-09-14T11:50:33.119635+0000","last_became_active":"2024-09-14T11:38:50.587593+0000","last_became_peered":"2024-09-14T11:38:50.587593+0000","last_unstale":"2024-09-14T11:50:33.119635+0000","last_undegraded":"2024-09-14T11:50:33.119635+0000","last_fullsized":"2024-09-14T11:50:33.119635+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:30.104550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"261'2","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.317473+0000","last_change":"2024-09-14T11:27:41.650094+0000","last_active":"2024-09-14T11:51:53.317473+0000","last_peered":"2024-09-14T11:51:53.317473+0000","last_clean":"2024-09-14T11:51:53.317473+0000","last_became_active":"2024-09-14T11:27:41.649297+0000","last_became_peered":"2024-09-14T11:27:41.649297+0000","last_unstale":"2024-09-14T11:51:53.317473+0000","last_undegraded":"2024-09-14T11:51:53.317473+0000","last_fullsized":"2024-09-14T11:51:53.317473+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"261'3","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:04.321677+0000","last_change":"2024-09-14T11:27:38.608702+0000","last_active":"2024-09-14T11:51:04.321677+0000","last_peered":"2024-09-14T11:51:04.321677+0000","last_clean":"2024-09-14T11:51:04.321677+0000","last_became_active":"2024-09-14T11:27:38.607929+0000","last_became_peered":"2024-09-14T11:27:38.607929+0000","last_unstale":"2024-09-14T11:51:04.321677+0000","last_undegraded":"2024-09-14T11:51:04.321677+0000","last_fullsized":"2024-09-14T11:51:04.321677+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:02.938378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"264'16","reported_seq":85,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.111235+0000","last_change":"2024-09-14T11:26:04.262715+0000","last_active":"2024-09-14T11:50:18.111235+0000","last_peered":"2024-09-14T11:50:18.111235+0000","last_clean":"2024-09-14T11:50:18.111235+0000","last_became_active":"2024-09-14T11:26:04.261101+0000","last_became_peered":"2024-09-14T11:26:04.261101+0000","last_unstale":"2024-09-14T11:50:18.111235+0000","last_undegraded":"2024-09-14T11:50:18.111235+0000","last_fullsized":"2024-09-14T11:50:18.111235+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:32.177932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":70,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"264'2","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.712333+0000","last_change":"2024-09-14T11:54:42.712333+0000","last_active":"2024-09-14T11:54:42.712333+0000","last_peered":"2024-09-14T11:54:42.712333+0000","last_clean":"2024-09-14T11:54:42.712333+0000","last_became_active":"2024-09-14T11:38:50.565980+0000","last_became_peered":"2024-09-14T11:38:50.565980+0000","last_unstale":"2024-09-14T11:54:42.712333+0000","last_undegraded":"2024-09-14T11:54:42.712333+0000","last_fullsized":"2024-09-14T11:54:42.712333+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:42.712137+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:42.712137+0000","last_clean_scrub_stamp":"2024-09-14T11:54:42.712137+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:56.324022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"264'5","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:28.159762+0000","last_change":"2024-09-14T11:27:41.660949+0000","last_active":"2024-09-14T11:53:28.159762+0000","last_peered":"2024-09-14T11:53:28.159762+0000","last_clean":"2024-09-14T11:53:28.159762+0000","last_became_active":"2024-09-14T11:27:41.660264+0000","last_became_peered":"2024-09-14T11:27:41.660264+0000","last_unstale":"2024-09-14T11:53:28.159762+0000","last_undegraded":"2024-09-14T11:53:28.159762+0000","last_fullsized":"2024-09-14T11:53:28.159762+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:36.720927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"261'4","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.871763+0000","last_change":"2024-09-14T11:54:27.871763+0000","last_active":"2024-09-14T11:54:27.871763+0000","last_peered":"2024-09-14T11:54:27.871763+0000","last_clean":"2024-09-14T11:54:27.871763+0000","last_became_active":"2024-09-14T11:27:38.595788+0000","last_became_peered":"2024-09-14T11:27:38.595788+0000","last_unstale":"2024-09-14T11:54:27.871763+0000","last_undegraded":"2024-09-14T11:54:27.871763+0000","last_fullsized":"2024-09-14T11:54:27.871763+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-14T11:54:27.871566+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-14T11:54:27.871566+0000","last_clean_scrub_stamp":"2024-09-14T11:54:27.871566+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:37.867774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"264'35","reported_seq":143,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:41.127097+0000","last_change":"2024-09-14T11:54:41.127097+0000","last_active":"2024-09-14T11:54:41.127097+0000","last_peered":"2024-09-14T11:54:41.127097+0000","last_clean":"2024-09-14T11:54:41.127097+0000","last_became_active":"2024-09-14T11:26:04.279281+0000","last_became_peered":"2024-09-14T11:26:04.279281+0000","last_unstale":"2024-09-14T11:54:41.127097+0000","last_undegraded":"2024-09-14T11:54:41.127097+0000","last_fullsized":"2024-09-14T11:54:41.127097+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'35","last_scrub_stamp":"2024-09-14T11:54:41.126910+0000","last_deep_scrub":"264'35","last_deep_scrub_stamp":"2024-09-14T11:54:41.126910+0000","last_clean_scrub_stamp":"2024-09-14T11:54:41.126910+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:18.051800+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":194,"num_write":86,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.083376+0000","last_change":"2024-09-14T11:54:42.083376+0000","last_active":"2024-09-14T11:54:42.083376+0000","last_peered":"2024-09-14T11:54:42.083376+0000","last_clean":"2024-09-14T11:54:42.083376+0000","last_became_active":"2024-09-14T11:38:50.573912+0000","last_became_peered":"2024-09-14T11:38:50.573912+0000","last_unstale":"2024-09-14T11:54:42.083376+0000","last_undegraded":"2024-09-14T11:54:42.083376+0000","last_fullsized":"2024-09-14T11:54:42.083376+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:42.083183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:42.083183+0000","last_clean_scrub_stamp":"2024-09-14T11:54:42.083183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:38.164805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"264'10","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.515902+0000","last_change":"2024-09-14T11:27:41.633217+0000","last_active":"2024-09-14T11:53:57.515902+0000","last_peered":"2024-09-14T11:53:57.515902+0000","last_clean":"2024-09-14T11:53:57.515902+0000","last_became_active":"2024-09-14T11:27:41.632456+0000","last_became_peered":"2024-09-14T11:27:41.632456+0000","last_unstale":"2024-09-14T11:53:57.515902+0000","last_undegraded":"2024-09-14T11:53:57.515902+0000","last_fullsized":"2024-09-14T11:53:57.515902+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15362,"num_write":10,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"261'2","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:40.513991+0000","last_change":"2024-09-14T11:54:40.513991+0000","last_active":"2024-09-14T11:54:40.513991+0000","last_peered":"2024-09-14T11:54:40.513991+0000","last_clean":"2024-09-14T11:54:40.513991+0000","last_became_active":"2024-09-14T11:27:38.616935+0000","last_became_peered":"2024-09-14T11:27:38.616935+0000","last_unstale":"2024-09-14T11:54:40.513991+0000","last_undegraded":"2024-09-14T11:54:40.513991+0000","last_fullsized":"2024-09-14T11:54:40.513991+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-14T11:54:40.513806+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-14T11:54:40.513806+0000","last_clean_scrub_stamp":"2024-09-14T11:54:40.513806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:00.725064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"264'38","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:35.540214+0000","last_change":"2024-09-14T11:54:35.540214+0000","last_active":"2024-09-14T11:54:35.540214+0000","last_peered":"2024-09-14T11:54:35.540214+0000","last_clean":"2024-09-14T11:54:35.540214+0000","last_became_active":"2024-09-14T11:26:04.268202+0000","last_became_peered":"2024-09-14T11:26:04.268202+0000","last_unstale":"2024-09-14T11:54:35.540214+0000","last_undegraded":"2024-09-14T11:54:35.540214+0000","last_fullsized":"2024-09-14T11:54:35.540214+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'38","last_scrub_stamp":"2024-09-14T11:54:35.539999+0000","last_deep_scrub":"264'38","last_deep_scrub_stamp":"2024-09-14T11:54:35.539999+0000","last_clean_scrub_stamp":"2024-09-14T11:54:35.539999+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:43.448218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":294,"num_read_kb":198,"num_write":96,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:36.908602+0000","last_change":"2024-09-14T11:54:36.908602+0000","last_active":"2024-09-14T11:54:36.908602+0000","last_peered":"2024-09-14T11:54:36.908602+0000","last_clean":"2024-09-14T11:54:36.908602+0000","last_became_active":"2024-09-14T11:38:50.585324+0000","last_became_peered":"2024-09-14T11:38:50.585324+0000","last_unstale":"2024-09-14T11:54:36.908602+0000","last_undegraded":"2024-09-14T11:54:36.908602+0000","last_fullsized":"2024-09-14T11:54:36.908602+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:36.908378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:36.908378+0000","last_clean_scrub_stamp":"2024-09-14T11:54:36.908378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:19.151586+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"264'6","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:31.912687+0000","last_change":"2024-09-14T11:54:31.912687+0000","last_active":"2024-09-14T11:54:31.912687+0000","last_peered":"2024-09-14T11:54:31.912687+0000","last_clean":"2024-09-14T11:54:31.912687+0000","last_became_active":"2024-09-14T11:27:41.652940+0000","last_became_peered":"2024-09-14T11:27:41.652940+0000","last_unstale":"2024-09-14T11:54:31.912687+0000","last_undegraded":"2024-09-14T11:54:31.912687+0000","last_fullsized":"2024-09-14T11:54:31.912687+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-14T11:54:31.912497+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-14T11:54:31.912497+0000","last_clean_scrub_stamp":"2024-09-14T11:54:31.912497+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:48.642280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10244,"num_write":6,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"261'5","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:48.136858+0000","last_change":"2024-09-14T11:27:38.603632+0000","last_active":"2024-09-14T11:51:48.136858+0000","last_peered":"2024-09-14T11:51:48.136858+0000","last_clean":"2024-09-14T11:51:48.136858+0000","last_became_active":"2024-09-14T11:27:38.603013+0000","last_became_peered":"2024-09-14T11:27:38.603013+0000","last_unstale":"2024-09-14T11:51:48.136858+0000","last_undegraded":"2024-09-14T11:51:48.136858+0000","last_fullsized":"2024-09-14T11:51:48.136858+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:49.333416+0000","last_change":"2024-09-14T11:26:04.263990+0000","last_active":"2024-09-14T11:51:49.333416+0000","last_peered":"2024-09-14T11:51:49.333416+0000","last_clean":"2024-09-14T11:51:49.333416+0000","last_became_active":"2024-09-14T11:26:04.263245+0000","last_became_peered":"2024-09-14T11:26:04.263245+0000","last_unstale":"2024-09-14T11:51:49.333416+0000","last_undegraded":"2024-09-14T11:51:49.333416+0000","last_fullsized":"2024-09-14T11:51:49.333416+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.125221+0000","last_change":"2024-09-14T11:38:50.591827+0000","last_active":"2024-09-14T11:50:58.125221+0000","last_peered":"2024-09-14T11:50:58.125221+0000","last_clean":"2024-09-14T11:50:58.125221+0000","last_became_active":"2024-09-14T11:38:50.591033+0000","last_became_peered":"2024-09-14T11:38:50.591033+0000","last_unstale":"2024-09-14T11:50:58.125221+0000","last_undegraded":"2024-09-14T11:50:58.125221+0000","last_fullsized":"2024-09-14T11:50:58.125221+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:09.654882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"264'2","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:23.158433+0000","last_change":"2024-09-14T11:27:41.645102+0000","last_active":"2024-09-14T11:53:23.158433+0000","last_peered":"2024-09-14T11:53:23.158433+0000","last_clean":"2024-09-14T11:53:23.158433+0000","last_became_active":"2024-09-14T11:27:41.634584+0000","last_became_peered":"2024-09-14T11:27:41.634584+0000","last_unstale":"2024-09-14T11:53:23.158433+0000","last_undegraded":"2024-09-14T11:53:23.158433+0000","last_fullsized":"2024-09-14T11:53:23.158433+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:33.590598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:32.685095+0000","last_change":"2024-09-14T11:54:32.685095+0000","last_active":"2024-09-14T11:54:32.685095+0000","last_peered":"2024-09-14T11:54:32.685095+0000","last_clean":"2024-09-14T11:54:32.685095+0000","last_became_active":"2024-09-14T11:27:38.611912+0000","last_became_peered":"2024-09-14T11:27:38.611912+0000","last_unstale":"2024-09-14T11:54:32.685095+0000","last_undegraded":"2024-09-14T11:54:32.685095+0000","last_fullsized":"2024-09-14T11:54:32.685095+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:32.684888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:32.684888+0000","last_clean_scrub_stamp":"2024-09-14T11:54:32.684888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:49.951022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"264'32","reported_seq":135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:44.332084+0000","last_change":"2024-09-14T11:26:04.264797+0000","last_active":"2024-09-14T11:51:44.332084+0000","last_peered":"2024-09-14T11:51:44.332084+0000","last_clean":"2024-09-14T11:51:44.332084+0000","last_became_active":"2024-09-14T11:26:04.264179+0000","last_became_peered":"2024-09-14T11:26:04.264179+0000","last_unstale":"2024-09-14T11:51:44.332084+0000","last_undegraded":"2024-09-14T11:51:44.332084+0000","last_fullsized":"2024-09-14T11:51:44.332084+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":260,"num_read_kb":165,"num_write":79,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.122121+0000","last_change":"2024-09-14T11:38:50.553543+0000","last_active":"2024-09-14T11:50:58.122121+0000","last_peered":"2024-09-14T11:50:58.122121+0000","last_clean":"2024-09-14T11:50:58.122121+0000","last_became_active":"2024-09-14T11:38:50.552891+0000","last_became_peered":"2024-09-14T11:38:50.552891+0000","last_unstale":"2024-09-14T11:50:58.122121+0000","last_undegraded":"2024-09-14T11:50:58.122121+0000","last_fullsized":"2024-09-14T11:50:58.122121+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:10.586101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"261'4","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.126156+0000","last_change":"2024-09-14T11:27:41.643791+0000","last_active":"2024-09-14T11:51:03.126156+0000","last_peered":"2024-09-14T11:51:03.126156+0000","last_clean":"2024-09-14T11:51:03.126156+0000","last_became_active":"2024-09-14T11:27:41.634824+0000","last_became_peered":"2024-09-14T11:27:41.634824+0000","last_unstale":"2024-09-14T11:51:03.126156+0000","last_undegraded":"2024-09-14T11:51:03.126156+0000","last_fullsized":"2024-09-14T11:51:03.126156+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:45.655086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:18.157188+0000","last_change":"2024-09-14T11:27:38.609347+0000","last_active":"2024-09-14T11:53:18.157188+0000","last_peered":"2024-09-14T11:53:18.157188+0000","last_clean":"2024-09-14T11:53:18.157188+0000","last_became_active":"2024-09-14T11:27:38.608412+0000","last_became_peered":"2024-09-14T11:27:38.608412+0000","last_unstale":"2024-09-14T11:53:18.157188+0000","last_undegraded":"2024-09-14T11:53:18.157188+0000","last_fullsized":"2024-09-14T11:53:18.157188+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:24.685660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"264'44","reported_seq":166,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:34.543253+0000","last_change":"2024-09-14T11:54:34.543253+0000","last_active":"2024-09-14T11:54:34.543253+0000","last_peered":"2024-09-14T11:54:34.543253+0000","last_clean":"2024-09-14T11:54:34.543253+0000","last_became_active":"2024-09-14T11:26:04.272026+0000","last_became_peered":"2024-09-14T11:26:04.272026+0000","last_unstale":"2024-09-14T11:54:34.543253+0000","last_undegraded":"2024-09-14T11:54:34.543253+0000","last_fullsized":"2024-09-14T11:54:34.543253+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'44","last_scrub_stamp":"2024-09-14T11:54:34.543061+0000","last_deep_scrub":"264'44","last_deep_scrub_stamp":"2024-09-14T11:54:34.543061+0000","last_clean_scrub_stamp":"2024-09-14T11:54:34.543061+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:37.348884+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":232,"num_write":112,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.115743+0000","last_change":"2024-09-14T11:38:50.576604+0000","last_active":"2024-09-14T11:50:38.115743+0000","last_peered":"2024-09-14T11:50:38.115743+0000","last_clean":"2024-09-14T11:50:38.115743+0000","last_became_active":"2024-09-14T11:38:50.575796+0000","last_became_peered":"2024-09-14T11:38:50.575796+0000","last_unstale":"2024-09-14T11:50:38.115743+0000","last_undegraded":"2024-09-14T11:50:38.115743+0000","last_fullsized":"2024-09-14T11:50:38.115743+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:03.217316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"264'5","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:23.340671+0000","last_change":"2024-09-14T11:27:41.635521+0000","last_active":"2024-09-14T11:53:23.340671+0000","last_peered":"2024-09-14T11:53:23.340671+0000","last_clean":"2024-09-14T11:53:23.340671+0000","last_became_active":"2024-09-14T11:27:41.634402+0000","last_became_peered":"2024-09-14T11:27:41.634402+0000","last_unstale":"2024-09-14T11:53:23.340671+0000","last_undegraded":"2024-09-14T11:53:23.340671+0000","last_fullsized":"2024-09-14T11:53:23.340671+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:27.030127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:35.735915+0000","last_change":"2024-09-14T11:54:35.735915+0000","last_active":"2024-09-14T11:54:35.735915+0000","last_peered":"2024-09-14T11:54:35.735915+0000","last_clean":"2024-09-14T11:54:35.735915+0000","last_became_active":"2024-09-14T11:27:38.609363+0000","last_became_peered":"2024-09-14T11:27:38.609363+0000","last_unstale":"2024-09-14T11:54:35.735915+0000","last_undegraded":"2024-09-14T11:54:35.735915+0000","last_fullsized":"2024-09-14T11:54:35.735915+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:35.735614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:35.735614+0000","last_clean_scrub_stamp":"2024-09-14T11:54:35.735614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:35:41.231749+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"264'17","reported_seq":96,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:35.196987+0000","last_change":"2024-09-14T11:54:35.196987+0000","last_active":"2024-09-14T11:54:35.196987+0000","last_peered":"2024-09-14T11:54:35.196987+0000","last_clean":"2024-09-14T11:54:35.196987+0000","last_became_active":"2024-09-14T11:26:04.261498+0000","last_became_peered":"2024-09-14T11:26:04.261498+0000","last_unstale":"2024-09-14T11:54:35.196987+0000","last_undegraded":"2024-09-14T11:54:35.196987+0000","last_fullsized":"2024-09-14T11:54:35.196987+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'17","last_scrub_stamp":"2024-09-14T11:54:35.196770+0000","last_deep_scrub":"264'17","last_deep_scrub_stamp":"2024-09-14T11:54:35.196770+0000","last_clean_scrub_stamp":"2024-09-14T11:54:35.196770+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:35.021708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":93,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.122005+0000","last_change":"2024-09-14T11:38:50.576965+0000","last_active":"2024-09-14T11:50:58.122005+0000","last_peered":"2024-09-14T11:50:58.122005+0000","last_clean":"2024-09-14T11:50:58.122005+0000","last_became_active":"2024-09-14T11:38:50.576165+0000","last_became_peered":"2024-09-14T11:38:50.576165+0000","last_unstale":"2024-09-14T11:50:58.122005+0000","last_undegraded":"2024-09-14T11:50:58.122005+0000","last_fullsized":"2024-09-14T11:50:58.122005+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:25.583158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"264'2","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.356430+0000","last_change":"2024-09-14T11:27:41.650299+0000","last_active":"2024-09-14T11:53:24.356430+0000","last_peered":"2024-09-14T11:53:24.356430+0000","last_clean":"2024-09-14T11:53:24.356430+0000","last_became_active":"2024-09-14T11:27:41.649598+0000","last_became_peered":"2024-09-14T11:27:41.649598+0000","last_unstale":"2024-09-14T11:53:24.356430+0000","last_undegraded":"2024-09-14T11:53:24.356430+0000","last_fullsized":"2024-09-14T11:53:24.356430+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:10.114521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:39.755998+0000","last_change":"2024-09-14T11:54:39.755998+0000","last_active":"2024-09-14T11:54:39.755998+0000","last_peered":"2024-09-14T11:54:39.755998+0000","last_clean":"2024-09-14T11:54:39.755998+0000","last_became_active":"2024-09-14T11:27:38.598429+0000","last_became_peered":"2024-09-14T11:27:38.598429+0000","last_unstale":"2024-09-14T11:54:39.755998+0000","last_undegraded":"2024-09-14T11:54:39.755998+0000","last_fullsized":"2024-09-14T11:54:39.755998+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:39.755724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:39.755724+0000","last_clean_scrub_stamp":"2024-09-14T11:54:39.755724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:41:24.015461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"264'26","reported_seq":123,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:33.532947+0000","last_change":"2024-09-14T11:54:33.532947+0000","last_active":"2024-09-14T11:54:33.532947+0000","last_peered":"2024-09-14T11:54:33.532947+0000","last_clean":"2024-09-14T11:54:33.532947+0000","last_became_active":"2024-09-14T11:26:04.272216+0000","last_became_peered":"2024-09-14T11:26:04.272216+0000","last_unstale":"2024-09-14T11:54:33.532947+0000","last_undegraded":"2024-09-14T11:54:33.532947+0000","last_fullsized":"2024-09-14T11:54:33.532947+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'26","last_scrub_stamp":"2024-09-14T11:54:33.532773+0000","last_deep_scrub":"264'26","last_deep_scrub_stamp":"2024-09-14T11:54:33.532773+0000","last_clean_scrub_stamp":"2024-09-14T11:54:33.532773+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:59.031617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":141,"num_write":65,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:58.138877+0000","last_change":"2024-09-14T11:38:50.589752+0000","last_active":"2024-09-14T11:51:58.138877+0000","last_peered":"2024-09-14T11:51:58.138877+0000","last_clean":"2024-09-14T11:51:58.138877+0000","last_became_active":"2024-09-14T11:38:50.589121+0000","last_became_peered":"2024-09-14T11:38:50.589121+0000","last_unstale":"2024-09-14T11:51:58.138877+0000","last_undegraded":"2024-09-14T11:51:58.138877+0000","last_fullsized":"2024-09-14T11:51:58.138877+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"261'4","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:28.328325+0000","last_change":"2024-09-14T11:27:41.631708+0000","last_active":"2024-09-14T11:52:28.328325+0000","last_peered":"2024-09-14T11:52:28.328325+0000","last_clean":"2024-09-14T11:52:28.328325+0000","last_became_active":"2024-09-14T11:27:41.630970+0000","last_became_peered":"2024-09-14T11:27:41.630970+0000","last_unstale":"2024-09-14T11:52:28.328325+0000","last_undegraded":"2024-09-14T11:52:28.328325+0000","last_fullsized":"2024-09-14T11:52:28.328325+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:39.125357+0000","last_change":"2024-09-14T11:54:39.125193+0000","last_active":"2024-09-14T11:54:39.125357+0000","last_peered":"2024-09-14T11:54:39.125357+0000","last_clean":"2024-09-14T11:54:39.125357+0000","last_became_active":"2024-09-14T11:27:38.580979+0000","last_became_peered":"2024-09-14T11:27:38.580979+0000","last_unstale":"2024-09-14T11:54:39.125357+0000","last_undegraded":"2024-09-14T11:54:39.125357+0000","last_fullsized":"2024-09-14T11:54:39.125357+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:39.125010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:39.125010+0000","last_clean_scrub_stamp":"2024-09-14T11:54:39.125010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:19.882964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"261'22","reported_seq":114,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:30.439047+0000","last_change":"2024-09-14T11:54:30.439047+0000","last_active":"2024-09-14T11:54:30.439047+0000","last_peered":"2024-09-14T11:54:30.439047+0000","last_clean":"2024-09-14T11:54:30.439047+0000","last_became_active":"2024-09-14T11:26:04.275034+0000","last_became_peered":"2024-09-14T11:26:04.275034+0000","last_unstale":"2024-09-14T11:54:30.439047+0000","last_undegraded":"2024-09-14T11:54:30.439047+0000","last_fullsized":"2024-09-14T11:54:30.439047+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'22","last_scrub_stamp":"2024-09-14T11:54:30.438866+0000","last_deep_scrub":"261'22","last_deep_scrub_stamp":"2024-09-14T11:54:30.438866+0000","last_clean_scrub_stamp":"2024-09-14T11:54:30.438866+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:15.538153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":117,"num_write":55,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:41.821827+0000","last_change":"2024-09-14T11:54:41.821827+0000","last_active":"2024-09-14T11:54:41.821827+0000","last_peered":"2024-09-14T11:54:41.821827+0000","last_clean":"2024-09-14T11:54:41.821827+0000","last_became_active":"2024-09-14T11:38:50.596395+0000","last_became_peered":"2024-09-14T11:38:50.596395+0000","last_unstale":"2024-09-14T11:54:41.821827+0000","last_undegraded":"2024-09-14T11:54:41.821827+0000","last_fullsized":"2024-09-14T11:54:41.821827+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:41.821655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:41.821655+0000","last_clean_scrub_stamp":"2024-09-14T11:54:41.821655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:51.729531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"264'4","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.272236+0000","last_change":"2024-09-14T11:27:41.657302+0000","last_active":"2024-09-14T11:53:57.272236+0000","last_peered":"2024-09-14T11:53:57.272236+0000","last_clean":"2024-09-14T11:53:57.272236+0000","last_became_active":"2024-09-14T11:27:41.656659+0000","last_became_peered":"2024-09-14T11:27:41.656659+0000","last_unstale":"2024-09-14T11:53:57.272236+0000","last_undegraded":"2024-09-14T11:53:57.272236+0000","last_fullsized":"2024-09-14T11:53:57.272236+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":100,"num_write":4,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:39.662124+0000","last_change":"2024-09-14T11:54:39.662124+0000","last_active":"2024-09-14T11:54:39.662124+0000","last_peered":"2024-09-14T11:54:39.662124+0000","last_clean":"2024-09-14T11:54:39.662124+0000","last_became_active":"2024-09-14T11:27:38.604732+0000","last_became_peered":"2024-09-14T11:27:38.604732+0000","last_unstale":"2024-09-14T11:54:39.662124+0000","last_undegraded":"2024-09-14T11:54:39.662124+0000","last_fullsized":"2024-09-14T11:54:39.662124+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:39.661953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:39.661953+0000","last_clean_scrub_stamp":"2024-09-14T11:54:39.661953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:27.640744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"264'35","reported_seq":134,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:49.317370+0000","last_change":"2024-09-14T11:26:04.280000+0000","last_active":"2024-09-14T11:50:49.317370+0000","last_peered":"2024-09-14T11:50:49.317370+0000","last_clean":"2024-09-14T11:50:49.317370+0000","last_became_active":"2024-09-14T11:26:04.279402+0000","last_became_peered":"2024-09-14T11:26:04.279402+0000","last_unstale":"2024-09-14T11:50:49.317370+0000","last_undegraded":"2024-09-14T11:50:49.317370+0000","last_fullsized":"2024-09-14T11:50:49.317370+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:08.691450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":174,"num_write":94,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:54.336661+0000","last_change":"2024-09-14T11:38:50.573603+0000","last_active":"2024-09-14T11:51:54.336661+0000","last_peered":"2024-09-14T11:51:54.336661+0000","last_clean":"2024-09-14T11:51:54.336661+0000","last_became_active":"2024-09-14T11:38:50.573062+0000","last_became_peered":"2024-09-14T11:38:50.573062+0000","last_unstale":"2024-09-14T11:51:54.336661+0000","last_undegraded":"2024-09-14T11:51:54.336661+0000","last_fullsized":"2024-09-14T11:51:54.336661+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"264'7","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.367995+0000","last_change":"2024-09-14T11:27:41.639765+0000","last_active":"2024-09-14T11:53:57.367995+0000","last_peered":"2024-09-14T11:53:57.367995+0000","last_clean":"2024-09-14T11:53:57.367995+0000","last_became_active":"2024-09-14T11:27:41.639051+0000","last_became_peered":"2024-09-14T11:27:41.639051+0000","last_unstale":"2024-09-14T11:53:57.367995+0000","last_undegraded":"2024-09-14T11:53:57.367995+0000","last_fullsized":"2024-09-14T11:53:57.367995+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"264'4","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.453774+0000","last_change":"2024-09-14T11:54:38.453774+0000","last_active":"2024-09-14T11:54:38.453774+0000","last_peered":"2024-09-14T11:54:38.453774+0000","last_clean":"2024-09-14T11:54:38.453774+0000","last_became_active":"2024-09-14T11:27:38.619608+0000","last_became_peered":"2024-09-14T11:27:38.619608+0000","last_unstale":"2024-09-14T11:54:38.453774+0000","last_undegraded":"2024-09-14T11:54:38.453774+0000","last_fullsized":"2024-09-14T11:54:38.453774+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T11:54:38.453594+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T11:54:38.453594+0000","last_clean_scrub_stamp":"2024-09-14T11:54:38.453594+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:36.579941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"264'28","reported_seq":124,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:33.716691+0000","last_change":"2024-09-14T11:54:33.716691+0000","last_active":"2024-09-14T11:54:33.716691+0000","last_peered":"2024-09-14T11:54:33.716691+0000","last_clean":"2024-09-14T11:54:33.716691+0000","last_became_active":"2024-09-14T11:26:04.272960+0000","last_became_peered":"2024-09-14T11:26:04.272960+0000","last_unstale":"2024-09-14T11:54:33.716691+0000","last_undegraded":"2024-09-14T11:54:33.716691+0000","last_fullsized":"2024-09-14T11:54:33.716691+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'28","last_scrub_stamp":"2024-09-14T11:54:33.716463+0000","last_deep_scrub":"264'28","last_deep_scrub_stamp":"2024-09-14T11:54:33.716463+0000","last_clean_scrub_stamp":"2024-09-14T11:54:33.716463+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:37.462810+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":136,"num_write":79,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:37.781649+0000","last_change":"2024-09-14T11:54:37.781649+0000","last_active":"2024-09-14T11:54:37.781649+0000","last_peered":"2024-09-14T11:54:37.781649+0000","last_clean":"2024-09-14T11:54:37.781649+0000","last_became_active":"2024-09-14T11:38:50.569743+0000","last_became_peered":"2024-09-14T11:38:50.569743+0000","last_unstale":"2024-09-14T11:54:37.781649+0000","last_undegraded":"2024-09-14T11:54:37.781649+0000","last_fullsized":"2024-09-14T11:54:37.781649+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:37.781472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:37.781472+0000","last_clean_scrub_stamp":"2024-09-14T11:54:37.781472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:12.956391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"264'5","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.534701+0000","last_change":"2024-09-14T11:27:41.654827+0000","last_active":"2024-09-14T11:53:57.534701+0000","last_peered":"2024-09-14T11:53:57.534701+0000","last_clean":"2024-09-14T11:53:57.534701+0000","last_became_active":"2024-09-14T11:27:41.653929+0000","last_became_peered":"2024-09-14T11:27:41.653929+0000","last_unstale":"2024-09-14T11:53:57.534701+0000","last_undegraded":"2024-09-14T11:53:57.534701+0000","last_fullsized":"2024-09-14T11:53:57.534701+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":118,"num_write":10,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"264'9","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:39.495730+0000","last_change":"2024-09-14T11:54:39.495730+0000","last_active":"2024-09-14T11:54:39.495730+0000","last_peered":"2024-09-14T11:54:39.495730+0000","last_clean":"2024-09-14T11:54:39.495730+0000","last_became_active":"2024-09-14T11:27:38.619441+0000","last_became_peered":"2024-09-14T11:27:38.619441+0000","last_unstale":"2024-09-14T11:54:39.495730+0000","last_undegraded":"2024-09-14T11:54:39.495730+0000","last_fullsized":"2024-09-14T11:54:39.495730+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-09-14T11:54:39.495455+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-09-14T11:54:39.495455+0000","last_clean_scrub_stamp":"2024-09-14T11:54:39.495455+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:33.156798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":21504,"num_write":14,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"264'28","reported_seq":123,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:33.632841+0000","last_change":"2024-09-14T11:54:33.632841+0000","last_active":"2024-09-14T11:54:33.632841+0000","last_peered":"2024-09-14T11:54:33.632841+0000","last_clean":"2024-09-14T11:54:33.632841+0000","last_became_active":"2024-09-14T11:26:04.271747+0000","last_became_peered":"2024-09-14T11:26:04.271747+0000","last_unstale":"2024-09-14T11:54:33.632841+0000","last_undegraded":"2024-09-14T11:54:33.632841+0000","last_fullsized":"2024-09-14T11:54:33.632841+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'28","last_scrub_stamp":"2024-09-14T11:54:33.632646+0000","last_deep_scrub":"264'28","last_deep_scrub_stamp":"2024-09-14T11:54:33.632646+0000","last_clean_scrub_stamp":"2024-09-14T11:54:33.632646+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:32.196817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":132,"num_write":73,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:23.144464+0000","last_change":"2024-09-14T11:38:50.590185+0000","last_active":"2024-09-14T11:52:23.144464+0000","last_peered":"2024-09-14T11:52:23.144464+0000","last_clean":"2024-09-14T11:52:23.144464+0000","last_became_active":"2024-09-14T11:38:50.589444+0000","last_became_peered":"2024-09-14T11:38:50.589444+0000","last_unstale":"2024-09-14T11:52:23.144464+0000","last_undegraded":"2024-09-14T11:52:23.144464+0000","last_fullsized":"2024-09-14T11:52:23.144464+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"261'2","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:34.329581+0000","last_change":"2024-09-14T11:27:41.641002+0000","last_active":"2024-09-14T11:51:34.329581+0000","last_peered":"2024-09-14T11:51:34.329581+0000","last_clean":"2024-09-14T11:51:34.329581+0000","last_became_active":"2024-09-14T11:27:41.640105+0000","last_became_peered":"2024-09-14T11:27:41.640105+0000","last_unstale":"2024-09-14T11:51:34.329581+0000","last_undegraded":"2024-09-14T11:51:34.329581+0000","last_fullsized":"2024-09-14T11:51:34.329581+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:12.987982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"264'11","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:36.499007+0000","last_change":"2024-09-14T11:54:36.499007+0000","last_active":"2024-09-14T11:54:36.499007+0000","last_peered":"2024-09-14T11:54:36.499007+0000","last_clean":"2024-09-14T11:54:36.499007+0000","last_became_active":"2024-09-14T11:27:38.612745+0000","last_became_peered":"2024-09-14T11:27:38.612745+0000","last_unstale":"2024-09-14T11:54:36.499007+0000","last_undegraded":"2024-09-14T11:54:36.499007+0000","last_fullsized":"2024-09-14T11:54:36.499007+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'11","last_scrub_stamp":"2024-09-14T11:54:36.498817+0000","last_deep_scrub":"264'11","last_deep_scrub_stamp":"2024-09-14T11:54:36.498817+0000","last_clean_scrub_stamp":"2024-09-14T11:54:36.498817+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:31.561242+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6207,"num_write":16,"num_write_kb":2107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"264'45","reported_seq":178,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:32.641432+0000","last_change":"2024-09-14T11:54:32.641432+0000","last_active":"2024-09-14T11:54:32.641432+0000","last_peered":"2024-09-14T11:54:32.641432+0000","last_clean":"2024-09-14T11:54:32.641432+0000","last_became_active":"2024-09-14T11:26:04.273309+0000","last_became_peered":"2024-09-14T11:26:04.273309+0000","last_unstale":"2024-09-14T11:54:32.641432+0000","last_undegraded":"2024-09-14T11:54:32.641432+0000","last_fullsized":"2024-09-14T11:54:32.641432+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'45","last_scrub_stamp":"2024-09-14T11:54:32.641166+0000","last_deep_scrub":"264'45","last_deep_scrub_stamp":"2024-09-14T11:54:32.641166+0000","last_clean_scrub_stamp":"2024-09-14T11:54:32.641166+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:40.953471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":376,"num_read_kb":242,"num_write":121,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:44.101834+0000","last_change":"2024-09-14T11:54:44.101704+0000","last_active":"2024-09-14T11:54:44.101834+0000","last_peered":"2024-09-14T11:54:44.101834+0000","last_clean":"2024-09-14T11:54:44.101834+0000","last_became_active":"2024-09-14T11:38:50.596495+0000","last_became_peered":"2024-09-14T11:38:50.596495+0000","last_unstale":"2024-09-14T11:54:44.101834+0000","last_undegraded":"2024-09-14T11:54:44.101834+0000","last_fullsized":"2024-09-14T11:54:44.101834+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:44.101486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:44.101486+0000","last_clean_scrub_stamp":"2024-09-14T11:54:44.101486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:40.560370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"264'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.105445+0000","last_change":"2024-09-14T11:54:43.105445+0000","last_active":"2024-09-14T11:54:43.105445+0000","last_peered":"2024-09-14T11:54:43.105445+0000","last_clean":"2024-09-14T11:54:43.105445+0000","last_became_active":"2024-09-14T11:27:41.650311+0000","last_became_peered":"2024-09-14T11:27:41.650311+0000","last_unstale":"2024-09-14T11:54:43.105445+0000","last_undegraded":"2024-09-14T11:54:43.105445+0000","last_fullsized":"2024-09-14T11:54:43.105445+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-14T11:54:43.105266+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-14T11:54:43.105266+0000","last_clean_scrub_stamp":"2024-09-14T11:54:43.105266+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:17.538352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"264'8","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.167098+0000","last_change":"2024-09-14T11:54:43.167098+0000","last_active":"2024-09-14T11:54:43.167098+0000","last_peered":"2024-09-14T11:54:43.167098+0000","last_clean":"2024-09-14T11:54:43.167098+0000","last_became_active":"2024-09-14T11:27:38.600043+0000","last_became_peered":"2024-09-14T11:27:38.600043+0000","last_unstale":"2024-09-14T11:54:43.167098+0000","last_undegraded":"2024-09-14T11:54:43.167098+0000","last_fullsized":"2024-09-14T11:54:43.167098+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-14T11:54:43.166917+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-14T11:54:43.166917+0000","last_clean_scrub_stamp":"2024-09-14T11:54:43.166917+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:04.371102+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":7170,"num_write":8,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"264'31","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:36.176386+0000","last_change":"2024-09-14T11:54:36.176386+0000","last_active":"2024-09-14T11:54:36.176386+0000","last_peered":"2024-09-14T11:54:36.176386+0000","last_clean":"2024-09-14T11:54:36.176386+0000","last_became_active":"2024-09-14T11:26:04.274089+0000","last_became_peered":"2024-09-14T11:26:04.274089+0000","last_unstale":"2024-09-14T11:54:36.176386+0000","last_undegraded":"2024-09-14T11:54:36.176386+0000","last_fullsized":"2024-09-14T11:54:36.176386+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'31","last_scrub_stamp":"2024-09-14T11:54:36.176207+0000","last_deep_scrub":"264'31","last_deep_scrub_stamp":"2024-09-14T11:54:36.176207+0000","last_clean_scrub_stamp":"2024-09-14T11:54:36.176207+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:32.653650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":254,"num_read_kb":164,"num_write":92,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"264'2","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:35.890706+0000","last_change":"2024-09-14T11:54:35.890556+0000","last_active":"2024-09-14T11:54:35.890706+0000","last_peered":"2024-09-14T11:54:35.890706+0000","last_clean":"2024-09-14T11:54:35.890706+0000","last_became_active":"2024-09-14T11:38:50.592765+0000","last_became_peered":"2024-09-14T11:38:50.592765+0000","last_unstale":"2024-09-14T11:54:35.890706+0000","last_undegraded":"2024-09-14T11:54:35.890706+0000","last_fullsized":"2024-09-14T11:54:35.890706+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:35.890361+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:35.890361+0000","last_clean_scrub_stamp":"2024-09-14T11:54:35.890361+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:43.731599+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"261'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:41.742159+0000","last_change":"2024-09-14T11:54:41.742032+0000","last_active":"2024-09-14T11:54:41.742159+0000","last_peered":"2024-09-14T11:54:41.742159+0000","last_clean":"2024-09-14T11:54:41.742159+0000","last_became_active":"2024-09-14T11:27:41.646962+0000","last_became_peered":"2024-09-14T11:27:41.646962+0000","last_unstale":"2024-09-14T11:54:41.742159+0000","last_undegraded":"2024-09-14T11:54:41.742159+0000","last_fullsized":"2024-09-14T11:54:41.742159+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-14T11:54:41.741821+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-14T11:54:41.741821+0000","last_clean_scrub_stamp":"2024-09-14T11:54:41.741821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:52:34.345872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:37.456892+0000","last_change":"2024-09-14T11:54:37.456892+0000","last_active":"2024-09-14T11:54:37.456892+0000","last_peered":"2024-09-14T11:54:37.456892+0000","last_clean":"2024-09-14T11:54:37.456892+0000","last_became_active":"2024-09-14T11:27:38.612131+0000","last_became_peered":"2024-09-14T11:27:38.612131+0000","last_unstale":"2024-09-14T11:54:37.456892+0000","last_undegraded":"2024-09-14T11:54:37.456892+0000","last_fullsized":"2024-09-14T11:54:37.456892+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:37.456703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:37.456703+0000","last_clean_scrub_stamp":"2024-09-14T11:54:37.456703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:10.593240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"264'14","reported_seq":88,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.175401+0000","last_change":"2024-09-14T11:54:42.175401+0000","last_active":"2024-09-14T11:54:42.175401+0000","last_peered":"2024-09-14T11:54:42.175401+0000","last_clean":"2024-09-14T11:54:42.175401+0000","last_became_active":"2024-09-14T11:26:04.258976+0000","last_became_peered":"2024-09-14T11:26:04.258976+0000","last_unstale":"2024-09-14T11:54:42.175401+0000","last_undegraded":"2024-09-14T11:54:42.175401+0000","last_fullsized":"2024-09-14T11:54:42.175401+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'14","last_scrub_stamp":"2024-09-14T11:54:42.175217+0000","last_deep_scrub":"264'14","last_deep_scrub_stamp":"2024-09-14T11:54:42.175217+0000","last_clean_scrub_stamp":"2024-09-14T11:54:42.175217+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:46.240692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":72,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:23.327131+0000","last_change":"2024-09-14T11:38:50.594382+0000","last_active":"2024-09-14T11:52:23.327131+0000","last_peered":"2024-09-14T11:52:23.327131+0000","last_clean":"2024-09-14T11:52:23.327131+0000","last_became_active":"2024-09-14T11:38:50.593641+0000","last_became_peered":"2024-09-14T11:38:50.593641+0000","last_unstale":"2024-09-14T11:52:23.327131+0000","last_undegraded":"2024-09-14T11:52:23.327131+0000","last_fullsized":"2024-09-14T11:52:23.327131+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"261'7","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.894176+0000","last_change":"2024-09-14T11:54:38.894176+0000","last_active":"2024-09-14T11:54:38.894176+0000","last_peered":"2024-09-14T11:54:38.894176+0000","last_clean":"2024-09-14T11:54:38.894176+0000","last_became_active":"2024-09-14T11:27:41.657112+0000","last_became_peered":"2024-09-14T11:27:41.657112+0000","last_unstale":"2024-09-14T11:54:38.894176+0000","last_undegraded":"2024-09-14T11:54:38.894176+0000","last_fullsized":"2024-09-14T11:54:38.894176+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'7","last_scrub_stamp":"2024-09-14T11:54:38.893981+0000","last_deep_scrub":"261'7","last_deep_scrub_stamp":"2024-09-14T11:54:38.893981+0000","last_clean_scrub_stamp":"2024-09-14T11:54:38.893981+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:56.913823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":6146,"num_write":12,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"264'3","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.352280+0000","last_change":"2024-09-14T11:27:38.605512+0000","last_active":"2024-09-14T11:53:57.352280+0000","last_peered":"2024-09-14T11:53:57.352280+0000","last_clean":"2024-09-14T11:53:57.352280+0000","last_became_active":"2024-09-14T11:27:38.602864+0000","last_became_peered":"2024-09-14T11:27:38.602864+0000","last_unstale":"2024-09-14T11:53:57.352280+0000","last_undegraded":"2024-09-14T11:53:57.352280+0000","last_fullsized":"2024-09-14T11:53:57.352280+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"264'39","reported_seq":161,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:29.897512+0000","last_change":"2024-09-14T11:54:29.897512+0000","last_active":"2024-09-14T11:54:29.897512+0000","last_peered":"2024-09-14T11:54:29.897512+0000","last_clean":"2024-09-14T11:54:29.897512+0000","last_became_active":"2024-09-14T11:26:04.271893+0000","last_became_peered":"2024-09-14T11:26:04.271893+0000","last_unstale":"2024-09-14T11:54:29.897512+0000","last_undegraded":"2024-09-14T11:54:29.897512+0000","last_fullsized":"2024-09-14T11:54:29.897512+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'39","last_scrub_stamp":"2024-09-14T11:54:29.897326+0000","last_deep_scrub":"264'39","last_deep_scrub_stamp":"2024-09-14T11:54:29.897326+0000","last_clean_scrub_stamp":"2024-09-14T11:54:29.897326+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:50.067877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":319,"num_read_kb":212,"num_write":95,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:39.912208+0000","last_change":"2024-09-14T11:54:39.912208+0000","last_active":"2024-09-14T11:54:39.912208+0000","last_peered":"2024-09-14T11:54:39.912208+0000","last_clean":"2024-09-14T11:54:39.912208+0000","last_became_active":"2024-09-14T11:38:50.587827+0000","last_became_peered":"2024-09-14T11:38:50.587827+0000","last_unstale":"2024-09-14T11:54:39.912208+0000","last_undegraded":"2024-09-14T11:54:39.912208+0000","last_fullsized":"2024-09-14T11:54:39.912208+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:39.912020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:39.912020+0000","last_clean_scrub_stamp":"2024-09-14T11:54:39.912020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:38.246467+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"261'5","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:43.121925+0000","last_change":"2024-09-14T11:27:41.652540+0000","last_active":"2024-09-14T11:50:43.121925+0000","last_peered":"2024-09-14T11:50:43.121925+0000","last_clean":"2024-09-14T11:50:43.121925+0000","last_became_active":"2024-09-14T11:27:41.651778+0000","last_became_peered":"2024-09-14T11:27:41.651778+0000","last_unstale":"2024-09-14T11:50:43.121925+0000","last_undegraded":"2024-09-14T11:50:43.121925+0000","last_fullsized":"2024-09-14T11:50:43.121925+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:35.794859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:39.348217+0000","last_change":"2024-09-14T11:27:38.604820+0000","last_active":"2024-09-14T11:52:39.348217+0000","last_peered":"2024-09-14T11:52:39.348217+0000","last_clean":"2024-09-14T11:52:39.348217+0000","last_became_active":"2024-09-14T11:27:38.603954+0000","last_became_peered":"2024-09-14T11:27:38.603954+0000","last_unstale":"2024-09-14T11:52:39.348217+0000","last_undegraded":"2024-09-14T11:52:39.348217+0000","last_fullsized":"2024-09-14T11:52:39.348217+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"264'59","reported_seq":209,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:40.121557+0000","last_change":"2024-09-14T11:54:40.121557+0000","last_active":"2024-09-14T11:54:40.121557+0000","last_peered":"2024-09-14T11:54:40.121557+0000","last_clean":"2024-09-14T11:54:40.121557+0000","last_became_active":"2024-09-14T11:26:04.269206+0000","last_became_peered":"2024-09-14T11:26:04.269206+0000","last_unstale":"2024-09-14T11:54:40.121557+0000","last_undegraded":"2024-09-14T11:54:40.121557+0000","last_fullsized":"2024-09-14T11:54:40.121557+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'59","last_scrub_stamp":"2024-09-14T11:54:40.121338+0000","last_deep_scrub":"264'59","last_deep_scrub_stamp":"2024-09-14T11:54:40.121338+0000","last_clean_scrub_stamp":"2024-09-14T11:54:40.121338+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:16.225468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":473,"num_read_kb":330,"num_write":140,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:34.854153+0000","last_change":"2024-09-14T11:54:34.854153+0000","last_active":"2024-09-14T11:54:34.854153+0000","last_peered":"2024-09-14T11:54:34.854153+0000","last_clean":"2024-09-14T11:54:34.854153+0000","last_became_active":"2024-09-14T11:38:50.585233+0000","last_became_peered":"2024-09-14T11:38:50.585233+0000","last_unstale":"2024-09-14T11:54:34.854153+0000","last_undegraded":"2024-09-14T11:54:34.854153+0000","last_fullsized":"2024-09-14T11:54:34.854153+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:34.853978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:34.853978+0000","last_clean_scrub_stamp":"2024-09-14T11:54:34.853978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:57.638474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"261'4","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.120790+0000","last_change":"2024-09-14T11:27:41.660945+0000","last_active":"2024-09-14T11:50:38.120790+0000","last_peered":"2024-09-14T11:50:38.120790+0000","last_clean":"2024-09-14T11:50:38.120790+0000","last_became_active":"2024-09-14T11:27:41.660286+0000","last_became_peered":"2024-09-14T11:27:41.660286+0000","last_unstale":"2024-09-14T11:50:38.120790+0000","last_undegraded":"2024-09-14T11:50:38.120790+0000","last_fullsized":"2024-09-14T11:50:38.120790+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:47.102264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"261'2","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.115783+0000","last_change":"2024-09-14T11:27:38.594963+0000","last_active":"2024-09-14T11:50:38.115783+0000","last_peered":"2024-09-14T11:50:38.115783+0000","last_clean":"2024-09-14T11:50:38.115783+0000","last_became_active":"2024-09-14T11:27:38.591485+0000","last_became_peered":"2024-09-14T11:27:38.591485+0000","last_unstale":"2024-09-14T11:50:38.115783+0000","last_undegraded":"2024-09-14T11:50:38.115783+0000","last_fullsized":"2024-09-14T11:50:38.115783+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:00.325087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"261'8","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:04.339805+0000","last_change":"2024-09-14T11:26:04.284721+0000","last_active":"2024-09-14T11:52:04.339805+0000","last_peered":"2024-09-14T11:52:04.339805+0000","last_clean":"2024-09-14T11:52:04.339805+0000","last_became_active":"2024-09-14T11:26:04.280724+0000","last_became_peered":"2024-09-14T11:26:04.280724+0000","last_unstale":"2024-09-14T11:52:04.339805+0000","last_undegraded":"2024-09-14T11:52:04.339805+0000","last_fullsized":"2024-09-14T11:52:04.339805+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":39,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.124982+0000","last_change":"2024-09-14T11:38:50.586522+0000","last_active":"2024-09-14T11:50:58.124982+0000","last_peered":"2024-09-14T11:50:58.124982+0000","last_clean":"2024-09-14T11:50:58.124982+0000","last_became_active":"2024-09-14T11:38:50.586004+0000","last_became_peered":"2024-09-14T11:38:50.586004+0000","last_unstale":"2024-09-14T11:50:58.124982+0000","last_undegraded":"2024-09-14T11:50:58.124982+0000","last_fullsized":"2024-09-14T11:50:58.124982+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:21.529496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"264'4","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:33.848101+0000","last_change":"2024-09-14T11:54:33.848101+0000","last_active":"2024-09-14T11:54:33.848101+0000","last_peered":"2024-09-14T11:54:33.848101+0000","last_clean":"2024-09-14T11:54:33.848101+0000","last_became_active":"2024-09-14T11:27:41.656864+0000","last_became_peered":"2024-09-14T11:27:41.656864+0000","last_unstale":"2024-09-14T11:54:33.848101+0000","last_undegraded":"2024-09-14T11:54:33.848101+0000","last_fullsized":"2024-09-14T11:54:33.848101+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T11:54:33.847817+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T11:54:33.847817+0000","last_clean_scrub_stamp":"2024-09-14T11:54:33.847817+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:53.957568+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4123,"num_write":4,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"264'12","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.154931+0000","last_change":"2024-09-14T11:54:38.154931+0000","last_active":"2024-09-14T11:54:38.154931+0000","last_peered":"2024-09-14T11:54:38.154931+0000","last_clean":"2024-09-14T11:54:38.154931+0000","last_became_active":"2024-09-14T11:27:38.597416+0000","last_became_peered":"2024-09-14T11:27:38.597416+0000","last_unstale":"2024-09-14T11:54:38.154931+0000","last_undegraded":"2024-09-14T11:54:38.154931+0000","last_fullsized":"2024-09-14T11:54:38.154931+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'12","last_scrub_stamp":"2024-09-14T11:54:38.154747+0000","last_deep_scrub":"264'12","last_deep_scrub_stamp":"2024-09-14T11:54:38.154747+0000","last_clean_scrub_stamp":"2024-09-14T11:54:38.154747+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:23.115757+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":16434,"num_write":22,"num_write_kb":9264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"264'34","reported_seq":146,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:30.342924+0000","last_change":"2024-09-14T11:54:30.342924+0000","last_active":"2024-09-14T11:54:30.342924+0000","last_peered":"2024-09-14T11:54:30.342924+0000","last_clean":"2024-09-14T11:54:30.342924+0000","last_became_active":"2024-09-14T11:26:04.274720+0000","last_became_peered":"2024-09-14T11:26:04.274720+0000","last_unstale":"2024-09-14T11:54:30.342924+0000","last_undegraded":"2024-09-14T11:54:30.342924+0000","last_fullsized":"2024-09-14T11:54:30.342924+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'34","last_scrub_stamp":"2024-09-14T11:54:30.342736+0000","last_deep_scrub":"264'34","last_deep_scrub_stamp":"2024-09-14T11:54:30.342736+0000","last_clean_scrub_stamp":"2024-09-14T11:54:30.342736+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:59.676057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":267,"num_read_kb":161,"num_write":92,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:24.326912+0000","last_change":"2024-09-14T11:38:50.576319+0000","last_active":"2024-09-14T11:51:24.326912+0000","last_peered":"2024-09-14T11:51:24.326912+0000","last_clean":"2024-09-14T11:51:24.326912+0000","last_became_active":"2024-09-14T11:38:50.575662+0000","last_became_peered":"2024-09-14T11:38:50.575662+0000","last_unstale":"2024-09-14T11:51:24.326912+0000","last_undegraded":"2024-09-14T11:51:24.326912+0000","last_fullsized":"2024-09-14T11:51:24.326912+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:49.815419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:34.329826+0000","last_change":"2024-09-14T11:27:41.653202+0000","last_active":"2024-09-14T11:51:34.329826+0000","last_peered":"2024-09-14T11:51:34.329826+0000","last_clean":"2024-09-14T11:51:34.329826+0000","last_became_active":"2024-09-14T11:27:41.652132+0000","last_became_peered":"2024-09-14T11:27:41.652132+0000","last_unstale":"2024-09-14T11:51:34.329826+0000","last_undegraded":"2024-09-14T11:51:34.329826+0000","last_fullsized":"2024-09-14T11:51:34.329826+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:58.896733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"264'4","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.252163+0000","last_change":"2024-09-14T11:27:38.603010+0000","last_active":"2024-09-14T11:53:57.252163+0000","last_peered":"2024-09-14T11:53:57.252163+0000","last_clean":"2024-09-14T11:53:57.252163+0000","last_became_active":"2024-09-14T11:27:38.602099+0000","last_became_peered":"2024-09-14T11:27:38.602099+0000","last_unstale":"2024-09-14T11:53:57.252163+0000","last_undegraded":"2024-09-14T11:53:57.252163+0000","last_fullsized":"2024-09-14T11:53:57.252163+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:51.969381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"264'30","reported_seq":133,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:31.449672+0000","last_change":"2024-09-14T11:54:31.449672+0000","last_active":"2024-09-14T11:54:31.449672+0000","last_peered":"2024-09-14T11:54:31.449672+0000","last_clean":"2024-09-14T11:54:31.449672+0000","last_became_active":"2024-09-14T11:26:04.265553+0000","last_became_peered":"2024-09-14T11:26:04.265553+0000","last_unstale":"2024-09-14T11:54:31.449672+0000","last_undegraded":"2024-09-14T11:54:31.449672+0000","last_fullsized":"2024-09-14T11:54:31.449672+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'30","last_scrub_stamp":"2024-09-14T11:54:31.449479+0000","last_deep_scrub":"264'30","last_deep_scrub_stamp":"2024-09-14T11:54:31.449479+0000","last_clean_scrub_stamp":"2024-09-14T11:54:31.449479+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:24.468419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":163,"num_write":75,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.317511+0000","last_change":"2024-09-14T11:38:50.587405+0000","last_active":"2024-09-14T11:51:53.317511+0000","last_peered":"2024-09-14T11:51:53.317511+0000","last_clean":"2024-09-14T11:51:53.317511+0000","last_became_active":"2024-09-14T11:38:50.583172+0000","last_became_peered":"2024-09-14T11:38:50.583172+0000","last_unstale":"2024-09-14T11:51:53.317511+0000","last_undegraded":"2024-09-14T11:51:53.317511+0000","last_fullsized":"2024-09-14T11:51:53.317511+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:06.394703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"264'3","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:43.143563+0000","last_change":"2024-09-14T11:27:41.646437+0000","last_active":"2024-09-14T11:52:43.143563+0000","last_peered":"2024-09-14T11:52:43.143563+0000","last_clean":"2024-09-14T11:52:43.143563+0000","last_became_active":"2024-09-14T11:27:41.645631+0000","last_became_peered":"2024-09-14T11:27:41.645631+0000","last_unstale":"2024-09-14T11:52:43.143563+0000","last_undegraded":"2024-09-14T11:52:43.143563+0000","last_fullsized":"2024-09-14T11:52:43.143563+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:11.944240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"261'6","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:32.281053+0000","last_change":"2024-09-14T11:54:32.281053+0000","last_active":"2024-09-14T11:54:32.281053+0000","last_peered":"2024-09-14T11:54:32.281053+0000","last_clean":"2024-09-14T11:54:32.281053+0000","last_became_active":"2024-09-14T11:27:38.597788+0000","last_became_peered":"2024-09-14T11:27:38.597788+0000","last_unstale":"2024-09-14T11:54:32.281053+0000","last_undegraded":"2024-09-14T11:54:32.281053+0000","last_fullsized":"2024-09-14T11:54:32.281053+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-09-14T11:54:32.280860+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-09-14T11:54:32.280860+0000","last_clean_scrub_stamp":"2024-09-14T11:54:32.280860+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:14.084801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4123,"num_write":6,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"264'31","reported_seq":130,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:34.203858+0000","last_change":"2024-09-14T11:54:34.203858+0000","last_active":"2024-09-14T11:54:34.203858+0000","last_peered":"2024-09-14T11:54:34.203858+0000","last_clean":"2024-09-14T11:54:34.203858+0000","last_became_active":"2024-09-14T11:26:04.257219+0000","last_became_peered":"2024-09-14T11:26:04.257219+0000","last_unstale":"2024-09-14T11:54:34.203858+0000","last_undegraded":"2024-09-14T11:54:34.203858+0000","last_fullsized":"2024-09-14T11:54:34.203858+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'31","last_scrub_stamp":"2024-09-14T11:54:34.203639+0000","last_deep_scrub":"264'31","last_deep_scrub_stamp":"2024-09-14T11:54:34.203639+0000","last_clean_scrub_stamp":"2024-09-14T11:54:34.203639+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:33.680445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":127,"num_write":83,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.132228+0000","last_change":"2024-09-14T11:38:50.581794+0000","last_active":"2024-09-14T11:51:53.132228+0000","last_peered":"2024-09-14T11:51:53.132228+0000","last_clean":"2024-09-14T11:51:53.132228+0000","last_became_active":"2024-09-14T11:38:50.581128+0000","last_became_peered":"2024-09-14T11:38:50.581128+0000","last_unstale":"2024-09-14T11:51:53.132228+0000","last_undegraded":"2024-09-14T11:51:53.132228+0000","last_fullsized":"2024-09-14T11:51:53.132228+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"264'3","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:54.138947+0000","last_change":"2024-09-14T11:27:41.653209+0000","last_active":"2024-09-14T11:53:54.138947+0000","last_peered":"2024-09-14T11:53:54.138947+0000","last_clean":"2024-09-14T11:53:54.138947+0000","last_became_active":"2024-09-14T11:27:41.652549+0000","last_became_peered":"2024-09-14T11:27:41.652549+0000","last_unstale":"2024-09-14T11:53:54.138947+0000","last_undegraded":"2024-09-14T11:53:54.138947+0000","last_fullsized":"2024-09-14T11:53:54.138947+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:00.987136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"264'6","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.335876+0000","last_change":"2024-09-14T11:27:38.610165+0000","last_active":"2024-09-14T11:53:57.335876+0000","last_peered":"2024-09-14T11:53:57.335876+0000","last_clean":"2024-09-14T11:53:57.335876+0000","last_became_active":"2024-09-14T11:27:38.609483+0000","last_became_peered":"2024-09-14T11:27:38.609483+0000","last_unstale":"2024-09-14T11:53:57.335876+0000","last_undegraded":"2024-09-14T11:53:57.335876+0000","last_fullsized":"2024-09-14T11:53:57.335876+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:37.552386+0000","last_clean_scrub_stamp":"2024-09-14T11:27:37.552386+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12292,"num_write":6,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"264'27","reported_seq":114,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:43.442305+0000","last_change":"2024-09-14T11:26:04.269191+0000","last_active":"2024-09-14T11:51:43.442305+0000","last_peered":"2024-09-14T11:51:43.442305+0000","last_clean":"2024-09-14T11:51:43.442305+0000","last_became_active":"2024-09-14T11:26:04.268338+0000","last_became_peered":"2024-09-14T11:26:04.268338+0000","last_unstale":"2024-09-14T11:51:43.442305+0000","last_undegraded":"2024-09-14T11:51:43.442305+0000","last_fullsized":"2024-09-14T11:51:43.442305+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:41.961353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":125,"num_write":73,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.130723+0000","last_change":"2024-09-14T11:38:50.590316+0000","last_active":"2024-09-14T11:51:23.130723+0000","last_peered":"2024-09-14T11:51:23.130723+0000","last_clean":"2024-09-14T11:51:23.130723+0000","last_became_active":"2024-09-14T11:38:50.589588+0000","last_became_peered":"2024-09-14T11:38:50.589588+0000","last_unstale":"2024-09-14T11:51:23.130723+0000","last_undegraded":"2024-09-14T11:51:23.130723+0000","last_fullsized":"2024-09-14T11:51:23.130723+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:24.259049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"264'2","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:40.102585+0000","last_change":"2024-09-14T11:54:40.102585+0000","last_active":"2024-09-14T11:54:40.102585+0000","last_peered":"2024-09-14T11:54:40.102585+0000","last_clean":"2024-09-14T11:54:40.102585+0000","last_became_active":"2024-09-14T11:27:41.642400+0000","last_became_peered":"2024-09-14T11:27:41.642400+0000","last_unstale":"2024-09-14T11:54:40.102585+0000","last_undegraded":"2024-09-14T11:54:40.102585+0000","last_fullsized":"2024-09-14T11:54:40.102585+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:40.102397+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:40.102397+0000","last_clean_scrub_stamp":"2024-09-14T11:54:40.102397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:43.831109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"261'5","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.690174+0000","last_change":"2024-09-14T11:54:38.689979+0000","last_active":"2024-09-14T11:54:38.690174+0000","last_peered":"2024-09-14T11:54:38.690174+0000","last_clean":"2024-09-14T11:54:38.690174+0000","last_became_active":"2024-09-14T11:27:38.587990+0000","last_became_peered":"2024-09-14T11:27:38.587990+0000","last_unstale":"2024-09-14T11:54:38.690174+0000","last_undegraded":"2024-09-14T11:54:38.690174+0000","last_fullsized":"2024-09-14T11:54:38.690174+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-14T11:54:38.689786+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-14T11:54:38.689786+0000","last_clean_scrub_stamp":"2024-09-14T11:54:38.689786+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:38.094890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"264'55","reported_seq":192,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:43.699139+0000","last_change":"2024-09-14T11:26:04.258664+0000","last_active":"2024-09-14T11:51:43.699139+0000","last_peered":"2024-09-14T11:51:43.699139+0000","last_clean":"2024-09-14T11:51:43.699139+0000","last_became_active":"2024-09-14T11:26:04.257926+0000","last_became_peered":"2024-09-14T11:26:04.257926+0000","last_unstale":"2024-09-14T11:51:43.699139+0000","last_undegraded":"2024-09-14T11:51:43.699139+0000","last_fullsized":"2024-09-14T11:51:43.699139+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:03.211582+0000","last_clean_scrub_stamp":"2024-09-14T11:26:03.211582+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:33.436039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":423,"num_read_kb":280,"num_write":136,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:24.327084+0000","last_change":"2024-09-14T11:38:50.587747+0000","last_active":"2024-09-14T11:51:24.327084+0000","last_peered":"2024-09-14T11:51:24.327084+0000","last_clean":"2024-09-14T11:51:24.327084+0000","last_became_active":"2024-09-14T11:38:50.581923+0000","last_became_peered":"2024-09-14T11:38:50.581923+0000","last_unstale":"2024-09-14T11:51:24.327084+0000","last_undegraded":"2024-09-14T11:51:24.327084+0000","last_fullsized":"2024-09-14T11:51:24.327084+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:40.481426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:37.158020+0000","last_change":"2024-09-14T11:54:37.158020+0000","last_active":"2024-09-14T11:54:37.158020+0000","last_peered":"2024-09-14T11:54:37.158020+0000","last_clean":"2024-09-14T11:54:37.158020+0000","last_became_active":"2024-09-14T11:27:41.634692+0000","last_became_peered":"2024-09-14T11:27:41.634692+0000","last_unstale":"2024-09-14T11:54:37.158020+0000","last_undegraded":"2024-09-14T11:54:37.158020+0000","last_fullsized":"2024-09-14T11:54:37.158020+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:37.157845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:37.157845+0000","last_clean_scrub_stamp":"2024-09-14T11:54:37.157845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:26.919415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"264'8","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:34.689968+0000","last_change":"2024-09-14T11:54:34.689836+0000","last_active":"2024-09-14T11:54:34.689968+0000","last_peered":"2024-09-14T11:54:34.689968+0000","last_clean":"2024-09-14T11:54:34.689968+0000","last_became_active":"2024-09-14T11:27:38.612443+0000","last_became_peered":"2024-09-14T11:27:38.612443+0000","last_unstale":"2024-09-14T11:54:34.689968+0000","last_undegraded":"2024-09-14T11:54:34.689968+0000","last_fullsized":"2024-09-14T11:54:34.689968+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-14T11:54:34.689645+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-14T11:54:34.689645+0000","last_clean_scrub_stamp":"2024-09-14T11:54:34.689645+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:54.340768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16386,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"264'61","reported_seq":217,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:29.342302+0000","last_change":"2024-09-14T11:54:29.342302+0000","last_active":"2024-09-14T11:54:29.342302+0000","last_peered":"2024-09-14T11:54:29.342302+0000","last_clean":"2024-09-14T11:54:29.342302+0000","last_became_active":"2024-09-14T11:26:04.263498+0000","last_became_peered":"2024-09-14T11:26:04.263498+0000","last_unstale":"2024-09-14T11:54:29.342302+0000","last_undegraded":"2024-09-14T11:54:29.342302+0000","last_fullsized":"2024-09-14T11:54:29.342302+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'61","last_scrub_stamp":"2024-09-14T11:54:29.342123+0000","last_deep_scrub":"264'61","last_deep_scrub_stamp":"2024-09-14T11:54:29.342123+0000","last_clean_scrub_stamp":"2024-09-14T11:54:29.342123+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:20.972202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":491,"num_read_kb":357,"num_write":145,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"264'200","reported_seq":928,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.744180+0000","last_change":"2024-09-14T11:54:09.744180+0000","last_active":"2024-09-14T11:54:09.744180+0000","last_peered":"2024-09-14T11:54:09.744180+0000","last_clean":"2024-09-14T11:54:09.744180+0000","last_became_active":"2024-09-14T11:09:45.212881+0000","last_became_peered":"2024-09-14T11:09:45.212881+0000","last_unstale":"2024-09-14T11:54:09.744180+0000","last_undegraded":"2024-09-14T11:54:09.744180+0000","last_fullsized":"2024-09-14T11:54:09.744180+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'200","last_scrub_stamp":"2024-09-14T11:54:09.743907+0000","last_deep_scrub":"264'200","last_deep_scrub_stamp":"2024-09-14T11:54:09.743907+0000","last_clean_scrub_stamp":"2024-09-14T11:54:09.743907+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:12.346884+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":928,"num_read_kb":39441,"num_write":967,"num_write_kb":29636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"264'510","reported_seq":2117,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.589663+0000","last_change":"2024-09-14T11:54:15.589663+0000","last_active":"2024-09-14T11:54:15.589663+0000","last_peered":"2024-09-14T11:54:15.589663+0000","last_clean":"2024-09-14T11:54:15.589663+0000","last_became_active":"2024-09-14T11:09:46.960069+0000","last_became_peered":"2024-09-14T11:09:46.960069+0000","last_unstale":"2024-09-14T11:54:15.589663+0000","last_undegraded":"2024-09-14T11:54:15.589663+0000","last_fullsized":"2024-09-14T11:54:15.589663+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'510","last_scrub_stamp":"2024-09-14T11:54:15.589488+0000","last_deep_scrub":"264'510","last_deep_scrub_stamp":"2024-09-14T11:54:15.589488+0000","last_clean_scrub_stamp":"2024-09-14T11:54:15.589488+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:03.452431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2624,"num_read_kb":2455,"num_write":621,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"264'213","reported_seq":869,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:16.081574+0000","last_change":"2024-09-14T11:54:16.081574+0000","last_active":"2024-09-14T11:54:16.081574+0000","last_peered":"2024-09-14T11:54:16.081574+0000","last_clean":"2024-09-14T11:54:16.081574+0000","last_became_active":"2024-09-14T11:09:45.211049+0000","last_became_peered":"2024-09-14T11:09:45.211049+0000","last_unstale":"2024-09-14T11:54:16.081574+0000","last_undegraded":"2024-09-14T11:54:16.081574+0000","last_fullsized":"2024-09-14T11:54:16.081574+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'213","last_scrub_stamp":"2024-09-14T11:54:16.081321+0000","last_deep_scrub":"264'213","last_deep_scrub_stamp":"2024-09-14T11:54:16.081321+0000","last_clean_scrub_stamp":"2024-09-14T11:54:16.081321+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:38.768993+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":540,"num_read_kb":70257,"num_write":1018,"num_write_kb":34950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"264'761","reported_seq":2295,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:25.917678+0000","last_change":"2024-09-14T11:54:25.917678+0000","last_active":"2024-09-14T11:54:25.917678+0000","last_peered":"2024-09-14T11:54:25.917678+0000","last_clean":"2024-09-14T11:54:25.917678+0000","last_became_active":"2024-09-14T11:09:46.957446+0000","last_became_peered":"2024-09-14T11:09:46.957446+0000","last_unstale":"2024-09-14T11:54:25.917678+0000","last_undegraded":"2024-09-14T11:54:25.917678+0000","last_fullsized":"2024-09-14T11:54:25.917678+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'761","last_scrub_stamp":"2024-09-14T11:54:25.917475+0000","last_deep_scrub":"264'761","last_deep_scrub_stamp":"2024-09-14T11:54:25.917475+0000","last_clean_scrub_stamp":"2024-09-14T11:54:25.917475+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:18:02.157703+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3644,"num_read_kb":3296,"num_write":998,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"264'185","reported_seq":815,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.081219+0000","last_change":"2024-09-14T11:54:15.081219+0000","last_active":"2024-09-14T11:54:15.081219+0000","last_peered":"2024-09-14T11:54:15.081219+0000","last_clean":"2024-09-14T11:54:15.081219+0000","last_became_active":"2024-09-14T11:09:45.207458+0000","last_became_peered":"2024-09-14T11:09:45.207458+0000","last_unstale":"2024-09-14T11:54:15.081219+0000","last_undegraded":"2024-09-14T11:54:15.081219+0000","last_fullsized":"2024-09-14T11:54:15.081219+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'185","last_scrub_stamp":"2024-09-14T11:54:15.080970+0000","last_deep_scrub":"264'185","last_deep_scrub_stamp":"2024-09-14T11:54:15.080970+0000","last_clean_scrub_stamp":"2024-09-14T11:54:15.080970+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:43.319269+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":12475,"num_write":826,"num_write_kb":33777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"264'375","reported_seq":1906,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.931959+0000","last_change":"2024-09-14T11:54:26.931959+0000","last_active":"2024-09-14T11:54:26.931959+0000","last_peered":"2024-09-14T11:54:26.931959+0000","last_clean":"2024-09-14T11:54:26.931959+0000","last_became_active":"2024-09-14T11:09:46.950652+0000","last_became_peered":"2024-09-14T11:09:46.950652+0000","last_unstale":"2024-09-14T11:54:26.931959+0000","last_undegraded":"2024-09-14T11:54:26.931959+0000","last_fullsized":"2024-09-14T11:54:26.931959+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'375","last_scrub_stamp":"2024-09-14T11:54:26.931723+0000","last_deep_scrub":"264'375","last_deep_scrub_stamp":"2024-09-14T11:54:26.931723+0000","last_clean_scrub_stamp":"2024-09-14T11:54:26.931723+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:44.924195+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2108,"num_read_kb":2030,"num_write":424,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"264'209","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:16.405568+0000","last_change":"2024-09-14T11:54:16.405568+0000","last_active":"2024-09-14T11:54:16.405568+0000","last_peered":"2024-09-14T11:54:16.405568+0000","last_clean":"2024-09-14T11:54:16.405568+0000","last_became_active":"2024-09-14T11:09:45.185702+0000","last_became_peered":"2024-09-14T11:09:45.185702+0000","last_unstale":"2024-09-14T11:54:16.405568+0000","last_undegraded":"2024-09-14T11:54:16.405568+0000","last_fullsized":"2024-09-14T11:54:16.405568+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'209","last_scrub_stamp":"2024-09-14T11:54:16.405308+0000","last_deep_scrub":"264'209","last_deep_scrub_stamp":"2024-09-14T11:54:16.405308+0000","last_clean_scrub_stamp":"2024-09-14T11:54:16.405308+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:37.330840+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":495,"num_read_kb":15356,"num_write":918,"num_write_kb":51388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"264'416","reported_seq":1980,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.753329+0000","last_change":"2024-09-14T11:54:18.753329+0000","last_active":"2024-09-14T11:54:18.753329+0000","last_peered":"2024-09-14T11:54:18.753329+0000","last_clean":"2024-09-14T11:54:18.753329+0000","last_became_active":"2024-09-14T11:09:46.952230+0000","last_became_peered":"2024-09-14T11:09:46.952230+0000","last_unstale":"2024-09-14T11:54:18.753329+0000","last_undegraded":"2024-09-14T11:54:18.753329+0000","last_fullsized":"2024-09-14T11:54:18.753329+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'416","last_scrub_stamp":"2024-09-14T11:54:18.753111+0000","last_deep_scrub":"264'416","last_deep_scrub_stamp":"2024-09-14T11:54:18.753111+0000","last_clean_scrub_stamp":"2024-09-14T11:54:18.753111+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:38.004375+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2399,"num_read_kb":2276,"num_write":503,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"264'177","reported_seq":754,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.268410+0000","last_change":"2024-09-14T11:54:08.268410+0000","last_active":"2024-09-14T11:54:08.268410+0000","last_peered":"2024-09-14T11:54:08.268410+0000","last_clean":"2024-09-14T11:54:08.268410+0000","last_became_active":"2024-09-14T11:10:22.254947+0000","last_became_peered":"2024-09-14T11:10:22.254947+0000","last_unstale":"2024-09-14T11:54:08.268410+0000","last_undegraded":"2024-09-14T11:54:08.268410+0000","last_fullsized":"2024-09-14T11:54:08.268410+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-09-14T11:54:08.268210+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-09-14T11:54:08.268210+0000","last_clean_scrub_stamp":"2024-09-14T11:54:08.268210+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:14.156723+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":441,"num_read_kb":20000,"num_write":788,"num_write_kb":32213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'368","reported_seq":1761,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.799314+0000","last_change":"2024-09-14T11:54:17.799314+0000","last_active":"2024-09-14T11:54:17.799314+0000","last_peered":"2024-09-14T11:54:17.799314+0000","last_clean":"2024-09-14T11:54:17.799314+0000","last_became_active":"2024-09-14T11:09:46.962586+0000","last_became_peered":"2024-09-14T11:09:46.962586+0000","last_unstale":"2024-09-14T11:54:17.799314+0000","last_undegraded":"2024-09-14T11:54:17.799314+0000","last_fullsized":"2024-09-14T11:54:17.799314+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'368","last_scrub_stamp":"2024-09-14T11:54:17.799119+0000","last_deep_scrub":"264'368","last_deep_scrub_stamp":"2024-09-14T11:54:17.799119+0000","last_clean_scrub_stamp":"2024-09-14T11:54:17.799119+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:30:09.942238+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1989,"num_read_kb":1876,"num_write":428,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"264'210","reported_seq":845,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.412736+0000","last_change":"2024-09-14T11:54:10.412736+0000","last_active":"2024-09-14T11:54:10.412736+0000","last_peered":"2024-09-14T11:54:10.412736+0000","last_clean":"2024-09-14T11:54:10.412736+0000","last_became_active":"2024-09-14T11:09:45.187149+0000","last_became_peered":"2024-09-14T11:09:45.187149+0000","last_unstale":"2024-09-14T11:54:10.412736+0000","last_undegraded":"2024-09-14T11:54:10.412736+0000","last_fullsized":"2024-09-14T11:54:10.412736+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'210","last_scrub_stamp":"2024-09-14T11:54:10.412544+0000","last_deep_scrub":"264'210","last_deep_scrub_stamp":"2024-09-14T11:54:10.412544+0000","last_clean_scrub_stamp":"2024-09-14T11:54:10.412544+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:47.711478+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":555,"num_read_kb":3965,"num_write":975,"num_write_kb":31222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"264'787","reported_seq":2330,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.801159+0000","last_change":"2024-09-14T11:54:14.801159+0000","last_active":"2024-09-14T11:54:14.801159+0000","last_peered":"2024-09-14T11:54:14.801159+0000","last_clean":"2024-09-14T11:54:14.801159+0000","last_became_active":"2024-09-14T11:09:46.990102+0000","last_became_peered":"2024-09-14T11:09:46.990102+0000","last_unstale":"2024-09-14T11:54:14.801159+0000","last_undegraded":"2024-09-14T11:54:14.801159+0000","last_fullsized":"2024-09-14T11:54:14.801159+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'787","last_scrub_stamp":"2024-09-14T11:54:14.800969+0000","last_deep_scrub":"264'787","last_deep_scrub_stamp":"2024-09-14T11:54:14.800969+0000","last_clean_scrub_stamp":"2024-09-14T11:54:14.800969+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:44.286981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3903,"num_read_kb":3531,"num_write":1063,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"264'334","reported_seq":1003,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.759698+0000","last_change":"2024-09-14T11:54:10.759698+0000","last_active":"2024-09-14T11:54:10.759698+0000","last_peered":"2024-09-14T11:54:10.759698+0000","last_clean":"2024-09-14T11:54:10.759698+0000","last_became_active":"2024-09-14T11:09:45.204885+0000","last_became_peered":"2024-09-14T11:09:45.204885+0000","last_unstale":"2024-09-14T11:54:10.759698+0000","last_undegraded":"2024-09-14T11:54:10.759698+0000","last_fullsized":"2024-09-14T11:54:10.759698+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'334","last_scrub_stamp":"2024-09-14T11:54:10.759384+0000","last_deep_scrub":"264'334","last_deep_scrub_stamp":"2024-09-14T11:54:10.759384+0000","last_clean_scrub_stamp":"2024-09-14T11:54:10.759384+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:40.347879+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":904,"num_read_kb":1363,"num_write":1218,"num_write_kb":28416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"264'787","reported_seq":2369,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:12.434039+0000","last_change":"2024-09-14T11:54:12.434039+0000","last_active":"2024-09-14T11:54:12.434039+0000","last_peered":"2024-09-14T11:54:12.434039+0000","last_clean":"2024-09-14T11:54:12.434039+0000","last_became_active":"2024-09-14T11:09:46.951098+0000","last_became_peered":"2024-09-14T11:09:46.951098+0000","last_unstale":"2024-09-14T11:54:12.434039+0000","last_undegraded":"2024-09-14T11:54:12.434039+0000","last_fullsized":"2024-09-14T11:54:12.434039+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'787","last_scrub_stamp":"2024-09-14T11:54:12.433859+0000","last_deep_scrub":"264'787","last_deep_scrub_stamp":"2024-09-14T11:54:12.433859+0000","last_clean_scrub_stamp":"2024-09-14T11:54:12.433859+0000","objects_scrubbed":3,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:51.937141+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3820,"num_read_kb":3459,"num_write":1035,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"264'223","reported_seq":860,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.106645+0000","last_change":"2024-09-14T11:54:14.106645+0000","last_active":"2024-09-14T11:54:14.106645+0000","last_peered":"2024-09-14T11:54:14.106645+0000","last_clean":"2024-09-14T11:54:14.106645+0000","last_became_active":"2024-09-14T11:09:45.207406+0000","last_became_peered":"2024-09-14T11:09:45.207406+0000","last_unstale":"2024-09-14T11:54:14.106645+0000","last_undegraded":"2024-09-14T11:54:14.106645+0000","last_fullsized":"2024-09-14T11:54:14.106645+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'223","last_scrub_stamp":"2024-09-14T11:54:14.106465+0000","last_deep_scrub":"264'223","last_deep_scrub_stamp":"2024-09-14T11:54:14.106465+0000","last_clean_scrub_stamp":"2024-09-14T11:54:14.106465+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:53.896261+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":519,"num_read_kb":35149,"num_write":962,"num_write_kb":45963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"264'416","reported_seq":1964,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:25.077318+0000","last_change":"2024-09-14T11:54:25.077318+0000","last_active":"2024-09-14T11:54:25.077318+0000","last_peered":"2024-09-14T11:54:25.077318+0000","last_clean":"2024-09-14T11:54:25.077318+0000","last_became_active":"2024-09-14T11:09:46.995237+0000","last_became_peered":"2024-09-14T11:09:46.995237+0000","last_unstale":"2024-09-14T11:54:25.077318+0000","last_undegraded":"2024-09-14T11:54:25.077318+0000","last_fullsized":"2024-09-14T11:54:25.077318+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'416","last_scrub_stamp":"2024-09-14T11:54:25.077145+0000","last_deep_scrub":"264'416","last_deep_scrub_stamp":"2024-09-14T11:54:25.077145+0000","last_clean_scrub_stamp":"2024-09-14T11:54:25.077145+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:26.584597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2305,"num_read_kb":2183,"num_write":489,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"264'598","reported_seq":2224,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.893793+0000","last_change":"2024-09-14T11:54:27.893793+0000","last_active":"2024-09-14T11:54:27.893793+0000","last_peered":"2024-09-14T11:54:27.893793+0000","last_clean":"2024-09-14T11:54:27.893793+0000","last_became_active":"2024-09-14T11:09:46.959477+0000","last_became_peered":"2024-09-14T11:09:46.959477+0000","last_unstale":"2024-09-14T11:54:27.893793+0000","last_undegraded":"2024-09-14T11:54:27.893793+0000","last_fullsized":"2024-09-14T11:54:27.893793+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'598","last_scrub_stamp":"2024-09-14T11:54:27.893571+0000","last_deep_scrub":"264'598","last_deep_scrub_stamp":"2024-09-14T11:54:27.893571+0000","last_clean_scrub_stamp":"2024-09-14T11:54:27.893571+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":500,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:23.191112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3034,"num_read_kb":2795,"num_write":758,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"264'221","reported_seq":858,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:03.641120+0000","last_change":"2024-09-14T11:54:03.641120+0000","last_active":"2024-09-14T11:54:03.641120+0000","last_peered":"2024-09-14T11:54:03.641120+0000","last_clean":"2024-09-14T11:54:03.641120+0000","last_became_active":"2024-09-14T11:09:45.204030+0000","last_became_peered":"2024-09-14T11:09:45.204030+0000","last_unstale":"2024-09-14T11:54:03.641120+0000","last_undegraded":"2024-09-14T11:54:03.641120+0000","last_fullsized":"2024-09-14T11:54:03.641120+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'221","last_scrub_stamp":"2024-09-14T11:54:03.641022+0000","last_deep_scrub":"264'221","last_deep_scrub_stamp":"2024-09-14T11:54:03.641022+0000","last_clean_scrub_stamp":"2024-09-14T11:54:03.641022+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:40.015512+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655875,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":529,"num_read_kb":23907,"num_write":1077,"num_write_kb":37253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"264'525","reported_seq":2144,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.763390+0000","last_change":"2024-09-14T11:54:13.763390+0000","last_active":"2024-09-14T11:54:13.763390+0000","last_peered":"2024-09-14T11:54:13.763390+0000","last_clean":"2024-09-14T11:54:13.763390+0000","last_became_active":"2024-09-14T11:09:46.970750+0000","last_became_peered":"2024-09-14T11:09:46.970750+0000","last_unstale":"2024-09-14T11:54:13.763390+0000","last_undegraded":"2024-09-14T11:54:13.763390+0000","last_fullsized":"2024-09-14T11:54:13.763390+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'525","last_scrub_stamp":"2024-09-14T11:54:13.763206+0000","last_deep_scrub":"264'525","last_deep_scrub_stamp":"2024-09-14T11:54:13.763206+0000","last_clean_scrub_stamp":"2024-09-14T11:54:13.763206+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:17.444401+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2805,"num_read_kb":2599,"num_write":647,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":501,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"264'221","reported_seq":867,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.776030+0000","last_change":"2024-09-14T11:54:11.776030+0000","last_active":"2024-09-14T11:54:11.776030+0000","last_peered":"2024-09-14T11:54:11.776030+0000","last_clean":"2024-09-14T11:54:11.776030+0000","last_became_active":"2024-09-14T11:09:45.206812+0000","last_became_peered":"2024-09-14T11:09:45.206812+0000","last_unstale":"2024-09-14T11:54:11.776030+0000","last_undegraded":"2024-09-14T11:54:11.776030+0000","last_fullsized":"2024-09-14T11:54:11.776030+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'221","last_scrub_stamp":"2024-09-14T11:54:11.775812+0000","last_deep_scrub":"264'221","last_deep_scrub_stamp":"2024-09-14T11:54:11.775812+0000","last_clean_scrub_stamp":"2024-09-14T11:54:11.775812+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:44.723127+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":566,"num_read_kb":32523,"num_write":996,"num_write_kb":41963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"264'854","reported_seq":2587,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:12.504366+0000","last_change":"2024-09-14T11:54:12.504111+0000","last_active":"2024-09-14T11:54:12.504366+0000","last_peered":"2024-09-14T11:54:12.504366+0000","last_clean":"2024-09-14T11:54:12.504366+0000","last_became_active":"2024-09-14T11:09:46.975135+0000","last_became_peered":"2024-09-14T11:09:46.975135+0000","last_unstale":"2024-09-14T11:54:12.504366+0000","last_undegraded":"2024-09-14T11:54:12.504366+0000","last_fullsized":"2024-09-14T11:54:12.504366+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'854","last_scrub_stamp":"2024-09-14T11:54:12.503845+0000","last_deep_scrub":"264'854","last_deep_scrub_stamp":"2024-09-14T11:54:12.503845+0000","last_clean_scrub_stamp":"2024-09-14T11:54:12.503845+0000","objects_scrubbed":4,"log_size":54,"log_dups_size":800,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:18.835875+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4353,"num_read_kb":3966,"num_write":1152,"num_write_kb":464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2705,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"264'182","reported_seq":790,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.665227+0000","last_change":"2024-09-14T11:54:07.665227+0000","last_active":"2024-09-14T11:54:07.665227+0000","last_peered":"2024-09-14T11:54:07.665227+0000","last_clean":"2024-09-14T11:54:07.665227+0000","last_became_active":"2024-09-14T11:09:45.208314+0000","last_became_peered":"2024-09-14T11:09:45.208314+0000","last_unstale":"2024-09-14T11:54:07.665227+0000","last_undegraded":"2024-09-14T11:54:07.665227+0000","last_fullsized":"2024-09-14T11:54:07.665227+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'182","last_scrub_stamp":"2024-09-14T11:54:07.665056+0000","last_deep_scrub":"264'182","last_deep_scrub_stamp":"2024-09-14T11:54:07.665056+0000","last_clean_scrub_stamp":"2024-09-14T11:54:07.665056+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:37.478334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":417,"num_read_kb":7778,"num_write":841,"num_write_kb":25761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"264'905","reported_seq":2671,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:16.634553+0000","last_change":"2024-09-14T11:54:16.634553+0000","last_active":"2024-09-14T11:54:16.634553+0000","last_peered":"2024-09-14T11:54:16.634553+0000","last_clean":"2024-09-14T11:54:16.634553+0000","last_became_active":"2024-09-14T11:09:46.995182+0000","last_became_peered":"2024-09-14T11:09:46.995182+0000","last_unstale":"2024-09-14T11:54:16.634553+0000","last_undegraded":"2024-09-14T11:54:16.634553+0000","last_fullsized":"2024-09-14T11:54:16.634553+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'905","last_scrub_stamp":"2024-09-14T11:54:16.634329+0000","last_deep_scrub":"264'905","last_deep_scrub_stamp":"2024-09-14T11:54:16.634329+0000","last_clean_scrub_stamp":"2024-09-14T11:54:16.634329+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":800,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:39.480551+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4411,"num_read_kb":3995,"num_write":1182,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2289,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"264'216","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:03.748922+0000","last_change":"2024-09-14T11:54:03.748922+0000","last_active":"2024-09-14T11:54:03.748922+0000","last_peered":"2024-09-14T11:54:03.748922+0000","last_clean":"2024-09-14T11:54:03.748922+0000","last_became_active":"2024-09-14T11:09:45.215301+0000","last_became_peered":"2024-09-14T11:09:45.215301+0000","last_unstale":"2024-09-14T11:54:03.748922+0000","last_undegraded":"2024-09-14T11:54:03.748922+0000","last_fullsized":"2024-09-14T11:54:03.748922+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'216","last_scrub_stamp":"2024-09-14T11:54:03.748839+0000","last_deep_scrub":"264'216","last_deep_scrub_stamp":"2024-09-14T11:54:03.748839+0000","last_clean_scrub_stamp":"2024-09-14T11:54:03.748839+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:24.385373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":450,"num_read_kb":16973,"num_write":902,"num_write_kb":40194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"264'435","reported_seq":1986,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.069899+0000","last_change":"2024-09-14T11:54:24.069899+0000","last_active":"2024-09-14T11:54:24.069899+0000","last_peered":"2024-09-14T11:54:24.069899+0000","last_clean":"2024-09-14T11:54:24.069899+0000","last_became_active":"2024-09-14T11:09:46.974465+0000","last_became_peered":"2024-09-14T11:09:46.974465+0000","last_unstale":"2024-09-14T11:54:24.069899+0000","last_undegraded":"2024-09-14T11:54:24.069899+0000","last_fullsized":"2024-09-14T11:54:24.069899+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'435","last_scrub_stamp":"2024-09-14T11:54:24.069714+0000","last_deep_scrub":"264'435","last_deep_scrub_stamp":"2024-09-14T11:54:24.069714+0000","last_clean_scrub_stamp":"2024-09-14T11:54:24.069714+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:39.322778+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2378,"num_read_kb":2237,"num_write":500,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":695,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"264'228","reported_seq":897,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.669285+0000","last_change":"2024-09-14T11:54:07.669285+0000","last_active":"2024-09-14T11:54:07.669285+0000","last_peered":"2024-09-14T11:54:07.669285+0000","last_clean":"2024-09-14T11:54:07.669285+0000","last_became_active":"2024-09-14T11:09:45.210875+0000","last_became_peered":"2024-09-14T11:09:45.210875+0000","last_unstale":"2024-09-14T11:54:07.669285+0000","last_undegraded":"2024-09-14T11:54:07.669285+0000","last_fullsized":"2024-09-14T11:54:07.669285+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'228","last_scrub_stamp":"2024-09-14T11:54:07.669103+0000","last_deep_scrub":"264'228","last_deep_scrub_stamp":"2024-09-14T11:54:07.669103+0000","last_clean_scrub_stamp":"2024-09-14T11:54:07.669103+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:09.366495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":591,"num_read_kb":73875,"num_write":1091,"num_write_kb":38947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"264'417","reported_seq":1953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.522720+0000","last_change":"2024-09-14T11:54:13.522720+0000","last_active":"2024-09-14T11:54:13.522720+0000","last_peered":"2024-09-14T11:54:13.522720+0000","last_clean":"2024-09-14T11:54:13.522720+0000","last_became_active":"2024-09-14T11:09:46.958694+0000","last_became_peered":"2024-09-14T11:09:46.958694+0000","last_unstale":"2024-09-14T11:54:13.522720+0000","last_undegraded":"2024-09-14T11:54:13.522720+0000","last_fullsized":"2024-09-14T11:54:13.522720+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'417","last_scrub_stamp":"2024-09-14T11:54:13.522502+0000","last_deep_scrub":"264'417","last_deep_scrub_stamp":"2024-09-14T11:54:13.522502+0000","last_clean_scrub_stamp":"2024-09-14T11:54:13.522502+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:46.905027+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2265,"num_read_kb":2144,"num_write":479,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"264'199","reported_seq":832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.589028+0000","last_change":"2024-09-14T11:54:09.588770+0000","last_active":"2024-09-14T11:54:09.589028+0000","last_peered":"2024-09-14T11:54:09.589028+0000","last_clean":"2024-09-14T11:54:09.589028+0000","last_became_active":"2024-09-14T11:09:45.220968+0000","last_became_peered":"2024-09-14T11:09:45.220968+0000","last_unstale":"2024-09-14T11:54:09.589028+0000","last_undegraded":"2024-09-14T11:54:09.589028+0000","last_fullsized":"2024-09-14T11:54:09.589028+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'199","last_scrub_stamp":"2024-09-14T11:54:09.588498+0000","last_deep_scrub":"264'199","last_deep_scrub_stamp":"2024-09-14T11:54:09.588498+0000","last_clean_scrub_stamp":"2024-09-14T11:54:09.588498+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:12.229625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":534,"num_read_kb":44269,"num_write":1000,"num_write_kb":27179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"264'137","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:25.903195+0000","last_change":"2024-09-14T11:54:25.903195+0000","last_active":"2024-09-14T11:54:25.903195+0000","last_peered":"2024-09-14T11:54:25.903195+0000","last_clean":"2024-09-14T11:54:25.903195+0000","last_became_active":"2024-09-14T11:09:55.026753+0000","last_became_peered":"2024-09-14T11:09:55.026753+0000","last_unstale":"2024-09-14T11:54:25.903195+0000","last_undegraded":"2024-09-14T11:54:25.903195+0000","last_fullsized":"2024-09-14T11:54:25.903195+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'137","last_scrub_stamp":"2024-09-14T11:54:25.903005+0000","last_deep_scrub":"264'137","last_deep_scrub_stamp":"2024-09-14T11:54:25.903005+0000","last_clean_scrub_stamp":"2024-09-14T11:54:25.903005+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:06.554690+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":178,"num_read_kb":167,"num_write":319,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"264'372","reported_seq":1911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.554559+0000","last_change":"2024-09-14T11:54:14.554395+0000","last_active":"2024-09-14T11:54:14.554559+0000","last_peered":"2024-09-14T11:54:14.554559+0000","last_clean":"2024-09-14T11:54:14.554559+0000","last_became_active":"2024-09-14T11:09:46.985016+0000","last_became_peered":"2024-09-14T11:09:46.985016+0000","last_unstale":"2024-09-14T11:54:14.554559+0000","last_undegraded":"2024-09-14T11:54:14.554559+0000","last_fullsized":"2024-09-14T11:54:14.554559+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-09-14T11:54:14.554182+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-09-14T11:54:14.554182+0000","last_clean_scrub_stamp":"2024-09-14T11:54:14.554182+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:51.209068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2187,"num_read_kb":2090,"num_write":422,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"264'250","reported_seq":901,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.768228+0000","last_change":"2024-09-14T11:54:11.768228+0000","last_active":"2024-09-14T11:54:11.768228+0000","last_peered":"2024-09-14T11:54:11.768228+0000","last_clean":"2024-09-14T11:54:11.768228+0000","last_became_active":"2024-09-14T11:09:45.208756+0000","last_became_peered":"2024-09-14T11:09:45.208756+0000","last_unstale":"2024-09-14T11:54:11.768228+0000","last_undegraded":"2024-09-14T11:54:11.768228+0000","last_fullsized":"2024-09-14T11:54:11.768228+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'250","last_scrub_stamp":"2024-09-14T11:54:11.767918+0000","last_deep_scrub":"264'250","last_deep_scrub_stamp":"2024-09-14T11:54:11.767918+0000","last_clean_scrub_stamp":"2024-09-14T11:54:11.767918+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:36.187167+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":600,"num_read_kb":30329,"num_write":1164,"num_write_kb":41189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:31.805903+0000","last_change":"2024-09-14T11:54:31.805903+0000","last_active":"2024-09-14T11:54:31.805903+0000","last_peered":"2024-09-14T11:54:31.805903+0000","last_clean":"2024-09-14T11:54:31.805903+0000","last_became_active":"2024-09-14T11:09:48.969807+0000","last_became_peered":"2024-09-14T11:09:48.969807+0000","last_unstale":"2024-09-14T11:54:31.805903+0000","last_undegraded":"2024-09-14T11:54:31.805903+0000","last_fullsized":"2024-09-14T11:54:31.805903+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:31.805726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:31.805726+0000","last_clean_scrub_stamp":"2024-09-14T11:54:31.805726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:56.392475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"264'201","reported_seq":809,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:31.009609+0000","last_change":"2024-09-14T11:54:31.009609+0000","last_active":"2024-09-14T11:54:31.009609+0000","last_peered":"2024-09-14T11:54:31.009609+0000","last_clean":"2024-09-14T11:54:31.009609+0000","last_became_active":"2024-09-14T11:09:50.988903+0000","last_became_peered":"2024-09-14T11:09:50.988903+0000","last_unstale":"2024-09-14T11:54:31.009609+0000","last_undegraded":"2024-09-14T11:54:31.009609+0000","last_fullsized":"2024-09-14T11:54:31.009609+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'201","last_scrub_stamp":"2024-09-14T11:54:31.009421+0000","last_deep_scrub":"264'201","last_deep_scrub_stamp":"2024-09-14T11:54:31.009421+0000","last_clean_scrub_stamp":"2024-09-14T11:54:31.009421+0000","objects_scrubbed":5,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:43.933742+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12630,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":269,"num_read_kb":381,"num_write":162,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:25.538478+0000","last_change":"2024-09-14T11:54:25.538478+0000","last_active":"2024-09-14T11:54:25.538478+0000","last_peered":"2024-09-14T11:54:25.538478+0000","last_clean":"2024-09-14T11:54:25.538478+0000","last_became_active":"2024-09-14T11:09:53.010617+0000","last_became_peered":"2024-09-14T11:09:53.010617+0000","last_unstale":"2024-09-14T11:54:25.538478+0000","last_undegraded":"2024-09-14T11:54:25.538478+0000","last_fullsized":"2024-09-14T11:54:25.538478+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:25.538278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:25.538278+0000","last_clean_scrub_stamp":"2024-09-14T11:54:25.538278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:45.387138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"264'142","reported_seq":646,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:31.643444+0000","last_change":"2024-09-14T11:54:31.643444+0000","last_active":"2024-09-14T11:54:31.643444+0000","last_peered":"2024-09-14T11:54:31.643444+0000","last_clean":"2024-09-14T11:54:31.643444+0000","last_became_active":"2024-09-14T11:09:55.020070+0000","last_became_peered":"2024-09-14T11:09:55.020070+0000","last_unstale":"2024-09-14T11:54:31.643444+0000","last_undegraded":"2024-09-14T11:54:31.643444+0000","last_fullsized":"2024-09-14T11:54:31.643444+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'142","last_scrub_stamp":"2024-09-14T11:54:31.643193+0000","last_deep_scrub":"264'142","last_deep_scrub_stamp":"2024-09-14T11:54:31.643193+0000","last_clean_scrub_stamp":"2024-09-14T11:54:31.643193+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:27.421218+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":142,"num_write":346,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"264'930","reported_seq":2720,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.921565+0000","last_change":"2024-09-14T11:54:24.921565+0000","last_active":"2024-09-14T11:54:24.921565+0000","last_peered":"2024-09-14T11:54:24.921565+0000","last_clean":"2024-09-14T11:54:24.921565+0000","last_became_active":"2024-09-14T11:09:46.957383+0000","last_became_peered":"2024-09-14T11:09:46.957383+0000","last_unstale":"2024-09-14T11:54:24.921565+0000","last_undegraded":"2024-09-14T11:54:24.921565+0000","last_fullsized":"2024-09-14T11:54:24.921565+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'930","last_scrub_stamp":"2024-09-14T11:54:24.921482+0000","last_deep_scrub":"264'930","last_deep_scrub_stamp":"2024-09-14T11:54:24.921482+0000","last_clean_scrub_stamp":"2024-09-14T11:54:24.921482+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":900,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:12.803564+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4732,"num_read_kb":4281,"num_write":1231,"num_write_kb":469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2680,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"264'210","reported_seq":866,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.580780+0000","last_change":"2024-09-14T11:54:10.580780+0000","last_active":"2024-09-14T11:54:10.580780+0000","last_peered":"2024-09-14T11:54:10.580780+0000","last_clean":"2024-09-14T11:54:10.580780+0000","last_became_active":"2024-09-14T11:09:45.220059+0000","last_became_peered":"2024-09-14T11:09:45.220059+0000","last_unstale":"2024-09-14T11:54:10.580780+0000","last_undegraded":"2024-09-14T11:54:10.580780+0000","last_fullsized":"2024-09-14T11:54:10.580780+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'210","last_scrub_stamp":"2024-09-14T11:54:10.580574+0000","last_deep_scrub":"264'210","last_deep_scrub_stamp":"2024-09-14T11:54:10.580574+0000","last_clean_scrub_stamp":"2024-09-14T11:54:10.580574+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:31.836630+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":639,"num_read_kb":15720,"num_write":940,"num_write_kb":28935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:21.798898+0000","last_change":"2024-09-14T11:54:21.798898+0000","last_active":"2024-09-14T11:54:21.798898+0000","last_peered":"2024-09-14T11:54:21.798898+0000","last_clean":"2024-09-14T11:54:21.798898+0000","last_became_active":"2024-09-14T11:09:48.950055+0000","last_became_peered":"2024-09-14T11:09:48.950055+0000","last_unstale":"2024-09-14T11:54:21.798898+0000","last_undegraded":"2024-09-14T11:54:21.798898+0000","last_fullsized":"2024-09-14T11:54:21.798898+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:21.798715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:21.798715+0000","last_clean_scrub_stamp":"2024-09-14T11:54:21.798715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:05.334882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"264'87","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.663075+0000","last_change":"2024-09-14T11:54:20.663075+0000","last_active":"2024-09-14T11:54:20.663075+0000","last_peered":"2024-09-14T11:54:20.663075+0000","last_clean":"2024-09-14T11:54:20.663075+0000","last_became_active":"2024-09-14T11:09:50.989174+0000","last_became_peered":"2024-09-14T11:09:50.989174+0000","last_unstale":"2024-09-14T11:54:20.663075+0000","last_undegraded":"2024-09-14T11:54:20.663075+0000","last_fullsized":"2024-09-14T11:54:20.663075+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'87","last_scrub_stamp":"2024-09-14T11:54:20.662891+0000","last_deep_scrub":"264'87","last_deep_scrub_stamp":"2024-09-14T11:54:20.662891+0000","last_clean_scrub_stamp":"2024-09-14T11:54:20.662891+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:41.721701+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":97,"num_read_kb":91,"num_write":68,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.580218+0000","last_change":"2024-09-14T11:54:28.580218+0000","last_active":"2024-09-14T11:54:28.580218+0000","last_peered":"2024-09-14T11:54:28.580218+0000","last_clean":"2024-09-14T11:54:28.580218+0000","last_became_active":"2024-09-14T11:09:53.018290+0000","last_became_peered":"2024-09-14T11:09:53.018290+0000","last_unstale":"2024-09-14T11:54:28.580218+0000","last_undegraded":"2024-09-14T11:54:28.580218+0000","last_fullsized":"2024-09-14T11:54:28.580218+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:28.580020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:28.580020+0000","last_clean_scrub_stamp":"2024-09-14T11:54:28.580020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:50:13.166036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"264'97","reported_seq":600,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:30.601180+0000","last_change":"2024-09-14T11:54:30.601180+0000","last_active":"2024-09-14T11:54:30.601180+0000","last_peered":"2024-09-14T11:54:30.601180+0000","last_clean":"2024-09-14T11:54:30.601180+0000","last_became_active":"2024-09-14T11:09:55.018855+0000","last_became_peered":"2024-09-14T11:09:55.018855+0000","last_unstale":"2024-09-14T11:54:30.601180+0000","last_undegraded":"2024-09-14T11:54:30.601180+0000","last_fullsized":"2024-09-14T11:54:30.601180+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'97","last_scrub_stamp":"2024-09-14T11:54:30.600983+0000","last_deep_scrub":"264'97","last_deep_scrub_stamp":"2024-09-14T11:54:30.600983+0000","last_clean_scrub_stamp":"2024-09-14T11:54:30.600983+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:09.359758+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":100,"num_read_kb":99,"num_write":210,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"264'509","reported_seq":2261,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:21.075552+0000","last_change":"2024-09-14T11:54:21.075552+0000","last_active":"2024-09-14T11:54:21.075552+0000","last_peered":"2024-09-14T11:54:21.075552+0000","last_clean":"2024-09-14T11:54:21.075552+0000","last_became_active":"2024-09-14T11:09:46.975175+0000","last_became_peered":"2024-09-14T11:09:46.975175+0000","last_unstale":"2024-09-14T11:54:21.075552+0000","last_undegraded":"2024-09-14T11:54:21.075552+0000","last_fullsized":"2024-09-14T11:54:21.075552+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'509","last_scrub_stamp":"2024-09-14T11:54:21.075332+0000","last_deep_scrub":"264'509","last_deep_scrub_stamp":"2024-09-14T11:54:21.075332+0000","last_clean_scrub_stamp":"2024-09-14T11:54:21.075332+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:30:29.486556+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2885,"num_read_kb":2717,"num_write":615,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2551,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"264'240","reported_seq":865,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.759266+0000","last_change":"2024-09-14T11:54:10.759266+0000","last_active":"2024-09-14T11:54:10.759266+0000","last_peered":"2024-09-14T11:54:10.759266+0000","last_clean":"2024-09-14T11:54:10.759266+0000","last_became_active":"2024-09-14T11:09:45.205019+0000","last_became_peered":"2024-09-14T11:09:45.205019+0000","last_unstale":"2024-09-14T11:54:10.759266+0000","last_undegraded":"2024-09-14T11:54:10.759266+0000","last_fullsized":"2024-09-14T11:54:10.759266+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'240","last_scrub_stamp":"2024-09-14T11:54:10.759003+0000","last_deep_scrub":"264'240","last_deep_scrub_stamp":"2024-09-14T11:54:10.759003+0000","last_clean_scrub_stamp":"2024-09-14T11:54:10.759003+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:54.898617+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":563,"num_read_kb":1571,"num_write":1129,"num_write_kb":22204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.843171+0000","last_change":"2024-09-14T11:54:22.843171+0000","last_active":"2024-09-14T11:54:22.843171+0000","last_peered":"2024-09-14T11:54:22.843171+0000","last_clean":"2024-09-14T11:54:22.843171+0000","last_became_active":"2024-09-14T11:09:48.950260+0000","last_became_peered":"2024-09-14T11:09:48.950260+0000","last_unstale":"2024-09-14T11:54:22.843171+0000","last_undegraded":"2024-09-14T11:54:22.843171+0000","last_fullsized":"2024-09-14T11:54:22.843171+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:22.842969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:22.842969+0000","last_clean_scrub_stamp":"2024-09-14T11:54:22.842969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:18.066946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"264'112","reported_seq":653,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.935779+0000","last_change":"2024-09-14T11:54:28.935779+0000","last_active":"2024-09-14T11:54:28.935779+0000","last_peered":"2024-09-14T11:54:28.935779+0000","last_clean":"2024-09-14T11:54:28.935779+0000","last_became_active":"2024-09-14T11:09:50.977685+0000","last_became_peered":"2024-09-14T11:09:50.977685+0000","last_unstale":"2024-09-14T11:54:28.935779+0000","last_undegraded":"2024-09-14T11:54:28.935779+0000","last_fullsized":"2024-09-14T11:54:28.935779+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'112","last_scrub_stamp":"2024-09-14T11:54:28.935608+0000","last_deep_scrub":"264'112","last_deep_scrub_stamp":"2024-09-14T11:54:28.935608+0000","last_clean_scrub_stamp":"2024-09-14T11:54:28.935608+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:22.551848+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"264'789","reported_seq":2368,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:56.901355+0000","last_change":"2024-09-14T11:09:53.022562+0000","last_active":"2024-09-14T11:53:56.901355+0000","last_peered":"2024-09-14T11:53:56.901355+0000","last_clean":"2024-09-14T11:53:56.901355+0000","last_became_active":"2024-09-14T11:09:53.021212+0000","last_became_peered":"2024-09-14T11:09:53.021212+0000","last_unstale":"2024-09-14T11:53:56.901355+0000","last_undegraded":"2024-09-14T11:53:56.901355+0000","last_fullsized":"2024-09-14T11:53:56.901355+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:51.957402+0000","last_clean_scrub_stamp":"2024-09-14T11:09:51.957402+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:48.852973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"264'225","reported_seq":1068,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:31.300319+0000","last_change":"2024-09-14T11:54:31.300319+0000","last_active":"2024-09-14T11:54:31.300319+0000","last_peered":"2024-09-14T11:54:31.300319+0000","last_clean":"2024-09-14T11:54:31.300319+0000","last_became_active":"2024-09-14T11:09:55.013994+0000","last_became_peered":"2024-09-14T11:09:55.013994+0000","last_unstale":"2024-09-14T11:54:31.300319+0000","last_undegraded":"2024-09-14T11:54:31.300319+0000","last_fullsized":"2024-09-14T11:54:31.300319+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'225","last_scrub_stamp":"2024-09-14T11:54:31.300089+0000","last_deep_scrub":"264'225","last_deep_scrub_stamp":"2024-09-14T11:54:31.300089+0000","last_clean_scrub_stamp":"2024-09-14T11:54:31.300089+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:50.141514+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":446,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":657,"num_read_kb":640,"num_write":481,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"264'1913","reported_seq":3557,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.077459+0000","last_change":"2024-09-14T11:54:19.077459+0000","last_active":"2024-09-14T11:54:19.077459+0000","last_peered":"2024-09-14T11:54:19.077459+0000","last_clean":"2024-09-14T11:54:19.077459+0000","last_became_active":"2024-09-14T11:09:46.994623+0000","last_became_peered":"2024-09-14T11:09:46.994623+0000","last_unstale":"2024-09-14T11:54:19.077459+0000","last_undegraded":"2024-09-14T11:54:19.077459+0000","last_fullsized":"2024-09-14T11:54:19.077459+0000","mapping_epoch":25,"log_start":"264'1900","ondisk_log_start":"264'1900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1913","last_scrub_stamp":"2024-09-14T11:54:19.077195+0000","last_deep_scrub":"264'1913","last_deep_scrub_stamp":"2024-09-14T11:54:19.077195+0000","last_clean_scrub_stamp":"2024-09-14T11:54:19.077195+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":1900,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:38.527036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8495,"num_read_kb":7411,"num_write":2703,"num_write_kb":1197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"264'221","reported_seq":859,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.632086+0000","last_change":"2024-09-14T11:54:06.631924+0000","last_active":"2024-09-14T11:54:06.632086+0000","last_peered":"2024-09-14T11:54:06.632086+0000","last_clean":"2024-09-14T11:54:06.632086+0000","last_became_active":"2024-09-14T11:09:45.208282+0000","last_became_peered":"2024-09-14T11:09:45.208282+0000","last_unstale":"2024-09-14T11:54:06.632086+0000","last_undegraded":"2024-09-14T11:54:06.632086+0000","last_fullsized":"2024-09-14T11:54:06.632086+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'221","last_scrub_stamp":"2024-09-14T11:54:06.631656+0000","last_deep_scrub":"264'221","last_deep_scrub_stamp":"2024-09-14T11:54:06.631656+0000","last_clean_scrub_stamp":"2024-09-14T11:54:06.631656+0000","objects_scrubbed":8,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:03.012784+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5850204,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":521,"num_read_kb":14610,"num_write":976,"num_write_kb":27594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:34.741772+0000","last_change":"2024-09-14T11:54:34.741772+0000","last_active":"2024-09-14T11:54:34.741772+0000","last_peered":"2024-09-14T11:54:34.741772+0000","last_clean":"2024-09-14T11:54:34.741772+0000","last_became_active":"2024-09-14T11:09:48.959355+0000","last_became_peered":"2024-09-14T11:09:48.959355+0000","last_unstale":"2024-09-14T11:54:34.741772+0000","last_undegraded":"2024-09-14T11:54:34.741772+0000","last_fullsized":"2024-09-14T11:54:34.741772+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:34.741596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:34.741596+0000","last_clean_scrub_stamp":"2024-09-14T11:54:34.741596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:27.337576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"264'124","reported_seq":701,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.337531+0000","last_change":"2024-09-14T11:54:22.337531+0000","last_active":"2024-09-14T11:54:22.337531+0000","last_peered":"2024-09-14T11:54:22.337531+0000","last_clean":"2024-09-14T11:54:22.337531+0000","last_became_active":"2024-09-14T11:09:50.984035+0000","last_became_peered":"2024-09-14T11:09:50.984035+0000","last_unstale":"2024-09-14T11:54:22.337531+0000","last_undegraded":"2024-09-14T11:54:22.337531+0000","last_fullsized":"2024-09-14T11:54:22.337531+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-09-14T11:54:22.337342+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-09-14T11:54:22.337342+0000","last_clean_scrub_stamp":"2024-09-14T11:54:22.337342+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:46.850427+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":160,"num_read_kb":234,"num_write":82,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"264'803","reported_seq":2141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:34.063279+0000","last_change":"2024-09-14T11:54:34.063279+0000","last_active":"2024-09-14T11:54:34.063279+0000","last_peered":"2024-09-14T11:54:34.063279+0000","last_clean":"2024-09-14T11:54:34.063279+0000","last_became_active":"2024-09-14T11:09:53.004265+0000","last_became_peered":"2024-09-14T11:09:53.004265+0000","last_unstale":"2024-09-14T11:54:34.063279+0000","last_undegraded":"2024-09-14T11:54:34.063279+0000","last_fullsized":"2024-09-14T11:54:34.063279+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'803","last_scrub_stamp":"2024-09-14T11:54:34.063096+0000","last_deep_scrub":"264'803","last_deep_scrub_stamp":"2024-09-14T11:54:34.063096+0000","last_clean_scrub_stamp":"2024-09-14T11:54:34.063096+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:05.814740+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"264'523","reported_seq":2240,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.909509+0000","last_change":"2024-09-14T11:54:20.909509+0000","last_active":"2024-09-14T11:54:20.909509+0000","last_peered":"2024-09-14T11:54:20.909509+0000","last_clean":"2024-09-14T11:54:20.909509+0000","last_became_active":"2024-09-14T11:09:46.962838+0000","last_became_peered":"2024-09-14T11:09:46.962838+0000","last_unstale":"2024-09-14T11:54:20.909509+0000","last_undegraded":"2024-09-14T11:54:20.909509+0000","last_fullsized":"2024-09-14T11:54:20.909509+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'523","last_scrub_stamp":"2024-09-14T11:54:20.909319+0000","last_deep_scrub":"264'523","last_deep_scrub_stamp":"2024-09-14T11:54:20.909319+0000","last_clean_scrub_stamp":"2024-09-14T11:54:20.909319+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":500,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:08.391964+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2791,"num_read_kb":2616,"num_write":587,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"264'281","reported_seq":951,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.716443+0000","last_change":"2024-09-14T11:54:04.716443+0000","last_active":"2024-09-14T11:54:04.716443+0000","last_peered":"2024-09-14T11:54:04.716443+0000","last_clean":"2024-09-14T11:54:04.716443+0000","last_became_active":"2024-09-14T11:09:45.219674+0000","last_became_peered":"2024-09-14T11:09:45.219674+0000","last_unstale":"2024-09-14T11:54:04.716443+0000","last_undegraded":"2024-09-14T11:54:04.716443+0000","last_fullsized":"2024-09-14T11:54:04.716443+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'281","last_scrub_stamp":"2024-09-14T11:54:04.716246+0000","last_deep_scrub":"264'281","last_deep_scrub_stamp":"2024-09-14T11:54:04.716246+0000","last_clean_scrub_stamp":"2024-09-14T11:54:04.716246+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:35:04.002963+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":701,"num_read_kb":41266,"num_write":1220,"num_write_kb":49932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.565431+0000","last_change":"2024-09-14T11:54:14.565431+0000","last_active":"2024-09-14T11:54:14.565431+0000","last_peered":"2024-09-14T11:54:14.565431+0000","last_clean":"2024-09-14T11:54:14.565431+0000","last_became_active":"2024-09-14T11:09:48.958254+0000","last_became_peered":"2024-09-14T11:09:48.958254+0000","last_unstale":"2024-09-14T11:54:14.565431+0000","last_undegraded":"2024-09-14T11:54:14.565431+0000","last_fullsized":"2024-09-14T11:54:14.565431+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:14.565263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:14.565263+0000","last_clean_scrub_stamp":"2024-09-14T11:54:14.565263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:53.252174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"264'200","reported_seq":812,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:23.925778+0000","last_change":"2024-09-14T11:54:23.925778+0000","last_active":"2024-09-14T11:54:23.925778+0000","last_peered":"2024-09-14T11:54:23.925778+0000","last_clean":"2024-09-14T11:54:23.925778+0000","last_became_active":"2024-09-14T11:09:50.992673+0000","last_became_peered":"2024-09-14T11:09:50.992673+0000","last_unstale":"2024-09-14T11:54:23.925778+0000","last_undegraded":"2024-09-14T11:54:23.925778+0000","last_fullsized":"2024-09-14T11:54:23.925778+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'200","last_scrub_stamp":"2024-09-14T11:54:23.925583+0000","last_deep_scrub":"264'200","last_deep_scrub_stamp":"2024-09-14T11:54:23.925583+0000","last_clean_scrub_stamp":"2024-09-14T11:54:23.925583+0000","objects_scrubbed":9,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:04.720524+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11263,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":273,"num_read_kb":325,"num_write":154,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.601326+0000","last_change":"2024-09-14T11:54:28.601326+0000","last_active":"2024-09-14T11:54:28.601326+0000","last_peered":"2024-09-14T11:54:28.601326+0000","last_clean":"2024-09-14T11:54:28.601326+0000","last_became_active":"2024-09-14T11:09:53.007694+0000","last_became_peered":"2024-09-14T11:09:53.007694+0000","last_unstale":"2024-09-14T11:54:28.601326+0000","last_undegraded":"2024-09-14T11:54:28.601326+0000","last_fullsized":"2024-09-14T11:54:28.601326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:28.601148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:28.601148+0000","last_clean_scrub_stamp":"2024-09-14T11:54:28.601148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:31.854054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"264'569","reported_seq":1411,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:25.318804+0000","last_change":"2024-09-14T11:54:25.318804+0000","last_active":"2024-09-14T11:54:25.318804+0000","last_peered":"2024-09-14T11:54:25.318804+0000","last_clean":"2024-09-14T11:54:25.318804+0000","last_became_active":"2024-09-14T11:09:55.030659+0000","last_became_peered":"2024-09-14T11:09:55.030659+0000","last_unstale":"2024-09-14T11:54:25.318804+0000","last_undegraded":"2024-09-14T11:54:25.318804+0000","last_fullsized":"2024-09-14T11:54:25.318804+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'569","last_scrub_stamp":"2024-09-14T11:54:25.318519+0000","last_deep_scrub":"264'569","last_deep_scrub_stamp":"2024-09-14T11:54:25.318519+0000","last_clean_scrub_stamp":"2024-09-14T11:54:25.318519+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":500,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:14.986669+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1371,"num_read_kb":1346,"num_write":1205,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"264'1072","reported_seq":2650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.617875+0000","last_change":"2024-09-14T11:54:08.617875+0000","last_active":"2024-09-14T11:54:08.617875+0000","last_peered":"2024-09-14T11:54:08.617875+0000","last_clean":"2024-09-14T11:54:08.617875+0000","last_became_active":"2024-09-14T11:09:46.990046+0000","last_became_peered":"2024-09-14T11:09:46.990046+0000","last_unstale":"2024-09-14T11:54:08.617875+0000","last_undegraded":"2024-09-14T11:54:08.617875+0000","last_fullsized":"2024-09-14T11:54:08.617875+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1072","last_scrub_stamp":"2024-09-14T11:54:08.617699+0000","last_deep_scrub":"264'1072","last_deep_scrub_stamp":"2024-09-14T11:54:08.617699+0000","last_clean_scrub_stamp":"2024-09-14T11:54:08.617699+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":1000,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:02.219078+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5673,"num_read_kb":5118,"num_write":1579,"num_write_kb":694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"264'267","reported_seq":972,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:03.349250+0000","last_change":"2024-09-14T11:54:03.349250+0000","last_active":"2024-09-14T11:54:03.349250+0000","last_peered":"2024-09-14T11:54:03.349250+0000","last_clean":"2024-09-14T11:54:03.349250+0000","last_became_active":"2024-09-14T11:09:45.210020+0000","last_became_peered":"2024-09-14T11:09:45.210020+0000","last_unstale":"2024-09-14T11:54:03.349250+0000","last_undegraded":"2024-09-14T11:54:03.349250+0000","last_fullsized":"2024-09-14T11:54:03.349250+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'267","last_scrub_stamp":"2024-09-14T11:54:03.349170+0000","last_deep_scrub":"264'267","last_deep_scrub_stamp":"2024-09-14T11:54:03.349170+0000","last_clean_scrub_stamp":"2024-09-14T11:54:03.349170+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:32.965016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":888,"num_read_kb":725,"num_write":1131,"num_write_kb":36716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.609158+0000","last_change":"2024-09-14T11:54:17.609158+0000","last_active":"2024-09-14T11:54:17.609158+0000","last_peered":"2024-09-14T11:54:17.609158+0000","last_clean":"2024-09-14T11:54:17.609158+0000","last_became_active":"2024-09-14T11:09:48.973945+0000","last_became_peered":"2024-09-14T11:09:48.973945+0000","last_unstale":"2024-09-14T11:54:17.609158+0000","last_undegraded":"2024-09-14T11:54:17.609158+0000","last_fullsized":"2024-09-14T11:54:17.609158+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:17.608988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:17.608988+0000","last_clean_scrub_stamp":"2024-09-14T11:54:17.608988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:32.743186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"264'146","reported_seq":721,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.897298+0000","last_change":"2024-09-14T11:54:26.897298+0000","last_active":"2024-09-14T11:54:26.897298+0000","last_peered":"2024-09-14T11:54:26.897298+0000","last_clean":"2024-09-14T11:54:26.897298+0000","last_became_active":"2024-09-14T11:09:50.985800+0000","last_became_peered":"2024-09-14T11:09:50.985800+0000","last_unstale":"2024-09-14T11:54:26.897298+0000","last_undegraded":"2024-09-14T11:54:26.897298+0000","last_fullsized":"2024-09-14T11:54:26.897298+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'146","last_scrub_stamp":"2024-09-14T11:54:26.897102+0000","last_deep_scrub":"264'146","last_deep_scrub_stamp":"2024-09-14T11:54:26.897102+0000","last_clean_scrub_stamp":"2024-09-14T11:54:26.897102+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:12.702052+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14744,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":268,"num_write":96,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:34.950458+0000","last_change":"2024-09-14T11:54:34.950458+0000","last_active":"2024-09-14T11:54:34.950458+0000","last_peered":"2024-09-14T11:54:34.950458+0000","last_clean":"2024-09-14T11:54:34.950458+0000","last_became_active":"2024-09-14T11:09:53.002739+0000","last_became_peered":"2024-09-14T11:09:53.002739+0000","last_unstale":"2024-09-14T11:54:34.950458+0000","last_undegraded":"2024-09-14T11:54:34.950458+0000","last_fullsized":"2024-09-14T11:54:34.950458+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:34.950258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:34.950258+0000","last_clean_scrub_stamp":"2024-09-14T11:54:34.950258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:49.224667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"264'2504","reported_seq":4379,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:30.610057+0000","last_change":"2024-09-14T11:54:30.610057+0000","last_active":"2024-09-14T11:54:30.610057+0000","last_peered":"2024-09-14T11:54:30.610057+0000","last_clean":"2024-09-14T11:54:30.610057+0000","last_became_active":"2024-09-14T11:09:55.017307+0000","last_became_peered":"2024-09-14T11:09:55.017307+0000","last_unstale":"2024-09-14T11:54:30.610057+0000","last_undegraded":"2024-09-14T11:54:30.610057+0000","last_fullsized":"2024-09-14T11:54:30.610057+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2504","last_scrub_stamp":"2024-09-14T11:54:30.609835+0000","last_deep_scrub":"264'2504","last_deep_scrub_stamp":"2024-09-14T11:54:30.609835+0000","last_clean_scrub_stamp":"2024-09-14T11:54:30.609835+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":2400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:45:31.699682+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6356,"num_read_kb":6314,"num_write":5042,"num_write_kb":1853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"264'347","reported_seq":1764,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.365181+0000","last_change":"2024-09-14T11:54:08.365181+0000","last_active":"2024-09-14T11:54:08.365181+0000","last_peered":"2024-09-14T11:54:08.365181+0000","last_clean":"2024-09-14T11:54:08.365181+0000","last_became_active":"2024-09-14T11:09:46.952951+0000","last_became_peered":"2024-09-14T11:09:46.952951+0000","last_unstale":"2024-09-14T11:54:08.365181+0000","last_undegraded":"2024-09-14T11:54:08.365181+0000","last_fullsized":"2024-09-14T11:54:08.365181+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'347","last_scrub_stamp":"2024-09-14T11:54:08.364954+0000","last_deep_scrub":"264'347","last_deep_scrub_stamp":"2024-09-14T11:54:08.364954+0000","last_clean_scrub_stamp":"2024-09-14T11:54:08.364954+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:07.453326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1860,"num_read_kb":1783,"num_write":380,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"264'226","reported_seq":870,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.749433+0000","last_change":"2024-09-14T11:54:09.749433+0000","last_active":"2024-09-14T11:54:09.749433+0000","last_peered":"2024-09-14T11:54:09.749433+0000","last_clean":"2024-09-14T11:54:09.749433+0000","last_became_active":"2024-09-14T11:09:45.211217+0000","last_became_peered":"2024-09-14T11:09:45.211217+0000","last_unstale":"2024-09-14T11:54:09.749433+0000","last_undegraded":"2024-09-14T11:54:09.749433+0000","last_fullsized":"2024-09-14T11:54:09.749433+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'226","last_scrub_stamp":"2024-09-14T11:54:09.749200+0000","last_deep_scrub":"264'226","last_deep_scrub_stamp":"2024-09-14T11:54:09.749200+0000","last_clean_scrub_stamp":"2024-09-14T11:54:09.749200+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:53.881634+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":600,"num_read_kb":7544,"num_write":1094,"num_write_kb":12612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.066124+0000","last_change":"2024-09-14T11:54:27.066124+0000","last_active":"2024-09-14T11:54:27.066124+0000","last_peered":"2024-09-14T11:54:27.066124+0000","last_clean":"2024-09-14T11:54:27.066124+0000","last_became_active":"2024-09-14T11:09:48.957275+0000","last_became_peered":"2024-09-14T11:09:48.957275+0000","last_unstale":"2024-09-14T11:54:27.066124+0000","last_undegraded":"2024-09-14T11:54:27.066124+0000","last_fullsized":"2024-09-14T11:54:27.066124+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:27.065940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:27.065940+0000","last_clean_scrub_stamp":"2024-09-14T11:54:27.065940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:31.779734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"264'178","reported_seq":765,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:37.759839+0000","last_change":"2024-09-14T11:54:37.759839+0000","last_active":"2024-09-14T11:54:37.759839+0000","last_peered":"2024-09-14T11:54:37.759839+0000","last_clean":"2024-09-14T11:54:37.759839+0000","last_became_active":"2024-09-14T11:09:50.999759+0000","last_became_peered":"2024-09-14T11:09:50.999759+0000","last_unstale":"2024-09-14T11:54:37.759839+0000","last_undegraded":"2024-09-14T11:54:37.759839+0000","last_fullsized":"2024-09-14T11:54:37.759839+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'178","last_scrub_stamp":"2024-09-14T11:54:37.759617+0000","last_deep_scrub":"264'178","last_deep_scrub_stamp":"2024-09-14T11:54:37.759617+0000","last_clean_scrub_stamp":"2024-09-14T11:54:37.759617+0000","objects_scrubbed":8,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:44.576561+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6528,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":216,"num_read_kb":266,"num_write":126,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"264'803","reported_seq":2359,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:33.083119+0000","last_change":"2024-09-14T11:54:33.083119+0000","last_active":"2024-09-14T11:54:33.083119+0000","last_peered":"2024-09-14T11:54:33.083119+0000","last_clean":"2024-09-14T11:54:33.083119+0000","last_became_active":"2024-09-14T11:09:53.002667+0000","last_became_peered":"2024-09-14T11:09:53.002667+0000","last_unstale":"2024-09-14T11:54:33.083119+0000","last_undegraded":"2024-09-14T11:54:33.083119+0000","last_fullsized":"2024-09-14T11:54:33.083119+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'803","last_scrub_stamp":"2024-09-14T11:54:33.082941+0000","last_deep_scrub":"264'803","last_deep_scrub_stamp":"2024-09-14T11:54:33.082941+0000","last_clean_scrub_stamp":"2024-09-14T11:54:33.082941+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:12.117497+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"264'127","reported_seq":628,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:29.612334+0000","last_change":"2024-09-14T11:54:29.612334+0000","last_active":"2024-09-14T11:54:29.612334+0000","last_peered":"2024-09-14T11:54:29.612334+0000","last_clean":"2024-09-14T11:54:29.612334+0000","last_became_active":"2024-09-14T11:09:55.016802+0000","last_became_peered":"2024-09-14T11:09:55.016802+0000","last_unstale":"2024-09-14T11:54:29.612334+0000","last_undegraded":"2024-09-14T11:54:29.612334+0000","last_fullsized":"2024-09-14T11:54:29.612334+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'127","last_scrub_stamp":"2024-09-14T11:54:29.612082+0000","last_deep_scrub":"264'127","last_deep_scrub_stamp":"2024-09-14T11:54:29.612082+0000","last_clean_scrub_stamp":"2024-09-14T11:54:29.612082+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:14:18.130706+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":820,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":114,"num_write":311,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"264'748","reported_seq":2284,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.054187+0000","last_change":"2024-09-14T11:54:18.054187+0000","last_active":"2024-09-14T11:54:18.054187+0000","last_peered":"2024-09-14T11:54:18.054187+0000","last_clean":"2024-09-14T11:54:18.054187+0000","last_became_active":"2024-09-14T11:09:46.987523+0000","last_became_peered":"2024-09-14T11:09:46.987523+0000","last_unstale":"2024-09-14T11:54:18.054187+0000","last_undegraded":"2024-09-14T11:54:18.054187+0000","last_fullsized":"2024-09-14T11:54:18.054187+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'748","last_scrub_stamp":"2024-09-14T11:54:18.054011+0000","last_deep_scrub":"264'748","last_deep_scrub_stamp":"2024-09-14T11:54:18.054011+0000","last_clean_scrub_stamp":"2024-09-14T11:54:18.054011+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:45.880403+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3699,"num_read_kb":3347,"num_write":991,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"264'240","reported_seq":899,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:01.721039+0000","last_change":"2024-09-14T11:54:01.721039+0000","last_active":"2024-09-14T11:54:01.721039+0000","last_peered":"2024-09-14T11:54:01.721039+0000","last_clean":"2024-09-14T11:54:01.721039+0000","last_became_active":"2024-09-14T11:09:45.213648+0000","last_became_peered":"2024-09-14T11:09:45.213648+0000","last_unstale":"2024-09-14T11:54:01.721039+0000","last_undegraded":"2024-09-14T11:54:01.721039+0000","last_fullsized":"2024-09-14T11:54:01.721039+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'240","last_scrub_stamp":"2024-09-14T11:54:01.720967+0000","last_deep_scrub":"264'240","last_deep_scrub_stamp":"2024-09-14T11:54:01.720967+0000","last_clean_scrub_stamp":"2024-09-14T11:54:01.720967+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:13.876519+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1830584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":598,"num_read_kb":9438,"num_write":1111,"num_write_kb":42718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.656620+0000","last_change":"2024-09-14T11:54:18.656620+0000","last_active":"2024-09-14T11:54:18.656620+0000","last_peered":"2024-09-14T11:54:18.656620+0000","last_clean":"2024-09-14T11:54:18.656620+0000","last_became_active":"2024-09-14T11:09:48.965014+0000","last_became_peered":"2024-09-14T11:09:48.965014+0000","last_unstale":"2024-09-14T11:54:18.656620+0000","last_undegraded":"2024-09-14T11:54:18.656620+0000","last_fullsized":"2024-09-14T11:54:18.656620+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:18.656437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:18.656437+0000","last_clean_scrub_stamp":"2024-09-14T11:54:18.656437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:47.603996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"264'206","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:29.972634+0000","last_change":"2024-09-14T11:54:29.972634+0000","last_active":"2024-09-14T11:54:29.972634+0000","last_peered":"2024-09-14T11:54:29.972634+0000","last_clean":"2024-09-14T11:54:29.972634+0000","last_became_active":"2024-09-14T11:09:50.988991+0000","last_became_peered":"2024-09-14T11:09:50.988991+0000","last_unstale":"2024-09-14T11:54:29.972634+0000","last_undegraded":"2024-09-14T11:54:29.972634+0000","last_fullsized":"2024-09-14T11:54:29.972634+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'206","last_scrub_stamp":"2024-09-14T11:54:29.972424+0000","last_deep_scrub":"264'206","last_deep_scrub_stamp":"2024-09-14T11:54:29.972424+0000","last_clean_scrub_stamp":"2024-09-14T11:54:29.972424+0000","objects_scrubbed":6,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:17.229395+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16480,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":287,"num_read_kb":450,"num_write":148,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:31.073151+0000","last_change":"2024-09-14T11:54:31.073151+0000","last_active":"2024-09-14T11:54:31.073151+0000","last_peered":"2024-09-14T11:54:31.073151+0000","last_clean":"2024-09-14T11:54:31.073151+0000","last_became_active":"2024-09-14T11:09:53.010817+0000","last_became_peered":"2024-09-14T11:09:53.010817+0000","last_unstale":"2024-09-14T11:54:31.073151+0000","last_undegraded":"2024-09-14T11:54:31.073151+0000","last_fullsized":"2024-09-14T11:54:31.073151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:31.072969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:31.072969+0000","last_clean_scrub_stamp":"2024-09-14T11:54:31.072969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:25.026070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"264'119","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.389012+0000","last_change":"2024-09-14T11:54:28.389012+0000","last_active":"2024-09-14T11:54:28.389012+0000","last_peered":"2024-09-14T11:54:28.389012+0000","last_clean":"2024-09-14T11:54:28.389012+0000","last_became_active":"2024-09-14T11:09:55.025490+0000","last_became_peered":"2024-09-14T11:09:55.025490+0000","last_unstale":"2024-09-14T11:54:28.389012+0000","last_undegraded":"2024-09-14T11:54:28.389012+0000","last_fullsized":"2024-09-14T11:54:28.389012+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'119","last_scrub_stamp":"2024-09-14T11:54:28.388783+0000","last_deep_scrub":"264'119","last_deep_scrub_stamp":"2024-09-14T11:54:28.388783+0000","last_clean_scrub_stamp":"2024-09-14T11:54:28.388783+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:34.167171+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":533,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":108,"num_write":255,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"264'476","reported_seq":2030,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.703197+0000","last_change":"2024-09-14T11:54:08.703197+0000","last_active":"2024-09-14T11:54:08.703197+0000","last_peered":"2024-09-14T11:54:08.703197+0000","last_clean":"2024-09-14T11:54:08.703197+0000","last_became_active":"2024-09-14T11:09:46.970824+0000","last_became_peered":"2024-09-14T11:09:46.970824+0000","last_unstale":"2024-09-14T11:54:08.703197+0000","last_undegraded":"2024-09-14T11:54:08.703197+0000","last_fullsized":"2024-09-14T11:54:08.703197+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'476","last_scrub_stamp":"2024-09-14T11:54:08.702969+0000","last_deep_scrub":"264'476","last_deep_scrub_stamp":"2024-09-14T11:54:08.702969+0000","last_clean_scrub_stamp":"2024-09-14T11:54:08.702969+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:56.765104+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2551,"num_read_kb":2376,"num_write":583,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"264'199","reported_seq":798,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.232828+0000","last_change":"2024-09-14T11:54:05.232828+0000","last_active":"2024-09-14T11:54:05.232828+0000","last_peered":"2024-09-14T11:54:05.232828+0000","last_clean":"2024-09-14T11:54:05.232828+0000","last_became_active":"2024-09-14T11:09:45.216305+0000","last_became_peered":"2024-09-14T11:09:45.216305+0000","last_unstale":"2024-09-14T11:54:05.232828+0000","last_undegraded":"2024-09-14T11:54:05.232828+0000","last_fullsized":"2024-09-14T11:54:05.232828+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'199","last_scrub_stamp":"2024-09-14T11:54:05.232517+0000","last_deep_scrub":"264'199","last_deep_scrub_stamp":"2024-09-14T11:54:05.232517+0000","last_clean_scrub_stamp":"2024-09-14T11:54:05.232517+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:34.729977+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655887,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":432,"num_read_kb":2004,"num_write":918,"num_write_kb":29719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.348901+0000","last_change":"2024-09-14T11:54:19.348901+0000","last_active":"2024-09-14T11:54:19.348901+0000","last_peered":"2024-09-14T11:54:19.348901+0000","last_clean":"2024-09-14T11:54:19.348901+0000","last_became_active":"2024-09-14T11:09:48.968263+0000","last_became_peered":"2024-09-14T11:09:48.968263+0000","last_unstale":"2024-09-14T11:54:19.348901+0000","last_undegraded":"2024-09-14T11:54:19.348901+0000","last_fullsized":"2024-09-14T11:54:19.348901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:19.348715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:19.348715+0000","last_clean_scrub_stamp":"2024-09-14T11:54:19.348715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:01.380009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"264'151","reported_seq":730,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.524478+0000","last_change":"2024-09-14T11:54:24.524478+0000","last_active":"2024-09-14T11:54:24.524478+0000","last_peered":"2024-09-14T11:54:24.524478+0000","last_clean":"2024-09-14T11:54:24.524478+0000","last_became_active":"2024-09-14T11:09:50.998098+0000","last_became_peered":"2024-09-14T11:09:50.998098+0000","last_unstale":"2024-09-14T11:54:24.524478+0000","last_undegraded":"2024-09-14T11:54:24.524478+0000","last_fullsized":"2024-09-14T11:54:24.524478+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'151","last_scrub_stamp":"2024-09-14T11:54:24.524363+0000","last_deep_scrub":"264'151","last_deep_scrub_stamp":"2024-09-14T11:54:24.524363+0000","last_clean_scrub_stamp":"2024-09-14T11:54:24.524363+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:00.427318+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10966,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":215,"num_read_kb":296,"num_write":168,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:25.315628+0000","last_change":"2024-09-14T11:54:25.315628+0000","last_active":"2024-09-14T11:54:25.315628+0000","last_peered":"2024-09-14T11:54:25.315628+0000","last_clean":"2024-09-14T11:54:25.315628+0000","last_became_active":"2024-09-14T11:09:53.003759+0000","last_became_peered":"2024-09-14T11:09:53.003759+0000","last_unstale":"2024-09-14T11:54:25.315628+0000","last_undegraded":"2024-09-14T11:54:25.315628+0000","last_fullsized":"2024-09-14T11:54:25.315628+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:25.315450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:25.315450+0000","last_clean_scrub_stamp":"2024-09-14T11:54:25.315450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:53.076672+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"264'128","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:35.116168+0000","last_change":"2024-09-14T11:54:35.116168+0000","last_active":"2024-09-14T11:54:35.116168+0000","last_peered":"2024-09-14T11:54:35.116168+0000","last_clean":"2024-09-14T11:54:35.116168+0000","last_became_active":"2024-09-14T11:09:55.033844+0000","last_became_peered":"2024-09-14T11:09:55.033844+0000","last_unstale":"2024-09-14T11:54:35.116168+0000","last_undegraded":"2024-09-14T11:54:35.116168+0000","last_fullsized":"2024-09-14T11:54:35.116168+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'128","last_scrub_stamp":"2024-09-14T11:54:35.115901+0000","last_deep_scrub":"264'128","last_deep_scrub_stamp":"2024-09-14T11:54:35.115901+0000","last_clean_scrub_stamp":"2024-09-14T11:54:35.115901+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:16.357126+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":100,"num_write":302,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"264'542","reported_seq":2221,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:21.889015+0000","last_change":"2024-09-14T11:54:21.889015+0000","last_active":"2024-09-14T11:54:21.889015+0000","last_peered":"2024-09-14T11:54:21.889015+0000","last_clean":"2024-09-14T11:54:21.889015+0000","last_became_active":"2024-09-14T11:09:46.961100+0000","last_became_peered":"2024-09-14T11:09:46.961100+0000","last_unstale":"2024-09-14T11:54:21.889015+0000","last_undegraded":"2024-09-14T11:54:21.889015+0000","last_fullsized":"2024-09-14T11:54:21.889015+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'542","last_scrub_stamp":"2024-09-14T11:54:21.888836+0000","last_deep_scrub":"264'542","last_deep_scrub_stamp":"2024-09-14T11:54:21.888836+0000","last_clean_scrub_stamp":"2024-09-14T11:54:21.888836+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:17.653317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2788,"num_read_kb":2597,"num_write":616,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"264'220","reported_seq":840,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.775701+0000","last_change":"2024-09-14T11:54:08.775701+0000","last_active":"2024-09-14T11:54:08.775701+0000","last_peered":"2024-09-14T11:54:08.775701+0000","last_clean":"2024-09-14T11:54:08.775701+0000","last_became_active":"2024-09-14T11:09:45.198569+0000","last_became_peered":"2024-09-14T11:09:45.198569+0000","last_unstale":"2024-09-14T11:54:08.775701+0000","last_undegraded":"2024-09-14T11:54:08.775701+0000","last_fullsized":"2024-09-14T11:54:08.775701+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'220","last_scrub_stamp":"2024-09-14T11:54:08.775524+0000","last_deep_scrub":"264'220","last_deep_scrub_stamp":"2024-09-14T11:54:08.775524+0000","last_clean_scrub_stamp":"2024-09-14T11:54:08.775524+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:16.447398+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":586,"num_read_kb":15211,"num_write":901,"num_write_kb":32712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.034077+0000","last_change":"2024-09-14T11:54:26.034077+0000","last_active":"2024-09-14T11:54:26.034077+0000","last_peered":"2024-09-14T11:54:26.034077+0000","last_clean":"2024-09-14T11:54:26.034077+0000","last_became_active":"2024-09-14T11:09:48.952531+0000","last_became_peered":"2024-09-14T11:09:48.952531+0000","last_unstale":"2024-09-14T11:54:26.034077+0000","last_undegraded":"2024-09-14T11:54:26.034077+0000","last_fullsized":"2024-09-14T11:54:26.034077+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:26.033870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:26.033870+0000","last_clean_scrub_stamp":"2024-09-14T11:54:26.033870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:11.032743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"264'165","reported_seq":753,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:29.119773+0000","last_change":"2024-09-14T11:54:29.119773+0000","last_active":"2024-09-14T11:54:29.119773+0000","last_peered":"2024-09-14T11:54:29.119773+0000","last_clean":"2024-09-14T11:54:29.119773+0000","last_became_active":"2024-09-14T11:09:50.975455+0000","last_became_peered":"2024-09-14T11:09:50.975455+0000","last_unstale":"2024-09-14T11:54:29.119773+0000","last_undegraded":"2024-09-14T11:54:29.119773+0000","last_fullsized":"2024-09-14T11:54:29.119773+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'165","last_scrub_stamp":"2024-09-14T11:54:29.119569+0000","last_deep_scrub":"264'165","last_deep_scrub_stamp":"2024-09-14T11:54:29.119569+0000","last_clean_scrub_stamp":"2024-09-14T11:54:29.119569+0000","objects_scrubbed":7,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:47.076760+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16336,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":219,"num_read_kb":325,"num_write":124,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"264'773","reported_seq":2371,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:21.345870+0000","last_change":"2024-09-14T11:54:21.345870+0000","last_active":"2024-09-14T11:54:21.345870+0000","last_peered":"2024-09-14T11:54:21.345870+0000","last_clean":"2024-09-14T11:54:21.345870+0000","last_became_active":"2024-09-14T11:09:53.013805+0000","last_became_peered":"2024-09-14T11:09:53.013805+0000","last_unstale":"2024-09-14T11:54:21.345870+0000","last_undegraded":"2024-09-14T11:54:21.345870+0000","last_fullsized":"2024-09-14T11:54:21.345870+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'773","last_scrub_stamp":"2024-09-14T11:54:21.345641+0000","last_deep_scrub":"264'773","last_deep_scrub_stamp":"2024-09-14T11:54:21.345641+0000","last_clean_scrub_stamp":"2024-09-14T11:54:21.345641+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:00.678060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"264'156","reported_seq":669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.643051+0000","last_change":"2024-09-14T11:54:27.643051+0000","last_active":"2024-09-14T11:54:27.643051+0000","last_peered":"2024-09-14T11:54:27.643051+0000","last_clean":"2024-09-14T11:54:27.643051+0000","last_became_active":"2024-09-14T11:09:55.026656+0000","last_became_peered":"2024-09-14T11:09:55.026656+0000","last_unstale":"2024-09-14T11:54:27.643051+0000","last_undegraded":"2024-09-14T11:54:27.643051+0000","last_fullsized":"2024-09-14T11:54:27.643051+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'156","last_scrub_stamp":"2024-09-14T11:54:27.642792+0000","last_deep_scrub":"264'156","last_deep_scrub_stamp":"2024-09-14T11:54:27.642792+0000","last_clean_scrub_stamp":"2024-09-14T11:54:27.642792+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:43.007584+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1884,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":197,"num_read_kb":178,"num_write":396,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"264'509","reported_seq":2091,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.383975+0000","last_change":"2024-09-14T11:54:09.383975+0000","last_active":"2024-09-14T11:54:09.383975+0000","last_peered":"2024-09-14T11:54:09.383975+0000","last_clean":"2024-09-14T11:54:09.383975+0000","last_became_active":"2024-09-14T11:09:46.949867+0000","last_became_peered":"2024-09-14T11:09:46.949867+0000","last_unstale":"2024-09-14T11:54:09.383975+0000","last_undegraded":"2024-09-14T11:54:09.383975+0000","last_fullsized":"2024-09-14T11:54:09.383975+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'509","last_scrub_stamp":"2024-09-14T11:54:09.383770+0000","last_deep_scrub":"264'509","last_deep_scrub_stamp":"2024-09-14T11:54:09.383770+0000","last_clean_scrub_stamp":"2024-09-14T11:54:09.383770+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:39.270981+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2605,"num_read_kb":2418,"num_write":602,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"264'274","reported_seq":970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.730759+0000","last_change":"2024-09-14T11:54:07.730759+0000","last_active":"2024-09-14T11:54:07.730759+0000","last_peered":"2024-09-14T11:54:07.730759+0000","last_clean":"2024-09-14T11:54:07.730759+0000","last_became_active":"2024-09-14T11:09:45.207969+0000","last_became_peered":"2024-09-14T11:09:45.207969+0000","last_unstale":"2024-09-14T11:54:07.730759+0000","last_undegraded":"2024-09-14T11:54:07.730759+0000","last_fullsized":"2024-09-14T11:54:07.730759+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'274","last_scrub_stamp":"2024-09-14T11:54:07.730568+0000","last_deep_scrub":"264'274","last_deep_scrub_stamp":"2024-09-14T11:54:07.730568+0000","last_clean_scrub_stamp":"2024-09-14T11:54:07.730568+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:51.886568+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":716,"num_read_kb":90988,"num_write":1212,"num_write_kb":64456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"264'4","reported_seq":1465,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:16.581905+0000","last_change":"2024-09-14T11:54:16.581905+0000","last_active":"2024-09-14T11:54:16.581905+0000","last_peered":"2024-09-14T11:54:16.581905+0000","last_clean":"2024-09-14T11:54:16.581905+0000","last_became_active":"2024-09-14T11:09:48.961946+0000","last_became_peered":"2024-09-14T11:09:48.961946+0000","last_unstale":"2024-09-14T11:54:16.581905+0000","last_undegraded":"2024-09-14T11:54:16.581905+0000","last_fullsized":"2024-09-14T11:54:16.581905+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T11:54:16.581705+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T11:54:16.581705+0000","last_clean_scrub_stamp":"2024-09-14T11:54:16.581705+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:55.935557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":958,"num_read_kb":958,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"264'87","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.636698+0000","last_change":"2024-09-14T11:54:22.636698+0000","last_active":"2024-09-14T11:54:22.636698+0000","last_peered":"2024-09-14T11:54:22.636698+0000","last_clean":"2024-09-14T11:54:22.636698+0000","last_became_active":"2024-09-14T11:09:50.997281+0000","last_became_peered":"2024-09-14T11:09:50.997281+0000","last_unstale":"2024-09-14T11:54:22.636698+0000","last_undegraded":"2024-09-14T11:54:22.636698+0000","last_fullsized":"2024-09-14T11:54:22.636698+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'87","last_scrub_stamp":"2024-09-14T11:54:22.636343+0000","last_deep_scrub":"264'87","last_deep_scrub_stamp":"2024-09-14T11:54:22.636343+0000","last_clean_scrub_stamp":"2024-09-14T11:54:22.636343+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:32.101718+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"264'802","reported_seq":4470,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.610184+0000","last_change":"2024-09-14T11:54:27.610184+0000","last_active":"2024-09-14T11:54:27.610184+0000","last_peered":"2024-09-14T11:54:27.610184+0000","last_clean":"2024-09-14T11:54:27.610184+0000","last_became_active":"2024-09-14T11:09:53.010631+0000","last_became_peered":"2024-09-14T11:09:53.010631+0000","last_unstale":"2024-09-14T11:54:27.610184+0000","last_undegraded":"2024-09-14T11:54:27.610184+0000","last_fullsized":"2024-09-14T11:54:27.610184+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'802","last_scrub_stamp":"2024-09-14T11:54:27.609998+0000","last_deep_scrub":"264'802","last_deep_scrub_stamp":"2024-09-14T11:54:27.609998+0000","last_clean_scrub_stamp":"2024-09-14T11:54:27.609998+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:15:35.340229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"264'179","reported_seq":686,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.373878+0000","last_change":"2024-09-14T11:54:28.373878+0000","last_active":"2024-09-14T11:54:28.373878+0000","last_peered":"2024-09-14T11:54:28.373878+0000","last_clean":"2024-09-14T11:54:28.373878+0000","last_became_active":"2024-09-14T11:09:55.010215+0000","last_became_peered":"2024-09-14T11:09:55.010215+0000","last_unstale":"2024-09-14T11:54:28.373878+0000","last_undegraded":"2024-09-14T11:54:28.373878+0000","last_fullsized":"2024-09-14T11:54:28.373878+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'179","last_scrub_stamp":"2024-09-14T11:54:28.373690+0000","last_deep_scrub":"264'179","last_deep_scrub_stamp":"2024-09-14T11:54:28.373690+0000","last_clean_scrub_stamp":"2024-09-14T11:54:28.373690+0000","objects_scrubbed":1,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:57.309889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":123,"num_read_kb":114,"num_write":415,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"264'412","reported_seq":1895,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.272327+0000","last_change":"2024-09-14T11:54:09.272327+0000","last_active":"2024-09-14T11:54:09.272327+0000","last_peered":"2024-09-14T11:54:09.272327+0000","last_clean":"2024-09-14T11:54:09.272327+0000","last_became_active":"2024-09-14T11:09:46.966876+0000","last_became_peered":"2024-09-14T11:09:46.966876+0000","last_unstale":"2024-09-14T11:54:09.272327+0000","last_undegraded":"2024-09-14T11:54:09.272327+0000","last_fullsized":"2024-09-14T11:54:09.272327+0000","mapping_epoch":25,"log_start":"264'401","ondisk_log_start":"264'401","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'412","last_scrub_stamp":"2024-09-14T11:54:09.272144+0000","last_deep_scrub":"264'412","last_deep_scrub_stamp":"2024-09-14T11:54:09.272144+0000","last_clean_scrub_stamp":"2024-09-14T11:54:09.272144+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":401,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:51.396054+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2150,"num_read_kb":2036,"num_write":469,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"264'269","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.715548+0000","last_change":"2024-09-14T11:54:06.715548+0000","last_active":"2024-09-14T11:54:06.715548+0000","last_peered":"2024-09-14T11:54:06.715548+0000","last_clean":"2024-09-14T11:54:06.715548+0000","last_became_active":"2024-09-14T11:09:45.200039+0000","last_became_peered":"2024-09-14T11:09:45.200039+0000","last_unstale":"2024-09-14T11:54:06.715548+0000","last_undegraded":"2024-09-14T11:54:06.715548+0000","last_fullsized":"2024-09-14T11:54:06.715548+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'269","last_scrub_stamp":"2024-09-14T11:54:06.715283+0000","last_deep_scrub":"264'269","last_deep_scrub_stamp":"2024-09-14T11:54:06.715283+0000","last_clean_scrub_stamp":"2024-09-14T11:54:06.715283+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:06.417831+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":994,"num_read_kb":201012,"num_write":1230,"num_write_kb":37853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:32.772237+0000","last_change":"2024-09-14T11:54:32.772237+0000","last_active":"2024-09-14T11:54:32.772237+0000","last_peered":"2024-09-14T11:54:32.772237+0000","last_clean":"2024-09-14T11:54:32.772237+0000","last_became_active":"2024-09-14T11:09:48.972957+0000","last_became_peered":"2024-09-14T11:09:48.972957+0000","last_unstale":"2024-09-14T11:54:32.772237+0000","last_undegraded":"2024-09-14T11:54:32.772237+0000","last_fullsized":"2024-09-14T11:54:32.772237+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:32.771921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:32.771921+0000","last_clean_scrub_stamp":"2024-09-14T11:54:32.771921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:04.164477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"264'204","reported_seq":815,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:21.644031+0000","last_change":"2024-09-14T11:54:21.644031+0000","last_active":"2024-09-14T11:54:21.644031+0000","last_peered":"2024-09-14T11:54:21.644031+0000","last_clean":"2024-09-14T11:54:21.644031+0000","last_became_active":"2024-09-14T11:09:50.991938+0000","last_became_peered":"2024-09-14T11:09:50.991938+0000","last_unstale":"2024-09-14T11:54:21.644031+0000","last_undegraded":"2024-09-14T11:54:21.644031+0000","last_fullsized":"2024-09-14T11:54:21.644031+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'204","last_scrub_stamp":"2024-09-14T11:54:21.643805+0000","last_deep_scrub":"264'204","last_deep_scrub_stamp":"2024-09-14T11:54:21.643805+0000","last_clean_scrub_stamp":"2024-09-14T11:54:21.643805+0000","objects_scrubbed":8,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:27.053278+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11553,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":263,"num_read_kb":344,"num_write":148,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:23.317788+0000","last_change":"2024-09-14T11:54:23.317788+0000","last_active":"2024-09-14T11:54:23.317788+0000","last_peered":"2024-09-14T11:54:23.317788+0000","last_clean":"2024-09-14T11:54:23.317788+0000","last_became_active":"2024-09-14T11:09:53.006350+0000","last_became_peered":"2024-09-14T11:09:53.006350+0000","last_unstale":"2024-09-14T11:54:23.317788+0000","last_undegraded":"2024-09-14T11:54:23.317788+0000","last_fullsized":"2024-09-14T11:54:23.317788+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:23.317603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:23.317603+0000","last_clean_scrub_stamp":"2024-09-14T11:54:23.317603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:23.634009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"264'120","reported_seq":613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.344814+0000","last_change":"2024-09-14T11:54:27.344814+0000","last_active":"2024-09-14T11:54:27.344814+0000","last_peered":"2024-09-14T11:54:27.344814+0000","last_clean":"2024-09-14T11:54:27.344814+0000","last_became_active":"2024-09-14T11:09:55.012954+0000","last_became_peered":"2024-09-14T11:09:55.012954+0000","last_unstale":"2024-09-14T11:54:27.344814+0000","last_undegraded":"2024-09-14T11:54:27.344814+0000","last_fullsized":"2024-09-14T11:54:27.344814+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'120","last_scrub_stamp":"2024-09-14T11:54:27.344573+0000","last_deep_scrub":"264'120","last_deep_scrub_stamp":"2024-09-14T11:54:27.344573+0000","last_clean_scrub_stamp":"2024-09-14T11:54:27.344573+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:56.104563+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":106,"num_write":256,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"264'405","reported_seq":2080,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.883536+0000","last_change":"2024-09-14T11:54:19.883536+0000","last_active":"2024-09-14T11:54:19.883536+0000","last_peered":"2024-09-14T11:54:19.883536+0000","last_clean":"2024-09-14T11:54:19.883536+0000","last_became_active":"2024-09-14T11:09:46.960461+0000","last_became_peered":"2024-09-14T11:09:46.960461+0000","last_unstale":"2024-09-14T11:54:19.883536+0000","last_undegraded":"2024-09-14T11:54:19.883536+0000","last_fullsized":"2024-09-14T11:54:19.883536+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'405","last_scrub_stamp":"2024-09-14T11:54:19.883237+0000","last_deep_scrub":"264'405","last_deep_scrub_stamp":"2024-09-14T11:54:19.883237+0000","last_clean_scrub_stamp":"2024-09-14T11:54:19.883237+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:36.272832+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2438,"num_read_kb":2343,"num_write":447,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2036,"num_omap_keys":8,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"264'74","reported_seq":620,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:01.651107+0000","last_change":"2024-09-14T11:54:01.651107+0000","last_active":"2024-09-14T11:54:01.651107+0000","last_peered":"2024-09-14T11:54:01.651107+0000","last_clean":"2024-09-14T11:54:01.651107+0000","last_became_active":"2024-09-14T11:09:30.309524+0000","last_became_peered":"2024-09-14T11:09:30.309524+0000","last_unstale":"2024-09-14T11:54:01.651107+0000","last_undegraded":"2024-09-14T11:54:01.651107+0000","last_fullsized":"2024-09-14T11:54:01.651107+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'74","last_scrub_stamp":"2024-09-14T11:54:01.650935+0000","last_deep_scrub":"264'74","last_deep_scrub_stamp":"2024-09-14T11:54:01.650935+0000","last_clean_scrub_stamp":"2024-09-14T11:54:01.650935+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:53.062420+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"264'2","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.837336+0000","last_change":"2024-09-14T11:54:04.837336+0000","last_active":"2024-09-14T11:54:04.837336+0000","last_peered":"2024-09-14T11:54:04.837336+0000","last_clean":"2024-09-14T11:54:04.837336+0000","last_became_active":"2024-09-14T11:09:36.264768+0000","last_became_peered":"2024-09-14T11:09:36.264768+0000","last_unstale":"2024-09-14T11:54:04.837336+0000","last_undegraded":"2024-09-14T11:54:04.837336+0000","last_fullsized":"2024-09-14T11:54:04.837336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:04.837116+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:04.837116+0000","last_clean_scrub_stamp":"2024-09-14T11:54:04.837116+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:31.345731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00092723999999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"264'271","reported_seq":1086,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:03.714182+0000","last_change":"2024-09-14T11:54:03.714182+0000","last_active":"2024-09-14T11:54:03.714182+0000","last_peered":"2024-09-14T11:54:03.714182+0000","last_clean":"2024-09-14T11:54:03.714182+0000","last_became_active":"2024-09-14T11:09:45.193131+0000","last_became_peered":"2024-09-14T11:09:45.193131+0000","last_unstale":"2024-09-14T11:54:03.714182+0000","last_undegraded":"2024-09-14T11:54:03.714182+0000","last_fullsized":"2024-09-14T11:54:03.714182+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'271","last_scrub_stamp":"2024-09-14T11:54:03.713998+0000","last_deep_scrub":"264'271","last_deep_scrub_stamp":"2024-09-14T11:54:03.713998+0000","last_clean_scrub_stamp":"2024-09-14T11:54:03.713998+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:24.565125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1127,"num_read_kb":141056,"num_write":1044,"num_write_kb":44809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.830566+0000","last_change":"2024-09-14T11:54:20.830566+0000","last_active":"2024-09-14T11:54:20.830566+0000","last_peered":"2024-09-14T11:54:20.830566+0000","last_clean":"2024-09-14T11:54:20.830566+0000","last_became_active":"2024-09-14T11:09:48.970541+0000","last_became_peered":"2024-09-14T11:09:48.970541+0000","last_unstale":"2024-09-14T11:54:20.830566+0000","last_undegraded":"2024-09-14T11:54:20.830566+0000","last_fullsized":"2024-09-14T11:54:20.830566+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:20.830380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:20.830380+0000","last_clean_scrub_stamp":"2024-09-14T11:54:20.830380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:49.298720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"264'305","reported_seq":1009,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:35.744680+0000","last_change":"2024-09-14T11:54:35.744680+0000","last_active":"2024-09-14T11:54:35.744680+0000","last_peered":"2024-09-14T11:54:35.744680+0000","last_clean":"2024-09-14T11:54:35.744680+0000","last_became_active":"2024-09-14T11:09:50.993231+0000","last_became_peered":"2024-09-14T11:09:50.993231+0000","last_unstale":"2024-09-14T11:54:35.744680+0000","last_undegraded":"2024-09-14T11:54:35.744680+0000","last_fullsized":"2024-09-14T11:54:35.744680+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'305","last_scrub_stamp":"2024-09-14T11:54:35.744486+0000","last_deep_scrub":"264'305","last_deep_scrub_stamp":"2024-09-14T11:54:35.744486+0000","last_clean_scrub_stamp":"2024-09-14T11:54:35.744486+0000","objects_scrubbed":6,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:12.554646+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22194,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":549,"num_read_kb":706,"num_write":484,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106814,"num_omap_keys":256,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:32.086476+0000","last_change":"2024-09-14T11:54:32.086476+0000","last_active":"2024-09-14T11:54:32.086476+0000","last_peered":"2024-09-14T11:54:32.086476+0000","last_clean":"2024-09-14T11:54:32.086476+0000","last_became_active":"2024-09-14T11:09:53.004338+0000","last_became_peered":"2024-09-14T11:09:53.004338+0000","last_unstale":"2024-09-14T11:54:32.086476+0000","last_undegraded":"2024-09-14T11:54:32.086476+0000","last_fullsized":"2024-09-14T11:54:32.086476+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:32.086262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:32.086262+0000","last_clean_scrub_stamp":"2024-09-14T11:54:32.086262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:41.804074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"264'239","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.880952+0000","last_change":"2024-09-14T11:54:22.880952+0000","last_active":"2024-09-14T11:54:22.880952+0000","last_peered":"2024-09-14T11:54:22.880952+0000","last_clean":"2024-09-14T11:54:22.880952+0000","last_became_active":"2024-09-14T11:09:55.015569+0000","last_became_peered":"2024-09-14T11:09:55.015569+0000","last_unstale":"2024-09-14T11:54:22.880952+0000","last_undegraded":"2024-09-14T11:54:22.880952+0000","last_fullsized":"2024-09-14T11:54:22.880952+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'239","last_scrub_stamp":"2024-09-14T11:54:22.880736+0000","last_deep_scrub":"264'239","last_deep_scrub_stamp":"2024-09-14T11:54:22.880736+0000","last_clean_scrub_stamp":"2024-09-14T11:54:22.880736+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:24.816809+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1424,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":528,"num_read_kb":505,"num_write":525,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"264'794","reported_seq":2257,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.038964+0000","last_change":"2024-09-14T11:54:17.038964+0000","last_active":"2024-09-14T11:54:17.038964+0000","last_peered":"2024-09-14T11:54:17.038964+0000","last_clean":"2024-09-14T11:54:17.038964+0000","last_became_active":"2024-09-14T11:09:46.974517+0000","last_became_peered":"2024-09-14T11:09:46.974517+0000","last_unstale":"2024-09-14T11:54:17.038964+0000","last_undegraded":"2024-09-14T11:54:17.038964+0000","last_fullsized":"2024-09-14T11:54:17.038964+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'794","last_scrub_stamp":"2024-09-14T11:54:17.038783+0000","last_deep_scrub":"264'794","last_deep_scrub_stamp":"2024-09-14T11:54:17.038783+0000","last_clean_scrub_stamp":"2024-09-14T11:54:17.038783+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:13.442249+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3876,"num_read_kb":3470,"num_write":1072,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:03.793921+0000","last_change":"2024-09-14T11:54:03.793921+0000","last_active":"2024-09-14T11:54:03.793921+0000","last_peered":"2024-09-14T11:54:03.793921+0000","last_clean":"2024-09-14T11:54:03.793921+0000","last_became_active":"2024-09-14T11:09:36.110037+0000","last_became_peered":"2024-09-14T11:09:36.110037+0000","last_unstale":"2024-09-14T11:54:03.793921+0000","last_undegraded":"2024-09-14T11:54:03.793921+0000","last_fullsized":"2024-09-14T11:54:03.793921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:03.793825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:03.793825+0000","last_clean_scrub_stamp":"2024-09-14T11:54:03.793825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:58.071609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001043441,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"264'225","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.624617+0000","last_change":"2024-09-14T11:54:05.624617+0000","last_active":"2024-09-14T11:54:05.624617+0000","last_peered":"2024-09-14T11:54:05.624617+0000","last_clean":"2024-09-14T11:54:05.624617+0000","last_became_active":"2024-09-14T11:09:45.211579+0000","last_became_peered":"2024-09-14T11:09:45.211579+0000","last_unstale":"2024-09-14T11:54:05.624617+0000","last_undegraded":"2024-09-14T11:54:05.624617+0000","last_fullsized":"2024-09-14T11:54:05.624617+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'225","last_scrub_stamp":"2024-09-14T11:54:05.624423+0000","last_deep_scrub":"264'225","last_deep_scrub_stamp":"2024-09-14T11:54:05.624423+0000","last_clean_scrub_stamp":"2024-09-14T11:54:05.624423+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:48.379755+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":626,"num_read_kb":58466,"num_write":936,"num_write_kb":31030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:29.858547+0000","last_change":"2024-09-14T11:54:29.858547+0000","last_active":"2024-09-14T11:54:29.858547+0000","last_peered":"2024-09-14T11:54:29.858547+0000","last_clean":"2024-09-14T11:54:29.858547+0000","last_became_active":"2024-09-14T11:09:48.970218+0000","last_became_peered":"2024-09-14T11:09:48.970218+0000","last_unstale":"2024-09-14T11:54:29.858547+0000","last_undegraded":"2024-09-14T11:54:29.858547+0000","last_fullsized":"2024-09-14T11:54:29.858547+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:29.858359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:29.858359+0000","last_clean_scrub_stamp":"2024-09-14T11:54:29.858359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:44.732920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"264'872","reported_seq":2339,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.381488+0000","last_change":"2024-09-14T11:54:20.381488+0000","last_active":"2024-09-14T11:54:20.381488+0000","last_peered":"2024-09-14T11:54:20.381488+0000","last_clean":"2024-09-14T11:54:20.381488+0000","last_became_active":"2024-09-14T11:09:50.996406+0000","last_became_peered":"2024-09-14T11:09:50.996406+0000","last_unstale":"2024-09-14T11:54:20.381488+0000","last_undegraded":"2024-09-14T11:54:20.381488+0000","last_fullsized":"2024-09-14T11:54:20.381488+0000","mapping_epoch":29,"log_start":"264'800","ondisk_log_start":"264'800","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'872","last_scrub_stamp":"2024-09-14T11:54:20.381285+0000","last_deep_scrub":"264'872","last_deep_scrub_stamp":"2024-09-14T11:54:20.381285+0000","last_clean_scrub_stamp":"2024-09-14T11:54:20.381285+0000","objects_scrubbed":11,"log_size":72,"log_dups_size":800,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:34.362640+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34005,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1184,"num_read_kb":1407,"num_write":288,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:40.720017+0000","last_change":"2024-09-14T11:54:40.720017+0000","last_active":"2024-09-14T11:54:40.720017+0000","last_peered":"2024-09-14T11:54:40.720017+0000","last_clean":"2024-09-14T11:54:40.720017+0000","last_became_active":"2024-09-14T11:09:53.022006+0000","last_became_peered":"2024-09-14T11:09:53.022006+0000","last_unstale":"2024-09-14T11:54:40.720017+0000","last_undegraded":"2024-09-14T11:54:40.720017+0000","last_fullsized":"2024-09-14T11:54:40.720017+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:40.719788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:40.719788+0000","last_clean_scrub_stamp":"2024-09-14T11:54:40.719788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:06.582867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"264'219","reported_seq":754,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:36.113973+0000","last_change":"2024-09-14T11:54:36.113973+0000","last_active":"2024-09-14T11:54:36.113973+0000","last_peered":"2024-09-14T11:54:36.113973+0000","last_clean":"2024-09-14T11:54:36.113973+0000","last_became_active":"2024-09-14T11:09:55.023966+0000","last_became_peered":"2024-09-14T11:09:55.023966+0000","last_unstale":"2024-09-14T11:54:36.113973+0000","last_undegraded":"2024-09-14T11:54:36.113973+0000","last_fullsized":"2024-09-14T11:54:36.113973+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'219","last_scrub_stamp":"2024-09-14T11:54:36.113759+0000","last_deep_scrub":"264'219","last_deep_scrub_stamp":"2024-09-14T11:54:36.113759+0000","last_clean_scrub_stamp":"2024-09-14T11:54:36.113759+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:37.214318+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":224,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":295,"num_read_kb":259,"num_write":448,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"264'467","reported_seq":2179,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:12.580698+0000","last_change":"2024-09-14T11:54:12.580698+0000","last_active":"2024-09-14T11:54:12.580698+0000","last_peered":"2024-09-14T11:54:12.580698+0000","last_clean":"2024-09-14T11:54:12.580698+0000","last_became_active":"2024-09-14T11:09:46.981472+0000","last_became_peered":"2024-09-14T11:09:46.981472+0000","last_unstale":"2024-09-14T11:54:12.580698+0000","last_undegraded":"2024-09-14T11:54:12.580698+0000","last_fullsized":"2024-09-14T11:54:12.580698+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'467","last_scrub_stamp":"2024-09-14T11:54:12.580519+0000","last_deep_scrub":"264'467","last_deep_scrub_stamp":"2024-09-14T11:54:12.580519+0000","last_clean_scrub_stamp":"2024-09-14T11:54:12.580519+0000","objects_scrubbed":3,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:18.230648+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2625,"num_read_kb":2493,"num_write":542,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":468,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":521,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.269223+0000","last_change":"2024-09-14T11:54:04.269223+0000","last_active":"2024-09-14T11:54:04.269223+0000","last_peered":"2024-09-14T11:54:04.269223+0000","last_clean":"2024-09-14T11:54:04.269223+0000","last_became_active":"2024-09-14T11:09:36.110778+0000","last_became_peered":"2024-09-14T11:09:36.110778+0000","last_unstale":"2024-09-14T11:54:04.269223+0000","last_undegraded":"2024-09-14T11:54:04.269223+0000","last_fullsized":"2024-09-14T11:54:04.269223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:04.269043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:04.269043+0000","last_clean_scrub_stamp":"2024-09-14T11:54:04.269043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:43.617127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001188634,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"264'181","reported_seq":786,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.103277+0000","last_change":"2024-09-14T11:54:11.103277+0000","last_active":"2024-09-14T11:54:11.103277+0000","last_peered":"2024-09-14T11:54:11.103277+0000","last_clean":"2024-09-14T11:54:11.103277+0000","last_became_active":"2024-09-14T11:09:45.214670+0000","last_became_peered":"2024-09-14T11:09:45.214670+0000","last_unstale":"2024-09-14T11:54:11.103277+0000","last_undegraded":"2024-09-14T11:54:11.103277+0000","last_fullsized":"2024-09-14T11:54:11.103277+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'181","last_scrub_stamp":"2024-09-14T11:54:11.103055+0000","last_deep_scrub":"264'181","last_deep_scrub_stamp":"2024-09-14T11:54:11.103055+0000","last_clean_scrub_stamp":"2024-09-14T11:54:11.103055+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:09.808494+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":427,"num_read_kb":11641,"num_write":795,"num_write_kb":32063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"264'2","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.410405+0000","last_change":"2024-09-14T11:54:17.410405+0000","last_active":"2024-09-14T11:54:17.410405+0000","last_peered":"2024-09-14T11:54:17.410405+0000","last_clean":"2024-09-14T11:54:17.410405+0000","last_became_active":"2024-09-14T11:09:48.968973+0000","last_became_peered":"2024-09-14T11:09:48.968973+0000","last_unstale":"2024-09-14T11:54:17.410405+0000","last_undegraded":"2024-09-14T11:54:17.410405+0000","last_fullsized":"2024-09-14T11:54:17.410405+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:17.410202+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:17.410202+0000","last_clean_scrub_stamp":"2024-09-14T11:54:17.410202+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:57.558922+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"264'243","reported_seq":1322,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.884841+0000","last_change":"2024-09-14T11:54:19.884841+0000","last_active":"2024-09-14T11:54:19.884841+0000","last_peered":"2024-09-14T11:54:19.884841+0000","last_clean":"2024-09-14T11:54:19.884841+0000","last_became_active":"2024-09-14T11:09:50.992589+0000","last_became_peered":"2024-09-14T11:09:50.992589+0000","last_unstale":"2024-09-14T11:54:19.884841+0000","last_undegraded":"2024-09-14T11:54:19.884841+0000","last_fullsized":"2024-09-14T11:54:19.884841+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'243","last_scrub_stamp":"2024-09-14T11:54:19.884635+0000","last_deep_scrub":"264'243","last_deep_scrub_stamp":"2024-09-14T11:54:19.884635+0000","last_clean_scrub_stamp":"2024-09-14T11:54:19.884635+0000","objects_scrubbed":9,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:08.377002+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":182,"num_read_kb":171,"num_write":149,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:33.968643+0000","last_change":"2024-09-14T11:54:33.968643+0000","last_active":"2024-09-14T11:54:33.968643+0000","last_peered":"2024-09-14T11:54:33.968643+0000","last_clean":"2024-09-14T11:54:33.968643+0000","last_became_active":"2024-09-14T11:09:53.007705+0000","last_became_peered":"2024-09-14T11:09:53.007705+0000","last_unstale":"2024-09-14T11:54:33.968643+0000","last_undegraded":"2024-09-14T11:54:33.968643+0000","last_fullsized":"2024-09-14T11:54:33.968643+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:33.968471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:33.968471+0000","last_clean_scrub_stamp":"2024-09-14T11:54:33.968471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:00.416592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"264'274","reported_seq":878,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.044137+0000","last_change":"2024-09-14T11:54:38.044137+0000","last_active":"2024-09-14T11:54:38.044137+0000","last_peered":"2024-09-14T11:54:38.044137+0000","last_clean":"2024-09-14T11:54:38.044137+0000","last_became_active":"2024-09-14T11:09:55.013944+0000","last_became_peered":"2024-09-14T11:09:55.013944+0000","last_unstale":"2024-09-14T11:54:38.044137+0000","last_undegraded":"2024-09-14T11:54:38.044137+0000","last_fullsized":"2024-09-14T11:54:38.044137+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'274","last_scrub_stamp":"2024-09-14T11:54:38.043916+0000","last_deep_scrub":"264'274","last_deep_scrub_stamp":"2024-09-14T11:54:38.043916+0000","last_clean_scrub_stamp":"2024-09-14T11:54:38.043916+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:39.814417+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":495,"num_read_kb":519,"num_write":596,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"264'934","reported_seq":2826,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.609638+0000","last_change":"2024-09-14T11:54:11.609638+0000","last_active":"2024-09-14T11:54:11.609638+0000","last_peered":"2024-09-14T11:54:11.609638+0000","last_clean":"2024-09-14T11:54:11.609638+0000","last_became_active":"2024-09-14T11:09:46.982027+0000","last_became_peered":"2024-09-14T11:09:46.982027+0000","last_unstale":"2024-09-14T11:54:11.609638+0000","last_undegraded":"2024-09-14T11:54:11.609638+0000","last_fullsized":"2024-09-14T11:54:11.609638+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'934","last_scrub_stamp":"2024-09-14T11:54:11.609414+0000","last_deep_scrub":"264'934","last_deep_scrub_stamp":"2024-09-14T11:54:11.609414+0000","last_clean_scrub_stamp":"2024-09-14T11:54:11.609414+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":900,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:10.281778+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4697,"num_read_kb":4271,"num_write":1214,"num_write_kb":435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3500,"num_omap_keys":14,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"264'3","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:02.833788+0000","last_change":"2024-09-14T11:54:02.833788+0000","last_active":"2024-09-14T11:54:02.833788+0000","last_peered":"2024-09-14T11:54:02.833788+0000","last_clean":"2024-09-14T11:54:02.833788+0000","last_became_active":"2024-09-14T11:09:36.887391+0000","last_became_peered":"2024-09-14T11:09:36.887391+0000","last_unstale":"2024-09-14T11:54:02.833788+0000","last_undegraded":"2024-09-14T11:54:02.833788+0000","last_fullsized":"2024-09-14T11:54:02.833788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:54:02.833629+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:54:02.833629+0000","last_clean_scrub_stamp":"2024-09-14T11:54:02.833629+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:54.259925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0023357849999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"264'265","reported_seq":918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.668795+0000","last_change":"2024-09-14T11:54:06.668795+0000","last_active":"2024-09-14T11:54:06.668795+0000","last_peered":"2024-09-14T11:54:06.668795+0000","last_clean":"2024-09-14T11:54:06.668795+0000","last_became_active":"2024-09-14T11:09:45.206492+0000","last_became_peered":"2024-09-14T11:09:45.206492+0000","last_unstale":"2024-09-14T11:54:06.668795+0000","last_undegraded":"2024-09-14T11:54:06.668795+0000","last_fullsized":"2024-09-14T11:54:06.668795+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'265","last_scrub_stamp":"2024-09-14T11:54:06.668580+0000","last_deep_scrub":"264'265","last_deep_scrub_stamp":"2024-09-14T11:54:06.668580+0000","last_clean_scrub_stamp":"2024-09-14T11:54:06.668580+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:06.267313+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":656,"num_read_kb":889,"num_write":1198,"num_write_kb":16465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:16.415674+0000","last_change":"2024-09-14T11:54:16.415674+0000","last_active":"2024-09-14T11:54:16.415674+0000","last_peered":"2024-09-14T11:54:16.415674+0000","last_clean":"2024-09-14T11:54:16.415674+0000","last_became_active":"2024-09-14T11:09:48.976315+0000","last_became_peered":"2024-09-14T11:09:48.976315+0000","last_unstale":"2024-09-14T11:54:16.415674+0000","last_undegraded":"2024-09-14T11:54:16.415674+0000","last_fullsized":"2024-09-14T11:54:16.415674+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:16.415478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:16.415478+0000","last_clean_scrub_stamp":"2024-09-14T11:54:16.415478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:28.319046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"264'128","reported_seq":673,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.101981+0000","last_change":"2024-09-14T11:54:28.101981+0000","last_active":"2024-09-14T11:54:28.101981+0000","last_peered":"2024-09-14T11:54:28.101981+0000","last_clean":"2024-09-14T11:54:28.101981+0000","last_became_active":"2024-09-14T11:09:50.983126+0000","last_became_peered":"2024-09-14T11:09:50.983126+0000","last_unstale":"2024-09-14T11:54:28.101981+0000","last_undegraded":"2024-09-14T11:54:28.101981+0000","last_fullsized":"2024-09-14T11:54:28.101981+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'128","last_scrub_stamp":"2024-09-14T11:54:28.101719+0000","last_deep_scrub":"264'128","last_deep_scrub_stamp":"2024-09-14T11:54:28.101719+0000","last_clean_scrub_stamp":"2024-09-14T11:54:28.101719+0000","objects_scrubbed":7,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:44.669683+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.699459+0000","last_change":"2024-09-14T11:54:42.699459+0000","last_active":"2024-09-14T11:54:42.699459+0000","last_peered":"2024-09-14T11:54:42.699459+0000","last_clean":"2024-09-14T11:54:42.699459+0000","last_became_active":"2024-09-14T11:09:53.015100+0000","last_became_peered":"2024-09-14T11:09:53.015100+0000","last_unstale":"2024-09-14T11:54:42.699459+0000","last_undegraded":"2024-09-14T11:54:42.699459+0000","last_fullsized":"2024-09-14T11:54:42.699459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:42.699238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:42.699238+0000","last_clean_scrub_stamp":"2024-09-14T11:54:42.699238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:22.933735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"264'127","reported_seq":685,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.585876+0000","last_change":"2024-09-14T11:54:26.585876+0000","last_active":"2024-09-14T11:54:26.585876+0000","last_peered":"2024-09-14T11:54:26.585876+0000","last_clean":"2024-09-14T11:54:26.585876+0000","last_became_active":"2024-09-14T11:09:55.025030+0000","last_became_peered":"2024-09-14T11:09:55.025030+0000","last_unstale":"2024-09-14T11:54:26.585876+0000","last_undegraded":"2024-09-14T11:54:26.585876+0000","last_fullsized":"2024-09-14T11:54:26.585876+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'127","last_scrub_stamp":"2024-09-14T11:54:26.585644+0000","last_deep_scrub":"264'127","last_deep_scrub_stamp":"2024-09-14T11:54:26.585644+0000","last_clean_scrub_stamp":"2024-09-14T11:54:26.585644+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:50:23.463245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":244,"num_read_kb":234,"num_write":307,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"264'432","reported_seq":1982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.590727+0000","last_change":"2024-09-14T11:54:13.590727+0000","last_active":"2024-09-14T11:54:13.590727+0000","last_peered":"2024-09-14T11:54:13.590727+0000","last_clean":"2024-09-14T11:54:13.590727+0000","last_became_active":"2024-09-14T11:09:46.981578+0000","last_became_peered":"2024-09-14T11:09:46.981578+0000","last_unstale":"2024-09-14T11:54:13.590727+0000","last_undegraded":"2024-09-14T11:54:13.590727+0000","last_fullsized":"2024-09-14T11:54:13.590727+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'432","last_scrub_stamp":"2024-09-14T11:54:13.590489+0000","last_deep_scrub":"264'432","last_deep_scrub_stamp":"2024-09-14T11:54:13.590489+0000","last_clean_scrub_stamp":"2024-09-14T11:54:13.590489+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:33.384996+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2336,"num_read_kb":2209,"num_write":501,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"264'246","reported_seq":892,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.337591+0000","last_change":"2024-09-14T11:54:06.337591+0000","last_active":"2024-09-14T11:54:06.337591+0000","last_peered":"2024-09-14T11:54:06.337591+0000","last_clean":"2024-09-14T11:54:06.337591+0000","last_became_active":"2024-09-14T11:09:45.216168+0000","last_became_peered":"2024-09-14T11:09:45.216168+0000","last_unstale":"2024-09-14T11:54:06.337591+0000","last_undegraded":"2024-09-14T11:54:06.337591+0000","last_fullsized":"2024-09-14T11:54:06.337591+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'246","last_scrub_stamp":"2024-09-14T11:54:06.337308+0000","last_deep_scrub":"264'246","last_deep_scrub_stamp":"2024-09-14T11:54:06.337308+0000","last_clean_scrub_stamp":"2024-09-14T11:54:06.337308+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:05.110637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":603,"num_read_kb":12400,"num_write":1048,"num_write_kb":24779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.160781+0000","last_change":"2024-09-14T11:54:04.160781+0000","last_active":"2024-09-14T11:54:04.160781+0000","last_peered":"2024-09-14T11:54:04.160781+0000","last_clean":"2024-09-14T11:54:04.160781+0000","last_became_active":"2024-09-14T11:09:36.887411+0000","last_became_peered":"2024-09-14T11:09:36.887411+0000","last_unstale":"2024-09-14T11:54:04.160781+0000","last_undegraded":"2024-09-14T11:54:04.160781+0000","last_fullsized":"2024-09-14T11:54:04.160781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:04.160581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:04.160581+0000","last_clean_scrub_stamp":"2024-09-14T11:54:04.160581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:54.717604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001210341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.809935+0000","last_change":"2024-09-14T11:54:20.809935+0000","last_active":"2024-09-14T11:54:20.809935+0000","last_peered":"2024-09-14T11:54:20.809935+0000","last_clean":"2024-09-14T11:54:20.809935+0000","last_became_active":"2024-09-14T11:09:48.969262+0000","last_became_peered":"2024-09-14T11:09:48.969262+0000","last_unstale":"2024-09-14T11:54:20.809935+0000","last_undegraded":"2024-09-14T11:54:20.809935+0000","last_fullsized":"2024-09-14T11:54:20.809935+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:20.809747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:20.809747+0000","last_clean_scrub_stamp":"2024-09-14T11:54:20.809747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:07.903941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"264'289","reported_seq":952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.417729+0000","last_change":"2024-09-14T11:54:18.417729+0000","last_active":"2024-09-14T11:54:18.417729+0000","last_peered":"2024-09-14T11:54:18.417729+0000","last_clean":"2024-09-14T11:54:18.417729+0000","last_became_active":"2024-09-14T11:09:50.991958+0000","last_became_peered":"2024-09-14T11:09:50.991958+0000","last_unstale":"2024-09-14T11:54:18.417729+0000","last_undegraded":"2024-09-14T11:54:18.417729+0000","last_fullsized":"2024-09-14T11:54:18.417729+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'289","last_scrub_stamp":"2024-09-14T11:54:18.417492+0000","last_deep_scrub":"264'289","last_deep_scrub_stamp":"2024-09-14T11:54:18.417492+0000","last_clean_scrub_stamp":"2024-09-14T11:54:18.417492+0000","objects_scrubbed":10,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:27.379177+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26179,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1035,"num_read_kb":1185,"num_write":1534,"num_write_kb":1392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":535828,"num_omap_keys":1208,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.328687+0000","last_change":"2024-09-14T11:54:18.328687+0000","last_active":"2024-09-14T11:54:18.328687+0000","last_peered":"2024-09-14T11:54:18.328687+0000","last_clean":"2024-09-14T11:54:18.328687+0000","last_became_active":"2024-09-14T11:09:53.001945+0000","last_became_peered":"2024-09-14T11:09:53.001945+0000","last_unstale":"2024-09-14T11:54:18.328687+0000","last_undegraded":"2024-09-14T11:54:18.328687+0000","last_fullsized":"2024-09-14T11:54:18.328687+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:18.328403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:18.328403+0000","last_clean_scrub_stamp":"2024-09-14T11:54:18.328403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:12.397430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"264'180","reported_seq":723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:39.103932+0000","last_change":"2024-09-14T11:54:39.103932+0000","last_active":"2024-09-14T11:54:39.103932+0000","last_peered":"2024-09-14T11:54:39.103932+0000","last_clean":"2024-09-14T11:54:39.103932+0000","last_became_active":"2024-09-14T11:09:55.019043+0000","last_became_peered":"2024-09-14T11:09:55.019043+0000","last_unstale":"2024-09-14T11:54:39.103932+0000","last_undegraded":"2024-09-14T11:54:39.103932+0000","last_fullsized":"2024-09-14T11:54:39.103932+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'180","last_scrub_stamp":"2024-09-14T11:54:39.103736+0000","last_deep_scrub":"264'180","last_deep_scrub_stamp":"2024-09-14T11:54:39.103736+0000","last_clean_scrub_stamp":"2024-09-14T11:54:39.103736+0000","objects_scrubbed":4,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:11:28.065517+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":311,"num_read_kb":271,"num_write":434,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"264'394","reported_seq":1919,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.629013+0000","last_change":"2024-09-14T11:54:08.629013+0000","last_active":"2024-09-14T11:54:08.629013+0000","last_peered":"2024-09-14T11:54:08.629013+0000","last_clean":"2024-09-14T11:54:08.629013+0000","last_became_active":"2024-09-14T11:09:46.979673+0000","last_became_peered":"2024-09-14T11:09:46.979673+0000","last_unstale":"2024-09-14T11:54:08.629013+0000","last_undegraded":"2024-09-14T11:54:08.629013+0000","last_fullsized":"2024-09-14T11:54:08.629013+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'394","last_scrub_stamp":"2024-09-14T11:54:08.628827+0000","last_deep_scrub":"264'394","last_deep_scrub_stamp":"2024-09-14T11:54:08.628827+0000","last_clean_scrub_stamp":"2024-09-14T11:54:08.628827+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:41.485918+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2181,"num_read_kb":2077,"num_write":440,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":892,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"264'177","reported_seq":756,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:03.638455+0000","last_change":"2024-09-14T11:54:03.638455+0000","last_active":"2024-09-14T11:54:03.638455+0000","last_peered":"2024-09-14T11:54:03.638455+0000","last_clean":"2024-09-14T11:54:03.638455+0000","last_became_active":"2024-09-14T11:09:45.220512+0000","last_became_peered":"2024-09-14T11:09:45.220512+0000","last_unstale":"2024-09-14T11:54:03.638455+0000","last_undegraded":"2024-09-14T11:54:03.638455+0000","last_fullsized":"2024-09-14T11:54:03.638455+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-09-14T11:54:03.638201+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-09-14T11:54:03.638201+0000","last_clean_scrub_stamp":"2024-09-14T11:54:03.638201+0000","objects_scrubbed":6,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:08.150074+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655861,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":337,"num_read_kb":1928,"num_write":799,"num_write_kb":32938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.796853+0000","last_change":"2024-09-14T11:54:05.796853+0000","last_active":"2024-09-14T11:54:05.796853+0000","last_peered":"2024-09-14T11:54:05.796853+0000","last_clean":"2024-09-14T11:54:05.796853+0000","last_became_active":"2024-09-14T11:09:36.110624+0000","last_became_peered":"2024-09-14T11:09:36.110624+0000","last_unstale":"2024-09-14T11:54:05.796853+0000","last_undegraded":"2024-09-14T11:54:05.796853+0000","last_fullsized":"2024-09-14T11:54:05.796853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:05.796663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:05.796663+0000","last_clean_scrub_stamp":"2024-09-14T11:54:05.796663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:14.358427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.002569127,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:16.834905+0000","last_change":"2024-09-14T11:54:16.834905+0000","last_active":"2024-09-14T11:54:16.834905+0000","last_peered":"2024-09-14T11:54:16.834905+0000","last_clean":"2024-09-14T11:54:16.834905+0000","last_became_active":"2024-09-14T11:09:48.968130+0000","last_became_peered":"2024-09-14T11:09:48.968130+0000","last_unstale":"2024-09-14T11:54:16.834905+0000","last_undegraded":"2024-09-14T11:54:16.834905+0000","last_fullsized":"2024-09-14T11:54:16.834905+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:16.834719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:16.834719+0000","last_clean_scrub_stamp":"2024-09-14T11:54:16.834719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:03.396931+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"264'164","reported_seq":731,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:21.634619+0000","last_change":"2024-09-14T11:54:21.634619+0000","last_active":"2024-09-14T11:54:21.634619+0000","last_peered":"2024-09-14T11:54:21.634619+0000","last_clean":"2024-09-14T11:54:21.634619+0000","last_became_active":"2024-09-14T11:09:50.997665+0000","last_became_peered":"2024-09-14T11:09:50.997665+0000","last_unstale":"2024-09-14T11:54:21.634619+0000","last_undegraded":"2024-09-14T11:54:21.634619+0000","last_fullsized":"2024-09-14T11:54:21.634619+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'164","last_scrub_stamp":"2024-09-14T11:54:21.634404+0000","last_deep_scrub":"264'164","last_deep_scrub_stamp":"2024-09-14T11:54:21.634404+0000","last_clean_scrub_stamp":"2024-09-14T11:54:21.634404+0000","objects_scrubbed":7,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:42.569487+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":193,"num_read_kb":186,"num_write":126,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"264'803","reported_seq":2781,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.590790+0000","last_change":"2024-09-14T11:54:22.590790+0000","last_active":"2024-09-14T11:54:22.590790+0000","last_peered":"2024-09-14T11:54:22.590790+0000","last_clean":"2024-09-14T11:54:22.590790+0000","last_became_active":"2024-09-14T11:09:53.018558+0000","last_became_peered":"2024-09-14T11:09:53.018558+0000","last_unstale":"2024-09-14T11:54:22.590790+0000","last_undegraded":"2024-09-14T11:54:22.590790+0000","last_fullsized":"2024-09-14T11:54:22.590790+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'803","last_scrub_stamp":"2024-09-14T11:54:22.590509+0000","last_deep_scrub":"264'803","last_deep_scrub_stamp":"2024-09-14T11:54:22.590509+0000","last_clean_scrub_stamp":"2024-09-14T11:54:22.590509+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:46:00.083819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"264'105","reported_seq":604,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:29.396336+0000","last_change":"2024-09-14T11:54:29.396336+0000","last_active":"2024-09-14T11:54:29.396336+0000","last_peered":"2024-09-14T11:54:29.396336+0000","last_clean":"2024-09-14T11:54:29.396336+0000","last_became_active":"2024-09-14T11:09:55.017739+0000","last_became_peered":"2024-09-14T11:09:55.017739+0000","last_unstale":"2024-09-14T11:54:29.396336+0000","last_undegraded":"2024-09-14T11:54:29.396336+0000","last_fullsized":"2024-09-14T11:54:29.396336+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'105","last_scrub_stamp":"2024-09-14T11:54:29.396141+0000","last_deep_scrub":"264'105","last_deep_scrub_stamp":"2024-09-14T11:54:29.396141+0000","last_clean_scrub_stamp":"2024-09-14T11:54:29.396141+0000","objects_scrubbed":4,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:14.770917+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":97,"num_read_kb":96,"num_write":232,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"264'1042","reported_seq":2583,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.687055+0000","last_change":"2024-09-14T11:54:09.687055+0000","last_active":"2024-09-14T11:54:09.687055+0000","last_peered":"2024-09-14T11:54:09.687055+0000","last_clean":"2024-09-14T11:54:09.687055+0000","last_became_active":"2024-09-14T11:09:46.958507+0000","last_became_peered":"2024-09-14T11:09:46.958507+0000","last_unstale":"2024-09-14T11:54:09.687055+0000","last_undegraded":"2024-09-14T11:54:09.687055+0000","last_fullsized":"2024-09-14T11:54:09.687055+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1042","last_scrub_stamp":"2024-09-14T11:54:09.686859+0000","last_deep_scrub":"264'1042","last_deep_scrub_stamp":"2024-09-14T11:54:09.686859+0000","last_clean_scrub_stamp":"2024-09-14T11:54:09.686859+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":1000,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:03.681837+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4784,"num_read_kb":4190,"num_write":1482,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"264'220","reported_seq":862,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.762074+0000","last_change":"2024-09-14T11:54:05.762074+0000","last_active":"2024-09-14T11:54:05.762074+0000","last_peered":"2024-09-14T11:54:05.762074+0000","last_clean":"2024-09-14T11:54:05.762074+0000","last_became_active":"2024-09-14T11:09:45.217039+0000","last_became_peered":"2024-09-14T11:09:45.217039+0000","last_unstale":"2024-09-14T11:54:05.762074+0000","last_undegraded":"2024-09-14T11:54:05.762074+0000","last_fullsized":"2024-09-14T11:54:05.762074+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'220","last_scrub_stamp":"2024-09-14T11:54:05.761858+0000","last_deep_scrub":"264'220","last_deep_scrub_stamp":"2024-09-14T11:54:05.761858+0000","last_clean_scrub_stamp":"2024-09-14T11:54:05.761858+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:30.840271+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":539,"num_read_kb":14764,"num_write":981,"num_write_kb":31870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:02.752870+0000","last_change":"2024-09-14T11:54:02.752870+0000","last_active":"2024-09-14T11:54:02.752870+0000","last_peered":"2024-09-14T11:54:02.752870+0000","last_clean":"2024-09-14T11:54:02.752870+0000","last_became_active":"2024-09-14T11:09:36.106073+0000","last_became_peered":"2024-09-14T11:09:36.106073+0000","last_unstale":"2024-09-14T11:54:02.752870+0000","last_undegraded":"2024-09-14T11:54:02.752870+0000","last_fullsized":"2024-09-14T11:54:02.752870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:02.752684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:02.752684+0000","last_clean_scrub_stamp":"2024-09-14T11:54:02.752684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:30.079185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012975129999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.856207+0000","last_change":"2024-09-14T11:54:28.856207+0000","last_active":"2024-09-14T11:54:28.856207+0000","last_peered":"2024-09-14T11:54:28.856207+0000","last_clean":"2024-09-14T11:54:28.856207+0000","last_became_active":"2024-09-14T11:09:48.970339+0000","last_became_peered":"2024-09-14T11:09:48.970339+0000","last_unstale":"2024-09-14T11:54:28.856207+0000","last_undegraded":"2024-09-14T11:54:28.856207+0000","last_fullsized":"2024-09-14T11:54:28.856207+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:28.856019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:28.856019+0000","last_clean_scrub_stamp":"2024-09-14T11:54:28.856019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:07.889082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"264'127","reported_seq":666,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:33.738196+0000","last_change":"2024-09-14T11:54:33.738196+0000","last_active":"2024-09-14T11:54:33.738196+0000","last_peered":"2024-09-14T11:54:33.738196+0000","last_clean":"2024-09-14T11:54:33.738196+0000","last_became_active":"2024-09-14T11:09:50.979827+0000","last_became_peered":"2024-09-14T11:09:50.979827+0000","last_unstale":"2024-09-14T11:54:33.738196+0000","last_undegraded":"2024-09-14T11:54:33.738196+0000","last_fullsized":"2024-09-14T11:54:33.738196+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'127","last_scrub_stamp":"2024-09-14T11:54:33.738016+0000","last_deep_scrub":"264'127","last_deep_scrub_stamp":"2024-09-14T11:54:33.738016+0000","last_clean_scrub_stamp":"2024-09-14T11:54:33.738016+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:42.416480+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":133,"num_read_kb":122,"num_write":94,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"264'803","reported_seq":2488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:30.106338+0000","last_change":"2024-09-14T11:54:30.106338+0000","last_active":"2024-09-14T11:54:30.106338+0000","last_peered":"2024-09-14T11:54:30.106338+0000","last_clean":"2024-09-14T11:54:30.106338+0000","last_became_active":"2024-09-14T11:09:53.007337+0000","last_became_peered":"2024-09-14T11:09:53.007337+0000","last_unstale":"2024-09-14T11:54:30.106338+0000","last_undegraded":"2024-09-14T11:54:30.106338+0000","last_fullsized":"2024-09-14T11:54:30.106338+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'803","last_scrub_stamp":"2024-09-14T11:54:30.106144+0000","last_deep_scrub":"264'803","last_deep_scrub_stamp":"2024-09-14T11:54:30.106144+0000","last_clean_scrub_stamp":"2024-09-14T11:54:30.106144+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:49.440969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"264'271","reported_seq":805,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:37.145706+0000","last_change":"2024-09-14T11:54:37.145706+0000","last_active":"2024-09-14T11:54:37.145706+0000","last_peered":"2024-09-14T11:54:37.145706+0000","last_clean":"2024-09-14T11:54:37.145706+0000","last_became_active":"2024-09-14T11:09:55.011828+0000","last_became_peered":"2024-09-14T11:09:55.011828+0000","last_unstale":"2024-09-14T11:54:37.145706+0000","last_undegraded":"2024-09-14T11:54:37.145706+0000","last_fullsized":"2024-09-14T11:54:37.145706+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'271","last_scrub_stamp":"2024-09-14T11:54:37.145521+0000","last_deep_scrub":"264'271","last_deep_scrub_stamp":"2024-09-14T11:54:37.145521+0000","last_clean_scrub_stamp":"2024-09-14T11:54:37.145521+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:04.142063+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":359,"num_read_kb":349,"num_write":571,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"264'1163","reported_seq":2668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.302504+0000","last_change":"2024-09-14T11:54:05.302504+0000","last_active":"2024-09-14T11:54:05.302504+0000","last_peered":"2024-09-14T11:54:05.302504+0000","last_clean":"2024-09-14T11:54:05.302504+0000","last_became_active":"2024-09-14T11:09:46.946010+0000","last_became_peered":"2024-09-14T11:09:46.946010+0000","last_unstale":"2024-09-14T11:54:05.302504+0000","last_undegraded":"2024-09-14T11:54:05.302504+0000","last_fullsized":"2024-09-14T11:54:05.302504+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1163","last_scrub_stamp":"2024-09-14T11:54:05.302255+0000","last_deep_scrub":"264'1163","last_deep_scrub_stamp":"2024-09-14T11:54:05.302255+0000","last_clean_scrub_stamp":"2024-09-14T11:54:05.302255+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":1100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:58.209905+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5209,"num_read_kb":4587,"num_write":1598,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":272,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"264'212","reported_seq":890,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.735457+0000","last_change":"2024-09-14T11:54:04.735457+0000","last_active":"2024-09-14T11:54:04.735457+0000","last_peered":"2024-09-14T11:54:04.735457+0000","last_clean":"2024-09-14T11:54:04.735457+0000","last_became_active":"2024-09-14T11:09:45.212500+0000","last_became_peered":"2024-09-14T11:09:45.212500+0000","last_unstale":"2024-09-14T11:54:04.735457+0000","last_undegraded":"2024-09-14T11:54:04.735457+0000","last_fullsized":"2024-09-14T11:54:04.735457+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'212","last_scrub_stamp":"2024-09-14T11:54:04.735162+0000","last_deep_scrub":"264'212","last_deep_scrub_stamp":"2024-09-14T11:54:04.735162+0000","last_clean_scrub_stamp":"2024-09-14T11:54:04.735162+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:20.313589+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":655,"num_read_kb":3804,"num_write":900,"num_write_kb":25360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.758528+0000","last_change":"2024-09-14T11:54:06.758528+0000","last_active":"2024-09-14T11:54:06.758528+0000","last_peered":"2024-09-14T11:54:06.758528+0000","last_clean":"2024-09-14T11:54:06.758528+0000","last_became_active":"2024-09-14T11:09:36.108781+0000","last_became_peered":"2024-09-14T11:09:36.108781+0000","last_unstale":"2024-09-14T11:54:06.758528+0000","last_undegraded":"2024-09-14T11:54:06.758528+0000","last_fullsized":"2024-09-14T11:54:06.758528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:06.758347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:06.758347+0000","last_clean_scrub_stamp":"2024-09-14T11:54:06.758347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:28:12.438815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002510581,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.798261+0000","last_change":"2024-09-14T11:54:19.798261+0000","last_active":"2024-09-14T11:54:19.798261+0000","last_peered":"2024-09-14T11:54:19.798261+0000","last_clean":"2024-09-14T11:54:19.798261+0000","last_became_active":"2024-09-14T11:09:48.970940+0000","last_became_peered":"2024-09-14T11:09:48.970940+0000","last_unstale":"2024-09-14T11:54:19.798261+0000","last_undegraded":"2024-09-14T11:54:19.798261+0000","last_fullsized":"2024-09-14T11:54:19.798261+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:19.798083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:19.798083+0000","last_clean_scrub_stamp":"2024-09-14T11:54:19.798083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:16.786632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"264'316","reported_seq":1034,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.851005+0000","last_change":"2024-09-14T11:54:18.851005+0000","last_active":"2024-09-14T11:54:18.851005+0000","last_peered":"2024-09-14T11:54:18.851005+0000","last_clean":"2024-09-14T11:54:18.851005+0000","last_became_active":"2024-09-14T11:09:50.992374+0000","last_became_peered":"2024-09-14T11:09:50.992374+0000","last_unstale":"2024-09-14T11:54:18.851005+0000","last_undegraded":"2024-09-14T11:54:18.851005+0000","last_fullsized":"2024-09-14T11:54:18.851005+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'316","last_scrub_stamp":"2024-09-14T11:54:18.850798+0000","last_deep_scrub":"264'316","last_deep_scrub_stamp":"2024-09-14T11:54:18.850798+0000","last_clean_scrub_stamp":"2024-09-14T11:54:18.850798+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:16.507010+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20511,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":444,"num_read_kb":597,"num_write":216,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:33.010265+0000","last_change":"2024-09-14T11:54:33.010265+0000","last_active":"2024-09-14T11:54:33.010265+0000","last_peered":"2024-09-14T11:54:33.010265+0000","last_clean":"2024-09-14T11:54:33.010265+0000","last_became_active":"2024-09-14T11:09:53.002904+0000","last_became_peered":"2024-09-14T11:09:53.002904+0000","last_unstale":"2024-09-14T11:54:33.010265+0000","last_undegraded":"2024-09-14T11:54:33.010265+0000","last_fullsized":"2024-09-14T11:54:33.010265+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:33.010079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:33.010079+0000","last_clean_scrub_stamp":"2024-09-14T11:54:33.010079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:39:42.102479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"264'134","reported_seq":642,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.336573+0000","last_change":"2024-09-14T11:54:26.336573+0000","last_active":"2024-09-14T11:54:26.336573+0000","last_peered":"2024-09-14T11:54:26.336573+0000","last_clean":"2024-09-14T11:54:26.336573+0000","last_became_active":"2024-09-14T11:09:55.014192+0000","last_became_peered":"2024-09-14T11:09:55.014192+0000","last_unstale":"2024-09-14T11:54:26.336573+0000","last_undegraded":"2024-09-14T11:54:26.336573+0000","last_fullsized":"2024-09-14T11:54:26.336573+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'134","last_scrub_stamp":"2024-09-14T11:54:26.336329+0000","last_deep_scrub":"264'134","last_deep_scrub_stamp":"2024-09-14T11:54:26.336329+0000","last_clean_scrub_stamp":"2024-09-14T11:54:26.336329+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:52:14.198542+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":303,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"264'165","reported_seq":755,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:39.092236+0000","last_change":"2024-09-14T11:54:39.092236+0000","last_active":"2024-09-14T11:54:39.092236+0000","last_peered":"2024-09-14T11:54:39.092236+0000","last_clean":"2024-09-14T11:54:39.092236+0000","last_became_active":"2024-09-14T11:09:55.015127+0000","last_became_peered":"2024-09-14T11:09:55.015127+0000","last_unstale":"2024-09-14T11:54:39.092236+0000","last_undegraded":"2024-09-14T11:54:39.092236+0000","last_fullsized":"2024-09-14T11:54:39.092236+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'165","last_scrub_stamp":"2024-09-14T11:54:39.091942+0000","last_deep_scrub":"264'165","last_deep_scrub_stamp":"2024-09-14T11:54:39.091942+0000","last_clean_scrub_stamp":"2024-09-14T11:54:39.091942+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:38.689842+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":313,"num_read_kb":285,"num_write":384,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"264'825","reported_seq":2491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.394964+0000","last_change":"2024-09-14T11:54:13.394964+0000","last_active":"2024-09-14T11:54:13.394964+0000","last_peered":"2024-09-14T11:54:13.394964+0000","last_clean":"2024-09-14T11:54:13.394964+0000","last_became_active":"2024-09-14T11:09:46.948706+0000","last_became_peered":"2024-09-14T11:09:46.948706+0000","last_unstale":"2024-09-14T11:54:13.394964+0000","last_undegraded":"2024-09-14T11:54:13.394964+0000","last_fullsized":"2024-09-14T11:54:13.394964+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'825","last_scrub_stamp":"2024-09-14T11:54:13.394780+0000","last_deep_scrub":"264'825","last_deep_scrub_stamp":"2024-09-14T11:54:13.394780+0000","last_clean_scrub_stamp":"2024-09-14T11:54:13.394780+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:09.219229+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4239,"num_read_kb":3866,"num_write":1097,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2295,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"264'194","reported_seq":844,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.818862+0000","last_change":"2024-09-14T11:54:14.818716+0000","last_active":"2024-09-14T11:54:14.818862+0000","last_peered":"2024-09-14T11:54:14.818862+0000","last_clean":"2024-09-14T11:54:14.818862+0000","last_became_active":"2024-09-14T11:09:45.201562+0000","last_became_peered":"2024-09-14T11:09:45.201562+0000","last_unstale":"2024-09-14T11:54:14.818862+0000","last_undegraded":"2024-09-14T11:54:14.818862+0000","last_fullsized":"2024-09-14T11:54:14.818862+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'194","last_scrub_stamp":"2024-09-14T11:54:14.818523+0000","last_deep_scrub":"264'194","last_deep_scrub_stamp":"2024-09-14T11:54:14.818523+0000","last_clean_scrub_stamp":"2024-09-14T11:54:14.818523+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:51:40.122733+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655874,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":505,"num_read_kb":86083,"num_write":869,"num_write_kb":49236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.602327+0000","last_change":"2024-09-14T11:54:20.602327+0000","last_active":"2024-09-14T11:54:20.602327+0000","last_peered":"2024-09-14T11:54:20.602327+0000","last_clean":"2024-09-14T11:54:20.602327+0000","last_became_active":"2024-09-14T11:09:48.962619+0000","last_became_peered":"2024-09-14T11:09:48.962619+0000","last_unstale":"2024-09-14T11:54:20.602327+0000","last_undegraded":"2024-09-14T11:54:20.602327+0000","last_fullsized":"2024-09-14T11:54:20.602327+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:20.602135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:20.602135+0000","last_clean_scrub_stamp":"2024-09-14T11:54:20.602135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:46.015649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"264'175","reported_seq":753,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:23.656894+0000","last_change":"2024-09-14T11:54:23.656894+0000","last_active":"2024-09-14T11:54:23.656894+0000","last_peered":"2024-09-14T11:54:23.656894+0000","last_clean":"2024-09-14T11:54:23.656894+0000","last_became_active":"2024-09-14T11:09:50.996047+0000","last_became_peered":"2024-09-14T11:09:50.996047+0000","last_unstale":"2024-09-14T11:54:23.656894+0000","last_undegraded":"2024-09-14T11:54:23.656894+0000","last_fullsized":"2024-09-14T11:54:23.656894+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'175","last_scrub_stamp":"2024-09-14T11:54:23.656676+0000","last_deep_scrub":"264'175","last_deep_scrub_stamp":"2024-09-14T11:54:23.656676+0000","last_clean_scrub_stamp":"2024-09-14T11:54:23.656676+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:01.298471+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28669,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":205,"num_read_kb":341,"num_write":126,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:23.273840+0000","last_change":"2024-09-14T11:54:23.273840+0000","last_active":"2024-09-14T11:54:23.273840+0000","last_peered":"2024-09-14T11:54:23.273840+0000","last_clean":"2024-09-14T11:54:23.273840+0000","last_became_active":"2024-09-14T11:09:53.000339+0000","last_became_peered":"2024-09-14T11:09:53.000339+0000","last_unstale":"2024-09-14T11:54:23.273840+0000","last_undegraded":"2024-09-14T11:54:23.273840+0000","last_fullsized":"2024-09-14T11:54:23.273840+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:23.273658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:23.273658+0000","last_clean_scrub_stamp":"2024-09-14T11:54:23.273658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:38:03.101466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"264'95","reported_seq":589,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:32.485486+0000","last_change":"2024-09-14T11:54:32.485486+0000","last_active":"2024-09-14T11:54:32.485486+0000","last_peered":"2024-09-14T11:54:32.485486+0000","last_clean":"2024-09-14T11:54:32.485486+0000","last_became_active":"2024-09-14T11:09:55.022477+0000","last_became_peered":"2024-09-14T11:09:55.022477+0000","last_unstale":"2024-09-14T11:54:32.485486+0000","last_undegraded":"2024-09-14T11:54:32.485486+0000","last_fullsized":"2024-09-14T11:54:32.485486+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'95","last_scrub_stamp":"2024-09-14T11:54:32.485306+0000","last_deep_scrub":"264'95","last_deep_scrub_stamp":"2024-09-14T11:54:32.485306+0000","last_clean_scrub_stamp":"2024-09-14T11:54:32.485306+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:28.186314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":73,"num_write":206,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"264'414","reported_seq":1955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.649873+0000","last_change":"2024-09-14T11:54:10.649873+0000","last_active":"2024-09-14T11:54:10.649873+0000","last_peered":"2024-09-14T11:54:10.649873+0000","last_clean":"2024-09-14T11:54:10.649873+0000","last_became_active":"2024-09-14T11:09:46.948572+0000","last_became_peered":"2024-09-14T11:09:46.948572+0000","last_unstale":"2024-09-14T11:54:10.649873+0000","last_undegraded":"2024-09-14T11:54:10.649873+0000","last_fullsized":"2024-09-14T11:54:10.649873+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'414","last_scrub_stamp":"2024-09-14T11:54:10.649705+0000","last_deep_scrub":"264'414","last_deep_scrub_stamp":"2024-09-14T11:54:10.649705+0000","last_clean_scrub_stamp":"2024-09-14T11:54:10.649705+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:12.848610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2176,"num_read_kb":2078,"num_write":464,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"264'236","reported_seq":860,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:02.763944+0000","last_change":"2024-09-14T11:54:02.763944+0000","last_active":"2024-09-14T11:54:02.763944+0000","last_peered":"2024-09-14T11:54:02.763944+0000","last_clean":"2024-09-14T11:54:02.763944+0000","last_became_active":"2024-09-14T11:09:45.223324+0000","last_became_peered":"2024-09-14T11:09:45.223324+0000","last_unstale":"2024-09-14T11:54:02.763944+0000","last_undegraded":"2024-09-14T11:54:02.763944+0000","last_fullsized":"2024-09-14T11:54:02.763944+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'236","last_scrub_stamp":"2024-09-14T11:54:02.763871+0000","last_deep_scrub":"264'236","last_deep_scrub_stamp":"2024-09-14T11:54:02.763871+0000","last_clean_scrub_stamp":"2024-09-14T11:54:02.763871+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:42.678734+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655868,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":554,"num_read_kb":7834,"num_write":1127,"num_write_kb":26023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"264'4","reported_seq":988,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:23.889113+0000","last_change":"2024-09-14T11:54:23.889113+0000","last_active":"2024-09-14T11:54:23.889113+0000","last_peered":"2024-09-14T11:54:23.889113+0000","last_clean":"2024-09-14T11:54:23.889113+0000","last_became_active":"2024-09-14T11:09:48.968561+0000","last_became_peered":"2024-09-14T11:09:48.968561+0000","last_unstale":"2024-09-14T11:54:23.889113+0000","last_undegraded":"2024-09-14T11:54:23.889113+0000","last_fullsized":"2024-09-14T11:54:23.889113+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T11:54:23.888928+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T11:54:23.888928+0000","last_clean_scrub_stamp":"2024-09-14T11:54:23.888928+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:46:06.061212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":728,"num_read_kb":726,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"264'47","reported_seq":557,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.898965+0000","last_change":"2024-09-14T11:54:27.898965+0000","last_active":"2024-09-14T11:54:27.898965+0000","last_peered":"2024-09-14T11:54:27.898965+0000","last_clean":"2024-09-14T11:54:27.898965+0000","last_became_active":"2024-09-14T11:09:50.981128+0000","last_became_peered":"2024-09-14T11:09:50.981128+0000","last_unstale":"2024-09-14T11:54:27.898965+0000","last_undegraded":"2024-09-14T11:54:27.898965+0000","last_fullsized":"2024-09-14T11:54:27.898965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'47","last_scrub_stamp":"2024-09-14T11:54:27.898748+0000","last_deep_scrub":"264'47","last_deep_scrub_stamp":"2024-09-14T11:54:27.898748+0000","last_clean_scrub_stamp":"2024-09-14T11:54:27.898748+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:00.300018+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.306525+0000","last_change":"2024-09-14T11:54:20.306525+0000","last_active":"2024-09-14T11:54:20.306525+0000","last_peered":"2024-09-14T11:54:20.306525+0000","last_clean":"2024-09-14T11:54:20.306525+0000","last_became_active":"2024-09-14T11:09:53.006292+0000","last_became_peered":"2024-09-14T11:09:53.006292+0000","last_unstale":"2024-09-14T11:54:20.306525+0000","last_undegraded":"2024-09-14T11:54:20.306525+0000","last_fullsized":"2024-09-14T11:54:20.306525+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:20.306354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:20.306354+0000","last_clean_scrub_stamp":"2024-09-14T11:54:20.306354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:34.456657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"264'207","reported_seq":732,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:31.610670+0000","last_change":"2024-09-14T11:54:31.610670+0000","last_active":"2024-09-14T11:54:31.610670+0000","last_peered":"2024-09-14T11:54:31.610670+0000","last_clean":"2024-09-14T11:54:31.610670+0000","last_became_active":"2024-09-14T11:09:55.014414+0000","last_became_peered":"2024-09-14T11:09:55.014414+0000","last_unstale":"2024-09-14T11:54:31.610670+0000","last_undegraded":"2024-09-14T11:54:31.610670+0000","last_fullsized":"2024-09-14T11:54:31.610670+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'207","last_scrub_stamp":"2024-09-14T11:54:31.610484+0000","last_deep_scrub":"264'207","last_deep_scrub_stamp":"2024-09-14T11:54:31.610484+0000","last_clean_scrub_stamp":"2024-09-14T11:54:31.610484+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:59.574341+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":294,"num_read_kb":289,"num_write":451,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"264'677","reported_seq":2440,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.681990+0000","last_change":"2024-09-14T11:54:14.681990+0000","last_active":"2024-09-14T11:54:14.681990+0000","last_peered":"2024-09-14T11:54:14.681990+0000","last_clean":"2024-09-14T11:54:14.681990+0000","last_became_active":"2024-09-14T11:09:46.962508+0000","last_became_peered":"2024-09-14T11:09:46.962508+0000","last_unstale":"2024-09-14T11:54:14.681990+0000","last_undegraded":"2024-09-14T11:54:14.681990+0000","last_fullsized":"2024-09-14T11:54:14.681990+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'677","last_scrub_stamp":"2024-09-14T11:54:14.681778+0000","last_deep_scrub":"264'677","last_deep_scrub_stamp":"2024-09-14T11:54:14.681778+0000","last_clean_scrub_stamp":"2024-09-14T11:54:14.681778+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":600,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:39.225516+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3732,"num_read_kb":3415,"num_write":933,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"264'190","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.341400+0000","last_change":"2024-09-14T11:54:04.341400+0000","last_active":"2024-09-14T11:54:04.341400+0000","last_peered":"2024-09-14T11:54:04.341400+0000","last_clean":"2024-09-14T11:54:04.341400+0000","last_became_active":"2024-09-14T11:09:45.206901+0000","last_became_peered":"2024-09-14T11:09:45.206901+0000","last_unstale":"2024-09-14T11:54:04.341400+0000","last_undegraded":"2024-09-14T11:54:04.341400+0000","last_fullsized":"2024-09-14T11:54:04.341400+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'190","last_scrub_stamp":"2024-09-14T11:54:04.341295+0000","last_deep_scrub":"264'190","last_deep_scrub_stamp":"2024-09-14T11:54:04.341295+0000","last_clean_scrub_stamp":"2024-09-14T11:54:04.341295+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:03.874799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":442,"num_read_kb":9264,"num_write":863,"num_write_kb":15949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.355084+0000","last_change":"2024-09-14T11:54:27.355084+0000","last_active":"2024-09-14T11:54:27.355084+0000","last_peered":"2024-09-14T11:54:27.355084+0000","last_clean":"2024-09-14T11:54:27.355084+0000","last_became_active":"2024-09-14T11:09:48.959413+0000","last_became_peered":"2024-09-14T11:09:48.959413+0000","last_unstale":"2024-09-14T11:54:27.355084+0000","last_undegraded":"2024-09-14T11:54:27.355084+0000","last_fullsized":"2024-09-14T11:54:27.355084+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:27.354885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:27.354885+0000","last_clean_scrub_stamp":"2024-09-14T11:54:27.354885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:07.088907+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"264'163","reported_seq":753,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.317507+0000","last_change":"2024-09-14T11:54:22.317507+0000","last_active":"2024-09-14T11:54:22.317507+0000","last_peered":"2024-09-14T11:54:22.317507+0000","last_clean":"2024-09-14T11:54:22.317507+0000","last_became_active":"2024-09-14T11:09:50.999585+0000","last_became_peered":"2024-09-14T11:09:50.999585+0000","last_unstale":"2024-09-14T11:54:22.317507+0000","last_undegraded":"2024-09-14T11:54:22.317507+0000","last_fullsized":"2024-09-14T11:54:22.317507+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'163","last_scrub_stamp":"2024-09-14T11:54:22.317312+0000","last_deep_scrub":"264'163","last_deep_scrub_stamp":"2024-09-14T11:54:22.317312+0000","last_clean_scrub_stamp":"2024-09-14T11:54:22.317312+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:12.615304+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7038,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":217,"num_read_kb":281,"num_write":118,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:23.566618+0000","last_change":"2024-09-14T11:54:23.566618+0000","last_active":"2024-09-14T11:54:23.566618+0000","last_peered":"2024-09-14T11:54:23.566618+0000","last_clean":"2024-09-14T11:54:23.566618+0000","last_became_active":"2024-09-14T11:09:53.018479+0000","last_became_peered":"2024-09-14T11:09:53.018479+0000","last_unstale":"2024-09-14T11:54:23.566618+0000","last_undegraded":"2024-09-14T11:54:23.566618+0000","last_fullsized":"2024-09-14T11:54:23.566618+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:23.566438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:23.566438+0000","last_clean_scrub_stamp":"2024-09-14T11:54:23.566438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:53:34.310619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"264'128","reported_seq":631,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.390381+0000","last_change":"2024-09-14T11:09:55.029326+0000","last_active":"2024-09-14T11:52:29.390381+0000","last_peered":"2024-09-14T11:52:29.390381+0000","last_clean":"2024-09-14T11:52:29.390381+0000","last_became_active":"2024-09-14T11:09:55.028633+0000","last_became_peered":"2024-09-14T11:09:55.028633+0000","last_unstale":"2024-09-14T11:52:29.390381+0000","last_undegraded":"2024-09-14T11:52:29.390381+0000","last_fullsized":"2024-09-14T11:52:29.390381+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:48.218210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":141,"num_write":296,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"264'506","reported_seq":2225,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.325712+0000","last_change":"2024-09-14T11:54:11.325712+0000","last_active":"2024-09-14T11:54:11.325712+0000","last_peered":"2024-09-14T11:54:11.325712+0000","last_clean":"2024-09-14T11:54:11.325712+0000","last_became_active":"2024-09-14T11:09:46.962364+0000","last_became_peered":"2024-09-14T11:09:46.962364+0000","last_unstale":"2024-09-14T11:54:11.325712+0000","last_undegraded":"2024-09-14T11:54:11.325712+0000","last_fullsized":"2024-09-14T11:54:11.325712+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'506","last_scrub_stamp":"2024-09-14T11:54:11.325519+0000","last_deep_scrub":"264'506","last_deep_scrub_stamp":"2024-09-14T11:54:11.325519+0000","last_clean_scrub_stamp":"2024-09-14T11:54:11.325519+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:16.688907+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2859,"num_read_kb":2685,"num_write":625,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"264'228","reported_seq":856,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.151831+0000","last_change":"2024-09-14T11:54:05.151831+0000","last_active":"2024-09-14T11:54:05.151831+0000","last_peered":"2024-09-14T11:54:05.151831+0000","last_clean":"2024-09-14T11:54:05.151831+0000","last_became_active":"2024-09-14T11:09:45.206145+0000","last_became_peered":"2024-09-14T11:09:45.206145+0000","last_unstale":"2024-09-14T11:54:05.151831+0000","last_undegraded":"2024-09-14T11:54:05.151831+0000","last_fullsized":"2024-09-14T11:54:05.151831+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'228","last_scrub_stamp":"2024-09-14T11:54:05.151645+0000","last_deep_scrub":"264'228","last_deep_scrub_stamp":"2024-09-14T11:54:05.151645+0000","last_clean_scrub_stamp":"2024-09-14T11:54:05.151645+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:21.231443+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":553,"num_read_kb":30372,"num_write":894,"num_write_kb":16933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"264'5","reported_seq":983,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:30.851200+0000","last_change":"2024-09-14T11:54:30.851200+0000","last_active":"2024-09-14T11:54:30.851200+0000","last_peered":"2024-09-14T11:54:30.851200+0000","last_clean":"2024-09-14T11:54:30.851200+0000","last_became_active":"2024-09-14T11:09:48.963563+0000","last_became_peered":"2024-09-14T11:09:48.963563+0000","last_unstale":"2024-09-14T11:54:30.851200+0000","last_undegraded":"2024-09-14T11:54:30.851200+0000","last_fullsized":"2024-09-14T11:54:30.851200+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-14T11:54:30.850999+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-14T11:54:30.850999+0000","last_clean_scrub_stamp":"2024-09-14T11:54:30.850999+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:37.854729+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":1197,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"264'128","reported_seq":698,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.899397+0000","last_change":"2024-09-14T11:54:24.899397+0000","last_active":"2024-09-14T11:54:24.899397+0000","last_peered":"2024-09-14T11:54:24.899397+0000","last_clean":"2024-09-14T11:54:24.899397+0000","last_became_active":"2024-09-14T11:09:50.988286+0000","last_became_peered":"2024-09-14T11:09:50.988286+0000","last_unstale":"2024-09-14T11:54:24.899397+0000","last_undegraded":"2024-09-14T11:54:24.899397+0000","last_fullsized":"2024-09-14T11:54:24.899397+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'128","last_scrub_stamp":"2024-09-14T11:54:24.899247+0000","last_deep_scrub":"264'128","last_deep_scrub_stamp":"2024-09-14T11:54:24.899247+0000","last_clean_scrub_stamp":"2024-09-14T11:54:24.899247+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:22.020527+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5180,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":147,"num_read_kb":193,"num_write":70,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.313607+0000","last_change":"2024-09-14T11:54:24.313607+0000","last_active":"2024-09-14T11:54:24.313607+0000","last_peered":"2024-09-14T11:54:24.313607+0000","last_clean":"2024-09-14T11:54:24.313607+0000","last_became_active":"2024-09-14T11:09:53.006975+0000","last_became_peered":"2024-09-14T11:09:53.006975+0000","last_unstale":"2024-09-14T11:54:24.313607+0000","last_undegraded":"2024-09-14T11:54:24.313607+0000","last_fullsized":"2024-09-14T11:54:24.313607+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:24.313368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:24.313368+0000","last_clean_scrub_stamp":"2024-09-14T11:54:24.313368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:50:17.993903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"264'601","reported_seq":2256,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.917264+0000","last_change":"2024-09-14T11:54:22.917264+0000","last_active":"2024-09-14T11:54:22.917264+0000","last_peered":"2024-09-14T11:54:22.917264+0000","last_clean":"2024-09-14T11:54:22.917264+0000","last_became_active":"2024-09-14T11:09:46.975017+0000","last_became_peered":"2024-09-14T11:09:46.975017+0000","last_unstale":"2024-09-14T11:54:22.917264+0000","last_undegraded":"2024-09-14T11:54:22.917264+0000","last_fullsized":"2024-09-14T11:54:22.917264+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'601","last_scrub_stamp":"2024-09-14T11:54:22.917071+0000","last_deep_scrub":"264'601","last_deep_scrub_stamp":"2024-09-14T11:54:22.917071+0000","last_clean_scrub_stamp":"2024-09-14T11:54:22.917071+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":500,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:52.422521+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3191,"num_read_kb":2927,"num_write":756,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"264'284","reported_seq":973,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.119049+0000","last_change":"2024-09-14T11:54:06.119049+0000","last_active":"2024-09-14T11:54:06.119049+0000","last_peered":"2024-09-14T11:54:06.119049+0000","last_clean":"2024-09-14T11:54:06.119049+0000","last_became_active":"2024-09-14T11:09:45.216742+0000","last_became_peered":"2024-09-14T11:09:45.216742+0000","last_unstale":"2024-09-14T11:54:06.119049+0000","last_undegraded":"2024-09-14T11:54:06.119049+0000","last_fullsized":"2024-09-14T11:54:06.119049+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'284","last_scrub_stamp":"2024-09-14T11:54:06.118835+0000","last_deep_scrub":"264'284","last_deep_scrub_stamp":"2024-09-14T11:54:06.118835+0000","last_clean_scrub_stamp":"2024-09-14T11:54:06.118835+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:00.653277+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":743,"num_read_kb":84606,"num_write":1211,"num_write_kb":44892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.642521+0000","last_change":"2024-09-14T11:54:19.642521+0000","last_active":"2024-09-14T11:54:19.642521+0000","last_peered":"2024-09-14T11:54:19.642521+0000","last_clean":"2024-09-14T11:54:19.642521+0000","last_became_active":"2024-09-14T11:09:48.966112+0000","last_became_peered":"2024-09-14T11:09:48.966112+0000","last_unstale":"2024-09-14T11:54:19.642521+0000","last_undegraded":"2024-09-14T11:54:19.642521+0000","last_fullsized":"2024-09-14T11:54:19.642521+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:19.642292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:19.642292+0000","last_clean_scrub_stamp":"2024-09-14T11:54:19.642292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:48.336482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"264'214","reported_seq":845,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:25.619507+0000","last_change":"2024-09-14T11:54:25.619507+0000","last_active":"2024-09-14T11:54:25.619507+0000","last_peered":"2024-09-14T11:54:25.619507+0000","last_clean":"2024-09-14T11:54:25.619507+0000","last_became_active":"2024-09-14T11:09:50.995279+0000","last_became_peered":"2024-09-14T11:09:50.995279+0000","last_unstale":"2024-09-14T11:54:25.619507+0000","last_undegraded":"2024-09-14T11:54:25.619507+0000","last_fullsized":"2024-09-14T11:54:25.619507+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'214","last_scrub_stamp":"2024-09-14T11:54:25.619315+0000","last_deep_scrub":"264'214","last_deep_scrub_stamp":"2024-09-14T11:54:25.619315+0000","last_clean_scrub_stamp":"2024-09-14T11:54:25.619315+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:24.525339+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27447,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":311,"num_read_kb":486,"num_write":198,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.315112+0000","last_change":"2024-09-14T11:54:24.315112+0000","last_active":"2024-09-14T11:54:24.315112+0000","last_peered":"2024-09-14T11:54:24.315112+0000","last_clean":"2024-09-14T11:54:24.315112+0000","last_became_active":"2024-09-14T11:09:53.002862+0000","last_became_peered":"2024-09-14T11:09:53.002862+0000","last_unstale":"2024-09-14T11:54:24.315112+0000","last_undegraded":"2024-09-14T11:54:24.315112+0000","last_fullsized":"2024-09-14T11:54:24.315112+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:24.314937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:24.314937+0000","last_clean_scrub_stamp":"2024-09-14T11:54:24.314937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:19.540172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"264'169","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:40.117939+0000","last_change":"2024-09-14T11:54:40.117939+0000","last_active":"2024-09-14T11:54:40.117939+0000","last_peered":"2024-09-14T11:54:40.117939+0000","last_clean":"2024-09-14T11:54:40.117939+0000","last_became_active":"2024-09-14T11:09:55.023821+0000","last_became_peered":"2024-09-14T11:09:55.023821+0000","last_unstale":"2024-09-14T11:54:40.117939+0000","last_undegraded":"2024-09-14T11:54:40.117939+0000","last_fullsized":"2024-09-14T11:54:40.117939+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'169","last_scrub_stamp":"2024-09-14T11:54:40.117756+0000","last_deep_scrub":"264'169","last_deep_scrub_stamp":"2024-09-14T11:54:40.117756+0000","last_clean_scrub_stamp":"2024-09-14T11:54:40.117756+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:42.833180+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":195,"num_read_kb":205,"num_write":392,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"264'863","reported_seq":2622,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.716452+0000","last_change":"2024-09-14T11:54:13.716452+0000","last_active":"2024-09-14T11:54:13.716452+0000","last_peered":"2024-09-14T11:54:13.716452+0000","last_clean":"2024-09-14T11:54:13.716452+0000","last_became_active":"2024-09-14T11:09:46.967144+0000","last_became_peered":"2024-09-14T11:09:46.967144+0000","last_unstale":"2024-09-14T11:54:13.716452+0000","last_undegraded":"2024-09-14T11:54:13.716452+0000","last_fullsized":"2024-09-14T11:54:13.716452+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'863","last_scrub_stamp":"2024-09-14T11:54:13.716280+0000","last_deep_scrub":"264'863","last_deep_scrub_stamp":"2024-09-14T11:54:13.716280+0000","last_clean_scrub_stamp":"2024-09-14T11:54:13.716280+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":800,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:40.233051+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4422,"num_read_kb":4033,"num_write":1158,"num_write_kb":453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"264'189","reported_seq":811,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.715232+0000","last_change":"2024-09-14T11:54:07.715232+0000","last_active":"2024-09-14T11:54:07.715232+0000","last_peered":"2024-09-14T11:54:07.715232+0000","last_clean":"2024-09-14T11:54:07.715232+0000","last_became_active":"2024-09-14T11:09:45.186745+0000","last_became_peered":"2024-09-14T11:09:45.186745+0000","last_unstale":"2024-09-14T11:54:07.715232+0000","last_undegraded":"2024-09-14T11:54:07.715232+0000","last_fullsized":"2024-09-14T11:54:07.715232+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'189","last_scrub_stamp":"2024-09-14T11:54:07.715044+0000","last_deep_scrub":"264'189","last_deep_scrub_stamp":"2024-09-14T11:54:07.715044+0000","last_clean_scrub_stamp":"2024-09-14T11:54:07.715044+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:02.047080+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":536,"num_read_kb":5513,"num_write":846,"num_write_kb":29456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.372960+0000","last_change":"2024-09-14T11:54:17.372960+0000","last_active":"2024-09-14T11:54:17.372960+0000","last_peered":"2024-09-14T11:54:17.372960+0000","last_clean":"2024-09-14T11:54:17.372960+0000","last_became_active":"2024-09-14T11:09:48.951908+0000","last_became_peered":"2024-09-14T11:09:48.951908+0000","last_unstale":"2024-09-14T11:54:17.372960+0000","last_undegraded":"2024-09-14T11:54:17.372960+0000","last_fullsized":"2024-09-14T11:54:17.372960+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:17.372741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:17.372741+0000","last_clean_scrub_stamp":"2024-09-14T11:54:17.372741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:12.820647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"264'174","reported_seq":758,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.748765+0000","last_change":"2024-09-14T11:54:38.748765+0000","last_active":"2024-09-14T11:54:38.748765+0000","last_peered":"2024-09-14T11:54:38.748765+0000","last_clean":"2024-09-14T11:54:38.748765+0000","last_became_active":"2024-09-14T11:09:50.983553+0000","last_became_peered":"2024-09-14T11:09:50.983553+0000","last_unstale":"2024-09-14T11:54:38.748765+0000","last_undegraded":"2024-09-14T11:54:38.748765+0000","last_fullsized":"2024-09-14T11:54:38.748765+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'174","last_scrub_stamp":"2024-09-14T11:54:38.748505+0000","last_deep_scrub":"264'174","last_deep_scrub_stamp":"2024-09-14T11:54:38.748505+0000","last_clean_scrub_stamp":"2024-09-14T11:54:38.748505+0000","objects_scrubbed":8,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:00.468758+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13815,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":225,"num_read_kb":306,"num_write":144,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.122370+0000","last_change":"2024-09-14T11:54:38.122370+0000","last_active":"2024-09-14T11:54:38.122370+0000","last_peered":"2024-09-14T11:54:38.122370+0000","last_clean":"2024-09-14T11:54:38.122370+0000","last_became_active":"2024-09-14T11:09:53.023609+0000","last_became_peered":"2024-09-14T11:09:53.023609+0000","last_unstale":"2024-09-14T11:54:38.122370+0000","last_undegraded":"2024-09-14T11:54:38.122370+0000","last_fullsized":"2024-09-14T11:54:38.122370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:38.122093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:38.122093+0000","last_clean_scrub_stamp":"2024-09-14T11:54:38.122093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:47.411895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"264'155","reported_seq":652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:28.533458+0000","last_change":"2024-09-14T11:09:55.029184+0000","last_active":"2024-09-14T11:52:28.533458+0000","last_peered":"2024-09-14T11:52:28.533458+0000","last_clean":"2024-09-14T11:52:28.533458+0000","last_became_active":"2024-09-14T11:09:55.028344+0000","last_became_peered":"2024-09-14T11:09:55.028344+0000","last_unstale":"2024-09-14T11:52:28.533458+0000","last_undegraded":"2024-09-14T11:52:28.533458+0000","last_fullsized":"2024-09-14T11:52:28.533458+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1619,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":178,"num_read_kb":177,"num_write":459,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"264'848","reported_seq":2454,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.402985+0000","last_change":"2024-09-14T11:54:14.402985+0000","last_active":"2024-09-14T11:54:14.402985+0000","last_peered":"2024-09-14T11:54:14.402985+0000","last_clean":"2024-09-14T11:54:14.402985+0000","last_became_active":"2024-09-14T11:09:46.990923+0000","last_became_peered":"2024-09-14T11:09:46.990923+0000","last_unstale":"2024-09-14T11:54:14.402985+0000","last_undegraded":"2024-09-14T11:54:14.402985+0000","last_fullsized":"2024-09-14T11:54:14.402985+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'848","last_scrub_stamp":"2024-09-14T11:54:14.402785+0000","last_deep_scrub":"264'848","last_deep_scrub_stamp":"2024-09-14T11:54:14.402785+0000","last_clean_scrub_stamp":"2024-09-14T11:54:14.402785+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":800,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:06.689765+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4067,"num_read_kb":3661,"num_write":1092,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"264'168","reported_seq":761,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.622290+0000","last_change":"2024-09-14T11:54:04.622290+0000","last_active":"2024-09-14T11:54:04.622290+0000","last_peered":"2024-09-14T11:54:04.622290+0000","last_clean":"2024-09-14T11:54:04.622290+0000","last_became_active":"2024-09-14T11:09:45.201058+0000","last_became_peered":"2024-09-14T11:09:45.201058+0000","last_unstale":"2024-09-14T11:54:04.622290+0000","last_undegraded":"2024-09-14T11:54:04.622290+0000","last_fullsized":"2024-09-14T11:54:04.622290+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'168","last_scrub_stamp":"2024-09-14T11:54:04.622018+0000","last_deep_scrub":"264'168","last_deep_scrub_stamp":"2024-09-14T11:54:04.622018+0000","last_clean_scrub_stamp":"2024-09-14T11:54:04.622018+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:44.170656+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":358,"num_read_kb":4087,"num_write":735,"num_write_kb":11722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.418808+0000","last_change":"2024-09-14T11:54:15.418808+0000","last_active":"2024-09-14T11:54:15.418808+0000","last_peered":"2024-09-14T11:54:15.418808+0000","last_clean":"2024-09-14T11:54:15.418808+0000","last_became_active":"2024-09-14T11:09:48.968770+0000","last_became_peered":"2024-09-14T11:09:48.968770+0000","last_unstale":"2024-09-14T11:54:15.418808+0000","last_undegraded":"2024-09-14T11:54:15.418808+0000","last_fullsized":"2024-09-14T11:54:15.418808+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:15.418547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:15.418547+0000","last_clean_scrub_stamp":"2024-09-14T11:54:15.418547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:15.576692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"264'137","reported_seq":717,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.660092+0000","last_change":"2024-09-14T11:54:26.660092+0000","last_active":"2024-09-14T11:54:26.660092+0000","last_peered":"2024-09-14T11:54:26.660092+0000","last_clean":"2024-09-14T11:54:26.660092+0000","last_became_active":"2024-09-14T11:09:50.999079+0000","last_became_peered":"2024-09-14T11:09:50.999079+0000","last_unstale":"2024-09-14T11:54:26.660092+0000","last_undegraded":"2024-09-14T11:54:26.660092+0000","last_fullsized":"2024-09-14T11:54:26.660092+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'137","last_scrub_stamp":"2024-09-14T11:54:26.659891+0000","last_deep_scrub":"264'137","last_deep_scrub_stamp":"2024-09-14T11:54:26.659891+0000","last_clean_scrub_stamp":"2024-09-14T11:54:26.659891+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:10.513103+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6871,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":175,"num_read_kb":247,"num_write":92,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.337061+0000","last_change":"2024-09-14T11:54:26.337061+0000","last_active":"2024-09-14T11:54:26.337061+0000","last_peered":"2024-09-14T11:54:26.337061+0000","last_clean":"2024-09-14T11:54:26.337061+0000","last_became_active":"2024-09-14T11:09:53.008952+0000","last_became_peered":"2024-09-14T11:09:53.008952+0000","last_unstale":"2024-09-14T11:54:26.337061+0000","last_undegraded":"2024-09-14T11:54:26.337061+0000","last_fullsized":"2024-09-14T11:54:26.337061+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:26.336884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:26.336884+0000","last_clean_scrub_stamp":"2024-09-14T11:54:26.336884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:22.557625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"264'141","reported_seq":634,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.061750+0000","last_change":"2024-09-14T11:09:55.029152+0000","last_active":"2024-09-14T11:53:44.061750+0000","last_peered":"2024-09-14T11:53:44.061750+0000","last_clean":"2024-09-14T11:53:44.061750+0000","last_became_active":"2024-09-14T11:09:55.028413+0000","last_became_peered":"2024-09-14T11:09:55.028413+0000","last_unstale":"2024-09-14T11:53:44.061750+0000","last_undegraded":"2024-09-14T11:53:44.061750+0000","last_fullsized":"2024-09-14T11:53:44.061750+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":142,"num_write":355,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"264'425","reported_seq":1990,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:12.675564+0000","last_change":"2024-09-14T11:54:12.675564+0000","last_active":"2024-09-14T11:54:12.675564+0000","last_peered":"2024-09-14T11:54:12.675564+0000","last_clean":"2024-09-14T11:54:12.675564+0000","last_became_active":"2024-09-14T11:09:46.986721+0000","last_became_peered":"2024-09-14T11:09:46.986721+0000","last_unstale":"2024-09-14T11:54:12.675564+0000","last_undegraded":"2024-09-14T11:54:12.675564+0000","last_fullsized":"2024-09-14T11:54:12.675564+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'425","last_scrub_stamp":"2024-09-14T11:54:12.675309+0000","last_deep_scrub":"264'425","last_deep_scrub_stamp":"2024-09-14T11:54:12.675309+0000","last_clean_scrub_stamp":"2024-09-14T11:54:12.675309+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:42.450711+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2241,"num_read_kb":2140,"num_write":472,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"264'231","reported_seq":843,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.670061+0000","last_change":"2024-09-14T11:54:08.670061+0000","last_active":"2024-09-14T11:54:08.670061+0000","last_peered":"2024-09-14T11:54:08.670061+0000","last_clean":"2024-09-14T11:54:08.670061+0000","last_became_active":"2024-09-14T11:09:45.211984+0000","last_became_peered":"2024-09-14T11:09:45.211984+0000","last_unstale":"2024-09-14T11:54:08.670061+0000","last_undegraded":"2024-09-14T11:54:08.670061+0000","last_fullsized":"2024-09-14T11:54:08.670061+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'231","last_scrub_stamp":"2024-09-14T11:54:08.669862+0000","last_deep_scrub":"264'231","last_deep_scrub_stamp":"2024-09-14T11:54:08.669862+0000","last_clean_scrub_stamp":"2024-09-14T11:54:08.669862+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:46.692498+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":505,"num_read_kb":8662,"num_write":1132,"num_write_kb":22372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:25.884052+0000","last_change":"2024-09-14T11:54:25.884052+0000","last_active":"2024-09-14T11:54:25.884052+0000","last_peered":"2024-09-14T11:54:25.884052+0000","last_clean":"2024-09-14T11:54:25.884052+0000","last_became_active":"2024-09-14T11:09:48.968459+0000","last_became_peered":"2024-09-14T11:09:48.968459+0000","last_unstale":"2024-09-14T11:54:25.884052+0000","last_undegraded":"2024-09-14T11:54:25.884052+0000","last_fullsized":"2024-09-14T11:54:25.884052+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:25.883831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:25.883831+0000","last_clean_scrub_stamp":"2024-09-14T11:54:25.883831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:45.445692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"264'102","reported_seq":626,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:39.757198+0000","last_change":"2024-09-14T11:54:39.757198+0000","last_active":"2024-09-14T11:54:39.757198+0000","last_peered":"2024-09-14T11:54:39.757198+0000","last_clean":"2024-09-14T11:54:39.757198+0000","last_became_active":"2024-09-14T11:09:50.979749+0000","last_became_peered":"2024-09-14T11:09:50.979749+0000","last_unstale":"2024-09-14T11:54:39.757198+0000","last_undegraded":"2024-09-14T11:54:39.757198+0000","last_fullsized":"2024-09-14T11:54:39.757198+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'102","last_scrub_stamp":"2024-09-14T11:54:39.756989+0000","last_deep_scrub":"264'102","last_deep_scrub_stamp":"2024-09-14T11:54:39.756989+0000","last_clean_scrub_stamp":"2024-09-14T11:54:39.756989+0000","objects_scrubbed":6,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:18.949852+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":88,"num_read_kb":80,"num_write":70,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"264'783","reported_seq":4308,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.866789+0000","last_change":"2024-09-14T11:54:26.866789+0000","last_active":"2024-09-14T11:54:26.866789+0000","last_peered":"2024-09-14T11:54:26.866789+0000","last_clean":"2024-09-14T11:54:26.866789+0000","last_became_active":"2024-09-14T11:09:53.014955+0000","last_became_peered":"2024-09-14T11:09:53.014955+0000","last_unstale":"2024-09-14T11:54:26.866789+0000","last_undegraded":"2024-09-14T11:54:26.866789+0000","last_fullsized":"2024-09-14T11:54:26.866789+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'783","last_scrub_stamp":"2024-09-14T11:54:26.866593+0000","last_deep_scrub":"264'783","last_deep_scrub_stamp":"2024-09-14T11:54:26.866593+0000","last_clean_scrub_stamp":"2024-09-14T11:54:26.866593+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:19.315165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"264'92","reported_seq":582,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.640080+0000","last_change":"2024-09-14T11:09:55.030910+0000","last_active":"2024-09-14T11:52:29.640080+0000","last_peered":"2024-09-14T11:52:29.640080+0000","last_clean":"2024-09-14T11:52:29.640080+0000","last_became_active":"2024-09-14T11:09:55.030211+0000","last_became_peered":"2024-09-14T11:09:55.030211+0000","last_unstale":"2024-09-14T11:52:29.640080+0000","last_undegraded":"2024-09-14T11:52:29.640080+0000","last_fullsized":"2024-09-14T11:52:29.640080+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":87,"num_write":222,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"264'456","reported_seq":2007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.356863+0000","last_change":"2024-09-14T11:54:19.356863+0000","last_active":"2024-09-14T11:54:19.356863+0000","last_peered":"2024-09-14T11:54:19.356863+0000","last_clean":"2024-09-14T11:54:19.356863+0000","last_became_active":"2024-09-14T11:09:46.974957+0000","last_became_peered":"2024-09-14T11:09:46.974957+0000","last_unstale":"2024-09-14T11:54:19.356863+0000","last_undegraded":"2024-09-14T11:54:19.356863+0000","last_fullsized":"2024-09-14T11:54:19.356863+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'456","last_scrub_stamp":"2024-09-14T11:54:19.356645+0000","last_deep_scrub":"264'456","last_deep_scrub_stamp":"2024-09-14T11:54:19.356645+0000","last_clean_scrub_stamp":"2024-09-14T11:54:19.356645+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:51.238936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2398,"num_read_kb":2260,"num_write":532,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"264'307","reported_seq":1007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:02.648344+0000","last_change":"2024-09-14T11:54:02.648344+0000","last_active":"2024-09-14T11:54:02.648344+0000","last_peered":"2024-09-14T11:54:02.648344+0000","last_clean":"2024-09-14T11:54:02.648344+0000","last_became_active":"2024-09-14T11:09:45.204014+0000","last_became_peered":"2024-09-14T11:09:45.204014+0000","last_unstale":"2024-09-14T11:54:02.648344+0000","last_undegraded":"2024-09-14T11:54:02.648344+0000","last_fullsized":"2024-09-14T11:54:02.648344+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'307","last_scrub_stamp":"2024-09-14T11:54:02.648264+0000","last_deep_scrub":"264'307","last_deep_scrub_stamp":"2024-09-14T11:54:02.648264+0000","last_clean_scrub_stamp":"2024-09-14T11:54:02.648264+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:19.048576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":844,"num_read_kb":35877,"num_write":1474,"num_write_kb":50924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.685905+0000","last_change":"2024-09-14T11:54:19.685905+0000","last_active":"2024-09-14T11:54:19.685905+0000","last_peered":"2024-09-14T11:54:19.685905+0000","last_clean":"2024-09-14T11:54:19.685905+0000","last_became_active":"2024-09-14T11:09:48.950445+0000","last_became_peered":"2024-09-14T11:09:48.950445+0000","last_unstale":"2024-09-14T11:54:19.685905+0000","last_undegraded":"2024-09-14T11:54:19.685905+0000","last_fullsized":"2024-09-14T11:54:19.685905+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:19.685726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:19.685726+0000","last_clean_scrub_stamp":"2024-09-14T11:54:19.685726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:25.961511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"264'173","reported_seq":757,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:21.861599+0000","last_change":"2024-09-14T11:54:21.861599+0000","last_active":"2024-09-14T11:54:21.861599+0000","last_peered":"2024-09-14T11:54:21.861599+0000","last_clean":"2024-09-14T11:54:21.861599+0000","last_became_active":"2024-09-14T11:09:50.992216+0000","last_became_peered":"2024-09-14T11:09:50.992216+0000","last_unstale":"2024-09-14T11:54:21.861599+0000","last_undegraded":"2024-09-14T11:54:21.861599+0000","last_fullsized":"2024-09-14T11:54:21.861599+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'173","last_scrub_stamp":"2024-09-14T11:54:21.861380+0000","last_deep_scrub":"264'173","last_deep_scrub_stamp":"2024-09-14T11:54:21.861380+0000","last_clean_scrub_stamp":"2024-09-14T11:54:21.861380+0000","objects_scrubbed":7,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:17.222257+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59902,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":237,"num_read_kb":452,"num_write":144,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:35.974705+0000","last_change":"2024-09-14T11:54:35.974705+0000","last_active":"2024-09-14T11:54:35.974705+0000","last_peered":"2024-09-14T11:54:35.974705+0000","last_clean":"2024-09-14T11:54:35.974705+0000","last_became_active":"2024-09-14T11:09:53.023492+0000","last_became_peered":"2024-09-14T11:09:53.023492+0000","last_unstale":"2024-09-14T11:54:35.974705+0000","last_undegraded":"2024-09-14T11:54:35.974705+0000","last_fullsized":"2024-09-14T11:54:35.974705+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:35.974527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:35.974527+0000","last_clean_scrub_stamp":"2024-09-14T11:54:35.974527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:08.100468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"264'115","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:29.590701+0000","last_change":"2024-09-14T11:54:29.590701+0000","last_active":"2024-09-14T11:54:29.590701+0000","last_peered":"2024-09-14T11:54:29.590701+0000","last_clean":"2024-09-14T11:54:29.590701+0000","last_became_active":"2024-09-14T11:09:55.027044+0000","last_became_peered":"2024-09-14T11:09:55.027044+0000","last_unstale":"2024-09-14T11:54:29.590701+0000","last_undegraded":"2024-09-14T11:54:29.590701+0000","last_fullsized":"2024-09-14T11:54:29.590701+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'115","last_scrub_stamp":"2024-09-14T11:54:29.590497+0000","last_deep_scrub":"264'115","last_deep_scrub_stamp":"2024-09-14T11:54:29.590497+0000","last_clean_scrub_stamp":"2024-09-14T11:54:29.590497+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:32:47.840687+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":137,"num_read_kb":126,"num_write":268,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"264'784","reported_seq":2418,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.425477+0000","last_change":"2024-09-14T11:54:11.425477+0000","last_active":"2024-09-14T11:54:11.425477+0000","last_peered":"2024-09-14T11:54:11.425477+0000","last_clean":"2024-09-14T11:54:11.425477+0000","last_became_active":"2024-09-14T11:09:46.981651+0000","last_became_peered":"2024-09-14T11:09:46.981651+0000","last_unstale":"2024-09-14T11:54:11.425477+0000","last_undegraded":"2024-09-14T11:54:11.425477+0000","last_fullsized":"2024-09-14T11:54:11.425477+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'784","last_scrub_stamp":"2024-09-14T11:54:11.425249+0000","last_deep_scrub":"264'784","last_deep_scrub_stamp":"2024-09-14T11:54:11.425249+0000","last_clean_scrub_stamp":"2024-09-14T11:54:11.425249+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:21.549218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3785,"num_read_kb":3457,"num_write":1011,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"264'249","reported_seq":896,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:12.758882+0000","last_change":"2024-09-14T11:54:12.758882+0000","last_active":"2024-09-14T11:54:12.758882+0000","last_peered":"2024-09-14T11:54:12.758882+0000","last_clean":"2024-09-14T11:54:12.758882+0000","last_became_active":"2024-09-14T11:09:45.215127+0000","last_became_peered":"2024-09-14T11:09:45.215127+0000","last_unstale":"2024-09-14T11:54:12.758882+0000","last_undegraded":"2024-09-14T11:54:12.758882+0000","last_fullsized":"2024-09-14T11:54:12.758882+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'249","last_scrub_stamp":"2024-09-14T11:54:12.758682+0000","last_deep_scrub":"264'249","last_deep_scrub_stamp":"2024-09-14T11:54:12.758682+0000","last_clean_scrub_stamp":"2024-09-14T11:54:12.758682+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:33.194428+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655838,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":590,"num_read_kb":34633,"num_write":1021,"num_write_kb":52307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:21.336091+0000","last_change":"2024-09-14T11:54:21.336091+0000","last_active":"2024-09-14T11:54:21.336091+0000","last_peered":"2024-09-14T11:54:21.336091+0000","last_clean":"2024-09-14T11:54:21.336091+0000","last_became_active":"2024-09-14T11:09:48.960006+0000","last_became_peered":"2024-09-14T11:09:48.960006+0000","last_unstale":"2024-09-14T11:54:21.336091+0000","last_undegraded":"2024-09-14T11:54:21.336091+0000","last_fullsized":"2024-09-14T11:54:21.336091+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:21.335912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:21.335912+0000","last_clean_scrub_stamp":"2024-09-14T11:54:21.335912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:58.931314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"264'121","reported_seq":695,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:31.988047+0000","last_change":"2024-09-14T11:54:31.988047+0000","last_active":"2024-09-14T11:54:31.988047+0000","last_peered":"2024-09-14T11:54:31.988047+0000","last_clean":"2024-09-14T11:54:31.988047+0000","last_became_active":"2024-09-14T11:09:50.975555+0000","last_became_peered":"2024-09-14T11:09:50.975555+0000","last_unstale":"2024-09-14T11:54:31.988047+0000","last_undegraded":"2024-09-14T11:54:31.988047+0000","last_fullsized":"2024-09-14T11:54:31.988047+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'121","last_scrub_stamp":"2024-09-14T11:54:31.987835+0000","last_deep_scrub":"264'121","last_deep_scrub_stamp":"2024-09-14T11:54:31.987835+0000","last_clean_scrub_stamp":"2024-09-14T11:54:31.987835+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:03.800123+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5710,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":156,"num_read_kb":221,"num_write":78,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:41.686153+0000","last_change":"2024-09-14T11:54:41.686153+0000","last_active":"2024-09-14T11:54:41.686153+0000","last_peered":"2024-09-14T11:54:41.686153+0000","last_clean":"2024-09-14T11:54:41.686153+0000","last_became_active":"2024-09-14T11:09:53.015039+0000","last_became_peered":"2024-09-14T11:09:53.015039+0000","last_unstale":"2024-09-14T11:54:41.686153+0000","last_undegraded":"2024-09-14T11:54:41.686153+0000","last_fullsized":"2024-09-14T11:54:41.686153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:41.685979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:41.685979+0000","last_clean_scrub_stamp":"2024-09-14T11:54:41.685979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:57.047277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"264'94","reported_seq":611,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:41.161656+0000","last_change":"2024-09-14T11:54:41.161656+0000","last_active":"2024-09-14T11:54:41.161656+0000","last_peered":"2024-09-14T11:54:41.161656+0000","last_clean":"2024-09-14T11:54:41.161656+0000","last_became_active":"2024-09-14T11:09:55.013997+0000","last_became_peered":"2024-09-14T11:09:55.013997+0000","last_unstale":"2024-09-14T11:54:41.161656+0000","last_undegraded":"2024-09-14T11:54:41.161656+0000","last_fullsized":"2024-09-14T11:54:41.161656+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'94","last_scrub_stamp":"2024-09-14T11:54:41.161480+0000","last_deep_scrub":"264'94","last_deep_scrub_stamp":"2024-09-14T11:54:41.161480+0000","last_clean_scrub_stamp":"2024-09-14T11:54:41.161480+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:08:50.915166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":557,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":129,"num_write":227,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"264'1275","reported_seq":2891,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.288870+0000","last_change":"2024-09-14T11:54:10.288870+0000","last_active":"2024-09-14T11:54:10.288870+0000","last_peered":"2024-09-14T11:54:10.288870+0000","last_clean":"2024-09-14T11:54:10.288870+0000","last_became_active":"2024-09-14T11:09:46.982770+0000","last_became_peered":"2024-09-14T11:09:46.982770+0000","last_unstale":"2024-09-14T11:54:10.288870+0000","last_undegraded":"2024-09-14T11:54:10.288870+0000","last_fullsized":"2024-09-14T11:54:10.288870+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1275","last_scrub_stamp":"2024-09-14T11:54:10.288683+0000","last_deep_scrub":"264'1275","last_deep_scrub_stamp":"2024-09-14T11:54:10.288683+0000","last_clean_scrub_stamp":"2024-09-14T11:54:10.288683+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":1200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:08.762030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5800,"num_read_kb":5089,"num_write":1775,"num_write_kb":736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"264'210","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.091928+0000","last_change":"2024-09-14T11:54:07.091928+0000","last_active":"2024-09-14T11:54:07.091928+0000","last_peered":"2024-09-14T11:54:07.091928+0000","last_clean":"2024-09-14T11:54:07.091928+0000","last_became_active":"2024-09-14T11:09:45.200971+0000","last_became_peered":"2024-09-14T11:09:45.200971+0000","last_unstale":"2024-09-14T11:54:07.091928+0000","last_undegraded":"2024-09-14T11:54:07.091928+0000","last_fullsized":"2024-09-14T11:54:07.091928+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'210","last_scrub_stamp":"2024-09-14T11:54:07.091775+0000","last_deep_scrub":"264'210","last_deep_scrub_stamp":"2024-09-14T11:54:07.091775+0000","last_clean_scrub_stamp":"2024-09-14T11:54:07.091775+0000","objects_scrubbed":6,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:25.105451+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3174623,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":502,"num_read_kb":61081,"num_write":905,"num_write_kb":39968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.657373+0000","last_change":"2024-09-14T11:54:18.657373+0000","last_active":"2024-09-14T11:54:18.657373+0000","last_peered":"2024-09-14T11:54:18.657373+0000","last_clean":"2024-09-14T11:54:18.657373+0000","last_became_active":"2024-09-14T11:09:48.958168+0000","last_became_peered":"2024-09-14T11:09:48.958168+0000","last_unstale":"2024-09-14T11:54:18.657373+0000","last_undegraded":"2024-09-14T11:54:18.657373+0000","last_fullsized":"2024-09-14T11:54:18.657373+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:18.657106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:18.657106+0000","last_clean_scrub_stamp":"2024-09-14T11:54:18.657106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:03.227051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"264'106","reported_seq":667,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.633267+0000","last_change":"2024-09-14T11:54:24.633267+0000","last_active":"2024-09-14T11:54:24.633267+0000","last_peered":"2024-09-14T11:54:24.633267+0000","last_clean":"2024-09-14T11:54:24.633267+0000","last_became_active":"2024-09-14T11:09:50.998951+0000","last_became_peered":"2024-09-14T11:09:50.998951+0000","last_unstale":"2024-09-14T11:54:24.633267+0000","last_undegraded":"2024-09-14T11:54:24.633267+0000","last_fullsized":"2024-09-14T11:54:24.633267+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'106","last_scrub_stamp":"2024-09-14T11:54:24.633080+0000","last_deep_scrub":"264'106","last_deep_scrub_stamp":"2024-09-14T11:54:24.633080+0000","last_clean_scrub_stamp":"2024-09-14T11:54:24.633080+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:50.324330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":125,"num_read_kb":141,"num_write":60,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.704603+0000","last_change":"2024-09-14T11:54:43.704603+0000","last_active":"2024-09-14T11:54:43.704603+0000","last_peered":"2024-09-14T11:54:43.704603+0000","last_clean":"2024-09-14T11:54:43.704603+0000","last_became_active":"2024-09-14T11:09:53.021595+0000","last_became_peered":"2024-09-14T11:09:53.021595+0000","last_unstale":"2024-09-14T11:54:43.704603+0000","last_undegraded":"2024-09-14T11:54:43.704603+0000","last_fullsized":"2024-09-14T11:54:43.704603+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:43.704427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:43.704427+0000","last_clean_scrub_stamp":"2024-09-14T11:54:43.704427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:19.553670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"264'187","reported_seq":1643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:52:27.560080+0000","last_change":"2024-09-14T11:09:55.029111+0000","last_active":"2024-09-14T11:52:27.560080+0000","last_peered":"2024-09-14T11:52:27.560080+0000","last_clean":"2024-09-14T11:52:27.560080+0000","last_became_active":"2024-09-14T11:09:55.028374+0000","last_became_peered":"2024-09-14T11:09:55.028374+0000","last_unstale":"2024-09-14T11:52:27.560080+0000","last_undegraded":"2024-09-14T11:52:27.560080+0000","last_fullsized":"2024-09-14T11:52:27.560080+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:09:53.977318+0000","last_clean_scrub_stamp":"2024-09-14T11:09:53.977318+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:11.828167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":650,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1185,"num_read_kb":1180,"num_write":425,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"264'678","reported_seq":2444,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.384340+0000","last_change":"2024-09-14T11:54:14.384340+0000","last_active":"2024-09-14T11:54:14.384340+0000","last_peered":"2024-09-14T11:54:14.384340+0000","last_clean":"2024-09-14T11:54:14.384340+0000","last_became_active":"2024-09-14T11:09:46.946243+0000","last_became_peered":"2024-09-14T11:09:46.946243+0000","last_unstale":"2024-09-14T11:54:14.384340+0000","last_undegraded":"2024-09-14T11:54:14.384340+0000","last_fullsized":"2024-09-14T11:54:14.384340+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'678","last_scrub_stamp":"2024-09-14T11:54:14.384140+0000","last_deep_scrub":"264'678","last_deep_scrub_stamp":"2024-09-14T11:54:14.384140+0000","last_clean_scrub_stamp":"2024-09-14T11:54:14.384140+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":600,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:37.864132+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3815,"num_read_kb":3478,"num_write":980,"num_write_kb":450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"264'190","reported_seq":824,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.123338+0000","last_change":"2024-09-14T11:54:08.123338+0000","last_active":"2024-09-14T11:54:08.123338+0000","last_peered":"2024-09-14T11:54:08.123338+0000","last_clean":"2024-09-14T11:54:08.123338+0000","last_became_active":"2024-09-14T11:09:45.201929+0000","last_became_peered":"2024-09-14T11:09:45.201929+0000","last_unstale":"2024-09-14T11:54:08.123338+0000","last_undegraded":"2024-09-14T11:54:08.123338+0000","last_fullsized":"2024-09-14T11:54:08.123338+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'190","last_scrub_stamp":"2024-09-14T11:54:08.123135+0000","last_deep_scrub":"264'190","last_deep_scrub_stamp":"2024-09-14T11:54:08.123135+0000","last_clean_scrub_stamp":"2024-09-14T11:54:08.123135+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:22.215301+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":518,"num_read_kb":13061,"num_write":810,"num_write_kb":29760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"264'2","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.880805+0000","last_change":"2024-09-14T11:54:24.880805+0000","last_active":"2024-09-14T11:54:24.880805+0000","last_peered":"2024-09-14T11:54:24.880805+0000","last_clean":"2024-09-14T11:54:24.880805+0000","last_became_active":"2024-09-14T11:09:48.963104+0000","last_became_peered":"2024-09-14T11:09:48.963104+0000","last_unstale":"2024-09-14T11:54:24.880805+0000","last_undegraded":"2024-09-14T11:54:24.880805+0000","last_fullsized":"2024-09-14T11:54:24.880805+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:24.880626+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:24.880626+0000","last_clean_scrub_stamp":"2024-09-14T11:54:24.880626+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:25.697197+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"264'169","reported_seq":754,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:36.772360+0000","last_change":"2024-09-14T11:54:36.772360+0000","last_active":"2024-09-14T11:54:36.772360+0000","last_peered":"2024-09-14T11:54:36.772360+0000","last_clean":"2024-09-14T11:54:36.772360+0000","last_became_active":"2024-09-14T11:09:50.983753+0000","last_became_peered":"2024-09-14T11:09:50.983753+0000","last_unstale":"2024-09-14T11:54:36.772360+0000","last_undegraded":"2024-09-14T11:54:36.772360+0000","last_fullsized":"2024-09-14T11:54:36.772360+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'169","last_scrub_stamp":"2024-09-14T11:54:36.772144+0000","last_deep_scrub":"264'169","last_deep_scrub_stamp":"2024-09-14T11:54:36.772144+0000","last_clean_scrub_stamp":"2024-09-14T11:54:36.772144+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:58.244746+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4671,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":206,"num_read_kb":262,"num_write":116,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:37.014050+0000","last_change":"2024-09-14T11:54:37.014050+0000","last_active":"2024-09-14T11:54:37.014050+0000","last_peered":"2024-09-14T11:54:37.014050+0000","last_clean":"2024-09-14T11:54:37.014050+0000","last_became_active":"2024-09-14T11:09:53.011077+0000","last_became_peered":"2024-09-14T11:09:53.011077+0000","last_unstale":"2024-09-14T11:54:37.014050+0000","last_undegraded":"2024-09-14T11:54:37.014050+0000","last_fullsized":"2024-09-14T11:54:37.014050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:37.013874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:37.013874+0000","last_clean_scrub_stamp":"2024-09-14T11:54:37.013874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:18.050567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"264'168","reported_seq":676,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.915244+0000","last_change":"2024-09-14T11:54:28.915244+0000","last_active":"2024-09-14T11:54:28.915244+0000","last_peered":"2024-09-14T11:54:28.915244+0000","last_clean":"2024-09-14T11:54:28.915244+0000","last_became_active":"2024-09-14T11:09:55.021523+0000","last_became_peered":"2024-09-14T11:09:55.021523+0000","last_unstale":"2024-09-14T11:54:28.915244+0000","last_undegraded":"2024-09-14T11:54:28.915244+0000","last_fullsized":"2024-09-14T11:54:28.915244+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'168","last_scrub_stamp":"2024-09-14T11:54:28.915034+0000","last_deep_scrub":"264'168","last_deep_scrub_stamp":"2024-09-14T11:54:28.915034+0000","last_clean_scrub_stamp":"2024-09-14T11:54:28.915034+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:04.328569+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1072,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":209,"num_read_kb":183,"num_write":413,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"264'931","reported_seq":2658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.708900+0000","last_change":"2024-09-14T11:54:15.708900+0000","last_active":"2024-09-14T11:54:15.708900+0000","last_peered":"2024-09-14T11:54:15.708900+0000","last_clean":"2024-09-14T11:54:15.708900+0000","last_became_active":"2024-09-14T11:09:46.951108+0000","last_became_peered":"2024-09-14T11:09:46.951108+0000","last_unstale":"2024-09-14T11:54:15.708900+0000","last_undegraded":"2024-09-14T11:54:15.708900+0000","last_fullsized":"2024-09-14T11:54:15.708900+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'931","last_scrub_stamp":"2024-09-14T11:54:15.708652+0000","last_deep_scrub":"264'931","last_deep_scrub_stamp":"2024-09-14T11:54:15.708652+0000","last_clean_scrub_stamp":"2024-09-14T11:54:15.708652+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":900,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:05.702799+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6915,"num_read_kb":6425,"num_write":1478,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"264'233","reported_seq":924,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:02.380470+0000","last_change":"2024-09-14T11:54:02.380470+0000","last_active":"2024-09-14T11:54:02.380470+0000","last_peered":"2024-09-14T11:54:02.380470+0000","last_clean":"2024-09-14T11:54:02.380470+0000","last_became_active":"2024-09-14T11:09:45.211372+0000","last_became_peered":"2024-09-14T11:09:45.211372+0000","last_unstale":"2024-09-14T11:54:02.380470+0000","last_undegraded":"2024-09-14T11:54:02.380470+0000","last_fullsized":"2024-09-14T11:54:02.380470+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'233","last_scrub_stamp":"2024-09-14T11:54:02.380386+0000","last_deep_scrub":"264'233","last_deep_scrub_stamp":"2024-09-14T11:54:02.380386+0000","last_clean_scrub_stamp":"2024-09-14T11:54:02.380386+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:14.254836+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":701,"num_read_kb":62622,"num_write":1043,"num_write_kb":26227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"264'1162","reported_seq":2874,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:12.335584+0000","last_change":"2024-09-14T11:54:12.335584+0000","last_active":"2024-09-14T11:54:12.335584+0000","last_peered":"2024-09-14T11:54:12.335584+0000","last_clean":"2024-09-14T11:54:12.335584+0000","last_became_active":"2024-09-14T11:09:46.970185+0000","last_became_peered":"2024-09-14T11:09:46.970185+0000","last_unstale":"2024-09-14T11:54:12.335584+0000","last_undegraded":"2024-09-14T11:54:12.335584+0000","last_fullsized":"2024-09-14T11:54:12.335584+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1162","last_scrub_stamp":"2024-09-14T11:54:12.335362+0000","last_deep_scrub":"264'1162","last_deep_scrub_stamp":"2024-09-14T11:54:12.335362+0000","last_clean_scrub_stamp":"2024-09-14T11:54:12.335362+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":1100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:35:56.805295+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5490,"num_read_kb":4916,"num_write":1574,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3025,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"264'229","reported_seq":853,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.253331+0000","last_change":"2024-09-14T11:54:06.253331+0000","last_active":"2024-09-14T11:54:06.253331+0000","last_peered":"2024-09-14T11:54:06.253331+0000","last_clean":"2024-09-14T11:54:06.253331+0000","last_became_active":"2024-09-14T11:09:45.213238+0000","last_became_peered":"2024-09-14T11:09:45.213238+0000","last_unstale":"2024-09-14T11:54:06.253331+0000","last_undegraded":"2024-09-14T11:54:06.253331+0000","last_fullsized":"2024-09-14T11:54:06.253331+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'229","last_scrub_stamp":"2024-09-14T11:54:06.253133+0000","last_deep_scrub":"264'229","last_deep_scrub_stamp":"2024-09-14T11:54:06.253133+0000","last_clean_scrub_stamp":"2024-09-14T11:54:06.253133+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:05.425833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":552,"num_read_kb":930,"num_write":1100,"num_write_kb":31959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"264'418","reported_seq":1954,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:23.955913+0000","last_change":"2024-09-14T11:54:23.955913+0000","last_active":"2024-09-14T11:54:23.955913+0000","last_peered":"2024-09-14T11:54:23.955913+0000","last_clean":"2024-09-14T11:54:23.955913+0000","last_became_active":"2024-09-14T11:09:46.958063+0000","last_became_peered":"2024-09-14T11:09:46.958063+0000","last_unstale":"2024-09-14T11:54:23.955913+0000","last_undegraded":"2024-09-14T11:54:23.955913+0000","last_fullsized":"2024-09-14T11:54:23.955913+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'418","last_scrub_stamp":"2024-09-14T11:54:23.955735+0000","last_deep_scrub":"264'418","last_deep_scrub_stamp":"2024-09-14T11:54:23.955735+0000","last_clean_scrub_stamp":"2024-09-14T11:54:23.955735+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:30:58.368408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2247,"num_read_kb":2131,"num_write":481,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"264'227","reported_seq":1046,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.795526+0000","last_change":"2024-09-14T11:54:13.795526+0000","last_active":"2024-09-14T11:54:13.795526+0000","last_peered":"2024-09-14T11:54:13.795526+0000","last_clean":"2024-09-14T11:54:13.795526+0000","last_became_active":"2024-09-14T11:09:45.217258+0000","last_became_peered":"2024-09-14T11:09:45.217258+0000","last_unstale":"2024-09-14T11:54:13.795526+0000","last_undegraded":"2024-09-14T11:54:13.795526+0000","last_fullsized":"2024-09-14T11:54:13.795526+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'227","last_scrub_stamp":"2024-09-14T11:54:13.795287+0000","last_deep_scrub":"264'227","last_deep_scrub_stamp":"2024-09-14T11:54:13.795287+0000","last_clean_scrub_stamp":"2024-09-14T11:54:13.795287+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:59.198774+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311659,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1093,"num_read_kb":14899,"num_write":1046,"num_write_kb":43826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"264'406","reported_seq":1928,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:23.077918+0000","last_change":"2024-09-14T11:54:23.077918+0000","last_active":"2024-09-14T11:54:23.077918+0000","last_peered":"2024-09-14T11:54:23.077918+0000","last_clean":"2024-09-14T11:54:23.077918+0000","last_became_active":"2024-09-14T11:09:46.987465+0000","last_became_peered":"2024-09-14T11:09:46.987465+0000","last_unstale":"2024-09-14T11:54:23.077918+0000","last_undegraded":"2024-09-14T11:54:23.077918+0000","last_fullsized":"2024-09-14T11:54:23.077918+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'406","last_scrub_stamp":"2024-09-14T11:54:23.077727+0000","last_deep_scrub":"264'406","last_deep_scrub_stamp":"2024-09-14T11:54:23.077727+0000","last_clean_scrub_stamp":"2024-09-14T11:54:23.077727+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:59.683153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2188,"num_read_kb":2091,"num_write":479,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"264'214","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.155990+0000","last_change":"2024-09-14T11:54:09.155990+0000","last_active":"2024-09-14T11:54:09.155990+0000","last_peered":"2024-09-14T11:54:09.155990+0000","last_clean":"2024-09-14T11:54:09.155990+0000","last_became_active":"2024-09-14T11:09:45.210754+0000","last_became_peered":"2024-09-14T11:09:45.210754+0000","last_unstale":"2024-09-14T11:54:09.155990+0000","last_undegraded":"2024-09-14T11:54:09.155990+0000","last_fullsized":"2024-09-14T11:54:09.155990+0000","mapping_epoch":23,"log_start":"264'201","ondisk_log_start":"264'201","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'214","last_scrub_stamp":"2024-09-14T11:54:09.155714+0000","last_deep_scrub":"264'214","last_deep_scrub_stamp":"2024-09-14T11:54:09.155714+0000","last_clean_scrub_stamp":"2024-09-14T11:54:09.155714+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":201,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:16.447066+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254321,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":979,"num_write":956,"num_write_kb":15237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"264'393","reported_seq":1918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.113285+0000","last_change":"2024-09-14T11:54:20.113285+0000","last_active":"2024-09-14T11:54:20.113285+0000","last_peered":"2024-09-14T11:54:20.113285+0000","last_clean":"2024-09-14T11:54:20.113285+0000","last_became_active":"2024-09-14T11:09:46.975006+0000","last_became_peered":"2024-09-14T11:09:46.975006+0000","last_unstale":"2024-09-14T11:54:20.113285+0000","last_undegraded":"2024-09-14T11:54:20.113285+0000","last_fullsized":"2024-09-14T11:54:20.113285+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'393","last_scrub_stamp":"2024-09-14T11:54:20.113113+0000","last_deep_scrub":"264'393","last_deep_scrub_stamp":"2024-09-14T11:54:20.113113+0000","last_clean_scrub_stamp":"2024-09-14T11:54:20.113113+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:34.432992+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2194,"num_read_kb":2087,"num_write":454,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"264'207","reported_seq":831,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.669688+0000","last_change":"2024-09-14T11:54:04.669688+0000","last_active":"2024-09-14T11:54:04.669688+0000","last_peered":"2024-09-14T11:54:04.669688+0000","last_clean":"2024-09-14T11:54:04.669688+0000","last_became_active":"2024-09-14T11:09:45.210639+0000","last_became_peered":"2024-09-14T11:09:45.210639+0000","last_unstale":"2024-09-14T11:54:04.669688+0000","last_undegraded":"2024-09-14T11:54:04.669688+0000","last_fullsized":"2024-09-14T11:54:04.669688+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'207","last_scrub_stamp":"2024-09-14T11:54:04.669386+0000","last_deep_scrub":"264'207","last_deep_scrub_stamp":"2024-09-14T11:54:04.669386+0000","last_clean_scrub_stamp":"2024-09-14T11:54:04.669386+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:45.645744+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655887,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":487,"num_read_kb":12081,"num_write":976,"num_write_kb":34333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"264'844","reported_seq":2520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:12.797196+0000","last_change":"2024-09-14T11:54:12.797196+0000","last_active":"2024-09-14T11:54:12.797196+0000","last_peered":"2024-09-14T11:54:12.797196+0000","last_clean":"2024-09-14T11:54:12.797196+0000","last_became_active":"2024-09-14T11:09:46.961185+0000","last_became_peered":"2024-09-14T11:09:46.961185+0000","last_unstale":"2024-09-14T11:54:12.797196+0000","last_undegraded":"2024-09-14T11:54:12.797196+0000","last_fullsized":"2024-09-14T11:54:12.797196+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'844","last_scrub_stamp":"2024-09-14T11:54:12.796991+0000","last_deep_scrub":"264'844","last_deep_scrub_stamp":"2024-09-14T11:54:12.796991+0000","last_clean_scrub_stamp":"2024-09-14T11:54:12.796991+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":800,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:51.293229+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4099,"num_read_kb":3707,"num_write":1108,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"264'193","reported_seq":809,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.672295+0000","last_change":"2024-09-14T11:54:06.672295+0000","last_active":"2024-09-14T11:54:06.672295+0000","last_peered":"2024-09-14T11:54:06.672295+0000","last_clean":"2024-09-14T11:54:06.672295+0000","last_became_active":"2024-09-14T11:09:45.220246+0000","last_became_peered":"2024-09-14T11:09:45.220246+0000","last_unstale":"2024-09-14T11:54:06.672295+0000","last_undegraded":"2024-09-14T11:54:06.672295+0000","last_fullsized":"2024-09-14T11:54:06.672295+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'193","last_scrub_stamp":"2024-09-14T11:54:06.672104+0000","last_deep_scrub":"264'193","last_deep_scrub_stamp":"2024-09-14T11:54:06.672104+0000","last_clean_scrub_stamp":"2024-09-14T11:54:06.672104+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:13.489184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":452,"num_read_kb":10292,"num_write":865,"num_write_kb":29061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"264'673","reported_seq":2021,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.583120+0000","last_change":"2024-09-14T11:54:15.583120+0000","last_active":"2024-09-14T11:54:15.583120+0000","last_peered":"2024-09-14T11:54:15.583120+0000","last_clean":"2024-09-14T11:54:15.583120+0000","last_became_active":"2024-09-14T11:09:46.990649+0000","last_became_peered":"2024-09-14T11:09:46.990649+0000","last_unstale":"2024-09-14T11:54:15.583120+0000","last_undegraded":"2024-09-14T11:54:15.583120+0000","last_fullsized":"2024-09-14T11:54:15.583120+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'673","last_scrub_stamp":"2024-09-14T11:54:15.582941+0000","last_deep_scrub":"264'673","last_deep_scrub_stamp":"2024-09-14T11:54:15.582941+0000","last_clean_scrub_stamp":"2024-09-14T11:54:15.582941+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":600,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:20.316004+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3174,"num_read_kb":2866,"num_write":894,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"264'236","reported_seq":903,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.320327+0000","last_change":"2024-09-14T11:54:07.320327+0000","last_active":"2024-09-14T11:54:07.320327+0000","last_peered":"2024-09-14T11:54:07.320327+0000","last_clean":"2024-09-14T11:54:07.320327+0000","last_became_active":"2024-09-14T11:09:45.207500+0000","last_became_peered":"2024-09-14T11:09:45.207500+0000","last_unstale":"2024-09-14T11:54:07.320327+0000","last_undegraded":"2024-09-14T11:54:07.320327+0000","last_fullsized":"2024-09-14T11:54:07.320327+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'236","last_scrub_stamp":"2024-09-14T11:54:07.320137+0000","last_deep_scrub":"264'236","last_deep_scrub_stamp":"2024-09-14T11:54:07.320137+0000","last_clean_scrub_stamp":"2024-09-14T11:54:07.320137+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:25.724756+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":644,"num_read_kb":28771,"num_write":1111,"num_write_kb":28685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"264'2091","reported_seq":3870,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.573339+0000","last_change":"2024-09-14T11:54:09.573339+0000","last_active":"2024-09-14T11:54:09.573339+0000","last_peered":"2024-09-14T11:54:09.573339+0000","last_clean":"2024-09-14T11:54:09.573339+0000","last_became_active":"2024-09-14T11:09:46.964893+0000","last_became_peered":"2024-09-14T11:09:46.964893+0000","last_unstale":"2024-09-14T11:54:09.573339+0000","last_undegraded":"2024-09-14T11:54:09.573339+0000","last_fullsized":"2024-09-14T11:54:09.573339+0000","mapping_epoch":25,"log_start":"264'2000","ondisk_log_start":"264'2000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2091","last_scrub_stamp":"2024-09-14T11:54:09.573154+0000","last_deep_scrub":"264'2091","last_deep_scrub_stamp":"2024-09-14T11:54:09.573154+0000","last_clean_scrub_stamp":"2024-09-14T11:54:09.573154+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":2000,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:09.033740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9234,"num_read_kb":7993,"num_write":3022,"num_write_kb":1347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"264'284","reported_seq":991,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.154261+0000","last_change":"2024-09-14T11:54:10.154261+0000","last_active":"2024-09-14T11:54:10.154261+0000","last_peered":"2024-09-14T11:54:10.154261+0000","last_clean":"2024-09-14T11:54:10.154261+0000","last_became_active":"2024-09-14T11:09:45.201951+0000","last_became_peered":"2024-09-14T11:09:45.201951+0000","last_unstale":"2024-09-14T11:54:10.154261+0000","last_undegraded":"2024-09-14T11:54:10.154261+0000","last_fullsized":"2024-09-14T11:54:10.154261+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'284","last_scrub_stamp":"2024-09-14T11:54:10.154062+0000","last_deep_scrub":"264'284","last_deep_scrub_stamp":"2024-09-14T11:54:10.154062+0000","last_clean_scrub_stamp":"2024-09-14T11:54:10.154062+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:54.648794+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655900,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":878,"num_read_kb":20954,"num_write":1195,"num_write_kb":48388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"264'393","reported_seq":1907,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.436438+0000","last_change":"2024-09-14T11:54:15.436438+0000","last_active":"2024-09-14T11:54:15.436438+0000","last_peered":"2024-09-14T11:54:15.436438+0000","last_clean":"2024-09-14T11:54:15.436438+0000","last_became_active":"2024-09-14T11:09:46.982125+0000","last_became_peered":"2024-09-14T11:09:46.982125+0000","last_unstale":"2024-09-14T11:54:15.436438+0000","last_undegraded":"2024-09-14T11:54:15.436438+0000","last_fullsized":"2024-09-14T11:54:15.436438+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'393","last_scrub_stamp":"2024-09-14T11:54:15.436260+0000","last_deep_scrub":"264'393","last_deep_scrub_stamp":"2024-09-14T11:54:15.436260+0000","last_clean_scrub_stamp":"2024-09-14T11:54:15.436260+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:35.766474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2124,"num_read_kb":2027,"num_write":431,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"264'254","reported_seq":939,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.887775+0000","last_change":"2024-09-14T11:54:18.887775+0000","last_active":"2024-09-14T11:54:18.887775+0000","last_peered":"2024-09-14T11:54:18.887775+0000","last_clean":"2024-09-14T11:54:18.887775+0000","last_became_active":"2024-09-14T11:09:45.219634+0000","last_became_peered":"2024-09-14T11:09:45.219634+0000","last_unstale":"2024-09-14T11:54:18.887775+0000","last_undegraded":"2024-09-14T11:54:18.887775+0000","last_fullsized":"2024-09-14T11:54:18.887775+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'254","last_scrub_stamp":"2024-09-14T11:54:18.887539+0000","last_deep_scrub":"264'254","last_deep_scrub_stamp":"2024-09-14T11:54:18.887539+0000","last_clean_scrub_stamp":"2024-09-14T11:54:18.887539+0000","objects_scrubbed":4,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:50.094040+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311685,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":704,"num_read_kb":35580,"num_write":1143,"num_write_kb":63455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"264'547","reported_seq":2105,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.794085+0000","last_change":"2024-09-14T11:54:15.794085+0000","last_active":"2024-09-14T11:54:15.794085+0000","last_peered":"2024-09-14T11:54:15.794085+0000","last_clean":"2024-09-14T11:54:15.794085+0000","last_became_active":"2024-09-14T11:09:46.962261+0000","last_became_peered":"2024-09-14T11:09:46.962261+0000","last_unstale":"2024-09-14T11:54:15.794085+0000","last_undegraded":"2024-09-14T11:54:15.794085+0000","last_fullsized":"2024-09-14T11:54:15.794085+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'547","last_scrub_stamp":"2024-09-14T11:54:15.793906+0000","last_deep_scrub":"264'547","last_deep_scrub_stamp":"2024-09-14T11:54:15.793906+0000","last_clean_scrub_stamp":"2024-09-14T11:54:15.793906+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:35.613525+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2646,"num_read_kb":2439,"num_write":661,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"264'219","reported_seq":862,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:12.137906+0000","last_change":"2024-09-14T11:54:12.137906+0000","last_active":"2024-09-14T11:54:12.137906+0000","last_peered":"2024-09-14T11:54:12.137906+0000","last_clean":"2024-09-14T11:54:12.137906+0000","last_became_active":"2024-09-14T11:09:45.200775+0000","last_became_peered":"2024-09-14T11:09:45.200775+0000","last_unstale":"2024-09-14T11:54:12.137906+0000","last_undegraded":"2024-09-14T11:54:12.137906+0000","last_fullsized":"2024-09-14T11:54:12.137906+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'219","last_scrub_stamp":"2024-09-14T11:54:12.137682+0000","last_deep_scrub":"264'219","last_deep_scrub_stamp":"2024-09-14T11:54:12.137682+0000","last_clean_scrub_stamp":"2024-09-14T11:54:12.137682+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:03.171120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":537,"num_read_kb":33597,"num_write":1024,"num_write_kb":35359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"264'568","reported_seq":2422,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.068157+0000","last_change":"2024-09-14T11:54:22.068157+0000","last_active":"2024-09-14T11:54:22.068157+0000","last_peered":"2024-09-14T11:54:22.068157+0000","last_clean":"2024-09-14T11:54:22.068157+0000","last_became_active":"2024-09-14T11:09:46.974543+0000","last_became_peered":"2024-09-14T11:09:46.974543+0000","last_unstale":"2024-09-14T11:54:22.068157+0000","last_undegraded":"2024-09-14T11:54:22.068157+0000","last_fullsized":"2024-09-14T11:54:22.068157+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'568","last_scrub_stamp":"2024-09-14T11:54:22.067970+0000","last_deep_scrub":"264'568","last_deep_scrub_stamp":"2024-09-14T11:54:22.067970+0000","last_clean_scrub_stamp":"2024-09-14T11:54:22.067970+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":500,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:18.404651+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3309,"num_read_kb":3115,"num_write":715,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2991,"num_omap_keys":12,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"264'214","reported_seq":853,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.652966+0000","last_change":"2024-09-14T11:54:05.652966+0000","last_active":"2024-09-14T11:54:05.652966+0000","last_peered":"2024-09-14T11:54:05.652966+0000","last_clean":"2024-09-14T11:54:05.652966+0000","last_became_active":"2024-09-14T11:09:45.204754+0000","last_became_peered":"2024-09-14T11:09:45.204754+0000","last_unstale":"2024-09-14T11:54:05.652966+0000","last_undegraded":"2024-09-14T11:54:05.652966+0000","last_fullsized":"2024-09-14T11:54:05.652966+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'214","last_scrub_stamp":"2024-09-14T11:54:05.652763+0000","last_deep_scrub":"264'214","last_deep_scrub_stamp":"2024-09-14T11:54:05.652763+0000","last_clean_scrub_stamp":"2024-09-14T11:54:05.652763+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:57.152636+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":525,"num_read_kb":30401,"num_write":981,"num_write_kb":24964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"264'575","reported_seq":2331,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.609313+0000","last_change":"2024-09-14T11:54:07.609313+0000","last_active":"2024-09-14T11:54:07.609313+0000","last_peered":"2024-09-14T11:54:07.609313+0000","last_clean":"2024-09-14T11:54:07.609313+0000","last_became_active":"2024-09-14T11:09:46.964946+0000","last_became_peered":"2024-09-14T11:09:46.964946+0000","last_unstale":"2024-09-14T11:54:07.609313+0000","last_undegraded":"2024-09-14T11:54:07.609313+0000","last_fullsized":"2024-09-14T11:54:07.609313+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'575","last_scrub_stamp":"2024-09-14T11:54:07.609118+0000","last_deep_scrub":"264'575","last_deep_scrub_stamp":"2024-09-14T11:54:07.609118+0000","last_clean_scrub_stamp":"2024-09-14T11:54:07.609118+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":500,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:14.923150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3099,"num_read_kb":2896,"num_write":721,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"264'213","reported_seq":908,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.691374+0000","last_change":"2024-09-14T11:54:11.691374+0000","last_active":"2024-09-14T11:54:11.691374+0000","last_peered":"2024-09-14T11:54:11.691374+0000","last_clean":"2024-09-14T11:54:11.691374+0000","last_became_active":"2024-09-14T11:09:45.191314+0000","last_became_peered":"2024-09-14T11:09:45.191314+0000","last_unstale":"2024-09-14T11:54:11.691374+0000","last_undegraded":"2024-09-14T11:54:11.691374+0000","last_fullsized":"2024-09-14T11:54:11.691374+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'213","last_scrub_stamp":"2024-09-14T11:54:11.691188+0000","last_deep_scrub":"264'213","last_deep_scrub_stamp":"2024-09-14T11:54:11.691188+0000","last_clean_scrub_stamp":"2024-09-14T11:54:11.691188+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:08.058246+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":695,"num_read_kb":24382,"num_write":1016,"num_write_kb":29533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"264'553","reported_seq":2039,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.538890+0000","last_change":"2024-09-14T11:54:11.538890+0000","last_active":"2024-09-14T11:54:11.538890+0000","last_peered":"2024-09-14T11:54:11.538890+0000","last_clean":"2024-09-14T11:54:11.538890+0000","last_became_active":"2024-09-14T11:09:46.994113+0000","last_became_peered":"2024-09-14T11:09:46.994113+0000","last_unstale":"2024-09-14T11:54:11.538890+0000","last_undegraded":"2024-09-14T11:54:11.538890+0000","last_fullsized":"2024-09-14T11:54:11.538890+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'553","last_scrub_stamp":"2024-09-14T11:54:11.538649+0000","last_deep_scrub":"264'553","last_deep_scrub_stamp":"2024-09-14T11:54:11.538649+0000","last_clean_scrub_stamp":"2024-09-14T11:54:11.538649+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:53.524362+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2807,"num_read_kb":2558,"num_write":736,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"264'224","reported_seq":826,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.714480+0000","last_change":"2024-09-14T11:54:05.714480+0000","last_active":"2024-09-14T11:54:05.714480+0000","last_peered":"2024-09-14T11:54:05.714480+0000","last_clean":"2024-09-14T11:54:05.714480+0000","last_became_active":"2024-09-14T11:09:45.214511+0000","last_became_peered":"2024-09-14T11:09:45.214511+0000","last_unstale":"2024-09-14T11:54:05.714480+0000","last_undegraded":"2024-09-14T11:54:05.714480+0000","last_fullsized":"2024-09-14T11:54:05.714480+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'224","last_scrub_stamp":"2024-09-14T11:54:05.714278+0000","last_deep_scrub":"264'224","last_deep_scrub_stamp":"2024-09-14T11:54:05.714278+0000","last_clean_scrub_stamp":"2024-09-14T11:54:05.714278+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:43.486418+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":484,"num_read_kb":9689,"num_write":1032,"num_write_kb":43578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"264'466","reported_seq":1950,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.375439+0000","last_change":"2024-09-14T11:54:13.375439+0000","last_active":"2024-09-14T11:54:13.375439+0000","last_peered":"2024-09-14T11:54:13.375439+0000","last_clean":"2024-09-14T11:54:13.375439+0000","last_became_active":"2024-09-14T11:09:46.974152+0000","last_became_peered":"2024-09-14T11:09:46.974152+0000","last_unstale":"2024-09-14T11:54:13.375439+0000","last_undegraded":"2024-09-14T11:54:13.375439+0000","last_fullsized":"2024-09-14T11:54:13.375439+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'466","last_scrub_stamp":"2024-09-14T11:54:13.375253+0000","last_deep_scrub":"264'466","last_deep_scrub_stamp":"2024-09-14T11:54:13.375253+0000","last_clean_scrub_stamp":"2024-09-14T11:54:13.375253+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:27.247012+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2413,"num_read_kb":2245,"num_write":556,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":963,"num_omap_keys":4,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"264'251","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.840451+0000","last_change":"2024-09-14T11:54:15.840451+0000","last_active":"2024-09-14T11:54:15.840451+0000","last_peered":"2024-09-14T11:54:15.840451+0000","last_clean":"2024-09-14T11:54:15.840451+0000","last_became_active":"2024-09-14T11:09:45.202934+0000","last_became_peered":"2024-09-14T11:09:45.202934+0000","last_unstale":"2024-09-14T11:54:15.840451+0000","last_undegraded":"2024-09-14T11:54:15.840451+0000","last_fullsized":"2024-09-14T11:54:15.840451+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'251","last_scrub_stamp":"2024-09-14T11:54:15.840262+0000","last_deep_scrub":"264'251","last_deep_scrub_stamp":"2024-09-14T11:54:15.840262+0000","last_clean_scrub_stamp":"2024-09-14T11:54:15.840262+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:52.093309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":642,"num_read_kb":75186,"num_write":1115,"num_write_kb":32522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"264'400","reported_seq":1922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:16.663245+0000","last_change":"2024-09-14T11:54:16.663245+0000","last_active":"2024-09-14T11:54:16.663245+0000","last_peered":"2024-09-14T11:54:16.663245+0000","last_clean":"2024-09-14T11:54:16.663245+0000","last_became_active":"2024-09-14T11:09:46.946993+0000","last_became_peered":"2024-09-14T11:09:46.946993+0000","last_unstale":"2024-09-14T11:54:16.663245+0000","last_undegraded":"2024-09-14T11:54:16.663245+0000","last_fullsized":"2024-09-14T11:54:16.663245+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'400","last_scrub_stamp":"2024-09-14T11:54:16.663026+0000","last_deep_scrub":"264'400","last_deep_scrub_stamp":"2024-09-14T11:54:16.663026+0000","last_clean_scrub_stamp":"2024-09-14T11:54:16.663026+0000","objects_scrubbed":6,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:18.854555+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2163,"num_read_kb":2058,"num_write":443,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"264'192","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.273980+0000","last_change":"2024-09-14T11:54:07.273839+0000","last_active":"2024-09-14T11:54:07.273980+0000","last_peered":"2024-09-14T11:54:07.273980+0000","last_clean":"2024-09-14T11:54:07.273980+0000","last_became_active":"2024-09-14T11:09:45.217119+0000","last_became_peered":"2024-09-14T11:09:45.217119+0000","last_unstale":"2024-09-14T11:54:07.273980+0000","last_undegraded":"2024-09-14T11:54:07.273980+0000","last_fullsized":"2024-09-14T11:54:07.273980+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'192","last_scrub_stamp":"2024-09-14T11:54:07.273623+0000","last_deep_scrub":"264'192","last_deep_scrub_stamp":"2024-09-14T11:54:07.273623+0000","last_clean_scrub_stamp":"2024-09-14T11:54:07.273623+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:44:27.235610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":19832,"num_write":847,"num_write_kb":31579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"264'831","reported_seq":2394,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.633118+0000","last_change":"2024-09-14T11:54:17.633118+0000","last_active":"2024-09-14T11:54:17.633118+0000","last_peered":"2024-09-14T11:54:17.633118+0000","last_clean":"2024-09-14T11:54:17.633118+0000","last_became_active":"2024-09-14T11:09:46.990899+0000","last_became_peered":"2024-09-14T11:09:46.990899+0000","last_unstale":"2024-09-14T11:54:17.633118+0000","last_undegraded":"2024-09-14T11:54:17.633118+0000","last_fullsized":"2024-09-14T11:54:17.633118+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'831","last_scrub_stamp":"2024-09-14T11:54:17.632872+0000","last_deep_scrub":"264'831","last_deep_scrub_stamp":"2024-09-14T11:54:17.632872+0000","last_clean_scrub_stamp":"2024-09-14T11:54:17.632872+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:11.212125+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3995,"num_read_kb":3582,"num_write":1122,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":246,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"264'250","reported_seq":960,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:16.871805+0000","last_change":"2024-09-14T11:54:16.871805+0000","last_active":"2024-09-14T11:54:16.871805+0000","last_peered":"2024-09-14T11:54:16.871805+0000","last_clean":"2024-09-14T11:54:16.871805+0000","last_became_active":"2024-09-14T11:09:45.214713+0000","last_became_peered":"2024-09-14T11:09:45.214713+0000","last_unstale":"2024-09-14T11:54:16.871805+0000","last_undegraded":"2024-09-14T11:54:16.871805+0000","last_fullsized":"2024-09-14T11:54:16.871805+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'250","last_scrub_stamp":"2024-09-14T11:54:16.871571+0000","last_deep_scrub":"264'250","last_deep_scrub_stamp":"2024-09-14T11:54:16.871571+0000","last_clean_scrub_stamp":"2024-09-14T11:54:16.871571+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:01.834473+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655874,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":741,"num_read_kb":73898,"num_write":1178,"num_write_kb":36295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"264'151","reported_seq":851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.901832+0000","last_change":"2024-09-14T11:54:17.901832+0000","last_active":"2024-09-14T11:54:17.901832+0000","last_peered":"2024-09-14T11:54:17.901832+0000","last_clean":"2024-09-14T11:54:17.901832+0000","last_became_active":"2024-09-14T11:09:45.202270+0000","last_became_peered":"2024-09-14T11:09:45.202270+0000","last_unstale":"2024-09-14T11:54:17.901832+0000","last_undegraded":"2024-09-14T11:54:17.901832+0000","last_fullsized":"2024-09-14T11:54:17.901832+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'151","last_scrub_stamp":"2024-09-14T11:54:17.901656+0000","last_deep_scrub":"264'151","last_deep_scrub_stamp":"2024-09-14T11:54:17.901656+0000","last_clean_scrub_stamp":"2024-09-14T11:54:17.901656+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:35.985077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":694,"num_read_kb":138365,"num_write":726,"num_write_kb":22161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"264'890","reported_seq":2655,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.708210+0000","last_change":"2024-09-14T11:54:17.708210+0000","last_active":"2024-09-14T11:54:17.708210+0000","last_peered":"2024-09-14T11:54:17.708210+0000","last_clean":"2024-09-14T11:54:17.708210+0000","last_became_active":"2024-09-14T11:09:46.947102+0000","last_became_peered":"2024-09-14T11:09:46.947102+0000","last_unstale":"2024-09-14T11:54:17.708210+0000","last_undegraded":"2024-09-14T11:54:17.708210+0000","last_fullsized":"2024-09-14T11:54:17.708210+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'890","last_scrub_stamp":"2024-09-14T11:54:17.707983+0000","last_deep_scrub":"264'890","last_deep_scrub_stamp":"2024-09-14T11:54:17.707983+0000","last_clean_scrub_stamp":"2024-09-14T11:54:17.707983+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":800,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:08.415593+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4492,"num_read_kb":4074,"num_write":1171,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"264'223","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.123278+0000","last_change":"2024-09-14T11:54:13.123278+0000","last_active":"2024-09-14T11:54:13.123278+0000","last_peered":"2024-09-14T11:54:13.123278+0000","last_clean":"2024-09-14T11:54:13.123278+0000","last_became_active":"2024-09-14T11:09:45.204922+0000","last_became_peered":"2024-09-14T11:09:45.204922+0000","last_unstale":"2024-09-14T11:54:13.123278+0000","last_undegraded":"2024-09-14T11:54:13.123278+0000","last_fullsized":"2024-09-14T11:54:13.123278+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'223","last_scrub_stamp":"2024-09-14T11:54:13.123032+0000","last_deep_scrub":"264'223","last_deep_scrub_stamp":"2024-09-14T11:54:13.123032+0000","last_clean_scrub_stamp":"2024-09-14T11:54:13.123032+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:16.567257+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":767,"num_read_kb":17805,"num_write":1021,"num_write_kb":50816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"264'497","reported_seq":2063,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.551499+0000","last_change":"2024-09-14T11:54:10.551499+0000","last_active":"2024-09-14T11:54:10.551499+0000","last_peered":"2024-09-14T11:54:10.551499+0000","last_clean":"2024-09-14T11:54:10.551499+0000","last_became_active":"2024-09-14T11:09:46.981819+0000","last_became_peered":"2024-09-14T11:09:46.981819+0000","last_unstale":"2024-09-14T11:54:10.551499+0000","last_undegraded":"2024-09-14T11:54:10.551499+0000","last_fullsized":"2024-09-14T11:54:10.551499+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'497","last_scrub_stamp":"2024-09-14T11:54:10.551288+0000","last_deep_scrub":"264'497","last_deep_scrub_stamp":"2024-09-14T11:54:10.551288+0000","last_clean_scrub_stamp":"2024-09-14T11:54:10.551288+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:02.481867+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2560,"num_read_kb":2380,"num_write":586,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10857,"num_read_kb":9179,"num_write":3115,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1006,"ondisk_log_size":1006,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15755,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":15151,"num_read_kb":14810,"num_write":17052,"num_write_kb":4979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2763,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1868,"ondisk_log_size":1868,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":759,"ondisk_log_size":759,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":375102,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":8356,"num_read_kb":10715,"num_write":5641,"num_write_kb":2812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":711024,"num_omap_keys":1616,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2014,"ondisk_log_size":2014,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2413,"num_read_kb":2881,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":220474,"num_read_kb":201951,"num_write":55880,"num_write_kb":19076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35749,"num_omap_keys":144,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4027,"ondisk_log_size":4027,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":40916491,"num_objects":168,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":0,"num_read":38991,"num_read_kb":2064033,"num_write":64568,"num_write_kb":2182336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":82870272,"data_stored":81832982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3601,"ondisk_log_size":3601,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":158488,"num_write":182,"num_write_kb":116383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":158381,"num_write":182,"num_write_kb":116383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509988,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220180,"kb_used_data":18244,"kb_used_omap":1,"kb_used_meta":201918,"kb_avail":94151660,"statfs":{"total":96636764160,"available":96411299840,"internally_reserved":0,"allocated":18681856,"data_stored":17014199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":206764487},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509990,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119184,"kb_used_data":11648,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94252656,"statfs":{"total":96636764160,"available":96514719744,"internally_reserved":0,"allocated":11927552,"data_stored":10256263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542692,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":205004,"kb_used_data":7292,"kb_used_omap":1,"kb_used_meta":197694,"kb_avail":94166836,"statfs":{"total":96636764160,"available":96426840064,"internally_reserved":0,"allocated":7467008,"data_stored":5850366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":202439114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542690,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84808,"kb_used_data":13368,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94287032,"statfs":{"total":96636764160,"available":96549920768,"internally_reserved":0,"allocated":13688832,"data_stored":12047474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542690,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":261108,"kb_used_data":23076,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94110732,"statfs":{"total":96636764160,"available":96369389568,"internally_reserved":0,"allocated":23629824,"data_stored":21914965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243726789},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542691,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148852,"kb_used_data":5284,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94222988,"statfs":{"total":96636764160,"available":96484339712,"internally_reserved":0,"allocated":5410816,"data_stored":3769131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542691,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":268348,"kb_used_data":16428,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94103492,"statfs":{"total":96636764160,"available":96361975808,"internally_reserved":0,"allocated":16822272,"data_stored":15174645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257948101},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542692,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":86684,"kb_used_data":15244,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94285156,"statfs":{"total":96636764160,"available":96547999744,"internally_reserved":0,"allocated":15609856,"data_stored":13878717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11948032,"data_stored":11766247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12473898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8265728,"data_stored":8142582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15040512,"data_stored":14902957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1753088,"data_stored":1656299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":19398656,"data_stored":19214635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10035200,"data_stored":9935327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3846144,"data_stored":3741037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":6024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":5138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":2784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:54:45.318 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.318 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.318 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.318 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.318 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.318 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.319 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.319 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.319 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.319 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.319 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.319 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.319 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.319 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.319 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.320 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.320 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.320 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.320 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.320 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.320 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.320 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.320 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.321 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.321 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.321 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.321 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.321 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.321 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.321 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.321 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.321 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.322 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.322 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.322 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.322 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.322 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.322 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.322 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.322 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.323 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.323 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.323 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.323 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.323 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.323 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.323 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.323 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.324 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.324 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.324 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.324 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.324 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.324 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.324 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.324 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.324 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.325 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:27:37.552386+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.325 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.325 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.325 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-14T11:26:03.211582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.325 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.326 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T11:09:51.957402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.327 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.327 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.327 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.328 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.328 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T11:09:53.977318+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=9, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:54:45.328 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T11:55:05.329 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:55:05.690 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:55:05.708 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-14T11:55:05.711 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":1625,"stamp":"2024-09-14T11:55:04.570446+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":41899528,"num_objects":636,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":636,"num_whiteouts":0,"num_read":296634,"num_read_kb":2620505,"num_write":146761,"num_write_kb":2444634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":200,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":750664,"num_omap_keys":1790,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13643,"ondisk_log_size":13643,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1412216,"kb_used_data":110584,"kb_used_omap":12,"kb_used_meta":1301491,"kb_avail":753562504,"statfs":{"total":773094113280,"available":771648004096,"internally_reserved":0,"allocated":113238016,"data_stored":99905760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1332727345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008139"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:40.907917+0000","last_change":"2024-09-14T11:54:40.907917+0000","last_active":"2024-09-14T11:54:40.907917+0000","last_peered":"2024-09-14T11:54:40.907917+0000","last_clean":"2024-09-14T11:54:40.907917+0000","last_became_active":"2024-09-14T11:38:50.585084+0000","last_became_peered":"2024-09-14T11:38:50.585084+0000","last_unstale":"2024-09-14T11:54:40.907917+0000","last_undegraded":"2024-09-14T11:54:40.907917+0000","last_fullsized":"2024-09-14T11:54:40.907917+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:40.907643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:40.907643+0000","last_clean_scrub_stamp":"2024-09-14T11:54:40.907643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:17:22.077501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:40.791499+0000","last_change":"2024-09-14T11:54:40.791499+0000","last_active":"2024-09-14T11:54:40.791499+0000","last_peered":"2024-09-14T11:54:40.791499+0000","last_clean":"2024-09-14T11:54:40.791499+0000","last_became_active":"2024-09-14T11:27:41.641034+0000","last_became_peered":"2024-09-14T11:27:41.641034+0000","last_unstale":"2024-09-14T11:54:40.791499+0000","last_undegraded":"2024-09-14T11:54:40.791499+0000","last_fullsized":"2024-09-14T11:54:40.791499+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:40.791318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:40.791318+0000","last_clean_scrub_stamp":"2024-09-14T11:54:40.791318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:54:19.134485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"261'2","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.449358+0000","last_change":"2024-09-14T11:54:42.449358+0000","last_active":"2024-09-14T11:54:42.449358+0000","last_peered":"2024-09-14T11:54:42.449358+0000","last_clean":"2024-09-14T11:54:42.449358+0000","last_became_active":"2024-09-14T11:27:38.617019+0000","last_became_peered":"2024-09-14T11:27:38.617019+0000","last_unstale":"2024-09-14T11:54:42.449358+0000","last_undegraded":"2024-09-14T11:54:42.449358+0000","last_fullsized":"2024-09-14T11:54:42.449358+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-14T11:54:42.449165+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-14T11:54:42.449165+0000","last_clean_scrub_stamp":"2024-09-14T11:54:42.449165+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:04.980679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"264'17","reported_seq":98,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:44.177150+0000","last_change":"2024-09-14T11:54:44.177150+0000","last_active":"2024-09-14T11:54:44.177150+0000","last_peered":"2024-09-14T11:54:44.177150+0000","last_clean":"2024-09-14T11:54:44.177150+0000","last_became_active":"2024-09-14T11:26:04.262003+0000","last_became_peered":"2024-09-14T11:26:04.262003+0000","last_unstale":"2024-09-14T11:54:44.177150+0000","last_undegraded":"2024-09-14T11:54:44.177150+0000","last_fullsized":"2024-09-14T11:54:44.177150+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'17","last_scrub_stamp":"2024-09-14T11:54:44.176964+0000","last_deep_scrub":"264'17","last_deep_scrub_stamp":"2024-09-14T11:54:44.176964+0000","last_clean_scrub_stamp":"2024-09-14T11:54:44.176964+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:33.915933+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":88,"num_write":45,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:44.702138+0000","last_change":"2024-09-14T11:54:44.702138+0000","last_active":"2024-09-14T11:54:44.702138+0000","last_peered":"2024-09-14T11:54:44.702138+0000","last_clean":"2024-09-14T11:54:44.702138+0000","last_became_active":"2024-09-14T11:38:50.592015+0000","last_became_peered":"2024-09-14T11:38:50.592015+0000","last_unstale":"2024-09-14T11:54:44.702138+0000","last_undegraded":"2024-09-14T11:54:44.702138+0000","last_fullsized":"2024-09-14T11:54:44.702138+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:44.701959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:44.701959+0000","last_clean_scrub_stamp":"2024-09-14T11:54:44.701959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:00.408391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"264'4","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:46.101615+0000","last_change":"2024-09-14T11:54:46.101615+0000","last_active":"2024-09-14T11:54:46.101615+0000","last_peered":"2024-09-14T11:54:46.101615+0000","last_clean":"2024-09-14T11:54:46.101615+0000","last_became_active":"2024-09-14T11:27:41.642359+0000","last_became_peered":"2024-09-14T11:27:41.642359+0000","last_unstale":"2024-09-14T11:54:46.101615+0000","last_undegraded":"2024-09-14T11:54:46.101615+0000","last_fullsized":"2024-09-14T11:54:46.101615+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T11:54:46.101333+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T11:54:46.101333+0000","last_clean_scrub_stamp":"2024-09-14T11:54:46.101333+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:04.408925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":4,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"264'5","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.117212+0000","last_change":"2024-09-14T11:54:47.117212+0000","last_active":"2024-09-14T11:54:47.117212+0000","last_peered":"2024-09-14T11:54:47.117212+0000","last_clean":"2024-09-14T11:54:47.117212+0000","last_became_active":"2024-09-14T11:27:38.597816+0000","last_became_peered":"2024-09-14T11:27:38.597816+0000","last_unstale":"2024-09-14T11:54:47.117212+0000","last_undegraded":"2024-09-14T11:54:47.117212+0000","last_fullsized":"2024-09-14T11:54:47.117212+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-14T11:54:47.117025+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-14T11:54:47.117025+0000","last_clean_scrub_stamp":"2024-09-14T11:54:47.117025+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:33:22.385308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1028,"num_write":10,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"264'31","reported_seq":136,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.128943+0000","last_change":"2024-09-14T11:54:42.128943+0000","last_active":"2024-09-14T11:54:42.128943+0000","last_peered":"2024-09-14T11:54:42.128943+0000","last_clean":"2024-09-14T11:54:42.128943+0000","last_became_active":"2024-09-14T11:26:04.280237+0000","last_became_peered":"2024-09-14T11:26:04.280237+0000","last_unstale":"2024-09-14T11:54:42.128943+0000","last_undegraded":"2024-09-14T11:54:42.128943+0000","last_fullsized":"2024-09-14T11:54:42.128943+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'31","last_scrub_stamp":"2024-09-14T11:54:42.128731+0000","last_deep_scrub":"264'31","last_deep_scrub_stamp":"2024-09-14T11:54:42.128731+0000","last_clean_scrub_stamp":"2024-09-14T11:54:42.128731+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:49.358269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":150,"num_write":82,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.752663+0000","last_change":"2024-09-14T11:54:38.752663+0000","last_active":"2024-09-14T11:54:38.752663+0000","last_peered":"2024-09-14T11:54:38.752663+0000","last_clean":"2024-09-14T11:54:38.752663+0000","last_became_active":"2024-09-14T11:38:50.574020+0000","last_became_peered":"2024-09-14T11:38:50.574020+0000","last_unstale":"2024-09-14T11:54:38.752663+0000","last_undegraded":"2024-09-14T11:54:38.752663+0000","last_fullsized":"2024-09-14T11:54:38.752663+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:38.752434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:38.752434+0000","last_clean_scrub_stamp":"2024-09-14T11:54:38.752434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:14.441214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:56.217967+0000","last_change":"2024-09-14T11:54:56.217967+0000","last_active":"2024-09-14T11:54:56.217967+0000","last_peered":"2024-09-14T11:54:56.217967+0000","last_clean":"2024-09-14T11:54:56.217967+0000","last_became_active":"2024-09-14T11:27:41.645143+0000","last_became_peered":"2024-09-14T11:27:41.645143+0000","last_unstale":"2024-09-14T11:54:56.217967+0000","last_undegraded":"2024-09-14T11:54:56.217967+0000","last_fullsized":"2024-09-14T11:54:56.217967+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:56.217787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:56.217787+0000","last_clean_scrub_stamp":"2024-09-14T11:54:56.217787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:11:14.282311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:41.469037+0000","last_change":"2024-09-14T11:54:41.469037+0000","last_active":"2024-09-14T11:54:41.469037+0000","last_peered":"2024-09-14T11:54:41.469037+0000","last_clean":"2024-09-14T11:54:41.469037+0000","last_became_active":"2024-09-14T11:27:38.619537+0000","last_became_peered":"2024-09-14T11:27:38.619537+0000","last_unstale":"2024-09-14T11:54:41.469037+0000","last_undegraded":"2024-09-14T11:54:41.469037+0000","last_fullsized":"2024-09-14T11:54:41.469037+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:41.468860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:41.468860+0000","last_clean_scrub_stamp":"2024-09-14T11:54:41.468860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:01.665027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"264'124","reported_seq":419,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:37.701474+0000","last_change":"2024-09-14T11:54:37.701474+0000","last_active":"2024-09-14T11:54:37.701474+0000","last_peered":"2024-09-14T11:54:37.701474+0000","last_clean":"2024-09-14T11:54:37.701474+0000","last_became_active":"2024-09-14T11:26:04.279472+0000","last_became_peered":"2024-09-14T11:26:04.279472+0000","last_unstale":"2024-09-14T11:54:37.701474+0000","last_undegraded":"2024-09-14T11:54:37.701474+0000","last_fullsized":"2024-09-14T11:54:37.701474+0000","mapping_epoch":253,"log_start":"261'100","ondisk_log_start":"261'100","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-09-14T11:54:37.701268+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-09-14T11:54:37.701268+0000","last_clean_scrub_stamp":"2024-09-14T11:54:37.701268+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:11.487369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1140,"num_read_kb":1229,"num_write":251,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:55:02.201817+0000","last_change":"2024-09-14T11:55:02.201817+0000","last_active":"2024-09-14T11:55:02.201817+0000","last_peered":"2024-09-14T11:55:02.201817+0000","last_clean":"2024-09-14T11:55:02.201817+0000","last_became_active":"2024-09-14T11:38:50.587700+0000","last_became_peered":"2024-09-14T11:38:50.587700+0000","last_unstale":"2024-09-14T11:55:02.201817+0000","last_undegraded":"2024-09-14T11:55:02.201817+0000","last_fullsized":"2024-09-14T11:55:02.201817+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:55:02.201648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:55:02.201648+0000","last_clean_scrub_stamp":"2024-09-14T11:55:02.201648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:35.299821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"264'8","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:54.160051+0000","last_change":"2024-09-14T11:54:54.160051+0000","last_active":"2024-09-14T11:54:54.160051+0000","last_peered":"2024-09-14T11:54:54.160051+0000","last_clean":"2024-09-14T11:54:54.160051+0000","last_became_active":"2024-09-14T11:27:41.644919+0000","last_became_peered":"2024-09-14T11:27:41.644919+0000","last_unstale":"2024-09-14T11:54:54.160051+0000","last_undegraded":"2024-09-14T11:54:54.160051+0000","last_fullsized":"2024-09-14T11:54:54.160051+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-14T11:54:54.159872+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-14T11:54:54.159872+0000","last_clean_scrub_stamp":"2024-09-14T11:54:54.159872+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:44.471517+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"264'2","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:36.784410+0000","last_change":"2024-09-14T11:54:36.784259+0000","last_active":"2024-09-14T11:54:36.784410+0000","last_peered":"2024-09-14T11:54:36.784410+0000","last_clean":"2024-09-14T11:54:36.784410+0000","last_became_active":"2024-09-14T11:27:38.609445+0000","last_became_peered":"2024-09-14T11:27:38.609445+0000","last_unstale":"2024-09-14T11:54:36.784410+0000","last_undegraded":"2024-09-14T11:54:36.784410+0000","last_fullsized":"2024-09-14T11:54:36.784410+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:36.784067+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:36.784067+0000","last_clean_scrub_stamp":"2024-09-14T11:54:36.784067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:03.982460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"264'61","reported_seq":221,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:35.620211+0000","last_change":"2024-09-14T11:54:35.620211+0000","last_active":"2024-09-14T11:54:35.620211+0000","last_peered":"2024-09-14T11:54:35.620211+0000","last_clean":"2024-09-14T11:54:35.620211+0000","last_became_active":"2024-09-14T11:26:04.282662+0000","last_became_peered":"2024-09-14T11:26:04.282662+0000","last_unstale":"2024-09-14T11:54:35.620211+0000","last_undegraded":"2024-09-14T11:54:35.620211+0000","last_fullsized":"2024-09-14T11:54:35.620211+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'61","last_scrub_stamp":"2024-09-14T11:54:35.620026+0000","last_deep_scrub":"264'61","last_deep_scrub_stamp":"2024-09-14T11:54:35.620026+0000","last_clean_scrub_stamp":"2024-09-14T11:54:35.620026+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:17.224367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":527,"num_read_kb":359,"num_write":147,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:53.722338+0000","last_change":"2024-09-14T11:54:53.722338+0000","last_active":"2024-09-14T11:54:53.722338+0000","last_peered":"2024-09-14T11:54:53.722338+0000","last_clean":"2024-09-14T11:54:53.722338+0000","last_became_active":"2024-09-14T11:38:50.582489+0000","last_became_peered":"2024-09-14T11:38:50.582489+0000","last_unstale":"2024-09-14T11:54:53.722338+0000","last_undegraded":"2024-09-14T11:54:53.722338+0000","last_fullsized":"2024-09-14T11:54:53.722338+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:53.722164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:53.722164+0000","last_clean_scrub_stamp":"2024-09-14T11:54:53.722164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:55.764397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:30.947800+0000","last_change":"2024-09-14T11:54:30.947800+0000","last_active":"2024-09-14T11:54:30.947800+0000","last_peered":"2024-09-14T11:54:30.947800+0000","last_clean":"2024-09-14T11:54:30.947800+0000","last_became_active":"2024-09-14T11:27:41.645724+0000","last_became_peered":"2024-09-14T11:27:41.645724+0000","last_unstale":"2024-09-14T11:54:30.947800+0000","last_undegraded":"2024-09-14T11:54:30.947800+0000","last_fullsized":"2024-09-14T11:54:30.947800+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:30.947615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:30.947615+0000","last_clean_scrub_stamp":"2024-09-14T11:54:30.947615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:51.069389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"264'3","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:46.156335+0000","last_change":"2024-09-14T11:54:46.156335+0000","last_active":"2024-09-14T11:54:46.156335+0000","last_peered":"2024-09-14T11:54:46.156335+0000","last_clean":"2024-09-14T11:54:46.156335+0000","last_became_active":"2024-09-14T11:27:38.605937+0000","last_became_peered":"2024-09-14T11:27:38.605937+0000","last_unstale":"2024-09-14T11:54:46.156335+0000","last_undegraded":"2024-09-14T11:54:46.156335+0000","last_fullsized":"2024-09-14T11:54:46.156335+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:54:46.156150+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:54:46.156150+0000","last_clean_scrub_stamp":"2024-09-14T11:54:46.156150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:32.542951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"264'12","reported_seq":80,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:36.664998+0000","last_change":"2024-09-14T11:54:36.664998+0000","last_active":"2024-09-14T11:54:36.664998+0000","last_peered":"2024-09-14T11:54:36.664998+0000","last_clean":"2024-09-14T11:54:36.664998+0000","last_became_active":"2024-09-14T11:26:04.278457+0000","last_became_peered":"2024-09-14T11:26:04.278457+0000","last_unstale":"2024-09-14T11:54:36.664998+0000","last_undegraded":"2024-09-14T11:54:36.664998+0000","last_fullsized":"2024-09-14T11:54:36.664998+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'12","last_scrub_stamp":"2024-09-14T11:54:36.664780+0000","last_deep_scrub":"264'12","last_deep_scrub_stamp":"2024-09-14T11:54:36.664780+0000","last_clean_scrub_stamp":"2024-09-14T11:54:36.664780+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:47.163712+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":56,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:49.275128+0000","last_change":"2024-09-14T11:54:49.275128+0000","last_active":"2024-09-14T11:54:49.275128+0000","last_peered":"2024-09-14T11:54:49.275128+0000","last_clean":"2024-09-14T11:54:49.275128+0000","last_became_active":"2024-09-14T11:38:50.576125+0000","last_became_peered":"2024-09-14T11:38:50.576125+0000","last_unstale":"2024-09-14T11:54:49.275128+0000","last_undegraded":"2024-09-14T11:54:49.275128+0000","last_fullsized":"2024-09-14T11:54:49.275128+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:49.274958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:49.274958+0000","last_clean_scrub_stamp":"2024-09-14T11:54:49.274958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:08.822999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"264'4","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.533800+0000","last_change":"2024-09-14T11:27:41.661526+0000","last_active":"2024-09-14T11:53:57.533800+0000","last_peered":"2024-09-14T11:53:57.533800+0000","last_clean":"2024-09-14T11:53:57.533800+0000","last_became_active":"2024-09-14T11:27:41.660702+0000","last_became_peered":"2024-09-14T11:27:41.660702+0000","last_unstale":"2024-09-14T11:53:57.533800+0000","last_undegraded":"2024-09-14T11:53:57.533800+0000","last_fullsized":"2024-09-14T11:53:57.533800+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"264'11","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.597373+0000","last_change":"2024-09-14T11:55:03.597373+0000","last_active":"2024-09-14T11:55:03.597373+0000","last_peered":"2024-09-14T11:55:03.597373+0000","last_clean":"2024-09-14T11:55:03.597373+0000","last_became_active":"2024-09-14T11:27:38.602908+0000","last_became_peered":"2024-09-14T11:27:38.602908+0000","last_unstale":"2024-09-14T11:55:03.597373+0000","last_undegraded":"2024-09-14T11:55:03.597373+0000","last_fullsized":"2024-09-14T11:55:03.597373+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'11","last_scrub_stamp":"2024-09-14T11:55:03.597190+0000","last_deep_scrub":"264'11","last_deep_scrub_stamp":"2024-09-14T11:55:03.597190+0000","last_clean_scrub_stamp":"2024-09-14T11:55:03.597190+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:12.474592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":15360,"num_write":16,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"264'30","reported_seq":134,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:33.236269+0000","last_change":"2024-09-14T11:54:33.236269+0000","last_active":"2024-09-14T11:54:33.236269+0000","last_peered":"2024-09-14T11:54:33.236269+0000","last_clean":"2024-09-14T11:54:33.236269+0000","last_became_active":"2024-09-14T11:26:04.258048+0000","last_became_peered":"2024-09-14T11:26:04.258048+0000","last_unstale":"2024-09-14T11:54:33.236269+0000","last_undegraded":"2024-09-14T11:54:33.236269+0000","last_fullsized":"2024-09-14T11:54:33.236269+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'30","last_scrub_stamp":"2024-09-14T11:54:33.236050+0000","last_deep_scrub":"264'30","last_deep_scrub_stamp":"2024-09-14T11:54:33.236050+0000","last_clean_scrub_stamp":"2024-09-14T11:54:33.236050+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:59.884986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":248,"num_read_kb":161,"num_write":75,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"264'2","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:45.135031+0000","last_change":"2024-09-14T11:54:45.135031+0000","last_active":"2024-09-14T11:54:45.135031+0000","last_peered":"2024-09-14T11:54:45.135031+0000","last_clean":"2024-09-14T11:54:45.135031+0000","last_became_active":"2024-09-14T11:38:50.590496+0000","last_became_peered":"2024-09-14T11:38:50.590496+0000","last_unstale":"2024-09-14T11:54:45.135031+0000","last_undegraded":"2024-09-14T11:54:45.135031+0000","last_fullsized":"2024-09-14T11:54:45.135031+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:45.134911+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:45.134911+0000","last_clean_scrub_stamp":"2024-09-14T11:54:45.134911+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:32:51.779048+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"264'11","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:41.128414+0000","last_change":"2024-09-14T11:54:41.128414+0000","last_active":"2024-09-14T11:54:41.128414+0000","last_peered":"2024-09-14T11:54:41.128414+0000","last_clean":"2024-09-14T11:54:41.128414+0000","last_became_active":"2024-09-14T11:27:41.635495+0000","last_became_peered":"2024-09-14T11:27:41.635495+0000","last_unstale":"2024-09-14T11:54:41.128414+0000","last_undegraded":"2024-09-14T11:54:41.128414+0000","last_fullsized":"2024-09-14T11:54:41.128414+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'11","last_scrub_stamp":"2024-09-14T11:54:41.128137+0000","last_deep_scrub":"264'11","last_deep_scrub_stamp":"2024-09-14T11:54:41.128137+0000","last_clean_scrub_stamp":"2024-09-14T11:54:41.128137+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:54:06.188677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":12817,"num_write":26,"num_write_kb":12817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"264'2","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:32.889714+0000","last_change":"2024-09-14T11:54:32.889714+0000","last_active":"2024-09-14T11:54:32.889714+0000","last_peered":"2024-09-14T11:54:32.889714+0000","last_clean":"2024-09-14T11:54:32.889714+0000","last_became_active":"2024-09-14T11:27:38.593507+0000","last_became_peered":"2024-09-14T11:27:38.593507+0000","last_unstale":"2024-09-14T11:54:32.889714+0000","last_undegraded":"2024-09-14T11:54:32.889714+0000","last_fullsized":"2024-09-14T11:54:32.889714+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:32.889523+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:32.889523+0000","last_clean_scrub_stamp":"2024-09-14T11:54:32.889523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:27.863989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"264'31","reported_seq":129,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.478651+0000","last_change":"2024-09-14T11:54:43.478651+0000","last_active":"2024-09-14T11:54:43.478651+0000","last_peered":"2024-09-14T11:54:43.478651+0000","last_clean":"2024-09-14T11:54:43.478651+0000","last_became_active":"2024-09-14T11:26:04.280799+0000","last_became_peered":"2024-09-14T11:26:04.280799+0000","last_unstale":"2024-09-14T11:54:43.478651+0000","last_undegraded":"2024-09-14T11:54:43.478651+0000","last_fullsized":"2024-09-14T11:54:43.478651+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'31","last_scrub_stamp":"2024-09-14T11:54:43.478466+0000","last_deep_scrub":"264'31","last_deep_scrub_stamp":"2024-09-14T11:54:43.478466+0000","last_clean_scrub_stamp":"2024-09-14T11:54:43.478466+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:00.283602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":229,"num_read_kb":151,"num_write":83,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:37.911419+0000","last_change":"2024-09-14T11:54:37.911419+0000","last_active":"2024-09-14T11:54:37.911419+0000","last_peered":"2024-09-14T11:54:37.911419+0000","last_clean":"2024-09-14T11:54:37.911419+0000","last_became_active":"2024-09-14T11:38:50.588260+0000","last_became_peered":"2024-09-14T11:38:50.588260+0000","last_unstale":"2024-09-14T11:54:37.911419+0000","last_undegraded":"2024-09-14T11:54:37.911419+0000","last_fullsized":"2024-09-14T11:54:37.911419+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:37.911196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:37.911196+0000","last_clean_scrub_stamp":"2024-09-14T11:54:37.911196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:48.971042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"261'2","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:49.591328+0000","last_change":"2024-09-14T11:54:49.591328+0000","last_active":"2024-09-14T11:54:49.591328+0000","last_peered":"2024-09-14T11:54:49.591328+0000","last_clean":"2024-09-14T11:54:49.591328+0000","last_became_active":"2024-09-14T11:27:41.649448+0000","last_became_peered":"2024-09-14T11:27:41.649448+0000","last_unstale":"2024-09-14T11:54:49.591328+0000","last_undegraded":"2024-09-14T11:54:49.591328+0000","last_fullsized":"2024-09-14T11:54:49.591328+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-14T11:54:49.591135+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-14T11:54:49.591135+0000","last_clean_scrub_stamp":"2024-09-14T11:54:49.591135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:42.983576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"264'3","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:40.705695+0000","last_change":"2024-09-14T11:54:40.705695+0000","last_active":"2024-09-14T11:54:40.705695+0000","last_peered":"2024-09-14T11:54:40.705695+0000","last_clean":"2024-09-14T11:54:40.705695+0000","last_became_active":"2024-09-14T11:27:38.598992+0000","last_became_peered":"2024-09-14T11:27:38.598992+0000","last_unstale":"2024-09-14T11:54:40.705695+0000","last_undegraded":"2024-09-14T11:54:40.705695+0000","last_fullsized":"2024-09-14T11:54:40.705695+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:54:40.705524+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:54:40.705524+0000","last_clean_scrub_stamp":"2024-09-14T11:54:40.705524+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:31.817310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"264'245","reported_seq":791,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:34.623337+0000","last_change":"2024-09-14T11:54:34.623337+0000","last_active":"2024-09-14T11:54:34.623337+0000","last_peered":"2024-09-14T11:54:34.623337+0000","last_clean":"2024-09-14T11:54:34.623337+0000","last_became_active":"2024-09-14T11:26:04.283058+0000","last_became_peered":"2024-09-14T11:26:04.283058+0000","last_unstale":"2024-09-14T11:54:34.623337+0000","last_undegraded":"2024-09-14T11:54:34.623337+0000","last_fullsized":"2024-09-14T11:54:34.623337+0000","mapping_epoch":253,"log_start":"261'200","ondisk_log_start":"261'200","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'245","last_scrub_stamp":"2024-09-14T11:54:34.623091+0000","last_deep_scrub":"264'245","last_deep_scrub_stamp":"2024-09-14T11:54:34.623091+0000","last_clean_scrub_stamp":"2024-09-14T11:54:34.623091+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:07.735348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2337,"num_read_kb":3061,"num_write":470,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:55:00.142199+0000","last_change":"2024-09-14T11:55:00.142199+0000","last_active":"2024-09-14T11:55:00.142199+0000","last_peered":"2024-09-14T11:55:00.142199+0000","last_clean":"2024-09-14T11:55:00.142199+0000","last_became_active":"2024-09-14T11:38:50.587593+0000","last_became_peered":"2024-09-14T11:38:50.587593+0000","last_unstale":"2024-09-14T11:55:00.142199+0000","last_undegraded":"2024-09-14T11:55:00.142199+0000","last_fullsized":"2024-09-14T11:55:00.142199+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:55:00.142019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:55:00.142019+0000","last_clean_scrub_stamp":"2024-09-14T11:55:00.142019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:32.438339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"261'2","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:48.640349+0000","last_change":"2024-09-14T11:54:48.640349+0000","last_active":"2024-09-14T11:54:48.640349+0000","last_peered":"2024-09-14T11:54:48.640349+0000","last_clean":"2024-09-14T11:54:48.640349+0000","last_became_active":"2024-09-14T11:27:41.649297+0000","last_became_peered":"2024-09-14T11:27:41.649297+0000","last_unstale":"2024-09-14T11:54:48.640349+0000","last_undegraded":"2024-09-14T11:54:48.640349+0000","last_fullsized":"2024-09-14T11:54:48.640349+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-14T11:54:48.640149+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-14T11:54:48.640149+0000","last_clean_scrub_stamp":"2024-09-14T11:54:48.640149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:27.287897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"261'3","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:55:00.612138+0000","last_change":"2024-09-14T11:55:00.612138+0000","last_active":"2024-09-14T11:55:00.612138+0000","last_peered":"2024-09-14T11:55:00.612138+0000","last_clean":"2024-09-14T11:55:00.612138+0000","last_became_active":"2024-09-14T11:27:38.607929+0000","last_became_peered":"2024-09-14T11:27:38.607929+0000","last_unstale":"2024-09-14T11:55:00.612138+0000","last_undegraded":"2024-09-14T11:55:00.612138+0000","last_fullsized":"2024-09-14T11:55:00.612138+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-14T11:55:00.611948+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-14T11:55:00.611948+0000","last_clean_scrub_stamp":"2024-09-14T11:55:00.611948+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:13.662888+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"264'16","reported_seq":93,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.178152+0000","last_change":"2024-09-14T11:54:43.178152+0000","last_active":"2024-09-14T11:54:43.178152+0000","last_peered":"2024-09-14T11:54:43.178152+0000","last_clean":"2024-09-14T11:54:43.178152+0000","last_became_active":"2024-09-14T11:26:04.261101+0000","last_became_peered":"2024-09-14T11:26:04.261101+0000","last_unstale":"2024-09-14T11:54:43.178152+0000","last_undegraded":"2024-09-14T11:54:43.178152+0000","last_fullsized":"2024-09-14T11:54:43.178152+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'16","last_scrub_stamp":"2024-09-14T11:54:43.177930+0000","last_deep_scrub":"264'16","last_deep_scrub_stamp":"2024-09-14T11:54:43.177930+0000","last_clean_scrub_stamp":"2024-09-14T11:54:43.177930+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:14.583863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":70,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"264'2","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.712333+0000","last_change":"2024-09-14T11:54:42.712333+0000","last_active":"2024-09-14T11:54:42.712333+0000","last_peered":"2024-09-14T11:54:42.712333+0000","last_clean":"2024-09-14T11:54:42.712333+0000","last_became_active":"2024-09-14T11:38:50.565980+0000","last_became_peered":"2024-09-14T11:38:50.565980+0000","last_unstale":"2024-09-14T11:54:42.712333+0000","last_undegraded":"2024-09-14T11:54:42.712333+0000","last_fullsized":"2024-09-14T11:54:42.712333+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:42.712137+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:42.712137+0000","last_clean_scrub_stamp":"2024-09-14T11:54:42.712137+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:56.324022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"264'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:52.154883+0000","last_change":"2024-09-14T11:54:52.154883+0000","last_active":"2024-09-14T11:54:52.154883+0000","last_peered":"2024-09-14T11:54:52.154883+0000","last_clean":"2024-09-14T11:54:52.154883+0000","last_became_active":"2024-09-14T11:27:41.660264+0000","last_became_peered":"2024-09-14T11:27:41.660264+0000","last_unstale":"2024-09-14T11:54:52.154883+0000","last_undegraded":"2024-09-14T11:54:52.154883+0000","last_fullsized":"2024-09-14T11:54:52.154883+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-14T11:54:52.154690+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-14T11:54:52.154690+0000","last_clean_scrub_stamp":"2024-09-14T11:54:52.154690+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:23:51.503968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"261'4","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.871763+0000","last_change":"2024-09-14T11:54:27.871763+0000","last_active":"2024-09-14T11:54:27.871763+0000","last_peered":"2024-09-14T11:54:27.871763+0000","last_clean":"2024-09-14T11:54:27.871763+0000","last_became_active":"2024-09-14T11:27:38.595788+0000","last_became_peered":"2024-09-14T11:27:38.595788+0000","last_unstale":"2024-09-14T11:54:27.871763+0000","last_undegraded":"2024-09-14T11:54:27.871763+0000","last_fullsized":"2024-09-14T11:54:27.871763+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-14T11:54:27.871566+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-14T11:54:27.871566+0000","last_clean_scrub_stamp":"2024-09-14T11:54:27.871566+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:37.867774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"264'35","reported_seq":143,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:41.127097+0000","last_change":"2024-09-14T11:54:41.127097+0000","last_active":"2024-09-14T11:54:41.127097+0000","last_peered":"2024-09-14T11:54:41.127097+0000","last_clean":"2024-09-14T11:54:41.127097+0000","last_became_active":"2024-09-14T11:26:04.279281+0000","last_became_peered":"2024-09-14T11:26:04.279281+0000","last_unstale":"2024-09-14T11:54:41.127097+0000","last_undegraded":"2024-09-14T11:54:41.127097+0000","last_fullsized":"2024-09-14T11:54:41.127097+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'35","last_scrub_stamp":"2024-09-14T11:54:41.126910+0000","last_deep_scrub":"264'35","last_deep_scrub_stamp":"2024-09-14T11:54:41.126910+0000","last_clean_scrub_stamp":"2024-09-14T11:54:41.126910+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:18.051800+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":194,"num_write":86,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.083376+0000","last_change":"2024-09-14T11:54:42.083376+0000","last_active":"2024-09-14T11:54:42.083376+0000","last_peered":"2024-09-14T11:54:42.083376+0000","last_clean":"2024-09-14T11:54:42.083376+0000","last_became_active":"2024-09-14T11:38:50.573912+0000","last_became_peered":"2024-09-14T11:38:50.573912+0000","last_unstale":"2024-09-14T11:54:42.083376+0000","last_undegraded":"2024-09-14T11:54:42.083376+0000","last_fullsized":"2024-09-14T11:54:42.083376+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:42.083183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:42.083183+0000","last_clean_scrub_stamp":"2024-09-14T11:54:42.083183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:38.164805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"264'10","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:51.634330+0000","last_change":"2024-09-14T11:54:51.634330+0000","last_active":"2024-09-14T11:54:51.634330+0000","last_peered":"2024-09-14T11:54:51.634330+0000","last_clean":"2024-09-14T11:54:51.634330+0000","last_became_active":"2024-09-14T11:27:41.632456+0000","last_became_peered":"2024-09-14T11:27:41.632456+0000","last_unstale":"2024-09-14T11:54:51.634330+0000","last_undegraded":"2024-09-14T11:54:51.634330+0000","last_fullsized":"2024-09-14T11:54:51.634330+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'10","last_scrub_stamp":"2024-09-14T11:54:51.634110+0000","last_deep_scrub":"264'10","last_deep_scrub_stamp":"2024-09-14T11:54:51.634110+0000","last_clean_scrub_stamp":"2024-09-14T11:54:51.634110+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:46.182170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15362,"num_write":10,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"261'2","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:40.513991+0000","last_change":"2024-09-14T11:54:40.513991+0000","last_active":"2024-09-14T11:54:40.513991+0000","last_peered":"2024-09-14T11:54:40.513991+0000","last_clean":"2024-09-14T11:54:40.513991+0000","last_became_active":"2024-09-14T11:27:38.616935+0000","last_became_peered":"2024-09-14T11:27:38.616935+0000","last_unstale":"2024-09-14T11:54:40.513991+0000","last_undegraded":"2024-09-14T11:54:40.513991+0000","last_fullsized":"2024-09-14T11:54:40.513991+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-14T11:54:40.513806+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-14T11:54:40.513806+0000","last_clean_scrub_stamp":"2024-09-14T11:54:40.513806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:00.725064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"264'38","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:35.540214+0000","last_change":"2024-09-14T11:54:35.540214+0000","last_active":"2024-09-14T11:54:35.540214+0000","last_peered":"2024-09-14T11:54:35.540214+0000","last_clean":"2024-09-14T11:54:35.540214+0000","last_became_active":"2024-09-14T11:26:04.268202+0000","last_became_peered":"2024-09-14T11:26:04.268202+0000","last_unstale":"2024-09-14T11:54:35.540214+0000","last_undegraded":"2024-09-14T11:54:35.540214+0000","last_fullsized":"2024-09-14T11:54:35.540214+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'38","last_scrub_stamp":"2024-09-14T11:54:35.539999+0000","last_deep_scrub":"264'38","last_deep_scrub_stamp":"2024-09-14T11:54:35.539999+0000","last_clean_scrub_stamp":"2024-09-14T11:54:35.539999+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:43.448218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":294,"num_read_kb":198,"num_write":96,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:36.908602+0000","last_change":"2024-09-14T11:54:36.908602+0000","last_active":"2024-09-14T11:54:36.908602+0000","last_peered":"2024-09-14T11:54:36.908602+0000","last_clean":"2024-09-14T11:54:36.908602+0000","last_became_active":"2024-09-14T11:38:50.585324+0000","last_became_peered":"2024-09-14T11:38:50.585324+0000","last_unstale":"2024-09-14T11:54:36.908602+0000","last_undegraded":"2024-09-14T11:54:36.908602+0000","last_fullsized":"2024-09-14T11:54:36.908602+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:36.908378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:36.908378+0000","last_clean_scrub_stamp":"2024-09-14T11:54:36.908378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:19.151586+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"264'6","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:31.912687+0000","last_change":"2024-09-14T11:54:31.912687+0000","last_active":"2024-09-14T11:54:31.912687+0000","last_peered":"2024-09-14T11:54:31.912687+0000","last_clean":"2024-09-14T11:54:31.912687+0000","last_became_active":"2024-09-14T11:27:41.652940+0000","last_became_peered":"2024-09-14T11:27:41.652940+0000","last_unstale":"2024-09-14T11:54:31.912687+0000","last_undegraded":"2024-09-14T11:54:31.912687+0000","last_fullsized":"2024-09-14T11:54:31.912687+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-14T11:54:31.912497+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-14T11:54:31.912497+0000","last_clean_scrub_stamp":"2024-09-14T11:54:31.912497+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:48.642280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10244,"num_write":6,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"261'5","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:45.187726+0000","last_change":"2024-09-14T11:54:45.187726+0000","last_active":"2024-09-14T11:54:45.187726+0000","last_peered":"2024-09-14T11:54:45.187726+0000","last_clean":"2024-09-14T11:54:45.187726+0000","last_became_active":"2024-09-14T11:27:38.603013+0000","last_became_peered":"2024-09-14T11:27:38.603013+0000","last_unstale":"2024-09-14T11:54:45.187726+0000","last_undegraded":"2024-09-14T11:54:45.187726+0000","last_fullsized":"2024-09-14T11:54:45.187726+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-14T11:54:45.187536+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-14T11:54:45.187536+0000","last_clean_scrub_stamp":"2024-09-14T11:54:45.187536+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:20.306009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:55.593249+0000","last_change":"2024-09-14T11:54:55.593249+0000","last_active":"2024-09-14T11:54:55.593249+0000","last_peered":"2024-09-14T11:54:55.593249+0000","last_clean":"2024-09-14T11:54:55.593249+0000","last_became_active":"2024-09-14T11:26:04.263245+0000","last_became_peered":"2024-09-14T11:26:04.263245+0000","last_unstale":"2024-09-14T11:54:55.593249+0000","last_undegraded":"2024-09-14T11:54:55.593249+0000","last_fullsized":"2024-09-14T11:54:55.593249+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:55.593066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:55.593066+0000","last_clean_scrub_stamp":"2024-09-14T11:54:55.593066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:59.958516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:55:01.185248+0000","last_change":"2024-09-14T11:55:01.185248+0000","last_active":"2024-09-14T11:55:01.185248+0000","last_peered":"2024-09-14T11:55:01.185248+0000","last_clean":"2024-09-14T11:55:01.185248+0000","last_became_active":"2024-09-14T11:38:50.591033+0000","last_became_peered":"2024-09-14T11:38:50.591033+0000","last_unstale":"2024-09-14T11:55:01.185248+0000","last_undegraded":"2024-09-14T11:55:01.185248+0000","last_fullsized":"2024-09-14T11:55:01.185248+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:55:01.185073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:55:01.185073+0000","last_clean_scrub_stamp":"2024-09-14T11:55:01.185073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:29.268850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"264'2","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:53.178290+0000","last_change":"2024-09-14T11:54:53.178290+0000","last_active":"2024-09-14T11:54:53.178290+0000","last_peered":"2024-09-14T11:54:53.178290+0000","last_clean":"2024-09-14T11:54:53.178290+0000","last_became_active":"2024-09-14T11:27:41.634584+0000","last_became_peered":"2024-09-14T11:27:41.634584+0000","last_unstale":"2024-09-14T11:54:53.178290+0000","last_undegraded":"2024-09-14T11:54:53.178290+0000","last_fullsized":"2024-09-14T11:54:53.178290+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:53.178069+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:53.178069+0000","last_clean_scrub_stamp":"2024-09-14T11:54:53.178069+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:11.311473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:32.685095+0000","last_change":"2024-09-14T11:54:32.685095+0000","last_active":"2024-09-14T11:54:32.685095+0000","last_peered":"2024-09-14T11:54:32.685095+0000","last_clean":"2024-09-14T11:54:32.685095+0000","last_became_active":"2024-09-14T11:27:38.611912+0000","last_became_peered":"2024-09-14T11:27:38.611912+0000","last_unstale":"2024-09-14T11:54:32.685095+0000","last_undegraded":"2024-09-14T11:54:32.685095+0000","last_fullsized":"2024-09-14T11:54:32.685095+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:32.684888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:32.684888+0000","last_clean_scrub_stamp":"2024-09-14T11:54:32.684888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:49.951022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"264'32","reported_seq":143,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:54.628885+0000","last_change":"2024-09-14T11:54:54.628885+0000","last_active":"2024-09-14T11:54:54.628885+0000","last_peered":"2024-09-14T11:54:54.628885+0000","last_clean":"2024-09-14T11:54:54.628885+0000","last_became_active":"2024-09-14T11:26:04.264179+0000","last_became_peered":"2024-09-14T11:26:04.264179+0000","last_unstale":"2024-09-14T11:54:54.628885+0000","last_undegraded":"2024-09-14T11:54:54.628885+0000","last_fullsized":"2024-09-14T11:54:54.628885+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'32","last_scrub_stamp":"2024-09-14T11:54:54.628692+0000","last_deep_scrub":"264'32","last_deep_scrub_stamp":"2024-09-14T11:54:54.628692+0000","last_clean_scrub_stamp":"2024-09-14T11:54:54.628692+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:59.611270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":260,"num_read_kb":165,"num_write":79,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:45.715455+0000","last_change":"2024-09-14T11:54:45.715455+0000","last_active":"2024-09-14T11:54:45.715455+0000","last_peered":"2024-09-14T11:54:45.715455+0000","last_clean":"2024-09-14T11:54:45.715455+0000","last_became_active":"2024-09-14T11:38:50.552891+0000","last_became_peered":"2024-09-14T11:38:50.552891+0000","last_unstale":"2024-09-14T11:54:45.715455+0000","last_undegraded":"2024-09-14T11:54:45.715455+0000","last_fullsized":"2024-09-14T11:54:45.715455+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:45.715238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:45.715238+0000","last_clean_scrub_stamp":"2024-09-14T11:54:45.715238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:42.014340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"261'4","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:51.107413+0000","last_change":"2024-09-14T11:54:51.107413+0000","last_active":"2024-09-14T11:54:51.107413+0000","last_peered":"2024-09-14T11:54:51.107413+0000","last_clean":"2024-09-14T11:54:51.107413+0000","last_became_active":"2024-09-14T11:27:41.634824+0000","last_became_peered":"2024-09-14T11:27:41.634824+0000","last_unstale":"2024-09-14T11:54:51.107413+0000","last_undegraded":"2024-09-14T11:54:51.107413+0000","last_fullsized":"2024-09-14T11:54:51.107413+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-14T11:54:51.107217+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-14T11:54:51.107217+0000","last_clean_scrub_stamp":"2024-09-14T11:54:51.107217+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:01.690818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"264'2","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:44.201032+0000","last_change":"2024-09-14T11:54:44.201032+0000","last_active":"2024-09-14T11:54:44.201032+0000","last_peered":"2024-09-14T11:54:44.201032+0000","last_clean":"2024-09-14T11:54:44.201032+0000","last_became_active":"2024-09-14T11:27:38.608412+0000","last_became_peered":"2024-09-14T11:27:38.608412+0000","last_unstale":"2024-09-14T11:54:44.201032+0000","last_undegraded":"2024-09-14T11:54:44.201032+0000","last_fullsized":"2024-09-14T11:54:44.201032+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:44.200860+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:44.200860+0000","last_clean_scrub_stamp":"2024-09-14T11:54:44.200860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:24.813906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"264'44","reported_seq":166,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:34.543253+0000","last_change":"2024-09-14T11:54:34.543253+0000","last_active":"2024-09-14T11:54:34.543253+0000","last_peered":"2024-09-14T11:54:34.543253+0000","last_clean":"2024-09-14T11:54:34.543253+0000","last_became_active":"2024-09-14T11:26:04.272026+0000","last_became_peered":"2024-09-14T11:26:04.272026+0000","last_unstale":"2024-09-14T11:54:34.543253+0000","last_undegraded":"2024-09-14T11:54:34.543253+0000","last_fullsized":"2024-09-14T11:54:34.543253+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'44","last_scrub_stamp":"2024-09-14T11:54:34.543061+0000","last_deep_scrub":"264'44","last_deep_scrub_stamp":"2024-09-14T11:54:34.543061+0000","last_clean_scrub_stamp":"2024-09-14T11:54:34.543061+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:37.348884+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":232,"num_write":112,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"264'2","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:48.239526+0000","last_change":"2024-09-14T11:54:48.239526+0000","last_active":"2024-09-14T11:54:48.239526+0000","last_peered":"2024-09-14T11:54:48.239526+0000","last_clean":"2024-09-14T11:54:48.239526+0000","last_became_active":"2024-09-14T11:38:50.575796+0000","last_became_peered":"2024-09-14T11:38:50.575796+0000","last_unstale":"2024-09-14T11:54:48.239526+0000","last_undegraded":"2024-09-14T11:54:48.239526+0000","last_fullsized":"2024-09-14T11:54:48.239526+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:48.239340+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:48.239340+0000","last_clean_scrub_stamp":"2024-09-14T11:54:48.239340+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:01.676473+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"264'5","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.618579+0000","last_change":"2024-09-14T11:54:47.618579+0000","last_active":"2024-09-14T11:54:47.618579+0000","last_peered":"2024-09-14T11:54:47.618579+0000","last_clean":"2024-09-14T11:54:47.618579+0000","last_became_active":"2024-09-14T11:27:41.634402+0000","last_became_peered":"2024-09-14T11:27:41.634402+0000","last_unstale":"2024-09-14T11:54:47.618579+0000","last_undegraded":"2024-09-14T11:54:47.618579+0000","last_fullsized":"2024-09-14T11:54:47.618579+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-14T11:54:47.618391+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-14T11:54:47.618391+0000","last_clean_scrub_stamp":"2024-09-14T11:54:47.618391+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:05.461604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:35.735915+0000","last_change":"2024-09-14T11:54:35.735915+0000","last_active":"2024-09-14T11:54:35.735915+0000","last_peered":"2024-09-14T11:54:35.735915+0000","last_clean":"2024-09-14T11:54:35.735915+0000","last_became_active":"2024-09-14T11:27:38.609363+0000","last_became_peered":"2024-09-14T11:27:38.609363+0000","last_unstale":"2024-09-14T11:54:35.735915+0000","last_undegraded":"2024-09-14T11:54:35.735915+0000","last_fullsized":"2024-09-14T11:54:35.735915+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:35.735614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:35.735614+0000","last_clean_scrub_stamp":"2024-09-14T11:54:35.735614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:35:41.231749+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"264'17","reported_seq":96,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:35.196987+0000","last_change":"2024-09-14T11:54:35.196987+0000","last_active":"2024-09-14T11:54:35.196987+0000","last_peered":"2024-09-14T11:54:35.196987+0000","last_clean":"2024-09-14T11:54:35.196987+0000","last_became_active":"2024-09-14T11:26:04.261498+0000","last_became_peered":"2024-09-14T11:26:04.261498+0000","last_unstale":"2024-09-14T11:54:35.196987+0000","last_undegraded":"2024-09-14T11:54:35.196987+0000","last_fullsized":"2024-09-14T11:54:35.196987+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'17","last_scrub_stamp":"2024-09-14T11:54:35.196770+0000","last_deep_scrub":"264'17","last_deep_scrub_stamp":"2024-09-14T11:54:35.196770+0000","last_clean_scrub_stamp":"2024-09-14T11:54:35.196770+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:35.021708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":93,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"264'2","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.747849+0000","last_change":"2024-09-14T11:54:43.747849+0000","last_active":"2024-09-14T11:54:43.747849+0000","last_peered":"2024-09-14T11:54:43.747849+0000","last_clean":"2024-09-14T11:54:43.747849+0000","last_became_active":"2024-09-14T11:38:50.576165+0000","last_became_peered":"2024-09-14T11:38:50.576165+0000","last_unstale":"2024-09-14T11:54:43.747849+0000","last_undegraded":"2024-09-14T11:54:43.747849+0000","last_fullsized":"2024-09-14T11:54:43.747849+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:43.747647+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:43.747647+0000","last_clean_scrub_stamp":"2024-09-14T11:54:43.747647+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:54.555162+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"264'2","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.356430+0000","last_change":"2024-09-14T11:27:41.650299+0000","last_active":"2024-09-14T11:53:24.356430+0000","last_peered":"2024-09-14T11:53:24.356430+0000","last_clean":"2024-09-14T11:53:24.356430+0000","last_became_active":"2024-09-14T11:27:41.649598+0000","last_became_peered":"2024-09-14T11:27:41.649598+0000","last_unstale":"2024-09-14T11:53:24.356430+0000","last_undegraded":"2024-09-14T11:53:24.356430+0000","last_fullsized":"2024-09-14T11:53:24.356430+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:10.114521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:39.755998+0000","last_change":"2024-09-14T11:54:39.755998+0000","last_active":"2024-09-14T11:54:39.755998+0000","last_peered":"2024-09-14T11:54:39.755998+0000","last_clean":"2024-09-14T11:54:39.755998+0000","last_became_active":"2024-09-14T11:27:38.598429+0000","last_became_peered":"2024-09-14T11:27:38.598429+0000","last_unstale":"2024-09-14T11:54:39.755998+0000","last_undegraded":"2024-09-14T11:54:39.755998+0000","last_fullsized":"2024-09-14T11:54:39.755998+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:39.755724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:39.755724+0000","last_clean_scrub_stamp":"2024-09-14T11:54:39.755724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:41:24.015461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"264'26","reported_seq":123,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:33.532947+0000","last_change":"2024-09-14T11:54:33.532947+0000","last_active":"2024-09-14T11:54:33.532947+0000","last_peered":"2024-09-14T11:54:33.532947+0000","last_clean":"2024-09-14T11:54:33.532947+0000","last_became_active":"2024-09-14T11:26:04.272216+0000","last_became_peered":"2024-09-14T11:26:04.272216+0000","last_unstale":"2024-09-14T11:54:33.532947+0000","last_undegraded":"2024-09-14T11:54:33.532947+0000","last_fullsized":"2024-09-14T11:54:33.532947+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'26","last_scrub_stamp":"2024-09-14T11:54:33.532773+0000","last_deep_scrub":"264'26","last_deep_scrub_stamp":"2024-09-14T11:54:33.532773+0000","last_clean_scrub_stamp":"2024-09-14T11:54:33.532773+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:59.031617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":141,"num_write":65,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.143112+0000","last_change":"2024-09-14T11:54:58.143112+0000","last_active":"2024-09-14T11:54:58.143112+0000","last_peered":"2024-09-14T11:54:58.143112+0000","last_clean":"2024-09-14T11:54:58.143112+0000","last_became_active":"2024-09-14T11:38:50.589121+0000","last_became_peered":"2024-09-14T11:38:50.589121+0000","last_unstale":"2024-09-14T11:54:58.143112+0000","last_undegraded":"2024-09-14T11:54:58.143112+0000","last_fullsized":"2024-09-14T11:54:58.143112+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:58.142933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:58.142933+0000","last_clean_scrub_stamp":"2024-09-14T11:54:58.142933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:23.535745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"261'4","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:45.551965+0000","last_change":"2024-09-14T11:54:45.551965+0000","last_active":"2024-09-14T11:54:45.551965+0000","last_peered":"2024-09-14T11:54:45.551965+0000","last_clean":"2024-09-14T11:54:45.551965+0000","last_became_active":"2024-09-14T11:27:41.630970+0000","last_became_peered":"2024-09-14T11:27:41.630970+0000","last_unstale":"2024-09-14T11:54:45.551965+0000","last_undegraded":"2024-09-14T11:54:45.551965+0000","last_fullsized":"2024-09-14T11:54:45.551965+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-14T11:54:45.551771+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-14T11:54:45.551771+0000","last_clean_scrub_stamp":"2024-09-14T11:54:45.551771+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:45.891308+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:39.125357+0000","last_change":"2024-09-14T11:54:39.125193+0000","last_active":"2024-09-14T11:54:39.125357+0000","last_peered":"2024-09-14T11:54:39.125357+0000","last_clean":"2024-09-14T11:54:39.125357+0000","last_became_active":"2024-09-14T11:27:38.580979+0000","last_became_peered":"2024-09-14T11:27:38.580979+0000","last_unstale":"2024-09-14T11:54:39.125357+0000","last_undegraded":"2024-09-14T11:54:39.125357+0000","last_fullsized":"2024-09-14T11:54:39.125357+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:39.125010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:39.125010+0000","last_clean_scrub_stamp":"2024-09-14T11:54:39.125010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:19.882964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"261'22","reported_seq":114,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:30.439047+0000","last_change":"2024-09-14T11:54:30.439047+0000","last_active":"2024-09-14T11:54:30.439047+0000","last_peered":"2024-09-14T11:54:30.439047+0000","last_clean":"2024-09-14T11:54:30.439047+0000","last_became_active":"2024-09-14T11:26:04.275034+0000","last_became_peered":"2024-09-14T11:26:04.275034+0000","last_unstale":"2024-09-14T11:54:30.439047+0000","last_undegraded":"2024-09-14T11:54:30.439047+0000","last_fullsized":"2024-09-14T11:54:30.439047+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'22","last_scrub_stamp":"2024-09-14T11:54:30.438866+0000","last_deep_scrub":"261'22","last_deep_scrub_stamp":"2024-09-14T11:54:30.438866+0000","last_clean_scrub_stamp":"2024-09-14T11:54:30.438866+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:15.538153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":117,"num_write":55,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:41.821827+0000","last_change":"2024-09-14T11:54:41.821827+0000","last_active":"2024-09-14T11:54:41.821827+0000","last_peered":"2024-09-14T11:54:41.821827+0000","last_clean":"2024-09-14T11:54:41.821827+0000","last_became_active":"2024-09-14T11:38:50.596395+0000","last_became_peered":"2024-09-14T11:38:50.596395+0000","last_unstale":"2024-09-14T11:54:41.821827+0000","last_undegraded":"2024-09-14T11:54:41.821827+0000","last_fullsized":"2024-09-14T11:54:41.821827+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:41.821655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:41.821655+0000","last_clean_scrub_stamp":"2024-09-14T11:54:41.821655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:51.729531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"264'4","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:44.502005+0000","last_change":"2024-09-14T11:54:44.502005+0000","last_active":"2024-09-14T11:54:44.502005+0000","last_peered":"2024-09-14T11:54:44.502005+0000","last_clean":"2024-09-14T11:54:44.502005+0000","last_became_active":"2024-09-14T11:27:41.656659+0000","last_became_peered":"2024-09-14T11:27:41.656659+0000","last_unstale":"2024-09-14T11:54:44.502005+0000","last_undegraded":"2024-09-14T11:54:44.502005+0000","last_fullsized":"2024-09-14T11:54:44.502005+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T11:54:44.501816+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T11:54:44.501816+0000","last_clean_scrub_stamp":"2024-09-14T11:54:44.501816+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:14.671511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":100,"num_write":4,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:39.662124+0000","last_change":"2024-09-14T11:54:39.662124+0000","last_active":"2024-09-14T11:54:39.662124+0000","last_peered":"2024-09-14T11:54:39.662124+0000","last_clean":"2024-09-14T11:54:39.662124+0000","last_became_active":"2024-09-14T11:27:38.604732+0000","last_became_peered":"2024-09-14T11:27:38.604732+0000","last_unstale":"2024-09-14T11:54:39.662124+0000","last_undegraded":"2024-09-14T11:54:39.662124+0000","last_fullsized":"2024-09-14T11:54:39.662124+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:39.661953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:39.661953+0000","last_clean_scrub_stamp":"2024-09-14T11:54:39.661953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:27.640744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"264'35","reported_seq":142,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:53.591220+0000","last_change":"2024-09-14T11:54:53.591220+0000","last_active":"2024-09-14T11:54:53.591220+0000","last_peered":"2024-09-14T11:54:53.591220+0000","last_clean":"2024-09-14T11:54:53.591220+0000","last_became_active":"2024-09-14T11:26:04.279402+0000","last_became_peered":"2024-09-14T11:26:04.279402+0000","last_unstale":"2024-09-14T11:54:53.591220+0000","last_undegraded":"2024-09-14T11:54:53.591220+0000","last_fullsized":"2024-09-14T11:54:53.591220+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'35","last_scrub_stamp":"2024-09-14T11:54:53.591037+0000","last_deep_scrub":"264'35","last_deep_scrub_stamp":"2024-09-14T11:54:53.591037+0000","last_clean_scrub_stamp":"2024-09-14T11:54:53.591037+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:42.763902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":174,"num_write":94,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:54.336661+0000","last_change":"2024-09-14T11:38:50.573603+0000","last_active":"2024-09-14T11:51:54.336661+0000","last_peered":"2024-09-14T11:51:54.336661+0000","last_clean":"2024-09-14T11:51:54.336661+0000","last_became_active":"2024-09-14T11:38:50.573062+0000","last_became_peered":"2024-09-14T11:38:50.573062+0000","last_unstale":"2024-09-14T11:51:54.336661+0000","last_undegraded":"2024-09-14T11:51:54.336661+0000","last_fullsized":"2024-09-14T11:51:54.336661+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"264'7","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:46.574905+0000","last_change":"2024-09-14T11:54:46.574905+0000","last_active":"2024-09-14T11:54:46.574905+0000","last_peered":"2024-09-14T11:54:46.574905+0000","last_clean":"2024-09-14T11:54:46.574905+0000","last_became_active":"2024-09-14T11:27:41.639051+0000","last_became_peered":"2024-09-14T11:27:41.639051+0000","last_unstale":"2024-09-14T11:54:46.574905+0000","last_undegraded":"2024-09-14T11:54:46.574905+0000","last_fullsized":"2024-09-14T11:54:46.574905+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-14T11:54:46.574719+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-14T11:54:46.574719+0000","last_clean_scrub_stamp":"2024-09-14T11:54:46.574719+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:12.073513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"264'4","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.453774+0000","last_change":"2024-09-14T11:54:38.453774+0000","last_active":"2024-09-14T11:54:38.453774+0000","last_peered":"2024-09-14T11:54:38.453774+0000","last_clean":"2024-09-14T11:54:38.453774+0000","last_became_active":"2024-09-14T11:27:38.619608+0000","last_became_peered":"2024-09-14T11:27:38.619608+0000","last_unstale":"2024-09-14T11:54:38.453774+0000","last_undegraded":"2024-09-14T11:54:38.453774+0000","last_fullsized":"2024-09-14T11:54:38.453774+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T11:54:38.453594+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T11:54:38.453594+0000","last_clean_scrub_stamp":"2024-09-14T11:54:38.453594+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:36.579941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"264'28","reported_seq":124,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:33.716691+0000","last_change":"2024-09-14T11:54:33.716691+0000","last_active":"2024-09-14T11:54:33.716691+0000","last_peered":"2024-09-14T11:54:33.716691+0000","last_clean":"2024-09-14T11:54:33.716691+0000","last_became_active":"2024-09-14T11:26:04.272960+0000","last_became_peered":"2024-09-14T11:26:04.272960+0000","last_unstale":"2024-09-14T11:54:33.716691+0000","last_undegraded":"2024-09-14T11:54:33.716691+0000","last_fullsized":"2024-09-14T11:54:33.716691+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'28","last_scrub_stamp":"2024-09-14T11:54:33.716463+0000","last_deep_scrub":"264'28","last_deep_scrub_stamp":"2024-09-14T11:54:33.716463+0000","last_clean_scrub_stamp":"2024-09-14T11:54:33.716463+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:37.462810+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":136,"num_write":79,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:37.781649+0000","last_change":"2024-09-14T11:54:37.781649+0000","last_active":"2024-09-14T11:54:37.781649+0000","last_peered":"2024-09-14T11:54:37.781649+0000","last_clean":"2024-09-14T11:54:37.781649+0000","last_became_active":"2024-09-14T11:38:50.569743+0000","last_became_peered":"2024-09-14T11:38:50.569743+0000","last_unstale":"2024-09-14T11:54:37.781649+0000","last_undegraded":"2024-09-14T11:54:37.781649+0000","last_fullsized":"2024-09-14T11:54:37.781649+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:37.781472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:37.781472+0000","last_clean_scrub_stamp":"2024-09-14T11:54:37.781472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:12.956391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"264'5","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:50.087718+0000","last_change":"2024-09-14T11:54:50.087718+0000","last_active":"2024-09-14T11:54:50.087718+0000","last_peered":"2024-09-14T11:54:50.087718+0000","last_clean":"2024-09-14T11:54:50.087718+0000","last_became_active":"2024-09-14T11:27:41.653929+0000","last_became_peered":"2024-09-14T11:27:41.653929+0000","last_unstale":"2024-09-14T11:54:50.087718+0000","last_undegraded":"2024-09-14T11:54:50.087718+0000","last_fullsized":"2024-09-14T11:54:50.087718+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-14T11:54:50.087526+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-14T11:54:50.087526+0000","last_clean_scrub_stamp":"2024-09-14T11:54:50.087526+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:59.453521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":118,"num_write":10,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"264'9","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:39.495730+0000","last_change":"2024-09-14T11:54:39.495730+0000","last_active":"2024-09-14T11:54:39.495730+0000","last_peered":"2024-09-14T11:54:39.495730+0000","last_clean":"2024-09-14T11:54:39.495730+0000","last_became_active":"2024-09-14T11:27:38.619441+0000","last_became_peered":"2024-09-14T11:27:38.619441+0000","last_unstale":"2024-09-14T11:54:39.495730+0000","last_undegraded":"2024-09-14T11:54:39.495730+0000","last_fullsized":"2024-09-14T11:54:39.495730+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-09-14T11:54:39.495455+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-09-14T11:54:39.495455+0000","last_clean_scrub_stamp":"2024-09-14T11:54:39.495455+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:33.156798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":21504,"num_write":14,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"264'28","reported_seq":123,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:33.632841+0000","last_change":"2024-09-14T11:54:33.632841+0000","last_active":"2024-09-14T11:54:33.632841+0000","last_peered":"2024-09-14T11:54:33.632841+0000","last_clean":"2024-09-14T11:54:33.632841+0000","last_became_active":"2024-09-14T11:26:04.271747+0000","last_became_peered":"2024-09-14T11:26:04.271747+0000","last_unstale":"2024-09-14T11:54:33.632841+0000","last_undegraded":"2024-09-14T11:54:33.632841+0000","last_fullsized":"2024-09-14T11:54:33.632841+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'28","last_scrub_stamp":"2024-09-14T11:54:33.632646+0000","last_deep_scrub":"264'28","last_deep_scrub_stamp":"2024-09-14T11:54:33.632646+0000","last_clean_scrub_stamp":"2024-09-14T11:54:33.632646+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:32.196817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":132,"num_write":73,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:59.097523+0000","last_change":"2024-09-14T11:54:59.097523+0000","last_active":"2024-09-14T11:54:59.097523+0000","last_peered":"2024-09-14T11:54:59.097523+0000","last_clean":"2024-09-14T11:54:59.097523+0000","last_became_active":"2024-09-14T11:38:50.589444+0000","last_became_peered":"2024-09-14T11:38:50.589444+0000","last_unstale":"2024-09-14T11:54:59.097523+0000","last_undegraded":"2024-09-14T11:54:59.097523+0000","last_fullsized":"2024-09-14T11:54:59.097523+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:59.097339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:59.097339+0000","last_clean_scrub_stamp":"2024-09-14T11:54:59.097339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:50.482678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"261'2","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:34.329581+0000","last_change":"2024-09-14T11:27:41.641002+0000","last_active":"2024-09-14T11:51:34.329581+0000","last_peered":"2024-09-14T11:51:34.329581+0000","last_clean":"2024-09-14T11:51:34.329581+0000","last_became_active":"2024-09-14T11:27:41.640105+0000","last_became_peered":"2024-09-14T11:27:41.640105+0000","last_unstale":"2024-09-14T11:51:34.329581+0000","last_undegraded":"2024-09-14T11:51:34.329581+0000","last_fullsized":"2024-09-14T11:51:34.329581+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:40.600226+0000","last_clean_scrub_stamp":"2024-09-14T11:27:40.600226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:12.987982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"264'11","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:36.499007+0000","last_change":"2024-09-14T11:54:36.499007+0000","last_active":"2024-09-14T11:54:36.499007+0000","last_peered":"2024-09-14T11:54:36.499007+0000","last_clean":"2024-09-14T11:54:36.499007+0000","last_became_active":"2024-09-14T11:27:38.612745+0000","last_became_peered":"2024-09-14T11:27:38.612745+0000","last_unstale":"2024-09-14T11:54:36.499007+0000","last_undegraded":"2024-09-14T11:54:36.499007+0000","last_fullsized":"2024-09-14T11:54:36.499007+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'11","last_scrub_stamp":"2024-09-14T11:54:36.498817+0000","last_deep_scrub":"264'11","last_deep_scrub_stamp":"2024-09-14T11:54:36.498817+0000","last_clean_scrub_stamp":"2024-09-14T11:54:36.498817+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:31.561242+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6207,"num_write":16,"num_write_kb":2107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"264'45","reported_seq":178,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:32.641432+0000","last_change":"2024-09-14T11:54:32.641432+0000","last_active":"2024-09-14T11:54:32.641432+0000","last_peered":"2024-09-14T11:54:32.641432+0000","last_clean":"2024-09-14T11:54:32.641432+0000","last_became_active":"2024-09-14T11:26:04.273309+0000","last_became_peered":"2024-09-14T11:26:04.273309+0000","last_unstale":"2024-09-14T11:54:32.641432+0000","last_undegraded":"2024-09-14T11:54:32.641432+0000","last_fullsized":"2024-09-14T11:54:32.641432+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'45","last_scrub_stamp":"2024-09-14T11:54:32.641166+0000","last_deep_scrub":"264'45","last_deep_scrub_stamp":"2024-09-14T11:54:32.641166+0000","last_clean_scrub_stamp":"2024-09-14T11:54:32.641166+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:40.953471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":376,"num_read_kb":242,"num_write":121,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:44.101834+0000","last_change":"2024-09-14T11:54:44.101704+0000","last_active":"2024-09-14T11:54:44.101834+0000","last_peered":"2024-09-14T11:54:44.101834+0000","last_clean":"2024-09-14T11:54:44.101834+0000","last_became_active":"2024-09-14T11:38:50.596495+0000","last_became_peered":"2024-09-14T11:38:50.596495+0000","last_unstale":"2024-09-14T11:54:44.101834+0000","last_undegraded":"2024-09-14T11:54:44.101834+0000","last_fullsized":"2024-09-14T11:54:44.101834+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:44.101486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:44.101486+0000","last_clean_scrub_stamp":"2024-09-14T11:54:44.101486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:40.560370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"264'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.105445+0000","last_change":"2024-09-14T11:54:43.105445+0000","last_active":"2024-09-14T11:54:43.105445+0000","last_peered":"2024-09-14T11:54:43.105445+0000","last_clean":"2024-09-14T11:54:43.105445+0000","last_became_active":"2024-09-14T11:27:41.650311+0000","last_became_peered":"2024-09-14T11:27:41.650311+0000","last_unstale":"2024-09-14T11:54:43.105445+0000","last_undegraded":"2024-09-14T11:54:43.105445+0000","last_fullsized":"2024-09-14T11:54:43.105445+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-14T11:54:43.105266+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-14T11:54:43.105266+0000","last_clean_scrub_stamp":"2024-09-14T11:54:43.105266+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:17.538352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"264'8","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.167098+0000","last_change":"2024-09-14T11:54:43.167098+0000","last_active":"2024-09-14T11:54:43.167098+0000","last_peered":"2024-09-14T11:54:43.167098+0000","last_clean":"2024-09-14T11:54:43.167098+0000","last_became_active":"2024-09-14T11:27:38.600043+0000","last_became_peered":"2024-09-14T11:27:38.600043+0000","last_unstale":"2024-09-14T11:54:43.167098+0000","last_undegraded":"2024-09-14T11:54:43.167098+0000","last_fullsized":"2024-09-14T11:54:43.167098+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-14T11:54:43.166917+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-14T11:54:43.166917+0000","last_clean_scrub_stamp":"2024-09-14T11:54:43.166917+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:04.371102+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":7170,"num_write":8,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"264'31","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:36.176386+0000","last_change":"2024-09-14T11:54:36.176386+0000","last_active":"2024-09-14T11:54:36.176386+0000","last_peered":"2024-09-14T11:54:36.176386+0000","last_clean":"2024-09-14T11:54:36.176386+0000","last_became_active":"2024-09-14T11:26:04.274089+0000","last_became_peered":"2024-09-14T11:26:04.274089+0000","last_unstale":"2024-09-14T11:54:36.176386+0000","last_undegraded":"2024-09-14T11:54:36.176386+0000","last_fullsized":"2024-09-14T11:54:36.176386+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'31","last_scrub_stamp":"2024-09-14T11:54:36.176207+0000","last_deep_scrub":"264'31","last_deep_scrub_stamp":"2024-09-14T11:54:36.176207+0000","last_clean_scrub_stamp":"2024-09-14T11:54:36.176207+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:32.653650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":254,"num_read_kb":164,"num_write":92,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"264'2","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:35.890706+0000","last_change":"2024-09-14T11:54:35.890556+0000","last_active":"2024-09-14T11:54:35.890706+0000","last_peered":"2024-09-14T11:54:35.890706+0000","last_clean":"2024-09-14T11:54:35.890706+0000","last_became_active":"2024-09-14T11:38:50.592765+0000","last_became_peered":"2024-09-14T11:38:50.592765+0000","last_unstale":"2024-09-14T11:54:35.890706+0000","last_undegraded":"2024-09-14T11:54:35.890706+0000","last_fullsized":"2024-09-14T11:54:35.890706+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:35.890361+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:35.890361+0000","last_clean_scrub_stamp":"2024-09-14T11:54:35.890361+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:43.731599+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"261'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:41.742159+0000","last_change":"2024-09-14T11:54:41.742032+0000","last_active":"2024-09-14T11:54:41.742159+0000","last_peered":"2024-09-14T11:54:41.742159+0000","last_clean":"2024-09-14T11:54:41.742159+0000","last_became_active":"2024-09-14T11:27:41.646962+0000","last_became_peered":"2024-09-14T11:27:41.646962+0000","last_unstale":"2024-09-14T11:54:41.742159+0000","last_undegraded":"2024-09-14T11:54:41.742159+0000","last_fullsized":"2024-09-14T11:54:41.742159+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-14T11:54:41.741821+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-14T11:54:41.741821+0000","last_clean_scrub_stamp":"2024-09-14T11:54:41.741821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:52:34.345872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:37.456892+0000","last_change":"2024-09-14T11:54:37.456892+0000","last_active":"2024-09-14T11:54:37.456892+0000","last_peered":"2024-09-14T11:54:37.456892+0000","last_clean":"2024-09-14T11:54:37.456892+0000","last_became_active":"2024-09-14T11:27:38.612131+0000","last_became_peered":"2024-09-14T11:27:38.612131+0000","last_unstale":"2024-09-14T11:54:37.456892+0000","last_undegraded":"2024-09-14T11:54:37.456892+0000","last_fullsized":"2024-09-14T11:54:37.456892+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:37.456703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:37.456703+0000","last_clean_scrub_stamp":"2024-09-14T11:54:37.456703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:10.593240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"264'14","reported_seq":88,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.175401+0000","last_change":"2024-09-14T11:54:42.175401+0000","last_active":"2024-09-14T11:54:42.175401+0000","last_peered":"2024-09-14T11:54:42.175401+0000","last_clean":"2024-09-14T11:54:42.175401+0000","last_became_active":"2024-09-14T11:26:04.258976+0000","last_became_peered":"2024-09-14T11:26:04.258976+0000","last_unstale":"2024-09-14T11:54:42.175401+0000","last_undegraded":"2024-09-14T11:54:42.175401+0000","last_fullsized":"2024-09-14T11:54:42.175401+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'14","last_scrub_stamp":"2024-09-14T11:54:42.175217+0000","last_deep_scrub":"264'14","last_deep_scrub_stamp":"2024-09-14T11:54:42.175217+0000","last_clean_scrub_stamp":"2024-09-14T11:54:42.175217+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:46.240692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":72,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:52.684034+0000","last_change":"2024-09-14T11:54:52.684034+0000","last_active":"2024-09-14T11:54:52.684034+0000","last_peered":"2024-09-14T11:54:52.684034+0000","last_clean":"2024-09-14T11:54:52.684034+0000","last_became_active":"2024-09-14T11:38:50.593641+0000","last_became_peered":"2024-09-14T11:38:50.593641+0000","last_unstale":"2024-09-14T11:54:52.684034+0000","last_undegraded":"2024-09-14T11:54:52.684034+0000","last_fullsized":"2024-09-14T11:54:52.684034+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:52.683824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:52.683824+0000","last_clean_scrub_stamp":"2024-09-14T11:54:52.683824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:28.599782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"261'7","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.894176+0000","last_change":"2024-09-14T11:54:38.894176+0000","last_active":"2024-09-14T11:54:38.894176+0000","last_peered":"2024-09-14T11:54:38.894176+0000","last_clean":"2024-09-14T11:54:38.894176+0000","last_became_active":"2024-09-14T11:27:41.657112+0000","last_became_peered":"2024-09-14T11:27:41.657112+0000","last_unstale":"2024-09-14T11:54:38.894176+0000","last_undegraded":"2024-09-14T11:54:38.894176+0000","last_fullsized":"2024-09-14T11:54:38.894176+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'7","last_scrub_stamp":"2024-09-14T11:54:38.893981+0000","last_deep_scrub":"261'7","last_deep_scrub_stamp":"2024-09-14T11:54:38.893981+0000","last_clean_scrub_stamp":"2024-09-14T11:54:38.893981+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:56.913823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":6146,"num_write":12,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"264'3","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:59.570054+0000","last_change":"2024-09-14T11:54:59.570054+0000","last_active":"2024-09-14T11:54:59.570054+0000","last_peered":"2024-09-14T11:54:59.570054+0000","last_clean":"2024-09-14T11:54:59.570054+0000","last_became_active":"2024-09-14T11:27:38.602864+0000","last_became_peered":"2024-09-14T11:27:38.602864+0000","last_unstale":"2024-09-14T11:54:59.570054+0000","last_undegraded":"2024-09-14T11:54:59.570054+0000","last_fullsized":"2024-09-14T11:54:59.570054+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:54:59.569859+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:54:59.569859+0000","last_clean_scrub_stamp":"2024-09-14T11:54:59.569859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:12.723206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"264'39","reported_seq":161,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:29.897512+0000","last_change":"2024-09-14T11:54:29.897512+0000","last_active":"2024-09-14T11:54:29.897512+0000","last_peered":"2024-09-14T11:54:29.897512+0000","last_clean":"2024-09-14T11:54:29.897512+0000","last_became_active":"2024-09-14T11:26:04.271893+0000","last_became_peered":"2024-09-14T11:26:04.271893+0000","last_unstale":"2024-09-14T11:54:29.897512+0000","last_undegraded":"2024-09-14T11:54:29.897512+0000","last_fullsized":"2024-09-14T11:54:29.897512+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'39","last_scrub_stamp":"2024-09-14T11:54:29.897326+0000","last_deep_scrub":"264'39","last_deep_scrub_stamp":"2024-09-14T11:54:29.897326+0000","last_clean_scrub_stamp":"2024-09-14T11:54:29.897326+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:50.067877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":319,"num_read_kb":212,"num_write":95,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:39.912208+0000","last_change":"2024-09-14T11:54:39.912208+0000","last_active":"2024-09-14T11:54:39.912208+0000","last_peered":"2024-09-14T11:54:39.912208+0000","last_clean":"2024-09-14T11:54:39.912208+0000","last_became_active":"2024-09-14T11:38:50.587827+0000","last_became_peered":"2024-09-14T11:38:50.587827+0000","last_unstale":"2024-09-14T11:54:39.912208+0000","last_undegraded":"2024-09-14T11:54:39.912208+0000","last_fullsized":"2024-09-14T11:54:39.912208+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:39.912020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:39.912020+0000","last_clean_scrub_stamp":"2024-09-14T11:54:39.912020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:38.246467+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"261'5","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:49.115994+0000","last_change":"2024-09-14T11:54:49.115787+0000","last_active":"2024-09-14T11:54:49.115994+0000","last_peered":"2024-09-14T11:54:49.115994+0000","last_clean":"2024-09-14T11:54:49.115994+0000","last_became_active":"2024-09-14T11:27:41.651778+0000","last_became_peered":"2024-09-14T11:27:41.651778+0000","last_unstale":"2024-09-14T11:54:49.115994+0000","last_undegraded":"2024-09-14T11:54:49.115994+0000","last_fullsized":"2024-09-14T11:54:49.115994+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-14T11:54:49.115592+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-14T11:54:49.115592+0000","last_clean_scrub_stamp":"2024-09-14T11:54:49.115592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:17:25.061815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:56.561405+0000","last_change":"2024-09-14T11:54:56.561405+0000","last_active":"2024-09-14T11:54:56.561405+0000","last_peered":"2024-09-14T11:54:56.561405+0000","last_clean":"2024-09-14T11:54:56.561405+0000","last_became_active":"2024-09-14T11:27:38.603954+0000","last_became_peered":"2024-09-14T11:27:38.603954+0000","last_unstale":"2024-09-14T11:54:56.561405+0000","last_undegraded":"2024-09-14T11:54:56.561405+0000","last_fullsized":"2024-09-14T11:54:56.561405+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:56.561220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:56.561220+0000","last_clean_scrub_stamp":"2024-09-14T11:54:56.561220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:38.490434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"264'59","reported_seq":209,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:40.121557+0000","last_change":"2024-09-14T11:54:40.121557+0000","last_active":"2024-09-14T11:54:40.121557+0000","last_peered":"2024-09-14T11:54:40.121557+0000","last_clean":"2024-09-14T11:54:40.121557+0000","last_became_active":"2024-09-14T11:26:04.269206+0000","last_became_peered":"2024-09-14T11:26:04.269206+0000","last_unstale":"2024-09-14T11:54:40.121557+0000","last_undegraded":"2024-09-14T11:54:40.121557+0000","last_fullsized":"2024-09-14T11:54:40.121557+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'59","last_scrub_stamp":"2024-09-14T11:54:40.121338+0000","last_deep_scrub":"264'59","last_deep_scrub_stamp":"2024-09-14T11:54:40.121338+0000","last_clean_scrub_stamp":"2024-09-14T11:54:40.121338+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:16.225468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":473,"num_read_kb":330,"num_write":140,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:34.854153+0000","last_change":"2024-09-14T11:54:34.854153+0000","last_active":"2024-09-14T11:54:34.854153+0000","last_peered":"2024-09-14T11:54:34.854153+0000","last_clean":"2024-09-14T11:54:34.854153+0000","last_became_active":"2024-09-14T11:38:50.585233+0000","last_became_peered":"2024-09-14T11:38:50.585233+0000","last_unstale":"2024-09-14T11:54:34.854153+0000","last_undegraded":"2024-09-14T11:54:34.854153+0000","last_fullsized":"2024-09-14T11:54:34.854153+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:34.853978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:34.853978+0000","last_clean_scrub_stamp":"2024-09-14T11:54:34.853978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:57.638474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"261'4","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:48.136949+0000","last_change":"2024-09-14T11:54:48.136796+0000","last_active":"2024-09-14T11:54:48.136949+0000","last_peered":"2024-09-14T11:54:48.136949+0000","last_clean":"2024-09-14T11:54:48.136949+0000","last_became_active":"2024-09-14T11:27:41.660286+0000","last_became_peered":"2024-09-14T11:27:41.660286+0000","last_unstale":"2024-09-14T11:54:48.136949+0000","last_undegraded":"2024-09-14T11:54:48.136949+0000","last_fullsized":"2024-09-14T11:54:48.136949+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-14T11:54:48.136603+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-14T11:54:48.136603+0000","last_clean_scrub_stamp":"2024-09-14T11:54:48.136603+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:28.232610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"261'2","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:45.217865+0000","last_change":"2024-09-14T11:54:45.217618+0000","last_active":"2024-09-14T11:54:45.217865+0000","last_peered":"2024-09-14T11:54:45.217865+0000","last_clean":"2024-09-14T11:54:45.217865+0000","last_became_active":"2024-09-14T11:27:38.591485+0000","last_became_peered":"2024-09-14T11:27:38.591485+0000","last_unstale":"2024-09-14T11:54:45.217865+0000","last_undegraded":"2024-09-14T11:54:45.217865+0000","last_fullsized":"2024-09-14T11:54:45.217865+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-14T11:54:45.217339+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-14T11:54:45.217339+0000","last_clean_scrub_stamp":"2024-09-14T11:54:45.217339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:38.002344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"261'8","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:51.573141+0000","last_change":"2024-09-14T11:54:51.573141+0000","last_active":"2024-09-14T11:54:51.573141+0000","last_peered":"2024-09-14T11:54:51.573141+0000","last_clean":"2024-09-14T11:54:51.573141+0000","last_became_active":"2024-09-14T11:26:04.280724+0000","last_became_peered":"2024-09-14T11:26:04.280724+0000","last_unstale":"2024-09-14T11:54:51.573141+0000","last_undegraded":"2024-09-14T11:54:51.573141+0000","last_fullsized":"2024-09-14T11:54:51.573141+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-14T11:54:51.572948+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-14T11:54:51.572948+0000","last_clean_scrub_stamp":"2024-09-14T11:54:51.572948+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:17.543439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":39,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:55.194297+0000","last_change":"2024-09-14T11:54:55.194157+0000","last_active":"2024-09-14T11:54:55.194297+0000","last_peered":"2024-09-14T11:54:55.194297+0000","last_clean":"2024-09-14T11:54:55.194297+0000","last_became_active":"2024-09-14T11:38:50.586004+0000","last_became_peered":"2024-09-14T11:38:50.586004+0000","last_unstale":"2024-09-14T11:54:55.194297+0000","last_undegraded":"2024-09-14T11:54:55.194297+0000","last_fullsized":"2024-09-14T11:54:55.194297+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:55.193953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:55.193953+0000","last_clean_scrub_stamp":"2024-09-14T11:54:55.193953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:04.675756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"264'4","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:33.848101+0000","last_change":"2024-09-14T11:54:33.848101+0000","last_active":"2024-09-14T11:54:33.848101+0000","last_peered":"2024-09-14T11:54:33.848101+0000","last_clean":"2024-09-14T11:54:33.848101+0000","last_became_active":"2024-09-14T11:27:41.656864+0000","last_became_peered":"2024-09-14T11:27:41.656864+0000","last_unstale":"2024-09-14T11:54:33.848101+0000","last_undegraded":"2024-09-14T11:54:33.848101+0000","last_fullsized":"2024-09-14T11:54:33.848101+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T11:54:33.847817+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T11:54:33.847817+0000","last_clean_scrub_stamp":"2024-09-14T11:54:33.847817+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:53.957568+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4123,"num_write":4,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"264'12","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.154931+0000","last_change":"2024-09-14T11:54:38.154931+0000","last_active":"2024-09-14T11:54:38.154931+0000","last_peered":"2024-09-14T11:54:38.154931+0000","last_clean":"2024-09-14T11:54:38.154931+0000","last_became_active":"2024-09-14T11:27:38.597416+0000","last_became_peered":"2024-09-14T11:27:38.597416+0000","last_unstale":"2024-09-14T11:54:38.154931+0000","last_undegraded":"2024-09-14T11:54:38.154931+0000","last_fullsized":"2024-09-14T11:54:38.154931+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'12","last_scrub_stamp":"2024-09-14T11:54:38.154747+0000","last_deep_scrub":"264'12","last_deep_scrub_stamp":"2024-09-14T11:54:38.154747+0000","last_clean_scrub_stamp":"2024-09-14T11:54:38.154747+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:23.115757+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":16434,"num_write":22,"num_write_kb":9264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"264'34","reported_seq":146,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:30.342924+0000","last_change":"2024-09-14T11:54:30.342924+0000","last_active":"2024-09-14T11:54:30.342924+0000","last_peered":"2024-09-14T11:54:30.342924+0000","last_clean":"2024-09-14T11:54:30.342924+0000","last_became_active":"2024-09-14T11:26:04.274720+0000","last_became_peered":"2024-09-14T11:26:04.274720+0000","last_unstale":"2024-09-14T11:54:30.342924+0000","last_undegraded":"2024-09-14T11:54:30.342924+0000","last_fullsized":"2024-09-14T11:54:30.342924+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'34","last_scrub_stamp":"2024-09-14T11:54:30.342736+0000","last_deep_scrub":"264'34","last_deep_scrub_stamp":"2024-09-14T11:54:30.342736+0000","last_clean_scrub_stamp":"2024-09-14T11:54:30.342736+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:59.676057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":267,"num_read_kb":161,"num_write":92,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:24.326912+0000","last_change":"2024-09-14T11:38:50.576319+0000","last_active":"2024-09-14T11:51:24.326912+0000","last_peered":"2024-09-14T11:51:24.326912+0000","last_clean":"2024-09-14T11:51:24.326912+0000","last_became_active":"2024-09-14T11:38:50.575662+0000","last_became_peered":"2024-09-14T11:38:50.575662+0000","last_unstale":"2024-09-14T11:51:24.326912+0000","last_undegraded":"2024-09-14T11:51:24.326912+0000","last_fullsized":"2024-09-14T11:51:24.326912+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:49.815419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:55:02.610560+0000","last_change":"2024-09-14T11:55:02.610560+0000","last_active":"2024-09-14T11:55:02.610560+0000","last_peered":"2024-09-14T11:55:02.610560+0000","last_clean":"2024-09-14T11:55:02.610560+0000","last_became_active":"2024-09-14T11:27:41.652132+0000","last_became_peered":"2024-09-14T11:27:41.652132+0000","last_unstale":"2024-09-14T11:55:02.610560+0000","last_undegraded":"2024-09-14T11:55:02.610560+0000","last_fullsized":"2024-09-14T11:55:02.610560+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:55:02.610378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:55:02.610378+0000","last_clean_scrub_stamp":"2024-09-14T11:55:02.610378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:06.470649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"264'4","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:57.591929+0000","last_change":"2024-09-14T11:54:57.591929+0000","last_active":"2024-09-14T11:54:57.591929+0000","last_peered":"2024-09-14T11:54:57.591929+0000","last_clean":"2024-09-14T11:54:57.591929+0000","last_became_active":"2024-09-14T11:27:38.602099+0000","last_became_peered":"2024-09-14T11:27:38.602099+0000","last_unstale":"2024-09-14T11:54:57.591929+0000","last_undegraded":"2024-09-14T11:54:57.591929+0000","last_fullsized":"2024-09-14T11:54:57.591929+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T11:54:57.591743+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T11:54:57.591743+0000","last_clean_scrub_stamp":"2024-09-14T11:54:57.591743+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:44.881147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"264'30","reported_seq":133,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:31.449672+0000","last_change":"2024-09-14T11:54:31.449672+0000","last_active":"2024-09-14T11:54:31.449672+0000","last_peered":"2024-09-14T11:54:31.449672+0000","last_clean":"2024-09-14T11:54:31.449672+0000","last_became_active":"2024-09-14T11:26:04.265553+0000","last_became_peered":"2024-09-14T11:26:04.265553+0000","last_unstale":"2024-09-14T11:54:31.449672+0000","last_undegraded":"2024-09-14T11:54:31.449672+0000","last_fullsized":"2024-09-14T11:54:31.449672+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'30","last_scrub_stamp":"2024-09-14T11:54:31.449479+0000","last_deep_scrub":"264'30","last_deep_scrub_stamp":"2024-09-14T11:54:31.449479+0000","last_clean_scrub_stamp":"2024-09-14T11:54:31.449479+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:24.468419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":163,"num_write":75,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"264'2","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:50.630238+0000","last_change":"2024-09-14T11:54:50.630238+0000","last_active":"2024-09-14T11:54:50.630238+0000","last_peered":"2024-09-14T11:54:50.630238+0000","last_clean":"2024-09-14T11:54:50.630238+0000","last_became_active":"2024-09-14T11:38:50.583172+0000","last_became_peered":"2024-09-14T11:38:50.583172+0000","last_unstale":"2024-09-14T11:54:50.630238+0000","last_undegraded":"2024-09-14T11:54:50.630238+0000","last_fullsized":"2024-09-14T11:54:50.630238+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:50.630057+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:50.630057+0000","last_clean_scrub_stamp":"2024-09-14T11:54:50.630057+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:54.211506+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"264'3","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:46.223966+0000","last_change":"2024-09-14T11:54:46.223801+0000","last_active":"2024-09-14T11:54:46.223966+0000","last_peered":"2024-09-14T11:54:46.223966+0000","last_clean":"2024-09-14T11:54:46.223966+0000","last_became_active":"2024-09-14T11:27:41.645631+0000","last_became_peered":"2024-09-14T11:27:41.645631+0000","last_unstale":"2024-09-14T11:54:46.223966+0000","last_undegraded":"2024-09-14T11:54:46.223966+0000","last_fullsized":"2024-09-14T11:54:46.223966+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:54:46.223621+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:54:46.223621+0000","last_clean_scrub_stamp":"2024-09-14T11:54:46.223621+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:14.738671+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"261'6","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:32.281053+0000","last_change":"2024-09-14T11:54:32.281053+0000","last_active":"2024-09-14T11:54:32.281053+0000","last_peered":"2024-09-14T11:54:32.281053+0000","last_clean":"2024-09-14T11:54:32.281053+0000","last_became_active":"2024-09-14T11:27:38.597788+0000","last_became_peered":"2024-09-14T11:27:38.597788+0000","last_unstale":"2024-09-14T11:54:32.281053+0000","last_undegraded":"2024-09-14T11:54:32.281053+0000","last_fullsized":"2024-09-14T11:54:32.281053+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-09-14T11:54:32.280860+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-09-14T11:54:32.280860+0000","last_clean_scrub_stamp":"2024-09-14T11:54:32.280860+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:14.084801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4123,"num_write":6,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"264'31","reported_seq":130,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:34.203858+0000","last_change":"2024-09-14T11:54:34.203858+0000","last_active":"2024-09-14T11:54:34.203858+0000","last_peered":"2024-09-14T11:54:34.203858+0000","last_clean":"2024-09-14T11:54:34.203858+0000","last_became_active":"2024-09-14T11:26:04.257219+0000","last_became_peered":"2024-09-14T11:26:04.257219+0000","last_unstale":"2024-09-14T11:54:34.203858+0000","last_undegraded":"2024-09-14T11:54:34.203858+0000","last_fullsized":"2024-09-14T11:54:34.203858+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'31","last_scrub_stamp":"2024-09-14T11:54:34.203639+0000","last_deep_scrub":"264'31","last_deep_scrub_stamp":"2024-09-14T11:54:34.203639+0000","last_clean_scrub_stamp":"2024-09-14T11:54:34.203639+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:33.680445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":127,"num_write":83,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.252119+0000","last_change":"2024-09-14T11:54:47.252119+0000","last_active":"2024-09-14T11:54:47.252119+0000","last_peered":"2024-09-14T11:54:47.252119+0000","last_clean":"2024-09-14T11:54:47.252119+0000","last_became_active":"2024-09-14T11:38:50.581128+0000","last_became_peered":"2024-09-14T11:38:50.581128+0000","last_unstale":"2024-09-14T11:54:47.252119+0000","last_undegraded":"2024-09-14T11:54:47.252119+0000","last_fullsized":"2024-09-14T11:54:47.252119+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:47.251950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:47.251950+0000","last_clean_scrub_stamp":"2024-09-14T11:54:47.251950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:51.824406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"264'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:55:01.637790+0000","last_change":"2024-09-14T11:55:01.637790+0000","last_active":"2024-09-14T11:55:01.637790+0000","last_peered":"2024-09-14T11:55:01.637790+0000","last_clean":"2024-09-14T11:55:01.637790+0000","last_became_active":"2024-09-14T11:27:41.652549+0000","last_became_peered":"2024-09-14T11:27:41.652549+0000","last_unstale":"2024-09-14T11:55:01.637790+0000","last_undegraded":"2024-09-14T11:55:01.637790+0000","last_fullsized":"2024-09-14T11:55:01.637790+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:55:01.637604+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:55:01.637604+0000","last_clean_scrub_stamp":"2024-09-14T11:55:01.637604+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:17.598048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"264'6","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.571106+0000","last_change":"2024-09-14T11:54:58.571106+0000","last_active":"2024-09-14T11:54:58.571106+0000","last_peered":"2024-09-14T11:54:58.571106+0000","last_clean":"2024-09-14T11:54:58.571106+0000","last_became_active":"2024-09-14T11:27:38.609483+0000","last_became_peered":"2024-09-14T11:27:38.609483+0000","last_unstale":"2024-09-14T11:54:58.571106+0000","last_undegraded":"2024-09-14T11:54:58.571106+0000","last_fullsized":"2024-09-14T11:54:58.571106+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-14T11:54:58.570917+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-14T11:54:58.570917+0000","last_clean_scrub_stamp":"2024-09-14T11:54:58.570917+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:18:55.493511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12292,"num_write":6,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"264'27","reported_seq":122,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:50.617847+0000","last_change":"2024-09-14T11:54:50.617847+0000","last_active":"2024-09-14T11:54:50.617847+0000","last_peered":"2024-09-14T11:54:50.617847+0000","last_clean":"2024-09-14T11:54:50.617847+0000","last_became_active":"2024-09-14T11:26:04.268338+0000","last_became_peered":"2024-09-14T11:26:04.268338+0000","last_unstale":"2024-09-14T11:54:50.617847+0000","last_undegraded":"2024-09-14T11:54:50.617847+0000","last_fullsized":"2024-09-14T11:54:50.617847+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'27","last_scrub_stamp":"2024-09-14T11:54:50.617661+0000","last_deep_scrub":"264'27","last_deep_scrub_stamp":"2024-09-14T11:54:50.617661+0000","last_clean_scrub_stamp":"2024-09-14T11:54:50.617661+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:07.967626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":125,"num_write":73,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:57.181216+0000","last_change":"2024-09-14T11:54:57.181216+0000","last_active":"2024-09-14T11:54:57.181216+0000","last_peered":"2024-09-14T11:54:57.181216+0000","last_clean":"2024-09-14T11:54:57.181216+0000","last_became_active":"2024-09-14T11:38:50.589588+0000","last_became_peered":"2024-09-14T11:38:50.589588+0000","last_unstale":"2024-09-14T11:54:57.181216+0000","last_undegraded":"2024-09-14T11:54:57.181216+0000","last_fullsized":"2024-09-14T11:54:57.181216+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:57.181029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:57.181029+0000","last_clean_scrub_stamp":"2024-09-14T11:54:57.181029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:17.545033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"264'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:40.102752+0000","last_change":"2024-09-14T11:54:40.102585+0000","last_active":"2024-09-14T11:54:40.102752+0000","last_peered":"2024-09-14T11:54:40.102752+0000","last_clean":"2024-09-14T11:54:40.102752+0000","last_became_active":"2024-09-14T11:27:41.642400+0000","last_became_peered":"2024-09-14T11:27:41.642400+0000","last_unstale":"2024-09-14T11:54:40.102752+0000","last_undegraded":"2024-09-14T11:54:40.102752+0000","last_fullsized":"2024-09-14T11:54:40.102752+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:40.102397+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:40.102397+0000","last_clean_scrub_stamp":"2024-09-14T11:54:40.102397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:43.831109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"261'5","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.690174+0000","last_change":"2024-09-14T11:54:38.689979+0000","last_active":"2024-09-14T11:54:38.690174+0000","last_peered":"2024-09-14T11:54:38.690174+0000","last_clean":"2024-09-14T11:54:38.690174+0000","last_became_active":"2024-09-14T11:27:38.587990+0000","last_became_peered":"2024-09-14T11:27:38.587990+0000","last_unstale":"2024-09-14T11:54:38.690174+0000","last_undegraded":"2024-09-14T11:54:38.690174+0000","last_fullsized":"2024-09-14T11:54:38.690174+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-14T11:54:38.689786+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-14T11:54:38.689786+0000","last_clean_scrub_stamp":"2024-09-14T11:54:38.689786+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:38.094890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"264'55","reported_seq":200,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:52.573688+0000","last_change":"2024-09-14T11:54:52.573688+0000","last_active":"2024-09-14T11:54:52.573688+0000","last_peered":"2024-09-14T11:54:52.573688+0000","last_clean":"2024-09-14T11:54:52.573688+0000","last_became_active":"2024-09-14T11:26:04.257926+0000","last_became_peered":"2024-09-14T11:26:04.257926+0000","last_unstale":"2024-09-14T11:54:52.573688+0000","last_undegraded":"2024-09-14T11:54:52.573688+0000","last_fullsized":"2024-09-14T11:54:52.573688+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'55","last_scrub_stamp":"2024-09-14T11:54:52.573501+0000","last_deep_scrub":"264'55","last_deep_scrub_stamp":"2024-09-14T11:54:52.573501+0000","last_clean_scrub_stamp":"2024-09-14T11:54:52.573501+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:18.073167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":423,"num_read_kb":280,"num_write":136,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:51:24.327084+0000","last_change":"2024-09-14T11:38:50.587747+0000","last_active":"2024-09-14T11:51:24.327084+0000","last_peered":"2024-09-14T11:51:24.327084+0000","last_clean":"2024-09-14T11:51:24.327084+0000","last_became_active":"2024-09-14T11:38:50.581923+0000","last_became_peered":"2024-09-14T11:38:50.581923+0000","last_unstale":"2024-09-14T11:51:24.327084+0000","last_undegraded":"2024-09-14T11:51:24.327084+0000","last_fullsized":"2024-09-14T11:51:24.327084+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.520691+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.520691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:40.481426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:37.158171+0000","last_change":"2024-09-14T11:54:37.158020+0000","last_active":"2024-09-14T11:54:37.158171+0000","last_peered":"2024-09-14T11:54:37.158171+0000","last_clean":"2024-09-14T11:54:37.158171+0000","last_became_active":"2024-09-14T11:27:41.634692+0000","last_became_peered":"2024-09-14T11:27:41.634692+0000","last_unstale":"2024-09-14T11:54:37.158171+0000","last_undegraded":"2024-09-14T11:54:37.158171+0000","last_fullsized":"2024-09-14T11:54:37.158171+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:37.157845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:37.157845+0000","last_clean_scrub_stamp":"2024-09-14T11:54:37.157845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:26.919415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"264'8","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:34.689968+0000","last_change":"2024-09-14T11:54:34.689836+0000","last_active":"2024-09-14T11:54:34.689968+0000","last_peered":"2024-09-14T11:54:34.689968+0000","last_clean":"2024-09-14T11:54:34.689968+0000","last_became_active":"2024-09-14T11:27:38.612443+0000","last_became_peered":"2024-09-14T11:27:38.612443+0000","last_unstale":"2024-09-14T11:54:34.689968+0000","last_undegraded":"2024-09-14T11:54:34.689968+0000","last_fullsized":"2024-09-14T11:54:34.689968+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-14T11:54:34.689645+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-14T11:54:34.689645+0000","last_clean_scrub_stamp":"2024-09-14T11:54:34.689645+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:54.340768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16386,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"264'61","reported_seq":217,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:29.342302+0000","last_change":"2024-09-14T11:54:29.342302+0000","last_active":"2024-09-14T11:54:29.342302+0000","last_peered":"2024-09-14T11:54:29.342302+0000","last_clean":"2024-09-14T11:54:29.342302+0000","last_became_active":"2024-09-14T11:26:04.263498+0000","last_became_peered":"2024-09-14T11:26:04.263498+0000","last_unstale":"2024-09-14T11:54:29.342302+0000","last_undegraded":"2024-09-14T11:54:29.342302+0000","last_fullsized":"2024-09-14T11:54:29.342302+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'61","last_scrub_stamp":"2024-09-14T11:54:29.342123+0000","last_deep_scrub":"264'61","last_deep_scrub_stamp":"2024-09-14T11:54:29.342123+0000","last_clean_scrub_stamp":"2024-09-14T11:54:29.342123+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:20.972202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":491,"num_read_kb":357,"num_write":145,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"264'200","reported_seq":928,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.744180+0000","last_change":"2024-09-14T11:54:09.744180+0000","last_active":"2024-09-14T11:54:09.744180+0000","last_peered":"2024-09-14T11:54:09.744180+0000","last_clean":"2024-09-14T11:54:09.744180+0000","last_became_active":"2024-09-14T11:09:45.212881+0000","last_became_peered":"2024-09-14T11:09:45.212881+0000","last_unstale":"2024-09-14T11:54:09.744180+0000","last_undegraded":"2024-09-14T11:54:09.744180+0000","last_fullsized":"2024-09-14T11:54:09.744180+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'200","last_scrub_stamp":"2024-09-14T11:54:09.743907+0000","last_deep_scrub":"264'200","last_deep_scrub_stamp":"2024-09-14T11:54:09.743907+0000","last_clean_scrub_stamp":"2024-09-14T11:54:09.743907+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:12.346884+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":928,"num_read_kb":39441,"num_write":967,"num_write_kb":29636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"264'510","reported_seq":2118,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.589827+0000","last_change":"2024-09-14T11:54:15.589663+0000","last_active":"2024-09-14T11:54:15.589827+0000","last_peered":"2024-09-14T11:54:15.589827+0000","last_clean":"2024-09-14T11:54:15.589827+0000","last_became_active":"2024-09-14T11:09:46.960069+0000","last_became_peered":"2024-09-14T11:09:46.960069+0000","last_unstale":"2024-09-14T11:54:15.589827+0000","last_undegraded":"2024-09-14T11:54:15.589827+0000","last_fullsized":"2024-09-14T11:54:15.589827+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'510","last_scrub_stamp":"2024-09-14T11:54:15.589488+0000","last_deep_scrub":"264'510","last_deep_scrub_stamp":"2024-09-14T11:54:15.589488+0000","last_clean_scrub_stamp":"2024-09-14T11:54:15.589488+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:03.452431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2624,"num_read_kb":2455,"num_write":621,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"264'213","reported_seq":869,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:16.081574+0000","last_change":"2024-09-14T11:54:16.081574+0000","last_active":"2024-09-14T11:54:16.081574+0000","last_peered":"2024-09-14T11:54:16.081574+0000","last_clean":"2024-09-14T11:54:16.081574+0000","last_became_active":"2024-09-14T11:09:45.211049+0000","last_became_peered":"2024-09-14T11:09:45.211049+0000","last_unstale":"2024-09-14T11:54:16.081574+0000","last_undegraded":"2024-09-14T11:54:16.081574+0000","last_fullsized":"2024-09-14T11:54:16.081574+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'213","last_scrub_stamp":"2024-09-14T11:54:16.081321+0000","last_deep_scrub":"264'213","last_deep_scrub_stamp":"2024-09-14T11:54:16.081321+0000","last_clean_scrub_stamp":"2024-09-14T11:54:16.081321+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:38.768993+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":540,"num_read_kb":70257,"num_write":1018,"num_write_kb":34950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"264'761","reported_seq":2296,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:25.917821+0000","last_change":"2024-09-14T11:54:25.917678+0000","last_active":"2024-09-14T11:54:25.917821+0000","last_peered":"2024-09-14T11:54:25.917821+0000","last_clean":"2024-09-14T11:54:25.917821+0000","last_became_active":"2024-09-14T11:09:46.957446+0000","last_became_peered":"2024-09-14T11:09:46.957446+0000","last_unstale":"2024-09-14T11:54:25.917821+0000","last_undegraded":"2024-09-14T11:54:25.917821+0000","last_fullsized":"2024-09-14T11:54:25.917821+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'761","last_scrub_stamp":"2024-09-14T11:54:25.917475+0000","last_deep_scrub":"264'761","last_deep_scrub_stamp":"2024-09-14T11:54:25.917475+0000","last_clean_scrub_stamp":"2024-09-14T11:54:25.917475+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:18:02.157703+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3644,"num_read_kb":3296,"num_write":998,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"264'185","reported_seq":815,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.081219+0000","last_change":"2024-09-14T11:54:15.081219+0000","last_active":"2024-09-14T11:54:15.081219+0000","last_peered":"2024-09-14T11:54:15.081219+0000","last_clean":"2024-09-14T11:54:15.081219+0000","last_became_active":"2024-09-14T11:09:45.207458+0000","last_became_peered":"2024-09-14T11:09:45.207458+0000","last_unstale":"2024-09-14T11:54:15.081219+0000","last_undegraded":"2024-09-14T11:54:15.081219+0000","last_fullsized":"2024-09-14T11:54:15.081219+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'185","last_scrub_stamp":"2024-09-14T11:54:15.080970+0000","last_deep_scrub":"264'185","last_deep_scrub_stamp":"2024-09-14T11:54:15.080970+0000","last_clean_scrub_stamp":"2024-09-14T11:54:15.080970+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:43.319269+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":12475,"num_write":826,"num_write_kb":33777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"264'375","reported_seq":1907,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.932105+0000","last_change":"2024-09-14T11:54:26.931959+0000","last_active":"2024-09-14T11:54:26.932105+0000","last_peered":"2024-09-14T11:54:26.932105+0000","last_clean":"2024-09-14T11:54:26.932105+0000","last_became_active":"2024-09-14T11:09:46.950652+0000","last_became_peered":"2024-09-14T11:09:46.950652+0000","last_unstale":"2024-09-14T11:54:26.932105+0000","last_undegraded":"2024-09-14T11:54:26.932105+0000","last_fullsized":"2024-09-14T11:54:26.932105+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'375","last_scrub_stamp":"2024-09-14T11:54:26.931723+0000","last_deep_scrub":"264'375","last_deep_scrub_stamp":"2024-09-14T11:54:26.931723+0000","last_clean_scrub_stamp":"2024-09-14T11:54:26.931723+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:44.924195+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2108,"num_read_kb":2030,"num_write":424,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"264'209","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:16.405568+0000","last_change":"2024-09-14T11:54:16.405568+0000","last_active":"2024-09-14T11:54:16.405568+0000","last_peered":"2024-09-14T11:54:16.405568+0000","last_clean":"2024-09-14T11:54:16.405568+0000","last_became_active":"2024-09-14T11:09:45.185702+0000","last_became_peered":"2024-09-14T11:09:45.185702+0000","last_unstale":"2024-09-14T11:54:16.405568+0000","last_undegraded":"2024-09-14T11:54:16.405568+0000","last_fullsized":"2024-09-14T11:54:16.405568+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'209","last_scrub_stamp":"2024-09-14T11:54:16.405308+0000","last_deep_scrub":"264'209","last_deep_scrub_stamp":"2024-09-14T11:54:16.405308+0000","last_clean_scrub_stamp":"2024-09-14T11:54:16.405308+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:37.330840+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":495,"num_read_kb":15356,"num_write":918,"num_write_kb":51388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"264'416","reported_seq":1981,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.753605+0000","last_change":"2024-09-14T11:54:18.753329+0000","last_active":"2024-09-14T11:54:18.753605+0000","last_peered":"2024-09-14T11:54:18.753605+0000","last_clean":"2024-09-14T11:54:18.753605+0000","last_became_active":"2024-09-14T11:09:46.952230+0000","last_became_peered":"2024-09-14T11:09:46.952230+0000","last_unstale":"2024-09-14T11:54:18.753605+0000","last_undegraded":"2024-09-14T11:54:18.753605+0000","last_fullsized":"2024-09-14T11:54:18.753605+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'416","last_scrub_stamp":"2024-09-14T11:54:18.753111+0000","last_deep_scrub":"264'416","last_deep_scrub_stamp":"2024-09-14T11:54:18.753111+0000","last_clean_scrub_stamp":"2024-09-14T11:54:18.753111+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:38.004375+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2399,"num_read_kb":2276,"num_write":503,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"264'177","reported_seq":754,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.268410+0000","last_change":"2024-09-14T11:54:08.268410+0000","last_active":"2024-09-14T11:54:08.268410+0000","last_peered":"2024-09-14T11:54:08.268410+0000","last_clean":"2024-09-14T11:54:08.268410+0000","last_became_active":"2024-09-14T11:10:22.254947+0000","last_became_peered":"2024-09-14T11:10:22.254947+0000","last_unstale":"2024-09-14T11:54:08.268410+0000","last_undegraded":"2024-09-14T11:54:08.268410+0000","last_fullsized":"2024-09-14T11:54:08.268410+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-09-14T11:54:08.268210+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-09-14T11:54:08.268210+0000","last_clean_scrub_stamp":"2024-09-14T11:54:08.268210+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:14.156723+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":441,"num_read_kb":20000,"num_write":788,"num_write_kb":32213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'368","reported_seq":1761,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.799314+0000","last_change":"2024-09-14T11:54:17.799314+0000","last_active":"2024-09-14T11:54:17.799314+0000","last_peered":"2024-09-14T11:54:17.799314+0000","last_clean":"2024-09-14T11:54:17.799314+0000","last_became_active":"2024-09-14T11:09:46.962586+0000","last_became_peered":"2024-09-14T11:09:46.962586+0000","last_unstale":"2024-09-14T11:54:17.799314+0000","last_undegraded":"2024-09-14T11:54:17.799314+0000","last_fullsized":"2024-09-14T11:54:17.799314+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'368","last_scrub_stamp":"2024-09-14T11:54:17.799119+0000","last_deep_scrub":"264'368","last_deep_scrub_stamp":"2024-09-14T11:54:17.799119+0000","last_clean_scrub_stamp":"2024-09-14T11:54:17.799119+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:30:09.942238+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1989,"num_read_kb":1876,"num_write":428,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"264'210","reported_seq":846,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.412881+0000","last_change":"2024-09-14T11:54:10.412736+0000","last_active":"2024-09-14T11:54:10.412881+0000","last_peered":"2024-09-14T11:54:10.412881+0000","last_clean":"2024-09-14T11:54:10.412881+0000","last_became_active":"2024-09-14T11:09:45.187149+0000","last_became_peered":"2024-09-14T11:09:45.187149+0000","last_unstale":"2024-09-14T11:54:10.412881+0000","last_undegraded":"2024-09-14T11:54:10.412881+0000","last_fullsized":"2024-09-14T11:54:10.412881+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'210","last_scrub_stamp":"2024-09-14T11:54:10.412544+0000","last_deep_scrub":"264'210","last_deep_scrub_stamp":"2024-09-14T11:54:10.412544+0000","last_clean_scrub_stamp":"2024-09-14T11:54:10.412544+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:47.711478+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":555,"num_read_kb":3965,"num_write":975,"num_write_kb":31222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"264'787","reported_seq":2330,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.801159+0000","last_change":"2024-09-14T11:54:14.801159+0000","last_active":"2024-09-14T11:54:14.801159+0000","last_peered":"2024-09-14T11:54:14.801159+0000","last_clean":"2024-09-14T11:54:14.801159+0000","last_became_active":"2024-09-14T11:09:46.990102+0000","last_became_peered":"2024-09-14T11:09:46.990102+0000","last_unstale":"2024-09-14T11:54:14.801159+0000","last_undegraded":"2024-09-14T11:54:14.801159+0000","last_fullsized":"2024-09-14T11:54:14.801159+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'787","last_scrub_stamp":"2024-09-14T11:54:14.800969+0000","last_deep_scrub":"264'787","last_deep_scrub_stamp":"2024-09-14T11:54:14.800969+0000","last_clean_scrub_stamp":"2024-09-14T11:54:14.800969+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:44.286981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3903,"num_read_kb":3531,"num_write":1063,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"264'334","reported_seq":1004,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.759940+0000","last_change":"2024-09-14T11:54:10.759698+0000","last_active":"2024-09-14T11:54:10.759940+0000","last_peered":"2024-09-14T11:54:10.759940+0000","last_clean":"2024-09-14T11:54:10.759940+0000","last_became_active":"2024-09-14T11:09:45.204885+0000","last_became_peered":"2024-09-14T11:09:45.204885+0000","last_unstale":"2024-09-14T11:54:10.759940+0000","last_undegraded":"2024-09-14T11:54:10.759940+0000","last_fullsized":"2024-09-14T11:54:10.759940+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'334","last_scrub_stamp":"2024-09-14T11:54:10.759384+0000","last_deep_scrub":"264'334","last_deep_scrub_stamp":"2024-09-14T11:54:10.759384+0000","last_clean_scrub_stamp":"2024-09-14T11:54:10.759384+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:40.347879+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":904,"num_read_kb":1363,"num_write":1218,"num_write_kb":28416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"264'787","reported_seq":2369,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:12.434039+0000","last_change":"2024-09-14T11:54:12.434039+0000","last_active":"2024-09-14T11:54:12.434039+0000","last_peered":"2024-09-14T11:54:12.434039+0000","last_clean":"2024-09-14T11:54:12.434039+0000","last_became_active":"2024-09-14T11:09:46.951098+0000","last_became_peered":"2024-09-14T11:09:46.951098+0000","last_unstale":"2024-09-14T11:54:12.434039+0000","last_undegraded":"2024-09-14T11:54:12.434039+0000","last_fullsized":"2024-09-14T11:54:12.434039+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'787","last_scrub_stamp":"2024-09-14T11:54:12.433859+0000","last_deep_scrub":"264'787","last_deep_scrub_stamp":"2024-09-14T11:54:12.433859+0000","last_clean_scrub_stamp":"2024-09-14T11:54:12.433859+0000","objects_scrubbed":3,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:51.937141+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3820,"num_read_kb":3459,"num_write":1035,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"264'223","reported_seq":861,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.106805+0000","last_change":"2024-09-14T11:54:14.106645+0000","last_active":"2024-09-14T11:54:14.106805+0000","last_peered":"2024-09-14T11:54:14.106805+0000","last_clean":"2024-09-14T11:54:14.106805+0000","last_became_active":"2024-09-14T11:09:45.207406+0000","last_became_peered":"2024-09-14T11:09:45.207406+0000","last_unstale":"2024-09-14T11:54:14.106805+0000","last_undegraded":"2024-09-14T11:54:14.106805+0000","last_fullsized":"2024-09-14T11:54:14.106805+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'223","last_scrub_stamp":"2024-09-14T11:54:14.106465+0000","last_deep_scrub":"264'223","last_deep_scrub_stamp":"2024-09-14T11:54:14.106465+0000","last_clean_scrub_stamp":"2024-09-14T11:54:14.106465+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:53.896261+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":519,"num_read_kb":35149,"num_write":962,"num_write_kb":45963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"264'416","reported_seq":1964,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:25.077318+0000","last_change":"2024-09-14T11:54:25.077318+0000","last_active":"2024-09-14T11:54:25.077318+0000","last_peered":"2024-09-14T11:54:25.077318+0000","last_clean":"2024-09-14T11:54:25.077318+0000","last_became_active":"2024-09-14T11:09:46.995237+0000","last_became_peered":"2024-09-14T11:09:46.995237+0000","last_unstale":"2024-09-14T11:54:25.077318+0000","last_undegraded":"2024-09-14T11:54:25.077318+0000","last_fullsized":"2024-09-14T11:54:25.077318+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'416","last_scrub_stamp":"2024-09-14T11:54:25.077145+0000","last_deep_scrub":"264'416","last_deep_scrub_stamp":"2024-09-14T11:54:25.077145+0000","last_clean_scrub_stamp":"2024-09-14T11:54:25.077145+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:26.584597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2305,"num_read_kb":2183,"num_write":489,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"264'598","reported_seq":2224,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.893793+0000","last_change":"2024-09-14T11:54:27.893793+0000","last_active":"2024-09-14T11:54:27.893793+0000","last_peered":"2024-09-14T11:54:27.893793+0000","last_clean":"2024-09-14T11:54:27.893793+0000","last_became_active":"2024-09-14T11:09:46.959477+0000","last_became_peered":"2024-09-14T11:09:46.959477+0000","last_unstale":"2024-09-14T11:54:27.893793+0000","last_undegraded":"2024-09-14T11:54:27.893793+0000","last_fullsized":"2024-09-14T11:54:27.893793+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'598","last_scrub_stamp":"2024-09-14T11:54:27.893571+0000","last_deep_scrub":"264'598","last_deep_scrub_stamp":"2024-09-14T11:54:27.893571+0000","last_clean_scrub_stamp":"2024-09-14T11:54:27.893571+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":500,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:23.191112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3034,"num_read_kb":2795,"num_write":758,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"264'221","reported_seq":858,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:03.641120+0000","last_change":"2024-09-14T11:54:03.641120+0000","last_active":"2024-09-14T11:54:03.641120+0000","last_peered":"2024-09-14T11:54:03.641120+0000","last_clean":"2024-09-14T11:54:03.641120+0000","last_became_active":"2024-09-14T11:09:45.204030+0000","last_became_peered":"2024-09-14T11:09:45.204030+0000","last_unstale":"2024-09-14T11:54:03.641120+0000","last_undegraded":"2024-09-14T11:54:03.641120+0000","last_fullsized":"2024-09-14T11:54:03.641120+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'221","last_scrub_stamp":"2024-09-14T11:54:03.641022+0000","last_deep_scrub":"264'221","last_deep_scrub_stamp":"2024-09-14T11:54:03.641022+0000","last_clean_scrub_stamp":"2024-09-14T11:54:03.641022+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:40.015512+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655875,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":529,"num_read_kb":23907,"num_write":1077,"num_write_kb":37253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"264'525","reported_seq":2144,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.763390+0000","last_change":"2024-09-14T11:54:13.763390+0000","last_active":"2024-09-14T11:54:13.763390+0000","last_peered":"2024-09-14T11:54:13.763390+0000","last_clean":"2024-09-14T11:54:13.763390+0000","last_became_active":"2024-09-14T11:09:46.970750+0000","last_became_peered":"2024-09-14T11:09:46.970750+0000","last_unstale":"2024-09-14T11:54:13.763390+0000","last_undegraded":"2024-09-14T11:54:13.763390+0000","last_fullsized":"2024-09-14T11:54:13.763390+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'525","last_scrub_stamp":"2024-09-14T11:54:13.763206+0000","last_deep_scrub":"264'525","last_deep_scrub_stamp":"2024-09-14T11:54:13.763206+0000","last_clean_scrub_stamp":"2024-09-14T11:54:13.763206+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:17.444401+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2805,"num_read_kb":2599,"num_write":647,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":501,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"264'221","reported_seq":867,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.776030+0000","last_change":"2024-09-14T11:54:11.776030+0000","last_active":"2024-09-14T11:54:11.776030+0000","last_peered":"2024-09-14T11:54:11.776030+0000","last_clean":"2024-09-14T11:54:11.776030+0000","last_became_active":"2024-09-14T11:09:45.206812+0000","last_became_peered":"2024-09-14T11:09:45.206812+0000","last_unstale":"2024-09-14T11:54:11.776030+0000","last_undegraded":"2024-09-14T11:54:11.776030+0000","last_fullsized":"2024-09-14T11:54:11.776030+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'221","last_scrub_stamp":"2024-09-14T11:54:11.775812+0000","last_deep_scrub":"264'221","last_deep_scrub_stamp":"2024-09-14T11:54:11.775812+0000","last_clean_scrub_stamp":"2024-09-14T11:54:11.775812+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:44.723127+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":566,"num_read_kb":32523,"num_write":996,"num_write_kb":41963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"264'854","reported_seq":2587,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:12.504366+0000","last_change":"2024-09-14T11:54:12.504111+0000","last_active":"2024-09-14T11:54:12.504366+0000","last_peered":"2024-09-14T11:54:12.504366+0000","last_clean":"2024-09-14T11:54:12.504366+0000","last_became_active":"2024-09-14T11:09:46.975135+0000","last_became_peered":"2024-09-14T11:09:46.975135+0000","last_unstale":"2024-09-14T11:54:12.504366+0000","last_undegraded":"2024-09-14T11:54:12.504366+0000","last_fullsized":"2024-09-14T11:54:12.504366+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'854","last_scrub_stamp":"2024-09-14T11:54:12.503845+0000","last_deep_scrub":"264'854","last_deep_scrub_stamp":"2024-09-14T11:54:12.503845+0000","last_clean_scrub_stamp":"2024-09-14T11:54:12.503845+0000","objects_scrubbed":4,"log_size":54,"log_dups_size":800,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:18.835875+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4353,"num_read_kb":3966,"num_write":1152,"num_write_kb":464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2705,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"264'182","reported_seq":790,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.665227+0000","last_change":"2024-09-14T11:54:07.665227+0000","last_active":"2024-09-14T11:54:07.665227+0000","last_peered":"2024-09-14T11:54:07.665227+0000","last_clean":"2024-09-14T11:54:07.665227+0000","last_became_active":"2024-09-14T11:09:45.208314+0000","last_became_peered":"2024-09-14T11:09:45.208314+0000","last_unstale":"2024-09-14T11:54:07.665227+0000","last_undegraded":"2024-09-14T11:54:07.665227+0000","last_fullsized":"2024-09-14T11:54:07.665227+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'182","last_scrub_stamp":"2024-09-14T11:54:07.665056+0000","last_deep_scrub":"264'182","last_deep_scrub_stamp":"2024-09-14T11:54:07.665056+0000","last_clean_scrub_stamp":"2024-09-14T11:54:07.665056+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:37.478334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":417,"num_read_kb":7778,"num_write":841,"num_write_kb":25761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"264'905","reported_seq":2671,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:16.634553+0000","last_change":"2024-09-14T11:54:16.634553+0000","last_active":"2024-09-14T11:54:16.634553+0000","last_peered":"2024-09-14T11:54:16.634553+0000","last_clean":"2024-09-14T11:54:16.634553+0000","last_became_active":"2024-09-14T11:09:46.995182+0000","last_became_peered":"2024-09-14T11:09:46.995182+0000","last_unstale":"2024-09-14T11:54:16.634553+0000","last_undegraded":"2024-09-14T11:54:16.634553+0000","last_fullsized":"2024-09-14T11:54:16.634553+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'905","last_scrub_stamp":"2024-09-14T11:54:16.634329+0000","last_deep_scrub":"264'905","last_deep_scrub_stamp":"2024-09-14T11:54:16.634329+0000","last_clean_scrub_stamp":"2024-09-14T11:54:16.634329+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":800,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:39.480551+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4411,"num_read_kb":3995,"num_write":1182,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2289,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"264'216","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:03.748922+0000","last_change":"2024-09-14T11:54:03.748922+0000","last_active":"2024-09-14T11:54:03.748922+0000","last_peered":"2024-09-14T11:54:03.748922+0000","last_clean":"2024-09-14T11:54:03.748922+0000","last_became_active":"2024-09-14T11:09:45.215301+0000","last_became_peered":"2024-09-14T11:09:45.215301+0000","last_unstale":"2024-09-14T11:54:03.748922+0000","last_undegraded":"2024-09-14T11:54:03.748922+0000","last_fullsized":"2024-09-14T11:54:03.748922+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'216","last_scrub_stamp":"2024-09-14T11:54:03.748839+0000","last_deep_scrub":"264'216","last_deep_scrub_stamp":"2024-09-14T11:54:03.748839+0000","last_clean_scrub_stamp":"2024-09-14T11:54:03.748839+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:24.385373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":450,"num_read_kb":16973,"num_write":902,"num_write_kb":40194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"264'435","reported_seq":1986,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.069899+0000","last_change":"2024-09-14T11:54:24.069899+0000","last_active":"2024-09-14T11:54:24.069899+0000","last_peered":"2024-09-14T11:54:24.069899+0000","last_clean":"2024-09-14T11:54:24.069899+0000","last_became_active":"2024-09-14T11:09:46.974465+0000","last_became_peered":"2024-09-14T11:09:46.974465+0000","last_unstale":"2024-09-14T11:54:24.069899+0000","last_undegraded":"2024-09-14T11:54:24.069899+0000","last_fullsized":"2024-09-14T11:54:24.069899+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'435","last_scrub_stamp":"2024-09-14T11:54:24.069714+0000","last_deep_scrub":"264'435","last_deep_scrub_stamp":"2024-09-14T11:54:24.069714+0000","last_clean_scrub_stamp":"2024-09-14T11:54:24.069714+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:39.322778+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2378,"num_read_kb":2237,"num_write":500,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":695,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"264'228","reported_seq":897,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.669285+0000","last_change":"2024-09-14T11:54:07.669285+0000","last_active":"2024-09-14T11:54:07.669285+0000","last_peered":"2024-09-14T11:54:07.669285+0000","last_clean":"2024-09-14T11:54:07.669285+0000","last_became_active":"2024-09-14T11:09:45.210875+0000","last_became_peered":"2024-09-14T11:09:45.210875+0000","last_unstale":"2024-09-14T11:54:07.669285+0000","last_undegraded":"2024-09-14T11:54:07.669285+0000","last_fullsized":"2024-09-14T11:54:07.669285+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'228","last_scrub_stamp":"2024-09-14T11:54:07.669103+0000","last_deep_scrub":"264'228","last_deep_scrub_stamp":"2024-09-14T11:54:07.669103+0000","last_clean_scrub_stamp":"2024-09-14T11:54:07.669103+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:09.366495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":591,"num_read_kb":73875,"num_write":1091,"num_write_kb":38947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"264'417","reported_seq":1953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.522720+0000","last_change":"2024-09-14T11:54:13.522720+0000","last_active":"2024-09-14T11:54:13.522720+0000","last_peered":"2024-09-14T11:54:13.522720+0000","last_clean":"2024-09-14T11:54:13.522720+0000","last_became_active":"2024-09-14T11:09:46.958694+0000","last_became_peered":"2024-09-14T11:09:46.958694+0000","last_unstale":"2024-09-14T11:54:13.522720+0000","last_undegraded":"2024-09-14T11:54:13.522720+0000","last_fullsized":"2024-09-14T11:54:13.522720+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'417","last_scrub_stamp":"2024-09-14T11:54:13.522502+0000","last_deep_scrub":"264'417","last_deep_scrub_stamp":"2024-09-14T11:54:13.522502+0000","last_clean_scrub_stamp":"2024-09-14T11:54:13.522502+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:46.905027+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2265,"num_read_kb":2144,"num_write":479,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"264'199","reported_seq":832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.589028+0000","last_change":"2024-09-14T11:54:09.588770+0000","last_active":"2024-09-14T11:54:09.589028+0000","last_peered":"2024-09-14T11:54:09.589028+0000","last_clean":"2024-09-14T11:54:09.589028+0000","last_became_active":"2024-09-14T11:09:45.220968+0000","last_became_peered":"2024-09-14T11:09:45.220968+0000","last_unstale":"2024-09-14T11:54:09.589028+0000","last_undegraded":"2024-09-14T11:54:09.589028+0000","last_fullsized":"2024-09-14T11:54:09.589028+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'199","last_scrub_stamp":"2024-09-14T11:54:09.588498+0000","last_deep_scrub":"264'199","last_deep_scrub_stamp":"2024-09-14T11:54:09.588498+0000","last_clean_scrub_stamp":"2024-09-14T11:54:09.588498+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:12.229625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":534,"num_read_kb":44269,"num_write":1000,"num_write_kb":27179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"264'137","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:25.903195+0000","last_change":"2024-09-14T11:54:25.903195+0000","last_active":"2024-09-14T11:54:25.903195+0000","last_peered":"2024-09-14T11:54:25.903195+0000","last_clean":"2024-09-14T11:54:25.903195+0000","last_became_active":"2024-09-14T11:09:55.026753+0000","last_became_peered":"2024-09-14T11:09:55.026753+0000","last_unstale":"2024-09-14T11:54:25.903195+0000","last_undegraded":"2024-09-14T11:54:25.903195+0000","last_fullsized":"2024-09-14T11:54:25.903195+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'137","last_scrub_stamp":"2024-09-14T11:54:25.903005+0000","last_deep_scrub":"264'137","last_deep_scrub_stamp":"2024-09-14T11:54:25.903005+0000","last_clean_scrub_stamp":"2024-09-14T11:54:25.903005+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:06.554690+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":178,"num_read_kb":167,"num_write":319,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"264'372","reported_seq":1911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.554559+0000","last_change":"2024-09-14T11:54:14.554395+0000","last_active":"2024-09-14T11:54:14.554559+0000","last_peered":"2024-09-14T11:54:14.554559+0000","last_clean":"2024-09-14T11:54:14.554559+0000","last_became_active":"2024-09-14T11:09:46.985016+0000","last_became_peered":"2024-09-14T11:09:46.985016+0000","last_unstale":"2024-09-14T11:54:14.554559+0000","last_undegraded":"2024-09-14T11:54:14.554559+0000","last_fullsized":"2024-09-14T11:54:14.554559+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-09-14T11:54:14.554182+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-09-14T11:54:14.554182+0000","last_clean_scrub_stamp":"2024-09-14T11:54:14.554182+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:51.209068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2187,"num_read_kb":2090,"num_write":422,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"264'250","reported_seq":901,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.768228+0000","last_change":"2024-09-14T11:54:11.768228+0000","last_active":"2024-09-14T11:54:11.768228+0000","last_peered":"2024-09-14T11:54:11.768228+0000","last_clean":"2024-09-14T11:54:11.768228+0000","last_became_active":"2024-09-14T11:09:45.208756+0000","last_became_peered":"2024-09-14T11:09:45.208756+0000","last_unstale":"2024-09-14T11:54:11.768228+0000","last_undegraded":"2024-09-14T11:54:11.768228+0000","last_fullsized":"2024-09-14T11:54:11.768228+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'250","last_scrub_stamp":"2024-09-14T11:54:11.767918+0000","last_deep_scrub":"264'250","last_deep_scrub_stamp":"2024-09-14T11:54:11.767918+0000","last_clean_scrub_stamp":"2024-09-14T11:54:11.767918+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:36.187167+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":600,"num_read_kb":30329,"num_write":1164,"num_write_kb":41189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:31.805903+0000","last_change":"2024-09-14T11:54:31.805903+0000","last_active":"2024-09-14T11:54:31.805903+0000","last_peered":"2024-09-14T11:54:31.805903+0000","last_clean":"2024-09-14T11:54:31.805903+0000","last_became_active":"2024-09-14T11:09:48.969807+0000","last_became_peered":"2024-09-14T11:09:48.969807+0000","last_unstale":"2024-09-14T11:54:31.805903+0000","last_undegraded":"2024-09-14T11:54:31.805903+0000","last_fullsized":"2024-09-14T11:54:31.805903+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:31.805726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:31.805726+0000","last_clean_scrub_stamp":"2024-09-14T11:54:31.805726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:56.392475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"264'201","reported_seq":809,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:31.009609+0000","last_change":"2024-09-14T11:54:31.009609+0000","last_active":"2024-09-14T11:54:31.009609+0000","last_peered":"2024-09-14T11:54:31.009609+0000","last_clean":"2024-09-14T11:54:31.009609+0000","last_became_active":"2024-09-14T11:09:50.988903+0000","last_became_peered":"2024-09-14T11:09:50.988903+0000","last_unstale":"2024-09-14T11:54:31.009609+0000","last_undegraded":"2024-09-14T11:54:31.009609+0000","last_fullsized":"2024-09-14T11:54:31.009609+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'201","last_scrub_stamp":"2024-09-14T11:54:31.009421+0000","last_deep_scrub":"264'201","last_deep_scrub_stamp":"2024-09-14T11:54:31.009421+0000","last_clean_scrub_stamp":"2024-09-14T11:54:31.009421+0000","objects_scrubbed":5,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:43.933742+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12630,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":269,"num_read_kb":381,"num_write":162,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:25.538478+0000","last_change":"2024-09-14T11:54:25.538478+0000","last_active":"2024-09-14T11:54:25.538478+0000","last_peered":"2024-09-14T11:54:25.538478+0000","last_clean":"2024-09-14T11:54:25.538478+0000","last_became_active":"2024-09-14T11:09:53.010617+0000","last_became_peered":"2024-09-14T11:09:53.010617+0000","last_unstale":"2024-09-14T11:54:25.538478+0000","last_undegraded":"2024-09-14T11:54:25.538478+0000","last_fullsized":"2024-09-14T11:54:25.538478+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:25.538278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:25.538278+0000","last_clean_scrub_stamp":"2024-09-14T11:54:25.538278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:45.387138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"264'142","reported_seq":646,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:31.643444+0000","last_change":"2024-09-14T11:54:31.643444+0000","last_active":"2024-09-14T11:54:31.643444+0000","last_peered":"2024-09-14T11:54:31.643444+0000","last_clean":"2024-09-14T11:54:31.643444+0000","last_became_active":"2024-09-14T11:09:55.020070+0000","last_became_peered":"2024-09-14T11:09:55.020070+0000","last_unstale":"2024-09-14T11:54:31.643444+0000","last_undegraded":"2024-09-14T11:54:31.643444+0000","last_fullsized":"2024-09-14T11:54:31.643444+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'142","last_scrub_stamp":"2024-09-14T11:54:31.643193+0000","last_deep_scrub":"264'142","last_deep_scrub_stamp":"2024-09-14T11:54:31.643193+0000","last_clean_scrub_stamp":"2024-09-14T11:54:31.643193+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:27.421218+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":142,"num_write":346,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"264'930","reported_seq":2720,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.921565+0000","last_change":"2024-09-14T11:54:24.921565+0000","last_active":"2024-09-14T11:54:24.921565+0000","last_peered":"2024-09-14T11:54:24.921565+0000","last_clean":"2024-09-14T11:54:24.921565+0000","last_became_active":"2024-09-14T11:09:46.957383+0000","last_became_peered":"2024-09-14T11:09:46.957383+0000","last_unstale":"2024-09-14T11:54:24.921565+0000","last_undegraded":"2024-09-14T11:54:24.921565+0000","last_fullsized":"2024-09-14T11:54:24.921565+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'930","last_scrub_stamp":"2024-09-14T11:54:24.921482+0000","last_deep_scrub":"264'930","last_deep_scrub_stamp":"2024-09-14T11:54:24.921482+0000","last_clean_scrub_stamp":"2024-09-14T11:54:24.921482+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":900,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:12.803564+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4732,"num_read_kb":4281,"num_write":1231,"num_write_kb":469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2680,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"264'210","reported_seq":866,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.580780+0000","last_change":"2024-09-14T11:54:10.580780+0000","last_active":"2024-09-14T11:54:10.580780+0000","last_peered":"2024-09-14T11:54:10.580780+0000","last_clean":"2024-09-14T11:54:10.580780+0000","last_became_active":"2024-09-14T11:09:45.220059+0000","last_became_peered":"2024-09-14T11:09:45.220059+0000","last_unstale":"2024-09-14T11:54:10.580780+0000","last_undegraded":"2024-09-14T11:54:10.580780+0000","last_fullsized":"2024-09-14T11:54:10.580780+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'210","last_scrub_stamp":"2024-09-14T11:54:10.580574+0000","last_deep_scrub":"264'210","last_deep_scrub_stamp":"2024-09-14T11:54:10.580574+0000","last_clean_scrub_stamp":"2024-09-14T11:54:10.580574+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:31.836630+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":639,"num_read_kb":15720,"num_write":940,"num_write_kb":28935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:21.798898+0000","last_change":"2024-09-14T11:54:21.798898+0000","last_active":"2024-09-14T11:54:21.798898+0000","last_peered":"2024-09-14T11:54:21.798898+0000","last_clean":"2024-09-14T11:54:21.798898+0000","last_became_active":"2024-09-14T11:09:48.950055+0000","last_became_peered":"2024-09-14T11:09:48.950055+0000","last_unstale":"2024-09-14T11:54:21.798898+0000","last_undegraded":"2024-09-14T11:54:21.798898+0000","last_fullsized":"2024-09-14T11:54:21.798898+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:21.798715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:21.798715+0000","last_clean_scrub_stamp":"2024-09-14T11:54:21.798715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:05.334882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"264'87","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.663075+0000","last_change":"2024-09-14T11:54:20.663075+0000","last_active":"2024-09-14T11:54:20.663075+0000","last_peered":"2024-09-14T11:54:20.663075+0000","last_clean":"2024-09-14T11:54:20.663075+0000","last_became_active":"2024-09-14T11:09:50.989174+0000","last_became_peered":"2024-09-14T11:09:50.989174+0000","last_unstale":"2024-09-14T11:54:20.663075+0000","last_undegraded":"2024-09-14T11:54:20.663075+0000","last_fullsized":"2024-09-14T11:54:20.663075+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'87","last_scrub_stamp":"2024-09-14T11:54:20.662891+0000","last_deep_scrub":"264'87","last_deep_scrub_stamp":"2024-09-14T11:54:20.662891+0000","last_clean_scrub_stamp":"2024-09-14T11:54:20.662891+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:41.721701+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":97,"num_read_kb":91,"num_write":68,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.580218+0000","last_change":"2024-09-14T11:54:28.580218+0000","last_active":"2024-09-14T11:54:28.580218+0000","last_peered":"2024-09-14T11:54:28.580218+0000","last_clean":"2024-09-14T11:54:28.580218+0000","last_became_active":"2024-09-14T11:09:53.018290+0000","last_became_peered":"2024-09-14T11:09:53.018290+0000","last_unstale":"2024-09-14T11:54:28.580218+0000","last_undegraded":"2024-09-14T11:54:28.580218+0000","last_fullsized":"2024-09-14T11:54:28.580218+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:28.580020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:28.580020+0000","last_clean_scrub_stamp":"2024-09-14T11:54:28.580020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:50:13.166036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"264'97","reported_seq":601,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:30.601328+0000","last_change":"2024-09-14T11:54:30.601180+0000","last_active":"2024-09-14T11:54:30.601328+0000","last_peered":"2024-09-14T11:54:30.601328+0000","last_clean":"2024-09-14T11:54:30.601328+0000","last_became_active":"2024-09-14T11:09:55.018855+0000","last_became_peered":"2024-09-14T11:09:55.018855+0000","last_unstale":"2024-09-14T11:54:30.601328+0000","last_undegraded":"2024-09-14T11:54:30.601328+0000","last_fullsized":"2024-09-14T11:54:30.601328+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'97","last_scrub_stamp":"2024-09-14T11:54:30.600983+0000","last_deep_scrub":"264'97","last_deep_scrub_stamp":"2024-09-14T11:54:30.600983+0000","last_clean_scrub_stamp":"2024-09-14T11:54:30.600983+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:09.359758+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":100,"num_read_kb":99,"num_write":210,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"264'509","reported_seq":2261,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:21.075552+0000","last_change":"2024-09-14T11:54:21.075552+0000","last_active":"2024-09-14T11:54:21.075552+0000","last_peered":"2024-09-14T11:54:21.075552+0000","last_clean":"2024-09-14T11:54:21.075552+0000","last_became_active":"2024-09-14T11:09:46.975175+0000","last_became_peered":"2024-09-14T11:09:46.975175+0000","last_unstale":"2024-09-14T11:54:21.075552+0000","last_undegraded":"2024-09-14T11:54:21.075552+0000","last_fullsized":"2024-09-14T11:54:21.075552+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'509","last_scrub_stamp":"2024-09-14T11:54:21.075332+0000","last_deep_scrub":"264'509","last_deep_scrub_stamp":"2024-09-14T11:54:21.075332+0000","last_clean_scrub_stamp":"2024-09-14T11:54:21.075332+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:30:29.486556+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2885,"num_read_kb":2717,"num_write":615,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2551,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"264'240","reported_seq":865,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.759266+0000","last_change":"2024-09-14T11:54:10.759266+0000","last_active":"2024-09-14T11:54:10.759266+0000","last_peered":"2024-09-14T11:54:10.759266+0000","last_clean":"2024-09-14T11:54:10.759266+0000","last_became_active":"2024-09-14T11:09:45.205019+0000","last_became_peered":"2024-09-14T11:09:45.205019+0000","last_unstale":"2024-09-14T11:54:10.759266+0000","last_undegraded":"2024-09-14T11:54:10.759266+0000","last_fullsized":"2024-09-14T11:54:10.759266+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'240","last_scrub_stamp":"2024-09-14T11:54:10.759003+0000","last_deep_scrub":"264'240","last_deep_scrub_stamp":"2024-09-14T11:54:10.759003+0000","last_clean_scrub_stamp":"2024-09-14T11:54:10.759003+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:54.898617+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":563,"num_read_kb":1571,"num_write":1129,"num_write_kb":22204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.843171+0000","last_change":"2024-09-14T11:54:22.843171+0000","last_active":"2024-09-14T11:54:22.843171+0000","last_peered":"2024-09-14T11:54:22.843171+0000","last_clean":"2024-09-14T11:54:22.843171+0000","last_became_active":"2024-09-14T11:09:48.950260+0000","last_became_peered":"2024-09-14T11:09:48.950260+0000","last_unstale":"2024-09-14T11:54:22.843171+0000","last_undegraded":"2024-09-14T11:54:22.843171+0000","last_fullsized":"2024-09-14T11:54:22.843171+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:22.842969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:22.842969+0000","last_clean_scrub_stamp":"2024-09-14T11:54:22.842969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:18.066946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"264'112","reported_seq":653,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.935779+0000","last_change":"2024-09-14T11:54:28.935779+0000","last_active":"2024-09-14T11:54:28.935779+0000","last_peered":"2024-09-14T11:54:28.935779+0000","last_clean":"2024-09-14T11:54:28.935779+0000","last_became_active":"2024-09-14T11:09:50.977685+0000","last_became_peered":"2024-09-14T11:09:50.977685+0000","last_unstale":"2024-09-14T11:54:28.935779+0000","last_undegraded":"2024-09-14T11:54:28.935779+0000","last_fullsized":"2024-09-14T11:54:28.935779+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'112","last_scrub_stamp":"2024-09-14T11:54:28.935608+0000","last_deep_scrub":"264'112","last_deep_scrub_stamp":"2024-09-14T11:54:28.935608+0000","last_clean_scrub_stamp":"2024-09-14T11:54:28.935608+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:22.551848+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"264'790","reported_seq":2377,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:44.718355+0000","last_change":"2024-09-14T11:54:44.718355+0000","last_active":"2024-09-14T11:54:44.718355+0000","last_peered":"2024-09-14T11:54:44.718355+0000","last_clean":"2024-09-14T11:54:44.718355+0000","last_became_active":"2024-09-14T11:09:53.021212+0000","last_became_peered":"2024-09-14T11:09:53.021212+0000","last_unstale":"2024-09-14T11:54:44.718355+0000","last_undegraded":"2024-09-14T11:54:44.718355+0000","last_fullsized":"2024-09-14T11:54:44.718355+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'790","last_scrub_stamp":"2024-09-14T11:54:44.718156+0000","last_deep_scrub":"264'790","last_deep_scrub_stamp":"2024-09-14T11:54:44.718156+0000","last_clean_scrub_stamp":"2024-09-14T11:54:44.718156+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:05.765569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"264'225","reported_seq":1069,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:31.300882+0000","last_change":"2024-09-14T11:54:31.300319+0000","last_active":"2024-09-14T11:54:31.300882+0000","last_peered":"2024-09-14T11:54:31.300882+0000","last_clean":"2024-09-14T11:54:31.300882+0000","last_became_active":"2024-09-14T11:09:55.013994+0000","last_became_peered":"2024-09-14T11:09:55.013994+0000","last_unstale":"2024-09-14T11:54:31.300882+0000","last_undegraded":"2024-09-14T11:54:31.300882+0000","last_fullsized":"2024-09-14T11:54:31.300882+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'225","last_scrub_stamp":"2024-09-14T11:54:31.300089+0000","last_deep_scrub":"264'225","last_deep_scrub_stamp":"2024-09-14T11:54:31.300089+0000","last_clean_scrub_stamp":"2024-09-14T11:54:31.300089+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:50.141514+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":446,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":657,"num_read_kb":640,"num_write":481,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"264'1913","reported_seq":3557,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.077459+0000","last_change":"2024-09-14T11:54:19.077459+0000","last_active":"2024-09-14T11:54:19.077459+0000","last_peered":"2024-09-14T11:54:19.077459+0000","last_clean":"2024-09-14T11:54:19.077459+0000","last_became_active":"2024-09-14T11:09:46.994623+0000","last_became_peered":"2024-09-14T11:09:46.994623+0000","last_unstale":"2024-09-14T11:54:19.077459+0000","last_undegraded":"2024-09-14T11:54:19.077459+0000","last_fullsized":"2024-09-14T11:54:19.077459+0000","mapping_epoch":25,"log_start":"264'1900","ondisk_log_start":"264'1900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1913","last_scrub_stamp":"2024-09-14T11:54:19.077195+0000","last_deep_scrub":"264'1913","last_deep_scrub_stamp":"2024-09-14T11:54:19.077195+0000","last_clean_scrub_stamp":"2024-09-14T11:54:19.077195+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":1900,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:38.527036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8495,"num_read_kb":7411,"num_write":2703,"num_write_kb":1197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"264'221","reported_seq":859,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.632086+0000","last_change":"2024-09-14T11:54:06.631924+0000","last_active":"2024-09-14T11:54:06.632086+0000","last_peered":"2024-09-14T11:54:06.632086+0000","last_clean":"2024-09-14T11:54:06.632086+0000","last_became_active":"2024-09-14T11:09:45.208282+0000","last_became_peered":"2024-09-14T11:09:45.208282+0000","last_unstale":"2024-09-14T11:54:06.632086+0000","last_undegraded":"2024-09-14T11:54:06.632086+0000","last_fullsized":"2024-09-14T11:54:06.632086+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'221","last_scrub_stamp":"2024-09-14T11:54:06.631656+0000","last_deep_scrub":"264'221","last_deep_scrub_stamp":"2024-09-14T11:54:06.631656+0000","last_clean_scrub_stamp":"2024-09-14T11:54:06.631656+0000","objects_scrubbed":8,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:03.012784+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5850204,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":521,"num_read_kb":14610,"num_write":976,"num_write_kb":27594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:34.741772+0000","last_change":"2024-09-14T11:54:34.741772+0000","last_active":"2024-09-14T11:54:34.741772+0000","last_peered":"2024-09-14T11:54:34.741772+0000","last_clean":"2024-09-14T11:54:34.741772+0000","last_became_active":"2024-09-14T11:09:48.959355+0000","last_became_peered":"2024-09-14T11:09:48.959355+0000","last_unstale":"2024-09-14T11:54:34.741772+0000","last_undegraded":"2024-09-14T11:54:34.741772+0000","last_fullsized":"2024-09-14T11:54:34.741772+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:34.741596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:34.741596+0000","last_clean_scrub_stamp":"2024-09-14T11:54:34.741596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:27.337576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"264'124","reported_seq":701,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.337531+0000","last_change":"2024-09-14T11:54:22.337531+0000","last_active":"2024-09-14T11:54:22.337531+0000","last_peered":"2024-09-14T11:54:22.337531+0000","last_clean":"2024-09-14T11:54:22.337531+0000","last_became_active":"2024-09-14T11:09:50.984035+0000","last_became_peered":"2024-09-14T11:09:50.984035+0000","last_unstale":"2024-09-14T11:54:22.337531+0000","last_undegraded":"2024-09-14T11:54:22.337531+0000","last_fullsized":"2024-09-14T11:54:22.337531+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-09-14T11:54:22.337342+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-09-14T11:54:22.337342+0000","last_clean_scrub_stamp":"2024-09-14T11:54:22.337342+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:46.850427+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":160,"num_read_kb":234,"num_write":82,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"264'803","reported_seq":2141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:34.063279+0000","last_change":"2024-09-14T11:54:34.063279+0000","last_active":"2024-09-14T11:54:34.063279+0000","last_peered":"2024-09-14T11:54:34.063279+0000","last_clean":"2024-09-14T11:54:34.063279+0000","last_became_active":"2024-09-14T11:09:53.004265+0000","last_became_peered":"2024-09-14T11:09:53.004265+0000","last_unstale":"2024-09-14T11:54:34.063279+0000","last_undegraded":"2024-09-14T11:54:34.063279+0000","last_fullsized":"2024-09-14T11:54:34.063279+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'803","last_scrub_stamp":"2024-09-14T11:54:34.063096+0000","last_deep_scrub":"264'803","last_deep_scrub_stamp":"2024-09-14T11:54:34.063096+0000","last_clean_scrub_stamp":"2024-09-14T11:54:34.063096+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:05.814740+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"264'523","reported_seq":2240,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.909509+0000","last_change":"2024-09-14T11:54:20.909509+0000","last_active":"2024-09-14T11:54:20.909509+0000","last_peered":"2024-09-14T11:54:20.909509+0000","last_clean":"2024-09-14T11:54:20.909509+0000","last_became_active":"2024-09-14T11:09:46.962838+0000","last_became_peered":"2024-09-14T11:09:46.962838+0000","last_unstale":"2024-09-14T11:54:20.909509+0000","last_undegraded":"2024-09-14T11:54:20.909509+0000","last_fullsized":"2024-09-14T11:54:20.909509+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'523","last_scrub_stamp":"2024-09-14T11:54:20.909319+0000","last_deep_scrub":"264'523","last_deep_scrub_stamp":"2024-09-14T11:54:20.909319+0000","last_clean_scrub_stamp":"2024-09-14T11:54:20.909319+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":500,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:08.391964+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2791,"num_read_kb":2616,"num_write":587,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"264'281","reported_seq":952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.716583+0000","last_change":"2024-09-14T11:54:04.716443+0000","last_active":"2024-09-14T11:54:04.716583+0000","last_peered":"2024-09-14T11:54:04.716583+0000","last_clean":"2024-09-14T11:54:04.716583+0000","last_became_active":"2024-09-14T11:09:45.219674+0000","last_became_peered":"2024-09-14T11:09:45.219674+0000","last_unstale":"2024-09-14T11:54:04.716583+0000","last_undegraded":"2024-09-14T11:54:04.716583+0000","last_fullsized":"2024-09-14T11:54:04.716583+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'281","last_scrub_stamp":"2024-09-14T11:54:04.716246+0000","last_deep_scrub":"264'281","last_deep_scrub_stamp":"2024-09-14T11:54:04.716246+0000","last_clean_scrub_stamp":"2024-09-14T11:54:04.716246+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:35:04.002963+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":701,"num_read_kb":41266,"num_write":1220,"num_write_kb":49932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.565431+0000","last_change":"2024-09-14T11:54:14.565431+0000","last_active":"2024-09-14T11:54:14.565431+0000","last_peered":"2024-09-14T11:54:14.565431+0000","last_clean":"2024-09-14T11:54:14.565431+0000","last_became_active":"2024-09-14T11:09:48.958254+0000","last_became_peered":"2024-09-14T11:09:48.958254+0000","last_unstale":"2024-09-14T11:54:14.565431+0000","last_undegraded":"2024-09-14T11:54:14.565431+0000","last_fullsized":"2024-09-14T11:54:14.565431+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:14.565263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:14.565263+0000","last_clean_scrub_stamp":"2024-09-14T11:54:14.565263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:53.252174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"264'200","reported_seq":812,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:23.925778+0000","last_change":"2024-09-14T11:54:23.925778+0000","last_active":"2024-09-14T11:54:23.925778+0000","last_peered":"2024-09-14T11:54:23.925778+0000","last_clean":"2024-09-14T11:54:23.925778+0000","last_became_active":"2024-09-14T11:09:50.992673+0000","last_became_peered":"2024-09-14T11:09:50.992673+0000","last_unstale":"2024-09-14T11:54:23.925778+0000","last_undegraded":"2024-09-14T11:54:23.925778+0000","last_fullsized":"2024-09-14T11:54:23.925778+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'200","last_scrub_stamp":"2024-09-14T11:54:23.925583+0000","last_deep_scrub":"264'200","last_deep_scrub_stamp":"2024-09-14T11:54:23.925583+0000","last_clean_scrub_stamp":"2024-09-14T11:54:23.925583+0000","objects_scrubbed":9,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:04.720524+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11263,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":273,"num_read_kb":325,"num_write":154,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.601458+0000","last_change":"2024-09-14T11:54:28.601326+0000","last_active":"2024-09-14T11:54:28.601458+0000","last_peered":"2024-09-14T11:54:28.601458+0000","last_clean":"2024-09-14T11:54:28.601458+0000","last_became_active":"2024-09-14T11:09:53.007694+0000","last_became_peered":"2024-09-14T11:09:53.007694+0000","last_unstale":"2024-09-14T11:54:28.601458+0000","last_undegraded":"2024-09-14T11:54:28.601458+0000","last_fullsized":"2024-09-14T11:54:28.601458+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:28.601148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:28.601148+0000","last_clean_scrub_stamp":"2024-09-14T11:54:28.601148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:31.854054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"264'569","reported_seq":1411,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:25.318804+0000","last_change":"2024-09-14T11:54:25.318804+0000","last_active":"2024-09-14T11:54:25.318804+0000","last_peered":"2024-09-14T11:54:25.318804+0000","last_clean":"2024-09-14T11:54:25.318804+0000","last_became_active":"2024-09-14T11:09:55.030659+0000","last_became_peered":"2024-09-14T11:09:55.030659+0000","last_unstale":"2024-09-14T11:54:25.318804+0000","last_undegraded":"2024-09-14T11:54:25.318804+0000","last_fullsized":"2024-09-14T11:54:25.318804+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'569","last_scrub_stamp":"2024-09-14T11:54:25.318519+0000","last_deep_scrub":"264'569","last_deep_scrub_stamp":"2024-09-14T11:54:25.318519+0000","last_clean_scrub_stamp":"2024-09-14T11:54:25.318519+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":500,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:14.986669+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1371,"num_read_kb":1346,"num_write":1205,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"264'1072","reported_seq":2650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.617875+0000","last_change":"2024-09-14T11:54:08.617875+0000","last_active":"2024-09-14T11:54:08.617875+0000","last_peered":"2024-09-14T11:54:08.617875+0000","last_clean":"2024-09-14T11:54:08.617875+0000","last_became_active":"2024-09-14T11:09:46.990046+0000","last_became_peered":"2024-09-14T11:09:46.990046+0000","last_unstale":"2024-09-14T11:54:08.617875+0000","last_undegraded":"2024-09-14T11:54:08.617875+0000","last_fullsized":"2024-09-14T11:54:08.617875+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1072","last_scrub_stamp":"2024-09-14T11:54:08.617699+0000","last_deep_scrub":"264'1072","last_deep_scrub_stamp":"2024-09-14T11:54:08.617699+0000","last_clean_scrub_stamp":"2024-09-14T11:54:08.617699+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":1000,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:02.219078+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5673,"num_read_kb":5118,"num_write":1579,"num_write_kb":694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"264'267","reported_seq":973,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:03.349328+0000","last_change":"2024-09-14T11:54:03.349250+0000","last_active":"2024-09-14T11:54:03.349328+0000","last_peered":"2024-09-14T11:54:03.349328+0000","last_clean":"2024-09-14T11:54:03.349328+0000","last_became_active":"2024-09-14T11:09:45.210020+0000","last_became_peered":"2024-09-14T11:09:45.210020+0000","last_unstale":"2024-09-14T11:54:03.349328+0000","last_undegraded":"2024-09-14T11:54:03.349328+0000","last_fullsized":"2024-09-14T11:54:03.349328+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'267","last_scrub_stamp":"2024-09-14T11:54:03.349170+0000","last_deep_scrub":"264'267","last_deep_scrub_stamp":"2024-09-14T11:54:03.349170+0000","last_clean_scrub_stamp":"2024-09-14T11:54:03.349170+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:32.965016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":888,"num_read_kb":725,"num_write":1131,"num_write_kb":36716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.609158+0000","last_change":"2024-09-14T11:54:17.609158+0000","last_active":"2024-09-14T11:54:17.609158+0000","last_peered":"2024-09-14T11:54:17.609158+0000","last_clean":"2024-09-14T11:54:17.609158+0000","last_became_active":"2024-09-14T11:09:48.973945+0000","last_became_peered":"2024-09-14T11:09:48.973945+0000","last_unstale":"2024-09-14T11:54:17.609158+0000","last_undegraded":"2024-09-14T11:54:17.609158+0000","last_fullsized":"2024-09-14T11:54:17.609158+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:17.608988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:17.608988+0000","last_clean_scrub_stamp":"2024-09-14T11:54:17.608988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:32.743186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"264'146","reported_seq":722,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.897457+0000","last_change":"2024-09-14T11:54:26.897298+0000","last_active":"2024-09-14T11:54:26.897457+0000","last_peered":"2024-09-14T11:54:26.897457+0000","last_clean":"2024-09-14T11:54:26.897457+0000","last_became_active":"2024-09-14T11:09:50.985800+0000","last_became_peered":"2024-09-14T11:09:50.985800+0000","last_unstale":"2024-09-14T11:54:26.897457+0000","last_undegraded":"2024-09-14T11:54:26.897457+0000","last_fullsized":"2024-09-14T11:54:26.897457+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'146","last_scrub_stamp":"2024-09-14T11:54:26.897102+0000","last_deep_scrub":"264'146","last_deep_scrub_stamp":"2024-09-14T11:54:26.897102+0000","last_clean_scrub_stamp":"2024-09-14T11:54:26.897102+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:12.702052+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14744,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":268,"num_write":96,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:34.950458+0000","last_change":"2024-09-14T11:54:34.950458+0000","last_active":"2024-09-14T11:54:34.950458+0000","last_peered":"2024-09-14T11:54:34.950458+0000","last_clean":"2024-09-14T11:54:34.950458+0000","last_became_active":"2024-09-14T11:09:53.002739+0000","last_became_peered":"2024-09-14T11:09:53.002739+0000","last_unstale":"2024-09-14T11:54:34.950458+0000","last_undegraded":"2024-09-14T11:54:34.950458+0000","last_fullsized":"2024-09-14T11:54:34.950458+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:34.950258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:34.950258+0000","last_clean_scrub_stamp":"2024-09-14T11:54:34.950258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:49.224667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"264'2504","reported_seq":4379,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:30.610057+0000","last_change":"2024-09-14T11:54:30.610057+0000","last_active":"2024-09-14T11:54:30.610057+0000","last_peered":"2024-09-14T11:54:30.610057+0000","last_clean":"2024-09-14T11:54:30.610057+0000","last_became_active":"2024-09-14T11:09:55.017307+0000","last_became_peered":"2024-09-14T11:09:55.017307+0000","last_unstale":"2024-09-14T11:54:30.610057+0000","last_undegraded":"2024-09-14T11:54:30.610057+0000","last_fullsized":"2024-09-14T11:54:30.610057+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2504","last_scrub_stamp":"2024-09-14T11:54:30.609835+0000","last_deep_scrub":"264'2504","last_deep_scrub_stamp":"2024-09-14T11:54:30.609835+0000","last_clean_scrub_stamp":"2024-09-14T11:54:30.609835+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":2400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:45:31.699682+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6356,"num_read_kb":6314,"num_write":5042,"num_write_kb":1853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"264'347","reported_seq":1764,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.365181+0000","last_change":"2024-09-14T11:54:08.365181+0000","last_active":"2024-09-14T11:54:08.365181+0000","last_peered":"2024-09-14T11:54:08.365181+0000","last_clean":"2024-09-14T11:54:08.365181+0000","last_became_active":"2024-09-14T11:09:46.952951+0000","last_became_peered":"2024-09-14T11:09:46.952951+0000","last_unstale":"2024-09-14T11:54:08.365181+0000","last_undegraded":"2024-09-14T11:54:08.365181+0000","last_fullsized":"2024-09-14T11:54:08.365181+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'347","last_scrub_stamp":"2024-09-14T11:54:08.364954+0000","last_deep_scrub":"264'347","last_deep_scrub_stamp":"2024-09-14T11:54:08.364954+0000","last_clean_scrub_stamp":"2024-09-14T11:54:08.364954+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:07.453326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1860,"num_read_kb":1783,"num_write":380,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"264'226","reported_seq":871,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.749608+0000","last_change":"2024-09-14T11:54:09.749433+0000","last_active":"2024-09-14T11:54:09.749608+0000","last_peered":"2024-09-14T11:54:09.749608+0000","last_clean":"2024-09-14T11:54:09.749608+0000","last_became_active":"2024-09-14T11:09:45.211217+0000","last_became_peered":"2024-09-14T11:09:45.211217+0000","last_unstale":"2024-09-14T11:54:09.749608+0000","last_undegraded":"2024-09-14T11:54:09.749608+0000","last_fullsized":"2024-09-14T11:54:09.749608+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'226","last_scrub_stamp":"2024-09-14T11:54:09.749200+0000","last_deep_scrub":"264'226","last_deep_scrub_stamp":"2024-09-14T11:54:09.749200+0000","last_clean_scrub_stamp":"2024-09-14T11:54:09.749200+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:53.881634+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":600,"num_read_kb":7544,"num_write":1094,"num_write_kb":12612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.066291+0000","last_change":"2024-09-14T11:54:27.066124+0000","last_active":"2024-09-14T11:54:27.066291+0000","last_peered":"2024-09-14T11:54:27.066291+0000","last_clean":"2024-09-14T11:54:27.066291+0000","last_became_active":"2024-09-14T11:09:48.957275+0000","last_became_peered":"2024-09-14T11:09:48.957275+0000","last_unstale":"2024-09-14T11:54:27.066291+0000","last_undegraded":"2024-09-14T11:54:27.066291+0000","last_fullsized":"2024-09-14T11:54:27.066291+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:27.065940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:27.065940+0000","last_clean_scrub_stamp":"2024-09-14T11:54:27.065940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:31.779734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"264'178","reported_seq":765,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:37.759839+0000","last_change":"2024-09-14T11:54:37.759839+0000","last_active":"2024-09-14T11:54:37.759839+0000","last_peered":"2024-09-14T11:54:37.759839+0000","last_clean":"2024-09-14T11:54:37.759839+0000","last_became_active":"2024-09-14T11:09:50.999759+0000","last_became_peered":"2024-09-14T11:09:50.999759+0000","last_unstale":"2024-09-14T11:54:37.759839+0000","last_undegraded":"2024-09-14T11:54:37.759839+0000","last_fullsized":"2024-09-14T11:54:37.759839+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'178","last_scrub_stamp":"2024-09-14T11:54:37.759617+0000","last_deep_scrub":"264'178","last_deep_scrub_stamp":"2024-09-14T11:54:37.759617+0000","last_clean_scrub_stamp":"2024-09-14T11:54:37.759617+0000","objects_scrubbed":8,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:44.576561+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6528,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":216,"num_read_kb":266,"num_write":126,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"264'803","reported_seq":2359,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:33.083119+0000","last_change":"2024-09-14T11:54:33.083119+0000","last_active":"2024-09-14T11:54:33.083119+0000","last_peered":"2024-09-14T11:54:33.083119+0000","last_clean":"2024-09-14T11:54:33.083119+0000","last_became_active":"2024-09-14T11:09:53.002667+0000","last_became_peered":"2024-09-14T11:09:53.002667+0000","last_unstale":"2024-09-14T11:54:33.083119+0000","last_undegraded":"2024-09-14T11:54:33.083119+0000","last_fullsized":"2024-09-14T11:54:33.083119+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'803","last_scrub_stamp":"2024-09-14T11:54:33.082941+0000","last_deep_scrub":"264'803","last_deep_scrub_stamp":"2024-09-14T11:54:33.082941+0000","last_clean_scrub_stamp":"2024-09-14T11:54:33.082941+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:12.117497+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"264'127","reported_seq":628,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:29.612334+0000","last_change":"2024-09-14T11:54:29.612334+0000","last_active":"2024-09-14T11:54:29.612334+0000","last_peered":"2024-09-14T11:54:29.612334+0000","last_clean":"2024-09-14T11:54:29.612334+0000","last_became_active":"2024-09-14T11:09:55.016802+0000","last_became_peered":"2024-09-14T11:09:55.016802+0000","last_unstale":"2024-09-14T11:54:29.612334+0000","last_undegraded":"2024-09-14T11:54:29.612334+0000","last_fullsized":"2024-09-14T11:54:29.612334+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'127","last_scrub_stamp":"2024-09-14T11:54:29.612082+0000","last_deep_scrub":"264'127","last_deep_scrub_stamp":"2024-09-14T11:54:29.612082+0000","last_clean_scrub_stamp":"2024-09-14T11:54:29.612082+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:14:18.130706+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":820,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":114,"num_write":311,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"264'748","reported_seq":2285,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.054358+0000","last_change":"2024-09-14T11:54:18.054187+0000","last_active":"2024-09-14T11:54:18.054358+0000","last_peered":"2024-09-14T11:54:18.054358+0000","last_clean":"2024-09-14T11:54:18.054358+0000","last_became_active":"2024-09-14T11:09:46.987523+0000","last_became_peered":"2024-09-14T11:09:46.987523+0000","last_unstale":"2024-09-14T11:54:18.054358+0000","last_undegraded":"2024-09-14T11:54:18.054358+0000","last_fullsized":"2024-09-14T11:54:18.054358+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'748","last_scrub_stamp":"2024-09-14T11:54:18.054011+0000","last_deep_scrub":"264'748","last_deep_scrub_stamp":"2024-09-14T11:54:18.054011+0000","last_clean_scrub_stamp":"2024-09-14T11:54:18.054011+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:45.880403+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3699,"num_read_kb":3347,"num_write":991,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"264'240","reported_seq":900,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:01.721100+0000","last_change":"2024-09-14T11:54:01.721039+0000","last_active":"2024-09-14T11:54:01.721100+0000","last_peered":"2024-09-14T11:54:01.721100+0000","last_clean":"2024-09-14T11:54:01.721100+0000","last_became_active":"2024-09-14T11:09:45.213648+0000","last_became_peered":"2024-09-14T11:09:45.213648+0000","last_unstale":"2024-09-14T11:54:01.721100+0000","last_undegraded":"2024-09-14T11:54:01.721100+0000","last_fullsized":"2024-09-14T11:54:01.721100+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'240","last_scrub_stamp":"2024-09-14T11:54:01.720967+0000","last_deep_scrub":"264'240","last_deep_scrub_stamp":"2024-09-14T11:54:01.720967+0000","last_clean_scrub_stamp":"2024-09-14T11:54:01.720967+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:13.876519+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1830584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":598,"num_read_kb":9438,"num_write":1111,"num_write_kb":42718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.656620+0000","last_change":"2024-09-14T11:54:18.656620+0000","last_active":"2024-09-14T11:54:18.656620+0000","last_peered":"2024-09-14T11:54:18.656620+0000","last_clean":"2024-09-14T11:54:18.656620+0000","last_became_active":"2024-09-14T11:09:48.965014+0000","last_became_peered":"2024-09-14T11:09:48.965014+0000","last_unstale":"2024-09-14T11:54:18.656620+0000","last_undegraded":"2024-09-14T11:54:18.656620+0000","last_fullsized":"2024-09-14T11:54:18.656620+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:18.656437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:18.656437+0000","last_clean_scrub_stamp":"2024-09-14T11:54:18.656437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:47.603996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"264'206","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:29.972634+0000","last_change":"2024-09-14T11:54:29.972634+0000","last_active":"2024-09-14T11:54:29.972634+0000","last_peered":"2024-09-14T11:54:29.972634+0000","last_clean":"2024-09-14T11:54:29.972634+0000","last_became_active":"2024-09-14T11:09:50.988991+0000","last_became_peered":"2024-09-14T11:09:50.988991+0000","last_unstale":"2024-09-14T11:54:29.972634+0000","last_undegraded":"2024-09-14T11:54:29.972634+0000","last_fullsized":"2024-09-14T11:54:29.972634+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'206","last_scrub_stamp":"2024-09-14T11:54:29.972424+0000","last_deep_scrub":"264'206","last_deep_scrub_stamp":"2024-09-14T11:54:29.972424+0000","last_clean_scrub_stamp":"2024-09-14T11:54:29.972424+0000","objects_scrubbed":6,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:17.229395+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16480,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":287,"num_read_kb":450,"num_write":148,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:31.073151+0000","last_change":"2024-09-14T11:54:31.073151+0000","last_active":"2024-09-14T11:54:31.073151+0000","last_peered":"2024-09-14T11:54:31.073151+0000","last_clean":"2024-09-14T11:54:31.073151+0000","last_became_active":"2024-09-14T11:09:53.010817+0000","last_became_peered":"2024-09-14T11:09:53.010817+0000","last_unstale":"2024-09-14T11:54:31.073151+0000","last_undegraded":"2024-09-14T11:54:31.073151+0000","last_fullsized":"2024-09-14T11:54:31.073151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:31.072969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:31.072969+0000","last_clean_scrub_stamp":"2024-09-14T11:54:31.072969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:25.026070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"264'119","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.389012+0000","last_change":"2024-09-14T11:54:28.389012+0000","last_active":"2024-09-14T11:54:28.389012+0000","last_peered":"2024-09-14T11:54:28.389012+0000","last_clean":"2024-09-14T11:54:28.389012+0000","last_became_active":"2024-09-14T11:09:55.025490+0000","last_became_peered":"2024-09-14T11:09:55.025490+0000","last_unstale":"2024-09-14T11:54:28.389012+0000","last_undegraded":"2024-09-14T11:54:28.389012+0000","last_fullsized":"2024-09-14T11:54:28.389012+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'119","last_scrub_stamp":"2024-09-14T11:54:28.388783+0000","last_deep_scrub":"264'119","last_deep_scrub_stamp":"2024-09-14T11:54:28.388783+0000","last_clean_scrub_stamp":"2024-09-14T11:54:28.388783+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:34.167171+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":533,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":108,"num_write":255,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"264'476","reported_seq":2031,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.703428+0000","last_change":"2024-09-14T11:54:08.703197+0000","last_active":"2024-09-14T11:54:08.703428+0000","last_peered":"2024-09-14T11:54:08.703428+0000","last_clean":"2024-09-14T11:54:08.703428+0000","last_became_active":"2024-09-14T11:09:46.970824+0000","last_became_peered":"2024-09-14T11:09:46.970824+0000","last_unstale":"2024-09-14T11:54:08.703428+0000","last_undegraded":"2024-09-14T11:54:08.703428+0000","last_fullsized":"2024-09-14T11:54:08.703428+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'476","last_scrub_stamp":"2024-09-14T11:54:08.702969+0000","last_deep_scrub":"264'476","last_deep_scrub_stamp":"2024-09-14T11:54:08.702969+0000","last_clean_scrub_stamp":"2024-09-14T11:54:08.702969+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:56.765104+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2551,"num_read_kb":2376,"num_write":583,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"264'199","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.232964+0000","last_change":"2024-09-14T11:54:05.232828+0000","last_active":"2024-09-14T11:54:05.232964+0000","last_peered":"2024-09-14T11:54:05.232964+0000","last_clean":"2024-09-14T11:54:05.232964+0000","last_became_active":"2024-09-14T11:09:45.216305+0000","last_became_peered":"2024-09-14T11:09:45.216305+0000","last_unstale":"2024-09-14T11:54:05.232964+0000","last_undegraded":"2024-09-14T11:54:05.232964+0000","last_fullsized":"2024-09-14T11:54:05.232964+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'199","last_scrub_stamp":"2024-09-14T11:54:05.232517+0000","last_deep_scrub":"264'199","last_deep_scrub_stamp":"2024-09-14T11:54:05.232517+0000","last_clean_scrub_stamp":"2024-09-14T11:54:05.232517+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:34.729977+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655887,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":432,"num_read_kb":2004,"num_write":918,"num_write_kb":29719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.349061+0000","last_change":"2024-09-14T11:54:19.348901+0000","last_active":"2024-09-14T11:54:19.349061+0000","last_peered":"2024-09-14T11:54:19.349061+0000","last_clean":"2024-09-14T11:54:19.349061+0000","last_became_active":"2024-09-14T11:09:48.968263+0000","last_became_peered":"2024-09-14T11:09:48.968263+0000","last_unstale":"2024-09-14T11:54:19.349061+0000","last_undegraded":"2024-09-14T11:54:19.349061+0000","last_fullsized":"2024-09-14T11:54:19.349061+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:19.348715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:19.348715+0000","last_clean_scrub_stamp":"2024-09-14T11:54:19.348715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:01.380009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"264'151","reported_seq":731,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.524575+0000","last_change":"2024-09-14T11:54:24.524478+0000","last_active":"2024-09-14T11:54:24.524575+0000","last_peered":"2024-09-14T11:54:24.524575+0000","last_clean":"2024-09-14T11:54:24.524575+0000","last_became_active":"2024-09-14T11:09:50.998098+0000","last_became_peered":"2024-09-14T11:09:50.998098+0000","last_unstale":"2024-09-14T11:54:24.524575+0000","last_undegraded":"2024-09-14T11:54:24.524575+0000","last_fullsized":"2024-09-14T11:54:24.524575+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'151","last_scrub_stamp":"2024-09-14T11:54:24.524363+0000","last_deep_scrub":"264'151","last_deep_scrub_stamp":"2024-09-14T11:54:24.524363+0000","last_clean_scrub_stamp":"2024-09-14T11:54:24.524363+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:00.427318+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10966,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":215,"num_read_kb":296,"num_write":168,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:25.315761+0000","last_change":"2024-09-14T11:54:25.315628+0000","last_active":"2024-09-14T11:54:25.315761+0000","last_peered":"2024-09-14T11:54:25.315761+0000","last_clean":"2024-09-14T11:54:25.315761+0000","last_became_active":"2024-09-14T11:09:53.003759+0000","last_became_peered":"2024-09-14T11:09:53.003759+0000","last_unstale":"2024-09-14T11:54:25.315761+0000","last_undegraded":"2024-09-14T11:54:25.315761+0000","last_fullsized":"2024-09-14T11:54:25.315761+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:25.315450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:25.315450+0000","last_clean_scrub_stamp":"2024-09-14T11:54:25.315450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:53.076672+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"264'128","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:35.116168+0000","last_change":"2024-09-14T11:54:35.116168+0000","last_active":"2024-09-14T11:54:35.116168+0000","last_peered":"2024-09-14T11:54:35.116168+0000","last_clean":"2024-09-14T11:54:35.116168+0000","last_became_active":"2024-09-14T11:09:55.033844+0000","last_became_peered":"2024-09-14T11:09:55.033844+0000","last_unstale":"2024-09-14T11:54:35.116168+0000","last_undegraded":"2024-09-14T11:54:35.116168+0000","last_fullsized":"2024-09-14T11:54:35.116168+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'128","last_scrub_stamp":"2024-09-14T11:54:35.115901+0000","last_deep_scrub":"264'128","last_deep_scrub_stamp":"2024-09-14T11:54:35.115901+0000","last_clean_scrub_stamp":"2024-09-14T11:54:35.115901+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:16.357126+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":100,"num_write":302,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"264'542","reported_seq":2222,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:21.889174+0000","last_change":"2024-09-14T11:54:21.889015+0000","last_active":"2024-09-14T11:54:21.889174+0000","last_peered":"2024-09-14T11:54:21.889174+0000","last_clean":"2024-09-14T11:54:21.889174+0000","last_became_active":"2024-09-14T11:09:46.961100+0000","last_became_peered":"2024-09-14T11:09:46.961100+0000","last_unstale":"2024-09-14T11:54:21.889174+0000","last_undegraded":"2024-09-14T11:54:21.889174+0000","last_fullsized":"2024-09-14T11:54:21.889174+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'542","last_scrub_stamp":"2024-09-14T11:54:21.888836+0000","last_deep_scrub":"264'542","last_deep_scrub_stamp":"2024-09-14T11:54:21.888836+0000","last_clean_scrub_stamp":"2024-09-14T11:54:21.888836+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:17.653317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2788,"num_read_kb":2597,"num_write":616,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"264'220","reported_seq":840,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.775701+0000","last_change":"2024-09-14T11:54:08.775701+0000","last_active":"2024-09-14T11:54:08.775701+0000","last_peered":"2024-09-14T11:54:08.775701+0000","last_clean":"2024-09-14T11:54:08.775701+0000","last_became_active":"2024-09-14T11:09:45.198569+0000","last_became_peered":"2024-09-14T11:09:45.198569+0000","last_unstale":"2024-09-14T11:54:08.775701+0000","last_undegraded":"2024-09-14T11:54:08.775701+0000","last_fullsized":"2024-09-14T11:54:08.775701+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'220","last_scrub_stamp":"2024-09-14T11:54:08.775524+0000","last_deep_scrub":"264'220","last_deep_scrub_stamp":"2024-09-14T11:54:08.775524+0000","last_clean_scrub_stamp":"2024-09-14T11:54:08.775524+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:16.447398+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":586,"num_read_kb":15211,"num_write":901,"num_write_kb":32712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.034316+0000","last_change":"2024-09-14T11:54:26.034077+0000","last_active":"2024-09-14T11:54:26.034316+0000","last_peered":"2024-09-14T11:54:26.034316+0000","last_clean":"2024-09-14T11:54:26.034316+0000","last_became_active":"2024-09-14T11:09:48.952531+0000","last_became_peered":"2024-09-14T11:09:48.952531+0000","last_unstale":"2024-09-14T11:54:26.034316+0000","last_undegraded":"2024-09-14T11:54:26.034316+0000","last_fullsized":"2024-09-14T11:54:26.034316+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:26.033870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:26.033870+0000","last_clean_scrub_stamp":"2024-09-14T11:54:26.033870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:11.032743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"264'165","reported_seq":754,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:29.119936+0000","last_change":"2024-09-14T11:54:29.119773+0000","last_active":"2024-09-14T11:54:29.119936+0000","last_peered":"2024-09-14T11:54:29.119936+0000","last_clean":"2024-09-14T11:54:29.119936+0000","last_became_active":"2024-09-14T11:09:50.975455+0000","last_became_peered":"2024-09-14T11:09:50.975455+0000","last_unstale":"2024-09-14T11:54:29.119936+0000","last_undegraded":"2024-09-14T11:54:29.119936+0000","last_fullsized":"2024-09-14T11:54:29.119936+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'165","last_scrub_stamp":"2024-09-14T11:54:29.119569+0000","last_deep_scrub":"264'165","last_deep_scrub_stamp":"2024-09-14T11:54:29.119569+0000","last_clean_scrub_stamp":"2024-09-14T11:54:29.119569+0000","objects_scrubbed":7,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:47.076760+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16336,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":219,"num_read_kb":325,"num_write":124,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"264'773","reported_seq":2372,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:21.346123+0000","last_change":"2024-09-14T11:54:21.345870+0000","last_active":"2024-09-14T11:54:21.346123+0000","last_peered":"2024-09-14T11:54:21.346123+0000","last_clean":"2024-09-14T11:54:21.346123+0000","last_became_active":"2024-09-14T11:09:53.013805+0000","last_became_peered":"2024-09-14T11:09:53.013805+0000","last_unstale":"2024-09-14T11:54:21.346123+0000","last_undegraded":"2024-09-14T11:54:21.346123+0000","last_fullsized":"2024-09-14T11:54:21.346123+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'773","last_scrub_stamp":"2024-09-14T11:54:21.345641+0000","last_deep_scrub":"264'773","last_deep_scrub_stamp":"2024-09-14T11:54:21.345641+0000","last_clean_scrub_stamp":"2024-09-14T11:54:21.345641+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:00.678060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"264'156","reported_seq":669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.643051+0000","last_change":"2024-09-14T11:54:27.643051+0000","last_active":"2024-09-14T11:54:27.643051+0000","last_peered":"2024-09-14T11:54:27.643051+0000","last_clean":"2024-09-14T11:54:27.643051+0000","last_became_active":"2024-09-14T11:09:55.026656+0000","last_became_peered":"2024-09-14T11:09:55.026656+0000","last_unstale":"2024-09-14T11:54:27.643051+0000","last_undegraded":"2024-09-14T11:54:27.643051+0000","last_fullsized":"2024-09-14T11:54:27.643051+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'156","last_scrub_stamp":"2024-09-14T11:54:27.642792+0000","last_deep_scrub":"264'156","last_deep_scrub_stamp":"2024-09-14T11:54:27.642792+0000","last_clean_scrub_stamp":"2024-09-14T11:54:27.642792+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:43.007584+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1884,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":197,"num_read_kb":178,"num_write":396,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"264'509","reported_seq":2092,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.384119+0000","last_change":"2024-09-14T11:54:09.383975+0000","last_active":"2024-09-14T11:54:09.384119+0000","last_peered":"2024-09-14T11:54:09.384119+0000","last_clean":"2024-09-14T11:54:09.384119+0000","last_became_active":"2024-09-14T11:09:46.949867+0000","last_became_peered":"2024-09-14T11:09:46.949867+0000","last_unstale":"2024-09-14T11:54:09.384119+0000","last_undegraded":"2024-09-14T11:54:09.384119+0000","last_fullsized":"2024-09-14T11:54:09.384119+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'509","last_scrub_stamp":"2024-09-14T11:54:09.383770+0000","last_deep_scrub":"264'509","last_deep_scrub_stamp":"2024-09-14T11:54:09.383770+0000","last_clean_scrub_stamp":"2024-09-14T11:54:09.383770+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:39.270981+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2605,"num_read_kb":2418,"num_write":602,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"264'274","reported_seq":970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.730759+0000","last_change":"2024-09-14T11:54:07.730759+0000","last_active":"2024-09-14T11:54:07.730759+0000","last_peered":"2024-09-14T11:54:07.730759+0000","last_clean":"2024-09-14T11:54:07.730759+0000","last_became_active":"2024-09-14T11:09:45.207969+0000","last_became_peered":"2024-09-14T11:09:45.207969+0000","last_unstale":"2024-09-14T11:54:07.730759+0000","last_undegraded":"2024-09-14T11:54:07.730759+0000","last_fullsized":"2024-09-14T11:54:07.730759+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'274","last_scrub_stamp":"2024-09-14T11:54:07.730568+0000","last_deep_scrub":"264'274","last_deep_scrub_stamp":"2024-09-14T11:54:07.730568+0000","last_clean_scrub_stamp":"2024-09-14T11:54:07.730568+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:51.886568+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":716,"num_read_kb":90988,"num_write":1212,"num_write_kb":64456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"264'4","reported_seq":1466,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:16.582083+0000","last_change":"2024-09-14T11:54:16.581905+0000","last_active":"2024-09-14T11:54:16.582083+0000","last_peered":"2024-09-14T11:54:16.582083+0000","last_clean":"2024-09-14T11:54:16.582083+0000","last_became_active":"2024-09-14T11:09:48.961946+0000","last_became_peered":"2024-09-14T11:09:48.961946+0000","last_unstale":"2024-09-14T11:54:16.582083+0000","last_undegraded":"2024-09-14T11:54:16.582083+0000","last_fullsized":"2024-09-14T11:54:16.582083+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T11:54:16.581705+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T11:54:16.581705+0000","last_clean_scrub_stamp":"2024-09-14T11:54:16.581705+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:55.935557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":958,"num_read_kb":958,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"264'87","reported_seq":611,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.637008+0000","last_change":"2024-09-14T11:54:22.636698+0000","last_active":"2024-09-14T11:54:22.637008+0000","last_peered":"2024-09-14T11:54:22.637008+0000","last_clean":"2024-09-14T11:54:22.637008+0000","last_became_active":"2024-09-14T11:09:50.997281+0000","last_became_peered":"2024-09-14T11:09:50.997281+0000","last_unstale":"2024-09-14T11:54:22.637008+0000","last_undegraded":"2024-09-14T11:54:22.637008+0000","last_fullsized":"2024-09-14T11:54:22.637008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'87","last_scrub_stamp":"2024-09-14T11:54:22.636343+0000","last_deep_scrub":"264'87","last_deep_scrub_stamp":"2024-09-14T11:54:22.636343+0000","last_clean_scrub_stamp":"2024-09-14T11:54:22.636343+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:32.101718+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"264'802","reported_seq":4471,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.610418+0000","last_change":"2024-09-14T11:54:27.610184+0000","last_active":"2024-09-14T11:54:27.610418+0000","last_peered":"2024-09-14T11:54:27.610418+0000","last_clean":"2024-09-14T11:54:27.610418+0000","last_became_active":"2024-09-14T11:09:53.010631+0000","last_became_peered":"2024-09-14T11:09:53.010631+0000","last_unstale":"2024-09-14T11:54:27.610418+0000","last_undegraded":"2024-09-14T11:54:27.610418+0000","last_fullsized":"2024-09-14T11:54:27.610418+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'802","last_scrub_stamp":"2024-09-14T11:54:27.609998+0000","last_deep_scrub":"264'802","last_deep_scrub_stamp":"2024-09-14T11:54:27.609998+0000","last_clean_scrub_stamp":"2024-09-14T11:54:27.609998+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:15:35.340229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"264'179","reported_seq":686,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.373878+0000","last_change":"2024-09-14T11:54:28.373878+0000","last_active":"2024-09-14T11:54:28.373878+0000","last_peered":"2024-09-14T11:54:28.373878+0000","last_clean":"2024-09-14T11:54:28.373878+0000","last_became_active":"2024-09-14T11:09:55.010215+0000","last_became_peered":"2024-09-14T11:09:55.010215+0000","last_unstale":"2024-09-14T11:54:28.373878+0000","last_undegraded":"2024-09-14T11:54:28.373878+0000","last_fullsized":"2024-09-14T11:54:28.373878+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'179","last_scrub_stamp":"2024-09-14T11:54:28.373690+0000","last_deep_scrub":"264'179","last_deep_scrub_stamp":"2024-09-14T11:54:28.373690+0000","last_clean_scrub_stamp":"2024-09-14T11:54:28.373690+0000","objects_scrubbed":1,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:57.309889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":123,"num_read_kb":114,"num_write":415,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"264'412","reported_seq":1896,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.272471+0000","last_change":"2024-09-14T11:54:09.272327+0000","last_active":"2024-09-14T11:54:09.272471+0000","last_peered":"2024-09-14T11:54:09.272471+0000","last_clean":"2024-09-14T11:54:09.272471+0000","last_became_active":"2024-09-14T11:09:46.966876+0000","last_became_peered":"2024-09-14T11:09:46.966876+0000","last_unstale":"2024-09-14T11:54:09.272471+0000","last_undegraded":"2024-09-14T11:54:09.272471+0000","last_fullsized":"2024-09-14T11:54:09.272471+0000","mapping_epoch":25,"log_start":"264'401","ondisk_log_start":"264'401","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'412","last_scrub_stamp":"2024-09-14T11:54:09.272144+0000","last_deep_scrub":"264'412","last_deep_scrub_stamp":"2024-09-14T11:54:09.272144+0000","last_clean_scrub_stamp":"2024-09-14T11:54:09.272144+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":401,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:51.396054+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2150,"num_read_kb":2036,"num_write":469,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"264'269","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.715548+0000","last_change":"2024-09-14T11:54:06.715548+0000","last_active":"2024-09-14T11:54:06.715548+0000","last_peered":"2024-09-14T11:54:06.715548+0000","last_clean":"2024-09-14T11:54:06.715548+0000","last_became_active":"2024-09-14T11:09:45.200039+0000","last_became_peered":"2024-09-14T11:09:45.200039+0000","last_unstale":"2024-09-14T11:54:06.715548+0000","last_undegraded":"2024-09-14T11:54:06.715548+0000","last_fullsized":"2024-09-14T11:54:06.715548+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'269","last_scrub_stamp":"2024-09-14T11:54:06.715283+0000","last_deep_scrub":"264'269","last_deep_scrub_stamp":"2024-09-14T11:54:06.715283+0000","last_clean_scrub_stamp":"2024-09-14T11:54:06.715283+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:06.417831+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":994,"num_read_kb":201012,"num_write":1230,"num_write_kb":37853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:32.772491+0000","last_change":"2024-09-14T11:54:32.772237+0000","last_active":"2024-09-14T11:54:32.772491+0000","last_peered":"2024-09-14T11:54:32.772491+0000","last_clean":"2024-09-14T11:54:32.772491+0000","last_became_active":"2024-09-14T11:09:48.972957+0000","last_became_peered":"2024-09-14T11:09:48.972957+0000","last_unstale":"2024-09-14T11:54:32.772491+0000","last_undegraded":"2024-09-14T11:54:32.772491+0000","last_fullsized":"2024-09-14T11:54:32.772491+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:32.771921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:32.771921+0000","last_clean_scrub_stamp":"2024-09-14T11:54:32.771921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:04.164477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"264'204","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:21.644170+0000","last_change":"2024-09-14T11:54:21.644031+0000","last_active":"2024-09-14T11:54:21.644170+0000","last_peered":"2024-09-14T11:54:21.644170+0000","last_clean":"2024-09-14T11:54:21.644170+0000","last_became_active":"2024-09-14T11:09:50.991938+0000","last_became_peered":"2024-09-14T11:09:50.991938+0000","last_unstale":"2024-09-14T11:54:21.644170+0000","last_undegraded":"2024-09-14T11:54:21.644170+0000","last_fullsized":"2024-09-14T11:54:21.644170+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'204","last_scrub_stamp":"2024-09-14T11:54:21.643805+0000","last_deep_scrub":"264'204","last_deep_scrub_stamp":"2024-09-14T11:54:21.643805+0000","last_clean_scrub_stamp":"2024-09-14T11:54:21.643805+0000","objects_scrubbed":8,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:27.053278+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11553,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":263,"num_read_kb":344,"num_write":148,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:23.317915+0000","last_change":"2024-09-14T11:54:23.317788+0000","last_active":"2024-09-14T11:54:23.317915+0000","last_peered":"2024-09-14T11:54:23.317915+0000","last_clean":"2024-09-14T11:54:23.317915+0000","last_became_active":"2024-09-14T11:09:53.006350+0000","last_became_peered":"2024-09-14T11:09:53.006350+0000","last_unstale":"2024-09-14T11:54:23.317915+0000","last_undegraded":"2024-09-14T11:54:23.317915+0000","last_fullsized":"2024-09-14T11:54:23.317915+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:23.317603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:23.317603+0000","last_clean_scrub_stamp":"2024-09-14T11:54:23.317603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:23.634009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"264'120","reported_seq":613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.344814+0000","last_change":"2024-09-14T11:54:27.344814+0000","last_active":"2024-09-14T11:54:27.344814+0000","last_peered":"2024-09-14T11:54:27.344814+0000","last_clean":"2024-09-14T11:54:27.344814+0000","last_became_active":"2024-09-14T11:09:55.012954+0000","last_became_peered":"2024-09-14T11:09:55.012954+0000","last_unstale":"2024-09-14T11:54:27.344814+0000","last_undegraded":"2024-09-14T11:54:27.344814+0000","last_fullsized":"2024-09-14T11:54:27.344814+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'120","last_scrub_stamp":"2024-09-14T11:54:27.344573+0000","last_deep_scrub":"264'120","last_deep_scrub_stamp":"2024-09-14T11:54:27.344573+0000","last_clean_scrub_stamp":"2024-09-14T11:54:27.344573+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:56.104563+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":106,"num_write":256,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"264'405","reported_seq":2080,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.883536+0000","last_change":"2024-09-14T11:54:19.883536+0000","last_active":"2024-09-14T11:54:19.883536+0000","last_peered":"2024-09-14T11:54:19.883536+0000","last_clean":"2024-09-14T11:54:19.883536+0000","last_became_active":"2024-09-14T11:09:46.960461+0000","last_became_peered":"2024-09-14T11:09:46.960461+0000","last_unstale":"2024-09-14T11:54:19.883536+0000","last_undegraded":"2024-09-14T11:54:19.883536+0000","last_fullsized":"2024-09-14T11:54:19.883536+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'405","last_scrub_stamp":"2024-09-14T11:54:19.883237+0000","last_deep_scrub":"264'405","last_deep_scrub_stamp":"2024-09-14T11:54:19.883237+0000","last_clean_scrub_stamp":"2024-09-14T11:54:19.883237+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:36.272832+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2438,"num_read_kb":2343,"num_write":447,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2036,"num_omap_keys":8,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"264'74","reported_seq":620,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:01.651107+0000","last_change":"2024-09-14T11:54:01.651107+0000","last_active":"2024-09-14T11:54:01.651107+0000","last_peered":"2024-09-14T11:54:01.651107+0000","last_clean":"2024-09-14T11:54:01.651107+0000","last_became_active":"2024-09-14T11:09:30.309524+0000","last_became_peered":"2024-09-14T11:09:30.309524+0000","last_unstale":"2024-09-14T11:54:01.651107+0000","last_undegraded":"2024-09-14T11:54:01.651107+0000","last_fullsized":"2024-09-14T11:54:01.651107+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'74","last_scrub_stamp":"2024-09-14T11:54:01.650935+0000","last_deep_scrub":"264'74","last_deep_scrub_stamp":"2024-09-14T11:54:01.650935+0000","last_clean_scrub_stamp":"2024-09-14T11:54:01.650935+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:53.062420+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"264'2","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.837336+0000","last_change":"2024-09-14T11:54:04.837336+0000","last_active":"2024-09-14T11:54:04.837336+0000","last_peered":"2024-09-14T11:54:04.837336+0000","last_clean":"2024-09-14T11:54:04.837336+0000","last_became_active":"2024-09-14T11:09:36.264768+0000","last_became_peered":"2024-09-14T11:09:36.264768+0000","last_unstale":"2024-09-14T11:54:04.837336+0000","last_undegraded":"2024-09-14T11:54:04.837336+0000","last_fullsized":"2024-09-14T11:54:04.837336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:04.837116+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:04.837116+0000","last_clean_scrub_stamp":"2024-09-14T11:54:04.837116+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:31.345731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00092723999999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"264'271","reported_seq":1086,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:03.714182+0000","last_change":"2024-09-14T11:54:03.714182+0000","last_active":"2024-09-14T11:54:03.714182+0000","last_peered":"2024-09-14T11:54:03.714182+0000","last_clean":"2024-09-14T11:54:03.714182+0000","last_became_active":"2024-09-14T11:09:45.193131+0000","last_became_peered":"2024-09-14T11:09:45.193131+0000","last_unstale":"2024-09-14T11:54:03.714182+0000","last_undegraded":"2024-09-14T11:54:03.714182+0000","last_fullsized":"2024-09-14T11:54:03.714182+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'271","last_scrub_stamp":"2024-09-14T11:54:03.713998+0000","last_deep_scrub":"264'271","last_deep_scrub_stamp":"2024-09-14T11:54:03.713998+0000","last_clean_scrub_stamp":"2024-09-14T11:54:03.713998+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:24.565125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1127,"num_read_kb":141056,"num_write":1044,"num_write_kb":44809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.830566+0000","last_change":"2024-09-14T11:54:20.830566+0000","last_active":"2024-09-14T11:54:20.830566+0000","last_peered":"2024-09-14T11:54:20.830566+0000","last_clean":"2024-09-14T11:54:20.830566+0000","last_became_active":"2024-09-14T11:09:48.970541+0000","last_became_peered":"2024-09-14T11:09:48.970541+0000","last_unstale":"2024-09-14T11:54:20.830566+0000","last_undegraded":"2024-09-14T11:54:20.830566+0000","last_fullsized":"2024-09-14T11:54:20.830566+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:20.830380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:20.830380+0000","last_clean_scrub_stamp":"2024-09-14T11:54:20.830380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:49.298720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"264'305","reported_seq":1009,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:35.744680+0000","last_change":"2024-09-14T11:54:35.744680+0000","last_active":"2024-09-14T11:54:35.744680+0000","last_peered":"2024-09-14T11:54:35.744680+0000","last_clean":"2024-09-14T11:54:35.744680+0000","last_became_active":"2024-09-14T11:09:50.993231+0000","last_became_peered":"2024-09-14T11:09:50.993231+0000","last_unstale":"2024-09-14T11:54:35.744680+0000","last_undegraded":"2024-09-14T11:54:35.744680+0000","last_fullsized":"2024-09-14T11:54:35.744680+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'305","last_scrub_stamp":"2024-09-14T11:54:35.744486+0000","last_deep_scrub":"264'305","last_deep_scrub_stamp":"2024-09-14T11:54:35.744486+0000","last_clean_scrub_stamp":"2024-09-14T11:54:35.744486+0000","objects_scrubbed":6,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:12.554646+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22194,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":549,"num_read_kb":706,"num_write":484,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106814,"num_omap_keys":256,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:32.086476+0000","last_change":"2024-09-14T11:54:32.086476+0000","last_active":"2024-09-14T11:54:32.086476+0000","last_peered":"2024-09-14T11:54:32.086476+0000","last_clean":"2024-09-14T11:54:32.086476+0000","last_became_active":"2024-09-14T11:09:53.004338+0000","last_became_peered":"2024-09-14T11:09:53.004338+0000","last_unstale":"2024-09-14T11:54:32.086476+0000","last_undegraded":"2024-09-14T11:54:32.086476+0000","last_fullsized":"2024-09-14T11:54:32.086476+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:32.086262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:32.086262+0000","last_clean_scrub_stamp":"2024-09-14T11:54:32.086262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:41.804074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"264'239","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.880952+0000","last_change":"2024-09-14T11:54:22.880952+0000","last_active":"2024-09-14T11:54:22.880952+0000","last_peered":"2024-09-14T11:54:22.880952+0000","last_clean":"2024-09-14T11:54:22.880952+0000","last_became_active":"2024-09-14T11:09:55.015569+0000","last_became_peered":"2024-09-14T11:09:55.015569+0000","last_unstale":"2024-09-14T11:54:22.880952+0000","last_undegraded":"2024-09-14T11:54:22.880952+0000","last_fullsized":"2024-09-14T11:54:22.880952+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'239","last_scrub_stamp":"2024-09-14T11:54:22.880736+0000","last_deep_scrub":"264'239","last_deep_scrub_stamp":"2024-09-14T11:54:22.880736+0000","last_clean_scrub_stamp":"2024-09-14T11:54:22.880736+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:24.816809+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1424,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":528,"num_read_kb":505,"num_write":525,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"264'794","reported_seq":2257,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.038964+0000","last_change":"2024-09-14T11:54:17.038964+0000","last_active":"2024-09-14T11:54:17.038964+0000","last_peered":"2024-09-14T11:54:17.038964+0000","last_clean":"2024-09-14T11:54:17.038964+0000","last_became_active":"2024-09-14T11:09:46.974517+0000","last_became_peered":"2024-09-14T11:09:46.974517+0000","last_unstale":"2024-09-14T11:54:17.038964+0000","last_undegraded":"2024-09-14T11:54:17.038964+0000","last_fullsized":"2024-09-14T11:54:17.038964+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'794","last_scrub_stamp":"2024-09-14T11:54:17.038783+0000","last_deep_scrub":"264'794","last_deep_scrub_stamp":"2024-09-14T11:54:17.038783+0000","last_clean_scrub_stamp":"2024-09-14T11:54:17.038783+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:13.442249+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3876,"num_read_kb":3470,"num_write":1072,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:03.793921+0000","last_change":"2024-09-14T11:54:03.793921+0000","last_active":"2024-09-14T11:54:03.793921+0000","last_peered":"2024-09-14T11:54:03.793921+0000","last_clean":"2024-09-14T11:54:03.793921+0000","last_became_active":"2024-09-14T11:09:36.110037+0000","last_became_peered":"2024-09-14T11:09:36.110037+0000","last_unstale":"2024-09-14T11:54:03.793921+0000","last_undegraded":"2024-09-14T11:54:03.793921+0000","last_fullsized":"2024-09-14T11:54:03.793921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:03.793825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:03.793825+0000","last_clean_scrub_stamp":"2024-09-14T11:54:03.793825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:58.071609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001043441,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"264'225","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.624617+0000","last_change":"2024-09-14T11:54:05.624617+0000","last_active":"2024-09-14T11:54:05.624617+0000","last_peered":"2024-09-14T11:54:05.624617+0000","last_clean":"2024-09-14T11:54:05.624617+0000","last_became_active":"2024-09-14T11:09:45.211579+0000","last_became_peered":"2024-09-14T11:09:45.211579+0000","last_unstale":"2024-09-14T11:54:05.624617+0000","last_undegraded":"2024-09-14T11:54:05.624617+0000","last_fullsized":"2024-09-14T11:54:05.624617+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'225","last_scrub_stamp":"2024-09-14T11:54:05.624423+0000","last_deep_scrub":"264'225","last_deep_scrub_stamp":"2024-09-14T11:54:05.624423+0000","last_clean_scrub_stamp":"2024-09-14T11:54:05.624423+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:48.379755+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":626,"num_read_kb":58466,"num_write":936,"num_write_kb":31030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:29.858547+0000","last_change":"2024-09-14T11:54:29.858547+0000","last_active":"2024-09-14T11:54:29.858547+0000","last_peered":"2024-09-14T11:54:29.858547+0000","last_clean":"2024-09-14T11:54:29.858547+0000","last_became_active":"2024-09-14T11:09:48.970218+0000","last_became_peered":"2024-09-14T11:09:48.970218+0000","last_unstale":"2024-09-14T11:54:29.858547+0000","last_undegraded":"2024-09-14T11:54:29.858547+0000","last_fullsized":"2024-09-14T11:54:29.858547+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:29.858359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:29.858359+0000","last_clean_scrub_stamp":"2024-09-14T11:54:29.858359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:44.732920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"264'872","reported_seq":2339,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.381488+0000","last_change":"2024-09-14T11:54:20.381488+0000","last_active":"2024-09-14T11:54:20.381488+0000","last_peered":"2024-09-14T11:54:20.381488+0000","last_clean":"2024-09-14T11:54:20.381488+0000","last_became_active":"2024-09-14T11:09:50.996406+0000","last_became_peered":"2024-09-14T11:09:50.996406+0000","last_unstale":"2024-09-14T11:54:20.381488+0000","last_undegraded":"2024-09-14T11:54:20.381488+0000","last_fullsized":"2024-09-14T11:54:20.381488+0000","mapping_epoch":29,"log_start":"264'800","ondisk_log_start":"264'800","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'872","last_scrub_stamp":"2024-09-14T11:54:20.381285+0000","last_deep_scrub":"264'872","last_deep_scrub_stamp":"2024-09-14T11:54:20.381285+0000","last_clean_scrub_stamp":"2024-09-14T11:54:20.381285+0000","objects_scrubbed":11,"log_size":72,"log_dups_size":800,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:34.362640+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34005,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1184,"num_read_kb":1407,"num_write":288,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:40.720017+0000","last_change":"2024-09-14T11:54:40.720017+0000","last_active":"2024-09-14T11:54:40.720017+0000","last_peered":"2024-09-14T11:54:40.720017+0000","last_clean":"2024-09-14T11:54:40.720017+0000","last_became_active":"2024-09-14T11:09:53.022006+0000","last_became_peered":"2024-09-14T11:09:53.022006+0000","last_unstale":"2024-09-14T11:54:40.720017+0000","last_undegraded":"2024-09-14T11:54:40.720017+0000","last_fullsized":"2024-09-14T11:54:40.720017+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:40.719788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:40.719788+0000","last_clean_scrub_stamp":"2024-09-14T11:54:40.719788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:06.582867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"264'219","reported_seq":754,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:36.113973+0000","last_change":"2024-09-14T11:54:36.113973+0000","last_active":"2024-09-14T11:54:36.113973+0000","last_peered":"2024-09-14T11:54:36.113973+0000","last_clean":"2024-09-14T11:54:36.113973+0000","last_became_active":"2024-09-14T11:09:55.023966+0000","last_became_peered":"2024-09-14T11:09:55.023966+0000","last_unstale":"2024-09-14T11:54:36.113973+0000","last_undegraded":"2024-09-14T11:54:36.113973+0000","last_fullsized":"2024-09-14T11:54:36.113973+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'219","last_scrub_stamp":"2024-09-14T11:54:36.113759+0000","last_deep_scrub":"264'219","last_deep_scrub_stamp":"2024-09-14T11:54:36.113759+0000","last_clean_scrub_stamp":"2024-09-14T11:54:36.113759+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:37.214318+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":224,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":295,"num_read_kb":259,"num_write":448,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"264'467","reported_seq":2179,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:12.580698+0000","last_change":"2024-09-14T11:54:12.580698+0000","last_active":"2024-09-14T11:54:12.580698+0000","last_peered":"2024-09-14T11:54:12.580698+0000","last_clean":"2024-09-14T11:54:12.580698+0000","last_became_active":"2024-09-14T11:09:46.981472+0000","last_became_peered":"2024-09-14T11:09:46.981472+0000","last_unstale":"2024-09-14T11:54:12.580698+0000","last_undegraded":"2024-09-14T11:54:12.580698+0000","last_fullsized":"2024-09-14T11:54:12.580698+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'467","last_scrub_stamp":"2024-09-14T11:54:12.580519+0000","last_deep_scrub":"264'467","last_deep_scrub_stamp":"2024-09-14T11:54:12.580519+0000","last_clean_scrub_stamp":"2024-09-14T11:54:12.580519+0000","objects_scrubbed":3,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:18.230648+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2625,"num_read_kb":2493,"num_write":542,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":468,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":521,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.269223+0000","last_change":"2024-09-14T11:54:04.269223+0000","last_active":"2024-09-14T11:54:04.269223+0000","last_peered":"2024-09-14T11:54:04.269223+0000","last_clean":"2024-09-14T11:54:04.269223+0000","last_became_active":"2024-09-14T11:09:36.110778+0000","last_became_peered":"2024-09-14T11:09:36.110778+0000","last_unstale":"2024-09-14T11:54:04.269223+0000","last_undegraded":"2024-09-14T11:54:04.269223+0000","last_fullsized":"2024-09-14T11:54:04.269223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:04.269043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:04.269043+0000","last_clean_scrub_stamp":"2024-09-14T11:54:04.269043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:43.617127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001188634,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"264'181","reported_seq":786,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.103277+0000","last_change":"2024-09-14T11:54:11.103277+0000","last_active":"2024-09-14T11:54:11.103277+0000","last_peered":"2024-09-14T11:54:11.103277+0000","last_clean":"2024-09-14T11:54:11.103277+0000","last_became_active":"2024-09-14T11:09:45.214670+0000","last_became_peered":"2024-09-14T11:09:45.214670+0000","last_unstale":"2024-09-14T11:54:11.103277+0000","last_undegraded":"2024-09-14T11:54:11.103277+0000","last_fullsized":"2024-09-14T11:54:11.103277+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'181","last_scrub_stamp":"2024-09-14T11:54:11.103055+0000","last_deep_scrub":"264'181","last_deep_scrub_stamp":"2024-09-14T11:54:11.103055+0000","last_clean_scrub_stamp":"2024-09-14T11:54:11.103055+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:09.808494+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":427,"num_read_kb":11641,"num_write":795,"num_write_kb":32063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"264'2","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.410405+0000","last_change":"2024-09-14T11:54:17.410405+0000","last_active":"2024-09-14T11:54:17.410405+0000","last_peered":"2024-09-14T11:54:17.410405+0000","last_clean":"2024-09-14T11:54:17.410405+0000","last_became_active":"2024-09-14T11:09:48.968973+0000","last_became_peered":"2024-09-14T11:09:48.968973+0000","last_unstale":"2024-09-14T11:54:17.410405+0000","last_undegraded":"2024-09-14T11:54:17.410405+0000","last_fullsized":"2024-09-14T11:54:17.410405+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:17.410202+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:17.410202+0000","last_clean_scrub_stamp":"2024-09-14T11:54:17.410202+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:57.558922+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"264'243","reported_seq":1322,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.884841+0000","last_change":"2024-09-14T11:54:19.884841+0000","last_active":"2024-09-14T11:54:19.884841+0000","last_peered":"2024-09-14T11:54:19.884841+0000","last_clean":"2024-09-14T11:54:19.884841+0000","last_became_active":"2024-09-14T11:09:50.992589+0000","last_became_peered":"2024-09-14T11:09:50.992589+0000","last_unstale":"2024-09-14T11:54:19.884841+0000","last_undegraded":"2024-09-14T11:54:19.884841+0000","last_fullsized":"2024-09-14T11:54:19.884841+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'243","last_scrub_stamp":"2024-09-14T11:54:19.884635+0000","last_deep_scrub":"264'243","last_deep_scrub_stamp":"2024-09-14T11:54:19.884635+0000","last_clean_scrub_stamp":"2024-09-14T11:54:19.884635+0000","objects_scrubbed":9,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:08.377002+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":182,"num_read_kb":171,"num_write":149,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:33.968643+0000","last_change":"2024-09-14T11:54:33.968643+0000","last_active":"2024-09-14T11:54:33.968643+0000","last_peered":"2024-09-14T11:54:33.968643+0000","last_clean":"2024-09-14T11:54:33.968643+0000","last_became_active":"2024-09-14T11:09:53.007705+0000","last_became_peered":"2024-09-14T11:09:53.007705+0000","last_unstale":"2024-09-14T11:54:33.968643+0000","last_undegraded":"2024-09-14T11:54:33.968643+0000","last_fullsized":"2024-09-14T11:54:33.968643+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:33.968471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:33.968471+0000","last_clean_scrub_stamp":"2024-09-14T11:54:33.968471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:00.416592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"264'274","reported_seq":879,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.044419+0000","last_change":"2024-09-14T11:54:38.044137+0000","last_active":"2024-09-14T11:54:38.044419+0000","last_peered":"2024-09-14T11:54:38.044419+0000","last_clean":"2024-09-14T11:54:38.044419+0000","last_became_active":"2024-09-14T11:09:55.013944+0000","last_became_peered":"2024-09-14T11:09:55.013944+0000","last_unstale":"2024-09-14T11:54:38.044419+0000","last_undegraded":"2024-09-14T11:54:38.044419+0000","last_fullsized":"2024-09-14T11:54:38.044419+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'274","last_scrub_stamp":"2024-09-14T11:54:38.043916+0000","last_deep_scrub":"264'274","last_deep_scrub_stamp":"2024-09-14T11:54:38.043916+0000","last_clean_scrub_stamp":"2024-09-14T11:54:38.043916+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:39.814417+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":495,"num_read_kb":519,"num_write":596,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"264'934","reported_seq":2826,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.609638+0000","last_change":"2024-09-14T11:54:11.609638+0000","last_active":"2024-09-14T11:54:11.609638+0000","last_peered":"2024-09-14T11:54:11.609638+0000","last_clean":"2024-09-14T11:54:11.609638+0000","last_became_active":"2024-09-14T11:09:46.982027+0000","last_became_peered":"2024-09-14T11:09:46.982027+0000","last_unstale":"2024-09-14T11:54:11.609638+0000","last_undegraded":"2024-09-14T11:54:11.609638+0000","last_fullsized":"2024-09-14T11:54:11.609638+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'934","last_scrub_stamp":"2024-09-14T11:54:11.609414+0000","last_deep_scrub":"264'934","last_deep_scrub_stamp":"2024-09-14T11:54:11.609414+0000","last_clean_scrub_stamp":"2024-09-14T11:54:11.609414+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":900,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:10.281778+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4697,"num_read_kb":4271,"num_write":1214,"num_write_kb":435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3500,"num_omap_keys":14,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"264'3","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:02.833788+0000","last_change":"2024-09-14T11:54:02.833788+0000","last_active":"2024-09-14T11:54:02.833788+0000","last_peered":"2024-09-14T11:54:02.833788+0000","last_clean":"2024-09-14T11:54:02.833788+0000","last_became_active":"2024-09-14T11:09:36.887391+0000","last_became_peered":"2024-09-14T11:09:36.887391+0000","last_unstale":"2024-09-14T11:54:02.833788+0000","last_undegraded":"2024-09-14T11:54:02.833788+0000","last_fullsized":"2024-09-14T11:54:02.833788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:54:02.833629+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:54:02.833629+0000","last_clean_scrub_stamp":"2024-09-14T11:54:02.833629+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:54.259925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0023357849999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"264'265","reported_seq":918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.668795+0000","last_change":"2024-09-14T11:54:06.668795+0000","last_active":"2024-09-14T11:54:06.668795+0000","last_peered":"2024-09-14T11:54:06.668795+0000","last_clean":"2024-09-14T11:54:06.668795+0000","last_became_active":"2024-09-14T11:09:45.206492+0000","last_became_peered":"2024-09-14T11:09:45.206492+0000","last_unstale":"2024-09-14T11:54:06.668795+0000","last_undegraded":"2024-09-14T11:54:06.668795+0000","last_fullsized":"2024-09-14T11:54:06.668795+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'265","last_scrub_stamp":"2024-09-14T11:54:06.668580+0000","last_deep_scrub":"264'265","last_deep_scrub_stamp":"2024-09-14T11:54:06.668580+0000","last_clean_scrub_stamp":"2024-09-14T11:54:06.668580+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:06.267313+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":656,"num_read_kb":889,"num_write":1198,"num_write_kb":16465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:16.415674+0000","last_change":"2024-09-14T11:54:16.415674+0000","last_active":"2024-09-14T11:54:16.415674+0000","last_peered":"2024-09-14T11:54:16.415674+0000","last_clean":"2024-09-14T11:54:16.415674+0000","last_became_active":"2024-09-14T11:09:48.976315+0000","last_became_peered":"2024-09-14T11:09:48.976315+0000","last_unstale":"2024-09-14T11:54:16.415674+0000","last_undegraded":"2024-09-14T11:54:16.415674+0000","last_fullsized":"2024-09-14T11:54:16.415674+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:16.415478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:16.415478+0000","last_clean_scrub_stamp":"2024-09-14T11:54:16.415478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:28.319046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"264'128","reported_seq":673,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.101981+0000","last_change":"2024-09-14T11:54:28.101981+0000","last_active":"2024-09-14T11:54:28.101981+0000","last_peered":"2024-09-14T11:54:28.101981+0000","last_clean":"2024-09-14T11:54:28.101981+0000","last_became_active":"2024-09-14T11:09:50.983126+0000","last_became_peered":"2024-09-14T11:09:50.983126+0000","last_unstale":"2024-09-14T11:54:28.101981+0000","last_undegraded":"2024-09-14T11:54:28.101981+0000","last_fullsized":"2024-09-14T11:54:28.101981+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'128","last_scrub_stamp":"2024-09-14T11:54:28.101719+0000","last_deep_scrub":"264'128","last_deep_scrub_stamp":"2024-09-14T11:54:28.101719+0000","last_clean_scrub_stamp":"2024-09-14T11:54:28.101719+0000","objects_scrubbed":7,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:44.669683+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.699459+0000","last_change":"2024-09-14T11:54:42.699459+0000","last_active":"2024-09-14T11:54:42.699459+0000","last_peered":"2024-09-14T11:54:42.699459+0000","last_clean":"2024-09-14T11:54:42.699459+0000","last_became_active":"2024-09-14T11:09:53.015100+0000","last_became_peered":"2024-09-14T11:09:53.015100+0000","last_unstale":"2024-09-14T11:54:42.699459+0000","last_undegraded":"2024-09-14T11:54:42.699459+0000","last_fullsized":"2024-09-14T11:54:42.699459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:42.699238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:42.699238+0000","last_clean_scrub_stamp":"2024-09-14T11:54:42.699238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:22.933735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"264'127","reported_seq":685,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.585876+0000","last_change":"2024-09-14T11:54:26.585876+0000","last_active":"2024-09-14T11:54:26.585876+0000","last_peered":"2024-09-14T11:54:26.585876+0000","last_clean":"2024-09-14T11:54:26.585876+0000","last_became_active":"2024-09-14T11:09:55.025030+0000","last_became_peered":"2024-09-14T11:09:55.025030+0000","last_unstale":"2024-09-14T11:54:26.585876+0000","last_undegraded":"2024-09-14T11:54:26.585876+0000","last_fullsized":"2024-09-14T11:54:26.585876+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'127","last_scrub_stamp":"2024-09-14T11:54:26.585644+0000","last_deep_scrub":"264'127","last_deep_scrub_stamp":"2024-09-14T11:54:26.585644+0000","last_clean_scrub_stamp":"2024-09-14T11:54:26.585644+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:50:23.463245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":244,"num_read_kb":234,"num_write":307,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"264'432","reported_seq":1982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.590727+0000","last_change":"2024-09-14T11:54:13.590727+0000","last_active":"2024-09-14T11:54:13.590727+0000","last_peered":"2024-09-14T11:54:13.590727+0000","last_clean":"2024-09-14T11:54:13.590727+0000","last_became_active":"2024-09-14T11:09:46.981578+0000","last_became_peered":"2024-09-14T11:09:46.981578+0000","last_unstale":"2024-09-14T11:54:13.590727+0000","last_undegraded":"2024-09-14T11:54:13.590727+0000","last_fullsized":"2024-09-14T11:54:13.590727+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'432","last_scrub_stamp":"2024-09-14T11:54:13.590489+0000","last_deep_scrub":"264'432","last_deep_scrub_stamp":"2024-09-14T11:54:13.590489+0000","last_clean_scrub_stamp":"2024-09-14T11:54:13.590489+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:33.384996+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2336,"num_read_kb":2209,"num_write":501,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"264'246","reported_seq":892,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.337591+0000","last_change":"2024-09-14T11:54:06.337591+0000","last_active":"2024-09-14T11:54:06.337591+0000","last_peered":"2024-09-14T11:54:06.337591+0000","last_clean":"2024-09-14T11:54:06.337591+0000","last_became_active":"2024-09-14T11:09:45.216168+0000","last_became_peered":"2024-09-14T11:09:45.216168+0000","last_unstale":"2024-09-14T11:54:06.337591+0000","last_undegraded":"2024-09-14T11:54:06.337591+0000","last_fullsized":"2024-09-14T11:54:06.337591+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'246","last_scrub_stamp":"2024-09-14T11:54:06.337308+0000","last_deep_scrub":"264'246","last_deep_scrub_stamp":"2024-09-14T11:54:06.337308+0000","last_clean_scrub_stamp":"2024-09-14T11:54:06.337308+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:05.110637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":603,"num_read_kb":12400,"num_write":1048,"num_write_kb":24779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.160781+0000","last_change":"2024-09-14T11:54:04.160781+0000","last_active":"2024-09-14T11:54:04.160781+0000","last_peered":"2024-09-14T11:54:04.160781+0000","last_clean":"2024-09-14T11:54:04.160781+0000","last_became_active":"2024-09-14T11:09:36.887411+0000","last_became_peered":"2024-09-14T11:09:36.887411+0000","last_unstale":"2024-09-14T11:54:04.160781+0000","last_undegraded":"2024-09-14T11:54:04.160781+0000","last_fullsized":"2024-09-14T11:54:04.160781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:04.160581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:04.160581+0000","last_clean_scrub_stamp":"2024-09-14T11:54:04.160581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:54.717604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001210341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.809935+0000","last_change":"2024-09-14T11:54:20.809935+0000","last_active":"2024-09-14T11:54:20.809935+0000","last_peered":"2024-09-14T11:54:20.809935+0000","last_clean":"2024-09-14T11:54:20.809935+0000","last_became_active":"2024-09-14T11:09:48.969262+0000","last_became_peered":"2024-09-14T11:09:48.969262+0000","last_unstale":"2024-09-14T11:54:20.809935+0000","last_undegraded":"2024-09-14T11:54:20.809935+0000","last_fullsized":"2024-09-14T11:54:20.809935+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:20.809747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:20.809747+0000","last_clean_scrub_stamp":"2024-09-14T11:54:20.809747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:07.903941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"264'289","reported_seq":952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.417729+0000","last_change":"2024-09-14T11:54:18.417729+0000","last_active":"2024-09-14T11:54:18.417729+0000","last_peered":"2024-09-14T11:54:18.417729+0000","last_clean":"2024-09-14T11:54:18.417729+0000","last_became_active":"2024-09-14T11:09:50.991958+0000","last_became_peered":"2024-09-14T11:09:50.991958+0000","last_unstale":"2024-09-14T11:54:18.417729+0000","last_undegraded":"2024-09-14T11:54:18.417729+0000","last_fullsized":"2024-09-14T11:54:18.417729+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'289","last_scrub_stamp":"2024-09-14T11:54:18.417492+0000","last_deep_scrub":"264'289","last_deep_scrub_stamp":"2024-09-14T11:54:18.417492+0000","last_clean_scrub_stamp":"2024-09-14T11:54:18.417492+0000","objects_scrubbed":10,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:27.379177+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26179,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1035,"num_read_kb":1185,"num_write":1534,"num_write_kb":1392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":535828,"num_omap_keys":1208,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.328687+0000","last_change":"2024-09-14T11:54:18.328687+0000","last_active":"2024-09-14T11:54:18.328687+0000","last_peered":"2024-09-14T11:54:18.328687+0000","last_clean":"2024-09-14T11:54:18.328687+0000","last_became_active":"2024-09-14T11:09:53.001945+0000","last_became_peered":"2024-09-14T11:09:53.001945+0000","last_unstale":"2024-09-14T11:54:18.328687+0000","last_undegraded":"2024-09-14T11:54:18.328687+0000","last_fullsized":"2024-09-14T11:54:18.328687+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:18.328403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:18.328403+0000","last_clean_scrub_stamp":"2024-09-14T11:54:18.328403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:12.397430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"264'180","reported_seq":724,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:39.104074+0000","last_change":"2024-09-14T11:54:39.103932+0000","last_active":"2024-09-14T11:54:39.104074+0000","last_peered":"2024-09-14T11:54:39.104074+0000","last_clean":"2024-09-14T11:54:39.104074+0000","last_became_active":"2024-09-14T11:09:55.019043+0000","last_became_peered":"2024-09-14T11:09:55.019043+0000","last_unstale":"2024-09-14T11:54:39.104074+0000","last_undegraded":"2024-09-14T11:54:39.104074+0000","last_fullsized":"2024-09-14T11:54:39.104074+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'180","last_scrub_stamp":"2024-09-14T11:54:39.103736+0000","last_deep_scrub":"264'180","last_deep_scrub_stamp":"2024-09-14T11:54:39.103736+0000","last_clean_scrub_stamp":"2024-09-14T11:54:39.103736+0000","objects_scrubbed":4,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:11:28.065517+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":311,"num_read_kb":271,"num_write":434,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"264'394","reported_seq":1919,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.629013+0000","last_change":"2024-09-14T11:54:08.629013+0000","last_active":"2024-09-14T11:54:08.629013+0000","last_peered":"2024-09-14T11:54:08.629013+0000","last_clean":"2024-09-14T11:54:08.629013+0000","last_became_active":"2024-09-14T11:09:46.979673+0000","last_became_peered":"2024-09-14T11:09:46.979673+0000","last_unstale":"2024-09-14T11:54:08.629013+0000","last_undegraded":"2024-09-14T11:54:08.629013+0000","last_fullsized":"2024-09-14T11:54:08.629013+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'394","last_scrub_stamp":"2024-09-14T11:54:08.628827+0000","last_deep_scrub":"264'394","last_deep_scrub_stamp":"2024-09-14T11:54:08.628827+0000","last_clean_scrub_stamp":"2024-09-14T11:54:08.628827+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:41.485918+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2181,"num_read_kb":2077,"num_write":440,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":892,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"264'177","reported_seq":756,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:03.638455+0000","last_change":"2024-09-14T11:54:03.638455+0000","last_active":"2024-09-14T11:54:03.638455+0000","last_peered":"2024-09-14T11:54:03.638455+0000","last_clean":"2024-09-14T11:54:03.638455+0000","last_became_active":"2024-09-14T11:09:45.220512+0000","last_became_peered":"2024-09-14T11:09:45.220512+0000","last_unstale":"2024-09-14T11:54:03.638455+0000","last_undegraded":"2024-09-14T11:54:03.638455+0000","last_fullsized":"2024-09-14T11:54:03.638455+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-09-14T11:54:03.638201+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-09-14T11:54:03.638201+0000","last_clean_scrub_stamp":"2024-09-14T11:54:03.638201+0000","objects_scrubbed":6,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:08.150074+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655861,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":337,"num_read_kb":1928,"num_write":799,"num_write_kb":32938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.796853+0000","last_change":"2024-09-14T11:54:05.796853+0000","last_active":"2024-09-14T11:54:05.796853+0000","last_peered":"2024-09-14T11:54:05.796853+0000","last_clean":"2024-09-14T11:54:05.796853+0000","last_became_active":"2024-09-14T11:09:36.110624+0000","last_became_peered":"2024-09-14T11:09:36.110624+0000","last_unstale":"2024-09-14T11:54:05.796853+0000","last_undegraded":"2024-09-14T11:54:05.796853+0000","last_fullsized":"2024-09-14T11:54:05.796853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:05.796663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:05.796663+0000","last_clean_scrub_stamp":"2024-09-14T11:54:05.796663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:14.358427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.002569127,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:16.834905+0000","last_change":"2024-09-14T11:54:16.834905+0000","last_active":"2024-09-14T11:54:16.834905+0000","last_peered":"2024-09-14T11:54:16.834905+0000","last_clean":"2024-09-14T11:54:16.834905+0000","last_became_active":"2024-09-14T11:09:48.968130+0000","last_became_peered":"2024-09-14T11:09:48.968130+0000","last_unstale":"2024-09-14T11:54:16.834905+0000","last_undegraded":"2024-09-14T11:54:16.834905+0000","last_fullsized":"2024-09-14T11:54:16.834905+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:16.834719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:16.834719+0000","last_clean_scrub_stamp":"2024-09-14T11:54:16.834719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:03.396931+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"264'164","reported_seq":731,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:21.634619+0000","last_change":"2024-09-14T11:54:21.634619+0000","last_active":"2024-09-14T11:54:21.634619+0000","last_peered":"2024-09-14T11:54:21.634619+0000","last_clean":"2024-09-14T11:54:21.634619+0000","last_became_active":"2024-09-14T11:09:50.997665+0000","last_became_peered":"2024-09-14T11:09:50.997665+0000","last_unstale":"2024-09-14T11:54:21.634619+0000","last_undegraded":"2024-09-14T11:54:21.634619+0000","last_fullsized":"2024-09-14T11:54:21.634619+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'164","last_scrub_stamp":"2024-09-14T11:54:21.634404+0000","last_deep_scrub":"264'164","last_deep_scrub_stamp":"2024-09-14T11:54:21.634404+0000","last_clean_scrub_stamp":"2024-09-14T11:54:21.634404+0000","objects_scrubbed":7,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:42.569487+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":193,"num_read_kb":186,"num_write":126,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"264'803","reported_seq":2781,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.590790+0000","last_change":"2024-09-14T11:54:22.590790+0000","last_active":"2024-09-14T11:54:22.590790+0000","last_peered":"2024-09-14T11:54:22.590790+0000","last_clean":"2024-09-14T11:54:22.590790+0000","last_became_active":"2024-09-14T11:09:53.018558+0000","last_became_peered":"2024-09-14T11:09:53.018558+0000","last_unstale":"2024-09-14T11:54:22.590790+0000","last_undegraded":"2024-09-14T11:54:22.590790+0000","last_fullsized":"2024-09-14T11:54:22.590790+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'803","last_scrub_stamp":"2024-09-14T11:54:22.590509+0000","last_deep_scrub":"264'803","last_deep_scrub_stamp":"2024-09-14T11:54:22.590509+0000","last_clean_scrub_stamp":"2024-09-14T11:54:22.590509+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:46:00.083819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"264'105","reported_seq":605,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:29.396479+0000","last_change":"2024-09-14T11:54:29.396336+0000","last_active":"2024-09-14T11:54:29.396479+0000","last_peered":"2024-09-14T11:54:29.396479+0000","last_clean":"2024-09-14T11:54:29.396479+0000","last_became_active":"2024-09-14T11:09:55.017739+0000","last_became_peered":"2024-09-14T11:09:55.017739+0000","last_unstale":"2024-09-14T11:54:29.396479+0000","last_undegraded":"2024-09-14T11:54:29.396479+0000","last_fullsized":"2024-09-14T11:54:29.396479+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'105","last_scrub_stamp":"2024-09-14T11:54:29.396141+0000","last_deep_scrub":"264'105","last_deep_scrub_stamp":"2024-09-14T11:54:29.396141+0000","last_clean_scrub_stamp":"2024-09-14T11:54:29.396141+0000","objects_scrubbed":4,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:14.770917+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":97,"num_read_kb":96,"num_write":232,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"264'1042","reported_seq":2583,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.687055+0000","last_change":"2024-09-14T11:54:09.687055+0000","last_active":"2024-09-14T11:54:09.687055+0000","last_peered":"2024-09-14T11:54:09.687055+0000","last_clean":"2024-09-14T11:54:09.687055+0000","last_became_active":"2024-09-14T11:09:46.958507+0000","last_became_peered":"2024-09-14T11:09:46.958507+0000","last_unstale":"2024-09-14T11:54:09.687055+0000","last_undegraded":"2024-09-14T11:54:09.687055+0000","last_fullsized":"2024-09-14T11:54:09.687055+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1042","last_scrub_stamp":"2024-09-14T11:54:09.686859+0000","last_deep_scrub":"264'1042","last_deep_scrub_stamp":"2024-09-14T11:54:09.686859+0000","last_clean_scrub_stamp":"2024-09-14T11:54:09.686859+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":1000,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:03.681837+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4784,"num_read_kb":4190,"num_write":1482,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"264'220","reported_seq":862,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.762074+0000","last_change":"2024-09-14T11:54:05.762074+0000","last_active":"2024-09-14T11:54:05.762074+0000","last_peered":"2024-09-14T11:54:05.762074+0000","last_clean":"2024-09-14T11:54:05.762074+0000","last_became_active":"2024-09-14T11:09:45.217039+0000","last_became_peered":"2024-09-14T11:09:45.217039+0000","last_unstale":"2024-09-14T11:54:05.762074+0000","last_undegraded":"2024-09-14T11:54:05.762074+0000","last_fullsized":"2024-09-14T11:54:05.762074+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'220","last_scrub_stamp":"2024-09-14T11:54:05.761858+0000","last_deep_scrub":"264'220","last_deep_scrub_stamp":"2024-09-14T11:54:05.761858+0000","last_clean_scrub_stamp":"2024-09-14T11:54:05.761858+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:30.840271+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":539,"num_read_kb":14764,"num_write":981,"num_write_kb":31870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:02.752870+0000","last_change":"2024-09-14T11:54:02.752870+0000","last_active":"2024-09-14T11:54:02.752870+0000","last_peered":"2024-09-14T11:54:02.752870+0000","last_clean":"2024-09-14T11:54:02.752870+0000","last_became_active":"2024-09-14T11:09:36.106073+0000","last_became_peered":"2024-09-14T11:09:36.106073+0000","last_unstale":"2024-09-14T11:54:02.752870+0000","last_undegraded":"2024-09-14T11:54:02.752870+0000","last_fullsized":"2024-09-14T11:54:02.752870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:02.752684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:02.752684+0000","last_clean_scrub_stamp":"2024-09-14T11:54:02.752684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:30.079185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012975129999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.856207+0000","last_change":"2024-09-14T11:54:28.856207+0000","last_active":"2024-09-14T11:54:28.856207+0000","last_peered":"2024-09-14T11:54:28.856207+0000","last_clean":"2024-09-14T11:54:28.856207+0000","last_became_active":"2024-09-14T11:09:48.970339+0000","last_became_peered":"2024-09-14T11:09:48.970339+0000","last_unstale":"2024-09-14T11:54:28.856207+0000","last_undegraded":"2024-09-14T11:54:28.856207+0000","last_fullsized":"2024-09-14T11:54:28.856207+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:28.856019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:28.856019+0000","last_clean_scrub_stamp":"2024-09-14T11:54:28.856019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:07.889082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"264'127","reported_seq":666,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:33.738196+0000","last_change":"2024-09-14T11:54:33.738196+0000","last_active":"2024-09-14T11:54:33.738196+0000","last_peered":"2024-09-14T11:54:33.738196+0000","last_clean":"2024-09-14T11:54:33.738196+0000","last_became_active":"2024-09-14T11:09:50.979827+0000","last_became_peered":"2024-09-14T11:09:50.979827+0000","last_unstale":"2024-09-14T11:54:33.738196+0000","last_undegraded":"2024-09-14T11:54:33.738196+0000","last_fullsized":"2024-09-14T11:54:33.738196+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'127","last_scrub_stamp":"2024-09-14T11:54:33.738016+0000","last_deep_scrub":"264'127","last_deep_scrub_stamp":"2024-09-14T11:54:33.738016+0000","last_clean_scrub_stamp":"2024-09-14T11:54:33.738016+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:42.416480+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":133,"num_read_kb":122,"num_write":94,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"264'803","reported_seq":2488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:30.106338+0000","last_change":"2024-09-14T11:54:30.106338+0000","last_active":"2024-09-14T11:54:30.106338+0000","last_peered":"2024-09-14T11:54:30.106338+0000","last_clean":"2024-09-14T11:54:30.106338+0000","last_became_active":"2024-09-14T11:09:53.007337+0000","last_became_peered":"2024-09-14T11:09:53.007337+0000","last_unstale":"2024-09-14T11:54:30.106338+0000","last_undegraded":"2024-09-14T11:54:30.106338+0000","last_fullsized":"2024-09-14T11:54:30.106338+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'803","last_scrub_stamp":"2024-09-14T11:54:30.106144+0000","last_deep_scrub":"264'803","last_deep_scrub_stamp":"2024-09-14T11:54:30.106144+0000","last_clean_scrub_stamp":"2024-09-14T11:54:30.106144+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:49.440969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"264'271","reported_seq":806,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:37.145858+0000","last_change":"2024-09-14T11:54:37.145706+0000","last_active":"2024-09-14T11:54:37.145858+0000","last_peered":"2024-09-14T11:54:37.145858+0000","last_clean":"2024-09-14T11:54:37.145858+0000","last_became_active":"2024-09-14T11:09:55.011828+0000","last_became_peered":"2024-09-14T11:09:55.011828+0000","last_unstale":"2024-09-14T11:54:37.145858+0000","last_undegraded":"2024-09-14T11:54:37.145858+0000","last_fullsized":"2024-09-14T11:54:37.145858+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'271","last_scrub_stamp":"2024-09-14T11:54:37.145521+0000","last_deep_scrub":"264'271","last_deep_scrub_stamp":"2024-09-14T11:54:37.145521+0000","last_clean_scrub_stamp":"2024-09-14T11:54:37.145521+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:04.142063+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":359,"num_read_kb":349,"num_write":571,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"264'1163","reported_seq":2668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.302504+0000","last_change":"2024-09-14T11:54:05.302504+0000","last_active":"2024-09-14T11:54:05.302504+0000","last_peered":"2024-09-14T11:54:05.302504+0000","last_clean":"2024-09-14T11:54:05.302504+0000","last_became_active":"2024-09-14T11:09:46.946010+0000","last_became_peered":"2024-09-14T11:09:46.946010+0000","last_unstale":"2024-09-14T11:54:05.302504+0000","last_undegraded":"2024-09-14T11:54:05.302504+0000","last_fullsized":"2024-09-14T11:54:05.302504+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1163","last_scrub_stamp":"2024-09-14T11:54:05.302255+0000","last_deep_scrub":"264'1163","last_deep_scrub_stamp":"2024-09-14T11:54:05.302255+0000","last_clean_scrub_stamp":"2024-09-14T11:54:05.302255+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":1100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:58.209905+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5209,"num_read_kb":4587,"num_write":1598,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":272,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"264'212","reported_seq":890,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.735457+0000","last_change":"2024-09-14T11:54:04.735457+0000","last_active":"2024-09-14T11:54:04.735457+0000","last_peered":"2024-09-14T11:54:04.735457+0000","last_clean":"2024-09-14T11:54:04.735457+0000","last_became_active":"2024-09-14T11:09:45.212500+0000","last_became_peered":"2024-09-14T11:09:45.212500+0000","last_unstale":"2024-09-14T11:54:04.735457+0000","last_undegraded":"2024-09-14T11:54:04.735457+0000","last_fullsized":"2024-09-14T11:54:04.735457+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'212","last_scrub_stamp":"2024-09-14T11:54:04.735162+0000","last_deep_scrub":"264'212","last_deep_scrub_stamp":"2024-09-14T11:54:04.735162+0000","last_clean_scrub_stamp":"2024-09-14T11:54:04.735162+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:20.313589+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":655,"num_read_kb":3804,"num_write":900,"num_write_kb":25360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.758528+0000","last_change":"2024-09-14T11:54:06.758528+0000","last_active":"2024-09-14T11:54:06.758528+0000","last_peered":"2024-09-14T11:54:06.758528+0000","last_clean":"2024-09-14T11:54:06.758528+0000","last_became_active":"2024-09-14T11:09:36.108781+0000","last_became_peered":"2024-09-14T11:09:36.108781+0000","last_unstale":"2024-09-14T11:54:06.758528+0000","last_undegraded":"2024-09-14T11:54:06.758528+0000","last_fullsized":"2024-09-14T11:54:06.758528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:06.758347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:06.758347+0000","last_clean_scrub_stamp":"2024-09-14T11:54:06.758347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:28:12.438815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002510581,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.798261+0000","last_change":"2024-09-14T11:54:19.798261+0000","last_active":"2024-09-14T11:54:19.798261+0000","last_peered":"2024-09-14T11:54:19.798261+0000","last_clean":"2024-09-14T11:54:19.798261+0000","last_became_active":"2024-09-14T11:09:48.970940+0000","last_became_peered":"2024-09-14T11:09:48.970940+0000","last_unstale":"2024-09-14T11:54:19.798261+0000","last_undegraded":"2024-09-14T11:54:19.798261+0000","last_fullsized":"2024-09-14T11:54:19.798261+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:19.798083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:19.798083+0000","last_clean_scrub_stamp":"2024-09-14T11:54:19.798083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:16.786632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"264'316","reported_seq":1034,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.851005+0000","last_change":"2024-09-14T11:54:18.851005+0000","last_active":"2024-09-14T11:54:18.851005+0000","last_peered":"2024-09-14T11:54:18.851005+0000","last_clean":"2024-09-14T11:54:18.851005+0000","last_became_active":"2024-09-14T11:09:50.992374+0000","last_became_peered":"2024-09-14T11:09:50.992374+0000","last_unstale":"2024-09-14T11:54:18.851005+0000","last_undegraded":"2024-09-14T11:54:18.851005+0000","last_fullsized":"2024-09-14T11:54:18.851005+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'316","last_scrub_stamp":"2024-09-14T11:54:18.850798+0000","last_deep_scrub":"264'316","last_deep_scrub_stamp":"2024-09-14T11:54:18.850798+0000","last_clean_scrub_stamp":"2024-09-14T11:54:18.850798+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:16.507010+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20511,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":444,"num_read_kb":597,"num_write":216,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:33.010265+0000","last_change":"2024-09-14T11:54:33.010265+0000","last_active":"2024-09-14T11:54:33.010265+0000","last_peered":"2024-09-14T11:54:33.010265+0000","last_clean":"2024-09-14T11:54:33.010265+0000","last_became_active":"2024-09-14T11:09:53.002904+0000","last_became_peered":"2024-09-14T11:09:53.002904+0000","last_unstale":"2024-09-14T11:54:33.010265+0000","last_undegraded":"2024-09-14T11:54:33.010265+0000","last_fullsized":"2024-09-14T11:54:33.010265+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:33.010079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:33.010079+0000","last_clean_scrub_stamp":"2024-09-14T11:54:33.010079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:39:42.102479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"264'134","reported_seq":643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.336831+0000","last_change":"2024-09-14T11:54:26.336573+0000","last_active":"2024-09-14T11:54:26.336831+0000","last_peered":"2024-09-14T11:54:26.336831+0000","last_clean":"2024-09-14T11:54:26.336831+0000","last_became_active":"2024-09-14T11:09:55.014192+0000","last_became_peered":"2024-09-14T11:09:55.014192+0000","last_unstale":"2024-09-14T11:54:26.336831+0000","last_undegraded":"2024-09-14T11:54:26.336831+0000","last_fullsized":"2024-09-14T11:54:26.336831+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'134","last_scrub_stamp":"2024-09-14T11:54:26.336329+0000","last_deep_scrub":"264'134","last_deep_scrub_stamp":"2024-09-14T11:54:26.336329+0000","last_clean_scrub_stamp":"2024-09-14T11:54:26.336329+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:52:14.198542+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":303,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"264'165","reported_seq":755,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:39.092236+0000","last_change":"2024-09-14T11:54:39.092236+0000","last_active":"2024-09-14T11:54:39.092236+0000","last_peered":"2024-09-14T11:54:39.092236+0000","last_clean":"2024-09-14T11:54:39.092236+0000","last_became_active":"2024-09-14T11:09:55.015127+0000","last_became_peered":"2024-09-14T11:09:55.015127+0000","last_unstale":"2024-09-14T11:54:39.092236+0000","last_undegraded":"2024-09-14T11:54:39.092236+0000","last_fullsized":"2024-09-14T11:54:39.092236+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'165","last_scrub_stamp":"2024-09-14T11:54:39.091942+0000","last_deep_scrub":"264'165","last_deep_scrub_stamp":"2024-09-14T11:54:39.091942+0000","last_clean_scrub_stamp":"2024-09-14T11:54:39.091942+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:38.689842+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":313,"num_read_kb":285,"num_write":384,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"264'825","reported_seq":2491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.394964+0000","last_change":"2024-09-14T11:54:13.394964+0000","last_active":"2024-09-14T11:54:13.394964+0000","last_peered":"2024-09-14T11:54:13.394964+0000","last_clean":"2024-09-14T11:54:13.394964+0000","last_became_active":"2024-09-14T11:09:46.948706+0000","last_became_peered":"2024-09-14T11:09:46.948706+0000","last_unstale":"2024-09-14T11:54:13.394964+0000","last_undegraded":"2024-09-14T11:54:13.394964+0000","last_fullsized":"2024-09-14T11:54:13.394964+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'825","last_scrub_stamp":"2024-09-14T11:54:13.394780+0000","last_deep_scrub":"264'825","last_deep_scrub_stamp":"2024-09-14T11:54:13.394780+0000","last_clean_scrub_stamp":"2024-09-14T11:54:13.394780+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:09.219229+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4239,"num_read_kb":3866,"num_write":1097,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2295,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"264'194","reported_seq":844,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.818862+0000","last_change":"2024-09-14T11:54:14.818716+0000","last_active":"2024-09-14T11:54:14.818862+0000","last_peered":"2024-09-14T11:54:14.818862+0000","last_clean":"2024-09-14T11:54:14.818862+0000","last_became_active":"2024-09-14T11:09:45.201562+0000","last_became_peered":"2024-09-14T11:09:45.201562+0000","last_unstale":"2024-09-14T11:54:14.818862+0000","last_undegraded":"2024-09-14T11:54:14.818862+0000","last_fullsized":"2024-09-14T11:54:14.818862+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'194","last_scrub_stamp":"2024-09-14T11:54:14.818523+0000","last_deep_scrub":"264'194","last_deep_scrub_stamp":"2024-09-14T11:54:14.818523+0000","last_clean_scrub_stamp":"2024-09-14T11:54:14.818523+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:51:40.122733+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655874,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":505,"num_read_kb":86083,"num_write":869,"num_write_kb":49236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.602327+0000","last_change":"2024-09-14T11:54:20.602327+0000","last_active":"2024-09-14T11:54:20.602327+0000","last_peered":"2024-09-14T11:54:20.602327+0000","last_clean":"2024-09-14T11:54:20.602327+0000","last_became_active":"2024-09-14T11:09:48.962619+0000","last_became_peered":"2024-09-14T11:09:48.962619+0000","last_unstale":"2024-09-14T11:54:20.602327+0000","last_undegraded":"2024-09-14T11:54:20.602327+0000","last_fullsized":"2024-09-14T11:54:20.602327+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:20.602135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:20.602135+0000","last_clean_scrub_stamp":"2024-09-14T11:54:20.602135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:46.015649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"264'175","reported_seq":753,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:23.656894+0000","last_change":"2024-09-14T11:54:23.656894+0000","last_active":"2024-09-14T11:54:23.656894+0000","last_peered":"2024-09-14T11:54:23.656894+0000","last_clean":"2024-09-14T11:54:23.656894+0000","last_became_active":"2024-09-14T11:09:50.996047+0000","last_became_peered":"2024-09-14T11:09:50.996047+0000","last_unstale":"2024-09-14T11:54:23.656894+0000","last_undegraded":"2024-09-14T11:54:23.656894+0000","last_fullsized":"2024-09-14T11:54:23.656894+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'175","last_scrub_stamp":"2024-09-14T11:54:23.656676+0000","last_deep_scrub":"264'175","last_deep_scrub_stamp":"2024-09-14T11:54:23.656676+0000","last_clean_scrub_stamp":"2024-09-14T11:54:23.656676+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:01.298471+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28669,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":205,"num_read_kb":341,"num_write":126,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:23.273840+0000","last_change":"2024-09-14T11:54:23.273840+0000","last_active":"2024-09-14T11:54:23.273840+0000","last_peered":"2024-09-14T11:54:23.273840+0000","last_clean":"2024-09-14T11:54:23.273840+0000","last_became_active":"2024-09-14T11:09:53.000339+0000","last_became_peered":"2024-09-14T11:09:53.000339+0000","last_unstale":"2024-09-14T11:54:23.273840+0000","last_undegraded":"2024-09-14T11:54:23.273840+0000","last_fullsized":"2024-09-14T11:54:23.273840+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:23.273658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:23.273658+0000","last_clean_scrub_stamp":"2024-09-14T11:54:23.273658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:38:03.101466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"264'95","reported_seq":589,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:32.485486+0000","last_change":"2024-09-14T11:54:32.485486+0000","last_active":"2024-09-14T11:54:32.485486+0000","last_peered":"2024-09-14T11:54:32.485486+0000","last_clean":"2024-09-14T11:54:32.485486+0000","last_became_active":"2024-09-14T11:09:55.022477+0000","last_became_peered":"2024-09-14T11:09:55.022477+0000","last_unstale":"2024-09-14T11:54:32.485486+0000","last_undegraded":"2024-09-14T11:54:32.485486+0000","last_fullsized":"2024-09-14T11:54:32.485486+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'95","last_scrub_stamp":"2024-09-14T11:54:32.485306+0000","last_deep_scrub":"264'95","last_deep_scrub_stamp":"2024-09-14T11:54:32.485306+0000","last_clean_scrub_stamp":"2024-09-14T11:54:32.485306+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:28.186314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":73,"num_write":206,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"264'414","reported_seq":1955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.649873+0000","last_change":"2024-09-14T11:54:10.649873+0000","last_active":"2024-09-14T11:54:10.649873+0000","last_peered":"2024-09-14T11:54:10.649873+0000","last_clean":"2024-09-14T11:54:10.649873+0000","last_became_active":"2024-09-14T11:09:46.948572+0000","last_became_peered":"2024-09-14T11:09:46.948572+0000","last_unstale":"2024-09-14T11:54:10.649873+0000","last_undegraded":"2024-09-14T11:54:10.649873+0000","last_fullsized":"2024-09-14T11:54:10.649873+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'414","last_scrub_stamp":"2024-09-14T11:54:10.649705+0000","last_deep_scrub":"264'414","last_deep_scrub_stamp":"2024-09-14T11:54:10.649705+0000","last_clean_scrub_stamp":"2024-09-14T11:54:10.649705+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:12.848610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2176,"num_read_kb":2078,"num_write":464,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"264'236","reported_seq":860,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:02.763944+0000","last_change":"2024-09-14T11:54:02.763944+0000","last_active":"2024-09-14T11:54:02.763944+0000","last_peered":"2024-09-14T11:54:02.763944+0000","last_clean":"2024-09-14T11:54:02.763944+0000","last_became_active":"2024-09-14T11:09:45.223324+0000","last_became_peered":"2024-09-14T11:09:45.223324+0000","last_unstale":"2024-09-14T11:54:02.763944+0000","last_undegraded":"2024-09-14T11:54:02.763944+0000","last_fullsized":"2024-09-14T11:54:02.763944+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'236","last_scrub_stamp":"2024-09-14T11:54:02.763871+0000","last_deep_scrub":"264'236","last_deep_scrub_stamp":"2024-09-14T11:54:02.763871+0000","last_clean_scrub_stamp":"2024-09-14T11:54:02.763871+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:42.678734+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655868,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":554,"num_read_kb":7834,"num_write":1127,"num_write_kb":26023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"264'4","reported_seq":988,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:23.889113+0000","last_change":"2024-09-14T11:54:23.889113+0000","last_active":"2024-09-14T11:54:23.889113+0000","last_peered":"2024-09-14T11:54:23.889113+0000","last_clean":"2024-09-14T11:54:23.889113+0000","last_became_active":"2024-09-14T11:09:48.968561+0000","last_became_peered":"2024-09-14T11:09:48.968561+0000","last_unstale":"2024-09-14T11:54:23.889113+0000","last_undegraded":"2024-09-14T11:54:23.889113+0000","last_fullsized":"2024-09-14T11:54:23.889113+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T11:54:23.888928+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T11:54:23.888928+0000","last_clean_scrub_stamp":"2024-09-14T11:54:23.888928+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:46:06.061212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":728,"num_read_kb":726,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"264'47","reported_seq":557,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.898965+0000","last_change":"2024-09-14T11:54:27.898965+0000","last_active":"2024-09-14T11:54:27.898965+0000","last_peered":"2024-09-14T11:54:27.898965+0000","last_clean":"2024-09-14T11:54:27.898965+0000","last_became_active":"2024-09-14T11:09:50.981128+0000","last_became_peered":"2024-09-14T11:09:50.981128+0000","last_unstale":"2024-09-14T11:54:27.898965+0000","last_undegraded":"2024-09-14T11:54:27.898965+0000","last_fullsized":"2024-09-14T11:54:27.898965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'47","last_scrub_stamp":"2024-09-14T11:54:27.898748+0000","last_deep_scrub":"264'47","last_deep_scrub_stamp":"2024-09-14T11:54:27.898748+0000","last_clean_scrub_stamp":"2024-09-14T11:54:27.898748+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:00.300018+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.306525+0000","last_change":"2024-09-14T11:54:20.306525+0000","last_active":"2024-09-14T11:54:20.306525+0000","last_peered":"2024-09-14T11:54:20.306525+0000","last_clean":"2024-09-14T11:54:20.306525+0000","last_became_active":"2024-09-14T11:09:53.006292+0000","last_became_peered":"2024-09-14T11:09:53.006292+0000","last_unstale":"2024-09-14T11:54:20.306525+0000","last_undegraded":"2024-09-14T11:54:20.306525+0000","last_fullsized":"2024-09-14T11:54:20.306525+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:20.306354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:20.306354+0000","last_clean_scrub_stamp":"2024-09-14T11:54:20.306354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:34.456657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"264'207","reported_seq":733,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:31.610859+0000","last_change":"2024-09-14T11:54:31.610670+0000","last_active":"2024-09-14T11:54:31.610859+0000","last_peered":"2024-09-14T11:54:31.610859+0000","last_clean":"2024-09-14T11:54:31.610859+0000","last_became_active":"2024-09-14T11:09:55.014414+0000","last_became_peered":"2024-09-14T11:09:55.014414+0000","last_unstale":"2024-09-14T11:54:31.610859+0000","last_undegraded":"2024-09-14T11:54:31.610859+0000","last_fullsized":"2024-09-14T11:54:31.610859+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'207","last_scrub_stamp":"2024-09-14T11:54:31.610484+0000","last_deep_scrub":"264'207","last_deep_scrub_stamp":"2024-09-14T11:54:31.610484+0000","last_clean_scrub_stamp":"2024-09-14T11:54:31.610484+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:59.574341+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":294,"num_read_kb":289,"num_write":451,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"264'677","reported_seq":2440,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.681990+0000","last_change":"2024-09-14T11:54:14.681990+0000","last_active":"2024-09-14T11:54:14.681990+0000","last_peered":"2024-09-14T11:54:14.681990+0000","last_clean":"2024-09-14T11:54:14.681990+0000","last_became_active":"2024-09-14T11:09:46.962508+0000","last_became_peered":"2024-09-14T11:09:46.962508+0000","last_unstale":"2024-09-14T11:54:14.681990+0000","last_undegraded":"2024-09-14T11:54:14.681990+0000","last_fullsized":"2024-09-14T11:54:14.681990+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'677","last_scrub_stamp":"2024-09-14T11:54:14.681778+0000","last_deep_scrub":"264'677","last_deep_scrub_stamp":"2024-09-14T11:54:14.681778+0000","last_clean_scrub_stamp":"2024-09-14T11:54:14.681778+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":600,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:39.225516+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3732,"num_read_kb":3415,"num_write":933,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"264'190","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.341400+0000","last_change":"2024-09-14T11:54:04.341400+0000","last_active":"2024-09-14T11:54:04.341400+0000","last_peered":"2024-09-14T11:54:04.341400+0000","last_clean":"2024-09-14T11:54:04.341400+0000","last_became_active":"2024-09-14T11:09:45.206901+0000","last_became_peered":"2024-09-14T11:09:45.206901+0000","last_unstale":"2024-09-14T11:54:04.341400+0000","last_undegraded":"2024-09-14T11:54:04.341400+0000","last_fullsized":"2024-09-14T11:54:04.341400+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'190","last_scrub_stamp":"2024-09-14T11:54:04.341295+0000","last_deep_scrub":"264'190","last_deep_scrub_stamp":"2024-09-14T11:54:04.341295+0000","last_clean_scrub_stamp":"2024-09-14T11:54:04.341295+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:03.874799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":442,"num_read_kb":9264,"num_write":863,"num_write_kb":15949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.355084+0000","last_change":"2024-09-14T11:54:27.355084+0000","last_active":"2024-09-14T11:54:27.355084+0000","last_peered":"2024-09-14T11:54:27.355084+0000","last_clean":"2024-09-14T11:54:27.355084+0000","last_became_active":"2024-09-14T11:09:48.959413+0000","last_became_peered":"2024-09-14T11:09:48.959413+0000","last_unstale":"2024-09-14T11:54:27.355084+0000","last_undegraded":"2024-09-14T11:54:27.355084+0000","last_fullsized":"2024-09-14T11:54:27.355084+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:27.354885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:27.354885+0000","last_clean_scrub_stamp":"2024-09-14T11:54:27.354885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:07.088907+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"264'163","reported_seq":753,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.317507+0000","last_change":"2024-09-14T11:54:22.317507+0000","last_active":"2024-09-14T11:54:22.317507+0000","last_peered":"2024-09-14T11:54:22.317507+0000","last_clean":"2024-09-14T11:54:22.317507+0000","last_became_active":"2024-09-14T11:09:50.999585+0000","last_became_peered":"2024-09-14T11:09:50.999585+0000","last_unstale":"2024-09-14T11:54:22.317507+0000","last_undegraded":"2024-09-14T11:54:22.317507+0000","last_fullsized":"2024-09-14T11:54:22.317507+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'163","last_scrub_stamp":"2024-09-14T11:54:22.317312+0000","last_deep_scrub":"264'163","last_deep_scrub_stamp":"2024-09-14T11:54:22.317312+0000","last_clean_scrub_stamp":"2024-09-14T11:54:22.317312+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:12.615304+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7038,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":217,"num_read_kb":281,"num_write":118,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:23.566618+0000","last_change":"2024-09-14T11:54:23.566618+0000","last_active":"2024-09-14T11:54:23.566618+0000","last_peered":"2024-09-14T11:54:23.566618+0000","last_clean":"2024-09-14T11:54:23.566618+0000","last_became_active":"2024-09-14T11:09:53.018479+0000","last_became_peered":"2024-09-14T11:09:53.018479+0000","last_unstale":"2024-09-14T11:54:23.566618+0000","last_undegraded":"2024-09-14T11:54:23.566618+0000","last_fullsized":"2024-09-14T11:54:23.566618+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:23.566438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:23.566438+0000","last_clean_scrub_stamp":"2024-09-14T11:54:23.566438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:53:34.310619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"264'129","reported_seq":641,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:49.643219+0000","last_change":"2024-09-14T11:54:49.642954+0000","last_active":"2024-09-14T11:54:49.643219+0000","last_peered":"2024-09-14T11:54:49.643219+0000","last_clean":"2024-09-14T11:54:49.643219+0000","last_became_active":"2024-09-14T11:09:55.028633+0000","last_became_peered":"2024-09-14T11:09:55.028633+0000","last_unstale":"2024-09-14T11:54:49.643219+0000","last_undegraded":"2024-09-14T11:54:49.643219+0000","last_fullsized":"2024-09-14T11:54:49.643219+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'129","last_scrub_stamp":"2024-09-14T11:54:49.642720+0000","last_deep_scrub":"264'129","last_deep_scrub_stamp":"2024-09-14T11:54:49.642720+0000","last_clean_scrub_stamp":"2024-09-14T11:54:49.642720+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:13.334343+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":141,"num_write":296,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"264'506","reported_seq":2225,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.325712+0000","last_change":"2024-09-14T11:54:11.325712+0000","last_active":"2024-09-14T11:54:11.325712+0000","last_peered":"2024-09-14T11:54:11.325712+0000","last_clean":"2024-09-14T11:54:11.325712+0000","last_became_active":"2024-09-14T11:09:46.962364+0000","last_became_peered":"2024-09-14T11:09:46.962364+0000","last_unstale":"2024-09-14T11:54:11.325712+0000","last_undegraded":"2024-09-14T11:54:11.325712+0000","last_fullsized":"2024-09-14T11:54:11.325712+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'506","last_scrub_stamp":"2024-09-14T11:54:11.325519+0000","last_deep_scrub":"264'506","last_deep_scrub_stamp":"2024-09-14T11:54:11.325519+0000","last_clean_scrub_stamp":"2024-09-14T11:54:11.325519+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:16.688907+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2859,"num_read_kb":2685,"num_write":625,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"264'228","reported_seq":856,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.151831+0000","last_change":"2024-09-14T11:54:05.151831+0000","last_active":"2024-09-14T11:54:05.151831+0000","last_peered":"2024-09-14T11:54:05.151831+0000","last_clean":"2024-09-14T11:54:05.151831+0000","last_became_active":"2024-09-14T11:09:45.206145+0000","last_became_peered":"2024-09-14T11:09:45.206145+0000","last_unstale":"2024-09-14T11:54:05.151831+0000","last_undegraded":"2024-09-14T11:54:05.151831+0000","last_fullsized":"2024-09-14T11:54:05.151831+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'228","last_scrub_stamp":"2024-09-14T11:54:05.151645+0000","last_deep_scrub":"264'228","last_deep_scrub_stamp":"2024-09-14T11:54:05.151645+0000","last_clean_scrub_stamp":"2024-09-14T11:54:05.151645+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:21.231443+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":553,"num_read_kb":30372,"num_write":894,"num_write_kb":16933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"264'5","reported_seq":983,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:30.851200+0000","last_change":"2024-09-14T11:54:30.851200+0000","last_active":"2024-09-14T11:54:30.851200+0000","last_peered":"2024-09-14T11:54:30.851200+0000","last_clean":"2024-09-14T11:54:30.851200+0000","last_became_active":"2024-09-14T11:09:48.963563+0000","last_became_peered":"2024-09-14T11:09:48.963563+0000","last_unstale":"2024-09-14T11:54:30.851200+0000","last_undegraded":"2024-09-14T11:54:30.851200+0000","last_fullsized":"2024-09-14T11:54:30.851200+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-14T11:54:30.850999+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-14T11:54:30.850999+0000","last_clean_scrub_stamp":"2024-09-14T11:54:30.850999+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:37.854729+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":1197,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"264'128","reported_seq":698,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.899397+0000","last_change":"2024-09-14T11:54:24.899397+0000","last_active":"2024-09-14T11:54:24.899397+0000","last_peered":"2024-09-14T11:54:24.899397+0000","last_clean":"2024-09-14T11:54:24.899397+0000","last_became_active":"2024-09-14T11:09:50.988286+0000","last_became_peered":"2024-09-14T11:09:50.988286+0000","last_unstale":"2024-09-14T11:54:24.899397+0000","last_undegraded":"2024-09-14T11:54:24.899397+0000","last_fullsized":"2024-09-14T11:54:24.899397+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'128","last_scrub_stamp":"2024-09-14T11:54:24.899247+0000","last_deep_scrub":"264'128","last_deep_scrub_stamp":"2024-09-14T11:54:24.899247+0000","last_clean_scrub_stamp":"2024-09-14T11:54:24.899247+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:22.020527+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5180,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":147,"num_read_kb":193,"num_write":70,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.313607+0000","last_change":"2024-09-14T11:54:24.313607+0000","last_active":"2024-09-14T11:54:24.313607+0000","last_peered":"2024-09-14T11:54:24.313607+0000","last_clean":"2024-09-14T11:54:24.313607+0000","last_became_active":"2024-09-14T11:09:53.006975+0000","last_became_peered":"2024-09-14T11:09:53.006975+0000","last_unstale":"2024-09-14T11:54:24.313607+0000","last_undegraded":"2024-09-14T11:54:24.313607+0000","last_fullsized":"2024-09-14T11:54:24.313607+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:24.313368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:24.313368+0000","last_clean_scrub_stamp":"2024-09-14T11:54:24.313368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:50:17.993903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"264'601","reported_seq":2256,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.917264+0000","last_change":"2024-09-14T11:54:22.917264+0000","last_active":"2024-09-14T11:54:22.917264+0000","last_peered":"2024-09-14T11:54:22.917264+0000","last_clean":"2024-09-14T11:54:22.917264+0000","last_became_active":"2024-09-14T11:09:46.975017+0000","last_became_peered":"2024-09-14T11:09:46.975017+0000","last_unstale":"2024-09-14T11:54:22.917264+0000","last_undegraded":"2024-09-14T11:54:22.917264+0000","last_fullsized":"2024-09-14T11:54:22.917264+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'601","last_scrub_stamp":"2024-09-14T11:54:22.917071+0000","last_deep_scrub":"264'601","last_deep_scrub_stamp":"2024-09-14T11:54:22.917071+0000","last_clean_scrub_stamp":"2024-09-14T11:54:22.917071+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":500,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:52.422521+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3191,"num_read_kb":2927,"num_write":756,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"264'284","reported_seq":973,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.119049+0000","last_change":"2024-09-14T11:54:06.119049+0000","last_active":"2024-09-14T11:54:06.119049+0000","last_peered":"2024-09-14T11:54:06.119049+0000","last_clean":"2024-09-14T11:54:06.119049+0000","last_became_active":"2024-09-14T11:09:45.216742+0000","last_became_peered":"2024-09-14T11:09:45.216742+0000","last_unstale":"2024-09-14T11:54:06.119049+0000","last_undegraded":"2024-09-14T11:54:06.119049+0000","last_fullsized":"2024-09-14T11:54:06.119049+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'284","last_scrub_stamp":"2024-09-14T11:54:06.118835+0000","last_deep_scrub":"264'284","last_deep_scrub_stamp":"2024-09-14T11:54:06.118835+0000","last_clean_scrub_stamp":"2024-09-14T11:54:06.118835+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:00.653277+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":743,"num_read_kb":84606,"num_write":1211,"num_write_kb":44892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.642521+0000","last_change":"2024-09-14T11:54:19.642521+0000","last_active":"2024-09-14T11:54:19.642521+0000","last_peered":"2024-09-14T11:54:19.642521+0000","last_clean":"2024-09-14T11:54:19.642521+0000","last_became_active":"2024-09-14T11:09:48.966112+0000","last_became_peered":"2024-09-14T11:09:48.966112+0000","last_unstale":"2024-09-14T11:54:19.642521+0000","last_undegraded":"2024-09-14T11:54:19.642521+0000","last_fullsized":"2024-09-14T11:54:19.642521+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:19.642292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:19.642292+0000","last_clean_scrub_stamp":"2024-09-14T11:54:19.642292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:48.336482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"264'214","reported_seq":846,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:25.619648+0000","last_change":"2024-09-14T11:54:25.619507+0000","last_active":"2024-09-14T11:54:25.619648+0000","last_peered":"2024-09-14T11:54:25.619648+0000","last_clean":"2024-09-14T11:54:25.619648+0000","last_became_active":"2024-09-14T11:09:50.995279+0000","last_became_peered":"2024-09-14T11:09:50.995279+0000","last_unstale":"2024-09-14T11:54:25.619648+0000","last_undegraded":"2024-09-14T11:54:25.619648+0000","last_fullsized":"2024-09-14T11:54:25.619648+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'214","last_scrub_stamp":"2024-09-14T11:54:25.619315+0000","last_deep_scrub":"264'214","last_deep_scrub_stamp":"2024-09-14T11:54:25.619315+0000","last_clean_scrub_stamp":"2024-09-14T11:54:25.619315+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:24.525339+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27447,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":311,"num_read_kb":486,"num_write":198,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.315249+0000","last_change":"2024-09-14T11:54:24.315112+0000","last_active":"2024-09-14T11:54:24.315249+0000","last_peered":"2024-09-14T11:54:24.315249+0000","last_clean":"2024-09-14T11:54:24.315249+0000","last_became_active":"2024-09-14T11:09:53.002862+0000","last_became_peered":"2024-09-14T11:09:53.002862+0000","last_unstale":"2024-09-14T11:54:24.315249+0000","last_undegraded":"2024-09-14T11:54:24.315249+0000","last_fullsized":"2024-09-14T11:54:24.315249+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:24.314937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:24.314937+0000","last_clean_scrub_stamp":"2024-09-14T11:54:24.314937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:19.540172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"264'169","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:40.117939+0000","last_change":"2024-09-14T11:54:40.117939+0000","last_active":"2024-09-14T11:54:40.117939+0000","last_peered":"2024-09-14T11:54:40.117939+0000","last_clean":"2024-09-14T11:54:40.117939+0000","last_became_active":"2024-09-14T11:09:55.023821+0000","last_became_peered":"2024-09-14T11:09:55.023821+0000","last_unstale":"2024-09-14T11:54:40.117939+0000","last_undegraded":"2024-09-14T11:54:40.117939+0000","last_fullsized":"2024-09-14T11:54:40.117939+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'169","last_scrub_stamp":"2024-09-14T11:54:40.117756+0000","last_deep_scrub":"264'169","last_deep_scrub_stamp":"2024-09-14T11:54:40.117756+0000","last_clean_scrub_stamp":"2024-09-14T11:54:40.117756+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:42.833180+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":195,"num_read_kb":205,"num_write":392,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"264'863","reported_seq":2622,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.716452+0000","last_change":"2024-09-14T11:54:13.716452+0000","last_active":"2024-09-14T11:54:13.716452+0000","last_peered":"2024-09-14T11:54:13.716452+0000","last_clean":"2024-09-14T11:54:13.716452+0000","last_became_active":"2024-09-14T11:09:46.967144+0000","last_became_peered":"2024-09-14T11:09:46.967144+0000","last_unstale":"2024-09-14T11:54:13.716452+0000","last_undegraded":"2024-09-14T11:54:13.716452+0000","last_fullsized":"2024-09-14T11:54:13.716452+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'863","last_scrub_stamp":"2024-09-14T11:54:13.716280+0000","last_deep_scrub":"264'863","last_deep_scrub_stamp":"2024-09-14T11:54:13.716280+0000","last_clean_scrub_stamp":"2024-09-14T11:54:13.716280+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":800,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:40.233051+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4422,"num_read_kb":4033,"num_write":1158,"num_write_kb":453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"264'189","reported_seq":811,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.715232+0000","last_change":"2024-09-14T11:54:07.715232+0000","last_active":"2024-09-14T11:54:07.715232+0000","last_peered":"2024-09-14T11:54:07.715232+0000","last_clean":"2024-09-14T11:54:07.715232+0000","last_became_active":"2024-09-14T11:09:45.186745+0000","last_became_peered":"2024-09-14T11:09:45.186745+0000","last_unstale":"2024-09-14T11:54:07.715232+0000","last_undegraded":"2024-09-14T11:54:07.715232+0000","last_fullsized":"2024-09-14T11:54:07.715232+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'189","last_scrub_stamp":"2024-09-14T11:54:07.715044+0000","last_deep_scrub":"264'189","last_deep_scrub_stamp":"2024-09-14T11:54:07.715044+0000","last_clean_scrub_stamp":"2024-09-14T11:54:07.715044+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:02.047080+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":536,"num_read_kb":5513,"num_write":846,"num_write_kb":29456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.372960+0000","last_change":"2024-09-14T11:54:17.372960+0000","last_active":"2024-09-14T11:54:17.372960+0000","last_peered":"2024-09-14T11:54:17.372960+0000","last_clean":"2024-09-14T11:54:17.372960+0000","last_became_active":"2024-09-14T11:09:48.951908+0000","last_became_peered":"2024-09-14T11:09:48.951908+0000","last_unstale":"2024-09-14T11:54:17.372960+0000","last_undegraded":"2024-09-14T11:54:17.372960+0000","last_fullsized":"2024-09-14T11:54:17.372960+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:17.372741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:17.372741+0000","last_clean_scrub_stamp":"2024-09-14T11:54:17.372741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:12.820647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"264'174","reported_seq":759,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.748905+0000","last_change":"2024-09-14T11:54:38.748765+0000","last_active":"2024-09-14T11:54:38.748905+0000","last_peered":"2024-09-14T11:54:38.748905+0000","last_clean":"2024-09-14T11:54:38.748905+0000","last_became_active":"2024-09-14T11:09:50.983553+0000","last_became_peered":"2024-09-14T11:09:50.983553+0000","last_unstale":"2024-09-14T11:54:38.748905+0000","last_undegraded":"2024-09-14T11:54:38.748905+0000","last_fullsized":"2024-09-14T11:54:38.748905+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'174","last_scrub_stamp":"2024-09-14T11:54:38.748505+0000","last_deep_scrub":"264'174","last_deep_scrub_stamp":"2024-09-14T11:54:38.748505+0000","last_clean_scrub_stamp":"2024-09-14T11:54:38.748505+0000","objects_scrubbed":8,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:00.468758+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13815,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":225,"num_read_kb":306,"num_write":144,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.122603+0000","last_change":"2024-09-14T11:54:38.122370+0000","last_active":"2024-09-14T11:54:38.122603+0000","last_peered":"2024-09-14T11:54:38.122603+0000","last_clean":"2024-09-14T11:54:38.122603+0000","last_became_active":"2024-09-14T11:09:53.023609+0000","last_became_peered":"2024-09-14T11:09:53.023609+0000","last_unstale":"2024-09-14T11:54:38.122603+0000","last_undegraded":"2024-09-14T11:54:38.122603+0000","last_fullsized":"2024-09-14T11:54:38.122603+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:38.122093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:38.122093+0000","last_clean_scrub_stamp":"2024-09-14T11:54:38.122093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:47.411895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"264'160","reported_seq":665,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:46.726951+0000","last_change":"2024-09-14T11:54:46.726951+0000","last_active":"2024-09-14T11:54:46.726951+0000","last_peered":"2024-09-14T11:54:46.726951+0000","last_clean":"2024-09-14T11:54:46.726951+0000","last_became_active":"2024-09-14T11:09:55.028344+0000","last_became_peered":"2024-09-14T11:09:55.028344+0000","last_unstale":"2024-09-14T11:54:46.726951+0000","last_undegraded":"2024-09-14T11:54:46.726951+0000","last_fullsized":"2024-09-14T11:54:46.726951+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'160","last_scrub_stamp":"2024-09-14T11:54:46.726755+0000","last_deep_scrub":"264'160","last_deep_scrub_stamp":"2024-09-14T11:54:46.726755+0000","last_clean_scrub_stamp":"2024-09-14T11:54:46.726755+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:37.970471+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1619,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":178,"num_read_kb":177,"num_write":459,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"264'848","reported_seq":2455,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.403132+0000","last_change":"2024-09-14T11:54:14.402985+0000","last_active":"2024-09-14T11:54:14.403132+0000","last_peered":"2024-09-14T11:54:14.403132+0000","last_clean":"2024-09-14T11:54:14.403132+0000","last_became_active":"2024-09-14T11:09:46.990923+0000","last_became_peered":"2024-09-14T11:09:46.990923+0000","last_unstale":"2024-09-14T11:54:14.403132+0000","last_undegraded":"2024-09-14T11:54:14.403132+0000","last_fullsized":"2024-09-14T11:54:14.403132+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'848","last_scrub_stamp":"2024-09-14T11:54:14.402785+0000","last_deep_scrub":"264'848","last_deep_scrub_stamp":"2024-09-14T11:54:14.402785+0000","last_clean_scrub_stamp":"2024-09-14T11:54:14.402785+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":800,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:06.689765+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4067,"num_read_kb":3661,"num_write":1092,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"264'168","reported_seq":762,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.622544+0000","last_change":"2024-09-14T11:54:04.622290+0000","last_active":"2024-09-14T11:54:04.622544+0000","last_peered":"2024-09-14T11:54:04.622544+0000","last_clean":"2024-09-14T11:54:04.622544+0000","last_became_active":"2024-09-14T11:09:45.201058+0000","last_became_peered":"2024-09-14T11:09:45.201058+0000","last_unstale":"2024-09-14T11:54:04.622544+0000","last_undegraded":"2024-09-14T11:54:04.622544+0000","last_fullsized":"2024-09-14T11:54:04.622544+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'168","last_scrub_stamp":"2024-09-14T11:54:04.622018+0000","last_deep_scrub":"264'168","last_deep_scrub_stamp":"2024-09-14T11:54:04.622018+0000","last_clean_scrub_stamp":"2024-09-14T11:54:04.622018+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:44.170656+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":358,"num_read_kb":4087,"num_write":735,"num_write_kb":11722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.418960+0000","last_change":"2024-09-14T11:54:15.418808+0000","last_active":"2024-09-14T11:54:15.418960+0000","last_peered":"2024-09-14T11:54:15.418960+0000","last_clean":"2024-09-14T11:54:15.418960+0000","last_became_active":"2024-09-14T11:09:48.968770+0000","last_became_peered":"2024-09-14T11:09:48.968770+0000","last_unstale":"2024-09-14T11:54:15.418960+0000","last_undegraded":"2024-09-14T11:54:15.418960+0000","last_fullsized":"2024-09-14T11:54:15.418960+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:15.418547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:15.418547+0000","last_clean_scrub_stamp":"2024-09-14T11:54:15.418547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:15.576692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"264'137","reported_seq":717,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.660092+0000","last_change":"2024-09-14T11:54:26.660092+0000","last_active":"2024-09-14T11:54:26.660092+0000","last_peered":"2024-09-14T11:54:26.660092+0000","last_clean":"2024-09-14T11:54:26.660092+0000","last_became_active":"2024-09-14T11:09:50.999079+0000","last_became_peered":"2024-09-14T11:09:50.999079+0000","last_unstale":"2024-09-14T11:54:26.660092+0000","last_undegraded":"2024-09-14T11:54:26.660092+0000","last_fullsized":"2024-09-14T11:54:26.660092+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'137","last_scrub_stamp":"2024-09-14T11:54:26.659891+0000","last_deep_scrub":"264'137","last_deep_scrub_stamp":"2024-09-14T11:54:26.659891+0000","last_clean_scrub_stamp":"2024-09-14T11:54:26.659891+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:10.513103+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6871,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":175,"num_read_kb":247,"num_write":92,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.337061+0000","last_change":"2024-09-14T11:54:26.337061+0000","last_active":"2024-09-14T11:54:26.337061+0000","last_peered":"2024-09-14T11:54:26.337061+0000","last_clean":"2024-09-14T11:54:26.337061+0000","last_became_active":"2024-09-14T11:09:53.008952+0000","last_became_peered":"2024-09-14T11:09:53.008952+0000","last_unstale":"2024-09-14T11:54:26.337061+0000","last_undegraded":"2024-09-14T11:54:26.337061+0000","last_fullsized":"2024-09-14T11:54:26.337061+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:26.336884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:26.336884+0000","last_clean_scrub_stamp":"2024-09-14T11:54:26.336884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:22.557625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"264'144","reported_seq":645,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.701790+0000","last_change":"2024-09-14T11:54:47.701790+0000","last_active":"2024-09-14T11:54:47.701790+0000","last_peered":"2024-09-14T11:54:47.701790+0000","last_clean":"2024-09-14T11:54:47.701790+0000","last_became_active":"2024-09-14T11:09:55.028413+0000","last_became_peered":"2024-09-14T11:09:55.028413+0000","last_unstale":"2024-09-14T11:54:47.701790+0000","last_undegraded":"2024-09-14T11:54:47.701790+0000","last_fullsized":"2024-09-14T11:54:47.701790+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'144","last_scrub_stamp":"2024-09-14T11:54:47.701603+0000","last_deep_scrub":"264'144","last_deep_scrub_stamp":"2024-09-14T11:54:47.701603+0000","last_clean_scrub_stamp":"2024-09-14T11:54:47.701603+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:10.272787+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":142,"num_write":355,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"264'425","reported_seq":1991,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:12.675846+0000","last_change":"2024-09-14T11:54:12.675564+0000","last_active":"2024-09-14T11:54:12.675846+0000","last_peered":"2024-09-14T11:54:12.675846+0000","last_clean":"2024-09-14T11:54:12.675846+0000","last_became_active":"2024-09-14T11:09:46.986721+0000","last_became_peered":"2024-09-14T11:09:46.986721+0000","last_unstale":"2024-09-14T11:54:12.675846+0000","last_undegraded":"2024-09-14T11:54:12.675846+0000","last_fullsized":"2024-09-14T11:54:12.675846+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'425","last_scrub_stamp":"2024-09-14T11:54:12.675309+0000","last_deep_scrub":"264'425","last_deep_scrub_stamp":"2024-09-14T11:54:12.675309+0000","last_clean_scrub_stamp":"2024-09-14T11:54:12.675309+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:42.450711+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2241,"num_read_kb":2140,"num_write":472,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"264'231","reported_seq":844,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.670244+0000","last_change":"2024-09-14T11:54:08.670061+0000","last_active":"2024-09-14T11:54:08.670244+0000","last_peered":"2024-09-14T11:54:08.670244+0000","last_clean":"2024-09-14T11:54:08.670244+0000","last_became_active":"2024-09-14T11:09:45.211984+0000","last_became_peered":"2024-09-14T11:09:45.211984+0000","last_unstale":"2024-09-14T11:54:08.670244+0000","last_undegraded":"2024-09-14T11:54:08.670244+0000","last_fullsized":"2024-09-14T11:54:08.670244+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'231","last_scrub_stamp":"2024-09-14T11:54:08.669862+0000","last_deep_scrub":"264'231","last_deep_scrub_stamp":"2024-09-14T11:54:08.669862+0000","last_clean_scrub_stamp":"2024-09-14T11:54:08.669862+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:46.692498+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":505,"num_read_kb":8662,"num_write":1132,"num_write_kb":22372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:25.884206+0000","last_change":"2024-09-14T11:54:25.884052+0000","last_active":"2024-09-14T11:54:25.884206+0000","last_peered":"2024-09-14T11:54:25.884206+0000","last_clean":"2024-09-14T11:54:25.884206+0000","last_became_active":"2024-09-14T11:09:48.968459+0000","last_became_peered":"2024-09-14T11:09:48.968459+0000","last_unstale":"2024-09-14T11:54:25.884206+0000","last_undegraded":"2024-09-14T11:54:25.884206+0000","last_fullsized":"2024-09-14T11:54:25.884206+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:25.883831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:25.883831+0000","last_clean_scrub_stamp":"2024-09-14T11:54:25.883831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:45.445692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"264'102","reported_seq":626,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:39.757198+0000","last_change":"2024-09-14T11:54:39.757198+0000","last_active":"2024-09-14T11:54:39.757198+0000","last_peered":"2024-09-14T11:54:39.757198+0000","last_clean":"2024-09-14T11:54:39.757198+0000","last_became_active":"2024-09-14T11:09:50.979749+0000","last_became_peered":"2024-09-14T11:09:50.979749+0000","last_unstale":"2024-09-14T11:54:39.757198+0000","last_undegraded":"2024-09-14T11:54:39.757198+0000","last_fullsized":"2024-09-14T11:54:39.757198+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'102","last_scrub_stamp":"2024-09-14T11:54:39.756989+0000","last_deep_scrub":"264'102","last_deep_scrub_stamp":"2024-09-14T11:54:39.756989+0000","last_clean_scrub_stamp":"2024-09-14T11:54:39.756989+0000","objects_scrubbed":6,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:18.949852+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":88,"num_read_kb":80,"num_write":70,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"264'783","reported_seq":4308,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.866789+0000","last_change":"2024-09-14T11:54:26.866789+0000","last_active":"2024-09-14T11:54:26.866789+0000","last_peered":"2024-09-14T11:54:26.866789+0000","last_clean":"2024-09-14T11:54:26.866789+0000","last_became_active":"2024-09-14T11:09:53.014955+0000","last_became_peered":"2024-09-14T11:09:53.014955+0000","last_unstale":"2024-09-14T11:54:26.866789+0000","last_undegraded":"2024-09-14T11:54:26.866789+0000","last_fullsized":"2024-09-14T11:54:26.866789+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'783","last_scrub_stamp":"2024-09-14T11:54:26.866593+0000","last_deep_scrub":"264'783","last_deep_scrub_stamp":"2024-09-14T11:54:26.866593+0000","last_clean_scrub_stamp":"2024-09-14T11:54:26.866593+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:19.315165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"264'92","reported_seq":590,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:45.685182+0000","last_change":"2024-09-14T11:54:45.685182+0000","last_active":"2024-09-14T11:54:45.685182+0000","last_peered":"2024-09-14T11:54:45.685182+0000","last_clean":"2024-09-14T11:54:45.685182+0000","last_became_active":"2024-09-14T11:09:55.030211+0000","last_became_peered":"2024-09-14T11:09:55.030211+0000","last_unstale":"2024-09-14T11:54:45.685182+0000","last_undegraded":"2024-09-14T11:54:45.685182+0000","last_fullsized":"2024-09-14T11:54:45.685182+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'92","last_scrub_stamp":"2024-09-14T11:54:45.684986+0000","last_deep_scrub":"264'92","last_deep_scrub_stamp":"2024-09-14T11:54:45.684986+0000","last_clean_scrub_stamp":"2024-09-14T11:54:45.684986+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:19.324250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":87,"num_write":222,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"264'456","reported_seq":2008,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.357098+0000","last_change":"2024-09-14T11:54:19.356863+0000","last_active":"2024-09-14T11:54:19.357098+0000","last_peered":"2024-09-14T11:54:19.357098+0000","last_clean":"2024-09-14T11:54:19.357098+0000","last_became_active":"2024-09-14T11:09:46.974957+0000","last_became_peered":"2024-09-14T11:09:46.974957+0000","last_unstale":"2024-09-14T11:54:19.357098+0000","last_undegraded":"2024-09-14T11:54:19.357098+0000","last_fullsized":"2024-09-14T11:54:19.357098+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'456","last_scrub_stamp":"2024-09-14T11:54:19.356645+0000","last_deep_scrub":"264'456","last_deep_scrub_stamp":"2024-09-14T11:54:19.356645+0000","last_clean_scrub_stamp":"2024-09-14T11:54:19.356645+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:51.238936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2398,"num_read_kb":2260,"num_write":532,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"264'307","reported_seq":1008,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:02.648404+0000","last_change":"2024-09-14T11:54:02.648344+0000","last_active":"2024-09-14T11:54:02.648404+0000","last_peered":"2024-09-14T11:54:02.648404+0000","last_clean":"2024-09-14T11:54:02.648404+0000","last_became_active":"2024-09-14T11:09:45.204014+0000","last_became_peered":"2024-09-14T11:09:45.204014+0000","last_unstale":"2024-09-14T11:54:02.648404+0000","last_undegraded":"2024-09-14T11:54:02.648404+0000","last_fullsized":"2024-09-14T11:54:02.648404+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'307","last_scrub_stamp":"2024-09-14T11:54:02.648264+0000","last_deep_scrub":"264'307","last_deep_scrub_stamp":"2024-09-14T11:54:02.648264+0000","last_clean_scrub_stamp":"2024-09-14T11:54:02.648264+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:19.048576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":844,"num_read_kb":35877,"num_write":1474,"num_write_kb":50924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.686069+0000","last_change":"2024-09-14T11:54:19.685905+0000","last_active":"2024-09-14T11:54:19.686069+0000","last_peered":"2024-09-14T11:54:19.686069+0000","last_clean":"2024-09-14T11:54:19.686069+0000","last_became_active":"2024-09-14T11:09:48.950445+0000","last_became_peered":"2024-09-14T11:09:48.950445+0000","last_unstale":"2024-09-14T11:54:19.686069+0000","last_undegraded":"2024-09-14T11:54:19.686069+0000","last_fullsized":"2024-09-14T11:54:19.686069+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:19.685726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:19.685726+0000","last_clean_scrub_stamp":"2024-09-14T11:54:19.685726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:25.961511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"264'173","reported_seq":757,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:21.861599+0000","last_change":"2024-09-14T11:54:21.861599+0000","last_active":"2024-09-14T11:54:21.861599+0000","last_peered":"2024-09-14T11:54:21.861599+0000","last_clean":"2024-09-14T11:54:21.861599+0000","last_became_active":"2024-09-14T11:09:50.992216+0000","last_became_peered":"2024-09-14T11:09:50.992216+0000","last_unstale":"2024-09-14T11:54:21.861599+0000","last_undegraded":"2024-09-14T11:54:21.861599+0000","last_fullsized":"2024-09-14T11:54:21.861599+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'173","last_scrub_stamp":"2024-09-14T11:54:21.861380+0000","last_deep_scrub":"264'173","last_deep_scrub_stamp":"2024-09-14T11:54:21.861380+0000","last_clean_scrub_stamp":"2024-09-14T11:54:21.861380+0000","objects_scrubbed":7,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:17.222257+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59902,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":237,"num_read_kb":452,"num_write":144,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:35.974705+0000","last_change":"2024-09-14T11:54:35.974705+0000","last_active":"2024-09-14T11:54:35.974705+0000","last_peered":"2024-09-14T11:54:35.974705+0000","last_clean":"2024-09-14T11:54:35.974705+0000","last_became_active":"2024-09-14T11:09:53.023492+0000","last_became_peered":"2024-09-14T11:09:53.023492+0000","last_unstale":"2024-09-14T11:54:35.974705+0000","last_undegraded":"2024-09-14T11:54:35.974705+0000","last_fullsized":"2024-09-14T11:54:35.974705+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:35.974527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:35.974527+0000","last_clean_scrub_stamp":"2024-09-14T11:54:35.974527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:08.100468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"264'115","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:29.590701+0000","last_change":"2024-09-14T11:54:29.590701+0000","last_active":"2024-09-14T11:54:29.590701+0000","last_peered":"2024-09-14T11:54:29.590701+0000","last_clean":"2024-09-14T11:54:29.590701+0000","last_became_active":"2024-09-14T11:09:55.027044+0000","last_became_peered":"2024-09-14T11:09:55.027044+0000","last_unstale":"2024-09-14T11:54:29.590701+0000","last_undegraded":"2024-09-14T11:54:29.590701+0000","last_fullsized":"2024-09-14T11:54:29.590701+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'115","last_scrub_stamp":"2024-09-14T11:54:29.590497+0000","last_deep_scrub":"264'115","last_deep_scrub_stamp":"2024-09-14T11:54:29.590497+0000","last_clean_scrub_stamp":"2024-09-14T11:54:29.590497+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:32:47.840687+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":137,"num_read_kb":126,"num_write":268,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"264'784","reported_seq":2419,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.425744+0000","last_change":"2024-09-14T11:54:11.425477+0000","last_active":"2024-09-14T11:54:11.425744+0000","last_peered":"2024-09-14T11:54:11.425744+0000","last_clean":"2024-09-14T11:54:11.425744+0000","last_became_active":"2024-09-14T11:09:46.981651+0000","last_became_peered":"2024-09-14T11:09:46.981651+0000","last_unstale":"2024-09-14T11:54:11.425744+0000","last_undegraded":"2024-09-14T11:54:11.425744+0000","last_fullsized":"2024-09-14T11:54:11.425744+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'784","last_scrub_stamp":"2024-09-14T11:54:11.425249+0000","last_deep_scrub":"264'784","last_deep_scrub_stamp":"2024-09-14T11:54:11.425249+0000","last_clean_scrub_stamp":"2024-09-14T11:54:11.425249+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:21.549218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3785,"num_read_kb":3457,"num_write":1011,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"264'249","reported_seq":897,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:12.759056+0000","last_change":"2024-09-14T11:54:12.758882+0000","last_active":"2024-09-14T11:54:12.759056+0000","last_peered":"2024-09-14T11:54:12.759056+0000","last_clean":"2024-09-14T11:54:12.759056+0000","last_became_active":"2024-09-14T11:09:45.215127+0000","last_became_peered":"2024-09-14T11:09:45.215127+0000","last_unstale":"2024-09-14T11:54:12.759056+0000","last_undegraded":"2024-09-14T11:54:12.759056+0000","last_fullsized":"2024-09-14T11:54:12.759056+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'249","last_scrub_stamp":"2024-09-14T11:54:12.758682+0000","last_deep_scrub":"264'249","last_deep_scrub_stamp":"2024-09-14T11:54:12.758682+0000","last_clean_scrub_stamp":"2024-09-14T11:54:12.758682+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:33.194428+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655838,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":590,"num_read_kb":34633,"num_write":1021,"num_write_kb":52307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:21.336236+0000","last_change":"2024-09-14T11:54:21.336091+0000","last_active":"2024-09-14T11:54:21.336236+0000","last_peered":"2024-09-14T11:54:21.336236+0000","last_clean":"2024-09-14T11:54:21.336236+0000","last_became_active":"2024-09-14T11:09:48.960006+0000","last_became_peered":"2024-09-14T11:09:48.960006+0000","last_unstale":"2024-09-14T11:54:21.336236+0000","last_undegraded":"2024-09-14T11:54:21.336236+0000","last_fullsized":"2024-09-14T11:54:21.336236+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:21.335912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:21.335912+0000","last_clean_scrub_stamp":"2024-09-14T11:54:21.335912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:58.931314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"264'121","reported_seq":695,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:31.988047+0000","last_change":"2024-09-14T11:54:31.988047+0000","last_active":"2024-09-14T11:54:31.988047+0000","last_peered":"2024-09-14T11:54:31.988047+0000","last_clean":"2024-09-14T11:54:31.988047+0000","last_became_active":"2024-09-14T11:09:50.975555+0000","last_became_peered":"2024-09-14T11:09:50.975555+0000","last_unstale":"2024-09-14T11:54:31.988047+0000","last_undegraded":"2024-09-14T11:54:31.988047+0000","last_fullsized":"2024-09-14T11:54:31.988047+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'121","last_scrub_stamp":"2024-09-14T11:54:31.987835+0000","last_deep_scrub":"264'121","last_deep_scrub_stamp":"2024-09-14T11:54:31.987835+0000","last_clean_scrub_stamp":"2024-09-14T11:54:31.987835+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:03.800123+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5710,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":156,"num_read_kb":221,"num_write":78,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:41.686153+0000","last_change":"2024-09-14T11:54:41.686153+0000","last_active":"2024-09-14T11:54:41.686153+0000","last_peered":"2024-09-14T11:54:41.686153+0000","last_clean":"2024-09-14T11:54:41.686153+0000","last_became_active":"2024-09-14T11:09:53.015039+0000","last_became_peered":"2024-09-14T11:09:53.015039+0000","last_unstale":"2024-09-14T11:54:41.686153+0000","last_undegraded":"2024-09-14T11:54:41.686153+0000","last_fullsized":"2024-09-14T11:54:41.686153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:41.685979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:41.685979+0000","last_clean_scrub_stamp":"2024-09-14T11:54:41.685979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:57.047277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"264'94","reported_seq":611,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:41.161656+0000","last_change":"2024-09-14T11:54:41.161656+0000","last_active":"2024-09-14T11:54:41.161656+0000","last_peered":"2024-09-14T11:54:41.161656+0000","last_clean":"2024-09-14T11:54:41.161656+0000","last_became_active":"2024-09-14T11:09:55.013997+0000","last_became_peered":"2024-09-14T11:09:55.013997+0000","last_unstale":"2024-09-14T11:54:41.161656+0000","last_undegraded":"2024-09-14T11:54:41.161656+0000","last_fullsized":"2024-09-14T11:54:41.161656+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'94","last_scrub_stamp":"2024-09-14T11:54:41.161480+0000","last_deep_scrub":"264'94","last_deep_scrub_stamp":"2024-09-14T11:54:41.161480+0000","last_clean_scrub_stamp":"2024-09-14T11:54:41.161480+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:08:50.915166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":557,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":129,"num_write":227,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"264'1275","reported_seq":2891,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.288870+0000","last_change":"2024-09-14T11:54:10.288870+0000","last_active":"2024-09-14T11:54:10.288870+0000","last_peered":"2024-09-14T11:54:10.288870+0000","last_clean":"2024-09-14T11:54:10.288870+0000","last_became_active":"2024-09-14T11:09:46.982770+0000","last_became_peered":"2024-09-14T11:09:46.982770+0000","last_unstale":"2024-09-14T11:54:10.288870+0000","last_undegraded":"2024-09-14T11:54:10.288870+0000","last_fullsized":"2024-09-14T11:54:10.288870+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1275","last_scrub_stamp":"2024-09-14T11:54:10.288683+0000","last_deep_scrub":"264'1275","last_deep_scrub_stamp":"2024-09-14T11:54:10.288683+0000","last_clean_scrub_stamp":"2024-09-14T11:54:10.288683+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":1200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:08.762030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5800,"num_read_kb":5089,"num_write":1775,"num_write_kb":736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"264'210","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.091928+0000","last_change":"2024-09-14T11:54:07.091928+0000","last_active":"2024-09-14T11:54:07.091928+0000","last_peered":"2024-09-14T11:54:07.091928+0000","last_clean":"2024-09-14T11:54:07.091928+0000","last_became_active":"2024-09-14T11:09:45.200971+0000","last_became_peered":"2024-09-14T11:09:45.200971+0000","last_unstale":"2024-09-14T11:54:07.091928+0000","last_undegraded":"2024-09-14T11:54:07.091928+0000","last_fullsized":"2024-09-14T11:54:07.091928+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'210","last_scrub_stamp":"2024-09-14T11:54:07.091775+0000","last_deep_scrub":"264'210","last_deep_scrub_stamp":"2024-09-14T11:54:07.091775+0000","last_clean_scrub_stamp":"2024-09-14T11:54:07.091775+0000","objects_scrubbed":6,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:25.105451+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3174623,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":502,"num_read_kb":61081,"num_write":905,"num_write_kb":39968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.657373+0000","last_change":"2024-09-14T11:54:18.657373+0000","last_active":"2024-09-14T11:54:18.657373+0000","last_peered":"2024-09-14T11:54:18.657373+0000","last_clean":"2024-09-14T11:54:18.657373+0000","last_became_active":"2024-09-14T11:09:48.958168+0000","last_became_peered":"2024-09-14T11:09:48.958168+0000","last_unstale":"2024-09-14T11:54:18.657373+0000","last_undegraded":"2024-09-14T11:54:18.657373+0000","last_fullsized":"2024-09-14T11:54:18.657373+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:18.657106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:18.657106+0000","last_clean_scrub_stamp":"2024-09-14T11:54:18.657106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:03.227051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"264'106","reported_seq":668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.633417+0000","last_change":"2024-09-14T11:54:24.633267+0000","last_active":"2024-09-14T11:54:24.633417+0000","last_peered":"2024-09-14T11:54:24.633417+0000","last_clean":"2024-09-14T11:54:24.633417+0000","last_became_active":"2024-09-14T11:09:50.998951+0000","last_became_peered":"2024-09-14T11:09:50.998951+0000","last_unstale":"2024-09-14T11:54:24.633417+0000","last_undegraded":"2024-09-14T11:54:24.633417+0000","last_fullsized":"2024-09-14T11:54:24.633417+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'106","last_scrub_stamp":"2024-09-14T11:54:24.633080+0000","last_deep_scrub":"264'106","last_deep_scrub_stamp":"2024-09-14T11:54:24.633080+0000","last_clean_scrub_stamp":"2024-09-14T11:54:24.633080+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:50.324330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":125,"num_read_kb":141,"num_write":60,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.704753+0000","last_change":"2024-09-14T11:54:43.704603+0000","last_active":"2024-09-14T11:54:43.704753+0000","last_peered":"2024-09-14T11:54:43.704753+0000","last_clean":"2024-09-14T11:54:43.704753+0000","last_became_active":"2024-09-14T11:09:53.021595+0000","last_became_peered":"2024-09-14T11:09:53.021595+0000","last_unstale":"2024-09-14T11:54:43.704753+0000","last_undegraded":"2024-09-14T11:54:43.704753+0000","last_fullsized":"2024-09-14T11:54:43.704753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:43.704427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:43.704427+0000","last_clean_scrub_stamp":"2024-09-14T11:54:43.704427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:19.553670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"264'193","reported_seq":1657,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:48.687722+0000","last_change":"2024-09-14T11:54:48.687722+0000","last_active":"2024-09-14T11:54:48.687722+0000","last_peered":"2024-09-14T11:54:48.687722+0000","last_clean":"2024-09-14T11:54:48.687722+0000","last_became_active":"2024-09-14T11:09:55.028374+0000","last_became_peered":"2024-09-14T11:09:55.028374+0000","last_unstale":"2024-09-14T11:54:48.687722+0000","last_undegraded":"2024-09-14T11:54:48.687722+0000","last_fullsized":"2024-09-14T11:54:48.687722+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'193","last_scrub_stamp":"2024-09-14T11:54:48.687521+0000","last_deep_scrub":"264'193","last_deep_scrub_stamp":"2024-09-14T11:54:48.687521+0000","last_clean_scrub_stamp":"2024-09-14T11:54:48.687521+0000","objects_scrubbed":6,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:10.626480+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":650,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1185,"num_read_kb":1180,"num_write":425,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"264'678","reported_seq":2444,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.384340+0000","last_change":"2024-09-14T11:54:14.384340+0000","last_active":"2024-09-14T11:54:14.384340+0000","last_peered":"2024-09-14T11:54:14.384340+0000","last_clean":"2024-09-14T11:54:14.384340+0000","last_became_active":"2024-09-14T11:09:46.946243+0000","last_became_peered":"2024-09-14T11:09:46.946243+0000","last_unstale":"2024-09-14T11:54:14.384340+0000","last_undegraded":"2024-09-14T11:54:14.384340+0000","last_fullsized":"2024-09-14T11:54:14.384340+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'678","last_scrub_stamp":"2024-09-14T11:54:14.384140+0000","last_deep_scrub":"264'678","last_deep_scrub_stamp":"2024-09-14T11:54:14.384140+0000","last_clean_scrub_stamp":"2024-09-14T11:54:14.384140+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":600,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:37.864132+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3815,"num_read_kb":3478,"num_write":980,"num_write_kb":450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"264'190","reported_seq":824,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.123338+0000","last_change":"2024-09-14T11:54:08.123338+0000","last_active":"2024-09-14T11:54:08.123338+0000","last_peered":"2024-09-14T11:54:08.123338+0000","last_clean":"2024-09-14T11:54:08.123338+0000","last_became_active":"2024-09-14T11:09:45.201929+0000","last_became_peered":"2024-09-14T11:09:45.201929+0000","last_unstale":"2024-09-14T11:54:08.123338+0000","last_undegraded":"2024-09-14T11:54:08.123338+0000","last_fullsized":"2024-09-14T11:54:08.123338+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'190","last_scrub_stamp":"2024-09-14T11:54:08.123135+0000","last_deep_scrub":"264'190","last_deep_scrub_stamp":"2024-09-14T11:54:08.123135+0000","last_clean_scrub_stamp":"2024-09-14T11:54:08.123135+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:22.215301+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":518,"num_read_kb":13061,"num_write":810,"num_write_kb":29760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"264'2","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.880805+0000","last_change":"2024-09-14T11:54:24.880805+0000","last_active":"2024-09-14T11:54:24.880805+0000","last_peered":"2024-09-14T11:54:24.880805+0000","last_clean":"2024-09-14T11:54:24.880805+0000","last_became_active":"2024-09-14T11:09:48.963104+0000","last_became_peered":"2024-09-14T11:09:48.963104+0000","last_unstale":"2024-09-14T11:54:24.880805+0000","last_undegraded":"2024-09-14T11:54:24.880805+0000","last_fullsized":"2024-09-14T11:54:24.880805+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:24.880626+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:24.880626+0000","last_clean_scrub_stamp":"2024-09-14T11:54:24.880626+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:25.697197+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"264'169","reported_seq":755,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:36.772538+0000","last_change":"2024-09-14T11:54:36.772360+0000","last_active":"2024-09-14T11:54:36.772538+0000","last_peered":"2024-09-14T11:54:36.772538+0000","last_clean":"2024-09-14T11:54:36.772538+0000","last_became_active":"2024-09-14T11:09:50.983753+0000","last_became_peered":"2024-09-14T11:09:50.983753+0000","last_unstale":"2024-09-14T11:54:36.772538+0000","last_undegraded":"2024-09-14T11:54:36.772538+0000","last_fullsized":"2024-09-14T11:54:36.772538+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'169","last_scrub_stamp":"2024-09-14T11:54:36.772144+0000","last_deep_scrub":"264'169","last_deep_scrub_stamp":"2024-09-14T11:54:36.772144+0000","last_clean_scrub_stamp":"2024-09-14T11:54:36.772144+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:58.244746+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4671,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":206,"num_read_kb":262,"num_write":116,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:37.014216+0000","last_change":"2024-09-14T11:54:37.014050+0000","last_active":"2024-09-14T11:54:37.014216+0000","last_peered":"2024-09-14T11:54:37.014216+0000","last_clean":"2024-09-14T11:54:37.014216+0000","last_became_active":"2024-09-14T11:09:53.011077+0000","last_became_peered":"2024-09-14T11:09:53.011077+0000","last_unstale":"2024-09-14T11:54:37.014216+0000","last_undegraded":"2024-09-14T11:54:37.014216+0000","last_fullsized":"2024-09-14T11:54:37.014216+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:37.013874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:37.013874+0000","last_clean_scrub_stamp":"2024-09-14T11:54:37.013874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:18.050567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"264'168","reported_seq":676,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.915244+0000","last_change":"2024-09-14T11:54:28.915244+0000","last_active":"2024-09-14T11:54:28.915244+0000","last_peered":"2024-09-14T11:54:28.915244+0000","last_clean":"2024-09-14T11:54:28.915244+0000","last_became_active":"2024-09-14T11:09:55.021523+0000","last_became_peered":"2024-09-14T11:09:55.021523+0000","last_unstale":"2024-09-14T11:54:28.915244+0000","last_undegraded":"2024-09-14T11:54:28.915244+0000","last_fullsized":"2024-09-14T11:54:28.915244+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'168","last_scrub_stamp":"2024-09-14T11:54:28.915034+0000","last_deep_scrub":"264'168","last_deep_scrub_stamp":"2024-09-14T11:54:28.915034+0000","last_clean_scrub_stamp":"2024-09-14T11:54:28.915034+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:04.328569+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1072,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":209,"num_read_kb":183,"num_write":413,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"264'931","reported_seq":2658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.708900+0000","last_change":"2024-09-14T11:54:15.708900+0000","last_active":"2024-09-14T11:54:15.708900+0000","last_peered":"2024-09-14T11:54:15.708900+0000","last_clean":"2024-09-14T11:54:15.708900+0000","last_became_active":"2024-09-14T11:09:46.951108+0000","last_became_peered":"2024-09-14T11:09:46.951108+0000","last_unstale":"2024-09-14T11:54:15.708900+0000","last_undegraded":"2024-09-14T11:54:15.708900+0000","last_fullsized":"2024-09-14T11:54:15.708900+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'931","last_scrub_stamp":"2024-09-14T11:54:15.708652+0000","last_deep_scrub":"264'931","last_deep_scrub_stamp":"2024-09-14T11:54:15.708652+0000","last_clean_scrub_stamp":"2024-09-14T11:54:15.708652+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":900,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:05.702799+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6915,"num_read_kb":6425,"num_write":1478,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"264'233","reported_seq":924,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:02.380470+0000","last_change":"2024-09-14T11:54:02.380470+0000","last_active":"2024-09-14T11:54:02.380470+0000","last_peered":"2024-09-14T11:54:02.380470+0000","last_clean":"2024-09-14T11:54:02.380470+0000","last_became_active":"2024-09-14T11:09:45.211372+0000","last_became_peered":"2024-09-14T11:09:45.211372+0000","last_unstale":"2024-09-14T11:54:02.380470+0000","last_undegraded":"2024-09-14T11:54:02.380470+0000","last_fullsized":"2024-09-14T11:54:02.380470+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'233","last_scrub_stamp":"2024-09-14T11:54:02.380386+0000","last_deep_scrub":"264'233","last_deep_scrub_stamp":"2024-09-14T11:54:02.380386+0000","last_clean_scrub_stamp":"2024-09-14T11:54:02.380386+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:14.254836+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":701,"num_read_kb":62622,"num_write":1043,"num_write_kb":26227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"264'1162","reported_seq":2874,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:12.335584+0000","last_change":"2024-09-14T11:54:12.335584+0000","last_active":"2024-09-14T11:54:12.335584+0000","last_peered":"2024-09-14T11:54:12.335584+0000","last_clean":"2024-09-14T11:54:12.335584+0000","last_became_active":"2024-09-14T11:09:46.970185+0000","last_became_peered":"2024-09-14T11:09:46.970185+0000","last_unstale":"2024-09-14T11:54:12.335584+0000","last_undegraded":"2024-09-14T11:54:12.335584+0000","last_fullsized":"2024-09-14T11:54:12.335584+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1162","last_scrub_stamp":"2024-09-14T11:54:12.335362+0000","last_deep_scrub":"264'1162","last_deep_scrub_stamp":"2024-09-14T11:54:12.335362+0000","last_clean_scrub_stamp":"2024-09-14T11:54:12.335362+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":1100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:35:56.805295+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5490,"num_read_kb":4916,"num_write":1574,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3025,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"264'229","reported_seq":853,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.253331+0000","last_change":"2024-09-14T11:54:06.253331+0000","last_active":"2024-09-14T11:54:06.253331+0000","last_peered":"2024-09-14T11:54:06.253331+0000","last_clean":"2024-09-14T11:54:06.253331+0000","last_became_active":"2024-09-14T11:09:45.213238+0000","last_became_peered":"2024-09-14T11:09:45.213238+0000","last_unstale":"2024-09-14T11:54:06.253331+0000","last_undegraded":"2024-09-14T11:54:06.253331+0000","last_fullsized":"2024-09-14T11:54:06.253331+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'229","last_scrub_stamp":"2024-09-14T11:54:06.253133+0000","last_deep_scrub":"264'229","last_deep_scrub_stamp":"2024-09-14T11:54:06.253133+0000","last_clean_scrub_stamp":"2024-09-14T11:54:06.253133+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:05.425833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":552,"num_read_kb":930,"num_write":1100,"num_write_kb":31959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"264'418","reported_seq":1954,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:23.955913+0000","last_change":"2024-09-14T11:54:23.955913+0000","last_active":"2024-09-14T11:54:23.955913+0000","last_peered":"2024-09-14T11:54:23.955913+0000","last_clean":"2024-09-14T11:54:23.955913+0000","last_became_active":"2024-09-14T11:09:46.958063+0000","last_became_peered":"2024-09-14T11:09:46.958063+0000","last_unstale":"2024-09-14T11:54:23.955913+0000","last_undegraded":"2024-09-14T11:54:23.955913+0000","last_fullsized":"2024-09-14T11:54:23.955913+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'418","last_scrub_stamp":"2024-09-14T11:54:23.955735+0000","last_deep_scrub":"264'418","last_deep_scrub_stamp":"2024-09-14T11:54:23.955735+0000","last_clean_scrub_stamp":"2024-09-14T11:54:23.955735+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:30:58.368408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2247,"num_read_kb":2131,"num_write":481,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"264'227","reported_seq":1046,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.795526+0000","last_change":"2024-09-14T11:54:13.795526+0000","last_active":"2024-09-14T11:54:13.795526+0000","last_peered":"2024-09-14T11:54:13.795526+0000","last_clean":"2024-09-14T11:54:13.795526+0000","last_became_active":"2024-09-14T11:09:45.217258+0000","last_became_peered":"2024-09-14T11:09:45.217258+0000","last_unstale":"2024-09-14T11:54:13.795526+0000","last_undegraded":"2024-09-14T11:54:13.795526+0000","last_fullsized":"2024-09-14T11:54:13.795526+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'227","last_scrub_stamp":"2024-09-14T11:54:13.795287+0000","last_deep_scrub":"264'227","last_deep_scrub_stamp":"2024-09-14T11:54:13.795287+0000","last_clean_scrub_stamp":"2024-09-14T11:54:13.795287+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:59.198774+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311659,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1093,"num_read_kb":14899,"num_write":1046,"num_write_kb":43826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"264'406","reported_seq":1928,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:23.077918+0000","last_change":"2024-09-14T11:54:23.077918+0000","last_active":"2024-09-14T11:54:23.077918+0000","last_peered":"2024-09-14T11:54:23.077918+0000","last_clean":"2024-09-14T11:54:23.077918+0000","last_became_active":"2024-09-14T11:09:46.987465+0000","last_became_peered":"2024-09-14T11:09:46.987465+0000","last_unstale":"2024-09-14T11:54:23.077918+0000","last_undegraded":"2024-09-14T11:54:23.077918+0000","last_fullsized":"2024-09-14T11:54:23.077918+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'406","last_scrub_stamp":"2024-09-14T11:54:23.077727+0000","last_deep_scrub":"264'406","last_deep_scrub_stamp":"2024-09-14T11:54:23.077727+0000","last_clean_scrub_stamp":"2024-09-14T11:54:23.077727+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:59.683153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2188,"num_read_kb":2091,"num_write":479,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"264'214","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.155990+0000","last_change":"2024-09-14T11:54:09.155990+0000","last_active":"2024-09-14T11:54:09.155990+0000","last_peered":"2024-09-14T11:54:09.155990+0000","last_clean":"2024-09-14T11:54:09.155990+0000","last_became_active":"2024-09-14T11:09:45.210754+0000","last_became_peered":"2024-09-14T11:09:45.210754+0000","last_unstale":"2024-09-14T11:54:09.155990+0000","last_undegraded":"2024-09-14T11:54:09.155990+0000","last_fullsized":"2024-09-14T11:54:09.155990+0000","mapping_epoch":23,"log_start":"264'201","ondisk_log_start":"264'201","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'214","last_scrub_stamp":"2024-09-14T11:54:09.155714+0000","last_deep_scrub":"264'214","last_deep_scrub_stamp":"2024-09-14T11:54:09.155714+0000","last_clean_scrub_stamp":"2024-09-14T11:54:09.155714+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":201,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:16.447066+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254321,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":979,"num_write":956,"num_write_kb":15237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"264'393","reported_seq":1918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.113285+0000","last_change":"2024-09-14T11:54:20.113285+0000","last_active":"2024-09-14T11:54:20.113285+0000","last_peered":"2024-09-14T11:54:20.113285+0000","last_clean":"2024-09-14T11:54:20.113285+0000","last_became_active":"2024-09-14T11:09:46.975006+0000","last_became_peered":"2024-09-14T11:09:46.975006+0000","last_unstale":"2024-09-14T11:54:20.113285+0000","last_undegraded":"2024-09-14T11:54:20.113285+0000","last_fullsized":"2024-09-14T11:54:20.113285+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'393","last_scrub_stamp":"2024-09-14T11:54:20.113113+0000","last_deep_scrub":"264'393","last_deep_scrub_stamp":"2024-09-14T11:54:20.113113+0000","last_clean_scrub_stamp":"2024-09-14T11:54:20.113113+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:34.432992+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2194,"num_read_kb":2087,"num_write":454,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"264'207","reported_seq":831,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.669688+0000","last_change":"2024-09-14T11:54:04.669688+0000","last_active":"2024-09-14T11:54:04.669688+0000","last_peered":"2024-09-14T11:54:04.669688+0000","last_clean":"2024-09-14T11:54:04.669688+0000","last_became_active":"2024-09-14T11:09:45.210639+0000","last_became_peered":"2024-09-14T11:09:45.210639+0000","last_unstale":"2024-09-14T11:54:04.669688+0000","last_undegraded":"2024-09-14T11:54:04.669688+0000","last_fullsized":"2024-09-14T11:54:04.669688+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'207","last_scrub_stamp":"2024-09-14T11:54:04.669386+0000","last_deep_scrub":"264'207","last_deep_scrub_stamp":"2024-09-14T11:54:04.669386+0000","last_clean_scrub_stamp":"2024-09-14T11:54:04.669386+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:45.645744+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655887,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":487,"num_read_kb":12081,"num_write":976,"num_write_kb":34333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"264'844","reported_seq":2520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:12.797196+0000","last_change":"2024-09-14T11:54:12.797196+0000","last_active":"2024-09-14T11:54:12.797196+0000","last_peered":"2024-09-14T11:54:12.797196+0000","last_clean":"2024-09-14T11:54:12.797196+0000","last_became_active":"2024-09-14T11:09:46.961185+0000","last_became_peered":"2024-09-14T11:09:46.961185+0000","last_unstale":"2024-09-14T11:54:12.797196+0000","last_undegraded":"2024-09-14T11:54:12.797196+0000","last_fullsized":"2024-09-14T11:54:12.797196+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'844","last_scrub_stamp":"2024-09-14T11:54:12.796991+0000","last_deep_scrub":"264'844","last_deep_scrub_stamp":"2024-09-14T11:54:12.796991+0000","last_clean_scrub_stamp":"2024-09-14T11:54:12.796991+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":800,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:51.293229+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4099,"num_read_kb":3707,"num_write":1108,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"264'193","reported_seq":809,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.672295+0000","last_change":"2024-09-14T11:54:06.672295+0000","last_active":"2024-09-14T11:54:06.672295+0000","last_peered":"2024-09-14T11:54:06.672295+0000","last_clean":"2024-09-14T11:54:06.672295+0000","last_became_active":"2024-09-14T11:09:45.220246+0000","last_became_peered":"2024-09-14T11:09:45.220246+0000","last_unstale":"2024-09-14T11:54:06.672295+0000","last_undegraded":"2024-09-14T11:54:06.672295+0000","last_fullsized":"2024-09-14T11:54:06.672295+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'193","last_scrub_stamp":"2024-09-14T11:54:06.672104+0000","last_deep_scrub":"264'193","last_deep_scrub_stamp":"2024-09-14T11:54:06.672104+0000","last_clean_scrub_stamp":"2024-09-14T11:54:06.672104+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:13.489184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":452,"num_read_kb":10292,"num_write":865,"num_write_kb":29061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"264'673","reported_seq":2021,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.583120+0000","last_change":"2024-09-14T11:54:15.583120+0000","last_active":"2024-09-14T11:54:15.583120+0000","last_peered":"2024-09-14T11:54:15.583120+0000","last_clean":"2024-09-14T11:54:15.583120+0000","last_became_active":"2024-09-14T11:09:46.990649+0000","last_became_peered":"2024-09-14T11:09:46.990649+0000","last_unstale":"2024-09-14T11:54:15.583120+0000","last_undegraded":"2024-09-14T11:54:15.583120+0000","last_fullsized":"2024-09-14T11:54:15.583120+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'673","last_scrub_stamp":"2024-09-14T11:54:15.582941+0000","last_deep_scrub":"264'673","last_deep_scrub_stamp":"2024-09-14T11:54:15.582941+0000","last_clean_scrub_stamp":"2024-09-14T11:54:15.582941+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":600,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:20.316004+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3174,"num_read_kb":2866,"num_write":894,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"264'236","reported_seq":903,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.320327+0000","last_change":"2024-09-14T11:54:07.320327+0000","last_active":"2024-09-14T11:54:07.320327+0000","last_peered":"2024-09-14T11:54:07.320327+0000","last_clean":"2024-09-14T11:54:07.320327+0000","last_became_active":"2024-09-14T11:09:45.207500+0000","last_became_peered":"2024-09-14T11:09:45.207500+0000","last_unstale":"2024-09-14T11:54:07.320327+0000","last_undegraded":"2024-09-14T11:54:07.320327+0000","last_fullsized":"2024-09-14T11:54:07.320327+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'236","last_scrub_stamp":"2024-09-14T11:54:07.320137+0000","last_deep_scrub":"264'236","last_deep_scrub_stamp":"2024-09-14T11:54:07.320137+0000","last_clean_scrub_stamp":"2024-09-14T11:54:07.320137+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:25.724756+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":644,"num_read_kb":28771,"num_write":1111,"num_write_kb":28685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"264'2091","reported_seq":3870,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.573339+0000","last_change":"2024-09-14T11:54:09.573339+0000","last_active":"2024-09-14T11:54:09.573339+0000","last_peered":"2024-09-14T11:54:09.573339+0000","last_clean":"2024-09-14T11:54:09.573339+0000","last_became_active":"2024-09-14T11:09:46.964893+0000","last_became_peered":"2024-09-14T11:09:46.964893+0000","last_unstale":"2024-09-14T11:54:09.573339+0000","last_undegraded":"2024-09-14T11:54:09.573339+0000","last_fullsized":"2024-09-14T11:54:09.573339+0000","mapping_epoch":25,"log_start":"264'2000","ondisk_log_start":"264'2000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2091","last_scrub_stamp":"2024-09-14T11:54:09.573154+0000","last_deep_scrub":"264'2091","last_deep_scrub_stamp":"2024-09-14T11:54:09.573154+0000","last_clean_scrub_stamp":"2024-09-14T11:54:09.573154+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":2000,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:09.033740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9234,"num_read_kb":7993,"num_write":3022,"num_write_kb":1347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"264'284","reported_seq":991,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.154261+0000","last_change":"2024-09-14T11:54:10.154261+0000","last_active":"2024-09-14T11:54:10.154261+0000","last_peered":"2024-09-14T11:54:10.154261+0000","last_clean":"2024-09-14T11:54:10.154261+0000","last_became_active":"2024-09-14T11:09:45.201951+0000","last_became_peered":"2024-09-14T11:09:45.201951+0000","last_unstale":"2024-09-14T11:54:10.154261+0000","last_undegraded":"2024-09-14T11:54:10.154261+0000","last_fullsized":"2024-09-14T11:54:10.154261+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'284","last_scrub_stamp":"2024-09-14T11:54:10.154062+0000","last_deep_scrub":"264'284","last_deep_scrub_stamp":"2024-09-14T11:54:10.154062+0000","last_clean_scrub_stamp":"2024-09-14T11:54:10.154062+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:54.648794+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655900,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":878,"num_read_kb":20954,"num_write":1195,"num_write_kb":48388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"264'393","reported_seq":1907,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.436438+0000","last_change":"2024-09-14T11:54:15.436438+0000","last_active":"2024-09-14T11:54:15.436438+0000","last_peered":"2024-09-14T11:54:15.436438+0000","last_clean":"2024-09-14T11:54:15.436438+0000","last_became_active":"2024-09-14T11:09:46.982125+0000","last_became_peered":"2024-09-14T11:09:46.982125+0000","last_unstale":"2024-09-14T11:54:15.436438+0000","last_undegraded":"2024-09-14T11:54:15.436438+0000","last_fullsized":"2024-09-14T11:54:15.436438+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'393","last_scrub_stamp":"2024-09-14T11:54:15.436260+0000","last_deep_scrub":"264'393","last_deep_scrub_stamp":"2024-09-14T11:54:15.436260+0000","last_clean_scrub_stamp":"2024-09-14T11:54:15.436260+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:35.766474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2124,"num_read_kb":2027,"num_write":431,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"264'254","reported_seq":939,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.887775+0000","last_change":"2024-09-14T11:54:18.887775+0000","last_active":"2024-09-14T11:54:18.887775+0000","last_peered":"2024-09-14T11:54:18.887775+0000","last_clean":"2024-09-14T11:54:18.887775+0000","last_became_active":"2024-09-14T11:09:45.219634+0000","last_became_peered":"2024-09-14T11:09:45.219634+0000","last_unstale":"2024-09-14T11:54:18.887775+0000","last_undegraded":"2024-09-14T11:54:18.887775+0000","last_fullsized":"2024-09-14T11:54:18.887775+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'254","last_scrub_stamp":"2024-09-14T11:54:18.887539+0000","last_deep_scrub":"264'254","last_deep_scrub_stamp":"2024-09-14T11:54:18.887539+0000","last_clean_scrub_stamp":"2024-09-14T11:54:18.887539+0000","objects_scrubbed":4,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:50.094040+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311685,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":704,"num_read_kb":35580,"num_write":1143,"num_write_kb":63455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"264'547","reported_seq":2105,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.794085+0000","last_change":"2024-09-14T11:54:15.794085+0000","last_active":"2024-09-14T11:54:15.794085+0000","last_peered":"2024-09-14T11:54:15.794085+0000","last_clean":"2024-09-14T11:54:15.794085+0000","last_became_active":"2024-09-14T11:09:46.962261+0000","last_became_peered":"2024-09-14T11:09:46.962261+0000","last_unstale":"2024-09-14T11:54:15.794085+0000","last_undegraded":"2024-09-14T11:54:15.794085+0000","last_fullsized":"2024-09-14T11:54:15.794085+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'547","last_scrub_stamp":"2024-09-14T11:54:15.793906+0000","last_deep_scrub":"264'547","last_deep_scrub_stamp":"2024-09-14T11:54:15.793906+0000","last_clean_scrub_stamp":"2024-09-14T11:54:15.793906+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:35.613525+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2646,"num_read_kb":2439,"num_write":661,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"264'219","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:12.138157+0000","last_change":"2024-09-14T11:54:12.137906+0000","last_active":"2024-09-14T11:54:12.138157+0000","last_peered":"2024-09-14T11:54:12.138157+0000","last_clean":"2024-09-14T11:54:12.138157+0000","last_became_active":"2024-09-14T11:09:45.200775+0000","last_became_peered":"2024-09-14T11:09:45.200775+0000","last_unstale":"2024-09-14T11:54:12.138157+0000","last_undegraded":"2024-09-14T11:54:12.138157+0000","last_fullsized":"2024-09-14T11:54:12.138157+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'219","last_scrub_stamp":"2024-09-14T11:54:12.137682+0000","last_deep_scrub":"264'219","last_deep_scrub_stamp":"2024-09-14T11:54:12.137682+0000","last_clean_scrub_stamp":"2024-09-14T11:54:12.137682+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:03.171120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":537,"num_read_kb":33597,"num_write":1024,"num_write_kb":35359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"264'568","reported_seq":2423,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.068302+0000","last_change":"2024-09-14T11:54:22.068157+0000","last_active":"2024-09-14T11:54:22.068302+0000","last_peered":"2024-09-14T11:54:22.068302+0000","last_clean":"2024-09-14T11:54:22.068302+0000","last_became_active":"2024-09-14T11:09:46.974543+0000","last_became_peered":"2024-09-14T11:09:46.974543+0000","last_unstale":"2024-09-14T11:54:22.068302+0000","last_undegraded":"2024-09-14T11:54:22.068302+0000","last_fullsized":"2024-09-14T11:54:22.068302+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'568","last_scrub_stamp":"2024-09-14T11:54:22.067970+0000","last_deep_scrub":"264'568","last_deep_scrub_stamp":"2024-09-14T11:54:22.067970+0000","last_clean_scrub_stamp":"2024-09-14T11:54:22.067970+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":500,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:18.404651+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3309,"num_read_kb":3115,"num_write":715,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2991,"num_omap_keys":12,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"264'214","reported_seq":854,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.653114+0000","last_change":"2024-09-14T11:54:05.652966+0000","last_active":"2024-09-14T11:54:05.653114+0000","last_peered":"2024-09-14T11:54:05.653114+0000","last_clean":"2024-09-14T11:54:05.653114+0000","last_became_active":"2024-09-14T11:09:45.204754+0000","last_became_peered":"2024-09-14T11:09:45.204754+0000","last_unstale":"2024-09-14T11:54:05.653114+0000","last_undegraded":"2024-09-14T11:54:05.653114+0000","last_fullsized":"2024-09-14T11:54:05.653114+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'214","last_scrub_stamp":"2024-09-14T11:54:05.652763+0000","last_deep_scrub":"264'214","last_deep_scrub_stamp":"2024-09-14T11:54:05.652763+0000","last_clean_scrub_stamp":"2024-09-14T11:54:05.652763+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:57.152636+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":525,"num_read_kb":30401,"num_write":981,"num_write_kb":24964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"264'575","reported_seq":2332,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.609480+0000","last_change":"2024-09-14T11:54:07.609313+0000","last_active":"2024-09-14T11:54:07.609480+0000","last_peered":"2024-09-14T11:54:07.609480+0000","last_clean":"2024-09-14T11:54:07.609480+0000","last_became_active":"2024-09-14T11:09:46.964946+0000","last_became_peered":"2024-09-14T11:09:46.964946+0000","last_unstale":"2024-09-14T11:54:07.609480+0000","last_undegraded":"2024-09-14T11:54:07.609480+0000","last_fullsized":"2024-09-14T11:54:07.609480+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'575","last_scrub_stamp":"2024-09-14T11:54:07.609118+0000","last_deep_scrub":"264'575","last_deep_scrub_stamp":"2024-09-14T11:54:07.609118+0000","last_clean_scrub_stamp":"2024-09-14T11:54:07.609118+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":500,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:14.923150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3099,"num_read_kb":2896,"num_write":721,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"264'213","reported_seq":909,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.691655+0000","last_change":"2024-09-14T11:54:11.691374+0000","last_active":"2024-09-14T11:54:11.691655+0000","last_peered":"2024-09-14T11:54:11.691655+0000","last_clean":"2024-09-14T11:54:11.691655+0000","last_became_active":"2024-09-14T11:09:45.191314+0000","last_became_peered":"2024-09-14T11:09:45.191314+0000","last_unstale":"2024-09-14T11:54:11.691655+0000","last_undegraded":"2024-09-14T11:54:11.691655+0000","last_fullsized":"2024-09-14T11:54:11.691655+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'213","last_scrub_stamp":"2024-09-14T11:54:11.691188+0000","last_deep_scrub":"264'213","last_deep_scrub_stamp":"2024-09-14T11:54:11.691188+0000","last_clean_scrub_stamp":"2024-09-14T11:54:11.691188+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:08.058246+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":695,"num_read_kb":24382,"num_write":1016,"num_write_kb":29533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"264'553","reported_seq":2040,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.539170+0000","last_change":"2024-09-14T11:54:11.538890+0000","last_active":"2024-09-14T11:54:11.539170+0000","last_peered":"2024-09-14T11:54:11.539170+0000","last_clean":"2024-09-14T11:54:11.539170+0000","last_became_active":"2024-09-14T11:09:46.994113+0000","last_became_peered":"2024-09-14T11:09:46.994113+0000","last_unstale":"2024-09-14T11:54:11.539170+0000","last_undegraded":"2024-09-14T11:54:11.539170+0000","last_fullsized":"2024-09-14T11:54:11.539170+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'553","last_scrub_stamp":"2024-09-14T11:54:11.538649+0000","last_deep_scrub":"264'553","last_deep_scrub_stamp":"2024-09-14T11:54:11.538649+0000","last_clean_scrub_stamp":"2024-09-14T11:54:11.538649+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:53.524362+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2807,"num_read_kb":2558,"num_write":736,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"264'224","reported_seq":827,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.714696+0000","last_change":"2024-09-14T11:54:05.714480+0000","last_active":"2024-09-14T11:54:05.714696+0000","last_peered":"2024-09-14T11:54:05.714696+0000","last_clean":"2024-09-14T11:54:05.714696+0000","last_became_active":"2024-09-14T11:09:45.214511+0000","last_became_peered":"2024-09-14T11:09:45.214511+0000","last_unstale":"2024-09-14T11:54:05.714696+0000","last_undegraded":"2024-09-14T11:54:05.714696+0000","last_fullsized":"2024-09-14T11:54:05.714696+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'224","last_scrub_stamp":"2024-09-14T11:54:05.714278+0000","last_deep_scrub":"264'224","last_deep_scrub_stamp":"2024-09-14T11:54:05.714278+0000","last_clean_scrub_stamp":"2024-09-14T11:54:05.714278+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:43.486418+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":484,"num_read_kb":9689,"num_write":1032,"num_write_kb":43578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"264'466","reported_seq":1951,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.375582+0000","last_change":"2024-09-14T11:54:13.375439+0000","last_active":"2024-09-14T11:54:13.375582+0000","last_peered":"2024-09-14T11:54:13.375582+0000","last_clean":"2024-09-14T11:54:13.375582+0000","last_became_active":"2024-09-14T11:09:46.974152+0000","last_became_peered":"2024-09-14T11:09:46.974152+0000","last_unstale":"2024-09-14T11:54:13.375582+0000","last_undegraded":"2024-09-14T11:54:13.375582+0000","last_fullsized":"2024-09-14T11:54:13.375582+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'466","last_scrub_stamp":"2024-09-14T11:54:13.375253+0000","last_deep_scrub":"264'466","last_deep_scrub_stamp":"2024-09-14T11:54:13.375253+0000","last_clean_scrub_stamp":"2024-09-14T11:54:13.375253+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:27.247012+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2413,"num_read_kb":2245,"num_write":556,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":963,"num_omap_keys":4,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"264'251","reported_seq":912,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.840595+0000","last_change":"2024-09-14T11:54:15.840451+0000","last_active":"2024-09-14T11:54:15.840595+0000","last_peered":"2024-09-14T11:54:15.840595+0000","last_clean":"2024-09-14T11:54:15.840595+0000","last_became_active":"2024-09-14T11:09:45.202934+0000","last_became_peered":"2024-09-14T11:09:45.202934+0000","last_unstale":"2024-09-14T11:54:15.840595+0000","last_undegraded":"2024-09-14T11:54:15.840595+0000","last_fullsized":"2024-09-14T11:54:15.840595+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'251","last_scrub_stamp":"2024-09-14T11:54:15.840262+0000","last_deep_scrub":"264'251","last_deep_scrub_stamp":"2024-09-14T11:54:15.840262+0000","last_clean_scrub_stamp":"2024-09-14T11:54:15.840262+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:52.093309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":642,"num_read_kb":75186,"num_write":1115,"num_write_kb":32522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"264'400","reported_seq":1923,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:16.663384+0000","last_change":"2024-09-14T11:54:16.663245+0000","last_active":"2024-09-14T11:54:16.663384+0000","last_peered":"2024-09-14T11:54:16.663384+0000","last_clean":"2024-09-14T11:54:16.663384+0000","last_became_active":"2024-09-14T11:09:46.946993+0000","last_became_peered":"2024-09-14T11:09:46.946993+0000","last_unstale":"2024-09-14T11:54:16.663384+0000","last_undegraded":"2024-09-14T11:54:16.663384+0000","last_fullsized":"2024-09-14T11:54:16.663384+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'400","last_scrub_stamp":"2024-09-14T11:54:16.663026+0000","last_deep_scrub":"264'400","last_deep_scrub_stamp":"2024-09-14T11:54:16.663026+0000","last_clean_scrub_stamp":"2024-09-14T11:54:16.663026+0000","objects_scrubbed":6,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:18.854555+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2163,"num_read_kb":2058,"num_write":443,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"264'192","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.273980+0000","last_change":"2024-09-14T11:54:07.273839+0000","last_active":"2024-09-14T11:54:07.273980+0000","last_peered":"2024-09-14T11:54:07.273980+0000","last_clean":"2024-09-14T11:54:07.273980+0000","last_became_active":"2024-09-14T11:09:45.217119+0000","last_became_peered":"2024-09-14T11:09:45.217119+0000","last_unstale":"2024-09-14T11:54:07.273980+0000","last_undegraded":"2024-09-14T11:54:07.273980+0000","last_fullsized":"2024-09-14T11:54:07.273980+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'192","last_scrub_stamp":"2024-09-14T11:54:07.273623+0000","last_deep_scrub":"264'192","last_deep_scrub_stamp":"2024-09-14T11:54:07.273623+0000","last_clean_scrub_stamp":"2024-09-14T11:54:07.273623+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:44:27.235610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":19832,"num_write":847,"num_write_kb":31579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"264'831","reported_seq":2394,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.633118+0000","last_change":"2024-09-14T11:54:17.633118+0000","last_active":"2024-09-14T11:54:17.633118+0000","last_peered":"2024-09-14T11:54:17.633118+0000","last_clean":"2024-09-14T11:54:17.633118+0000","last_became_active":"2024-09-14T11:09:46.990899+0000","last_became_peered":"2024-09-14T11:09:46.990899+0000","last_unstale":"2024-09-14T11:54:17.633118+0000","last_undegraded":"2024-09-14T11:54:17.633118+0000","last_fullsized":"2024-09-14T11:54:17.633118+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'831","last_scrub_stamp":"2024-09-14T11:54:17.632872+0000","last_deep_scrub":"264'831","last_deep_scrub_stamp":"2024-09-14T11:54:17.632872+0000","last_clean_scrub_stamp":"2024-09-14T11:54:17.632872+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:11.212125+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3995,"num_read_kb":3582,"num_write":1122,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":246,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"264'250","reported_seq":960,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:16.871805+0000","last_change":"2024-09-14T11:54:16.871805+0000","last_active":"2024-09-14T11:54:16.871805+0000","last_peered":"2024-09-14T11:54:16.871805+0000","last_clean":"2024-09-14T11:54:16.871805+0000","last_became_active":"2024-09-14T11:09:45.214713+0000","last_became_peered":"2024-09-14T11:09:45.214713+0000","last_unstale":"2024-09-14T11:54:16.871805+0000","last_undegraded":"2024-09-14T11:54:16.871805+0000","last_fullsized":"2024-09-14T11:54:16.871805+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'250","last_scrub_stamp":"2024-09-14T11:54:16.871571+0000","last_deep_scrub":"264'250","last_deep_scrub_stamp":"2024-09-14T11:54:16.871571+0000","last_clean_scrub_stamp":"2024-09-14T11:54:16.871571+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:01.834473+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655874,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":741,"num_read_kb":73898,"num_write":1178,"num_write_kb":36295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"264'151","reported_seq":851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.901832+0000","last_change":"2024-09-14T11:54:17.901832+0000","last_active":"2024-09-14T11:54:17.901832+0000","last_peered":"2024-09-14T11:54:17.901832+0000","last_clean":"2024-09-14T11:54:17.901832+0000","last_became_active":"2024-09-14T11:09:45.202270+0000","last_became_peered":"2024-09-14T11:09:45.202270+0000","last_unstale":"2024-09-14T11:54:17.901832+0000","last_undegraded":"2024-09-14T11:54:17.901832+0000","last_fullsized":"2024-09-14T11:54:17.901832+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'151","last_scrub_stamp":"2024-09-14T11:54:17.901656+0000","last_deep_scrub":"264'151","last_deep_scrub_stamp":"2024-09-14T11:54:17.901656+0000","last_clean_scrub_stamp":"2024-09-14T11:54:17.901656+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:35.985077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":694,"num_read_kb":138365,"num_write":726,"num_write_kb":22161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"264'890","reported_seq":2655,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.708210+0000","last_change":"2024-09-14T11:54:17.708210+0000","last_active":"2024-09-14T11:54:17.708210+0000","last_peered":"2024-09-14T11:54:17.708210+0000","last_clean":"2024-09-14T11:54:17.708210+0000","last_became_active":"2024-09-14T11:09:46.947102+0000","last_became_peered":"2024-09-14T11:09:46.947102+0000","last_unstale":"2024-09-14T11:54:17.708210+0000","last_undegraded":"2024-09-14T11:54:17.708210+0000","last_fullsized":"2024-09-14T11:54:17.708210+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'890","last_scrub_stamp":"2024-09-14T11:54:17.707983+0000","last_deep_scrub":"264'890","last_deep_scrub_stamp":"2024-09-14T11:54:17.707983+0000","last_clean_scrub_stamp":"2024-09-14T11:54:17.707983+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":800,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:08.415593+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4492,"num_read_kb":4074,"num_write":1171,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"264'223","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.123278+0000","last_change":"2024-09-14T11:54:13.123278+0000","last_active":"2024-09-14T11:54:13.123278+0000","last_peered":"2024-09-14T11:54:13.123278+0000","last_clean":"2024-09-14T11:54:13.123278+0000","last_became_active":"2024-09-14T11:09:45.204922+0000","last_became_peered":"2024-09-14T11:09:45.204922+0000","last_unstale":"2024-09-14T11:54:13.123278+0000","last_undegraded":"2024-09-14T11:54:13.123278+0000","last_fullsized":"2024-09-14T11:54:13.123278+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'223","last_scrub_stamp":"2024-09-14T11:54:13.123032+0000","last_deep_scrub":"264'223","last_deep_scrub_stamp":"2024-09-14T11:54:13.123032+0000","last_clean_scrub_stamp":"2024-09-14T11:54:13.123032+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:16.567257+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":767,"num_read_kb":17805,"num_write":1021,"num_write_kb":50816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"264'497","reported_seq":2063,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.551499+0000","last_change":"2024-09-14T11:54:10.551499+0000","last_active":"2024-09-14T11:54:10.551499+0000","last_peered":"2024-09-14T11:54:10.551499+0000","last_clean":"2024-09-14T11:54:10.551499+0000","last_became_active":"2024-09-14T11:09:46.981819+0000","last_became_peered":"2024-09-14T11:09:46.981819+0000","last_unstale":"2024-09-14T11:54:10.551499+0000","last_undegraded":"2024-09-14T11:54:10.551499+0000","last_fullsized":"2024-09-14T11:54:10.551499+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'497","last_scrub_stamp":"2024-09-14T11:54:10.551288+0000","last_deep_scrub":"264'497","last_deep_scrub_stamp":"2024-09-14T11:54:10.551288+0000","last_clean_scrub_stamp":"2024-09-14T11:54:10.551288+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:02.481867+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2560,"num_read_kb":2380,"num_write":586,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10857,"num_read_kb":9179,"num_write":3115,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1006,"ondisk_log_size":1006,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15755,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":15151,"num_read_kb":14810,"num_write":17052,"num_write_kb":4979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2763,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1883,"ondisk_log_size":1883,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":760,"ondisk_log_size":760,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":375102,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":8356,"num_read_kb":10715,"num_write":5641,"num_write_kb":2812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":711024,"num_omap_keys":1616,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2014,"ondisk_log_size":2014,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2413,"num_read_kb":2881,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":220474,"num_read_kb":201951,"num_write":55880,"num_write_kb":19076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35749,"num_omap_keys":144,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4027,"ondisk_log_size":4027,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":40916491,"num_objects":168,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":0,"num_read":38991,"num_read_kb":2064033,"num_write":64568,"num_write_kb":2182336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":82870272,"data_stored":81832982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3601,"ondisk_log_size":3601,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":158488,"num_write":182,"num_write_kb":116383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":158381,"num_write":182,"num_write_kb":116383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509992,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220180,"kb_used_data":18244,"kb_used_omap":1,"kb_used_meta":201918,"kb_avail":94151660,"statfs":{"total":96636764160,"available":96411299840,"internally_reserved":0,"allocated":18681856,"data_stored":17014199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":206764487},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509994,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119184,"kb_used_data":11648,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94252656,"statfs":{"total":96636764160,"available":96514719744,"internally_reserved":0,"allocated":11927552,"data_stored":10256263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542696,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":205004,"kb_used_data":7292,"kb_used_omap":1,"kb_used_meta":197694,"kb_avail":94166836,"statfs":{"total":96636764160,"available":96426840064,"internally_reserved":0,"allocated":7467008,"data_stored":5850366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":202439114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542694,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84808,"kb_used_data":13368,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94287032,"statfs":{"total":96636764160,"available":96549920768,"internally_reserved":0,"allocated":13688832,"data_stored":12047474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542694,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":261108,"kb_used_data":23076,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94110732,"statfs":{"total":96636764160,"available":96369389568,"internally_reserved":0,"allocated":23629824,"data_stored":21914965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243726789},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542695,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":166900,"kb_used_data":5284,"kb_used_omap":1,"kb_used_meta":161598,"kb_avail":94204940,"statfs":{"total":96636764160,"available":96465858560,"internally_reserved":0,"allocated":5410816,"data_stored":3769131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":165476805},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542695,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":268348,"kb_used_data":16428,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94103492,"statfs":{"total":96636764160,"available":96361975808,"internally_reserved":0,"allocated":16822272,"data_stored":15174645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257948101},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542696,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":86684,"kb_used_data":15244,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94285156,"statfs":{"total":96636764160,"available":96547999744,"internally_reserved":0,"allocated":15609856,"data_stored":13878717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11948032,"data_stored":11766247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12473898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8265728,"data_stored":8142582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15040512,"data_stored":14902957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1753088,"data_stored":1656299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":19398656,"data_stored":19214635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10035200,"data_stored":9935327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3846144,"data_stored":3741037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":6024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":5138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":2784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:55:05.727 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:55:05.728 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:55:05.728 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:55:05.728 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:27:40.600226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:55:05.729 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:55:05.729 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:38:49.520691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=53, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:55:05.732 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T11:55:25.732 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:55:26.091 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-14T11:55:26.105 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-09-14T11:55:26.119 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":1635,"stamp":"2024-09-14T11:55:24.584594+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":41899528,"num_objects":636,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":636,"num_whiteouts":0,"num_read":296634,"num_read_kb":2620505,"num_write":146761,"num_write_kb":2444634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":200,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":750664,"num_omap_keys":1790,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13643,"ondisk_log_size":13643,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1412216,"kb_used_data":110584,"kb_used_omap":12,"kb_used_meta":1301491,"kb_avail":753562504,"statfs":{"total":773094113280,"available":771648004096,"internally_reserved":0,"allocated":113238016,"data_stored":99905760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1332727345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007838"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:40.907917+0000","last_change":"2024-09-14T11:54:40.907917+0000","last_active":"2024-09-14T11:54:40.907917+0000","last_peered":"2024-09-14T11:54:40.907917+0000","last_clean":"2024-09-14T11:54:40.907917+0000","last_became_active":"2024-09-14T11:38:50.585084+0000","last_became_peered":"2024-09-14T11:38:50.585084+0000","last_unstale":"2024-09-14T11:54:40.907917+0000","last_undegraded":"2024-09-14T11:54:40.907917+0000","last_fullsized":"2024-09-14T11:54:40.907917+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:40.907643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:40.907643+0000","last_clean_scrub_stamp":"2024-09-14T11:54:40.907643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:17:22.077501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:40.791669+0000","last_change":"2024-09-14T11:54:40.791499+0000","last_active":"2024-09-14T11:54:40.791669+0000","last_peered":"2024-09-14T11:54:40.791669+0000","last_clean":"2024-09-14T11:54:40.791669+0000","last_became_active":"2024-09-14T11:27:41.641034+0000","last_became_peered":"2024-09-14T11:27:41.641034+0000","last_unstale":"2024-09-14T11:54:40.791669+0000","last_undegraded":"2024-09-14T11:54:40.791669+0000","last_fullsized":"2024-09-14T11:54:40.791669+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:40.791318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:40.791318+0000","last_clean_scrub_stamp":"2024-09-14T11:54:40.791318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:54:19.134485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"261'2","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.449490+0000","last_change":"2024-09-14T11:54:42.449358+0000","last_active":"2024-09-14T11:54:42.449490+0000","last_peered":"2024-09-14T11:54:42.449490+0000","last_clean":"2024-09-14T11:54:42.449490+0000","last_became_active":"2024-09-14T11:27:38.617019+0000","last_became_peered":"2024-09-14T11:27:38.617019+0000","last_unstale":"2024-09-14T11:54:42.449490+0000","last_undegraded":"2024-09-14T11:54:42.449490+0000","last_fullsized":"2024-09-14T11:54:42.449490+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-14T11:54:42.449165+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-14T11:54:42.449165+0000","last_clean_scrub_stamp":"2024-09-14T11:54:42.449165+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:04.980679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"264'17","reported_seq":99,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:44.177310+0000","last_change":"2024-09-14T11:54:44.177150+0000","last_active":"2024-09-14T11:54:44.177310+0000","last_peered":"2024-09-14T11:54:44.177310+0000","last_clean":"2024-09-14T11:54:44.177310+0000","last_became_active":"2024-09-14T11:26:04.262003+0000","last_became_peered":"2024-09-14T11:26:04.262003+0000","last_unstale":"2024-09-14T11:54:44.177310+0000","last_undegraded":"2024-09-14T11:54:44.177310+0000","last_fullsized":"2024-09-14T11:54:44.177310+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'17","last_scrub_stamp":"2024-09-14T11:54:44.176964+0000","last_deep_scrub":"264'17","last_deep_scrub_stamp":"2024-09-14T11:54:44.176964+0000","last_clean_scrub_stamp":"2024-09-14T11:54:44.176964+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:33.915933+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":88,"num_write":45,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:44.702138+0000","last_change":"2024-09-14T11:54:44.702138+0000","last_active":"2024-09-14T11:54:44.702138+0000","last_peered":"2024-09-14T11:54:44.702138+0000","last_clean":"2024-09-14T11:54:44.702138+0000","last_became_active":"2024-09-14T11:38:50.592015+0000","last_became_peered":"2024-09-14T11:38:50.592015+0000","last_unstale":"2024-09-14T11:54:44.702138+0000","last_undegraded":"2024-09-14T11:54:44.702138+0000","last_fullsized":"2024-09-14T11:54:44.702138+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:44.701959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:44.701959+0000","last_clean_scrub_stamp":"2024-09-14T11:54:44.701959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:00.408391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"264'4","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:46.101896+0000","last_change":"2024-09-14T11:54:46.101615+0000","last_active":"2024-09-14T11:54:46.101896+0000","last_peered":"2024-09-14T11:54:46.101896+0000","last_clean":"2024-09-14T11:54:46.101896+0000","last_became_active":"2024-09-14T11:27:41.642359+0000","last_became_peered":"2024-09-14T11:27:41.642359+0000","last_unstale":"2024-09-14T11:54:46.101896+0000","last_undegraded":"2024-09-14T11:54:46.101896+0000","last_fullsized":"2024-09-14T11:54:46.101896+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T11:54:46.101333+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T11:54:46.101333+0000","last_clean_scrub_stamp":"2024-09-14T11:54:46.101333+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:04.408925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":4,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"264'5","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.117347+0000","last_change":"2024-09-14T11:54:47.117212+0000","last_active":"2024-09-14T11:54:47.117347+0000","last_peered":"2024-09-14T11:54:47.117347+0000","last_clean":"2024-09-14T11:54:47.117347+0000","last_became_active":"2024-09-14T11:27:38.597816+0000","last_became_peered":"2024-09-14T11:27:38.597816+0000","last_unstale":"2024-09-14T11:54:47.117347+0000","last_undegraded":"2024-09-14T11:54:47.117347+0000","last_fullsized":"2024-09-14T11:54:47.117347+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-14T11:54:47.117025+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-14T11:54:47.117025+0000","last_clean_scrub_stamp":"2024-09-14T11:54:47.117025+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:33:22.385308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1028,"num_write":10,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"264'31","reported_seq":136,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.128943+0000","last_change":"2024-09-14T11:54:42.128943+0000","last_active":"2024-09-14T11:54:42.128943+0000","last_peered":"2024-09-14T11:54:42.128943+0000","last_clean":"2024-09-14T11:54:42.128943+0000","last_became_active":"2024-09-14T11:26:04.280237+0000","last_became_peered":"2024-09-14T11:26:04.280237+0000","last_unstale":"2024-09-14T11:54:42.128943+0000","last_undegraded":"2024-09-14T11:54:42.128943+0000","last_fullsized":"2024-09-14T11:54:42.128943+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'31","last_scrub_stamp":"2024-09-14T11:54:42.128731+0000","last_deep_scrub":"264'31","last_deep_scrub_stamp":"2024-09-14T11:54:42.128731+0000","last_clean_scrub_stamp":"2024-09-14T11:54:42.128731+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:49.358269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":150,"num_write":82,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.752663+0000","last_change":"2024-09-14T11:54:38.752663+0000","last_active":"2024-09-14T11:54:38.752663+0000","last_peered":"2024-09-14T11:54:38.752663+0000","last_clean":"2024-09-14T11:54:38.752663+0000","last_became_active":"2024-09-14T11:38:50.574020+0000","last_became_peered":"2024-09-14T11:38:50.574020+0000","last_unstale":"2024-09-14T11:54:38.752663+0000","last_undegraded":"2024-09-14T11:54:38.752663+0000","last_fullsized":"2024-09-14T11:54:38.752663+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:38.752434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:38.752434+0000","last_clean_scrub_stamp":"2024-09-14T11:54:38.752434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:14.441214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:56.217967+0000","last_change":"2024-09-14T11:54:56.217967+0000","last_active":"2024-09-14T11:54:56.217967+0000","last_peered":"2024-09-14T11:54:56.217967+0000","last_clean":"2024-09-14T11:54:56.217967+0000","last_became_active":"2024-09-14T11:27:41.645143+0000","last_became_peered":"2024-09-14T11:27:41.645143+0000","last_unstale":"2024-09-14T11:54:56.217967+0000","last_undegraded":"2024-09-14T11:54:56.217967+0000","last_fullsized":"2024-09-14T11:54:56.217967+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:56.217787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:56.217787+0000","last_clean_scrub_stamp":"2024-09-14T11:54:56.217787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:11:14.282311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:41.469037+0000","last_change":"2024-09-14T11:54:41.469037+0000","last_active":"2024-09-14T11:54:41.469037+0000","last_peered":"2024-09-14T11:54:41.469037+0000","last_clean":"2024-09-14T11:54:41.469037+0000","last_became_active":"2024-09-14T11:27:38.619537+0000","last_became_peered":"2024-09-14T11:27:38.619537+0000","last_unstale":"2024-09-14T11:54:41.469037+0000","last_undegraded":"2024-09-14T11:54:41.469037+0000","last_fullsized":"2024-09-14T11:54:41.469037+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:41.468860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:41.468860+0000","last_clean_scrub_stamp":"2024-09-14T11:54:41.468860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:01.665027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"264'124","reported_seq":419,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:37.701474+0000","last_change":"2024-09-14T11:54:37.701474+0000","last_active":"2024-09-14T11:54:37.701474+0000","last_peered":"2024-09-14T11:54:37.701474+0000","last_clean":"2024-09-14T11:54:37.701474+0000","last_became_active":"2024-09-14T11:26:04.279472+0000","last_became_peered":"2024-09-14T11:26:04.279472+0000","last_unstale":"2024-09-14T11:54:37.701474+0000","last_undegraded":"2024-09-14T11:54:37.701474+0000","last_fullsized":"2024-09-14T11:54:37.701474+0000","mapping_epoch":253,"log_start":"261'100","ondisk_log_start":"261'100","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-09-14T11:54:37.701268+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-09-14T11:54:37.701268+0000","last_clean_scrub_stamp":"2024-09-14T11:54:37.701268+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:11.487369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1140,"num_read_kb":1229,"num_write":251,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:55:02.201817+0000","last_change":"2024-09-14T11:55:02.201817+0000","last_active":"2024-09-14T11:55:02.201817+0000","last_peered":"2024-09-14T11:55:02.201817+0000","last_clean":"2024-09-14T11:55:02.201817+0000","last_became_active":"2024-09-14T11:38:50.587700+0000","last_became_peered":"2024-09-14T11:38:50.587700+0000","last_unstale":"2024-09-14T11:55:02.201817+0000","last_undegraded":"2024-09-14T11:55:02.201817+0000","last_fullsized":"2024-09-14T11:55:02.201817+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:55:02.201648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:55:02.201648+0000","last_clean_scrub_stamp":"2024-09-14T11:55:02.201648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:35.299821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"264'8","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:54.160051+0000","last_change":"2024-09-14T11:54:54.160051+0000","last_active":"2024-09-14T11:54:54.160051+0000","last_peered":"2024-09-14T11:54:54.160051+0000","last_clean":"2024-09-14T11:54:54.160051+0000","last_became_active":"2024-09-14T11:27:41.644919+0000","last_became_peered":"2024-09-14T11:27:41.644919+0000","last_unstale":"2024-09-14T11:54:54.160051+0000","last_undegraded":"2024-09-14T11:54:54.160051+0000","last_fullsized":"2024-09-14T11:54:54.160051+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-14T11:54:54.159872+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-14T11:54:54.159872+0000","last_clean_scrub_stamp":"2024-09-14T11:54:54.159872+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:44.471517+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"264'2","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:36.784410+0000","last_change":"2024-09-14T11:54:36.784259+0000","last_active":"2024-09-14T11:54:36.784410+0000","last_peered":"2024-09-14T11:54:36.784410+0000","last_clean":"2024-09-14T11:54:36.784410+0000","last_became_active":"2024-09-14T11:27:38.609445+0000","last_became_peered":"2024-09-14T11:27:38.609445+0000","last_unstale":"2024-09-14T11:54:36.784410+0000","last_undegraded":"2024-09-14T11:54:36.784410+0000","last_fullsized":"2024-09-14T11:54:36.784410+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:36.784067+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:36.784067+0000","last_clean_scrub_stamp":"2024-09-14T11:54:36.784067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:03.982460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"264'61","reported_seq":221,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:35.620211+0000","last_change":"2024-09-14T11:54:35.620211+0000","last_active":"2024-09-14T11:54:35.620211+0000","last_peered":"2024-09-14T11:54:35.620211+0000","last_clean":"2024-09-14T11:54:35.620211+0000","last_became_active":"2024-09-14T11:26:04.282662+0000","last_became_peered":"2024-09-14T11:26:04.282662+0000","last_unstale":"2024-09-14T11:54:35.620211+0000","last_undegraded":"2024-09-14T11:54:35.620211+0000","last_fullsized":"2024-09-14T11:54:35.620211+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'61","last_scrub_stamp":"2024-09-14T11:54:35.620026+0000","last_deep_scrub":"264'61","last_deep_scrub_stamp":"2024-09-14T11:54:35.620026+0000","last_clean_scrub_stamp":"2024-09-14T11:54:35.620026+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:17.224367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":527,"num_read_kb":359,"num_write":147,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:53.722338+0000","last_change":"2024-09-14T11:54:53.722338+0000","last_active":"2024-09-14T11:54:53.722338+0000","last_peered":"2024-09-14T11:54:53.722338+0000","last_clean":"2024-09-14T11:54:53.722338+0000","last_became_active":"2024-09-14T11:38:50.582489+0000","last_became_peered":"2024-09-14T11:38:50.582489+0000","last_unstale":"2024-09-14T11:54:53.722338+0000","last_undegraded":"2024-09-14T11:54:53.722338+0000","last_fullsized":"2024-09-14T11:54:53.722338+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:53.722164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:53.722164+0000","last_clean_scrub_stamp":"2024-09-14T11:54:53.722164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:55.764397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:30.947800+0000","last_change":"2024-09-14T11:54:30.947800+0000","last_active":"2024-09-14T11:54:30.947800+0000","last_peered":"2024-09-14T11:54:30.947800+0000","last_clean":"2024-09-14T11:54:30.947800+0000","last_became_active":"2024-09-14T11:27:41.645724+0000","last_became_peered":"2024-09-14T11:27:41.645724+0000","last_unstale":"2024-09-14T11:54:30.947800+0000","last_undegraded":"2024-09-14T11:54:30.947800+0000","last_fullsized":"2024-09-14T11:54:30.947800+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:30.947615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:30.947615+0000","last_clean_scrub_stamp":"2024-09-14T11:54:30.947615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:51.069389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"264'3","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:46.156335+0000","last_change":"2024-09-14T11:54:46.156335+0000","last_active":"2024-09-14T11:54:46.156335+0000","last_peered":"2024-09-14T11:54:46.156335+0000","last_clean":"2024-09-14T11:54:46.156335+0000","last_became_active":"2024-09-14T11:27:38.605937+0000","last_became_peered":"2024-09-14T11:27:38.605937+0000","last_unstale":"2024-09-14T11:54:46.156335+0000","last_undegraded":"2024-09-14T11:54:46.156335+0000","last_fullsized":"2024-09-14T11:54:46.156335+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:54:46.156150+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:54:46.156150+0000","last_clean_scrub_stamp":"2024-09-14T11:54:46.156150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:32.542951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"264'12","reported_seq":80,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:36.664998+0000","last_change":"2024-09-14T11:54:36.664998+0000","last_active":"2024-09-14T11:54:36.664998+0000","last_peered":"2024-09-14T11:54:36.664998+0000","last_clean":"2024-09-14T11:54:36.664998+0000","last_became_active":"2024-09-14T11:26:04.278457+0000","last_became_peered":"2024-09-14T11:26:04.278457+0000","last_unstale":"2024-09-14T11:54:36.664998+0000","last_undegraded":"2024-09-14T11:54:36.664998+0000","last_fullsized":"2024-09-14T11:54:36.664998+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'12","last_scrub_stamp":"2024-09-14T11:54:36.664780+0000","last_deep_scrub":"264'12","last_deep_scrub_stamp":"2024-09-14T11:54:36.664780+0000","last_clean_scrub_stamp":"2024-09-14T11:54:36.664780+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:47.163712+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":56,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:49.275128+0000","last_change":"2024-09-14T11:54:49.275128+0000","last_active":"2024-09-14T11:54:49.275128+0000","last_peered":"2024-09-14T11:54:49.275128+0000","last_clean":"2024-09-14T11:54:49.275128+0000","last_became_active":"2024-09-14T11:38:50.576125+0000","last_became_peered":"2024-09-14T11:38:50.576125+0000","last_unstale":"2024-09-14T11:54:49.275128+0000","last_undegraded":"2024-09-14T11:54:49.275128+0000","last_fullsized":"2024-09-14T11:54:49.275128+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:49.274958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:49.274958+0000","last_clean_scrub_stamp":"2024-09-14T11:54:49.274958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:08.822999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"264'4","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:55:05.596865+0000","last_change":"2024-09-14T11:55:05.596865+0000","last_active":"2024-09-14T11:55:05.596865+0000","last_peered":"2024-09-14T11:55:05.596865+0000","last_clean":"2024-09-14T11:55:05.596865+0000","last_became_active":"2024-09-14T11:27:41.660702+0000","last_became_peered":"2024-09-14T11:27:41.660702+0000","last_unstale":"2024-09-14T11:55:05.596865+0000","last_undegraded":"2024-09-14T11:55:05.596865+0000","last_fullsized":"2024-09-14T11:55:05.596865+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T11:55:05.596592+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T11:55:05.596592+0000","last_clean_scrub_stamp":"2024-09-14T11:55:05.596592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:46.653985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"264'11","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.597373+0000","last_change":"2024-09-14T11:55:03.597373+0000","last_active":"2024-09-14T11:55:03.597373+0000","last_peered":"2024-09-14T11:55:03.597373+0000","last_clean":"2024-09-14T11:55:03.597373+0000","last_became_active":"2024-09-14T11:27:38.602908+0000","last_became_peered":"2024-09-14T11:27:38.602908+0000","last_unstale":"2024-09-14T11:55:03.597373+0000","last_undegraded":"2024-09-14T11:55:03.597373+0000","last_fullsized":"2024-09-14T11:55:03.597373+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'11","last_scrub_stamp":"2024-09-14T11:55:03.597190+0000","last_deep_scrub":"264'11","last_deep_scrub_stamp":"2024-09-14T11:55:03.597190+0000","last_clean_scrub_stamp":"2024-09-14T11:55:03.597190+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:12.474592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":15360,"num_write":16,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"264'30","reported_seq":134,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:33.236269+0000","last_change":"2024-09-14T11:54:33.236269+0000","last_active":"2024-09-14T11:54:33.236269+0000","last_peered":"2024-09-14T11:54:33.236269+0000","last_clean":"2024-09-14T11:54:33.236269+0000","last_became_active":"2024-09-14T11:26:04.258048+0000","last_became_peered":"2024-09-14T11:26:04.258048+0000","last_unstale":"2024-09-14T11:54:33.236269+0000","last_undegraded":"2024-09-14T11:54:33.236269+0000","last_fullsized":"2024-09-14T11:54:33.236269+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'30","last_scrub_stamp":"2024-09-14T11:54:33.236050+0000","last_deep_scrub":"264'30","last_deep_scrub_stamp":"2024-09-14T11:54:33.236050+0000","last_clean_scrub_stamp":"2024-09-14T11:54:33.236050+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:59.884986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":248,"num_read_kb":161,"num_write":75,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"264'2","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:45.135031+0000","last_change":"2024-09-14T11:54:45.135031+0000","last_active":"2024-09-14T11:54:45.135031+0000","last_peered":"2024-09-14T11:54:45.135031+0000","last_clean":"2024-09-14T11:54:45.135031+0000","last_became_active":"2024-09-14T11:38:50.590496+0000","last_became_peered":"2024-09-14T11:38:50.590496+0000","last_unstale":"2024-09-14T11:54:45.135031+0000","last_undegraded":"2024-09-14T11:54:45.135031+0000","last_fullsized":"2024-09-14T11:54:45.135031+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:45.134911+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:45.134911+0000","last_clean_scrub_stamp":"2024-09-14T11:54:45.134911+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:32:51.779048+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"264'11","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:41.128663+0000","last_change":"2024-09-14T11:54:41.128414+0000","last_active":"2024-09-14T11:54:41.128663+0000","last_peered":"2024-09-14T11:54:41.128663+0000","last_clean":"2024-09-14T11:54:41.128663+0000","last_became_active":"2024-09-14T11:27:41.635495+0000","last_became_peered":"2024-09-14T11:27:41.635495+0000","last_unstale":"2024-09-14T11:54:41.128663+0000","last_undegraded":"2024-09-14T11:54:41.128663+0000","last_fullsized":"2024-09-14T11:54:41.128663+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'11","last_scrub_stamp":"2024-09-14T11:54:41.128137+0000","last_deep_scrub":"264'11","last_deep_scrub_stamp":"2024-09-14T11:54:41.128137+0000","last_clean_scrub_stamp":"2024-09-14T11:54:41.128137+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:54:06.188677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":12817,"num_write":26,"num_write_kb":12817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"264'2","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:32.889904+0000","last_change":"2024-09-14T11:54:32.889714+0000","last_active":"2024-09-14T11:54:32.889904+0000","last_peered":"2024-09-14T11:54:32.889904+0000","last_clean":"2024-09-14T11:54:32.889904+0000","last_became_active":"2024-09-14T11:27:38.593507+0000","last_became_peered":"2024-09-14T11:27:38.593507+0000","last_unstale":"2024-09-14T11:54:32.889904+0000","last_undegraded":"2024-09-14T11:54:32.889904+0000","last_fullsized":"2024-09-14T11:54:32.889904+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:32.889523+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:32.889523+0000","last_clean_scrub_stamp":"2024-09-14T11:54:32.889523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:27.863989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"264'31","reported_seq":130,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.478805+0000","last_change":"2024-09-14T11:54:43.478651+0000","last_active":"2024-09-14T11:54:43.478805+0000","last_peered":"2024-09-14T11:54:43.478805+0000","last_clean":"2024-09-14T11:54:43.478805+0000","last_became_active":"2024-09-14T11:26:04.280799+0000","last_became_peered":"2024-09-14T11:26:04.280799+0000","last_unstale":"2024-09-14T11:54:43.478805+0000","last_undegraded":"2024-09-14T11:54:43.478805+0000","last_fullsized":"2024-09-14T11:54:43.478805+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'31","last_scrub_stamp":"2024-09-14T11:54:43.478466+0000","last_deep_scrub":"264'31","last_deep_scrub_stamp":"2024-09-14T11:54:43.478466+0000","last_clean_scrub_stamp":"2024-09-14T11:54:43.478466+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:00.283602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":229,"num_read_kb":151,"num_write":83,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:37.911419+0000","last_change":"2024-09-14T11:54:37.911419+0000","last_active":"2024-09-14T11:54:37.911419+0000","last_peered":"2024-09-14T11:54:37.911419+0000","last_clean":"2024-09-14T11:54:37.911419+0000","last_became_active":"2024-09-14T11:38:50.588260+0000","last_became_peered":"2024-09-14T11:38:50.588260+0000","last_unstale":"2024-09-14T11:54:37.911419+0000","last_undegraded":"2024-09-14T11:54:37.911419+0000","last_fullsized":"2024-09-14T11:54:37.911419+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:37.911196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:37.911196+0000","last_clean_scrub_stamp":"2024-09-14T11:54:37.911196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:48.971042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"261'2","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:49.591467+0000","last_change":"2024-09-14T11:54:49.591328+0000","last_active":"2024-09-14T11:54:49.591467+0000","last_peered":"2024-09-14T11:54:49.591467+0000","last_clean":"2024-09-14T11:54:49.591467+0000","last_became_active":"2024-09-14T11:27:41.649448+0000","last_became_peered":"2024-09-14T11:27:41.649448+0000","last_unstale":"2024-09-14T11:54:49.591467+0000","last_undegraded":"2024-09-14T11:54:49.591467+0000","last_fullsized":"2024-09-14T11:54:49.591467+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-14T11:54:49.591135+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-14T11:54:49.591135+0000","last_clean_scrub_stamp":"2024-09-14T11:54:49.591135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:42.983576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"264'3","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:40.705869+0000","last_change":"2024-09-14T11:54:40.705695+0000","last_active":"2024-09-14T11:54:40.705869+0000","last_peered":"2024-09-14T11:54:40.705869+0000","last_clean":"2024-09-14T11:54:40.705869+0000","last_became_active":"2024-09-14T11:27:38.598992+0000","last_became_peered":"2024-09-14T11:27:38.598992+0000","last_unstale":"2024-09-14T11:54:40.705869+0000","last_undegraded":"2024-09-14T11:54:40.705869+0000","last_fullsized":"2024-09-14T11:54:40.705869+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:54:40.705524+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:54:40.705524+0000","last_clean_scrub_stamp":"2024-09-14T11:54:40.705524+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:31.817310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"264'245","reported_seq":792,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:34.623555+0000","last_change":"2024-09-14T11:54:34.623337+0000","last_active":"2024-09-14T11:54:34.623555+0000","last_peered":"2024-09-14T11:54:34.623555+0000","last_clean":"2024-09-14T11:54:34.623555+0000","last_became_active":"2024-09-14T11:26:04.283058+0000","last_became_peered":"2024-09-14T11:26:04.283058+0000","last_unstale":"2024-09-14T11:54:34.623555+0000","last_undegraded":"2024-09-14T11:54:34.623555+0000","last_fullsized":"2024-09-14T11:54:34.623555+0000","mapping_epoch":253,"log_start":"261'200","ondisk_log_start":"261'200","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'245","last_scrub_stamp":"2024-09-14T11:54:34.623091+0000","last_deep_scrub":"264'245","last_deep_scrub_stamp":"2024-09-14T11:54:34.623091+0000","last_clean_scrub_stamp":"2024-09-14T11:54:34.623091+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:07.735348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2337,"num_read_kb":3061,"num_write":470,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:55:00.142378+0000","last_change":"2024-09-14T11:55:00.142199+0000","last_active":"2024-09-14T11:55:00.142378+0000","last_peered":"2024-09-14T11:55:00.142378+0000","last_clean":"2024-09-14T11:55:00.142378+0000","last_became_active":"2024-09-14T11:38:50.587593+0000","last_became_peered":"2024-09-14T11:38:50.587593+0000","last_unstale":"2024-09-14T11:55:00.142378+0000","last_undegraded":"2024-09-14T11:55:00.142378+0000","last_fullsized":"2024-09-14T11:55:00.142378+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:55:00.142019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:55:00.142019+0000","last_clean_scrub_stamp":"2024-09-14T11:55:00.142019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:32.438339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"261'2","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:48.640349+0000","last_change":"2024-09-14T11:54:48.640349+0000","last_active":"2024-09-14T11:54:48.640349+0000","last_peered":"2024-09-14T11:54:48.640349+0000","last_clean":"2024-09-14T11:54:48.640349+0000","last_became_active":"2024-09-14T11:27:41.649297+0000","last_became_peered":"2024-09-14T11:27:41.649297+0000","last_unstale":"2024-09-14T11:54:48.640349+0000","last_undegraded":"2024-09-14T11:54:48.640349+0000","last_fullsized":"2024-09-14T11:54:48.640349+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-14T11:54:48.640149+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-14T11:54:48.640149+0000","last_clean_scrub_stamp":"2024-09-14T11:54:48.640149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:27.287897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"261'3","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:55:00.612138+0000","last_change":"2024-09-14T11:55:00.612138+0000","last_active":"2024-09-14T11:55:00.612138+0000","last_peered":"2024-09-14T11:55:00.612138+0000","last_clean":"2024-09-14T11:55:00.612138+0000","last_became_active":"2024-09-14T11:27:38.607929+0000","last_became_peered":"2024-09-14T11:27:38.607929+0000","last_unstale":"2024-09-14T11:55:00.612138+0000","last_undegraded":"2024-09-14T11:55:00.612138+0000","last_fullsized":"2024-09-14T11:55:00.612138+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-14T11:55:00.611948+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-14T11:55:00.611948+0000","last_clean_scrub_stamp":"2024-09-14T11:55:00.611948+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:13.662888+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"264'16","reported_seq":94,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.178430+0000","last_change":"2024-09-14T11:54:43.178152+0000","last_active":"2024-09-14T11:54:43.178430+0000","last_peered":"2024-09-14T11:54:43.178430+0000","last_clean":"2024-09-14T11:54:43.178430+0000","last_became_active":"2024-09-14T11:26:04.261101+0000","last_became_peered":"2024-09-14T11:26:04.261101+0000","last_unstale":"2024-09-14T11:54:43.178430+0000","last_undegraded":"2024-09-14T11:54:43.178430+0000","last_fullsized":"2024-09-14T11:54:43.178430+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'16","last_scrub_stamp":"2024-09-14T11:54:43.177930+0000","last_deep_scrub":"264'16","last_deep_scrub_stamp":"2024-09-14T11:54:43.177930+0000","last_clean_scrub_stamp":"2024-09-14T11:54:43.177930+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:14.583863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":70,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"264'2","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.712466+0000","last_change":"2024-09-14T11:54:42.712333+0000","last_active":"2024-09-14T11:54:42.712466+0000","last_peered":"2024-09-14T11:54:42.712466+0000","last_clean":"2024-09-14T11:54:42.712466+0000","last_became_active":"2024-09-14T11:38:50.565980+0000","last_became_peered":"2024-09-14T11:38:50.565980+0000","last_unstale":"2024-09-14T11:54:42.712466+0000","last_undegraded":"2024-09-14T11:54:42.712466+0000","last_fullsized":"2024-09-14T11:54:42.712466+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:42.712137+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:42.712137+0000","last_clean_scrub_stamp":"2024-09-14T11:54:42.712137+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:56.324022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"264'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:52.154883+0000","last_change":"2024-09-14T11:54:52.154883+0000","last_active":"2024-09-14T11:54:52.154883+0000","last_peered":"2024-09-14T11:54:52.154883+0000","last_clean":"2024-09-14T11:54:52.154883+0000","last_became_active":"2024-09-14T11:27:41.660264+0000","last_became_peered":"2024-09-14T11:27:41.660264+0000","last_unstale":"2024-09-14T11:54:52.154883+0000","last_undegraded":"2024-09-14T11:54:52.154883+0000","last_fullsized":"2024-09-14T11:54:52.154883+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-14T11:54:52.154690+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-14T11:54:52.154690+0000","last_clean_scrub_stamp":"2024-09-14T11:54:52.154690+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:23:51.503968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"261'4","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.871763+0000","last_change":"2024-09-14T11:54:27.871763+0000","last_active":"2024-09-14T11:54:27.871763+0000","last_peered":"2024-09-14T11:54:27.871763+0000","last_clean":"2024-09-14T11:54:27.871763+0000","last_became_active":"2024-09-14T11:27:38.595788+0000","last_became_peered":"2024-09-14T11:27:38.595788+0000","last_unstale":"2024-09-14T11:54:27.871763+0000","last_undegraded":"2024-09-14T11:54:27.871763+0000","last_fullsized":"2024-09-14T11:54:27.871763+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-14T11:54:27.871566+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-14T11:54:27.871566+0000","last_clean_scrub_stamp":"2024-09-14T11:54:27.871566+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:37.867774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"264'35","reported_seq":144,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:41.127270+0000","last_change":"2024-09-14T11:54:41.127097+0000","last_active":"2024-09-14T11:54:41.127270+0000","last_peered":"2024-09-14T11:54:41.127270+0000","last_clean":"2024-09-14T11:54:41.127270+0000","last_became_active":"2024-09-14T11:26:04.279281+0000","last_became_peered":"2024-09-14T11:26:04.279281+0000","last_unstale":"2024-09-14T11:54:41.127270+0000","last_undegraded":"2024-09-14T11:54:41.127270+0000","last_fullsized":"2024-09-14T11:54:41.127270+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'35","last_scrub_stamp":"2024-09-14T11:54:41.126910+0000","last_deep_scrub":"264'35","last_deep_scrub_stamp":"2024-09-14T11:54:41.126910+0000","last_clean_scrub_stamp":"2024-09-14T11:54:41.126910+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:18.051800+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":194,"num_write":86,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.083505+0000","last_change":"2024-09-14T11:54:42.083376+0000","last_active":"2024-09-14T11:54:42.083505+0000","last_peered":"2024-09-14T11:54:42.083505+0000","last_clean":"2024-09-14T11:54:42.083505+0000","last_became_active":"2024-09-14T11:38:50.573912+0000","last_became_peered":"2024-09-14T11:38:50.573912+0000","last_unstale":"2024-09-14T11:54:42.083505+0000","last_undegraded":"2024-09-14T11:54:42.083505+0000","last_fullsized":"2024-09-14T11:54:42.083505+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:42.083183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:42.083183+0000","last_clean_scrub_stamp":"2024-09-14T11:54:42.083183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:38.164805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"264'10","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:51.634330+0000","last_change":"2024-09-14T11:54:51.634330+0000","last_active":"2024-09-14T11:54:51.634330+0000","last_peered":"2024-09-14T11:54:51.634330+0000","last_clean":"2024-09-14T11:54:51.634330+0000","last_became_active":"2024-09-14T11:27:41.632456+0000","last_became_peered":"2024-09-14T11:27:41.632456+0000","last_unstale":"2024-09-14T11:54:51.634330+0000","last_undegraded":"2024-09-14T11:54:51.634330+0000","last_fullsized":"2024-09-14T11:54:51.634330+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'10","last_scrub_stamp":"2024-09-14T11:54:51.634110+0000","last_deep_scrub":"264'10","last_deep_scrub_stamp":"2024-09-14T11:54:51.634110+0000","last_clean_scrub_stamp":"2024-09-14T11:54:51.634110+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:46.182170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15362,"num_write":10,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"261'2","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:40.513991+0000","last_change":"2024-09-14T11:54:40.513991+0000","last_active":"2024-09-14T11:54:40.513991+0000","last_peered":"2024-09-14T11:54:40.513991+0000","last_clean":"2024-09-14T11:54:40.513991+0000","last_became_active":"2024-09-14T11:27:38.616935+0000","last_became_peered":"2024-09-14T11:27:38.616935+0000","last_unstale":"2024-09-14T11:54:40.513991+0000","last_undegraded":"2024-09-14T11:54:40.513991+0000","last_fullsized":"2024-09-14T11:54:40.513991+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-14T11:54:40.513806+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-14T11:54:40.513806+0000","last_clean_scrub_stamp":"2024-09-14T11:54:40.513806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:00.725064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"264'38","reported_seq":153,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:35.540456+0000","last_change":"2024-09-14T11:54:35.540214+0000","last_active":"2024-09-14T11:54:35.540456+0000","last_peered":"2024-09-14T11:54:35.540456+0000","last_clean":"2024-09-14T11:54:35.540456+0000","last_became_active":"2024-09-14T11:26:04.268202+0000","last_became_peered":"2024-09-14T11:26:04.268202+0000","last_unstale":"2024-09-14T11:54:35.540456+0000","last_undegraded":"2024-09-14T11:54:35.540456+0000","last_fullsized":"2024-09-14T11:54:35.540456+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'38","last_scrub_stamp":"2024-09-14T11:54:35.539999+0000","last_deep_scrub":"264'38","last_deep_scrub_stamp":"2024-09-14T11:54:35.539999+0000","last_clean_scrub_stamp":"2024-09-14T11:54:35.539999+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:43.448218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":294,"num_read_kb":198,"num_write":96,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:36.908841+0000","last_change":"2024-09-14T11:54:36.908602+0000","last_active":"2024-09-14T11:54:36.908841+0000","last_peered":"2024-09-14T11:54:36.908841+0000","last_clean":"2024-09-14T11:54:36.908841+0000","last_became_active":"2024-09-14T11:38:50.585324+0000","last_became_peered":"2024-09-14T11:38:50.585324+0000","last_unstale":"2024-09-14T11:54:36.908841+0000","last_undegraded":"2024-09-14T11:54:36.908841+0000","last_fullsized":"2024-09-14T11:54:36.908841+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:36.908378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:36.908378+0000","last_clean_scrub_stamp":"2024-09-14T11:54:36.908378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:19.151586+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"264'6","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:31.912687+0000","last_change":"2024-09-14T11:54:31.912687+0000","last_active":"2024-09-14T11:54:31.912687+0000","last_peered":"2024-09-14T11:54:31.912687+0000","last_clean":"2024-09-14T11:54:31.912687+0000","last_became_active":"2024-09-14T11:27:41.652940+0000","last_became_peered":"2024-09-14T11:27:41.652940+0000","last_unstale":"2024-09-14T11:54:31.912687+0000","last_undegraded":"2024-09-14T11:54:31.912687+0000","last_fullsized":"2024-09-14T11:54:31.912687+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-14T11:54:31.912497+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-14T11:54:31.912497+0000","last_clean_scrub_stamp":"2024-09-14T11:54:31.912497+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:48.642280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10244,"num_write":6,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"261'5","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:45.187726+0000","last_change":"2024-09-14T11:54:45.187726+0000","last_active":"2024-09-14T11:54:45.187726+0000","last_peered":"2024-09-14T11:54:45.187726+0000","last_clean":"2024-09-14T11:54:45.187726+0000","last_became_active":"2024-09-14T11:27:38.603013+0000","last_became_peered":"2024-09-14T11:27:38.603013+0000","last_unstale":"2024-09-14T11:54:45.187726+0000","last_undegraded":"2024-09-14T11:54:45.187726+0000","last_fullsized":"2024-09-14T11:54:45.187726+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-14T11:54:45.187536+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-14T11:54:45.187536+0000","last_clean_scrub_stamp":"2024-09-14T11:54:45.187536+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:20.306009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:55.593249+0000","last_change":"2024-09-14T11:54:55.593249+0000","last_active":"2024-09-14T11:54:55.593249+0000","last_peered":"2024-09-14T11:54:55.593249+0000","last_clean":"2024-09-14T11:54:55.593249+0000","last_became_active":"2024-09-14T11:26:04.263245+0000","last_became_peered":"2024-09-14T11:26:04.263245+0000","last_unstale":"2024-09-14T11:54:55.593249+0000","last_undegraded":"2024-09-14T11:54:55.593249+0000","last_fullsized":"2024-09-14T11:54:55.593249+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:55.593066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:55.593066+0000","last_clean_scrub_stamp":"2024-09-14T11:54:55.593066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:59.958516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:55:01.185248+0000","last_change":"2024-09-14T11:55:01.185248+0000","last_active":"2024-09-14T11:55:01.185248+0000","last_peered":"2024-09-14T11:55:01.185248+0000","last_clean":"2024-09-14T11:55:01.185248+0000","last_became_active":"2024-09-14T11:38:50.591033+0000","last_became_peered":"2024-09-14T11:38:50.591033+0000","last_unstale":"2024-09-14T11:55:01.185248+0000","last_undegraded":"2024-09-14T11:55:01.185248+0000","last_fullsized":"2024-09-14T11:55:01.185248+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:55:01.185073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:55:01.185073+0000","last_clean_scrub_stamp":"2024-09-14T11:55:01.185073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:29.268850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"264'2","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:53.178290+0000","last_change":"2024-09-14T11:54:53.178290+0000","last_active":"2024-09-14T11:54:53.178290+0000","last_peered":"2024-09-14T11:54:53.178290+0000","last_clean":"2024-09-14T11:54:53.178290+0000","last_became_active":"2024-09-14T11:27:41.634584+0000","last_became_peered":"2024-09-14T11:27:41.634584+0000","last_unstale":"2024-09-14T11:54:53.178290+0000","last_undegraded":"2024-09-14T11:54:53.178290+0000","last_fullsized":"2024-09-14T11:54:53.178290+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:53.178069+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:53.178069+0000","last_clean_scrub_stamp":"2024-09-14T11:54:53.178069+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:11.311473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:32.685095+0000","last_change":"2024-09-14T11:54:32.685095+0000","last_active":"2024-09-14T11:54:32.685095+0000","last_peered":"2024-09-14T11:54:32.685095+0000","last_clean":"2024-09-14T11:54:32.685095+0000","last_became_active":"2024-09-14T11:27:38.611912+0000","last_became_peered":"2024-09-14T11:27:38.611912+0000","last_unstale":"2024-09-14T11:54:32.685095+0000","last_undegraded":"2024-09-14T11:54:32.685095+0000","last_fullsized":"2024-09-14T11:54:32.685095+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:32.684888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:32.684888+0000","last_clean_scrub_stamp":"2024-09-14T11:54:32.684888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:49.951022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"264'32","reported_seq":143,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:54.628885+0000","last_change":"2024-09-14T11:54:54.628885+0000","last_active":"2024-09-14T11:54:54.628885+0000","last_peered":"2024-09-14T11:54:54.628885+0000","last_clean":"2024-09-14T11:54:54.628885+0000","last_became_active":"2024-09-14T11:26:04.264179+0000","last_became_peered":"2024-09-14T11:26:04.264179+0000","last_unstale":"2024-09-14T11:54:54.628885+0000","last_undegraded":"2024-09-14T11:54:54.628885+0000","last_fullsized":"2024-09-14T11:54:54.628885+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'32","last_scrub_stamp":"2024-09-14T11:54:54.628692+0000","last_deep_scrub":"264'32","last_deep_scrub_stamp":"2024-09-14T11:54:54.628692+0000","last_clean_scrub_stamp":"2024-09-14T11:54:54.628692+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:59.611270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":260,"num_read_kb":165,"num_write":79,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:45.715455+0000","last_change":"2024-09-14T11:54:45.715455+0000","last_active":"2024-09-14T11:54:45.715455+0000","last_peered":"2024-09-14T11:54:45.715455+0000","last_clean":"2024-09-14T11:54:45.715455+0000","last_became_active":"2024-09-14T11:38:50.552891+0000","last_became_peered":"2024-09-14T11:38:50.552891+0000","last_unstale":"2024-09-14T11:54:45.715455+0000","last_undegraded":"2024-09-14T11:54:45.715455+0000","last_fullsized":"2024-09-14T11:54:45.715455+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:45.715238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:45.715238+0000","last_clean_scrub_stamp":"2024-09-14T11:54:45.715238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:42.014340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"261'4","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:51.107413+0000","last_change":"2024-09-14T11:54:51.107413+0000","last_active":"2024-09-14T11:54:51.107413+0000","last_peered":"2024-09-14T11:54:51.107413+0000","last_clean":"2024-09-14T11:54:51.107413+0000","last_became_active":"2024-09-14T11:27:41.634824+0000","last_became_peered":"2024-09-14T11:27:41.634824+0000","last_unstale":"2024-09-14T11:54:51.107413+0000","last_undegraded":"2024-09-14T11:54:51.107413+0000","last_fullsized":"2024-09-14T11:54:51.107413+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-14T11:54:51.107217+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-14T11:54:51.107217+0000","last_clean_scrub_stamp":"2024-09-14T11:54:51.107217+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:01.690818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"264'2","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:44.201032+0000","last_change":"2024-09-14T11:54:44.201032+0000","last_active":"2024-09-14T11:54:44.201032+0000","last_peered":"2024-09-14T11:54:44.201032+0000","last_clean":"2024-09-14T11:54:44.201032+0000","last_became_active":"2024-09-14T11:27:38.608412+0000","last_became_peered":"2024-09-14T11:27:38.608412+0000","last_unstale":"2024-09-14T11:54:44.201032+0000","last_undegraded":"2024-09-14T11:54:44.201032+0000","last_fullsized":"2024-09-14T11:54:44.201032+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:44.200860+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:44.200860+0000","last_clean_scrub_stamp":"2024-09-14T11:54:44.200860+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:24.813906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"264'44","reported_seq":166,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:34.543253+0000","last_change":"2024-09-14T11:54:34.543253+0000","last_active":"2024-09-14T11:54:34.543253+0000","last_peered":"2024-09-14T11:54:34.543253+0000","last_clean":"2024-09-14T11:54:34.543253+0000","last_became_active":"2024-09-14T11:26:04.272026+0000","last_became_peered":"2024-09-14T11:26:04.272026+0000","last_unstale":"2024-09-14T11:54:34.543253+0000","last_undegraded":"2024-09-14T11:54:34.543253+0000","last_fullsized":"2024-09-14T11:54:34.543253+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'44","last_scrub_stamp":"2024-09-14T11:54:34.543061+0000","last_deep_scrub":"264'44","last_deep_scrub_stamp":"2024-09-14T11:54:34.543061+0000","last_clean_scrub_stamp":"2024-09-14T11:54:34.543061+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:37.348884+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":232,"num_write":112,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"264'2","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:48.239688+0000","last_change":"2024-09-14T11:54:48.239526+0000","last_active":"2024-09-14T11:54:48.239688+0000","last_peered":"2024-09-14T11:54:48.239688+0000","last_clean":"2024-09-14T11:54:48.239688+0000","last_became_active":"2024-09-14T11:38:50.575796+0000","last_became_peered":"2024-09-14T11:38:50.575796+0000","last_unstale":"2024-09-14T11:54:48.239688+0000","last_undegraded":"2024-09-14T11:54:48.239688+0000","last_fullsized":"2024-09-14T11:54:48.239688+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:48.239340+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:48.239340+0000","last_clean_scrub_stamp":"2024-09-14T11:54:48.239340+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:01.676473+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"264'5","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.618579+0000","last_change":"2024-09-14T11:54:47.618579+0000","last_active":"2024-09-14T11:54:47.618579+0000","last_peered":"2024-09-14T11:54:47.618579+0000","last_clean":"2024-09-14T11:54:47.618579+0000","last_became_active":"2024-09-14T11:27:41.634402+0000","last_became_peered":"2024-09-14T11:27:41.634402+0000","last_unstale":"2024-09-14T11:54:47.618579+0000","last_undegraded":"2024-09-14T11:54:47.618579+0000","last_fullsized":"2024-09-14T11:54:47.618579+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-14T11:54:47.618391+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-14T11:54:47.618391+0000","last_clean_scrub_stamp":"2024-09-14T11:54:47.618391+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:05.461604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:35.735915+0000","last_change":"2024-09-14T11:54:35.735915+0000","last_active":"2024-09-14T11:54:35.735915+0000","last_peered":"2024-09-14T11:54:35.735915+0000","last_clean":"2024-09-14T11:54:35.735915+0000","last_became_active":"2024-09-14T11:27:38.609363+0000","last_became_peered":"2024-09-14T11:27:38.609363+0000","last_unstale":"2024-09-14T11:54:35.735915+0000","last_undegraded":"2024-09-14T11:54:35.735915+0000","last_fullsized":"2024-09-14T11:54:35.735915+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:35.735614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:35.735614+0000","last_clean_scrub_stamp":"2024-09-14T11:54:35.735614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:35:41.231749+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"264'17","reported_seq":96,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:35.196987+0000","last_change":"2024-09-14T11:54:35.196987+0000","last_active":"2024-09-14T11:54:35.196987+0000","last_peered":"2024-09-14T11:54:35.196987+0000","last_clean":"2024-09-14T11:54:35.196987+0000","last_became_active":"2024-09-14T11:26:04.261498+0000","last_became_peered":"2024-09-14T11:26:04.261498+0000","last_unstale":"2024-09-14T11:54:35.196987+0000","last_undegraded":"2024-09-14T11:54:35.196987+0000","last_fullsized":"2024-09-14T11:54:35.196987+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'17","last_scrub_stamp":"2024-09-14T11:54:35.196770+0000","last_deep_scrub":"264'17","last_deep_scrub_stamp":"2024-09-14T11:54:35.196770+0000","last_clean_scrub_stamp":"2024-09-14T11:54:35.196770+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:35.021708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":93,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"264'2","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.747849+0000","last_change":"2024-09-14T11:54:43.747849+0000","last_active":"2024-09-14T11:54:43.747849+0000","last_peered":"2024-09-14T11:54:43.747849+0000","last_clean":"2024-09-14T11:54:43.747849+0000","last_became_active":"2024-09-14T11:38:50.576165+0000","last_became_peered":"2024-09-14T11:38:50.576165+0000","last_unstale":"2024-09-14T11:54:43.747849+0000","last_undegraded":"2024-09-14T11:54:43.747849+0000","last_fullsized":"2024-09-14T11:54:43.747849+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:43.747647+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:43.747647+0000","last_clean_scrub_stamp":"2024-09-14T11:54:43.747647+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:54.555162+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"264'2","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:55:04.599195+0000","last_change":"2024-09-14T11:55:04.599195+0000","last_active":"2024-09-14T11:55:04.599195+0000","last_peered":"2024-09-14T11:55:04.599195+0000","last_clean":"2024-09-14T11:55:04.599195+0000","last_became_active":"2024-09-14T11:27:41.649598+0000","last_became_peered":"2024-09-14T11:27:41.649598+0000","last_unstale":"2024-09-14T11:55:04.599195+0000","last_undegraded":"2024-09-14T11:55:04.599195+0000","last_fullsized":"2024-09-14T11:55:04.599195+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:55:04.598976+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:55:04.598976+0000","last_clean_scrub_stamp":"2024-09-14T11:55:04.598976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:13.569397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:39.755998+0000","last_change":"2024-09-14T11:54:39.755998+0000","last_active":"2024-09-14T11:54:39.755998+0000","last_peered":"2024-09-14T11:54:39.755998+0000","last_clean":"2024-09-14T11:54:39.755998+0000","last_became_active":"2024-09-14T11:27:38.598429+0000","last_became_peered":"2024-09-14T11:27:38.598429+0000","last_unstale":"2024-09-14T11:54:39.755998+0000","last_undegraded":"2024-09-14T11:54:39.755998+0000","last_fullsized":"2024-09-14T11:54:39.755998+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:39.755724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:39.755724+0000","last_clean_scrub_stamp":"2024-09-14T11:54:39.755724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:41:24.015461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"264'26","reported_seq":123,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:33.532947+0000","last_change":"2024-09-14T11:54:33.532947+0000","last_active":"2024-09-14T11:54:33.532947+0000","last_peered":"2024-09-14T11:54:33.532947+0000","last_clean":"2024-09-14T11:54:33.532947+0000","last_became_active":"2024-09-14T11:26:04.272216+0000","last_became_peered":"2024-09-14T11:26:04.272216+0000","last_unstale":"2024-09-14T11:54:33.532947+0000","last_undegraded":"2024-09-14T11:54:33.532947+0000","last_fullsized":"2024-09-14T11:54:33.532947+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'26","last_scrub_stamp":"2024-09-14T11:54:33.532773+0000","last_deep_scrub":"264'26","last_deep_scrub_stamp":"2024-09-14T11:54:33.532773+0000","last_clean_scrub_stamp":"2024-09-14T11:54:33.532773+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:59.031617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":141,"num_write":65,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.143112+0000","last_change":"2024-09-14T11:54:58.143112+0000","last_active":"2024-09-14T11:54:58.143112+0000","last_peered":"2024-09-14T11:54:58.143112+0000","last_clean":"2024-09-14T11:54:58.143112+0000","last_became_active":"2024-09-14T11:38:50.589121+0000","last_became_peered":"2024-09-14T11:38:50.589121+0000","last_unstale":"2024-09-14T11:54:58.143112+0000","last_undegraded":"2024-09-14T11:54:58.143112+0000","last_fullsized":"2024-09-14T11:54:58.143112+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:58.142933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:58.142933+0000","last_clean_scrub_stamp":"2024-09-14T11:54:58.142933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:23.535745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"261'4","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:45.551965+0000","last_change":"2024-09-14T11:54:45.551965+0000","last_active":"2024-09-14T11:54:45.551965+0000","last_peered":"2024-09-14T11:54:45.551965+0000","last_clean":"2024-09-14T11:54:45.551965+0000","last_became_active":"2024-09-14T11:27:41.630970+0000","last_became_peered":"2024-09-14T11:27:41.630970+0000","last_unstale":"2024-09-14T11:54:45.551965+0000","last_undegraded":"2024-09-14T11:54:45.551965+0000","last_fullsized":"2024-09-14T11:54:45.551965+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-14T11:54:45.551771+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-14T11:54:45.551771+0000","last_clean_scrub_stamp":"2024-09-14T11:54:45.551771+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:45.891308+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:39.125357+0000","last_change":"2024-09-14T11:54:39.125193+0000","last_active":"2024-09-14T11:54:39.125357+0000","last_peered":"2024-09-14T11:54:39.125357+0000","last_clean":"2024-09-14T11:54:39.125357+0000","last_became_active":"2024-09-14T11:27:38.580979+0000","last_became_peered":"2024-09-14T11:27:38.580979+0000","last_unstale":"2024-09-14T11:54:39.125357+0000","last_undegraded":"2024-09-14T11:54:39.125357+0000","last_fullsized":"2024-09-14T11:54:39.125357+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:39.125010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:39.125010+0000","last_clean_scrub_stamp":"2024-09-14T11:54:39.125010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:19.882964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"261'22","reported_seq":115,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:30.439177+0000","last_change":"2024-09-14T11:54:30.439047+0000","last_active":"2024-09-14T11:54:30.439177+0000","last_peered":"2024-09-14T11:54:30.439177+0000","last_clean":"2024-09-14T11:54:30.439177+0000","last_became_active":"2024-09-14T11:26:04.275034+0000","last_became_peered":"2024-09-14T11:26:04.275034+0000","last_unstale":"2024-09-14T11:54:30.439177+0000","last_undegraded":"2024-09-14T11:54:30.439177+0000","last_fullsized":"2024-09-14T11:54:30.439177+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'22","last_scrub_stamp":"2024-09-14T11:54:30.438866+0000","last_deep_scrub":"261'22","last_deep_scrub_stamp":"2024-09-14T11:54:30.438866+0000","last_clean_scrub_stamp":"2024-09-14T11:54:30.438866+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:15.538153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":117,"num_write":55,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:41.821827+0000","last_change":"2024-09-14T11:54:41.821827+0000","last_active":"2024-09-14T11:54:41.821827+0000","last_peered":"2024-09-14T11:54:41.821827+0000","last_clean":"2024-09-14T11:54:41.821827+0000","last_became_active":"2024-09-14T11:38:50.596395+0000","last_became_peered":"2024-09-14T11:38:50.596395+0000","last_unstale":"2024-09-14T11:54:41.821827+0000","last_undegraded":"2024-09-14T11:54:41.821827+0000","last_fullsized":"2024-09-14T11:54:41.821827+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:41.821655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:41.821655+0000","last_clean_scrub_stamp":"2024-09-14T11:54:41.821655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:51.729531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"264'4","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:44.502005+0000","last_change":"2024-09-14T11:54:44.502005+0000","last_active":"2024-09-14T11:54:44.502005+0000","last_peered":"2024-09-14T11:54:44.502005+0000","last_clean":"2024-09-14T11:54:44.502005+0000","last_became_active":"2024-09-14T11:27:41.656659+0000","last_became_peered":"2024-09-14T11:27:41.656659+0000","last_unstale":"2024-09-14T11:54:44.502005+0000","last_undegraded":"2024-09-14T11:54:44.502005+0000","last_fullsized":"2024-09-14T11:54:44.502005+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T11:54:44.501816+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T11:54:44.501816+0000","last_clean_scrub_stamp":"2024-09-14T11:54:44.501816+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:14.671511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":100,"num_write":4,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:39.662124+0000","last_change":"2024-09-14T11:54:39.662124+0000","last_active":"2024-09-14T11:54:39.662124+0000","last_peered":"2024-09-14T11:54:39.662124+0000","last_clean":"2024-09-14T11:54:39.662124+0000","last_became_active":"2024-09-14T11:27:38.604732+0000","last_became_peered":"2024-09-14T11:27:38.604732+0000","last_unstale":"2024-09-14T11:54:39.662124+0000","last_undegraded":"2024-09-14T11:54:39.662124+0000","last_fullsized":"2024-09-14T11:54:39.662124+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:39.661953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:39.661953+0000","last_clean_scrub_stamp":"2024-09-14T11:54:39.661953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:27.640744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"264'35","reported_seq":143,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:53.591375+0000","last_change":"2024-09-14T11:54:53.591220+0000","last_active":"2024-09-14T11:54:53.591375+0000","last_peered":"2024-09-14T11:54:53.591375+0000","last_clean":"2024-09-14T11:54:53.591375+0000","last_became_active":"2024-09-14T11:26:04.279402+0000","last_became_peered":"2024-09-14T11:26:04.279402+0000","last_unstale":"2024-09-14T11:54:53.591375+0000","last_undegraded":"2024-09-14T11:54:53.591375+0000","last_fullsized":"2024-09-14T11:54:53.591375+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'35","last_scrub_stamp":"2024-09-14T11:54:53.591037+0000","last_deep_scrub":"264'35","last_deep_scrub_stamp":"2024-09-14T11:54:53.591037+0000","last_clean_scrub_stamp":"2024-09-14T11:54:53.591037+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:42.763902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":174,"num_write":94,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:55:08.671289+0000","last_change":"2024-09-14T11:55:08.671289+0000","last_active":"2024-09-14T11:55:08.671289+0000","last_peered":"2024-09-14T11:55:08.671289+0000","last_clean":"2024-09-14T11:55:08.671289+0000","last_became_active":"2024-09-14T11:38:50.573062+0000","last_became_peered":"2024-09-14T11:38:50.573062+0000","last_unstale":"2024-09-14T11:55:08.671289+0000","last_undegraded":"2024-09-14T11:55:08.671289+0000","last_fullsized":"2024-09-14T11:55:08.671289+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:55:08.671101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:55:08.671101+0000","last_clean_scrub_stamp":"2024-09-14T11:55:08.671101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:28.070590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"264'7","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:46.574905+0000","last_change":"2024-09-14T11:54:46.574905+0000","last_active":"2024-09-14T11:54:46.574905+0000","last_peered":"2024-09-14T11:54:46.574905+0000","last_clean":"2024-09-14T11:54:46.574905+0000","last_became_active":"2024-09-14T11:27:41.639051+0000","last_became_peered":"2024-09-14T11:27:41.639051+0000","last_unstale":"2024-09-14T11:54:46.574905+0000","last_undegraded":"2024-09-14T11:54:46.574905+0000","last_fullsized":"2024-09-14T11:54:46.574905+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-14T11:54:46.574719+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-14T11:54:46.574719+0000","last_clean_scrub_stamp":"2024-09-14T11:54:46.574719+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:12.073513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"264'4","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.453774+0000","last_change":"2024-09-14T11:54:38.453774+0000","last_active":"2024-09-14T11:54:38.453774+0000","last_peered":"2024-09-14T11:54:38.453774+0000","last_clean":"2024-09-14T11:54:38.453774+0000","last_became_active":"2024-09-14T11:27:38.619608+0000","last_became_peered":"2024-09-14T11:27:38.619608+0000","last_unstale":"2024-09-14T11:54:38.453774+0000","last_undegraded":"2024-09-14T11:54:38.453774+0000","last_fullsized":"2024-09-14T11:54:38.453774+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T11:54:38.453594+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T11:54:38.453594+0000","last_clean_scrub_stamp":"2024-09-14T11:54:38.453594+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:36.579941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"264'28","reported_seq":125,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:33.716945+0000","last_change":"2024-09-14T11:54:33.716691+0000","last_active":"2024-09-14T11:54:33.716945+0000","last_peered":"2024-09-14T11:54:33.716945+0000","last_clean":"2024-09-14T11:54:33.716945+0000","last_became_active":"2024-09-14T11:26:04.272960+0000","last_became_peered":"2024-09-14T11:26:04.272960+0000","last_unstale":"2024-09-14T11:54:33.716945+0000","last_undegraded":"2024-09-14T11:54:33.716945+0000","last_fullsized":"2024-09-14T11:54:33.716945+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'28","last_scrub_stamp":"2024-09-14T11:54:33.716463+0000","last_deep_scrub":"264'28","last_deep_scrub_stamp":"2024-09-14T11:54:33.716463+0000","last_clean_scrub_stamp":"2024-09-14T11:54:33.716463+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:37.462810+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":136,"num_write":79,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:37.781649+0000","last_change":"2024-09-14T11:54:37.781649+0000","last_active":"2024-09-14T11:54:37.781649+0000","last_peered":"2024-09-14T11:54:37.781649+0000","last_clean":"2024-09-14T11:54:37.781649+0000","last_became_active":"2024-09-14T11:38:50.569743+0000","last_became_peered":"2024-09-14T11:38:50.569743+0000","last_unstale":"2024-09-14T11:54:37.781649+0000","last_undegraded":"2024-09-14T11:54:37.781649+0000","last_fullsized":"2024-09-14T11:54:37.781649+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:37.781472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:37.781472+0000","last_clean_scrub_stamp":"2024-09-14T11:54:37.781472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:12.956391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"264'5","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:50.087718+0000","last_change":"2024-09-14T11:54:50.087718+0000","last_active":"2024-09-14T11:54:50.087718+0000","last_peered":"2024-09-14T11:54:50.087718+0000","last_clean":"2024-09-14T11:54:50.087718+0000","last_became_active":"2024-09-14T11:27:41.653929+0000","last_became_peered":"2024-09-14T11:27:41.653929+0000","last_unstale":"2024-09-14T11:54:50.087718+0000","last_undegraded":"2024-09-14T11:54:50.087718+0000","last_fullsized":"2024-09-14T11:54:50.087718+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-14T11:54:50.087526+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-14T11:54:50.087526+0000","last_clean_scrub_stamp":"2024-09-14T11:54:50.087526+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:59.453521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":118,"num_write":10,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"264'9","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:39.495730+0000","last_change":"2024-09-14T11:54:39.495730+0000","last_active":"2024-09-14T11:54:39.495730+0000","last_peered":"2024-09-14T11:54:39.495730+0000","last_clean":"2024-09-14T11:54:39.495730+0000","last_became_active":"2024-09-14T11:27:38.619441+0000","last_became_peered":"2024-09-14T11:27:38.619441+0000","last_unstale":"2024-09-14T11:54:39.495730+0000","last_undegraded":"2024-09-14T11:54:39.495730+0000","last_fullsized":"2024-09-14T11:54:39.495730+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-09-14T11:54:39.495455+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-09-14T11:54:39.495455+0000","last_clean_scrub_stamp":"2024-09-14T11:54:39.495455+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:33.156798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":21504,"num_write":14,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"264'28","reported_seq":124,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:33.632984+0000","last_change":"2024-09-14T11:54:33.632841+0000","last_active":"2024-09-14T11:54:33.632984+0000","last_peered":"2024-09-14T11:54:33.632984+0000","last_clean":"2024-09-14T11:54:33.632984+0000","last_became_active":"2024-09-14T11:26:04.271747+0000","last_became_peered":"2024-09-14T11:26:04.271747+0000","last_unstale":"2024-09-14T11:54:33.632984+0000","last_undegraded":"2024-09-14T11:54:33.632984+0000","last_fullsized":"2024-09-14T11:54:33.632984+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'28","last_scrub_stamp":"2024-09-14T11:54:33.632646+0000","last_deep_scrub":"264'28","last_deep_scrub_stamp":"2024-09-14T11:54:33.632646+0000","last_clean_scrub_stamp":"2024-09-14T11:54:33.632646+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:32.196817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":132,"num_write":73,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:59.097523+0000","last_change":"2024-09-14T11:54:59.097523+0000","last_active":"2024-09-14T11:54:59.097523+0000","last_peered":"2024-09-14T11:54:59.097523+0000","last_clean":"2024-09-14T11:54:59.097523+0000","last_became_active":"2024-09-14T11:38:50.589444+0000","last_became_peered":"2024-09-14T11:38:50.589444+0000","last_unstale":"2024-09-14T11:54:59.097523+0000","last_undegraded":"2024-09-14T11:54:59.097523+0000","last_fullsized":"2024-09-14T11:54:59.097523+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:59.097339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:59.097339+0000","last_clean_scrub_stamp":"2024-09-14T11:54:59.097339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:50.482678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"261'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:55:06.646861+0000","last_change":"2024-09-14T11:55:06.646861+0000","last_active":"2024-09-14T11:55:06.646861+0000","last_peered":"2024-09-14T11:55:06.646861+0000","last_clean":"2024-09-14T11:55:06.646861+0000","last_became_active":"2024-09-14T11:27:41.640105+0000","last_became_peered":"2024-09-14T11:27:41.640105+0000","last_unstale":"2024-09-14T11:55:06.646861+0000","last_undegraded":"2024-09-14T11:55:06.646861+0000","last_fullsized":"2024-09-14T11:55:06.646861+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-14T11:55:06.646641+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-14T11:55:06.646641+0000","last_clean_scrub_stamp":"2024-09-14T11:55:06.646641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:56.199397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"264'11","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:36.499007+0000","last_change":"2024-09-14T11:54:36.499007+0000","last_active":"2024-09-14T11:54:36.499007+0000","last_peered":"2024-09-14T11:54:36.499007+0000","last_clean":"2024-09-14T11:54:36.499007+0000","last_became_active":"2024-09-14T11:27:38.612745+0000","last_became_peered":"2024-09-14T11:27:38.612745+0000","last_unstale":"2024-09-14T11:54:36.499007+0000","last_undegraded":"2024-09-14T11:54:36.499007+0000","last_fullsized":"2024-09-14T11:54:36.499007+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'11","last_scrub_stamp":"2024-09-14T11:54:36.498817+0000","last_deep_scrub":"264'11","last_deep_scrub_stamp":"2024-09-14T11:54:36.498817+0000","last_clean_scrub_stamp":"2024-09-14T11:54:36.498817+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:31.561242+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":6207,"num_write":16,"num_write_kb":2107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"264'45","reported_seq":179,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:32.641713+0000","last_change":"2024-09-14T11:54:32.641432+0000","last_active":"2024-09-14T11:54:32.641713+0000","last_peered":"2024-09-14T11:54:32.641713+0000","last_clean":"2024-09-14T11:54:32.641713+0000","last_became_active":"2024-09-14T11:26:04.273309+0000","last_became_peered":"2024-09-14T11:26:04.273309+0000","last_unstale":"2024-09-14T11:54:32.641713+0000","last_undegraded":"2024-09-14T11:54:32.641713+0000","last_fullsized":"2024-09-14T11:54:32.641713+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'45","last_scrub_stamp":"2024-09-14T11:54:32.641166+0000","last_deep_scrub":"264'45","last_deep_scrub_stamp":"2024-09-14T11:54:32.641166+0000","last_clean_scrub_stamp":"2024-09-14T11:54:32.641166+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:40.953471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":376,"num_read_kb":242,"num_write":121,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:44.101834+0000","last_change":"2024-09-14T11:54:44.101704+0000","last_active":"2024-09-14T11:54:44.101834+0000","last_peered":"2024-09-14T11:54:44.101834+0000","last_clean":"2024-09-14T11:54:44.101834+0000","last_became_active":"2024-09-14T11:38:50.596495+0000","last_became_peered":"2024-09-14T11:38:50.596495+0000","last_unstale":"2024-09-14T11:54:44.101834+0000","last_undegraded":"2024-09-14T11:54:44.101834+0000","last_fullsized":"2024-09-14T11:54:44.101834+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:44.101486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:44.101486+0000","last_clean_scrub_stamp":"2024-09-14T11:54:44.101486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:40.560370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"264'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.105445+0000","last_change":"2024-09-14T11:54:43.105445+0000","last_active":"2024-09-14T11:54:43.105445+0000","last_peered":"2024-09-14T11:54:43.105445+0000","last_clean":"2024-09-14T11:54:43.105445+0000","last_became_active":"2024-09-14T11:27:41.650311+0000","last_became_peered":"2024-09-14T11:27:41.650311+0000","last_unstale":"2024-09-14T11:54:43.105445+0000","last_undegraded":"2024-09-14T11:54:43.105445+0000","last_fullsized":"2024-09-14T11:54:43.105445+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-14T11:54:43.105266+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-14T11:54:43.105266+0000","last_clean_scrub_stamp":"2024-09-14T11:54:43.105266+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:17.538352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"264'8","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.167098+0000","last_change":"2024-09-14T11:54:43.167098+0000","last_active":"2024-09-14T11:54:43.167098+0000","last_peered":"2024-09-14T11:54:43.167098+0000","last_clean":"2024-09-14T11:54:43.167098+0000","last_became_active":"2024-09-14T11:27:38.600043+0000","last_became_peered":"2024-09-14T11:27:38.600043+0000","last_unstale":"2024-09-14T11:54:43.167098+0000","last_undegraded":"2024-09-14T11:54:43.167098+0000","last_fullsized":"2024-09-14T11:54:43.167098+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-14T11:54:43.166917+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-14T11:54:43.166917+0000","last_clean_scrub_stamp":"2024-09-14T11:54:43.166917+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:04.371102+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":7170,"num_write":8,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"264'31","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:36.176386+0000","last_change":"2024-09-14T11:54:36.176386+0000","last_active":"2024-09-14T11:54:36.176386+0000","last_peered":"2024-09-14T11:54:36.176386+0000","last_clean":"2024-09-14T11:54:36.176386+0000","last_became_active":"2024-09-14T11:26:04.274089+0000","last_became_peered":"2024-09-14T11:26:04.274089+0000","last_unstale":"2024-09-14T11:54:36.176386+0000","last_undegraded":"2024-09-14T11:54:36.176386+0000","last_fullsized":"2024-09-14T11:54:36.176386+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'31","last_scrub_stamp":"2024-09-14T11:54:36.176207+0000","last_deep_scrub":"264'31","last_deep_scrub_stamp":"2024-09-14T11:54:36.176207+0000","last_clean_scrub_stamp":"2024-09-14T11:54:36.176207+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:32.653650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":254,"num_read_kb":164,"num_write":92,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"264'2","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:35.890706+0000","last_change":"2024-09-14T11:54:35.890556+0000","last_active":"2024-09-14T11:54:35.890706+0000","last_peered":"2024-09-14T11:54:35.890706+0000","last_clean":"2024-09-14T11:54:35.890706+0000","last_became_active":"2024-09-14T11:38:50.592765+0000","last_became_peered":"2024-09-14T11:38:50.592765+0000","last_unstale":"2024-09-14T11:54:35.890706+0000","last_undegraded":"2024-09-14T11:54:35.890706+0000","last_fullsized":"2024-09-14T11:54:35.890706+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:35.890361+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:35.890361+0000","last_clean_scrub_stamp":"2024-09-14T11:54:35.890361+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:43.731599+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"261'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:41.742159+0000","last_change":"2024-09-14T11:54:41.742032+0000","last_active":"2024-09-14T11:54:41.742159+0000","last_peered":"2024-09-14T11:54:41.742159+0000","last_clean":"2024-09-14T11:54:41.742159+0000","last_became_active":"2024-09-14T11:27:41.646962+0000","last_became_peered":"2024-09-14T11:27:41.646962+0000","last_unstale":"2024-09-14T11:54:41.742159+0000","last_undegraded":"2024-09-14T11:54:41.742159+0000","last_fullsized":"2024-09-14T11:54:41.742159+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-14T11:54:41.741821+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-14T11:54:41.741821+0000","last_clean_scrub_stamp":"2024-09-14T11:54:41.741821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:52:34.345872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:37.456892+0000","last_change":"2024-09-14T11:54:37.456892+0000","last_active":"2024-09-14T11:54:37.456892+0000","last_peered":"2024-09-14T11:54:37.456892+0000","last_clean":"2024-09-14T11:54:37.456892+0000","last_became_active":"2024-09-14T11:27:38.612131+0000","last_became_peered":"2024-09-14T11:27:38.612131+0000","last_unstale":"2024-09-14T11:54:37.456892+0000","last_undegraded":"2024-09-14T11:54:37.456892+0000","last_fullsized":"2024-09-14T11:54:37.456892+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:37.456703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:37.456703+0000","last_clean_scrub_stamp":"2024-09-14T11:54:37.456703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:10.593240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"264'14","reported_seq":88,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.175401+0000","last_change":"2024-09-14T11:54:42.175401+0000","last_active":"2024-09-14T11:54:42.175401+0000","last_peered":"2024-09-14T11:54:42.175401+0000","last_clean":"2024-09-14T11:54:42.175401+0000","last_became_active":"2024-09-14T11:26:04.258976+0000","last_became_peered":"2024-09-14T11:26:04.258976+0000","last_unstale":"2024-09-14T11:54:42.175401+0000","last_undegraded":"2024-09-14T11:54:42.175401+0000","last_fullsized":"2024-09-14T11:54:42.175401+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'14","last_scrub_stamp":"2024-09-14T11:54:42.175217+0000","last_deep_scrub":"264'14","last_deep_scrub_stamp":"2024-09-14T11:54:42.175217+0000","last_clean_scrub_stamp":"2024-09-14T11:54:42.175217+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:46.240692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":72,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:52.684034+0000","last_change":"2024-09-14T11:54:52.684034+0000","last_active":"2024-09-14T11:54:52.684034+0000","last_peered":"2024-09-14T11:54:52.684034+0000","last_clean":"2024-09-14T11:54:52.684034+0000","last_became_active":"2024-09-14T11:38:50.593641+0000","last_became_peered":"2024-09-14T11:38:50.593641+0000","last_unstale":"2024-09-14T11:54:52.684034+0000","last_undegraded":"2024-09-14T11:54:52.684034+0000","last_fullsized":"2024-09-14T11:54:52.684034+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:52.683824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:52.683824+0000","last_clean_scrub_stamp":"2024-09-14T11:54:52.683824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:28.599782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"261'7","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.894176+0000","last_change":"2024-09-14T11:54:38.894176+0000","last_active":"2024-09-14T11:54:38.894176+0000","last_peered":"2024-09-14T11:54:38.894176+0000","last_clean":"2024-09-14T11:54:38.894176+0000","last_became_active":"2024-09-14T11:27:41.657112+0000","last_became_peered":"2024-09-14T11:27:41.657112+0000","last_unstale":"2024-09-14T11:54:38.894176+0000","last_undegraded":"2024-09-14T11:54:38.894176+0000","last_fullsized":"2024-09-14T11:54:38.894176+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'7","last_scrub_stamp":"2024-09-14T11:54:38.893981+0000","last_deep_scrub":"261'7","last_deep_scrub_stamp":"2024-09-14T11:54:38.893981+0000","last_clean_scrub_stamp":"2024-09-14T11:54:38.893981+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:56.913823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":6146,"num_write":12,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"264'3","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:59.570054+0000","last_change":"2024-09-14T11:54:59.570054+0000","last_active":"2024-09-14T11:54:59.570054+0000","last_peered":"2024-09-14T11:54:59.570054+0000","last_clean":"2024-09-14T11:54:59.570054+0000","last_became_active":"2024-09-14T11:27:38.602864+0000","last_became_peered":"2024-09-14T11:27:38.602864+0000","last_unstale":"2024-09-14T11:54:59.570054+0000","last_undegraded":"2024-09-14T11:54:59.570054+0000","last_fullsized":"2024-09-14T11:54:59.570054+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:54:59.569859+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:54:59.569859+0000","last_clean_scrub_stamp":"2024-09-14T11:54:59.569859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:12.723206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"264'39","reported_seq":161,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:29.897512+0000","last_change":"2024-09-14T11:54:29.897512+0000","last_active":"2024-09-14T11:54:29.897512+0000","last_peered":"2024-09-14T11:54:29.897512+0000","last_clean":"2024-09-14T11:54:29.897512+0000","last_became_active":"2024-09-14T11:26:04.271893+0000","last_became_peered":"2024-09-14T11:26:04.271893+0000","last_unstale":"2024-09-14T11:54:29.897512+0000","last_undegraded":"2024-09-14T11:54:29.897512+0000","last_fullsized":"2024-09-14T11:54:29.897512+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'39","last_scrub_stamp":"2024-09-14T11:54:29.897326+0000","last_deep_scrub":"264'39","last_deep_scrub_stamp":"2024-09-14T11:54:29.897326+0000","last_clean_scrub_stamp":"2024-09-14T11:54:29.897326+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:50.067877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":319,"num_read_kb":212,"num_write":95,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:39.912208+0000","last_change":"2024-09-14T11:54:39.912208+0000","last_active":"2024-09-14T11:54:39.912208+0000","last_peered":"2024-09-14T11:54:39.912208+0000","last_clean":"2024-09-14T11:54:39.912208+0000","last_became_active":"2024-09-14T11:38:50.587827+0000","last_became_peered":"2024-09-14T11:38:50.587827+0000","last_unstale":"2024-09-14T11:54:39.912208+0000","last_undegraded":"2024-09-14T11:54:39.912208+0000","last_fullsized":"2024-09-14T11:54:39.912208+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:39.912020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:39.912020+0000","last_clean_scrub_stamp":"2024-09-14T11:54:39.912020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:38.246467+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"261'5","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:49.115994+0000","last_change":"2024-09-14T11:54:49.115787+0000","last_active":"2024-09-14T11:54:49.115994+0000","last_peered":"2024-09-14T11:54:49.115994+0000","last_clean":"2024-09-14T11:54:49.115994+0000","last_became_active":"2024-09-14T11:27:41.651778+0000","last_became_peered":"2024-09-14T11:27:41.651778+0000","last_unstale":"2024-09-14T11:54:49.115994+0000","last_undegraded":"2024-09-14T11:54:49.115994+0000","last_fullsized":"2024-09-14T11:54:49.115994+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-14T11:54:49.115592+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-14T11:54:49.115592+0000","last_clean_scrub_stamp":"2024-09-14T11:54:49.115592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:17:25.061815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:56.561405+0000","last_change":"2024-09-14T11:54:56.561405+0000","last_active":"2024-09-14T11:54:56.561405+0000","last_peered":"2024-09-14T11:54:56.561405+0000","last_clean":"2024-09-14T11:54:56.561405+0000","last_became_active":"2024-09-14T11:27:38.603954+0000","last_became_peered":"2024-09-14T11:27:38.603954+0000","last_unstale":"2024-09-14T11:54:56.561405+0000","last_undegraded":"2024-09-14T11:54:56.561405+0000","last_fullsized":"2024-09-14T11:54:56.561405+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:56.561220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:56.561220+0000","last_clean_scrub_stamp":"2024-09-14T11:54:56.561220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:38.490434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"264'59","reported_seq":209,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:40.121557+0000","last_change":"2024-09-14T11:54:40.121557+0000","last_active":"2024-09-14T11:54:40.121557+0000","last_peered":"2024-09-14T11:54:40.121557+0000","last_clean":"2024-09-14T11:54:40.121557+0000","last_became_active":"2024-09-14T11:26:04.269206+0000","last_became_peered":"2024-09-14T11:26:04.269206+0000","last_unstale":"2024-09-14T11:54:40.121557+0000","last_undegraded":"2024-09-14T11:54:40.121557+0000","last_fullsized":"2024-09-14T11:54:40.121557+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'59","last_scrub_stamp":"2024-09-14T11:54:40.121338+0000","last_deep_scrub":"264'59","last_deep_scrub_stamp":"2024-09-14T11:54:40.121338+0000","last_clean_scrub_stamp":"2024-09-14T11:54:40.121338+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:16.225468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":473,"num_read_kb":330,"num_write":140,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:34.854153+0000","last_change":"2024-09-14T11:54:34.854153+0000","last_active":"2024-09-14T11:54:34.854153+0000","last_peered":"2024-09-14T11:54:34.854153+0000","last_clean":"2024-09-14T11:54:34.854153+0000","last_became_active":"2024-09-14T11:38:50.585233+0000","last_became_peered":"2024-09-14T11:38:50.585233+0000","last_unstale":"2024-09-14T11:54:34.854153+0000","last_undegraded":"2024-09-14T11:54:34.854153+0000","last_fullsized":"2024-09-14T11:54:34.854153+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:34.853978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:34.853978+0000","last_clean_scrub_stamp":"2024-09-14T11:54:34.853978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:57.638474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"261'4","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:48.136949+0000","last_change":"2024-09-14T11:54:48.136796+0000","last_active":"2024-09-14T11:54:48.136949+0000","last_peered":"2024-09-14T11:54:48.136949+0000","last_clean":"2024-09-14T11:54:48.136949+0000","last_became_active":"2024-09-14T11:27:41.660286+0000","last_became_peered":"2024-09-14T11:27:41.660286+0000","last_unstale":"2024-09-14T11:54:48.136949+0000","last_undegraded":"2024-09-14T11:54:48.136949+0000","last_fullsized":"2024-09-14T11:54:48.136949+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4","last_scrub_stamp":"2024-09-14T11:54:48.136603+0000","last_deep_scrub":"261'4","last_deep_scrub_stamp":"2024-09-14T11:54:48.136603+0000","last_clean_scrub_stamp":"2024-09-14T11:54:48.136603+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:28.232610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"261'2","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:45.217865+0000","last_change":"2024-09-14T11:54:45.217618+0000","last_active":"2024-09-14T11:54:45.217865+0000","last_peered":"2024-09-14T11:54:45.217865+0000","last_clean":"2024-09-14T11:54:45.217865+0000","last_became_active":"2024-09-14T11:27:38.591485+0000","last_became_peered":"2024-09-14T11:27:38.591485+0000","last_unstale":"2024-09-14T11:54:45.217865+0000","last_undegraded":"2024-09-14T11:54:45.217865+0000","last_fullsized":"2024-09-14T11:54:45.217865+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-14T11:54:45.217339+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-14T11:54:45.217339+0000","last_clean_scrub_stamp":"2024-09-14T11:54:45.217339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:38.002344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"261'8","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:51.573141+0000","last_change":"2024-09-14T11:54:51.573141+0000","last_active":"2024-09-14T11:54:51.573141+0000","last_peered":"2024-09-14T11:54:51.573141+0000","last_clean":"2024-09-14T11:54:51.573141+0000","last_became_active":"2024-09-14T11:26:04.280724+0000","last_became_peered":"2024-09-14T11:26:04.280724+0000","last_unstale":"2024-09-14T11:54:51.573141+0000","last_undegraded":"2024-09-14T11:54:51.573141+0000","last_fullsized":"2024-09-14T11:54:51.573141+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-14T11:54:51.572948+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-14T11:54:51.572948+0000","last_clean_scrub_stamp":"2024-09-14T11:54:51.572948+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:17.543439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":39,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:55.194297+0000","last_change":"2024-09-14T11:54:55.194157+0000","last_active":"2024-09-14T11:54:55.194297+0000","last_peered":"2024-09-14T11:54:55.194297+0000","last_clean":"2024-09-14T11:54:55.194297+0000","last_became_active":"2024-09-14T11:38:50.586004+0000","last_became_peered":"2024-09-14T11:38:50.586004+0000","last_unstale":"2024-09-14T11:54:55.194297+0000","last_undegraded":"2024-09-14T11:54:55.194297+0000","last_fullsized":"2024-09-14T11:54:55.194297+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:55.193953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:55.193953+0000","last_clean_scrub_stamp":"2024-09-14T11:54:55.193953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:04.675756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"264'4","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:33.848101+0000","last_change":"2024-09-14T11:54:33.848101+0000","last_active":"2024-09-14T11:54:33.848101+0000","last_peered":"2024-09-14T11:54:33.848101+0000","last_clean":"2024-09-14T11:54:33.848101+0000","last_became_active":"2024-09-14T11:27:41.656864+0000","last_became_peered":"2024-09-14T11:27:41.656864+0000","last_unstale":"2024-09-14T11:54:33.848101+0000","last_undegraded":"2024-09-14T11:54:33.848101+0000","last_fullsized":"2024-09-14T11:54:33.848101+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T11:54:33.847817+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T11:54:33.847817+0000","last_clean_scrub_stamp":"2024-09-14T11:54:33.847817+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:53.957568+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4123,"num_write":4,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"264'12","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.154931+0000","last_change":"2024-09-14T11:54:38.154931+0000","last_active":"2024-09-14T11:54:38.154931+0000","last_peered":"2024-09-14T11:54:38.154931+0000","last_clean":"2024-09-14T11:54:38.154931+0000","last_became_active":"2024-09-14T11:27:38.597416+0000","last_became_peered":"2024-09-14T11:27:38.597416+0000","last_unstale":"2024-09-14T11:54:38.154931+0000","last_undegraded":"2024-09-14T11:54:38.154931+0000","last_fullsized":"2024-09-14T11:54:38.154931+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'12","last_scrub_stamp":"2024-09-14T11:54:38.154747+0000","last_deep_scrub":"264'12","last_deep_scrub_stamp":"2024-09-14T11:54:38.154747+0000","last_clean_scrub_stamp":"2024-09-14T11:54:38.154747+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:23.115757+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":16434,"num_write":22,"num_write_kb":9264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"264'34","reported_seq":147,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:30.343089+0000","last_change":"2024-09-14T11:54:30.342924+0000","last_active":"2024-09-14T11:54:30.343089+0000","last_peered":"2024-09-14T11:54:30.343089+0000","last_clean":"2024-09-14T11:54:30.343089+0000","last_became_active":"2024-09-14T11:26:04.274720+0000","last_became_peered":"2024-09-14T11:26:04.274720+0000","last_unstale":"2024-09-14T11:54:30.343089+0000","last_undegraded":"2024-09-14T11:54:30.343089+0000","last_fullsized":"2024-09-14T11:54:30.343089+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'34","last_scrub_stamp":"2024-09-14T11:54:30.342736+0000","last_deep_scrub":"264'34","last_deep_scrub_stamp":"2024-09-14T11:54:30.342736+0000","last_clean_scrub_stamp":"2024-09-14T11:54:30.342736+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:59.676057+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":267,"num_read_kb":161,"num_write":92,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:55:09.719690+0000","last_change":"2024-09-14T11:55:09.719690+0000","last_active":"2024-09-14T11:55:09.719690+0000","last_peered":"2024-09-14T11:55:09.719690+0000","last_clean":"2024-09-14T11:55:09.719690+0000","last_became_active":"2024-09-14T11:38:50.575662+0000","last_became_peered":"2024-09-14T11:38:50.575662+0000","last_unstale":"2024-09-14T11:55:09.719690+0000","last_undegraded":"2024-09-14T11:55:09.719690+0000","last_fullsized":"2024-09-14T11:55:09.719690+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:55:09.719501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:55:09.719501+0000","last_clean_scrub_stamp":"2024-09-14T11:55:09.719501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:34.226033+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:55:02.610560+0000","last_change":"2024-09-14T11:55:02.610560+0000","last_active":"2024-09-14T11:55:02.610560+0000","last_peered":"2024-09-14T11:55:02.610560+0000","last_clean":"2024-09-14T11:55:02.610560+0000","last_became_active":"2024-09-14T11:27:41.652132+0000","last_became_peered":"2024-09-14T11:27:41.652132+0000","last_unstale":"2024-09-14T11:55:02.610560+0000","last_undegraded":"2024-09-14T11:55:02.610560+0000","last_fullsized":"2024-09-14T11:55:02.610560+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:55:02.610378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:55:02.610378+0000","last_clean_scrub_stamp":"2024-09-14T11:55:02.610378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:06.470649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"264'4","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:57.591929+0000","last_change":"2024-09-14T11:54:57.591929+0000","last_active":"2024-09-14T11:54:57.591929+0000","last_peered":"2024-09-14T11:54:57.591929+0000","last_clean":"2024-09-14T11:54:57.591929+0000","last_became_active":"2024-09-14T11:27:38.602099+0000","last_became_peered":"2024-09-14T11:27:38.602099+0000","last_unstale":"2024-09-14T11:54:57.591929+0000","last_undegraded":"2024-09-14T11:54:57.591929+0000","last_fullsized":"2024-09-14T11:54:57.591929+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T11:54:57.591743+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T11:54:57.591743+0000","last_clean_scrub_stamp":"2024-09-14T11:54:57.591743+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:44.881147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"264'30","reported_seq":134,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:31.449815+0000","last_change":"2024-09-14T11:54:31.449672+0000","last_active":"2024-09-14T11:54:31.449815+0000","last_peered":"2024-09-14T11:54:31.449815+0000","last_clean":"2024-09-14T11:54:31.449815+0000","last_became_active":"2024-09-14T11:26:04.265553+0000","last_became_peered":"2024-09-14T11:26:04.265553+0000","last_unstale":"2024-09-14T11:54:31.449815+0000","last_undegraded":"2024-09-14T11:54:31.449815+0000","last_fullsized":"2024-09-14T11:54:31.449815+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'30","last_scrub_stamp":"2024-09-14T11:54:31.449479+0000","last_deep_scrub":"264'30","last_deep_scrub_stamp":"2024-09-14T11:54:31.449479+0000","last_clean_scrub_stamp":"2024-09-14T11:54:31.449479+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:24.468419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":163,"num_write":75,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"264'2","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:50.630238+0000","last_change":"2024-09-14T11:54:50.630238+0000","last_active":"2024-09-14T11:54:50.630238+0000","last_peered":"2024-09-14T11:54:50.630238+0000","last_clean":"2024-09-14T11:54:50.630238+0000","last_became_active":"2024-09-14T11:38:50.583172+0000","last_became_peered":"2024-09-14T11:38:50.583172+0000","last_unstale":"2024-09-14T11:54:50.630238+0000","last_undegraded":"2024-09-14T11:54:50.630238+0000","last_fullsized":"2024-09-14T11:54:50.630238+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:50.630057+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:50.630057+0000","last_clean_scrub_stamp":"2024-09-14T11:54:50.630057+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:54.211506+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"264'3","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:46.223966+0000","last_change":"2024-09-14T11:54:46.223801+0000","last_active":"2024-09-14T11:54:46.223966+0000","last_peered":"2024-09-14T11:54:46.223966+0000","last_clean":"2024-09-14T11:54:46.223966+0000","last_became_active":"2024-09-14T11:27:41.645631+0000","last_became_peered":"2024-09-14T11:27:41.645631+0000","last_unstale":"2024-09-14T11:54:46.223966+0000","last_undegraded":"2024-09-14T11:54:46.223966+0000","last_fullsized":"2024-09-14T11:54:46.223966+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:54:46.223621+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:54:46.223621+0000","last_clean_scrub_stamp":"2024-09-14T11:54:46.223621+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:14.738671+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"261'6","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:32.281053+0000","last_change":"2024-09-14T11:54:32.281053+0000","last_active":"2024-09-14T11:54:32.281053+0000","last_peered":"2024-09-14T11:54:32.281053+0000","last_clean":"2024-09-14T11:54:32.281053+0000","last_became_active":"2024-09-14T11:27:38.597788+0000","last_became_peered":"2024-09-14T11:27:38.597788+0000","last_unstale":"2024-09-14T11:54:32.281053+0000","last_undegraded":"2024-09-14T11:54:32.281053+0000","last_fullsized":"2024-09-14T11:54:32.281053+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-09-14T11:54:32.280860+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-09-14T11:54:32.280860+0000","last_clean_scrub_stamp":"2024-09-14T11:54:32.280860+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:14.084801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4123,"num_write":6,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"264'31","reported_seq":131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:34.204141+0000","last_change":"2024-09-14T11:54:34.203858+0000","last_active":"2024-09-14T11:54:34.204141+0000","last_peered":"2024-09-14T11:54:34.204141+0000","last_clean":"2024-09-14T11:54:34.204141+0000","last_became_active":"2024-09-14T11:26:04.257219+0000","last_became_peered":"2024-09-14T11:26:04.257219+0000","last_unstale":"2024-09-14T11:54:34.204141+0000","last_undegraded":"2024-09-14T11:54:34.204141+0000","last_fullsized":"2024-09-14T11:54:34.204141+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'31","last_scrub_stamp":"2024-09-14T11:54:34.203639+0000","last_deep_scrub":"264'31","last_deep_scrub_stamp":"2024-09-14T11:54:34.203639+0000","last_clean_scrub_stamp":"2024-09-14T11:54:34.203639+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:33.680445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":127,"num_write":83,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.252119+0000","last_change":"2024-09-14T11:54:47.252119+0000","last_active":"2024-09-14T11:54:47.252119+0000","last_peered":"2024-09-14T11:54:47.252119+0000","last_clean":"2024-09-14T11:54:47.252119+0000","last_became_active":"2024-09-14T11:38:50.581128+0000","last_became_peered":"2024-09-14T11:38:50.581128+0000","last_unstale":"2024-09-14T11:54:47.252119+0000","last_undegraded":"2024-09-14T11:54:47.252119+0000","last_fullsized":"2024-09-14T11:54:47.252119+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:47.251950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:47.251950+0000","last_clean_scrub_stamp":"2024-09-14T11:54:47.251950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:51.824406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"264'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:55:01.637790+0000","last_change":"2024-09-14T11:55:01.637790+0000","last_active":"2024-09-14T11:55:01.637790+0000","last_peered":"2024-09-14T11:55:01.637790+0000","last_clean":"2024-09-14T11:55:01.637790+0000","last_became_active":"2024-09-14T11:27:41.652549+0000","last_became_peered":"2024-09-14T11:27:41.652549+0000","last_unstale":"2024-09-14T11:55:01.637790+0000","last_undegraded":"2024-09-14T11:55:01.637790+0000","last_fullsized":"2024-09-14T11:55:01.637790+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:55:01.637604+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:55:01.637604+0000","last_clean_scrub_stamp":"2024-09-14T11:55:01.637604+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:17.598048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"264'6","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.571106+0000","last_change":"2024-09-14T11:54:58.571106+0000","last_active":"2024-09-14T11:54:58.571106+0000","last_peered":"2024-09-14T11:54:58.571106+0000","last_clean":"2024-09-14T11:54:58.571106+0000","last_became_active":"2024-09-14T11:27:38.609483+0000","last_became_peered":"2024-09-14T11:27:38.609483+0000","last_unstale":"2024-09-14T11:54:58.571106+0000","last_undegraded":"2024-09-14T11:54:58.571106+0000","last_fullsized":"2024-09-14T11:54:58.571106+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-14T11:54:58.570917+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-14T11:54:58.570917+0000","last_clean_scrub_stamp":"2024-09-14T11:54:58.570917+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:18:55.493511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12292,"num_write":6,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"264'27","reported_seq":123,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:50.618056+0000","last_change":"2024-09-14T11:54:50.617847+0000","last_active":"2024-09-14T11:54:50.618056+0000","last_peered":"2024-09-14T11:54:50.618056+0000","last_clean":"2024-09-14T11:54:50.618056+0000","last_became_active":"2024-09-14T11:26:04.268338+0000","last_became_peered":"2024-09-14T11:26:04.268338+0000","last_unstale":"2024-09-14T11:54:50.618056+0000","last_undegraded":"2024-09-14T11:54:50.618056+0000","last_fullsized":"2024-09-14T11:54:50.618056+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'27","last_scrub_stamp":"2024-09-14T11:54:50.617661+0000","last_deep_scrub":"264'27","last_deep_scrub_stamp":"2024-09-14T11:54:50.617661+0000","last_clean_scrub_stamp":"2024-09-14T11:54:50.617661+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:07.967626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":125,"num_write":73,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:57.181216+0000","last_change":"2024-09-14T11:54:57.181216+0000","last_active":"2024-09-14T11:54:57.181216+0000","last_peered":"2024-09-14T11:54:57.181216+0000","last_clean":"2024-09-14T11:54:57.181216+0000","last_became_active":"2024-09-14T11:38:50.589588+0000","last_became_peered":"2024-09-14T11:38:50.589588+0000","last_unstale":"2024-09-14T11:54:57.181216+0000","last_undegraded":"2024-09-14T11:54:57.181216+0000","last_fullsized":"2024-09-14T11:54:57.181216+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:57.181029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:57.181029+0000","last_clean_scrub_stamp":"2024-09-14T11:54:57.181029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:17.545033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"264'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:40.102752+0000","last_change":"2024-09-14T11:54:40.102585+0000","last_active":"2024-09-14T11:54:40.102752+0000","last_peered":"2024-09-14T11:54:40.102752+0000","last_clean":"2024-09-14T11:54:40.102752+0000","last_became_active":"2024-09-14T11:27:41.642400+0000","last_became_peered":"2024-09-14T11:27:41.642400+0000","last_unstale":"2024-09-14T11:54:40.102752+0000","last_undegraded":"2024-09-14T11:54:40.102752+0000","last_fullsized":"2024-09-14T11:54:40.102752+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:40.102397+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:40.102397+0000","last_clean_scrub_stamp":"2024-09-14T11:54:40.102397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:43.831109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"261'5","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.690174+0000","last_change":"2024-09-14T11:54:38.689979+0000","last_active":"2024-09-14T11:54:38.690174+0000","last_peered":"2024-09-14T11:54:38.690174+0000","last_clean":"2024-09-14T11:54:38.690174+0000","last_became_active":"2024-09-14T11:27:38.587990+0000","last_became_peered":"2024-09-14T11:27:38.587990+0000","last_unstale":"2024-09-14T11:54:38.690174+0000","last_undegraded":"2024-09-14T11:54:38.690174+0000","last_fullsized":"2024-09-14T11:54:38.690174+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-14T11:54:38.689786+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-14T11:54:38.689786+0000","last_clean_scrub_stamp":"2024-09-14T11:54:38.689786+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:38.094890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"264'55","reported_seq":201,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:52.573854+0000","last_change":"2024-09-14T11:54:52.573688+0000","last_active":"2024-09-14T11:54:52.573854+0000","last_peered":"2024-09-14T11:54:52.573854+0000","last_clean":"2024-09-14T11:54:52.573854+0000","last_became_active":"2024-09-14T11:26:04.257926+0000","last_became_peered":"2024-09-14T11:26:04.257926+0000","last_unstale":"2024-09-14T11:54:52.573854+0000","last_undegraded":"2024-09-14T11:54:52.573854+0000","last_fullsized":"2024-09-14T11:54:52.573854+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'55","last_scrub_stamp":"2024-09-14T11:54:52.573501+0000","last_deep_scrub":"264'55","last_deep_scrub_stamp":"2024-09-14T11:54:52.573501+0000","last_clean_scrub_stamp":"2024-09-14T11:54:52.573501+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:18.073167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":423,"num_read_kb":280,"num_write":136,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.647582+0000","last_change":"2024-09-14T11:55:07.647582+0000","last_active":"2024-09-14T11:55:07.647582+0000","last_peered":"2024-09-14T11:55:07.647582+0000","last_clean":"2024-09-14T11:55:07.647582+0000","last_became_active":"2024-09-14T11:38:50.581923+0000","last_became_peered":"2024-09-14T11:38:50.581923+0000","last_unstale":"2024-09-14T11:55:07.647582+0000","last_undegraded":"2024-09-14T11:55:07.647582+0000","last_fullsized":"2024-09-14T11:55:07.647582+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:55:07.647398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:55:07.647398+0000","last_clean_scrub_stamp":"2024-09-14T11:55:07.647398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:43.176030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:37.158171+0000","last_change":"2024-09-14T11:54:37.158020+0000","last_active":"2024-09-14T11:54:37.158171+0000","last_peered":"2024-09-14T11:54:37.158171+0000","last_clean":"2024-09-14T11:54:37.158171+0000","last_became_active":"2024-09-14T11:27:41.634692+0000","last_became_peered":"2024-09-14T11:27:41.634692+0000","last_unstale":"2024-09-14T11:54:37.158171+0000","last_undegraded":"2024-09-14T11:54:37.158171+0000","last_fullsized":"2024-09-14T11:54:37.158171+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:37.157845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:37.157845+0000","last_clean_scrub_stamp":"2024-09-14T11:54:37.157845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:26.919415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"264'8","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:34.689968+0000","last_change":"2024-09-14T11:54:34.689836+0000","last_active":"2024-09-14T11:54:34.689968+0000","last_peered":"2024-09-14T11:54:34.689968+0000","last_clean":"2024-09-14T11:54:34.689968+0000","last_became_active":"2024-09-14T11:27:38.612443+0000","last_became_peered":"2024-09-14T11:27:38.612443+0000","last_unstale":"2024-09-14T11:54:34.689968+0000","last_undegraded":"2024-09-14T11:54:34.689968+0000","last_fullsized":"2024-09-14T11:54:34.689968+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-14T11:54:34.689645+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-14T11:54:34.689645+0000","last_clean_scrub_stamp":"2024-09-14T11:54:34.689645+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:54.340768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16386,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"264'61","reported_seq":217,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:29.342302+0000","last_change":"2024-09-14T11:54:29.342302+0000","last_active":"2024-09-14T11:54:29.342302+0000","last_peered":"2024-09-14T11:54:29.342302+0000","last_clean":"2024-09-14T11:54:29.342302+0000","last_became_active":"2024-09-14T11:26:04.263498+0000","last_became_peered":"2024-09-14T11:26:04.263498+0000","last_unstale":"2024-09-14T11:54:29.342302+0000","last_undegraded":"2024-09-14T11:54:29.342302+0000","last_fullsized":"2024-09-14T11:54:29.342302+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'61","last_scrub_stamp":"2024-09-14T11:54:29.342123+0000","last_deep_scrub":"264'61","last_deep_scrub_stamp":"2024-09-14T11:54:29.342123+0000","last_clean_scrub_stamp":"2024-09-14T11:54:29.342123+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:20.972202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":491,"num_read_kb":357,"num_write":145,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"264'200","reported_seq":928,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.744180+0000","last_change":"2024-09-14T11:54:09.744180+0000","last_active":"2024-09-14T11:54:09.744180+0000","last_peered":"2024-09-14T11:54:09.744180+0000","last_clean":"2024-09-14T11:54:09.744180+0000","last_became_active":"2024-09-14T11:09:45.212881+0000","last_became_peered":"2024-09-14T11:09:45.212881+0000","last_unstale":"2024-09-14T11:54:09.744180+0000","last_undegraded":"2024-09-14T11:54:09.744180+0000","last_fullsized":"2024-09-14T11:54:09.744180+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'200","last_scrub_stamp":"2024-09-14T11:54:09.743907+0000","last_deep_scrub":"264'200","last_deep_scrub_stamp":"2024-09-14T11:54:09.743907+0000","last_clean_scrub_stamp":"2024-09-14T11:54:09.743907+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:12.346884+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":928,"num_read_kb":39441,"num_write":967,"num_write_kb":29636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"264'510","reported_seq":2118,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.589827+0000","last_change":"2024-09-14T11:54:15.589663+0000","last_active":"2024-09-14T11:54:15.589827+0000","last_peered":"2024-09-14T11:54:15.589827+0000","last_clean":"2024-09-14T11:54:15.589827+0000","last_became_active":"2024-09-14T11:09:46.960069+0000","last_became_peered":"2024-09-14T11:09:46.960069+0000","last_unstale":"2024-09-14T11:54:15.589827+0000","last_undegraded":"2024-09-14T11:54:15.589827+0000","last_fullsized":"2024-09-14T11:54:15.589827+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'510","last_scrub_stamp":"2024-09-14T11:54:15.589488+0000","last_deep_scrub":"264'510","last_deep_scrub_stamp":"2024-09-14T11:54:15.589488+0000","last_clean_scrub_stamp":"2024-09-14T11:54:15.589488+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:03.452431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2624,"num_read_kb":2455,"num_write":621,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"264'213","reported_seq":869,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:16.081574+0000","last_change":"2024-09-14T11:54:16.081574+0000","last_active":"2024-09-14T11:54:16.081574+0000","last_peered":"2024-09-14T11:54:16.081574+0000","last_clean":"2024-09-14T11:54:16.081574+0000","last_became_active":"2024-09-14T11:09:45.211049+0000","last_became_peered":"2024-09-14T11:09:45.211049+0000","last_unstale":"2024-09-14T11:54:16.081574+0000","last_undegraded":"2024-09-14T11:54:16.081574+0000","last_fullsized":"2024-09-14T11:54:16.081574+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'213","last_scrub_stamp":"2024-09-14T11:54:16.081321+0000","last_deep_scrub":"264'213","last_deep_scrub_stamp":"2024-09-14T11:54:16.081321+0000","last_clean_scrub_stamp":"2024-09-14T11:54:16.081321+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:38.768993+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":540,"num_read_kb":70257,"num_write":1018,"num_write_kb":34950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"264'761","reported_seq":2296,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:25.917821+0000","last_change":"2024-09-14T11:54:25.917678+0000","last_active":"2024-09-14T11:54:25.917821+0000","last_peered":"2024-09-14T11:54:25.917821+0000","last_clean":"2024-09-14T11:54:25.917821+0000","last_became_active":"2024-09-14T11:09:46.957446+0000","last_became_peered":"2024-09-14T11:09:46.957446+0000","last_unstale":"2024-09-14T11:54:25.917821+0000","last_undegraded":"2024-09-14T11:54:25.917821+0000","last_fullsized":"2024-09-14T11:54:25.917821+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'761","last_scrub_stamp":"2024-09-14T11:54:25.917475+0000","last_deep_scrub":"264'761","last_deep_scrub_stamp":"2024-09-14T11:54:25.917475+0000","last_clean_scrub_stamp":"2024-09-14T11:54:25.917475+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:18:02.157703+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3644,"num_read_kb":3296,"num_write":998,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"264'185","reported_seq":815,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.081219+0000","last_change":"2024-09-14T11:54:15.081219+0000","last_active":"2024-09-14T11:54:15.081219+0000","last_peered":"2024-09-14T11:54:15.081219+0000","last_clean":"2024-09-14T11:54:15.081219+0000","last_became_active":"2024-09-14T11:09:45.207458+0000","last_became_peered":"2024-09-14T11:09:45.207458+0000","last_unstale":"2024-09-14T11:54:15.081219+0000","last_undegraded":"2024-09-14T11:54:15.081219+0000","last_fullsized":"2024-09-14T11:54:15.081219+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'185","last_scrub_stamp":"2024-09-14T11:54:15.080970+0000","last_deep_scrub":"264'185","last_deep_scrub_stamp":"2024-09-14T11:54:15.080970+0000","last_clean_scrub_stamp":"2024-09-14T11:54:15.080970+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:43.319269+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":12475,"num_write":826,"num_write_kb":33777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"264'375","reported_seq":1907,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.932105+0000","last_change":"2024-09-14T11:54:26.931959+0000","last_active":"2024-09-14T11:54:26.932105+0000","last_peered":"2024-09-14T11:54:26.932105+0000","last_clean":"2024-09-14T11:54:26.932105+0000","last_became_active":"2024-09-14T11:09:46.950652+0000","last_became_peered":"2024-09-14T11:09:46.950652+0000","last_unstale":"2024-09-14T11:54:26.932105+0000","last_undegraded":"2024-09-14T11:54:26.932105+0000","last_fullsized":"2024-09-14T11:54:26.932105+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'375","last_scrub_stamp":"2024-09-14T11:54:26.931723+0000","last_deep_scrub":"264'375","last_deep_scrub_stamp":"2024-09-14T11:54:26.931723+0000","last_clean_scrub_stamp":"2024-09-14T11:54:26.931723+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:44.924195+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2108,"num_read_kb":2030,"num_write":424,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"264'209","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:16.405568+0000","last_change":"2024-09-14T11:54:16.405568+0000","last_active":"2024-09-14T11:54:16.405568+0000","last_peered":"2024-09-14T11:54:16.405568+0000","last_clean":"2024-09-14T11:54:16.405568+0000","last_became_active":"2024-09-14T11:09:45.185702+0000","last_became_peered":"2024-09-14T11:09:45.185702+0000","last_unstale":"2024-09-14T11:54:16.405568+0000","last_undegraded":"2024-09-14T11:54:16.405568+0000","last_fullsized":"2024-09-14T11:54:16.405568+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'209","last_scrub_stamp":"2024-09-14T11:54:16.405308+0000","last_deep_scrub":"264'209","last_deep_scrub_stamp":"2024-09-14T11:54:16.405308+0000","last_clean_scrub_stamp":"2024-09-14T11:54:16.405308+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:37.330840+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":495,"num_read_kb":15356,"num_write":918,"num_write_kb":51388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"264'416","reported_seq":1981,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.753605+0000","last_change":"2024-09-14T11:54:18.753329+0000","last_active":"2024-09-14T11:54:18.753605+0000","last_peered":"2024-09-14T11:54:18.753605+0000","last_clean":"2024-09-14T11:54:18.753605+0000","last_became_active":"2024-09-14T11:09:46.952230+0000","last_became_peered":"2024-09-14T11:09:46.952230+0000","last_unstale":"2024-09-14T11:54:18.753605+0000","last_undegraded":"2024-09-14T11:54:18.753605+0000","last_fullsized":"2024-09-14T11:54:18.753605+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'416","last_scrub_stamp":"2024-09-14T11:54:18.753111+0000","last_deep_scrub":"264'416","last_deep_scrub_stamp":"2024-09-14T11:54:18.753111+0000","last_clean_scrub_stamp":"2024-09-14T11:54:18.753111+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:38.004375+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2399,"num_read_kb":2276,"num_write":503,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"264'177","reported_seq":755,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.268559+0000","last_change":"2024-09-14T11:54:08.268410+0000","last_active":"2024-09-14T11:54:08.268559+0000","last_peered":"2024-09-14T11:54:08.268559+0000","last_clean":"2024-09-14T11:54:08.268559+0000","last_became_active":"2024-09-14T11:10:22.254947+0000","last_became_peered":"2024-09-14T11:10:22.254947+0000","last_unstale":"2024-09-14T11:54:08.268559+0000","last_undegraded":"2024-09-14T11:54:08.268559+0000","last_fullsized":"2024-09-14T11:54:08.268559+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-09-14T11:54:08.268210+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-09-14T11:54:08.268210+0000","last_clean_scrub_stamp":"2024-09-14T11:54:08.268210+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:14.156723+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":441,"num_read_kb":20000,"num_write":788,"num_write_kb":32213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'368","reported_seq":1761,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.799314+0000","last_change":"2024-09-14T11:54:17.799314+0000","last_active":"2024-09-14T11:54:17.799314+0000","last_peered":"2024-09-14T11:54:17.799314+0000","last_clean":"2024-09-14T11:54:17.799314+0000","last_became_active":"2024-09-14T11:09:46.962586+0000","last_became_peered":"2024-09-14T11:09:46.962586+0000","last_unstale":"2024-09-14T11:54:17.799314+0000","last_undegraded":"2024-09-14T11:54:17.799314+0000","last_fullsized":"2024-09-14T11:54:17.799314+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'368","last_scrub_stamp":"2024-09-14T11:54:17.799119+0000","last_deep_scrub":"264'368","last_deep_scrub_stamp":"2024-09-14T11:54:17.799119+0000","last_clean_scrub_stamp":"2024-09-14T11:54:17.799119+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:30:09.942238+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1989,"num_read_kb":1876,"num_write":428,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"264'210","reported_seq":846,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.412881+0000","last_change":"2024-09-14T11:54:10.412736+0000","last_active":"2024-09-14T11:54:10.412881+0000","last_peered":"2024-09-14T11:54:10.412881+0000","last_clean":"2024-09-14T11:54:10.412881+0000","last_became_active":"2024-09-14T11:09:45.187149+0000","last_became_peered":"2024-09-14T11:09:45.187149+0000","last_unstale":"2024-09-14T11:54:10.412881+0000","last_undegraded":"2024-09-14T11:54:10.412881+0000","last_fullsized":"2024-09-14T11:54:10.412881+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'210","last_scrub_stamp":"2024-09-14T11:54:10.412544+0000","last_deep_scrub":"264'210","last_deep_scrub_stamp":"2024-09-14T11:54:10.412544+0000","last_clean_scrub_stamp":"2024-09-14T11:54:10.412544+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:47.711478+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":555,"num_read_kb":3965,"num_write":975,"num_write_kb":31222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"264'787","reported_seq":2330,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.801159+0000","last_change":"2024-09-14T11:54:14.801159+0000","last_active":"2024-09-14T11:54:14.801159+0000","last_peered":"2024-09-14T11:54:14.801159+0000","last_clean":"2024-09-14T11:54:14.801159+0000","last_became_active":"2024-09-14T11:09:46.990102+0000","last_became_peered":"2024-09-14T11:09:46.990102+0000","last_unstale":"2024-09-14T11:54:14.801159+0000","last_undegraded":"2024-09-14T11:54:14.801159+0000","last_fullsized":"2024-09-14T11:54:14.801159+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'787","last_scrub_stamp":"2024-09-14T11:54:14.800969+0000","last_deep_scrub":"264'787","last_deep_scrub_stamp":"2024-09-14T11:54:14.800969+0000","last_clean_scrub_stamp":"2024-09-14T11:54:14.800969+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:44.286981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3903,"num_read_kb":3531,"num_write":1063,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"264'334","reported_seq":1004,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.759940+0000","last_change":"2024-09-14T11:54:10.759698+0000","last_active":"2024-09-14T11:54:10.759940+0000","last_peered":"2024-09-14T11:54:10.759940+0000","last_clean":"2024-09-14T11:54:10.759940+0000","last_became_active":"2024-09-14T11:09:45.204885+0000","last_became_peered":"2024-09-14T11:09:45.204885+0000","last_unstale":"2024-09-14T11:54:10.759940+0000","last_undegraded":"2024-09-14T11:54:10.759940+0000","last_fullsized":"2024-09-14T11:54:10.759940+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'334","last_scrub_stamp":"2024-09-14T11:54:10.759384+0000","last_deep_scrub":"264'334","last_deep_scrub_stamp":"2024-09-14T11:54:10.759384+0000","last_clean_scrub_stamp":"2024-09-14T11:54:10.759384+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:40.347879+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":904,"num_read_kb":1363,"num_write":1218,"num_write_kb":28416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"264'787","reported_seq":2369,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:12.434039+0000","last_change":"2024-09-14T11:54:12.434039+0000","last_active":"2024-09-14T11:54:12.434039+0000","last_peered":"2024-09-14T11:54:12.434039+0000","last_clean":"2024-09-14T11:54:12.434039+0000","last_became_active":"2024-09-14T11:09:46.951098+0000","last_became_peered":"2024-09-14T11:09:46.951098+0000","last_unstale":"2024-09-14T11:54:12.434039+0000","last_undegraded":"2024-09-14T11:54:12.434039+0000","last_fullsized":"2024-09-14T11:54:12.434039+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'787","last_scrub_stamp":"2024-09-14T11:54:12.433859+0000","last_deep_scrub":"264'787","last_deep_scrub_stamp":"2024-09-14T11:54:12.433859+0000","last_clean_scrub_stamp":"2024-09-14T11:54:12.433859+0000","objects_scrubbed":3,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:51.937141+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3820,"num_read_kb":3459,"num_write":1035,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"264'223","reported_seq":861,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.106805+0000","last_change":"2024-09-14T11:54:14.106645+0000","last_active":"2024-09-14T11:54:14.106805+0000","last_peered":"2024-09-14T11:54:14.106805+0000","last_clean":"2024-09-14T11:54:14.106805+0000","last_became_active":"2024-09-14T11:09:45.207406+0000","last_became_peered":"2024-09-14T11:09:45.207406+0000","last_unstale":"2024-09-14T11:54:14.106805+0000","last_undegraded":"2024-09-14T11:54:14.106805+0000","last_fullsized":"2024-09-14T11:54:14.106805+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'223","last_scrub_stamp":"2024-09-14T11:54:14.106465+0000","last_deep_scrub":"264'223","last_deep_scrub_stamp":"2024-09-14T11:54:14.106465+0000","last_clean_scrub_stamp":"2024-09-14T11:54:14.106465+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:53.896261+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":519,"num_read_kb":35149,"num_write":962,"num_write_kb":45963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"264'416","reported_seq":1964,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:25.077318+0000","last_change":"2024-09-14T11:54:25.077318+0000","last_active":"2024-09-14T11:54:25.077318+0000","last_peered":"2024-09-14T11:54:25.077318+0000","last_clean":"2024-09-14T11:54:25.077318+0000","last_became_active":"2024-09-14T11:09:46.995237+0000","last_became_peered":"2024-09-14T11:09:46.995237+0000","last_unstale":"2024-09-14T11:54:25.077318+0000","last_undegraded":"2024-09-14T11:54:25.077318+0000","last_fullsized":"2024-09-14T11:54:25.077318+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'416","last_scrub_stamp":"2024-09-14T11:54:25.077145+0000","last_deep_scrub":"264'416","last_deep_scrub_stamp":"2024-09-14T11:54:25.077145+0000","last_clean_scrub_stamp":"2024-09-14T11:54:25.077145+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:26.584597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2305,"num_read_kb":2183,"num_write":489,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"264'598","reported_seq":2224,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.893793+0000","last_change":"2024-09-14T11:54:27.893793+0000","last_active":"2024-09-14T11:54:27.893793+0000","last_peered":"2024-09-14T11:54:27.893793+0000","last_clean":"2024-09-14T11:54:27.893793+0000","last_became_active":"2024-09-14T11:09:46.959477+0000","last_became_peered":"2024-09-14T11:09:46.959477+0000","last_unstale":"2024-09-14T11:54:27.893793+0000","last_undegraded":"2024-09-14T11:54:27.893793+0000","last_fullsized":"2024-09-14T11:54:27.893793+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'598","last_scrub_stamp":"2024-09-14T11:54:27.893571+0000","last_deep_scrub":"264'598","last_deep_scrub_stamp":"2024-09-14T11:54:27.893571+0000","last_clean_scrub_stamp":"2024-09-14T11:54:27.893571+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":500,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:23.191112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3034,"num_read_kb":2795,"num_write":758,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"264'221","reported_seq":858,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:03.641120+0000","last_change":"2024-09-14T11:54:03.641120+0000","last_active":"2024-09-14T11:54:03.641120+0000","last_peered":"2024-09-14T11:54:03.641120+0000","last_clean":"2024-09-14T11:54:03.641120+0000","last_became_active":"2024-09-14T11:09:45.204030+0000","last_became_peered":"2024-09-14T11:09:45.204030+0000","last_unstale":"2024-09-14T11:54:03.641120+0000","last_undegraded":"2024-09-14T11:54:03.641120+0000","last_fullsized":"2024-09-14T11:54:03.641120+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'221","last_scrub_stamp":"2024-09-14T11:54:03.641022+0000","last_deep_scrub":"264'221","last_deep_scrub_stamp":"2024-09-14T11:54:03.641022+0000","last_clean_scrub_stamp":"2024-09-14T11:54:03.641022+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:40.015512+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655875,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":529,"num_read_kb":23907,"num_write":1077,"num_write_kb":37253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"264'525","reported_seq":2144,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.763390+0000","last_change":"2024-09-14T11:54:13.763390+0000","last_active":"2024-09-14T11:54:13.763390+0000","last_peered":"2024-09-14T11:54:13.763390+0000","last_clean":"2024-09-14T11:54:13.763390+0000","last_became_active":"2024-09-14T11:09:46.970750+0000","last_became_peered":"2024-09-14T11:09:46.970750+0000","last_unstale":"2024-09-14T11:54:13.763390+0000","last_undegraded":"2024-09-14T11:54:13.763390+0000","last_fullsized":"2024-09-14T11:54:13.763390+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'525","last_scrub_stamp":"2024-09-14T11:54:13.763206+0000","last_deep_scrub":"264'525","last_deep_scrub_stamp":"2024-09-14T11:54:13.763206+0000","last_clean_scrub_stamp":"2024-09-14T11:54:13.763206+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:17.444401+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2805,"num_read_kb":2599,"num_write":647,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":501,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"264'221","reported_seq":867,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.776030+0000","last_change":"2024-09-14T11:54:11.776030+0000","last_active":"2024-09-14T11:54:11.776030+0000","last_peered":"2024-09-14T11:54:11.776030+0000","last_clean":"2024-09-14T11:54:11.776030+0000","last_became_active":"2024-09-14T11:09:45.206812+0000","last_became_peered":"2024-09-14T11:09:45.206812+0000","last_unstale":"2024-09-14T11:54:11.776030+0000","last_undegraded":"2024-09-14T11:54:11.776030+0000","last_fullsized":"2024-09-14T11:54:11.776030+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'221","last_scrub_stamp":"2024-09-14T11:54:11.775812+0000","last_deep_scrub":"264'221","last_deep_scrub_stamp":"2024-09-14T11:54:11.775812+0000","last_clean_scrub_stamp":"2024-09-14T11:54:11.775812+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:44.723127+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":566,"num_read_kb":32523,"num_write":996,"num_write_kb":41963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"264'854","reported_seq":2587,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:12.504366+0000","last_change":"2024-09-14T11:54:12.504111+0000","last_active":"2024-09-14T11:54:12.504366+0000","last_peered":"2024-09-14T11:54:12.504366+0000","last_clean":"2024-09-14T11:54:12.504366+0000","last_became_active":"2024-09-14T11:09:46.975135+0000","last_became_peered":"2024-09-14T11:09:46.975135+0000","last_unstale":"2024-09-14T11:54:12.504366+0000","last_undegraded":"2024-09-14T11:54:12.504366+0000","last_fullsized":"2024-09-14T11:54:12.504366+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'854","last_scrub_stamp":"2024-09-14T11:54:12.503845+0000","last_deep_scrub":"264'854","last_deep_scrub_stamp":"2024-09-14T11:54:12.503845+0000","last_clean_scrub_stamp":"2024-09-14T11:54:12.503845+0000","objects_scrubbed":4,"log_size":54,"log_dups_size":800,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:18.835875+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4353,"num_read_kb":3966,"num_write":1152,"num_write_kb":464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2705,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"264'182","reported_seq":790,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.665227+0000","last_change":"2024-09-14T11:54:07.665227+0000","last_active":"2024-09-14T11:54:07.665227+0000","last_peered":"2024-09-14T11:54:07.665227+0000","last_clean":"2024-09-14T11:54:07.665227+0000","last_became_active":"2024-09-14T11:09:45.208314+0000","last_became_peered":"2024-09-14T11:09:45.208314+0000","last_unstale":"2024-09-14T11:54:07.665227+0000","last_undegraded":"2024-09-14T11:54:07.665227+0000","last_fullsized":"2024-09-14T11:54:07.665227+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'182","last_scrub_stamp":"2024-09-14T11:54:07.665056+0000","last_deep_scrub":"264'182","last_deep_scrub_stamp":"2024-09-14T11:54:07.665056+0000","last_clean_scrub_stamp":"2024-09-14T11:54:07.665056+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:37.478334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":417,"num_read_kb":7778,"num_write":841,"num_write_kb":25761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"264'905","reported_seq":2671,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:16.634553+0000","last_change":"2024-09-14T11:54:16.634553+0000","last_active":"2024-09-14T11:54:16.634553+0000","last_peered":"2024-09-14T11:54:16.634553+0000","last_clean":"2024-09-14T11:54:16.634553+0000","last_became_active":"2024-09-14T11:09:46.995182+0000","last_became_peered":"2024-09-14T11:09:46.995182+0000","last_unstale":"2024-09-14T11:54:16.634553+0000","last_undegraded":"2024-09-14T11:54:16.634553+0000","last_fullsized":"2024-09-14T11:54:16.634553+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'905","last_scrub_stamp":"2024-09-14T11:54:16.634329+0000","last_deep_scrub":"264'905","last_deep_scrub_stamp":"2024-09-14T11:54:16.634329+0000","last_clean_scrub_stamp":"2024-09-14T11:54:16.634329+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":800,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:39.480551+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4411,"num_read_kb":3995,"num_write":1182,"num_write_kb":428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2289,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"264'216","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:03.748922+0000","last_change":"2024-09-14T11:54:03.748922+0000","last_active":"2024-09-14T11:54:03.748922+0000","last_peered":"2024-09-14T11:54:03.748922+0000","last_clean":"2024-09-14T11:54:03.748922+0000","last_became_active":"2024-09-14T11:09:45.215301+0000","last_became_peered":"2024-09-14T11:09:45.215301+0000","last_unstale":"2024-09-14T11:54:03.748922+0000","last_undegraded":"2024-09-14T11:54:03.748922+0000","last_fullsized":"2024-09-14T11:54:03.748922+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'216","last_scrub_stamp":"2024-09-14T11:54:03.748839+0000","last_deep_scrub":"264'216","last_deep_scrub_stamp":"2024-09-14T11:54:03.748839+0000","last_clean_scrub_stamp":"2024-09-14T11:54:03.748839+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:24.385373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":450,"num_read_kb":16973,"num_write":902,"num_write_kb":40194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"264'435","reported_seq":1986,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.069899+0000","last_change":"2024-09-14T11:54:24.069899+0000","last_active":"2024-09-14T11:54:24.069899+0000","last_peered":"2024-09-14T11:54:24.069899+0000","last_clean":"2024-09-14T11:54:24.069899+0000","last_became_active":"2024-09-14T11:09:46.974465+0000","last_became_peered":"2024-09-14T11:09:46.974465+0000","last_unstale":"2024-09-14T11:54:24.069899+0000","last_undegraded":"2024-09-14T11:54:24.069899+0000","last_fullsized":"2024-09-14T11:54:24.069899+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'435","last_scrub_stamp":"2024-09-14T11:54:24.069714+0000","last_deep_scrub":"264'435","last_deep_scrub_stamp":"2024-09-14T11:54:24.069714+0000","last_clean_scrub_stamp":"2024-09-14T11:54:24.069714+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:39.322778+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2378,"num_read_kb":2237,"num_write":500,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":695,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"264'228","reported_seq":897,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.669285+0000","last_change":"2024-09-14T11:54:07.669285+0000","last_active":"2024-09-14T11:54:07.669285+0000","last_peered":"2024-09-14T11:54:07.669285+0000","last_clean":"2024-09-14T11:54:07.669285+0000","last_became_active":"2024-09-14T11:09:45.210875+0000","last_became_peered":"2024-09-14T11:09:45.210875+0000","last_unstale":"2024-09-14T11:54:07.669285+0000","last_undegraded":"2024-09-14T11:54:07.669285+0000","last_fullsized":"2024-09-14T11:54:07.669285+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'228","last_scrub_stamp":"2024-09-14T11:54:07.669103+0000","last_deep_scrub":"264'228","last_deep_scrub_stamp":"2024-09-14T11:54:07.669103+0000","last_clean_scrub_stamp":"2024-09-14T11:54:07.669103+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:09.366495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":591,"num_read_kb":73875,"num_write":1091,"num_write_kb":38947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"264'417","reported_seq":1953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.522720+0000","last_change":"2024-09-14T11:54:13.522720+0000","last_active":"2024-09-14T11:54:13.522720+0000","last_peered":"2024-09-14T11:54:13.522720+0000","last_clean":"2024-09-14T11:54:13.522720+0000","last_became_active":"2024-09-14T11:09:46.958694+0000","last_became_peered":"2024-09-14T11:09:46.958694+0000","last_unstale":"2024-09-14T11:54:13.522720+0000","last_undegraded":"2024-09-14T11:54:13.522720+0000","last_fullsized":"2024-09-14T11:54:13.522720+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'417","last_scrub_stamp":"2024-09-14T11:54:13.522502+0000","last_deep_scrub":"264'417","last_deep_scrub_stamp":"2024-09-14T11:54:13.522502+0000","last_clean_scrub_stamp":"2024-09-14T11:54:13.522502+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:46.905027+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2265,"num_read_kb":2144,"num_write":479,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"264'199","reported_seq":832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.589028+0000","last_change":"2024-09-14T11:54:09.588770+0000","last_active":"2024-09-14T11:54:09.589028+0000","last_peered":"2024-09-14T11:54:09.589028+0000","last_clean":"2024-09-14T11:54:09.589028+0000","last_became_active":"2024-09-14T11:09:45.220968+0000","last_became_peered":"2024-09-14T11:09:45.220968+0000","last_unstale":"2024-09-14T11:54:09.589028+0000","last_undegraded":"2024-09-14T11:54:09.589028+0000","last_fullsized":"2024-09-14T11:54:09.589028+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'199","last_scrub_stamp":"2024-09-14T11:54:09.588498+0000","last_deep_scrub":"264'199","last_deep_scrub_stamp":"2024-09-14T11:54:09.588498+0000","last_clean_scrub_stamp":"2024-09-14T11:54:09.588498+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:12.229625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":534,"num_read_kb":44269,"num_write":1000,"num_write_kb":27179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"264'137","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:25.903195+0000","last_change":"2024-09-14T11:54:25.903195+0000","last_active":"2024-09-14T11:54:25.903195+0000","last_peered":"2024-09-14T11:54:25.903195+0000","last_clean":"2024-09-14T11:54:25.903195+0000","last_became_active":"2024-09-14T11:09:55.026753+0000","last_became_peered":"2024-09-14T11:09:55.026753+0000","last_unstale":"2024-09-14T11:54:25.903195+0000","last_undegraded":"2024-09-14T11:54:25.903195+0000","last_fullsized":"2024-09-14T11:54:25.903195+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'137","last_scrub_stamp":"2024-09-14T11:54:25.903005+0000","last_deep_scrub":"264'137","last_deep_scrub_stamp":"2024-09-14T11:54:25.903005+0000","last_clean_scrub_stamp":"2024-09-14T11:54:25.903005+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:06.554690+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":178,"num_read_kb":167,"num_write":319,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"264'372","reported_seq":1911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.554559+0000","last_change":"2024-09-14T11:54:14.554395+0000","last_active":"2024-09-14T11:54:14.554559+0000","last_peered":"2024-09-14T11:54:14.554559+0000","last_clean":"2024-09-14T11:54:14.554559+0000","last_became_active":"2024-09-14T11:09:46.985016+0000","last_became_peered":"2024-09-14T11:09:46.985016+0000","last_unstale":"2024-09-14T11:54:14.554559+0000","last_undegraded":"2024-09-14T11:54:14.554559+0000","last_fullsized":"2024-09-14T11:54:14.554559+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-09-14T11:54:14.554182+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-09-14T11:54:14.554182+0000","last_clean_scrub_stamp":"2024-09-14T11:54:14.554182+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:51.209068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2187,"num_read_kb":2090,"num_write":422,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"264'250","reported_seq":901,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.768228+0000","last_change":"2024-09-14T11:54:11.768228+0000","last_active":"2024-09-14T11:54:11.768228+0000","last_peered":"2024-09-14T11:54:11.768228+0000","last_clean":"2024-09-14T11:54:11.768228+0000","last_became_active":"2024-09-14T11:09:45.208756+0000","last_became_peered":"2024-09-14T11:09:45.208756+0000","last_unstale":"2024-09-14T11:54:11.768228+0000","last_undegraded":"2024-09-14T11:54:11.768228+0000","last_fullsized":"2024-09-14T11:54:11.768228+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'250","last_scrub_stamp":"2024-09-14T11:54:11.767918+0000","last_deep_scrub":"264'250","last_deep_scrub_stamp":"2024-09-14T11:54:11.767918+0000","last_clean_scrub_stamp":"2024-09-14T11:54:11.767918+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:36.187167+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":600,"num_read_kb":30329,"num_write":1164,"num_write_kb":41189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:31.805903+0000","last_change":"2024-09-14T11:54:31.805903+0000","last_active":"2024-09-14T11:54:31.805903+0000","last_peered":"2024-09-14T11:54:31.805903+0000","last_clean":"2024-09-14T11:54:31.805903+0000","last_became_active":"2024-09-14T11:09:48.969807+0000","last_became_peered":"2024-09-14T11:09:48.969807+0000","last_unstale":"2024-09-14T11:54:31.805903+0000","last_undegraded":"2024-09-14T11:54:31.805903+0000","last_fullsized":"2024-09-14T11:54:31.805903+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:31.805726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:31.805726+0000","last_clean_scrub_stamp":"2024-09-14T11:54:31.805726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:56.392475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"264'201","reported_seq":809,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:31.009609+0000","last_change":"2024-09-14T11:54:31.009609+0000","last_active":"2024-09-14T11:54:31.009609+0000","last_peered":"2024-09-14T11:54:31.009609+0000","last_clean":"2024-09-14T11:54:31.009609+0000","last_became_active":"2024-09-14T11:09:50.988903+0000","last_became_peered":"2024-09-14T11:09:50.988903+0000","last_unstale":"2024-09-14T11:54:31.009609+0000","last_undegraded":"2024-09-14T11:54:31.009609+0000","last_fullsized":"2024-09-14T11:54:31.009609+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'201","last_scrub_stamp":"2024-09-14T11:54:31.009421+0000","last_deep_scrub":"264'201","last_deep_scrub_stamp":"2024-09-14T11:54:31.009421+0000","last_clean_scrub_stamp":"2024-09-14T11:54:31.009421+0000","objects_scrubbed":5,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:43.933742+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12630,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":269,"num_read_kb":381,"num_write":162,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:25.538478+0000","last_change":"2024-09-14T11:54:25.538478+0000","last_active":"2024-09-14T11:54:25.538478+0000","last_peered":"2024-09-14T11:54:25.538478+0000","last_clean":"2024-09-14T11:54:25.538478+0000","last_became_active":"2024-09-14T11:09:53.010617+0000","last_became_peered":"2024-09-14T11:09:53.010617+0000","last_unstale":"2024-09-14T11:54:25.538478+0000","last_undegraded":"2024-09-14T11:54:25.538478+0000","last_fullsized":"2024-09-14T11:54:25.538478+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:25.538278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:25.538278+0000","last_clean_scrub_stamp":"2024-09-14T11:54:25.538278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:45.387138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"264'142","reported_seq":646,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:31.643444+0000","last_change":"2024-09-14T11:54:31.643444+0000","last_active":"2024-09-14T11:54:31.643444+0000","last_peered":"2024-09-14T11:54:31.643444+0000","last_clean":"2024-09-14T11:54:31.643444+0000","last_became_active":"2024-09-14T11:09:55.020070+0000","last_became_peered":"2024-09-14T11:09:55.020070+0000","last_unstale":"2024-09-14T11:54:31.643444+0000","last_undegraded":"2024-09-14T11:54:31.643444+0000","last_fullsized":"2024-09-14T11:54:31.643444+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'142","last_scrub_stamp":"2024-09-14T11:54:31.643193+0000","last_deep_scrub":"264'142","last_deep_scrub_stamp":"2024-09-14T11:54:31.643193+0000","last_clean_scrub_stamp":"2024-09-14T11:54:31.643193+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:27.421218+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":142,"num_write":346,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"264'930","reported_seq":2720,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.921565+0000","last_change":"2024-09-14T11:54:24.921565+0000","last_active":"2024-09-14T11:54:24.921565+0000","last_peered":"2024-09-14T11:54:24.921565+0000","last_clean":"2024-09-14T11:54:24.921565+0000","last_became_active":"2024-09-14T11:09:46.957383+0000","last_became_peered":"2024-09-14T11:09:46.957383+0000","last_unstale":"2024-09-14T11:54:24.921565+0000","last_undegraded":"2024-09-14T11:54:24.921565+0000","last_fullsized":"2024-09-14T11:54:24.921565+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'930","last_scrub_stamp":"2024-09-14T11:54:24.921482+0000","last_deep_scrub":"264'930","last_deep_scrub_stamp":"2024-09-14T11:54:24.921482+0000","last_clean_scrub_stamp":"2024-09-14T11:54:24.921482+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":900,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:12.803564+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4732,"num_read_kb":4281,"num_write":1231,"num_write_kb":469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2680,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"264'210","reported_seq":866,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.580780+0000","last_change":"2024-09-14T11:54:10.580780+0000","last_active":"2024-09-14T11:54:10.580780+0000","last_peered":"2024-09-14T11:54:10.580780+0000","last_clean":"2024-09-14T11:54:10.580780+0000","last_became_active":"2024-09-14T11:09:45.220059+0000","last_became_peered":"2024-09-14T11:09:45.220059+0000","last_unstale":"2024-09-14T11:54:10.580780+0000","last_undegraded":"2024-09-14T11:54:10.580780+0000","last_fullsized":"2024-09-14T11:54:10.580780+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'210","last_scrub_stamp":"2024-09-14T11:54:10.580574+0000","last_deep_scrub":"264'210","last_deep_scrub_stamp":"2024-09-14T11:54:10.580574+0000","last_clean_scrub_stamp":"2024-09-14T11:54:10.580574+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:31.836630+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":639,"num_read_kb":15720,"num_write":940,"num_write_kb":28935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:21.798898+0000","last_change":"2024-09-14T11:54:21.798898+0000","last_active":"2024-09-14T11:54:21.798898+0000","last_peered":"2024-09-14T11:54:21.798898+0000","last_clean":"2024-09-14T11:54:21.798898+0000","last_became_active":"2024-09-14T11:09:48.950055+0000","last_became_peered":"2024-09-14T11:09:48.950055+0000","last_unstale":"2024-09-14T11:54:21.798898+0000","last_undegraded":"2024-09-14T11:54:21.798898+0000","last_fullsized":"2024-09-14T11:54:21.798898+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:21.798715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:21.798715+0000","last_clean_scrub_stamp":"2024-09-14T11:54:21.798715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:05.334882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"264'87","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.663075+0000","last_change":"2024-09-14T11:54:20.663075+0000","last_active":"2024-09-14T11:54:20.663075+0000","last_peered":"2024-09-14T11:54:20.663075+0000","last_clean":"2024-09-14T11:54:20.663075+0000","last_became_active":"2024-09-14T11:09:50.989174+0000","last_became_peered":"2024-09-14T11:09:50.989174+0000","last_unstale":"2024-09-14T11:54:20.663075+0000","last_undegraded":"2024-09-14T11:54:20.663075+0000","last_fullsized":"2024-09-14T11:54:20.663075+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'87","last_scrub_stamp":"2024-09-14T11:54:20.662891+0000","last_deep_scrub":"264'87","last_deep_scrub_stamp":"2024-09-14T11:54:20.662891+0000","last_clean_scrub_stamp":"2024-09-14T11:54:20.662891+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:41.721701+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":97,"num_read_kb":91,"num_write":68,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.580218+0000","last_change":"2024-09-14T11:54:28.580218+0000","last_active":"2024-09-14T11:54:28.580218+0000","last_peered":"2024-09-14T11:54:28.580218+0000","last_clean":"2024-09-14T11:54:28.580218+0000","last_became_active":"2024-09-14T11:09:53.018290+0000","last_became_peered":"2024-09-14T11:09:53.018290+0000","last_unstale":"2024-09-14T11:54:28.580218+0000","last_undegraded":"2024-09-14T11:54:28.580218+0000","last_fullsized":"2024-09-14T11:54:28.580218+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:28.580020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:28.580020+0000","last_clean_scrub_stamp":"2024-09-14T11:54:28.580020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:50:13.166036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"264'97","reported_seq":601,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:30.601328+0000","last_change":"2024-09-14T11:54:30.601180+0000","last_active":"2024-09-14T11:54:30.601328+0000","last_peered":"2024-09-14T11:54:30.601328+0000","last_clean":"2024-09-14T11:54:30.601328+0000","last_became_active":"2024-09-14T11:09:55.018855+0000","last_became_peered":"2024-09-14T11:09:55.018855+0000","last_unstale":"2024-09-14T11:54:30.601328+0000","last_undegraded":"2024-09-14T11:54:30.601328+0000","last_fullsized":"2024-09-14T11:54:30.601328+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'97","last_scrub_stamp":"2024-09-14T11:54:30.600983+0000","last_deep_scrub":"264'97","last_deep_scrub_stamp":"2024-09-14T11:54:30.600983+0000","last_clean_scrub_stamp":"2024-09-14T11:54:30.600983+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:09.359758+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":100,"num_read_kb":99,"num_write":210,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"264'509","reported_seq":2261,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:21.075552+0000","last_change":"2024-09-14T11:54:21.075552+0000","last_active":"2024-09-14T11:54:21.075552+0000","last_peered":"2024-09-14T11:54:21.075552+0000","last_clean":"2024-09-14T11:54:21.075552+0000","last_became_active":"2024-09-14T11:09:46.975175+0000","last_became_peered":"2024-09-14T11:09:46.975175+0000","last_unstale":"2024-09-14T11:54:21.075552+0000","last_undegraded":"2024-09-14T11:54:21.075552+0000","last_fullsized":"2024-09-14T11:54:21.075552+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'509","last_scrub_stamp":"2024-09-14T11:54:21.075332+0000","last_deep_scrub":"264'509","last_deep_scrub_stamp":"2024-09-14T11:54:21.075332+0000","last_clean_scrub_stamp":"2024-09-14T11:54:21.075332+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:30:29.486556+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2885,"num_read_kb":2717,"num_write":615,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2551,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"264'240","reported_seq":865,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.759266+0000","last_change":"2024-09-14T11:54:10.759266+0000","last_active":"2024-09-14T11:54:10.759266+0000","last_peered":"2024-09-14T11:54:10.759266+0000","last_clean":"2024-09-14T11:54:10.759266+0000","last_became_active":"2024-09-14T11:09:45.205019+0000","last_became_peered":"2024-09-14T11:09:45.205019+0000","last_unstale":"2024-09-14T11:54:10.759266+0000","last_undegraded":"2024-09-14T11:54:10.759266+0000","last_fullsized":"2024-09-14T11:54:10.759266+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'240","last_scrub_stamp":"2024-09-14T11:54:10.759003+0000","last_deep_scrub":"264'240","last_deep_scrub_stamp":"2024-09-14T11:54:10.759003+0000","last_clean_scrub_stamp":"2024-09-14T11:54:10.759003+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:54.898617+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":563,"num_read_kb":1571,"num_write":1129,"num_write_kb":22204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.843171+0000","last_change":"2024-09-14T11:54:22.843171+0000","last_active":"2024-09-14T11:54:22.843171+0000","last_peered":"2024-09-14T11:54:22.843171+0000","last_clean":"2024-09-14T11:54:22.843171+0000","last_became_active":"2024-09-14T11:09:48.950260+0000","last_became_peered":"2024-09-14T11:09:48.950260+0000","last_unstale":"2024-09-14T11:54:22.843171+0000","last_undegraded":"2024-09-14T11:54:22.843171+0000","last_fullsized":"2024-09-14T11:54:22.843171+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:22.842969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:22.842969+0000","last_clean_scrub_stamp":"2024-09-14T11:54:22.842969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:18.066946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"264'112","reported_seq":653,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.935779+0000","last_change":"2024-09-14T11:54:28.935779+0000","last_active":"2024-09-14T11:54:28.935779+0000","last_peered":"2024-09-14T11:54:28.935779+0000","last_clean":"2024-09-14T11:54:28.935779+0000","last_became_active":"2024-09-14T11:09:50.977685+0000","last_became_peered":"2024-09-14T11:09:50.977685+0000","last_unstale":"2024-09-14T11:54:28.935779+0000","last_undegraded":"2024-09-14T11:54:28.935779+0000","last_fullsized":"2024-09-14T11:54:28.935779+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'112","last_scrub_stamp":"2024-09-14T11:54:28.935608+0000","last_deep_scrub":"264'112","last_deep_scrub_stamp":"2024-09-14T11:54:28.935608+0000","last_clean_scrub_stamp":"2024-09-14T11:54:28.935608+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:22.551848+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"264'790","reported_seq":2377,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:44.718355+0000","last_change":"2024-09-14T11:54:44.718355+0000","last_active":"2024-09-14T11:54:44.718355+0000","last_peered":"2024-09-14T11:54:44.718355+0000","last_clean":"2024-09-14T11:54:44.718355+0000","last_became_active":"2024-09-14T11:09:53.021212+0000","last_became_peered":"2024-09-14T11:09:53.021212+0000","last_unstale":"2024-09-14T11:54:44.718355+0000","last_undegraded":"2024-09-14T11:54:44.718355+0000","last_fullsized":"2024-09-14T11:54:44.718355+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'790","last_scrub_stamp":"2024-09-14T11:54:44.718156+0000","last_deep_scrub":"264'790","last_deep_scrub_stamp":"2024-09-14T11:54:44.718156+0000","last_clean_scrub_stamp":"2024-09-14T11:54:44.718156+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:05.765569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"264'225","reported_seq":1069,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:31.300882+0000","last_change":"2024-09-14T11:54:31.300319+0000","last_active":"2024-09-14T11:54:31.300882+0000","last_peered":"2024-09-14T11:54:31.300882+0000","last_clean":"2024-09-14T11:54:31.300882+0000","last_became_active":"2024-09-14T11:09:55.013994+0000","last_became_peered":"2024-09-14T11:09:55.013994+0000","last_unstale":"2024-09-14T11:54:31.300882+0000","last_undegraded":"2024-09-14T11:54:31.300882+0000","last_fullsized":"2024-09-14T11:54:31.300882+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'225","last_scrub_stamp":"2024-09-14T11:54:31.300089+0000","last_deep_scrub":"264'225","last_deep_scrub_stamp":"2024-09-14T11:54:31.300089+0000","last_clean_scrub_stamp":"2024-09-14T11:54:31.300089+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:50.141514+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":446,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":657,"num_read_kb":640,"num_write":481,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"264'1913","reported_seq":3557,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.077459+0000","last_change":"2024-09-14T11:54:19.077459+0000","last_active":"2024-09-14T11:54:19.077459+0000","last_peered":"2024-09-14T11:54:19.077459+0000","last_clean":"2024-09-14T11:54:19.077459+0000","last_became_active":"2024-09-14T11:09:46.994623+0000","last_became_peered":"2024-09-14T11:09:46.994623+0000","last_unstale":"2024-09-14T11:54:19.077459+0000","last_undegraded":"2024-09-14T11:54:19.077459+0000","last_fullsized":"2024-09-14T11:54:19.077459+0000","mapping_epoch":25,"log_start":"264'1900","ondisk_log_start":"264'1900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1913","last_scrub_stamp":"2024-09-14T11:54:19.077195+0000","last_deep_scrub":"264'1913","last_deep_scrub_stamp":"2024-09-14T11:54:19.077195+0000","last_clean_scrub_stamp":"2024-09-14T11:54:19.077195+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":1900,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:38.527036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8495,"num_read_kb":7411,"num_write":2703,"num_write_kb":1197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"264'221","reported_seq":859,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.632086+0000","last_change":"2024-09-14T11:54:06.631924+0000","last_active":"2024-09-14T11:54:06.632086+0000","last_peered":"2024-09-14T11:54:06.632086+0000","last_clean":"2024-09-14T11:54:06.632086+0000","last_became_active":"2024-09-14T11:09:45.208282+0000","last_became_peered":"2024-09-14T11:09:45.208282+0000","last_unstale":"2024-09-14T11:54:06.632086+0000","last_undegraded":"2024-09-14T11:54:06.632086+0000","last_fullsized":"2024-09-14T11:54:06.632086+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'221","last_scrub_stamp":"2024-09-14T11:54:06.631656+0000","last_deep_scrub":"264'221","last_deep_scrub_stamp":"2024-09-14T11:54:06.631656+0000","last_clean_scrub_stamp":"2024-09-14T11:54:06.631656+0000","objects_scrubbed":8,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:03.012784+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5850204,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":521,"num_read_kb":14610,"num_write":976,"num_write_kb":27594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:34.741772+0000","last_change":"2024-09-14T11:54:34.741772+0000","last_active":"2024-09-14T11:54:34.741772+0000","last_peered":"2024-09-14T11:54:34.741772+0000","last_clean":"2024-09-14T11:54:34.741772+0000","last_became_active":"2024-09-14T11:09:48.959355+0000","last_became_peered":"2024-09-14T11:09:48.959355+0000","last_unstale":"2024-09-14T11:54:34.741772+0000","last_undegraded":"2024-09-14T11:54:34.741772+0000","last_fullsized":"2024-09-14T11:54:34.741772+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:34.741596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:34.741596+0000","last_clean_scrub_stamp":"2024-09-14T11:54:34.741596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:27.337576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"264'124","reported_seq":701,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.337531+0000","last_change":"2024-09-14T11:54:22.337531+0000","last_active":"2024-09-14T11:54:22.337531+0000","last_peered":"2024-09-14T11:54:22.337531+0000","last_clean":"2024-09-14T11:54:22.337531+0000","last_became_active":"2024-09-14T11:09:50.984035+0000","last_became_peered":"2024-09-14T11:09:50.984035+0000","last_unstale":"2024-09-14T11:54:22.337531+0000","last_undegraded":"2024-09-14T11:54:22.337531+0000","last_fullsized":"2024-09-14T11:54:22.337531+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-09-14T11:54:22.337342+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-09-14T11:54:22.337342+0000","last_clean_scrub_stamp":"2024-09-14T11:54:22.337342+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:46.850427+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":160,"num_read_kb":234,"num_write":82,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"264'803","reported_seq":2141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:34.063279+0000","last_change":"2024-09-14T11:54:34.063279+0000","last_active":"2024-09-14T11:54:34.063279+0000","last_peered":"2024-09-14T11:54:34.063279+0000","last_clean":"2024-09-14T11:54:34.063279+0000","last_became_active":"2024-09-14T11:09:53.004265+0000","last_became_peered":"2024-09-14T11:09:53.004265+0000","last_unstale":"2024-09-14T11:54:34.063279+0000","last_undegraded":"2024-09-14T11:54:34.063279+0000","last_fullsized":"2024-09-14T11:54:34.063279+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'803","last_scrub_stamp":"2024-09-14T11:54:34.063096+0000","last_deep_scrub":"264'803","last_deep_scrub_stamp":"2024-09-14T11:54:34.063096+0000","last_clean_scrub_stamp":"2024-09-14T11:54:34.063096+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:05.814740+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"264'523","reported_seq":2241,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.909644+0000","last_change":"2024-09-14T11:54:20.909509+0000","last_active":"2024-09-14T11:54:20.909644+0000","last_peered":"2024-09-14T11:54:20.909644+0000","last_clean":"2024-09-14T11:54:20.909644+0000","last_became_active":"2024-09-14T11:09:46.962838+0000","last_became_peered":"2024-09-14T11:09:46.962838+0000","last_unstale":"2024-09-14T11:54:20.909644+0000","last_undegraded":"2024-09-14T11:54:20.909644+0000","last_fullsized":"2024-09-14T11:54:20.909644+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'523","last_scrub_stamp":"2024-09-14T11:54:20.909319+0000","last_deep_scrub":"264'523","last_deep_scrub_stamp":"2024-09-14T11:54:20.909319+0000","last_clean_scrub_stamp":"2024-09-14T11:54:20.909319+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":500,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:08.391964+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2791,"num_read_kb":2616,"num_write":587,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"264'281","reported_seq":952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.716583+0000","last_change":"2024-09-14T11:54:04.716443+0000","last_active":"2024-09-14T11:54:04.716583+0000","last_peered":"2024-09-14T11:54:04.716583+0000","last_clean":"2024-09-14T11:54:04.716583+0000","last_became_active":"2024-09-14T11:09:45.219674+0000","last_became_peered":"2024-09-14T11:09:45.219674+0000","last_unstale":"2024-09-14T11:54:04.716583+0000","last_undegraded":"2024-09-14T11:54:04.716583+0000","last_fullsized":"2024-09-14T11:54:04.716583+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'281","last_scrub_stamp":"2024-09-14T11:54:04.716246+0000","last_deep_scrub":"264'281","last_deep_scrub_stamp":"2024-09-14T11:54:04.716246+0000","last_clean_scrub_stamp":"2024-09-14T11:54:04.716246+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:35:04.002963+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":701,"num_read_kb":41266,"num_write":1220,"num_write_kb":49932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.565627+0000","last_change":"2024-09-14T11:54:14.565431+0000","last_active":"2024-09-14T11:54:14.565627+0000","last_peered":"2024-09-14T11:54:14.565627+0000","last_clean":"2024-09-14T11:54:14.565627+0000","last_became_active":"2024-09-14T11:09:48.958254+0000","last_became_peered":"2024-09-14T11:09:48.958254+0000","last_unstale":"2024-09-14T11:54:14.565627+0000","last_undegraded":"2024-09-14T11:54:14.565627+0000","last_fullsized":"2024-09-14T11:54:14.565627+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:14.565263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:14.565263+0000","last_clean_scrub_stamp":"2024-09-14T11:54:14.565263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:53.252174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"264'200","reported_seq":812,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:23.925778+0000","last_change":"2024-09-14T11:54:23.925778+0000","last_active":"2024-09-14T11:54:23.925778+0000","last_peered":"2024-09-14T11:54:23.925778+0000","last_clean":"2024-09-14T11:54:23.925778+0000","last_became_active":"2024-09-14T11:09:50.992673+0000","last_became_peered":"2024-09-14T11:09:50.992673+0000","last_unstale":"2024-09-14T11:54:23.925778+0000","last_undegraded":"2024-09-14T11:54:23.925778+0000","last_fullsized":"2024-09-14T11:54:23.925778+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'200","last_scrub_stamp":"2024-09-14T11:54:23.925583+0000","last_deep_scrub":"264'200","last_deep_scrub_stamp":"2024-09-14T11:54:23.925583+0000","last_clean_scrub_stamp":"2024-09-14T11:54:23.925583+0000","objects_scrubbed":9,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:04.720524+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11263,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":273,"num_read_kb":325,"num_write":154,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.601458+0000","last_change":"2024-09-14T11:54:28.601326+0000","last_active":"2024-09-14T11:54:28.601458+0000","last_peered":"2024-09-14T11:54:28.601458+0000","last_clean":"2024-09-14T11:54:28.601458+0000","last_became_active":"2024-09-14T11:09:53.007694+0000","last_became_peered":"2024-09-14T11:09:53.007694+0000","last_unstale":"2024-09-14T11:54:28.601458+0000","last_undegraded":"2024-09-14T11:54:28.601458+0000","last_fullsized":"2024-09-14T11:54:28.601458+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:28.601148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:28.601148+0000","last_clean_scrub_stamp":"2024-09-14T11:54:28.601148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:31.854054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"264'569","reported_seq":1411,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:25.318804+0000","last_change":"2024-09-14T11:54:25.318804+0000","last_active":"2024-09-14T11:54:25.318804+0000","last_peered":"2024-09-14T11:54:25.318804+0000","last_clean":"2024-09-14T11:54:25.318804+0000","last_became_active":"2024-09-14T11:09:55.030659+0000","last_became_peered":"2024-09-14T11:09:55.030659+0000","last_unstale":"2024-09-14T11:54:25.318804+0000","last_undegraded":"2024-09-14T11:54:25.318804+0000","last_fullsized":"2024-09-14T11:54:25.318804+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'569","last_scrub_stamp":"2024-09-14T11:54:25.318519+0000","last_deep_scrub":"264'569","last_deep_scrub_stamp":"2024-09-14T11:54:25.318519+0000","last_clean_scrub_stamp":"2024-09-14T11:54:25.318519+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":500,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:14.986669+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1371,"num_read_kb":1346,"num_write":1205,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"264'1072","reported_seq":2651,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.618042+0000","last_change":"2024-09-14T11:54:08.617875+0000","last_active":"2024-09-14T11:54:08.618042+0000","last_peered":"2024-09-14T11:54:08.618042+0000","last_clean":"2024-09-14T11:54:08.618042+0000","last_became_active":"2024-09-14T11:09:46.990046+0000","last_became_peered":"2024-09-14T11:09:46.990046+0000","last_unstale":"2024-09-14T11:54:08.618042+0000","last_undegraded":"2024-09-14T11:54:08.618042+0000","last_fullsized":"2024-09-14T11:54:08.618042+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1072","last_scrub_stamp":"2024-09-14T11:54:08.617699+0000","last_deep_scrub":"264'1072","last_deep_scrub_stamp":"2024-09-14T11:54:08.617699+0000","last_clean_scrub_stamp":"2024-09-14T11:54:08.617699+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":1000,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:02.219078+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5673,"num_read_kb":5118,"num_write":1579,"num_write_kb":694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"264'267","reported_seq":973,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:03.349328+0000","last_change":"2024-09-14T11:54:03.349250+0000","last_active":"2024-09-14T11:54:03.349328+0000","last_peered":"2024-09-14T11:54:03.349328+0000","last_clean":"2024-09-14T11:54:03.349328+0000","last_became_active":"2024-09-14T11:09:45.210020+0000","last_became_peered":"2024-09-14T11:09:45.210020+0000","last_unstale":"2024-09-14T11:54:03.349328+0000","last_undegraded":"2024-09-14T11:54:03.349328+0000","last_fullsized":"2024-09-14T11:54:03.349328+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'267","last_scrub_stamp":"2024-09-14T11:54:03.349170+0000","last_deep_scrub":"264'267","last_deep_scrub_stamp":"2024-09-14T11:54:03.349170+0000","last_clean_scrub_stamp":"2024-09-14T11:54:03.349170+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:32.965016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":888,"num_read_kb":725,"num_write":1131,"num_write_kb":36716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.609326+0000","last_change":"2024-09-14T11:54:17.609158+0000","last_active":"2024-09-14T11:54:17.609326+0000","last_peered":"2024-09-14T11:54:17.609326+0000","last_clean":"2024-09-14T11:54:17.609326+0000","last_became_active":"2024-09-14T11:09:48.973945+0000","last_became_peered":"2024-09-14T11:09:48.973945+0000","last_unstale":"2024-09-14T11:54:17.609326+0000","last_undegraded":"2024-09-14T11:54:17.609326+0000","last_fullsized":"2024-09-14T11:54:17.609326+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:17.608988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:17.608988+0000","last_clean_scrub_stamp":"2024-09-14T11:54:17.608988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:32.743186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"264'146","reported_seq":722,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.897457+0000","last_change":"2024-09-14T11:54:26.897298+0000","last_active":"2024-09-14T11:54:26.897457+0000","last_peered":"2024-09-14T11:54:26.897457+0000","last_clean":"2024-09-14T11:54:26.897457+0000","last_became_active":"2024-09-14T11:09:50.985800+0000","last_became_peered":"2024-09-14T11:09:50.985800+0000","last_unstale":"2024-09-14T11:54:26.897457+0000","last_undegraded":"2024-09-14T11:54:26.897457+0000","last_fullsized":"2024-09-14T11:54:26.897457+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'146","last_scrub_stamp":"2024-09-14T11:54:26.897102+0000","last_deep_scrub":"264'146","last_deep_scrub_stamp":"2024-09-14T11:54:26.897102+0000","last_clean_scrub_stamp":"2024-09-14T11:54:26.897102+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:12.702052+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14744,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":268,"num_write":96,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:34.950458+0000","last_change":"2024-09-14T11:54:34.950458+0000","last_active":"2024-09-14T11:54:34.950458+0000","last_peered":"2024-09-14T11:54:34.950458+0000","last_clean":"2024-09-14T11:54:34.950458+0000","last_became_active":"2024-09-14T11:09:53.002739+0000","last_became_peered":"2024-09-14T11:09:53.002739+0000","last_unstale":"2024-09-14T11:54:34.950458+0000","last_undegraded":"2024-09-14T11:54:34.950458+0000","last_fullsized":"2024-09-14T11:54:34.950458+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:34.950258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:34.950258+0000","last_clean_scrub_stamp":"2024-09-14T11:54:34.950258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:49.224667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"264'2504","reported_seq":4379,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:30.610057+0000","last_change":"2024-09-14T11:54:30.610057+0000","last_active":"2024-09-14T11:54:30.610057+0000","last_peered":"2024-09-14T11:54:30.610057+0000","last_clean":"2024-09-14T11:54:30.610057+0000","last_became_active":"2024-09-14T11:09:55.017307+0000","last_became_peered":"2024-09-14T11:09:55.017307+0000","last_unstale":"2024-09-14T11:54:30.610057+0000","last_undegraded":"2024-09-14T11:54:30.610057+0000","last_fullsized":"2024-09-14T11:54:30.610057+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2504","last_scrub_stamp":"2024-09-14T11:54:30.609835+0000","last_deep_scrub":"264'2504","last_deep_scrub_stamp":"2024-09-14T11:54:30.609835+0000","last_clean_scrub_stamp":"2024-09-14T11:54:30.609835+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":2400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:45:31.699682+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6356,"num_read_kb":6314,"num_write":5042,"num_write_kb":1853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"264'347","reported_seq":1764,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.365181+0000","last_change":"2024-09-14T11:54:08.365181+0000","last_active":"2024-09-14T11:54:08.365181+0000","last_peered":"2024-09-14T11:54:08.365181+0000","last_clean":"2024-09-14T11:54:08.365181+0000","last_became_active":"2024-09-14T11:09:46.952951+0000","last_became_peered":"2024-09-14T11:09:46.952951+0000","last_unstale":"2024-09-14T11:54:08.365181+0000","last_undegraded":"2024-09-14T11:54:08.365181+0000","last_fullsized":"2024-09-14T11:54:08.365181+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'347","last_scrub_stamp":"2024-09-14T11:54:08.364954+0000","last_deep_scrub":"264'347","last_deep_scrub_stamp":"2024-09-14T11:54:08.364954+0000","last_clean_scrub_stamp":"2024-09-14T11:54:08.364954+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:07.453326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1860,"num_read_kb":1783,"num_write":380,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"264'226","reported_seq":871,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.749608+0000","last_change":"2024-09-14T11:54:09.749433+0000","last_active":"2024-09-14T11:54:09.749608+0000","last_peered":"2024-09-14T11:54:09.749608+0000","last_clean":"2024-09-14T11:54:09.749608+0000","last_became_active":"2024-09-14T11:09:45.211217+0000","last_became_peered":"2024-09-14T11:09:45.211217+0000","last_unstale":"2024-09-14T11:54:09.749608+0000","last_undegraded":"2024-09-14T11:54:09.749608+0000","last_fullsized":"2024-09-14T11:54:09.749608+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'226","last_scrub_stamp":"2024-09-14T11:54:09.749200+0000","last_deep_scrub":"264'226","last_deep_scrub_stamp":"2024-09-14T11:54:09.749200+0000","last_clean_scrub_stamp":"2024-09-14T11:54:09.749200+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:53.881634+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":600,"num_read_kb":7544,"num_write":1094,"num_write_kb":12612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.066291+0000","last_change":"2024-09-14T11:54:27.066124+0000","last_active":"2024-09-14T11:54:27.066291+0000","last_peered":"2024-09-14T11:54:27.066291+0000","last_clean":"2024-09-14T11:54:27.066291+0000","last_became_active":"2024-09-14T11:09:48.957275+0000","last_became_peered":"2024-09-14T11:09:48.957275+0000","last_unstale":"2024-09-14T11:54:27.066291+0000","last_undegraded":"2024-09-14T11:54:27.066291+0000","last_fullsized":"2024-09-14T11:54:27.066291+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:27.065940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:27.065940+0000","last_clean_scrub_stamp":"2024-09-14T11:54:27.065940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:31.779734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"264'178","reported_seq":766,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:37.759984+0000","last_change":"2024-09-14T11:54:37.759839+0000","last_active":"2024-09-14T11:54:37.759984+0000","last_peered":"2024-09-14T11:54:37.759984+0000","last_clean":"2024-09-14T11:54:37.759984+0000","last_became_active":"2024-09-14T11:09:50.999759+0000","last_became_peered":"2024-09-14T11:09:50.999759+0000","last_unstale":"2024-09-14T11:54:37.759984+0000","last_undegraded":"2024-09-14T11:54:37.759984+0000","last_fullsized":"2024-09-14T11:54:37.759984+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'178","last_scrub_stamp":"2024-09-14T11:54:37.759617+0000","last_deep_scrub":"264'178","last_deep_scrub_stamp":"2024-09-14T11:54:37.759617+0000","last_clean_scrub_stamp":"2024-09-14T11:54:37.759617+0000","objects_scrubbed":8,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:44.576561+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6528,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":216,"num_read_kb":266,"num_write":126,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"264'803","reported_seq":2360,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:33.083287+0000","last_change":"2024-09-14T11:54:33.083119+0000","last_active":"2024-09-14T11:54:33.083287+0000","last_peered":"2024-09-14T11:54:33.083287+0000","last_clean":"2024-09-14T11:54:33.083287+0000","last_became_active":"2024-09-14T11:09:53.002667+0000","last_became_peered":"2024-09-14T11:09:53.002667+0000","last_unstale":"2024-09-14T11:54:33.083287+0000","last_undegraded":"2024-09-14T11:54:33.083287+0000","last_fullsized":"2024-09-14T11:54:33.083287+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'803","last_scrub_stamp":"2024-09-14T11:54:33.082941+0000","last_deep_scrub":"264'803","last_deep_scrub_stamp":"2024-09-14T11:54:33.082941+0000","last_clean_scrub_stamp":"2024-09-14T11:54:33.082941+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:12.117497+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"264'127","reported_seq":628,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:29.612334+0000","last_change":"2024-09-14T11:54:29.612334+0000","last_active":"2024-09-14T11:54:29.612334+0000","last_peered":"2024-09-14T11:54:29.612334+0000","last_clean":"2024-09-14T11:54:29.612334+0000","last_became_active":"2024-09-14T11:09:55.016802+0000","last_became_peered":"2024-09-14T11:09:55.016802+0000","last_unstale":"2024-09-14T11:54:29.612334+0000","last_undegraded":"2024-09-14T11:54:29.612334+0000","last_fullsized":"2024-09-14T11:54:29.612334+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'127","last_scrub_stamp":"2024-09-14T11:54:29.612082+0000","last_deep_scrub":"264'127","last_deep_scrub_stamp":"2024-09-14T11:54:29.612082+0000","last_clean_scrub_stamp":"2024-09-14T11:54:29.612082+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:14:18.130706+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":820,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":114,"num_write":311,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"264'748","reported_seq":2285,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.054358+0000","last_change":"2024-09-14T11:54:18.054187+0000","last_active":"2024-09-14T11:54:18.054358+0000","last_peered":"2024-09-14T11:54:18.054358+0000","last_clean":"2024-09-14T11:54:18.054358+0000","last_became_active":"2024-09-14T11:09:46.987523+0000","last_became_peered":"2024-09-14T11:09:46.987523+0000","last_unstale":"2024-09-14T11:54:18.054358+0000","last_undegraded":"2024-09-14T11:54:18.054358+0000","last_fullsized":"2024-09-14T11:54:18.054358+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'748","last_scrub_stamp":"2024-09-14T11:54:18.054011+0000","last_deep_scrub":"264'748","last_deep_scrub_stamp":"2024-09-14T11:54:18.054011+0000","last_clean_scrub_stamp":"2024-09-14T11:54:18.054011+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:45.880403+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3699,"num_read_kb":3347,"num_write":991,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"264'240","reported_seq":900,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:01.721100+0000","last_change":"2024-09-14T11:54:01.721039+0000","last_active":"2024-09-14T11:54:01.721100+0000","last_peered":"2024-09-14T11:54:01.721100+0000","last_clean":"2024-09-14T11:54:01.721100+0000","last_became_active":"2024-09-14T11:09:45.213648+0000","last_became_peered":"2024-09-14T11:09:45.213648+0000","last_unstale":"2024-09-14T11:54:01.721100+0000","last_undegraded":"2024-09-14T11:54:01.721100+0000","last_fullsized":"2024-09-14T11:54:01.721100+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'240","last_scrub_stamp":"2024-09-14T11:54:01.720967+0000","last_deep_scrub":"264'240","last_deep_scrub_stamp":"2024-09-14T11:54:01.720967+0000","last_clean_scrub_stamp":"2024-09-14T11:54:01.720967+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:13.876519+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1830584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":598,"num_read_kb":9438,"num_write":1111,"num_write_kb":42718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.656620+0000","last_change":"2024-09-14T11:54:18.656620+0000","last_active":"2024-09-14T11:54:18.656620+0000","last_peered":"2024-09-14T11:54:18.656620+0000","last_clean":"2024-09-14T11:54:18.656620+0000","last_became_active":"2024-09-14T11:09:48.965014+0000","last_became_peered":"2024-09-14T11:09:48.965014+0000","last_unstale":"2024-09-14T11:54:18.656620+0000","last_undegraded":"2024-09-14T11:54:18.656620+0000","last_fullsized":"2024-09-14T11:54:18.656620+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:18.656437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:18.656437+0000","last_clean_scrub_stamp":"2024-09-14T11:54:18.656437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:47.603996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"264'206","reported_seq":843,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:29.972799+0000","last_change":"2024-09-14T11:54:29.972634+0000","last_active":"2024-09-14T11:54:29.972799+0000","last_peered":"2024-09-14T11:54:29.972799+0000","last_clean":"2024-09-14T11:54:29.972799+0000","last_became_active":"2024-09-14T11:09:50.988991+0000","last_became_peered":"2024-09-14T11:09:50.988991+0000","last_unstale":"2024-09-14T11:54:29.972799+0000","last_undegraded":"2024-09-14T11:54:29.972799+0000","last_fullsized":"2024-09-14T11:54:29.972799+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'206","last_scrub_stamp":"2024-09-14T11:54:29.972424+0000","last_deep_scrub":"264'206","last_deep_scrub_stamp":"2024-09-14T11:54:29.972424+0000","last_clean_scrub_stamp":"2024-09-14T11:54:29.972424+0000","objects_scrubbed":6,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:17.229395+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16480,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":287,"num_read_kb":450,"num_write":148,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:31.073276+0000","last_change":"2024-09-14T11:54:31.073151+0000","last_active":"2024-09-14T11:54:31.073276+0000","last_peered":"2024-09-14T11:54:31.073276+0000","last_clean":"2024-09-14T11:54:31.073276+0000","last_became_active":"2024-09-14T11:09:53.010817+0000","last_became_peered":"2024-09-14T11:09:53.010817+0000","last_unstale":"2024-09-14T11:54:31.073276+0000","last_undegraded":"2024-09-14T11:54:31.073276+0000","last_fullsized":"2024-09-14T11:54:31.073276+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:31.072969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:31.072969+0000","last_clean_scrub_stamp":"2024-09-14T11:54:31.072969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:25.026070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"264'119","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.389012+0000","last_change":"2024-09-14T11:54:28.389012+0000","last_active":"2024-09-14T11:54:28.389012+0000","last_peered":"2024-09-14T11:54:28.389012+0000","last_clean":"2024-09-14T11:54:28.389012+0000","last_became_active":"2024-09-14T11:09:55.025490+0000","last_became_peered":"2024-09-14T11:09:55.025490+0000","last_unstale":"2024-09-14T11:54:28.389012+0000","last_undegraded":"2024-09-14T11:54:28.389012+0000","last_fullsized":"2024-09-14T11:54:28.389012+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'119","last_scrub_stamp":"2024-09-14T11:54:28.388783+0000","last_deep_scrub":"264'119","last_deep_scrub_stamp":"2024-09-14T11:54:28.388783+0000","last_clean_scrub_stamp":"2024-09-14T11:54:28.388783+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:34.167171+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":533,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":108,"num_write":255,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"264'476","reported_seq":2031,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.703428+0000","last_change":"2024-09-14T11:54:08.703197+0000","last_active":"2024-09-14T11:54:08.703428+0000","last_peered":"2024-09-14T11:54:08.703428+0000","last_clean":"2024-09-14T11:54:08.703428+0000","last_became_active":"2024-09-14T11:09:46.970824+0000","last_became_peered":"2024-09-14T11:09:46.970824+0000","last_unstale":"2024-09-14T11:54:08.703428+0000","last_undegraded":"2024-09-14T11:54:08.703428+0000","last_fullsized":"2024-09-14T11:54:08.703428+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'476","last_scrub_stamp":"2024-09-14T11:54:08.702969+0000","last_deep_scrub":"264'476","last_deep_scrub_stamp":"2024-09-14T11:54:08.702969+0000","last_clean_scrub_stamp":"2024-09-14T11:54:08.702969+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:56.765104+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2551,"num_read_kb":2376,"num_write":583,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"264'199","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.232964+0000","last_change":"2024-09-14T11:54:05.232828+0000","last_active":"2024-09-14T11:54:05.232964+0000","last_peered":"2024-09-14T11:54:05.232964+0000","last_clean":"2024-09-14T11:54:05.232964+0000","last_became_active":"2024-09-14T11:09:45.216305+0000","last_became_peered":"2024-09-14T11:09:45.216305+0000","last_unstale":"2024-09-14T11:54:05.232964+0000","last_undegraded":"2024-09-14T11:54:05.232964+0000","last_fullsized":"2024-09-14T11:54:05.232964+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'199","last_scrub_stamp":"2024-09-14T11:54:05.232517+0000","last_deep_scrub":"264'199","last_deep_scrub_stamp":"2024-09-14T11:54:05.232517+0000","last_clean_scrub_stamp":"2024-09-14T11:54:05.232517+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:34.729977+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655887,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":432,"num_read_kb":2004,"num_write":918,"num_write_kb":29719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.349061+0000","last_change":"2024-09-14T11:54:19.348901+0000","last_active":"2024-09-14T11:54:19.349061+0000","last_peered":"2024-09-14T11:54:19.349061+0000","last_clean":"2024-09-14T11:54:19.349061+0000","last_became_active":"2024-09-14T11:09:48.968263+0000","last_became_peered":"2024-09-14T11:09:48.968263+0000","last_unstale":"2024-09-14T11:54:19.349061+0000","last_undegraded":"2024-09-14T11:54:19.349061+0000","last_fullsized":"2024-09-14T11:54:19.349061+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:19.348715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:19.348715+0000","last_clean_scrub_stamp":"2024-09-14T11:54:19.348715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:01.380009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"264'151","reported_seq":731,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.524575+0000","last_change":"2024-09-14T11:54:24.524478+0000","last_active":"2024-09-14T11:54:24.524575+0000","last_peered":"2024-09-14T11:54:24.524575+0000","last_clean":"2024-09-14T11:54:24.524575+0000","last_became_active":"2024-09-14T11:09:50.998098+0000","last_became_peered":"2024-09-14T11:09:50.998098+0000","last_unstale":"2024-09-14T11:54:24.524575+0000","last_undegraded":"2024-09-14T11:54:24.524575+0000","last_fullsized":"2024-09-14T11:54:24.524575+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'151","last_scrub_stamp":"2024-09-14T11:54:24.524363+0000","last_deep_scrub":"264'151","last_deep_scrub_stamp":"2024-09-14T11:54:24.524363+0000","last_clean_scrub_stamp":"2024-09-14T11:54:24.524363+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:00.427318+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10966,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":215,"num_read_kb":296,"num_write":168,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:25.315761+0000","last_change":"2024-09-14T11:54:25.315628+0000","last_active":"2024-09-14T11:54:25.315761+0000","last_peered":"2024-09-14T11:54:25.315761+0000","last_clean":"2024-09-14T11:54:25.315761+0000","last_became_active":"2024-09-14T11:09:53.003759+0000","last_became_peered":"2024-09-14T11:09:53.003759+0000","last_unstale":"2024-09-14T11:54:25.315761+0000","last_undegraded":"2024-09-14T11:54:25.315761+0000","last_fullsized":"2024-09-14T11:54:25.315761+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:25.315450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:25.315450+0000","last_clean_scrub_stamp":"2024-09-14T11:54:25.315450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:53.076672+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"264'128","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:35.116168+0000","last_change":"2024-09-14T11:54:35.116168+0000","last_active":"2024-09-14T11:54:35.116168+0000","last_peered":"2024-09-14T11:54:35.116168+0000","last_clean":"2024-09-14T11:54:35.116168+0000","last_became_active":"2024-09-14T11:09:55.033844+0000","last_became_peered":"2024-09-14T11:09:55.033844+0000","last_unstale":"2024-09-14T11:54:35.116168+0000","last_undegraded":"2024-09-14T11:54:35.116168+0000","last_fullsized":"2024-09-14T11:54:35.116168+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'128","last_scrub_stamp":"2024-09-14T11:54:35.115901+0000","last_deep_scrub":"264'128","last_deep_scrub_stamp":"2024-09-14T11:54:35.115901+0000","last_clean_scrub_stamp":"2024-09-14T11:54:35.115901+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:16.357126+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":100,"num_write":302,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"264'542","reported_seq":2222,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:21.889174+0000","last_change":"2024-09-14T11:54:21.889015+0000","last_active":"2024-09-14T11:54:21.889174+0000","last_peered":"2024-09-14T11:54:21.889174+0000","last_clean":"2024-09-14T11:54:21.889174+0000","last_became_active":"2024-09-14T11:09:46.961100+0000","last_became_peered":"2024-09-14T11:09:46.961100+0000","last_unstale":"2024-09-14T11:54:21.889174+0000","last_undegraded":"2024-09-14T11:54:21.889174+0000","last_fullsized":"2024-09-14T11:54:21.889174+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'542","last_scrub_stamp":"2024-09-14T11:54:21.888836+0000","last_deep_scrub":"264'542","last_deep_scrub_stamp":"2024-09-14T11:54:21.888836+0000","last_clean_scrub_stamp":"2024-09-14T11:54:21.888836+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:17.653317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2788,"num_read_kb":2597,"num_write":616,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"264'220","reported_seq":840,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.775701+0000","last_change":"2024-09-14T11:54:08.775701+0000","last_active":"2024-09-14T11:54:08.775701+0000","last_peered":"2024-09-14T11:54:08.775701+0000","last_clean":"2024-09-14T11:54:08.775701+0000","last_became_active":"2024-09-14T11:09:45.198569+0000","last_became_peered":"2024-09-14T11:09:45.198569+0000","last_unstale":"2024-09-14T11:54:08.775701+0000","last_undegraded":"2024-09-14T11:54:08.775701+0000","last_fullsized":"2024-09-14T11:54:08.775701+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'220","last_scrub_stamp":"2024-09-14T11:54:08.775524+0000","last_deep_scrub":"264'220","last_deep_scrub_stamp":"2024-09-14T11:54:08.775524+0000","last_clean_scrub_stamp":"2024-09-14T11:54:08.775524+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:16.447398+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":586,"num_read_kb":15211,"num_write":901,"num_write_kb":32712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.034316+0000","last_change":"2024-09-14T11:54:26.034077+0000","last_active":"2024-09-14T11:54:26.034316+0000","last_peered":"2024-09-14T11:54:26.034316+0000","last_clean":"2024-09-14T11:54:26.034316+0000","last_became_active":"2024-09-14T11:09:48.952531+0000","last_became_peered":"2024-09-14T11:09:48.952531+0000","last_unstale":"2024-09-14T11:54:26.034316+0000","last_undegraded":"2024-09-14T11:54:26.034316+0000","last_fullsized":"2024-09-14T11:54:26.034316+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:26.033870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:26.033870+0000","last_clean_scrub_stamp":"2024-09-14T11:54:26.033870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:11.032743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"264'165","reported_seq":754,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:29.119936+0000","last_change":"2024-09-14T11:54:29.119773+0000","last_active":"2024-09-14T11:54:29.119936+0000","last_peered":"2024-09-14T11:54:29.119936+0000","last_clean":"2024-09-14T11:54:29.119936+0000","last_became_active":"2024-09-14T11:09:50.975455+0000","last_became_peered":"2024-09-14T11:09:50.975455+0000","last_unstale":"2024-09-14T11:54:29.119936+0000","last_undegraded":"2024-09-14T11:54:29.119936+0000","last_fullsized":"2024-09-14T11:54:29.119936+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'165","last_scrub_stamp":"2024-09-14T11:54:29.119569+0000","last_deep_scrub":"264'165","last_deep_scrub_stamp":"2024-09-14T11:54:29.119569+0000","last_clean_scrub_stamp":"2024-09-14T11:54:29.119569+0000","objects_scrubbed":7,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:47.076760+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16336,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":219,"num_read_kb":325,"num_write":124,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"264'773","reported_seq":2372,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:21.346123+0000","last_change":"2024-09-14T11:54:21.345870+0000","last_active":"2024-09-14T11:54:21.346123+0000","last_peered":"2024-09-14T11:54:21.346123+0000","last_clean":"2024-09-14T11:54:21.346123+0000","last_became_active":"2024-09-14T11:09:53.013805+0000","last_became_peered":"2024-09-14T11:09:53.013805+0000","last_unstale":"2024-09-14T11:54:21.346123+0000","last_undegraded":"2024-09-14T11:54:21.346123+0000","last_fullsized":"2024-09-14T11:54:21.346123+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'773","last_scrub_stamp":"2024-09-14T11:54:21.345641+0000","last_deep_scrub":"264'773","last_deep_scrub_stamp":"2024-09-14T11:54:21.345641+0000","last_clean_scrub_stamp":"2024-09-14T11:54:21.345641+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:00.678060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"264'156","reported_seq":669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.643051+0000","last_change":"2024-09-14T11:54:27.643051+0000","last_active":"2024-09-14T11:54:27.643051+0000","last_peered":"2024-09-14T11:54:27.643051+0000","last_clean":"2024-09-14T11:54:27.643051+0000","last_became_active":"2024-09-14T11:09:55.026656+0000","last_became_peered":"2024-09-14T11:09:55.026656+0000","last_unstale":"2024-09-14T11:54:27.643051+0000","last_undegraded":"2024-09-14T11:54:27.643051+0000","last_fullsized":"2024-09-14T11:54:27.643051+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'156","last_scrub_stamp":"2024-09-14T11:54:27.642792+0000","last_deep_scrub":"264'156","last_deep_scrub_stamp":"2024-09-14T11:54:27.642792+0000","last_clean_scrub_stamp":"2024-09-14T11:54:27.642792+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:43.007584+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1884,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":197,"num_read_kb":178,"num_write":396,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"264'509","reported_seq":2092,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.384119+0000","last_change":"2024-09-14T11:54:09.383975+0000","last_active":"2024-09-14T11:54:09.384119+0000","last_peered":"2024-09-14T11:54:09.384119+0000","last_clean":"2024-09-14T11:54:09.384119+0000","last_became_active":"2024-09-14T11:09:46.949867+0000","last_became_peered":"2024-09-14T11:09:46.949867+0000","last_unstale":"2024-09-14T11:54:09.384119+0000","last_undegraded":"2024-09-14T11:54:09.384119+0000","last_fullsized":"2024-09-14T11:54:09.384119+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'509","last_scrub_stamp":"2024-09-14T11:54:09.383770+0000","last_deep_scrub":"264'509","last_deep_scrub_stamp":"2024-09-14T11:54:09.383770+0000","last_clean_scrub_stamp":"2024-09-14T11:54:09.383770+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:39.270981+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2605,"num_read_kb":2418,"num_write":602,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"264'274","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.730902+0000","last_change":"2024-09-14T11:54:07.730759+0000","last_active":"2024-09-14T11:54:07.730902+0000","last_peered":"2024-09-14T11:54:07.730902+0000","last_clean":"2024-09-14T11:54:07.730902+0000","last_became_active":"2024-09-14T11:09:45.207969+0000","last_became_peered":"2024-09-14T11:09:45.207969+0000","last_unstale":"2024-09-14T11:54:07.730902+0000","last_undegraded":"2024-09-14T11:54:07.730902+0000","last_fullsized":"2024-09-14T11:54:07.730902+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'274","last_scrub_stamp":"2024-09-14T11:54:07.730568+0000","last_deep_scrub":"264'274","last_deep_scrub_stamp":"2024-09-14T11:54:07.730568+0000","last_clean_scrub_stamp":"2024-09-14T11:54:07.730568+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:51.886568+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":716,"num_read_kb":90988,"num_write":1212,"num_write_kb":64456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"264'4","reported_seq":1466,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:16.582083+0000","last_change":"2024-09-14T11:54:16.581905+0000","last_active":"2024-09-14T11:54:16.582083+0000","last_peered":"2024-09-14T11:54:16.582083+0000","last_clean":"2024-09-14T11:54:16.582083+0000","last_became_active":"2024-09-14T11:09:48.961946+0000","last_became_peered":"2024-09-14T11:09:48.961946+0000","last_unstale":"2024-09-14T11:54:16.582083+0000","last_undegraded":"2024-09-14T11:54:16.582083+0000","last_fullsized":"2024-09-14T11:54:16.582083+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T11:54:16.581705+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T11:54:16.581705+0000","last_clean_scrub_stamp":"2024-09-14T11:54:16.581705+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:55.935557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":958,"num_read_kb":958,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"264'87","reported_seq":611,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.637008+0000","last_change":"2024-09-14T11:54:22.636698+0000","last_active":"2024-09-14T11:54:22.637008+0000","last_peered":"2024-09-14T11:54:22.637008+0000","last_clean":"2024-09-14T11:54:22.637008+0000","last_became_active":"2024-09-14T11:09:50.997281+0000","last_became_peered":"2024-09-14T11:09:50.997281+0000","last_unstale":"2024-09-14T11:54:22.637008+0000","last_undegraded":"2024-09-14T11:54:22.637008+0000","last_fullsized":"2024-09-14T11:54:22.637008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'87","last_scrub_stamp":"2024-09-14T11:54:22.636343+0000","last_deep_scrub":"264'87","last_deep_scrub_stamp":"2024-09-14T11:54:22.636343+0000","last_clean_scrub_stamp":"2024-09-14T11:54:22.636343+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:32.101718+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"264'802","reported_seq":4471,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.610418+0000","last_change":"2024-09-14T11:54:27.610184+0000","last_active":"2024-09-14T11:54:27.610418+0000","last_peered":"2024-09-14T11:54:27.610418+0000","last_clean":"2024-09-14T11:54:27.610418+0000","last_became_active":"2024-09-14T11:09:53.010631+0000","last_became_peered":"2024-09-14T11:09:53.010631+0000","last_unstale":"2024-09-14T11:54:27.610418+0000","last_undegraded":"2024-09-14T11:54:27.610418+0000","last_fullsized":"2024-09-14T11:54:27.610418+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'802","last_scrub_stamp":"2024-09-14T11:54:27.609998+0000","last_deep_scrub":"264'802","last_deep_scrub_stamp":"2024-09-14T11:54:27.609998+0000","last_clean_scrub_stamp":"2024-09-14T11:54:27.609998+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:15:35.340229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"264'179","reported_seq":686,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.373878+0000","last_change":"2024-09-14T11:54:28.373878+0000","last_active":"2024-09-14T11:54:28.373878+0000","last_peered":"2024-09-14T11:54:28.373878+0000","last_clean":"2024-09-14T11:54:28.373878+0000","last_became_active":"2024-09-14T11:09:55.010215+0000","last_became_peered":"2024-09-14T11:09:55.010215+0000","last_unstale":"2024-09-14T11:54:28.373878+0000","last_undegraded":"2024-09-14T11:54:28.373878+0000","last_fullsized":"2024-09-14T11:54:28.373878+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'179","last_scrub_stamp":"2024-09-14T11:54:28.373690+0000","last_deep_scrub":"264'179","last_deep_scrub_stamp":"2024-09-14T11:54:28.373690+0000","last_clean_scrub_stamp":"2024-09-14T11:54:28.373690+0000","objects_scrubbed":1,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:57.309889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":123,"num_read_kb":114,"num_write":415,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"264'412","reported_seq":1896,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.272471+0000","last_change":"2024-09-14T11:54:09.272327+0000","last_active":"2024-09-14T11:54:09.272471+0000","last_peered":"2024-09-14T11:54:09.272471+0000","last_clean":"2024-09-14T11:54:09.272471+0000","last_became_active":"2024-09-14T11:09:46.966876+0000","last_became_peered":"2024-09-14T11:09:46.966876+0000","last_unstale":"2024-09-14T11:54:09.272471+0000","last_undegraded":"2024-09-14T11:54:09.272471+0000","last_fullsized":"2024-09-14T11:54:09.272471+0000","mapping_epoch":25,"log_start":"264'401","ondisk_log_start":"264'401","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'412","last_scrub_stamp":"2024-09-14T11:54:09.272144+0000","last_deep_scrub":"264'412","last_deep_scrub_stamp":"2024-09-14T11:54:09.272144+0000","last_clean_scrub_stamp":"2024-09-14T11:54:09.272144+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":401,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:51.396054+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2150,"num_read_kb":2036,"num_write":469,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"264'269","reported_seq":1028,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.715835+0000","last_change":"2024-09-14T11:54:06.715548+0000","last_active":"2024-09-14T11:54:06.715835+0000","last_peered":"2024-09-14T11:54:06.715835+0000","last_clean":"2024-09-14T11:54:06.715835+0000","last_became_active":"2024-09-14T11:09:45.200039+0000","last_became_peered":"2024-09-14T11:09:45.200039+0000","last_unstale":"2024-09-14T11:54:06.715835+0000","last_undegraded":"2024-09-14T11:54:06.715835+0000","last_fullsized":"2024-09-14T11:54:06.715835+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'269","last_scrub_stamp":"2024-09-14T11:54:06.715283+0000","last_deep_scrub":"264'269","last_deep_scrub_stamp":"2024-09-14T11:54:06.715283+0000","last_clean_scrub_stamp":"2024-09-14T11:54:06.715283+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:06.417831+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":994,"num_read_kb":201012,"num_write":1230,"num_write_kb":37853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:32.772491+0000","last_change":"2024-09-14T11:54:32.772237+0000","last_active":"2024-09-14T11:54:32.772491+0000","last_peered":"2024-09-14T11:54:32.772491+0000","last_clean":"2024-09-14T11:54:32.772491+0000","last_became_active":"2024-09-14T11:09:48.972957+0000","last_became_peered":"2024-09-14T11:09:48.972957+0000","last_unstale":"2024-09-14T11:54:32.772491+0000","last_undegraded":"2024-09-14T11:54:32.772491+0000","last_fullsized":"2024-09-14T11:54:32.772491+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:32.771921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:32.771921+0000","last_clean_scrub_stamp":"2024-09-14T11:54:32.771921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:04.164477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"264'204","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:21.644170+0000","last_change":"2024-09-14T11:54:21.644031+0000","last_active":"2024-09-14T11:54:21.644170+0000","last_peered":"2024-09-14T11:54:21.644170+0000","last_clean":"2024-09-14T11:54:21.644170+0000","last_became_active":"2024-09-14T11:09:50.991938+0000","last_became_peered":"2024-09-14T11:09:50.991938+0000","last_unstale":"2024-09-14T11:54:21.644170+0000","last_undegraded":"2024-09-14T11:54:21.644170+0000","last_fullsized":"2024-09-14T11:54:21.644170+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'204","last_scrub_stamp":"2024-09-14T11:54:21.643805+0000","last_deep_scrub":"264'204","last_deep_scrub_stamp":"2024-09-14T11:54:21.643805+0000","last_clean_scrub_stamp":"2024-09-14T11:54:21.643805+0000","objects_scrubbed":8,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:27.053278+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11553,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":263,"num_read_kb":344,"num_write":148,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:23.317915+0000","last_change":"2024-09-14T11:54:23.317788+0000","last_active":"2024-09-14T11:54:23.317915+0000","last_peered":"2024-09-14T11:54:23.317915+0000","last_clean":"2024-09-14T11:54:23.317915+0000","last_became_active":"2024-09-14T11:09:53.006350+0000","last_became_peered":"2024-09-14T11:09:53.006350+0000","last_unstale":"2024-09-14T11:54:23.317915+0000","last_undegraded":"2024-09-14T11:54:23.317915+0000","last_fullsized":"2024-09-14T11:54:23.317915+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:23.317603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:23.317603+0000","last_clean_scrub_stamp":"2024-09-14T11:54:23.317603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:23.634009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"264'120","reported_seq":613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.344814+0000","last_change":"2024-09-14T11:54:27.344814+0000","last_active":"2024-09-14T11:54:27.344814+0000","last_peered":"2024-09-14T11:54:27.344814+0000","last_clean":"2024-09-14T11:54:27.344814+0000","last_became_active":"2024-09-14T11:09:55.012954+0000","last_became_peered":"2024-09-14T11:09:55.012954+0000","last_unstale":"2024-09-14T11:54:27.344814+0000","last_undegraded":"2024-09-14T11:54:27.344814+0000","last_fullsized":"2024-09-14T11:54:27.344814+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'120","last_scrub_stamp":"2024-09-14T11:54:27.344573+0000","last_deep_scrub":"264'120","last_deep_scrub_stamp":"2024-09-14T11:54:27.344573+0000","last_clean_scrub_stamp":"2024-09-14T11:54:27.344573+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:56.104563+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":106,"num_write":256,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"264'405","reported_seq":2080,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.883536+0000","last_change":"2024-09-14T11:54:19.883536+0000","last_active":"2024-09-14T11:54:19.883536+0000","last_peered":"2024-09-14T11:54:19.883536+0000","last_clean":"2024-09-14T11:54:19.883536+0000","last_became_active":"2024-09-14T11:09:46.960461+0000","last_became_peered":"2024-09-14T11:09:46.960461+0000","last_unstale":"2024-09-14T11:54:19.883536+0000","last_undegraded":"2024-09-14T11:54:19.883536+0000","last_fullsized":"2024-09-14T11:54:19.883536+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'405","last_scrub_stamp":"2024-09-14T11:54:19.883237+0000","last_deep_scrub":"264'405","last_deep_scrub_stamp":"2024-09-14T11:54:19.883237+0000","last_clean_scrub_stamp":"2024-09-14T11:54:19.883237+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:36.272832+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2438,"num_read_kb":2343,"num_write":447,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2036,"num_omap_keys":8,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"264'74","reported_seq":620,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:01.651107+0000","last_change":"2024-09-14T11:54:01.651107+0000","last_active":"2024-09-14T11:54:01.651107+0000","last_peered":"2024-09-14T11:54:01.651107+0000","last_clean":"2024-09-14T11:54:01.651107+0000","last_became_active":"2024-09-14T11:09:30.309524+0000","last_became_peered":"2024-09-14T11:09:30.309524+0000","last_unstale":"2024-09-14T11:54:01.651107+0000","last_undegraded":"2024-09-14T11:54:01.651107+0000","last_fullsized":"2024-09-14T11:54:01.651107+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'74","last_scrub_stamp":"2024-09-14T11:54:01.650935+0000","last_deep_scrub":"264'74","last_deep_scrub_stamp":"2024-09-14T11:54:01.650935+0000","last_clean_scrub_stamp":"2024-09-14T11:54:01.650935+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:53.062420+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"264'2","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.837336+0000","last_change":"2024-09-14T11:54:04.837336+0000","last_active":"2024-09-14T11:54:04.837336+0000","last_peered":"2024-09-14T11:54:04.837336+0000","last_clean":"2024-09-14T11:54:04.837336+0000","last_became_active":"2024-09-14T11:09:36.264768+0000","last_became_peered":"2024-09-14T11:09:36.264768+0000","last_unstale":"2024-09-14T11:54:04.837336+0000","last_undegraded":"2024-09-14T11:54:04.837336+0000","last_fullsized":"2024-09-14T11:54:04.837336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:04.837116+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:04.837116+0000","last_clean_scrub_stamp":"2024-09-14T11:54:04.837116+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:31.345731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00092723999999999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"264'271","reported_seq":1086,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:03.714182+0000","last_change":"2024-09-14T11:54:03.714182+0000","last_active":"2024-09-14T11:54:03.714182+0000","last_peered":"2024-09-14T11:54:03.714182+0000","last_clean":"2024-09-14T11:54:03.714182+0000","last_became_active":"2024-09-14T11:09:45.193131+0000","last_became_peered":"2024-09-14T11:09:45.193131+0000","last_unstale":"2024-09-14T11:54:03.714182+0000","last_undegraded":"2024-09-14T11:54:03.714182+0000","last_fullsized":"2024-09-14T11:54:03.714182+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'271","last_scrub_stamp":"2024-09-14T11:54:03.713998+0000","last_deep_scrub":"264'271","last_deep_scrub_stamp":"2024-09-14T11:54:03.713998+0000","last_clean_scrub_stamp":"2024-09-14T11:54:03.713998+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:24.565125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1127,"num_read_kb":141056,"num_write":1044,"num_write_kb":44809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.830566+0000","last_change":"2024-09-14T11:54:20.830566+0000","last_active":"2024-09-14T11:54:20.830566+0000","last_peered":"2024-09-14T11:54:20.830566+0000","last_clean":"2024-09-14T11:54:20.830566+0000","last_became_active":"2024-09-14T11:09:48.970541+0000","last_became_peered":"2024-09-14T11:09:48.970541+0000","last_unstale":"2024-09-14T11:54:20.830566+0000","last_undegraded":"2024-09-14T11:54:20.830566+0000","last_fullsized":"2024-09-14T11:54:20.830566+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:20.830380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:20.830380+0000","last_clean_scrub_stamp":"2024-09-14T11:54:20.830380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:49.298720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"264'305","reported_seq":1010,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:35.744823+0000","last_change":"2024-09-14T11:54:35.744680+0000","last_active":"2024-09-14T11:54:35.744823+0000","last_peered":"2024-09-14T11:54:35.744823+0000","last_clean":"2024-09-14T11:54:35.744823+0000","last_became_active":"2024-09-14T11:09:50.993231+0000","last_became_peered":"2024-09-14T11:09:50.993231+0000","last_unstale":"2024-09-14T11:54:35.744823+0000","last_undegraded":"2024-09-14T11:54:35.744823+0000","last_fullsized":"2024-09-14T11:54:35.744823+0000","mapping_epoch":29,"log_start":"261'200","ondisk_log_start":"261'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'305","last_scrub_stamp":"2024-09-14T11:54:35.744486+0000","last_deep_scrub":"264'305","last_deep_scrub_stamp":"2024-09-14T11:54:35.744486+0000","last_clean_scrub_stamp":"2024-09-14T11:54:35.744486+0000","objects_scrubbed":6,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:12.554646+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22194,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":549,"num_read_kb":706,"num_write":484,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106814,"num_omap_keys":256,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:32.086620+0000","last_change":"2024-09-14T11:54:32.086476+0000","last_active":"2024-09-14T11:54:32.086620+0000","last_peered":"2024-09-14T11:54:32.086620+0000","last_clean":"2024-09-14T11:54:32.086620+0000","last_became_active":"2024-09-14T11:09:53.004338+0000","last_became_peered":"2024-09-14T11:09:53.004338+0000","last_unstale":"2024-09-14T11:54:32.086620+0000","last_undegraded":"2024-09-14T11:54:32.086620+0000","last_fullsized":"2024-09-14T11:54:32.086620+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:32.086262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:32.086262+0000","last_clean_scrub_stamp":"2024-09-14T11:54:32.086262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:41.804074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"264'239","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.880952+0000","last_change":"2024-09-14T11:54:22.880952+0000","last_active":"2024-09-14T11:54:22.880952+0000","last_peered":"2024-09-14T11:54:22.880952+0000","last_clean":"2024-09-14T11:54:22.880952+0000","last_became_active":"2024-09-14T11:09:55.015569+0000","last_became_peered":"2024-09-14T11:09:55.015569+0000","last_unstale":"2024-09-14T11:54:22.880952+0000","last_undegraded":"2024-09-14T11:54:22.880952+0000","last_fullsized":"2024-09-14T11:54:22.880952+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'239","last_scrub_stamp":"2024-09-14T11:54:22.880736+0000","last_deep_scrub":"264'239","last_deep_scrub_stamp":"2024-09-14T11:54:22.880736+0000","last_clean_scrub_stamp":"2024-09-14T11:54:22.880736+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:24.816809+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1424,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":528,"num_read_kb":505,"num_write":525,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"264'794","reported_seq":2258,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.039135+0000","last_change":"2024-09-14T11:54:17.038964+0000","last_active":"2024-09-14T11:54:17.039135+0000","last_peered":"2024-09-14T11:54:17.039135+0000","last_clean":"2024-09-14T11:54:17.039135+0000","last_became_active":"2024-09-14T11:09:46.974517+0000","last_became_peered":"2024-09-14T11:09:46.974517+0000","last_unstale":"2024-09-14T11:54:17.039135+0000","last_undegraded":"2024-09-14T11:54:17.039135+0000","last_fullsized":"2024-09-14T11:54:17.039135+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'794","last_scrub_stamp":"2024-09-14T11:54:17.038783+0000","last_deep_scrub":"264'794","last_deep_scrub_stamp":"2024-09-14T11:54:17.038783+0000","last_clean_scrub_stamp":"2024-09-14T11:54:17.038783+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:13.442249+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3876,"num_read_kb":3470,"num_write":1072,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:03.793921+0000","last_change":"2024-09-14T11:54:03.793921+0000","last_active":"2024-09-14T11:54:03.793921+0000","last_peered":"2024-09-14T11:54:03.793921+0000","last_clean":"2024-09-14T11:54:03.793921+0000","last_became_active":"2024-09-14T11:09:36.110037+0000","last_became_peered":"2024-09-14T11:09:36.110037+0000","last_unstale":"2024-09-14T11:54:03.793921+0000","last_undegraded":"2024-09-14T11:54:03.793921+0000","last_fullsized":"2024-09-14T11:54:03.793921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:03.793825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:03.793825+0000","last_clean_scrub_stamp":"2024-09-14T11:54:03.793825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:58.071609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001043441,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"264'225","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.624617+0000","last_change":"2024-09-14T11:54:05.624617+0000","last_active":"2024-09-14T11:54:05.624617+0000","last_peered":"2024-09-14T11:54:05.624617+0000","last_clean":"2024-09-14T11:54:05.624617+0000","last_became_active":"2024-09-14T11:09:45.211579+0000","last_became_peered":"2024-09-14T11:09:45.211579+0000","last_unstale":"2024-09-14T11:54:05.624617+0000","last_undegraded":"2024-09-14T11:54:05.624617+0000","last_fullsized":"2024-09-14T11:54:05.624617+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'225","last_scrub_stamp":"2024-09-14T11:54:05.624423+0000","last_deep_scrub":"264'225","last_deep_scrub_stamp":"2024-09-14T11:54:05.624423+0000","last_clean_scrub_stamp":"2024-09-14T11:54:05.624423+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:48.379755+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":626,"num_read_kb":58466,"num_write":936,"num_write_kb":31030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:29.858707+0000","last_change":"2024-09-14T11:54:29.858547+0000","last_active":"2024-09-14T11:54:29.858707+0000","last_peered":"2024-09-14T11:54:29.858707+0000","last_clean":"2024-09-14T11:54:29.858707+0000","last_became_active":"2024-09-14T11:09:48.970218+0000","last_became_peered":"2024-09-14T11:09:48.970218+0000","last_unstale":"2024-09-14T11:54:29.858707+0000","last_undegraded":"2024-09-14T11:54:29.858707+0000","last_fullsized":"2024-09-14T11:54:29.858707+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:29.858359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:29.858359+0000","last_clean_scrub_stamp":"2024-09-14T11:54:29.858359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:44.732920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"264'872","reported_seq":2339,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.381488+0000","last_change":"2024-09-14T11:54:20.381488+0000","last_active":"2024-09-14T11:54:20.381488+0000","last_peered":"2024-09-14T11:54:20.381488+0000","last_clean":"2024-09-14T11:54:20.381488+0000","last_became_active":"2024-09-14T11:09:50.996406+0000","last_became_peered":"2024-09-14T11:09:50.996406+0000","last_unstale":"2024-09-14T11:54:20.381488+0000","last_undegraded":"2024-09-14T11:54:20.381488+0000","last_fullsized":"2024-09-14T11:54:20.381488+0000","mapping_epoch":29,"log_start":"264'800","ondisk_log_start":"264'800","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'872","last_scrub_stamp":"2024-09-14T11:54:20.381285+0000","last_deep_scrub":"264'872","last_deep_scrub_stamp":"2024-09-14T11:54:20.381285+0000","last_clean_scrub_stamp":"2024-09-14T11:54:20.381285+0000","objects_scrubbed":11,"log_size":72,"log_dups_size":800,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:34.362640+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34005,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1184,"num_read_kb":1407,"num_write":288,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:40.720017+0000","last_change":"2024-09-14T11:54:40.720017+0000","last_active":"2024-09-14T11:54:40.720017+0000","last_peered":"2024-09-14T11:54:40.720017+0000","last_clean":"2024-09-14T11:54:40.720017+0000","last_became_active":"2024-09-14T11:09:53.022006+0000","last_became_peered":"2024-09-14T11:09:53.022006+0000","last_unstale":"2024-09-14T11:54:40.720017+0000","last_undegraded":"2024-09-14T11:54:40.720017+0000","last_fullsized":"2024-09-14T11:54:40.720017+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:40.719788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:40.719788+0000","last_clean_scrub_stamp":"2024-09-14T11:54:40.719788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:06.582867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"264'219","reported_seq":754,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:36.113973+0000","last_change":"2024-09-14T11:54:36.113973+0000","last_active":"2024-09-14T11:54:36.113973+0000","last_peered":"2024-09-14T11:54:36.113973+0000","last_clean":"2024-09-14T11:54:36.113973+0000","last_became_active":"2024-09-14T11:09:55.023966+0000","last_became_peered":"2024-09-14T11:09:55.023966+0000","last_unstale":"2024-09-14T11:54:36.113973+0000","last_undegraded":"2024-09-14T11:54:36.113973+0000","last_fullsized":"2024-09-14T11:54:36.113973+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'219","last_scrub_stamp":"2024-09-14T11:54:36.113759+0000","last_deep_scrub":"264'219","last_deep_scrub_stamp":"2024-09-14T11:54:36.113759+0000","last_clean_scrub_stamp":"2024-09-14T11:54:36.113759+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:37.214318+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":224,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":295,"num_read_kb":259,"num_write":448,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"264'467","reported_seq":2180,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:12.580846+0000","last_change":"2024-09-14T11:54:12.580698+0000","last_active":"2024-09-14T11:54:12.580846+0000","last_peered":"2024-09-14T11:54:12.580846+0000","last_clean":"2024-09-14T11:54:12.580846+0000","last_became_active":"2024-09-14T11:09:46.981472+0000","last_became_peered":"2024-09-14T11:09:46.981472+0000","last_unstale":"2024-09-14T11:54:12.580846+0000","last_undegraded":"2024-09-14T11:54:12.580846+0000","last_fullsized":"2024-09-14T11:54:12.580846+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'467","last_scrub_stamp":"2024-09-14T11:54:12.580519+0000","last_deep_scrub":"264'467","last_deep_scrub_stamp":"2024-09-14T11:54:12.580519+0000","last_clean_scrub_stamp":"2024-09-14T11:54:12.580519+0000","objects_scrubbed":3,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:18.230648+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2625,"num_read_kb":2493,"num_write":542,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":468,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":521,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.269223+0000","last_change":"2024-09-14T11:54:04.269223+0000","last_active":"2024-09-14T11:54:04.269223+0000","last_peered":"2024-09-14T11:54:04.269223+0000","last_clean":"2024-09-14T11:54:04.269223+0000","last_became_active":"2024-09-14T11:09:36.110778+0000","last_became_peered":"2024-09-14T11:09:36.110778+0000","last_unstale":"2024-09-14T11:54:04.269223+0000","last_undegraded":"2024-09-14T11:54:04.269223+0000","last_fullsized":"2024-09-14T11:54:04.269223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:04.269043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:04.269043+0000","last_clean_scrub_stamp":"2024-09-14T11:54:04.269043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:43.617127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001188634,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"264'181","reported_seq":786,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.103277+0000","last_change":"2024-09-14T11:54:11.103277+0000","last_active":"2024-09-14T11:54:11.103277+0000","last_peered":"2024-09-14T11:54:11.103277+0000","last_clean":"2024-09-14T11:54:11.103277+0000","last_became_active":"2024-09-14T11:09:45.214670+0000","last_became_peered":"2024-09-14T11:09:45.214670+0000","last_unstale":"2024-09-14T11:54:11.103277+0000","last_undegraded":"2024-09-14T11:54:11.103277+0000","last_fullsized":"2024-09-14T11:54:11.103277+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'181","last_scrub_stamp":"2024-09-14T11:54:11.103055+0000","last_deep_scrub":"264'181","last_deep_scrub_stamp":"2024-09-14T11:54:11.103055+0000","last_clean_scrub_stamp":"2024-09-14T11:54:11.103055+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:09.808494+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":427,"num_read_kb":11641,"num_write":795,"num_write_kb":32063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"264'2","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.410573+0000","last_change":"2024-09-14T11:54:17.410405+0000","last_active":"2024-09-14T11:54:17.410573+0000","last_peered":"2024-09-14T11:54:17.410573+0000","last_clean":"2024-09-14T11:54:17.410573+0000","last_became_active":"2024-09-14T11:09:48.968973+0000","last_became_peered":"2024-09-14T11:09:48.968973+0000","last_unstale":"2024-09-14T11:54:17.410573+0000","last_undegraded":"2024-09-14T11:54:17.410573+0000","last_fullsized":"2024-09-14T11:54:17.410573+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:17.410202+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:17.410202+0000","last_clean_scrub_stamp":"2024-09-14T11:54:17.410202+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:57.558922+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"264'243","reported_seq":1322,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.884841+0000","last_change":"2024-09-14T11:54:19.884841+0000","last_active":"2024-09-14T11:54:19.884841+0000","last_peered":"2024-09-14T11:54:19.884841+0000","last_clean":"2024-09-14T11:54:19.884841+0000","last_became_active":"2024-09-14T11:09:50.992589+0000","last_became_peered":"2024-09-14T11:09:50.992589+0000","last_unstale":"2024-09-14T11:54:19.884841+0000","last_undegraded":"2024-09-14T11:54:19.884841+0000","last_fullsized":"2024-09-14T11:54:19.884841+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'243","last_scrub_stamp":"2024-09-14T11:54:19.884635+0000","last_deep_scrub":"264'243","last_deep_scrub_stamp":"2024-09-14T11:54:19.884635+0000","last_clean_scrub_stamp":"2024-09-14T11:54:19.884635+0000","objects_scrubbed":9,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:08.377002+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":182,"num_read_kb":171,"num_write":149,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:33.968643+0000","last_change":"2024-09-14T11:54:33.968643+0000","last_active":"2024-09-14T11:54:33.968643+0000","last_peered":"2024-09-14T11:54:33.968643+0000","last_clean":"2024-09-14T11:54:33.968643+0000","last_became_active":"2024-09-14T11:09:53.007705+0000","last_became_peered":"2024-09-14T11:09:53.007705+0000","last_unstale":"2024-09-14T11:54:33.968643+0000","last_undegraded":"2024-09-14T11:54:33.968643+0000","last_fullsized":"2024-09-14T11:54:33.968643+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:33.968471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:33.968471+0000","last_clean_scrub_stamp":"2024-09-14T11:54:33.968471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:00.416592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"264'274","reported_seq":879,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.044419+0000","last_change":"2024-09-14T11:54:38.044137+0000","last_active":"2024-09-14T11:54:38.044419+0000","last_peered":"2024-09-14T11:54:38.044419+0000","last_clean":"2024-09-14T11:54:38.044419+0000","last_became_active":"2024-09-14T11:09:55.013944+0000","last_became_peered":"2024-09-14T11:09:55.013944+0000","last_unstale":"2024-09-14T11:54:38.044419+0000","last_undegraded":"2024-09-14T11:54:38.044419+0000","last_fullsized":"2024-09-14T11:54:38.044419+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'274","last_scrub_stamp":"2024-09-14T11:54:38.043916+0000","last_deep_scrub":"264'274","last_deep_scrub_stamp":"2024-09-14T11:54:38.043916+0000","last_clean_scrub_stamp":"2024-09-14T11:54:38.043916+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:39.814417+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":495,"num_read_kb":519,"num_write":596,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"264'934","reported_seq":2826,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.609638+0000","last_change":"2024-09-14T11:54:11.609638+0000","last_active":"2024-09-14T11:54:11.609638+0000","last_peered":"2024-09-14T11:54:11.609638+0000","last_clean":"2024-09-14T11:54:11.609638+0000","last_became_active":"2024-09-14T11:09:46.982027+0000","last_became_peered":"2024-09-14T11:09:46.982027+0000","last_unstale":"2024-09-14T11:54:11.609638+0000","last_undegraded":"2024-09-14T11:54:11.609638+0000","last_fullsized":"2024-09-14T11:54:11.609638+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'934","last_scrub_stamp":"2024-09-14T11:54:11.609414+0000","last_deep_scrub":"264'934","last_deep_scrub_stamp":"2024-09-14T11:54:11.609414+0000","last_clean_scrub_stamp":"2024-09-14T11:54:11.609414+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":900,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:10.281778+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4697,"num_read_kb":4271,"num_write":1214,"num_write_kb":435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3500,"num_omap_keys":14,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"264'3","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:02.833788+0000","last_change":"2024-09-14T11:54:02.833788+0000","last_active":"2024-09-14T11:54:02.833788+0000","last_peered":"2024-09-14T11:54:02.833788+0000","last_clean":"2024-09-14T11:54:02.833788+0000","last_became_active":"2024-09-14T11:09:36.887391+0000","last_became_peered":"2024-09-14T11:09:36.887391+0000","last_unstale":"2024-09-14T11:54:02.833788+0000","last_undegraded":"2024-09-14T11:54:02.833788+0000","last_fullsized":"2024-09-14T11:54:02.833788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:54:02.833629+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:54:02.833629+0000","last_clean_scrub_stamp":"2024-09-14T11:54:02.833629+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:54.259925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0023357849999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"264'265","reported_seq":918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.668795+0000","last_change":"2024-09-14T11:54:06.668795+0000","last_active":"2024-09-14T11:54:06.668795+0000","last_peered":"2024-09-14T11:54:06.668795+0000","last_clean":"2024-09-14T11:54:06.668795+0000","last_became_active":"2024-09-14T11:09:45.206492+0000","last_became_peered":"2024-09-14T11:09:45.206492+0000","last_unstale":"2024-09-14T11:54:06.668795+0000","last_undegraded":"2024-09-14T11:54:06.668795+0000","last_fullsized":"2024-09-14T11:54:06.668795+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'265","last_scrub_stamp":"2024-09-14T11:54:06.668580+0000","last_deep_scrub":"264'265","last_deep_scrub_stamp":"2024-09-14T11:54:06.668580+0000","last_clean_scrub_stamp":"2024-09-14T11:54:06.668580+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:06.267313+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":656,"num_read_kb":889,"num_write":1198,"num_write_kb":16465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:16.415674+0000","last_change":"2024-09-14T11:54:16.415674+0000","last_active":"2024-09-14T11:54:16.415674+0000","last_peered":"2024-09-14T11:54:16.415674+0000","last_clean":"2024-09-14T11:54:16.415674+0000","last_became_active":"2024-09-14T11:09:48.976315+0000","last_became_peered":"2024-09-14T11:09:48.976315+0000","last_unstale":"2024-09-14T11:54:16.415674+0000","last_undegraded":"2024-09-14T11:54:16.415674+0000","last_fullsized":"2024-09-14T11:54:16.415674+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:16.415478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:16.415478+0000","last_clean_scrub_stamp":"2024-09-14T11:54:16.415478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:28.319046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"264'128","reported_seq":674,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.102291+0000","last_change":"2024-09-14T11:54:28.101981+0000","last_active":"2024-09-14T11:54:28.102291+0000","last_peered":"2024-09-14T11:54:28.102291+0000","last_clean":"2024-09-14T11:54:28.102291+0000","last_became_active":"2024-09-14T11:09:50.983126+0000","last_became_peered":"2024-09-14T11:09:50.983126+0000","last_unstale":"2024-09-14T11:54:28.102291+0000","last_undegraded":"2024-09-14T11:54:28.102291+0000","last_fullsized":"2024-09-14T11:54:28.102291+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'128","last_scrub_stamp":"2024-09-14T11:54:28.101719+0000","last_deep_scrub":"264'128","last_deep_scrub_stamp":"2024-09-14T11:54:28.101719+0000","last_clean_scrub_stamp":"2024-09-14T11:54:28.101719+0000","objects_scrubbed":7,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:44.669683+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.699711+0000","last_change":"2024-09-14T11:54:42.699459+0000","last_active":"2024-09-14T11:54:42.699711+0000","last_peered":"2024-09-14T11:54:42.699711+0000","last_clean":"2024-09-14T11:54:42.699711+0000","last_became_active":"2024-09-14T11:09:53.015100+0000","last_became_peered":"2024-09-14T11:09:53.015100+0000","last_unstale":"2024-09-14T11:54:42.699711+0000","last_undegraded":"2024-09-14T11:54:42.699711+0000","last_fullsized":"2024-09-14T11:54:42.699711+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:42.699238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:42.699238+0000","last_clean_scrub_stamp":"2024-09-14T11:54:42.699238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:22.933735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"264'127","reported_seq":685,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.585876+0000","last_change":"2024-09-14T11:54:26.585876+0000","last_active":"2024-09-14T11:54:26.585876+0000","last_peered":"2024-09-14T11:54:26.585876+0000","last_clean":"2024-09-14T11:54:26.585876+0000","last_became_active":"2024-09-14T11:09:55.025030+0000","last_became_peered":"2024-09-14T11:09:55.025030+0000","last_unstale":"2024-09-14T11:54:26.585876+0000","last_undegraded":"2024-09-14T11:54:26.585876+0000","last_fullsized":"2024-09-14T11:54:26.585876+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'127","last_scrub_stamp":"2024-09-14T11:54:26.585644+0000","last_deep_scrub":"264'127","last_deep_scrub_stamp":"2024-09-14T11:54:26.585644+0000","last_clean_scrub_stamp":"2024-09-14T11:54:26.585644+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:50:23.463245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":244,"num_read_kb":234,"num_write":307,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"264'432","reported_seq":1982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.590727+0000","last_change":"2024-09-14T11:54:13.590727+0000","last_active":"2024-09-14T11:54:13.590727+0000","last_peered":"2024-09-14T11:54:13.590727+0000","last_clean":"2024-09-14T11:54:13.590727+0000","last_became_active":"2024-09-14T11:09:46.981578+0000","last_became_peered":"2024-09-14T11:09:46.981578+0000","last_unstale":"2024-09-14T11:54:13.590727+0000","last_undegraded":"2024-09-14T11:54:13.590727+0000","last_fullsized":"2024-09-14T11:54:13.590727+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'432","last_scrub_stamp":"2024-09-14T11:54:13.590489+0000","last_deep_scrub":"264'432","last_deep_scrub_stamp":"2024-09-14T11:54:13.590489+0000","last_clean_scrub_stamp":"2024-09-14T11:54:13.590489+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:33.384996+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2336,"num_read_kb":2209,"num_write":501,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"264'246","reported_seq":892,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.337591+0000","last_change":"2024-09-14T11:54:06.337591+0000","last_active":"2024-09-14T11:54:06.337591+0000","last_peered":"2024-09-14T11:54:06.337591+0000","last_clean":"2024-09-14T11:54:06.337591+0000","last_became_active":"2024-09-14T11:09:45.216168+0000","last_became_peered":"2024-09-14T11:09:45.216168+0000","last_unstale":"2024-09-14T11:54:06.337591+0000","last_undegraded":"2024-09-14T11:54:06.337591+0000","last_fullsized":"2024-09-14T11:54:06.337591+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'246","last_scrub_stamp":"2024-09-14T11:54:06.337308+0000","last_deep_scrub":"264'246","last_deep_scrub_stamp":"2024-09-14T11:54:06.337308+0000","last_clean_scrub_stamp":"2024-09-14T11:54:06.337308+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:05.110637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":603,"num_read_kb":12400,"num_write":1048,"num_write_kb":24779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.160781+0000","last_change":"2024-09-14T11:54:04.160781+0000","last_active":"2024-09-14T11:54:04.160781+0000","last_peered":"2024-09-14T11:54:04.160781+0000","last_clean":"2024-09-14T11:54:04.160781+0000","last_became_active":"2024-09-14T11:09:36.887411+0000","last_became_peered":"2024-09-14T11:09:36.887411+0000","last_unstale":"2024-09-14T11:54:04.160781+0000","last_undegraded":"2024-09-14T11:54:04.160781+0000","last_fullsized":"2024-09-14T11:54:04.160781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:04.160581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:04.160581+0000","last_clean_scrub_stamp":"2024-09-14T11:54:04.160581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:54.717604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001210341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.809935+0000","last_change":"2024-09-14T11:54:20.809935+0000","last_active":"2024-09-14T11:54:20.809935+0000","last_peered":"2024-09-14T11:54:20.809935+0000","last_clean":"2024-09-14T11:54:20.809935+0000","last_became_active":"2024-09-14T11:09:48.969262+0000","last_became_peered":"2024-09-14T11:09:48.969262+0000","last_unstale":"2024-09-14T11:54:20.809935+0000","last_undegraded":"2024-09-14T11:54:20.809935+0000","last_fullsized":"2024-09-14T11:54:20.809935+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:20.809747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:20.809747+0000","last_clean_scrub_stamp":"2024-09-14T11:54:20.809747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:07.903941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"264'289","reported_seq":952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.417729+0000","last_change":"2024-09-14T11:54:18.417729+0000","last_active":"2024-09-14T11:54:18.417729+0000","last_peered":"2024-09-14T11:54:18.417729+0000","last_clean":"2024-09-14T11:54:18.417729+0000","last_became_active":"2024-09-14T11:09:50.991958+0000","last_became_peered":"2024-09-14T11:09:50.991958+0000","last_unstale":"2024-09-14T11:54:18.417729+0000","last_undegraded":"2024-09-14T11:54:18.417729+0000","last_fullsized":"2024-09-14T11:54:18.417729+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'289","last_scrub_stamp":"2024-09-14T11:54:18.417492+0000","last_deep_scrub":"264'289","last_deep_scrub_stamp":"2024-09-14T11:54:18.417492+0000","last_clean_scrub_stamp":"2024-09-14T11:54:18.417492+0000","objects_scrubbed":10,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:27.379177+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26179,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1035,"num_read_kb":1185,"num_write":1534,"num_write_kb":1392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":535828,"num_omap_keys":1208,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.328687+0000","last_change":"2024-09-14T11:54:18.328687+0000","last_active":"2024-09-14T11:54:18.328687+0000","last_peered":"2024-09-14T11:54:18.328687+0000","last_clean":"2024-09-14T11:54:18.328687+0000","last_became_active":"2024-09-14T11:09:53.001945+0000","last_became_peered":"2024-09-14T11:09:53.001945+0000","last_unstale":"2024-09-14T11:54:18.328687+0000","last_undegraded":"2024-09-14T11:54:18.328687+0000","last_fullsized":"2024-09-14T11:54:18.328687+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:18.328403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:18.328403+0000","last_clean_scrub_stamp":"2024-09-14T11:54:18.328403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:12.397430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"264'180","reported_seq":724,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:39.104074+0000","last_change":"2024-09-14T11:54:39.103932+0000","last_active":"2024-09-14T11:54:39.104074+0000","last_peered":"2024-09-14T11:54:39.104074+0000","last_clean":"2024-09-14T11:54:39.104074+0000","last_became_active":"2024-09-14T11:09:55.019043+0000","last_became_peered":"2024-09-14T11:09:55.019043+0000","last_unstale":"2024-09-14T11:54:39.104074+0000","last_undegraded":"2024-09-14T11:54:39.104074+0000","last_fullsized":"2024-09-14T11:54:39.104074+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'180","last_scrub_stamp":"2024-09-14T11:54:39.103736+0000","last_deep_scrub":"264'180","last_deep_scrub_stamp":"2024-09-14T11:54:39.103736+0000","last_clean_scrub_stamp":"2024-09-14T11:54:39.103736+0000","objects_scrubbed":4,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:11:28.065517+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":311,"num_read_kb":271,"num_write":434,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"264'394","reported_seq":1919,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.629013+0000","last_change":"2024-09-14T11:54:08.629013+0000","last_active":"2024-09-14T11:54:08.629013+0000","last_peered":"2024-09-14T11:54:08.629013+0000","last_clean":"2024-09-14T11:54:08.629013+0000","last_became_active":"2024-09-14T11:09:46.979673+0000","last_became_peered":"2024-09-14T11:09:46.979673+0000","last_unstale":"2024-09-14T11:54:08.629013+0000","last_undegraded":"2024-09-14T11:54:08.629013+0000","last_fullsized":"2024-09-14T11:54:08.629013+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'394","last_scrub_stamp":"2024-09-14T11:54:08.628827+0000","last_deep_scrub":"264'394","last_deep_scrub_stamp":"2024-09-14T11:54:08.628827+0000","last_clean_scrub_stamp":"2024-09-14T11:54:08.628827+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:41.485918+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2181,"num_read_kb":2077,"num_write":440,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":892,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"264'177","reported_seq":756,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:03.638455+0000","last_change":"2024-09-14T11:54:03.638455+0000","last_active":"2024-09-14T11:54:03.638455+0000","last_peered":"2024-09-14T11:54:03.638455+0000","last_clean":"2024-09-14T11:54:03.638455+0000","last_became_active":"2024-09-14T11:09:45.220512+0000","last_became_peered":"2024-09-14T11:09:45.220512+0000","last_unstale":"2024-09-14T11:54:03.638455+0000","last_undegraded":"2024-09-14T11:54:03.638455+0000","last_fullsized":"2024-09-14T11:54:03.638455+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-09-14T11:54:03.638201+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-09-14T11:54:03.638201+0000","last_clean_scrub_stamp":"2024-09-14T11:54:03.638201+0000","objects_scrubbed":6,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:08.150074+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655861,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":337,"num_read_kb":1928,"num_write":799,"num_write_kb":32938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.796853+0000","last_change":"2024-09-14T11:54:05.796853+0000","last_active":"2024-09-14T11:54:05.796853+0000","last_peered":"2024-09-14T11:54:05.796853+0000","last_clean":"2024-09-14T11:54:05.796853+0000","last_became_active":"2024-09-14T11:09:36.110624+0000","last_became_peered":"2024-09-14T11:09:36.110624+0000","last_unstale":"2024-09-14T11:54:05.796853+0000","last_undegraded":"2024-09-14T11:54:05.796853+0000","last_fullsized":"2024-09-14T11:54:05.796853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:05.796663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:05.796663+0000","last_clean_scrub_stamp":"2024-09-14T11:54:05.796663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:14.358427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.002569127,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:16.834905+0000","last_change":"2024-09-14T11:54:16.834905+0000","last_active":"2024-09-14T11:54:16.834905+0000","last_peered":"2024-09-14T11:54:16.834905+0000","last_clean":"2024-09-14T11:54:16.834905+0000","last_became_active":"2024-09-14T11:09:48.968130+0000","last_became_peered":"2024-09-14T11:09:48.968130+0000","last_unstale":"2024-09-14T11:54:16.834905+0000","last_undegraded":"2024-09-14T11:54:16.834905+0000","last_fullsized":"2024-09-14T11:54:16.834905+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:16.834719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:16.834719+0000","last_clean_scrub_stamp":"2024-09-14T11:54:16.834719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:03.396931+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"264'164","reported_seq":731,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:21.634619+0000","last_change":"2024-09-14T11:54:21.634619+0000","last_active":"2024-09-14T11:54:21.634619+0000","last_peered":"2024-09-14T11:54:21.634619+0000","last_clean":"2024-09-14T11:54:21.634619+0000","last_became_active":"2024-09-14T11:09:50.997665+0000","last_became_peered":"2024-09-14T11:09:50.997665+0000","last_unstale":"2024-09-14T11:54:21.634619+0000","last_undegraded":"2024-09-14T11:54:21.634619+0000","last_fullsized":"2024-09-14T11:54:21.634619+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'164","last_scrub_stamp":"2024-09-14T11:54:21.634404+0000","last_deep_scrub":"264'164","last_deep_scrub_stamp":"2024-09-14T11:54:21.634404+0000","last_clean_scrub_stamp":"2024-09-14T11:54:21.634404+0000","objects_scrubbed":7,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:42.569487+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":193,"num_read_kb":186,"num_write":126,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"264'803","reported_seq":2781,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.590790+0000","last_change":"2024-09-14T11:54:22.590790+0000","last_active":"2024-09-14T11:54:22.590790+0000","last_peered":"2024-09-14T11:54:22.590790+0000","last_clean":"2024-09-14T11:54:22.590790+0000","last_became_active":"2024-09-14T11:09:53.018558+0000","last_became_peered":"2024-09-14T11:09:53.018558+0000","last_unstale":"2024-09-14T11:54:22.590790+0000","last_undegraded":"2024-09-14T11:54:22.590790+0000","last_fullsized":"2024-09-14T11:54:22.590790+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'803","last_scrub_stamp":"2024-09-14T11:54:22.590509+0000","last_deep_scrub":"264'803","last_deep_scrub_stamp":"2024-09-14T11:54:22.590509+0000","last_clean_scrub_stamp":"2024-09-14T11:54:22.590509+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:46:00.083819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"264'105","reported_seq":605,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:29.396479+0000","last_change":"2024-09-14T11:54:29.396336+0000","last_active":"2024-09-14T11:54:29.396479+0000","last_peered":"2024-09-14T11:54:29.396479+0000","last_clean":"2024-09-14T11:54:29.396479+0000","last_became_active":"2024-09-14T11:09:55.017739+0000","last_became_peered":"2024-09-14T11:09:55.017739+0000","last_unstale":"2024-09-14T11:54:29.396479+0000","last_undegraded":"2024-09-14T11:54:29.396479+0000","last_fullsized":"2024-09-14T11:54:29.396479+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'105","last_scrub_stamp":"2024-09-14T11:54:29.396141+0000","last_deep_scrub":"264'105","last_deep_scrub_stamp":"2024-09-14T11:54:29.396141+0000","last_clean_scrub_stamp":"2024-09-14T11:54:29.396141+0000","objects_scrubbed":4,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:14.770917+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":97,"num_read_kb":96,"num_write":232,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"264'1042","reported_seq":2583,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.687055+0000","last_change":"2024-09-14T11:54:09.687055+0000","last_active":"2024-09-14T11:54:09.687055+0000","last_peered":"2024-09-14T11:54:09.687055+0000","last_clean":"2024-09-14T11:54:09.687055+0000","last_became_active":"2024-09-14T11:09:46.958507+0000","last_became_peered":"2024-09-14T11:09:46.958507+0000","last_unstale":"2024-09-14T11:54:09.687055+0000","last_undegraded":"2024-09-14T11:54:09.687055+0000","last_fullsized":"2024-09-14T11:54:09.687055+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1042","last_scrub_stamp":"2024-09-14T11:54:09.686859+0000","last_deep_scrub":"264'1042","last_deep_scrub_stamp":"2024-09-14T11:54:09.686859+0000","last_clean_scrub_stamp":"2024-09-14T11:54:09.686859+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":1000,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:03.681837+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4784,"num_read_kb":4190,"num_write":1482,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"264'220","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.762213+0000","last_change":"2024-09-14T11:54:05.762074+0000","last_active":"2024-09-14T11:54:05.762213+0000","last_peered":"2024-09-14T11:54:05.762213+0000","last_clean":"2024-09-14T11:54:05.762213+0000","last_became_active":"2024-09-14T11:09:45.217039+0000","last_became_peered":"2024-09-14T11:09:45.217039+0000","last_unstale":"2024-09-14T11:54:05.762213+0000","last_undegraded":"2024-09-14T11:54:05.762213+0000","last_fullsized":"2024-09-14T11:54:05.762213+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'220","last_scrub_stamp":"2024-09-14T11:54:05.761858+0000","last_deep_scrub":"264'220","last_deep_scrub_stamp":"2024-09-14T11:54:05.761858+0000","last_clean_scrub_stamp":"2024-09-14T11:54:05.761858+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:30.840271+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":539,"num_read_kb":14764,"num_write":981,"num_write_kb":31870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:02.753024+0000","last_change":"2024-09-14T11:54:02.752870+0000","last_active":"2024-09-14T11:54:02.753024+0000","last_peered":"2024-09-14T11:54:02.753024+0000","last_clean":"2024-09-14T11:54:02.753024+0000","last_became_active":"2024-09-14T11:09:36.106073+0000","last_became_peered":"2024-09-14T11:09:36.106073+0000","last_unstale":"2024-09-14T11:54:02.753024+0000","last_undegraded":"2024-09-14T11:54:02.753024+0000","last_fullsized":"2024-09-14T11:54:02.753024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:02.752684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:02.752684+0000","last_clean_scrub_stamp":"2024-09-14T11:54:02.752684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:30.079185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012975129999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.856207+0000","last_change":"2024-09-14T11:54:28.856207+0000","last_active":"2024-09-14T11:54:28.856207+0000","last_peered":"2024-09-14T11:54:28.856207+0000","last_clean":"2024-09-14T11:54:28.856207+0000","last_became_active":"2024-09-14T11:09:48.970339+0000","last_became_peered":"2024-09-14T11:09:48.970339+0000","last_unstale":"2024-09-14T11:54:28.856207+0000","last_undegraded":"2024-09-14T11:54:28.856207+0000","last_fullsized":"2024-09-14T11:54:28.856207+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:28.856019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:28.856019+0000","last_clean_scrub_stamp":"2024-09-14T11:54:28.856019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:07.889082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"264'127","reported_seq":666,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:33.738196+0000","last_change":"2024-09-14T11:54:33.738196+0000","last_active":"2024-09-14T11:54:33.738196+0000","last_peered":"2024-09-14T11:54:33.738196+0000","last_clean":"2024-09-14T11:54:33.738196+0000","last_became_active":"2024-09-14T11:09:50.979827+0000","last_became_peered":"2024-09-14T11:09:50.979827+0000","last_unstale":"2024-09-14T11:54:33.738196+0000","last_undegraded":"2024-09-14T11:54:33.738196+0000","last_fullsized":"2024-09-14T11:54:33.738196+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'127","last_scrub_stamp":"2024-09-14T11:54:33.738016+0000","last_deep_scrub":"264'127","last_deep_scrub_stamp":"2024-09-14T11:54:33.738016+0000","last_clean_scrub_stamp":"2024-09-14T11:54:33.738016+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:42.416480+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":133,"num_read_kb":122,"num_write":94,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"264'803","reported_seq":2488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:30.106338+0000","last_change":"2024-09-14T11:54:30.106338+0000","last_active":"2024-09-14T11:54:30.106338+0000","last_peered":"2024-09-14T11:54:30.106338+0000","last_clean":"2024-09-14T11:54:30.106338+0000","last_became_active":"2024-09-14T11:09:53.007337+0000","last_became_peered":"2024-09-14T11:09:53.007337+0000","last_unstale":"2024-09-14T11:54:30.106338+0000","last_undegraded":"2024-09-14T11:54:30.106338+0000","last_fullsized":"2024-09-14T11:54:30.106338+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'803","last_scrub_stamp":"2024-09-14T11:54:30.106144+0000","last_deep_scrub":"264'803","last_deep_scrub_stamp":"2024-09-14T11:54:30.106144+0000","last_clean_scrub_stamp":"2024-09-14T11:54:30.106144+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:49.440969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"264'271","reported_seq":806,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:37.145858+0000","last_change":"2024-09-14T11:54:37.145706+0000","last_active":"2024-09-14T11:54:37.145858+0000","last_peered":"2024-09-14T11:54:37.145858+0000","last_clean":"2024-09-14T11:54:37.145858+0000","last_became_active":"2024-09-14T11:09:55.011828+0000","last_became_peered":"2024-09-14T11:09:55.011828+0000","last_unstale":"2024-09-14T11:54:37.145858+0000","last_undegraded":"2024-09-14T11:54:37.145858+0000","last_fullsized":"2024-09-14T11:54:37.145858+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'271","last_scrub_stamp":"2024-09-14T11:54:37.145521+0000","last_deep_scrub":"264'271","last_deep_scrub_stamp":"2024-09-14T11:54:37.145521+0000","last_clean_scrub_stamp":"2024-09-14T11:54:37.145521+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:04.142063+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":359,"num_read_kb":349,"num_write":571,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"264'1163","reported_seq":2668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.302504+0000","last_change":"2024-09-14T11:54:05.302504+0000","last_active":"2024-09-14T11:54:05.302504+0000","last_peered":"2024-09-14T11:54:05.302504+0000","last_clean":"2024-09-14T11:54:05.302504+0000","last_became_active":"2024-09-14T11:09:46.946010+0000","last_became_peered":"2024-09-14T11:09:46.946010+0000","last_unstale":"2024-09-14T11:54:05.302504+0000","last_undegraded":"2024-09-14T11:54:05.302504+0000","last_fullsized":"2024-09-14T11:54:05.302504+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1163","last_scrub_stamp":"2024-09-14T11:54:05.302255+0000","last_deep_scrub":"264'1163","last_deep_scrub_stamp":"2024-09-14T11:54:05.302255+0000","last_clean_scrub_stamp":"2024-09-14T11:54:05.302255+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":1100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:58.209905+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5209,"num_read_kb":4587,"num_write":1598,"num_write_kb":661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":272,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"264'212","reported_seq":891,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.735634+0000","last_change":"2024-09-14T11:54:04.735457+0000","last_active":"2024-09-14T11:54:04.735634+0000","last_peered":"2024-09-14T11:54:04.735634+0000","last_clean":"2024-09-14T11:54:04.735634+0000","last_became_active":"2024-09-14T11:09:45.212500+0000","last_became_peered":"2024-09-14T11:09:45.212500+0000","last_unstale":"2024-09-14T11:54:04.735634+0000","last_undegraded":"2024-09-14T11:54:04.735634+0000","last_fullsized":"2024-09-14T11:54:04.735634+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'212","last_scrub_stamp":"2024-09-14T11:54:04.735162+0000","last_deep_scrub":"264'212","last_deep_scrub_stamp":"2024-09-14T11:54:04.735162+0000","last_clean_scrub_stamp":"2024-09-14T11:54:04.735162+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:20.313589+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":655,"num_read_kb":3804,"num_write":900,"num_write_kb":25360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.758653+0000","last_change":"2024-09-14T11:54:06.758528+0000","last_active":"2024-09-14T11:54:06.758653+0000","last_peered":"2024-09-14T11:54:06.758653+0000","last_clean":"2024-09-14T11:54:06.758653+0000","last_became_active":"2024-09-14T11:09:36.108781+0000","last_became_peered":"2024-09-14T11:09:36.108781+0000","last_unstale":"2024-09-14T11:54:06.758653+0000","last_undegraded":"2024-09-14T11:54:06.758653+0000","last_fullsized":"2024-09-14T11:54:06.758653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:06.758347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:06.758347+0000","last_clean_scrub_stamp":"2024-09-14T11:54:06.758347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:28:12.438815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002510581,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.798261+0000","last_change":"2024-09-14T11:54:19.798261+0000","last_active":"2024-09-14T11:54:19.798261+0000","last_peered":"2024-09-14T11:54:19.798261+0000","last_clean":"2024-09-14T11:54:19.798261+0000","last_became_active":"2024-09-14T11:09:48.970940+0000","last_became_peered":"2024-09-14T11:09:48.970940+0000","last_unstale":"2024-09-14T11:54:19.798261+0000","last_undegraded":"2024-09-14T11:54:19.798261+0000","last_fullsized":"2024-09-14T11:54:19.798261+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:19.798083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:19.798083+0000","last_clean_scrub_stamp":"2024-09-14T11:54:19.798083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:16.786632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"264'316","reported_seq":1034,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.851005+0000","last_change":"2024-09-14T11:54:18.851005+0000","last_active":"2024-09-14T11:54:18.851005+0000","last_peered":"2024-09-14T11:54:18.851005+0000","last_clean":"2024-09-14T11:54:18.851005+0000","last_became_active":"2024-09-14T11:09:50.992374+0000","last_became_peered":"2024-09-14T11:09:50.992374+0000","last_unstale":"2024-09-14T11:54:18.851005+0000","last_undegraded":"2024-09-14T11:54:18.851005+0000","last_fullsized":"2024-09-14T11:54:18.851005+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'316","last_scrub_stamp":"2024-09-14T11:54:18.850798+0000","last_deep_scrub":"264'316","last_deep_scrub_stamp":"2024-09-14T11:54:18.850798+0000","last_clean_scrub_stamp":"2024-09-14T11:54:18.850798+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:16.507010+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20511,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":444,"num_read_kb":597,"num_write":216,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:33.010265+0000","last_change":"2024-09-14T11:54:33.010265+0000","last_active":"2024-09-14T11:54:33.010265+0000","last_peered":"2024-09-14T11:54:33.010265+0000","last_clean":"2024-09-14T11:54:33.010265+0000","last_became_active":"2024-09-14T11:09:53.002904+0000","last_became_peered":"2024-09-14T11:09:53.002904+0000","last_unstale":"2024-09-14T11:54:33.010265+0000","last_undegraded":"2024-09-14T11:54:33.010265+0000","last_fullsized":"2024-09-14T11:54:33.010265+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:33.010079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:33.010079+0000","last_clean_scrub_stamp":"2024-09-14T11:54:33.010079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:39:42.102479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"264'134","reported_seq":643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.336831+0000","last_change":"2024-09-14T11:54:26.336573+0000","last_active":"2024-09-14T11:54:26.336831+0000","last_peered":"2024-09-14T11:54:26.336831+0000","last_clean":"2024-09-14T11:54:26.336831+0000","last_became_active":"2024-09-14T11:09:55.014192+0000","last_became_peered":"2024-09-14T11:09:55.014192+0000","last_unstale":"2024-09-14T11:54:26.336831+0000","last_undegraded":"2024-09-14T11:54:26.336831+0000","last_fullsized":"2024-09-14T11:54:26.336831+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'134","last_scrub_stamp":"2024-09-14T11:54:26.336329+0000","last_deep_scrub":"264'134","last_deep_scrub_stamp":"2024-09-14T11:54:26.336329+0000","last_clean_scrub_stamp":"2024-09-14T11:54:26.336329+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:52:14.198542+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":132,"num_write":303,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"264'165","reported_seq":755,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:39.092236+0000","last_change":"2024-09-14T11:54:39.092236+0000","last_active":"2024-09-14T11:54:39.092236+0000","last_peered":"2024-09-14T11:54:39.092236+0000","last_clean":"2024-09-14T11:54:39.092236+0000","last_became_active":"2024-09-14T11:09:55.015127+0000","last_became_peered":"2024-09-14T11:09:55.015127+0000","last_unstale":"2024-09-14T11:54:39.092236+0000","last_undegraded":"2024-09-14T11:54:39.092236+0000","last_fullsized":"2024-09-14T11:54:39.092236+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'165","last_scrub_stamp":"2024-09-14T11:54:39.091942+0000","last_deep_scrub":"264'165","last_deep_scrub_stamp":"2024-09-14T11:54:39.091942+0000","last_clean_scrub_stamp":"2024-09-14T11:54:39.091942+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:38.689842+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":313,"num_read_kb":285,"num_write":384,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"264'825","reported_seq":2491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.394964+0000","last_change":"2024-09-14T11:54:13.394964+0000","last_active":"2024-09-14T11:54:13.394964+0000","last_peered":"2024-09-14T11:54:13.394964+0000","last_clean":"2024-09-14T11:54:13.394964+0000","last_became_active":"2024-09-14T11:09:46.948706+0000","last_became_peered":"2024-09-14T11:09:46.948706+0000","last_unstale":"2024-09-14T11:54:13.394964+0000","last_undegraded":"2024-09-14T11:54:13.394964+0000","last_fullsized":"2024-09-14T11:54:13.394964+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'825","last_scrub_stamp":"2024-09-14T11:54:13.394780+0000","last_deep_scrub":"264'825","last_deep_scrub_stamp":"2024-09-14T11:54:13.394780+0000","last_clean_scrub_stamp":"2024-09-14T11:54:13.394780+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:09.219229+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4239,"num_read_kb":3866,"num_write":1097,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2295,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"264'194","reported_seq":844,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.818862+0000","last_change":"2024-09-14T11:54:14.818716+0000","last_active":"2024-09-14T11:54:14.818862+0000","last_peered":"2024-09-14T11:54:14.818862+0000","last_clean":"2024-09-14T11:54:14.818862+0000","last_became_active":"2024-09-14T11:09:45.201562+0000","last_became_peered":"2024-09-14T11:09:45.201562+0000","last_unstale":"2024-09-14T11:54:14.818862+0000","last_undegraded":"2024-09-14T11:54:14.818862+0000","last_fullsized":"2024-09-14T11:54:14.818862+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'194","last_scrub_stamp":"2024-09-14T11:54:14.818523+0000","last_deep_scrub":"264'194","last_deep_scrub_stamp":"2024-09-14T11:54:14.818523+0000","last_clean_scrub_stamp":"2024-09-14T11:54:14.818523+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:51:40.122733+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655874,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":505,"num_read_kb":86083,"num_write":869,"num_write_kb":49236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.602327+0000","last_change":"2024-09-14T11:54:20.602327+0000","last_active":"2024-09-14T11:54:20.602327+0000","last_peered":"2024-09-14T11:54:20.602327+0000","last_clean":"2024-09-14T11:54:20.602327+0000","last_became_active":"2024-09-14T11:09:48.962619+0000","last_became_peered":"2024-09-14T11:09:48.962619+0000","last_unstale":"2024-09-14T11:54:20.602327+0000","last_undegraded":"2024-09-14T11:54:20.602327+0000","last_fullsized":"2024-09-14T11:54:20.602327+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:20.602135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:20.602135+0000","last_clean_scrub_stamp":"2024-09-14T11:54:20.602135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:46.015649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"264'175","reported_seq":753,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:23.656894+0000","last_change":"2024-09-14T11:54:23.656894+0000","last_active":"2024-09-14T11:54:23.656894+0000","last_peered":"2024-09-14T11:54:23.656894+0000","last_clean":"2024-09-14T11:54:23.656894+0000","last_became_active":"2024-09-14T11:09:50.996047+0000","last_became_peered":"2024-09-14T11:09:50.996047+0000","last_unstale":"2024-09-14T11:54:23.656894+0000","last_undegraded":"2024-09-14T11:54:23.656894+0000","last_fullsized":"2024-09-14T11:54:23.656894+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'175","last_scrub_stamp":"2024-09-14T11:54:23.656676+0000","last_deep_scrub":"264'175","last_deep_scrub_stamp":"2024-09-14T11:54:23.656676+0000","last_clean_scrub_stamp":"2024-09-14T11:54:23.656676+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:01.298471+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28669,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":205,"num_read_kb":341,"num_write":126,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:23.273840+0000","last_change":"2024-09-14T11:54:23.273840+0000","last_active":"2024-09-14T11:54:23.273840+0000","last_peered":"2024-09-14T11:54:23.273840+0000","last_clean":"2024-09-14T11:54:23.273840+0000","last_became_active":"2024-09-14T11:09:53.000339+0000","last_became_peered":"2024-09-14T11:09:53.000339+0000","last_unstale":"2024-09-14T11:54:23.273840+0000","last_undegraded":"2024-09-14T11:54:23.273840+0000","last_fullsized":"2024-09-14T11:54:23.273840+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:23.273658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:23.273658+0000","last_clean_scrub_stamp":"2024-09-14T11:54:23.273658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:38:03.101466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"264'95","reported_seq":589,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:32.485486+0000","last_change":"2024-09-14T11:54:32.485486+0000","last_active":"2024-09-14T11:54:32.485486+0000","last_peered":"2024-09-14T11:54:32.485486+0000","last_clean":"2024-09-14T11:54:32.485486+0000","last_became_active":"2024-09-14T11:09:55.022477+0000","last_became_peered":"2024-09-14T11:09:55.022477+0000","last_unstale":"2024-09-14T11:54:32.485486+0000","last_undegraded":"2024-09-14T11:54:32.485486+0000","last_fullsized":"2024-09-14T11:54:32.485486+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'95","last_scrub_stamp":"2024-09-14T11:54:32.485306+0000","last_deep_scrub":"264'95","last_deep_scrub_stamp":"2024-09-14T11:54:32.485306+0000","last_clean_scrub_stamp":"2024-09-14T11:54:32.485306+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:28.186314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":73,"num_write":206,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"264'414","reported_seq":1955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.649873+0000","last_change":"2024-09-14T11:54:10.649873+0000","last_active":"2024-09-14T11:54:10.649873+0000","last_peered":"2024-09-14T11:54:10.649873+0000","last_clean":"2024-09-14T11:54:10.649873+0000","last_became_active":"2024-09-14T11:09:46.948572+0000","last_became_peered":"2024-09-14T11:09:46.948572+0000","last_unstale":"2024-09-14T11:54:10.649873+0000","last_undegraded":"2024-09-14T11:54:10.649873+0000","last_fullsized":"2024-09-14T11:54:10.649873+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'414","last_scrub_stamp":"2024-09-14T11:54:10.649705+0000","last_deep_scrub":"264'414","last_deep_scrub_stamp":"2024-09-14T11:54:10.649705+0000","last_clean_scrub_stamp":"2024-09-14T11:54:10.649705+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:12.848610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2176,"num_read_kb":2078,"num_write":464,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"264'236","reported_seq":860,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:02.763944+0000","last_change":"2024-09-14T11:54:02.763944+0000","last_active":"2024-09-14T11:54:02.763944+0000","last_peered":"2024-09-14T11:54:02.763944+0000","last_clean":"2024-09-14T11:54:02.763944+0000","last_became_active":"2024-09-14T11:09:45.223324+0000","last_became_peered":"2024-09-14T11:09:45.223324+0000","last_unstale":"2024-09-14T11:54:02.763944+0000","last_undegraded":"2024-09-14T11:54:02.763944+0000","last_fullsized":"2024-09-14T11:54:02.763944+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'236","last_scrub_stamp":"2024-09-14T11:54:02.763871+0000","last_deep_scrub":"264'236","last_deep_scrub_stamp":"2024-09-14T11:54:02.763871+0000","last_clean_scrub_stamp":"2024-09-14T11:54:02.763871+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:42.678734+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655868,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":554,"num_read_kb":7834,"num_write":1127,"num_write_kb":26023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"264'4","reported_seq":988,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:23.889113+0000","last_change":"2024-09-14T11:54:23.889113+0000","last_active":"2024-09-14T11:54:23.889113+0000","last_peered":"2024-09-14T11:54:23.889113+0000","last_clean":"2024-09-14T11:54:23.889113+0000","last_became_active":"2024-09-14T11:09:48.968561+0000","last_became_peered":"2024-09-14T11:09:48.968561+0000","last_unstale":"2024-09-14T11:54:23.889113+0000","last_undegraded":"2024-09-14T11:54:23.889113+0000","last_fullsized":"2024-09-14T11:54:23.889113+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T11:54:23.888928+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T11:54:23.888928+0000","last_clean_scrub_stamp":"2024-09-14T11:54:23.888928+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:46:06.061212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":728,"num_read_kb":726,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"264'47","reported_seq":557,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.898965+0000","last_change":"2024-09-14T11:54:27.898965+0000","last_active":"2024-09-14T11:54:27.898965+0000","last_peered":"2024-09-14T11:54:27.898965+0000","last_clean":"2024-09-14T11:54:27.898965+0000","last_became_active":"2024-09-14T11:09:50.981128+0000","last_became_peered":"2024-09-14T11:09:50.981128+0000","last_unstale":"2024-09-14T11:54:27.898965+0000","last_undegraded":"2024-09-14T11:54:27.898965+0000","last_fullsized":"2024-09-14T11:54:27.898965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'47","last_scrub_stamp":"2024-09-14T11:54:27.898748+0000","last_deep_scrub":"264'47","last_deep_scrub_stamp":"2024-09-14T11:54:27.898748+0000","last_clean_scrub_stamp":"2024-09-14T11:54:27.898748+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:00.300018+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.306525+0000","last_change":"2024-09-14T11:54:20.306525+0000","last_active":"2024-09-14T11:54:20.306525+0000","last_peered":"2024-09-14T11:54:20.306525+0000","last_clean":"2024-09-14T11:54:20.306525+0000","last_became_active":"2024-09-14T11:09:53.006292+0000","last_became_peered":"2024-09-14T11:09:53.006292+0000","last_unstale":"2024-09-14T11:54:20.306525+0000","last_undegraded":"2024-09-14T11:54:20.306525+0000","last_fullsized":"2024-09-14T11:54:20.306525+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:20.306354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:20.306354+0000","last_clean_scrub_stamp":"2024-09-14T11:54:20.306354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:34.456657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"264'207","reported_seq":733,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:31.610859+0000","last_change":"2024-09-14T11:54:31.610670+0000","last_active":"2024-09-14T11:54:31.610859+0000","last_peered":"2024-09-14T11:54:31.610859+0000","last_clean":"2024-09-14T11:54:31.610859+0000","last_became_active":"2024-09-14T11:09:55.014414+0000","last_became_peered":"2024-09-14T11:09:55.014414+0000","last_unstale":"2024-09-14T11:54:31.610859+0000","last_undegraded":"2024-09-14T11:54:31.610859+0000","last_fullsized":"2024-09-14T11:54:31.610859+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'207","last_scrub_stamp":"2024-09-14T11:54:31.610484+0000","last_deep_scrub":"264'207","last_deep_scrub_stamp":"2024-09-14T11:54:31.610484+0000","last_clean_scrub_stamp":"2024-09-14T11:54:31.610484+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:59.574341+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":294,"num_read_kb":289,"num_write":451,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"264'677","reported_seq":2440,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.681990+0000","last_change":"2024-09-14T11:54:14.681990+0000","last_active":"2024-09-14T11:54:14.681990+0000","last_peered":"2024-09-14T11:54:14.681990+0000","last_clean":"2024-09-14T11:54:14.681990+0000","last_became_active":"2024-09-14T11:09:46.962508+0000","last_became_peered":"2024-09-14T11:09:46.962508+0000","last_unstale":"2024-09-14T11:54:14.681990+0000","last_undegraded":"2024-09-14T11:54:14.681990+0000","last_fullsized":"2024-09-14T11:54:14.681990+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'677","last_scrub_stamp":"2024-09-14T11:54:14.681778+0000","last_deep_scrub":"264'677","last_deep_scrub_stamp":"2024-09-14T11:54:14.681778+0000","last_clean_scrub_stamp":"2024-09-14T11:54:14.681778+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":600,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:39.225516+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3732,"num_read_kb":3415,"num_write":933,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"264'190","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.341400+0000","last_change":"2024-09-14T11:54:04.341400+0000","last_active":"2024-09-14T11:54:04.341400+0000","last_peered":"2024-09-14T11:54:04.341400+0000","last_clean":"2024-09-14T11:54:04.341400+0000","last_became_active":"2024-09-14T11:09:45.206901+0000","last_became_peered":"2024-09-14T11:09:45.206901+0000","last_unstale":"2024-09-14T11:54:04.341400+0000","last_undegraded":"2024-09-14T11:54:04.341400+0000","last_fullsized":"2024-09-14T11:54:04.341400+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'190","last_scrub_stamp":"2024-09-14T11:54:04.341295+0000","last_deep_scrub":"264'190","last_deep_scrub_stamp":"2024-09-14T11:54:04.341295+0000","last_clean_scrub_stamp":"2024-09-14T11:54:04.341295+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:03.874799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":442,"num_read_kb":9264,"num_write":863,"num_write_kb":15949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.355084+0000","last_change":"2024-09-14T11:54:27.355084+0000","last_active":"2024-09-14T11:54:27.355084+0000","last_peered":"2024-09-14T11:54:27.355084+0000","last_clean":"2024-09-14T11:54:27.355084+0000","last_became_active":"2024-09-14T11:09:48.959413+0000","last_became_peered":"2024-09-14T11:09:48.959413+0000","last_unstale":"2024-09-14T11:54:27.355084+0000","last_undegraded":"2024-09-14T11:54:27.355084+0000","last_fullsized":"2024-09-14T11:54:27.355084+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:27.354885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:27.354885+0000","last_clean_scrub_stamp":"2024-09-14T11:54:27.354885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:07.088907+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"264'163","reported_seq":753,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.317507+0000","last_change":"2024-09-14T11:54:22.317507+0000","last_active":"2024-09-14T11:54:22.317507+0000","last_peered":"2024-09-14T11:54:22.317507+0000","last_clean":"2024-09-14T11:54:22.317507+0000","last_became_active":"2024-09-14T11:09:50.999585+0000","last_became_peered":"2024-09-14T11:09:50.999585+0000","last_unstale":"2024-09-14T11:54:22.317507+0000","last_undegraded":"2024-09-14T11:54:22.317507+0000","last_fullsized":"2024-09-14T11:54:22.317507+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'163","last_scrub_stamp":"2024-09-14T11:54:22.317312+0000","last_deep_scrub":"264'163","last_deep_scrub_stamp":"2024-09-14T11:54:22.317312+0000","last_clean_scrub_stamp":"2024-09-14T11:54:22.317312+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:12.615304+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7038,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":217,"num_read_kb":281,"num_write":118,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:23.566618+0000","last_change":"2024-09-14T11:54:23.566618+0000","last_active":"2024-09-14T11:54:23.566618+0000","last_peered":"2024-09-14T11:54:23.566618+0000","last_clean":"2024-09-14T11:54:23.566618+0000","last_became_active":"2024-09-14T11:09:53.018479+0000","last_became_peered":"2024-09-14T11:09:53.018479+0000","last_unstale":"2024-09-14T11:54:23.566618+0000","last_undegraded":"2024-09-14T11:54:23.566618+0000","last_fullsized":"2024-09-14T11:54:23.566618+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:23.566438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:23.566438+0000","last_clean_scrub_stamp":"2024-09-14T11:54:23.566438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:53:34.310619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"264'129","reported_seq":641,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:49.643219+0000","last_change":"2024-09-14T11:54:49.642954+0000","last_active":"2024-09-14T11:54:49.643219+0000","last_peered":"2024-09-14T11:54:49.643219+0000","last_clean":"2024-09-14T11:54:49.643219+0000","last_became_active":"2024-09-14T11:09:55.028633+0000","last_became_peered":"2024-09-14T11:09:55.028633+0000","last_unstale":"2024-09-14T11:54:49.643219+0000","last_undegraded":"2024-09-14T11:54:49.643219+0000","last_fullsized":"2024-09-14T11:54:49.643219+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'129","last_scrub_stamp":"2024-09-14T11:54:49.642720+0000","last_deep_scrub":"264'129","last_deep_scrub_stamp":"2024-09-14T11:54:49.642720+0000","last_clean_scrub_stamp":"2024-09-14T11:54:49.642720+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:13.334343+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":141,"num_read_kb":141,"num_write":296,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"264'506","reported_seq":2225,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.325712+0000","last_change":"2024-09-14T11:54:11.325712+0000","last_active":"2024-09-14T11:54:11.325712+0000","last_peered":"2024-09-14T11:54:11.325712+0000","last_clean":"2024-09-14T11:54:11.325712+0000","last_became_active":"2024-09-14T11:09:46.962364+0000","last_became_peered":"2024-09-14T11:09:46.962364+0000","last_unstale":"2024-09-14T11:54:11.325712+0000","last_undegraded":"2024-09-14T11:54:11.325712+0000","last_fullsized":"2024-09-14T11:54:11.325712+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'506","last_scrub_stamp":"2024-09-14T11:54:11.325519+0000","last_deep_scrub":"264'506","last_deep_scrub_stamp":"2024-09-14T11:54:11.325519+0000","last_clean_scrub_stamp":"2024-09-14T11:54:11.325519+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:16.688907+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2859,"num_read_kb":2685,"num_write":625,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"264'228","reported_seq":856,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.151831+0000","last_change":"2024-09-14T11:54:05.151831+0000","last_active":"2024-09-14T11:54:05.151831+0000","last_peered":"2024-09-14T11:54:05.151831+0000","last_clean":"2024-09-14T11:54:05.151831+0000","last_became_active":"2024-09-14T11:09:45.206145+0000","last_became_peered":"2024-09-14T11:09:45.206145+0000","last_unstale":"2024-09-14T11:54:05.151831+0000","last_undegraded":"2024-09-14T11:54:05.151831+0000","last_fullsized":"2024-09-14T11:54:05.151831+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'228","last_scrub_stamp":"2024-09-14T11:54:05.151645+0000","last_deep_scrub":"264'228","last_deep_scrub_stamp":"2024-09-14T11:54:05.151645+0000","last_clean_scrub_stamp":"2024-09-14T11:54:05.151645+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:21.231443+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":553,"num_read_kb":30372,"num_write":894,"num_write_kb":16933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"264'5","reported_seq":983,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:30.851200+0000","last_change":"2024-09-14T11:54:30.851200+0000","last_active":"2024-09-14T11:54:30.851200+0000","last_peered":"2024-09-14T11:54:30.851200+0000","last_clean":"2024-09-14T11:54:30.851200+0000","last_became_active":"2024-09-14T11:09:48.963563+0000","last_became_peered":"2024-09-14T11:09:48.963563+0000","last_unstale":"2024-09-14T11:54:30.851200+0000","last_undegraded":"2024-09-14T11:54:30.851200+0000","last_fullsized":"2024-09-14T11:54:30.851200+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-14T11:54:30.850999+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-14T11:54:30.850999+0000","last_clean_scrub_stamp":"2024-09-14T11:54:30.850999+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:37.854729+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":1197,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"264'128","reported_seq":698,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.899397+0000","last_change":"2024-09-14T11:54:24.899397+0000","last_active":"2024-09-14T11:54:24.899397+0000","last_peered":"2024-09-14T11:54:24.899397+0000","last_clean":"2024-09-14T11:54:24.899397+0000","last_became_active":"2024-09-14T11:09:50.988286+0000","last_became_peered":"2024-09-14T11:09:50.988286+0000","last_unstale":"2024-09-14T11:54:24.899397+0000","last_undegraded":"2024-09-14T11:54:24.899397+0000","last_fullsized":"2024-09-14T11:54:24.899397+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'128","last_scrub_stamp":"2024-09-14T11:54:24.899247+0000","last_deep_scrub":"264'128","last_deep_scrub_stamp":"2024-09-14T11:54:24.899247+0000","last_clean_scrub_stamp":"2024-09-14T11:54:24.899247+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:22.020527+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5180,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":147,"num_read_kb":193,"num_write":70,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.313607+0000","last_change":"2024-09-14T11:54:24.313607+0000","last_active":"2024-09-14T11:54:24.313607+0000","last_peered":"2024-09-14T11:54:24.313607+0000","last_clean":"2024-09-14T11:54:24.313607+0000","last_became_active":"2024-09-14T11:09:53.006975+0000","last_became_peered":"2024-09-14T11:09:53.006975+0000","last_unstale":"2024-09-14T11:54:24.313607+0000","last_undegraded":"2024-09-14T11:54:24.313607+0000","last_fullsized":"2024-09-14T11:54:24.313607+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:24.313368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:24.313368+0000","last_clean_scrub_stamp":"2024-09-14T11:54:24.313368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:50:17.993903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"264'601","reported_seq":2256,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.917264+0000","last_change":"2024-09-14T11:54:22.917264+0000","last_active":"2024-09-14T11:54:22.917264+0000","last_peered":"2024-09-14T11:54:22.917264+0000","last_clean":"2024-09-14T11:54:22.917264+0000","last_became_active":"2024-09-14T11:09:46.975017+0000","last_became_peered":"2024-09-14T11:09:46.975017+0000","last_unstale":"2024-09-14T11:54:22.917264+0000","last_undegraded":"2024-09-14T11:54:22.917264+0000","last_fullsized":"2024-09-14T11:54:22.917264+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'601","last_scrub_stamp":"2024-09-14T11:54:22.917071+0000","last_deep_scrub":"264'601","last_deep_scrub_stamp":"2024-09-14T11:54:22.917071+0000","last_clean_scrub_stamp":"2024-09-14T11:54:22.917071+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":500,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:52.422521+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3191,"num_read_kb":2927,"num_write":756,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"264'284","reported_seq":973,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.119049+0000","last_change":"2024-09-14T11:54:06.119049+0000","last_active":"2024-09-14T11:54:06.119049+0000","last_peered":"2024-09-14T11:54:06.119049+0000","last_clean":"2024-09-14T11:54:06.119049+0000","last_became_active":"2024-09-14T11:09:45.216742+0000","last_became_peered":"2024-09-14T11:09:45.216742+0000","last_unstale":"2024-09-14T11:54:06.119049+0000","last_undegraded":"2024-09-14T11:54:06.119049+0000","last_fullsized":"2024-09-14T11:54:06.119049+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'284","last_scrub_stamp":"2024-09-14T11:54:06.118835+0000","last_deep_scrub":"264'284","last_deep_scrub_stamp":"2024-09-14T11:54:06.118835+0000","last_clean_scrub_stamp":"2024-09-14T11:54:06.118835+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:00.653277+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":743,"num_read_kb":84606,"num_write":1211,"num_write_kb":44892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.642521+0000","last_change":"2024-09-14T11:54:19.642521+0000","last_active":"2024-09-14T11:54:19.642521+0000","last_peered":"2024-09-14T11:54:19.642521+0000","last_clean":"2024-09-14T11:54:19.642521+0000","last_became_active":"2024-09-14T11:09:48.966112+0000","last_became_peered":"2024-09-14T11:09:48.966112+0000","last_unstale":"2024-09-14T11:54:19.642521+0000","last_undegraded":"2024-09-14T11:54:19.642521+0000","last_fullsized":"2024-09-14T11:54:19.642521+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:19.642292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:19.642292+0000","last_clean_scrub_stamp":"2024-09-14T11:54:19.642292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:48.336482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"264'214","reported_seq":846,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:25.619648+0000","last_change":"2024-09-14T11:54:25.619507+0000","last_active":"2024-09-14T11:54:25.619648+0000","last_peered":"2024-09-14T11:54:25.619648+0000","last_clean":"2024-09-14T11:54:25.619648+0000","last_became_active":"2024-09-14T11:09:50.995279+0000","last_became_peered":"2024-09-14T11:09:50.995279+0000","last_unstale":"2024-09-14T11:54:25.619648+0000","last_undegraded":"2024-09-14T11:54:25.619648+0000","last_fullsized":"2024-09-14T11:54:25.619648+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'214","last_scrub_stamp":"2024-09-14T11:54:25.619315+0000","last_deep_scrub":"264'214","last_deep_scrub_stamp":"2024-09-14T11:54:25.619315+0000","last_clean_scrub_stamp":"2024-09-14T11:54:25.619315+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:24.525339+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27447,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":311,"num_read_kb":486,"num_write":198,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.315249+0000","last_change":"2024-09-14T11:54:24.315112+0000","last_active":"2024-09-14T11:54:24.315249+0000","last_peered":"2024-09-14T11:54:24.315249+0000","last_clean":"2024-09-14T11:54:24.315249+0000","last_became_active":"2024-09-14T11:09:53.002862+0000","last_became_peered":"2024-09-14T11:09:53.002862+0000","last_unstale":"2024-09-14T11:54:24.315249+0000","last_undegraded":"2024-09-14T11:54:24.315249+0000","last_fullsized":"2024-09-14T11:54:24.315249+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:24.314937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:24.314937+0000","last_clean_scrub_stamp":"2024-09-14T11:54:24.314937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:19.540172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"264'169","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:40.117939+0000","last_change":"2024-09-14T11:54:40.117939+0000","last_active":"2024-09-14T11:54:40.117939+0000","last_peered":"2024-09-14T11:54:40.117939+0000","last_clean":"2024-09-14T11:54:40.117939+0000","last_became_active":"2024-09-14T11:09:55.023821+0000","last_became_peered":"2024-09-14T11:09:55.023821+0000","last_unstale":"2024-09-14T11:54:40.117939+0000","last_undegraded":"2024-09-14T11:54:40.117939+0000","last_fullsized":"2024-09-14T11:54:40.117939+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'169","last_scrub_stamp":"2024-09-14T11:54:40.117756+0000","last_deep_scrub":"264'169","last_deep_scrub_stamp":"2024-09-14T11:54:40.117756+0000","last_clean_scrub_stamp":"2024-09-14T11:54:40.117756+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:42.833180+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":195,"num_read_kb":205,"num_write":392,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"264'863","reported_seq":2622,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.716452+0000","last_change":"2024-09-14T11:54:13.716452+0000","last_active":"2024-09-14T11:54:13.716452+0000","last_peered":"2024-09-14T11:54:13.716452+0000","last_clean":"2024-09-14T11:54:13.716452+0000","last_became_active":"2024-09-14T11:09:46.967144+0000","last_became_peered":"2024-09-14T11:09:46.967144+0000","last_unstale":"2024-09-14T11:54:13.716452+0000","last_undegraded":"2024-09-14T11:54:13.716452+0000","last_fullsized":"2024-09-14T11:54:13.716452+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'863","last_scrub_stamp":"2024-09-14T11:54:13.716280+0000","last_deep_scrub":"264'863","last_deep_scrub_stamp":"2024-09-14T11:54:13.716280+0000","last_clean_scrub_stamp":"2024-09-14T11:54:13.716280+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":800,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:40.233051+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4422,"num_read_kb":4033,"num_write":1158,"num_write_kb":453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"264'189","reported_seq":811,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.715232+0000","last_change":"2024-09-14T11:54:07.715232+0000","last_active":"2024-09-14T11:54:07.715232+0000","last_peered":"2024-09-14T11:54:07.715232+0000","last_clean":"2024-09-14T11:54:07.715232+0000","last_became_active":"2024-09-14T11:09:45.186745+0000","last_became_peered":"2024-09-14T11:09:45.186745+0000","last_unstale":"2024-09-14T11:54:07.715232+0000","last_undegraded":"2024-09-14T11:54:07.715232+0000","last_fullsized":"2024-09-14T11:54:07.715232+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'189","last_scrub_stamp":"2024-09-14T11:54:07.715044+0000","last_deep_scrub":"264'189","last_deep_scrub_stamp":"2024-09-14T11:54:07.715044+0000","last_clean_scrub_stamp":"2024-09-14T11:54:07.715044+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:02.047080+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":536,"num_read_kb":5513,"num_write":846,"num_write_kb":29456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.372960+0000","last_change":"2024-09-14T11:54:17.372960+0000","last_active":"2024-09-14T11:54:17.372960+0000","last_peered":"2024-09-14T11:54:17.372960+0000","last_clean":"2024-09-14T11:54:17.372960+0000","last_became_active":"2024-09-14T11:09:48.951908+0000","last_became_peered":"2024-09-14T11:09:48.951908+0000","last_unstale":"2024-09-14T11:54:17.372960+0000","last_undegraded":"2024-09-14T11:54:17.372960+0000","last_fullsized":"2024-09-14T11:54:17.372960+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:17.372741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:17.372741+0000","last_clean_scrub_stamp":"2024-09-14T11:54:17.372741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:12.820647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"264'174","reported_seq":759,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.748905+0000","last_change":"2024-09-14T11:54:38.748765+0000","last_active":"2024-09-14T11:54:38.748905+0000","last_peered":"2024-09-14T11:54:38.748905+0000","last_clean":"2024-09-14T11:54:38.748905+0000","last_became_active":"2024-09-14T11:09:50.983553+0000","last_became_peered":"2024-09-14T11:09:50.983553+0000","last_unstale":"2024-09-14T11:54:38.748905+0000","last_undegraded":"2024-09-14T11:54:38.748905+0000","last_fullsized":"2024-09-14T11:54:38.748905+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'174","last_scrub_stamp":"2024-09-14T11:54:38.748505+0000","last_deep_scrub":"264'174","last_deep_scrub_stamp":"2024-09-14T11:54:38.748505+0000","last_clean_scrub_stamp":"2024-09-14T11:54:38.748505+0000","objects_scrubbed":8,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:00.468758+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13815,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":225,"num_read_kb":306,"num_write":144,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.122603+0000","last_change":"2024-09-14T11:54:38.122370+0000","last_active":"2024-09-14T11:54:38.122603+0000","last_peered":"2024-09-14T11:54:38.122603+0000","last_clean":"2024-09-14T11:54:38.122603+0000","last_became_active":"2024-09-14T11:09:53.023609+0000","last_became_peered":"2024-09-14T11:09:53.023609+0000","last_unstale":"2024-09-14T11:54:38.122603+0000","last_undegraded":"2024-09-14T11:54:38.122603+0000","last_fullsized":"2024-09-14T11:54:38.122603+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:38.122093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:38.122093+0000","last_clean_scrub_stamp":"2024-09-14T11:54:38.122093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:47.411895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"264'160","reported_seq":665,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:46.726951+0000","last_change":"2024-09-14T11:54:46.726951+0000","last_active":"2024-09-14T11:54:46.726951+0000","last_peered":"2024-09-14T11:54:46.726951+0000","last_clean":"2024-09-14T11:54:46.726951+0000","last_became_active":"2024-09-14T11:09:55.028344+0000","last_became_peered":"2024-09-14T11:09:55.028344+0000","last_unstale":"2024-09-14T11:54:46.726951+0000","last_undegraded":"2024-09-14T11:54:46.726951+0000","last_fullsized":"2024-09-14T11:54:46.726951+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'160","last_scrub_stamp":"2024-09-14T11:54:46.726755+0000","last_deep_scrub":"264'160","last_deep_scrub_stamp":"2024-09-14T11:54:46.726755+0000","last_clean_scrub_stamp":"2024-09-14T11:54:46.726755+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:37.970471+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1619,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":178,"num_read_kb":177,"num_write":459,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"264'848","reported_seq":2455,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.403132+0000","last_change":"2024-09-14T11:54:14.402985+0000","last_active":"2024-09-14T11:54:14.403132+0000","last_peered":"2024-09-14T11:54:14.403132+0000","last_clean":"2024-09-14T11:54:14.403132+0000","last_became_active":"2024-09-14T11:09:46.990923+0000","last_became_peered":"2024-09-14T11:09:46.990923+0000","last_unstale":"2024-09-14T11:54:14.403132+0000","last_undegraded":"2024-09-14T11:54:14.403132+0000","last_fullsized":"2024-09-14T11:54:14.403132+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'848","last_scrub_stamp":"2024-09-14T11:54:14.402785+0000","last_deep_scrub":"264'848","last_deep_scrub_stamp":"2024-09-14T11:54:14.402785+0000","last_clean_scrub_stamp":"2024-09-14T11:54:14.402785+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":800,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:06.689765+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4067,"num_read_kb":3661,"num_write":1092,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"264'168","reported_seq":762,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.622544+0000","last_change":"2024-09-14T11:54:04.622290+0000","last_active":"2024-09-14T11:54:04.622544+0000","last_peered":"2024-09-14T11:54:04.622544+0000","last_clean":"2024-09-14T11:54:04.622544+0000","last_became_active":"2024-09-14T11:09:45.201058+0000","last_became_peered":"2024-09-14T11:09:45.201058+0000","last_unstale":"2024-09-14T11:54:04.622544+0000","last_undegraded":"2024-09-14T11:54:04.622544+0000","last_fullsized":"2024-09-14T11:54:04.622544+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'168","last_scrub_stamp":"2024-09-14T11:54:04.622018+0000","last_deep_scrub":"264'168","last_deep_scrub_stamp":"2024-09-14T11:54:04.622018+0000","last_clean_scrub_stamp":"2024-09-14T11:54:04.622018+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:44.170656+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":358,"num_read_kb":4087,"num_write":735,"num_write_kb":11722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.418960+0000","last_change":"2024-09-14T11:54:15.418808+0000","last_active":"2024-09-14T11:54:15.418960+0000","last_peered":"2024-09-14T11:54:15.418960+0000","last_clean":"2024-09-14T11:54:15.418960+0000","last_became_active":"2024-09-14T11:09:48.968770+0000","last_became_peered":"2024-09-14T11:09:48.968770+0000","last_unstale":"2024-09-14T11:54:15.418960+0000","last_undegraded":"2024-09-14T11:54:15.418960+0000","last_fullsized":"2024-09-14T11:54:15.418960+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:15.418547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:15.418547+0000","last_clean_scrub_stamp":"2024-09-14T11:54:15.418547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:15.576692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"264'137","reported_seq":717,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.660092+0000","last_change":"2024-09-14T11:54:26.660092+0000","last_active":"2024-09-14T11:54:26.660092+0000","last_peered":"2024-09-14T11:54:26.660092+0000","last_clean":"2024-09-14T11:54:26.660092+0000","last_became_active":"2024-09-14T11:09:50.999079+0000","last_became_peered":"2024-09-14T11:09:50.999079+0000","last_unstale":"2024-09-14T11:54:26.660092+0000","last_undegraded":"2024-09-14T11:54:26.660092+0000","last_fullsized":"2024-09-14T11:54:26.660092+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'137","last_scrub_stamp":"2024-09-14T11:54:26.659891+0000","last_deep_scrub":"264'137","last_deep_scrub_stamp":"2024-09-14T11:54:26.659891+0000","last_clean_scrub_stamp":"2024-09-14T11:54:26.659891+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:10.513103+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6871,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":175,"num_read_kb":247,"num_write":92,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.337061+0000","last_change":"2024-09-14T11:54:26.337061+0000","last_active":"2024-09-14T11:54:26.337061+0000","last_peered":"2024-09-14T11:54:26.337061+0000","last_clean":"2024-09-14T11:54:26.337061+0000","last_became_active":"2024-09-14T11:09:53.008952+0000","last_became_peered":"2024-09-14T11:09:53.008952+0000","last_unstale":"2024-09-14T11:54:26.337061+0000","last_undegraded":"2024-09-14T11:54:26.337061+0000","last_fullsized":"2024-09-14T11:54:26.337061+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:26.336884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:26.336884+0000","last_clean_scrub_stamp":"2024-09-14T11:54:26.336884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:22.557625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"264'144","reported_seq":645,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.701790+0000","last_change":"2024-09-14T11:54:47.701790+0000","last_active":"2024-09-14T11:54:47.701790+0000","last_peered":"2024-09-14T11:54:47.701790+0000","last_clean":"2024-09-14T11:54:47.701790+0000","last_became_active":"2024-09-14T11:09:55.028413+0000","last_became_peered":"2024-09-14T11:09:55.028413+0000","last_unstale":"2024-09-14T11:54:47.701790+0000","last_undegraded":"2024-09-14T11:54:47.701790+0000","last_fullsized":"2024-09-14T11:54:47.701790+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'144","last_scrub_stamp":"2024-09-14T11:54:47.701603+0000","last_deep_scrub":"264'144","last_deep_scrub_stamp":"2024-09-14T11:54:47.701603+0000","last_clean_scrub_stamp":"2024-09-14T11:54:47.701603+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:10.272787+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":142,"num_write":355,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"264'425","reported_seq":1991,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:12.675846+0000","last_change":"2024-09-14T11:54:12.675564+0000","last_active":"2024-09-14T11:54:12.675846+0000","last_peered":"2024-09-14T11:54:12.675846+0000","last_clean":"2024-09-14T11:54:12.675846+0000","last_became_active":"2024-09-14T11:09:46.986721+0000","last_became_peered":"2024-09-14T11:09:46.986721+0000","last_unstale":"2024-09-14T11:54:12.675846+0000","last_undegraded":"2024-09-14T11:54:12.675846+0000","last_fullsized":"2024-09-14T11:54:12.675846+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'425","last_scrub_stamp":"2024-09-14T11:54:12.675309+0000","last_deep_scrub":"264'425","last_deep_scrub_stamp":"2024-09-14T11:54:12.675309+0000","last_clean_scrub_stamp":"2024-09-14T11:54:12.675309+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:42.450711+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2241,"num_read_kb":2140,"num_write":472,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"264'231","reported_seq":844,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.670244+0000","last_change":"2024-09-14T11:54:08.670061+0000","last_active":"2024-09-14T11:54:08.670244+0000","last_peered":"2024-09-14T11:54:08.670244+0000","last_clean":"2024-09-14T11:54:08.670244+0000","last_became_active":"2024-09-14T11:09:45.211984+0000","last_became_peered":"2024-09-14T11:09:45.211984+0000","last_unstale":"2024-09-14T11:54:08.670244+0000","last_undegraded":"2024-09-14T11:54:08.670244+0000","last_fullsized":"2024-09-14T11:54:08.670244+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'231","last_scrub_stamp":"2024-09-14T11:54:08.669862+0000","last_deep_scrub":"264'231","last_deep_scrub_stamp":"2024-09-14T11:54:08.669862+0000","last_clean_scrub_stamp":"2024-09-14T11:54:08.669862+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:46.692498+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":505,"num_read_kb":8662,"num_write":1132,"num_write_kb":22372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:25.884206+0000","last_change":"2024-09-14T11:54:25.884052+0000","last_active":"2024-09-14T11:54:25.884206+0000","last_peered":"2024-09-14T11:54:25.884206+0000","last_clean":"2024-09-14T11:54:25.884206+0000","last_became_active":"2024-09-14T11:09:48.968459+0000","last_became_peered":"2024-09-14T11:09:48.968459+0000","last_unstale":"2024-09-14T11:54:25.884206+0000","last_undegraded":"2024-09-14T11:54:25.884206+0000","last_fullsized":"2024-09-14T11:54:25.884206+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:25.883831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:25.883831+0000","last_clean_scrub_stamp":"2024-09-14T11:54:25.883831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:45.445692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"264'102","reported_seq":626,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:39.757198+0000","last_change":"2024-09-14T11:54:39.757198+0000","last_active":"2024-09-14T11:54:39.757198+0000","last_peered":"2024-09-14T11:54:39.757198+0000","last_clean":"2024-09-14T11:54:39.757198+0000","last_became_active":"2024-09-14T11:09:50.979749+0000","last_became_peered":"2024-09-14T11:09:50.979749+0000","last_unstale":"2024-09-14T11:54:39.757198+0000","last_undegraded":"2024-09-14T11:54:39.757198+0000","last_fullsized":"2024-09-14T11:54:39.757198+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'102","last_scrub_stamp":"2024-09-14T11:54:39.756989+0000","last_deep_scrub":"264'102","last_deep_scrub_stamp":"2024-09-14T11:54:39.756989+0000","last_clean_scrub_stamp":"2024-09-14T11:54:39.756989+0000","objects_scrubbed":6,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:18.949852+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":88,"num_read_kb":80,"num_write":70,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"264'783","reported_seq":4308,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:26.866789+0000","last_change":"2024-09-14T11:54:26.866789+0000","last_active":"2024-09-14T11:54:26.866789+0000","last_peered":"2024-09-14T11:54:26.866789+0000","last_clean":"2024-09-14T11:54:26.866789+0000","last_became_active":"2024-09-14T11:09:53.014955+0000","last_became_peered":"2024-09-14T11:09:53.014955+0000","last_unstale":"2024-09-14T11:54:26.866789+0000","last_undegraded":"2024-09-14T11:54:26.866789+0000","last_fullsized":"2024-09-14T11:54:26.866789+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'783","last_scrub_stamp":"2024-09-14T11:54:26.866593+0000","last_deep_scrub":"264'783","last_deep_scrub_stamp":"2024-09-14T11:54:26.866593+0000","last_clean_scrub_stamp":"2024-09-14T11:54:26.866593+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:19.315165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"264'92","reported_seq":590,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:45.685182+0000","last_change":"2024-09-14T11:54:45.685182+0000","last_active":"2024-09-14T11:54:45.685182+0000","last_peered":"2024-09-14T11:54:45.685182+0000","last_clean":"2024-09-14T11:54:45.685182+0000","last_became_active":"2024-09-14T11:09:55.030211+0000","last_became_peered":"2024-09-14T11:09:55.030211+0000","last_unstale":"2024-09-14T11:54:45.685182+0000","last_undegraded":"2024-09-14T11:54:45.685182+0000","last_fullsized":"2024-09-14T11:54:45.685182+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'92","last_scrub_stamp":"2024-09-14T11:54:45.684986+0000","last_deep_scrub":"264'92","last_deep_scrub_stamp":"2024-09-14T11:54:45.684986+0000","last_clean_scrub_stamp":"2024-09-14T11:54:45.684986+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:19.324250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":87,"num_write":222,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"264'456","reported_seq":2008,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.357098+0000","last_change":"2024-09-14T11:54:19.356863+0000","last_active":"2024-09-14T11:54:19.357098+0000","last_peered":"2024-09-14T11:54:19.357098+0000","last_clean":"2024-09-14T11:54:19.357098+0000","last_became_active":"2024-09-14T11:09:46.974957+0000","last_became_peered":"2024-09-14T11:09:46.974957+0000","last_unstale":"2024-09-14T11:54:19.357098+0000","last_undegraded":"2024-09-14T11:54:19.357098+0000","last_fullsized":"2024-09-14T11:54:19.357098+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'456","last_scrub_stamp":"2024-09-14T11:54:19.356645+0000","last_deep_scrub":"264'456","last_deep_scrub_stamp":"2024-09-14T11:54:19.356645+0000","last_clean_scrub_stamp":"2024-09-14T11:54:19.356645+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:51.238936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2398,"num_read_kb":2260,"num_write":532,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"264'307","reported_seq":1008,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:02.648404+0000","last_change":"2024-09-14T11:54:02.648344+0000","last_active":"2024-09-14T11:54:02.648404+0000","last_peered":"2024-09-14T11:54:02.648404+0000","last_clean":"2024-09-14T11:54:02.648404+0000","last_became_active":"2024-09-14T11:09:45.204014+0000","last_became_peered":"2024-09-14T11:09:45.204014+0000","last_unstale":"2024-09-14T11:54:02.648404+0000","last_undegraded":"2024-09-14T11:54:02.648404+0000","last_fullsized":"2024-09-14T11:54:02.648404+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'307","last_scrub_stamp":"2024-09-14T11:54:02.648264+0000","last_deep_scrub":"264'307","last_deep_scrub_stamp":"2024-09-14T11:54:02.648264+0000","last_clean_scrub_stamp":"2024-09-14T11:54:02.648264+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:19.048576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":844,"num_read_kb":35877,"num_write":1474,"num_write_kb":50924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:19.686069+0000","last_change":"2024-09-14T11:54:19.685905+0000","last_active":"2024-09-14T11:54:19.686069+0000","last_peered":"2024-09-14T11:54:19.686069+0000","last_clean":"2024-09-14T11:54:19.686069+0000","last_became_active":"2024-09-14T11:09:48.950445+0000","last_became_peered":"2024-09-14T11:09:48.950445+0000","last_unstale":"2024-09-14T11:54:19.686069+0000","last_undegraded":"2024-09-14T11:54:19.686069+0000","last_fullsized":"2024-09-14T11:54:19.686069+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:19.685726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:19.685726+0000","last_clean_scrub_stamp":"2024-09-14T11:54:19.685726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:25.961511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"264'173","reported_seq":757,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:21.861599+0000","last_change":"2024-09-14T11:54:21.861599+0000","last_active":"2024-09-14T11:54:21.861599+0000","last_peered":"2024-09-14T11:54:21.861599+0000","last_clean":"2024-09-14T11:54:21.861599+0000","last_became_active":"2024-09-14T11:09:50.992216+0000","last_became_peered":"2024-09-14T11:09:50.992216+0000","last_unstale":"2024-09-14T11:54:21.861599+0000","last_undegraded":"2024-09-14T11:54:21.861599+0000","last_fullsized":"2024-09-14T11:54:21.861599+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'173","last_scrub_stamp":"2024-09-14T11:54:21.861380+0000","last_deep_scrub":"264'173","last_deep_scrub_stamp":"2024-09-14T11:54:21.861380+0000","last_clean_scrub_stamp":"2024-09-14T11:54:21.861380+0000","objects_scrubbed":7,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:17.222257+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59902,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":237,"num_read_kb":452,"num_write":144,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:35.974705+0000","last_change":"2024-09-14T11:54:35.974705+0000","last_active":"2024-09-14T11:54:35.974705+0000","last_peered":"2024-09-14T11:54:35.974705+0000","last_clean":"2024-09-14T11:54:35.974705+0000","last_became_active":"2024-09-14T11:09:53.023492+0000","last_became_peered":"2024-09-14T11:09:53.023492+0000","last_unstale":"2024-09-14T11:54:35.974705+0000","last_undegraded":"2024-09-14T11:54:35.974705+0000","last_fullsized":"2024-09-14T11:54:35.974705+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:35.974527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:35.974527+0000","last_clean_scrub_stamp":"2024-09-14T11:54:35.974527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:08.100468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"264'115","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:29.590701+0000","last_change":"2024-09-14T11:54:29.590701+0000","last_active":"2024-09-14T11:54:29.590701+0000","last_peered":"2024-09-14T11:54:29.590701+0000","last_clean":"2024-09-14T11:54:29.590701+0000","last_became_active":"2024-09-14T11:09:55.027044+0000","last_became_peered":"2024-09-14T11:09:55.027044+0000","last_unstale":"2024-09-14T11:54:29.590701+0000","last_undegraded":"2024-09-14T11:54:29.590701+0000","last_fullsized":"2024-09-14T11:54:29.590701+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'115","last_scrub_stamp":"2024-09-14T11:54:29.590497+0000","last_deep_scrub":"264'115","last_deep_scrub_stamp":"2024-09-14T11:54:29.590497+0000","last_clean_scrub_stamp":"2024-09-14T11:54:29.590497+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:32:47.840687+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":137,"num_read_kb":126,"num_write":268,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"264'784","reported_seq":2419,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.425744+0000","last_change":"2024-09-14T11:54:11.425477+0000","last_active":"2024-09-14T11:54:11.425744+0000","last_peered":"2024-09-14T11:54:11.425744+0000","last_clean":"2024-09-14T11:54:11.425744+0000","last_became_active":"2024-09-14T11:09:46.981651+0000","last_became_peered":"2024-09-14T11:09:46.981651+0000","last_unstale":"2024-09-14T11:54:11.425744+0000","last_undegraded":"2024-09-14T11:54:11.425744+0000","last_fullsized":"2024-09-14T11:54:11.425744+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'784","last_scrub_stamp":"2024-09-14T11:54:11.425249+0000","last_deep_scrub":"264'784","last_deep_scrub_stamp":"2024-09-14T11:54:11.425249+0000","last_clean_scrub_stamp":"2024-09-14T11:54:11.425249+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:21.549218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3785,"num_read_kb":3457,"num_write":1011,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"264'249","reported_seq":897,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:12.759056+0000","last_change":"2024-09-14T11:54:12.758882+0000","last_active":"2024-09-14T11:54:12.759056+0000","last_peered":"2024-09-14T11:54:12.759056+0000","last_clean":"2024-09-14T11:54:12.759056+0000","last_became_active":"2024-09-14T11:09:45.215127+0000","last_became_peered":"2024-09-14T11:09:45.215127+0000","last_unstale":"2024-09-14T11:54:12.759056+0000","last_undegraded":"2024-09-14T11:54:12.759056+0000","last_fullsized":"2024-09-14T11:54:12.759056+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'249","last_scrub_stamp":"2024-09-14T11:54:12.758682+0000","last_deep_scrub":"264'249","last_deep_scrub_stamp":"2024-09-14T11:54:12.758682+0000","last_clean_scrub_stamp":"2024-09-14T11:54:12.758682+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:33.194428+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655838,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":590,"num_read_kb":34633,"num_write":1021,"num_write_kb":52307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:21.336236+0000","last_change":"2024-09-14T11:54:21.336091+0000","last_active":"2024-09-14T11:54:21.336236+0000","last_peered":"2024-09-14T11:54:21.336236+0000","last_clean":"2024-09-14T11:54:21.336236+0000","last_became_active":"2024-09-14T11:09:48.960006+0000","last_became_peered":"2024-09-14T11:09:48.960006+0000","last_unstale":"2024-09-14T11:54:21.336236+0000","last_undegraded":"2024-09-14T11:54:21.336236+0000","last_fullsized":"2024-09-14T11:54:21.336236+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:21.335912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:21.335912+0000","last_clean_scrub_stamp":"2024-09-14T11:54:21.335912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:58.931314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"264'121","reported_seq":695,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:31.988047+0000","last_change":"2024-09-14T11:54:31.988047+0000","last_active":"2024-09-14T11:54:31.988047+0000","last_peered":"2024-09-14T11:54:31.988047+0000","last_clean":"2024-09-14T11:54:31.988047+0000","last_became_active":"2024-09-14T11:09:50.975555+0000","last_became_peered":"2024-09-14T11:09:50.975555+0000","last_unstale":"2024-09-14T11:54:31.988047+0000","last_undegraded":"2024-09-14T11:54:31.988047+0000","last_fullsized":"2024-09-14T11:54:31.988047+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'121","last_scrub_stamp":"2024-09-14T11:54:31.987835+0000","last_deep_scrub":"264'121","last_deep_scrub_stamp":"2024-09-14T11:54:31.987835+0000","last_clean_scrub_stamp":"2024-09-14T11:54:31.987835+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:03.800123+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5710,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":156,"num_read_kb":221,"num_write":78,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:41.686153+0000","last_change":"2024-09-14T11:54:41.686153+0000","last_active":"2024-09-14T11:54:41.686153+0000","last_peered":"2024-09-14T11:54:41.686153+0000","last_clean":"2024-09-14T11:54:41.686153+0000","last_became_active":"2024-09-14T11:09:53.015039+0000","last_became_peered":"2024-09-14T11:09:53.015039+0000","last_unstale":"2024-09-14T11:54:41.686153+0000","last_undegraded":"2024-09-14T11:54:41.686153+0000","last_fullsized":"2024-09-14T11:54:41.686153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:41.685979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:41.685979+0000","last_clean_scrub_stamp":"2024-09-14T11:54:41.685979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:57.047277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"264'94","reported_seq":611,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:41.161656+0000","last_change":"2024-09-14T11:54:41.161656+0000","last_active":"2024-09-14T11:54:41.161656+0000","last_peered":"2024-09-14T11:54:41.161656+0000","last_clean":"2024-09-14T11:54:41.161656+0000","last_became_active":"2024-09-14T11:09:55.013997+0000","last_became_peered":"2024-09-14T11:09:55.013997+0000","last_unstale":"2024-09-14T11:54:41.161656+0000","last_undegraded":"2024-09-14T11:54:41.161656+0000","last_fullsized":"2024-09-14T11:54:41.161656+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'94","last_scrub_stamp":"2024-09-14T11:54:41.161480+0000","last_deep_scrub":"264'94","last_deep_scrub_stamp":"2024-09-14T11:54:41.161480+0000","last_clean_scrub_stamp":"2024-09-14T11:54:41.161480+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:08:50.915166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":557,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":129,"num_write":227,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"264'1275","reported_seq":2891,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.288870+0000","last_change":"2024-09-14T11:54:10.288870+0000","last_active":"2024-09-14T11:54:10.288870+0000","last_peered":"2024-09-14T11:54:10.288870+0000","last_clean":"2024-09-14T11:54:10.288870+0000","last_became_active":"2024-09-14T11:09:46.982770+0000","last_became_peered":"2024-09-14T11:09:46.982770+0000","last_unstale":"2024-09-14T11:54:10.288870+0000","last_undegraded":"2024-09-14T11:54:10.288870+0000","last_fullsized":"2024-09-14T11:54:10.288870+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1275","last_scrub_stamp":"2024-09-14T11:54:10.288683+0000","last_deep_scrub":"264'1275","last_deep_scrub_stamp":"2024-09-14T11:54:10.288683+0000","last_clean_scrub_stamp":"2024-09-14T11:54:10.288683+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":1200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:08.762030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5800,"num_read_kb":5089,"num_write":1775,"num_write_kb":736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"264'210","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.091928+0000","last_change":"2024-09-14T11:54:07.091928+0000","last_active":"2024-09-14T11:54:07.091928+0000","last_peered":"2024-09-14T11:54:07.091928+0000","last_clean":"2024-09-14T11:54:07.091928+0000","last_became_active":"2024-09-14T11:09:45.200971+0000","last_became_peered":"2024-09-14T11:09:45.200971+0000","last_unstale":"2024-09-14T11:54:07.091928+0000","last_undegraded":"2024-09-14T11:54:07.091928+0000","last_fullsized":"2024-09-14T11:54:07.091928+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'210","last_scrub_stamp":"2024-09-14T11:54:07.091775+0000","last_deep_scrub":"264'210","last_deep_scrub_stamp":"2024-09-14T11:54:07.091775+0000","last_clean_scrub_stamp":"2024-09-14T11:54:07.091775+0000","objects_scrubbed":6,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:25.105451+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3174623,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":502,"num_read_kb":61081,"num_write":905,"num_write_kb":39968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.657373+0000","last_change":"2024-09-14T11:54:18.657373+0000","last_active":"2024-09-14T11:54:18.657373+0000","last_peered":"2024-09-14T11:54:18.657373+0000","last_clean":"2024-09-14T11:54:18.657373+0000","last_became_active":"2024-09-14T11:09:48.958168+0000","last_became_peered":"2024-09-14T11:09:48.958168+0000","last_unstale":"2024-09-14T11:54:18.657373+0000","last_undegraded":"2024-09-14T11:54:18.657373+0000","last_fullsized":"2024-09-14T11:54:18.657373+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:18.657106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:18.657106+0000","last_clean_scrub_stamp":"2024-09-14T11:54:18.657106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:03.227051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"264'106","reported_seq":668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.633417+0000","last_change":"2024-09-14T11:54:24.633267+0000","last_active":"2024-09-14T11:54:24.633417+0000","last_peered":"2024-09-14T11:54:24.633417+0000","last_clean":"2024-09-14T11:54:24.633417+0000","last_became_active":"2024-09-14T11:09:50.998951+0000","last_became_peered":"2024-09-14T11:09:50.998951+0000","last_unstale":"2024-09-14T11:54:24.633417+0000","last_undegraded":"2024-09-14T11:54:24.633417+0000","last_fullsized":"2024-09-14T11:54:24.633417+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'106","last_scrub_stamp":"2024-09-14T11:54:24.633080+0000","last_deep_scrub":"264'106","last_deep_scrub_stamp":"2024-09-14T11:54:24.633080+0000","last_clean_scrub_stamp":"2024-09-14T11:54:24.633080+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:50.324330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":125,"num_read_kb":141,"num_write":60,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.704753+0000","last_change":"2024-09-14T11:54:43.704603+0000","last_active":"2024-09-14T11:54:43.704753+0000","last_peered":"2024-09-14T11:54:43.704753+0000","last_clean":"2024-09-14T11:54:43.704753+0000","last_became_active":"2024-09-14T11:09:53.021595+0000","last_became_peered":"2024-09-14T11:09:53.021595+0000","last_unstale":"2024-09-14T11:54:43.704753+0000","last_undegraded":"2024-09-14T11:54:43.704753+0000","last_fullsized":"2024-09-14T11:54:43.704753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:43.704427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:43.704427+0000","last_clean_scrub_stamp":"2024-09-14T11:54:43.704427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:19.553670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"264'193","reported_seq":1657,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:48.687722+0000","last_change":"2024-09-14T11:54:48.687722+0000","last_active":"2024-09-14T11:54:48.687722+0000","last_peered":"2024-09-14T11:54:48.687722+0000","last_clean":"2024-09-14T11:54:48.687722+0000","last_became_active":"2024-09-14T11:09:55.028374+0000","last_became_peered":"2024-09-14T11:09:55.028374+0000","last_unstale":"2024-09-14T11:54:48.687722+0000","last_undegraded":"2024-09-14T11:54:48.687722+0000","last_fullsized":"2024-09-14T11:54:48.687722+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'193","last_scrub_stamp":"2024-09-14T11:54:48.687521+0000","last_deep_scrub":"264'193","last_deep_scrub_stamp":"2024-09-14T11:54:48.687521+0000","last_clean_scrub_stamp":"2024-09-14T11:54:48.687521+0000","objects_scrubbed":6,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:10.626480+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":650,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1185,"num_read_kb":1180,"num_write":425,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"264'678","reported_seq":2444,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:14.384340+0000","last_change":"2024-09-14T11:54:14.384340+0000","last_active":"2024-09-14T11:54:14.384340+0000","last_peered":"2024-09-14T11:54:14.384340+0000","last_clean":"2024-09-14T11:54:14.384340+0000","last_became_active":"2024-09-14T11:09:46.946243+0000","last_became_peered":"2024-09-14T11:09:46.946243+0000","last_unstale":"2024-09-14T11:54:14.384340+0000","last_undegraded":"2024-09-14T11:54:14.384340+0000","last_fullsized":"2024-09-14T11:54:14.384340+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'678","last_scrub_stamp":"2024-09-14T11:54:14.384140+0000","last_deep_scrub":"264'678","last_deep_scrub_stamp":"2024-09-14T11:54:14.384140+0000","last_clean_scrub_stamp":"2024-09-14T11:54:14.384140+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":600,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:37.864132+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3815,"num_read_kb":3478,"num_write":980,"num_write_kb":450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"264'190","reported_seq":824,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.123338+0000","last_change":"2024-09-14T11:54:08.123338+0000","last_active":"2024-09-14T11:54:08.123338+0000","last_peered":"2024-09-14T11:54:08.123338+0000","last_clean":"2024-09-14T11:54:08.123338+0000","last_became_active":"2024-09-14T11:09:45.201929+0000","last_became_peered":"2024-09-14T11:09:45.201929+0000","last_unstale":"2024-09-14T11:54:08.123338+0000","last_undegraded":"2024-09-14T11:54:08.123338+0000","last_fullsized":"2024-09-14T11:54:08.123338+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'190","last_scrub_stamp":"2024-09-14T11:54:08.123135+0000","last_deep_scrub":"264'190","last_deep_scrub_stamp":"2024-09-14T11:54:08.123135+0000","last_clean_scrub_stamp":"2024-09-14T11:54:08.123135+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:22.215301+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":518,"num_read_kb":13061,"num_write":810,"num_write_kb":29760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"264'2","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:24.880805+0000","last_change":"2024-09-14T11:54:24.880805+0000","last_active":"2024-09-14T11:54:24.880805+0000","last_peered":"2024-09-14T11:54:24.880805+0000","last_clean":"2024-09-14T11:54:24.880805+0000","last_became_active":"2024-09-14T11:09:48.963104+0000","last_became_peered":"2024-09-14T11:09:48.963104+0000","last_unstale":"2024-09-14T11:54:24.880805+0000","last_undegraded":"2024-09-14T11:54:24.880805+0000","last_fullsized":"2024-09-14T11:54:24.880805+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:54:24.880626+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:54:24.880626+0000","last_clean_scrub_stamp":"2024-09-14T11:54:24.880626+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:25.697197+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"264'169","reported_seq":755,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:36.772538+0000","last_change":"2024-09-14T11:54:36.772360+0000","last_active":"2024-09-14T11:54:36.772538+0000","last_peered":"2024-09-14T11:54:36.772538+0000","last_clean":"2024-09-14T11:54:36.772538+0000","last_became_active":"2024-09-14T11:09:50.983753+0000","last_became_peered":"2024-09-14T11:09:50.983753+0000","last_unstale":"2024-09-14T11:54:36.772538+0000","last_undegraded":"2024-09-14T11:54:36.772538+0000","last_fullsized":"2024-09-14T11:54:36.772538+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'169","last_scrub_stamp":"2024-09-14T11:54:36.772144+0000","last_deep_scrub":"264'169","last_deep_scrub_stamp":"2024-09-14T11:54:36.772144+0000","last_clean_scrub_stamp":"2024-09-14T11:54:36.772144+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:58.244746+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4671,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":206,"num_read_kb":262,"num_write":116,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:37.014216+0000","last_change":"2024-09-14T11:54:37.014050+0000","last_active":"2024-09-14T11:54:37.014216+0000","last_peered":"2024-09-14T11:54:37.014216+0000","last_clean":"2024-09-14T11:54:37.014216+0000","last_became_active":"2024-09-14T11:09:53.011077+0000","last_became_peered":"2024-09-14T11:09:53.011077+0000","last_unstale":"2024-09-14T11:54:37.014216+0000","last_undegraded":"2024-09-14T11:54:37.014216+0000","last_fullsized":"2024-09-14T11:54:37.014216+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:54:37.013874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:54:37.013874+0000","last_clean_scrub_stamp":"2024-09-14T11:54:37.013874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:18.050567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"264'168","reported_seq":676,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.915244+0000","last_change":"2024-09-14T11:54:28.915244+0000","last_active":"2024-09-14T11:54:28.915244+0000","last_peered":"2024-09-14T11:54:28.915244+0000","last_clean":"2024-09-14T11:54:28.915244+0000","last_became_active":"2024-09-14T11:09:55.021523+0000","last_became_peered":"2024-09-14T11:09:55.021523+0000","last_unstale":"2024-09-14T11:54:28.915244+0000","last_undegraded":"2024-09-14T11:54:28.915244+0000","last_fullsized":"2024-09-14T11:54:28.915244+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'168","last_scrub_stamp":"2024-09-14T11:54:28.915034+0000","last_deep_scrub":"264'168","last_deep_scrub_stamp":"2024-09-14T11:54:28.915034+0000","last_clean_scrub_stamp":"2024-09-14T11:54:28.915034+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:04.328569+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1072,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":209,"num_read_kb":183,"num_write":413,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"264'931","reported_seq":2659,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.709159+0000","last_change":"2024-09-14T11:54:15.708900+0000","last_active":"2024-09-14T11:54:15.709159+0000","last_peered":"2024-09-14T11:54:15.709159+0000","last_clean":"2024-09-14T11:54:15.709159+0000","last_became_active":"2024-09-14T11:09:46.951108+0000","last_became_peered":"2024-09-14T11:09:46.951108+0000","last_unstale":"2024-09-14T11:54:15.709159+0000","last_undegraded":"2024-09-14T11:54:15.709159+0000","last_fullsized":"2024-09-14T11:54:15.709159+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'931","last_scrub_stamp":"2024-09-14T11:54:15.708652+0000","last_deep_scrub":"264'931","last_deep_scrub_stamp":"2024-09-14T11:54:15.708652+0000","last_clean_scrub_stamp":"2024-09-14T11:54:15.708652+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":900,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:05.702799+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6915,"num_read_kb":6425,"num_write":1478,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"264'233","reported_seq":924,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:02.380470+0000","last_change":"2024-09-14T11:54:02.380470+0000","last_active":"2024-09-14T11:54:02.380470+0000","last_peered":"2024-09-14T11:54:02.380470+0000","last_clean":"2024-09-14T11:54:02.380470+0000","last_became_active":"2024-09-14T11:09:45.211372+0000","last_became_peered":"2024-09-14T11:09:45.211372+0000","last_unstale":"2024-09-14T11:54:02.380470+0000","last_undegraded":"2024-09-14T11:54:02.380470+0000","last_fullsized":"2024-09-14T11:54:02.380470+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'233","last_scrub_stamp":"2024-09-14T11:54:02.380386+0000","last_deep_scrub":"264'233","last_deep_scrub_stamp":"2024-09-14T11:54:02.380386+0000","last_clean_scrub_stamp":"2024-09-14T11:54:02.380386+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:14.254836+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":701,"num_read_kb":62622,"num_write":1043,"num_write_kb":26227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"264'1162","reported_seq":2875,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:12.335795+0000","last_change":"2024-09-14T11:54:12.335584+0000","last_active":"2024-09-14T11:54:12.335795+0000","last_peered":"2024-09-14T11:54:12.335795+0000","last_clean":"2024-09-14T11:54:12.335795+0000","last_became_active":"2024-09-14T11:09:46.970185+0000","last_became_peered":"2024-09-14T11:09:46.970185+0000","last_unstale":"2024-09-14T11:54:12.335795+0000","last_undegraded":"2024-09-14T11:54:12.335795+0000","last_fullsized":"2024-09-14T11:54:12.335795+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1162","last_scrub_stamp":"2024-09-14T11:54:12.335362+0000","last_deep_scrub":"264'1162","last_deep_scrub_stamp":"2024-09-14T11:54:12.335362+0000","last_clean_scrub_stamp":"2024-09-14T11:54:12.335362+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":1100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:35:56.805295+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5490,"num_read_kb":4916,"num_write":1574,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3025,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"264'229","reported_seq":853,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.253331+0000","last_change":"2024-09-14T11:54:06.253331+0000","last_active":"2024-09-14T11:54:06.253331+0000","last_peered":"2024-09-14T11:54:06.253331+0000","last_clean":"2024-09-14T11:54:06.253331+0000","last_became_active":"2024-09-14T11:09:45.213238+0000","last_became_peered":"2024-09-14T11:09:45.213238+0000","last_unstale":"2024-09-14T11:54:06.253331+0000","last_undegraded":"2024-09-14T11:54:06.253331+0000","last_fullsized":"2024-09-14T11:54:06.253331+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'229","last_scrub_stamp":"2024-09-14T11:54:06.253133+0000","last_deep_scrub":"264'229","last_deep_scrub_stamp":"2024-09-14T11:54:06.253133+0000","last_clean_scrub_stamp":"2024-09-14T11:54:06.253133+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:05.425833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":552,"num_read_kb":930,"num_write":1100,"num_write_kb":31959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"264'418","reported_seq":1955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:23.956045+0000","last_change":"2024-09-14T11:54:23.955913+0000","last_active":"2024-09-14T11:54:23.956045+0000","last_peered":"2024-09-14T11:54:23.956045+0000","last_clean":"2024-09-14T11:54:23.956045+0000","last_became_active":"2024-09-14T11:09:46.958063+0000","last_became_peered":"2024-09-14T11:09:46.958063+0000","last_unstale":"2024-09-14T11:54:23.956045+0000","last_undegraded":"2024-09-14T11:54:23.956045+0000","last_fullsized":"2024-09-14T11:54:23.956045+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'418","last_scrub_stamp":"2024-09-14T11:54:23.955735+0000","last_deep_scrub":"264'418","last_deep_scrub_stamp":"2024-09-14T11:54:23.955735+0000","last_clean_scrub_stamp":"2024-09-14T11:54:23.955735+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:30:58.368408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2247,"num_read_kb":2131,"num_write":481,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"264'227","reported_seq":1046,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.795526+0000","last_change":"2024-09-14T11:54:13.795526+0000","last_active":"2024-09-14T11:54:13.795526+0000","last_peered":"2024-09-14T11:54:13.795526+0000","last_clean":"2024-09-14T11:54:13.795526+0000","last_became_active":"2024-09-14T11:09:45.217258+0000","last_became_peered":"2024-09-14T11:09:45.217258+0000","last_unstale":"2024-09-14T11:54:13.795526+0000","last_undegraded":"2024-09-14T11:54:13.795526+0000","last_fullsized":"2024-09-14T11:54:13.795526+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'227","last_scrub_stamp":"2024-09-14T11:54:13.795287+0000","last_deep_scrub":"264'227","last_deep_scrub_stamp":"2024-09-14T11:54:13.795287+0000","last_clean_scrub_stamp":"2024-09-14T11:54:13.795287+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:59.198774+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311659,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1093,"num_read_kb":14899,"num_write":1046,"num_write_kb":43826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"264'406","reported_seq":1929,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:23.078079+0000","last_change":"2024-09-14T11:54:23.077918+0000","last_active":"2024-09-14T11:54:23.078079+0000","last_peered":"2024-09-14T11:54:23.078079+0000","last_clean":"2024-09-14T11:54:23.078079+0000","last_became_active":"2024-09-14T11:09:46.987465+0000","last_became_peered":"2024-09-14T11:09:46.987465+0000","last_unstale":"2024-09-14T11:54:23.078079+0000","last_undegraded":"2024-09-14T11:54:23.078079+0000","last_fullsized":"2024-09-14T11:54:23.078079+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'406","last_scrub_stamp":"2024-09-14T11:54:23.077727+0000","last_deep_scrub":"264'406","last_deep_scrub_stamp":"2024-09-14T11:54:23.077727+0000","last_clean_scrub_stamp":"2024-09-14T11:54:23.077727+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:59.683153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2188,"num_read_kb":2091,"num_write":479,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"264'214","reported_seq":833,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.155990+0000","last_change":"2024-09-14T11:54:09.155990+0000","last_active":"2024-09-14T11:54:09.155990+0000","last_peered":"2024-09-14T11:54:09.155990+0000","last_clean":"2024-09-14T11:54:09.155990+0000","last_became_active":"2024-09-14T11:09:45.210754+0000","last_became_peered":"2024-09-14T11:09:45.210754+0000","last_unstale":"2024-09-14T11:54:09.155990+0000","last_undegraded":"2024-09-14T11:54:09.155990+0000","last_fullsized":"2024-09-14T11:54:09.155990+0000","mapping_epoch":23,"log_start":"264'201","ondisk_log_start":"264'201","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'214","last_scrub_stamp":"2024-09-14T11:54:09.155714+0000","last_deep_scrub":"264'214","last_deep_scrub_stamp":"2024-09-14T11:54:09.155714+0000","last_clean_scrub_stamp":"2024-09-14T11:54:09.155714+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":201,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:16.447066+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254321,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":979,"num_write":956,"num_write_kb":15237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"264'393","reported_seq":1918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:20.113285+0000","last_change":"2024-09-14T11:54:20.113285+0000","last_active":"2024-09-14T11:54:20.113285+0000","last_peered":"2024-09-14T11:54:20.113285+0000","last_clean":"2024-09-14T11:54:20.113285+0000","last_became_active":"2024-09-14T11:09:46.975006+0000","last_became_peered":"2024-09-14T11:09:46.975006+0000","last_unstale":"2024-09-14T11:54:20.113285+0000","last_undegraded":"2024-09-14T11:54:20.113285+0000","last_fullsized":"2024-09-14T11:54:20.113285+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'393","last_scrub_stamp":"2024-09-14T11:54:20.113113+0000","last_deep_scrub":"264'393","last_deep_scrub_stamp":"2024-09-14T11:54:20.113113+0000","last_clean_scrub_stamp":"2024-09-14T11:54:20.113113+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:34.432992+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2194,"num_read_kb":2087,"num_write":454,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"264'207","reported_seq":832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:04.669979+0000","last_change":"2024-09-14T11:54:04.669688+0000","last_active":"2024-09-14T11:54:04.669979+0000","last_peered":"2024-09-14T11:54:04.669979+0000","last_clean":"2024-09-14T11:54:04.669979+0000","last_became_active":"2024-09-14T11:09:45.210639+0000","last_became_peered":"2024-09-14T11:09:45.210639+0000","last_unstale":"2024-09-14T11:54:04.669979+0000","last_undegraded":"2024-09-14T11:54:04.669979+0000","last_fullsized":"2024-09-14T11:54:04.669979+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'207","last_scrub_stamp":"2024-09-14T11:54:04.669386+0000","last_deep_scrub":"264'207","last_deep_scrub_stamp":"2024-09-14T11:54:04.669386+0000","last_clean_scrub_stamp":"2024-09-14T11:54:04.669386+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:45.645744+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655887,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":487,"num_read_kb":12081,"num_write":976,"num_write_kb":34333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"264'844","reported_seq":2520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:12.797196+0000","last_change":"2024-09-14T11:54:12.797196+0000","last_active":"2024-09-14T11:54:12.797196+0000","last_peered":"2024-09-14T11:54:12.797196+0000","last_clean":"2024-09-14T11:54:12.797196+0000","last_became_active":"2024-09-14T11:09:46.961185+0000","last_became_peered":"2024-09-14T11:09:46.961185+0000","last_unstale":"2024-09-14T11:54:12.797196+0000","last_undegraded":"2024-09-14T11:54:12.797196+0000","last_fullsized":"2024-09-14T11:54:12.797196+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'844","last_scrub_stamp":"2024-09-14T11:54:12.796991+0000","last_deep_scrub":"264'844","last_deep_scrub_stamp":"2024-09-14T11:54:12.796991+0000","last_clean_scrub_stamp":"2024-09-14T11:54:12.796991+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":800,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:51.293229+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4099,"num_read_kb":3707,"num_write":1108,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"264'193","reported_seq":810,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:06.672470+0000","last_change":"2024-09-14T11:54:06.672295+0000","last_active":"2024-09-14T11:54:06.672470+0000","last_peered":"2024-09-14T11:54:06.672470+0000","last_clean":"2024-09-14T11:54:06.672470+0000","last_became_active":"2024-09-14T11:09:45.220246+0000","last_became_peered":"2024-09-14T11:09:45.220246+0000","last_unstale":"2024-09-14T11:54:06.672470+0000","last_undegraded":"2024-09-14T11:54:06.672470+0000","last_fullsized":"2024-09-14T11:54:06.672470+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'193","last_scrub_stamp":"2024-09-14T11:54:06.672104+0000","last_deep_scrub":"264'193","last_deep_scrub_stamp":"2024-09-14T11:54:06.672104+0000","last_clean_scrub_stamp":"2024-09-14T11:54:06.672104+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:13.489184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":452,"num_read_kb":10292,"num_write":865,"num_write_kb":29061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"264'673","reported_seq":2021,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.583120+0000","last_change":"2024-09-14T11:54:15.583120+0000","last_active":"2024-09-14T11:54:15.583120+0000","last_peered":"2024-09-14T11:54:15.583120+0000","last_clean":"2024-09-14T11:54:15.583120+0000","last_became_active":"2024-09-14T11:09:46.990649+0000","last_became_peered":"2024-09-14T11:09:46.990649+0000","last_unstale":"2024-09-14T11:54:15.583120+0000","last_undegraded":"2024-09-14T11:54:15.583120+0000","last_fullsized":"2024-09-14T11:54:15.583120+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'673","last_scrub_stamp":"2024-09-14T11:54:15.582941+0000","last_deep_scrub":"264'673","last_deep_scrub_stamp":"2024-09-14T11:54:15.582941+0000","last_clean_scrub_stamp":"2024-09-14T11:54:15.582941+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":600,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:20.316004+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3174,"num_read_kb":2866,"num_write":894,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"264'236","reported_seq":904,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.320491+0000","last_change":"2024-09-14T11:54:07.320327+0000","last_active":"2024-09-14T11:54:07.320491+0000","last_peered":"2024-09-14T11:54:07.320491+0000","last_clean":"2024-09-14T11:54:07.320491+0000","last_became_active":"2024-09-14T11:09:45.207500+0000","last_became_peered":"2024-09-14T11:09:45.207500+0000","last_unstale":"2024-09-14T11:54:07.320491+0000","last_undegraded":"2024-09-14T11:54:07.320491+0000","last_fullsized":"2024-09-14T11:54:07.320491+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'236","last_scrub_stamp":"2024-09-14T11:54:07.320137+0000","last_deep_scrub":"264'236","last_deep_scrub_stamp":"2024-09-14T11:54:07.320137+0000","last_clean_scrub_stamp":"2024-09-14T11:54:07.320137+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:25.724756+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":644,"num_read_kb":28771,"num_write":1111,"num_write_kb":28685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"264'2091","reported_seq":3870,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:09.573339+0000","last_change":"2024-09-14T11:54:09.573339+0000","last_active":"2024-09-14T11:54:09.573339+0000","last_peered":"2024-09-14T11:54:09.573339+0000","last_clean":"2024-09-14T11:54:09.573339+0000","last_became_active":"2024-09-14T11:09:46.964893+0000","last_became_peered":"2024-09-14T11:09:46.964893+0000","last_unstale":"2024-09-14T11:54:09.573339+0000","last_undegraded":"2024-09-14T11:54:09.573339+0000","last_fullsized":"2024-09-14T11:54:09.573339+0000","mapping_epoch":25,"log_start":"264'2000","ondisk_log_start":"264'2000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2091","last_scrub_stamp":"2024-09-14T11:54:09.573154+0000","last_deep_scrub":"264'2091","last_deep_scrub_stamp":"2024-09-14T11:54:09.573154+0000","last_clean_scrub_stamp":"2024-09-14T11:54:09.573154+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":2000,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:09.033740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9234,"num_read_kb":7993,"num_write":3022,"num_write_kb":1347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"264'284","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.154424+0000","last_change":"2024-09-14T11:54:10.154261+0000","last_active":"2024-09-14T11:54:10.154424+0000","last_peered":"2024-09-14T11:54:10.154424+0000","last_clean":"2024-09-14T11:54:10.154424+0000","last_became_active":"2024-09-14T11:09:45.201951+0000","last_became_peered":"2024-09-14T11:09:45.201951+0000","last_unstale":"2024-09-14T11:54:10.154424+0000","last_undegraded":"2024-09-14T11:54:10.154424+0000","last_fullsized":"2024-09-14T11:54:10.154424+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'284","last_scrub_stamp":"2024-09-14T11:54:10.154062+0000","last_deep_scrub":"264'284","last_deep_scrub_stamp":"2024-09-14T11:54:10.154062+0000","last_clean_scrub_stamp":"2024-09-14T11:54:10.154062+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:54.648794+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655900,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":878,"num_read_kb":20954,"num_write":1195,"num_write_kb":48388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"264'393","reported_seq":1907,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.436438+0000","last_change":"2024-09-14T11:54:15.436438+0000","last_active":"2024-09-14T11:54:15.436438+0000","last_peered":"2024-09-14T11:54:15.436438+0000","last_clean":"2024-09-14T11:54:15.436438+0000","last_became_active":"2024-09-14T11:09:46.982125+0000","last_became_peered":"2024-09-14T11:09:46.982125+0000","last_unstale":"2024-09-14T11:54:15.436438+0000","last_undegraded":"2024-09-14T11:54:15.436438+0000","last_fullsized":"2024-09-14T11:54:15.436438+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'393","last_scrub_stamp":"2024-09-14T11:54:15.436260+0000","last_deep_scrub":"264'393","last_deep_scrub_stamp":"2024-09-14T11:54:15.436260+0000","last_clean_scrub_stamp":"2024-09-14T11:54:15.436260+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:35.766474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2124,"num_read_kb":2027,"num_write":431,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"264'254","reported_seq":939,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.887775+0000","last_change":"2024-09-14T11:54:18.887775+0000","last_active":"2024-09-14T11:54:18.887775+0000","last_peered":"2024-09-14T11:54:18.887775+0000","last_clean":"2024-09-14T11:54:18.887775+0000","last_became_active":"2024-09-14T11:09:45.219634+0000","last_became_peered":"2024-09-14T11:09:45.219634+0000","last_unstale":"2024-09-14T11:54:18.887775+0000","last_undegraded":"2024-09-14T11:54:18.887775+0000","last_fullsized":"2024-09-14T11:54:18.887775+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'254","last_scrub_stamp":"2024-09-14T11:54:18.887539+0000","last_deep_scrub":"264'254","last_deep_scrub_stamp":"2024-09-14T11:54:18.887539+0000","last_clean_scrub_stamp":"2024-09-14T11:54:18.887539+0000","objects_scrubbed":4,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:50.094040+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311685,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":704,"num_read_kb":35580,"num_write":1143,"num_write_kb":63455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"264'547","reported_seq":2105,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.794085+0000","last_change":"2024-09-14T11:54:15.794085+0000","last_active":"2024-09-14T11:54:15.794085+0000","last_peered":"2024-09-14T11:54:15.794085+0000","last_clean":"2024-09-14T11:54:15.794085+0000","last_became_active":"2024-09-14T11:09:46.962261+0000","last_became_peered":"2024-09-14T11:09:46.962261+0000","last_unstale":"2024-09-14T11:54:15.794085+0000","last_undegraded":"2024-09-14T11:54:15.794085+0000","last_fullsized":"2024-09-14T11:54:15.794085+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'547","last_scrub_stamp":"2024-09-14T11:54:15.793906+0000","last_deep_scrub":"264'547","last_deep_scrub_stamp":"2024-09-14T11:54:15.793906+0000","last_clean_scrub_stamp":"2024-09-14T11:54:15.793906+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:35.613525+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2646,"num_read_kb":2439,"num_write":661,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"264'219","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:12.138157+0000","last_change":"2024-09-14T11:54:12.137906+0000","last_active":"2024-09-14T11:54:12.138157+0000","last_peered":"2024-09-14T11:54:12.138157+0000","last_clean":"2024-09-14T11:54:12.138157+0000","last_became_active":"2024-09-14T11:09:45.200775+0000","last_became_peered":"2024-09-14T11:09:45.200775+0000","last_unstale":"2024-09-14T11:54:12.138157+0000","last_undegraded":"2024-09-14T11:54:12.138157+0000","last_fullsized":"2024-09-14T11:54:12.138157+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'219","last_scrub_stamp":"2024-09-14T11:54:12.137682+0000","last_deep_scrub":"264'219","last_deep_scrub_stamp":"2024-09-14T11:54:12.137682+0000","last_clean_scrub_stamp":"2024-09-14T11:54:12.137682+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:03.171120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":537,"num_read_kb":33597,"num_write":1024,"num_write_kb":35359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"264'568","reported_seq":2423,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.068302+0000","last_change":"2024-09-14T11:54:22.068157+0000","last_active":"2024-09-14T11:54:22.068302+0000","last_peered":"2024-09-14T11:54:22.068302+0000","last_clean":"2024-09-14T11:54:22.068302+0000","last_became_active":"2024-09-14T11:09:46.974543+0000","last_became_peered":"2024-09-14T11:09:46.974543+0000","last_unstale":"2024-09-14T11:54:22.068302+0000","last_undegraded":"2024-09-14T11:54:22.068302+0000","last_fullsized":"2024-09-14T11:54:22.068302+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'568","last_scrub_stamp":"2024-09-14T11:54:22.067970+0000","last_deep_scrub":"264'568","last_deep_scrub_stamp":"2024-09-14T11:54:22.067970+0000","last_clean_scrub_stamp":"2024-09-14T11:54:22.067970+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":500,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:18.404651+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3309,"num_read_kb":3115,"num_write":715,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2991,"num_omap_keys":12,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"264'214","reported_seq":854,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.653114+0000","last_change":"2024-09-14T11:54:05.652966+0000","last_active":"2024-09-14T11:54:05.653114+0000","last_peered":"2024-09-14T11:54:05.653114+0000","last_clean":"2024-09-14T11:54:05.653114+0000","last_became_active":"2024-09-14T11:09:45.204754+0000","last_became_peered":"2024-09-14T11:09:45.204754+0000","last_unstale":"2024-09-14T11:54:05.653114+0000","last_undegraded":"2024-09-14T11:54:05.653114+0000","last_fullsized":"2024-09-14T11:54:05.653114+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'214","last_scrub_stamp":"2024-09-14T11:54:05.652763+0000","last_deep_scrub":"264'214","last_deep_scrub_stamp":"2024-09-14T11:54:05.652763+0000","last_clean_scrub_stamp":"2024-09-14T11:54:05.652763+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:57.152636+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":525,"num_read_kb":30401,"num_write":981,"num_write_kb":24964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"264'575","reported_seq":2332,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.609480+0000","last_change":"2024-09-14T11:54:07.609313+0000","last_active":"2024-09-14T11:54:07.609480+0000","last_peered":"2024-09-14T11:54:07.609480+0000","last_clean":"2024-09-14T11:54:07.609480+0000","last_became_active":"2024-09-14T11:09:46.964946+0000","last_became_peered":"2024-09-14T11:09:46.964946+0000","last_unstale":"2024-09-14T11:54:07.609480+0000","last_undegraded":"2024-09-14T11:54:07.609480+0000","last_fullsized":"2024-09-14T11:54:07.609480+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'575","last_scrub_stamp":"2024-09-14T11:54:07.609118+0000","last_deep_scrub":"264'575","last_deep_scrub_stamp":"2024-09-14T11:54:07.609118+0000","last_clean_scrub_stamp":"2024-09-14T11:54:07.609118+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":500,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:14.923150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3099,"num_read_kb":2896,"num_write":721,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"264'213","reported_seq":909,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.691655+0000","last_change":"2024-09-14T11:54:11.691374+0000","last_active":"2024-09-14T11:54:11.691655+0000","last_peered":"2024-09-14T11:54:11.691655+0000","last_clean":"2024-09-14T11:54:11.691655+0000","last_became_active":"2024-09-14T11:09:45.191314+0000","last_became_peered":"2024-09-14T11:09:45.191314+0000","last_unstale":"2024-09-14T11:54:11.691655+0000","last_undegraded":"2024-09-14T11:54:11.691655+0000","last_fullsized":"2024-09-14T11:54:11.691655+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'213","last_scrub_stamp":"2024-09-14T11:54:11.691188+0000","last_deep_scrub":"264'213","last_deep_scrub_stamp":"2024-09-14T11:54:11.691188+0000","last_clean_scrub_stamp":"2024-09-14T11:54:11.691188+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:08.058246+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":695,"num_read_kb":24382,"num_write":1016,"num_write_kb":29533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"264'553","reported_seq":2040,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:11.539170+0000","last_change":"2024-09-14T11:54:11.538890+0000","last_active":"2024-09-14T11:54:11.539170+0000","last_peered":"2024-09-14T11:54:11.539170+0000","last_clean":"2024-09-14T11:54:11.539170+0000","last_became_active":"2024-09-14T11:09:46.994113+0000","last_became_peered":"2024-09-14T11:09:46.994113+0000","last_unstale":"2024-09-14T11:54:11.539170+0000","last_undegraded":"2024-09-14T11:54:11.539170+0000","last_fullsized":"2024-09-14T11:54:11.539170+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'553","last_scrub_stamp":"2024-09-14T11:54:11.538649+0000","last_deep_scrub":"264'553","last_deep_scrub_stamp":"2024-09-14T11:54:11.538649+0000","last_clean_scrub_stamp":"2024-09-14T11:54:11.538649+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:53.524362+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2807,"num_read_kb":2558,"num_write":736,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"264'224","reported_seq":827,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:05.714696+0000","last_change":"2024-09-14T11:54:05.714480+0000","last_active":"2024-09-14T11:54:05.714696+0000","last_peered":"2024-09-14T11:54:05.714696+0000","last_clean":"2024-09-14T11:54:05.714696+0000","last_became_active":"2024-09-14T11:09:45.214511+0000","last_became_peered":"2024-09-14T11:09:45.214511+0000","last_unstale":"2024-09-14T11:54:05.714696+0000","last_undegraded":"2024-09-14T11:54:05.714696+0000","last_fullsized":"2024-09-14T11:54:05.714696+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'224","last_scrub_stamp":"2024-09-14T11:54:05.714278+0000","last_deep_scrub":"264'224","last_deep_scrub_stamp":"2024-09-14T11:54:05.714278+0000","last_clean_scrub_stamp":"2024-09-14T11:54:05.714278+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:43.486418+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":484,"num_read_kb":9689,"num_write":1032,"num_write_kb":43578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"264'466","reported_seq":1951,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.375582+0000","last_change":"2024-09-14T11:54:13.375439+0000","last_active":"2024-09-14T11:54:13.375582+0000","last_peered":"2024-09-14T11:54:13.375582+0000","last_clean":"2024-09-14T11:54:13.375582+0000","last_became_active":"2024-09-14T11:09:46.974152+0000","last_became_peered":"2024-09-14T11:09:46.974152+0000","last_unstale":"2024-09-14T11:54:13.375582+0000","last_undegraded":"2024-09-14T11:54:13.375582+0000","last_fullsized":"2024-09-14T11:54:13.375582+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'466","last_scrub_stamp":"2024-09-14T11:54:13.375253+0000","last_deep_scrub":"264'466","last_deep_scrub_stamp":"2024-09-14T11:54:13.375253+0000","last_clean_scrub_stamp":"2024-09-14T11:54:13.375253+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:27.247012+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2413,"num_read_kb":2245,"num_write":556,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":963,"num_omap_keys":4,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"264'251","reported_seq":912,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:15.840595+0000","last_change":"2024-09-14T11:54:15.840451+0000","last_active":"2024-09-14T11:54:15.840595+0000","last_peered":"2024-09-14T11:54:15.840595+0000","last_clean":"2024-09-14T11:54:15.840595+0000","last_became_active":"2024-09-14T11:09:45.202934+0000","last_became_peered":"2024-09-14T11:09:45.202934+0000","last_unstale":"2024-09-14T11:54:15.840595+0000","last_undegraded":"2024-09-14T11:54:15.840595+0000","last_fullsized":"2024-09-14T11:54:15.840595+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'251","last_scrub_stamp":"2024-09-14T11:54:15.840262+0000","last_deep_scrub":"264'251","last_deep_scrub_stamp":"2024-09-14T11:54:15.840262+0000","last_clean_scrub_stamp":"2024-09-14T11:54:15.840262+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:52.093309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":642,"num_read_kb":75186,"num_write":1115,"num_write_kb":32522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"264'400","reported_seq":1923,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:16.663384+0000","last_change":"2024-09-14T11:54:16.663245+0000","last_active":"2024-09-14T11:54:16.663384+0000","last_peered":"2024-09-14T11:54:16.663384+0000","last_clean":"2024-09-14T11:54:16.663384+0000","last_became_active":"2024-09-14T11:09:46.946993+0000","last_became_peered":"2024-09-14T11:09:46.946993+0000","last_unstale":"2024-09-14T11:54:16.663384+0000","last_undegraded":"2024-09-14T11:54:16.663384+0000","last_fullsized":"2024-09-14T11:54:16.663384+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'400","last_scrub_stamp":"2024-09-14T11:54:16.663026+0000","last_deep_scrub":"264'400","last_deep_scrub_stamp":"2024-09-14T11:54:16.663026+0000","last_clean_scrub_stamp":"2024-09-14T11:54:16.663026+0000","objects_scrubbed":6,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:18.854555+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2163,"num_read_kb":2058,"num_write":443,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"264'192","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.273980+0000","last_change":"2024-09-14T11:54:07.273839+0000","last_active":"2024-09-14T11:54:07.273980+0000","last_peered":"2024-09-14T11:54:07.273980+0000","last_clean":"2024-09-14T11:54:07.273980+0000","last_became_active":"2024-09-14T11:09:45.217119+0000","last_became_peered":"2024-09-14T11:09:45.217119+0000","last_unstale":"2024-09-14T11:54:07.273980+0000","last_undegraded":"2024-09-14T11:54:07.273980+0000","last_fullsized":"2024-09-14T11:54:07.273980+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'192","last_scrub_stamp":"2024-09-14T11:54:07.273623+0000","last_deep_scrub":"264'192","last_deep_scrub_stamp":"2024-09-14T11:54:07.273623+0000","last_clean_scrub_stamp":"2024-09-14T11:54:07.273623+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:44:27.235610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":19832,"num_write":847,"num_write_kb":31579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"264'831","reported_seq":2395,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.633341+0000","last_change":"2024-09-14T11:54:17.633118+0000","last_active":"2024-09-14T11:54:17.633341+0000","last_peered":"2024-09-14T11:54:17.633341+0000","last_clean":"2024-09-14T11:54:17.633341+0000","last_became_active":"2024-09-14T11:09:46.990899+0000","last_became_peered":"2024-09-14T11:09:46.990899+0000","last_unstale":"2024-09-14T11:54:17.633341+0000","last_undegraded":"2024-09-14T11:54:17.633341+0000","last_fullsized":"2024-09-14T11:54:17.633341+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'831","last_scrub_stamp":"2024-09-14T11:54:17.632872+0000","last_deep_scrub":"264'831","last_deep_scrub_stamp":"2024-09-14T11:54:17.632872+0000","last_clean_scrub_stamp":"2024-09-14T11:54:17.632872+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:11.212125+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3995,"num_read_kb":3582,"num_write":1122,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":246,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"264'250","reported_seq":960,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:16.871805+0000","last_change":"2024-09-14T11:54:16.871805+0000","last_active":"2024-09-14T11:54:16.871805+0000","last_peered":"2024-09-14T11:54:16.871805+0000","last_clean":"2024-09-14T11:54:16.871805+0000","last_became_active":"2024-09-14T11:09:45.214713+0000","last_became_peered":"2024-09-14T11:09:45.214713+0000","last_unstale":"2024-09-14T11:54:16.871805+0000","last_undegraded":"2024-09-14T11:54:16.871805+0000","last_fullsized":"2024-09-14T11:54:16.871805+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'250","last_scrub_stamp":"2024-09-14T11:54:16.871571+0000","last_deep_scrub":"264'250","last_deep_scrub_stamp":"2024-09-14T11:54:16.871571+0000","last_clean_scrub_stamp":"2024-09-14T11:54:16.871571+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:01.834473+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655874,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":741,"num_read_kb":73898,"num_write":1178,"num_write_kb":36295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"264'151","reported_seq":851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.901832+0000","last_change":"2024-09-14T11:54:17.901832+0000","last_active":"2024-09-14T11:54:17.901832+0000","last_peered":"2024-09-14T11:54:17.901832+0000","last_clean":"2024-09-14T11:54:17.901832+0000","last_became_active":"2024-09-14T11:09:45.202270+0000","last_became_peered":"2024-09-14T11:09:45.202270+0000","last_unstale":"2024-09-14T11:54:17.901832+0000","last_undegraded":"2024-09-14T11:54:17.901832+0000","last_fullsized":"2024-09-14T11:54:17.901832+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'151","last_scrub_stamp":"2024-09-14T11:54:17.901656+0000","last_deep_scrub":"264'151","last_deep_scrub_stamp":"2024-09-14T11:54:17.901656+0000","last_clean_scrub_stamp":"2024-09-14T11:54:17.901656+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:35.985077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":694,"num_read_kb":138365,"num_write":726,"num_write_kb":22161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"264'890","reported_seq":2655,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.708210+0000","last_change":"2024-09-14T11:54:17.708210+0000","last_active":"2024-09-14T11:54:17.708210+0000","last_peered":"2024-09-14T11:54:17.708210+0000","last_clean":"2024-09-14T11:54:17.708210+0000","last_became_active":"2024-09-14T11:09:46.947102+0000","last_became_peered":"2024-09-14T11:09:46.947102+0000","last_unstale":"2024-09-14T11:54:17.708210+0000","last_undegraded":"2024-09-14T11:54:17.708210+0000","last_fullsized":"2024-09-14T11:54:17.708210+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'890","last_scrub_stamp":"2024-09-14T11:54:17.707983+0000","last_deep_scrub":"264'890","last_deep_scrub_stamp":"2024-09-14T11:54:17.707983+0000","last_clean_scrub_stamp":"2024-09-14T11:54:17.707983+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":800,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:08.415593+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4492,"num_read_kb":4074,"num_write":1171,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"264'223","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.123278+0000","last_change":"2024-09-14T11:54:13.123278+0000","last_active":"2024-09-14T11:54:13.123278+0000","last_peered":"2024-09-14T11:54:13.123278+0000","last_clean":"2024-09-14T11:54:13.123278+0000","last_became_active":"2024-09-14T11:09:45.204922+0000","last_became_peered":"2024-09-14T11:09:45.204922+0000","last_unstale":"2024-09-14T11:54:13.123278+0000","last_undegraded":"2024-09-14T11:54:13.123278+0000","last_fullsized":"2024-09-14T11:54:13.123278+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'223","last_scrub_stamp":"2024-09-14T11:54:13.123032+0000","last_deep_scrub":"264'223","last_deep_scrub_stamp":"2024-09-14T11:54:13.123032+0000","last_clean_scrub_stamp":"2024-09-14T11:54:13.123032+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:16.567257+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":767,"num_read_kb":17805,"num_write":1021,"num_write_kb":50816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"264'497","reported_seq":2063,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:54:10.551499+0000","last_change":"2024-09-14T11:54:10.551499+0000","last_active":"2024-09-14T11:54:10.551499+0000","last_peered":"2024-09-14T11:54:10.551499+0000","last_clean":"2024-09-14T11:54:10.551499+0000","last_became_active":"2024-09-14T11:09:46.981819+0000","last_became_peered":"2024-09-14T11:09:46.981819+0000","last_unstale":"2024-09-14T11:54:10.551499+0000","last_undegraded":"2024-09-14T11:54:10.551499+0000","last_fullsized":"2024-09-14T11:54:10.551499+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'497","last_scrub_stamp":"2024-09-14T11:54:10.551288+0000","last_deep_scrub":"264'497","last_deep_scrub_stamp":"2024-09-14T11:54:10.551288+0000","last_clean_scrub_stamp":"2024-09-14T11:54:10.551288+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:02.481867+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2560,"num_read_kb":2380,"num_write":586,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10857,"num_read_kb":9179,"num_write":3115,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1006,"ondisk_log_size":1006,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15755,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":15151,"num_read_kb":14810,"num_write":17052,"num_write_kb":4979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2763,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1883,"ondisk_log_size":1883,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":760,"ondisk_log_size":760,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":375102,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":8356,"num_read_kb":10715,"num_write":5641,"num_write_kb":2812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":711024,"num_omap_keys":1616,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2014,"ondisk_log_size":2014,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2413,"num_read_kb":2881,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":220474,"num_read_kb":201951,"num_write":55880,"num_write_kb":19076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35749,"num_omap_keys":144,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4027,"ondisk_log_size":4027,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":40916491,"num_objects":168,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":0,"num_read":38991,"num_read_kb":2064033,"num_write":64568,"num_write_kb":2182336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":82870272,"data_stored":81832982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3601,"ondisk_log_size":3601,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":158488,"num_write":182,"num_write_kb":116383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":158381,"num_write":182,"num_write_kb":116383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509996,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220180,"kb_used_data":18244,"kb_used_omap":1,"kb_used_meta":201918,"kb_avail":94151660,"statfs":{"total":96636764160,"available":96411299840,"internally_reserved":0,"allocated":18681856,"data_stored":17014199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":206764487},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509998,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119184,"kb_used_data":11648,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94252656,"statfs":{"total":96636764160,"available":96514719744,"internally_reserved":0,"allocated":11927552,"data_stored":10256263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542700,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":205004,"kb_used_data":7292,"kb_used_omap":1,"kb_used_meta":197694,"kb_avail":94166836,"statfs":{"total":96636764160,"available":96426840064,"internally_reserved":0,"allocated":7467008,"data_stored":5850366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":202439114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542698,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84808,"kb_used_data":13368,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94287032,"statfs":{"total":96636764160,"available":96549920768,"internally_reserved":0,"allocated":13688832,"data_stored":12047474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542698,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":261108,"kb_used_data":23076,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94110732,"statfs":{"total":96636764160,"available":96369389568,"internally_reserved":0,"allocated":23629824,"data_stored":21914965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243726789},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542699,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":166900,"kb_used_data":5284,"kb_used_omap":1,"kb_used_meta":161598,"kb_avail":94204940,"statfs":{"total":96636764160,"available":96465858560,"internally_reserved":0,"allocated":5410816,"data_stored":3769131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":165476805},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542699,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":268348,"kb_used_data":16428,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94103492,"statfs":{"total":96636764160,"available":96361975808,"internally_reserved":0,"allocated":16822272,"data_stored":15174645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257948101},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542700,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":86684,"kb_used_data":15244,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94285156,"statfs":{"total":96636764160,"available":96547999744,"internally_reserved":0,"allocated":15609856,"data_stored":13878717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11948032,"data_stored":11766247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12473898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8265728,"data_stored":8142582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15040512,"data_stored":14902957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1753088,"data_stored":1656299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":19398656,"data_stored":19214635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10035200,"data_stored":9935327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3846144,"data_stored":3741037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":6024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":5138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":2784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:55:26.138 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-14T11:55:26.495 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-14T11:55:26.495 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-14T11:55:26.496 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-14T11:55:26.496 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:55:26.568 INFO:tasks.ceph.osd.0:Stopped 2024-09-14T11:55:26.568 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-14T11:55:26.568 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:55:28.445 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-09-14T11:55:32.669 INFO:tasks.ceph.osd.1:Stopped 2024-09-14T11:55:32.670 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-14T11:55:32.670 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:55:32.760 INFO:tasks.ceph.osd.2:Stopped 2024-09-14T11:55:32.760 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-14T11:55:32.760 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:55:32.845 INFO:tasks.ceph.osd.3:Stopped 2024-09-14T11:55:32.846 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-14T11:55:32.846 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:55:34.252 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-09-14T11:55:34.252 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-09-14T11:55:38.947 INFO:tasks.ceph.osd.4:Stopped 2024-09-14T11:55:38.976 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-14T11:55:38.976 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:55:39.065 INFO:tasks.ceph.osd.5:Stopped 2024-09-14T11:55:39.066 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-14T11:55:39.066 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:55:39.857 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-14T11:55:39.857 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-09-14T11:55:45.167 INFO:tasks.ceph.osd.6:Stopped 2024-09-14T11:55:45.167 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-14T11:55:45.168 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:55:45.242 INFO:tasks.ceph.osd.7:Stopped 2024-09-14T11:55:45.242 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-14T11:55:45.242 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-14T11:55:45.243 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:55:45.273 INFO:tasks.ceph.mgr.y:Stopped 2024-09-14T11:55:45.273 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-14T11:55:45.273 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:55:45.302 INFO:tasks.ceph.mgr.x:Stopped 2024-09-14T11:55:45.302 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-14T11:55:45.303 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-14T11:55:45.303 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:55:45.303 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~6s 2024-09-14T11:55:45.303 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2024-09-14T11:55:45.303 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-09-14T11:55:45.339 INFO:tasks.ceph.mon.a:Stopped 2024-09-14T11:55:45.339 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-14T11:55:45.339 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:55:45.404 INFO:tasks.ceph.mon.c:Stopped 2024-09-14T11:55:45.405 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-14T11:55:45.405 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:55:45.431 INFO:tasks.ceph.mon.b:Stopped 2024-09-14T11:55:45.431 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-14T11:55:45.431 DEBUG:teuthology.orchestra.run.smithi071:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-14T11:55:45.462 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-14T11:55:45.462 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-14T11:55:45.747 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-14T11:55:45.747 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-14T11:55:45.934 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-14T11:55:45.934 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-14T11:55:46.041 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-14T11:55:46.041 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-14T11:55:46.174 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi157.front.sepia.ceph.com 2024-09-14T11:55:46.174 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-14T11:55:46.599 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi157.front.sepia.ceph.com 2024-09-14T11:55:46.599 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-14T11:55:46.782 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi157.front.sepia.ceph.com 2024-09-14T11:55:46.782 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-14T11:55:46.962 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi157.front.sepia.ceph.com 2024-09-14T11:55:46.963 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-14T11:55:47.151 INFO:tasks.ceph:Archiving mon data... 2024-09-14T11:55:47.153 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904156/data/mon.a.tgz 2024-09-14T11:55:47.153 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2024-09-14T11:55:47.159 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.ZTpSx1LiWH 2024-09-14T11:55:47.159 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ZTpSx1LiWH 2024-09-14T11:55:47.347 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.ZTpSx1LiWH 2024-09-14T11:55:47.411 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.ZTpSx1LiWH is 540KB 2024-09-14T11:55:47.473 DEBUG:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.ZTpSx1LiWH 2024-09-14T11:55:47.478 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904156/data/mon.c.tgz 2024-09-14T11:55:47.478 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2024-09-14T11:55:47.527 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.eLKUpwZzvL 2024-09-14T11:55:47.527 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.eLKUpwZzvL 2024-09-14T11:55:47.721 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.eLKUpwZzvL 2024-09-14T11:55:47.783 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.eLKUpwZzvL is 580KB 2024-09-14T11:55:47.849 DEBUG:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.eLKUpwZzvL 2024-09-14T11:55:47.854 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904156/data/mon.b.tgz 2024-09-14T11:55:47.855 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2024-09-14T11:55:47.860 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.8dSS6hjExj 2024-09-14T11:55:47.861 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.8dSS6hjExj 2024-09-14T11:55:48.060 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.8dSS6hjExj 2024-09-14T11:55:48.129 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.8dSS6hjExj is 579KB 2024-09-14T11:55:48.193 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.8dSS6hjExj 2024-09-14T11:55:48.199 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-14T11:55:48.199 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T11:55:48.202 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T11:55:48.261 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T11:55:48.308 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T11:55:48.308 INFO:tasks.ceph:Archiving crash dumps... 2024-09-14T11:55:48.310 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904156/remote/smithi071/crash 2024-09-14T11:55:48.311 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T11:55:48.325 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904156/remote/smithi157/crash 2024-09-14T11:55:48.326 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T11:55:48.363 INFO:tasks.ceph:Compressing logs... 2024-09-14T11:55:48.363 DEBUG:teuthology.orchestra.run.smithi071:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T11:55:48.376 DEBUG:teuthology.orchestra.run.smithi157:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T11:55:48.404 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32008.log 2024-09-14T11:55:48.404 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26849.log 2024-09-14T11:55:48.406 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181285.log 2024-09-14T11:55:48.406 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32008.log: /var/log/ceph/ceph-client.admin.26849.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-14T11:55:48.406 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32008.log.gz 2024-09-14T11:55:48.406 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26849.log.gz 2024-09-14T11:55:48.406 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.181285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86641.log 2024-09-14T11:55:48.406 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181285.log.gz 2024-09-14T11:55:48.406 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144468.log 2024-09-14T11:55:48.411 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.86641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38269.log 2024-09-14T11:55:48.411 INFO:teuthology.orchestra.run.smithi071.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.86641.log.gz 2024-09-14T11:55:48.411 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.144468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47924.log 2024-09-14T11:55:48.411 INFO:teuthology.orchestra.run.smithi071.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.144468.log.gz 2024-09-14T11:55:48.411 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.38269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49104.log 2024-09-14T11:55:48.411 INFO:teuthology.orchestra.run.smithi071.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.38269.log.gz 2024-09-14T11:55:48.411 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.47924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181181.log 2024-09-14T11:55:48.411 INFO:teuthology.orchestra.run.smithi071.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.47924.log.gz 2024-09-14T11:55:48.412 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.49104.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-14T11:55:48.412 INFO:teuthology.orchestra.run.smithi071.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.49104.log.gz 2024-09-14T11:55:48.412 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.181181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156983.log 2024-09-14T11:55:48.412 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181181.log.gz 2024-09-14T11:55:48.412 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36315.log 2024-09-14T11:55:48.412 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.156983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32218.log 2024-09-14T11:55:48.412 INFO:teuthology.orchestra.run.smithi071.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.156983.log.gz 2024-09-14T11:55:48.412 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.36315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106115.log 2024-09-14T11:55:48.412 INFO:teuthology.orchestra.run.smithi071.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.36315.log.gz 2024-09-14T11:55:48.412 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66864.log 2024-09-14T11:55:48.412 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32218.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32218.log.gz 2024-09-14T11:55:48.412 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.106115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161153.log 2024-09-14T11:55:48.412 INFO:teuthology.orchestra.run.smithi071.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.106115.log.gz 2024-09-14T11:55:48.413 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.66864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181783.log 2024-09-14T11:55:48.413 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.161153.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.66864.log.gz 2024-09-14T11:55:48.417 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136207.log 2024-09-14T11:55:48.417 INFO:teuthology.orchestra.run.smithi071.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.161153.log.gz 2024-09-14T11:55:48.417 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55846.log 2024-09-14T11:55:48.417 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.181783.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181783.log.gz 2024-09-14T11:55:48.417 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.136207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52104.log 2024-09-14T11:55:48.418 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55846.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.136207.log.gz 2024-09-14T11:55:48.418 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145061.log 2024-09-14T11:55:48.418 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178655.log 2024-09-14T11:55:48.418 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.52104.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52104.log.gz 2024-09-14T11:55:48.418 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.145061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51514.log 2024-09-14T11:55:48.418 INFO:teuthology.orchestra.run.smithi071.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.145061.log.gz 2024-09-14T11:55:48.418 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.178655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110246.log 2024-09-14T11:55:48.418 INFO:teuthology.orchestra.run.smithi071.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.178655.log.gz 2024-09-14T11:55:48.419 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.51514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67455.log 2024-09-14T11:55:48.419 INFO:teuthology.orchestra.run.smithi071.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.51514.log.gz 2024-09-14T11:55:48.419 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.110246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181597.log 2024-09-14T11:55:48.419 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.67455.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.110246.log.gz 2024-09-14T11:55:48.419 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35731.log 2024-09-14T11:55:48.420 INFO:teuthology.orchestra.run.smithi071.stderr: 24.4% -- replaced with /var/log/ceph/ceph-client.admin.67455.log.gz 2024-09-14T11:55:48.420 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.181597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112606.log 2024-09-14T11:55:48.420 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181597.log.gz 2024-09-14T11:55:48.420 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.35731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44384.log 2024-09-14T11:55:48.420 INFO:teuthology.orchestra.run.smithi071.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.35731.log.gz 2024-09-14T11:55:48.420 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.112606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130307.log 2024-09-14T11:55:48.420 INFO:teuthology.orchestra.run.smithi071.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.112606.log.gz 2024-09-14T11:55:48.420 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.44384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178605.log 2024-09-14T11:55:48.424 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.130307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32428.log 2024-09-14T11:55:48.424 INFO:teuthology.orchestra.run.smithi071.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.44384.log.gz 2024-09-14T11:55:48.424 INFO:teuthology.orchestra.run.smithi071.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.130307.log.gz 2024-09-14T11:55:48.424 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21909.log 2024-09-14T11:55:48.424 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.178605.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178605.log.gz 2024-09-14T11:55:48.424 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-14T11:55:48.424 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32428.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32428.log.gz 2024-09-14T11:55:48.424 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph.tmp-client.admin.21909.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21909.log.gz 2024-09-14T11:55:48.424 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111426.log 2024-09-14T11:55:48.424 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98443.log 2024-09-14T11:55:48.425 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.111426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.167466.log 2024-09-14T11:55:48.425 INFO:teuthology.orchestra.run.smithi071.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.111426.log.gz 2024-09-14T11:55:48.425 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179369.log 2024-09-14T11:55:48.425 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.98443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145651.log 2024-09-14T11:55:48.425 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.167466.log: /var/log/ceph/ceph-client.admin.179369.log: 84.4% -- replaced with /var/log/ceph/ceph-client.0.167466.log.gz 2024-09-14T11:55:48.425 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115556.log 2024-09-14T11:55:48.425 INFO:teuthology.orchestra.run.smithi071.stderr: 84.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180562.log 2024-09-14T11:55:48.425 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.179369.log.gz 2024-09-14T11:55:48.425 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.145651.log: /var/log/ceph/ceph-client.admin.115556.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.115556.log.gz 2024-09-14T11:55:48.425 INFO:teuthology.orchestra.run.smithi071.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.98443.log.gz 2024-09-14T11:55:48.425 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77201.log 2024-09-14T11:55:48.426 INFO:teuthology.orchestra.run.smithi071.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.145651.log.gz 2024-09-14T11:55:48.426 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.180562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84281.log 2024-09-14T11:55:48.426 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166275.log 2024-09-14T11:55:48.426 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.77201.log: /var/log/ceph/ceph-client.admin.84281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39564.log 2024-09-14T11:55:48.426 INFO:teuthology.orchestra.run.smithi071.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.77201.log.gz 2024-09-14T11:55:48.431 INFO:teuthology.orchestra.run.smithi071.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.84281.log.gz 2024-09-14T11:55:48.431 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.166275.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.166275.log.gz 2024-09-14T11:55:48.431 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116146.log 2024-09-14T11:55:48.431 INFO:teuthology.orchestra.run.smithi071.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.180562.log.gz 2024-09-14T11:55:48.431 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39564.log: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.55846.log.gz 2024-09-14T11:55:48.431 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129717.log 2024-09-14T11:55:48.432 INFO:teuthology.orchestra.run.smithi071.stderr: 83.6% -- replaced with /var/log/ceph/ceph-client.admin.39564.log.gz 2024-09-14T11:55:48.432 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112016.log 2024-09-14T11:55:48.432 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.116146.log: /var/log/ceph/ceph-client.admin.129717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61677.log 2024-09-14T11:55:48.432 INFO:teuthology.orchestra.run.smithi071.stderr: 85.1% 81.9% -- replaced with /var/log/ceph/ceph-client.admin.129717.log.gz 2024-09-14T11:55:48.432 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.116146.log.gz/var/log/ceph/ceph-client.admin.112016.log: 2024-09-14T11:55:48.432 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130897.log 2024-09-14T11:55:48.432 INFO:teuthology.orchestra.run.smithi071.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.112016.log.gz 2024-09-14T11:55:48.432 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97263.log 2024-09-14T11:55:48.432 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.61677.log: /var/log/ceph/ceph-client.admin.130897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32010.log 2024-09-14T11:55:48.432 INFO:teuthology.orchestra.run.smithi071.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.130897.log.gz 2024-09-14T11:55:48.432 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32017.log 2024-09-14T11:55:48.433 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.97263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37667.log 2024-09-14T11:55:48.433 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32010.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.97263.log.gz 2024-09-14T11:55:48.433 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32010.log.gz 2024-09-14T11:55:48.433 INFO:teuthology.orchestra.run.smithi071.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61677.log.gz 2024-09-14T11:55:48.433 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32017.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32017.log.gz 2024-09-14T11:55:48.433 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77791.log 2024-09-14T11:55:48.433 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.37667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32425.log 2024-09-14T11:55:48.433 INFO:teuthology.orchestra.run.smithi071.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.37667.log.gz 2024-09-14T11:55:48.433 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.77791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48514.log 2024-09-14T11:55:48.433 INFO:teuthology.orchestra.run.smithi071.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.77791.log.gz 2024-09-14T11:55:48.433 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32425.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32425.log.gz 2024-09-14T11:55:48.433 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50334.log 2024-09-14T11:55:48.433 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.48514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143288.log 2024-09-14T11:55:48.434 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.50334.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.48514.log.gz 2024-09-14T11:55:48.434 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.169238.log 2024-09-14T11:55:48.434 INFO:teuthology.orchestra.run.smithi071.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.50334.log.gz 2024-09-14T11:55:48.434 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152753.log 2024-09-14T11:55:48.434 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.143288.log: /var/log/ceph/ceph-client.0.169238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49744.log 2024-09-14T11:55:48.443 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26799.log 2024-09-14T11:55:48.444 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-14T11:55:48.444 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.26799.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26799.log.gz 2024-09-14T11:55:48.444 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-14T11:55:48.444 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26703.log 2024-09-14T11:55:48.444 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26727.log 2024-09-14T11:55:48.444 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.26703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26847.log 2024-09-14T11:55:48.444 INFO:teuthology.orchestra.run.smithi157.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26703.log.gz 2024-09-14T11:55:48.444 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.26727.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-14T11:55:48.444 INFO:teuthology.orchestra.run.smithi157.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26727.log.gz 2024-09-14T11:55:48.444 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.26847.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26847.log.gz 2024-09-14T11:55:48.444 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-14T11:55:48.444 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T11:55:48.445 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26751.log 2024-09-14T11:55:48.445 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26871.log 2024-09-14T11:55:48.445 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.26751.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T11:55:48.445 INFO:teuthology.orchestra.run.smithi157.stderr: 0.0%/var/log/ceph/ceph-client.admin.26871.log: -- replaced with /var/log/ceph/ceph-client.admin.26751.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26775.log 2024-09-14T11:55:48.445 INFO:teuthology.orchestra.run.smithi157.stderr: 0.0% 2024-09-14T11:55:48.445 INFO:teuthology.orchestra.run.smithi157.stderr: -- replaced with /var/log/ceph/ceph-client.admin.26871.log.gz 2024-09-14T11:55:48.445 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-14T11:55:48.445 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.26775.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-14T11:55:48.445 INFO:teuthology.orchestra.run.smithi157.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26775.log.gz 2024-09-14T11:55:48.445 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26823.log 2024-09-14T11:55:48.445 INFO:teuthology.orchestra.run.smithi157.stderr: 90.7%/var/log/ceph/ceph-osd.4.log: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T11:55:48.446 INFO:teuthology.orchestra.run.smithi157.stderr: 87.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T11:55:48.446 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.26823.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26823.log.gz 2024-09-14T11:55:48.452 INFO:teuthology.orchestra.run.smithi071.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.0.169238.log.gz 85.7% 2024-09-14T11:55:48.452 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.143288.log.gz 2024-09-14T11:55:48.452 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.152753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92543.log 2024-09-14T11:55:48.452 INFO:teuthology.orchestra.run.smithi071.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.152753.log.gz 2024-09-14T11:55:48.452 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32221.log 2024-09-14T11:55:48.452 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.49744.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.49744.log.gz 2024-09-14T11:55:48.452 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.92543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33973.log 2024-09-14T11:55:48.452 INFO:teuthology.orchestra.run.smithi071.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.92543.log.gz 2024-09-14T11:55:48.452 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122046.log 2024-09-14T11:55:48.452 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32221.log: /var/log/ceph/ceph-client.0.33973.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.32221.log.gz -- 2024-09-14T11:55:48.452 INFO:teuthology.orchestra.run.smithi071.stderr: /var/log/ceph/ceph-client.admin.102575.log 2024-09-14T11:55:48.453 INFO:teuthology.orchestra.run.smithi071.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.0.33973.log.gz 2024-09-14T11:55:48.453 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.122046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156368.log 2024-09-14T11:55:48.453 INFO:teuthology.orchestra.run.smithi071.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.122046.log.gz 2024-09-14T11:55:48.453 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.102575.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.102575.log.gz 2024-09-14T11:55:48.453 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119686.log 2024-09-14T11:55:48.453 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181207.log 2024-09-14T11:55:48.453 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.156368.log: /var/log/ceph/ceph-client.admin.119686.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156368.log.gz 2024-09-14T11:55:48.453 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52154.log 2024-09-14T11:55:48.453 INFO:teuthology.orchestra.run.smithi071.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.119686.log.gz 2024-09-14T11:55:48.453 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.181207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177992.log 2024-09-14T11:55:48.454 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181207.log.gz 2024-09-14T11:55:48.454 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.52154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32689.log 2024-09-14T11:55:48.454 INFO:teuthology.orchestra.run.smithi071.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.52154.log.gz 2024-09-14T11:55:48.454 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.177992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46744.log 2024-09-14T11:55:48.454 INFO:teuthology.orchestra.run.smithi071.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.177992.log.gz 2024-09-14T11:55:48.454 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42564.log 2024-09-14T11:55:48.454 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32689.log.gz 2024-09-14T11:55:48.454 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148011.log 2024-09-14T11:55:48.454 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.46744.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.46744.log.gz 2024-09-14T11:55:48.454 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.42564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.158471.log 2024-09-14T11:55:48.454 INFO:teuthology.orchestra.run.smithi071.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.42564.log.gz 2024-09-14T11:55:48.454 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136797.log 2024-09-14T11:55:48.454 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.148011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32217.log 2024-09-14T11:55:48.454 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.158471.log: /var/log/ceph/ceph-client.admin.136797.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.148011.log.gz 2024-09-14T11:55:48.455 INFO:teuthology.orchestra.run.smithi071.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.0.158471.log.gz 2024-09-14T11:55:48.455 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-14T11:55:48.455 INFO:teuthology.orchestra.run.smithi071.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.136797.log.gz 2024-09-14T11:55:48.455 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32409.log 2024-09-14T11:55:48.455 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32217.log.gz 2024-09-14T11:55:48.455 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95493.log 2024-09-14T11:55:48.455 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57796.log 2024-09-14T11:55:48.455 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32409.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32409.log.gz 2024-09-14T11:55:48.455 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.95493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131487.log 2024-09-14T11:55:48.455 INFO:teuthology.orchestra.run.smithi071.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.95493.log.gz 2024-09-14T11:55:48.455 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.57796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120866.log 2024-09-14T11:55:48.455 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155163.log 2024-09-14T11:55:48.455 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.131487.log: /var/log/ceph/ceph-client.admin.120866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137977.log 2024-09-14T11:55:48.455 INFO:teuthology.orchestra.run.smithi071.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.131487.log.gz 2024-09-14T11:55:48.456 INFO:teuthology.orchestra.run.smithi071.stderr: 89.1%/var/log/ceph/ceph-client.admin.155163.log: -- replaced with /var/log/ceph/ceph-client.admin.120866.log.gz 2024-09-14T11:55:48.456 INFO:teuthology.orchestra.run.smithi071.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.155163.log.gz 2024-09-14T11:55:48.456 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35147.log 2024-09-14T11:55:48.456 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.137977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61032.log 2024-09-14T11:55:48.456 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.35147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178582.log 2024-09-14T11:55:48.456 INFO:teuthology.orchestra.run.smithi071.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.35147.log.gz 2024-09-14T11:55:48.456 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.61032.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.137977.log.gz 2024-09-14T11:55:48.456 INFO:teuthology.orchestra.run.smithi071.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.57796.log.gz 2024-09-14T11:55:48.456 INFO:teuthology.orchestra.run.smithi071.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.61032.log.gz 2024-09-14T11:55:48.456 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96673.log 2024-09-14T11:55:48.456 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.178582.log: 24.2% -- replaced with /var/log/ceph/ceph-client.admin.178582.log.gz 2024-09-14T11:55:48.456 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-14T11:55:48.456 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59740.log 2024-09-14T11:55:48.456 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.96673.log: gzip -5 --verbose --/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.71891.log 2024-09-14T11:55:48.456 INFO:teuthology.orchestra.run.smithi071.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96673.log.gz/var/log/ceph/ceph-client.admin.59740.log: 2024-09-14T11:55:48.457 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75431.log 2024-09-14T11:55:48.457 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.71891.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.71891.log.gz 2024-09-14T11:55:48.457 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106706.log 2024-09-14T11:55:48.457 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.75431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142108.log 2024-09-14T11:55:48.457 INFO:teuthology.orchestra.run.smithi071.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.59740.log.gz 2024-09-14T11:55:48.457 INFO:teuthology.orchestra.run.smithi071.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.75431.log.gz/var/log/ceph/ceph-client.admin.106706.log: 2024-09-14T11:55:48.457 INFO:teuthology.orchestra.run.smithi071.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.106706.log.gz 2024-09-14T11:55:48.457 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73071.log 2024-09-14T11:55:48.457 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.142108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156393.log 2024-09-14T11:55:48.457 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.73071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103165.log 2024-09-14T11:55:48.457 INFO:teuthology.orchestra.run.smithi071.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.73071.log.gz 2024-09-14T11:55:48.457 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.156393.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.156393.log.gz 2024-09-14T11:55:48.457 INFO:teuthology.orchestra.run.smithi071.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.142108.log.gz 2024-09-14T11:55:48.464 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179344.log 2024-09-14T11:55:48.465 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.103165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181415.log 2024-09-14T11:55:48.465 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.179344.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.103165.log.gz 2024-09-14T11:55:48.465 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81331.log 2024-09-14T11:55:48.465 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179344.log.gz 2024-09-14T11:55:48.465 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64502.log 2024-09-14T11:55:48.465 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.181415.log: /var/log/ceph/ceph-client.admin.81331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181623.log 2024-09-14T11:55:48.465 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181415.log.gz 2024-09-14T11:55:48.465 INFO:teuthology.orchestra.run.smithi071.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.81331.log.gz 2024-09-14T11:55:48.465 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.64502.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.64502.log.gz 2024-09-14T11:55:48.465 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149191.log 2024-09-14T11:55:48.465 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.181623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181702.log 2024-09-14T11:55:48.465 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181623.log.gz 2024-09-14T11:55:48.466 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.149191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124406.log 2024-09-14T11:55:48.466 INFO:teuthology.orchestra.run.smithi071.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.149191.log.gz 2024-09-14T11:55:48.466 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.181702.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181702.log.gz 2024-09-14T11:55:48.466 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170418.log 2024-09-14T11:55:48.466 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.124406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66273.log 2024-09-14T11:55:48.466 INFO:teuthology.orchestra.run.smithi071.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.124406.log.gz 2024-09-14T11:55:48.466 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.170418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43154.log 2024-09-14T11:55:48.466 INFO:teuthology.orchestra.run.smithi071.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.0.170418.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79561.log 2024-09-14T11:55:48.466 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-14T11:55:48.466 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.66273.log: /var/log/ceph/ceph-client.admin.43154.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.66273.log.gz 2024-09-14T11:55:48.466 INFO:teuthology.orchestra.run.smithi071.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.43154.log.gz 2024-09-14T11:55:48.466 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68097.log 2024-09-14T11:55:48.466 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.79561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126766.log 2024-09-14T11:55:48.466 INFO:teuthology.orchestra.run.smithi071.stderr: 82.1%/var/log/ceph/ceph-client.0.68097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161742.log 2024-09-14T11:55:48.466 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.79561.log.gz 2024-09-14T11:55:48.467 INFO:teuthology.orchestra.run.smithi071.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.0.68097.log.gz 2024-09-14T11:55:48.467 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126766.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.126766.log.gz 2024-09-14T11:55:48.467 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120276.log 2024-09-14T11:55:48.467 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124996.log 2024-09-14T11:55:48.467 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.161742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113196.log 2024-09-14T11:55:48.467 INFO:teuthology.orchestra.run.smithi071.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.161742.log.gz 2024-09-14T11:55:48.467 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120276.log: /var/log/ceph/ceph-client.admin.124996.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.120276.log.gz 2024-09-14T11:55:48.467 INFO:teuthology.orchestra.run.smithi071.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.124996.log.gz 2024-09-14T11:55:48.467 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108476.log 2024-09-14T11:55:48.467 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.113196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60387.log 2024-09-14T11:55:48.467 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.108476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181757.log 2024-09-14T11:55:48.467 INFO:teuthology.orchestra.run.smithi071.stderr: 88.3%/var/log/ceph/ceph-client.admin.60387.log: -- replaced with /var/log/ceph/ceph-client.admin.108476.log.gz 2024-09-14T11:55:48.467 INFO:teuthology.orchestra.run.smithi071.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.113196.log.gz 2024-09-14T11:55:48.469 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91953.log 2024-09-14T11:55:48.469 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.181757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72481.log 2024-09-14T11:55:48.469 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181757.log.gz 2024-09-14T11:55:48.469 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165686.log 2024-09-14T11:55:48.469 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.91953.log: /var/log/ceph/ceph-client.admin.72481.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.91953.log.gz 2024-09-14T11:55:48.469 INFO:teuthology.orchestra.run.smithi071.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.72481.log.gz 2024-09-14T11:55:48.469 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85461.log 2024-09-14T11:55:48.469 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139157.log 2024-09-14T11:55:48.470 INFO:teuthology.orchestra.run.smithi157.stderr: 95.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-14T11:55:48.471 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.165686.log: /var/log/ceph/ceph-client.admin.85461.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.85461.log.gz 2024-09-14T11:55:48.471 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133257.log 2024-09-14T11:55:48.471 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.139157.log: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.165686.log.gz 2024-09-14T11:55:48.471 INFO:teuthology.orchestra.run.smithi071.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.139157.log.gz 2024-09-14T11:55:48.471 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113786.log 2024-09-14T11:55:48.472 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58441.log 2024-09-14T11:55:48.472 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.133257.log: /var/log/ceph/ceph-client.admin.113786.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.133257.log.gz 2024-09-14T11:55:48.473 INFO:teuthology.orchestra.run.smithi071.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.113786.log.gz 2024-09-14T11:55:48.473 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109656.log 2024-09-14T11:55:48.473 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128537.log 2024-09-14T11:55:48.474 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.58441.log: /var/log/ceph/ceph-client.admin.109656.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.109656.log.gz 2024-09-14T11:55:48.478 INFO:teuthology.orchestra.run.smithi071.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.58441.log.gz 2024-09-14T11:55:48.478 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181728.log 2024-09-14T11:55:48.480 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.128537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181233.log 2024-09-14T11:55:48.480 INFO:teuthology.orchestra.run.smithi071.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.128537.log.gz 2024-09-14T11:55:48.480 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.181728.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181728.log.gz 2024-09-14T11:55:48.480 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147421.log 2024-09-14T11:55:48.481 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.181233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32613.log 2024-09-14T11:55:48.481 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181233.log.gz 2024-09-14T11:55:48.481 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78971.log 2024-09-14T11:55:48.481 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.147421.log: /var/log/ceph/ceph-client.admin.32613.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.147421.log.gz 2024-09-14T11:55:48.482 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32613.log.gz 2024-09-14T11:55:48.482 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181155.log 2024-09-14T11:55:48.482 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54256.log 2024-09-14T11:55:48.483 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.78971.log: /var/log/ceph/ceph-client.admin.181155.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.78971.log.gz 2024-09-14T11:55:48.483 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181155.log.gz 2024-09-14T11:55:48.483 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54625.log 2024-09-14T11:55:48.484 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157573.log 2024-09-14T11:55:48.484 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.54256.log: /var/log/ceph/ceph-client.admin.54625.log: 59.0% 58.1% -- replaced with /var/log/ceph/ceph-client.admin.54256.log.gz 2024-09-14T11:55:48.484 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54625.log.gz 2024-09-14T11:55:48.484 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163048.log 2024-09-14T11:55:48.485 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49694.log 2024-09-14T11:55:48.485 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.157573.log: /var/log/ceph/ceph-client.admin.163048.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.157573.log.gz 2024-09-14T11:55:48.485 INFO:teuthology.orchestra.run.smithi071.stderr: 92.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47334.log 2024-09-14T11:55:48.485 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.163048.log.gz 2024-09-14T11:55:48.486 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.49694.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49694.log.gz 2024-09-14T11:55:48.486 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181545.log 2024-09-14T11:55:48.487 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103755.log 2024-09-14T11:55:48.487 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.47334.log: /var/log/ceph/ceph-client.admin.181545.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.47334.log.gz 2024-09-14T11:55:48.487 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181545.log.gz 2024-09-14T11:55:48.487 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.172188.log 2024-09-14T11:55:48.488 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153933.log 2024-09-14T11:55:48.489 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.103755.log: /var/log/ceph/ceph-client.0.172188.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.103755.log.gz 2024-09-14T11:55:48.489 INFO:teuthology.orchestra.run.smithi071.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.0.172188.log.gz 2024-09-14T11:55:48.489 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52744.log 2024-09-14T11:55:48.490 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.153933.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.153933.log.gz 2024-09-14T11:55:48.490 INFO:teuthology.orchestra.run.smithi071.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.60387.log.gz 2024-09-14T11:55:48.490 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109066.log 2024-09-14T11:55:48.491 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.52744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49719.log 2024-09-14T11:55:48.491 INFO:teuthology.orchestra.run.smithi071.stderr: 86.5%/var/log/ceph/ceph-client.admin.109066.log: -- replaced with /var/log/ceph/ceph-client.admin.52744.log.gzgzip 2024-09-14T11:55:48.491 INFO:teuthology.orchestra.run.smithi071.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.40154.log 2024-09-14T11:55:48.491 INFO:teuthology.orchestra.run.smithi071.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.109066.log.gz 2024-09-14T11:55:48.491 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.49719.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49719.log.gz 2024-09-14T11:55:48.492 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32665.log 2024-09-14T11:55:48.492 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104935.log 2024-09-14T11:55:48.493 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40154.log: /var/log/ceph/ceph-client.admin.32665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114966.log 2024-09-14T11:55:48.493 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32665.log.gz 2024-09-14T11:55:48.493 INFO:teuthology.orchestra.run.smithi071.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.40154.log.gz 2024-09-14T11:55:48.493 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.104935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84871.log 2024-09-14T11:55:48.494 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-14T11:55:48.494 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.114966.log: /var/log/ceph/ceph-client.admin.84871.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.114966.log.gz 2024-09-14T11:55:48.494 INFO:teuthology.orchestra.run.smithi071.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.84871.log.gz 2024-09-14T11:55:48.494 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31865.log 2024-09-14T11:55:48.494 INFO:teuthology.orchestra.run.smithi071.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.104935.log.gz 2024-09-14T11:55:48.507 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53334.log 2024-09-14T11:55:48.507 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32788.log 2024-09-14T11:55:48.507 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31865.log.gz 2024-09-14T11:55:48.508 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.53334.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.53334.log.gz 2024-09-14T11:55:48.508 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181363.log 2024-09-14T11:55:48.509 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177402.log 2024-09-14T11:55:48.509 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.32788.log: /var/log/ceph/ceph-client.admin.181363.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181363.log.gz 2024-09-14T11:55:48.509 INFO:teuthology.orchestra.run.smithi071.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.0.32788.log.gz 2024-09-14T11:55:48.510 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181675.log 2024-09-14T11:55:48.510 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134437.log 2024-09-14T11:55:48.511 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.177402.log: /var/log/ceph/ceph-client.admin.181675.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181675.log.gz 2024-09-14T11:55:48.511 INFO:teuthology.orchestra.run.smithi071.stderr: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.177402.log.gz 2024-09-14T11:55:48.511 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151551.log 2024-09-14T11:55:48.512 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55257.log 2024-09-14T11:55:48.512 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.134437.log: /var/log/ceph/ceph-client.admin.151551.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.134437.log.gz 2024-09-14T11:55:48.513 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151551.log.gz 2024-09-14T11:55:48.513 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179245.log 2024-09-14T11:55:48.513 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105525.log 2024-09-14T11:55:48.514 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55257.log: /var/log/ceph/ceph-client.admin.179245.log: 24.8% 84.4% -- replaced with /var/log/ceph/ceph-client.admin.179245.log.gz -- replaced with /var/log/ceph/ceph-client.admin.55257.log.gz 2024-09-14T11:55:48.514 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-14T11:55:48.514 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101395.log 2024-09-14T11:55:48.514 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127947.log 2024-09-14T11:55:48.514 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.105525.log: /var/log/ceph/ceph-client.admin.101395.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.105525.log.gz 2024-09-14T11:55:48.515 INFO:teuthology.orchestra.run.smithi071.stderr: 82.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80741.log 2024-09-14T11:55:48.515 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.101395.log.gz 2024-09-14T11:55:48.515 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127947.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.127947.log.gz 2024-09-14T11:55:48.516 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.168056.log 2024-09-14T11:55:48.516 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55192.log 2024-09-14T11:55:48.516 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.80741.log: /var/log/ceph/ceph-client.0.168056.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.80741.log.gz 2024-09-14T11:55:48.517 INFO:teuthology.orchestra.run.smithi071.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.168056.log.gz 2024-09-14T11:55:48.517 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32443.log 2024-09-14T11:55:48.518 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181519.log 2024-09-14T11:55:48.518 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55192.log: /var/log/ceph/ceph-client.admin.32443.log: 21.6% -- replaced with /var/log/ceph/ceph-client.admin.55192.log.gz 2024-09-14T11:55:48.518 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32443.log.gz 2024-09-14T11:55:48.518 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179318.log 2024-09-14T11:55:48.520 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32205.log 2024-09-14T11:55:48.520 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.181519.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181519.log.gz 2024-09-14T11:55:48.520 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.179318.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179318.log.gz 2024-09-14T11:55:48.520 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179293.log 2024-09-14T11:55:48.521 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32205.log.gz 2024-09-14T11:55:48.521 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107296.log 2024-09-14T11:55:48.522 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87231.log 2024-09-14T11:55:48.522 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.179293.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179293.log.gz 2024-09-14T11:55:48.522 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.107296.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-14T11:55:48.522 INFO:teuthology.orchestra.run.smithi071.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.107296.log.gz 2024-09-14T11:55:48.522 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.87231.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.87231.log.gz 2024-09-14T11:55:48.522 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-14T11:55:48.523 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121456.log 2024-09-14T11:55:48.527 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: /var/log/ceph/ceph-osd.1.log: 94.2% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-14T11:55:48.527 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31911.log 2024-09-14T11:55:48.528 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.121456.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.121456.log.gz 2024-09-14T11:55:48.528 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38974.log 2024-09-14T11:55:48.529 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31911.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31911.log.gz 2024-09-14T11:55:48.529 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94903.log 2024-09-14T11:55:48.530 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.38974.log: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.38974.log.gz 2024-09-14T11:55:48.530 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31963.log 2024-09-14T11:55:48.531 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.94903.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.94903.log.gz 2024-09-14T11:55:48.532 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150371.log 2024-09-14T11:55:48.532 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31963.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31963.log.gz 2024-09-14T11:55:48.533 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76611.log 2024-09-14T11:55:48.533 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.150371.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.150371.log.gz 2024-09-14T11:55:48.534 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54018.log 2024-09-14T11:55:48.535 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.76611.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.76611.log.gz 2024-09-14T11:55:48.535 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179268.log 2024-09-14T11:55:48.536 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.54018.log: 60.7% -- replaced with /var/log/ceph/ceph-client.admin.54018.log.gz 2024-09-14T11:55:48.536 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44974.log 2024-09-14T11:55:48.537 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.179268.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179268.log.gz 2024-09-14T11:55:48.537 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133847.log 2024-09-14T11:55:48.538 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.44974.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.44974.log.gz 2024-09-14T11:55:48.538 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83101.log 2024-09-14T11:55:48.541 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.133847.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.133847.log.gz 2024-09-14T11:55:48.541 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65683.log 2024-09-14T11:55:48.542 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.83101.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.83101.log.gz 2024-09-14T11:55:48.542 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151573.log 2024-09-14T11:55:48.543 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.65683.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.65683.log.gz 2024-09-14T11:55:48.544 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99033.log 2024-09-14T11:55:48.544 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.151573.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.151573.log.gz 2024-09-14T11:55:48.545 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32765.log 2024-09-14T11:55:48.545 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.99033.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.99033.log.gz 2024-09-14T11:55:48.546 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137387.log 2024-09-14T11:55:48.546 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32765.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32765.log.gz 2024-09-14T11:55:48.547 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175728.log 2024-09-14T11:55:48.548 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.137387.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.137387.log.gz 2024-09-14T11:55:48.548 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81921.log 2024-09-14T11:55:48.549 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.175728.log: 84.4% -- replaced with /var/log/ceph/ceph-client.0.175728.log.gz 2024-09-14T11:55:48.549 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153343.log 2024-09-14T11:55:48.551 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.81921.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.81921.log.gz 2024-09-14T11:55:48.552 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78381.log 2024-09-14T11:55:48.552 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.153343.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.153343.log.gz 2024-09-14T11:55:48.553 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152163.log 2024-09-14T11:55:48.554 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.78381.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.78381.log.gz 2024-09-14T11:55:48.554 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163637.log 2024-09-14T11:55:48.555 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.152163.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.152163.log.gz 2024-09-14T11:55:48.555 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175138.log 2024-09-14T11:55:48.556 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.163637.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.163637.log.gz 2024-09-14T11:55:48.557 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68735.log 2024-09-14T11:55:48.557 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.175138.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.175138.log.gz 2024-09-14T11:55:48.558 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100805.log 2024-09-14T11:55:48.558 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.68735.log: 48.9% -- replaced with /var/log/ceph/ceph-client.admin.68735.log.gz 2024-09-14T11:55:48.559 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31727.log 2024-09-14T11:55:48.560 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.100805.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.100805.log.gz 2024-09-14T11:55:48.560 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32015.log 2024-09-14T11:55:48.561 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31727.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31727.log.gz 2024-09-14T11:55:48.561 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57144.log 2024-09-14T11:55:48.562 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32015.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32015.log.gz 2024-09-14T11:55:48.562 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88411.log 2024-09-14T11:55:48.569 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.57144.log: 93.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135617.log 2024-09-14T11:55:48.571 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.88411.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.57144.log.gz 2024-09-14T11:55:48.571 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.88411.log.gz 2024-09-14T11:55:48.571 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33386.log 2024-09-14T11:55:48.572 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.135617.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.135617.log.gz 2024-09-14T11:55:48.572 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143878.log 2024-09-14T11:55:48.573 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.33386.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.33386.log.gz 2024-09-14T11:55:48.573 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181649.log 2024-09-14T11:55:48.575 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.143878.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.143878.log.gz 2024-09-14T11:55:48.575 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181571.log 2024-09-14T11:55:48.576 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.181649.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181649.log.gz 2024-09-14T11:55:48.576 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54527.log 2024-09-14T11:55:48.577 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.181571.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181571.log.gz 2024-09-14T11:55:48.577 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T11:55:48.578 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.54527.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.54527.log.gz 2024-09-14T11:55:48.578 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.168648.log 2024-09-14T11:55:48.587 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46154.log 2024-09-14T11:55:48.587 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.168648.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.168648.log.gz 2024-09-14T11:55:48.591 INFO:teuthology.orchestra.run.smithi071.stderr: 93.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T11:55:48.591 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32201.log 2024-09-14T11:55:48.592 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.46154.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.46154.log.gz 2024-09-14T11:55:48.592 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63626.log 2024-09-14T11:55:48.593 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32201.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32201.log.gz 2024-09-14T11:55:48.593 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101985.log 2024-09-14T11:55:48.594 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.63626.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.63626.log.gz 2024-09-14T11:55:48.594 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159652.log 2024-09-14T11:55:48.595 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.101985.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101985.log.gz 2024-09-14T11:55:48.595 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148601.log 2024-09-14T11:55:48.596 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.159652.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.159652.log.gz 2024-09-14T11:55:48.597 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127357.log 2024-09-14T11:55:48.597 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.148601.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.148601.log.gz 2024-09-14T11:55:48.598 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32639.log 2024-09-14T11:55:48.599 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127357.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.127357.log.gz 2024-09-14T11:55:48.599 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100215.log 2024-09-14T11:55:48.600 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32639.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32639.log.gz 2024-09-14T11:55:48.600 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117326.log 2024-09-14T11:55:48.601 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.100215.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.100215.log.gz 2024-09-14T11:55:48.601 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45564.log 2024-09-14T11:55:48.602 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.117326.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.117326.log.gz 2024-09-14T11:55:48.603 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87821.log 2024-09-14T11:55:48.604 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.45564.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.45564.log.gz 2024-09-14T11:55:48.604 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140928.log 2024-09-14T11:55:48.605 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.87821.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.87821.log.gz 2024-09-14T11:55:48.605 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40744.log 2024-09-14T11:55:48.606 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.140928.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.140928.log.gz 2024-09-14T11:55:48.606 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59086.log 2024-09-14T11:55:48.607 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40744.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.40744.log.gz 2024-09-14T11:55:48.607 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65091.log 2024-09-14T11:55:48.610 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.59086.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.59086.log.gz 2024-09-14T11:55:48.610 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43794.log 2024-09-14T11:55:48.611 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.65091.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.65091.log.gz 2024-09-14T11:55:48.611 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34563.log 2024-09-14T11:55:48.612 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.43794.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.43794.log.gz 2024-09-14T11:55:48.612 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32426.log 2024-09-14T11:55:48.613 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.34563.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.34563.log.gz 2024-09-14T11:55:48.613 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89591.log 2024-09-14T11:55:48.614 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32426.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32426.log.gz 2024-09-14T11:55:48.614 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142698.log 2024-09-14T11:55:48.615 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.89591.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.89591.log.gz 2024-09-14T11:55:48.615 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-14T11:55:48.616 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.142698.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.142698.log.gz 2024-09-14T11:55:48.616 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181441.log 2024-09-14T11:55:48.638 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32211.log 2024-09-14T11:55:48.639 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.181441.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181441.log.gz 2024-09-14T11:55:48.650 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150961.log 2024-09-14T11:55:48.651 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32211.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32211.log.gz 2024-09-14T11:55:48.671 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90181.log 2024-09-14T11:55:48.671 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.150961.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.150961.log.gz 2024-09-14T11:55:48.672 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.166876.log 2024-09-14T11:55:48.674 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.90181.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.90181.log.gz 2024-09-14T11:55:48.679 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99623.log 2024-09-14T11:55:48.691 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.166876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181807.log 2024-09-14T11:55:48.691 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.99623.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.99623.log.gz 2024-09-14T11:55:48.695 INFO:teuthology.orchestra.run.smithi071.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.0.166876.log.gz 2024-09-14T11:55:48.699 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132077.log 2024-09-14T11:55:48.699 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.181807.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181807.log.gz 2024-09-14T11:55:48.707 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94313.log 2024-09-14T11:55:48.707 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.132077.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.132077.log.gz 2024-09-14T11:55:48.719 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149781.log 2024-09-14T11:55:48.719 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.94313.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.94313.log.gz 2024-09-14T11:55:48.727 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68835.log 2024-09-14T11:55:48.727 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.149781.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.149781.log.gz 2024-09-14T11:55:48.735 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154548.log 2024-09-14T11:55:48.737 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.68835.log: 92.1% -- replaced with /var/log/ceph/ceph-client.0.68835.log.gz 2024-09-14T11:55:48.742 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54569.log 2024-09-14T11:55:48.742 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.154548.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154548.log.gz 2024-09-14T11:55:48.751 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54335.log 2024-09-14T11:55:48.751 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.54569.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54569.log.gz 2024-09-14T11:55:48.767 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32225.log 2024-09-14T11:55:48.767 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.54335.log: 50.3% -- replaced with /var/log/ceph/ceph-client.admin.54335.log.gz 2024-09-14T11:55:48.775 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26701.log 2024-09-14T11:55:48.775 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32225.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32225.log.gz 2024-09-14T11:55:48.783 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-14T11:55:48.783 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.26701.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26701.log.gz 2024-09-14T11:55:48.791 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118506.log 2024-09-14T11:55:48.799 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91361.log 2024-09-14T11:55:48.799 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.118506.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.118506.log.gz 2024-09-14T11:55:48.807 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156343.log 2024-09-14T11:55:48.807 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.91361.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.91361.log.gz 2024-09-14T11:55:48.815 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32016.log 2024-09-14T11:55:48.815 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.156343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156343.log.gz 2024-09-14T11:55:48.823 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117916.log 2024-09-14T11:55:48.823 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32016.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32016.log.gz 2024-09-14T11:55:48.831 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74841.log 2024-09-14T11:55:48.831 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.117916.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.117916.log.gz 2024-09-14T11:55:48.839 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.173368.log 2024-09-14T11:55:48.839 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.74841.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.74841.log.gz 2024-09-14T11:55:48.847 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181311.log 2024-09-14T11:55:48.847 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.173368.log: 84.1% -- replaced with /var/log/ceph/ceph-client.0.173368.log.gz 2024-09-14T11:55:48.855 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32427.log 2024-09-14T11:55:48.855 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.181311.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181311.log.gz 2024-09-14T11:55:48.863 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T11:55:48.863 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32427.log.gz 2024-09-14T11:55:48.879 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154523.log 2024-09-14T11:55:48.882 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph.audit.log: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-14T11:55:48.882 INFO:teuthology.orchestra.run.smithi071.stderr: 94.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T11:55:48.883 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107886.log 2024-09-14T11:55:48.883 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.154523.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154523.log.gz 2024-09-14T11:55:48.883 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135027.log 2024-09-14T11:55:48.884 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.107886.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.107886.log.gz 2024-09-14T11:55:48.884 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73661.log 2024-09-14T11:55:48.885 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.135027.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.135027.log.gz 2024-09-14T11:55:48.885 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141518.log 2024-09-14T11:55:48.886 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.73661.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.73661.log.gz 2024-09-14T11:55:48.886 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.172778.log 2024-09-14T11:55:48.887 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.141518.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.141518.log.gz 2024-09-14T11:55:48.887 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32429.log 2024-09-14T11:55:48.888 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.172778.log: 80.5% -- replaced with /var/log/ceph/ceph-client.0.172778.log.gz 2024-09-14T11:55:48.888 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62325.log 2024-09-14T11:55:48.889 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32429.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32429.log.gz 2024-09-14T11:55:48.889 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123816.log 2024-09-14T11:55:48.891 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.62325.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62325.log.gz 2024-09-14T11:55:48.891 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32012.log 2024-09-14T11:55:48.892 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.123816.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.123816.log.gz 2024-09-14T11:55:48.892 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86051.log 2024-09-14T11:55:48.893 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32012.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32012.log.gz 2024-09-14T11:55:48.893 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116736.log 2024-09-14T11:55:48.894 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.86051.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.86051.log.gz 2024-09-14T11:55:48.894 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96083.log 2024-09-14T11:55:48.895 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.116736.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.116736.log.gz 2024-09-14T11:55:48.895 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.171598.log 2024-09-14T11:55:48.896 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.96083.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.96083.log.gz 2024-09-14T11:55:48.911 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26948.log 2024-09-14T11:55:48.911 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.171598.log: 84.4% -- replaced with /var/log/ceph/ceph-client.0.171598.log.gz 2024-09-14T11:55:48.922 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181389.log 2024-09-14T11:55:48.923 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.26948.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26948.log.gz 2024-09-14T11:55:48.938 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93723.log 2024-09-14T11:55:48.939 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.181389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181389.log.gz 2024-09-14T11:55:48.958 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32013.log 2024-09-14T11:55:48.959 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.93723.log: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.93723.log.gz 2024-09-14T11:55:48.972 INFO:teuthology.orchestra.run.smithi071.stderr: 94.6% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-14T11:55:48.975 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32014.log 2024-09-14T11:55:48.975 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32013.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32013.log.gz 2024-09-14T11:55:48.976 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80151.log 2024-09-14T11:55:48.977 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32014.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32014.log.gz 2024-09-14T11:55:48.977 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74251.log 2024-09-14T11:55:48.978 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.80151.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.80151.log.gz 2024-09-14T11:55:48.978 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90771.log 2024-09-14T11:55:48.979 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.74251.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.74251.log.gz 2024-09-14T11:55:48.979 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176318.log 2024-09-14T11:55:48.980 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.90771.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.90771.log.gz 2024-09-14T11:55:48.981 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83691.log 2024-09-14T11:55:48.981 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.176318.log: 80.7% -- replaced with /var/log/ceph/ceph-client.0.176318.log.gz 2024-09-14T11:55:48.981 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54597.log 2024-09-14T11:55:48.982 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.83691.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.83691.log.gz 2024-09-14T11:55:48.983 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82511.log 2024-09-14T11:55:48.992 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.54597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43744.log 2024-09-14T11:55:48.993 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.82511.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.82511.log.gz 2024-09-14T11:55:48.999 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.171008.log 2024-09-14T11:55:48.999 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.43744.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43744.log.gz 2024-09-14T11:55:49.000 INFO:teuthology.orchestra.run.smithi071.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54597.log.gz 2024-09-14T11:55:49.000 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50924.log 2024-09-14T11:55:49.001 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.171008.log: 80.6% -- replaced with /var/log/ceph/ceph-client.0.171008.log.gz 2024-09-14T11:55:49.001 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31815.log 2024-09-14T11:55:49.002 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.50924.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.50924.log.gz 2024-09-14T11:55:49.003 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54650.log 2024-09-14T11:55:49.003 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31815.log.gz 2024-09-14T11:55:49.004 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181337.log 2024-09-14T11:55:49.005 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.54650.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.54650.log.gz 2024-09-14T11:55:49.005 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43769.log 2024-09-14T11:55:49.006 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.181337.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181337.log.gz 2024-09-14T11:55:49.006 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146831.log 2024-09-14T11:55:49.006 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.43769.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43769.log.gz 2024-09-14T11:55:49.007 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160564.log 2024-09-14T11:55:49.008 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.146831.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.146831.log.gz 2024-09-14T11:55:49.008 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129127.log 2024-09-14T11:55:49.010 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.160564.log: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.160564.log.gz 2024-09-14T11:55:49.010 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41974.log 2024-09-14T11:55:49.011 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129127.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.129127.log.gz 2024-09-14T11:55:49.012 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.169828.log 2024-09-14T11:55:49.012 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.41974.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.41974.log.gz 2024-09-14T11:55:49.013 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55219.log 2024-09-14T11:55:49.014 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.169828.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.169828.log.gz 2024-09-14T11:55:49.014 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62973.log 2024-09-14T11:55:49.015 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55219.log: 19.9% -- replaced with /var/log/ceph/ceph-client.admin.55219.log.gz 2024-09-14T11:55:49.015 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41334.log 2024-09-14T11:55:49.020 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.62973.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.62973.log.gz 2024-09-14T11:55:49.020 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31840.log 2024-09-14T11:55:49.020 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.41334.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41334.log.gz 2024-09-14T11:55:49.021 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56499.log 2024-09-14T11:55:49.021 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31840.log.gz 2024-09-14T11:55:49.022 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114376.log 2024-09-14T11:55:49.023 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.56499.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.56499.log.gz 2024-09-14T11:55:49.023 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179966.log 2024-09-14T11:55:49.024 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.114376.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.114376.log.gz 2024-09-14T11:55:49.025 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181259.log 2024-09-14T11:55:49.025 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.179966.log: 81.0% -- replaced with /var/log/ceph/ceph-client.0.179966.log.gz 2024-09-14T11:55:49.026 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155753.log 2024-09-14T11:55:49.026 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.181259.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181259.log.gz 2024-09-14T11:55:49.027 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132667.log 2024-09-14T11:55:49.028 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.155753.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.155753.log.gz 2024-09-14T11:55:49.028 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138567.log 2024-09-14T11:55:49.029 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.132667.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.132667.log.gz 2024-09-14T11:55:49.029 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164227.log 2024-09-14T11:55:49.030 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.138567.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.138567.log.gz 2024-09-14T11:55:49.030 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.174548.log 2024-09-14T11:55:49.031 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.164227.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.164227.log.gz 2024-09-14T11:55:49.032 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97853.log 2024-09-14T11:55:49.032 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.174548.log: 80.7% -- replaced with /var/log/ceph/ceph-client.0.174548.log.gz 2024-09-14T11:55:49.033 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31885.log 2024-09-14T11:55:49.034 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.97853.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.97853.log.gz 2024-09-14T11:55:49.034 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31937.log 2024-09-14T11:55:49.035 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31885.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31885.log.gz 2024-09-14T11:55:49.035 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164816.log 2024-09-14T11:55:49.036 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31937.log.gz 2024-09-14T11:55:49.036 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119096.log 2024-09-14T11:55:49.037 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.164816.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.164816.log.gz 2024-09-14T11:55:49.037 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140338.log 2024-09-14T11:55:49.040 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119096.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.119096.log.gz 2024-09-14T11:55:49.040 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146241.log 2024-09-14T11:55:49.041 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.140338.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.140338.log.gz 2024-09-14T11:55:49.041 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154573.log 2024-09-14T11:55:49.042 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.146241.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.146241.log.gz 2024-09-14T11:55:49.042 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104345.log 2024-09-14T11:55:49.043 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.154573.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.154573.log.gz 2024-09-14T11:55:49.043 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122636.log 2024-09-14T11:55:49.044 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.104345.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.104345.log.gz 2024-09-14T11:55:49.045 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162331.log 2024-09-14T11:55:49.045 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.122636.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.122636.log.gz 2024-09-14T11:55:49.046 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126176.log 2024-09-14T11:55:49.047 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.162331.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.162331.log.gz 2024-09-14T11:55:49.047 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125586.log 2024-09-14T11:55:49.048 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126176.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.126176.log.gz 2024-09-14T11:55:49.049 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123226.log 2024-09-14T11:55:49.050 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.125586.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.125586.log.gz 2024-09-14T11:55:49.051 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32216.log 2024-09-14T11:55:49.051 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.123226.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.123226.log.gz 2024-09-14T11:55:49.052 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.173958.log 2024-09-14T11:55:49.053 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32216.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32216.log.gz 2024-09-14T11:55:49.053 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89001.log 2024-09-14T11:55:49.054 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.173958.log: 84.7% -- replaced with /var/log/ceph/ceph-client.0.173958.log.gz 2024-09-14T11:55:49.054 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181467.log 2024-09-14T11:55:49.055 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.89001.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.89001.log.gz 2024-09-14T11:55:49.055 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70711.log 2024-09-14T11:55:49.056 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.181467.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181467.log.gz 2024-09-14T11:55:49.056 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93133.log 2024-09-14T11:55:49.057 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.70711.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.70711.log.gz 2024-09-14T11:55:49.057 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41384.log 2024-09-14T11:55:49.058 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.93133.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.93133.log.gz 2024-09-14T11:55:49.059 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110836.log 2024-09-14T11:55:49.059 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.41384.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.41384.log.gz 2024-09-14T11:55:49.060 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67507.log 2024-09-14T11:55:49.061 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.110836.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.110836.log.gz 2024-09-14T11:55:49.061 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70121.log 2024-09-14T11:55:49.062 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.67507.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.67507.log.gz 2024-09-14T11:55:49.062 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32405.log 2024-09-14T11:55:49.063 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.70121.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.70121.log.gz 2024-09-14T11:55:49.063 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178630.log 2024-09-14T11:55:49.064 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32405.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32405.log.gz 2024-09-14T11:55:49.065 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71301.log 2024-09-14T11:55:49.065 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.178630.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178630.log.gz 2024-09-14T11:55:49.065 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76021.log 2024-09-14T11:55:49.066 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.71301.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.71301.log.gz 2024-09-14T11:55:49.067 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52129.log 2024-09-14T11:55:49.067 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.76021.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.76021.log.gz 2024-09-14T11:55:49.068 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32715.log 2024-09-14T11:55:49.068 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.52129.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52129.log.gz 2024-09-14T11:55:49.069 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139748.log 2024-09-14T11:55:49.069 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32715.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32715.log.gz 2024-09-14T11:55:49.070 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32739.log 2024-09-14T11:55:49.071 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.139748.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.139748.log.gz 2024-09-14T11:55:49.071 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159063.log 2024-09-14T11:55:49.072 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32739.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32739.log.gz 2024-09-14T11:55:49.072 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69425.log 2024-09-14T11:55:49.073 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.159063.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.159063.log.gz 2024-09-14T11:55:49.074 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181493.log 2024-09-14T11:55:49.075 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.69425.log: 80.3% -- replaced with /var/log/ceph/ceph-client.0.69425.log.gz 2024-09-14T11:55:49.075 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41359.log 2024-09-14T11:55:49.076 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.181493.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181493.log.gz 2024-09-14T11:55:49.076 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.41359.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41359.log.gz 2024-09-14T11:55:49.276 INFO:teuthology.orchestra.run.smithi157.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-14T11:55:49.601 INFO:teuthology.orchestra.run.smithi071.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-14T11:55:50.251 INFO:teuthology.orchestra.run.smithi071.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-14T11:55:50.304 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-14T11:55:50.304 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2024-09-14T11:55:50.304 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2024-09-14T11:55:51.662 INFO:teuthology.orchestra.run.smithi071.stderr: 93.4% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-14T11:55:55.805 INFO:teuthology.orchestra.run.smithi071.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-14T11:55:56.106 INFO:teuthology.orchestra.run.smithi157.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-14T11:55:56.181 INFO:teuthology.orchestra.run.smithi157.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-14T11:55:57.022 INFO:teuthology.orchestra.run.smithi071.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-14T11:55:59.692 INFO:teuthology.orchestra.run.smithi071.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-14T11:55:59.920 INFO:teuthology.orchestra.run.smithi157.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-14T11:56:04.113 INFO:teuthology.orchestra.run.smithi071.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-14T11:56:04.115 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-14T11:56:04.115 INFO:teuthology.orchestra.run.smithi071.stderr:real 0m15.736s 2024-09-14T11:56:04.115 INFO:teuthology.orchestra.run.smithi071.stderr:user 0m47.944s 2024-09-14T11:56:04.115 INFO:teuthology.orchestra.run.smithi071.stderr:sys 0m1.871s 2024-09-14T11:56:04.854 INFO:teuthology.orchestra.run.smithi157.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-14T11:56:04.855 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-09-14T11:56:04.855 INFO:teuthology.orchestra.run.smithi157.stderr:real 0m16.444s 2024-09-14T11:56:04.855 INFO:teuthology.orchestra.run.smithi157.stderr:user 0m42.641s 2024-09-14T11:56:04.855 INFO:teuthology.orchestra.run.smithi157.stderr:sys 0m1.609s 2024-09-14T11:56:04.856 INFO:tasks.ceph:Archiving logs... 2024-09-14T11:56:04.856 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904156/remote/smithi071/log 2024-09-14T11:56:04.857 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T11:56:10.129 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904156/remote/smithi157/log 2024-09-14T11:56:10.130 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T11:56:14.864 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-14T11:56:14.874 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-14T11:56:14.874 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T11:56:14.877 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T11:56:14.956 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-14T11:56:14.965 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-14T11:56:14.966 DEBUG:teuthology.orchestra.run.smithi071:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T11:56:14.968 DEBUG:teuthology.orchestra.run.smithi157:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T11:56:14.979 INFO:teuthology.orchestra.run.smithi071.stdout: remote refid st t when poll reach delay offset jitter 2024-09-14T11:56:14.979 INFO:teuthology.orchestra.run.smithi071.stdout:============================================================================== 2024-09-14T11:56:14.979 INFO:teuthology.orchestra.run.smithi071.stdout:+hv01.front.sepi 67.205.162.81 3 u 77 128 377 0.108 -5.479 0.610 2024-09-14T11:56:14.979 INFO:teuthology.orchestra.run.smithi071.stdout:*hv02.front.sepi 63.231.80.2 3 u 30 128 377 0.112 -5.620 0.957 2024-09-14T11:56:14.979 INFO:teuthology.orchestra.run.smithi071.stdout:+hv03.front.sepi 74.6.168.72 3 u 29 128 377 0.105 +6.773 0.762 2024-09-14T11:56:14.979 INFO:teuthology.orchestra.run.smithi071.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-14T11:56:14.982 INFO:teuthology.orchestra.run.smithi157.stdout: remote refid st t when poll reach delay offset jitter 2024-09-14T11:56:14.982 INFO:teuthology.orchestra.run.smithi157.stdout:============================================================================== 2024-09-14T11:56:14.982 INFO:teuthology.orchestra.run.smithi157.stdout:+hv01.front.sepi 67.205.162.81 3 u 85 128 377 0.099 -5.656 0.595 2024-09-14T11:56:14.982 INFO:teuthology.orchestra.run.smithi157.stdout:*hv02.front.sepi 63.231.80.2 3 u 39 128 377 0.120 -6.341 0.749 2024-09-14T11:56:14.982 INFO:teuthology.orchestra.run.smithi157.stdout:+hv03.front.sepi 74.6.168.72 3 u 87 128 377 0.098 +5.973 0.762 2024-09-14T11:56:14.982 INFO:teuthology.orchestra.run.smithi157.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-14T11:56:14.983 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-14T11:56:14.992 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-14T11:56:14.993 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-14T11:56:15.002 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-14T11:56:15.019 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-14T11:56:15.029 INFO:teuthology.task.internal:Duration was 3439.197958 seconds 2024-09-14T11:56:15.029 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-14T11:56:15.038 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-14T11:56:15.038 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T11:56:15.040 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T11:56:15.077 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-14T11:56:15.077 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi071.front.sepia.ceph.com 2024-09-14T11:56:15.077 DEBUG:teuthology.orchestra.run.smithi071:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T11:56:15.132 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi157.front.sepia.ceph.com 2024-09-14T11:56:15.132 DEBUG:teuthology.orchestra.run.smithi157:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T11:56:15.141 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-14T11:56:15.141 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T11:56:15.176 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T11:56:15.214 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-14T11:56:15.215 DEBUG:teuthology.orchestra.run.smithi071:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T11:56:15.244 DEBUG:teuthology.orchestra.run.smithi157:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T11:56:15.317 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-14T11:56:15.327 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-14T11:56:15.328 DEBUG:teuthology.orchestra.run.smithi071:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T11:56:15.339 DEBUG:teuthology.orchestra.run.smithi157:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T11:56:15.351 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-14T11:56:15.362 DEBUG:teuthology.orchestra.run.smithi071:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T11:56:15.383 DEBUG:teuthology.orchestra.run.smithi157:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T11:56:15.393 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = core 2024-09-14T11:56:15.404 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = core 2024-09-14T11:56:15.487 DEBUG:teuthology.orchestra.run.smithi071:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T11:56:15.491 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:56:15.492 DEBUG:teuthology.orchestra.run.smithi157:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T11:56:15.538 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:56:15.539 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-14T11:56:15.550 INFO:teuthology.task.internal:Transferring archived files... 2024-09-14T11:56:15.550 DEBUG:teuthology.misc:Transferring archived files from smithi071:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904156/remote/smithi071 2024-09-14T11:56:15.550 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T11:56:15.574 DEBUG:teuthology.misc:Transferring archived files from smithi157:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904156/remote/smithi157 2024-09-14T11:56:15.574 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T11:56:15.603 INFO:teuthology.task.internal:Removing archive directory... 2024-09-14T11:56:15.603 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T11:56:15.616 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T11:56:15.648 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-14T11:56:15.659 INFO:teuthology.task.internal:Not uploading archives. 2024-09-14T11:56:15.659 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-14T11:56:15.669 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-14T11:56:15.669 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T11:56:15.672 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T11:56:15.675 INFO:teuthology.orchestra.run.smithi071.stdout: 658621 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 11:56 /home/ubuntu/cephtest 2024-09-14T11:56:15.696 INFO:teuthology.orchestra.run.smithi157.stdout: 658641 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 11:56 /home/ubuntu/cephtest 2024-09-14T11:56:15.697 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-14T11:56:15.707 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-14T11:56:15.730 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} duration: 3439.197958469391 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-14T11:56:15.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T11:56:15.831 INFO:teuthology.run:pass